2026-02-17T10:54:49.743 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-17T10:54:49.761 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T10:54:49.841 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51248 branch: wip-bharath19-testing-2026-02-13-0903-squid description: rados/verify/{centos_latest ceph clusters/fixed-4 d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} email: skanta@redhat.com first_in_suite: false flavor: default job_id: '51248' kernel: branch: distro kdb: 1 sha1: distro last_in_suite: false machine_type: trial name: skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-bharath19-testing-2026-02-13-0903-squid ceph: conf: client: debug monc: 20 debug ms: 1 debug objecter: 20 debug rados: 20 global: mon client directed command retry: 5 mon election default strategy: 1 ms inject socket failures: 5000 ms type: async osd heartbeat grace: 160 osd op thread timeout: 150 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osd crush smoke test: false mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 mon scrub interval: 300 mon warn on pool no app: false paxos service trim min: 10 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true bluestore zero block detection: true debug bluefs: 1 debug bluestore: 1 debug monc: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd class default list: '*' osd class load list: '*' osd client watch timeout: 240 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd fast shutdown: false osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd memory target: 1610612736 osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - reached quota - overall HEALTH_ - \(CACHE_POOL_NO_HIT_SET\) - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(SLOW_OPS\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(OBJECT_MISPLACED\) - slow request - overall HEALTH_ - \(PG_ - \(MON_DOWN\) - \(SLOW_OPS\) - slow request - OSD bench result sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e stop-daemons-timeout: 1200 valgrind: mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes osd: - --tool=memcheck ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: debuginfo: true flavor: default sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-bharath19-testing-2026-02-13-0903-squid sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e owner: scheduled_skanta@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - osd.0 - osd.4 - osd.8 - osd.12 - - mon.b - osd.1 - osd.5 - osd.9 - osd.13 - - mon.c - osd.2 - osd.6 - osd.10 - osd.14 - - mgr.x - osd.3 - osd.7 - osd.11 - osd.15 - client.0 seed: 3603 sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-bharath19-testing-2026-02-13-0903-squid suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e targets: trial049.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJjYN4M7NWTYnJPmNG+2Xoiiufi+7/RYJ4P6pU1HzV8o/A6udGqDw6wYcMJDuCHkm/sw275aLThiTjZpmd6HYXg= trial097.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKPOjyd5Wlv1zY0q0agkiaMgL2X2x1JSS2ibcgzOY34afJj4Kojpm1tjTqlQHYrxZ32z/kp0naI37RvP7eLIgj4= trial157.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNAXNyW6k63X3r5MnE+xpVNto3790b7OTnzzrXfpNfiOs4ivH1PDnDg29dUQsHfNazBbv3JS7WAnBwhPxZqyOok= trial162.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBrW4Rt2QZ+kMjA6iyoN80YQt1vU5s/Zf1VPVDl/0A07VA6aJZR1mUcJOPqqpourj8hsXFaxvF8syIPkR6oJ3/c= tasks: - install: null - ceph: null - workunit: clients: client.0: - rados/test.sh env: ALLOW_TIMEOUTS: '1' timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - '-- Don''t run this test on tiny clusters if py_len(yaml.roles) < 4 then reject() end ' teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-17_04:03:08 tube: trial user: skanta verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682 2026-02-17T10:54:49.841 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa; will attempt to use it 2026-02-17T10:54:49.841 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks 2026-02-17T10:54:49.841 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-17T10:54:49.843 INFO:teuthology.task.internal:Checking packages... 2026-02-17T10:54:49.843 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e' 2026-02-17T10:54:49.843 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-17T10:54:49.843 INFO:teuthology.packaging:ref: None 2026-02-17T10:54:49.843 INFO:teuthology.packaging:tag: None 2026-02-17T10:54:49.843 INFO:teuthology.packaging:branch: wip-bharath19-testing-2026-02-13-0903-squid 2026-02-17T10:54:49.843 INFO:teuthology.packaging:sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-17T10:54:49.843 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-bharath19-testing-2026-02-13-0903-squid 2026-02-17T10:54:49.972 INFO:teuthology.task.internal:Found packages for ceph version 19.2.3-705.g04cf6dd4 2026-02-17T10:54:49.973 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-17T10:54:49.985 INFO:teuthology.task.internal:no buildpackages task found 2026-02-17T10:54:49.985 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-17T10:54:49.999 INFO:teuthology.task.internal:Saving configuration 2026-02-17T10:54:50.011 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-17T10:54:50.024 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-17T10:54:50.102 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial049.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51248', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-17 10:50:54.266016', 'locked_by': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJjYN4M7NWTYnJPmNG+2Xoiiufi+7/RYJ4P6pU1HzV8o/A6udGqDw6wYcMJDuCHkm/sw275aLThiTjZpmd6HYXg='} 2026-02-17T10:54:50.159 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial097.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51248', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-17 10:50:54.266839', 'locked_by': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKPOjyd5Wlv1zY0q0agkiaMgL2X2x1JSS2ibcgzOY34afJj4Kojpm1tjTqlQHYrxZ32z/kp0naI37RvP7eLIgj4='} 2026-02-17T10:54:50.215 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial157.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51248', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-17 10:50:54.265394', 'locked_by': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNAXNyW6k63X3r5MnE+xpVNto3790b7OTnzzrXfpNfiOs4ivH1PDnDg29dUQsHfNazBbv3JS7WAnBwhPxZqyOok='} 2026-02-17T10:54:50.271 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial162.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51248', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-17 10:50:54.266435', 'locked_by': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBrW4Rt2QZ+kMjA6iyoN80YQt1vU5s/Zf1VPVDl/0A07VA6aJZR1mUcJOPqqpourj8hsXFaxvF8syIPkR6oJ3/c='} 2026-02-17T10:54:50.271 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-17T10:54:50.283 INFO:teuthology.task.internal:roles: ubuntu@trial049.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'osd.0', 'osd.4', 'osd.8', 'osd.12'] 2026-02-17T10:54:50.283 INFO:teuthology.task.internal:roles: ubuntu@trial097.front.sepia.ceph.com - ['mon.b', 'osd.1', 'osd.5', 'osd.9', 'osd.13'] 2026-02-17T10:54:50.283 INFO:teuthology.task.internal:roles: ubuntu@trial157.front.sepia.ceph.com - ['mon.c', 'osd.2', 'osd.6', 'osd.10', 'osd.14'] 2026-02-17T10:54:50.283 INFO:teuthology.task.internal:roles: ubuntu@trial162.front.sepia.ceph.com - ['mgr.x', 'osd.3', 'osd.7', 'osd.11', 'osd.15', 'client.0'] 2026-02-17T10:54:50.283 INFO:teuthology.run_tasks:Running task console_log... 2026-02-17T10:54:50.533 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x71aae55cb880>, signals=[15]) 2026-02-17T10:54:50.533 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-17T10:54:50.544 INFO:teuthology.task.internal:Opening connections... 2026-02-17T10:54:50.544 DEBUG:teuthology.task.internal:connecting to ubuntu@trial049.front.sepia.ceph.com 2026-02-17T10:54:50.545 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T10:54:50.607 DEBUG:teuthology.task.internal:connecting to ubuntu@trial097.front.sepia.ceph.com 2026-02-17T10:54:50.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T10:54:50.671 DEBUG:teuthology.task.internal:connecting to ubuntu@trial157.front.sepia.ceph.com 2026-02-17T10:54:50.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T10:54:50.736 DEBUG:teuthology.task.internal:connecting to ubuntu@trial162.front.sepia.ceph.com 2026-02-17T10:54:50.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T10:54:50.800 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-17T10:54:50.812 DEBUG:teuthology.orchestra.run.trial049:> uname -m 2026-02-17T10:54:50.828 INFO:teuthology.orchestra.run.trial049.stdout:x86_64 2026-02-17T10:54:50.829 DEBUG:teuthology.orchestra.run.trial049:> cat /etc/os-release 2026-02-17T10:54:50.884 INFO:teuthology.orchestra.run.trial049.stdout:NAME="CentOS Stream" 2026-02-17T10:54:50.884 INFO:teuthology.orchestra.run.trial049.stdout:VERSION="9" 2026-02-17T10:54:50.884 INFO:teuthology.orchestra.run.trial049.stdout:ID="centos" 2026-02-17T10:54:50.884 INFO:teuthology.orchestra.run.trial049.stdout:ID_LIKE="rhel fedora" 2026-02-17T10:54:50.884 INFO:teuthology.orchestra.run.trial049.stdout:VERSION_ID="9" 2026-02-17T10:54:50.884 INFO:teuthology.orchestra.run.trial049.stdout:PLATFORM_ID="platform:el9" 2026-02-17T10:54:50.884 INFO:teuthology.orchestra.run.trial049.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-17T10:54:50.884 INFO:teuthology.orchestra.run.trial049.stdout:ANSI_COLOR="0;31" 2026-02-17T10:54:50.884 INFO:teuthology.orchestra.run.trial049.stdout:LOGO="fedora-logo-icon" 2026-02-17T10:54:50.884 INFO:teuthology.orchestra.run.trial049.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-17T10:54:50.884 INFO:teuthology.orchestra.run.trial049.stdout:HOME_URL="https://centos.org/" 2026-02-17T10:54:50.884 INFO:teuthology.orchestra.run.trial049.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-17T10:54:50.884 INFO:teuthology.orchestra.run.trial049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-17T10:54:50.884 INFO:teuthology.orchestra.run.trial049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-17T10:54:50.885 INFO:teuthology.lock.ops:Updating trial049.front.sepia.ceph.com on lock server 2026-02-17T10:54:50.960 DEBUG:teuthology.orchestra.run.trial097:> uname -m 2026-02-17T10:54:50.976 INFO:teuthology.orchestra.run.trial097.stdout:x86_64 2026-02-17T10:54:50.976 DEBUG:teuthology.orchestra.run.trial097:> cat /etc/os-release 2026-02-17T10:54:51.031 INFO:teuthology.orchestra.run.trial097.stdout:NAME="CentOS Stream" 2026-02-17T10:54:51.031 INFO:teuthology.orchestra.run.trial097.stdout:VERSION="9" 2026-02-17T10:54:51.031 INFO:teuthology.orchestra.run.trial097.stdout:ID="centos" 2026-02-17T10:54:51.031 INFO:teuthology.orchestra.run.trial097.stdout:ID_LIKE="rhel fedora" 2026-02-17T10:54:51.031 INFO:teuthology.orchestra.run.trial097.stdout:VERSION_ID="9" 2026-02-17T10:54:51.031 INFO:teuthology.orchestra.run.trial097.stdout:PLATFORM_ID="platform:el9" 2026-02-17T10:54:51.031 INFO:teuthology.orchestra.run.trial097.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-17T10:54:51.031 INFO:teuthology.orchestra.run.trial097.stdout:ANSI_COLOR="0;31" 2026-02-17T10:54:51.031 INFO:teuthology.orchestra.run.trial097.stdout:LOGO="fedora-logo-icon" 2026-02-17T10:54:51.032 INFO:teuthology.orchestra.run.trial097.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-17T10:54:51.032 INFO:teuthology.orchestra.run.trial097.stdout:HOME_URL="https://centos.org/" 2026-02-17T10:54:51.032 INFO:teuthology.orchestra.run.trial097.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-17T10:54:51.032 INFO:teuthology.orchestra.run.trial097.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-17T10:54:51.032 INFO:teuthology.orchestra.run.trial097.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-17T10:54:51.032 INFO:teuthology.lock.ops:Updating trial097.front.sepia.ceph.com on lock server 2026-02-17T10:54:51.107 DEBUG:teuthology.orchestra.run.trial157:> uname -m 2026-02-17T10:54:51.124 INFO:teuthology.orchestra.run.trial157.stdout:x86_64 2026-02-17T10:54:51.124 DEBUG:teuthology.orchestra.run.trial157:> cat /etc/os-release 2026-02-17T10:54:51.179 INFO:teuthology.orchestra.run.trial157.stdout:NAME="CentOS Stream" 2026-02-17T10:54:51.179 INFO:teuthology.orchestra.run.trial157.stdout:VERSION="9" 2026-02-17T10:54:51.179 INFO:teuthology.orchestra.run.trial157.stdout:ID="centos" 2026-02-17T10:54:51.179 INFO:teuthology.orchestra.run.trial157.stdout:ID_LIKE="rhel fedora" 2026-02-17T10:54:51.179 INFO:teuthology.orchestra.run.trial157.stdout:VERSION_ID="9" 2026-02-17T10:54:51.179 INFO:teuthology.orchestra.run.trial157.stdout:PLATFORM_ID="platform:el9" 2026-02-17T10:54:51.179 INFO:teuthology.orchestra.run.trial157.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-17T10:54:51.179 INFO:teuthology.orchestra.run.trial157.stdout:ANSI_COLOR="0;31" 2026-02-17T10:54:51.179 INFO:teuthology.orchestra.run.trial157.stdout:LOGO="fedora-logo-icon" 2026-02-17T10:54:51.179 INFO:teuthology.orchestra.run.trial157.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-17T10:54:51.179 INFO:teuthology.orchestra.run.trial157.stdout:HOME_URL="https://centos.org/" 2026-02-17T10:54:51.179 INFO:teuthology.orchestra.run.trial157.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-17T10:54:51.179 INFO:teuthology.orchestra.run.trial157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-17T10:54:51.179 INFO:teuthology.orchestra.run.trial157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-17T10:54:51.179 INFO:teuthology.lock.ops:Updating trial157.front.sepia.ceph.com on lock server 2026-02-17T10:54:51.239 DEBUG:teuthology.orchestra.run.trial162:> uname -m 2026-02-17T10:54:51.256 INFO:teuthology.orchestra.run.trial162.stdout:x86_64 2026-02-17T10:54:51.256 DEBUG:teuthology.orchestra.run.trial162:> cat /etc/os-release 2026-02-17T10:54:51.314 INFO:teuthology.orchestra.run.trial162.stdout:NAME="CentOS Stream" 2026-02-17T10:54:51.314 INFO:teuthology.orchestra.run.trial162.stdout:VERSION="9" 2026-02-17T10:54:51.314 INFO:teuthology.orchestra.run.trial162.stdout:ID="centos" 2026-02-17T10:54:51.314 INFO:teuthology.orchestra.run.trial162.stdout:ID_LIKE="rhel fedora" 2026-02-17T10:54:51.314 INFO:teuthology.orchestra.run.trial162.stdout:VERSION_ID="9" 2026-02-17T10:54:51.314 INFO:teuthology.orchestra.run.trial162.stdout:PLATFORM_ID="platform:el9" 2026-02-17T10:54:51.314 INFO:teuthology.orchestra.run.trial162.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-17T10:54:51.314 INFO:teuthology.orchestra.run.trial162.stdout:ANSI_COLOR="0;31" 2026-02-17T10:54:51.314 INFO:teuthology.orchestra.run.trial162.stdout:LOGO="fedora-logo-icon" 2026-02-17T10:54:51.314 INFO:teuthology.orchestra.run.trial162.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-17T10:54:51.315 INFO:teuthology.orchestra.run.trial162.stdout:HOME_URL="https://centos.org/" 2026-02-17T10:54:51.315 INFO:teuthology.orchestra.run.trial162.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-17T10:54:51.315 INFO:teuthology.orchestra.run.trial162.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-17T10:54:51.315 INFO:teuthology.orchestra.run.trial162.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-17T10:54:51.315 INFO:teuthology.lock.ops:Updating trial162.front.sepia.ceph.com on lock server 2026-02-17T10:54:51.396 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-17T10:54:51.409 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-17T10:54:51.421 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-17T10:54:51.421 DEBUG:teuthology.orchestra.run.trial049:> test '!' -e /home/ubuntu/cephtest 2026-02-17T10:54:51.423 DEBUG:teuthology.orchestra.run.trial097:> test '!' -e /home/ubuntu/cephtest 2026-02-17T10:54:51.424 DEBUG:teuthology.orchestra.run.trial157:> test '!' -e /home/ubuntu/cephtest 2026-02-17T10:54:51.426 DEBUG:teuthology.orchestra.run.trial162:> test '!' -e /home/ubuntu/cephtest 2026-02-17T10:54:51.443 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-17T10:54:51.453 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-17T10:54:51.453 DEBUG:teuthology.orchestra.run.trial049:> test -z $(ls -A /var/lib/ceph) 2026-02-17T10:54:51.480 DEBUG:teuthology.orchestra.run.trial097:> test -z $(ls -A /var/lib/ceph) 2026-02-17T10:54:51.483 DEBUG:teuthology.orchestra.run.trial157:> test -z $(ls -A /var/lib/ceph) 2026-02-17T10:54:51.485 DEBUG:teuthology.orchestra.run.trial162:> test -z $(ls -A /var/lib/ceph) 2026-02-17T10:54:51.504 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-17T10:54:52.840 INFO:teuthology.run_tasks:Running task kernel... 2026-02-17T10:54:52.861 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-17T10:54:52.861 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'mon.c': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-17T10:54:52.862 DEBUG:teuthology.orchestra.run.trial049:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-17T10:54:52.863 DEBUG:teuthology.orchestra.run.trial097:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-17T10:54:52.863 DEBUG:teuthology.orchestra.run.trial157:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-17T10:54:52.863 DEBUG:teuthology.orchestra.run.trial162:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-17T10:54:52.879 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T10:54:52.880 DEBUG:teuthology.orchestra.run.trial097:> uname -r 2026-02-17T10:54:52.881 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T10:54:52.881 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T10:54:52.882 DEBUG:teuthology.orchestra.run.trial157:> uname -r 2026-02-17T10:54:52.882 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-17T10:54:52.883 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T10:54:52.883 DEBUG:teuthology.orchestra.run.trial162:> uname -r 2026-02-17T10:54:52.936 INFO:teuthology.orchestra.run.trial097.stdout:5.14.0-645.el9.x86_64 2026-02-17T10:54:52.936 INFO:teuthology.task.kernel:Running kernel on trial097: 5.14.0-645.el9.x86_64 2026-02-17T10:54:52.937 DEBUG:teuthology.orchestra.run.trial097:> sudo yum install -y kernel 2026-02-17T10:54:52.939 INFO:teuthology.orchestra.run.trial049.stdout:5.14.0-645.el9.x86_64 2026-02-17T10:54:52.940 INFO:teuthology.task.kernel:Running kernel on trial049: 5.14.0-645.el9.x86_64 2026-02-17T10:54:52.940 DEBUG:teuthology.orchestra.run.trial049:> sudo yum install -y kernel 2026-02-17T10:54:52.942 INFO:teuthology.orchestra.run.trial162.stdout:5.14.0-645.el9.x86_64 2026-02-17T10:54:52.942 INFO:teuthology.orchestra.run.trial157.stdout:5.14.0-645.el9.x86_64 2026-02-17T10:54:52.942 INFO:teuthology.task.kernel:Running kernel on trial162: 5.14.0-645.el9.x86_64 2026-02-17T10:54:52.942 DEBUG:teuthology.orchestra.run.trial162:> sudo yum install -y kernel 2026-02-17T10:54:52.943 INFO:teuthology.task.kernel:Running kernel on trial157: 5.14.0-645.el9.x86_64 2026-02-17T10:54:52.943 DEBUG:teuthology.orchestra.run.trial157:> sudo yum install -y kernel 2026-02-17T10:54:54.159 INFO:teuthology.orchestra.run.trial097.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.9 MB 00:00 2026-02-17T10:54:54.310 INFO:teuthology.orchestra.run.trial162.stdout:CentOS Stream 9 - BaseOS 8.8 MB/s | 8.9 MB 00:01 2026-02-17T10:54:54.550 INFO:teuthology.orchestra.run.trial157.stdout:CentOS Stream 9 - BaseOS 7.1 MB/s | 8.9 MB 00:01 2026-02-17T10:54:55.050 INFO:teuthology.orchestra.run.trial097.stdout:CentOS Stream 9 - AppStream 74 MB/s | 27 MB 00:00 2026-02-17T10:54:57.329 INFO:teuthology.orchestra.run.trial162.stdout:CentOS Stream 9 - AppStream 11 MB/s | 27 MB 00:02 2026-02-17T10:54:57.884 INFO:teuthology.orchestra.run.trial097.stdout:CentOS Stream 9 - CRB 16 MB/s | 7.8 MB 00:00 2026-02-17T10:54:58.835 INFO:teuthology.orchestra.run.trial097.stdout:CentOS Stream 9 - Extras packages 93 kB/s | 20 kB 00:00 2026-02-17T10:55:00.173 INFO:teuthology.orchestra.run.trial097.stdout:Extra Packages for Enterprise Linux 16 MB/s | 20 MB 00:01 2026-02-17T10:55:00.779 INFO:teuthology.orchestra.run.trial162.stdout:CentOS Stream 9 - CRB 7.7 MB/s | 7.8 MB 00:01 2026-02-17T10:55:01.628 INFO:teuthology.orchestra.run.trial162.stdout:CentOS Stream 9 - Extras packages 183 kB/s | 20 kB 00:00 2026-02-17T10:55:01.853 INFO:teuthology.orchestra.run.trial049.stdout:CentOS Stream 9 - BaseOS 1.0 MB/s | 8.9 MB 00:08 2026-02-17T10:55:02.768 INFO:teuthology.orchestra.run.trial162.stdout:Extra Packages for Enterprise Linux 19 MB/s | 20 MB 00:01 2026-02-17T10:55:03.359 INFO:teuthology.orchestra.run.trial097.stdout:lab-extras 740 kB/s | 50 kB 00:00 2026-02-17T10:55:04.376 INFO:teuthology.orchestra.run.trial097.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-17T10:55:04.396 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-17T10:55:04.397 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T10:55:04.397 INFO:teuthology.orchestra.run.trial097.stdout: Package Architecture Version Repository Size 2026-02-17T10:55:04.398 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T10:55:04.398 INFO:teuthology.orchestra.run.trial097.stdout:Installing: 2026-02-17T10:55:04.398 INFO:teuthology.orchestra.run.trial097.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-17T10:55:04.398 INFO:teuthology.orchestra.run.trial097.stdout:Installing dependencies: 2026-02-17T10:55:04.398 INFO:teuthology.orchestra.run.trial097.stdout: kernel-core x86_64 5.14.0-681.el9 baseos 17 M 2026-02-17T10:55:04.398 INFO:teuthology.orchestra.run.trial097.stdout: kernel-modules x86_64 5.14.0-681.el9 baseos 40 M 2026-02-17T10:55:04.398 INFO:teuthology.orchestra.run.trial097.stdout: kernel-modules-core x86_64 5.14.0-681.el9 baseos 31 M 2026-02-17T10:55:04.398 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T10:55:04.398 INFO:teuthology.orchestra.run.trial097.stdout:Transaction Summary 2026-02-17T10:55:04.398 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T10:55:04.398 INFO:teuthology.orchestra.run.trial097.stdout:Install 4 Packages 2026-02-17T10:55:04.399 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T10:55:04.399 INFO:teuthology.orchestra.run.trial097.stdout:Total download size: 88 M 2026-02-17T10:55:04.399 INFO:teuthology.orchestra.run.trial097.stdout:Installed size: 135 M 2026-02-17T10:55:04.399 INFO:teuthology.orchestra.run.trial097.stdout:Downloading Packages: 2026-02-17T10:55:05.183 INFO:teuthology.orchestra.run.trial049.stdout:CentOS Stream 9 - AppStream 9.6 MB/s | 27 MB 00:02 2026-02-17T10:55:05.958 INFO:teuthology.orchestra.run.trial162.stdout:lab-extras 2.5 MB/s | 50 kB 00:00 2026-02-17T10:55:06.273 INFO:teuthology.orchestra.run.trial097.stdout:(1/4): kernel-5.14.0-681.el9.x86_64.rpm 514 kB/s | 803 kB 00:01 2026-02-17T10:55:06.981 INFO:teuthology.orchestra.run.trial162.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-17T10:55:07.001 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T10:55:07.002 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T10:55:07.003 INFO:teuthology.orchestra.run.trial162.stdout: Package Architecture Version Repository Size 2026-02-17T10:55:07.003 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T10:55:07.003 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-17T10:55:07.003 INFO:teuthology.orchestra.run.trial162.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-17T10:55:07.003 INFO:teuthology.orchestra.run.trial162.stdout:Installing dependencies: 2026-02-17T10:55:07.003 INFO:teuthology.orchestra.run.trial162.stdout: kernel-core x86_64 5.14.0-681.el9 baseos 17 M 2026-02-17T10:55:07.003 INFO:teuthology.orchestra.run.trial162.stdout: kernel-modules x86_64 5.14.0-681.el9 baseos 40 M 2026-02-17T10:55:07.003 INFO:teuthology.orchestra.run.trial162.stdout: kernel-modules-core x86_64 5.14.0-681.el9 baseos 31 M 2026-02-17T10:55:07.003 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T10:55:07.003 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-17T10:55:07.004 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T10:55:07.004 INFO:teuthology.orchestra.run.trial162.stdout:Install 4 Packages 2026-02-17T10:55:07.004 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T10:55:07.004 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 88 M 2026-02-17T10:55:07.004 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 135 M 2026-02-17T10:55:07.004 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-17T10:55:08.479 INFO:teuthology.orchestra.run.trial049.stdout:CentOS Stream 9 - CRB 8.6 MB/s | 7.8 MB 00:00 2026-02-17T10:55:08.534 INFO:teuthology.orchestra.run.trial162.stdout:(1/4): kernel-5.14.0-681.el9.x86_64.rpm 558 kB/s | 803 kB 00:01 2026-02-17T10:55:10.253 INFO:teuthology.orchestra.run.trial049.stdout:CentOS Stream 9 - Extras packages 20 kB/s | 20 kB 00:01 2026-02-17T10:55:12.293 INFO:teuthology.orchestra.run.trial049.stdout:Extra Packages for Enterprise Linux 10 MB/s | 20 MB 00:01 2026-02-17T10:55:15.501 INFO:teuthology.orchestra.run.trial049.stdout:lab-extras 1.8 MB/s | 50 kB 00:00 2026-02-17T10:55:16.514 INFO:teuthology.orchestra.run.trial049.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-17T10:55:16.534 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-17T10:55:16.534 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T10:55:16.535 INFO:teuthology.orchestra.run.trial049.stdout: Package Architecture Version Repository Size 2026-02-17T10:55:16.535 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T10:55:16.535 INFO:teuthology.orchestra.run.trial049.stdout:Installing: 2026-02-17T10:55:16.535 INFO:teuthology.orchestra.run.trial049.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-17T10:55:16.535 INFO:teuthology.orchestra.run.trial049.stdout:Installing dependencies: 2026-02-17T10:55:16.535 INFO:teuthology.orchestra.run.trial049.stdout: kernel-core x86_64 5.14.0-681.el9 baseos 17 M 2026-02-17T10:55:16.535 INFO:teuthology.orchestra.run.trial049.stdout: kernel-modules x86_64 5.14.0-681.el9 baseos 40 M 2026-02-17T10:55:16.535 INFO:teuthology.orchestra.run.trial049.stdout: kernel-modules-core x86_64 5.14.0-681.el9 baseos 31 M 2026-02-17T10:55:16.535 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T10:55:16.535 INFO:teuthology.orchestra.run.trial049.stdout:Transaction Summary 2026-02-17T10:55:16.535 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T10:55:16.535 INFO:teuthology.orchestra.run.trial049.stdout:Install 4 Packages 2026-02-17T10:55:16.535 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T10:55:16.535 INFO:teuthology.orchestra.run.trial049.stdout:Total download size: 88 M 2026-02-17T10:55:16.535 INFO:teuthology.orchestra.run.trial049.stdout:Installed size: 135 M 2026-02-17T10:55:16.535 INFO:teuthology.orchestra.run.trial049.stdout:Downloading Packages: 2026-02-17T10:55:17.001 INFO:teuthology.orchestra.run.trial049.stdout:(1/4): kernel-5.14.0-681.el9.x86_64.rpm 4.9 MB/s | 803 kB 00:00 2026-02-17T10:55:17.440 INFO:teuthology.orchestra.run.trial049.stdout:(2/4): kernel-modules-core-5.14.0-681.el9.x86_6 70 MB/s | 31 MB 00:00 2026-02-17T10:55:17.530 INFO:teuthology.orchestra.run.trial049.stdout:(3/4): kernel-core-5.14.0-681.el9.x86_64.rpm 25 MB/s | 17 MB 00:00 2026-02-17T10:55:17.879 INFO:teuthology.orchestra.run.trial049.stdout:(4/4): kernel-modules-5.14.0-681.el9.x86_64.rpm 38 MB/s | 40 MB 00:01 2026-02-17T10:55:17.880 INFO:teuthology.orchestra.run.trial049.stdout:-------------------------------------------------------------------------------- 2026-02-17T10:55:17.880 INFO:teuthology.orchestra.run.trial049.stdout:Total 66 MB/s | 88 MB 00:01 2026-02-17T10:55:18.071 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction check 2026-02-17T10:55:18.275 INFO:teuthology.orchestra.run.trial049.stdout:Transaction check succeeded. 2026-02-17T10:55:18.275 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction test 2026-02-17T10:55:18.622 INFO:teuthology.orchestra.run.trial049.stdout:Transaction test succeeded. 2026-02-17T10:55:18.623 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction 2026-02-17T10:55:18.871 INFO:teuthology.orchestra.run.trial097.stdout:(2/4): kernel-core-5.14.0-681.el9.x86_64.rpm 1.2 MB/s | 17 MB 00:14 2026-02-17T10:55:19.712 INFO:teuthology.orchestra.run.trial049.stdout: Preparing : 1/1 2026-02-17T10:55:19.994 INFO:teuthology.orchestra.run.trial049.stdout: Installing : kernel-modules-core-5.14.0-681.el9.x86_64 1/4 2026-02-17T10:55:20.013 INFO:teuthology.orchestra.run.trial049.stdout: Installing : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T10:55:21.788 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T10:55:21.816 INFO:teuthology.orchestra.run.trial049.stdout: Installing : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T10:55:23.024 INFO:teuthology.orchestra.run.trial157.stdout:CentOS Stream 9 - AppStream 982 kB/s | 27 MB 00:27 2026-02-17T10:55:24.837 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T10:55:24.843 INFO:teuthology.orchestra.run.trial049.stdout: Installing : kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T10:55:25.761 INFO:teuthology.orchestra.run.trial157.stdout:CentOS Stream 9 - CRB 21 MB/s | 7.8 MB 00:00 2026-02-17T10:55:26.565 INFO:teuthology.orchestra.run.trial157.stdout:CentOS Stream 9 - Extras packages 249 kB/s | 20 kB 00:00 2026-02-17T10:55:27.230 INFO:teuthology.orchestra.run.trial157.stdout:Extra Packages for Enterprise Linux 34 MB/s | 20 MB 00:00 2026-02-17T10:55:27.872 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T10:55:28.087 INFO:teuthology.orchestra.run.trial162.stdout:(2/4): kernel-core-5.14.0-681.el9.x86_64.rpm 833 kB/s | 17 MB 00:20 2026-02-17T10:55:30.461 INFO:teuthology.orchestra.run.trial157.stdout:lab-extras 1.3 MB/s | 50 kB 00:00 2026-02-17T10:55:31.481 INFO:teuthology.orchestra.run.trial157.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-17T10:55:31.501 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-17T10:55:31.502 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T10:55:31.502 INFO:teuthology.orchestra.run.trial157.stdout: Package Architecture Version Repository Size 2026-02-17T10:55:31.502 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T10:55:31.502 INFO:teuthology.orchestra.run.trial157.stdout:Installing: 2026-02-17T10:55:31.503 INFO:teuthology.orchestra.run.trial157.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-17T10:55:31.503 INFO:teuthology.orchestra.run.trial157.stdout:Installing dependencies: 2026-02-17T10:55:31.503 INFO:teuthology.orchestra.run.trial157.stdout: kernel-core x86_64 5.14.0-681.el9 baseos 17 M 2026-02-17T10:55:31.503 INFO:teuthology.orchestra.run.trial157.stdout: kernel-modules x86_64 5.14.0-681.el9 baseos 40 M 2026-02-17T10:55:31.503 INFO:teuthology.orchestra.run.trial157.stdout: kernel-modules-core x86_64 5.14.0-681.el9 baseos 31 M 2026-02-17T10:55:31.503 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T10:55:31.503 INFO:teuthology.orchestra.run.trial157.stdout:Transaction Summary 2026-02-17T10:55:31.503 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T10:55:31.503 INFO:teuthology.orchestra.run.trial157.stdout:Install 4 Packages 2026-02-17T10:55:31.503 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T10:55:31.503 INFO:teuthology.orchestra.run.trial157.stdout:Total download size: 88 M 2026-02-17T10:55:31.504 INFO:teuthology.orchestra.run.trial157.stdout:Installed size: 135 M 2026-02-17T10:55:31.504 INFO:teuthology.orchestra.run.trial157.stdout:Downloading Packages: 2026-02-17T10:55:32.230 INFO:teuthology.orchestra.run.trial157.stdout:(1/4): kernel-5.14.0-681.el9.x86_64.rpm 1.2 MB/s | 803 kB 00:00 2026-02-17T10:55:32.808 INFO:teuthology.orchestra.run.trial157.stdout:(2/4): kernel-core-5.14.0-681.el9.x86_64.rpm 14 MB/s | 17 MB 00:01 2026-02-17T10:55:33.281 INFO:teuthology.orchestra.run.trial157.stdout:(3/4): kernel-modules-core-5.14.0-681.el9.x86_6 29 MB/s | 31 MB 00:01 2026-02-17T10:55:33.455 INFO:teuthology.orchestra.run.trial157.stdout:(4/4): kernel-modules-5.14.0-681.el9.x86_64.rpm 21 MB/s | 40 MB 00:01 2026-02-17T10:55:33.455 INFO:teuthology.orchestra.run.trial157.stdout:-------------------------------------------------------------------------------- 2026-02-17T10:55:33.455 INFO:teuthology.orchestra.run.trial157.stdout:Total 45 MB/s | 88 MB 00:01 2026-02-17T10:55:33.643 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction check 2026-02-17T10:55:33.855 INFO:teuthology.orchestra.run.trial157.stdout:Transaction check succeeded. 2026-02-17T10:55:33.856 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction test 2026-02-17T10:55:34.203 INFO:teuthology.orchestra.run.trial157.stdout:Transaction test succeeded. 2026-02-17T10:55:34.204 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction 2026-02-17T10:55:35.295 INFO:teuthology.orchestra.run.trial157.stdout: Preparing : 1/1 2026-02-17T10:55:35.577 INFO:teuthology.orchestra.run.trial157.stdout: Installing : kernel-modules-core-5.14.0-681.el9.x86_64 1/4 2026-02-17T10:55:35.596 INFO:teuthology.orchestra.run.trial157.stdout: Installing : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T10:55:37.382 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T10:55:37.411 INFO:teuthology.orchestra.run.trial157.stdout: Installing : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T10:55:38.474 INFO:teuthology.orchestra.run.trial097.stdout:(3/4): kernel-modules-core-5.14.0-681.el9.x86_6 981 kB/s | 31 MB 00:32 2026-02-17T10:55:40.434 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T10:55:40.440 INFO:teuthology.orchestra.run.trial157.stdout: Installing : kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T10:55:43.468 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T10:55:45.260 INFO:teuthology.orchestra.run.trial162.stdout:(3/4): kernel-modules-core-5.14.0-681.el9.x86_6 860 kB/s | 31 MB 00:36 2026-02-17T10:55:52.431 INFO:teuthology.orchestra.run.trial097.stdout:(4/4): kernel-modules-5.14.0-681.el9.x86_64.rpm 849 kB/s | 40 MB 00:47 2026-02-17T10:55:52.432 INFO:teuthology.orchestra.run.trial097.stdout:-------------------------------------------------------------------------------- 2026-02-17T10:55:52.433 INFO:teuthology.orchestra.run.trial097.stdout:Total 1.8 MB/s | 88 MB 00:48 2026-02-17T10:55:52.622 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction check 2026-02-17T10:55:52.839 INFO:teuthology.orchestra.run.trial097.stdout:Transaction check succeeded. 2026-02-17T10:55:52.839 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction test 2026-02-17T10:55:53.186 INFO:teuthology.orchestra.run.trial097.stdout:Transaction test succeeded. 2026-02-17T10:55:53.186 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction 2026-02-17T10:55:54.276 INFO:teuthology.orchestra.run.trial097.stdout: Preparing : 1/1 2026-02-17T10:55:54.403 INFO:teuthology.orchestra.run.trial162.stdout:(4/4): kernel-modules-5.14.0-681.el9.x86_64.rpm 857 kB/s | 40 MB 00:47 2026-02-17T10:55:54.405 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-17T10:55:54.405 INFO:teuthology.orchestra.run.trial162.stdout:Total 1.9 MB/s | 88 MB 00:47 2026-02-17T10:55:54.560 INFO:teuthology.orchestra.run.trial097.stdout: Installing : kernel-modules-core-5.14.0-681.el9.x86_64 1/4 2026-02-17T10:55:54.579 INFO:teuthology.orchestra.run.trial097.stdout: Installing : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T10:55:54.594 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-17T10:55:54.802 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-17T10:55:54.802 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-17T10:55:55.147 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-17T10:55:55.148 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-17T10:55:56.230 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-17T10:55:56.364 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T10:55:56.393 INFO:teuthology.orchestra.run.trial097.stdout: Installing : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T10:55:56.517 INFO:teuthology.orchestra.run.trial162.stdout: Installing : kernel-modules-core-5.14.0-681.el9.x86_64 1/4 2026-02-17T10:55:56.536 INFO:teuthology.orchestra.run.trial162.stdout: Installing : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T10:55:58.116 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T10:55:58.137 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 4/4 2026-02-17T10:55:58.308 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T10:55:58.308 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/4 2026-02-17T10:55:58.308 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T10:55:58.308 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T10:55:58.327 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T10:55:58.355 INFO:teuthology.orchestra.run.trial162.stdout: Installing : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T10:55:58.359 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T10:55:58.359 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T10:55:58.359 INFO:teuthology.orchestra.run.trial049.stdout:Installed: 2026-02-17T10:55:58.359 INFO:teuthology.orchestra.run.trial049.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-17T10:55:58.359 INFO:teuthology.orchestra.run.trial049.stdout: kernel-core-5.14.0-681.el9.x86_64 2026-02-17T10:55:58.359 INFO:teuthology.orchestra.run.trial049.stdout: kernel-modules-5.14.0-681.el9.x86_64 2026-02-17T10:55:58.359 INFO:teuthology.orchestra.run.trial049.stdout: kernel-modules-core-5.14.0-681.el9.x86_64 2026-02-17T10:55:58.359 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T10:55:58.359 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-17T10:55:58.416 DEBUG:teuthology.orchestra.run.trial049:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T10:55:58.443 INFO:teuthology.orchestra.run.trial049.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T10:55:58.443 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T10:55:58.443 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-681.el9.x86_64 2026-02-17T10:55:58.443 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-17T10:55:58.444 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-17T10:55:58.444 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-17T10:55:58.444 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial049.front.sepia.ceph.com, path=None, version=distro) 2026-02-17T10:55:58.444 DEBUG:teuthology.orchestra.run.trial049:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T10:55:58.505 INFO:teuthology.orchestra.run.trial049.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T10:55:58.507 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T10:55:58.507 DEBUG:teuthology.orchestra.run.trial049:> sudo rpm -qi grub2-tools 2026-02-17T10:55:58.575 INFO:teuthology.orchestra.run.trial049.stdout:Name : grub2-tools 2026-02-17T10:55:58.575 INFO:teuthology.orchestra.run.trial049.stdout:Epoch : 1 2026-02-17T10:55:58.575 INFO:teuthology.orchestra.run.trial049.stdout:Version : 2.06 2026-02-17T10:55:58.576 INFO:teuthology.orchestra.run.trial049.stdout:Release : 118.el9 2026-02-17T10:55:58.576 INFO:teuthology.orchestra.run.trial049.stdout:Architecture: x86_64 2026-02-17T10:55:58.576 INFO:teuthology.orchestra.run.trial049.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-17T10:55:58.576 INFO:teuthology.orchestra.run.trial049.stdout:Group : Unspecified 2026-02-17T10:55:58.576 INFO:teuthology.orchestra.run.trial049.stdout:Size : 8393909 2026-02-17T10:55:58.576 INFO:teuthology.orchestra.run.trial049.stdout:License : GPLv3+ 2026-02-17T10:55:58.576 INFO:teuthology.orchestra.run.trial049.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-17T10:55:58.576 INFO:teuthology.orchestra.run.trial049.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-17T10:55:58.576 INFO:teuthology.orchestra.run.trial049.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-17T10:55:58.576 INFO:teuthology.orchestra.run.trial049.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-17T10:55:58.576 INFO:teuthology.orchestra.run.trial049.stdout:Packager : builder@centos.org 2026-02-17T10:55:58.576 INFO:teuthology.orchestra.run.trial049.stdout:Vendor : CentOS 2026-02-17T10:55:58.577 INFO:teuthology.orchestra.run.trial049.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-17T10:55:58.577 INFO:teuthology.orchestra.run.trial049.stdout:Summary : Support tools for GRUB. 2026-02-17T10:55:58.577 INFO:teuthology.orchestra.run.trial049.stdout:Description : 2026-02-17T10:55:58.577 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T10:55:58.577 INFO:teuthology.orchestra.run.trial049.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-17T10:55:58.577 INFO:teuthology.orchestra.run.trial049.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-17T10:55:58.577 INFO:teuthology.orchestra.run.trial049.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-17T10:55:58.577 INFO:teuthology.orchestra.run.trial049.stdout:hardware devices. 2026-02-17T10:55:58.577 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T10:55:58.577 INFO:teuthology.orchestra.run.trial049.stdout:This subpackage provides tools for support of all platforms. 2026-02-17T10:55:58.578 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-17T10:55:58.579 INFO:teuthology.task.kernel:Updating grub on trial049 to boot 5.14.0-681.el9.x86_64 2026-02-17T10:55:58.579 DEBUG:teuthology.orchestra.run.trial049:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-17T10:55:58.643 INFO:teuthology.orchestra.run.trial049.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T10:55:58.644 DEBUG:teuthology.orchestra.run.trial049:> sudo command -v grubby && echo yes || echo no 2026-02-17T10:55:58.707 INFO:teuthology.orchestra.run.trial049.stdout:/sbin/grubby 2026-02-17T10:55:58.709 INFO:teuthology.orchestra.run.trial049.stdout:yes 2026-02-17T10:55:58.709 DEBUG:teuthology.orchestra.run.trial049:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-681.el9.x86_64" | head -n 1 2026-02-17T10:55:58.773 INFO:teuthology.orchestra.run.trial049.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T10:55:58.773 DEBUG:teuthology.orchestra.run.trial049:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64 2026-02-17T10:55:58.846 DEBUG:teuthology.orchestra.run.trial049:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-17T10:55:59.052 INFO:teuthology.orchestra.run.trial049.stderr:Generating grub configuration file ... 2026-02-17T10:55:59.115 INFO:teuthology.orchestra.run.trial049.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-17T10:55:59.121 INFO:teuthology.orchestra.run.trial049.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-17T10:55:59.372 INFO:teuthology.orchestra.run.trial049.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-17T10:55:59.378 INFO:teuthology.orchestra.run.trial049.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-17T10:55:59.410 INFO:teuthology.orchestra.run.trial049.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-17T10:55:59.411 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T10:55:59.416 INFO:teuthology.orchestra.run.trial049.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-17T10:55:59.417 INFO:teuthology.orchestra.run.trial097.stdout: Installing : kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T10:55:59.440 INFO:teuthology.orchestra.run.trial049.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-17T10:55:59.446 INFO:teuthology.orchestra.run.trial049.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-17T10:55:59.526 INFO:teuthology.orchestra.run.trial049.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T10:55:59.534 INFO:teuthology.orchestra.run.trial049.stderr:done 2026-02-17T10:55:59.536 DEBUG:teuthology.orchestra.run.trial049:> test -d /sys/firmware/efi 2026-02-17T10:55:59.552 DEBUG:teuthology.orchestra.run.trial049:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-17T10:55:59.617 INFO:teuthology.orchestra.run.trial049.stdout:/boot/efi/EFI/BOOT 2026-02-17T10:55:59.618 INFO:teuthology.orchestra.run.trial049.stdout:/boot/efi/EFI/centos 2026-02-17T10:55:59.619 DEBUG:teuthology.orchestra.run.trial049:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-17T10:55:59.684 INFO:teuthology.orchestra.run.trial049.stdout:no 2026-02-17T10:55:59.684 DEBUG:teuthology.orchestra.run.trial049:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-17T10:55:59.747 INFO:teuthology.orchestra.run.trial049.stdout:yes 2026-02-17T10:55:59.748 DEBUG:teuthology.orchestra.run.trial049:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-17T10:55:59.811 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial049 2026-02-17T10:55:59.812 DEBUG:teuthology.orchestra.run.trial049:> sudo bash -c ' 2026-02-17T10:55:59.812 DEBUG:teuthology.orchestra.run.trial049:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-17T10:55:59.812 DEBUG:teuthology.orchestra.run.trial049:> ' 2026-02-17T10:56:01.377 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T10:56:01.384 INFO:teuthology.orchestra.run.trial162.stdout: Installing : kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T10:56:02.659 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T10:56:04.412 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T10:56:13.793 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T10:56:13.814 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 4/4 2026-02-17T10:56:13.881 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T10:56:13.881 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/4 2026-02-17T10:56:13.882 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T10:56:13.882 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T10:56:13.935 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T10:56:13.936 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T10:56:13.936 INFO:teuthology.orchestra.run.trial157.stdout:Installed: 2026-02-17T10:56:13.936 INFO:teuthology.orchestra.run.trial157.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-17T10:56:13.936 INFO:teuthology.orchestra.run.trial157.stdout: kernel-core-5.14.0-681.el9.x86_64 2026-02-17T10:56:13.936 INFO:teuthology.orchestra.run.trial157.stdout: kernel-modules-5.14.0-681.el9.x86_64 2026-02-17T10:56:13.936 INFO:teuthology.orchestra.run.trial157.stdout: kernel-modules-core-5.14.0-681.el9.x86_64 2026-02-17T10:56:13.936 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T10:56:13.936 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-17T10:56:13.995 DEBUG:teuthology.orchestra.run.trial157:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T10:56:14.021 INFO:teuthology.orchestra.run.trial157.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T10:56:14.022 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T10:56:14.022 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-681.el9.x86_64 2026-02-17T10:56:14.022 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-17T10:56:14.022 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-17T10:56:14.022 INFO:teuthology.task.kernel:Installing distro kernel on mon.c... 2026-02-17T10:56:14.022 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial157.front.sepia.ceph.com, path=None, version=distro) 2026-02-17T10:56:14.023 DEBUG:teuthology.orchestra.run.trial157:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T10:56:14.087 INFO:teuthology.orchestra.run.trial157.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T10:56:14.088 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T10:56:14.088 DEBUG:teuthology.orchestra.run.trial157:> sudo rpm -qi grub2-tools 2026-02-17T10:56:14.158 INFO:teuthology.orchestra.run.trial157.stdout:Name : grub2-tools 2026-02-17T10:56:14.159 INFO:teuthology.orchestra.run.trial157.stdout:Epoch : 1 2026-02-17T10:56:14.159 INFO:teuthology.orchestra.run.trial157.stdout:Version : 2.06 2026-02-17T10:56:14.159 INFO:teuthology.orchestra.run.trial157.stdout:Release : 118.el9 2026-02-17T10:56:14.159 INFO:teuthology.orchestra.run.trial157.stdout:Architecture: x86_64 2026-02-17T10:56:14.159 INFO:teuthology.orchestra.run.trial157.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-17T10:56:14.159 INFO:teuthology.orchestra.run.trial157.stdout:Group : Unspecified 2026-02-17T10:56:14.159 INFO:teuthology.orchestra.run.trial157.stdout:Size : 8393909 2026-02-17T10:56:14.159 INFO:teuthology.orchestra.run.trial157.stdout:License : GPLv3+ 2026-02-17T10:56:14.159 INFO:teuthology.orchestra.run.trial157.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-17T10:56:14.159 INFO:teuthology.orchestra.run.trial157.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-17T10:56:14.159 INFO:teuthology.orchestra.run.trial157.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-17T10:56:14.159 INFO:teuthology.orchestra.run.trial157.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-17T10:56:14.160 INFO:teuthology.orchestra.run.trial157.stdout:Packager : builder@centos.org 2026-02-17T10:56:14.160 INFO:teuthology.orchestra.run.trial157.stdout:Vendor : CentOS 2026-02-17T10:56:14.160 INFO:teuthology.orchestra.run.trial157.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-17T10:56:14.160 INFO:teuthology.orchestra.run.trial157.stdout:Summary : Support tools for GRUB. 2026-02-17T10:56:14.160 INFO:teuthology.orchestra.run.trial157.stdout:Description : 2026-02-17T10:56:14.160 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T10:56:14.160 INFO:teuthology.orchestra.run.trial157.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-17T10:56:14.160 INFO:teuthology.orchestra.run.trial157.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-17T10:56:14.160 INFO:teuthology.orchestra.run.trial157.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-17T10:56:14.160 INFO:teuthology.orchestra.run.trial157.stdout:hardware devices. 2026-02-17T10:56:14.160 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T10:56:14.160 INFO:teuthology.orchestra.run.trial157.stdout:This subpackage provides tools for support of all platforms. 2026-02-17T10:56:14.161 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-17T10:56:14.161 INFO:teuthology.task.kernel:Updating grub on trial157 to boot 5.14.0-681.el9.x86_64 2026-02-17T10:56:14.161 DEBUG:teuthology.orchestra.run.trial157:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-17T10:56:14.224 INFO:teuthology.orchestra.run.trial157.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T10:56:14.226 DEBUG:teuthology.orchestra.run.trial157:> sudo command -v grubby && echo yes || echo no 2026-02-17T10:56:14.290 INFO:teuthology.orchestra.run.trial157.stdout:/sbin/grubby 2026-02-17T10:56:14.291 INFO:teuthology.orchestra.run.trial157.stdout:yes 2026-02-17T10:56:14.292 DEBUG:teuthology.orchestra.run.trial157:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-681.el9.x86_64" | head -n 1 2026-02-17T10:56:14.355 INFO:teuthology.orchestra.run.trial157.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T10:56:14.356 DEBUG:teuthology.orchestra.run.trial157:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64 2026-02-17T10:56:14.429 DEBUG:teuthology.orchestra.run.trial157:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-17T10:56:14.637 INFO:teuthology.orchestra.run.trial157.stderr:Generating grub configuration file ... 2026-02-17T10:56:14.700 INFO:teuthology.orchestra.run.trial157.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-17T10:56:14.707 INFO:teuthology.orchestra.run.trial157.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-17T10:56:14.954 INFO:teuthology.orchestra.run.trial157.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-17T10:56:14.961 INFO:teuthology.orchestra.run.trial157.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-17T10:56:14.992 INFO:teuthology.orchestra.run.trial157.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-17T10:56:14.999 INFO:teuthology.orchestra.run.trial157.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-17T10:56:15.023 INFO:teuthology.orchestra.run.trial157.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-17T10:56:15.029 INFO:teuthology.orchestra.run.trial157.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-17T10:56:15.111 INFO:teuthology.orchestra.run.trial157.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T10:56:15.119 INFO:teuthology.orchestra.run.trial157.stderr:done 2026-02-17T10:56:15.121 DEBUG:teuthology.orchestra.run.trial157:> test -d /sys/firmware/efi 2026-02-17T10:56:15.135 DEBUG:teuthology.orchestra.run.trial157:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-17T10:56:15.201 INFO:teuthology.orchestra.run.trial157.stdout:/boot/efi/EFI/BOOT 2026-02-17T10:56:15.201 INFO:teuthology.orchestra.run.trial157.stdout:/boot/efi/EFI/centos 2026-02-17T10:56:15.203 DEBUG:teuthology.orchestra.run.trial157:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-17T10:56:15.270 INFO:teuthology.orchestra.run.trial157.stdout:no 2026-02-17T10:56:15.270 DEBUG:teuthology.orchestra.run.trial157:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-17T10:56:15.334 INFO:teuthology.orchestra.run.trial157.stdout:yes 2026-02-17T10:56:15.334 DEBUG:teuthology.orchestra.run.trial157:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-17T10:56:15.398 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial157 2026-02-17T10:56:15.398 DEBUG:teuthology.orchestra.run.trial157:> sudo bash -c ' 2026-02-17T10:56:15.398 DEBUG:teuthology.orchestra.run.trial157:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-17T10:56:15.398 DEBUG:teuthology.orchestra.run.trial157:> ' 2026-02-17T10:56:29.855 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-17T10:56:29.855 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-17T10:56:29.856 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T10:56:32.908 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T10:56:32.929 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 4/4 2026-02-17T10:56:33.097 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T10:56:33.098 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/4 2026-02-17T10:56:33.098 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T10:56:33.098 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T10:56:33.150 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T10:56:33.150 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T10:56:33.150 INFO:teuthology.orchestra.run.trial097.stdout:Installed: 2026-02-17T10:56:33.150 INFO:teuthology.orchestra.run.trial097.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-17T10:56:33.150 INFO:teuthology.orchestra.run.trial097.stdout: kernel-core-5.14.0-681.el9.x86_64 2026-02-17T10:56:33.150 INFO:teuthology.orchestra.run.trial097.stdout: kernel-modules-5.14.0-681.el9.x86_64 2026-02-17T10:56:33.150 INFO:teuthology.orchestra.run.trial097.stdout: kernel-modules-core-5.14.0-681.el9.x86_64 2026-02-17T10:56:33.150 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T10:56:33.150 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-17T10:56:33.208 DEBUG:teuthology.orchestra.run.trial097:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T10:56:33.232 INFO:teuthology.orchestra.run.trial097.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T10:56:33.233 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T10:56:33.234 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-681.el9.x86_64 2026-02-17T10:56:33.234 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-17T10:56:33.234 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-17T10:56:33.234 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2026-02-17T10:56:33.234 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial097.front.sepia.ceph.com, path=None, version=distro) 2026-02-17T10:56:33.234 DEBUG:teuthology.orchestra.run.trial097:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T10:56:33.299 INFO:teuthology.orchestra.run.trial097.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T10:56:33.300 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T10:56:33.300 DEBUG:teuthology.orchestra.run.trial097:> sudo rpm -qi grub2-tools 2026-02-17T10:56:33.369 INFO:teuthology.orchestra.run.trial097.stdout:Name : grub2-tools 2026-02-17T10:56:33.369 INFO:teuthology.orchestra.run.trial097.stdout:Epoch : 1 2026-02-17T10:56:33.369 INFO:teuthology.orchestra.run.trial097.stdout:Version : 2.06 2026-02-17T10:56:33.369 INFO:teuthology.orchestra.run.trial097.stdout:Release : 118.el9 2026-02-17T10:56:33.369 INFO:teuthology.orchestra.run.trial097.stdout:Architecture: x86_64 2026-02-17T10:56:33.369 INFO:teuthology.orchestra.run.trial097.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-17T10:56:33.369 INFO:teuthology.orchestra.run.trial097.stdout:Group : Unspecified 2026-02-17T10:56:33.369 INFO:teuthology.orchestra.run.trial097.stdout:Size : 8393909 2026-02-17T10:56:33.369 INFO:teuthology.orchestra.run.trial097.stdout:License : GPLv3+ 2026-02-17T10:56:33.369 INFO:teuthology.orchestra.run.trial097.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-17T10:56:33.369 INFO:teuthology.orchestra.run.trial097.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-17T10:56:33.369 INFO:teuthology.orchestra.run.trial097.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-17T10:56:33.369 INFO:teuthology.orchestra.run.trial097.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-17T10:56:33.369 INFO:teuthology.orchestra.run.trial097.stdout:Packager : builder@centos.org 2026-02-17T10:56:33.369 INFO:teuthology.orchestra.run.trial097.stdout:Vendor : CentOS 2026-02-17T10:56:33.369 INFO:teuthology.orchestra.run.trial097.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-17T10:56:33.369 INFO:teuthology.orchestra.run.trial097.stdout:Summary : Support tools for GRUB. 2026-02-17T10:56:33.369 INFO:teuthology.orchestra.run.trial097.stdout:Description : 2026-02-17T10:56:33.369 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T10:56:33.369 INFO:teuthology.orchestra.run.trial097.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-17T10:56:33.369 INFO:teuthology.orchestra.run.trial097.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-17T10:56:33.369 INFO:teuthology.orchestra.run.trial097.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-17T10:56:33.369 INFO:teuthology.orchestra.run.trial097.stdout:hardware devices. 2026-02-17T10:56:33.369 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T10:56:33.369 INFO:teuthology.orchestra.run.trial097.stdout:This subpackage provides tools for support of all platforms. 2026-02-17T10:56:33.370 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-17T10:56:33.370 INFO:teuthology.task.kernel:Updating grub on trial097 to boot 5.14.0-681.el9.x86_64 2026-02-17T10:56:33.370 DEBUG:teuthology.orchestra.run.trial097:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-17T10:56:33.433 INFO:teuthology.orchestra.run.trial097.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T10:56:33.435 DEBUG:teuthology.orchestra.run.trial097:> sudo command -v grubby && echo yes || echo no 2026-02-17T10:56:33.498 INFO:teuthology.orchestra.run.trial097.stdout:/sbin/grubby 2026-02-17T10:56:33.499 INFO:teuthology.orchestra.run.trial097.stdout:yes 2026-02-17T10:56:33.499 DEBUG:teuthology.orchestra.run.trial097:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-681.el9.x86_64" | head -n 1 2026-02-17T10:56:33.565 INFO:teuthology.orchestra.run.trial097.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T10:56:33.566 DEBUG:teuthology.orchestra.run.trial097:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64 2026-02-17T10:56:33.639 DEBUG:teuthology.orchestra.run.trial097:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-17T10:56:33.845 INFO:teuthology.orchestra.run.trial097.stderr:Generating grub configuration file ... 2026-02-17T10:56:33.909 INFO:teuthology.orchestra.run.trial097.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-17T10:56:33.915 INFO:teuthology.orchestra.run.trial097.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-17T10:56:34.169 INFO:teuthology.orchestra.run.trial097.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-17T10:56:34.175 INFO:teuthology.orchestra.run.trial097.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-17T10:56:34.206 INFO:teuthology.orchestra.run.trial097.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-17T10:56:34.213 INFO:teuthology.orchestra.run.trial097.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-17T10:56:34.237 INFO:teuthology.orchestra.run.trial097.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-17T10:56:34.243 INFO:teuthology.orchestra.run.trial097.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-17T10:56:34.324 INFO:teuthology.orchestra.run.trial097.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T10:56:34.332 INFO:teuthology.orchestra.run.trial097.stderr:done 2026-02-17T10:56:34.334 DEBUG:teuthology.orchestra.run.trial097:> test -d /sys/firmware/efi 2026-02-17T10:56:34.349 DEBUG:teuthology.orchestra.run.trial097:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-17T10:56:34.413 INFO:teuthology.orchestra.run.trial097.stdout:/boot/efi/EFI/BOOT 2026-02-17T10:56:34.413 INFO:teuthology.orchestra.run.trial097.stdout:/boot/efi/EFI/centos 2026-02-17T10:56:34.415 DEBUG:teuthology.orchestra.run.trial097:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-17T10:56:34.478 INFO:teuthology.orchestra.run.trial097.stdout:no 2026-02-17T10:56:34.479 DEBUG:teuthology.orchestra.run.trial097:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-17T10:56:34.543 INFO:teuthology.orchestra.run.trial097.stdout:yes 2026-02-17T10:56:34.544 DEBUG:teuthology.orchestra.run.trial097:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-17T10:56:34.608 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial097 2026-02-17T10:56:34.608 DEBUG:teuthology.orchestra.run.trial097:> sudo bash -c ' 2026-02-17T10:56:34.608 DEBUG:teuthology.orchestra.run.trial097:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-17T10:56:34.608 DEBUG:teuthology.orchestra.run.trial097:> ' 2026-02-17T10:56:34.792 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T10:56:34.812 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 4/4 2026-02-17T10:56:34.875 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T10:56:34.875 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/4 2026-02-17T10:56:34.875 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T10:56:34.875 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T10:56:34.928 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T10:56:34.928 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T10:56:34.928 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-17T10:56:34.928 INFO:teuthology.orchestra.run.trial162.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-17T10:56:34.929 INFO:teuthology.orchestra.run.trial162.stdout: kernel-core-5.14.0-681.el9.x86_64 2026-02-17T10:56:34.929 INFO:teuthology.orchestra.run.trial162.stdout: kernel-modules-5.14.0-681.el9.x86_64 2026-02-17T10:56:34.929 INFO:teuthology.orchestra.run.trial162.stdout: kernel-modules-core-5.14.0-681.el9.x86_64 2026-02-17T10:56:34.929 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T10:56:34.929 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T10:56:34.982 DEBUG:teuthology.orchestra.run.trial162:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T10:56:35.007 INFO:teuthology.orchestra.run.trial162.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T10:56:35.008 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T10:56:35.008 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-681.el9.x86_64 2026-02-17T10:56:35.009 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-17T10:56:35.009 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-17T10:56:35.009 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2026-02-17T10:56:35.009 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial162.front.sepia.ceph.com, path=None, version=distro) 2026-02-17T10:56:35.009 DEBUG:teuthology.orchestra.run.trial162:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T10:56:35.072 INFO:teuthology.orchestra.run.trial162.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T10:56:35.073 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T10:56:35.073 DEBUG:teuthology.orchestra.run.trial162:> sudo rpm -qi grub2-tools 2026-02-17T10:56:35.143 INFO:teuthology.orchestra.run.trial162.stdout:Name : grub2-tools 2026-02-17T10:56:35.143 INFO:teuthology.orchestra.run.trial162.stdout:Epoch : 1 2026-02-17T10:56:35.143 INFO:teuthology.orchestra.run.trial162.stdout:Version : 2.06 2026-02-17T10:56:35.143 INFO:teuthology.orchestra.run.trial162.stdout:Release : 118.el9 2026-02-17T10:56:35.143 INFO:teuthology.orchestra.run.trial162.stdout:Architecture: x86_64 2026-02-17T10:56:35.143 INFO:teuthology.orchestra.run.trial162.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-17T10:56:35.143 INFO:teuthology.orchestra.run.trial162.stdout:Group : Unspecified 2026-02-17T10:56:35.143 INFO:teuthology.orchestra.run.trial162.stdout:Size : 8393909 2026-02-17T10:56:35.143 INFO:teuthology.orchestra.run.trial162.stdout:License : GPLv3+ 2026-02-17T10:56:35.143 INFO:teuthology.orchestra.run.trial162.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-17T10:56:35.143 INFO:teuthology.orchestra.run.trial162.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-17T10:56:35.143 INFO:teuthology.orchestra.run.trial162.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-17T10:56:35.143 INFO:teuthology.orchestra.run.trial162.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-17T10:56:35.143 INFO:teuthology.orchestra.run.trial162.stdout:Packager : builder@centos.org 2026-02-17T10:56:35.143 INFO:teuthology.orchestra.run.trial162.stdout:Vendor : CentOS 2026-02-17T10:56:35.143 INFO:teuthology.orchestra.run.trial162.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-17T10:56:35.143 INFO:teuthology.orchestra.run.trial162.stdout:Summary : Support tools for GRUB. 2026-02-17T10:56:35.143 INFO:teuthology.orchestra.run.trial162.stdout:Description : 2026-02-17T10:56:35.143 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T10:56:35.144 INFO:teuthology.orchestra.run.trial162.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-17T10:56:35.144 INFO:teuthology.orchestra.run.trial162.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-17T10:56:35.144 INFO:teuthology.orchestra.run.trial162.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-17T10:56:35.144 INFO:teuthology.orchestra.run.trial162.stdout:hardware devices. 2026-02-17T10:56:35.144 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T10:56:35.144 INFO:teuthology.orchestra.run.trial162.stdout:This subpackage provides tools for support of all platforms. 2026-02-17T10:56:35.145 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-17T10:56:35.145 INFO:teuthology.task.kernel:Updating grub on trial162 to boot 5.14.0-681.el9.x86_64 2026-02-17T10:56:35.145 DEBUG:teuthology.orchestra.run.trial162:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-17T10:56:35.210 INFO:teuthology.orchestra.run.trial162.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T10:56:35.211 DEBUG:teuthology.orchestra.run.trial162:> sudo command -v grubby && echo yes || echo no 2026-02-17T10:56:35.274 INFO:teuthology.orchestra.run.trial162.stdout:/sbin/grubby 2026-02-17T10:56:35.275 INFO:teuthology.orchestra.run.trial162.stdout:yes 2026-02-17T10:56:35.276 DEBUG:teuthology.orchestra.run.trial162:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-681.el9.x86_64" | head -n 1 2026-02-17T10:56:35.339 INFO:teuthology.orchestra.run.trial162.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T10:56:35.340 DEBUG:teuthology.orchestra.run.trial162:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64 2026-02-17T10:56:35.413 DEBUG:teuthology.orchestra.run.trial162:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-17T10:56:35.622 INFO:teuthology.orchestra.run.trial162.stderr:Generating grub configuration file ... 2026-02-17T10:56:35.685 INFO:teuthology.orchestra.run.trial162.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-17T10:56:35.691 INFO:teuthology.orchestra.run.trial162.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-17T10:56:35.940 INFO:teuthology.orchestra.run.trial162.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-17T10:56:35.947 INFO:teuthology.orchestra.run.trial162.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-17T10:56:35.978 INFO:teuthology.orchestra.run.trial162.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-17T10:56:35.984 INFO:teuthology.orchestra.run.trial162.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-17T10:56:36.008 INFO:teuthology.orchestra.run.trial162.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-17T10:56:36.015 INFO:teuthology.orchestra.run.trial162.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-17T10:56:36.095 INFO:teuthology.orchestra.run.trial162.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T10:56:36.103 INFO:teuthology.orchestra.run.trial162.stderr:done 2026-02-17T10:56:36.104 DEBUG:teuthology.orchestra.run.trial162:> test -d /sys/firmware/efi 2026-02-17T10:56:36.119 DEBUG:teuthology.orchestra.run.trial162:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-17T10:56:36.185 INFO:teuthology.orchestra.run.trial162.stdout:/boot/efi/EFI/BOOT 2026-02-17T10:56:36.185 INFO:teuthology.orchestra.run.trial162.stdout:/boot/efi/EFI/centos 2026-02-17T10:56:36.186 DEBUG:teuthology.orchestra.run.trial162:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-17T10:56:36.251 INFO:teuthology.orchestra.run.trial162.stdout:no 2026-02-17T10:56:36.252 DEBUG:teuthology.orchestra.run.trial162:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-17T10:56:36.315 INFO:teuthology.orchestra.run.trial162.stdout:yes 2026-02-17T10:56:36.315 DEBUG:teuthology.orchestra.run.trial162:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-17T10:56:36.380 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial162 2026-02-17T10:56:36.380 DEBUG:teuthology.orchestra.run.trial162:> sudo bash -c ' 2026-02-17T10:56:36.380 DEBUG:teuthology.orchestra.run.trial162:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-17T10:56:36.380 DEBUG:teuthology.orchestra.run.trial162:> ' 2026-02-17T10:56:45.441 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-17T10:56:45.441 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial157.front.sepia.ceph.com' 2026-02-17T10:56:45.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T10:57:04.650 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-17T10:57:04.651 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial097.front.sepia.ceph.com' 2026-02-17T10:57:04.651 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T10:57:06.422 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2026-02-17T10:57:06.423 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial162.front.sepia.ceph.com' 2026-02-17T10:57:06.423 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T10:57:29.859 DEBUG:teuthology.orchestra.remote:timed out 2026-02-17T10:57:38.868 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-17T10:57:38.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T10:57:38.997 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-17T10:57:39.149 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-17T10:57:39.149 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-681.el9.x86_64"... 2026-02-17T10:57:39.149 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-17T10:57:39.205 INFO:teuthology.orchestra.run.trial049.stdout:5.14.0-681.el9.x86_64 2026-02-17T10:57:39.206 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 5.14.0-681.el9.x86_64 2026-02-17T10:57:39.206 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-17T10:57:39.206 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-17T10:57:40.207 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-17T10:57:40.207 DEBUG:teuthology.orchestra.run.trial049:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-17T10:57:40.236 INFO:teuthology.orchestra.run.trial049.stdout:ttyS1 2026-02-17T10:57:40.264 DEBUG:teuthology.parallel:result is None 2026-02-17T10:57:45.443 DEBUG:teuthology.orchestra.remote:timed out 2026-02-17T10:57:54.444 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial157.front.sepia.ceph.com' 2026-02-17T10:57:54.445 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T10:57:54.582 DEBUG:teuthology.orchestra.run.trial157:> true 2026-02-17T10:57:54.753 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial157.front.sepia.ceph.com' 2026-02-17T10:57:54.754 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-681.el9.x86_64"... 2026-02-17T10:57:54.754 DEBUG:teuthology.orchestra.run.trial157:> uname -r 2026-02-17T10:57:54.809 INFO:teuthology.orchestra.run.trial157.stdout:5.14.0-681.el9.x86_64 2026-02-17T10:57:54.809 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 5.14.0-681.el9.x86_64 2026-02-17T10:57:54.810 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-17T10:57:54.810 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-17T10:57:55.810 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2026-02-17T10:57:55.811 DEBUG:teuthology.orchestra.run.trial157:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-17T10:57:55.841 INFO:teuthology.orchestra.run.trial157.stdout:ttyS1 2026-02-17T10:57:55.861 DEBUG:teuthology.parallel:result is None 2026-02-17T10:58:04.653 DEBUG:teuthology.orchestra.remote:timed out 2026-02-17T10:58:06.424 DEBUG:teuthology.orchestra.remote:timed out 2026-02-17T10:58:13.654 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial097.front.sepia.ceph.com' 2026-02-17T10:58:13.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T10:58:13.796 DEBUG:teuthology.orchestra.run.trial097:> true 2026-02-17T10:58:13.958 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial097.front.sepia.ceph.com' 2026-02-17T10:58:13.958 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-681.el9.x86_64"... 2026-02-17T10:58:13.958 DEBUG:teuthology.orchestra.run.trial097:> uname -r 2026-02-17T10:58:14.016 INFO:teuthology.orchestra.run.trial097.stdout:5.14.0-681.el9.x86_64 2026-02-17T10:58:14.017 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 5.14.0-681.el9.x86_64 2026-02-17T10:58:14.017 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-17T10:58:14.017 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-17T10:58:15.018 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2026-02-17T10:58:15.018 DEBUG:teuthology.orchestra.run.trial097:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-17T10:58:15.048 INFO:teuthology.orchestra.run.trial097.stdout:ttyS1 2026-02-17T10:58:15.065 DEBUG:teuthology.parallel:result is None 2026-02-17T10:58:15.425 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial162.front.sepia.ceph.com' 2026-02-17T10:58:15.426 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T10:58:15.532 DEBUG:teuthology.orchestra.run.trial162:> true 2026-02-17T10:58:15.686 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial162.front.sepia.ceph.com' 2026-02-17T10:58:15.686 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-681.el9.x86_64"... 2026-02-17T10:58:15.686 DEBUG:teuthology.orchestra.run.trial162:> uname -r 2026-02-17T10:58:15.742 INFO:teuthology.orchestra.run.trial162.stdout:5.14.0-681.el9.x86_64 2026-02-17T10:58:15.743 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 5.14.0-681.el9.x86_64 2026-02-17T10:58:15.743 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-17T10:58:15.743 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-17T10:58:16.744 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2026-02-17T10:58:16.745 DEBUG:teuthology.orchestra.run.trial162:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-17T10:58:16.774 INFO:teuthology.orchestra.run.trial162.stdout:ttyS1 2026-02-17T10:58:16.799 DEBUG:teuthology.parallel:result is None 2026-02-17T10:58:16.799 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-17T10:58:16.811 INFO:teuthology.task.internal:Creating test directory... 2026-02-17T10:58:16.811 DEBUG:teuthology.orchestra.run.trial049:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-17T10:58:16.814 DEBUG:teuthology.orchestra.run.trial097:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-17T10:58:16.816 DEBUG:teuthology.orchestra.run.trial157:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-17T10:58:16.819 DEBUG:teuthology.orchestra.run.trial162:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-17T10:58:16.857 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-17T10:58:16.872 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-17T10:58:16.887 INFO:teuthology.task.internal:Creating archive directory... 2026-02-17T10:58:16.887 DEBUG:teuthology.orchestra.run.trial049:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-17T10:58:16.890 DEBUG:teuthology.orchestra.run.trial097:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-17T10:58:16.893 DEBUG:teuthology.orchestra.run.trial157:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-17T10:58:16.896 DEBUG:teuthology.orchestra.run.trial162:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-17T10:58:16.923 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-17T10:58:16.935 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-17T10:58:16.936 DEBUG:teuthology.orchestra.run.trial049:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-17T10:58:16.948 DEBUG:teuthology.orchestra.run.trial097:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-17T10:58:16.951 DEBUG:teuthology.orchestra.run.trial157:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-17T10:58:16.954 DEBUG:teuthology.orchestra.run.trial162:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-17T10:58:16.971 INFO:teuthology.orchestra.run.trial049.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T10:58:16.974 INFO:teuthology.orchestra.run.trial097.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T10:58:16.976 INFO:teuthology.orchestra.run.trial157.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T10:58:16.978 INFO:teuthology.orchestra.run.trial162.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T10:58:16.980 INFO:teuthology.orchestra.run.trial049.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T10:58:16.983 INFO:teuthology.orchestra.run.trial097.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T10:58:16.985 INFO:teuthology.orchestra.run.trial157.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T10:58:16.987 INFO:teuthology.orchestra.run.trial162.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T10:58:16.989 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-17T10:58:17.002 INFO:teuthology.task.internal:Configuring sudo... 2026-02-17T10:58:17.002 DEBUG:teuthology.orchestra.run.trial049:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-17T10:58:17.024 DEBUG:teuthology.orchestra.run.trial097:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-17T10:58:17.027 DEBUG:teuthology.orchestra.run.trial157:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-17T10:58:17.029 DEBUG:teuthology.orchestra.run.trial162:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-17T10:58:17.056 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-17T10:58:17.073 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-17T10:58:17.074 DEBUG:teuthology.orchestra.run.trial049:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-17T10:58:17.088 DEBUG:teuthology.orchestra.run.trial097:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-17T10:58:17.091 DEBUG:teuthology.orchestra.run.trial157:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-17T10:58:17.094 DEBUG:teuthology.orchestra.run.trial162:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-17T10:58:17.111 DEBUG:teuthology.orchestra.run.trial049:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T10:58:17.260 DEBUG:teuthology.orchestra.run.trial049:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T10:58:17.286 DEBUG:teuthology.orchestra.run.trial049:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T10:58:17.436 DEBUG:teuthology.orchestra.run.trial049:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T10:58:17.461 DEBUG:teuthology.orchestra.run.trial049:> set -ex 2026-02-17T10:58:17.461 DEBUG:teuthology.orchestra.run.trial049:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-17T10:58:17.524 DEBUG:teuthology.orchestra.run.trial097:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T10:58:17.630 DEBUG:teuthology.orchestra.run.trial097:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T10:58:17.655 DEBUG:teuthology.orchestra.run.trial097:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T10:58:17.805 DEBUG:teuthology.orchestra.run.trial097:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T10:58:17.829 DEBUG:teuthology.orchestra.run.trial097:> set -ex 2026-02-17T10:58:17.829 DEBUG:teuthology.orchestra.run.trial097:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-17T10:58:17.894 DEBUG:teuthology.orchestra.run.trial157:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T10:58:18.007 DEBUG:teuthology.orchestra.run.trial157:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T10:58:18.032 DEBUG:teuthology.orchestra.run.trial157:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T10:58:18.179 DEBUG:teuthology.orchestra.run.trial157:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T10:58:18.204 DEBUG:teuthology.orchestra.run.trial157:> set -ex 2026-02-17T10:58:18.204 DEBUG:teuthology.orchestra.run.trial157:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-17T10:58:18.266 DEBUG:teuthology.orchestra.run.trial162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T10:58:18.372 DEBUG:teuthology.orchestra.run.trial162:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T10:58:18.397 DEBUG:teuthology.orchestra.run.trial162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T10:58:18.543 DEBUG:teuthology.orchestra.run.trial162:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T10:58:18.568 DEBUG:teuthology.orchestra.run.trial162:> set -ex 2026-02-17T10:58:18.568 DEBUG:teuthology.orchestra.run.trial162:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-17T10:58:18.633 DEBUG:teuthology.orchestra.run.trial049:> sudo service rsyslog restart 2026-02-17T10:58:18.636 DEBUG:teuthology.orchestra.run.trial097:> sudo service rsyslog restart 2026-02-17T10:58:18.639 DEBUG:teuthology.orchestra.run.trial157:> sudo service rsyslog restart 2026-02-17T10:58:18.641 DEBUG:teuthology.orchestra.run.trial162:> sudo service rsyslog restart 2026-02-17T10:58:18.662 INFO:teuthology.orchestra.run.trial049.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T10:58:18.665 INFO:teuthology.orchestra.run.trial097.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T10:58:18.667 INFO:teuthology.orchestra.run.trial157.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T10:58:18.700 INFO:teuthology.orchestra.run.trial162.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T10:58:19.224 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-17T10:58:19.236 INFO:teuthology.task.internal:Starting timer... 2026-02-17T10:58:19.236 INFO:teuthology.run_tasks:Running task pcp... 2026-02-17T10:58:19.260 INFO:teuthology.run_tasks:Running task selinux... 2026-02-17T10:58:19.278 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2026-02-17T10:58:19.278 DEBUG:teuthology.orchestra.run.trial049:> sudo service auditd rotate 2026-02-17T10:58:19.309 INFO:teuthology.orchestra.run.trial049.stdout:Rotating logs: 2026-02-17T10:58:19.310 DEBUG:teuthology.orchestra.run.trial097:> sudo service auditd rotate 2026-02-17T10:58:19.340 INFO:teuthology.orchestra.run.trial097.stdout:Rotating logs: 2026-02-17T10:58:19.342 DEBUG:teuthology.orchestra.run.trial157:> sudo service auditd rotate 2026-02-17T10:58:19.371 INFO:teuthology.orchestra.run.trial157.stdout:Rotating logs: 2026-02-17T10:58:19.372 DEBUG:teuthology.orchestra.run.trial162:> sudo service auditd rotate 2026-02-17T10:58:19.401 INFO:teuthology.orchestra.run.trial162.stdout:Rotating logs: 2026-02-17T10:58:19.403 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-17T10:58:19.403 DEBUG:teuthology.orchestra.run.trial049:> /usr/sbin/getenforce 2026-02-17T10:58:19.420 INFO:teuthology.orchestra.run.trial049.stdout:Permissive 2026-02-17T10:58:19.421 DEBUG:teuthology.orchestra.run.trial097:> /usr/sbin/getenforce 2026-02-17T10:58:19.438 INFO:teuthology.orchestra.run.trial097.stdout:Permissive 2026-02-17T10:58:19.439 DEBUG:teuthology.orchestra.run.trial157:> /usr/sbin/getenforce 2026-02-17T10:58:19.455 INFO:teuthology.orchestra.run.trial157.stdout:Permissive 2026-02-17T10:58:19.456 DEBUG:teuthology.orchestra.run.trial162:> /usr/sbin/getenforce 2026-02-17T10:58:19.472 INFO:teuthology.orchestra.run.trial162.stdout:Permissive 2026-02-17T10:58:19.473 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial049.front.sepia.ceph.com': 'permissive', 'ubuntu@trial097.front.sepia.ceph.com': 'permissive', 'ubuntu@trial157.front.sepia.ceph.com': 'permissive', 'ubuntu@trial162.front.sepia.ceph.com': 'permissive'} 2026-02-17T10:58:19.473 DEBUG:teuthology.orchestra.run.trial049:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T10:58:19.499 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T10:58:19.500 DEBUG:teuthology.orchestra.run.trial097:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T10:58:19.525 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T10:58:19.525 DEBUG:teuthology.orchestra.run.trial157:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T10:58:19.551 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T10:58:19.551 DEBUG:teuthology.orchestra.run.trial162:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T10:58:19.576 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T10:58:19.577 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-17T10:58:19.577 DEBUG:teuthology.orchestra.run.trial049:> sudo /usr/sbin/setenforce permissive 2026-02-17T10:58:19.603 DEBUG:teuthology.orchestra.run.trial097:> sudo /usr/sbin/setenforce permissive 2026-02-17T10:58:19.628 DEBUG:teuthology.orchestra.run.trial157:> sudo /usr/sbin/setenforce permissive 2026-02-17T10:58:19.653 DEBUG:teuthology.orchestra.run.trial162:> sudo /usr/sbin/setenforce permissive 2026-02-17T10:58:19.679 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-17T10:58:19.694 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-17T10:58:19.705 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-17T10:58:19.707 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial049.front.sepia.ceph.com,trial097.front.sepia.ceph.com,trial157.front.sepia.ceph.com,trial162.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-17T11:01:26.438 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial049.front.sepia.ceph.com'), Remote(name='ubuntu@trial097.front.sepia.ceph.com'), Remote(name='ubuntu@trial157.front.sepia.ceph.com'), Remote(name='ubuntu@trial162.front.sepia.ceph.com')] 2026-02-17T11:01:26.441 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-17T11:01:26.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T11:01:26.550 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-17T11:01:26.624 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-17T11:01:26.624 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial097.front.sepia.ceph.com' 2026-02-17T11:01:26.624 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T11:01:26.701 DEBUG:teuthology.orchestra.run.trial097:> true 2026-02-17T11:01:26.773 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial097.front.sepia.ceph.com' 2026-02-17T11:01:26.774 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial157.front.sepia.ceph.com' 2026-02-17T11:01:26.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T11:01:26.860 DEBUG:teuthology.orchestra.run.trial157:> true 2026-02-17T11:01:26.932 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial157.front.sepia.ceph.com' 2026-02-17T11:01:26.933 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial162.front.sepia.ceph.com' 2026-02-17T11:01:26.933 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T11:01:27.007 DEBUG:teuthology.orchestra.run.trial162:> true 2026-02-17T11:01:27.082 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial162.front.sepia.ceph.com' 2026-02-17T11:01:27.083 INFO:teuthology.run_tasks:Running task clock... 2026-02-17T11:01:27.097 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-17T11:01:27.097 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-17T11:01:27.098 DEBUG:teuthology.orchestra.run.trial049:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T11:01:27.101 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-17T11:01:27.101 DEBUG:teuthology.orchestra.run.trial097:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T11:01:27.104 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-17T11:01:27.104 DEBUG:teuthology.orchestra.run.trial157:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T11:01:27.106 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-17T11:01:27.106 DEBUG:teuthology.orchestra.run.trial162:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T11:01:27.126 INFO:teuthology.orchestra.run.trial049.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-17T11:01:27.129 INFO:teuthology.orchestra.run.trial097.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-17T11:01:27.133 INFO:teuthology.orchestra.run.trial157.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-17T11:01:27.138 INFO:teuthology.orchestra.run.trial049.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-17T11:01:27.142 INFO:teuthology.orchestra.run.trial097.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-17T11:01:27.145 INFO:teuthology.orchestra.run.trial157.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-17T11:01:27.151 INFO:teuthology.orchestra.run.trial162.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-17T11:01:27.157 INFO:teuthology.orchestra.run.trial049.stderr:sudo: ntpd: command not found 2026-02-17T11:01:27.163 INFO:teuthology.orchestra.run.trial097.stderr:sudo: ntpd: command not found 2026-02-17T11:01:27.163 INFO:teuthology.orchestra.run.trial162.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-17T11:01:27.165 INFO:teuthology.orchestra.run.trial157.stderr:sudo: ntpd: command not found 2026-02-17T11:01:27.167 INFO:teuthology.orchestra.run.trial049.stdout:506 Cannot talk to daemon 2026-02-17T11:01:27.173 INFO:teuthology.orchestra.run.trial097.stdout:506 Cannot talk to daemon 2026-02-17T11:01:27.175 INFO:teuthology.orchestra.run.trial157.stdout:506 Cannot talk to daemon 2026-02-17T11:01:27.179 INFO:teuthology.orchestra.run.trial049.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-17T11:01:27.183 INFO:teuthology.orchestra.run.trial162.stderr:sudo: ntpd: command not found 2026-02-17T11:01:27.185 INFO:teuthology.orchestra.run.trial097.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-17T11:01:27.186 INFO:teuthology.orchestra.run.trial157.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-17T11:01:27.192 INFO:teuthology.orchestra.run.trial049.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-17T11:01:27.193 INFO:teuthology.orchestra.run.trial162.stdout:506 Cannot talk to daemon 2026-02-17T11:01:27.197 INFO:teuthology.orchestra.run.trial097.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-17T11:01:27.198 INFO:teuthology.orchestra.run.trial157.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-17T11:01:27.205 INFO:teuthology.orchestra.run.trial162.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-17T11:01:27.217 INFO:teuthology.orchestra.run.trial162.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-17T11:01:27.241 INFO:teuthology.orchestra.run.trial049.stderr:bash: line 1: ntpq: command not found 2026-02-17T11:01:27.242 INFO:teuthology.orchestra.run.trial157.stderr:bash: line 1: ntpq: command not found 2026-02-17T11:01:27.243 INFO:teuthology.orchestra.run.trial049.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T11:01:27.243 INFO:teuthology.orchestra.run.trial049.stdout:=============================================================================== 2026-02-17T11:01:27.244 INFO:teuthology.orchestra.run.trial157.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T11:01:27.245 INFO:teuthology.orchestra.run.trial157.stdout:=============================================================================== 2026-02-17T11:01:27.247 INFO:teuthology.orchestra.run.trial097.stderr:bash: line 1: ntpq: command not found 2026-02-17T11:01:27.258 INFO:teuthology.orchestra.run.trial097.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T11:01:27.258 INFO:teuthology.orchestra.run.trial097.stdout:=============================================================================== 2026-02-17T11:01:27.258 INFO:teuthology.orchestra.run.trial097.stdout:^? time.cloudflare.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T11:01:27.267 INFO:teuthology.orchestra.run.trial162.stderr:bash: line 1: ntpq: command not found 2026-02-17T11:01:27.270 INFO:teuthology.orchestra.run.trial162.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T11:01:27.270 INFO:teuthology.orchestra.run.trial162.stdout:=============================================================================== 2026-02-17T11:01:27.270 INFO:teuthology.orchestra.run.trial162.stdout:^? time.cloudflare.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T11:01:27.271 INFO:teuthology.run_tasks:Running task install... 2026-02-17T11:01:27.285 DEBUG:teuthology.task.install:project ceph 2026-02-17T11:01:27.285 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e'}} 2026-02-17T11:01:27.285 DEBUG:teuthology.task.install:config {'debuginfo': True, 'flavor': 'default', 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e'} 2026-02-17T11:01:27.285 INFO:teuthology.task.install:Using flavor: default 2026-02-17T11:01:27.294 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse', 'ceph-common-dbg', 'ceph-fuse-dbg', 'ceph-mds-dbg', 'ceph-mgr-dbg', 'ceph-mon-dbg', 'ceph-osd-dbg', 'ceph-test-dbg', 'libcephfs2-dbg', 'librados2-dbg', 'libradosstriper1-dbg', 'librbd1-dbg', 'librgw2-dbg', 'radosgw-dbg', 'rbd-fuse-dbg', 'rbd-mirror-dbg', 'rbd-nbd-dbg'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd', 'ceph-base-debuginfo', 'ceph-common-debuginfo', 'ceph-immutable-object-cache-debuginfo', 'ceph-radosgw-debuginfo', 'ceph-test-debuginfo', 'ceph-base-debuginfo', 'ceph-mgr-debuginfo', 'ceph-mds-debuginfo', 'ceph-mon-debuginfo', 'ceph-osd-debuginfo', 'ceph-fuse-debuginfo', 'librados-devel-debuginfo', 'libcephfs2-debuginfo', 'librados2-debuginfo', 'librbd1-debuginfo', 'python3-cephfs-debuginfo', 'python3-rados-debuginfo', 'python3-rbd-debuginfo', 'python3-rgw-debuginfo', 'rbd-fuse-debuginfo', 'rbd-mirror-debuginfo', 'rbd-nbd-debuginfo']} 2026-02-17T11:01:27.294 INFO:teuthology.task.install:extra packages: [] 2026-02-17T11:01:27.295 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e', 'tag': None, 'wait_for_package': False} 2026-02-17T11:01:27.297 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-17T11:01:27.301 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e', 'tag': None, 'wait_for_package': False} 2026-02-17T11:01:27.302 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-17T11:01:27.303 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e', 'tag': None, 'wait_for_package': False} 2026-02-17T11:01:27.304 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-17T11:01:27.305 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e', 'tag': None, 'wait_for_package': False} 2026-02-17T11:01:27.306 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-17T11:01:27.591 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/centos/9/flavors/default/ 2026-02-17T11:01:27.592 INFO:teuthology.task.install.rpm:Package version is 19.2.3-705.g04cf6dd4 2026-02-17T11:01:27.605 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/centos/9/flavors/default/ 2026-02-17T11:01:27.605 INFO:teuthology.task.install.rpm:Package version is 19.2.3-705.g04cf6dd4 2026-02-17T11:01:27.606 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/centos/9/flavors/default/ 2026-02-17T11:01:27.606 INFO:teuthology.task.install.rpm:Package version is 19.2.3-705.g04cf6dd4 2026-02-17T11:01:27.606 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/centos/9/flavors/default/ 2026-02-17T11:01:27.606 INFO:teuthology.task.install.rpm:Package version is 19.2.3-705.g04cf6dd4 2026-02-17T11:01:27.845 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-17T11:01:27.845 DEBUG:teuthology.orchestra.run.trial157:> set -ex 2026-02-17T11:01:27.845 DEBUG:teuthology.orchestra.run.trial157:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-17T11:01:27.848 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-17T11:01:27.848 DEBUG:teuthology.orchestra.run.trial049:> set -ex 2026-02-17T11:01:27.848 DEBUG:teuthology.orchestra.run.trial049:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-17T11:01:27.849 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-17T11:01:27.849 DEBUG:teuthology.orchestra.run.trial162:> set -ex 2026-02-17T11:01:27.849 DEBUG:teuthology.orchestra.run.trial162:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-17T11:01:27.854 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-17T11:01:27.854 DEBUG:teuthology.orchestra.run.trial097:> set -ex 2026-02-17T11:01:27.854 DEBUG:teuthology.orchestra.run.trial097:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-17T11:01:27.874 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2026-02-17T11:01:27.874 DEBUG:teuthology.orchestra.run.trial049:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-17T11:01:27.876 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2026-02-17T11:01:27.876 DEBUG:teuthology.orchestra.run.trial157:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-17T11:01:27.876 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2026-02-17T11:01:27.876 DEBUG:teuthology.orchestra.run.trial162:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-17T11:01:27.879 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2026-02-17T11:01:27.879 DEBUG:teuthology.orchestra.run.trial097:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-17T11:01:27.939 DEBUG:teuthology.orchestra.run.trial049:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-17T11:01:27.942 DEBUG:teuthology.orchestra.run.trial157:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-17T11:01:27.942 DEBUG:teuthology.orchestra.run.trial162:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-17T11:01:27.947 DEBUG:teuthology.orchestra.run.trial097:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-17T11:01:28.013 DEBUG:teuthology.orchestra.run.trial049:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-17T11:01:28.015 DEBUG:teuthology.orchestra.run.trial157:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-17T11:01:28.017 DEBUG:teuthology.orchestra.run.trial162:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-17T11:01:28.019 DEBUG:teuthology.orchestra.run.trial097:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-17T11:01:28.076 INFO:teuthology.orchestra.run.trial049.stdout:check_obsoletes = 1 2026-02-17T11:01:28.078 DEBUG:teuthology.orchestra.run.trial049:> sudo yum clean all 2026-02-17T11:01:28.080 INFO:teuthology.orchestra.run.trial157.stdout:check_obsoletes = 1 2026-02-17T11:01:28.081 INFO:teuthology.orchestra.run.trial162.stdout:check_obsoletes = 1 2026-02-17T11:01:28.082 DEBUG:teuthology.orchestra.run.trial157:> sudo yum clean all 2026-02-17T11:01:28.083 INFO:teuthology.orchestra.run.trial097.stdout:check_obsoletes = 1 2026-02-17T11:01:28.084 DEBUG:teuthology.orchestra.run.trial162:> sudo yum clean all 2026-02-17T11:01:28.085 DEBUG:teuthology.orchestra.run.trial097:> sudo yum clean all 2026-02-17T11:01:28.226 INFO:teuthology.orchestra.run.trial049.stdout:41 files removed 2026-02-17T11:01:28.233 INFO:teuthology.orchestra.run.trial162.stdout:41 files removed 2026-02-17T11:01:28.235 INFO:teuthology.orchestra.run.trial097.stdout:41 files removed 2026-02-17T11:01:28.235 INFO:teuthology.orchestra.run.trial157.stdout:41 files removed 2026-02-17T11:01:28.240 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-radosgw 2026-02-17T11:01:28.247 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install ceph-radosgw 2026-02-17T11:01:28.249 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install ceph-radosgw 2026-02-17T11:01:28.251 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install ceph-radosgw 2026-02-17T11:01:28.506 INFO:teuthology.orchestra.run.trial049.stdout:ceph packages for x86_64 687 kB/s | 86 kB 00:00 2026-02-17T11:01:28.514 INFO:teuthology.orchestra.run.trial162.stdout:ceph packages for x86_64 692 kB/s | 86 kB 00:00 2026-02-17T11:01:28.526 INFO:teuthology.orchestra.run.trial157.stdout:ceph packages for x86_64 670 kB/s | 86 kB 00:00 2026-02-17T11:01:28.528 INFO:teuthology.orchestra.run.trial097.stdout:ceph packages for x86_64 642 kB/s | 86 kB 00:00 2026-02-17T11:01:28.640 INFO:teuthology.orchestra.run.trial049.stdout:ceph noarch packages 113 kB/s | 12 kB 00:00 2026-02-17T11:01:28.645 INFO:teuthology.orchestra.run.trial162.stdout:ceph noarch packages 113 kB/s | 12 kB 00:00 2026-02-17T11:01:28.657 INFO:teuthology.orchestra.run.trial157.stdout:ceph noarch packages 113 kB/s | 12 kB 00:00 2026-02-17T11:01:28.659 INFO:teuthology.orchestra.run.trial097.stdout:ceph noarch packages 113 kB/s | 12 kB 00:00 2026-02-17T11:01:28.764 INFO:teuthology.orchestra.run.trial049.stdout:ceph source packages 18 kB/s | 1.9 kB 00:00 2026-02-17T11:01:28.772 INFO:teuthology.orchestra.run.trial162.stdout:ceph source packages 18 kB/s | 1.9 kB 00:00 2026-02-17T11:01:28.779 INFO:teuthology.orchestra.run.trial157.stdout:ceph source packages 19 kB/s | 1.9 kB 00:00 2026-02-17T11:01:28.785 INFO:teuthology.orchestra.run.trial097.stdout:ceph source packages 18 kB/s | 1.9 kB 00:00 2026-02-17T11:01:29.102 INFO:teuthology.orchestra.run.trial049.stdout:CentOS Stream 9 - BaseOS 28 MB/s | 8.9 MB 00:00 2026-02-17T11:01:29.487 INFO:teuthology.orchestra.run.trial157.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.9 MB 00:00 2026-02-17T11:01:30.848 INFO:teuthology.orchestra.run.trial097.stdout:CentOS Stream 9 - BaseOS 4.4 MB/s | 8.9 MB 00:02 2026-02-17T11:01:31.382 INFO:teuthology.orchestra.run.trial162.stdout:CentOS Stream 9 - BaseOS 3.4 MB/s | 8.9 MB 00:02 2026-02-17T11:01:34.519 INFO:teuthology.orchestra.run.trial097.stdout:CentOS Stream 9 - AppStream 8.6 MB/s | 27 MB 00:03 2026-02-17T11:01:35.964 INFO:teuthology.orchestra.run.trial157.stdout:CentOS Stream 9 - AppStream 4.5 MB/s | 27 MB 00:05 2026-02-17T11:01:37.211 INFO:teuthology.orchestra.run.trial097.stdout:CentOS Stream 9 - CRB 31 MB/s | 7.8 MB 00:00 2026-02-17T11:01:38.072 INFO:teuthology.orchestra.run.trial097.stdout:CentOS Stream 9 - Extras packages 184 kB/s | 20 kB 00:00 2026-02-17T11:01:38.782 INFO:teuthology.orchestra.run.trial097.stdout:Extra Packages for Enterprise Linux 31 MB/s | 20 MB 00:00 2026-02-17T11:01:39.613 INFO:teuthology.orchestra.run.trial157.stdout:CentOS Stream 9 - CRB 6.2 MB/s | 7.8 MB 00:01 2026-02-17T11:01:40.461 INFO:teuthology.orchestra.run.trial157.stdout:CentOS Stream 9 - Extras packages 166 kB/s | 20 kB 00:00 2026-02-17T11:01:41.804 INFO:teuthology.orchestra.run.trial157.stdout:Extra Packages for Enterprise Linux 16 MB/s | 20 MB 00:01 2026-02-17T11:01:42.064 INFO:teuthology.orchestra.run.trial097.stdout:lab-extras 1.1 MB/s | 50 kB 00:00 2026-02-17T11:01:43.292 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-17T11:01:43.293 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:01:43.293 INFO:teuthology.orchestra.run.trial097.stdout: Package Arch Version Repository Size 2026-02-17T11:01:43.293 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:01:43.293 INFO:teuthology.orchestra.run.trial097.stdout:Installing: 2026-02-17T11:01:43.293 INFO:teuthology.orchestra.run.trial097.stdout: ceph-radosgw x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 11 M 2026-02-17T11:01:43.294 INFO:teuthology.orchestra.run.trial097.stdout:Upgrading: 2026-02-17T11:01:43.294 INFO:teuthology.orchestra.run.trial097.stdout: librados2 x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 3.4 M 2026-02-17T11:01:43.294 INFO:teuthology.orchestra.run.trial097.stdout: librbd1 x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 3.2 M 2026-02-17T11:01:43.294 INFO:teuthology.orchestra.run.trial097.stdout:Installing dependencies: 2026-02-17T11:01:43.294 INFO:teuthology.orchestra.run.trial097.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-17T11:01:43.294 INFO:teuthology.orchestra.run.trial097.stdout: ceph-base x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 5.5 M 2026-02-17T11:01:43.294 INFO:teuthology.orchestra.run.trial097.stdout: ceph-common x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 22 M 2026-02-17T11:01:43.294 INFO:teuthology.orchestra.run.trial097.stdout: ceph-selinux x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 25 k 2026-02-17T11:01:43.294 INFO:teuthology.orchestra.run.trial097.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-17T11:01:43.294 INFO:teuthology.orchestra.run.trial097.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-17T11:01:43.294 INFO:teuthology.orchestra.run.trial097.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-17T11:01:43.294 INFO:teuthology.orchestra.run.trial097.stdout: libcephfs2 x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 1.0 M 2026-02-17T11:01:43.295 INFO:teuthology.orchestra.run.trial097.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-17T11:01:43.295 INFO:teuthology.orchestra.run.trial097.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-17T11:01:43.295 INFO:teuthology.orchestra.run.trial097.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-17T11:01:43.295 INFO:teuthology.orchestra.run.trial097.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-17T11:01:43.295 INFO:teuthology.orchestra.run.trial097.stdout: libradosstriper1 x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 503 k 2026-02-17T11:01:43.295 INFO:teuthology.orchestra.run.trial097.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-17T11:01:43.295 INFO:teuthology.orchestra.run.trial097.stdout: librgw2 x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 5.4 M 2026-02-17T11:01:43.295 INFO:teuthology.orchestra.run.trial097.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-17T11:01:43.295 INFO:teuthology.orchestra.run.trial097.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-17T11:01:43.295 INFO:teuthology.orchestra.run.trial097.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-17T11:01:43.295 INFO:teuthology.orchestra.run.trial097.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-17T11:01:43.295 INFO:teuthology.orchestra.run.trial097.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-17T11:01:43.295 INFO:teuthology.orchestra.run.trial097.stdout: python3-ceph-argparse x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 45 k 2026-02-17T11:01:43.296 INFO:teuthology.orchestra.run.trial097.stdout: python3-ceph-common x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 154 k 2026-02-17T11:01:43.296 INFO:teuthology.orchestra.run.trial097.stdout: python3-cephfs x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 165 k 2026-02-17T11:01:43.296 INFO:teuthology.orchestra.run.trial097.stdout: python3-rados x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 323 k 2026-02-17T11:01:43.296 INFO:teuthology.orchestra.run.trial097.stdout: python3-rbd x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 303 k 2026-02-17T11:01:43.296 INFO:teuthology.orchestra.run.trial097.stdout: python3-rgw x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 100 k 2026-02-17T11:01:43.296 INFO:teuthology.orchestra.run.trial097.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-17T11:01:43.296 INFO:teuthology.orchestra.run.trial097.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-17T11:01:43.296 INFO:teuthology.orchestra.run.trial097.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-17T11:01:43.296 INFO:teuthology.orchestra.run.trial097.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-17T11:01:43.296 INFO:teuthology.orchestra.run.trial097.stdout:Installing weak dependencies: 2026-02-17T11:01:43.296 INFO:teuthology.orchestra.run.trial097.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-17T11:01:43.296 INFO:teuthology.orchestra.run.trial097.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-17T11:01:43.296 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:01:43.297 INFO:teuthology.orchestra.run.trial097.stdout:Transaction Summary 2026-02-17T11:01:43.297 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:01:43.297 INFO:teuthology.orchestra.run.trial097.stdout:Install 33 Packages 2026-02-17T11:01:43.297 INFO:teuthology.orchestra.run.trial097.stdout:Upgrade 2 Packages 2026-02-17T11:01:43.297 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:01:43.298 INFO:teuthology.orchestra.run.trial097.stdout:Total download size: 63 M 2026-02-17T11:01:43.298 INFO:teuthology.orchestra.run.trial097.stdout:Downloading Packages: 2026-02-17T11:01:44.134 INFO:teuthology.orchestra.run.trial097.stdout:(1/35): ceph-base-19.2.3-705.g04cf6dd4.el9.x86_ 16 MB/s | 5.5 MB 00:00 2026-02-17T11:01:44.174 INFO:teuthology.orchestra.run.trial097.stdout:(2/35): ceph-selinux-19.2.3-705.g04cf6dd4.el9.x 633 kB/s | 25 kB 00:00 2026-02-17T11:01:44.234 INFO:teuthology.orchestra.run.trial097.stdout:(3/35): libcephfs2-19.2.3-705.g04cf6dd4.el9.x86 16 MB/s | 1.0 MB 00:00 2026-02-17T11:01:44.288 INFO:teuthology.orchestra.run.trial097.stdout:(4/35): libradosstriper1-19.2.3-705.g04cf6dd4.e 9.2 MB/s | 503 kB 00:00 2026-02-17T11:01:44.382 INFO:teuthology.orchestra.run.trial097.stdout:(5/35): ceph-radosgw-19.2.3-705.g04cf6dd4.el9.x 18 MB/s | 11 MB 00:00 2026-02-17T11:01:44.425 INFO:teuthology.orchestra.run.trial097.stdout:(6/35): python3-ceph-argparse-19.2.3-705.g04cf6 1.0 MB/s | 45 kB 00:00 2026-02-17T11:01:44.477 INFO:teuthology.orchestra.run.trial097.stdout:(7/35): python3-ceph-common-19.2.3-705.g04cf6dd 2.9 MB/s | 154 kB 00:00 2026-02-17T11:01:44.509 INFO:teuthology.orchestra.run.trial097.stdout:(8/35): librgw2-19.2.3-705.g04cf6dd4.el9.x86_64 24 MB/s | 5.4 MB 00:00 2026-02-17T11:01:44.525 INFO:teuthology.orchestra.run.trial097.stdout:(9/35): python3-cephfs-19.2.3-705.g04cf6dd4.el9 3.4 MB/s | 165 kB 00:00 2026-02-17T11:01:44.544 INFO:teuthology.orchestra.run.trial097.stdout:(10/35): python3-rados-19.2.3-705.g04cf6dd4.el9 9.0 MB/s | 323 kB 00:00 2026-02-17T11:01:44.563 INFO:teuthology.orchestra.run.trial097.stdout:(11/35): python3-rbd-19.2.3-705.g04cf6dd4.el9.x 7.8 MB/s | 303 kB 00:00 2026-02-17T11:01:44.578 INFO:teuthology.orchestra.run.trial097.stdout:(12/35): python3-rgw-19.2.3-705.g04cf6dd4.el9.x 2.9 MB/s | 100 kB 00:00 2026-02-17T11:01:44.596 INFO:teuthology.orchestra.run.trial097.stdout:(13/35): mailcap-2.1.49-5.el9.noarch.rpm 1.0 MB/s | 33 kB 00:00 2026-02-17T11:01:44.613 INFO:teuthology.orchestra.run.trial097.stdout:(14/35): pciutils-3.7.0-7.el9.x86_64.rpm 5.5 MB/s | 93 kB 00:00 2026-02-17T11:01:44.640 INFO:teuthology.orchestra.run.trial097.stdout:(15/35): nvme-cli-2.13-1.el9.x86_64.rpm 18 MB/s | 1.1 MB 00:00 2026-02-17T11:01:44.691 INFO:teuthology.orchestra.run.trial097.stdout:(16/35): ceph-common-19.2.3-705.g04cf6dd4.el9.x 24 MB/s | 22 MB 00:00 2026-02-17T11:01:45.045 INFO:teuthology.orchestra.run.trial157.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-17T11:01:45.228 INFO:teuthology.orchestra.run.trial097.stdout:(17/35): boost-program-options-1.75.0-13.el9.x8 169 kB/s | 104 kB 00:00 2026-02-17T11:01:45.330 INFO:teuthology.orchestra.run.trial097.stdout:(18/35): librabbitmq-0.11.0-7.el9.x86_64.rpm 443 kB/s | 45 kB 00:00 2026-02-17T11:01:45.347 INFO:teuthology.orchestra.run.trial097.stdout:(19/35): libnbd-1.20.3-4.el9.x86_64.rpm 231 kB/s | 164 kB 00:00 2026-02-17T11:01:45.364 INFO:teuthology.orchestra.run.trial097.stdout:(20/35): libpmemobj-1.12.1-1.el9.x86_64.rpm 238 kB/s | 160 kB 00:00 2026-02-17T11:01:45.709 INFO:teuthology.orchestra.run.trial097.stdout:(21/35): qatlib-25.08.0-2.el9.x86_64.rpm 695 kB/s | 240 kB 00:00 2026-02-17T11:01:45.774 INFO:teuthology.orchestra.run.trial097.stdout:(22/35): lttng-ust-2.12.0-6.el9.x86_64.rpm 686 kB/s | 292 kB 00:00 2026-02-17T11:01:45.811 INFO:teuthology.orchestra.run.trial097.stdout:(23/35): qatlib-service-25.08.0-2.el9.x86_64.rp 365 kB/s | 37 kB 00:00 2026-02-17T11:01:45.876 INFO:teuthology.orchestra.run.trial097.stdout:(24/35): qatzip-libs-1.3.1-1.el9.x86_64.rpm 654 kB/s | 66 kB 00:00 2026-02-17T11:01:46.033 INFO:teuthology.orchestra.run.trial097.stdout:(25/35): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.4 MB/s | 308 kB 00:00 2026-02-17T11:01:46.067 INFO:teuthology.orchestra.run.trial097.stdout:(26/35): libarrow-doc-9.0.0-15.el9.noarch.rpm 746 kB/s | 25 kB 00:00 2026-02-17T11:01:46.102 INFO:teuthology.orchestra.run.trial097.stdout:(27/35): liboath-2.6.12-1.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2026-02-17T11:01:46.139 INFO:teuthology.orchestra.run.trial097.stdout:(28/35): libunwind-1.6.2-1.el9.x86_64.rpm 1.8 MB/s | 67 kB 00:00 2026-02-17T11:01:46.161 INFO:teuthology.orchestra.run.trial097.stdout:(29/35): librdkafka-1.6.1-102.el9.x86_64.rpm 798 kB/s | 662 kB 00:00 2026-02-17T11:01:46.221 INFO:teuthology.orchestra.run.trial097.stdout:(30/35): libarrow-9.0.0-15.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2026-02-17T11:01:46.231 INFO:teuthology.orchestra.run.trial097.stdout:(31/35): parquet-libs-9.0.0-15.el9.x86_64.rpm 8.9 MB/s | 838 kB 00:00 2026-02-17T11:01:46.263 INFO:teuthology.orchestra.run.trial097.stdout:(32/35): thrift-0.15.0-4.el9.x86_64.rpm 37 MB/s | 1.6 MB 00:00 2026-02-17T11:01:46.275 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-17T11:01:46.276 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:01:46.277 INFO:teuthology.orchestra.run.trial157.stdout: Package Arch Version Repository Size 2026-02-17T11:01:46.277 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:01:46.277 INFO:teuthology.orchestra.run.trial157.stdout:Installing: 2026-02-17T11:01:46.277 INFO:teuthology.orchestra.run.trial157.stdout: ceph-radosgw x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 11 M 2026-02-17T11:01:46.277 INFO:teuthology.orchestra.run.trial157.stdout:Upgrading: 2026-02-17T11:01:46.277 INFO:teuthology.orchestra.run.trial157.stdout: librados2 x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 3.4 M 2026-02-17T11:01:46.278 INFO:teuthology.orchestra.run.trial157.stdout: librbd1 x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 3.2 M 2026-02-17T11:01:46.278 INFO:teuthology.orchestra.run.trial157.stdout:Installing dependencies: 2026-02-17T11:01:46.278 INFO:teuthology.orchestra.run.trial157.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-17T11:01:46.278 INFO:teuthology.orchestra.run.trial157.stdout: ceph-base x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 5.5 M 2026-02-17T11:01:46.278 INFO:teuthology.orchestra.run.trial157.stdout: ceph-common x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 22 M 2026-02-17T11:01:46.278 INFO:teuthology.orchestra.run.trial157.stdout: ceph-selinux x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 25 k 2026-02-17T11:01:46.279 INFO:teuthology.orchestra.run.trial157.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-17T11:01:46.279 INFO:teuthology.orchestra.run.trial157.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-17T11:01:46.279 INFO:teuthology.orchestra.run.trial157.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-17T11:01:46.279 INFO:teuthology.orchestra.run.trial157.stdout: libcephfs2 x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 1.0 M 2026-02-17T11:01:46.279 INFO:teuthology.orchestra.run.trial157.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-17T11:01:46.279 INFO:teuthology.orchestra.run.trial157.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-17T11:01:46.279 INFO:teuthology.orchestra.run.trial157.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-17T11:01:46.280 INFO:teuthology.orchestra.run.trial157.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-17T11:01:46.280 INFO:teuthology.orchestra.run.trial157.stdout: libradosstriper1 x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 503 k 2026-02-17T11:01:46.280 INFO:teuthology.orchestra.run.trial157.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-17T11:01:46.280 INFO:teuthology.orchestra.run.trial157.stdout: librgw2 x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 5.4 M 2026-02-17T11:01:46.280 INFO:teuthology.orchestra.run.trial157.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-17T11:01:46.280 INFO:teuthology.orchestra.run.trial157.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-17T11:01:46.280 INFO:teuthology.orchestra.run.trial157.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-17T11:01:46.281 INFO:teuthology.orchestra.run.trial157.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-17T11:01:46.281 INFO:teuthology.orchestra.run.trial157.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-17T11:01:46.281 INFO:teuthology.orchestra.run.trial157.stdout: python3-ceph-argparse x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 45 k 2026-02-17T11:01:46.281 INFO:teuthology.orchestra.run.trial157.stdout: python3-ceph-common x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 154 k 2026-02-17T11:01:46.281 INFO:teuthology.orchestra.run.trial157.stdout: python3-cephfs x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 165 k 2026-02-17T11:01:46.281 INFO:teuthology.orchestra.run.trial157.stdout: python3-rados x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 323 k 2026-02-17T11:01:46.281 INFO:teuthology.orchestra.run.trial157.stdout: python3-rbd x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 303 k 2026-02-17T11:01:46.282 INFO:teuthology.orchestra.run.trial157.stdout: python3-rgw x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 100 k 2026-02-17T11:01:46.282 INFO:teuthology.orchestra.run.trial157.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-17T11:01:46.282 INFO:teuthology.orchestra.run.trial157.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-17T11:01:46.282 INFO:teuthology.orchestra.run.trial157.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-17T11:01:46.282 INFO:teuthology.orchestra.run.trial157.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-17T11:01:46.282 INFO:teuthology.orchestra.run.trial157.stdout:Installing weak dependencies: 2026-02-17T11:01:46.283 INFO:teuthology.orchestra.run.trial157.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-17T11:01:46.283 INFO:teuthology.orchestra.run.trial157.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-17T11:01:46.283 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:01:46.283 INFO:teuthology.orchestra.run.trial157.stdout:Transaction Summary 2026-02-17T11:01:46.283 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:01:46.283 INFO:teuthology.orchestra.run.trial157.stdout:Install 33 Packages 2026-02-17T11:01:46.284 INFO:teuthology.orchestra.run.trial157.stdout:Upgrade 2 Packages 2026-02-17T11:01:46.284 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:01:46.285 INFO:teuthology.orchestra.run.trial157.stdout:Total download size: 63 M 2026-02-17T11:01:46.285 INFO:teuthology.orchestra.run.trial157.stdout:Downloading Packages: 2026-02-17T11:01:46.350 INFO:teuthology.orchestra.run.trial097.stdout:(33/35): librados2-19.2.3-705.g04cf6dd4.el9.x86 29 MB/s | 3.4 MB 00:00 2026-02-17T11:01:46.356 INFO:teuthology.orchestra.run.trial097.stdout:(34/35): re2-20211101-20.el9.x86_64.rpm 981 kB/s | 191 kB 00:00 2026-02-17T11:01:46.397 INFO:teuthology.orchestra.run.trial097.stdout:(35/35): librbd1-19.2.3-705.g04cf6dd4.el9.x86_6 24 MB/s | 3.2 MB 00:00 2026-02-17T11:01:46.400 INFO:teuthology.orchestra.run.trial097.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:01:46.400 INFO:teuthology.orchestra.run.trial097.stdout:Total 20 MB/s | 63 MB 00:03 2026-02-17T11:01:46.501 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction check 2026-02-17T11:01:46.519 INFO:teuthology.orchestra.run.trial097.stdout:Transaction check succeeded. 2026-02-17T11:01:46.520 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction test 2026-02-17T11:01:46.758 INFO:teuthology.orchestra.run.trial097.stdout:Transaction test succeeded. 2026-02-17T11:01:46.758 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction 2026-02-17T11:01:47.055 INFO:teuthology.orchestra.run.trial097.stdout: Preparing : 1/1 2026-02-17T11:01:47.064 INFO:teuthology.orchestra.run.trial097.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/37 2026-02-17T11:01:47.067 INFO:teuthology.orchestra.run.trial097.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/37 2026-02-17T11:01:47.079 INFO:teuthology.orchestra.run.trial097.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/37 2026-02-17T11:01:47.088 INFO:teuthology.orchestra.run.trial157.stdout:(1/35): ceph-base-19.2.3-705.g04cf6dd4.el9.x86_ 16 MB/s | 5.5 MB 00:00 2026-02-17T11:01:47.128 INFO:teuthology.orchestra.run.trial157.stdout:(2/35): ceph-selinux-19.2.3-705.g04cf6dd4.el9.x 620 kB/s | 25 kB 00:00 2026-02-17T11:01:47.189 INFO:teuthology.orchestra.run.trial157.stdout:(3/35): libcephfs2-19.2.3-705.g04cf6dd4.el9.x86 16 MB/s | 1.0 MB 00:00 2026-02-17T11:01:47.228 INFO:teuthology.orchestra.run.trial097.stdout: Installing : thrift-0.15.0-4.el9.x86_64 4/37 2026-02-17T11:01:47.233 INFO:teuthology.orchestra.run.trial097.stdout: Upgrading : librados2-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/37 2026-02-17T11:01:47.244 INFO:teuthology.orchestra.run.trial157.stdout:(4/35): libradosstriper1-19.2.3-705.g04cf6dd4.e 9.0 MB/s | 503 kB 00:00 2026-02-17T11:01:47.263 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: librados2-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/37 2026-02-17T11:01:47.307 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-rados-2:19.2.3-705.g04cf6dd4.el9.x86_64 6/37 2026-02-17T11:01:47.308 INFO:teuthology.orchestra.run.trial097.stdout: Installing : libcephfs2-2:19.2.3-705.g04cf6dd4.el9.x86_64 7/37 2026-02-17T11:01:47.320 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: libcephfs2-2:19.2.3-705.g04cf6dd4.el9.x86_64 7/37 2026-02-17T11:01:47.324 INFO:teuthology.orchestra.run.trial097.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/37 2026-02-17T11:01:47.333 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-ceph-argparse-2:19.2.3-705.g04cf6dd4.el9.x 9/37 2026-02-17T11:01:47.348 INFO:teuthology.orchestra.run.trial157.stdout:(5/35): ceph-radosgw-19.2.3-705.g04cf6dd4.el9.x 18 MB/s | 11 MB 00:00 2026-02-17T11:01:47.355 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-cephfs-2:19.2.3-705.g04cf6dd4.el9.x86_64 10/37 2026-02-17T11:01:47.356 INFO:teuthology.orchestra.run.trial097.stdout: Installing : libradosstriper1-2:19.2.3-705.g04cf6dd4.el9.x86_64 11/37 2026-02-17T11:01:47.369 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: libradosstriper1-2:19.2.3-705.g04cf6dd4.el9.x86_64 11/37 2026-02-17T11:01:47.400 INFO:teuthology.orchestra.run.trial157.stdout:(6/35): python3-ceph-argparse-19.2.3-705.g04cf6 878 kB/s | 45 kB 00:00 2026-02-17T11:01:47.401 INFO:teuthology.orchestra.run.trial097.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/37 2026-02-17T11:01:47.405 INFO:teuthology.orchestra.run.trial097.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 13/37 2026-02-17T11:01:47.411 INFO:teuthology.orchestra.run.trial097.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/37 2026-02-17T11:01:47.413 INFO:teuthology.orchestra.run.trial097.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/37 2026-02-17T11:01:47.417 INFO:teuthology.orchestra.run.trial097.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 16/37 2026-02-17T11:01:47.421 INFO:teuthology.orchestra.run.trial097.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/37 2026-02-17T11:01:47.456 INFO:teuthology.orchestra.run.trial157.stdout:(7/35): python3-ceph-common-19.2.3-705.g04cf6dd 2.7 MB/s | 154 kB 00:00 2026-02-17T11:01:47.480 INFO:teuthology.orchestra.run.trial157.stdout:(8/35): librgw2-19.2.3-705.g04cf6dd4.el9.x86_64 23 MB/s | 5.4 MB 00:00 2026-02-17T11:01:47.503 INFO:teuthology.orchestra.run.trial157.stdout:(9/35): python3-cephfs-19.2.3-705.g04cf6dd4.el9 3.4 MB/s | 165 kB 00:00 2026-02-17T11:01:47.516 INFO:teuthology.orchestra.run.trial157.stdout:(10/35): python3-rados-19.2.3-705.g04cf6dd4.el9 8.6 MB/s | 323 kB 00:00 2026-02-17T11:01:47.544 INFO:teuthology.orchestra.run.trial157.stdout:(11/35): python3-rbd-19.2.3-705.g04cf6dd4.el9.x 7.3 MB/s | 303 kB 00:00 2026-02-17T11:01:47.553 INFO:teuthology.orchestra.run.trial157.stdout:(12/35): python3-rgw-19.2.3-705.g04cf6dd4.el9.x 2.7 MB/s | 100 kB 00:00 2026-02-17T11:01:47.561 INFO:teuthology.orchestra.run.trial097.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-17T11:01:47.562 INFO:teuthology.orchestra.run.trial097.stdout: Upgrading : librbd1-2:19.2.3-705.g04cf6dd4.el9.x86_64 19/37 2026-02-17T11:01:47.589 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: librbd1-2:19.2.3-705.g04cf6dd4.el9.x86_64 19/37 2026-02-17T11:01:47.592 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-rbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 20/37 2026-02-17T11:01:47.598 INFO:teuthology.orchestra.run.trial097.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/37 2026-02-17T11:01:47.641 INFO:teuthology.orchestra.run.trial157.stdout:(13/35): ceph-common-19.2.3-705.g04cf6dd4.el9.x 24 MB/s | 22 MB 00:00 2026-02-17T11:01:47.824 INFO:teuthology.orchestra.run.trial097.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/37 2026-02-17T11:01:47.825 INFO:teuthology.orchestra.run.trial097.stdout: Installing : librgw2-2:19.2.3-705.g04cf6dd4.el9.x86_64 23/37 2026-02-17T11:01:47.841 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: librgw2-2:19.2.3-705.g04cf6dd4.el9.x86_64 23/37 2026-02-17T11:01:47.844 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-rgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 24/37 2026-02-17T11:01:47.851 INFO:teuthology.orchestra.run.trial097.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/37 2026-02-17T11:01:47.853 INFO:teuthology.orchestra.run.trial097.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/37 2026-02-17T11:01:47.854 INFO:teuthology.orchestra.run.trial097.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-17T11:01:47.873 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-17T11:01:47.986 INFO:teuthology.orchestra.run.trial097.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/37 2026-02-17T11:01:47.989 INFO:teuthology.orchestra.run.trial097.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 29/37 2026-02-17T11:01:48.140 INFO:teuthology.orchestra.run.trial157.stdout:(14/35): mailcap-2.1.49-5.el9.noarch.rpm 56 kB/s | 33 kB 00:00 2026-02-17T11:01:48.184 INFO:teuthology.orchestra.run.trial157.stdout:(15/35): boost-program-options-1.75.0-13.el9.x8 2.3 MB/s | 104 kB 00:00 2026-02-17T11:01:48.210 INFO:teuthology.orchestra.run.trial157.stdout:(16/35): libnbd-1.20.3-4.el9.x86_64.rpm 6.2 MB/s | 164 kB 00:00 2026-02-17T11:01:48.231 INFO:teuthology.orchestra.run.trial157.stdout:(17/35): libpmemobj-1.12.1-1.el9.x86_64.rpm 7.3 MB/s | 160 kB 00:00 2026-02-17T11:01:48.251 INFO:teuthology.orchestra.run.trial157.stdout:(18/35): librabbitmq-0.11.0-7.el9.x86_64.rpm 2.2 MB/s | 45 kB 00:00 2026-02-17T11:01:48.268 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 29/37 2026-02-17T11:01:48.268 INFO:teuthology.orchestra.run.trial097.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-17T11:01:48.268 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:01:48.279 INFO:teuthology.orchestra.run.trial157.stdout:(19/35): librdkafka-1.6.1-102.el9.x86_64.rpm 23 MB/s | 662 kB 00:00 2026-02-17T11:01:48.300 INFO:teuthology.orchestra.run.trial157.stdout:(20/35): lttng-ust-2.12.0-6.el9.x86_64.rpm 13 MB/s | 292 kB 00:00 2026-02-17T11:01:48.310 INFO:teuthology.orchestra.run.trial097.stdout: Installing : mailcap-2.1.49-5.el9.noarch 30/37 2026-02-17T11:01:48.311 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86 31/37 2026-02-17T11:01:48.323 INFO:teuthology.orchestra.run.trial157.stdout:(21/35): qatlib-25.08.0-2.el9.x86_64.rpm 10 MB/s | 240 kB 00:00 2026-02-17T11:01:48.346 INFO:teuthology.orchestra.run.trial157.stdout:(22/35): qatlib-service-25.08.0-2.el9.x86_64.rp 1.6 MB/s | 37 kB 00:00 2026-02-17T11:01:48.368 INFO:teuthology.orchestra.run.trial157.stdout:(23/35): qatzip-libs-1.3.1-1.el9.x86_64.rpm 3.0 MB/s | 66 kB 00:00 2026-02-17T11:01:48.385 INFO:teuthology.orchestra.run.trial157.stdout:(24/35): pciutils-3.7.0-7.el9.x86_64.rpm 125 kB/s | 93 kB 00:00 2026-02-17T11:01:49.185 INFO:teuthology.orchestra.run.trial157.stdout:(25/35): gperftools-libs-2.9.1-3.el9.x86_64.rpm 376 kB/s | 308 kB 00:00 2026-02-17T11:01:49.267 INFO:teuthology.orchestra.run.trial157.stdout:(26/35): libarrow-doc-9.0.0-15.el9.noarch.rpm 300 kB/s | 25 kB 00:00 2026-02-17T11:01:49.295 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 32/37 2026-02-17T11:01:49.297 INFO:teuthology.orchestra.run.trial097.stdout: Installing : ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 32/37 2026-02-17T11:01:49.350 INFO:teuthology.orchestra.run.trial157.stdout:(27/35): liboath-2.6.12-1.el9.x86_64.rpm 592 kB/s | 49 kB 00:00 2026-02-17T11:01:49.433 INFO:teuthology.orchestra.run.trial157.stdout:(28/35): libunwind-1.6.2-1.el9.x86_64.rpm 819 kB/s | 67 kB 00:00 2026-02-17T11:01:49.449 INFO:teuthology.orchestra.run.trial157.stdout:(29/35): nvme-cli-2.13-1.el9.x86_64.rpm 592 kB/s | 1.1 MB 00:01 2026-02-17T11:01:49.583 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 32/37 2026-02-17T11:01:49.586 INFO:teuthology.orchestra.run.trial097.stdout: Installing : ceph-base-2:19.2.3-705.g04cf6dd4.el9.x86_64 33/37 2026-02-17T11:01:49.625 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: ceph-base-2:19.2.3-705.g04cf6dd4.el9.x86_64 33/37 2026-02-17T11:01:49.625 INFO:teuthology.orchestra.run.trial097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-17T11:01:49.625 INFO:teuthology.orchestra.run.trial097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-17T11:01:49.625 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:01:49.628 INFO:teuthology.orchestra.run.trial097.stdout: Installing : ceph-selinux-2:19.2.3-705.g04cf6dd4.el9.x86_64 34/37 2026-02-17T11:01:50.121 INFO:teuthology.orchestra.run.trial157.stdout:(30/35): re2-20211101-20.el9.x86_64.rpm 285 kB/s | 191 kB 00:00 2026-02-17T11:01:50.405 INFO:teuthology.orchestra.run.trial157.stdout:(31/35): parquet-libs-9.0.0-15.el9.x86_64.rpm 862 kB/s | 838 kB 00:00 2026-02-17T11:01:50.521 INFO:teuthology.orchestra.run.trial157.stdout:(32/35): librados2-19.2.3-705.g04cf6dd4.el9.x86 29 MB/s | 3.4 MB 00:00 2026-02-17T11:01:50.581 INFO:teuthology.orchestra.run.trial157.stdout:(33/35): librbd1-19.2.3-705.g04cf6dd4.el9.x86_6 53 MB/s | 3.2 MB 00:00 2026-02-17T11:01:52.085 INFO:teuthology.orchestra.run.trial157.stdout:(34/35): thrift-0.15.0-4.el9.x86_64.rpm 825 kB/s | 1.6 MB 00:01 2026-02-17T11:01:53.980 INFO:teuthology.orchestra.run.trial157.stdout:(35/35): libarrow-9.0.0-15.el9.x86_64.rpm 807 kB/s | 4.4 MB 00:05 2026-02-17T11:01:53.986 INFO:teuthology.orchestra.run.trial157.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:01:53.987 INFO:teuthology.orchestra.run.trial157.stdout:Total 8.2 MB/s | 63 MB 00:07 2026-02-17T11:01:54.080 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction check 2026-02-17T11:01:54.098 INFO:teuthology.orchestra.run.trial157.stdout:Transaction check succeeded. 2026-02-17T11:01:54.098 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction test 2026-02-17T11:01:54.113 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: ceph-selinux-2:19.2.3-705.g04cf6dd4.el9.x86_64 34/37 2026-02-17T11:01:54.114 INFO:teuthology.orchestra.run.trial097.stdout:skipping the directory /sys 2026-02-17T11:01:54.114 INFO:teuthology.orchestra.run.trial097.stdout:skipping the directory /proc 2026-02-17T11:01:54.114 INFO:teuthology.orchestra.run.trial097.stdout:skipping the directory /mnt 2026-02-17T11:01:54.114 INFO:teuthology.orchestra.run.trial097.stdout:skipping the directory /var/tmp 2026-02-17T11:01:54.114 INFO:teuthology.orchestra.run.trial097.stdout:skipping the directory /home 2026-02-17T11:01:54.114 INFO:teuthology.orchestra.run.trial097.stdout:skipping the directory /root 2026-02-17T11:01:54.114 INFO:teuthology.orchestra.run.trial097.stdout:skipping the directory /tmp 2026-02-17T11:01:54.115 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:01:54.337 INFO:teuthology.orchestra.run.trial157.stdout:Transaction test succeeded. 2026-02-17T11:01:54.337 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction 2026-02-17T11:01:54.571 INFO:teuthology.orchestra.run.trial097.stdout: Installing : ceph-radosgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 35/37 2026-02-17T11:01:54.595 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 35/37 2026-02-17T11:01:54.595 INFO:teuthology.orchestra.run.trial097.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:01:54.595 INFO:teuthology.orchestra.run.trial097.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-17T11:01:54.595 INFO:teuthology.orchestra.run.trial097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T11:01:54.595 INFO:teuthology.orchestra.run.trial097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T11:01:54.595 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:01:54.597 INFO:teuthology.orchestra.run.trial097.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-17T11:01:54.609 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-17T11:01:54.610 INFO:teuthology.orchestra.run.trial097.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T11:01:54.632 INFO:teuthology.orchestra.run.trial157.stdout: Preparing : 1/1 2026-02-17T11:01:54.640 INFO:teuthology.orchestra.run.trial157.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/37 2026-02-17T11:01:54.642 INFO:teuthology.orchestra.run.trial157.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/37 2026-02-17T11:01:54.654 INFO:teuthology.orchestra.run.trial157.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/37 2026-02-17T11:01:54.666 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T11:01:54.666 INFO:teuthology.orchestra.run.trial097.stdout:Creating group 'qat' with GID 992. 2026-02-17T11:01:54.666 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:01:54.805 INFO:teuthology.orchestra.run.trial157.stdout: Installing : thrift-0.15.0-4.el9.x86_64 4/37 2026-02-17T11:01:54.809 INFO:teuthology.orchestra.run.trial157.stdout: Upgrading : librados2-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/37 2026-02-17T11:01:54.838 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: librados2-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/37 2026-02-17T11:01:54.881 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-rados-2:19.2.3-705.g04cf6dd4.el9.x86_64 6/37 2026-02-17T11:01:54.882 INFO:teuthology.orchestra.run.trial157.stdout: Installing : libcephfs2-2:19.2.3-705.g04cf6dd4.el9.x86_64 7/37 2026-02-17T11:01:54.893 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: libcephfs2-2:19.2.3-705.g04cf6dd4.el9.x86_64 7/37 2026-02-17T11:01:54.897 INFO:teuthology.orchestra.run.trial157.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/37 2026-02-17T11:01:54.906 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-ceph-argparse-2:19.2.3-705.g04cf6dd4.el9.x 9/37 2026-02-17T11:01:54.928 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-cephfs-2:19.2.3-705.g04cf6dd4.el9.x86_64 10/37 2026-02-17T11:01:54.929 INFO:teuthology.orchestra.run.trial157.stdout: Installing : libradosstriper1-2:19.2.3-705.g04cf6dd4.el9.x86_64 11/37 2026-02-17T11:01:54.941 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : ceph-base-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/37 2026-02-17T11:01:54.941 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 2/37 2026-02-17T11:01:54.941 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : ceph-radosgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 3/37 2026-02-17T11:01:54.941 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : ceph-selinux-2:19.2.3-705.g04cf6dd4.el9.x86_64 4/37 2026-02-17T11:01:54.941 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : libcephfs2-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/37 2026-02-17T11:01:54.941 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : libradosstriper1-2:19.2.3-705.g04cf6dd4.el9.x86_64 6/37 2026-02-17T11:01:54.941 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : librgw2-2:19.2.3-705.g04cf6dd4.el9.x86_64 7/37 2026-02-17T11:01:54.942 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-ceph-argparse-2:19.2.3-705.g04cf6dd4.el9.x 8/37 2026-02-17T11:01:54.942 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86 9/37 2026-02-17T11:01:54.942 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-cephfs-2:19.2.3-705.g04cf6dd4.el9.x86_64 10/37 2026-02-17T11:01:54.942 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-rados-2:19.2.3-705.g04cf6dd4.el9.x86_64 11/37 2026-02-17T11:01:54.942 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-rbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 12/37 2026-02-17T11:01:54.942 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-rgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 13/37 2026-02-17T11:01:54.942 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/37 2026-02-17T11:01:54.942 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 15/37 2026-02-17T11:01:54.942 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 16/37 2026-02-17T11:01:54.942 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 17/37 2026-02-17T11:01:54.942 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-17T11:01:54.942 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 19/37 2026-02-17T11:01:54.943 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 20/37 2026-02-17T11:01:54.943 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 21/37 2026-02-17T11:01:54.943 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 22/37 2026-02-17T11:01:54.943 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 23/37 2026-02-17T11:01:54.943 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 24/37 2026-02-17T11:01:54.943 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 25/37 2026-02-17T11:01:54.943 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 26/37 2026-02-17T11:01:54.943 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 27/37 2026-02-17T11:01:54.943 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 28/37 2026-02-17T11:01:54.943 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 29/37 2026-02-17T11:01:54.944 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 30/37 2026-02-17T11:01:54.944 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 31/37 2026-02-17T11:01:54.944 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : re2-1:20211101-20.el9.x86_64 32/37 2026-02-17T11:01:54.944 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 33/37 2026-02-17T11:01:54.944 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : librados2-2:19.2.3-705.g04cf6dd4.el9.x86_64 34/37 2026-02-17T11:01:54.944 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 35/37 2026-02-17T11:01:54.944 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : librbd1-2:19.2.3-705.g04cf6dd4.el9.x86_64 36/37 2026-02-17T11:01:54.944 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: libradosstriper1-2:19.2.3-705.g04cf6dd4.el9.x86_64 11/37 2026-02-17T11:01:54.972 INFO:teuthology.orchestra.run.trial157.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/37 2026-02-17T11:01:54.976 INFO:teuthology.orchestra.run.trial157.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 13/37 2026-02-17T11:01:54.982 INFO:teuthology.orchestra.run.trial157.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/37 2026-02-17T11:01:54.984 INFO:teuthology.orchestra.run.trial157.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/37 2026-02-17T11:01:54.987 INFO:teuthology.orchestra.run.trial157.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 16/37 2026-02-17T11:01:54.992 INFO:teuthology.orchestra.run.trial157.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/37 2026-02-17T11:01:55.001 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T11:01:55.001 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:01:55.001 INFO:teuthology.orchestra.run.trial097.stdout:Upgraded: 2026-02-17T11:01:55.002 INFO:teuthology.orchestra.run.trial097.stdout: librados2-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:01:55.002 INFO:teuthology.orchestra.run.trial097.stdout: librbd1-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:01:55.002 INFO:teuthology.orchestra.run.trial097.stdout:Installed: 2026-02-17T11:01:55.002 INFO:teuthology.orchestra.run.trial097.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-17T11:01:55.002 INFO:teuthology.orchestra.run.trial097.stdout: ceph-base-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:01:55.002 INFO:teuthology.orchestra.run.trial097.stdout: ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:01:55.002 INFO:teuthology.orchestra.run.trial097.stdout: ceph-radosgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:01:55.002 INFO:teuthology.orchestra.run.trial097.stdout: ceph-selinux-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:01:55.002 INFO:teuthology.orchestra.run.trial097.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-17T11:01:55.002 INFO:teuthology.orchestra.run.trial097.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-17T11:01:55.002 INFO:teuthology.orchestra.run.trial097.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-17T11:01:55.002 INFO:teuthology.orchestra.run.trial097.stdout: libcephfs2-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:01:55.002 INFO:teuthology.orchestra.run.trial097.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-17T11:01:55.003 INFO:teuthology.orchestra.run.trial097.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-17T11:01:55.003 INFO:teuthology.orchestra.run.trial097.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-17T11:01:55.003 INFO:teuthology.orchestra.run.trial097.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-17T11:01:55.003 INFO:teuthology.orchestra.run.trial097.stdout: libradosstriper1-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:01:55.003 INFO:teuthology.orchestra.run.trial097.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-17T11:01:55.003 INFO:teuthology.orchestra.run.trial097.stdout: librgw2-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:01:55.003 INFO:teuthology.orchestra.run.trial097.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-17T11:01:55.003 INFO:teuthology.orchestra.run.trial097.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-17T11:01:55.003 INFO:teuthology.orchestra.run.trial097.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-17T11:01:55.003 INFO:teuthology.orchestra.run.trial097.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-17T11:01:55.003 INFO:teuthology.orchestra.run.trial097.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-17T11:01:55.003 INFO:teuthology.orchestra.run.trial097.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-17T11:01:55.003 INFO:teuthology.orchestra.run.trial097.stdout: python3-ceph-argparse-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:01:55.003 INFO:teuthology.orchestra.run.trial097.stdout: python3-ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:01:55.004 INFO:teuthology.orchestra.run.trial097.stdout: python3-cephfs-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:01:55.004 INFO:teuthology.orchestra.run.trial097.stdout: python3-rados-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:01:55.004 INFO:teuthology.orchestra.run.trial097.stdout: python3-rbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:01:55.004 INFO:teuthology.orchestra.run.trial097.stdout: python3-rgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:01:55.004 INFO:teuthology.orchestra.run.trial097.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-17T11:01:55.004 INFO:teuthology.orchestra.run.trial097.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-17T11:01:55.004 INFO:teuthology.orchestra.run.trial097.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-17T11:01:55.004 INFO:teuthology.orchestra.run.trial097.stdout: re2-1:20211101-20.el9.x86_64 2026-02-17T11:01:55.004 INFO:teuthology.orchestra.run.trial097.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-17T11:01:55.004 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:01:55.004 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-17T11:01:55.042 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install ceph-test 2026-02-17T11:01:55.134 INFO:teuthology.orchestra.run.trial157.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-17T11:01:55.136 INFO:teuthology.orchestra.run.trial157.stdout: Upgrading : librbd1-2:19.2.3-705.g04cf6dd4.el9.x86_64 19/37 2026-02-17T11:01:55.161 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: librbd1-2:19.2.3-705.g04cf6dd4.el9.x86_64 19/37 2026-02-17T11:01:55.164 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-rbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 20/37 2026-02-17T11:01:55.172 INFO:teuthology.orchestra.run.trial157.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/37 2026-02-17T11:01:55.355 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:00:13 ago on Tue 17 Feb 2026 11:01:42 AM UTC. 2026-02-17T11:01:55.398 INFO:teuthology.orchestra.run.trial157.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/37 2026-02-17T11:01:55.399 INFO:teuthology.orchestra.run.trial157.stdout: Installing : librgw2-2:19.2.3-705.g04cf6dd4.el9.x86_64 23/37 2026-02-17T11:01:55.416 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: librgw2-2:19.2.3-705.g04cf6dd4.el9.x86_64 23/37 2026-02-17T11:01:55.419 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-rgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 24/37 2026-02-17T11:01:55.424 INFO:teuthology.orchestra.run.trial157.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/37 2026-02-17T11:01:55.426 INFO:teuthology.orchestra.run.trial157.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/37 2026-02-17T11:01:55.427 INFO:teuthology.orchestra.run.trial157.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-17T11:01:55.437 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-17T11:01:55.438 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:01:55.438 INFO:teuthology.orchestra.run.trial097.stdout: Package Arch Version Repository Size 2026-02-17T11:01:55.438 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:01:55.438 INFO:teuthology.orchestra.run.trial097.stdout:Installing: 2026-02-17T11:01:55.438 INFO:teuthology.orchestra.run.trial097.stdout: ceph-test x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 50 M 2026-02-17T11:01:55.438 INFO:teuthology.orchestra.run.trial097.stdout:Installing dependencies: 2026-02-17T11:01:55.438 INFO:teuthology.orchestra.run.trial097.stdout: libcephsqlite x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 163 k 2026-02-17T11:01:55.438 INFO:teuthology.orchestra.run.trial097.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-17T11:01:55.438 INFO:teuthology.orchestra.run.trial097.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-17T11:01:55.439 INFO:teuthology.orchestra.run.trial097.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-17T11:01:55.439 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:01:55.439 INFO:teuthology.orchestra.run.trial097.stdout:Transaction Summary 2026-02-17T11:01:55.439 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:01:55.439 INFO:teuthology.orchestra.run.trial097.stdout:Install 5 Packages 2026-02-17T11:01:55.439 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:01:55.440 INFO:teuthology.orchestra.run.trial097.stdout:Total download size: 50 M 2026-02-17T11:01:55.440 INFO:teuthology.orchestra.run.trial097.stdout:Installed size: 212 M 2026-02-17T11:01:55.440 INFO:teuthology.orchestra.run.trial097.stdout:Downloading Packages: 2026-02-17T11:01:55.444 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-17T11:01:55.558 INFO:teuthology.orchestra.run.trial157.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/37 2026-02-17T11:01:55.560 INFO:teuthology.orchestra.run.trial157.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 29/37 2026-02-17T11:01:55.591 INFO:teuthology.orchestra.run.trial097.stdout:(1/5): libcephsqlite-19.2.3-705.g04cf6dd4.el9.x 1.9 MB/s | 163 kB 00:00 2026-02-17T11:01:55.641 INFO:teuthology.orchestra.run.trial097.stdout:(2/5): libxslt-1.1.34-12.el9.x86_64.rpm 1.7 MB/s | 233 kB 00:00 2026-02-17T11:01:55.666 INFO:teuthology.orchestra.run.trial097.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.4 MB/s | 64 kB 00:00 2026-02-17T11:01:55.727 INFO:teuthology.orchestra.run.trial097.stdout:(4/5): socat-1.7.4.1-8.el9.x86_64.rpm 2.2 MB/s | 303 kB 00:00 2026-02-17T11:01:55.844 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 29/37 2026-02-17T11:01:55.845 INFO:teuthology.orchestra.run.trial157.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-17T11:01:55.845 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:01:55.883 INFO:teuthology.orchestra.run.trial157.stdout: Installing : mailcap-2.1.49-5.el9.noarch 30/37 2026-02-17T11:01:55.885 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86 31/37 2026-02-17T11:01:56.515 INFO:teuthology.orchestra.run.trial097.stdout:(5/5): ceph-test-19.2.3-705.g04cf6dd4.el9.x86_6 49 MB/s | 50 MB 00:01 2026-02-17T11:01:56.516 INFO:teuthology.orchestra.run.trial097.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:01:56.516 INFO:teuthology.orchestra.run.trial097.stdout:Total 47 MB/s | 50 MB 00:01 2026-02-17T11:01:56.542 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction check 2026-02-17T11:01:56.551 INFO:teuthology.orchestra.run.trial097.stdout:Transaction check succeeded. 2026-02-17T11:01:56.551 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction test 2026-02-17T11:01:56.735 INFO:teuthology.orchestra.run.trial097.stdout:Transaction test succeeded. 2026-02-17T11:01:56.736 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction 2026-02-17T11:01:56.865 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 32/37 2026-02-17T11:01:56.867 INFO:teuthology.orchestra.run.trial157.stdout: Installing : ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 32/37 2026-02-17T11:01:56.945 INFO:teuthology.orchestra.run.trial097.stdout: Preparing : 1/1 2026-02-17T11:01:56.951 INFO:teuthology.orchestra.run.trial097.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-17T11:01:56.955 INFO:teuthology.orchestra.run.trial097.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-17T11:01:56.963 INFO:teuthology.orchestra.run.trial097.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-17T11:01:56.964 INFO:teuthology.orchestra.run.trial097.stdout: Installing : libcephsqlite-2:19.2.3-705.g04cf6dd4.el9.x86_64 4/5 2026-02-17T11:01:57.150 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 32/37 2026-02-17T11:01:57.153 INFO:teuthology.orchestra.run.trial157.stdout: Installing : ceph-base-2:19.2.3-705.g04cf6dd4.el9.x86_64 33/37 2026-02-17T11:01:57.196 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: ceph-base-2:19.2.3-705.g04cf6dd4.el9.x86_64 33/37 2026-02-17T11:01:57.197 INFO:teuthology.orchestra.run.trial157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-17T11:01:57.197 INFO:teuthology.orchestra.run.trial157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-17T11:01:57.197 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:01:57.199 INFO:teuthology.orchestra.run.trial157.stdout: Installing : ceph-selinux-2:19.2.3-705.g04cf6dd4.el9.x86_64 34/37 2026-02-17T11:01:57.999 INFO:teuthology.orchestra.run.trial049.stdout:CentOS Stream 9 - AppStream 968 kB/s | 27 MB 00:28 2026-02-17T11:01:59.206 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: libcephsqlite-2:19.2.3-705.g04cf6dd4.el9.x86_64 4/5 2026-02-17T11:01:59.225 INFO:teuthology.orchestra.run.trial097.stdout: Installing : ceph-test-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/5 2026-02-17T11:01:59.437 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: ceph-test-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/5 2026-02-17T11:01:59.437 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : ceph-test-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/5 2026-02-17T11:01:59.437 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : libcephsqlite-2:19.2.3-705.g04cf6dd4.el9.x86_64 2/5 2026-02-17T11:01:59.437 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-17T11:01:59.437 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-17T11:01:59.489 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-17T11:01:59.489 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:01:59.490 INFO:teuthology.orchestra.run.trial097.stdout:Installed: 2026-02-17T11:01:59.490 INFO:teuthology.orchestra.run.trial097.stdout: ceph-test-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:01:59.490 INFO:teuthology.orchestra.run.trial097.stdout: libcephsqlite-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:01:59.490 INFO:teuthology.orchestra.run.trial097.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-17T11:01:59.490 INFO:teuthology.orchestra.run.trial097.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-17T11:01:59.490 INFO:teuthology.orchestra.run.trial097.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-17T11:01:59.490 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:01:59.490 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-17T11:01:59.523 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install ceph 2026-02-17T11:01:59.809 INFO:teuthology.orchestra.run.trial162.stdout:CentOS Stream 9 - AppStream 984 kB/s | 27 MB 00:27 2026-02-17T11:01:59.824 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:00:17 ago on Tue 17 Feb 2026 11:01:42 AM UTC. 2026-02-17T11:01:59.910 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-17T11:01:59.913 INFO:teuthology.orchestra.run.trial097.stdout:====================================================================================== 2026-02-17T11:01:59.913 INFO:teuthology.orchestra.run.trial097.stdout: Package Arch Version Repository Size 2026-02-17T11:01:59.913 INFO:teuthology.orchestra.run.trial097.stdout:====================================================================================== 2026-02-17T11:01:59.914 INFO:teuthology.orchestra.run.trial097.stdout:Installing: 2026-02-17T11:01:59.914 INFO:teuthology.orchestra.run.trial097.stdout: ceph x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 6.5 k 2026-02-17T11:01:59.914 INFO:teuthology.orchestra.run.trial097.stdout:Installing dependencies: 2026-02-17T11:01:59.914 INFO:teuthology.orchestra.run.trial097.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-17T11:01:59.914 INFO:teuthology.orchestra.run.trial097.stdout: ceph-grafana-dashboards noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 31 k 2026-02-17T11:01:59.914 INFO:teuthology.orchestra.run.trial097.stdout: ceph-mds x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 2.4 M 2026-02-17T11:01:59.914 INFO:teuthology.orchestra.run.trial097.stdout: ceph-mgr x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 1.1 M 2026-02-17T11:01:59.914 INFO:teuthology.orchestra.run.trial097.stdout: ceph-mgr-modules-core noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 253 k 2026-02-17T11:01:59.914 INFO:teuthology.orchestra.run.trial097.stdout: ceph-mon x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 4.7 M 2026-02-17T11:01:59.914 INFO:teuthology.orchestra.run.trial097.stdout: ceph-osd x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 17 M 2026-02-17T11:01:59.914 INFO:teuthology.orchestra.run.trial097.stdout: ceph-prometheus-alerts noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 17 k 2026-02-17T11:01:59.915 INFO:teuthology.orchestra.run.trial097.stdout: cephadm noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 769 k 2026-02-17T11:01:59.915 INFO:teuthology.orchestra.run.trial097.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-17T11:01:59.915 INFO:teuthology.orchestra.run.trial097.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-17T11:01:59.915 INFO:teuthology.orchestra.run.trial097.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-17T11:01:59.915 INFO:teuthology.orchestra.run.trial097.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-17T11:01:59.915 INFO:teuthology.orchestra.run.trial097.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-17T11:01:59.915 INFO:teuthology.orchestra.run.trial097.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-17T11:01:59.915 INFO:teuthology.orchestra.run.trial097.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-17T11:01:59.915 INFO:teuthology.orchestra.run.trial097.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-17T11:01:59.915 INFO:teuthology.orchestra.run.trial097.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-17T11:01:59.915 INFO:teuthology.orchestra.run.trial097.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-17T11:01:59.915 INFO:teuthology.orchestra.run.trial097.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-17T11:01:59.915 INFO:teuthology.orchestra.run.trial097.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-17T11:01:59.916 INFO:teuthology.orchestra.run.trial097.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-17T11:01:59.916 INFO:teuthology.orchestra.run.trial097.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-17T11:01:59.916 INFO:teuthology.orchestra.run.trial097.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-17T11:01:59.916 INFO:teuthology.orchestra.run.trial097.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-17T11:01:59.916 INFO:teuthology.orchestra.run.trial097.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-17T11:01:59.916 INFO:teuthology.orchestra.run.trial097.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-17T11:01:59.916 INFO:teuthology.orchestra.run.trial097.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-17T11:01:59.916 INFO:teuthology.orchestra.run.trial097.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-17T11:01:59.916 INFO:teuthology.orchestra.run.trial097.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-17T11:01:59.916 INFO:teuthology.orchestra.run.trial097.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-17T11:01:59.916 INFO:teuthology.orchestra.run.trial097.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-17T11:01:59.916 INFO:teuthology.orchestra.run.trial097.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-17T11:01:59.917 INFO:teuthology.orchestra.run.trial097.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-17T11:01:59.917 INFO:teuthology.orchestra.run.trial097.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-17T11:01:59.917 INFO:teuthology.orchestra.run.trial097.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-17T11:01:59.917 INFO:teuthology.orchestra.run.trial097.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-17T11:01:59.917 INFO:teuthology.orchestra.run.trial097.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-17T11:01:59.917 INFO:teuthology.orchestra.run.trial097.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-17T11:01:59.917 INFO:teuthology.orchestra.run.trial097.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-17T11:01:59.917 INFO:teuthology.orchestra.run.trial097.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-17T11:01:59.917 INFO:teuthology.orchestra.run.trial097.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-17T11:01:59.917 INFO:teuthology.orchestra.run.trial097.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-17T11:01:59.917 INFO:teuthology.orchestra.run.trial097.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-17T11:01:59.917 INFO:teuthology.orchestra.run.trial097.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-17T11:01:59.917 INFO:teuthology.orchestra.run.trial097.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-17T11:01:59.917 INFO:teuthology.orchestra.run.trial097.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-17T11:01:59.918 INFO:teuthology.orchestra.run.trial097.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-17T11:01:59.918 INFO:teuthology.orchestra.run.trial097.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-17T11:01:59.918 INFO:teuthology.orchestra.run.trial097.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-17T11:01:59.918 INFO:teuthology.orchestra.run.trial097.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-17T11:01:59.918 INFO:teuthology.orchestra.run.trial097.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-17T11:01:59.918 INFO:teuthology.orchestra.run.trial097.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-17T11:01:59.918 INFO:teuthology.orchestra.run.trial097.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-17T11:01:59.918 INFO:teuthology.orchestra.run.trial097.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-17T11:01:59.918 INFO:teuthology.orchestra.run.trial097.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-17T11:01:59.918 INFO:teuthology.orchestra.run.trial097.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-17T11:01:59.918 INFO:teuthology.orchestra.run.trial097.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-17T11:01:59.918 INFO:teuthology.orchestra.run.trial097.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-17T11:01:59.918 INFO:teuthology.orchestra.run.trial097.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-17T11:01:59.919 INFO:teuthology.orchestra.run.trial097.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-17T11:01:59.919 INFO:teuthology.orchestra.run.trial097.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-17T11:01:59.919 INFO:teuthology.orchestra.run.trial097.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-17T11:01:59.919 INFO:teuthology.orchestra.run.trial097.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-17T11:01:59.919 INFO:teuthology.orchestra.run.trial097.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-17T11:01:59.919 INFO:teuthology.orchestra.run.trial097.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-17T11:01:59.919 INFO:teuthology.orchestra.run.trial097.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-17T11:01:59.919 INFO:teuthology.orchestra.run.trial097.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-17T11:01:59.919 INFO:teuthology.orchestra.run.trial097.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-17T11:01:59.919 INFO:teuthology.orchestra.run.trial097.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-17T11:01:59.919 INFO:teuthology.orchestra.run.trial097.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-17T11:01:59.919 INFO:teuthology.orchestra.run.trial097.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-17T11:01:59.919 INFO:teuthology.orchestra.run.trial097.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-17T11:01:59.920 INFO:teuthology.orchestra.run.trial097.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-17T11:01:59.920 INFO:teuthology.orchestra.run.trial097.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-17T11:01:59.920 INFO:teuthology.orchestra.run.trial097.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-17T11:01:59.920 INFO:teuthology.orchestra.run.trial097.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-17T11:01:59.920 INFO:teuthology.orchestra.run.trial097.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-17T11:01:59.920 INFO:teuthology.orchestra.run.trial097.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-17T11:01:59.920 INFO:teuthology.orchestra.run.trial097.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-17T11:01:59.920 INFO:teuthology.orchestra.run.trial097.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-17T11:01:59.920 INFO:teuthology.orchestra.run.trial097.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-17T11:01:59.920 INFO:teuthology.orchestra.run.trial097.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-17T11:01:59.920 INFO:teuthology.orchestra.run.trial097.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-17T11:01:59.920 INFO:teuthology.orchestra.run.trial097.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-17T11:01:59.920 INFO:teuthology.orchestra.run.trial097.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-17T11:01:59.921 INFO:teuthology.orchestra.run.trial097.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-17T11:01:59.921 INFO:teuthology.orchestra.run.trial097.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-17T11:01:59.921 INFO:teuthology.orchestra.run.trial097.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-17T11:01:59.921 INFO:teuthology.orchestra.run.trial097.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-17T11:01:59.921 INFO:teuthology.orchestra.run.trial097.stdout:Installing weak dependencies: 2026-02-17T11:01:59.921 INFO:teuthology.orchestra.run.trial097.stdout: ceph-mgr-cephadm noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 150 k 2026-02-17T11:01:59.921 INFO:teuthology.orchestra.run.trial097.stdout: ceph-mgr-dashboard noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 3.8 M 2026-02-17T11:01:59.921 INFO:teuthology.orchestra.run.trial097.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 7.4 M 2026-02-17T11:01:59.921 INFO:teuthology.orchestra.run.trial097.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 22 k 2026-02-17T11:01:59.921 INFO:teuthology.orchestra.run.trial097.stdout: ceph-mgr-rook noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 49 k 2026-02-17T11:01:59.921 INFO:teuthology.orchestra.run.trial097.stdout: ceph-volume noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 299 k 2026-02-17T11:01:59.921 INFO:teuthology.orchestra.run.trial097.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-17T11:01:59.922 INFO:teuthology.orchestra.run.trial097.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-17T11:01:59.922 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:01:59.922 INFO:teuthology.orchestra.run.trial097.stdout:Transaction Summary 2026-02-17T11:01:59.922 INFO:teuthology.orchestra.run.trial097.stdout:====================================================================================== 2026-02-17T11:01:59.922 INFO:teuthology.orchestra.run.trial097.stdout:Install 99 Packages 2026-02-17T11:01:59.922 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:01:59.923 INFO:teuthology.orchestra.run.trial097.stdout:Total download size: 95 M 2026-02-17T11:01:59.923 INFO:teuthology.orchestra.run.trial097.stdout:Installed size: 520 M 2026-02-17T11:01:59.923 INFO:teuthology.orchestra.run.trial097.stdout:Downloading Packages: 2026-02-17T11:02:00.547 INFO:teuthology.orchestra.run.trial097.stdout:(1/99): ceph-19.2.3-705.g04cf6dd4.el9.x86_64.rp 130 kB/s | 6.5 kB 00:00 2026-02-17T11:02:00.630 INFO:teuthology.orchestra.run.trial097.stdout:(2/99): ceph-mgr-19.2.3-705.g04cf6dd4.el9.x86_6 8.0 MB/s | 1.1 MB 00:00 2026-02-17T11:02:00.702 INFO:teuthology.orchestra.run.trial097.stdout:(3/99): ceph-mds-19.2.3-705.g04cf6dd4.el9.x86_6 12 MB/s | 2.4 MB 00:00 2026-02-17T11:02:00.738 INFO:teuthology.orchestra.run.trial097.stdout:(4/99): ceph-grafana-dashboards-19.2.3-705.g04c 862 kB/s | 31 kB 00:00 2026-02-17T11:02:00.774 INFO:teuthology.orchestra.run.trial097.stdout:(5/99): ceph-mon-19.2.3-705.g04cf6dd4.el9.x86_6 21 MB/s | 4.7 MB 00:00 2026-02-17T11:02:00.774 INFO:teuthology.orchestra.run.trial097.stdout:(6/99): ceph-mgr-cephadm-19.2.3-705.g04cf6dd4.e 4.1 MB/s | 150 kB 00:00 2026-02-17T11:02:00.979 INFO:teuthology.orchestra.run.trial097.stdout:(7/99): ceph-mgr-dashboard-19.2.3-705.g04cf6dd4 19 MB/s | 3.8 MB 00:00 2026-02-17T11:02:01.023 INFO:teuthology.orchestra.run.trial097.stdout:(8/99): ceph-mgr-k8sevents-19.2.3-705.g04cf6dd4 498 kB/s | 22 kB 00:00 2026-02-17T11:02:01.074 INFO:teuthology.orchestra.run.trial097.stdout:(9/99): ceph-mgr-modules-core-19.2.3-705.g04cf6 4.8 MB/s | 253 kB 00:00 2026-02-17T11:02:01.124 INFO:teuthology.orchestra.run.trial097.stdout:(10/99): ceph-mgr-rook-19.2.3-705.g04cf6dd4.el9 1.0 MB/s | 49 kB 00:00 2026-02-17T11:02:01.140 INFO:teuthology.orchestra.run.trial097.stdout:(11/99): ceph-mgr-diskprediction-local-19.2.3-7 20 MB/s | 7.4 MB 00:00 2026-02-17T11:02:01.156 INFO:teuthology.orchestra.run.trial097.stdout:(12/99): ceph-prometheus-alerts-19.2.3-705.g04c 516 kB/s | 17 kB 00:00 2026-02-17T11:02:01.174 INFO:teuthology.orchestra.run.trial097.stdout:(13/99): ceph-volume-19.2.3-705.g04cf6dd4.el9.n 8.6 MB/s | 299 kB 00:00 2026-02-17T11:02:01.203 INFO:teuthology.orchestra.run.trial097.stdout:(14/99): cephadm-19.2.3-705.g04cf6dd4.el9.noarc 16 MB/s | 769 kB 00:00 2026-02-17T11:02:01.208 INFO:teuthology.orchestra.run.trial097.stdout:(15/99): cryptsetup-2.8.1-2.el9.x86_64.rpm 10 MB/s | 350 kB 00:00 2026-02-17T11:02:01.213 INFO:teuthology.orchestra.run.trial097.stdout:(16/99): libconfig-1.7.2-9.el9.x86_64.rpm 15 MB/s | 72 kB 00:00 2026-02-17T11:02:01.215 INFO:teuthology.orchestra.run.trial097.stdout:(17/99): ledmon-libs-1.1.0-3.el9.x86_64.rpm 3.3 MB/s | 40 kB 00:00 2026-02-17T11:02:01.227 INFO:teuthology.orchestra.run.trial097.stdout:(18/99): libquadmath-11.5.0-14.el9.x86_64.rpm 15 MB/s | 184 kB 00:00 2026-02-17T11:02:01.251 INFO:teuthology.orchestra.run.trial097.stdout:(19/99): ceph-osd-19.2.3-705.g04cf6dd4.el9.x86_ 28 MB/s | 17 MB 00:00 2026-02-17T11:02:01.253 INFO:teuthology.orchestra.run.trial097.stdout:(20/99): libgfortran-11.5.0-14.el9.x86_64.rpm 19 MB/s | 794 kB 00:00 2026-02-17T11:02:01.253 INFO:teuthology.orchestra.run.trial097.stdout:(21/99): python3-cffi-1.14.5-5.el9.x86_64.rpm 9.5 MB/s | 253 kB 00:00 2026-02-17T11:02:01.259 INFO:teuthology.orchestra.run.trial097.stdout:(22/99): python3-ply-3.11-14.el9.noarch.rpm 17 MB/s | 106 kB 00:00 2026-02-17T11:02:01.261 INFO:teuthology.orchestra.run.trial097.stdout:(23/99): python3-pycparser-2.20-6.el9.noarch.rp 18 MB/s | 135 kB 00:00 2026-02-17T11:02:01.281 INFO:teuthology.orchestra.run.trial097.stdout:(24/99): python3-cryptography-36.0.1-5.el9.x86_ 42 MB/s | 1.2 MB 00:00 2026-02-17T11:02:01.283 INFO:teuthology.orchestra.run.trial097.stdout:(25/99): python3-requests-2.25.1-10.el9.noarch. 5.5 MB/s | 126 kB 00:00 2026-02-17T11:02:01.284 INFO:teuthology.orchestra.run.trial097.stdout:(26/99): python3-pyparsing-2.4.7-9.el9.noarch.r 5.9 MB/s | 150 kB 00:00 2026-02-17T11:02:01.288 INFO:teuthology.orchestra.run.trial097.stdout:(27/99): python3-urllib3-1.26.5-7.el9.noarch.rp 31 MB/s | 218 kB 00:00 2026-02-17T11:02:01.290 INFO:teuthology.orchestra.run.trial097.stdout:(28/99): zip-3.0-35.el9.x86_64.rpm 43 MB/s | 266 kB 00:00 2026-02-17T11:02:01.293 INFO:teuthology.orchestra.run.trial097.stdout:(29/99): unzip-6.0-59.el9.x86_64.rpm 18 MB/s | 182 kB 00:00 2026-02-17T11:02:01.344 INFO:teuthology.orchestra.run.trial097.stdout:(30/99): flexiblas-openblas-openmp-3.0.4-9.el9. 294 kB/s | 15 kB 00:00 2026-02-17T11:02:01.361 INFO:teuthology.orchestra.run.trial097.stdout:(31/99): flexiblas-3.0.4-9.el9.x86_64.rpm 407 kB/s | 30 kB 00:00 2026-02-17T11:02:01.383 INFO:teuthology.orchestra.run.trial097.stdout:(32/99): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 6.2 MB/s | 246 kB 00:00 2026-02-17T11:02:01.394 INFO:teuthology.orchestra.run.trial097.stdout:(33/99): lua-5.4.4-4.el9.x86_64.rpm 5.5 MB/s | 188 kB 00:00 2026-02-17T11:02:01.407 INFO:teuthology.orchestra.run.trial097.stdout:(34/99): openblas-0.3.29-1.el9.x86_64.rpm 1.7 MB/s | 42 kB 00:00 2026-02-17T11:02:01.497 INFO:teuthology.orchestra.run.trial097.stdout:(35/99): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 14 MB/s | 3.0 MB 00:00 2026-02-17T11:02:01.516 INFO:teuthology.orchestra.run.trial097.stdout:(36/99): protobuf-3.14.0-17.el9.x86_64.rpm 9.2 MB/s | 1.0 MB 00:00 2026-02-17T11:02:01.601 INFO:teuthology.orchestra.run.trial097.stdout:(37/99): python3-devel-3.9.25-2.el9.x86_64.rpm 2.8 MB/s | 244 kB 00:00 2026-02-17T11:02:01.659 INFO:teuthology.orchestra.run.trial097.stdout:(38/99): python3-jinja2-2.11.3-8.el9.noarch.rpm 4.2 MB/s | 249 kB 00:00 2026-02-17T11:02:01.692 INFO:teuthology.orchestra.run.trial097.stdout:(39/99): openblas-openmp-0.3.29-1.el9.x86_64.rp 18 MB/s | 5.3 MB 00:00 2026-02-17T11:02:01.757 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: ceph-selinux-2:19.2.3-705.g04cf6dd4.el9.x86_64 34/37 2026-02-17T11:02:01.757 INFO:teuthology.orchestra.run.trial157.stdout:skipping the directory /sys 2026-02-17T11:02:01.757 INFO:teuthology.orchestra.run.trial157.stdout:skipping the directory /proc 2026-02-17T11:02:01.757 INFO:teuthology.orchestra.run.trial157.stdout:skipping the directory /mnt 2026-02-17T11:02:01.757 INFO:teuthology.orchestra.run.trial157.stdout:skipping the directory /var/tmp 2026-02-17T11:02:01.758 INFO:teuthology.orchestra.run.trial157.stdout:skipping the directory /home 2026-02-17T11:02:01.758 INFO:teuthology.orchestra.run.trial157.stdout:skipping the directory /root 2026-02-17T11:02:01.758 INFO:teuthology.orchestra.run.trial157.stdout:skipping the directory /tmp 2026-02-17T11:02:01.758 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:02:01.761 INFO:teuthology.orchestra.run.trial097.stdout:(40/99): python3-libstoragemgmt-1.10.1-1.el9.x8 1.7 MB/s | 177 kB 00:00 2026-02-17T11:02:01.828 INFO:teuthology.orchestra.run.trial097.stdout:(41/99): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2026-02-17T11:02:01.830 INFO:teuthology.orchestra.run.trial097.stdout:(42/99): python3-lxml-4.6.5-3.el9.x86_64.rpm 8.9 MB/s | 1.2 MB 00:00 2026-02-17T11:02:01.845 INFO:teuthology.orchestra.run.trial097.stdout:(43/99): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2026-02-17T11:02:01.872 INFO:teuthology.orchestra.run.trial097.stdout:(44/99): python3-markupsafe-1.1.1-12.el9.x86_64 775 kB/s | 35 kB 00:00 2026-02-17T11:02:01.927 INFO:teuthology.orchestra.run.trial097.stdout:(45/99): python3-numpy-f2py-1.23.5-2.el9.x86_64 5.3 MB/s | 442 kB 00:00 2026-02-17T11:02:01.927 INFO:teuthology.orchestra.run.trial097.stdout:(46/99): python3-packaging-20.9-5.el9.noarch.rp 1.4 MB/s | 77 kB 00:00 2026-02-17T11:02:01.943 INFO:teuthology.orchestra.run.trial049.stdout:CentOS Stream 9 - CRB 5.0 MB/s | 7.8 MB 00:01 2026-02-17T11:02:01.965 INFO:teuthology.orchestra.run.trial097.stdout:(47/99): python3-pyasn1-0.4.8-6.el9.noarch.rpm 4.2 MB/s | 159 kB 00:00 2026-02-17T11:02:01.969 INFO:teuthology.orchestra.run.trial097.stdout:(48/99): python3-protobuf-3.14.0-17.el9.noarch. 6.3 MB/s | 267 kB 00:00 2026-02-17T11:02:01.987 INFO:teuthology.orchestra.run.trial097.stdout:(49/99): python3-numpy-1.23.5-2.el9.x86_64.rpm 39 MB/s | 6.1 MB 00:00 2026-02-17T11:02:01.993 INFO:teuthology.orchestra.run.trial097.stdout:(50/99): python3-requests-oauthlib-1.3.0-12.el9 2.2 MB/s | 54 kB 00:00 2026-02-17T11:02:01.995 INFO:teuthology.orchestra.run.trial097.stdout:(51/99): python3-pyasn1-modules-0.4.8-6.el9.noa 8.9 MB/s | 279 kB 00:00 2026-02-17T11:02:02.024 INFO:teuthology.orchestra.run.trial097.stdout:(52/99): python3-toml-0.10.2-6.el9.noarch.rpm 1.3 MB/s | 42 kB 00:00 2026-02-17T11:02:02.030 INFO:teuthology.orchestra.run.trial097.stdout:(53/99): xmlsec1-1.2.29-13.el9.x86_64.rpm 5.3 MB/s | 189 kB 00:00 2026-02-17T11:02:02.053 INFO:teuthology.orchestra.run.trial097.stdout:(54/99): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 3.1 MB/s | 90 kB 00:00 2026-02-17T11:02:02.128 INFO:teuthology.orchestra.run.trial097.stdout:(55/99): python3-scipy-1.9.3-2.el9.x86_64.rpm 137 MB/s | 19 MB 00:00 2026-02-17T11:02:02.209 INFO:teuthology.orchestra.run.trial157.stdout: Installing : ceph-radosgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 35/37 2026-02-17T11:02:02.233 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 35/37 2026-02-17T11:02:02.233 INFO:teuthology.orchestra.run.trial157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:02:02.233 INFO:teuthology.orchestra.run.trial157.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-17T11:02:02.233 INFO:teuthology.orchestra.run.trial157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T11:02:02.233 INFO:teuthology.orchestra.run.trial157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T11:02:02.233 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:02:02.235 INFO:teuthology.orchestra.run.trial157.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-17T11:02:02.247 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-17T11:02:02.247 INFO:teuthology.orchestra.run.trial157.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T11:02:02.299 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T11:02:02.299 INFO:teuthology.orchestra.run.trial157.stdout:Creating group 'qat' with GID 992. 2026-02-17T11:02:02.299 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:02:02.467 INFO:teuthology.orchestra.run.trial097.stdout:(56/99): lua-devel-5.4.4-4.el9.x86_64.rpm 51 kB/s | 22 kB 00:00 2026-02-17T11:02:02.571 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : ceph-base-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/37 2026-02-17T11:02:02.572 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 2/37 2026-02-17T11:02:02.572 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : ceph-radosgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 3/37 2026-02-17T11:02:02.572 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : ceph-selinux-2:19.2.3-705.g04cf6dd4.el9.x86_64 4/37 2026-02-17T11:02:02.572 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : libcephfs2-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/37 2026-02-17T11:02:02.572 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : libradosstriper1-2:19.2.3-705.g04cf6dd4.el9.x86_64 6/37 2026-02-17T11:02:02.572 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : librgw2-2:19.2.3-705.g04cf6dd4.el9.x86_64 7/37 2026-02-17T11:02:02.572 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-ceph-argparse-2:19.2.3-705.g04cf6dd4.el9.x 8/37 2026-02-17T11:02:02.572 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86 9/37 2026-02-17T11:02:02.572 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-cephfs-2:19.2.3-705.g04cf6dd4.el9.x86_64 10/37 2026-02-17T11:02:02.572 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-rados-2:19.2.3-705.g04cf6dd4.el9.x86_64 11/37 2026-02-17T11:02:02.573 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-rbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 12/37 2026-02-17T11:02:02.573 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-rgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 13/37 2026-02-17T11:02:02.573 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/37 2026-02-17T11:02:02.573 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 15/37 2026-02-17T11:02:02.573 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 16/37 2026-02-17T11:02:02.573 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 17/37 2026-02-17T11:02:02.573 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-17T11:02:02.573 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 19/37 2026-02-17T11:02:02.573 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 20/37 2026-02-17T11:02:02.573 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 21/37 2026-02-17T11:02:02.573 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 22/37 2026-02-17T11:02:02.574 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 23/37 2026-02-17T11:02:02.574 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 24/37 2026-02-17T11:02:02.574 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 25/37 2026-02-17T11:02:02.574 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 26/37 2026-02-17T11:02:02.574 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 27/37 2026-02-17T11:02:02.574 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 28/37 2026-02-17T11:02:02.574 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 29/37 2026-02-17T11:02:02.574 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 30/37 2026-02-17T11:02:02.574 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 31/37 2026-02-17T11:02:02.574 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : re2-1:20211101-20.el9.x86_64 32/37 2026-02-17T11:02:02.574 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 33/37 2026-02-17T11:02:02.575 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : librados2-2:19.2.3-705.g04cf6dd4.el9.x86_64 34/37 2026-02-17T11:02:02.575 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 35/37 2026-02-17T11:02:02.575 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : librbd1-2:19.2.3-705.g04cf6dd4.el9.x86_64 36/37 2026-02-17T11:02:02.632 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T11:02:02.632 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:02:02.632 INFO:teuthology.orchestra.run.trial157.stdout:Upgraded: 2026-02-17T11:02:02.632 INFO:teuthology.orchestra.run.trial157.stdout: librados2-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:02.632 INFO:teuthology.orchestra.run.trial157.stdout: librbd1-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:02.632 INFO:teuthology.orchestra.run.trial157.stdout:Installed: 2026-02-17T11:02:02.632 INFO:teuthology.orchestra.run.trial157.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-17T11:02:02.633 INFO:teuthology.orchestra.run.trial157.stdout: ceph-base-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:02.633 INFO:teuthology.orchestra.run.trial157.stdout: ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:02.633 INFO:teuthology.orchestra.run.trial157.stdout: ceph-radosgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:02.633 INFO:teuthology.orchestra.run.trial157.stdout: ceph-selinux-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:02.633 INFO:teuthology.orchestra.run.trial157.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-17T11:02:02.633 INFO:teuthology.orchestra.run.trial157.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-17T11:02:02.633 INFO:teuthology.orchestra.run.trial157.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-17T11:02:02.633 INFO:teuthology.orchestra.run.trial157.stdout: libcephfs2-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:02.633 INFO:teuthology.orchestra.run.trial157.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-17T11:02:02.633 INFO:teuthology.orchestra.run.trial157.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-17T11:02:02.633 INFO:teuthology.orchestra.run.trial157.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-17T11:02:02.633 INFO:teuthology.orchestra.run.trial157.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-17T11:02:02.634 INFO:teuthology.orchestra.run.trial157.stdout: libradosstriper1-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:02.634 INFO:teuthology.orchestra.run.trial157.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-17T11:02:02.634 INFO:teuthology.orchestra.run.trial157.stdout: librgw2-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:02.634 INFO:teuthology.orchestra.run.trial157.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-17T11:02:02.634 INFO:teuthology.orchestra.run.trial157.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-17T11:02:02.634 INFO:teuthology.orchestra.run.trial157.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-17T11:02:02.634 INFO:teuthology.orchestra.run.trial157.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-17T11:02:02.634 INFO:teuthology.orchestra.run.trial157.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-17T11:02:02.634 INFO:teuthology.orchestra.run.trial157.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-17T11:02:02.634 INFO:teuthology.orchestra.run.trial157.stdout: python3-ceph-argparse-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:02.634 INFO:teuthology.orchestra.run.trial157.stdout: python3-ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:02.635 INFO:teuthology.orchestra.run.trial157.stdout: python3-cephfs-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:02.635 INFO:teuthology.orchestra.run.trial157.stdout: python3-rados-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:02.635 INFO:teuthology.orchestra.run.trial157.stdout: python3-rbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:02.635 INFO:teuthology.orchestra.run.trial157.stdout: python3-rgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:02.635 INFO:teuthology.orchestra.run.trial157.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-17T11:02:02.635 INFO:teuthology.orchestra.run.trial157.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-17T11:02:02.635 INFO:teuthology.orchestra.run.trial157.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-17T11:02:02.635 INFO:teuthology.orchestra.run.trial157.stdout: re2-1:20211101-20.el9.x86_64 2026-02-17T11:02:02.635 INFO:teuthology.orchestra.run.trial157.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-17T11:02:02.635 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:02:02.635 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-17T11:02:02.655 INFO:teuthology.orchestra.run.trial097.stdout:(57/99): abseil-cpp-20211102.0-4.el9.x86_64.rpm 1.0 MB/s | 551 kB 00:00 2026-02-17T11:02:02.674 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install ceph-test 2026-02-17T11:02:02.717 INFO:teuthology.orchestra.run.trial097.stdout:(58/99): grpc-data-1.46.7-10.el9.noarch.rpm 78 kB/s | 19 kB 00:00 2026-02-17T11:02:02.726 INFO:teuthology.orchestra.run.trial097.stdout:(59/99): luarocks-3.9.2-5.el9.noarch.rpm 2.1 MB/s | 151 kB 00:00 2026-02-17T11:02:02.789 INFO:teuthology.orchestra.run.trial097.stdout:(60/99): python3-autocommand-2.2.2-8.el9.noarch 471 kB/s | 29 kB 00:00 2026-02-17T11:02:02.795 INFO:teuthology.orchestra.run.trial049.stdout:CentOS Stream 9 - Extras packages 183 kB/s | 20 kB 00:00 2026-02-17T11:02:02.854 INFO:teuthology.orchestra.run.trial097.stdout:(61/99): python3-backports-tarfile-1.2.0-1.el9. 922 kB/s | 60 kB 00:00 2026-02-17T11:02:02.917 INFO:teuthology.orchestra.run.trial097.stdout:(62/99): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 686 kB/s | 43 kB 00:00 2026-02-17T11:02:02.980 INFO:teuthology.orchestra.run.trial097.stdout:(63/99): python3-cachetools-4.2.4-1.el9.noarch. 515 kB/s | 32 kB 00:00 2026-02-17T11:02:02.989 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:00:17 ago on Tue 17 Feb 2026 11:01:45 AM UTC. 2026-02-17T11:02:03.037 INFO:teuthology.orchestra.run.trial097.stdout:(64/99): python3-asyncssh-2.13.2-5.el9.noarch.r 1.7 MB/s | 548 kB 00:00 2026-02-17T11:02:03.041 INFO:teuthology.orchestra.run.trial097.stdout:(65/99): python3-certifi-2023.05.07-4.el9.noarc 230 kB/s | 14 kB 00:00 2026-02-17T11:02:03.059 INFO:teuthology.orchestra.run.trial162.stdout:CentOS Stream 9 - CRB 8.7 MB/s | 7.8 MB 00:00 2026-02-17T11:02:03.071 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-17T11:02:03.072 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:02:03.072 INFO:teuthology.orchestra.run.trial157.stdout: Package Arch Version Repository Size 2026-02-17T11:02:03.072 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:02:03.073 INFO:teuthology.orchestra.run.trial157.stdout:Installing: 2026-02-17T11:02:03.073 INFO:teuthology.orchestra.run.trial157.stdout: ceph-test x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 50 M 2026-02-17T11:02:03.073 INFO:teuthology.orchestra.run.trial157.stdout:Installing dependencies: 2026-02-17T11:02:03.073 INFO:teuthology.orchestra.run.trial157.stdout: libcephsqlite x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 163 k 2026-02-17T11:02:03.073 INFO:teuthology.orchestra.run.trial157.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-17T11:02:03.073 INFO:teuthology.orchestra.run.trial157.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-17T11:02:03.073 INFO:teuthology.orchestra.run.trial157.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-17T11:02:03.073 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:02:03.073 INFO:teuthology.orchestra.run.trial157.stdout:Transaction Summary 2026-02-17T11:02:03.073 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:02:03.073 INFO:teuthology.orchestra.run.trial157.stdout:Install 5 Packages 2026-02-17T11:02:03.074 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:02:03.074 INFO:teuthology.orchestra.run.trial157.stdout:Total download size: 50 M 2026-02-17T11:02:03.074 INFO:teuthology.orchestra.run.trial157.stdout:Installed size: 212 M 2026-02-17T11:02:03.074 INFO:teuthology.orchestra.run.trial157.stdout:Downloading Packages: 2026-02-17T11:02:03.110 INFO:teuthology.orchestra.run.trial097.stdout:(66/99): python3-cheroot-10.0.1-4.el9.noarch.rp 2.3 MB/s | 173 kB 00:00 2026-02-17T11:02:03.129 INFO:teuthology.orchestra.run.trial097.stdout:(67/99): python3-cherrypy-18.6.1-2.el9.noarch.r 4.0 MB/s | 358 kB 00:00 2026-02-17T11:02:03.189 INFO:teuthology.orchestra.run.trial097.stdout:(68/99): python3-google-auth-2.45.0-1.el9.noarc 3.1 MB/s | 254 kB 00:00 2026-02-17T11:02:03.220 INFO:teuthology.orchestra.run.trial157.stdout:(1/5): libcephsqlite-19.2.3-705.g04cf6dd4.el9.x 1.9 MB/s | 163 kB 00:00 2026-02-17T11:02:03.261 INFO:teuthology.orchestra.run.trial097.stdout:(69/99): python3-grpcio-tools-1.46.7-10.el9.x86 2.0 MB/s | 144 kB 00:00 2026-02-17T11:02:03.277 INFO:teuthology.orchestra.run.trial157.stdout:(2/5): libxslt-1.1.34-12.el9.x86_64.rpm 1.6 MB/s | 233 kB 00:00 2026-02-17T11:02:03.297 INFO:teuthology.orchestra.run.trial157.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 3.1 MB/s | 64 kB 00:00 2026-02-17T11:02:03.324 INFO:teuthology.orchestra.run.trial097.stdout:(70/99): python3-grpcio-1.46.7-10.el9.x86_64.rp 10 MB/s | 2.0 MB 00:00 2026-02-17T11:02:03.331 INFO:teuthology.orchestra.run.trial097.stdout:(71/99): python3-influxdb-5.3.1-1.el9.noarch.rp 1.9 MB/s | 139 kB 00:00 2026-02-17T11:02:03.336 INFO:teuthology.orchestra.run.trial157.stdout:(4/5): socat-1.7.4.1-8.el9.x86_64.rpm 2.5 MB/s | 303 kB 00:00 2026-02-17T11:02:03.385 INFO:teuthology.orchestra.run.trial097.stdout:(72/99): python3-isodate-0.6.1-3.el9.noarch.rpm 915 kB/s | 56 kB 00:00 2026-02-17T11:02:03.392 INFO:teuthology.orchestra.run.trial097.stdout:(73/99): python3-jaraco-8.2.1-3.el9.noarch.rpm 175 kB/s | 11 kB 00:00 2026-02-17T11:02:03.446 INFO:teuthology.orchestra.run.trial097.stdout:(74/99): python3-jaraco-classes-3.2.1-5.el9.noa 289 kB/s | 18 kB 00:00 2026-02-17T11:02:03.453 INFO:teuthology.orchestra.run.trial097.stdout:(75/99): python3-jaraco-collections-3.0.0-8.el9 377 kB/s | 23 kB 00:00 2026-02-17T11:02:03.507 INFO:teuthology.orchestra.run.trial097.stdout:(76/99): python3-jaraco-context-6.0.1-3.el9.noa 321 kB/s | 20 kB 00:00 2026-02-17T11:02:03.515 INFO:teuthology.orchestra.run.trial097.stdout:(77/99): python3-jaraco-functools-3.5.0-2.el9.n 315 kB/s | 19 kB 00:00 2026-02-17T11:02:03.534 INFO:teuthology.orchestra.run.trial097.stdout:(78/99): protobuf-compiler-3.14.0-17.el9.x86_64 582 kB/s | 862 kB 00:01 2026-02-17T11:02:03.570 INFO:teuthology.orchestra.run.trial097.stdout:(79/99): python3-jaraco-text-4.0.0-2.el9.noarch 422 kB/s | 26 kB 00:00 2026-02-17T11:02:03.632 INFO:teuthology.orchestra.run.trial097.stdout:(80/99): python3-more-itertools-8.12.0-2.el9.no 1.2 MB/s | 79 kB 00:00 2026-02-17T11:02:03.653 INFO:teuthology.orchestra.run.trial097.stdout:(81/99): python3-kubernetes-26.1.0-3.el9.noarch 7.4 MB/s | 1.0 MB 00:00 2026-02-17T11:02:03.694 INFO:teuthology.orchestra.run.trial097.stdout:(82/99): python3-msgpack-1.0.3-2.el9.x86_64.rpm 1.4 MB/s | 86 kB 00:00 2026-02-17T11:02:03.716 INFO:teuthology.orchestra.run.trial097.stdout:(83/99): python3-natsort-7.1.1-5.el9.noarch.rpm 930 kB/s | 58 kB 00:00 2026-02-17T11:02:03.767 INFO:teuthology.orchestra.run.trial097.stdout:(84/99): python3-pecan-1.4.2-3.el9.noarch.rpm 3.7 MB/s | 272 kB 00:00 2026-02-17T11:02:03.777 INFO:teuthology.orchestra.run.trial097.stdout:(85/99): python3-portend-3.1.0-2.el9.noarch.rpm 268 kB/s | 16 kB 00:00 2026-02-17T11:02:03.825 INFO:teuthology.orchestra.run.trial097.stdout:(86/99): python3-logutils-0.3.5-21.el9.noarch.r 159 kB/s | 46 kB 00:00 2026-02-17T11:02:03.829 INFO:teuthology.orchestra.run.trial097.stdout:(87/99): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.4 MB/s | 90 kB 00:00 2026-02-17T11:02:03.838 INFO:teuthology.orchestra.run.trial097.stdout:(88/99): python3-repoze-lru-0.7-16.el9.noarch.r 502 kB/s | 31 kB 00:00 2026-02-17T11:02:03.890 INFO:teuthology.orchestra.run.trial097.stdout:(89/99): python3-rsa-4.9-2.el9.noarch.rpm 965 kB/s | 59 kB 00:00 2026-02-17T11:02:03.902 INFO:teuthology.orchestra.run.trial097.stdout:(90/99): python3-saml-1.16.0-1.el9.noarch.rpm 1.9 MB/s | 125 kB 00:00 2026-02-17T11:02:03.952 INFO:teuthology.orchestra.run.trial097.stdout:(91/99): python3-tempora-5.0.0-2.el9.noarch.rpm 584 kB/s | 36 kB 00:00 2026-02-17T11:02:03.965 INFO:teuthology.orchestra.run.trial097.stdout:(92/99): python3-typing-extensions-4.15.0-1.el9 1.3 MB/s | 86 kB 00:00 2026-02-17T11:02:04.021 INFO:teuthology.orchestra.run.trial097.stdout:(93/99): python3-routes-2.5.1-5.el9.noarch.rpm 963 kB/s | 188 kB 00:00 2026-02-17T11:02:04.022 INFO:teuthology.orchestra.run.trial097.stdout:(94/99): python3-webob-1.8.8-2.el9.noarch.rpm 3.2 MB/s | 230 kB 00:00 2026-02-17T11:02:04.028 INFO:teuthology.orchestra.run.trial097.stdout:(95/99): python3-websocket-client-1.2.3-2.el9.n 1.4 MB/s | 90 kB 00:00 2026-02-17T11:02:04.095 INFO:teuthology.orchestra.run.trial097.stdout:(96/99): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 668 kB/s | 48 kB 00:00 2026-02-17T11:02:04.096 INFO:teuthology.orchestra.run.trial097.stdout:(97/99): python3-xmltodict-0.12.0-15.el9.noarch 326 kB/s | 22 kB 00:00 2026-02-17T11:02:04.154 INFO:teuthology.orchestra.run.trial157.stdout:(5/5): ceph-test-19.2.3-705.g04cf6dd4.el9.x86_6 49 MB/s | 50 MB 00:01 2026-02-17T11:02:04.156 INFO:teuthology.orchestra.run.trial157.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:02:04.156 INFO:teuthology.orchestra.run.trial157.stdout:Total 46 MB/s | 50 MB 00:01 2026-02-17T11:02:04.156 INFO:teuthology.orchestra.run.trial097.stdout:(98/99): python3-zc-lockfile-2.0-10.el9.noarch. 327 kB/s | 20 kB 00:00 2026-02-17T11:02:04.183 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction check 2026-02-17T11:02:04.192 INFO:teuthology.orchestra.run.trial097.stdout:(99/99): python3-werkzeug-2.0.3-3.el9.1.noarch. 2.4 MB/s | 427 kB 00:00 2026-02-17T11:02:04.193 INFO:teuthology.orchestra.run.trial157.stdout:Transaction check succeeded. 2026-02-17T11:02:04.193 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction test 2026-02-17T11:02:04.196 INFO:teuthology.orchestra.run.trial097.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:02:04.197 INFO:teuthology.orchestra.run.trial097.stdout:Total 22 MB/s | 95 MB 00:04 2026-02-17T11:02:04.377 INFO:teuthology.orchestra.run.trial157.stdout:Transaction test succeeded. 2026-02-17T11:02:04.377 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction 2026-02-17T11:02:04.589 INFO:teuthology.orchestra.run.trial157.stdout: Preparing : 1/1 2026-02-17T11:02:04.595 INFO:teuthology.orchestra.run.trial157.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-17T11:02:04.599 INFO:teuthology.orchestra.run.trial157.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-17T11:02:04.607 INFO:teuthology.orchestra.run.trial157.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-17T11:02:04.608 INFO:teuthology.orchestra.run.trial157.stdout: Installing : libcephsqlite-2:19.2.3-705.g04cf6dd4.el9.x86_64 4/5 2026-02-17T11:02:04.620 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction check 2026-02-17T11:02:04.657 INFO:teuthology.orchestra.run.trial097.stdout:Transaction check succeeded. 2026-02-17T11:02:04.657 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction test 2026-02-17T11:02:04.946 INFO:teuthology.orchestra.run.trial162.stdout:CentOS Stream 9 - Extras packages 17 kB/s | 20 kB 00:01 2026-02-17T11:02:05.073 INFO:teuthology.orchestra.run.trial097.stdout:Transaction test succeeded. 2026-02-17T11:02:05.073 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction 2026-02-17T11:02:05.513 INFO:teuthology.orchestra.run.trial097.stdout: Preparing : 1/1 2026-02-17T11:02:05.515 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/99 2026-02-17T11:02:05.546 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/99 2026-02-17T11:02:05.551 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 3/99 2026-02-17T11:02:05.572 INFO:teuthology.orchestra.run.trial097.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 4/99 2026-02-17T11:02:05.578 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 5/99 2026-02-17T11:02:05.612 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 6/99 2026-02-17T11:02:05.621 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 7/99 2026-02-17T11:02:05.626 INFO:teuthology.orchestra.run.trial097.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 8/99 2026-02-17T11:02:05.628 INFO:teuthology.orchestra.run.trial097.stdout: Installing : lua-5.4.4-4.el9.x86_64 9/99 2026-02-17T11:02:05.633 INFO:teuthology.orchestra.run.trial097.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 10/99 2026-02-17T11:02:05.656 INFO:teuthology.orchestra.run.trial097.stdout: Installing : unzip-6.0-59.el9.x86_64 11/99 2026-02-17T11:02:05.668 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 12/99 2026-02-17T11:02:05.671 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 13/99 2026-02-17T11:02:05.677 INFO:teuthology.orchestra.run.trial097.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 14/99 2026-02-17T11:02:05.679 INFO:teuthology.orchestra.run.trial097.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 15/99 2026-02-17T11:02:05.690 INFO:teuthology.orchestra.run.trial097.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 16/99 2026-02-17T11:02:05.696 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 17/99 2026-02-17T11:02:05.720 INFO:teuthology.orchestra.run.trial097.stdout: Installing : zip-3.0-35.el9.x86_64 18/99 2026-02-17T11:02:05.723 INFO:teuthology.orchestra.run.trial097.stdout: Installing : luarocks-3.9.2-5.el9.noarch 19/99 2026-02-17T11:02:05.730 INFO:teuthology.orchestra.run.trial097.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 20/99 2026-02-17T11:02:05.755 INFO:teuthology.orchestra.run.trial097.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 21/99 2026-02-17T11:02:05.807 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 22/99 2026-02-17T11:02:05.820 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 23/99 2026-02-17T11:02:05.822 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-rsa-4.9-2.el9.noarch 24/99 2026-02-17T11:02:05.827 INFO:teuthology.orchestra.run.trial097.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 25/99 2026-02-17T11:02:05.832 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 26/99 2026-02-17T11:02:05.837 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 27/99 2026-02-17T11:02:05.840 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 28/99 2026-02-17T11:02:05.855 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 29/99 2026-02-17T11:02:05.876 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 30/99 2026-02-17T11:02:05.880 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 31/99 2026-02-17T11:02:05.886 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 32/99 2026-02-17T11:02:05.897 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 33/99 2026-02-17T11:02:05.906 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 34/99 2026-02-17T11:02:05.912 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 35/99 2026-02-17T11:02:05.932 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 36/99 2026-02-17T11:02:05.941 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 37/99 2026-02-17T11:02:05.995 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 38/99 2026-02-17T11:02:06.007 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 39/99 2026-02-17T11:02:06.023 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 40/99 2026-02-17T11:02:06.028 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 41/99 2026-02-17T11:02:06.035 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 42/99 2026-02-17T11:02:06.076 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 43/99 2026-02-17T11:02:06.235 INFO:teuthology.orchestra.run.trial162.stdout:Extra Packages for Enterprise Linux 17 MB/s | 20 MB 00:01 2026-02-17T11:02:06.403 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 44/99 2026-02-17T11:02:06.413 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 45/99 2026-02-17T11:02:06.417 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 46/99 2026-02-17T11:02:06.423 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 47/99 2026-02-17T11:02:06.425 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 48/99 2026-02-17T11:02:06.453 INFO:teuthology.orchestra.run.trial097.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 49/99 2026-02-17T11:02:06.496 INFO:teuthology.orchestra.run.trial097.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 50/99 2026-02-17T11:02:06.502 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 51/99 2026-02-17T11:02:06.506 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 52/99 2026-02-17T11:02:06.512 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 53/99 2026-02-17T11:02:06.515 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 54/99 2026-02-17T11:02:06.522 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 55/99 2026-02-17T11:02:06.526 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 56/99 2026-02-17T11:02:06.554 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 57/99 2026-02-17T11:02:06.564 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 58/99 2026-02-17T11:02:06.598 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 59/99 2026-02-17T11:02:06.624 INFO:teuthology.orchestra.run.trial049.stdout:Extra Packages for Enterprise Linux 5.4 MB/s | 20 MB 00:03 2026-02-17T11:02:06.824 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 60/99 2026-02-17T11:02:06.848 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 61/99 2026-02-17T11:02:06.852 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 62/99 2026-02-17T11:02:06.894 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: libcephsqlite-2:19.2.3-705.g04cf6dd4.el9.x86_64 4/5 2026-02-17T11:02:06.909 INFO:teuthology.orchestra.run.trial097.stdout: Installing : openblas-0.3.29-1.el9.x86_64 63/99 2026-02-17T11:02:06.911 INFO:teuthology.orchestra.run.trial097.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 64/99 2026-02-17T11:02:06.912 INFO:teuthology.orchestra.run.trial157.stdout: Installing : ceph-test-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/5 2026-02-17T11:02:06.932 INFO:teuthology.orchestra.run.trial097.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 65/99 2026-02-17T11:02:07.145 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: ceph-test-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/5 2026-02-17T11:02:07.146 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : ceph-test-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/5 2026-02-17T11:02:07.146 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : libcephsqlite-2:19.2.3-705.g04cf6dd4.el9.x86_64 2/5 2026-02-17T11:02:07.146 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-17T11:02:07.146 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-17T11:02:07.199 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-17T11:02:07.199 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:02:07.199 INFO:teuthology.orchestra.run.trial157.stdout:Installed: 2026-02-17T11:02:07.199 INFO:teuthology.orchestra.run.trial157.stdout: ceph-test-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:07.199 INFO:teuthology.orchestra.run.trial157.stdout: libcephsqlite-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:07.199 INFO:teuthology.orchestra.run.trial157.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-17T11:02:07.199 INFO:teuthology.orchestra.run.trial157.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-17T11:02:07.199 INFO:teuthology.orchestra.run.trial157.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-17T11:02:07.200 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:02:07.200 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-17T11:02:07.232 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install ceph 2026-02-17T11:02:07.259 INFO:teuthology.orchestra.run.trial097.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 66/99 2026-02-17T11:02:07.333 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 67/99 2026-02-17T11:02:07.533 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:00:22 ago on Tue 17 Feb 2026 11:01:45 AM UTC. 2026-02-17T11:02:07.620 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-17T11:02:07.623 INFO:teuthology.orchestra.run.trial157.stdout:====================================================================================== 2026-02-17T11:02:07.623 INFO:teuthology.orchestra.run.trial157.stdout: Package Arch Version Repository Size 2026-02-17T11:02:07.623 INFO:teuthology.orchestra.run.trial157.stdout:====================================================================================== 2026-02-17T11:02:07.623 INFO:teuthology.orchestra.run.trial157.stdout:Installing: 2026-02-17T11:02:07.623 INFO:teuthology.orchestra.run.trial157.stdout: ceph x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 6.5 k 2026-02-17T11:02:07.623 INFO:teuthology.orchestra.run.trial157.stdout:Installing dependencies: 2026-02-17T11:02:07.623 INFO:teuthology.orchestra.run.trial157.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-17T11:02:07.623 INFO:teuthology.orchestra.run.trial157.stdout: ceph-grafana-dashboards noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 31 k 2026-02-17T11:02:07.624 INFO:teuthology.orchestra.run.trial157.stdout: ceph-mds x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 2.4 M 2026-02-17T11:02:07.624 INFO:teuthology.orchestra.run.trial157.stdout: ceph-mgr x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 1.1 M 2026-02-17T11:02:07.624 INFO:teuthology.orchestra.run.trial157.stdout: ceph-mgr-modules-core noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 253 k 2026-02-17T11:02:07.624 INFO:teuthology.orchestra.run.trial157.stdout: ceph-mon x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 4.7 M 2026-02-17T11:02:07.624 INFO:teuthology.orchestra.run.trial157.stdout: ceph-osd x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 17 M 2026-02-17T11:02:07.624 INFO:teuthology.orchestra.run.trial157.stdout: ceph-prometheus-alerts noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 17 k 2026-02-17T11:02:07.624 INFO:teuthology.orchestra.run.trial157.stdout: cephadm noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 769 k 2026-02-17T11:02:07.624 INFO:teuthology.orchestra.run.trial157.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-17T11:02:07.624 INFO:teuthology.orchestra.run.trial157.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-17T11:02:07.624 INFO:teuthology.orchestra.run.trial157.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-17T11:02:07.624 INFO:teuthology.orchestra.run.trial157.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-17T11:02:07.624 INFO:teuthology.orchestra.run.trial157.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-17T11:02:07.625 INFO:teuthology.orchestra.run.trial157.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-17T11:02:07.625 INFO:teuthology.orchestra.run.trial157.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-17T11:02:07.625 INFO:teuthology.orchestra.run.trial157.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-17T11:02:07.625 INFO:teuthology.orchestra.run.trial157.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-17T11:02:07.625 INFO:teuthology.orchestra.run.trial157.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-17T11:02:07.625 INFO:teuthology.orchestra.run.trial157.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-17T11:02:07.625 INFO:teuthology.orchestra.run.trial157.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-17T11:02:07.625 INFO:teuthology.orchestra.run.trial157.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-17T11:02:07.625 INFO:teuthology.orchestra.run.trial157.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-17T11:02:07.625 INFO:teuthology.orchestra.run.trial157.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-17T11:02:07.625 INFO:teuthology.orchestra.run.trial157.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-17T11:02:07.625 INFO:teuthology.orchestra.run.trial157.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-17T11:02:07.625 INFO:teuthology.orchestra.run.trial157.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-17T11:02:07.626 INFO:teuthology.orchestra.run.trial157.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-17T11:02:07.626 INFO:teuthology.orchestra.run.trial157.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-17T11:02:07.626 INFO:teuthology.orchestra.run.trial157.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-17T11:02:07.626 INFO:teuthology.orchestra.run.trial157.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-17T11:02:07.626 INFO:teuthology.orchestra.run.trial157.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-17T11:02:07.626 INFO:teuthology.orchestra.run.trial157.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-17T11:02:07.626 INFO:teuthology.orchestra.run.trial157.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-17T11:02:07.626 INFO:teuthology.orchestra.run.trial157.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-17T11:02:07.626 INFO:teuthology.orchestra.run.trial157.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-17T11:02:07.626 INFO:teuthology.orchestra.run.trial157.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-17T11:02:07.626 INFO:teuthology.orchestra.run.trial157.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-17T11:02:07.626 INFO:teuthology.orchestra.run.trial157.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-17T11:02:07.627 INFO:teuthology.orchestra.run.trial157.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-17T11:02:07.627 INFO:teuthology.orchestra.run.trial157.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-17T11:02:07.627 INFO:teuthology.orchestra.run.trial157.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-17T11:02:07.627 INFO:teuthology.orchestra.run.trial157.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-17T11:02:07.627 INFO:teuthology.orchestra.run.trial157.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-17T11:02:07.627 INFO:teuthology.orchestra.run.trial157.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-17T11:02:07.627 INFO:teuthology.orchestra.run.trial157.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-17T11:02:07.627 INFO:teuthology.orchestra.run.trial157.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-17T11:02:07.627 INFO:teuthology.orchestra.run.trial157.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-17T11:02:07.627 INFO:teuthology.orchestra.run.trial157.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-17T11:02:07.627 INFO:teuthology.orchestra.run.trial157.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-17T11:02:07.627 INFO:teuthology.orchestra.run.trial157.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-17T11:02:07.627 INFO:teuthology.orchestra.run.trial157.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-17T11:02:07.628 INFO:teuthology.orchestra.run.trial157.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-17T11:02:07.628 INFO:teuthology.orchestra.run.trial157.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-17T11:02:07.628 INFO:teuthology.orchestra.run.trial157.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-17T11:02:07.628 INFO:teuthology.orchestra.run.trial157.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-17T11:02:07.628 INFO:teuthology.orchestra.run.trial157.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-17T11:02:07.628 INFO:teuthology.orchestra.run.trial157.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-17T11:02:07.628 INFO:teuthology.orchestra.run.trial157.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-17T11:02:07.628 INFO:teuthology.orchestra.run.trial157.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-17T11:02:07.628 INFO:teuthology.orchestra.run.trial157.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-17T11:02:07.628 INFO:teuthology.orchestra.run.trial157.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-17T11:02:07.628 INFO:teuthology.orchestra.run.trial157.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-17T11:02:07.628 INFO:teuthology.orchestra.run.trial157.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-17T11:02:07.628 INFO:teuthology.orchestra.run.trial157.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-17T11:02:07.629 INFO:teuthology.orchestra.run.trial157.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-17T11:02:07.629 INFO:teuthology.orchestra.run.trial157.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-17T11:02:07.629 INFO:teuthology.orchestra.run.trial157.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-17T11:02:07.629 INFO:teuthology.orchestra.run.trial157.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-17T11:02:07.629 INFO:teuthology.orchestra.run.trial157.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-17T11:02:07.629 INFO:teuthology.orchestra.run.trial157.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-17T11:02:07.629 INFO:teuthology.orchestra.run.trial157.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-17T11:02:07.629 INFO:teuthology.orchestra.run.trial157.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-17T11:02:07.629 INFO:teuthology.orchestra.run.trial157.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-17T11:02:07.629 INFO:teuthology.orchestra.run.trial157.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-17T11:02:07.629 INFO:teuthology.orchestra.run.trial157.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-17T11:02:07.629 INFO:teuthology.orchestra.run.trial157.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-17T11:02:07.629 INFO:teuthology.orchestra.run.trial157.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-17T11:02:07.630 INFO:teuthology.orchestra.run.trial157.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-17T11:02:07.630 INFO:teuthology.orchestra.run.trial157.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-17T11:02:07.630 INFO:teuthology.orchestra.run.trial157.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-17T11:02:07.630 INFO:teuthology.orchestra.run.trial157.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-17T11:02:07.630 INFO:teuthology.orchestra.run.trial157.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-17T11:02:07.630 INFO:teuthology.orchestra.run.trial157.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-17T11:02:07.630 INFO:teuthology.orchestra.run.trial157.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-17T11:02:07.630 INFO:teuthology.orchestra.run.trial157.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-17T11:02:07.630 INFO:teuthology.orchestra.run.trial157.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-17T11:02:07.630 INFO:teuthology.orchestra.run.trial157.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-17T11:02:07.630 INFO:teuthology.orchestra.run.trial157.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-17T11:02:07.630 INFO:teuthology.orchestra.run.trial157.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-17T11:02:07.631 INFO:teuthology.orchestra.run.trial157.stdout:Installing weak dependencies: 2026-02-17T11:02:07.631 INFO:teuthology.orchestra.run.trial157.stdout: ceph-mgr-cephadm noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 150 k 2026-02-17T11:02:07.631 INFO:teuthology.orchestra.run.trial157.stdout: ceph-mgr-dashboard noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 3.8 M 2026-02-17T11:02:07.631 INFO:teuthology.orchestra.run.trial157.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 7.4 M 2026-02-17T11:02:07.631 INFO:teuthology.orchestra.run.trial157.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 22 k 2026-02-17T11:02:07.631 INFO:teuthology.orchestra.run.trial157.stdout: ceph-mgr-rook noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 49 k 2026-02-17T11:02:07.631 INFO:teuthology.orchestra.run.trial157.stdout: ceph-volume noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 299 k 2026-02-17T11:02:07.631 INFO:teuthology.orchestra.run.trial157.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-17T11:02:07.631 INFO:teuthology.orchestra.run.trial157.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-17T11:02:07.631 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:02:07.631 INFO:teuthology.orchestra.run.trial157.stdout:Transaction Summary 2026-02-17T11:02:07.631 INFO:teuthology.orchestra.run.trial157.stdout:====================================================================================== 2026-02-17T11:02:07.632 INFO:teuthology.orchestra.run.trial157.stdout:Install 99 Packages 2026-02-17T11:02:07.632 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:02:07.633 INFO:teuthology.orchestra.run.trial157.stdout:Total download size: 95 M 2026-02-17T11:02:07.633 INFO:teuthology.orchestra.run.trial157.stdout:Installed size: 520 M 2026-02-17T11:02:07.633 INFO:teuthology.orchestra.run.trial157.stdout:Downloading Packages: 2026-02-17T11:02:08.007 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 68/99 2026-02-17T11:02:08.024 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 69/99 2026-02-17T11:02:08.034 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 70/99 2026-02-17T11:02:08.041 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-packaging-20.9-5.el9.noarch 71/99 2026-02-17T11:02:08.054 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-ply-3.11-14.el9.noarch 72/99 2026-02-17T11:02:08.070 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 73/99 2026-02-17T11:02:08.145 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 74/99 2026-02-17T11:02:08.155 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 75/99 2026-02-17T11:02:08.178 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 76/99 2026-02-17T11:02:08.207 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 77/99 2026-02-17T11:02:08.208 INFO:teuthology.orchestra.run.trial157.stdout:(1/99): ceph-19.2.3-705.g04cf6dd4.el9.x86_64.rp 129 kB/s | 6.5 kB 00:00 2026-02-17T11:02:08.258 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 78/99 2026-02-17T11:02:08.265 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 79/99 2026-02-17T11:02:08.268 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 80/99 2026-02-17T11:02:08.269 INFO:teuthology.orchestra.run.trial097.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 81/99 2026-02-17T11:02:08.287 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T11:02:08.288 INFO:teuthology.orchestra.run.trial097.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-17T11:02:08.288 INFO:teuthology.orchestra.run.trial097.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-17T11:02:08.288 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:02:08.295 INFO:teuthology.orchestra.run.trial097.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T11:02:08.301 INFO:teuthology.orchestra.run.trial157.stdout:(2/99): ceph-mgr-19.2.3-705.g04cf6dd4.el9.x86_6 7.5 MB/s | 1.1 MB 00:00 2026-02-17T11:02:08.320 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T11:02:08.320 INFO:teuthology.orchestra.run.trial097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-17T11:02:08.320 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:02:08.328 INFO:teuthology.orchestra.run.trial157.stdout:(3/99): ceph-mds-19.2.3-705.g04cf6dd4.el9.x86_6 14 MB/s | 2.4 MB 00:00 2026-02-17T11:02:08.354 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 83/99 2026-02-17T11:02:08.359 INFO:teuthology.orchestra.run.trial157.stdout:(4/99): ceph-grafana-dashboards-19.2.3-705.g04c 989 kB/s | 31 kB 00:00 2026-02-17T11:02:08.395 INFO:teuthology.orchestra.run.trial157.stdout:(5/99): ceph-mgr-cephadm-19.2.3-705.g04cf6dd4.e 4.1 MB/s | 150 kB 00:00 2026-02-17T11:02:08.418 INFO:teuthology.orchestra.run.trial097.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 84/99 2026-02-17T11:02:08.420 INFO:teuthology.orchestra.run.trial097.stdout: Installing : ceph-volume-2:19.2.3-705.g04cf6dd4.el9.noarch 85/99 2026-02-17T11:02:08.434 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: ceph-volume-2:19.2.3-705.g04cf6dd4.el9.noarch 85/99 2026-02-17T11:02:08.434 INFO:teuthology.orchestra.run.trial097.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:02:08.435 INFO:teuthology.orchestra.run.trial097.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-17T11:02:08.435 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:02:08.441 INFO:teuthology.orchestra.run.trial157.stdout:(6/99): ceph-mon-19.2.3-705.g04cf6dd4.el9.x86_6 20 MB/s | 4.7 MB 00:00 2026-02-17T11:02:08.657 INFO:teuthology.orchestra.run.trial157.stdout:(7/99): ceph-mgr-dashboard-19.2.3-705.g04cf6dd4 15 MB/s | 3.8 MB 00:00 2026-02-17T11:02:08.689 INFO:teuthology.orchestra.run.trial157.stdout:(8/99): ceph-mgr-k8sevents-19.2.3-705.g04cf6dd4 677 kB/s | 22 kB 00:00 2026-02-17T11:02:08.732 INFO:teuthology.orchestra.run.trial157.stdout:(9/99): ceph-mgr-modules-core-19.2.3-705.g04cf6 5.7 MB/s | 253 kB 00:00 2026-02-17T11:02:08.763 INFO:teuthology.orchestra.run.trial157.stdout:(10/99): ceph-mgr-rook-19.2.3-705.g04cf6dd4.el9 1.6 MB/s | 49 kB 00:00 2026-02-17T11:02:08.790 INFO:teuthology.orchestra.run.trial157.stdout:(11/99): ceph-prometheus-alerts-19.2.3-705.g04c 623 kB/s | 17 kB 00:00 2026-02-17T11:02:08.822 INFO:teuthology.orchestra.run.trial157.stdout:(12/99): ceph-volume-19.2.3-705.g04cf6dd4.el9.n 9.1 MB/s | 299 kB 00:00 2026-02-17T11:02:08.863 INFO:teuthology.orchestra.run.trial157.stdout:(13/99): cephadm-19.2.3-705.g04cf6dd4.el9.noarc 18 MB/s | 769 kB 00:00 2026-02-17T11:02:08.884 INFO:teuthology.orchestra.run.trial157.stdout:(14/99): cryptsetup-2.8.1-2.el9.x86_64.rpm 16 MB/s | 350 kB 00:00 2026-02-17T11:02:08.889 INFO:teuthology.orchestra.run.trial157.stdout:(15/99): ledmon-libs-1.1.0-3.el9.x86_64.rpm 9.2 MB/s | 40 kB 00:00 2026-02-17T11:02:08.894 INFO:teuthology.orchestra.run.trial157.stdout:(16/99): libconfig-1.7.2-9.el9.x86_64.rpm 15 MB/s | 72 kB 00:00 2026-02-17T11:02:08.908 INFO:teuthology.orchestra.run.trial157.stdout:(17/99): ceph-mgr-diskprediction-local-19.2.3-7 16 MB/s | 7.4 MB 00:00 2026-02-17T11:02:08.911 INFO:teuthology.orchestra.run.trial157.stdout:(18/99): libgfortran-11.5.0-14.el9.x86_64.rpm 46 MB/s | 794 kB 00:00 2026-02-17T11:02:08.920 INFO:teuthology.orchestra.run.trial157.stdout:(19/99): python3-cffi-1.14.5-5.el9.x86_64.rpm 27 MB/s | 253 kB 00:00 2026-02-17T11:02:08.926 INFO:teuthology.orchestra.run.trial157.stdout:(20/99): libquadmath-11.5.0-14.el9.x86_64.rpm 10 MB/s | 184 kB 00:00 2026-02-17T11:02:08.933 INFO:teuthology.orchestra.run.trial157.stdout:(21/99): python3-cryptography-36.0.1-5.el9.x86_ 102 MB/s | 1.2 MB 00:00 2026-02-17T11:02:08.933 INFO:teuthology.orchestra.run.trial157.stdout:(22/99): python3-ply-3.11-14.el9.noarch.rpm 16 MB/s | 106 kB 00:00 2026-02-17T11:02:08.939 INFO:teuthology.orchestra.run.trial157.stdout:(23/99): python3-pycparser-2.20-6.el9.noarch.rp 21 MB/s | 135 kB 00:00 2026-02-17T11:02:08.939 INFO:teuthology.orchestra.run.trial157.stdout:(24/99): python3-pyparsing-2.4.7-9.el9.noarch.r 24 MB/s | 150 kB 00:00 2026-02-17T11:02:08.943 INFO:teuthology.orchestra.run.trial157.stdout:(25/99): python3-requests-2.25.1-10.el9.noarch. 28 MB/s | 126 kB 00:00 2026-02-17T11:02:08.948 INFO:teuthology.orchestra.run.trial157.stdout:(26/99): python3-urllib3-1.26.5-7.el9.noarch.rp 26 MB/s | 218 kB 00:00 2026-02-17T11:02:08.949 INFO:teuthology.orchestra.run.trial157.stdout:(27/99): unzip-6.0-59.el9.x86_64.rpm 30 MB/s | 182 kB 00:00 2026-02-17T11:02:08.954 INFO:teuthology.orchestra.run.trial157.stdout:(28/99): zip-3.0-35.el9.x86_64.rpm 41 MB/s | 266 kB 00:00 2026-02-17T11:02:09.026 INFO:teuthology.orchestra.run.trial157.stdout:(29/99): ceph-osd-19.2.3-705.g04cf6dd4.el9.x86_ 24 MB/s | 17 MB 00:00 2026-02-17T11:02:09.036 INFO:teuthology.orchestra.run.trial157.stdout:(30/99): flexiblas-3.0.4-9.el9.x86_64.rpm 345 kB/s | 30 kB 00:00 2026-02-17T11:02:09.085 INFO:teuthology.orchestra.run.trial157.stdout:(31/99): flexiblas-openblas-openmp-3.0.4-9.el9. 252 kB/s | 15 kB 00:00 2026-02-17T11:02:09.097 INFO:teuthology.orchestra.run.trial157.stdout:(32/99): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 3.9 MB/s | 246 kB 00:00 2026-02-17T11:02:09.135 INFO:teuthology.orchestra.run.trial097.stdout: Installing : ceph-osd-2:19.2.3-705.g04cf6dd4.el9.x86_64 86/99 2026-02-17T11:02:09.157 INFO:teuthology.orchestra.run.trial157.stdout:(33/99): openblas-0.3.29-1.el9.x86_64.rpm 704 kB/s | 42 kB 00:00 2026-02-17T11:02:09.161 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: ceph-osd-2:19.2.3-705.g04cf6dd4.el9.x86_64 86/99 2026-02-17T11:02:09.161 INFO:teuthology.orchestra.run.trial097.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:02:09.161 INFO:teuthology.orchestra.run.trial097.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-17T11:02:09.161 INFO:teuthology.orchestra.run.trial097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T11:02:09.161 INFO:teuthology.orchestra.run.trial097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T11:02:09.161 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:02:09.170 INFO:teuthology.orchestra.run.trial157.stdout:(34/99): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2026-02-17T11:02:09.217 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 87/99 2026-02-17T11:02:09.219 INFO:teuthology.orchestra.run.trial097.stdout: Installing : cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 87/99 2026-02-17T11:02:09.224 INFO:teuthology.orchestra.run.trial097.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-705.g04cf6dd4.el9. 88/99 2026-02-17T11:02:09.243 INFO:teuthology.orchestra.run.trial097.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-705.g04cf6dd4.el9 89/99 2026-02-17T11:02:09.244 INFO:teuthology.orchestra.run.trial097.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 90/99 2026-02-17T11:02:09.256 INFO:teuthology.orchestra.run.trial157.stdout:(35/99): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 9.9 MB/s | 3.0 MB 00:00 2026-02-17T11:02:09.352 INFO:teuthology.orchestra.run.trial157.stdout:(36/99): protobuf-3.14.0-17.el9.x86_64.rpm 5.5 MB/s | 1.0 MB 00:00 2026-02-17T11:02:09.411 INFO:teuthology.orchestra.run.trial162.stdout:lab-extras 2.5 MB/s | 50 kB 00:00 2026-02-17T11:02:09.439 INFO:teuthology.orchestra.run.trial157.stdout:(37/99): python3-devel-3.9.25-2.el9.x86_64.rpm 2.7 MB/s | 244 kB 00:00 2026-02-17T11:02:09.597 INFO:teuthology.orchestra.run.trial157.stdout:(38/99): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2026-02-17T11:02:09.598 INFO:teuthology.orchestra.run.trial157.stdout:(39/99): python3-jinja2-2.11.3-8.el9.noarch.rpm 1.5 MB/s | 249 kB 00:00 2026-02-17T11:02:09.654 INFO:teuthology.orchestra.run.trial157.stdout:(40/99): python3-libstoragemgmt-1.10.1-1.el9.x8 3.0 MB/s | 177 kB 00:00 2026-02-17T11:02:09.692 INFO:teuthology.orchestra.run.trial157.stdout:(41/99): python3-mako-1.1.4-6.el9.noarch.rpm 4.5 MB/s | 172 kB 00:00 2026-02-17T11:02:09.722 INFO:teuthology.orchestra.run.trial157.stdout:(42/99): python3-markupsafe-1.1.1-12.el9.x86_64 1.1 MB/s | 35 kB 00:00 2026-02-17T11:02:09.734 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 90/99 2026-02-17T11:02:09.738 INFO:teuthology.orchestra.run.trial097.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-705.g04cf6dd4.el9.noar 91/99 2026-02-17T11:02:09.809 INFO:teuthology.orchestra.run.trial049.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-17T11:02:09.880 INFO:teuthology.orchestra.run.trial157.stdout:(43/99): openblas-openmp-0.3.29-1.el9.x86_64.rp 7.3 MB/s | 5.3 MB 00:00 2026-02-17T11:02:09.951 INFO:teuthology.orchestra.run.trial157.stdout:(44/99): python3-numpy-f2py-1.23.5-2.el9.x86_64 6.1 MB/s | 442 kB 00:00 2026-02-17T11:02:09.962 INFO:teuthology.orchestra.run.trial157.stdout:(45/99): python3-lxml-4.6.5-3.el9.x86_64.rpm 3.4 MB/s | 1.2 MB 00:00 2026-02-17T11:02:09.977 INFO:teuthology.orchestra.run.trial157.stdout:(46/99): python3-packaging-20.9-5.el9.noarch.rp 2.9 MB/s | 77 kB 00:00 2026-02-17T11:02:10.072 INFO:teuthology.orchestra.run.trial157.stdout:(47/99): python3-numpy-1.23.5-2.el9.x86_64.rpm 18 MB/s | 6.1 MB 00:00 2026-02-17T11:02:10.089 INFO:teuthology.orchestra.run.trial157.stdout:(48/99): python3-protobuf-3.14.0-17.el9.noarch. 2.1 MB/s | 267 kB 00:00 2026-02-17T11:02:10.113 INFO:teuthology.orchestra.run.trial157.stdout:(49/99): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.1 MB/s | 159 kB 00:00 2026-02-17T11:02:10.115 INFO:teuthology.orchestra.run.trial157.stdout:(50/99): python3-pyasn1-modules-0.4.8-6.el9.noa 6.2 MB/s | 279 kB 00:00 2026-02-17T11:02:10.172 INFO:teuthology.orchestra.run.trial157.stdout:(51/99): python3-requests-oauthlib-1.3.0-12.el9 652 kB/s | 54 kB 00:00 2026-02-17T11:02:10.174 INFO:teuthology.orchestra.run.trial157.stdout:(52/99): python3-toml-0.10.2-6.el9.noarch.rpm 711 kB/s | 42 kB 00:00 2026-02-17T11:02:10.190 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-705.g04cf6dd4.el9.noar 91/99 2026-02-17T11:02:10.191 INFO:teuthology.orchestra.run.trial097.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-705.g04cf6d 92/99 2026-02-17T11:02:10.203 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-705.g04cf6d 92/99 2026-02-17T11:02:10.203 INFO:teuthology.orchestra.run.trial097.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-705.g04cf6dd4.el9.noar 93/99 2026-02-17T11:02:10.223 INFO:teuthology.orchestra.run.trial157.stdout:(53/99): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 1.8 MB/s | 90 kB 00:00 2026-02-17T11:02:10.259 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-705.g04cf6dd4.el9.noar 93/99 2026-02-17T11:02:10.259 INFO:teuthology.orchestra.run.trial157.stdout:(54/99): xmlsec1-1.2.29-13.el9.x86_64.rpm 2.1 MB/s | 189 kB 00:00 2026-02-17T11:02:10.308 INFO:teuthology.orchestra.run.trial097.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-705.g04cf6dd4.el9.n 94/99 2026-02-17T11:02:10.309 INFO:teuthology.orchestra.run.trial097.stdout: Installing : ceph-mgr-2:19.2.3-705.g04cf6dd4.el9.x86_64 95/99 2026-02-17T11:02:10.331 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: ceph-mgr-2:19.2.3-705.g04cf6dd4.el9.x86_64 95/99 2026-02-17T11:02:10.331 INFO:teuthology.orchestra.run.trial097.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:02:10.331 INFO:teuthology.orchestra.run.trial097.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-17T11:02:10.331 INFO:teuthology.orchestra.run.trial097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T11:02:10.331 INFO:teuthology.orchestra.run.trial097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T11:02:10.331 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:02:10.343 INFO:teuthology.orchestra.run.trial097.stdout: Installing : ceph-mgr-rook-2:19.2.3-705.g04cf6dd4.el9.noarch 96/99 2026-02-17T11:02:10.473 INFO:teuthology.orchestra.run.trial157.stdout:(55/99): lua-devel-5.4.4-4.el9.x86_64.rpm 89 kB/s | 22 kB 00:00 2026-02-17T11:02:10.509 INFO:teuthology.orchestra.run.trial157.stdout:(56/99): abseil-cpp-20211102.0-4.el9.x86_64.rpm 15 MB/s | 551 kB 00:00 2026-02-17T11:02:10.512 INFO:teuthology.orchestra.run.trial157.stdout:(57/99): grpc-data-1.46.7-10.el9.noarch.rpm 5.8 MB/s | 19 kB 00:00 2026-02-17T11:02:10.516 INFO:teuthology.orchestra.run.trial157.stdout:(58/99): luarocks-3.9.2-5.el9.noarch.rpm 39 MB/s | 151 kB 00:00 2026-02-17T11:02:10.521 INFO:teuthology.orchestra.run.trial157.stdout:(59/99): python3-asyncssh-2.13.2-5.el9.noarch.r 112 MB/s | 548 kB 00:00 2026-02-17T11:02:10.524 INFO:teuthology.orchestra.run.trial157.stdout:(60/99): python3-autocommand-2.2.2-8.el9.noarch 8.6 MB/s | 29 kB 00:00 2026-02-17T11:02:10.528 INFO:teuthology.orchestra.run.trial157.stdout:(61/99): python3-backports-tarfile-1.2.0-1.el9. 16 MB/s | 60 kB 00:00 2026-02-17T11:02:10.532 INFO:teuthology.orchestra.run.trial157.stdout:(62/99): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 12 MB/s | 43 kB 00:00 2026-02-17T11:02:10.535 INFO:teuthology.orchestra.run.trial157.stdout:(63/99): python3-cachetools-4.2.4-1.el9.noarch. 9.1 MB/s | 32 kB 00:00 2026-02-17T11:02:10.539 INFO:teuthology.orchestra.run.trial157.stdout:(64/99): python3-certifi-2023.05.07-4.el9.noarc 4.2 MB/s | 14 kB 00:00 2026-02-17T11:02:10.543 INFO:teuthology.orchestra.run.trial157.stdout:(65/99): python3-cheroot-10.0.1-4.el9.noarch.rp 45 MB/s | 173 kB 00:00 2026-02-17T11:02:10.547 INFO:teuthology.orchestra.run.trial157.stdout:(66/99): python3-cherrypy-18.6.1-2.el9.noarch.r 79 MB/s | 358 kB 00:00 2026-02-17T11:02:10.551 INFO:teuthology.orchestra.run.trial157.stdout:(67/99): python3-google-auth-2.45.0-1.el9.noarc 63 MB/s | 254 kB 00:00 2026-02-17T11:02:10.558 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-705.g04cf6dd4.el9.noarch 96/99 2026-02-17T11:02:10.560 INFO:teuthology.orchestra.run.trial097.stdout: Installing : ceph-mon-2:19.2.3-705.g04cf6dd4.el9.x86_64 97/99 2026-02-17T11:02:10.561 INFO:teuthology.orchestra.run.trial157.stdout:(68/99): python3-grpcio-1.46.7-10.el9.x86_64.rp 217 MB/s | 2.0 MB 00:00 2026-02-17T11:02:10.565 INFO:teuthology.orchestra.run.trial157.stdout:(69/99): python3-grpcio-tools-1.46.7-10.el9.x86 37 MB/s | 144 kB 00:00 2026-02-17T11:02:10.569 INFO:teuthology.orchestra.run.trial157.stdout:(70/99): python3-influxdb-5.3.1-1.el9.noarch.rp 36 MB/s | 139 kB 00:00 2026-02-17T11:02:10.572 INFO:teuthology.orchestra.run.trial157.stdout:(71/99): python3-isodate-0.6.1-3.el9.noarch.rpm 17 MB/s | 56 kB 00:00 2026-02-17T11:02:10.576 INFO:teuthology.orchestra.run.trial157.stdout:(72/99): python3-jaraco-8.2.1-3.el9.noarch.rpm 3.2 MB/s | 11 kB 00:00 2026-02-17T11:02:10.579 INFO:teuthology.orchestra.run.trial157.stdout:(73/99): python3-jaraco-classes-3.2.1-5.el9.noa 5.2 MB/s | 18 kB 00:00 2026-02-17T11:02:10.581 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: ceph-mon-2:19.2.3-705.g04cf6dd4.el9.x86_64 97/99 2026-02-17T11:02:10.581 INFO:teuthology.orchestra.run.trial097.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:02:10.581 INFO:teuthology.orchestra.run.trial097.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-17T11:02:10.581 INFO:teuthology.orchestra.run.trial097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T11:02:10.582 INFO:teuthology.orchestra.run.trial097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T11:02:10.582 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:02:10.582 INFO:teuthology.orchestra.run.trial157.stdout:(74/99): python3-jaraco-collections-3.0.0-8.el9 6.8 MB/s | 23 kB 00:00 2026-02-17T11:02:10.586 INFO:teuthology.orchestra.run.trial157.stdout:(75/99): python3-jaraco-context-6.0.1-3.el9.noa 5.8 MB/s | 20 kB 00:00 2026-02-17T11:02:10.589 INFO:teuthology.orchestra.run.trial157.stdout:(76/99): python3-jaraco-functools-3.5.0-2.el9.n 5.7 MB/s | 19 kB 00:00 2026-02-17T11:02:10.593 INFO:teuthology.orchestra.run.trial157.stdout:(77/99): python3-jaraco-text-4.0.0-2.el9.noarch 7.8 MB/s | 26 kB 00:00 2026-02-17T11:02:10.599 INFO:teuthology.orchestra.run.trial157.stdout:(78/99): python3-kubernetes-26.1.0-3.el9.noarch 176 MB/s | 1.0 MB 00:00 2026-02-17T11:02:10.602 INFO:teuthology.orchestra.run.trial157.stdout:(79/99): python3-logutils-0.3.5-21.el9.noarch.r 14 MB/s | 46 kB 00:00 2026-02-17T11:02:10.606 INFO:teuthology.orchestra.run.trial157.stdout:(80/99): python3-more-itertools-8.12.0-2.el9.no 22 MB/s | 79 kB 00:00 2026-02-17T11:02:10.610 INFO:teuthology.orchestra.run.trial157.stdout:(81/99): python3-msgpack-1.0.3-2.el9.x86_64.rpm 23 MB/s | 86 kB 00:00 2026-02-17T11:02:10.613 INFO:teuthology.orchestra.run.trial157.stdout:(82/99): python3-natsort-7.1.1-5.el9.noarch.rpm 17 MB/s | 58 kB 00:00 2026-02-17T11:02:10.617 INFO:teuthology.orchestra.run.trial157.stdout:(83/99): python3-pecan-1.4.2-3.el9.noarch.rpm 67 MB/s | 272 kB 00:00 2026-02-17T11:02:10.621 INFO:teuthology.orchestra.run.trial157.stdout:(84/99): python3-portend-3.1.0-2.el9.noarch.rpm 4.9 MB/s | 16 kB 00:00 2026-02-17T11:02:10.624 INFO:teuthology.orchestra.run.trial157.stdout:(85/99): python3-pyOpenSSL-21.0.0-1.el9.noarch. 24 MB/s | 90 kB 00:00 2026-02-17T11:02:10.628 INFO:teuthology.orchestra.run.trial157.stdout:(86/99): python3-repoze-lru-0.7-16.el9.noarch.r 8.7 MB/s | 31 kB 00:00 2026-02-17T11:02:10.632 INFO:teuthology.orchestra.run.trial157.stdout:(87/99): python3-routes-2.5.1-5.el9.noarch.rpm 50 MB/s | 188 kB 00:00 2026-02-17T11:02:10.635 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T11:02:10.635 INFO:teuthology.orchestra.run.trial157.stdout:(88/99): python3-rsa-4.9-2.el9.noarch.rpm 16 MB/s | 59 kB 00:00 2026-02-17T11:02:10.636 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:02:10.636 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repository Size 2026-02-17T11:02:10.636 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:02:10.637 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-17T11:02:10.637 INFO:teuthology.orchestra.run.trial162.stdout: ceph-radosgw x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 11 M 2026-02-17T11:02:10.637 INFO:teuthology.orchestra.run.trial162.stdout:Upgrading: 2026-02-17T11:02:10.637 INFO:teuthology.orchestra.run.trial162.stdout: librados2 x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 3.4 M 2026-02-17T11:02:10.637 INFO:teuthology.orchestra.run.trial162.stdout: librbd1 x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 3.2 M 2026-02-17T11:02:10.637 INFO:teuthology.orchestra.run.trial162.stdout:Installing dependencies: 2026-02-17T11:02:10.637 INFO:teuthology.orchestra.run.trial162.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-17T11:02:10.637 INFO:teuthology.orchestra.run.trial162.stdout: ceph-base x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 5.5 M 2026-02-17T11:02:10.637 INFO:teuthology.orchestra.run.trial162.stdout: ceph-common x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 22 M 2026-02-17T11:02:10.637 INFO:teuthology.orchestra.run.trial162.stdout: ceph-selinux x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 25 k 2026-02-17T11:02:10.637 INFO:teuthology.orchestra.run.trial162.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-17T11:02:10.638 INFO:teuthology.orchestra.run.trial162.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-17T11:02:10.638 INFO:teuthology.orchestra.run.trial162.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-17T11:02:10.638 INFO:teuthology.orchestra.run.trial162.stdout: libcephfs2 x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 1.0 M 2026-02-17T11:02:10.638 INFO:teuthology.orchestra.run.trial162.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-17T11:02:10.638 INFO:teuthology.orchestra.run.trial162.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-17T11:02:10.638 INFO:teuthology.orchestra.run.trial162.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-17T11:02:10.638 INFO:teuthology.orchestra.run.trial162.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-17T11:02:10.638 INFO:teuthology.orchestra.run.trial162.stdout: libradosstriper1 x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 503 k 2026-02-17T11:02:10.638 INFO:teuthology.orchestra.run.trial162.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-17T11:02:10.638 INFO:teuthology.orchestra.run.trial162.stdout: librgw2 x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 5.4 M 2026-02-17T11:02:10.638 INFO:teuthology.orchestra.run.trial162.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-17T11:02:10.638 INFO:teuthology.orchestra.run.trial162.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-17T11:02:10.638 INFO:teuthology.orchestra.run.trial162.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-17T11:02:10.639 INFO:teuthology.orchestra.run.trial162.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-17T11:02:10.639 INFO:teuthology.orchestra.run.trial162.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-17T11:02:10.639 INFO:teuthology.orchestra.run.trial162.stdout: python3-ceph-argparse x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 45 k 2026-02-17T11:02:10.639 INFO:teuthology.orchestra.run.trial162.stdout: python3-ceph-common x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 154 k 2026-02-17T11:02:10.639 INFO:teuthology.orchestra.run.trial162.stdout: python3-cephfs x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 165 k 2026-02-17T11:02:10.639 INFO:teuthology.orchestra.run.trial162.stdout: python3-rados x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 323 k 2026-02-17T11:02:10.639 INFO:teuthology.orchestra.run.trial162.stdout: python3-rbd x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 303 k 2026-02-17T11:02:10.639 INFO:teuthology.orchestra.run.trial162.stdout: python3-rgw x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 100 k 2026-02-17T11:02:10.639 INFO:teuthology.orchestra.run.trial162.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-17T11:02:10.639 INFO:teuthology.orchestra.run.trial162.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-17T11:02:10.639 INFO:teuthology.orchestra.run.trial162.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-17T11:02:10.639 INFO:teuthology.orchestra.run.trial162.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-17T11:02:10.639 INFO:teuthology.orchestra.run.trial162.stdout:Installing weak dependencies: 2026-02-17T11:02:10.640 INFO:teuthology.orchestra.run.trial162.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-17T11:02:10.640 INFO:teuthology.orchestra.run.trial162.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-17T11:02:10.640 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:02:10.640 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-17T11:02:10.640 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:02:10.640 INFO:teuthology.orchestra.run.trial162.stdout:Install 33 Packages 2026-02-17T11:02:10.640 INFO:teuthology.orchestra.run.trial162.stdout:Upgrade 2 Packages 2026-02-17T11:02:10.640 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:02:10.641 INFO:teuthology.orchestra.run.trial157.stdout:(89/99): python3-saml-1.16.0-1.el9.noarch.rpm 33 MB/s | 125 kB 00:00 2026-02-17T11:02:10.641 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 63 M 2026-02-17T11:02:10.641 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-17T11:02:10.643 INFO:teuthology.orchestra.run.trial157.stdout:(90/99): python3-tempora-5.0.0-2.el9.noarch.rpm 10 MB/s | 36 kB 00:00 2026-02-17T11:02:10.646 INFO:teuthology.orchestra.run.trial157.stdout:(91/99): python3-typing-extensions-4.15.0-1.el9 24 MB/s | 86 kB 00:00 2026-02-17T11:02:10.650 INFO:teuthology.orchestra.run.trial157.stdout:(92/99): python3-webob-1.8.8-2.el9.noarch.rpm 57 MB/s | 230 kB 00:00 2026-02-17T11:02:10.654 INFO:teuthology.orchestra.run.trial157.stdout:(93/99): python3-websocket-client-1.2.3-2.el9.n 25 MB/s | 90 kB 00:00 2026-02-17T11:02:10.658 INFO:teuthology.orchestra.run.trial157.stdout:(94/99): python3-werkzeug-2.0.3-3.el9.1.noarch. 96 MB/s | 427 kB 00:00 2026-02-17T11:02:10.662 INFO:teuthology.orchestra.run.trial157.stdout:(95/99): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 14 MB/s | 48 kB 00:00 2026-02-17T11:02:10.665 INFO:teuthology.orchestra.run.trial157.stdout:(96/99): python3-xmltodict-0.12.0-15.el9.noarch 6.4 MB/s | 22 kB 00:00 2026-02-17T11:02:10.669 INFO:teuthology.orchestra.run.trial157.stdout:(97/99): python3-zc-lockfile-2.0-10.el9.noarch. 5.6 MB/s | 20 kB 00:00 2026-02-17T11:02:10.685 INFO:teuthology.orchestra.run.trial097.stdout: Installing : ceph-mds-2:19.2.3-705.g04cf6dd4.el9.x86_64 98/99 2026-02-17T11:02:10.707 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: ceph-mds-2:19.2.3-705.g04cf6dd4.el9.x86_64 98/99 2026-02-17T11:02:10.707 INFO:teuthology.orchestra.run.trial097.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:02:10.707 INFO:teuthology.orchestra.run.trial097.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-17T11:02:10.707 INFO:teuthology.orchestra.run.trial097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T11:02:10.707 INFO:teuthology.orchestra.run.trial097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T11:02:10.707 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:02:10.726 INFO:teuthology.orchestra.run.trial097.stdout: Installing : ceph-2:19.2.3-705.g04cf6dd4.el9.x86_64 99/99 2026-02-17T11:02:10.899 INFO:teuthology.orchestra.run.trial157.stdout:(98/99): protobuf-compiler-3.14.0-17.el9.x86_64 1.3 MB/s | 862 kB 00:00 2026-02-17T11:02:11.023 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-17T11:02:11.024 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:02:11.024 INFO:teuthology.orchestra.run.trial049.stdout: Package Arch Version Repository Size 2026-02-17T11:02:11.024 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:02:11.024 INFO:teuthology.orchestra.run.trial049.stdout:Installing: 2026-02-17T11:02:11.024 INFO:teuthology.orchestra.run.trial049.stdout: ceph-radosgw x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 11 M 2026-02-17T11:02:11.025 INFO:teuthology.orchestra.run.trial049.stdout:Upgrading: 2026-02-17T11:02:11.025 INFO:teuthology.orchestra.run.trial049.stdout: librados2 x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 3.4 M 2026-02-17T11:02:11.025 INFO:teuthology.orchestra.run.trial049.stdout: librbd1 x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 3.2 M 2026-02-17T11:02:11.025 INFO:teuthology.orchestra.run.trial049.stdout:Installing dependencies: 2026-02-17T11:02:11.025 INFO:teuthology.orchestra.run.trial049.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-17T11:02:11.025 INFO:teuthology.orchestra.run.trial049.stdout: ceph-base x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 5.5 M 2026-02-17T11:02:11.025 INFO:teuthology.orchestra.run.trial049.stdout: ceph-common x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 22 M 2026-02-17T11:02:11.025 INFO:teuthology.orchestra.run.trial049.stdout: ceph-selinux x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 25 k 2026-02-17T11:02:11.025 INFO:teuthology.orchestra.run.trial049.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-17T11:02:11.025 INFO:teuthology.orchestra.run.trial049.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-17T11:02:11.025 INFO:teuthology.orchestra.run.trial049.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-17T11:02:11.026 INFO:teuthology.orchestra.run.trial049.stdout: libcephfs2 x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 1.0 M 2026-02-17T11:02:11.026 INFO:teuthology.orchestra.run.trial049.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-17T11:02:11.026 INFO:teuthology.orchestra.run.trial049.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-17T11:02:11.026 INFO:teuthology.orchestra.run.trial049.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-17T11:02:11.026 INFO:teuthology.orchestra.run.trial049.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-17T11:02:11.026 INFO:teuthology.orchestra.run.trial049.stdout: libradosstriper1 x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 503 k 2026-02-17T11:02:11.026 INFO:teuthology.orchestra.run.trial049.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-17T11:02:11.026 INFO:teuthology.orchestra.run.trial049.stdout: librgw2 x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 5.4 M 2026-02-17T11:02:11.026 INFO:teuthology.orchestra.run.trial049.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-17T11:02:11.026 INFO:teuthology.orchestra.run.trial049.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-17T11:02:11.026 INFO:teuthology.orchestra.run.trial049.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-17T11:02:11.026 INFO:teuthology.orchestra.run.trial049.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-17T11:02:11.027 INFO:teuthology.orchestra.run.trial049.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-17T11:02:11.027 INFO:teuthology.orchestra.run.trial049.stdout: python3-ceph-argparse x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 45 k 2026-02-17T11:02:11.027 INFO:teuthology.orchestra.run.trial049.stdout: python3-ceph-common x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 154 k 2026-02-17T11:02:11.027 INFO:teuthology.orchestra.run.trial049.stdout: python3-cephfs x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 165 k 2026-02-17T11:02:11.027 INFO:teuthology.orchestra.run.trial049.stdout: python3-rados x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 323 k 2026-02-17T11:02:11.027 INFO:teuthology.orchestra.run.trial049.stdout: python3-rbd x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 303 k 2026-02-17T11:02:11.027 INFO:teuthology.orchestra.run.trial049.stdout: python3-rgw x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 100 k 2026-02-17T11:02:11.027 INFO:teuthology.orchestra.run.trial049.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-17T11:02:11.027 INFO:teuthology.orchestra.run.trial049.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-17T11:02:11.027 INFO:teuthology.orchestra.run.trial049.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-17T11:02:11.027 INFO:teuthology.orchestra.run.trial049.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-17T11:02:11.027 INFO:teuthology.orchestra.run.trial049.stdout:Installing weak dependencies: 2026-02-17T11:02:11.027 INFO:teuthology.orchestra.run.trial049.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-17T11:02:11.028 INFO:teuthology.orchestra.run.trial049.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-17T11:02:11.028 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:02:11.028 INFO:teuthology.orchestra.run.trial049.stdout:Transaction Summary 2026-02-17T11:02:11.028 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:02:11.028 INFO:teuthology.orchestra.run.trial049.stdout:Install 33 Packages 2026-02-17T11:02:11.028 INFO:teuthology.orchestra.run.trial049.stdout:Upgrade 2 Packages 2026-02-17T11:02:11.028 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:02:11.029 INFO:teuthology.orchestra.run.trial049.stdout:Total download size: 63 M 2026-02-17T11:02:11.029 INFO:teuthology.orchestra.run.trial049.stdout:Downloading Packages: 2026-02-17T11:02:11.075 INFO:teuthology.orchestra.run.trial157.stdout:(99/99): python3-scipy-1.9.3-2.el9.x86_64.rpm 20 MB/s | 19 MB 00:00 2026-02-17T11:02:11.077 INFO:teuthology.orchestra.run.trial157.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:02:11.077 INFO:teuthology.orchestra.run.trial157.stdout:Total 28 MB/s | 95 MB 00:03 2026-02-17T11:02:11.422 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: ceph-2:19.2.3-705.g04cf6dd4.el9.x86_64 99/99 2026-02-17T11:02:11.422 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : ceph-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/99 2026-02-17T11:02:11.422 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : ceph-mds-2:19.2.3-705.g04cf6dd4.el9.x86_64 2/99 2026-02-17T11:02:11.422 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : ceph-mgr-2:19.2.3-705.g04cf6dd4.el9.x86_64 3/99 2026-02-17T11:02:11.423 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : ceph-mon-2:19.2.3-705.g04cf6dd4.el9.x86_64 4/99 2026-02-17T11:02:11.423 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : ceph-osd-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/99 2026-02-17T11:02:11.423 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-705.g04cf6dd4.el9 6/99 2026-02-17T11:02:11.423 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 7/99 2026-02-17T11:02:11.423 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-705.g04cf6dd4.el9.noar 8/99 2026-02-17T11:02:11.423 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-705.g04cf6d 9/99 2026-02-17T11:02:11.423 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-705.g04cf6dd4.el9.noar 10/99 2026-02-17T11:02:11.423 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-705.g04cf6dd4.el9.n 11/99 2026-02-17T11:02:11.423 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : ceph-mgr-rook-2:19.2.3-705.g04cf6dd4.el9.noarch 12/99 2026-02-17T11:02:11.423 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-705.g04cf6dd4.el9. 13/99 2026-02-17T11:02:11.423 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : ceph-volume-2:19.2.3-705.g04cf6dd4.el9.noarch 14/99 2026-02-17T11:02:11.424 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 15/99 2026-02-17T11:02:11.424 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 16/99 2026-02-17T11:02:11.424 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/99 2026-02-17T11:02:11.424 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/99 2026-02-17T11:02:11.424 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/99 2026-02-17T11:02:11.424 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/99 2026-02-17T11:02:11.424 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/99 2026-02-17T11:02:11.424 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/99 2026-02-17T11:02:11.424 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/99 2026-02-17T11:02:11.424 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/99 2026-02-17T11:02:11.424 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/99 2026-02-17T11:02:11.424 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/99 2026-02-17T11:02:11.425 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/99 2026-02-17T11:02:11.425 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/99 2026-02-17T11:02:11.425 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : zip-3.0-35.el9.x86_64 29/99 2026-02-17T11:02:11.425 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 30/99 2026-02-17T11:02:11.425 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 31/99 2026-02-17T11:02:11.425 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 32/99 2026-02-17T11:02:11.425 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/99 2026-02-17T11:02:11.425 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/99 2026-02-17T11:02:11.425 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/99 2026-02-17T11:02:11.425 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/99 2026-02-17T11:02:11.425 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/99 2026-02-17T11:02:11.425 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/99 2026-02-17T11:02:11.425 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 39/99 2026-02-17T11:02:11.425 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/99 2026-02-17T11:02:11.426 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 41/99 2026-02-17T11:02:11.426 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 42/99 2026-02-17T11:02:11.426 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 43/99 2026-02-17T11:02:11.426 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/99 2026-02-17T11:02:11.426 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/99 2026-02-17T11:02:11.426 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/99 2026-02-17T11:02:11.426 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/99 2026-02-17T11:02:11.426 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/99 2026-02-17T11:02:11.426 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 49/99 2026-02-17T11:02:11.426 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 50/99 2026-02-17T11:02:11.426 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/99 2026-02-17T11:02:11.426 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/99 2026-02-17T11:02:11.426 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/99 2026-02-17T11:02:11.427 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/99 2026-02-17T11:02:11.427 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/99 2026-02-17T11:02:11.427 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/99 2026-02-17T11:02:11.427 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/99 2026-02-17T11:02:11.427 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/99 2026-02-17T11:02:11.427 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/99 2026-02-17T11:02:11.427 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/99 2026-02-17T11:02:11.427 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/99 2026-02-17T11:02:11.427 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/99 2026-02-17T11:02:11.427 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/99 2026-02-17T11:02:11.427 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/99 2026-02-17T11:02:11.427 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/99 2026-02-17T11:02:11.427 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/99 2026-02-17T11:02:11.428 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/99 2026-02-17T11:02:11.428 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/99 2026-02-17T11:02:11.428 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/99 2026-02-17T11:02:11.428 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/99 2026-02-17T11:02:11.428 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/99 2026-02-17T11:02:11.428 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/99 2026-02-17T11:02:11.428 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/99 2026-02-17T11:02:11.428 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/99 2026-02-17T11:02:11.428 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/99 2026-02-17T11:02:11.428 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/99 2026-02-17T11:02:11.428 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/99 2026-02-17T11:02:11.428 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/99 2026-02-17T11:02:11.428 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/99 2026-02-17T11:02:11.429 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/99 2026-02-17T11:02:11.429 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 81/99 2026-02-17T11:02:11.429 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/99 2026-02-17T11:02:11.429 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/99 2026-02-17T11:02:11.429 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/99 2026-02-17T11:02:11.429 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 85/99 2026-02-17T11:02:11.429 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 86/99 2026-02-17T11:02:11.429 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/99 2026-02-17T11:02:11.429 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 88/99 2026-02-17T11:02:11.429 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 89/99 2026-02-17T11:02:11.429 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 90/99 2026-02-17T11:02:11.429 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 91/99 2026-02-17T11:02:11.429 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 92/99 2026-02-17T11:02:11.430 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 93/99 2026-02-17T11:02:11.430 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 94/99 2026-02-17T11:02:11.430 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 95/99 2026-02-17T11:02:11.430 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 96/99 2026-02-17T11:02:11.430 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 97/99 2026-02-17T11:02:11.430 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 98/99 2026-02-17T11:02:11.447 INFO:teuthology.orchestra.run.trial162.stdout:(1/35): ceph-base-19.2.3-705.g04cf6dd4.el9.x86_ 15 MB/s | 5.5 MB 00:00 2026-02-17T11:02:11.483 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction check 2026-02-17T11:02:11.486 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 99/99 2026-02-17T11:02:11.487 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:02:11.487 INFO:teuthology.orchestra.run.trial097.stdout:Installed: 2026-02-17T11:02:11.487 INFO:teuthology.orchestra.run.trial097.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-17T11:02:11.487 INFO:teuthology.orchestra.run.trial097.stdout: ceph-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:11.487 INFO:teuthology.orchestra.run.trial097.stdout: ceph-grafana-dashboards-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T11:02:11.487 INFO:teuthology.orchestra.run.trial097.stdout: ceph-mds-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:11.487 INFO:teuthology.orchestra.run.trial097.stdout: ceph-mgr-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:11.487 INFO:teuthology.orchestra.run.trial097.stdout: ceph-mgr-cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T11:02:11.487 INFO:teuthology.orchestra.run.trial097.stdout: ceph-mgr-dashboard-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T11:02:11.487 INFO:teuthology.orchestra.run.trial097.stdout: ceph-mgr-diskprediction-local-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T11:02:11.488 INFO:teuthology.orchestra.run.trial097.stdout: ceph-mgr-k8sevents-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T11:02:11.488 INFO:teuthology.orchestra.run.trial097.stdout: ceph-mgr-modules-core-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T11:02:11.488 INFO:teuthology.orchestra.run.trial097.stdout: ceph-mgr-rook-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T11:02:11.488 INFO:teuthology.orchestra.run.trial097.stdout: ceph-mon-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:11.488 INFO:teuthology.orchestra.run.trial097.stdout: ceph-osd-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:11.488 INFO:teuthology.orchestra.run.trial097.stdout: ceph-prometheus-alerts-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T11:02:11.488 INFO:teuthology.orchestra.run.trial097.stdout: ceph-volume-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T11:02:11.488 INFO:teuthology.orchestra.run.trial097.stdout: cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T11:02:11.488 INFO:teuthology.orchestra.run.trial097.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-17T11:02:11.488 INFO:teuthology.orchestra.run.trial097.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-17T11:02:11.488 INFO:teuthology.orchestra.run.trial097.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-17T11:02:11.488 INFO:teuthology.orchestra.run.trial097.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-17T11:02:11.489 INFO:teuthology.orchestra.run.trial097.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-17T11:02:11.489 INFO:teuthology.orchestra.run.trial097.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-17T11:02:11.489 INFO:teuthology.orchestra.run.trial097.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-17T11:02:11.489 INFO:teuthology.orchestra.run.trial097.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-17T11:02:11.489 INFO:teuthology.orchestra.run.trial097.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-17T11:02:11.489 INFO:teuthology.orchestra.run.trial097.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T11:02:11.489 INFO:teuthology.orchestra.run.trial097.stdout: lua-5.4.4-4.el9.x86_64 2026-02-17T11:02:11.489 INFO:teuthology.orchestra.run.trial097.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-17T11:02:11.489 INFO:teuthology.orchestra.run.trial097.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-17T11:02:11.489 INFO:teuthology.orchestra.run.trial097.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-17T11:02:11.489 INFO:teuthology.orchestra.run.trial097.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-17T11:02:11.489 INFO:teuthology.orchestra.run.trial097.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-17T11:02:11.490 INFO:teuthology.orchestra.run.trial097.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-17T11:02:11.490 INFO:teuthology.orchestra.run.trial097.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-17T11:02:11.490 INFO:teuthology.orchestra.run.trial097.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-17T11:02:11.490 INFO:teuthology.orchestra.run.trial097.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-17T11:02:11.490 INFO:teuthology.orchestra.run.trial097.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-17T11:02:11.490 INFO:teuthology.orchestra.run.trial097.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-17T11:02:11.490 INFO:teuthology.orchestra.run.trial097.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-17T11:02:11.490 INFO:teuthology.orchestra.run.trial097.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-17T11:02:11.490 INFO:teuthology.orchestra.run.trial097.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-17T11:02:11.490 INFO:teuthology.orchestra.run.trial097.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-17T11:02:11.490 INFO:teuthology.orchestra.run.trial097.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-17T11:02:11.490 INFO:teuthology.orchestra.run.trial097.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-17T11:02:11.490 INFO:teuthology.orchestra.run.trial097.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-17T11:02:11.491 INFO:teuthology.orchestra.run.trial097.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-17T11:02:11.491 INFO:teuthology.orchestra.run.trial097.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-17T11:02:11.491 INFO:teuthology.orchestra.run.trial097.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-17T11:02:11.491 INFO:teuthology.orchestra.run.trial097.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-17T11:02:11.491 INFO:teuthology.orchestra.run.trial097.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-17T11:02:11.491 INFO:teuthology.orchestra.run.trial097.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-17T11:02:11.491 INFO:teuthology.orchestra.run.trial097.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-17T11:02:11.491 INFO:teuthology.orchestra.run.trial097.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-17T11:02:11.491 INFO:teuthology.orchestra.run.trial097.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-17T11:02:11.491 INFO:teuthology.orchestra.run.trial097.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-17T11:02:11.491 INFO:teuthology.orchestra.run.trial097.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-17T11:02:11.491 INFO:teuthology.orchestra.run.trial097.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-17T11:02:11.491 INFO:teuthology.orchestra.run.trial097.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-17T11:02:11.492 INFO:teuthology.orchestra.run.trial097.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T11:02:11.492 INFO:teuthology.orchestra.run.trial097.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-17T11:02:11.492 INFO:teuthology.orchestra.run.trial097.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-17T11:02:11.492 INFO:teuthology.orchestra.run.trial097.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-17T11:02:11.492 INFO:teuthology.orchestra.run.trial097.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-17T11:02:11.492 INFO:teuthology.orchestra.run.trial097.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-17T11:02:11.492 INFO:teuthology.orchestra.run.trial097.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-17T11:02:11.492 INFO:teuthology.orchestra.run.trial097.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-17T11:02:11.492 INFO:teuthology.orchestra.run.trial097.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-17T11:02:11.492 INFO:teuthology.orchestra.run.trial097.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-17T11:02:11.492 INFO:teuthology.orchestra.run.trial097.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-17T11:02:11.492 INFO:teuthology.orchestra.run.trial097.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-17T11:02:11.493 INFO:teuthology.orchestra.run.trial097.stdout: python3-ply-3.11-14.el9.noarch 2026-02-17T11:02:11.493 INFO:teuthology.orchestra.run.trial097.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-17T11:02:11.493 INFO:teuthology.orchestra.run.trial097.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-17T11:02:11.493 INFO:teuthology.orchestra.run.trial097.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-17T11:02:11.493 INFO:teuthology.orchestra.run.trial097.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-17T11:02:11.493 INFO:teuthology.orchestra.run.trial097.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-17T11:02:11.493 INFO:teuthology.orchestra.run.trial097.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-17T11:02:11.493 INFO:teuthology.orchestra.run.trial097.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-17T11:02:11.493 INFO:teuthology.orchestra.run.trial097.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-17T11:02:11.493 INFO:teuthology.orchestra.run.trial097.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-17T11:02:11.493 INFO:teuthology.orchestra.run.trial097.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-17T11:02:11.493 INFO:teuthology.orchestra.run.trial097.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-17T11:02:11.493 INFO:teuthology.orchestra.run.trial097.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-17T11:02:11.494 INFO:teuthology.orchestra.run.trial097.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-17T11:02:11.494 INFO:teuthology.orchestra.run.trial097.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-17T11:02:11.494 INFO:teuthology.orchestra.run.trial097.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-17T11:02:11.494 INFO:teuthology.orchestra.run.trial097.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-17T11:02:11.494 INFO:teuthology.orchestra.run.trial097.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-17T11:02:11.494 INFO:teuthology.orchestra.run.trial097.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-17T11:02:11.494 INFO:teuthology.orchestra.run.trial097.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-17T11:02:11.494 INFO:teuthology.orchestra.run.trial097.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-17T11:02:11.494 INFO:teuthology.orchestra.run.trial097.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-17T11:02:11.494 INFO:teuthology.orchestra.run.trial097.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-17T11:02:11.494 INFO:teuthology.orchestra.run.trial097.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-17T11:02:11.494 INFO:teuthology.orchestra.run.trial097.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-17T11:02:11.494 INFO:teuthology.orchestra.run.trial097.stdout: unzip-6.0-59.el9.x86_64 2026-02-17T11:02:11.495 INFO:teuthology.orchestra.run.trial097.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-17T11:02:11.495 INFO:teuthology.orchestra.run.trial097.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-17T11:02:11.495 INFO:teuthology.orchestra.run.trial097.stdout: zip-3.0-35.el9.x86_64 2026-02-17T11:02:11.495 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:02:11.495 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-17T11:02:11.495 INFO:teuthology.orchestra.run.trial162.stdout:(2/35): ceph-selinux-19.2.3-705.g04cf6dd4.el9.x 584 kB/s | 25 kB 00:00 2026-02-17T11:02:11.521 INFO:teuthology.orchestra.run.trial157.stdout:Transaction check succeeded. 2026-02-17T11:02:11.521 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction test 2026-02-17T11:02:11.543 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install ceph-base 2026-02-17T11:02:11.556 INFO:teuthology.orchestra.run.trial162.stdout:(3/35): libcephfs2-19.2.3-705.g04cf6dd4.el9.x86 15 MB/s | 1.0 MB 00:00 2026-02-17T11:02:11.588 INFO:teuthology.orchestra.run.trial162.stdout:(4/35): ceph-radosgw-19.2.3-705.g04cf6dd4.el9.x 21 MB/s | 11 MB 00:00 2026-02-17T11:02:11.596 INFO:teuthology.orchestra.run.trial162.stdout:(5/35): libradosstriper1-19.2.3-705.g04cf6dd4.e 12 MB/s | 503 kB 00:00 2026-02-17T11:02:11.651 INFO:teuthology.orchestra.run.trial162.stdout:(6/35): python3-ceph-argparse-19.2.3-705.g04cf6 823 kB/s | 45 kB 00:00 2026-02-17T11:02:11.717 INFO:teuthology.orchestra.run.trial162.stdout:(7/35): python3-ceph-common-19.2.3-705.g04cf6dd 2.3 MB/s | 154 kB 00:00 2026-02-17T11:02:11.787 INFO:teuthology.orchestra.run.trial162.stdout:(8/35): python3-cephfs-19.2.3-705.g04cf6dd4.el9 2.3 MB/s | 165 kB 00:00 2026-02-17T11:02:11.827 INFO:teuthology.orchestra.run.trial162.stdout:(9/35): librgw2-19.2.3-705.g04cf6dd4.el9.x86_64 23 MB/s | 5.4 MB 00:00 2026-02-17T11:02:11.832 INFO:teuthology.orchestra.run.trial162.stdout:(10/35): python3-rados-19.2.3-705.g04cf6dd4.el9 7.1 MB/s | 323 kB 00:00 2026-02-17T11:02:11.858 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:00:29 ago on Tue 17 Feb 2026 11:01:42 AM UTC. 2026-02-17T11:02:11.872 INFO:teuthology.orchestra.run.trial162.stdout:(11/35): python3-rbd-19.2.3-705.g04cf6dd4.el9.x 6.7 MB/s | 303 kB 00:00 2026-02-17T11:02:11.873 INFO:teuthology.orchestra.run.trial162.stdout:(12/35): python3-rgw-19.2.3-705.g04cf6dd4.el9.x 2.4 MB/s | 100 kB 00:00 2026-02-17T11:02:11.897 INFO:teuthology.orchestra.run.trial162.stdout:(13/35): mailcap-2.1.49-5.el9.noarch.rpm 1.3 MB/s | 33 kB 00:00 2026-02-17T11:02:11.915 INFO:teuthology.orchestra.run.trial162.stdout:(14/35): pciutils-3.7.0-7.el9.x86_64.rpm 5.3 MB/s | 93 kB 00:00 2026-02-17T11:02:11.922 INFO:teuthology.orchestra.run.trial097.stdout:Package ceph-base-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T11:02:11.937 INFO:teuthology.orchestra.run.trial162.stdout:(15/35): nvme-cli-2.13-1.el9.x86_64.rpm 17 MB/s | 1.1 MB 00:00 2026-02-17T11:02:11.939 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-17T11:02:11.940 INFO:teuthology.orchestra.run.trial097.stdout:Nothing to do. 2026-02-17T11:02:11.940 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-17T11:02:11.941 INFO:teuthology.orchestra.run.trial157.stdout:Transaction test succeeded. 2026-02-17T11:02:11.941 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction 2026-02-17T11:02:11.961 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install cephadm 2026-02-17T11:02:11.982 INFO:teuthology.orchestra.run.trial162.stdout:(16/35): boost-program-options-1.75.0-13.el9.x8 1.5 MB/s | 104 kB 00:00 2026-02-17T11:02:11.989 INFO:teuthology.orchestra.run.trial162.stdout:(17/35): libnbd-1.20.3-4.el9.x86_64.rpm 3.1 MB/s | 164 kB 00:00 2026-02-17T11:02:12.011 INFO:teuthology.orchestra.run.trial162.stdout:(18/35): libpmemobj-1.12.1-1.el9.x86_64.rpm 5.4 MB/s | 160 kB 00:00 2026-02-17T11:02:12.013 INFO:teuthology.orchestra.run.trial162.stdout:(19/35): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.8 MB/s | 45 kB 00:00 2026-02-17T11:02:12.042 INFO:teuthology.orchestra.run.trial162.stdout:(20/35): librdkafka-1.6.1-102.el9.x86_64.rpm 21 MB/s | 662 kB 00:00 2026-02-17T11:02:12.042 INFO:teuthology.orchestra.run.trial162.stdout:(21/35): lttng-ust-2.12.0-6.el9.x86_64.rpm 9.8 MB/s | 292 kB 00:00 2026-02-17T11:02:12.063 INFO:teuthology.orchestra.run.trial162.stdout:(22/35): qatlib-service-25.08.0-2.el9.x86_64.rp 1.7 MB/s | 37 kB 00:00 2026-02-17T11:02:12.064 INFO:teuthology.orchestra.run.trial162.stdout:(23/35): qatlib-25.08.0-2.el9.x86_64.rpm 10 MB/s | 240 kB 00:00 2026-02-17T11:02:12.086 INFO:teuthology.orchestra.run.trial162.stdout:(24/35): qatzip-libs-1.3.1-1.el9.x86_64.rpm 2.9 MB/s | 66 kB 00:00 2026-02-17T11:02:12.131 INFO:teuthology.orchestra.run.trial162.stdout:(25/35): ceph-common-19.2.3-705.g04cf6dd4.el9.x 21 MB/s | 22 MB 00:01 2026-02-17T11:02:12.271 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:00:30 ago on Tue 17 Feb 2026 11:01:42 AM UTC. 2026-02-17T11:02:12.307 INFO:teuthology.orchestra.run.trial049.stdout:(1/35): ceph-base-19.2.3-705.g04cf6dd4.el9.x86_ 5.2 MB/s | 5.5 MB 00:01 2026-02-17T11:02:12.322 INFO:teuthology.orchestra.run.trial049.stdout:(2/35): ceph-selinux-19.2.3-705.g04cf6dd4.el9.x 1.7 MB/s | 25 kB 00:00 2026-02-17T11:02:12.335 INFO:teuthology.orchestra.run.trial097.stdout:Package cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-17T11:02:12.349 INFO:teuthology.orchestra.run.trial162.stdout:(26/35): libarrow-doc-9.0.0-15.el9.noarch.rpm 114 kB/s | 25 kB 00:00 2026-02-17T11:02:12.353 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-17T11:02:12.354 INFO:teuthology.orchestra.run.trial097.stdout:Nothing to do. 2026-02-17T11:02:12.354 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-17T11:02:12.375 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install ceph-immutable-object-cache 2026-02-17T11:02:12.388 INFO:teuthology.orchestra.run.trial157.stdout: Preparing : 1/1 2026-02-17T11:02:12.390 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/99 2026-02-17T11:02:12.421 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/99 2026-02-17T11:02:12.426 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 3/99 2026-02-17T11:02:12.431 INFO:teuthology.orchestra.run.trial049.stdout:(3/35): libcephfs2-19.2.3-705.g04cf6dd4.el9.x86 8.9 MB/s | 1.0 MB 00:00 2026-02-17T11:02:12.448 INFO:teuthology.orchestra.run.trial157.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 4/99 2026-02-17T11:02:12.454 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 5/99 2026-02-17T11:02:12.487 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 6/99 2026-02-17T11:02:12.496 INFO:teuthology.orchestra.run.trial162.stdout:(27/35): liboath-2.6.12-1.el9.x86_64.rpm 332 kB/s | 49 kB 00:00 2026-02-17T11:02:12.497 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 7/99 2026-02-17T11:02:12.502 INFO:teuthology.orchestra.run.trial157.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 8/99 2026-02-17T11:02:12.504 INFO:teuthology.orchestra.run.trial157.stdout: Installing : lua-5.4.4-4.el9.x86_64 9/99 2026-02-17T11:02:12.507 INFO:teuthology.orchestra.run.trial049.stdout:(4/35): libradosstriper1-19.2.3-705.g04cf6dd4.e 6.5 MB/s | 503 kB 00:00 2026-02-17T11:02:12.509 INFO:teuthology.orchestra.run.trial157.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 10/99 2026-02-17T11:02:12.527 INFO:teuthology.orchestra.run.trial162.stdout:(28/35): gperftools-libs-2.9.1-3.el9.x86_64.rpm 664 kB/s | 308 kB 00:00 2026-02-17T11:02:12.532 INFO:teuthology.orchestra.run.trial157.stdout: Installing : unzip-6.0-59.el9.x86_64 11/99 2026-02-17T11:02:12.545 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 12/99 2026-02-17T11:02:12.548 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 13/99 2026-02-17T11:02:12.554 INFO:teuthology.orchestra.run.trial157.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 14/99 2026-02-17T11:02:12.555 INFO:teuthology.orchestra.run.trial157.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 15/99 2026-02-17T11:02:12.567 INFO:teuthology.orchestra.run.trial157.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 16/99 2026-02-17T11:02:12.573 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 17/99 2026-02-17T11:02:12.596 INFO:teuthology.orchestra.run.trial049.stdout:(5/35): ceph-common-19.2.3-705.g04cf6dd4.el9.x8 16 MB/s | 22 MB 00:01 2026-02-17T11:02:12.597 INFO:teuthology.orchestra.run.trial157.stdout: Installing : zip-3.0-35.el9.x86_64 18/99 2026-02-17T11:02:12.601 INFO:teuthology.orchestra.run.trial157.stdout: Installing : luarocks-3.9.2-5.el9.noarch 19/99 2026-02-17T11:02:12.604 INFO:teuthology.orchestra.run.trial162.stdout:(29/35): libunwind-1.6.2-1.el9.x86_64.rpm 620 kB/s | 67 kB 00:00 2026-02-17T11:02:12.608 INFO:teuthology.orchestra.run.trial157.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 20/99 2026-02-17T11:02:12.608 INFO:teuthology.orchestra.run.trial049.stdout:(6/35): python3-ceph-argparse-19.2.3-705.g04cf6 3.8 MB/s | 45 kB 00:00 2026-02-17T11:02:12.621 INFO:teuthology.orchestra.run.trial049.stdout:(7/35): python3-ceph-common-19.2.3-705.g04cf6dd 12 MB/s | 154 kB 00:00 2026-02-17T11:02:12.633 INFO:teuthology.orchestra.run.trial157.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 21/99 2026-02-17T11:02:12.633 INFO:teuthology.orchestra.run.trial049.stdout:(8/35): python3-cephfs-19.2.3-705.g04cf6dd4.el9 14 MB/s | 165 kB 00:00 2026-02-17T11:02:12.646 INFO:teuthology.orchestra.run.trial049.stdout:(9/35): python3-rados-19.2.3-705.g04cf6dd4.el9. 26 MB/s | 323 kB 00:00 2026-02-17T11:02:12.658 INFO:teuthology.orchestra.run.trial049.stdout:(10/35): python3-rbd-19.2.3-705.g04cf6dd4.el9.x 24 MB/s | 303 kB 00:00 2026-02-17T11:02:12.670 INFO:teuthology.orchestra.run.trial049.stdout:(11/35): python3-rgw-19.2.3-705.g04cf6dd4.el9.x 8.3 MB/s | 100 kB 00:00 2026-02-17T11:02:12.684 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:00:30 ago on Tue 17 Feb 2026 11:01:42 AM UTC. 2026-02-17T11:02:12.685 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 22/99 2026-02-17T11:02:12.698 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 23/99 2026-02-17T11:02:12.700 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-rsa-4.9-2.el9.noarch 24/99 2026-02-17T11:02:12.705 INFO:teuthology.orchestra.run.trial157.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 25/99 2026-02-17T11:02:12.710 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 26/99 2026-02-17T11:02:12.715 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 27/99 2026-02-17T11:02:12.718 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 28/99 2026-02-17T11:02:12.731 INFO:teuthology.orchestra.run.trial162.stdout:(30/35): parquet-libs-9.0.0-15.el9.x86_64.rpm 4.0 MB/s | 838 kB 00:00 2026-02-17T11:02:12.732 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 29/99 2026-02-17T11:02:12.754 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 30/99 2026-02-17T11:02:12.758 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 31/99 2026-02-17T11:02:12.763 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 32/99 2026-02-17T11:02:12.766 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-17T11:02:12.768 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:02:12.768 INFO:teuthology.orchestra.run.trial097.stdout: Package Arch Version Repo Size 2026-02-17T11:02:12.768 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:02:12.768 INFO:teuthology.orchestra.run.trial097.stdout:Installing: 2026-02-17T11:02:12.768 INFO:teuthology.orchestra.run.trial097.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 145 k 2026-02-17T11:02:12.768 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:02:12.768 INFO:teuthology.orchestra.run.trial097.stdout:Transaction Summary 2026-02-17T11:02:12.768 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:02:12.769 INFO:teuthology.orchestra.run.trial097.stdout:Install 1 Package 2026-02-17T11:02:12.769 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:02:12.769 INFO:teuthology.orchestra.run.trial097.stdout:Total download size: 145 k 2026-02-17T11:02:12.769 INFO:teuthology.orchestra.run.trial097.stdout:Installed size: 431 k 2026-02-17T11:02:12.769 INFO:teuthology.orchestra.run.trial097.stdout:Downloading Packages: 2026-02-17T11:02:12.772 INFO:teuthology.orchestra.run.trial049.stdout:(12/35): ceph-radosgw-19.2.3-705.g04cf6dd4.el9. 7.0 MB/s | 11 MB 00:01 2026-02-17T11:02:12.775 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 33/99 2026-02-17T11:02:12.778 INFO:teuthology.orchestra.run.trial162.stdout:(31/35): re2-20211101-20.el9.x86_64.rpm 1.1 MB/s | 191 kB 00:00 2026-02-17T11:02:12.784 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 34/99 2026-02-17T11:02:12.790 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 35/99 2026-02-17T11:02:12.797 INFO:teuthology.orchestra.run.trial162.stdout:(32/35): libarrow-9.0.0-15.el9.x86_64.rpm 6.2 MB/s | 4.4 MB 00:00 2026-02-17T11:02:12.809 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 36/99 2026-02-17T11:02:12.818 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 37/99 2026-02-17T11:02:12.873 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 38/99 2026-02-17T11:02:12.876 INFO:teuthology.orchestra.run.trial049.stdout:(13/35): librgw2-19.2.3-705.g04cf6dd4.el9.x86_6 15 MB/s | 5.4 MB 00:00 2026-02-17T11:02:12.885 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 39/99 2026-02-17T11:02:12.893 INFO:teuthology.orchestra.run.trial162.stdout:(33/35): thrift-0.15.0-4.el9.x86_64.rpm 9.8 MB/s | 1.6 MB 00:00 2026-02-17T11:02:12.899 INFO:teuthology.orchestra.run.trial097.stdout:ceph-immutable-object-cache-19.2.3-705.g04cf6dd 1.1 MB/s | 145 kB 00:00 2026-02-17T11:02:12.899 INFO:teuthology.orchestra.run.trial097.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:02:12.899 INFO:teuthology.orchestra.run.trial097.stdout:Total 1.1 MB/s | 145 kB 00:00 2026-02-17T11:02:12.899 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction check 2026-02-17T11:02:12.901 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 40/99 2026-02-17T11:02:12.901 INFO:teuthology.orchestra.run.trial162.stdout:(34/35): librados2-19.2.3-705.g04cf6dd4.el9.x86 28 MB/s | 3.4 MB 00:00 2026-02-17T11:02:12.903 INFO:teuthology.orchestra.run.trial097.stdout:Transaction check succeeded. 2026-02-17T11:02:12.903 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction test 2026-02-17T11:02:12.905 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 41/99 2026-02-17T11:02:12.913 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 42/99 2026-02-17T11:02:12.923 INFO:teuthology.orchestra.run.trial162.stdout:(35/35): librbd1-19.2.3-705.g04cf6dd4.el9.x86_6 25 MB/s | 3.2 MB 00:00 2026-02-17T11:02:12.926 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:02:12.926 INFO:teuthology.orchestra.run.trial162.stdout:Total 28 MB/s | 63 MB 00:02 2026-02-17T11:02:12.933 INFO:teuthology.orchestra.run.trial049.stdout:(14/35): mailcap-2.1.49-5.el9.noarch.rpm 126 kB/s | 33 kB 00:00 2026-02-17T11:02:12.934 INFO:teuthology.orchestra.run.trial097.stdout:Transaction test succeeded. 2026-02-17T11:02:12.934 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction 2026-02-17T11:02:12.953 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 43/99 2026-02-17T11:02:12.988 INFO:teuthology.orchestra.run.trial097.stdout: Preparing : 1/1 2026-02-17T11:02:12.990 INFO:teuthology.orchestra.run.trial097.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-705.g04cf6dd4.e 1/1 2026-02-17T11:02:13.003 INFO:teuthology.orchestra.run.trial049.stdout:(15/35): boost-program-options-1.75.0-13.el9.x8 1.5 MB/s | 104 kB 00:00 2026-02-17T11:02:13.014 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-705.g04cf6dd4.e 1/1 2026-02-17T11:02:13.014 INFO:teuthology.orchestra.run.trial097.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:02:13.014 INFO:teuthology.orchestra.run.trial097.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-17T11:02:13.014 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:02:13.015 INFO:teuthology.orchestra.run.trial049.stdout:(16/35): libnbd-1.20.3-4.el9.x86_64.rpm 14 MB/s | 164 kB 00:00 2026-02-17T11:02:13.027 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-17T11:02:13.031 INFO:teuthology.orchestra.run.trial049.stdout:(17/35): libpmemobj-1.12.1-1.el9.x86_64.rpm 9.5 MB/s | 160 kB 00:00 2026-02-17T11:02:13.045 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-17T11:02:13.045 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-17T11:02:13.047 INFO:teuthology.orchestra.run.trial049.stdout:(18/35): librabbitmq-0.11.0-7.el9.x86_64.rpm 2.8 MB/s | 45 kB 00:00 2026-02-17T11:02:13.071 INFO:teuthology.orchestra.run.trial049.stdout:(19/35): librdkafka-1.6.1-102.el9.x86_64.rpm 28 MB/s | 662 kB 00:00 2026-02-17T11:02:13.090 INFO:teuthology.orchestra.run.trial049.stdout:(20/35): lttng-ust-2.12.0-6.el9.x86_64.rpm 15 MB/s | 292 kB 00:00 2026-02-17T11:02:13.108 INFO:teuthology.orchestra.run.trial049.stdout:(21/35): qatlib-25.08.0-2.el9.x86_64.rpm 13 MB/s | 240 kB 00:00 2026-02-17T11:02:13.122 INFO:teuthology.orchestra.run.trial049.stdout:(22/35): qatlib-service-25.08.0-2.el9.x86_64.rp 2.6 MB/s | 37 kB 00:00 2026-02-17T11:02:13.136 INFO:teuthology.orchestra.run.trial049.stdout:(23/35): qatzip-libs-1.3.1-1.el9.x86_64.rpm 4.6 MB/s | 66 kB 00:00 2026-02-17T11:02:13.265 INFO:teuthology.orchestra.run.trial049.stdout:(24/35): pciutils-3.7.0-7.el9.x86_64.rpm 239 kB/s | 93 kB 00:00 2026-02-17T11:02:13.279 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 44/99 2026-02-17T11:02:13.282 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-17T11:02:13.283 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-17T11:02:13.289 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 45/99 2026-02-17T11:02:13.293 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 46/99 2026-02-17T11:02:13.299 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 47/99 2026-02-17T11:02:13.301 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 48/99 2026-02-17T11:02:13.329 INFO:teuthology.orchestra.run.trial157.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 49/99 2026-02-17T11:02:13.332 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-705.g04cf6dd4.e 1/1 2026-02-17T11:02:13.332 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:02:13.332 INFO:teuthology.orchestra.run.trial097.stdout:Installed: 2026-02-17T11:02:13.333 INFO:teuthology.orchestra.run.trial097.stdout: ceph-immutable-object-cache-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:13.333 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:02:13.333 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-17T11:02:13.360 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install ceph-mgr 2026-02-17T11:02:13.373 INFO:teuthology.orchestra.run.trial157.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 50/99 2026-02-17T11:02:13.380 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 51/99 2026-02-17T11:02:13.382 INFO:teuthology.orchestra.run.trial049.stdout:(25/35): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.2 MB/s | 308 kB 00:00 2026-02-17T11:02:13.383 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 52/99 2026-02-17T11:02:13.389 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 53/99 2026-02-17T11:02:13.393 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 54/99 2026-02-17T11:02:13.400 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 55/99 2026-02-17T11:02:13.403 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 56/99 2026-02-17T11:02:13.421 INFO:teuthology.orchestra.run.trial049.stdout:(26/35): libarrow-doc-9.0.0-15.el9.noarch.rpm 646 kB/s | 25 kB 00:00 2026-02-17T11:02:13.431 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 57/99 2026-02-17T11:02:13.441 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 58/99 2026-02-17T11:02:13.442 INFO:teuthology.orchestra.run.trial049.stdout:(27/35): nvme-cli-2.13-1.el9.x86_64.rpm 1.6 MB/s | 1.1 MB 00:00 2026-02-17T11:02:13.459 INFO:teuthology.orchestra.run.trial049.stdout:(28/35): liboath-2.6.12-1.el9.x86_64.rpm 1.2 MB/s | 49 kB 00:00 2026-02-17T11:02:13.476 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 59/99 2026-02-17T11:02:13.562 INFO:teuthology.orchestra.run.trial049.stdout:(29/35): parquet-libs-9.0.0-15.el9.x86_64.rpm 8.0 MB/s | 838 kB 00:00 2026-02-17T11:02:13.572 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-17T11:02:13.580 INFO:teuthology.orchestra.run.trial162.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/37 2026-02-17T11:02:13.583 INFO:teuthology.orchestra.run.trial162.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/37 2026-02-17T11:02:13.594 INFO:teuthology.orchestra.run.trial162.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/37 2026-02-17T11:02:13.598 INFO:teuthology.orchestra.run.trial049.stdout:(30/35): libunwind-1.6.2-1.el9.x86_64.rpm 432 kB/s | 67 kB 00:00 2026-02-17T11:02:13.601 INFO:teuthology.orchestra.run.trial049.stdout:(31/35): re2-20211101-20.el9.x86_64.rpm 4.7 MB/s | 191 kB 00:00 2026-02-17T11:02:13.641 INFO:teuthology.orchestra.run.trial049.stdout:(32/35): libarrow-9.0.0-15.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2026-02-17T11:02:13.678 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:00:31 ago on Tue 17 Feb 2026 11:01:42 AM UTC. 2026-02-17T11:02:13.701 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 60/99 2026-02-17T11:02:13.725 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 61/99 2026-02-17T11:02:13.728 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 62/99 2026-02-17T11:02:13.732 INFO:teuthology.orchestra.run.trial049.stdout:(33/35): librbd1-19.2.3-705.g04cf6dd4.el9.x86_6 35 MB/s | 3.2 MB 00:00 2026-02-17T11:02:13.742 INFO:teuthology.orchestra.run.trial097.stdout:Package ceph-mgr-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T11:02:13.745 INFO:teuthology.orchestra.run.trial162.stdout: Installing : thrift-0.15.0-4.el9.x86_64 4/37 2026-02-17T11:02:13.749 INFO:teuthology.orchestra.run.trial162.stdout: Upgrading : librados2-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/37 2026-02-17T11:02:13.760 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-17T11:02:13.760 INFO:teuthology.orchestra.run.trial097.stdout:Nothing to do. 2026-02-17T11:02:13.761 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-17T11:02:13.780 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: librados2-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/37 2026-02-17T11:02:13.783 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install ceph-mgr-dashboard 2026-02-17T11:02:13.787 INFO:teuthology.orchestra.run.trial157.stdout: Installing : openblas-0.3.29-1.el9.x86_64 63/99 2026-02-17T11:02:13.789 INFO:teuthology.orchestra.run.trial157.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 64/99 2026-02-17T11:02:13.804 INFO:teuthology.orchestra.run.trial049.stdout:(34/35): thrift-0.15.0-4.el9.x86_64.rpm 7.7 MB/s | 1.6 MB 00:00 2026-02-17T11:02:13.811 INFO:teuthology.orchestra.run.trial157.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 65/99 2026-02-17T11:02:13.813 INFO:teuthology.orchestra.run.trial049.stdout:(35/35): librados2-19.2.3-705.g04cf6dd4.el9.x86 16 MB/s | 3.4 MB 00:00 2026-02-17T11:02:13.815 INFO:teuthology.orchestra.run.trial049.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:02:13.815 INFO:teuthology.orchestra.run.trial049.stdout:Total 23 MB/s | 63 MB 00:02 2026-02-17T11:02:13.823 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-rados-2:19.2.3-705.g04cf6dd4.el9.x86_64 6/37 2026-02-17T11:02:13.824 INFO:teuthology.orchestra.run.trial162.stdout: Installing : libcephfs2-2:19.2.3-705.g04cf6dd4.el9.x86_64 7/37 2026-02-17T11:02:13.836 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: libcephfs2-2:19.2.3-705.g04cf6dd4.el9.x86_64 7/37 2026-02-17T11:02:13.840 INFO:teuthology.orchestra.run.trial162.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/37 2026-02-17T11:02:13.849 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-ceph-argparse-2:19.2.3-705.g04cf6dd4.el9.x 9/37 2026-02-17T11:02:13.872 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-cephfs-2:19.2.3-705.g04cf6dd4.el9.x86_64 10/37 2026-02-17T11:02:13.872 INFO:teuthology.orchestra.run.trial162.stdout: Installing : libradosstriper1-2:19.2.3-705.g04cf6dd4.el9.x86_64 11/37 2026-02-17T11:02:13.886 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: libradosstriper1-2:19.2.3-705.g04cf6dd4.el9.x86_64 11/37 2026-02-17T11:02:13.913 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction check 2026-02-17T11:02:13.919 INFO:teuthology.orchestra.run.trial162.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/37 2026-02-17T11:02:13.923 INFO:teuthology.orchestra.run.trial162.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 13/37 2026-02-17T11:02:13.929 INFO:teuthology.orchestra.run.trial162.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/37 2026-02-17T11:02:13.930 INFO:teuthology.orchestra.run.trial049.stdout:Transaction check succeeded. 2026-02-17T11:02:13.931 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction test 2026-02-17T11:02:13.932 INFO:teuthology.orchestra.run.trial162.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/37 2026-02-17T11:02:13.934 INFO:teuthology.orchestra.run.trial162.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 16/37 2026-02-17T11:02:13.939 INFO:teuthology.orchestra.run.trial162.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/37 2026-02-17T11:02:14.078 INFO:teuthology.orchestra.run.trial162.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-17T11:02:14.079 INFO:teuthology.orchestra.run.trial162.stdout: Upgrading : librbd1-2:19.2.3-705.g04cf6dd4.el9.x86_64 19/37 2026-02-17T11:02:14.094 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:00:32 ago on Tue 17 Feb 2026 11:01:42 AM UTC. 2026-02-17T11:02:14.106 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: librbd1-2:19.2.3-705.g04cf6dd4.el9.x86_64 19/37 2026-02-17T11:02:14.108 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-rbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 20/37 2026-02-17T11:02:14.114 INFO:teuthology.orchestra.run.trial162.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/37 2026-02-17T11:02:14.139 INFO:teuthology.orchestra.run.trial157.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 66/99 2026-02-17T11:02:14.159 INFO:teuthology.orchestra.run.trial097.stdout:Package ceph-mgr-dashboard-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-17T11:02:14.168 INFO:teuthology.orchestra.run.trial049.stdout:Transaction test succeeded. 2026-02-17T11:02:14.168 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction 2026-02-17T11:02:14.176 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-17T11:02:14.177 INFO:teuthology.orchestra.run.trial097.stdout:Nothing to do. 2026-02-17T11:02:14.177 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-17T11:02:14.199 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-17T11:02:14.214 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 67/99 2026-02-17T11:02:14.338 INFO:teuthology.orchestra.run.trial162.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/37 2026-02-17T11:02:14.339 INFO:teuthology.orchestra.run.trial162.stdout: Installing : librgw2-2:19.2.3-705.g04cf6dd4.el9.x86_64 23/37 2026-02-17T11:02:14.355 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: librgw2-2:19.2.3-705.g04cf6dd4.el9.x86_64 23/37 2026-02-17T11:02:14.359 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-rgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 24/37 2026-02-17T11:02:14.363 INFO:teuthology.orchestra.run.trial162.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/37 2026-02-17T11:02:14.365 INFO:teuthology.orchestra.run.trial162.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/37 2026-02-17T11:02:14.366 INFO:teuthology.orchestra.run.trial162.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-17T11:02:14.385 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-17T11:02:14.463 INFO:teuthology.orchestra.run.trial049.stdout: Preparing : 1/1 2026-02-17T11:02:14.471 INFO:teuthology.orchestra.run.trial049.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/37 2026-02-17T11:02:14.475 INFO:teuthology.orchestra.run.trial049.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/37 2026-02-17T11:02:14.486 INFO:teuthology.orchestra.run.trial049.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/37 2026-02-17T11:02:14.498 INFO:teuthology.orchestra.run.trial162.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/37 2026-02-17T11:02:14.500 INFO:teuthology.orchestra.run.trial162.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 29/37 2026-02-17T11:02:14.505 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:00:32 ago on Tue 17 Feb 2026 11:01:42 AM UTC. 2026-02-17T11:02:14.569 INFO:teuthology.orchestra.run.trial097.stdout:Package ceph-mgr-diskprediction-local-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-17T11:02:14.587 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-17T11:02:14.587 INFO:teuthology.orchestra.run.trial097.stdout:Nothing to do. 2026-02-17T11:02:14.587 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-17T11:02:14.609 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install ceph-mgr-rook 2026-02-17T11:02:14.640 INFO:teuthology.orchestra.run.trial049.stdout: Installing : thrift-0.15.0-4.el9.x86_64 4/37 2026-02-17T11:02:14.645 INFO:teuthology.orchestra.run.trial049.stdout: Upgrading : librados2-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/37 2026-02-17T11:02:14.675 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: librados2-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/37 2026-02-17T11:02:14.718 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-rados-2:19.2.3-705.g04cf6dd4.el9.x86_64 6/37 2026-02-17T11:02:14.719 INFO:teuthology.orchestra.run.trial049.stdout: Installing : libcephfs2-2:19.2.3-705.g04cf6dd4.el9.x86_64 7/37 2026-02-17T11:02:14.732 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: libcephfs2-2:19.2.3-705.g04cf6dd4.el9.x86_64 7/37 2026-02-17T11:02:14.736 INFO:teuthology.orchestra.run.trial049.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/37 2026-02-17T11:02:14.747 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-ceph-argparse-2:19.2.3-705.g04cf6dd4.el9.x 9/37 2026-02-17T11:02:14.770 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-cephfs-2:19.2.3-705.g04cf6dd4.el9.x86_64 10/37 2026-02-17T11:02:14.771 INFO:teuthology.orchestra.run.trial049.stdout: Installing : libradosstriper1-2:19.2.3-705.g04cf6dd4.el9.x86_64 11/37 2026-02-17T11:02:14.772 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 29/37 2026-02-17T11:02:14.772 INFO:teuthology.orchestra.run.trial162.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-17T11:02:14.773 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:02:14.783 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: libradosstriper1-2:19.2.3-705.g04cf6dd4.el9.x86_64 11/37 2026-02-17T11:02:14.811 INFO:teuthology.orchestra.run.trial162.stdout: Installing : mailcap-2.1.49-5.el9.noarch 30/37 2026-02-17T11:02:14.813 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86 31/37 2026-02-17T11:02:14.813 INFO:teuthology.orchestra.run.trial049.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/37 2026-02-17T11:02:14.817 INFO:teuthology.orchestra.run.trial049.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 13/37 2026-02-17T11:02:14.823 INFO:teuthology.orchestra.run.trial049.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/37 2026-02-17T11:02:14.825 INFO:teuthology.orchestra.run.trial049.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/37 2026-02-17T11:02:14.828 INFO:teuthology.orchestra.run.trial049.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 16/37 2026-02-17T11:02:14.833 INFO:teuthology.orchestra.run.trial049.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/37 2026-02-17T11:02:14.893 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 68/99 2026-02-17T11:02:14.910 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 69/99 2026-02-17T11:02:14.920 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 70/99 2026-02-17T11:02:14.924 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:00:32 ago on Tue 17 Feb 2026 11:01:42 AM UTC. 2026-02-17T11:02:14.927 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-packaging-20.9-5.el9.noarch 71/99 2026-02-17T11:02:14.940 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-ply-3.11-14.el9.noarch 72/99 2026-02-17T11:02:14.956 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 73/99 2026-02-17T11:02:14.975 INFO:teuthology.orchestra.run.trial049.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-17T11:02:14.977 INFO:teuthology.orchestra.run.trial049.stdout: Upgrading : librbd1-2:19.2.3-705.g04cf6dd4.el9.x86_64 19/37 2026-02-17T11:02:14.988 INFO:teuthology.orchestra.run.trial097.stdout:Package ceph-mgr-rook-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-17T11:02:15.001 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: librbd1-2:19.2.3-705.g04cf6dd4.el9.x86_64 19/37 2026-02-17T11:02:15.004 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-rbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 20/37 2026-02-17T11:02:15.006 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-17T11:02:15.006 INFO:teuthology.orchestra.run.trial097.stdout:Nothing to do. 2026-02-17T11:02:15.006 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-17T11:02:15.010 INFO:teuthology.orchestra.run.trial049.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/37 2026-02-17T11:02:15.029 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install ceph-mgr-cephadm 2026-02-17T11:02:15.033 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 74/99 2026-02-17T11:02:15.041 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 75/99 2026-02-17T11:02:15.065 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 76/99 2026-02-17T11:02:15.095 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 77/99 2026-02-17T11:02:15.146 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 78/99 2026-02-17T11:02:15.152 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 79/99 2026-02-17T11:02:15.156 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 80/99 2026-02-17T11:02:15.157 INFO:teuthology.orchestra.run.trial157.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 81/99 2026-02-17T11:02:15.175 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T11:02:15.176 INFO:teuthology.orchestra.run.trial157.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-17T11:02:15.176 INFO:teuthology.orchestra.run.trial157.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-17T11:02:15.176 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:02:15.183 INFO:teuthology.orchestra.run.trial157.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T11:02:15.209 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T11:02:15.209 INFO:teuthology.orchestra.run.trial157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-17T11:02:15.209 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:02:15.238 INFO:teuthology.orchestra.run.trial049.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/37 2026-02-17T11:02:15.240 INFO:teuthology.orchestra.run.trial049.stdout: Installing : librgw2-2:19.2.3-705.g04cf6dd4.el9.x86_64 23/37 2026-02-17T11:02:15.245 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 83/99 2026-02-17T11:02:15.255 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: librgw2-2:19.2.3-705.g04cf6dd4.el9.x86_64 23/37 2026-02-17T11:02:15.258 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-rgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 24/37 2026-02-17T11:02:15.263 INFO:teuthology.orchestra.run.trial049.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/37 2026-02-17T11:02:15.265 INFO:teuthology.orchestra.run.trial049.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/37 2026-02-17T11:02:15.266 INFO:teuthology.orchestra.run.trial049.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-17T11:02:15.282 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-17T11:02:15.309 INFO:teuthology.orchestra.run.trial157.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 84/99 2026-02-17T11:02:15.311 INFO:teuthology.orchestra.run.trial157.stdout: Installing : ceph-volume-2:19.2.3-705.g04cf6dd4.el9.noarch 85/99 2026-02-17T11:02:15.325 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: ceph-volume-2:19.2.3-705.g04cf6dd4.el9.noarch 85/99 2026-02-17T11:02:15.325 INFO:teuthology.orchestra.run.trial157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:02:15.325 INFO:teuthology.orchestra.run.trial157.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-17T11:02:15.326 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:02:15.334 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:00:33 ago on Tue 17 Feb 2026 11:01:42 AM UTC. 2026-02-17T11:02:15.393 INFO:teuthology.orchestra.run.trial049.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/37 2026-02-17T11:02:15.395 INFO:teuthology.orchestra.run.trial049.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 29/37 2026-02-17T11:02:15.398 INFO:teuthology.orchestra.run.trial097.stdout:Package ceph-mgr-cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-17T11:02:15.415 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-17T11:02:15.416 INFO:teuthology.orchestra.run.trial097.stdout:Nothing to do. 2026-02-17T11:02:15.416 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-17T11:02:15.437 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install ceph-fuse 2026-02-17T11:02:15.670 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 29/37 2026-02-17T11:02:15.670 INFO:teuthology.orchestra.run.trial049.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-17T11:02:15.670 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:02:15.709 INFO:teuthology.orchestra.run.trial049.stdout: Installing : mailcap-2.1.49-5.el9.noarch 30/37 2026-02-17T11:02:15.711 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86 31/37 2026-02-17T11:02:15.744 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:00:33 ago on Tue 17 Feb 2026 11:01:42 AM UTC. 2026-02-17T11:02:15.795 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 32/37 2026-02-17T11:02:15.797 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 32/37 2026-02-17T11:02:15.827 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-17T11:02:15.828 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:02:15.828 INFO:teuthology.orchestra.run.trial097.stdout: Package Architecture Version Repository Size 2026-02-17T11:02:15.828 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:02:15.828 INFO:teuthology.orchestra.run.trial097.stdout:Installing: 2026-02-17T11:02:15.828 INFO:teuthology.orchestra.run.trial097.stdout: ceph-fuse x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 1.2 M 2026-02-17T11:02:15.828 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:02:15.828 INFO:teuthology.orchestra.run.trial097.stdout:Transaction Summary 2026-02-17T11:02:15.828 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:02:15.828 INFO:teuthology.orchestra.run.trial097.stdout:Install 1 Package 2026-02-17T11:02:15.828 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:02:15.829 INFO:teuthology.orchestra.run.trial097.stdout:Total download size: 1.2 M 2026-02-17T11:02:15.829 INFO:teuthology.orchestra.run.trial097.stdout:Installed size: 3.6 M 2026-02-17T11:02:15.829 INFO:teuthology.orchestra.run.trial097.stdout:Downloading Packages: 2026-02-17T11:02:16.035 INFO:teuthology.orchestra.run.trial157.stdout: Installing : ceph-osd-2:19.2.3-705.g04cf6dd4.el9.x86_64 86/99 2026-02-17T11:02:16.059 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: ceph-osd-2:19.2.3-705.g04cf6dd4.el9.x86_64 86/99 2026-02-17T11:02:16.059 INFO:teuthology.orchestra.run.trial157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:02:16.059 INFO:teuthology.orchestra.run.trial157.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-17T11:02:16.059 INFO:teuthology.orchestra.run.trial157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T11:02:16.060 INFO:teuthology.orchestra.run.trial157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T11:02:16.060 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:02:16.079 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 32/37 2026-02-17T11:02:16.082 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-base-2:19.2.3-705.g04cf6dd4.el9.x86_64 33/37 2026-02-17T11:02:16.116 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 87/99 2026-02-17T11:02:16.118 INFO:teuthology.orchestra.run.trial157.stdout: Installing : cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 87/99 2026-02-17T11:02:16.123 INFO:teuthology.orchestra.run.trial157.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-705.g04cf6dd4.el9. 88/99 2026-02-17T11:02:16.125 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-base-2:19.2.3-705.g04cf6dd4.el9.x86_64 33/37 2026-02-17T11:02:16.125 INFO:teuthology.orchestra.run.trial162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-17T11:02:16.125 INFO:teuthology.orchestra.run.trial162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-17T11:02:16.125 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:02:16.128 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-selinux-2:19.2.3-705.g04cf6dd4.el9.x86_64 34/37 2026-02-17T11:02:16.143 INFO:teuthology.orchestra.run.trial157.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-705.g04cf6dd4.el9 89/99 2026-02-17T11:02:16.144 INFO:teuthology.orchestra.run.trial157.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 90/99 2026-02-17T11:02:16.181 INFO:teuthology.orchestra.run.trial097.stdout:ceph-fuse-19.2.3-705.g04cf6dd4.el9.x86_64.rpm 3.3 MB/s | 1.2 MB 00:00 2026-02-17T11:02:16.182 INFO:teuthology.orchestra.run.trial097.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:02:16.182 INFO:teuthology.orchestra.run.trial097.stdout:Total 3.2 MB/s | 1.2 MB 00:00 2026-02-17T11:02:16.182 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction check 2026-02-17T11:02:16.186 INFO:teuthology.orchestra.run.trial097.stdout:Transaction check succeeded. 2026-02-17T11:02:16.186 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction test 2026-02-17T11:02:16.220 INFO:teuthology.orchestra.run.trial097.stdout:Transaction test succeeded. 2026-02-17T11:02:16.220 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction 2026-02-17T11:02:16.320 INFO:teuthology.orchestra.run.trial097.stdout: Preparing : 1/1 2026-02-17T11:02:16.337 INFO:teuthology.orchestra.run.trial097.stdout: Installing : ceph-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:16.541 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: ceph-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:16.598 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : ceph-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:16.598 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:02:16.599 INFO:teuthology.orchestra.run.trial097.stdout:Installed: 2026-02-17T11:02:16.599 INFO:teuthology.orchestra.run.trial097.stdout: ceph-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:16.599 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:02:16.599 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-17T11:02:16.626 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install ceph-volume 2026-02-17T11:02:16.640 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 90/99 2026-02-17T11:02:16.644 INFO:teuthology.orchestra.run.trial157.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-705.g04cf6dd4.el9.noar 91/99 2026-02-17T11:02:16.712 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 32/37 2026-02-17T11:02:16.714 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 32/37 2026-02-17T11:02:16.943 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:00:34 ago on Tue 17 Feb 2026 11:01:42 AM UTC. 2026-02-17T11:02:16.999 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 32/37 2026-02-17T11:02:17.002 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-base-2:19.2.3-705.g04cf6dd4.el9.x86_64 33/37 2026-02-17T11:02:17.007 INFO:teuthology.orchestra.run.trial097.stdout:Package ceph-volume-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-17T11:02:17.025 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-17T11:02:17.026 INFO:teuthology.orchestra.run.trial097.stdout:Nothing to do. 2026-02-17T11:02:17.026 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-17T11:02:17.048 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install librados-devel 2026-02-17T11:02:17.050 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-base-2:19.2.3-705.g04cf6dd4.el9.x86_64 33/37 2026-02-17T11:02:17.050 INFO:teuthology.orchestra.run.trial049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-17T11:02:17.050 INFO:teuthology.orchestra.run.trial049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-17T11:02:17.051 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:02:17.051 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-selinux-2:19.2.3-705.g04cf6dd4.el9.x86_64 34/37 2026-02-17T11:02:17.099 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-705.g04cf6dd4.el9.noar 91/99 2026-02-17T11:02:17.100 INFO:teuthology.orchestra.run.trial157.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-705.g04cf6d 92/99 2026-02-17T11:02:17.112 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-705.g04cf6d 92/99 2026-02-17T11:02:17.113 INFO:teuthology.orchestra.run.trial157.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-705.g04cf6dd4.el9.noar 93/99 2026-02-17T11:02:17.169 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-705.g04cf6dd4.el9.noar 93/99 2026-02-17T11:02:17.220 INFO:teuthology.orchestra.run.trial157.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-705.g04cf6dd4.el9.n 94/99 2026-02-17T11:02:17.221 INFO:teuthology.orchestra.run.trial157.stdout: Installing : ceph-mgr-2:19.2.3-705.g04cf6dd4.el9.x86_64 95/99 2026-02-17T11:02:17.242 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: ceph-mgr-2:19.2.3-705.g04cf6dd4.el9.x86_64 95/99 2026-02-17T11:02:17.242 INFO:teuthology.orchestra.run.trial157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:02:17.243 INFO:teuthology.orchestra.run.trial157.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-17T11:02:17.243 INFO:teuthology.orchestra.run.trial157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T11:02:17.243 INFO:teuthology.orchestra.run.trial157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T11:02:17.243 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:02:17.254 INFO:teuthology.orchestra.run.trial157.stdout: Installing : ceph-mgr-rook-2:19.2.3-705.g04cf6dd4.el9.noarch 96/99 2026-02-17T11:02:17.357 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:00:35 ago on Tue 17 Feb 2026 11:01:42 AM UTC. 2026-02-17T11:02:17.439 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-17T11:02:17.440 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:02:17.441 INFO:teuthology.orchestra.run.trial097.stdout: Package Arch Version Repo Size 2026-02-17T11:02:17.441 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:02:17.441 INFO:teuthology.orchestra.run.trial097.stdout:Installing: 2026-02-17T11:02:17.441 INFO:teuthology.orchestra.run.trial097.stdout: librados-devel x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 126 k 2026-02-17T11:02:17.441 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:02:17.441 INFO:teuthology.orchestra.run.trial097.stdout:Transaction Summary 2026-02-17T11:02:17.441 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:02:17.441 INFO:teuthology.orchestra.run.trial097.stdout:Install 1 Package 2026-02-17T11:02:17.441 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:02:17.441 INFO:teuthology.orchestra.run.trial097.stdout:Total download size: 126 k 2026-02-17T11:02:17.442 INFO:teuthology.orchestra.run.trial097.stdout:Installed size: 456 k 2026-02-17T11:02:17.442 INFO:teuthology.orchestra.run.trial097.stdout:Downloading Packages: 2026-02-17T11:02:17.476 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-705.g04cf6dd4.el9.noarch 96/99 2026-02-17T11:02:17.477 INFO:teuthology.orchestra.run.trial157.stdout: Installing : ceph-mon-2:19.2.3-705.g04cf6dd4.el9.x86_64 97/99 2026-02-17T11:02:17.498 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: ceph-mon-2:19.2.3-705.g04cf6dd4.el9.x86_64 97/99 2026-02-17T11:02:17.498 INFO:teuthology.orchestra.run.trial157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:02:17.499 INFO:teuthology.orchestra.run.trial157.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-17T11:02:17.499 INFO:teuthology.orchestra.run.trial157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T11:02:17.499 INFO:teuthology.orchestra.run.trial157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T11:02:17.499 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:02:17.526 INFO:teuthology.orchestra.run.trial097.stdout:librados-devel-19.2.3-705.g04cf6dd4.el9.x86_64. 1.4 MB/s | 126 kB 00:00 2026-02-17T11:02:17.527 INFO:teuthology.orchestra.run.trial097.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:02:17.527 INFO:teuthology.orchestra.run.trial097.stdout:Total 1.4 MB/s | 126 kB 00:00 2026-02-17T11:02:17.528 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction check 2026-02-17T11:02:17.530 INFO:teuthology.orchestra.run.trial097.stdout:Transaction check succeeded. 2026-02-17T11:02:17.530 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction test 2026-02-17T11:02:17.561 INFO:teuthology.orchestra.run.trial097.stdout:Transaction test succeeded. 2026-02-17T11:02:17.561 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction 2026-02-17T11:02:17.602 INFO:teuthology.orchestra.run.trial157.stdout: Installing : ceph-mds-2:19.2.3-705.g04cf6dd4.el9.x86_64 98/99 2026-02-17T11:02:17.616 INFO:teuthology.orchestra.run.trial097.stdout: Preparing : 1/1 2026-02-17T11:02:17.624 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: ceph-mds-2:19.2.3-705.g04cf6dd4.el9.x86_64 98/99 2026-02-17T11:02:17.624 INFO:teuthology.orchestra.run.trial157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:02:17.624 INFO:teuthology.orchestra.run.trial157.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-17T11:02:17.624 INFO:teuthology.orchestra.run.trial157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T11:02:17.624 INFO:teuthology.orchestra.run.trial157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T11:02:17.624 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:02:17.632 INFO:teuthology.orchestra.run.trial097.stdout: Installing : librados-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:17.642 INFO:teuthology.orchestra.run.trial157.stdout: Installing : ceph-2:19.2.3-705.g04cf6dd4.el9.x86_64 99/99 2026-02-17T11:02:17.709 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: librados-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:17.767 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : librados-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:17.767 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:02:17.767 INFO:teuthology.orchestra.run.trial097.stdout:Installed: 2026-02-17T11:02:17.767 INFO:teuthology.orchestra.run.trial097.stdout: librados-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:17.767 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:02:17.767 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-17T11:02:17.795 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install libcephfs2 2026-02-17T11:02:18.109 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:00:36 ago on Tue 17 Feb 2026 11:01:42 AM UTC. 2026-02-17T11:02:18.174 INFO:teuthology.orchestra.run.trial097.stdout:Package libcephfs2-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T11:02:18.191 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-17T11:02:18.192 INFO:teuthology.orchestra.run.trial097.stdout:Nothing to do. 2026-02-17T11:02:18.192 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-17T11:02:18.212 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install libcephfs-devel 2026-02-17T11:02:18.287 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: ceph-2:19.2.3-705.g04cf6dd4.el9.x86_64 99/99 2026-02-17T11:02:18.288 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : ceph-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/99 2026-02-17T11:02:18.288 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : ceph-mds-2:19.2.3-705.g04cf6dd4.el9.x86_64 2/99 2026-02-17T11:02:18.288 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : ceph-mgr-2:19.2.3-705.g04cf6dd4.el9.x86_64 3/99 2026-02-17T11:02:18.288 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : ceph-mon-2:19.2.3-705.g04cf6dd4.el9.x86_64 4/99 2026-02-17T11:02:18.288 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : ceph-osd-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/99 2026-02-17T11:02:18.288 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-705.g04cf6dd4.el9 6/99 2026-02-17T11:02:18.288 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 7/99 2026-02-17T11:02:18.289 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-705.g04cf6dd4.el9.noar 8/99 2026-02-17T11:02:18.289 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-705.g04cf6d 9/99 2026-02-17T11:02:18.289 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-705.g04cf6dd4.el9.noar 10/99 2026-02-17T11:02:18.289 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-705.g04cf6dd4.el9.n 11/99 2026-02-17T11:02:18.289 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : ceph-mgr-rook-2:19.2.3-705.g04cf6dd4.el9.noarch 12/99 2026-02-17T11:02:18.289 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-705.g04cf6dd4.el9. 13/99 2026-02-17T11:02:18.289 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : ceph-volume-2:19.2.3-705.g04cf6dd4.el9.noarch 14/99 2026-02-17T11:02:18.290 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 15/99 2026-02-17T11:02:18.290 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 16/99 2026-02-17T11:02:18.290 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/99 2026-02-17T11:02:18.290 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/99 2026-02-17T11:02:18.290 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/99 2026-02-17T11:02:18.290 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/99 2026-02-17T11:02:18.290 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/99 2026-02-17T11:02:18.290 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/99 2026-02-17T11:02:18.290 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/99 2026-02-17T11:02:18.291 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/99 2026-02-17T11:02:18.291 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/99 2026-02-17T11:02:18.291 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/99 2026-02-17T11:02:18.291 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/99 2026-02-17T11:02:18.291 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/99 2026-02-17T11:02:18.291 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : zip-3.0-35.el9.x86_64 29/99 2026-02-17T11:02:18.291 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 30/99 2026-02-17T11:02:18.291 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 31/99 2026-02-17T11:02:18.292 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 32/99 2026-02-17T11:02:18.292 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/99 2026-02-17T11:02:18.292 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/99 2026-02-17T11:02:18.292 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/99 2026-02-17T11:02:18.292 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/99 2026-02-17T11:02:18.292 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/99 2026-02-17T11:02:18.292 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/99 2026-02-17T11:02:18.292 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 39/99 2026-02-17T11:02:18.293 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/99 2026-02-17T11:02:18.293 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 41/99 2026-02-17T11:02:18.293 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 42/99 2026-02-17T11:02:18.293 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 43/99 2026-02-17T11:02:18.293 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/99 2026-02-17T11:02:18.293 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/99 2026-02-17T11:02:18.293 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/99 2026-02-17T11:02:18.293 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/99 2026-02-17T11:02:18.293 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/99 2026-02-17T11:02:18.294 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 49/99 2026-02-17T11:02:18.294 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 50/99 2026-02-17T11:02:18.294 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/99 2026-02-17T11:02:18.294 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/99 2026-02-17T11:02:18.294 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/99 2026-02-17T11:02:18.294 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/99 2026-02-17T11:02:18.294 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/99 2026-02-17T11:02:18.294 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/99 2026-02-17T11:02:18.294 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/99 2026-02-17T11:02:18.294 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/99 2026-02-17T11:02:18.295 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/99 2026-02-17T11:02:18.295 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/99 2026-02-17T11:02:18.295 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/99 2026-02-17T11:02:18.295 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/99 2026-02-17T11:02:18.295 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/99 2026-02-17T11:02:18.295 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/99 2026-02-17T11:02:18.295 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/99 2026-02-17T11:02:18.295 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/99 2026-02-17T11:02:18.295 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/99 2026-02-17T11:02:18.295 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/99 2026-02-17T11:02:18.295 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/99 2026-02-17T11:02:18.295 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/99 2026-02-17T11:02:18.296 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/99 2026-02-17T11:02:18.296 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/99 2026-02-17T11:02:18.296 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/99 2026-02-17T11:02:18.296 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/99 2026-02-17T11:02:18.296 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/99 2026-02-17T11:02:18.296 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/99 2026-02-17T11:02:18.296 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/99 2026-02-17T11:02:18.296 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/99 2026-02-17T11:02:18.296 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/99 2026-02-17T11:02:18.296 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/99 2026-02-17T11:02:18.296 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 81/99 2026-02-17T11:02:18.296 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/99 2026-02-17T11:02:18.296 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/99 2026-02-17T11:02:18.297 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/99 2026-02-17T11:02:18.297 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 85/99 2026-02-17T11:02:18.297 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 86/99 2026-02-17T11:02:18.297 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/99 2026-02-17T11:02:18.297 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 88/99 2026-02-17T11:02:18.297 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 89/99 2026-02-17T11:02:18.297 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 90/99 2026-02-17T11:02:18.297 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 91/99 2026-02-17T11:02:18.297 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 92/99 2026-02-17T11:02:18.297 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 93/99 2026-02-17T11:02:18.297 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 94/99 2026-02-17T11:02:18.297 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 95/99 2026-02-17T11:02:18.297 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 96/99 2026-02-17T11:02:18.298 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 97/99 2026-02-17T11:02:18.298 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 98/99 2026-02-17T11:02:18.345 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 99/99 2026-02-17T11:02:18.345 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:02:18.345 INFO:teuthology.orchestra.run.trial157.stdout:Installed: 2026-02-17T11:02:18.346 INFO:teuthology.orchestra.run.trial157.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-17T11:02:18.346 INFO:teuthology.orchestra.run.trial157.stdout: ceph-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:18.346 INFO:teuthology.orchestra.run.trial157.stdout: ceph-grafana-dashboards-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T11:02:18.346 INFO:teuthology.orchestra.run.trial157.stdout: ceph-mds-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:18.346 INFO:teuthology.orchestra.run.trial157.stdout: ceph-mgr-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:18.346 INFO:teuthology.orchestra.run.trial157.stdout: ceph-mgr-cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T11:02:18.346 INFO:teuthology.orchestra.run.trial157.stdout: ceph-mgr-dashboard-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T11:02:18.346 INFO:teuthology.orchestra.run.trial157.stdout: ceph-mgr-diskprediction-local-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T11:02:18.346 INFO:teuthology.orchestra.run.trial157.stdout: ceph-mgr-k8sevents-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T11:02:18.346 INFO:teuthology.orchestra.run.trial157.stdout: ceph-mgr-modules-core-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T11:02:18.346 INFO:teuthology.orchestra.run.trial157.stdout: ceph-mgr-rook-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T11:02:18.346 INFO:teuthology.orchestra.run.trial157.stdout: ceph-mon-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:18.347 INFO:teuthology.orchestra.run.trial157.stdout: ceph-osd-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:18.347 INFO:teuthology.orchestra.run.trial157.stdout: ceph-prometheus-alerts-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T11:02:18.347 INFO:teuthology.orchestra.run.trial157.stdout: ceph-volume-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T11:02:18.347 INFO:teuthology.orchestra.run.trial157.stdout: cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T11:02:18.347 INFO:teuthology.orchestra.run.trial157.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-17T11:02:18.347 INFO:teuthology.orchestra.run.trial157.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-17T11:02:18.347 INFO:teuthology.orchestra.run.trial157.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-17T11:02:18.347 INFO:teuthology.orchestra.run.trial157.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-17T11:02:18.347 INFO:teuthology.orchestra.run.trial157.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-17T11:02:18.347 INFO:teuthology.orchestra.run.trial157.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-17T11:02:18.347 INFO:teuthology.orchestra.run.trial157.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-17T11:02:18.347 INFO:teuthology.orchestra.run.trial157.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-17T11:02:18.348 INFO:teuthology.orchestra.run.trial157.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-17T11:02:18.348 INFO:teuthology.orchestra.run.trial157.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T11:02:18.348 INFO:teuthology.orchestra.run.trial157.stdout: lua-5.4.4-4.el9.x86_64 2026-02-17T11:02:18.348 INFO:teuthology.orchestra.run.trial157.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-17T11:02:18.348 INFO:teuthology.orchestra.run.trial157.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-17T11:02:18.348 INFO:teuthology.orchestra.run.trial157.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-17T11:02:18.348 INFO:teuthology.orchestra.run.trial157.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-17T11:02:18.348 INFO:teuthology.orchestra.run.trial157.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-17T11:02:18.348 INFO:teuthology.orchestra.run.trial157.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-17T11:02:18.348 INFO:teuthology.orchestra.run.trial157.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-17T11:02:18.348 INFO:teuthology.orchestra.run.trial157.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-17T11:02:18.348 INFO:teuthology.orchestra.run.trial157.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-17T11:02:18.349 INFO:teuthology.orchestra.run.trial157.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-17T11:02:18.349 INFO:teuthology.orchestra.run.trial157.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-17T11:02:18.349 INFO:teuthology.orchestra.run.trial157.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-17T11:02:18.349 INFO:teuthology.orchestra.run.trial157.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-17T11:02:18.349 INFO:teuthology.orchestra.run.trial157.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-17T11:02:18.349 INFO:teuthology.orchestra.run.trial157.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-17T11:02:18.349 INFO:teuthology.orchestra.run.trial157.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-17T11:02:18.349 INFO:teuthology.orchestra.run.trial157.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-17T11:02:18.349 INFO:teuthology.orchestra.run.trial157.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-17T11:02:18.349 INFO:teuthology.orchestra.run.trial157.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-17T11:02:18.349 INFO:teuthology.orchestra.run.trial157.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-17T11:02:18.349 INFO:teuthology.orchestra.run.trial157.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-17T11:02:18.349 INFO:teuthology.orchestra.run.trial157.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-17T11:02:18.350 INFO:teuthology.orchestra.run.trial157.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-17T11:02:18.350 INFO:teuthology.orchestra.run.trial157.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-17T11:02:18.350 INFO:teuthology.orchestra.run.trial157.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-17T11:02:18.350 INFO:teuthology.orchestra.run.trial157.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-17T11:02:18.350 INFO:teuthology.orchestra.run.trial157.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-17T11:02:18.350 INFO:teuthology.orchestra.run.trial157.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-17T11:02:18.350 INFO:teuthology.orchestra.run.trial157.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-17T11:02:18.350 INFO:teuthology.orchestra.run.trial157.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-17T11:02:18.350 INFO:teuthology.orchestra.run.trial157.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-17T11:02:18.350 INFO:teuthology.orchestra.run.trial157.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T11:02:18.350 INFO:teuthology.orchestra.run.trial157.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-17T11:02:18.350 INFO:teuthology.orchestra.run.trial157.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-17T11:02:18.351 INFO:teuthology.orchestra.run.trial157.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-17T11:02:18.351 INFO:teuthology.orchestra.run.trial157.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-17T11:02:18.351 INFO:teuthology.orchestra.run.trial157.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-17T11:02:18.351 INFO:teuthology.orchestra.run.trial157.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-17T11:02:18.351 INFO:teuthology.orchestra.run.trial157.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-17T11:02:18.351 INFO:teuthology.orchestra.run.trial157.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-17T11:02:18.351 INFO:teuthology.orchestra.run.trial157.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-17T11:02:18.351 INFO:teuthology.orchestra.run.trial157.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-17T11:02:18.351 INFO:teuthology.orchestra.run.trial157.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-17T11:02:18.351 INFO:teuthology.orchestra.run.trial157.stdout: python3-ply-3.11-14.el9.noarch 2026-02-17T11:02:18.351 INFO:teuthology.orchestra.run.trial157.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-17T11:02:18.351 INFO:teuthology.orchestra.run.trial157.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-17T11:02:18.351 INFO:teuthology.orchestra.run.trial157.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-17T11:02:18.351 INFO:teuthology.orchestra.run.trial157.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-17T11:02:18.352 INFO:teuthology.orchestra.run.trial157.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-17T11:02:18.352 INFO:teuthology.orchestra.run.trial157.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-17T11:02:18.352 INFO:teuthology.orchestra.run.trial157.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-17T11:02:18.352 INFO:teuthology.orchestra.run.trial157.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-17T11:02:18.352 INFO:teuthology.orchestra.run.trial157.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-17T11:02:18.352 INFO:teuthology.orchestra.run.trial157.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-17T11:02:18.352 INFO:teuthology.orchestra.run.trial157.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-17T11:02:18.352 INFO:teuthology.orchestra.run.trial157.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-17T11:02:18.352 INFO:teuthology.orchestra.run.trial157.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-17T11:02:18.352 INFO:teuthology.orchestra.run.trial157.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-17T11:02:18.352 INFO:teuthology.orchestra.run.trial157.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-17T11:02:18.352 INFO:teuthology.orchestra.run.trial157.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-17T11:02:18.352 INFO:teuthology.orchestra.run.trial157.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-17T11:02:18.353 INFO:teuthology.orchestra.run.trial157.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-17T11:02:18.353 INFO:teuthology.orchestra.run.trial157.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-17T11:02:18.353 INFO:teuthology.orchestra.run.trial157.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-17T11:02:18.353 INFO:teuthology.orchestra.run.trial157.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-17T11:02:18.353 INFO:teuthology.orchestra.run.trial157.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-17T11:02:18.353 INFO:teuthology.orchestra.run.trial157.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-17T11:02:18.353 INFO:teuthology.orchestra.run.trial157.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-17T11:02:18.353 INFO:teuthology.orchestra.run.trial157.stdout: unzip-6.0-59.el9.x86_64 2026-02-17T11:02:18.353 INFO:teuthology.orchestra.run.trial157.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-17T11:02:18.353 INFO:teuthology.orchestra.run.trial157.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-17T11:02:18.353 INFO:teuthology.orchestra.run.trial157.stdout: zip-3.0-35.el9.x86_64 2026-02-17T11:02:18.353 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:02:18.354 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-17T11:02:18.401 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install ceph-base 2026-02-17T11:02:18.523 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:00:36 ago on Tue 17 Feb 2026 11:01:42 AM UTC. 2026-02-17T11:02:18.605 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-17T11:02:18.605 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:02:18.606 INFO:teuthology.orchestra.run.trial097.stdout: Package Arch Version Repo Size 2026-02-17T11:02:18.606 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:02:18.606 INFO:teuthology.orchestra.run.trial097.stdout:Installing: 2026-02-17T11:02:18.606 INFO:teuthology.orchestra.run.trial097.stdout: libcephfs-devel x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 34 k 2026-02-17T11:02:18.606 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:02:18.606 INFO:teuthology.orchestra.run.trial097.stdout:Transaction Summary 2026-02-17T11:02:18.606 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:02:18.606 INFO:teuthology.orchestra.run.trial097.stdout:Install 1 Package 2026-02-17T11:02:18.606 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:02:18.607 INFO:teuthology.orchestra.run.trial097.stdout:Total download size: 34 k 2026-02-17T11:02:18.607 INFO:teuthology.orchestra.run.trial097.stdout:Installed size: 153 k 2026-02-17T11:02:18.607 INFO:teuthology.orchestra.run.trial097.stdout:Downloading Packages: 2026-02-17T11:02:18.668 INFO:teuthology.orchestra.run.trial097.stdout:libcephfs-devel-19.2.3-705.g04cf6dd4.el9.x86_64 536 kB/s | 34 kB 00:00 2026-02-17T11:02:18.669 INFO:teuthology.orchestra.run.trial097.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:02:18.669 INFO:teuthology.orchestra.run.trial097.stdout:Total 529 kB/s | 34 kB 00:00 2026-02-17T11:02:18.669 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction check 2026-02-17T11:02:18.671 INFO:teuthology.orchestra.run.trial097.stdout:Transaction check succeeded. 2026-02-17T11:02:18.671 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction test 2026-02-17T11:02:18.672 INFO:teuthology.orchestra.run.trial097.stdout:Transaction test succeeded. 2026-02-17T11:02:18.673 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction 2026-02-17T11:02:18.693 INFO:teuthology.orchestra.run.trial097.stdout: Preparing : 1/1 2026-02-17T11:02:18.709 INFO:teuthology.orchestra.run.trial097.stdout: Installing : libcephfs-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:18.720 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:00:33 ago on Tue 17 Feb 2026 11:01:45 AM UTC. 2026-02-17T11:02:18.764 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: libcephfs-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:18.785 INFO:teuthology.orchestra.run.trial157.stdout:Package ceph-base-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T11:02:18.802 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-17T11:02:18.803 INFO:teuthology.orchestra.run.trial157.stdout:Nothing to do. 2026-02-17T11:02:18.803 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-17T11:02:18.820 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : libcephfs-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:18.820 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:02:18.820 INFO:teuthology.orchestra.run.trial097.stdout:Installed: 2026-02-17T11:02:18.820 INFO:teuthology.orchestra.run.trial097.stdout: libcephfs-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:18.820 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:02:18.820 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-17T11:02:18.825 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install cephadm 2026-02-17T11:02:18.847 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install librados2 2026-02-17T11:02:19.133 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:00:34 ago on Tue 17 Feb 2026 11:01:45 AM UTC. 2026-02-17T11:02:19.160 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 11:01:42 AM UTC. 2026-02-17T11:02:19.197 INFO:teuthology.orchestra.run.trial157.stdout:Package cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-17T11:02:19.214 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-17T11:02:19.215 INFO:teuthology.orchestra.run.trial157.stdout:Nothing to do. 2026-02-17T11:02:19.215 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-17T11:02:19.225 INFO:teuthology.orchestra.run.trial097.stdout:Package librados2-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T11:02:19.236 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install ceph-immutable-object-cache 2026-02-17T11:02:19.242 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-17T11:02:19.243 INFO:teuthology.orchestra.run.trial097.stdout:Nothing to do. 2026-02-17T11:02:19.243 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-17T11:02:19.265 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install librbd1 2026-02-17T11:02:19.541 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:00:34 ago on Tue 17 Feb 2026 11:01:45 AM UTC. 2026-02-17T11:02:19.572 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 11:01:42 AM UTC. 2026-02-17T11:02:19.624 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-17T11:02:19.625 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:02:19.625 INFO:teuthology.orchestra.run.trial157.stdout: Package Arch Version Repo Size 2026-02-17T11:02:19.625 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:02:19.625 INFO:teuthology.orchestra.run.trial157.stdout:Installing: 2026-02-17T11:02:19.625 INFO:teuthology.orchestra.run.trial157.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 145 k 2026-02-17T11:02:19.625 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:02:19.626 INFO:teuthology.orchestra.run.trial157.stdout:Transaction Summary 2026-02-17T11:02:19.626 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:02:19.626 INFO:teuthology.orchestra.run.trial157.stdout:Install 1 Package 2026-02-17T11:02:19.626 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:02:19.626 INFO:teuthology.orchestra.run.trial157.stdout:Total download size: 145 k 2026-02-17T11:02:19.626 INFO:teuthology.orchestra.run.trial157.stdout:Installed size: 431 k 2026-02-17T11:02:19.626 INFO:teuthology.orchestra.run.trial157.stdout:Downloading Packages: 2026-02-17T11:02:19.636 INFO:teuthology.orchestra.run.trial097.stdout:Package librbd1-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T11:02:19.653 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-17T11:02:19.654 INFO:teuthology.orchestra.run.trial097.stdout:Nothing to do. 2026-02-17T11:02:19.654 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-17T11:02:19.676 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install python3-rados 2026-02-17T11:02:19.710 INFO:teuthology.orchestra.run.trial157.stdout:ceph-immutable-object-cache-19.2.3-705.g04cf6dd 1.7 MB/s | 145 kB 00:00 2026-02-17T11:02:19.712 INFO:teuthology.orchestra.run.trial157.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:02:19.712 INFO:teuthology.orchestra.run.trial157.stdout:Total 1.6 MB/s | 145 kB 00:00 2026-02-17T11:02:19.712 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction check 2026-02-17T11:02:19.715 INFO:teuthology.orchestra.run.trial157.stdout:Transaction check succeeded. 2026-02-17T11:02:19.715 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction test 2026-02-17T11:02:19.746 INFO:teuthology.orchestra.run.trial157.stdout:Transaction test succeeded. 2026-02-17T11:02:19.747 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction 2026-02-17T11:02:19.801 INFO:teuthology.orchestra.run.trial157.stdout: Preparing : 1/1 2026-02-17T11:02:19.802 INFO:teuthology.orchestra.run.trial157.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-705.g04cf6dd4.e 1/1 2026-02-17T11:02:19.824 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-705.g04cf6dd4.e 1/1 2026-02-17T11:02:19.824 INFO:teuthology.orchestra.run.trial157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:02:19.824 INFO:teuthology.orchestra.run.trial157.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-17T11:02:19.824 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:02:19.988 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 11:01:42 AM UTC. 2026-02-17T11:02:20.051 INFO:teuthology.orchestra.run.trial097.stdout:Package python3-rados-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T11:02:20.069 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-17T11:02:20.069 INFO:teuthology.orchestra.run.trial097.stdout:Nothing to do. 2026-02-17T11:02:20.069 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-17T11:02:20.092 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install python3-rgw 2026-02-17T11:02:20.103 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-705.g04cf6dd4.e 1/1 2026-02-17T11:02:20.103 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:02:20.103 INFO:teuthology.orchestra.run.trial157.stdout:Installed: 2026-02-17T11:02:20.104 INFO:teuthology.orchestra.run.trial157.stdout: ceph-immutable-object-cache-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:20.104 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:02:20.104 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-17T11:02:20.129 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install ceph-mgr 2026-02-17T11:02:20.402 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Feb 2026 11:01:42 AM UTC. 2026-02-17T11:02:20.438 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:00:35 ago on Tue 17 Feb 2026 11:01:45 AM UTC. 2026-02-17T11:02:20.465 INFO:teuthology.orchestra.run.trial097.stdout:Package python3-rgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T11:02:20.482 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-17T11:02:20.483 INFO:teuthology.orchestra.run.trial097.stdout:Nothing to do. 2026-02-17T11:02:20.483 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-17T11:02:20.502 INFO:teuthology.orchestra.run.trial157.stdout:Package ceph-mgr-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T11:02:20.504 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install python3-cephfs 2026-02-17T11:02:20.519 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-17T11:02:20.520 INFO:teuthology.orchestra.run.trial157.stdout:Nothing to do. 2026-02-17T11:02:20.520 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-17T11:02:20.541 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install ceph-mgr-dashboard 2026-02-17T11:02:20.607 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-selinux-2:19.2.3-705.g04cf6dd4.el9.x86_64 34/37 2026-02-17T11:02:20.607 INFO:teuthology.orchestra.run.trial162.stdout:skipping the directory /sys 2026-02-17T11:02:20.607 INFO:teuthology.orchestra.run.trial162.stdout:skipping the directory /proc 2026-02-17T11:02:20.607 INFO:teuthology.orchestra.run.trial162.stdout:skipping the directory /mnt 2026-02-17T11:02:20.607 INFO:teuthology.orchestra.run.trial162.stdout:skipping the directory /var/tmp 2026-02-17T11:02:20.607 INFO:teuthology.orchestra.run.trial162.stdout:skipping the directory /home 2026-02-17T11:02:20.607 INFO:teuthology.orchestra.run.trial162.stdout:skipping the directory /root 2026-02-17T11:02:20.607 INFO:teuthology.orchestra.run.trial162.stdout:skipping the directory /tmp 2026-02-17T11:02:20.608 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:02:20.813 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Feb 2026 11:01:42 AM UTC. 2026-02-17T11:02:20.856 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:00:35 ago on Tue 17 Feb 2026 11:01:45 AM UTC. 2026-02-17T11:02:20.876 INFO:teuthology.orchestra.run.trial097.stdout:Package python3-cephfs-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T11:02:20.894 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-17T11:02:20.895 INFO:teuthology.orchestra.run.trial097.stdout:Nothing to do. 2026-02-17T11:02:20.895 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-17T11:02:20.916 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install python3-rbd 2026-02-17T11:02:20.920 INFO:teuthology.orchestra.run.trial157.stdout:Package ceph-mgr-dashboard-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-17T11:02:20.940 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-17T11:02:20.940 INFO:teuthology.orchestra.run.trial157.stdout:Nothing to do. 2026-02-17T11:02:20.941 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-17T11:02:20.961 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-17T11:02:21.065 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-radosgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 35/37 2026-02-17T11:02:21.089 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 35/37 2026-02-17T11:02:21.089 INFO:teuthology.orchestra.run.trial162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:02:21.089 INFO:teuthology.orchestra.run.trial162.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-17T11:02:21.089 INFO:teuthology.orchestra.run.trial162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T11:02:21.089 INFO:teuthology.orchestra.run.trial162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T11:02:21.089 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:02:21.090 INFO:teuthology.orchestra.run.trial162.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-17T11:02:21.103 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-17T11:02:21.103 INFO:teuthology.orchestra.run.trial162.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T11:02:21.160 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T11:02:21.160 INFO:teuthology.orchestra.run.trial162.stdout:Creating group 'qat' with GID 992. 2026-02-17T11:02:21.160 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:02:21.227 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:00:39 ago on Tue 17 Feb 2026 11:01:42 AM UTC. 2026-02-17T11:02:21.273 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:00:36 ago on Tue 17 Feb 2026 11:01:45 AM UTC. 2026-02-17T11:02:21.291 INFO:teuthology.orchestra.run.trial097.stdout:Package python3-rbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T11:02:21.308 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-17T11:02:21.309 INFO:teuthology.orchestra.run.trial097.stdout:Nothing to do. 2026-02-17T11:02:21.309 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-17T11:02:21.331 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install rbd-fuse 2026-02-17T11:02:21.337 INFO:teuthology.orchestra.run.trial157.stdout:Package ceph-mgr-diskprediction-local-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-17T11:02:21.355 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-17T11:02:21.356 INFO:teuthology.orchestra.run.trial157.stdout:Nothing to do. 2026-02-17T11:02:21.356 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-17T11:02:21.376 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install ceph-mgr-rook 2026-02-17T11:02:21.433 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-base-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/37 2026-02-17T11:02:21.434 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 2/37 2026-02-17T11:02:21.434 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-radosgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 3/37 2026-02-17T11:02:21.434 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-selinux-2:19.2.3-705.g04cf6dd4.el9.x86_64 4/37 2026-02-17T11:02:21.434 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : libcephfs2-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/37 2026-02-17T11:02:21.434 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : libradosstriper1-2:19.2.3-705.g04cf6dd4.el9.x86_64 6/37 2026-02-17T11:02:21.434 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : librgw2-2:19.2.3-705.g04cf6dd4.el9.x86_64 7/37 2026-02-17T11:02:21.434 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-ceph-argparse-2:19.2.3-705.g04cf6dd4.el9.x 8/37 2026-02-17T11:02:21.434 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86 9/37 2026-02-17T11:02:21.434 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-cephfs-2:19.2.3-705.g04cf6dd4.el9.x86_64 10/37 2026-02-17T11:02:21.434 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-rados-2:19.2.3-705.g04cf6dd4.el9.x86_64 11/37 2026-02-17T11:02:21.434 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-rbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 12/37 2026-02-17T11:02:21.435 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-rgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 13/37 2026-02-17T11:02:21.435 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/37 2026-02-17T11:02:21.435 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 15/37 2026-02-17T11:02:21.435 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 16/37 2026-02-17T11:02:21.435 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 17/37 2026-02-17T11:02:21.435 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-17T11:02:21.435 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 19/37 2026-02-17T11:02:21.435 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 20/37 2026-02-17T11:02:21.435 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 21/37 2026-02-17T11:02:21.435 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 22/37 2026-02-17T11:02:21.435 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 23/37 2026-02-17T11:02:21.435 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 24/37 2026-02-17T11:02:21.435 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 25/37 2026-02-17T11:02:21.436 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 26/37 2026-02-17T11:02:21.436 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 27/37 2026-02-17T11:02:21.436 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 28/37 2026-02-17T11:02:21.436 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 29/37 2026-02-17T11:02:21.436 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 30/37 2026-02-17T11:02:21.436 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 31/37 2026-02-17T11:02:21.436 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : re2-1:20211101-20.el9.x86_64 32/37 2026-02-17T11:02:21.436 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 33/37 2026-02-17T11:02:21.436 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : librados2-2:19.2.3-705.g04cf6dd4.el9.x86_64 34/37 2026-02-17T11:02:21.436 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 35/37 2026-02-17T11:02:21.436 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : librbd1-2:19.2.3-705.g04cf6dd4.el9.x86_64 36/37 2026-02-17T11:02:21.490 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-selinux-2:19.2.3-705.g04cf6dd4.el9.x86_64 34/37 2026-02-17T11:02:21.490 INFO:teuthology.orchestra.run.trial049.stdout:skipping the directory /sys 2026-02-17T11:02:21.490 INFO:teuthology.orchestra.run.trial049.stdout:skipping the directory /proc 2026-02-17T11:02:21.490 INFO:teuthology.orchestra.run.trial049.stdout:skipping the directory /mnt 2026-02-17T11:02:21.490 INFO:teuthology.orchestra.run.trial049.stdout:skipping the directory /var/tmp 2026-02-17T11:02:21.490 INFO:teuthology.orchestra.run.trial049.stdout:skipping the directory /home 2026-02-17T11:02:21.490 INFO:teuthology.orchestra.run.trial049.stdout:skipping the directory /root 2026-02-17T11:02:21.490 INFO:teuthology.orchestra.run.trial049.stdout:skipping the directory /tmp 2026-02-17T11:02:21.490 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:02:21.493 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T11:02:21.493 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:02:21.493 INFO:teuthology.orchestra.run.trial162.stdout:Upgraded: 2026-02-17T11:02:21.493 INFO:teuthology.orchestra.run.trial162.stdout: librados2-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:21.494 INFO:teuthology.orchestra.run.trial162.stdout: librbd1-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:21.494 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-17T11:02:21.494 INFO:teuthology.orchestra.run.trial162.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-17T11:02:21.494 INFO:teuthology.orchestra.run.trial162.stdout: ceph-base-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:21.494 INFO:teuthology.orchestra.run.trial162.stdout: ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:21.494 INFO:teuthology.orchestra.run.trial162.stdout: ceph-radosgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:21.494 INFO:teuthology.orchestra.run.trial162.stdout: ceph-selinux-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:21.494 INFO:teuthology.orchestra.run.trial162.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-17T11:02:21.494 INFO:teuthology.orchestra.run.trial162.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-17T11:02:21.494 INFO:teuthology.orchestra.run.trial162.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-17T11:02:21.494 INFO:teuthology.orchestra.run.trial162.stdout: libcephfs2-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:21.494 INFO:teuthology.orchestra.run.trial162.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-17T11:02:21.495 INFO:teuthology.orchestra.run.trial162.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-17T11:02:21.495 INFO:teuthology.orchestra.run.trial162.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-17T11:02:21.495 INFO:teuthology.orchestra.run.trial162.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-17T11:02:21.495 INFO:teuthology.orchestra.run.trial162.stdout: libradosstriper1-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:21.495 INFO:teuthology.orchestra.run.trial162.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-17T11:02:21.495 INFO:teuthology.orchestra.run.trial162.stdout: librgw2-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:21.495 INFO:teuthology.orchestra.run.trial162.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-17T11:02:21.495 INFO:teuthology.orchestra.run.trial162.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-17T11:02:21.495 INFO:teuthology.orchestra.run.trial162.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-17T11:02:21.495 INFO:teuthology.orchestra.run.trial162.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-17T11:02:21.495 INFO:teuthology.orchestra.run.trial162.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-17T11:02:21.495 INFO:teuthology.orchestra.run.trial162.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-17T11:02:21.495 INFO:teuthology.orchestra.run.trial162.stdout: python3-ceph-argparse-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:21.496 INFO:teuthology.orchestra.run.trial162.stdout: python3-ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:21.496 INFO:teuthology.orchestra.run.trial162.stdout: python3-cephfs-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:21.496 INFO:teuthology.orchestra.run.trial162.stdout: python3-rados-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:21.496 INFO:teuthology.orchestra.run.trial162.stdout: python3-rbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:21.496 INFO:teuthology.orchestra.run.trial162.stdout: python3-rgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:21.496 INFO:teuthology.orchestra.run.trial162.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-17T11:02:21.496 INFO:teuthology.orchestra.run.trial162.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-17T11:02:21.496 INFO:teuthology.orchestra.run.trial162.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-17T11:02:21.496 INFO:teuthology.orchestra.run.trial162.stdout: re2-1:20211101-20.el9.x86_64 2026-02-17T11:02:21.496 INFO:teuthology.orchestra.run.trial162.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-17T11:02:21.496 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:02:21.496 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T11:02:21.536 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install ceph-test 2026-02-17T11:02:21.638 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:00:39 ago on Tue 17 Feb 2026 11:01:42 AM UTC. 2026-02-17T11:02:21.687 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:00:36 ago on Tue 17 Feb 2026 11:01:45 AM UTC. 2026-02-17T11:02:21.719 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-17T11:02:21.720 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:02:21.720 INFO:teuthology.orchestra.run.trial097.stdout: Package Architecture Version Repository Size 2026-02-17T11:02:21.720 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:02:21.720 INFO:teuthology.orchestra.run.trial097.stdout:Installing: 2026-02-17T11:02:21.720 INFO:teuthology.orchestra.run.trial097.stdout: rbd-fuse x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 85 k 2026-02-17T11:02:21.720 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:02:21.720 INFO:teuthology.orchestra.run.trial097.stdout:Transaction Summary 2026-02-17T11:02:21.720 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:02:21.720 INFO:teuthology.orchestra.run.trial097.stdout:Install 1 Package 2026-02-17T11:02:21.720 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:02:21.720 INFO:teuthology.orchestra.run.trial097.stdout:Total download size: 85 k 2026-02-17T11:02:21.720 INFO:teuthology.orchestra.run.trial097.stdout:Installed size: 227 k 2026-02-17T11:02:21.720 INFO:teuthology.orchestra.run.trial097.stdout:Downloading Packages: 2026-02-17T11:02:21.751 INFO:teuthology.orchestra.run.trial157.stdout:Package ceph-mgr-rook-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-17T11:02:21.769 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-17T11:02:21.769 INFO:teuthology.orchestra.run.trial157.stdout:Nothing to do. 2026-02-17T11:02:21.769 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-17T11:02:21.790 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install ceph-mgr-cephadm 2026-02-17T11:02:21.794 INFO:teuthology.orchestra.run.trial097.stdout:rbd-fuse-19.2.3-705.g04cf6dd4.el9.x86_64.rpm 1.1 MB/s | 85 kB 00:00 2026-02-17T11:02:21.794 INFO:teuthology.orchestra.run.trial097.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:02:21.795 INFO:teuthology.orchestra.run.trial097.stdout:Total 1.1 MB/s | 85 kB 00:00 2026-02-17T11:02:21.795 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction check 2026-02-17T11:02:21.798 INFO:teuthology.orchestra.run.trial097.stdout:Transaction check succeeded. 2026-02-17T11:02:21.798 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction test 2026-02-17T11:02:21.828 INFO:teuthology.orchestra.run.trial097.stdout:Transaction test succeeded. 2026-02-17T11:02:21.828 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction 2026-02-17T11:02:21.848 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:00:12 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:02:21.879 INFO:teuthology.orchestra.run.trial097.stdout: Preparing : 1/1 2026-02-17T11:02:21.896 INFO:teuthology.orchestra.run.trial097.stdout: Installing : rbd-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:21.931 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T11:02:21.932 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:02:21.932 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repository Size 2026-02-17T11:02:21.933 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:02:21.933 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-17T11:02:21.933 INFO:teuthology.orchestra.run.trial162.stdout: ceph-test x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 50 M 2026-02-17T11:02:21.933 INFO:teuthology.orchestra.run.trial162.stdout:Installing dependencies: 2026-02-17T11:02:21.933 INFO:teuthology.orchestra.run.trial162.stdout: libcephsqlite x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 163 k 2026-02-17T11:02:21.933 INFO:teuthology.orchestra.run.trial162.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-17T11:02:21.933 INFO:teuthology.orchestra.run.trial162.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-17T11:02:21.933 INFO:teuthology.orchestra.run.trial162.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-17T11:02:21.933 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:02:21.933 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-17T11:02:21.933 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:02:21.934 INFO:teuthology.orchestra.run.trial162.stdout:Install 5 Packages 2026-02-17T11:02:21.934 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:02:21.934 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 50 M 2026-02-17T11:02:21.934 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 212 M 2026-02-17T11:02:21.934 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-17T11:02:21.950 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-radosgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 35/37 2026-02-17T11:02:21.974 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 35/37 2026-02-17T11:02:21.974 INFO:teuthology.orchestra.run.trial049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:02:21.974 INFO:teuthology.orchestra.run.trial049.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-17T11:02:21.974 INFO:teuthology.orchestra.run.trial049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T11:02:21.974 INFO:teuthology.orchestra.run.trial049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T11:02:21.974 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:02:21.976 INFO:teuthology.orchestra.run.trial049.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-17T11:02:21.976 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: rbd-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:21.988 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-17T11:02:21.988 INFO:teuthology.orchestra.run.trial049.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T11:02:22.034 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : rbd-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:22.034 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:02:22.034 INFO:teuthology.orchestra.run.trial097.stdout:Installed: 2026-02-17T11:02:22.034 INFO:teuthology.orchestra.run.trial097.stdout: rbd-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:22.034 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:02:22.034 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-17T11:02:22.041 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T11:02:22.041 INFO:teuthology.orchestra.run.trial049.stdout:Creating group 'qat' with GID 992. 2026-02-17T11:02:22.041 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:02:22.062 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install rbd-mirror 2026-02-17T11:02:22.102 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 11:01:45 AM UTC. 2026-02-17T11:02:22.119 INFO:teuthology.orchestra.run.trial162.stdout:(1/5): libcephsqlite-19.2.3-705.g04cf6dd4.el9.x 1.8 MB/s | 163 kB 00:00 2026-02-17T11:02:22.167 INFO:teuthology.orchestra.run.trial157.stdout:Package ceph-mgr-cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-17T11:02:22.184 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-17T11:02:22.185 INFO:teuthology.orchestra.run.trial157.stdout:Nothing to do. 2026-02-17T11:02:22.185 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-17T11:02:22.206 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install ceph-fuse 2026-02-17T11:02:22.312 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-base-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/37 2026-02-17T11:02:22.312 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 2/37 2026-02-17T11:02:22.312 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-radosgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 3/37 2026-02-17T11:02:22.312 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-selinux-2:19.2.3-705.g04cf6dd4.el9.x86_64 4/37 2026-02-17T11:02:22.312 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : libcephfs2-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/37 2026-02-17T11:02:22.313 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : libradosstriper1-2:19.2.3-705.g04cf6dd4.el9.x86_64 6/37 2026-02-17T11:02:22.313 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : librgw2-2:19.2.3-705.g04cf6dd4.el9.x86_64 7/37 2026-02-17T11:02:22.313 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-ceph-argparse-2:19.2.3-705.g04cf6dd4.el9.x 8/37 2026-02-17T11:02:22.313 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86 9/37 2026-02-17T11:02:22.313 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-cephfs-2:19.2.3-705.g04cf6dd4.el9.x86_64 10/37 2026-02-17T11:02:22.313 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-rados-2:19.2.3-705.g04cf6dd4.el9.x86_64 11/37 2026-02-17T11:02:22.313 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-rbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 12/37 2026-02-17T11:02:22.313 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-rgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 13/37 2026-02-17T11:02:22.313 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/37 2026-02-17T11:02:22.313 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 15/37 2026-02-17T11:02:22.313 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 16/37 2026-02-17T11:02:22.313 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 17/37 2026-02-17T11:02:22.314 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-17T11:02:22.314 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 19/37 2026-02-17T11:02:22.314 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 20/37 2026-02-17T11:02:22.314 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 21/37 2026-02-17T11:02:22.314 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 22/37 2026-02-17T11:02:22.314 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 23/37 2026-02-17T11:02:22.314 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 24/37 2026-02-17T11:02:22.314 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 25/37 2026-02-17T11:02:22.314 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 26/37 2026-02-17T11:02:22.314 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 27/37 2026-02-17T11:02:22.314 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 28/37 2026-02-17T11:02:22.314 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 29/37 2026-02-17T11:02:22.314 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 30/37 2026-02-17T11:02:22.315 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 31/37 2026-02-17T11:02:22.315 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : re2-1:20211101-20.el9.x86_64 32/37 2026-02-17T11:02:22.315 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 33/37 2026-02-17T11:02:22.315 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : librados2-2:19.2.3-705.g04cf6dd4.el9.x86_64 34/37 2026-02-17T11:02:22.315 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 35/37 2026-02-17T11:02:22.315 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : librbd1-2:19.2.3-705.g04cf6dd4.el9.x86_64 36/37 2026-02-17T11:02:22.372 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T11:02:22.372 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:02:22.372 INFO:teuthology.orchestra.run.trial049.stdout:Upgraded: 2026-02-17T11:02:22.372 INFO:teuthology.orchestra.run.trial049.stdout: librados2-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:22.373 INFO:teuthology.orchestra.run.trial049.stdout: librbd1-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:22.373 INFO:teuthology.orchestra.run.trial049.stdout:Installed: 2026-02-17T11:02:22.373 INFO:teuthology.orchestra.run.trial049.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-17T11:02:22.373 INFO:teuthology.orchestra.run.trial049.stdout: ceph-base-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:22.373 INFO:teuthology.orchestra.run.trial049.stdout: ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:22.373 INFO:teuthology.orchestra.run.trial049.stdout: ceph-radosgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:22.373 INFO:teuthology.orchestra.run.trial049.stdout: ceph-selinux-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:22.373 INFO:teuthology.orchestra.run.trial049.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-17T11:02:22.373 INFO:teuthology.orchestra.run.trial049.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-17T11:02:22.373 INFO:teuthology.orchestra.run.trial049.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-17T11:02:22.373 INFO:teuthology.orchestra.run.trial049.stdout: libcephfs2-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:22.374 INFO:teuthology.orchestra.run.trial049.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-17T11:02:22.374 INFO:teuthology.orchestra.run.trial049.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-17T11:02:22.374 INFO:teuthology.orchestra.run.trial049.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-17T11:02:22.374 INFO:teuthology.orchestra.run.trial049.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-17T11:02:22.374 INFO:teuthology.orchestra.run.trial049.stdout: libradosstriper1-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:22.374 INFO:teuthology.orchestra.run.trial049.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-17T11:02:22.374 INFO:teuthology.orchestra.run.trial049.stdout: librgw2-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:22.374 INFO:teuthology.orchestra.run.trial049.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-17T11:02:22.374 INFO:teuthology.orchestra.run.trial049.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-17T11:02:22.374 INFO:teuthology.orchestra.run.trial049.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-17T11:02:22.374 INFO:teuthology.orchestra.run.trial049.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-17T11:02:22.374 INFO:teuthology.orchestra.run.trial049.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-17T11:02:22.374 INFO:teuthology.orchestra.run.trial049.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-17T11:02:22.375 INFO:teuthology.orchestra.run.trial049.stdout: python3-ceph-argparse-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:22.375 INFO:teuthology.orchestra.run.trial049.stdout: python3-ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:22.375 INFO:teuthology.orchestra.run.trial049.stdout: python3-cephfs-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:22.375 INFO:teuthology.orchestra.run.trial049.stdout: python3-rados-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:22.375 INFO:teuthology.orchestra.run.trial049.stdout: python3-rbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:22.375 INFO:teuthology.orchestra.run.trial049.stdout: python3-rgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:22.375 INFO:teuthology.orchestra.run.trial049.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-17T11:02:22.375 INFO:teuthology.orchestra.run.trial049.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-17T11:02:22.375 INFO:teuthology.orchestra.run.trial049.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-17T11:02:22.375 INFO:teuthology.orchestra.run.trial049.stdout: re2-1:20211101-20.el9.x86_64 2026-02-17T11:02:22.375 INFO:teuthology.orchestra.run.trial049.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-17T11:02:22.376 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:02:22.376 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-17T11:02:22.376 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:00:40 ago on Tue 17 Feb 2026 11:01:42 AM UTC. 2026-02-17T11:02:22.416 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-test 2026-02-17T11:02:22.456 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-17T11:02:22.457 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:02:22.457 INFO:teuthology.orchestra.run.trial097.stdout: Package Arch Version Repo Size 2026-02-17T11:02:22.457 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:02:22.457 INFO:teuthology.orchestra.run.trial097.stdout:Installing: 2026-02-17T11:02:22.458 INFO:teuthology.orchestra.run.trial097.stdout: rbd-mirror x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 3.1 M 2026-02-17T11:02:22.458 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:02:22.458 INFO:teuthology.orchestra.run.trial097.stdout:Transaction Summary 2026-02-17T11:02:22.458 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:02:22.458 INFO:teuthology.orchestra.run.trial097.stdout:Install 1 Package 2026-02-17T11:02:22.458 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:02:22.458 INFO:teuthology.orchestra.run.trial097.stdout:Total download size: 3.1 M 2026-02-17T11:02:22.458 INFO:teuthology.orchestra.run.trial097.stdout:Installed size: 13 M 2026-02-17T11:02:22.458 INFO:teuthology.orchestra.run.trial097.stdout:Downloading Packages: 2026-02-17T11:02:22.520 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 11:01:45 AM UTC. 2026-02-17T11:02:22.602 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-17T11:02:22.603 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:02:22.603 INFO:teuthology.orchestra.run.trial157.stdout: Package Architecture Version Repository Size 2026-02-17T11:02:22.603 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:02:22.603 INFO:teuthology.orchestra.run.trial157.stdout:Installing: 2026-02-17T11:02:22.603 INFO:teuthology.orchestra.run.trial157.stdout: ceph-fuse x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 1.2 M 2026-02-17T11:02:22.603 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:02:22.603 INFO:teuthology.orchestra.run.trial157.stdout:Transaction Summary 2026-02-17T11:02:22.603 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:02:22.603 INFO:teuthology.orchestra.run.trial157.stdout:Install 1 Package 2026-02-17T11:02:22.604 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:02:22.604 INFO:teuthology.orchestra.run.trial157.stdout:Total download size: 1.2 M 2026-02-17T11:02:22.604 INFO:teuthology.orchestra.run.trial157.stdout:Installed size: 3.6 M 2026-02-17T11:02:22.604 INFO:teuthology.orchestra.run.trial157.stdout:Downloading Packages: 2026-02-17T11:02:22.729 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:13 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:02:22.776 INFO:teuthology.orchestra.run.trial162.stdout:(2/5): libxslt-1.1.34-12.el9.x86_64.rpm 312 kB/s | 233 kB 00:00 2026-02-17T11:02:22.814 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-17T11:02:22.815 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:02:22.815 INFO:teuthology.orchestra.run.trial049.stdout: Package Arch Version Repository Size 2026-02-17T11:02:22.816 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:02:22.816 INFO:teuthology.orchestra.run.trial049.stdout:Installing: 2026-02-17T11:02:22.816 INFO:teuthology.orchestra.run.trial049.stdout: ceph-test x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 50 M 2026-02-17T11:02:22.816 INFO:teuthology.orchestra.run.trial049.stdout:Installing dependencies: 2026-02-17T11:02:22.816 INFO:teuthology.orchestra.run.trial049.stdout: libcephsqlite x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 163 k 2026-02-17T11:02:22.816 INFO:teuthology.orchestra.run.trial049.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-17T11:02:22.816 INFO:teuthology.orchestra.run.trial049.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-17T11:02:22.816 INFO:teuthology.orchestra.run.trial049.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-17T11:02:22.816 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:02:22.816 INFO:teuthology.orchestra.run.trial049.stdout:Transaction Summary 2026-02-17T11:02:22.816 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:02:22.817 INFO:teuthology.orchestra.run.trial049.stdout:Install 5 Packages 2026-02-17T11:02:22.817 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:02:22.817 INFO:teuthology.orchestra.run.trial049.stdout:Total download size: 50 M 2026-02-17T11:02:22.817 INFO:teuthology.orchestra.run.trial049.stdout:Installed size: 212 M 2026-02-17T11:02:22.817 INFO:teuthology.orchestra.run.trial049.stdout:Downloading Packages: 2026-02-17T11:02:22.863 INFO:teuthology.orchestra.run.trial162.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 738 kB/s | 64 kB 00:00 2026-02-17T11:02:22.948 INFO:teuthology.orchestra.run.trial162.stdout:(4/5): socat-1.7.4.1-8.el9.x86_64.rpm 366 kB/s | 303 kB 00:00 2026-02-17T11:02:23.063 INFO:teuthology.orchestra.run.trial049.stdout:(1/5): libcephsqlite-19.2.3-705.g04cf6dd4.el9.x 873 kB/s | 163 kB 00:00 2026-02-17T11:02:23.065 INFO:teuthology.orchestra.run.trial162.stdout:(5/5): ceph-test-19.2.3-705.g04cf6dd4.el9.x86_6 48 MB/s | 50 MB 00:01 2026-02-17T11:02:23.067 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:02:23.067 INFO:teuthology.orchestra.run.trial162.stdout:Total 44 MB/s | 50 MB 00:01 2026-02-17T11:02:23.093 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-17T11:02:23.104 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-17T11:02:23.104 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-17T11:02:23.207 INFO:teuthology.orchestra.run.trial097.stdout:rbd-mirror-19.2.3-705.g04cf6dd4.el9.x86_64.rpm 4.2 MB/s | 3.1 MB 00:00 2026-02-17T11:02:23.207 INFO:teuthology.orchestra.run.trial097.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:02:23.207 INFO:teuthology.orchestra.run.trial097.stdout:Total 4.2 MB/s | 3.1 MB 00:00 2026-02-17T11:02:23.207 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction check 2026-02-17T11:02:23.211 INFO:teuthology.orchestra.run.trial097.stdout:Transaction check succeeded. 2026-02-17T11:02:23.211 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction test 2026-02-17T11:02:23.247 INFO:teuthology.orchestra.run.trial157.stdout:ceph-fuse-19.2.3-705.g04cf6dd4.el9.x86_64.rpm 1.8 MB/s | 1.2 MB 00:00 2026-02-17T11:02:23.248 INFO:teuthology.orchestra.run.trial157.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:02:23.248 INFO:teuthology.orchestra.run.trial157.stdout:Total 1.8 MB/s | 1.2 MB 00:00 2026-02-17T11:02:23.248 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction check 2026-02-17T11:02:23.252 INFO:teuthology.orchestra.run.trial157.stdout:Transaction check succeeded. 2026-02-17T11:02:23.252 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction test 2026-02-17T11:02:23.253 INFO:teuthology.orchestra.run.trial097.stdout:Transaction test succeeded. 2026-02-17T11:02:23.253 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction 2026-02-17T11:02:23.286 INFO:teuthology.orchestra.run.trial157.stdout:Transaction test succeeded. 2026-02-17T11:02:23.286 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction 2026-02-17T11:02:23.291 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-17T11:02:23.291 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-17T11:02:23.386 INFO:teuthology.orchestra.run.trial157.stdout: Preparing : 1/1 2026-02-17T11:02:23.403 INFO:teuthology.orchestra.run.trial157.stdout: Installing : ceph-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:23.450 INFO:teuthology.orchestra.run.trial097.stdout: Preparing : 1/1 2026-02-17T11:02:23.452 INFO:teuthology.orchestra.run.trial097.stdout: Installing : rbd-mirror-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:23.476 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: rbd-mirror-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:23.476 INFO:teuthology.orchestra.run.trial097.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:02:23.476 INFO:teuthology.orchestra.run.trial097.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-17T11:02:23.476 INFO:teuthology.orchestra.run.trial097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T11:02:23.476 INFO:teuthology.orchestra.run.trial097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T11:02:23.476 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:02:23.503 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-17T11:02:23.509 INFO:teuthology.orchestra.run.trial162.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-17T11:02:23.513 INFO:teuthology.orchestra.run.trial162.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-17T11:02:23.521 INFO:teuthology.orchestra.run.trial162.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-17T11:02:23.521 INFO:teuthology.orchestra.run.trial162.stdout: Installing : libcephsqlite-2:19.2.3-705.g04cf6dd4.el9.x86_64 4/5 2026-02-17T11:02:23.649 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: ceph-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:23.657 INFO:teuthology.orchestra.run.trial049.stdout:(2/5): libxslt-1.1.34-12.el9.x86_64.rpm 298 kB/s | 233 kB 00:00 2026-02-17T11:02:23.706 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : ceph-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:23.706 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:02:23.706 INFO:teuthology.orchestra.run.trial157.stdout:Installed: 2026-02-17T11:02:23.706 INFO:teuthology.orchestra.run.trial157.stdout: ceph-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:23.706 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:02:23.706 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-17T11:02:23.735 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install ceph-volume 2026-02-17T11:02:23.802 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : rbd-mirror-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:23.802 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:02:23.802 INFO:teuthology.orchestra.run.trial097.stdout:Installed: 2026-02-17T11:02:23.802 INFO:teuthology.orchestra.run.trial097.stdout: rbd-mirror-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:23.802 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:02:23.803 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-17T11:02:23.825 INFO:teuthology.orchestra.run.trial049.stdout:(3/5): socat-1.7.4.1-8.el9.x86_64.rpm 398 kB/s | 303 kB 00:00 2026-02-17T11:02:23.828 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install rbd-nbd 2026-02-17T11:02:23.844 INFO:teuthology.orchestra.run.trial049.stdout:(4/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 340 kB/s | 64 kB 00:00 2026-02-17T11:02:24.047 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:00:39 ago on Tue 17 Feb 2026 11:01:45 AM UTC. 2026-02-17T11:02:24.112 INFO:teuthology.orchestra.run.trial157.stdout:Package ceph-volume-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-17T11:02:24.129 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-17T11:02:24.130 INFO:teuthology.orchestra.run.trial157.stdout:Nothing to do. 2026-02-17T11:02:24.130 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-17T11:02:24.135 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:00:42 ago on Tue 17 Feb 2026 11:01:42 AM UTC. 2026-02-17T11:02:24.151 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install librados-devel 2026-02-17T11:02:24.216 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-17T11:02:24.217 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:02:24.217 INFO:teuthology.orchestra.run.trial097.stdout: Package Architecture Version Repository Size 2026-02-17T11:02:24.217 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:02:24.217 INFO:teuthology.orchestra.run.trial097.stdout:Installing: 2026-02-17T11:02:24.217 INFO:teuthology.orchestra.run.trial097.stdout: rbd-nbd x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 171 k 2026-02-17T11:02:24.217 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:02:24.218 INFO:teuthology.orchestra.run.trial097.stdout:Transaction Summary 2026-02-17T11:02:24.218 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:02:24.218 INFO:teuthology.orchestra.run.trial097.stdout:Install 1 Package 2026-02-17T11:02:24.218 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:02:24.218 INFO:teuthology.orchestra.run.trial097.stdout:Total download size: 171 k 2026-02-17T11:02:24.218 INFO:teuthology.orchestra.run.trial097.stdout:Installed size: 490 k 2026-02-17T11:02:24.218 INFO:teuthology.orchestra.run.trial097.stdout:Downloading Packages: 2026-02-17T11:02:24.458 INFO:teuthology.orchestra.run.trial049.stdout:(5/5): ceph-test-19.2.3-705.g04cf6dd4.el9.x86_6 31 MB/s | 50 MB 00:01 2026-02-17T11:02:24.459 INFO:teuthology.orchestra.run.trial097.stdout:rbd-nbd-19.2.3-705.g04cf6dd4.el9.x86_64.rpm 707 kB/s | 171 kB 00:00 2026-02-17T11:02:24.460 INFO:teuthology.orchestra.run.trial097.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:02:24.460 INFO:teuthology.orchestra.run.trial097.stdout:Total 702 kB/s | 171 kB 00:00 2026-02-17T11:02:24.460 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction check 2026-02-17T11:02:24.461 INFO:teuthology.orchestra.run.trial049.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:02:24.461 INFO:teuthology.orchestra.run.trial049.stdout:Total 31 MB/s | 50 MB 00:01 2026-02-17T11:02:24.461 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:00:39 ago on Tue 17 Feb 2026 11:01:45 AM UTC. 2026-02-17T11:02:24.464 INFO:teuthology.orchestra.run.trial097.stdout:Transaction check succeeded. 2026-02-17T11:02:24.464 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction test 2026-02-17T11:02:24.486 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction check 2026-02-17T11:02:24.495 INFO:teuthology.orchestra.run.trial097.stdout:Transaction test succeeded. 2026-02-17T11:02:24.495 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction 2026-02-17T11:02:24.496 INFO:teuthology.orchestra.run.trial049.stdout:Transaction check succeeded. 2026-02-17T11:02:24.496 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction test 2026-02-17T11:02:24.544 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-17T11:02:24.544 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:02:24.544 INFO:teuthology.orchestra.run.trial157.stdout: Package Arch Version Repo Size 2026-02-17T11:02:24.544 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:02:24.544 INFO:teuthology.orchestra.run.trial157.stdout:Installing: 2026-02-17T11:02:24.544 INFO:teuthology.orchestra.run.trial157.stdout: librados-devel x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 126 k 2026-02-17T11:02:24.544 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:02:24.545 INFO:teuthology.orchestra.run.trial157.stdout:Transaction Summary 2026-02-17T11:02:24.545 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:02:24.545 INFO:teuthology.orchestra.run.trial157.stdout:Install 1 Package 2026-02-17T11:02:24.545 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:02:24.545 INFO:teuthology.orchestra.run.trial157.stdout:Total download size: 126 k 2026-02-17T11:02:24.545 INFO:teuthology.orchestra.run.trial157.stdout:Installed size: 456 k 2026-02-17T11:02:24.545 INFO:teuthology.orchestra.run.trial157.stdout:Downloading Packages: 2026-02-17T11:02:24.551 INFO:teuthology.orchestra.run.trial097.stdout: Preparing : 1/1 2026-02-17T11:02:24.567 INFO:teuthology.orchestra.run.trial097.stdout: Installing : rbd-nbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:24.632 INFO:teuthology.orchestra.run.trial157.stdout:librados-devel-19.2.3-705.g04cf6dd4.el9.x86_64. 1.4 MB/s | 126 kB 00:00 2026-02-17T11:02:24.632 INFO:teuthology.orchestra.run.trial157.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:02:24.632 INFO:teuthology.orchestra.run.trial157.stdout:Total 1.4 MB/s | 126 kB 00:00 2026-02-17T11:02:24.632 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction check 2026-02-17T11:02:24.634 INFO:teuthology.orchestra.run.trial157.stdout:Transaction check succeeded. 2026-02-17T11:02:24.634 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction test 2026-02-17T11:02:24.646 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: rbd-nbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:24.665 INFO:teuthology.orchestra.run.trial157.stdout:Transaction test succeeded. 2026-02-17T11:02:24.665 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction 2026-02-17T11:02:24.681 INFO:teuthology.orchestra.run.trial049.stdout:Transaction test succeeded. 2026-02-17T11:02:24.682 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction 2026-02-17T11:02:24.704 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : rbd-nbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:24.705 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:02:24.705 INFO:teuthology.orchestra.run.trial097.stdout:Installed: 2026-02-17T11:02:24.705 INFO:teuthology.orchestra.run.trial097.stdout: rbd-nbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:24.705 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:02:24.705 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-17T11:02:24.719 INFO:teuthology.orchestra.run.trial157.stdout: Preparing : 1/1 2026-02-17T11:02:24.731 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install ceph-base-debuginfo 2026-02-17T11:02:24.736 INFO:teuthology.orchestra.run.trial157.stdout: Installing : librados-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:24.814 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: librados-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:24.871 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : librados-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:24.871 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:02:24.871 INFO:teuthology.orchestra.run.trial157.stdout:Installed: 2026-02-17T11:02:24.871 INFO:teuthology.orchestra.run.trial157.stdout: librados-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:24.871 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:02:24.871 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-17T11:02:24.894 INFO:teuthology.orchestra.run.trial049.stdout: Preparing : 1/1 2026-02-17T11:02:24.899 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install libcephfs2 2026-02-17T11:02:24.900 INFO:teuthology.orchestra.run.trial049.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-17T11:02:24.904 INFO:teuthology.orchestra.run.trial049.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-17T11:02:24.912 INFO:teuthology.orchestra.run.trial049.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-17T11:02:24.912 INFO:teuthology.orchestra.run.trial049.stdout: Installing : libcephsqlite-2:19.2.3-705.g04cf6dd4.el9.x86_64 4/5 2026-02-17T11:02:25.045 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:00:43 ago on Tue 17 Feb 2026 11:01:42 AM UTC. 2026-02-17T11:02:25.128 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-17T11:02:25.129 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:02:25.129 INFO:teuthology.orchestra.run.trial097.stdout: Package Arch Version Repo Size 2026-02-17T11:02:25.130 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:02:25.130 INFO:teuthology.orchestra.run.trial097.stdout:Installing: 2026-02-17T11:02:25.130 INFO:teuthology.orchestra.run.trial097.stdout: ceph-base-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 72 M 2026-02-17T11:02:25.130 INFO:teuthology.orchestra.run.trial097.stdout:Installing dependencies: 2026-02-17T11:02:25.130 INFO:teuthology.orchestra.run.trial097.stdout: ceph-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 24 M 2026-02-17T11:02:25.130 INFO:teuthology.orchestra.run.trial097.stdout:Installing weak dependencies: 2026-02-17T11:02:25.130 INFO:teuthology.orchestra.run.trial097.stdout: ceph-debugsource x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 11 M 2026-02-17T11:02:25.130 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:02:25.130 INFO:teuthology.orchestra.run.trial097.stdout:Transaction Summary 2026-02-17T11:02:25.130 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:02:25.131 INFO:teuthology.orchestra.run.trial097.stdout:Install 3 Packages 2026-02-17T11:02:25.131 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:02:25.131 INFO:teuthology.orchestra.run.trial097.stdout:Total download size: 107 M 2026-02-17T11:02:25.131 INFO:teuthology.orchestra.run.trial097.stdout:Installed size: 654 M 2026-02-17T11:02:25.131 INFO:teuthology.orchestra.run.trial097.stdout:Downloading Packages: 2026-02-17T11:02:25.216 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:00:40 ago on Tue 17 Feb 2026 11:01:45 AM UTC. 2026-02-17T11:02:25.282 INFO:teuthology.orchestra.run.trial157.stdout:Package libcephfs2-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T11:02:25.300 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-17T11:02:25.301 INFO:teuthology.orchestra.run.trial157.stdout:Nothing to do. 2026-02-17T11:02:25.301 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-17T11:02:25.323 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install libcephfs-devel 2026-02-17T11:02:25.636 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:00:40 ago on Tue 17 Feb 2026 11:01:45 AM UTC. 2026-02-17T11:02:25.717 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-17T11:02:25.718 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:02:25.718 INFO:teuthology.orchestra.run.trial157.stdout: Package Arch Version Repo Size 2026-02-17T11:02:25.719 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:02:25.719 INFO:teuthology.orchestra.run.trial157.stdout:Installing: 2026-02-17T11:02:25.719 INFO:teuthology.orchestra.run.trial157.stdout: libcephfs-devel x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 34 k 2026-02-17T11:02:25.719 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:02:25.719 INFO:teuthology.orchestra.run.trial157.stdout:Transaction Summary 2026-02-17T11:02:25.719 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:02:25.719 INFO:teuthology.orchestra.run.trial157.stdout:Install 1 Package 2026-02-17T11:02:25.719 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:02:25.719 INFO:teuthology.orchestra.run.trial157.stdout:Total download size: 34 k 2026-02-17T11:02:25.719 INFO:teuthology.orchestra.run.trial157.stdout:Installed size: 153 k 2026-02-17T11:02:25.719 INFO:teuthology.orchestra.run.trial157.stdout:Downloading Packages: 2026-02-17T11:02:25.773 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: libcephsqlite-2:19.2.3-705.g04cf6dd4.el9.x86_64 4/5 2026-02-17T11:02:25.792 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-test-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/5 2026-02-17T11:02:26.019 INFO:teuthology.orchestra.run.trial157.stdout:libcephfs-devel-19.2.3-705.g04cf6dd4.el9.x86_64 112 kB/s | 34 kB 00:00 2026-02-17T11:02:26.019 INFO:teuthology.orchestra.run.trial157.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:02:26.019 INFO:teuthology.orchestra.run.trial157.stdout:Total 111 kB/s | 34 kB 00:00 2026-02-17T11:02:26.019 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction check 2026-02-17T11:02:26.021 INFO:teuthology.orchestra.run.trial157.stdout:Transaction check succeeded. 2026-02-17T11:02:26.021 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction test 2026-02-17T11:02:26.023 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-test-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/5 2026-02-17T11:02:26.023 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-test-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/5 2026-02-17T11:02:26.023 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : libcephsqlite-2:19.2.3-705.g04cf6dd4.el9.x86_64 2/5 2026-02-17T11:02:26.024 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-17T11:02:26.024 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-17T11:02:26.024 INFO:teuthology.orchestra.run.trial157.stdout:Transaction test succeeded. 2026-02-17T11:02:26.024 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction 2026-02-17T11:02:26.044 INFO:teuthology.orchestra.run.trial157.stdout: Preparing : 1/1 2026-02-17T11:02:26.060 INFO:teuthology.orchestra.run.trial157.stdout: Installing : libcephfs-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:26.076 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-17T11:02:26.076 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:02:26.076 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-17T11:02:26.076 INFO:teuthology.orchestra.run.trial162.stdout: ceph-test-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:26.076 INFO:teuthology.orchestra.run.trial162.stdout: libcephsqlite-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:26.076 INFO:teuthology.orchestra.run.trial162.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-17T11:02:26.076 INFO:teuthology.orchestra.run.trial162.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-17T11:02:26.076 INFO:teuthology.orchestra.run.trial162.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-17T11:02:26.076 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:02:26.076 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T11:02:26.111 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install ceph 2026-02-17T11:02:26.118 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: libcephfs-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:26.173 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : libcephfs-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:26.173 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:02:26.174 INFO:teuthology.orchestra.run.trial157.stdout:Installed: 2026-02-17T11:02:26.174 INFO:teuthology.orchestra.run.trial157.stdout: libcephfs-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:26.174 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:02:26.174 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-17T11:02:26.201 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install librados2 2026-02-17T11:02:26.210 INFO:teuthology.orchestra.run.trial097.stdout:(1/3): ceph-debugsource-19.2.3-705.g04cf6dd4.el 10 MB/s | 11 MB 00:01 2026-02-17T11:02:26.418 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:00:17 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:02:26.505 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T11:02:26.508 INFO:teuthology.orchestra.run.trial162.stdout:====================================================================================== 2026-02-17T11:02:26.508 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repository Size 2026-02-17T11:02:26.508 INFO:teuthology.orchestra.run.trial162.stdout:====================================================================================== 2026-02-17T11:02:26.508 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-17T11:02:26.508 INFO:teuthology.orchestra.run.trial162.stdout: ceph x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 6.5 k 2026-02-17T11:02:26.508 INFO:teuthology.orchestra.run.trial162.stdout:Installing dependencies: 2026-02-17T11:02:26.509 INFO:teuthology.orchestra.run.trial162.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-17T11:02:26.509 INFO:teuthology.orchestra.run.trial162.stdout: ceph-grafana-dashboards noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 31 k 2026-02-17T11:02:26.509 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mds x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 2.4 M 2026-02-17T11:02:26.509 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mgr x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 1.1 M 2026-02-17T11:02:26.509 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mgr-modules-core noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 253 k 2026-02-17T11:02:26.509 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mon x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 4.7 M 2026-02-17T11:02:26.509 INFO:teuthology.orchestra.run.trial162.stdout: ceph-osd x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 17 M 2026-02-17T11:02:26.509 INFO:teuthology.orchestra.run.trial162.stdout: ceph-prometheus-alerts noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 17 k 2026-02-17T11:02:26.509 INFO:teuthology.orchestra.run.trial162.stdout: cephadm noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 769 k 2026-02-17T11:02:26.509 INFO:teuthology.orchestra.run.trial162.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-17T11:02:26.509 INFO:teuthology.orchestra.run.trial162.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-17T11:02:26.509 INFO:teuthology.orchestra.run.trial162.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-17T11:02:26.510 INFO:teuthology.orchestra.run.trial162.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-17T11:02:26.510 INFO:teuthology.orchestra.run.trial162.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-17T11:02:26.510 INFO:teuthology.orchestra.run.trial162.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-17T11:02:26.510 INFO:teuthology.orchestra.run.trial162.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-17T11:02:26.510 INFO:teuthology.orchestra.run.trial162.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-17T11:02:26.510 INFO:teuthology.orchestra.run.trial162.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-17T11:02:26.510 INFO:teuthology.orchestra.run.trial162.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-17T11:02:26.510 INFO:teuthology.orchestra.run.trial162.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-17T11:02:26.510 INFO:teuthology.orchestra.run.trial162.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-17T11:02:26.510 INFO:teuthology.orchestra.run.trial162.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-17T11:02:26.510 INFO:teuthology.orchestra.run.trial162.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-17T11:02:26.510 INFO:teuthology.orchestra.run.trial162.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-17T11:02:26.511 INFO:teuthology.orchestra.run.trial162.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-17T11:02:26.511 INFO:teuthology.orchestra.run.trial162.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-17T11:02:26.511 INFO:teuthology.orchestra.run.trial162.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-17T11:02:26.511 INFO:teuthology.orchestra.run.trial162.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-17T11:02:26.511 INFO:teuthology.orchestra.run.trial162.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-17T11:02:26.511 INFO:teuthology.orchestra.run.trial162.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-17T11:02:26.511 INFO:teuthology.orchestra.run.trial162.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-17T11:02:26.511 INFO:teuthology.orchestra.run.trial162.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-17T11:02:26.511 INFO:teuthology.orchestra.run.trial162.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-17T11:02:26.511 INFO:teuthology.orchestra.run.trial162.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-17T11:02:26.511 INFO:teuthology.orchestra.run.trial162.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-17T11:02:26.511 INFO:teuthology.orchestra.run.trial162.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-17T11:02:26.511 INFO:teuthology.orchestra.run.trial162.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-17T11:02:26.512 INFO:teuthology.orchestra.run.trial162.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-17T11:02:26.512 INFO:teuthology.orchestra.run.trial162.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-17T11:02:26.512 INFO:teuthology.orchestra.run.trial162.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-17T11:02:26.512 INFO:teuthology.orchestra.run.trial162.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-17T11:02:26.512 INFO:teuthology.orchestra.run.trial162.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-17T11:02:26.512 INFO:teuthology.orchestra.run.trial162.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-17T11:02:26.512 INFO:teuthology.orchestra.run.trial162.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-17T11:02:26.512 INFO:teuthology.orchestra.run.trial162.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-17T11:02:26.512 INFO:teuthology.orchestra.run.trial162.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-17T11:02:26.512 INFO:teuthology.orchestra.run.trial162.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-17T11:02:26.512 INFO:teuthology.orchestra.run.trial162.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-17T11:02:26.512 INFO:teuthology.orchestra.run.trial162.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-17T11:02:26.513 INFO:teuthology.orchestra.run.trial162.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-17T11:02:26.513 INFO:teuthology.orchestra.run.trial162.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-17T11:02:26.513 INFO:teuthology.orchestra.run.trial162.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-17T11:02:26.513 INFO:teuthology.orchestra.run.trial162.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-17T11:02:26.513 INFO:teuthology.orchestra.run.trial162.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-17T11:02:26.513 INFO:teuthology.orchestra.run.trial162.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-17T11:02:26.513 INFO:teuthology.orchestra.run.trial162.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-17T11:02:26.513 INFO:teuthology.orchestra.run.trial162.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-17T11:02:26.513 INFO:teuthology.orchestra.run.trial162.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-17T11:02:26.513 INFO:teuthology.orchestra.run.trial162.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-17T11:02:26.513 INFO:teuthology.orchestra.run.trial162.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-17T11:02:26.513 INFO:teuthology.orchestra.run.trial162.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-17T11:02:26.514 INFO:teuthology.orchestra.run.trial162.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-17T11:02:26.514 INFO:teuthology.orchestra.run.trial162.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-17T11:02:26.514 INFO:teuthology.orchestra.run.trial162.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-17T11:02:26.514 INFO:teuthology.orchestra.run.trial162.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-17T11:02:26.514 INFO:teuthology.orchestra.run.trial162.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-17T11:02:26.514 INFO:teuthology.orchestra.run.trial162.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-17T11:02:26.514 INFO:teuthology.orchestra.run.trial162.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-17T11:02:26.514 INFO:teuthology.orchestra.run.trial162.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-17T11:02:26.514 INFO:teuthology.orchestra.run.trial162.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-17T11:02:26.514 INFO:teuthology.orchestra.run.trial162.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-17T11:02:26.514 INFO:teuthology.orchestra.run.trial162.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-17T11:02:26.514 INFO:teuthology.orchestra.run.trial162.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-17T11:02:26.515 INFO:teuthology.orchestra.run.trial162.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-17T11:02:26.515 INFO:teuthology.orchestra.run.trial162.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-17T11:02:26.515 INFO:teuthology.orchestra.run.trial162.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-17T11:02:26.515 INFO:teuthology.orchestra.run.trial162.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-17T11:02:26.515 INFO:teuthology.orchestra.run.trial162.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-17T11:02:26.515 INFO:teuthology.orchestra.run.trial162.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-17T11:02:26.515 INFO:teuthology.orchestra.run.trial162.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-17T11:02:26.515 INFO:teuthology.orchestra.run.trial162.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-17T11:02:26.515 INFO:teuthology.orchestra.run.trial162.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-17T11:02:26.515 INFO:teuthology.orchestra.run.trial162.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-17T11:02:26.515 INFO:teuthology.orchestra.run.trial162.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-17T11:02:26.515 INFO:teuthology.orchestra.run.trial162.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-17T11:02:26.515 INFO:teuthology.orchestra.run.trial162.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-17T11:02:26.516 INFO:teuthology.orchestra.run.trial162.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-17T11:02:26.516 INFO:teuthology.orchestra.run.trial162.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-17T11:02:26.516 INFO:teuthology.orchestra.run.trial162.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-17T11:02:26.516 INFO:teuthology.orchestra.run.trial162.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-17T11:02:26.516 INFO:teuthology.orchestra.run.trial162.stdout:Installing weak dependencies: 2026-02-17T11:02:26.516 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mgr-cephadm noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 150 k 2026-02-17T11:02:26.516 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mgr-dashboard noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 3.8 M 2026-02-17T11:02:26.516 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 7.4 M 2026-02-17T11:02:26.516 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 22 k 2026-02-17T11:02:26.516 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mgr-rook noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 49 k 2026-02-17T11:02:26.516 INFO:teuthology.orchestra.run.trial162.stdout: ceph-volume noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 299 k 2026-02-17T11:02:26.516 INFO:teuthology.orchestra.run.trial162.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-17T11:02:26.517 INFO:teuthology.orchestra.run.trial162.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-17T11:02:26.517 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:02:26.517 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-17T11:02:26.517 INFO:teuthology.orchestra.run.trial162.stdout:====================================================================================== 2026-02-17T11:02:26.517 INFO:teuthology.orchestra.run.trial162.stdout:Install 99 Packages 2026-02-17T11:02:26.517 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:02:26.518 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:00:41 ago on Tue 17 Feb 2026 11:01:45 AM UTC. 2026-02-17T11:02:26.518 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 95 M 2026-02-17T11:02:26.519 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 520 M 2026-02-17T11:02:26.519 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-17T11:02:26.577 INFO:teuthology.orchestra.run.trial157.stdout:Package librados2-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T11:02:26.595 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-17T11:02:26.595 INFO:teuthology.orchestra.run.trial157.stdout:Nothing to do. 2026-02-17T11:02:26.595 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-17T11:02:26.616 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install librbd1 2026-02-17T11:02:26.929 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:00:41 ago on Tue 17 Feb 2026 11:01:45 AM UTC. 2026-02-17T11:02:26.994 INFO:teuthology.orchestra.run.trial157.stdout:Package librbd1-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T11:02:27.011 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-17T11:02:27.012 INFO:teuthology.orchestra.run.trial157.stdout:Nothing to do. 2026-02-17T11:02:27.012 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-17T11:02:27.034 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install python3-rados 2026-02-17T11:02:27.151 INFO:teuthology.orchestra.run.trial162.stdout:(1/99): ceph-19.2.3-705.g04cf6dd4.el9.x86_64.rp 91 kB/s | 6.5 kB 00:00 2026-02-17T11:02:27.188 INFO:teuthology.orchestra.run.trial097.stdout:(2/3): ceph-base-debuginfo-19.2.3-705.g04cf6dd4 35 MB/s | 72 MB 00:02 2026-02-17T11:02:27.222 INFO:teuthology.orchestra.run.trial097.stdout:(3/3): ceph-debuginfo-19.2.3-705.g04cf6dd4.el9. 12 MB/s | 24 MB 00:02 2026-02-17T11:02:27.223 INFO:teuthology.orchestra.run.trial097.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:02:27.224 INFO:teuthology.orchestra.run.trial097.stdout:Total 51 MB/s | 107 MB 00:02 2026-02-17T11:02:27.224 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction check 2026-02-17T11:02:27.229 INFO:teuthology.orchestra.run.trial097.stdout:Transaction check succeeded. 2026-02-17T11:02:27.229 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction test 2026-02-17T11:02:27.237 INFO:teuthology.orchestra.run.trial162.stdout:(2/99): ceph-mgr-19.2.3-705.g04cf6dd4.el9.x86_6 6.9 MB/s | 1.1 MB 00:00 2026-02-17T11:02:27.262 INFO:teuthology.orchestra.run.trial162.stdout:(3/99): ceph-mds-19.2.3-705.g04cf6dd4.el9.x86_6 13 MB/s | 2.4 MB 00:00 2026-02-17T11:02:27.290 INFO:teuthology.orchestra.run.trial162.stdout:(4/99): ceph-grafana-dashboards-19.2.3-705.g04c 1.1 MB/s | 31 kB 00:00 2026-02-17T11:02:27.302 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: libcephsqlite-2:19.2.3-705.g04cf6dd4.el9.x86_64 4/5 2026-02-17T11:02:27.319 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-test-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/5 2026-02-17T11:02:27.322 INFO:teuthology.orchestra.run.trial162.stdout:(5/99): ceph-mgr-cephadm-19.2.3-705.g04cf6dd4.e 4.6 MB/s | 150 kB 00:00 2026-02-17T11:02:27.344 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:00:42 ago on Tue 17 Feb 2026 11:01:45 AM UTC. 2026-02-17T11:02:27.409 INFO:teuthology.orchestra.run.trial157.stdout:Package python3-rados-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T11:02:27.427 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-17T11:02:27.427 INFO:teuthology.orchestra.run.trial157.stdout:Nothing to do. 2026-02-17T11:02:27.427 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-17T11:02:27.450 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install python3-rgw 2026-02-17T11:02:27.521 INFO:teuthology.orchestra.run.trial162.stdout:(6/99): ceph-mgr-dashboard-19.2.3-705.g04cf6dd4 19 MB/s | 3.8 MB 00:00 2026-02-17T11:02:27.547 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-test-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/5 2026-02-17T11:02:27.547 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-test-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/5 2026-02-17T11:02:27.547 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : libcephsqlite-2:19.2.3-705.g04cf6dd4.el9.x86_64 2/5 2026-02-17T11:02:27.547 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-17T11:02:27.547 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-17T11:02:27.602 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-17T11:02:27.602 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:02:27.602 INFO:teuthology.orchestra.run.trial049.stdout:Installed: 2026-02-17T11:02:27.602 INFO:teuthology.orchestra.run.trial049.stdout: ceph-test-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:27.602 INFO:teuthology.orchestra.run.trial049.stdout: libcephsqlite-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:27.603 INFO:teuthology.orchestra.run.trial049.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-17T11:02:27.603 INFO:teuthology.orchestra.run.trial049.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-17T11:02:27.603 INFO:teuthology.orchestra.run.trial049.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-17T11:02:27.603 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:02:27.603 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-17T11:02:27.609 INFO:teuthology.orchestra.run.trial097.stdout:Transaction test succeeded. 2026-02-17T11:02:27.609 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction 2026-02-17T11:02:27.637 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph 2026-02-17T11:02:27.658 INFO:teuthology.orchestra.run.trial162.stdout:(7/99): ceph-mon-19.2.3-705.g04cf6dd4.el9.x86_6 9.3 MB/s | 4.7 MB 00:00 2026-02-17T11:02:27.713 INFO:teuthology.orchestra.run.trial162.stdout:(8/99): ceph-mgr-k8sevents-19.2.3-705.g04cf6dd4 407 kB/s | 22 kB 00:00 2026-02-17T11:02:27.764 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:00:42 ago on Tue 17 Feb 2026 11:01:45 AM UTC. 2026-02-17T11:02:27.774 INFO:teuthology.orchestra.run.trial162.stdout:(9/99): ceph-mgr-modules-core-19.2.3-705.g04cf6 4.0 MB/s | 253 kB 00:00 2026-02-17T11:02:27.827 INFO:teuthology.orchestra.run.trial157.stdout:Package python3-rgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T11:02:27.834 INFO:teuthology.orchestra.run.trial162.stdout:(10/99): ceph-mgr-rook-19.2.3-705.g04cf6dd4.el9 820 kB/s | 49 kB 00:00 2026-02-17T11:02:27.845 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-17T11:02:27.845 INFO:teuthology.orchestra.run.trial157.stdout:Nothing to do. 2026-02-17T11:02:27.846 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-17T11:02:27.868 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install python3-cephfs 2026-02-17T11:02:27.873 INFO:teuthology.orchestra.run.trial162.stdout:(11/99): ceph-mgr-diskprediction-local-19.2.3-7 21 MB/s | 7.4 MB 00:00 2026-02-17T11:02:27.889 INFO:teuthology.orchestra.run.trial162.stdout:(12/99): ceph-prometheus-alerts-19.2.3-705.g04c 303 kB/s | 17 kB 00:00 2026-02-17T11:02:27.917 INFO:teuthology.orchestra.run.trial162.stdout:(13/99): ceph-volume-19.2.3-705.g04cf6dd4.el9.n 6.6 MB/s | 299 kB 00:00 2026-02-17T11:02:27.946 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:18 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:02:27.984 INFO:teuthology.orchestra.run.trial162.stdout:(14/99): ceph-osd-19.2.3-705.g04cf6dd4.el9.x86_ 23 MB/s | 17 MB 00:00 2026-02-17T11:02:27.985 INFO:teuthology.orchestra.run.trial162.stdout:(15/99): cephadm-19.2.3-705.g04cf6dd4.el9.noarc 7.8 MB/s | 769 kB 00:00 2026-02-17T11:02:28.026 INFO:teuthology.orchestra.run.trial162.stdout:(16/99): cryptsetup-2.8.1-2.el9.x86_64.rpm 3.2 MB/s | 350 kB 00:00 2026-02-17T11:02:28.032 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-17T11:02:28.036 INFO:teuthology.orchestra.run.trial049.stdout:====================================================================================== 2026-02-17T11:02:28.036 INFO:teuthology.orchestra.run.trial049.stdout: Package Arch Version Repository Size 2026-02-17T11:02:28.036 INFO:teuthology.orchestra.run.trial049.stdout:====================================================================================== 2026-02-17T11:02:28.036 INFO:teuthology.orchestra.run.trial049.stdout:Installing: 2026-02-17T11:02:28.036 INFO:teuthology.orchestra.run.trial049.stdout: ceph x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 6.5 k 2026-02-17T11:02:28.036 INFO:teuthology.orchestra.run.trial049.stdout:Installing dependencies: 2026-02-17T11:02:28.036 INFO:teuthology.orchestra.run.trial049.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-17T11:02:28.036 INFO:teuthology.orchestra.run.trial049.stdout: ceph-grafana-dashboards noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 31 k 2026-02-17T11:02:28.036 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mds x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 2.4 M 2026-02-17T11:02:28.037 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mgr x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 1.1 M 2026-02-17T11:02:28.037 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mgr-modules-core noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 253 k 2026-02-17T11:02:28.037 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mon x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 4.7 M 2026-02-17T11:02:28.037 INFO:teuthology.orchestra.run.trial049.stdout: ceph-osd x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 17 M 2026-02-17T11:02:28.037 INFO:teuthology.orchestra.run.trial049.stdout: ceph-prometheus-alerts noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 17 k 2026-02-17T11:02:28.037 INFO:teuthology.orchestra.run.trial049.stdout: cephadm noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 769 k 2026-02-17T11:02:28.037 INFO:teuthology.orchestra.run.trial049.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-17T11:02:28.037 INFO:teuthology.orchestra.run.trial049.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-17T11:02:28.037 INFO:teuthology.orchestra.run.trial049.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-17T11:02:28.037 INFO:teuthology.orchestra.run.trial049.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-17T11:02:28.037 INFO:teuthology.orchestra.run.trial049.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-17T11:02:28.037 INFO:teuthology.orchestra.run.trial049.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-17T11:02:28.038 INFO:teuthology.orchestra.run.trial049.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-17T11:02:28.038 INFO:teuthology.orchestra.run.trial049.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-17T11:02:28.038 INFO:teuthology.orchestra.run.trial049.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-17T11:02:28.038 INFO:teuthology.orchestra.run.trial049.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-17T11:02:28.038 INFO:teuthology.orchestra.run.trial049.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-17T11:02:28.038 INFO:teuthology.orchestra.run.trial049.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-17T11:02:28.038 INFO:teuthology.orchestra.run.trial049.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-17T11:02:28.038 INFO:teuthology.orchestra.run.trial049.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-17T11:02:28.038 INFO:teuthology.orchestra.run.trial049.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-17T11:02:28.038 INFO:teuthology.orchestra.run.trial049.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-17T11:02:28.038 INFO:teuthology.orchestra.run.trial049.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-17T11:02:28.038 INFO:teuthology.orchestra.run.trial049.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-17T11:02:28.039 INFO:teuthology.orchestra.run.trial049.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-17T11:02:28.039 INFO:teuthology.orchestra.run.trial049.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-17T11:02:28.039 INFO:teuthology.orchestra.run.trial049.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-17T11:02:28.039 INFO:teuthology.orchestra.run.trial049.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-17T11:02:28.039 INFO:teuthology.orchestra.run.trial049.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-17T11:02:28.039 INFO:teuthology.orchestra.run.trial049.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-17T11:02:28.039 INFO:teuthology.orchestra.run.trial049.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-17T11:02:28.039 INFO:teuthology.orchestra.run.trial049.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-17T11:02:28.039 INFO:teuthology.orchestra.run.trial049.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-17T11:02:28.039 INFO:teuthology.orchestra.run.trial049.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-17T11:02:28.039 INFO:teuthology.orchestra.run.trial049.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-17T11:02:28.039 INFO:teuthology.orchestra.run.trial049.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-17T11:02:28.039 INFO:teuthology.orchestra.run.trial049.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-17T11:02:28.040 INFO:teuthology.orchestra.run.trial049.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-17T11:02:28.040 INFO:teuthology.orchestra.run.trial049.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-17T11:02:28.040 INFO:teuthology.orchestra.run.trial049.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-17T11:02:28.040 INFO:teuthology.orchestra.run.trial049.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-17T11:02:28.040 INFO:teuthology.orchestra.run.trial049.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-17T11:02:28.040 INFO:teuthology.orchestra.run.trial049.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-17T11:02:28.040 INFO:teuthology.orchestra.run.trial049.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-17T11:02:28.040 INFO:teuthology.orchestra.run.trial049.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-17T11:02:28.040 INFO:teuthology.orchestra.run.trial049.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-17T11:02:28.040 INFO:teuthology.orchestra.run.trial049.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-17T11:02:28.040 INFO:teuthology.orchestra.run.trial049.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-17T11:02:28.040 INFO:teuthology.orchestra.run.trial049.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-17T11:02:28.041 INFO:teuthology.orchestra.run.trial049.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-17T11:02:28.041 INFO:teuthology.orchestra.run.trial049.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-17T11:02:28.041 INFO:teuthology.orchestra.run.trial049.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-17T11:02:28.041 INFO:teuthology.orchestra.run.trial049.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-17T11:02:28.041 INFO:teuthology.orchestra.run.trial049.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-17T11:02:28.041 INFO:teuthology.orchestra.run.trial049.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-17T11:02:28.041 INFO:teuthology.orchestra.run.trial049.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-17T11:02:28.041 INFO:teuthology.orchestra.run.trial049.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-17T11:02:28.041 INFO:teuthology.orchestra.run.trial049.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-17T11:02:28.041 INFO:teuthology.orchestra.run.trial049.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-17T11:02:28.041 INFO:teuthology.orchestra.run.trial049.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-17T11:02:28.042 INFO:teuthology.orchestra.run.trial049.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-17T11:02:28.042 INFO:teuthology.orchestra.run.trial049.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-17T11:02:28.042 INFO:teuthology.orchestra.run.trial049.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-17T11:02:28.042 INFO:teuthology.orchestra.run.trial049.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-17T11:02:28.042 INFO:teuthology.orchestra.run.trial049.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-17T11:02:28.042 INFO:teuthology.orchestra.run.trial049.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-17T11:02:28.042 INFO:teuthology.orchestra.run.trial049.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-17T11:02:28.042 INFO:teuthology.orchestra.run.trial049.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-17T11:02:28.042 INFO:teuthology.orchestra.run.trial049.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-17T11:02:28.042 INFO:teuthology.orchestra.run.trial049.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-17T11:02:28.042 INFO:teuthology.orchestra.run.trial049.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-17T11:02:28.042 INFO:teuthology.orchestra.run.trial049.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-17T11:02:28.043 INFO:teuthology.orchestra.run.trial049.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-17T11:02:28.043 INFO:teuthology.orchestra.run.trial049.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-17T11:02:28.043 INFO:teuthology.orchestra.run.trial049.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-17T11:02:28.043 INFO:teuthology.orchestra.run.trial049.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-17T11:02:28.043 INFO:teuthology.orchestra.run.trial049.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-17T11:02:28.043 INFO:teuthology.orchestra.run.trial049.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-17T11:02:28.043 INFO:teuthology.orchestra.run.trial049.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-17T11:02:28.043 INFO:teuthology.orchestra.run.trial049.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-17T11:02:28.043 INFO:teuthology.orchestra.run.trial049.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-17T11:02:28.043 INFO:teuthology.orchestra.run.trial049.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-17T11:02:28.043 INFO:teuthology.orchestra.run.trial049.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-17T11:02:28.043 INFO:teuthology.orchestra.run.trial049.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-17T11:02:28.044 INFO:teuthology.orchestra.run.trial049.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-17T11:02:28.044 INFO:teuthology.orchestra.run.trial049.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-17T11:02:28.044 INFO:teuthology.orchestra.run.trial049.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-17T11:02:28.044 INFO:teuthology.orchestra.run.trial049.stdout:Installing weak dependencies: 2026-02-17T11:02:28.044 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mgr-cephadm noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 150 k 2026-02-17T11:02:28.044 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mgr-dashboard noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 3.8 M 2026-02-17T11:02:28.044 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 7.4 M 2026-02-17T11:02:28.044 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 22 k 2026-02-17T11:02:28.044 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mgr-rook noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 49 k 2026-02-17T11:02:28.044 INFO:teuthology.orchestra.run.trial049.stdout: ceph-volume noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 299 k 2026-02-17T11:02:28.044 INFO:teuthology.orchestra.run.trial049.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-17T11:02:28.044 INFO:teuthology.orchestra.run.trial049.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-17T11:02:28.045 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:02:28.045 INFO:teuthology.orchestra.run.trial049.stdout:Transaction Summary 2026-02-17T11:02:28.045 INFO:teuthology.orchestra.run.trial049.stdout:====================================================================================== 2026-02-17T11:02:28.045 INFO:teuthology.orchestra.run.trial049.stdout:Install 99 Packages 2026-02-17T11:02:28.045 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:02:28.046 INFO:teuthology.orchestra.run.trial049.stdout:Total download size: 95 M 2026-02-17T11:02:28.046 INFO:teuthology.orchestra.run.trial049.stdout:Installed size: 520 M 2026-02-17T11:02:28.046 INFO:teuthology.orchestra.run.trial049.stdout:Downloading Packages: 2026-02-17T11:02:28.047 INFO:teuthology.orchestra.run.trial162.stdout:(17/99): ledmon-libs-1.1.0-3.el9.x86_64.rpm 647 kB/s | 40 kB 00:00 2026-02-17T11:02:28.049 INFO:teuthology.orchestra.run.trial162.stdout:(18/99): libconfig-1.7.2-9.el9.x86_64.rpm 1.1 MB/s | 72 kB 00:00 2026-02-17T11:02:28.073 INFO:teuthology.orchestra.run.trial162.stdout:(19/99): libgfortran-11.5.0-14.el9.x86_64.rpm 17 MB/s | 794 kB 00:00 2026-02-17T11:02:28.091 INFO:teuthology.orchestra.run.trial162.stdout:(20/99): libquadmath-11.5.0-14.el9.x86_64.rpm 4.1 MB/s | 184 kB 00:00 2026-02-17T11:02:28.094 INFO:teuthology.orchestra.run.trial162.stdout:(21/99): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.5 MB/s | 253 kB 00:00 2026-02-17T11:02:28.114 INFO:teuthology.orchestra.run.trial162.stdout:(22/99): python3-ply-3.11-14.el9.noarch.rpm 4.4 MB/s | 106 kB 00:00 2026-02-17T11:02:28.118 INFO:teuthology.orchestra.run.trial162.stdout:(23/99): python3-pycparser-2.20-6.el9.noarch.rp 5.5 MB/s | 135 kB 00:00 2026-02-17T11:02:28.130 INFO:teuthology.orchestra.run.trial162.stdout:(24/99): python3-cryptography-36.0.1-5.el9.x86_ 22 MB/s | 1.2 MB 00:00 2026-02-17T11:02:28.138 INFO:teuthology.orchestra.run.trial162.stdout:(25/99): python3-pyparsing-2.4.7-9.el9.noarch.r 6.2 MB/s | 150 kB 00:00 2026-02-17T11:02:28.142 INFO:teuthology.orchestra.run.trial162.stdout:(26/99): python3-requests-2.25.1-10.el9.noarch. 5.2 MB/s | 126 kB 00:00 2026-02-17T11:02:28.155 INFO:teuthology.orchestra.run.trial162.stdout:(27/99): python3-urllib3-1.26.5-7.el9.noarch.rp 8.8 MB/s | 218 kB 00:00 2026-02-17T11:02:28.163 INFO:teuthology.orchestra.run.trial162.stdout:(28/99): unzip-6.0-59.el9.x86_64.rpm 7.2 MB/s | 182 kB 00:00 2026-02-17T11:02:28.166 INFO:teuthology.orchestra.run.trial162.stdout:(29/99): zip-3.0-35.el9.x86_64.rpm 11 MB/s | 266 kB 00:00 2026-02-17T11:02:28.176 INFO:teuthology.orchestra.run.trial162.stdout:(30/99): flexiblas-3.0.4-9.el9.x86_64.rpm 1.3 MB/s | 30 kB 00:00 2026-02-17T11:02:28.180 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:00:43 ago on Tue 17 Feb 2026 11:01:45 AM UTC. 2026-02-17T11:02:28.188 INFO:teuthology.orchestra.run.trial162.stdout:(31/99): flexiblas-openblas-openmp-3.0.4-9.el9. 690 kB/s | 15 kB 00:00 2026-02-17T11:02:28.202 INFO:teuthology.orchestra.run.trial162.stdout:(32/99): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 9.3 MB/s | 246 kB 00:00 2026-02-17T11:02:28.212 INFO:teuthology.orchestra.run.trial162.stdout:(33/99): lua-5.4.4-4.el9.x86_64.rpm 7.6 MB/s | 188 kB 00:00 2026-02-17T11:02:28.224 INFO:teuthology.orchestra.run.trial162.stdout:(34/99): openblas-0.3.29-1.el9.x86_64.rpm 1.9 MB/s | 42 kB 00:00 2026-02-17T11:02:28.245 INFO:teuthology.orchestra.run.trial157.stdout:Package python3-cephfs-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T11:02:28.252 INFO:teuthology.orchestra.run.trial162.stdout:(35/99): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 34 MB/s | 3.0 MB 00:00 2026-02-17T11:02:28.254 INFO:teuthology.orchestra.run.trial162.stdout:(36/99): protobuf-3.14.0-17.el9.x86_64.rpm 34 MB/s | 1.0 MB 00:00 2026-02-17T11:02:28.262 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-17T11:02:28.263 INFO:teuthology.orchestra.run.trial157.stdout:Nothing to do. 2026-02-17T11:02:28.263 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-17T11:02:28.279 INFO:teuthology.orchestra.run.trial162.stdout:(37/99): python3-devel-3.9.25-2.el9.x86_64.rpm 9.6 MB/s | 244 kB 00:00 2026-02-17T11:02:28.285 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install python3-rbd 2026-02-17T11:02:28.304 INFO:teuthology.orchestra.run.trial162.stdout:(38/99): python3-jinja2-2.11.3-8.el9.noarch.rpm 9.8 MB/s | 249 kB 00:00 2026-02-17T11:02:28.311 INFO:teuthology.orchestra.run.trial162.stdout:(39/99): openblas-openmp-0.3.29-1.el9.x86_64.rp 53 MB/s | 5.3 MB 00:00 2026-02-17T11:02:28.328 INFO:teuthology.orchestra.run.trial162.stdout:(40/99): python3-libstoragemgmt-1.10.1-1.el9.x8 7.2 MB/s | 177 kB 00:00 2026-02-17T11:02:28.352 INFO:teuthology.orchestra.run.trial162.stdout:(41/99): python3-mako-1.1.4-6.el9.noarch.rpm 7.0 MB/s | 172 kB 00:00 2026-02-17T11:02:28.375 INFO:teuthology.orchestra.run.trial162.stdout:(42/99): python3-markupsafe-1.1.1-12.el9.x86_64 1.5 MB/s | 35 kB 00:00 2026-02-17T11:02:28.430 INFO:teuthology.orchestra.run.trial162.stdout:(43/99): python3-numpy-1.23.5-2.el9.x86_64.rpm 112 MB/s | 6.1 MB 00:00 2026-02-17T11:02:28.455 INFO:teuthology.orchestra.run.trial162.stdout:(44/99): python3-numpy-f2py-1.23.5-2.el9.x86_64 17 MB/s | 442 kB 00:00 2026-02-17T11:02:28.478 INFO:teuthology.orchestra.run.trial162.stdout:(45/99): python3-packaging-20.9-5.el9.noarch.rp 3.3 MB/s | 77 kB 00:00 2026-02-17T11:02:28.499 INFO:teuthology.orchestra.run.trial162.stdout:(46/99): python3-babel-2.9.1-2.el9.noarch.rpm 24 MB/s | 6.0 MB 00:00 2026-02-17T11:02:28.501 INFO:teuthology.orchestra.run.trial162.stdout:(47/99): python3-lxml-4.6.5-3.el9.x86_64.rpm 6.4 MB/s | 1.2 MB 00:00 2026-02-17T11:02:28.502 INFO:teuthology.orchestra.run.trial162.stdout:(48/99): python3-protobuf-3.14.0-17.el9.noarch. 11 MB/s | 267 kB 00:00 2026-02-17T11:02:28.523 INFO:teuthology.orchestra.run.trial162.stdout:(49/99): python3-pyasn1-0.4.8-6.el9.noarch.rpm 6.4 MB/s | 159 kB 00:00 2026-02-17T11:02:28.525 INFO:teuthology.orchestra.run.trial162.stdout:(50/99): python3-requests-oauthlib-1.3.0-12.el9 2.3 MB/s | 54 kB 00:00 2026-02-17T11:02:28.526 INFO:teuthology.orchestra.run.trial162.stdout:(51/99): python3-pyasn1-modules-0.4.8-6.el9.noa 11 MB/s | 279 kB 00:00 2026-02-17T11:02:28.547 INFO:teuthology.orchestra.run.trial162.stdout:(52/99): python3-toml-0.10.2-6.el9.noarch.rpm 1.8 MB/s | 42 kB 00:00 2026-02-17T11:02:28.550 INFO:teuthology.orchestra.run.trial162.stdout:(53/99): xmlsec1-1.2.29-13.el9.x86_64.rpm 7.8 MB/s | 189 kB 00:00 2026-02-17T11:02:28.560 INFO:teuthology.orchestra.run.trial162.stdout:(54/99): lua-devel-5.4.4-4.el9.x86_64.rpm 2.1 MB/s | 22 kB 00:00 2026-02-17T11:02:28.572 INFO:teuthology.orchestra.run.trial162.stdout:(55/99): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 3.6 MB/s | 90 kB 00:00 2026-02-17T11:02:28.580 INFO:teuthology.orchestra.run.trial162.stdout:(56/99): protobuf-compiler-3.14.0-17.el9.x86_64 44 MB/s | 862 kB 00:00 2026-02-17T11:02:28.601 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:00:43 ago on Tue 17 Feb 2026 11:01:45 AM UTC. 2026-02-17T11:02:28.665 INFO:teuthology.orchestra.run.trial157.stdout:Package python3-rbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T11:02:28.682 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-17T11:02:28.683 INFO:teuthology.orchestra.run.trial157.stdout:Nothing to do. 2026-02-17T11:02:28.683 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-17T11:02:28.704 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install rbd-fuse 2026-02-17T11:02:28.716 INFO:teuthology.orchestra.run.trial049.stdout:(1/99): ceph-19.2.3-705.g04cf6dd4.el9.x86_64.rp 114 kB/s | 6.5 kB 00:00 2026-02-17T11:02:28.779 INFO:teuthology.orchestra.run.trial162.stdout:(57/99): python3-scipy-1.9.3-2.el9.x86_64.rpm 75 MB/s | 19 MB 00:00 2026-02-17T11:02:28.795 INFO:teuthology.orchestra.run.trial049.stdout:(2/99): ceph-mgr-19.2.3-705.g04cf6dd4.el9.x86_6 8.0 MB/s | 1.1 MB 00:00 2026-02-17T11:02:28.816 INFO:teuthology.orchestra.run.trial049.stdout:(3/99): ceph-mds-19.2.3-705.g04cf6dd4.el9.x86_6 16 MB/s | 2.4 MB 00:00 2026-02-17T11:02:28.830 INFO:teuthology.orchestra.run.trial162.stdout:(58/99): grpc-data-1.46.7-10.el9.noarch.rpm 77 kB/s | 19 kB 00:00 2026-02-17T11:02:28.844 INFO:teuthology.orchestra.run.trial049.stdout:(4/99): ceph-grafana-dashboards-19.2.3-705.g04c 1.1 MB/s | 31 kB 00:00 2026-02-17T11:02:28.876 INFO:teuthology.orchestra.run.trial049.stdout:(5/99): ceph-mgr-cephadm-19.2.3-705.g04cf6dd4.e 4.6 MB/s | 150 kB 00:00 2026-02-17T11:02:29.015 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:00:44 ago on Tue 17 Feb 2026 11:01:45 AM UTC. 2026-02-17T11:02:29.019 INFO:teuthology.orchestra.run.trial049.stdout:(6/99): ceph-mon-19.2.3-705.g04cf6dd4.el9.x86_6 16 MB/s | 4.7 MB 00:00 2026-02-17T11:02:29.036 INFO:teuthology.orchestra.run.trial049.stdout:(7/99): ceph-mgr-dashboard-19.2.3-705.g04cf6dd4 24 MB/s | 3.8 MB 00:00 2026-02-17T11:02:29.069 INFO:teuthology.orchestra.run.trial049.stdout:(8/99): ceph-mgr-k8sevents-19.2.3-705.g04cf6dd4 657 kB/s | 22 kB 00:00 2026-02-17T11:02:29.080 INFO:teuthology.orchestra.run.trial162.stdout:(59/99): abseil-cpp-20211102.0-4.el9.x86_64.rpm 1.1 MB/s | 551 kB 00:00 2026-02-17T11:02:29.097 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-17T11:02:29.098 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:02:29.098 INFO:teuthology.orchestra.run.trial157.stdout: Package Architecture Version Repository Size 2026-02-17T11:02:29.098 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:02:29.098 INFO:teuthology.orchestra.run.trial157.stdout:Installing: 2026-02-17T11:02:29.098 INFO:teuthology.orchestra.run.trial157.stdout: rbd-fuse x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 85 k 2026-02-17T11:02:29.098 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:02:29.099 INFO:teuthology.orchestra.run.trial157.stdout:Transaction Summary 2026-02-17T11:02:29.099 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:02:29.099 INFO:teuthology.orchestra.run.trial157.stdout:Install 1 Package 2026-02-17T11:02:29.099 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:02:29.099 INFO:teuthology.orchestra.run.trial157.stdout:Total download size: 85 k 2026-02-17T11:02:29.099 INFO:teuthology.orchestra.run.trial157.stdout:Installed size: 227 k 2026-02-17T11:02:29.099 INFO:teuthology.orchestra.run.trial157.stdout:Downloading Packages: 2026-02-17T11:02:29.112 INFO:teuthology.orchestra.run.trial049.stdout:(9/99): ceph-mgr-modules-core-19.2.3-705.g04cf6 5.9 MB/s | 253 kB 00:00 2026-02-17T11:02:29.142 INFO:teuthology.orchestra.run.trial162.stdout:(60/99): python3-autocommand-2.2.2-8.el9.noarch 471 kB/s | 29 kB 00:00 2026-02-17T11:02:29.150 INFO:teuthology.orchestra.run.trial162.stdout:(61/99): python3-asyncssh-2.13.2-5.el9.noarch.r 1.7 MB/s | 548 kB 00:00 2026-02-17T11:02:29.151 INFO:teuthology.orchestra.run.trial049.stdout:(10/99): ceph-mgr-rook-19.2.3-705.g04cf6dd4.el9 1.2 MB/s | 49 kB 00:00 2026-02-17T11:02:29.193 INFO:teuthology.orchestra.run.trial049.stdout:(11/99): ceph-prometheus-alerts-19.2.3-705.g04c 404 kB/s | 17 kB 00:00 2026-02-17T11:02:29.207 INFO:teuthology.orchestra.run.trial162.stdout:(62/99): python3-backports-tarfile-1.2.0-1.el9. 930 kB/s | 60 kB 00:00 2026-02-17T11:02:29.214 INFO:teuthology.orchestra.run.trial162.stdout:(63/99): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 684 kB/s | 43 kB 00:00 2026-02-17T11:02:29.242 INFO:teuthology.orchestra.run.trial049.stdout:(12/99): ceph-volume-19.2.3-705.g04cf6dd4.el9.n 6.0 MB/s | 299 kB 00:00 2026-02-17T11:02:29.270 INFO:teuthology.orchestra.run.trial162.stdout:(64/99): python3-cachetools-4.2.4-1.el9.noarch. 515 kB/s | 32 kB 00:00 2026-02-17T11:02:29.275 INFO:teuthology.orchestra.run.trial162.stdout:(65/99): python3-certifi-2023.05.07-4.el9.noarc 229 kB/s | 14 kB 00:00 2026-02-17T11:02:29.292 INFO:teuthology.orchestra.run.trial162.stdout:(66/99): luarocks-3.9.2-5.el9.noarch.rpm 295 kB/s | 151 kB 00:00 2026-02-17T11:02:29.302 INFO:teuthology.orchestra.run.trial049.stdout:(13/99): cephadm-19.2.3-705.g04cf6dd4.el9.noarc 13 MB/s | 769 kB 00:00 2026-02-17T11:02:29.343 INFO:teuthology.orchestra.run.trial162.stdout:(67/99): python3-cheroot-10.0.1-4.el9.noarch.rp 2.3 MB/s | 173 kB 00:00 2026-02-17T11:02:29.362 INFO:teuthology.orchestra.run.trial162.stdout:(68/99): python3-cherrypy-18.6.1-2.el9.noarch.r 4.0 MB/s | 358 kB 00:00 2026-02-17T11:02:29.369 INFO:teuthology.orchestra.run.trial157.stdout:rbd-fuse-19.2.3-705.g04cf6dd4.el9.x86_64.rpm 313 kB/s | 85 kB 00:00 2026-02-17T11:02:29.370 INFO:teuthology.orchestra.run.trial157.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:02:29.370 INFO:teuthology.orchestra.run.trial157.stdout:Total 313 kB/s | 85 kB 00:00 2026-02-17T11:02:29.370 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction check 2026-02-17T11:02:29.373 INFO:teuthology.orchestra.run.trial157.stdout:Transaction check succeeded. 2026-02-17T11:02:29.373 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction test 2026-02-17T11:02:29.378 INFO:teuthology.orchestra.run.trial049.stdout:(14/99): ceph-mgr-diskprediction-local-19.2.3-7 21 MB/s | 7.4 MB 00:00 2026-02-17T11:02:29.405 INFO:teuthology.orchestra.run.trial157.stdout:Transaction test succeeded. 2026-02-17T11:02:29.405 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction 2026-02-17T11:02:29.416 INFO:teuthology.orchestra.run.trial049.stdout:(15/99): ceph-osd-19.2.3-705.g04cf6dd4.el9.x86_ 27 MB/s | 17 MB 00:00 2026-02-17T11:02:29.433 INFO:teuthology.orchestra.run.trial162.stdout:(69/99): python3-grpcio-tools-1.46.7-10.el9.x86 2.0 MB/s | 144 kB 00:00 2026-02-17T11:02:29.456 INFO:teuthology.orchestra.run.trial157.stdout: Preparing : 1/1 2026-02-17T11:02:29.472 INFO:teuthology.orchestra.run.trial157.stdout: Installing : rbd-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:29.484 INFO:teuthology.orchestra.run.trial162.stdout:(70/99): python3-google-auth-2.45.0-1.el9.noarc 1.3 MB/s | 254 kB 00:00 2026-02-17T11:02:29.503 INFO:teuthology.orchestra.run.trial162.stdout:(71/99): python3-influxdb-5.3.1-1.el9.noarch.rp 1.9 MB/s | 139 kB 00:00 2026-02-17T11:02:29.539 INFO:teuthology.orchestra.run.trial162.stdout:(72/99): python3-grpcio-1.46.7-10.el9.x86_64.rp 10 MB/s | 2.0 MB 00:00 2026-02-17T11:02:29.553 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: rbd-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:29.564 INFO:teuthology.orchestra.run.trial162.stdout:(73/99): python3-jaraco-8.2.1-3.el9.noarch.rpm 175 kB/s | 11 kB 00:00 2026-02-17T11:02:29.573 INFO:teuthology.orchestra.run.trial162.stdout:(74/99): python3-isodate-0.6.1-3.el9.noarch.rpm 630 kB/s | 56 kB 00:00 2026-02-17T11:02:29.601 INFO:teuthology.orchestra.run.trial162.stdout:(75/99): python3-jaraco-classes-3.2.1-5.el9.noa 285 kB/s | 18 kB 00:00 2026-02-17T11:02:29.614 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : rbd-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:29.614 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:02:29.614 INFO:teuthology.orchestra.run.trial157.stdout:Installed: 2026-02-17T11:02:29.614 INFO:teuthology.orchestra.run.trial157.stdout: rbd-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:29.614 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:02:29.614 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-17T11:02:29.626 INFO:teuthology.orchestra.run.trial162.stdout:(76/99): python3-jaraco-collections-3.0.0-8.el9 377 kB/s | 23 kB 00:00 2026-02-17T11:02:29.644 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install rbd-mirror 2026-02-17T11:02:29.655 INFO:teuthology.orchestra.run.trial049.stdout:(16/99): ledmon-libs-1.1.0-3.el9.x86_64.rpm 146 kB/s | 40 kB 00:00 2026-02-17T11:02:29.656 INFO:teuthology.orchestra.run.trial162.stdout:(77/99): python3-jaraco-context-6.0.1-3.el9.noa 237 kB/s | 20 kB 00:00 2026-02-17T11:02:29.662 INFO:teuthology.orchestra.run.trial162.stdout:(78/99): python3-jaraco-functools-3.5.0-2.el9.n 318 kB/s | 19 kB 00:00 2026-02-17T11:02:29.688 INFO:teuthology.orchestra.run.trial162.stdout:(79/99): python3-jaraco-text-4.0.0-2.el9.noarch 423 kB/s | 26 kB 00:00 2026-02-17T11:02:29.725 INFO:teuthology.orchestra.run.trial162.stdout:(80/99): python3-logutils-0.3.5-21.el9.noarch.r 741 kB/s | 46 kB 00:00 2026-02-17T11:02:29.755 INFO:teuthology.orchestra.run.trial162.stdout:(81/99): python3-more-itertools-8.12.0-2.el9.no 1.2 MB/s | 79 kB 00:00 2026-02-17T11:02:29.770 INFO:teuthology.orchestra.run.trial049.stdout:(17/99): libconfig-1.7.2-9.el9.x86_64.rpm 204 kB/s | 72 kB 00:00 2026-02-17T11:02:29.787 INFO:teuthology.orchestra.run.trial162.stdout:(82/99): python3-msgpack-1.0.3-2.el9.x86_64.rpm 1.3 MB/s | 86 kB 00:00 2026-02-17T11:02:29.819 INFO:teuthology.orchestra.run.trial162.stdout:(83/99): python3-natsort-7.1.1-5.el9.noarch.rpm 897 kB/s | 58 kB 00:00 2026-02-17T11:02:29.835 INFO:teuthology.orchestra.run.trial049.stdout:(18/99): cryptsetup-2.8.1-2.el9.x86_64.rpm 656 kB/s | 350 kB 00:00 2026-02-17T11:02:29.855 INFO:teuthology.orchestra.run.trial162.stdout:(84/99): python3-pecan-1.4.2-3.el9.noarch.rpm 4.0 MB/s | 272 kB 00:00 2026-02-17T11:02:29.881 INFO:teuthology.orchestra.run.trial162.stdout:(85/99): python3-portend-3.1.0-2.el9.noarch.rpm 266 kB/s | 16 kB 00:00 2026-02-17T11:02:29.901 INFO:teuthology.orchestra.run.trial162.stdout:(86/99): python3-kubernetes-26.1.0-3.el9.noarch 4.2 MB/s | 1.0 MB 00:00 2026-02-17T11:02:29.922 INFO:teuthology.orchestra.run.trial162.stdout:(87/99): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.3 MB/s | 90 kB 00:00 2026-02-17T11:02:29.943 INFO:teuthology.orchestra.run.trial162.stdout:(88/99): python3-repoze-lru-0.7-16.el9.noarch.r 492 kB/s | 31 kB 00:00 2026-02-17T11:02:29.952 INFO:teuthology.orchestra.run.trial049.stdout:(19/99): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.1 MB/s | 253 kB 00:00 2026-02-17T11:02:29.958 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:00:44 ago on Tue 17 Feb 2026 11:01:45 AM UTC. 2026-02-17T11:02:29.985 INFO:teuthology.orchestra.run.trial162.stdout:(89/99): python3-rsa-4.9-2.el9.noarch.rpm 944 kB/s | 59 kB 00:00 2026-02-17T11:02:29.990 INFO:teuthology.orchestra.run.trial162.stdout:(90/99): python3-routes-2.5.1-5.el9.noarch.rpm 2.1 MB/s | 188 kB 00:00 2026-02-17T11:02:29.998 INFO:teuthology.orchestra.run.trial049.stdout:(20/99): libquadmath-11.5.0-14.el9.x86_64.rpm 811 kB/s | 184 kB 00:00 2026-02-17T11:02:30.012 INFO:teuthology.orchestra.run.trial162.stdout:(91/99): python3-saml-1.16.0-1.el9.noarch.rpm 1.8 MB/s | 125 kB 00:00 2026-02-17T11:02:30.039 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-17T11:02:30.040 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:02:30.040 INFO:teuthology.orchestra.run.trial157.stdout: Package Arch Version Repo Size 2026-02-17T11:02:30.040 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:02:30.040 INFO:teuthology.orchestra.run.trial157.stdout:Installing: 2026-02-17T11:02:30.040 INFO:teuthology.orchestra.run.trial157.stdout: rbd-mirror x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 3.1 M 2026-02-17T11:02:30.040 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:02:30.040 INFO:teuthology.orchestra.run.trial157.stdout:Transaction Summary 2026-02-17T11:02:30.041 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:02:30.041 INFO:teuthology.orchestra.run.trial157.stdout:Install 1 Package 2026-02-17T11:02:30.041 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:02:30.041 INFO:teuthology.orchestra.run.trial157.stdout:Total download size: 3.1 M 2026-02-17T11:02:30.041 INFO:teuthology.orchestra.run.trial157.stdout:Installed size: 13 M 2026-02-17T11:02:30.041 INFO:teuthology.orchestra.run.trial157.stdout:Downloading Packages: 2026-02-17T11:02:30.046 INFO:teuthology.orchestra.run.trial162.stdout:(92/99): python3-tempora-5.0.0-2.el9.noarch.rpm 583 kB/s | 36 kB 00:00 2026-02-17T11:02:30.065 INFO:teuthology.orchestra.run.trial097.stdout: Preparing : 1/1 2026-02-17T11:02:30.073 INFO:teuthology.orchestra.run.trial162.stdout:(93/99): python3-typing-extensions-4.15.0-1.el9 1.0 MB/s | 86 kB 00:00 2026-02-17T11:02:30.090 INFO:teuthology.orchestra.run.trial162.stdout:(94/99): python3-webob-1.8.8-2.el9.noarch.rpm 2.9 MB/s | 230 kB 00:00 2026-02-17T11:02:30.091 INFO:teuthology.orchestra.run.trial049.stdout:(21/99): libgfortran-11.5.0-14.el9.x86_64.rpm 1.8 MB/s | 794 kB 00:00 2026-02-17T11:02:30.105 INFO:teuthology.orchestra.run.trial049.stdout:(22/99): python3-ply-3.11-14.el9.noarch.rpm 996 kB/s | 106 kB 00:00 2026-02-17T11:02:30.109 INFO:teuthology.orchestra.run.trial162.stdout:(95/99): python3-websocket-client-1.2.3-2.el9.n 1.4 MB/s | 90 kB 00:00 2026-02-17T11:02:30.154 INFO:teuthology.orchestra.run.trial162.stdout:(96/99): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 761 kB/s | 48 kB 00:00 2026-02-17T11:02:30.170 INFO:teuthology.orchestra.run.trial162.stdout:(97/99): python3-xmltodict-0.12.0-15.el9.noarch 362 kB/s | 22 kB 00:00 2026-02-17T11:02:30.174 INFO:teuthology.orchestra.run.trial162.stdout:(98/99): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.1 MB/s | 427 kB 00:00 2026-02-17T11:02:30.177 INFO:teuthology.orchestra.run.trial049.stdout:(23/99): python3-pycparser-2.20-6.el9.noarch.rp 1.5 MB/s | 135 kB 00:00 2026-02-17T11:02:30.191 INFO:teuthology.orchestra.run.trial157.stdout:rbd-mirror-19.2.3-705.g04cf6dd4.el9.x86_64.rpm 21 MB/s | 3.1 MB 00:00 2026-02-17T11:02:30.191 INFO:teuthology.orchestra.run.trial157.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:02:30.191 INFO:teuthology.orchestra.run.trial157.stdout:Total 21 MB/s | 3.1 MB 00:00 2026-02-17T11:02:30.191 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction check 2026-02-17T11:02:30.195 INFO:teuthology.orchestra.run.trial157.stdout:Transaction check succeeded. 2026-02-17T11:02:30.196 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction test 2026-02-17T11:02:30.197 INFO:teuthology.orchestra.run.trial049.stdout:(24/99): python3-cryptography-36.0.1-5.el9.x86_ 5.1 MB/s | 1.2 MB 00:00 2026-02-17T11:02:30.216 INFO:teuthology.orchestra.run.trial162.stdout:(99/99): python3-zc-lockfile-2.0-10.el9.noarch. 321 kB/s | 20 kB 00:00 2026-02-17T11:02:30.218 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:02:30.219 INFO:teuthology.orchestra.run.trial162.stdout:Total 26 MB/s | 95 MB 00:03 2026-02-17T11:02:30.224 INFO:teuthology.orchestra.run.trial049.stdout:(25/99): python3-pyparsing-2.4.7-9.el9.noarch.r 1.2 MB/s | 150 kB 00:00 2026-02-17T11:02:30.237 INFO:teuthology.orchestra.run.trial157.stdout:Transaction test succeeded. 2026-02-17T11:02:30.237 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction 2026-02-17T11:02:30.263 INFO:teuthology.orchestra.run.trial049.stdout:(26/99): python3-requests-2.25.1-10.el9.noarch. 1.4 MB/s | 126 kB 00:00 2026-02-17T11:02:30.283 INFO:teuthology.orchestra.run.trial049.stdout:(27/99): python3-urllib3-1.26.5-7.el9.noarch.rp 2.5 MB/s | 218 kB 00:00 2026-02-17T11:02:30.326 INFO:teuthology.orchestra.run.trial049.stdout:(28/99): flexiblas-3.0.4-9.el9.x86_64.rpm 698 kB/s | 30 kB 00:00 2026-02-17T11:02:30.350 INFO:teuthology.orchestra.run.trial049.stdout:(29/99): unzip-6.0-59.el9.x86_64.rpm 1.4 MB/s | 182 kB 00:00 2026-02-17T11:02:30.357 INFO:teuthology.orchestra.run.trial049.stdout:(30/99): zip-3.0-35.el9.x86_64.rpm 2.7 MB/s | 266 kB 00:00 2026-02-17T11:02:30.373 INFO:teuthology.orchestra.run.trial049.stdout:(31/99): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 64 MB/s | 3.0 MB 00:00 2026-02-17T11:02:30.398 INFO:teuthology.orchestra.run.trial049.stdout:(32/99): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 6.0 MB/s | 246 kB 00:00 2026-02-17T11:02:30.400 INFO:teuthology.orchestra.run.trial049.stdout:(33/99): flexiblas-openblas-openmp-3.0.4-9.el9. 299 kB/s | 15 kB 00:00 2026-02-17T11:02:30.408 INFO:teuthology.orchestra.run.trial049.stdout:(34/99): lua-5.4.4-4.el9.x86_64.rpm 5.2 MB/s | 188 kB 00:00 2026-02-17T11:02:30.435 INFO:teuthology.orchestra.run.trial049.stdout:(35/99): openblas-0.3.29-1.el9.x86_64.rpm 1.1 MB/s | 42 kB 00:00 2026-02-17T11:02:30.436 INFO:teuthology.orchestra.run.trial157.stdout: Preparing : 1/1 2026-02-17T11:02:30.438 INFO:teuthology.orchestra.run.trial157.stdout: Installing : rbd-mirror-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:30.450 INFO:teuthology.orchestra.run.trial049.stdout:(36/99): openblas-openmp-0.3.29-1.el9.x86_64.rp 107 MB/s | 5.3 MB 00:00 2026-02-17T11:02:30.452 INFO:teuthology.orchestra.run.trial049.stdout:(37/99): protobuf-3.14.0-17.el9.x86_64.rpm 23 MB/s | 1.0 MB 00:00 2026-02-17T11:02:30.461 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: rbd-mirror-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:30.462 INFO:teuthology.orchestra.run.trial157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:02:30.462 INFO:teuthology.orchestra.run.trial157.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-17T11:02:30.462 INFO:teuthology.orchestra.run.trial157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T11:02:30.462 INFO:teuthology.orchestra.run.trial157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T11:02:30.462 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:02:30.475 INFO:teuthology.orchestra.run.trial049.stdout:(38/99): python3-devel-3.9.25-2.el9.x86_64.rpm 9.9 MB/s | 244 kB 00:00 2026-02-17T11:02:30.477 INFO:teuthology.orchestra.run.trial049.stdout:(39/99): python3-jinja2-2.11.3-8.el9.noarch.rpm 9.8 MB/s | 249 kB 00:00 2026-02-17T11:02:30.490 INFO:teuthology.orchestra.run.trial049.stdout:(40/99): python3-babel-2.9.1-2.el9.noarch.rpm 110 MB/s | 6.0 MB 00:00 2026-02-17T11:02:30.499 INFO:teuthology.orchestra.run.trial049.stdout:(41/99): python3-libstoragemgmt-1.10.1-1.el9.x8 7.1 MB/s | 177 kB 00:00 2026-02-17T11:02:30.506 INFO:teuthology.orchestra.run.trial049.stdout:(42/99): python3-lxml-4.6.5-3.el9.x86_64.rpm 42 MB/s | 1.2 MB 00:00 2026-02-17T11:02:30.514 INFO:teuthology.orchestra.run.trial049.stdout:(43/99): python3-mako-1.1.4-6.el9.noarch.rpm 7.0 MB/s | 172 kB 00:00 2026-02-17T11:02:30.526 INFO:teuthology.orchestra.run.trial049.stdout:(44/99): python3-markupsafe-1.1.1-12.el9.x86_64 1.3 MB/s | 35 kB 00:00 2026-02-17T11:02:30.538 INFO:teuthology.orchestra.run.trial049.stdout:(45/99): python3-numpy-f2py-1.23.5-2.el9.x86_64 18 MB/s | 442 kB 00:00 2026-02-17T11:02:30.559 INFO:teuthology.orchestra.run.trial049.stdout:(46/99): python3-numpy-1.23.5-2.el9.x86_64.rpm 116 MB/s | 6.1 MB 00:00 2026-02-17T11:02:30.560 INFO:teuthology.orchestra.run.trial049.stdout:(47/99): python3-packaging-20.9-5.el9.noarch.rp 2.3 MB/s | 77 kB 00:00 2026-02-17T11:02:30.565 INFO:teuthology.orchestra.run.trial049.stdout:(48/99): python3-protobuf-3.14.0-17.el9.noarch. 9.7 MB/s | 267 kB 00:00 2026-02-17T11:02:30.585 INFO:teuthology.orchestra.run.trial049.stdout:(49/99): python3-pyasn1-modules-0.4.8-6.el9.noa 11 MB/s | 279 kB 00:00 2026-02-17T11:02:30.586 INFO:teuthology.orchestra.run.trial049.stdout:(50/99): python3-pyasn1-0.4.8-6.el9.noarch.rpm 5.8 MB/s | 159 kB 00:00 2026-02-17T11:02:30.586 INFO:teuthology.orchestra.run.trial049.stdout:(51/99): python3-requests-oauthlib-1.3.0-12.el9 2.4 MB/s | 54 kB 00:00 2026-02-17T11:02:30.611 INFO:teuthology.orchestra.run.trial049.stdout:(52/99): python3-toml-0.10.2-6.el9.noarch.rpm 1.7 MB/s | 42 kB 00:00 2026-02-17T11:02:30.615 INFO:teuthology.orchestra.run.trial049.stdout:(53/99): xmlsec1-1.2.29-13.el9.x86_64.rpm 6.4 MB/s | 189 kB 00:00 2026-02-17T11:02:30.635 INFO:teuthology.orchestra.run.trial049.stdout:(54/99): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 3.7 MB/s | 90 kB 00:00 2026-02-17T11:02:30.638 INFO:teuthology.orchestra.run.trial049.stdout:(55/99): lua-devel-5.4.4-4.el9.x86_64.rpm 983 kB/s | 22 kB 00:00 2026-02-17T11:02:30.658 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-17T11:02:30.663 INFO:teuthology.orchestra.run.trial049.stdout:(56/99): protobuf-compiler-3.14.0-17.el9.x86_64 31 MB/s | 862 kB 00:00 2026-02-17T11:02:30.694 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-17T11:02:30.694 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-17T11:02:30.710 INFO:teuthology.orchestra.run.trial049.stdout:(57/99): python3-scipy-1.9.3-2.el9.x86_64.rpm 155 MB/s | 19 MB 00:00 2026-02-17T11:02:30.710 INFO:teuthology.orchestra.run.trial049.stdout:(58/99): grpc-data-1.46.7-10.el9.noarch.rpm 412 kB/s | 19 kB 00:00 2026-02-17T11:02:30.730 INFO:teuthology.orchestra.run.trial049.stdout:(59/99): abseil-cpp-20211102.0-4.el9.x86_64.rpm 5.9 MB/s | 551 kB 00:00 2026-02-17T11:02:30.740 INFO:teuthology.orchestra.run.trial049.stdout:(60/99): python3-autocommand-2.2.2-8.el9.noarch 2.9 MB/s | 29 kB 00:00 2026-02-17T11:02:30.744 INFO:teuthology.orchestra.run.trial049.stdout:(61/99): luarocks-3.9.2-5.el9.noarch.rpm 4.3 MB/s | 151 kB 00:00 2026-02-17T11:02:30.750 INFO:teuthology.orchestra.run.trial049.stdout:(62/99): python3-backports-tarfile-1.2.0-1.el9. 5.8 MB/s | 60 kB 00:00 2026-02-17T11:02:30.755 INFO:teuthology.orchestra.run.trial049.stdout:(63/99): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 3.8 MB/s | 43 kB 00:00 2026-02-17T11:02:30.760 INFO:teuthology.orchestra.run.trial049.stdout:(64/99): python3-cachetools-4.2.4-1.el9.noarch. 3.2 MB/s | 32 kB 00:00 2026-02-17T11:02:30.765 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : rbd-mirror-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:30.765 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:02:30.766 INFO:teuthology.orchestra.run.trial157.stdout:Installed: 2026-02-17T11:02:30.766 INFO:teuthology.orchestra.run.trial157.stdout: rbd-mirror-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:30.766 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:02:30.766 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-17T11:02:30.766 INFO:teuthology.orchestra.run.trial049.stdout:(65/99): python3-certifi-2023.05.07-4.el9.noarc 1.3 MB/s | 14 kB 00:00 2026-02-17T11:02:30.771 INFO:teuthology.orchestra.run.trial049.stdout:(66/99): python3-cheroot-10.0.1-4.el9.noarch.rp 16 MB/s | 173 kB 00:00 2026-02-17T11:02:30.776 INFO:teuthology.orchestra.run.trial049.stdout:(67/99): python3-asyncssh-2.13.2-5.el9.noarch.r 8.2 MB/s | 548 kB 00:00 2026-02-17T11:02:30.784 INFO:teuthology.orchestra.run.trial049.stdout:(68/99): python3-google-auth-2.45.0-1.el9.noarc 20 MB/s | 254 kB 00:00 2026-02-17T11:02:30.790 INFO:teuthology.orchestra.run.trial049.stdout:(69/99): python3-cherrypy-18.6.1-2.el9.noarch.r 15 MB/s | 358 kB 00:00 2026-02-17T11:02:30.793 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install rbd-nbd 2026-02-17T11:02:30.796 INFO:teuthology.orchestra.run.trial049.stdout:(70/99): python3-grpcio-tools-1.46.7-10.el9.x86 11 MB/s | 144 kB 00:00 2026-02-17T11:02:30.803 INFO:teuthology.orchestra.run.trial049.stdout:(71/99): python3-influxdb-5.3.1-1.el9.noarch.rp 11 MB/s | 139 kB 00:00 2026-02-17T11:02:30.807 INFO:teuthology.orchestra.run.trial049.stdout:(72/99): python3-isodate-0.6.1-3.el9.noarch.rpm 5.3 MB/s | 56 kB 00:00 2026-02-17T11:02:30.810 INFO:teuthology.orchestra.run.trial049.stdout:(73/99): python3-grpcio-1.46.7-10.el9.x86_64.rp 60 MB/s | 2.0 MB 00:00 2026-02-17T11:02:30.813 INFO:teuthology.orchestra.run.trial049.stdout:(74/99): python3-jaraco-8.2.1-3.el9.noarch.rpm 1.0 MB/s | 11 kB 00:00 2026-02-17T11:02:30.816 INFO:teuthology.orchestra.run.trial049.stdout:(75/99): python3-jaraco-classes-3.2.1-5.el9.noa 1.8 MB/s | 18 kB 00:00 2026-02-17T11:02:30.820 INFO:teuthology.orchestra.run.trial049.stdout:(76/99): python3-jaraco-collections-3.0.0-8.el9 2.3 MB/s | 23 kB 00:00 2026-02-17T11:02:30.824 INFO:teuthology.orchestra.run.trial049.stdout:(77/99): python3-jaraco-context-6.0.1-3.el9.noa 1.8 MB/s | 20 kB 00:00 2026-02-17T11:02:30.826 INFO:teuthology.orchestra.run.trial049.stdout:(78/99): python3-jaraco-functools-3.5.0-2.el9.n 2.0 MB/s | 19 kB 00:00 2026-02-17T11:02:30.830 INFO:teuthology.orchestra.run.trial049.stdout:(79/99): python3-jaraco-text-4.0.0-2.el9.noarch 2.7 MB/s | 26 kB 00:00 2026-02-17T11:02:30.836 INFO:teuthology.orchestra.run.trial049.stdout:(80/99): python3-logutils-0.3.5-21.el9.noarch.r 4.4 MB/s | 46 kB 00:00 2026-02-17T11:02:30.843 INFO:teuthology.orchestra.run.trial049.stdout:(81/99): python3-more-itertools-8.12.0-2.el9.no 6.2 MB/s | 79 kB 00:00 2026-02-17T11:02:30.848 INFO:teuthology.orchestra.run.trial049.stdout:(82/99): python3-msgpack-1.0.3-2.el9.x86_64.rpm 7.8 MB/s | 86 kB 00:00 2026-02-17T11:02:30.853 INFO:teuthology.orchestra.run.trial049.stdout:(83/99): python3-natsort-7.1.1-5.el9.noarch.rpm 5.6 MB/s | 58 kB 00:00 2026-02-17T11:02:30.855 INFO:teuthology.orchestra.run.trial049.stdout:(84/99): python3-kubernetes-26.1.0-3.el9.noarch 33 MB/s | 1.0 MB 00:00 2026-02-17T11:02:30.861 INFO:teuthology.orchestra.run.trial049.stdout:(85/99): python3-pecan-1.4.2-3.el9.noarch.rpm 21 MB/s | 272 kB 00:00 2026-02-17T11:02:30.863 INFO:teuthology.orchestra.run.trial049.stdout:(86/99): python3-portend-3.1.0-2.el9.noarch.rpm 1.7 MB/s | 16 kB 00:00 2026-02-17T11:02:30.867 INFO:teuthology.orchestra.run.trial049.stdout:(87/99): python3-pyOpenSSL-21.0.0-1.el9.noarch. 7.6 MB/s | 90 kB 00:00 2026-02-17T11:02:30.871 INFO:teuthology.orchestra.run.trial049.stdout:(88/99): python3-repoze-lru-0.7-16.el9.noarch.r 3.0 MB/s | 31 kB 00:00 2026-02-17T11:02:30.876 INFO:teuthology.orchestra.run.trial049.stdout:(89/99): python3-routes-2.5.1-5.el9.noarch.rpm 14 MB/s | 188 kB 00:00 2026-02-17T11:02:30.878 INFO:teuthology.orchestra.run.trial049.stdout:(90/99): python3-rsa-4.9-2.el9.noarch.rpm 5.2 MB/s | 59 kB 00:00 2026-02-17T11:02:30.882 INFO:teuthology.orchestra.run.trial049.stdout:(91/99): python3-saml-1.16.0-1.el9.noarch.rpm 11 MB/s | 125 kB 00:00 2026-02-17T11:02:30.886 INFO:teuthology.orchestra.run.trial049.stdout:(92/99): python3-tempora-5.0.0-2.el9.noarch.rpm 3.5 MB/s | 36 kB 00:00 2026-02-17T11:02:30.890 INFO:teuthology.orchestra.run.trial049.stdout:(93/99): python3-typing-extensions-4.15.0-1.el9 7.3 MB/s | 86 kB 00:00 2026-02-17T11:02:30.894 INFO:teuthology.orchestra.run.trial049.stdout:(94/99): python3-webob-1.8.8-2.el9.noarch.rpm 19 MB/s | 230 kB 00:00 2026-02-17T11:02:30.897 INFO:teuthology.orchestra.run.trial049.stdout:(95/99): python3-websocket-client-1.2.3-2.el9.n 8.1 MB/s | 90 kB 00:00 2026-02-17T11:02:30.903 INFO:teuthology.orchestra.run.trial049.stdout:(96/99): python3-werkzeug-2.0.3-3.el9.1.noarch. 31 MB/s | 427 kB 00:00 2026-02-17T11:02:30.904 INFO:teuthology.orchestra.run.trial049.stdout:(97/99): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 4.7 MB/s | 48 kB 00:00 2026-02-17T11:02:30.907 INFO:teuthology.orchestra.run.trial049.stdout:(98/99): python3-xmltodict-0.12.0-15.el9.noarch 2.1 MB/s | 22 kB 00:00 2026-02-17T11:02:30.915 INFO:teuthology.orchestra.run.trial049.stdout:(99/99): python3-zc-lockfile-2.0-10.el9.noarch. 1.6 MB/s | 20 kB 00:00 2026-02-17T11:02:30.917 INFO:teuthology.orchestra.run.trial049.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:02:30.917 INFO:teuthology.orchestra.run.trial049.stdout:Total 33 MB/s | 95 MB 00:02 2026-02-17T11:02:31.105 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:00:46 ago on Tue 17 Feb 2026 11:01:45 AM UTC. 2026-02-17T11:02:31.113 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-17T11:02:31.113 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-17T11:02:31.189 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-17T11:02:31.190 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:02:31.190 INFO:teuthology.orchestra.run.trial157.stdout: Package Architecture Version Repository Size 2026-02-17T11:02:31.190 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:02:31.190 INFO:teuthology.orchestra.run.trial157.stdout:Installing: 2026-02-17T11:02:31.190 INFO:teuthology.orchestra.run.trial157.stdout: rbd-nbd x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 171 k 2026-02-17T11:02:31.190 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:02:31.190 INFO:teuthology.orchestra.run.trial157.stdout:Transaction Summary 2026-02-17T11:02:31.190 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:02:31.190 INFO:teuthology.orchestra.run.trial157.stdout:Install 1 Package 2026-02-17T11:02:31.191 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:02:31.191 INFO:teuthology.orchestra.run.trial157.stdout:Total download size: 171 k 2026-02-17T11:02:31.191 INFO:teuthology.orchestra.run.trial157.stdout:Installed size: 490 k 2026-02-17T11:02:31.191 INFO:teuthology.orchestra.run.trial157.stdout:Downloading Packages: 2026-02-17T11:02:31.276 INFO:teuthology.orchestra.run.trial157.stdout:rbd-nbd-19.2.3-705.g04cf6dd4.el9.x86_64.rpm 1.9 MB/s | 171 kB 00:00 2026-02-17T11:02:31.277 INFO:teuthology.orchestra.run.trial157.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:02:31.277 INFO:teuthology.orchestra.run.trial157.stdout:Total 1.9 MB/s | 171 kB 00:00 2026-02-17T11:02:31.277 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction check 2026-02-17T11:02:31.281 INFO:teuthology.orchestra.run.trial157.stdout:Transaction check succeeded. 2026-02-17T11:02:31.281 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction test 2026-02-17T11:02:31.312 INFO:teuthology.orchestra.run.trial157.stdout:Transaction test succeeded. 2026-02-17T11:02:31.312 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction 2026-02-17T11:02:31.332 INFO:teuthology.orchestra.run.trial097.stdout: Installing : ceph-debugsource-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/3 2026-02-17T11:02:31.358 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction check 2026-02-17T11:02:31.368 INFO:teuthology.orchestra.run.trial157.stdout: Preparing : 1/1 2026-02-17T11:02:31.385 INFO:teuthology.orchestra.run.trial157.stdout: Installing : rbd-nbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:31.396 INFO:teuthology.orchestra.run.trial049.stdout:Transaction check succeeded. 2026-02-17T11:02:31.396 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction test 2026-02-17T11:02:31.469 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: rbd-nbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:31.526 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : rbd-nbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:31.526 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:02:31.526 INFO:teuthology.orchestra.run.trial157.stdout:Installed: 2026-02-17T11:02:31.526 INFO:teuthology.orchestra.run.trial157.stdout: rbd-nbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:31.526 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:02:31.526 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-17T11:02:31.554 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install ceph-base-debuginfo 2026-02-17T11:02:31.558 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-17T11:02:31.561 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/99 2026-02-17T11:02:31.593 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/99 2026-02-17T11:02:31.598 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 3/99 2026-02-17T11:02:31.619 INFO:teuthology.orchestra.run.trial162.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 4/99 2026-02-17T11:02:31.625 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 5/99 2026-02-17T11:02:31.658 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 6/99 2026-02-17T11:02:31.668 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 7/99 2026-02-17T11:02:31.673 INFO:teuthology.orchestra.run.trial162.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 8/99 2026-02-17T11:02:31.675 INFO:teuthology.orchestra.run.trial162.stdout: Installing : lua-5.4.4-4.el9.x86_64 9/99 2026-02-17T11:02:31.680 INFO:teuthology.orchestra.run.trial162.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 10/99 2026-02-17T11:02:31.703 INFO:teuthology.orchestra.run.trial162.stdout: Installing : unzip-6.0-59.el9.x86_64 11/99 2026-02-17T11:02:31.715 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 12/99 2026-02-17T11:02:31.719 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 13/99 2026-02-17T11:02:31.725 INFO:teuthology.orchestra.run.trial162.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 14/99 2026-02-17T11:02:31.727 INFO:teuthology.orchestra.run.trial162.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 15/99 2026-02-17T11:02:31.738 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 16/99 2026-02-17T11:02:31.744 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 17/99 2026-02-17T11:02:31.768 INFO:teuthology.orchestra.run.trial162.stdout: Installing : zip-3.0-35.el9.x86_64 18/99 2026-02-17T11:02:31.771 INFO:teuthology.orchestra.run.trial162.stdout: Installing : luarocks-3.9.2-5.el9.noarch 19/99 2026-02-17T11:02:31.778 INFO:teuthology.orchestra.run.trial162.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 20/99 2026-02-17T11:02:31.803 INFO:teuthology.orchestra.run.trial162.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 21/99 2026-02-17T11:02:31.813 INFO:teuthology.orchestra.run.trial049.stdout:Transaction test succeeded. 2026-02-17T11:02:31.814 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction 2026-02-17T11:02:31.855 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 22/99 2026-02-17T11:02:31.868 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 23/99 2026-02-17T11:02:31.870 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-rsa-4.9-2.el9.noarch 24/99 2026-02-17T11:02:31.874 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:00:46 ago on Tue 17 Feb 2026 11:01:45 AM UTC. 2026-02-17T11:02:31.875 INFO:teuthology.orchestra.run.trial162.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 25/99 2026-02-17T11:02:31.880 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 26/99 2026-02-17T11:02:31.884 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 27/99 2026-02-17T11:02:31.888 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 28/99 2026-02-17T11:02:31.902 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 29/99 2026-02-17T11:02:31.923 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 30/99 2026-02-17T11:02:31.928 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 31/99 2026-02-17T11:02:31.933 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 32/99 2026-02-17T11:02:31.944 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 33/99 2026-02-17T11:02:31.953 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 34/99 2026-02-17T11:02:31.957 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-17T11:02:31.957 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:02:31.958 INFO:teuthology.orchestra.run.trial157.stdout: Package Arch Version Repo Size 2026-02-17T11:02:31.958 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:02:31.958 INFO:teuthology.orchestra.run.trial157.stdout:Installing: 2026-02-17T11:02:31.958 INFO:teuthology.orchestra.run.trial157.stdout: ceph-base-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 72 M 2026-02-17T11:02:31.958 INFO:teuthology.orchestra.run.trial157.stdout:Installing dependencies: 2026-02-17T11:02:31.958 INFO:teuthology.orchestra.run.trial157.stdout: ceph-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 24 M 2026-02-17T11:02:31.958 INFO:teuthology.orchestra.run.trial157.stdout:Installing weak dependencies: 2026-02-17T11:02:31.958 INFO:teuthology.orchestra.run.trial157.stdout: ceph-debugsource x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 11 M 2026-02-17T11:02:31.958 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:02:31.959 INFO:teuthology.orchestra.run.trial157.stdout:Transaction Summary 2026-02-17T11:02:31.959 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:02:31.959 INFO:teuthology.orchestra.run.trial157.stdout:Install 3 Packages 2026-02-17T11:02:31.959 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:02:31.959 INFO:teuthology.orchestra.run.trial157.stdout:Total download size: 107 M 2026-02-17T11:02:31.959 INFO:teuthology.orchestra.run.trial157.stdout:Installed size: 654 M 2026-02-17T11:02:31.959 INFO:teuthology.orchestra.run.trial157.stdout:Downloading Packages: 2026-02-17T11:02:31.960 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 35/99 2026-02-17T11:02:31.979 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 36/99 2026-02-17T11:02:31.988 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 37/99 2026-02-17T11:02:32.043 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 38/99 2026-02-17T11:02:32.055 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 39/99 2026-02-17T11:02:32.071 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 40/99 2026-02-17T11:02:32.075 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 41/99 2026-02-17T11:02:32.083 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 42/99 2026-02-17T11:02:32.123 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 43/99 2026-02-17T11:02:32.257 INFO:teuthology.orchestra.run.trial049.stdout: Preparing : 1/1 2026-02-17T11:02:32.259 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/99 2026-02-17T11:02:32.290 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/99 2026-02-17T11:02:32.295 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 3/99 2026-02-17T11:02:32.316 INFO:teuthology.orchestra.run.trial049.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 4/99 2026-02-17T11:02:32.322 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 5/99 2026-02-17T11:02:32.356 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 6/99 2026-02-17T11:02:32.365 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 7/99 2026-02-17T11:02:32.370 INFO:teuthology.orchestra.run.trial049.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 8/99 2026-02-17T11:02:32.373 INFO:teuthology.orchestra.run.trial049.stdout: Installing : lua-5.4.4-4.el9.x86_64 9/99 2026-02-17T11:02:32.377 INFO:teuthology.orchestra.run.trial049.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 10/99 2026-02-17T11:02:32.400 INFO:teuthology.orchestra.run.trial049.stdout: Installing : unzip-6.0-59.el9.x86_64 11/99 2026-02-17T11:02:32.413 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 12/99 2026-02-17T11:02:32.416 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 13/99 2026-02-17T11:02:32.422 INFO:teuthology.orchestra.run.trial049.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 14/99 2026-02-17T11:02:32.424 INFO:teuthology.orchestra.run.trial049.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 15/99 2026-02-17T11:02:32.435 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 16/99 2026-02-17T11:02:32.441 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 17/99 2026-02-17T11:02:32.451 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 44/99 2026-02-17T11:02:32.461 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 45/99 2026-02-17T11:02:32.465 INFO:teuthology.orchestra.run.trial049.stdout: Installing : zip-3.0-35.el9.x86_64 18/99 2026-02-17T11:02:32.465 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 46/99 2026-02-17T11:02:32.468 INFO:teuthology.orchestra.run.trial049.stdout: Installing : luarocks-3.9.2-5.el9.noarch 19/99 2026-02-17T11:02:32.471 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 47/99 2026-02-17T11:02:32.473 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 48/99 2026-02-17T11:02:32.475 INFO:teuthology.orchestra.run.trial049.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 20/99 2026-02-17T11:02:32.499 INFO:teuthology.orchestra.run.trial049.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 21/99 2026-02-17T11:02:32.501 INFO:teuthology.orchestra.run.trial162.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 49/99 2026-02-17T11:02:32.544 INFO:teuthology.orchestra.run.trial162.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 50/99 2026-02-17T11:02:32.550 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 22/99 2026-02-17T11:02:32.551 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 51/99 2026-02-17T11:02:32.554 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 52/99 2026-02-17T11:02:32.560 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 53/99 2026-02-17T11:02:32.563 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 23/99 2026-02-17T11:02:32.564 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 54/99 2026-02-17T11:02:32.565 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-rsa-4.9-2.el9.noarch 24/99 2026-02-17T11:02:32.572 INFO:teuthology.orchestra.run.trial049.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 25/99 2026-02-17T11:02:32.574 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 55/99 2026-02-17T11:02:32.577 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 26/99 2026-02-17T11:02:32.577 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 56/99 2026-02-17T11:02:32.582 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 27/99 2026-02-17T11:02:32.585 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 28/99 2026-02-17T11:02:32.599 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 29/99 2026-02-17T11:02:32.605 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 57/99 2026-02-17T11:02:32.615 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 58/99 2026-02-17T11:02:32.620 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 30/99 2026-02-17T11:02:32.625 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 31/99 2026-02-17T11:02:32.630 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 32/99 2026-02-17T11:02:32.641 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 33/99 2026-02-17T11:02:32.650 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 59/99 2026-02-17T11:02:32.650 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 34/99 2026-02-17T11:02:32.656 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 35/99 2026-02-17T11:02:32.675 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 36/99 2026-02-17T11:02:32.684 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 37/99 2026-02-17T11:02:32.685 INFO:teuthology.orchestra.run.trial157.stdout:(1/3): ceph-debugsource-19.2.3-705.g04cf6dd4.el 15 MB/s | 11 MB 00:00 2026-02-17T11:02:32.738 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 38/99 2026-02-17T11:02:32.750 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 39/99 2026-02-17T11:02:32.766 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 40/99 2026-02-17T11:02:32.770 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 41/99 2026-02-17T11:02:32.778 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 42/99 2026-02-17T11:02:32.818 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 43/99 2026-02-17T11:02:32.873 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 60/99 2026-02-17T11:02:32.897 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 61/99 2026-02-17T11:02:32.900 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 62/99 2026-02-17T11:02:32.959 INFO:teuthology.orchestra.run.trial162.stdout: Installing : openblas-0.3.29-1.el9.x86_64 63/99 2026-02-17T11:02:32.960 INFO:teuthology.orchestra.run.trial162.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 64/99 2026-02-17T11:02:32.982 INFO:teuthology.orchestra.run.trial162.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 65/99 2026-02-17T11:02:33.141 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 44/99 2026-02-17T11:02:33.151 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 45/99 2026-02-17T11:02:33.155 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 46/99 2026-02-17T11:02:33.161 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 47/99 2026-02-17T11:02:33.163 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 48/99 2026-02-17T11:02:33.190 INFO:teuthology.orchestra.run.trial049.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 49/99 2026-02-17T11:02:33.207 INFO:teuthology.orchestra.run.trial157.stdout:(2/3): ceph-debuginfo-19.2.3-705.g04cf6dd4.el9. 20 MB/s | 24 MB 00:01 2026-02-17T11:02:33.234 INFO:teuthology.orchestra.run.trial049.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 50/99 2026-02-17T11:02:33.240 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 51/99 2026-02-17T11:02:33.244 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 52/99 2026-02-17T11:02:33.249 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 53/99 2026-02-17T11:02:33.253 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 54/99 2026-02-17T11:02:33.260 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 55/99 2026-02-17T11:02:33.264 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 56/99 2026-02-17T11:02:33.291 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 57/99 2026-02-17T11:02:33.301 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 58/99 2026-02-17T11:02:33.305 INFO:teuthology.orchestra.run.trial162.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 66/99 2026-02-17T11:02:33.336 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 59/99 2026-02-17T11:02:33.378 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 67/99 2026-02-17T11:02:33.559 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 60/99 2026-02-17T11:02:33.583 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 61/99 2026-02-17T11:02:33.587 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 62/99 2026-02-17T11:02:33.646 INFO:teuthology.orchestra.run.trial049.stdout: Installing : openblas-0.3.29-1.el9.x86_64 63/99 2026-02-17T11:02:33.647 INFO:teuthology.orchestra.run.trial049.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 64/99 2026-02-17T11:02:33.669 INFO:teuthology.orchestra.run.trial049.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 65/99 2026-02-17T11:02:33.994 INFO:teuthology.orchestra.run.trial049.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 66/99 2026-02-17T11:02:34.047 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 68/99 2026-02-17T11:02:34.064 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 69/99 2026-02-17T11:02:34.066 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 67/99 2026-02-17T11:02:34.074 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 70/99 2026-02-17T11:02:34.081 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-packaging-20.9-5.el9.noarch 71/99 2026-02-17T11:02:34.094 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-ply-3.11-14.el9.noarch 72/99 2026-02-17T11:02:34.110 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 73/99 2026-02-17T11:02:34.185 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 74/99 2026-02-17T11:02:34.193 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 75/99 2026-02-17T11:02:34.217 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 76/99 2026-02-17T11:02:34.246 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 77/99 2026-02-17T11:02:34.297 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 78/99 2026-02-17T11:02:34.303 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 79/99 2026-02-17T11:02:34.306 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 80/99 2026-02-17T11:02:34.307 INFO:teuthology.orchestra.run.trial162.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 81/99 2026-02-17T11:02:34.326 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T11:02:34.326 INFO:teuthology.orchestra.run.trial162.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-17T11:02:34.326 INFO:teuthology.orchestra.run.trial162.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-17T11:02:34.326 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:02:34.335 INFO:teuthology.orchestra.run.trial162.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T11:02:34.362 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T11:02:34.362 INFO:teuthology.orchestra.run.trial162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-17T11:02:34.362 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:02:34.398 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 83/99 2026-02-17T11:02:34.463 INFO:teuthology.orchestra.run.trial162.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 84/99 2026-02-17T11:02:34.465 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-volume-2:19.2.3-705.g04cf6dd4.el9.noarch 85/99 2026-02-17T11:02:34.480 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-volume-2:19.2.3-705.g04cf6dd4.el9.noarch 85/99 2026-02-17T11:02:34.480 INFO:teuthology.orchestra.run.trial162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:02:34.480 INFO:teuthology.orchestra.run.trial162.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-17T11:02:34.480 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:02:34.743 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 68/99 2026-02-17T11:02:34.761 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 69/99 2026-02-17T11:02:34.771 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 70/99 2026-02-17T11:02:34.777 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-packaging-20.9-5.el9.noarch 71/99 2026-02-17T11:02:34.791 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-ply-3.11-14.el9.noarch 72/99 2026-02-17T11:02:34.807 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 73/99 2026-02-17T11:02:34.882 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 74/99 2026-02-17T11:02:34.891 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 75/99 2026-02-17T11:02:34.914 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 76/99 2026-02-17T11:02:34.943 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 77/99 2026-02-17T11:02:34.994 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 78/99 2026-02-17T11:02:35.000 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 79/99 2026-02-17T11:02:35.003 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 80/99 2026-02-17T11:02:35.005 INFO:teuthology.orchestra.run.trial049.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 81/99 2026-02-17T11:02:35.005 INFO:teuthology.orchestra.run.trial097.stdout: Installing : ceph-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2/3 2026-02-17T11:02:35.023 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T11:02:35.023 INFO:teuthology.orchestra.run.trial049.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-17T11:02:35.023 INFO:teuthology.orchestra.run.trial049.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-17T11:02:35.023 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:02:35.024 INFO:teuthology.orchestra.run.trial097.stdout: Installing : ceph-base-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_6 3/3 2026-02-17T11:02:35.031 INFO:teuthology.orchestra.run.trial049.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T11:02:35.055 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T11:02:35.055 INFO:teuthology.orchestra.run.trial049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-17T11:02:35.055 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:02:35.091 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 83/99 2026-02-17T11:02:35.135 INFO:teuthology.orchestra.run.trial157.stdout:(3/3): ceph-base-debuginfo-19.2.3-705.g04cf6dd4 23 MB/s | 72 MB 00:03 2026-02-17T11:02:35.137 INFO:teuthology.orchestra.run.trial157.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:02:35.138 INFO:teuthology.orchestra.run.trial157.stdout:Total 34 MB/s | 107 MB 00:03 2026-02-17T11:02:35.138 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction check 2026-02-17T11:02:35.143 INFO:teuthology.orchestra.run.trial157.stdout:Transaction check succeeded. 2026-02-17T11:02:35.143 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction test 2026-02-17T11:02:35.155 INFO:teuthology.orchestra.run.trial049.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 84/99 2026-02-17T11:02:35.157 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-volume-2:19.2.3-705.g04cf6dd4.el9.noarch 85/99 2026-02-17T11:02:35.172 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-volume-2:19.2.3-705.g04cf6dd4.el9.noarch 85/99 2026-02-17T11:02:35.172 INFO:teuthology.orchestra.run.trial049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:02:35.172 INFO:teuthology.orchestra.run.trial049.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-17T11:02:35.172 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:02:35.190 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-osd-2:19.2.3-705.g04cf6dd4.el9.x86_64 86/99 2026-02-17T11:02:35.216 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-osd-2:19.2.3-705.g04cf6dd4.el9.x86_64 86/99 2026-02-17T11:02:35.216 INFO:teuthology.orchestra.run.trial162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:02:35.216 INFO:teuthology.orchestra.run.trial162.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-17T11:02:35.216 INFO:teuthology.orchestra.run.trial162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T11:02:35.216 INFO:teuthology.orchestra.run.trial162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T11:02:35.216 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:02:35.273 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 87/99 2026-02-17T11:02:35.276 INFO:teuthology.orchestra.run.trial162.stdout: Installing : cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 87/99 2026-02-17T11:02:35.281 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-705.g04cf6dd4.el9. 88/99 2026-02-17T11:02:35.301 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-705.g04cf6dd4.el9 89/99 2026-02-17T11:02:35.302 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 90/99 2026-02-17T11:02:35.524 INFO:teuthology.orchestra.run.trial157.stdout:Transaction test succeeded. 2026-02-17T11:02:35.524 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction 2026-02-17T11:02:35.572 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: ceph-base-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_6 3/3 2026-02-17T11:02:35.572 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : ceph-base-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_6 1/3 2026-02-17T11:02:35.572 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : ceph-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2/3 2026-02-17T11:02:35.630 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : ceph-debugsource-2:19.2.3-705.g04cf6dd4.el9.x86_64 3/3 2026-02-17T11:02:35.630 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:02:35.630 INFO:teuthology.orchestra.run.trial097.stdout:Installed: 2026-02-17T11:02:35.630 INFO:teuthology.orchestra.run.trial097.stdout: ceph-base-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:35.630 INFO:teuthology.orchestra.run.trial097.stdout: ceph-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:35.630 INFO:teuthology.orchestra.run.trial097.stdout: ceph-debugsource-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:35.630 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:02:35.630 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-17T11:02:35.672 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install ceph-common-debuginfo 2026-02-17T11:02:35.797 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 90/99 2026-02-17T11:02:35.801 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-705.g04cf6dd4.el9.noar 91/99 2026-02-17T11:02:35.868 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-osd-2:19.2.3-705.g04cf6dd4.el9.x86_64 86/99 2026-02-17T11:02:35.893 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-osd-2:19.2.3-705.g04cf6dd4.el9.x86_64 86/99 2026-02-17T11:02:35.893 INFO:teuthology.orchestra.run.trial049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:02:35.893 INFO:teuthology.orchestra.run.trial049.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-17T11:02:35.893 INFO:teuthology.orchestra.run.trial049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T11:02:35.893 INFO:teuthology.orchestra.run.trial049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T11:02:35.893 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:02:35.950 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 87/99 2026-02-17T11:02:35.951 INFO:teuthology.orchestra.run.trial049.stdout: Installing : cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 87/99 2026-02-17T11:02:35.956 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-705.g04cf6dd4.el9. 88/99 2026-02-17T11:02:35.976 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-705.g04cf6dd4.el9 89/99 2026-02-17T11:02:35.977 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 90/99 2026-02-17T11:02:35.987 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:00:53 ago on Tue 17 Feb 2026 11:01:42 AM UTC. 2026-02-17T11:02:36.069 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-17T11:02:36.069 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:02:36.069 INFO:teuthology.orchestra.run.trial097.stdout: Package Arch Version Repo Size 2026-02-17T11:02:36.069 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:02:36.069 INFO:teuthology.orchestra.run.trial097.stdout:Installing: 2026-02-17T11:02:36.069 INFO:teuthology.orchestra.run.trial097.stdout: ceph-common-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 474 M 2026-02-17T11:02:36.069 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:02:36.069 INFO:teuthology.orchestra.run.trial097.stdout:Transaction Summary 2026-02-17T11:02:36.070 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:02:36.070 INFO:teuthology.orchestra.run.trial097.stdout:Install 1 Package 2026-02-17T11:02:36.070 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:02:36.070 INFO:teuthology.orchestra.run.trial097.stdout:Total download size: 474 M 2026-02-17T11:02:36.070 INFO:teuthology.orchestra.run.trial097.stdout:Installed size: 2.0 G 2026-02-17T11:02:36.070 INFO:teuthology.orchestra.run.trial097.stdout:Downloading Packages: 2026-02-17T11:02:36.258 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-705.g04cf6dd4.el9.noar 91/99 2026-02-17T11:02:36.259 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-705.g04cf6d 92/99 2026-02-17T11:02:36.271 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-705.g04cf6d 92/99 2026-02-17T11:02:36.272 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-705.g04cf6dd4.el9.noar 93/99 2026-02-17T11:02:36.328 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-705.g04cf6dd4.el9.noar 93/99 2026-02-17T11:02:36.380 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-705.g04cf6dd4.el9.n 94/99 2026-02-17T11:02:36.381 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-mgr-2:19.2.3-705.g04cf6dd4.el9.x86_64 95/99 2026-02-17T11:02:36.403 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-mgr-2:19.2.3-705.g04cf6dd4.el9.x86_64 95/99 2026-02-17T11:02:36.403 INFO:teuthology.orchestra.run.trial162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:02:36.403 INFO:teuthology.orchestra.run.trial162.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-17T11:02:36.403 INFO:teuthology.orchestra.run.trial162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T11:02:36.403 INFO:teuthology.orchestra.run.trial162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T11:02:36.403 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:02:36.415 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-mgr-rook-2:19.2.3-705.g04cf6dd4.el9.noarch 96/99 2026-02-17T11:02:36.469 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 90/99 2026-02-17T11:02:36.472 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-705.g04cf6dd4.el9.noar 91/99 2026-02-17T11:02:36.637 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-705.g04cf6dd4.el9.noarch 96/99 2026-02-17T11:02:36.639 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-mon-2:19.2.3-705.g04cf6dd4.el9.x86_64 97/99 2026-02-17T11:02:36.661 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-mon-2:19.2.3-705.g04cf6dd4.el9.x86_64 97/99 2026-02-17T11:02:36.661 INFO:teuthology.orchestra.run.trial162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:02:36.661 INFO:teuthology.orchestra.run.trial162.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-17T11:02:36.661 INFO:teuthology.orchestra.run.trial162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T11:02:36.661 INFO:teuthology.orchestra.run.trial162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T11:02:36.661 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:02:36.766 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-mds-2:19.2.3-705.g04cf6dd4.el9.x86_64 98/99 2026-02-17T11:02:36.788 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-mds-2:19.2.3-705.g04cf6dd4.el9.x86_64 98/99 2026-02-17T11:02:36.788 INFO:teuthology.orchestra.run.trial162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:02:36.788 INFO:teuthology.orchestra.run.trial162.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-17T11:02:36.788 INFO:teuthology.orchestra.run.trial162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T11:02:36.788 INFO:teuthology.orchestra.run.trial162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T11:02:36.788 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:02:36.806 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-2:19.2.3-705.g04cf6dd4.el9.x86_64 99/99 2026-02-17T11:02:36.923 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-705.g04cf6dd4.el9.noar 91/99 2026-02-17T11:02:36.923 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-705.g04cf6d 92/99 2026-02-17T11:02:36.935 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-705.g04cf6d 92/99 2026-02-17T11:02:36.936 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-705.g04cf6dd4.el9.noar 93/99 2026-02-17T11:02:36.990 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-705.g04cf6dd4.el9.noar 93/99 2026-02-17T11:02:37.039 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-705.g04cf6dd4.el9.n 94/99 2026-02-17T11:02:37.040 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-mgr-2:19.2.3-705.g04cf6dd4.el9.x86_64 95/99 2026-02-17T11:02:37.062 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-mgr-2:19.2.3-705.g04cf6dd4.el9.x86_64 95/99 2026-02-17T11:02:37.062 INFO:teuthology.orchestra.run.trial049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:02:37.062 INFO:teuthology.orchestra.run.trial049.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-17T11:02:37.062 INFO:teuthology.orchestra.run.trial049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T11:02:37.062 INFO:teuthology.orchestra.run.trial049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T11:02:37.063 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:02:37.074 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-mgr-rook-2:19.2.3-705.g04cf6dd4.el9.noarch 96/99 2026-02-17T11:02:37.290 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-705.g04cf6dd4.el9.noarch 96/99 2026-02-17T11:02:37.292 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-mon-2:19.2.3-705.g04cf6dd4.el9.x86_64 97/99 2026-02-17T11:02:37.313 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-mon-2:19.2.3-705.g04cf6dd4.el9.x86_64 97/99 2026-02-17T11:02:37.313 INFO:teuthology.orchestra.run.trial049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:02:37.314 INFO:teuthology.orchestra.run.trial049.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-17T11:02:37.314 INFO:teuthology.orchestra.run.trial049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T11:02:37.314 INFO:teuthology.orchestra.run.trial049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T11:02:37.314 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:02:37.415 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-mds-2:19.2.3-705.g04cf6dd4.el9.x86_64 98/99 2026-02-17T11:02:37.435 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-mds-2:19.2.3-705.g04cf6dd4.el9.x86_64 98/99 2026-02-17T11:02:37.435 INFO:teuthology.orchestra.run.trial049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:02:37.435 INFO:teuthology.orchestra.run.trial049.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-17T11:02:37.435 INFO:teuthology.orchestra.run.trial049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T11:02:37.435 INFO:teuthology.orchestra.run.trial049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T11:02:37.435 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:02:37.458 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-2:19.2.3-705.g04cf6dd4.el9.x86_64 99/99 2026-02-17T11:02:37.460 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-2:19.2.3-705.g04cf6dd4.el9.x86_64 99/99 2026-02-17T11:02:37.460 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/99 2026-02-17T11:02:37.460 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-mds-2:19.2.3-705.g04cf6dd4.el9.x86_64 2/99 2026-02-17T11:02:37.460 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-mgr-2:19.2.3-705.g04cf6dd4.el9.x86_64 3/99 2026-02-17T11:02:37.460 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-mon-2:19.2.3-705.g04cf6dd4.el9.x86_64 4/99 2026-02-17T11:02:37.460 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-osd-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/99 2026-02-17T11:02:37.460 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-705.g04cf6dd4.el9 6/99 2026-02-17T11:02:37.460 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 7/99 2026-02-17T11:02:37.460 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-705.g04cf6dd4.el9.noar 8/99 2026-02-17T11:02:37.460 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-705.g04cf6d 9/99 2026-02-17T11:02:37.460 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-705.g04cf6dd4.el9.noar 10/99 2026-02-17T11:02:37.461 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-705.g04cf6dd4.el9.n 11/99 2026-02-17T11:02:37.461 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-mgr-rook-2:19.2.3-705.g04cf6dd4.el9.noarch 12/99 2026-02-17T11:02:37.461 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-705.g04cf6dd4.el9. 13/99 2026-02-17T11:02:37.461 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-volume-2:19.2.3-705.g04cf6dd4.el9.noarch 14/99 2026-02-17T11:02:37.461 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 15/99 2026-02-17T11:02:37.461 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 16/99 2026-02-17T11:02:37.461 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/99 2026-02-17T11:02:37.461 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/99 2026-02-17T11:02:37.461 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/99 2026-02-17T11:02:37.461 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/99 2026-02-17T11:02:37.461 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/99 2026-02-17T11:02:37.461 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/99 2026-02-17T11:02:37.462 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/99 2026-02-17T11:02:37.462 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/99 2026-02-17T11:02:37.462 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/99 2026-02-17T11:02:37.462 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/99 2026-02-17T11:02:37.462 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/99 2026-02-17T11:02:37.462 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/99 2026-02-17T11:02:37.462 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : zip-3.0-35.el9.x86_64 29/99 2026-02-17T11:02:37.462 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 30/99 2026-02-17T11:02:37.462 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 31/99 2026-02-17T11:02:37.462 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 32/99 2026-02-17T11:02:37.462 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/99 2026-02-17T11:02:37.462 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/99 2026-02-17T11:02:37.462 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/99 2026-02-17T11:02:37.463 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/99 2026-02-17T11:02:37.463 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/99 2026-02-17T11:02:37.463 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/99 2026-02-17T11:02:37.463 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 39/99 2026-02-17T11:02:37.463 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/99 2026-02-17T11:02:37.463 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 41/99 2026-02-17T11:02:37.463 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 42/99 2026-02-17T11:02:37.463 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 43/99 2026-02-17T11:02:37.463 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/99 2026-02-17T11:02:37.463 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/99 2026-02-17T11:02:37.463 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/99 2026-02-17T11:02:37.463 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/99 2026-02-17T11:02:37.463 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/99 2026-02-17T11:02:37.464 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 49/99 2026-02-17T11:02:37.464 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 50/99 2026-02-17T11:02:37.464 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/99 2026-02-17T11:02:37.464 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/99 2026-02-17T11:02:37.464 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/99 2026-02-17T11:02:37.464 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/99 2026-02-17T11:02:37.464 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/99 2026-02-17T11:02:37.464 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/99 2026-02-17T11:02:37.464 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/99 2026-02-17T11:02:37.464 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/99 2026-02-17T11:02:37.464 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/99 2026-02-17T11:02:37.464 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/99 2026-02-17T11:02:37.464 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/99 2026-02-17T11:02:37.465 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/99 2026-02-17T11:02:37.465 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/99 2026-02-17T11:02:37.465 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/99 2026-02-17T11:02:37.465 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/99 2026-02-17T11:02:37.465 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/99 2026-02-17T11:02:37.465 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/99 2026-02-17T11:02:37.465 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/99 2026-02-17T11:02:37.465 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/99 2026-02-17T11:02:37.465 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/99 2026-02-17T11:02:37.465 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/99 2026-02-17T11:02:37.465 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/99 2026-02-17T11:02:37.465 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/99 2026-02-17T11:02:37.465 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/99 2026-02-17T11:02:37.466 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/99 2026-02-17T11:02:37.466 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/99 2026-02-17T11:02:37.466 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/99 2026-02-17T11:02:37.466 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/99 2026-02-17T11:02:37.466 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/99 2026-02-17T11:02:37.466 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/99 2026-02-17T11:02:37.466 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 81/99 2026-02-17T11:02:37.466 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/99 2026-02-17T11:02:37.466 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/99 2026-02-17T11:02:37.466 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/99 2026-02-17T11:02:37.466 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 85/99 2026-02-17T11:02:37.466 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 86/99 2026-02-17T11:02:37.466 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/99 2026-02-17T11:02:37.467 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 88/99 2026-02-17T11:02:37.467 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 89/99 2026-02-17T11:02:37.467 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 90/99 2026-02-17T11:02:37.467 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 91/99 2026-02-17T11:02:37.467 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 92/99 2026-02-17T11:02:37.467 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 93/99 2026-02-17T11:02:37.467 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 94/99 2026-02-17T11:02:37.467 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 95/99 2026-02-17T11:02:37.467 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 96/99 2026-02-17T11:02:37.467 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 97/99 2026-02-17T11:02:37.467 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 98/99 2026-02-17T11:02:37.522 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 99/99 2026-02-17T11:02:37.522 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:02:37.522 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-17T11:02:37.522 INFO:teuthology.orchestra.run.trial162.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-17T11:02:37.523 INFO:teuthology.orchestra.run.trial162.stdout: ceph-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:37.523 INFO:teuthology.orchestra.run.trial162.stdout: ceph-grafana-dashboards-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T11:02:37.523 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mds-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:37.523 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mgr-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:37.523 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mgr-cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T11:02:37.523 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mgr-dashboard-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T11:02:37.523 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mgr-diskprediction-local-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T11:02:37.523 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mgr-k8sevents-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T11:02:37.523 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mgr-modules-core-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T11:02:37.523 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mgr-rook-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T11:02:37.523 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mon-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:37.524 INFO:teuthology.orchestra.run.trial162.stdout: ceph-osd-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:37.524 INFO:teuthology.orchestra.run.trial162.stdout: ceph-prometheus-alerts-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T11:02:37.524 INFO:teuthology.orchestra.run.trial162.stdout: ceph-volume-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T11:02:37.524 INFO:teuthology.orchestra.run.trial162.stdout: cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T11:02:37.524 INFO:teuthology.orchestra.run.trial162.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-17T11:02:37.524 INFO:teuthology.orchestra.run.trial162.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-17T11:02:37.524 INFO:teuthology.orchestra.run.trial162.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-17T11:02:37.524 INFO:teuthology.orchestra.run.trial162.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-17T11:02:37.524 INFO:teuthology.orchestra.run.trial162.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-17T11:02:37.524 INFO:teuthology.orchestra.run.trial162.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-17T11:02:37.524 INFO:teuthology.orchestra.run.trial162.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-17T11:02:37.524 INFO:teuthology.orchestra.run.trial162.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-17T11:02:37.524 INFO:teuthology.orchestra.run.trial162.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-17T11:02:37.525 INFO:teuthology.orchestra.run.trial162.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T11:02:37.525 INFO:teuthology.orchestra.run.trial162.stdout: lua-5.4.4-4.el9.x86_64 2026-02-17T11:02:37.525 INFO:teuthology.orchestra.run.trial162.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-17T11:02:37.525 INFO:teuthology.orchestra.run.trial162.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-17T11:02:37.525 INFO:teuthology.orchestra.run.trial162.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-17T11:02:37.525 INFO:teuthology.orchestra.run.trial162.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-17T11:02:37.525 INFO:teuthology.orchestra.run.trial162.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-17T11:02:37.525 INFO:teuthology.orchestra.run.trial162.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-17T11:02:37.525 INFO:teuthology.orchestra.run.trial162.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-17T11:02:37.525 INFO:teuthology.orchestra.run.trial162.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-17T11:02:37.525 INFO:teuthology.orchestra.run.trial162.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-17T11:02:37.525 INFO:teuthology.orchestra.run.trial162.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-17T11:02:37.526 INFO:teuthology.orchestra.run.trial162.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-17T11:02:37.526 INFO:teuthology.orchestra.run.trial162.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-17T11:02:37.526 INFO:teuthology.orchestra.run.trial162.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-17T11:02:37.526 INFO:teuthology.orchestra.run.trial162.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-17T11:02:37.526 INFO:teuthology.orchestra.run.trial162.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-17T11:02:37.526 INFO:teuthology.orchestra.run.trial162.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-17T11:02:37.526 INFO:teuthology.orchestra.run.trial162.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-17T11:02:37.526 INFO:teuthology.orchestra.run.trial162.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-17T11:02:37.526 INFO:teuthology.orchestra.run.trial162.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-17T11:02:37.526 INFO:teuthology.orchestra.run.trial162.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-17T11:02:37.526 INFO:teuthology.orchestra.run.trial162.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-17T11:02:37.526 INFO:teuthology.orchestra.run.trial162.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-17T11:02:37.526 INFO:teuthology.orchestra.run.trial162.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-17T11:02:37.527 INFO:teuthology.orchestra.run.trial162.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-17T11:02:37.527 INFO:teuthology.orchestra.run.trial162.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-17T11:02:37.527 INFO:teuthology.orchestra.run.trial162.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-17T11:02:37.527 INFO:teuthology.orchestra.run.trial162.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-17T11:02:37.527 INFO:teuthology.orchestra.run.trial162.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-17T11:02:37.527 INFO:teuthology.orchestra.run.trial162.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-17T11:02:37.527 INFO:teuthology.orchestra.run.trial162.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-17T11:02:37.527 INFO:teuthology.orchestra.run.trial162.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-17T11:02:37.527 INFO:teuthology.orchestra.run.trial162.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T11:02:37.527 INFO:teuthology.orchestra.run.trial162.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-17T11:02:37.527 INFO:teuthology.orchestra.run.trial162.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-17T11:02:37.527 INFO:teuthology.orchestra.run.trial162.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-17T11:02:37.527 INFO:teuthology.orchestra.run.trial162.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-17T11:02:37.528 INFO:teuthology.orchestra.run.trial162.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-17T11:02:37.528 INFO:teuthology.orchestra.run.trial162.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-17T11:02:37.528 INFO:teuthology.orchestra.run.trial162.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-17T11:02:37.528 INFO:teuthology.orchestra.run.trial162.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-17T11:02:37.528 INFO:teuthology.orchestra.run.trial162.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-17T11:02:37.528 INFO:teuthology.orchestra.run.trial162.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-17T11:02:37.528 INFO:teuthology.orchestra.run.trial162.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-17T11:02:37.528 INFO:teuthology.orchestra.run.trial162.stdout: python3-ply-3.11-14.el9.noarch 2026-02-17T11:02:37.528 INFO:teuthology.orchestra.run.trial162.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-17T11:02:37.528 INFO:teuthology.orchestra.run.trial162.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-17T11:02:37.528 INFO:teuthology.orchestra.run.trial162.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-17T11:02:37.528 INFO:teuthology.orchestra.run.trial162.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-17T11:02:37.529 INFO:teuthology.orchestra.run.trial162.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-17T11:02:37.529 INFO:teuthology.orchestra.run.trial162.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-17T11:02:37.529 INFO:teuthology.orchestra.run.trial162.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-17T11:02:37.529 INFO:teuthology.orchestra.run.trial162.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-17T11:02:37.529 INFO:teuthology.orchestra.run.trial162.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-17T11:02:37.529 INFO:teuthology.orchestra.run.trial162.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-17T11:02:37.529 INFO:teuthology.orchestra.run.trial162.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-17T11:02:37.529 INFO:teuthology.orchestra.run.trial162.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-17T11:02:37.529 INFO:teuthology.orchestra.run.trial162.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-17T11:02:37.529 INFO:teuthology.orchestra.run.trial162.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-17T11:02:37.529 INFO:teuthology.orchestra.run.trial162.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-17T11:02:37.529 INFO:teuthology.orchestra.run.trial162.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-17T11:02:37.529 INFO:teuthology.orchestra.run.trial162.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-17T11:02:37.530 INFO:teuthology.orchestra.run.trial162.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-17T11:02:37.530 INFO:teuthology.orchestra.run.trial162.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-17T11:02:37.530 INFO:teuthology.orchestra.run.trial162.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-17T11:02:37.530 INFO:teuthology.orchestra.run.trial162.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-17T11:02:37.530 INFO:teuthology.orchestra.run.trial162.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-17T11:02:37.530 INFO:teuthology.orchestra.run.trial162.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-17T11:02:37.530 INFO:teuthology.orchestra.run.trial162.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-17T11:02:37.530 INFO:teuthology.orchestra.run.trial162.stdout: unzip-6.0-59.el9.x86_64 2026-02-17T11:02:37.530 INFO:teuthology.orchestra.run.trial162.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-17T11:02:37.530 INFO:teuthology.orchestra.run.trial162.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-17T11:02:37.530 INFO:teuthology.orchestra.run.trial162.stdout: zip-3.0-35.el9.x86_64 2026-02-17T11:02:37.530 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:02:37.530 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T11:02:37.577 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install ceph-base 2026-02-17T11:02:37.893 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:00:28 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:02:37.959 INFO:teuthology.orchestra.run.trial162.stdout:Package ceph-base-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T11:02:37.976 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T11:02:37.977 INFO:teuthology.orchestra.run.trial162.stdout:Nothing to do. 2026-02-17T11:02:37.977 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T11:02:37.998 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install cephadm 2026-02-17T11:02:38.006 INFO:teuthology.orchestra.run.trial157.stdout: Preparing : 1/1 2026-02-17T11:02:38.085 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-2:19.2.3-705.g04cf6dd4.el9.x86_64 99/99 2026-02-17T11:02:38.085 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/99 2026-02-17T11:02:38.085 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-mds-2:19.2.3-705.g04cf6dd4.el9.x86_64 2/99 2026-02-17T11:02:38.085 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-mgr-2:19.2.3-705.g04cf6dd4.el9.x86_64 3/99 2026-02-17T11:02:38.085 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-mon-2:19.2.3-705.g04cf6dd4.el9.x86_64 4/99 2026-02-17T11:02:38.085 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-osd-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/99 2026-02-17T11:02:38.085 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-705.g04cf6dd4.el9 6/99 2026-02-17T11:02:38.085 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 7/99 2026-02-17T11:02:38.086 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-705.g04cf6dd4.el9.noar 8/99 2026-02-17T11:02:38.086 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-705.g04cf6d 9/99 2026-02-17T11:02:38.086 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-705.g04cf6dd4.el9.noar 10/99 2026-02-17T11:02:38.086 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-705.g04cf6dd4.el9.n 11/99 2026-02-17T11:02:38.086 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-mgr-rook-2:19.2.3-705.g04cf6dd4.el9.noarch 12/99 2026-02-17T11:02:38.086 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-705.g04cf6dd4.el9. 13/99 2026-02-17T11:02:38.086 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-volume-2:19.2.3-705.g04cf6dd4.el9.noarch 14/99 2026-02-17T11:02:38.086 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 15/99 2026-02-17T11:02:38.086 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 16/99 2026-02-17T11:02:38.086 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/99 2026-02-17T11:02:38.086 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/99 2026-02-17T11:02:38.086 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/99 2026-02-17T11:02:38.087 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/99 2026-02-17T11:02:38.087 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/99 2026-02-17T11:02:38.087 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/99 2026-02-17T11:02:38.087 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/99 2026-02-17T11:02:38.087 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/99 2026-02-17T11:02:38.087 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/99 2026-02-17T11:02:38.087 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/99 2026-02-17T11:02:38.087 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/99 2026-02-17T11:02:38.087 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/99 2026-02-17T11:02:38.087 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : zip-3.0-35.el9.x86_64 29/99 2026-02-17T11:02:38.087 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 30/99 2026-02-17T11:02:38.087 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 31/99 2026-02-17T11:02:38.088 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 32/99 2026-02-17T11:02:38.088 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/99 2026-02-17T11:02:38.088 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/99 2026-02-17T11:02:38.088 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/99 2026-02-17T11:02:38.088 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/99 2026-02-17T11:02:38.088 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/99 2026-02-17T11:02:38.088 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/99 2026-02-17T11:02:38.088 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 39/99 2026-02-17T11:02:38.088 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/99 2026-02-17T11:02:38.088 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 41/99 2026-02-17T11:02:38.088 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 42/99 2026-02-17T11:02:38.088 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 43/99 2026-02-17T11:02:38.088 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/99 2026-02-17T11:02:38.089 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/99 2026-02-17T11:02:38.089 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/99 2026-02-17T11:02:38.089 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/99 2026-02-17T11:02:38.089 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/99 2026-02-17T11:02:38.089 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 49/99 2026-02-17T11:02:38.089 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 50/99 2026-02-17T11:02:38.089 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/99 2026-02-17T11:02:38.089 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/99 2026-02-17T11:02:38.089 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/99 2026-02-17T11:02:38.089 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/99 2026-02-17T11:02:38.089 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/99 2026-02-17T11:02:38.089 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/99 2026-02-17T11:02:38.089 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/99 2026-02-17T11:02:38.090 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/99 2026-02-17T11:02:38.090 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/99 2026-02-17T11:02:38.090 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/99 2026-02-17T11:02:38.090 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/99 2026-02-17T11:02:38.090 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/99 2026-02-17T11:02:38.090 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/99 2026-02-17T11:02:38.090 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/99 2026-02-17T11:02:38.090 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/99 2026-02-17T11:02:38.090 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/99 2026-02-17T11:02:38.090 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/99 2026-02-17T11:02:38.090 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/99 2026-02-17T11:02:38.090 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/99 2026-02-17T11:02:38.091 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/99 2026-02-17T11:02:38.091 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/99 2026-02-17T11:02:38.091 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/99 2026-02-17T11:02:38.091 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/99 2026-02-17T11:02:38.091 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/99 2026-02-17T11:02:38.091 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/99 2026-02-17T11:02:38.091 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/99 2026-02-17T11:02:38.091 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/99 2026-02-17T11:02:38.091 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/99 2026-02-17T11:02:38.091 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/99 2026-02-17T11:02:38.091 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/99 2026-02-17T11:02:38.091 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 81/99 2026-02-17T11:02:38.091 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/99 2026-02-17T11:02:38.092 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/99 2026-02-17T11:02:38.092 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/99 2026-02-17T11:02:38.092 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 85/99 2026-02-17T11:02:38.092 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 86/99 2026-02-17T11:02:38.092 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/99 2026-02-17T11:02:38.092 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 88/99 2026-02-17T11:02:38.092 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 89/99 2026-02-17T11:02:38.092 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 90/99 2026-02-17T11:02:38.092 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 91/99 2026-02-17T11:02:38.092 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 92/99 2026-02-17T11:02:38.093 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 93/99 2026-02-17T11:02:38.093 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 94/99 2026-02-17T11:02:38.093 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 95/99 2026-02-17T11:02:38.093 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 96/99 2026-02-17T11:02:38.093 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 97/99 2026-02-17T11:02:38.093 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 98/99 2026-02-17T11:02:38.148 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 99/99 2026-02-17T11:02:38.148 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:02:38.148 INFO:teuthology.orchestra.run.trial049.stdout:Installed: 2026-02-17T11:02:38.148 INFO:teuthology.orchestra.run.trial049.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-17T11:02:38.148 INFO:teuthology.orchestra.run.trial049.stdout: ceph-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:38.148 INFO:teuthology.orchestra.run.trial049.stdout: ceph-grafana-dashboards-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T11:02:38.149 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mds-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:38.149 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mgr-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:38.149 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mgr-cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T11:02:38.149 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mgr-dashboard-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T11:02:38.149 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mgr-diskprediction-local-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T11:02:38.149 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mgr-k8sevents-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T11:02:38.149 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mgr-modules-core-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T11:02:38.149 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mgr-rook-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T11:02:38.149 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mon-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:38.149 INFO:teuthology.orchestra.run.trial049.stdout: ceph-osd-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:38.149 INFO:teuthology.orchestra.run.trial049.stdout: ceph-prometheus-alerts-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T11:02:38.150 INFO:teuthology.orchestra.run.trial049.stdout: ceph-volume-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T11:02:38.150 INFO:teuthology.orchestra.run.trial049.stdout: cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T11:02:38.150 INFO:teuthology.orchestra.run.trial049.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-17T11:02:38.150 INFO:teuthology.orchestra.run.trial049.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-17T11:02:38.150 INFO:teuthology.orchestra.run.trial049.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-17T11:02:38.150 INFO:teuthology.orchestra.run.trial049.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-17T11:02:38.150 INFO:teuthology.orchestra.run.trial049.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-17T11:02:38.150 INFO:teuthology.orchestra.run.trial049.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-17T11:02:38.150 INFO:teuthology.orchestra.run.trial049.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-17T11:02:38.150 INFO:teuthology.orchestra.run.trial049.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-17T11:02:38.150 INFO:teuthology.orchestra.run.trial049.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-17T11:02:38.150 INFO:teuthology.orchestra.run.trial049.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T11:02:38.150 INFO:teuthology.orchestra.run.trial049.stdout: lua-5.4.4-4.el9.x86_64 2026-02-17T11:02:38.151 INFO:teuthology.orchestra.run.trial049.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-17T11:02:38.151 INFO:teuthology.orchestra.run.trial049.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-17T11:02:38.151 INFO:teuthology.orchestra.run.trial049.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-17T11:02:38.151 INFO:teuthology.orchestra.run.trial049.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-17T11:02:38.151 INFO:teuthology.orchestra.run.trial049.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-17T11:02:38.151 INFO:teuthology.orchestra.run.trial049.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-17T11:02:38.151 INFO:teuthology.orchestra.run.trial049.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-17T11:02:38.151 INFO:teuthology.orchestra.run.trial049.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-17T11:02:38.151 INFO:teuthology.orchestra.run.trial049.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-17T11:02:38.151 INFO:teuthology.orchestra.run.trial049.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-17T11:02:38.151 INFO:teuthology.orchestra.run.trial049.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-17T11:02:38.151 INFO:teuthology.orchestra.run.trial049.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-17T11:02:38.152 INFO:teuthology.orchestra.run.trial049.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-17T11:02:38.152 INFO:teuthology.orchestra.run.trial049.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-17T11:02:38.152 INFO:teuthology.orchestra.run.trial049.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-17T11:02:38.152 INFO:teuthology.orchestra.run.trial049.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-17T11:02:38.152 INFO:teuthology.orchestra.run.trial049.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-17T11:02:38.152 INFO:teuthology.orchestra.run.trial049.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-17T11:02:38.152 INFO:teuthology.orchestra.run.trial049.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-17T11:02:38.152 INFO:teuthology.orchestra.run.trial049.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-17T11:02:38.152 INFO:teuthology.orchestra.run.trial049.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-17T11:02:38.152 INFO:teuthology.orchestra.run.trial049.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-17T11:02:38.152 INFO:teuthology.orchestra.run.trial049.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-17T11:02:38.152 INFO:teuthology.orchestra.run.trial049.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-17T11:02:38.153 INFO:teuthology.orchestra.run.trial049.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-17T11:02:38.153 INFO:teuthology.orchestra.run.trial049.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-17T11:02:38.153 INFO:teuthology.orchestra.run.trial049.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-17T11:02:38.153 INFO:teuthology.orchestra.run.trial049.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-17T11:02:38.153 INFO:teuthology.orchestra.run.trial049.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-17T11:02:38.153 INFO:teuthology.orchestra.run.trial049.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-17T11:02:38.153 INFO:teuthology.orchestra.run.trial049.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-17T11:02:38.153 INFO:teuthology.orchestra.run.trial049.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T11:02:38.153 INFO:teuthology.orchestra.run.trial049.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-17T11:02:38.153 INFO:teuthology.orchestra.run.trial049.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-17T11:02:38.153 INFO:teuthology.orchestra.run.trial049.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-17T11:02:38.153 INFO:teuthology.orchestra.run.trial049.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-17T11:02:38.153 INFO:teuthology.orchestra.run.trial049.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-17T11:02:38.154 INFO:teuthology.orchestra.run.trial049.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-17T11:02:38.154 INFO:teuthology.orchestra.run.trial049.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-17T11:02:38.154 INFO:teuthology.orchestra.run.trial049.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-17T11:02:38.154 INFO:teuthology.orchestra.run.trial049.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-17T11:02:38.154 INFO:teuthology.orchestra.run.trial049.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-17T11:02:38.154 INFO:teuthology.orchestra.run.trial049.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-17T11:02:38.154 INFO:teuthology.orchestra.run.trial049.stdout: python3-ply-3.11-14.el9.noarch 2026-02-17T11:02:38.154 INFO:teuthology.orchestra.run.trial049.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-17T11:02:38.154 INFO:teuthology.orchestra.run.trial049.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-17T11:02:38.154 INFO:teuthology.orchestra.run.trial049.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-17T11:02:38.154 INFO:teuthology.orchestra.run.trial049.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-17T11:02:38.154 INFO:teuthology.orchestra.run.trial049.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-17T11:02:38.154 INFO:teuthology.orchestra.run.trial049.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-17T11:02:38.155 INFO:teuthology.orchestra.run.trial049.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-17T11:02:38.155 INFO:teuthology.orchestra.run.trial049.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-17T11:02:38.155 INFO:teuthology.orchestra.run.trial049.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-17T11:02:38.155 INFO:teuthology.orchestra.run.trial049.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-17T11:02:38.155 INFO:teuthology.orchestra.run.trial049.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-17T11:02:38.155 INFO:teuthology.orchestra.run.trial049.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-17T11:02:38.155 INFO:teuthology.orchestra.run.trial049.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-17T11:02:38.155 INFO:teuthology.orchestra.run.trial049.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-17T11:02:38.155 INFO:teuthology.orchestra.run.trial049.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-17T11:02:38.155 INFO:teuthology.orchestra.run.trial049.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-17T11:02:38.155 INFO:teuthology.orchestra.run.trial049.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-17T11:02:38.155 INFO:teuthology.orchestra.run.trial049.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-17T11:02:38.155 INFO:teuthology.orchestra.run.trial049.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-17T11:02:38.156 INFO:teuthology.orchestra.run.trial049.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-17T11:02:38.156 INFO:teuthology.orchestra.run.trial049.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-17T11:02:38.156 INFO:teuthology.orchestra.run.trial049.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-17T11:02:38.156 INFO:teuthology.orchestra.run.trial049.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-17T11:02:38.156 INFO:teuthology.orchestra.run.trial049.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-17T11:02:38.156 INFO:teuthology.orchestra.run.trial049.stdout: unzip-6.0-59.el9.x86_64 2026-02-17T11:02:38.156 INFO:teuthology.orchestra.run.trial049.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-17T11:02:38.156 INFO:teuthology.orchestra.run.trial049.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-17T11:02:38.156 INFO:teuthology.orchestra.run.trial049.stdout: zip-3.0-35.el9.x86_64 2026-02-17T11:02:38.156 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:02:38.156 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-17T11:02:38.202 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-base 2026-02-17T11:02:38.312 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:00:29 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:02:38.377 INFO:teuthology.orchestra.run.trial162.stdout:Package cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-17T11:02:38.394 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T11:02:38.395 INFO:teuthology.orchestra.run.trial162.stdout:Nothing to do. 2026-02-17T11:02:38.395 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T11:02:38.416 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install ceph-immutable-object-cache 2026-02-17T11:02:38.513 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:29 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:02:38.577 INFO:teuthology.orchestra.run.trial049.stdout:Package ceph-base-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T11:02:38.595 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-17T11:02:38.595 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-17T11:02:38.595 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-17T11:02:38.616 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install cephadm 2026-02-17T11:02:38.724 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:00:29 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:02:38.806 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T11:02:38.806 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:02:38.807 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repo Size 2026-02-17T11:02:38.807 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:02:38.807 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-17T11:02:38.807 INFO:teuthology.orchestra.run.trial162.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 145 k 2026-02-17T11:02:38.807 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:02:38.807 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-17T11:02:38.807 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:02:38.807 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-17T11:02:38.807 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:02:38.807 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 145 k 2026-02-17T11:02:38.807 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 431 k 2026-02-17T11:02:38.808 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-17T11:02:38.926 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:29 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:02:38.990 INFO:teuthology.orchestra.run.trial049.stdout:Package cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-17T11:02:39.009 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-17T11:02:39.009 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-17T11:02:39.009 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-17T11:02:39.009 INFO:teuthology.orchestra.run.trial162.stdout:ceph-immutable-object-cache-19.2.3-705.g04cf6dd 722 kB/s | 145 kB 00:00 2026-02-17T11:02:39.010 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:02:39.010 INFO:teuthology.orchestra.run.trial162.stdout:Total 718 kB/s | 145 kB 00:00 2026-02-17T11:02:39.010 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-17T11:02:39.013 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-17T11:02:39.013 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-17T11:02:39.029 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-immutable-object-cache 2026-02-17T11:02:39.044 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-17T11:02:39.044 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-17T11:02:39.098 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-17T11:02:39.099 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-705.g04cf6dd4.e 1/1 2026-02-17T11:02:39.121 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-705.g04cf6dd4.e 1/1 2026-02-17T11:02:39.122 INFO:teuthology.orchestra.run.trial162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:02:39.122 INFO:teuthology.orchestra.run.trial162.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-17T11:02:39.122 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:02:39.292 INFO:teuthology.orchestra.run.trial157.stdout: Installing : ceph-debugsource-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/3 2026-02-17T11:02:39.337 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:30 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:02:39.400 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-705.g04cf6dd4.e 1/1 2026-02-17T11:02:39.400 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:02:39.400 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-17T11:02:39.400 INFO:teuthology.orchestra.run.trial162.stdout: ceph-immutable-object-cache-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:39.401 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:02:39.401 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T11:02:39.418 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-17T11:02:39.419 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:02:39.419 INFO:teuthology.orchestra.run.trial049.stdout: Package Arch Version Repo Size 2026-02-17T11:02:39.419 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:02:39.419 INFO:teuthology.orchestra.run.trial049.stdout:Installing: 2026-02-17T11:02:39.420 INFO:teuthology.orchestra.run.trial049.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 145 k 2026-02-17T11:02:39.420 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:02:39.420 INFO:teuthology.orchestra.run.trial049.stdout:Transaction Summary 2026-02-17T11:02:39.420 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:02:39.420 INFO:teuthology.orchestra.run.trial049.stdout:Install 1 Package 2026-02-17T11:02:39.420 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:02:39.420 INFO:teuthology.orchestra.run.trial049.stdout:Total download size: 145 k 2026-02-17T11:02:39.420 INFO:teuthology.orchestra.run.trial049.stdout:Installed size: 431 k 2026-02-17T11:02:39.420 INFO:teuthology.orchestra.run.trial049.stdout:Downloading Packages: 2026-02-17T11:02:39.429 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install ceph-mgr 2026-02-17T11:02:39.629 INFO:teuthology.orchestra.run.trial049.stdout:ceph-immutable-object-cache-19.2.3-705.g04cf6dd 693 kB/s | 145 kB 00:00 2026-02-17T11:02:39.630 INFO:teuthology.orchestra.run.trial049.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:02:39.630 INFO:teuthology.orchestra.run.trial049.stdout:Total 689 kB/s | 145 kB 00:00 2026-02-17T11:02:39.630 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction check 2026-02-17T11:02:39.633 INFO:teuthology.orchestra.run.trial049.stdout:Transaction check succeeded. 2026-02-17T11:02:39.633 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction test 2026-02-17T11:02:39.664 INFO:teuthology.orchestra.run.trial049.stdout:Transaction test succeeded. 2026-02-17T11:02:39.664 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction 2026-02-17T11:02:39.719 INFO:teuthology.orchestra.run.trial049.stdout: Preparing : 1/1 2026-02-17T11:02:39.720 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-705.g04cf6dd4.e 1/1 2026-02-17T11:02:39.741 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-705.g04cf6dd4.e 1/1 2026-02-17T11:02:39.741 INFO:teuthology.orchestra.run.trial049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:02:39.741 INFO:teuthology.orchestra.run.trial049.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-17T11:02:39.741 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:02:39.744 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:00:30 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:02:39.808 INFO:teuthology.orchestra.run.trial162.stdout:Package ceph-mgr-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T11:02:39.825 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T11:02:39.826 INFO:teuthology.orchestra.run.trial162.stdout:Nothing to do. 2026-02-17T11:02:39.826 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T11:02:39.847 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install ceph-mgr-dashboard 2026-02-17T11:02:40.046 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-705.g04cf6dd4.e 1/1 2026-02-17T11:02:40.046 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:02:40.047 INFO:teuthology.orchestra.run.trial049.stdout:Installed: 2026-02-17T11:02:40.047 INFO:teuthology.orchestra.run.trial049.stdout: ceph-immutable-object-cache-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:40.047 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:02:40.047 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-17T11:02:40.074 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-mgr 2026-02-17T11:02:40.167 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:00:31 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:02:40.231 INFO:teuthology.orchestra.run.trial162.stdout:Package ceph-mgr-dashboard-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-17T11:02:40.249 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T11:02:40.250 INFO:teuthology.orchestra.run.trial162.stdout:Nothing to do. 2026-02-17T11:02:40.250 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T11:02:40.272 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-17T11:02:40.389 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:31 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:02:40.453 INFO:teuthology.orchestra.run.trial049.stdout:Package ceph-mgr-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T11:02:40.471 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-17T11:02:40.471 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-17T11:02:40.471 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-17T11:02:40.493 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-mgr-dashboard 2026-02-17T11:02:40.579 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:00:31 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:02:40.643 INFO:teuthology.orchestra.run.trial162.stdout:Package ceph-mgr-diskprediction-local-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-17T11:02:40.661 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T11:02:40.662 INFO:teuthology.orchestra.run.trial162.stdout:Nothing to do. 2026-02-17T11:02:40.662 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T11:02:40.682 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install ceph-mgr-rook 2026-02-17T11:02:40.804 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:31 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:02:40.870 INFO:teuthology.orchestra.run.trial049.stdout:Package ceph-mgr-dashboard-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-17T11:02:40.887 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-17T11:02:40.888 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-17T11:02:40.888 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-17T11:02:40.909 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-17T11:02:40.994 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:00:31 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:02:41.057 INFO:teuthology.orchestra.run.trial162.stdout:Package ceph-mgr-rook-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-17T11:02:41.075 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T11:02:41.075 INFO:teuthology.orchestra.run.trial162.stdout:Nothing to do. 2026-02-17T11:02:41.076 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T11:02:41.097 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install ceph-mgr-cephadm 2026-02-17T11:02:41.216 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:32 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:02:41.281 INFO:teuthology.orchestra.run.trial049.stdout:Package ceph-mgr-diskprediction-local-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-17T11:02:41.298 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-17T11:02:41.299 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-17T11:02:41.299 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-17T11:02:41.319 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-mgr-rook 2026-02-17T11:02:41.400 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:00:32 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:02:41.464 INFO:teuthology.orchestra.run.trial162.stdout:Package ceph-mgr-cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-17T11:02:41.482 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T11:02:41.482 INFO:teuthology.orchestra.run.trial162.stdout:Nothing to do. 2026-02-17T11:02:41.482 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T11:02:41.504 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install ceph-fuse 2026-02-17T11:02:41.625 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:32 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:02:41.689 INFO:teuthology.orchestra.run.trial049.stdout:Package ceph-mgr-rook-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-17T11:02:41.706 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-17T11:02:41.707 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-17T11:02:41.707 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-17T11:02:41.727 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-mgr-cephadm 2026-02-17T11:02:41.815 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:00:32 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:02:41.897 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T11:02:41.898 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:02:41.898 INFO:teuthology.orchestra.run.trial162.stdout: Package Architecture Version Repository Size 2026-02-17T11:02:41.898 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:02:41.898 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-17T11:02:41.898 INFO:teuthology.orchestra.run.trial162.stdout: ceph-fuse x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 1.2 M 2026-02-17T11:02:41.898 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:02:41.898 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-17T11:02:41.898 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:02:41.898 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-17T11:02:41.898 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:02:41.899 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 1.2 M 2026-02-17T11:02:41.899 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 3.6 M 2026-02-17T11:02:41.899 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-17T11:02:42.031 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:33 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:02:42.096 INFO:teuthology.orchestra.run.trial049.stdout:Package ceph-mgr-cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-17T11:02:42.114 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-17T11:02:42.114 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-17T11:02:42.114 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-17T11:02:42.136 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-fuse 2026-02-17T11:02:42.211 INFO:teuthology.orchestra.run.trial162.stdout:ceph-fuse-19.2.3-705.g04cf6dd4.el9.x86_64.rpm 3.7 MB/s | 1.2 MB 00:00 2026-02-17T11:02:42.212 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:02:42.213 INFO:teuthology.orchestra.run.trial162.stdout:Total 3.7 MB/s | 1.2 MB 00:00 2026-02-17T11:02:42.213 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-17T11:02:42.216 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-17T11:02:42.217 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-17T11:02:42.251 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-17T11:02:42.251 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-17T11:02:42.352 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-17T11:02:42.369 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:42.449 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:33 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:02:42.531 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-17T11:02:42.532 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:02:42.532 INFO:teuthology.orchestra.run.trial049.stdout: Package Architecture Version Repository Size 2026-02-17T11:02:42.532 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:02:42.532 INFO:teuthology.orchestra.run.trial049.stdout:Installing: 2026-02-17T11:02:42.532 INFO:teuthology.orchestra.run.trial049.stdout: ceph-fuse x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 1.2 M 2026-02-17T11:02:42.532 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:02:42.532 INFO:teuthology.orchestra.run.trial049.stdout:Transaction Summary 2026-02-17T11:02:42.532 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:02:42.533 INFO:teuthology.orchestra.run.trial049.stdout:Install 1 Package 2026-02-17T11:02:42.533 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:02:42.533 INFO:teuthology.orchestra.run.trial049.stdout:Total download size: 1.2 M 2026-02-17T11:02:42.533 INFO:teuthology.orchestra.run.trial049.stdout:Installed size: 3.6 M 2026-02-17T11:02:42.533 INFO:teuthology.orchestra.run.trial049.stdout:Downloading Packages: 2026-02-17T11:02:42.605 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:42.661 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:42.661 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:02:42.661 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-17T11:02:42.662 INFO:teuthology.orchestra.run.trial162.stdout: ceph-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:42.662 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:02:42.662 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T11:02:42.689 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install ceph-volume 2026-02-17T11:02:42.854 INFO:teuthology.orchestra.run.trial049.stdout:ceph-fuse-19.2.3-705.g04cf6dd4.el9.x86_64.rpm 3.6 MB/s | 1.2 MB 00:00 2026-02-17T11:02:42.855 INFO:teuthology.orchestra.run.trial049.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:02:42.855 INFO:teuthology.orchestra.run.trial049.stdout:Total 3.6 MB/s | 1.2 MB 00:00 2026-02-17T11:02:42.855 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction check 2026-02-17T11:02:42.859 INFO:teuthology.orchestra.run.trial049.stdout:Transaction check succeeded. 2026-02-17T11:02:42.859 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction test 2026-02-17T11:02:42.893 INFO:teuthology.orchestra.run.trial049.stdout:Transaction test succeeded. 2026-02-17T11:02:42.893 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction 2026-02-17T11:02:42.993 INFO:teuthology.orchestra.run.trial049.stdout: Preparing : 1/1 2026-02-17T11:02:42.999 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:00:33 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:02:43.010 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:43.045 INFO:teuthology.orchestra.run.trial157.stdout: Installing : ceph-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2/3 2026-02-17T11:02:43.063 INFO:teuthology.orchestra.run.trial162.stdout:Package ceph-volume-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-17T11:02:43.066 INFO:teuthology.orchestra.run.trial157.stdout: Installing : ceph-base-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_6 3/3 2026-02-17T11:02:43.081 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T11:02:43.082 INFO:teuthology.orchestra.run.trial162.stdout:Nothing to do. 2026-02-17T11:02:43.082 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T11:02:43.102 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install librados-devel 2026-02-17T11:02:43.235 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:43.291 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:43.291 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:02:43.291 INFO:teuthology.orchestra.run.trial049.stdout:Installed: 2026-02-17T11:02:43.291 INFO:teuthology.orchestra.run.trial049.stdout: ceph-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:43.291 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:02:43.291 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-17T11:02:43.319 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-volume 2026-02-17T11:02:43.412 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:00:34 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:02:43.495 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T11:02:43.495 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:02:43.495 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repo Size 2026-02-17T11:02:43.495 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:02:43.495 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-17T11:02:43.495 INFO:teuthology.orchestra.run.trial162.stdout: librados-devel x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 126 k 2026-02-17T11:02:43.496 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:02:43.496 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-17T11:02:43.496 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:02:43.496 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-17T11:02:43.496 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:02:43.496 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 126 k 2026-02-17T11:02:43.496 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 456 k 2026-02-17T11:02:43.496 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-17T11:02:43.622 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: ceph-base-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_6 3/3 2026-02-17T11:02:43.622 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : ceph-base-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_6 1/3 2026-02-17T11:02:43.622 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : ceph-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2/3 2026-02-17T11:02:43.634 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:34 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:02:43.679 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : ceph-debugsource-2:19.2.3-705.g04cf6dd4.el9.x86_64 3/3 2026-02-17T11:02:43.680 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:02:43.680 INFO:teuthology.orchestra.run.trial157.stdout:Installed: 2026-02-17T11:02:43.680 INFO:teuthology.orchestra.run.trial157.stdout: ceph-base-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:43.680 INFO:teuthology.orchestra.run.trial157.stdout: ceph-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:43.680 INFO:teuthology.orchestra.run.trial157.stdout: ceph-debugsource-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:43.680 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:02:43.680 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-17T11:02:43.699 INFO:teuthology.orchestra.run.trial049.stdout:Package ceph-volume-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-17T11:02:43.714 INFO:teuthology.orchestra.run.trial162.stdout:librados-devel-19.2.3-705.g04cf6dd4.el9.x86_64. 576 kB/s | 126 kB 00:00 2026-02-17T11:02:43.715 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:02:43.715 INFO:teuthology.orchestra.run.trial162.stdout:Total 574 kB/s | 126 kB 00:00 2026-02-17T11:02:43.715 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-17T11:02:43.717 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-17T11:02:43.717 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-17T11:02:43.717 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-17T11:02:43.718 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-17T11:02:43.718 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-17T11:02:43.721 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install ceph-common-debuginfo 2026-02-17T11:02:43.739 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install librados-devel 2026-02-17T11:02:43.750 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-17T11:02:43.750 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-17T11:02:43.804 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-17T11:02:43.821 INFO:teuthology.orchestra.run.trial162.stdout: Installing : librados-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:43.901 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: librados-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:43.956 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : librados-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:43.957 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:02:43.957 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-17T11:02:43.957 INFO:teuthology.orchestra.run.trial162.stdout: librados-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:43.957 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:02:43.957 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T11:02:43.984 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install libcephfs2 2026-02-17T11:02:44.029 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:00:59 ago on Tue 17 Feb 2026 11:01:45 AM UTC. 2026-02-17T11:02:44.049 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:35 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:02:44.112 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-17T11:02:44.113 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:02:44.113 INFO:teuthology.orchestra.run.trial157.stdout: Package Arch Version Repo Size 2026-02-17T11:02:44.113 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:02:44.113 INFO:teuthology.orchestra.run.trial157.stdout:Installing: 2026-02-17T11:02:44.113 INFO:teuthology.orchestra.run.trial157.stdout: ceph-common-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 474 M 2026-02-17T11:02:44.113 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:02:44.113 INFO:teuthology.orchestra.run.trial157.stdout:Transaction Summary 2026-02-17T11:02:44.114 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:02:44.114 INFO:teuthology.orchestra.run.trial157.stdout:Install 1 Package 2026-02-17T11:02:44.114 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:02:44.114 INFO:teuthology.orchestra.run.trial157.stdout:Total download size: 474 M 2026-02-17T11:02:44.114 INFO:teuthology.orchestra.run.trial157.stdout:Installed size: 2.0 G 2026-02-17T11:02:44.114 INFO:teuthology.orchestra.run.trial157.stdout:Downloading Packages: 2026-02-17T11:02:44.132 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-17T11:02:44.133 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:02:44.133 INFO:teuthology.orchestra.run.trial049.stdout: Package Arch Version Repo Size 2026-02-17T11:02:44.133 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:02:44.133 INFO:teuthology.orchestra.run.trial049.stdout:Installing: 2026-02-17T11:02:44.133 INFO:teuthology.orchestra.run.trial049.stdout: librados-devel x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 126 k 2026-02-17T11:02:44.134 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:02:44.134 INFO:teuthology.orchestra.run.trial049.stdout:Transaction Summary 2026-02-17T11:02:44.134 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:02:44.134 INFO:teuthology.orchestra.run.trial049.stdout:Install 1 Package 2026-02-17T11:02:44.134 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:02:44.134 INFO:teuthology.orchestra.run.trial049.stdout:Total download size: 126 k 2026-02-17T11:02:44.134 INFO:teuthology.orchestra.run.trial049.stdout:Installed size: 456 k 2026-02-17T11:02:44.134 INFO:teuthology.orchestra.run.trial049.stdout:Downloading Packages: 2026-02-17T11:02:44.293 INFO:teuthology.orchestra.run.trial049.stdout:librados-devel-19.2.3-705.g04cf6dd4.el9.x86_64. 792 kB/s | 126 kB 00:00 2026-02-17T11:02:44.294 INFO:teuthology.orchestra.run.trial049.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:02:44.294 INFO:teuthology.orchestra.run.trial049.stdout:Total 788 kB/s | 126 kB 00:00 2026-02-17T11:02:44.294 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction check 2026-02-17T11:02:44.296 INFO:teuthology.orchestra.run.trial049.stdout:Transaction check succeeded. 2026-02-17T11:02:44.297 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction test 2026-02-17T11:02:44.301 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:00:35 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:02:44.328 INFO:teuthology.orchestra.run.trial049.stdout:Transaction test succeeded. 2026-02-17T11:02:44.328 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction 2026-02-17T11:02:44.365 INFO:teuthology.orchestra.run.trial162.stdout:Package libcephfs2-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T11:02:44.383 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T11:02:44.383 INFO:teuthology.orchestra.run.trial049.stdout: Preparing : 1/1 2026-02-17T11:02:44.384 INFO:teuthology.orchestra.run.trial162.stdout:Nothing to do. 2026-02-17T11:02:44.384 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T11:02:44.400 INFO:teuthology.orchestra.run.trial049.stdout: Installing : librados-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:44.405 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install libcephfs-devel 2026-02-17T11:02:44.479 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: librados-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:44.537 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : librados-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:44.537 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:02:44.537 INFO:teuthology.orchestra.run.trial049.stdout:Installed: 2026-02-17T11:02:44.538 INFO:teuthology.orchestra.run.trial049.stdout: librados-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:44.538 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:02:44.538 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-17T11:02:44.564 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install libcephfs2 2026-02-17T11:02:44.721 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:00:35 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:02:44.804 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T11:02:44.804 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:02:44.804 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repo Size 2026-02-17T11:02:44.804 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:02:44.805 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-17T11:02:44.805 INFO:teuthology.orchestra.run.trial162.stdout: libcephfs-devel x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 34 k 2026-02-17T11:02:44.805 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:02:44.805 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-17T11:02:44.805 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:02:44.805 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-17T11:02:44.805 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:02:44.805 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 34 k 2026-02-17T11:02:44.805 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 153 k 2026-02-17T11:02:44.805 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-17T11:02:44.881 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:35 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:02:44.945 INFO:teuthology.orchestra.run.trial049.stdout:Package libcephfs2-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T11:02:44.962 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-17T11:02:44.963 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-17T11:02:44.963 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-17T11:02:44.983 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install libcephfs-devel 2026-02-17T11:02:45.038 INFO:teuthology.orchestra.run.trial162.stdout:libcephfs-devel-19.2.3-705.g04cf6dd4.el9.x86_64 144 kB/s | 34 kB 00:00 2026-02-17T11:02:45.038 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:02:45.039 INFO:teuthology.orchestra.run.trial162.stdout:Total 143 kB/s | 34 kB 00:00 2026-02-17T11:02:45.039 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-17T11:02:45.040 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-17T11:02:45.041 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-17T11:02:45.043 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-17T11:02:45.043 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-17T11:02:45.064 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-17T11:02:45.080 INFO:teuthology.orchestra.run.trial162.stdout: Installing : libcephfs-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:45.134 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: libcephfs-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:45.191 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : libcephfs-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:45.191 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:02:45.191 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-17T11:02:45.191 INFO:teuthology.orchestra.run.trial162.stdout: libcephfs-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:45.191 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:02:45.191 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T11:02:45.220 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install librados2 2026-02-17T11:02:45.296 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:36 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:02:45.379 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-17T11:02:45.380 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:02:45.380 INFO:teuthology.orchestra.run.trial049.stdout: Package Arch Version Repo Size 2026-02-17T11:02:45.380 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:02:45.380 INFO:teuthology.orchestra.run.trial049.stdout:Installing: 2026-02-17T11:02:45.381 INFO:teuthology.orchestra.run.trial049.stdout: libcephfs-devel x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 34 k 2026-02-17T11:02:45.381 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:02:45.381 INFO:teuthology.orchestra.run.trial049.stdout:Transaction Summary 2026-02-17T11:02:45.381 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:02:45.381 INFO:teuthology.orchestra.run.trial049.stdout:Install 1 Package 2026-02-17T11:02:45.381 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:02:45.381 INFO:teuthology.orchestra.run.trial049.stdout:Total download size: 34 k 2026-02-17T11:02:45.381 INFO:teuthology.orchestra.run.trial049.stdout:Installed size: 153 k 2026-02-17T11:02:45.381 INFO:teuthology.orchestra.run.trial049.stdout:Downloading Packages: 2026-02-17T11:02:45.529 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:00:36 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:02:45.596 INFO:teuthology.orchestra.run.trial162.stdout:Package librados2-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T11:02:45.614 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T11:02:45.614 INFO:teuthology.orchestra.run.trial162.stdout:Nothing to do. 2026-02-17T11:02:45.614 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T11:02:45.635 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install librbd1 2026-02-17T11:02:45.708 INFO:teuthology.orchestra.run.trial049.stdout:libcephfs-devel-19.2.3-705.g04cf6dd4.el9.x86_64 103 kB/s | 34 kB 00:00 2026-02-17T11:02:45.708 INFO:teuthology.orchestra.run.trial049.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:02:45.708 INFO:teuthology.orchestra.run.trial049.stdout:Total 102 kB/s | 34 kB 00:00 2026-02-17T11:02:45.708 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction check 2026-02-17T11:02:45.710 INFO:teuthology.orchestra.run.trial049.stdout:Transaction check succeeded. 2026-02-17T11:02:45.710 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction test 2026-02-17T11:02:45.712 INFO:teuthology.orchestra.run.trial049.stdout:Transaction test succeeded. 2026-02-17T11:02:45.713 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction 2026-02-17T11:02:45.732 INFO:teuthology.orchestra.run.trial049.stdout: Preparing : 1/1 2026-02-17T11:02:45.749 INFO:teuthology.orchestra.run.trial049.stdout: Installing : libcephfs-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:45.806 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: libcephfs-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:45.864 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : libcephfs-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:45.864 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:02:45.865 INFO:teuthology.orchestra.run.trial049.stdout:Installed: 2026-02-17T11:02:45.865 INFO:teuthology.orchestra.run.trial049.stdout: libcephfs-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:45.865 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:02:45.865 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-17T11:02:45.893 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install librados2 2026-02-17T11:02:45.948 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:00:36 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:02:46.013 INFO:teuthology.orchestra.run.trial162.stdout:Package librbd1-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T11:02:46.030 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T11:02:46.031 INFO:teuthology.orchestra.run.trial162.stdout:Nothing to do. 2026-02-17T11:02:46.031 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T11:02:46.052 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install python3-rados 2026-02-17T11:02:46.202 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:02:46.267 INFO:teuthology.orchestra.run.trial049.stdout:Package librados2-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T11:02:46.285 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-17T11:02:46.285 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-17T11:02:46.285 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-17T11:02:46.306 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install librbd1 2026-02-17T11:02:46.359 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:02:46.423 INFO:teuthology.orchestra.run.trial162.stdout:Package python3-rados-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T11:02:46.440 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T11:02:46.441 INFO:teuthology.orchestra.run.trial162.stdout:Nothing to do. 2026-02-17T11:02:46.441 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T11:02:46.462 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install python3-rgw 2026-02-17T11:02:46.615 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:02:46.679 INFO:teuthology.orchestra.run.trial049.stdout:Package librbd1-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T11:02:46.697 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-17T11:02:46.697 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-17T11:02:46.698 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-17T11:02:46.719 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install python3-rados 2026-02-17T11:02:46.774 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:02:46.839 INFO:teuthology.orchestra.run.trial162.stdout:Package python3-rgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T11:02:46.856 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T11:02:46.857 INFO:teuthology.orchestra.run.trial162.stdout:Nothing to do. 2026-02-17T11:02:46.857 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T11:02:46.878 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install python3-cephfs 2026-02-17T11:02:47.029 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:02:47.093 INFO:teuthology.orchestra.run.trial049.stdout:Package python3-rados-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T11:02:47.110 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-17T11:02:47.111 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-17T11:02:47.111 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-17T11:02:47.133 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install python3-rgw 2026-02-17T11:02:47.189 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:02:47.253 INFO:teuthology.orchestra.run.trial162.stdout:Package python3-cephfs-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T11:02:47.270 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T11:02:47.271 INFO:teuthology.orchestra.run.trial162.stdout:Nothing to do. 2026-02-17T11:02:47.271 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T11:02:47.292 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install python3-rbd 2026-02-17T11:02:47.443 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:02:47.508 INFO:teuthology.orchestra.run.trial049.stdout:Package python3-rgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T11:02:47.525 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-17T11:02:47.526 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-17T11:02:47.526 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-17T11:02:47.547 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install python3-cephfs 2026-02-17T11:02:47.606 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:02:47.642 INFO:teuthology.orchestra.run.trial097.stdout:ceph-common-debuginfo-19.2.3-705.g04cf6dd4.el9. 41 MB/s | 474 MB 00:11 2026-02-17T11:02:47.643 INFO:teuthology.orchestra.run.trial097.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:02:47.643 INFO:teuthology.orchestra.run.trial097.stdout:Total 41 MB/s | 474 MB 00:11 2026-02-17T11:02:47.644 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction check 2026-02-17T11:02:47.645 INFO:teuthology.orchestra.run.trial097.stdout:Transaction check succeeded. 2026-02-17T11:02:47.645 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction test 2026-02-17T11:02:47.670 INFO:teuthology.orchestra.run.trial162.stdout:Package python3-rbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T11:02:47.688 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T11:02:47.688 INFO:teuthology.orchestra.run.trial162.stdout:Nothing to do. 2026-02-17T11:02:47.688 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T11:02:47.710 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install rbd-fuse 2026-02-17T11:02:47.858 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:02:47.921 INFO:teuthology.orchestra.run.trial049.stdout:Package python3-cephfs-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T11:02:47.939 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-17T11:02:47.939 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-17T11:02:47.940 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-17T11:02:47.960 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install python3-rbd 2026-02-17T11:02:48.017 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:00:39 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:02:48.099 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T11:02:48.100 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:02:48.100 INFO:teuthology.orchestra.run.trial162.stdout: Package Architecture Version Repository Size 2026-02-17T11:02:48.101 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:02:48.101 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-17T11:02:48.101 INFO:teuthology.orchestra.run.trial162.stdout: rbd-fuse x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 85 k 2026-02-17T11:02:48.101 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:02:48.101 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-17T11:02:48.101 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:02:48.101 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-17T11:02:48.101 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:02:48.101 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 85 k 2026-02-17T11:02:48.101 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 227 k 2026-02-17T11:02:48.102 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-17T11:02:48.275 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:39 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:02:48.333 INFO:teuthology.orchestra.run.trial162.stdout:rbd-fuse-19.2.3-705.g04cf6dd4.el9.x86_64.rpm 366 kB/s | 85 kB 00:00 2026-02-17T11:02:48.333 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:02:48.334 INFO:teuthology.orchestra.run.trial162.stdout:Total 364 kB/s | 85 kB 00:00 2026-02-17T11:02:48.334 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-17T11:02:48.337 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-17T11:02:48.337 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-17T11:02:48.340 INFO:teuthology.orchestra.run.trial049.stdout:Package python3-rbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T11:02:48.357 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-17T11:02:48.358 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-17T11:02:48.358 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-17T11:02:48.368 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-17T11:02:48.368 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-17T11:02:48.380 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install rbd-fuse 2026-02-17T11:02:48.419 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-17T11:02:48.436 INFO:teuthology.orchestra.run.trial162.stdout: Installing : rbd-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:48.512 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: rbd-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:48.569 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : rbd-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:48.569 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:02:48.570 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-17T11:02:48.570 INFO:teuthology.orchestra.run.trial162.stdout: rbd-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:48.570 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:02:48.570 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T11:02:48.597 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install rbd-mirror 2026-02-17T11:02:48.692 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:39 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:02:48.773 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-17T11:02:48.774 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:02:48.774 INFO:teuthology.orchestra.run.trial049.stdout: Package Architecture Version Repository Size 2026-02-17T11:02:48.774 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:02:48.774 INFO:teuthology.orchestra.run.trial049.stdout:Installing: 2026-02-17T11:02:48.775 INFO:teuthology.orchestra.run.trial049.stdout: rbd-fuse x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 85 k 2026-02-17T11:02:48.775 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:02:48.775 INFO:teuthology.orchestra.run.trial049.stdout:Transaction Summary 2026-02-17T11:02:48.775 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:02:48.775 INFO:teuthology.orchestra.run.trial049.stdout:Install 1 Package 2026-02-17T11:02:48.775 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:02:48.775 INFO:teuthology.orchestra.run.trial049.stdout:Total download size: 85 k 2026-02-17T11:02:48.775 INFO:teuthology.orchestra.run.trial049.stdout:Installed size: 227 k 2026-02-17T11:02:48.775 INFO:teuthology.orchestra.run.trial049.stdout:Downloading Packages: 2026-02-17T11:02:48.920 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:00:39 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:02:49.003 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T11:02:49.003 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:02:49.003 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repo Size 2026-02-17T11:02:49.003 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:02:49.003 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-17T11:02:49.003 INFO:teuthology.orchestra.run.trial162.stdout: rbd-mirror x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 3.1 M 2026-02-17T11:02:49.003 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:02:49.003 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-17T11:02:49.003 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:02:49.004 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-17T11:02:49.004 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:02:49.004 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 3.1 M 2026-02-17T11:02:49.004 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 13 M 2026-02-17T11:02:49.004 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-17T11:02:49.031 INFO:teuthology.orchestra.run.trial049.stdout:rbd-fuse-19.2.3-705.g04cf6dd4.el9.x86_64.rpm 331 kB/s | 85 kB 00:00 2026-02-17T11:02:49.033 INFO:teuthology.orchestra.run.trial049.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:02:49.033 INFO:teuthology.orchestra.run.trial049.stdout:Total 328 kB/s | 85 kB 00:00 2026-02-17T11:02:49.033 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction check 2026-02-17T11:02:49.037 INFO:teuthology.orchestra.run.trial049.stdout:Transaction check succeeded. 2026-02-17T11:02:49.037 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction test 2026-02-17T11:02:49.055 INFO:teuthology.orchestra.run.trial097.stdout:Transaction test succeeded. 2026-02-17T11:02:49.055 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction 2026-02-17T11:02:49.067 INFO:teuthology.orchestra.run.trial049.stdout:Transaction test succeeded. 2026-02-17T11:02:49.067 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction 2026-02-17T11:02:49.118 INFO:teuthology.orchestra.run.trial049.stdout: Preparing : 1/1 2026-02-17T11:02:49.134 INFO:teuthology.orchestra.run.trial049.stdout: Installing : rbd-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:49.221 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: rbd-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:49.278 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : rbd-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:49.278 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:02:49.278 INFO:teuthology.orchestra.run.trial049.stdout:Installed: 2026-02-17T11:02:49.278 INFO:teuthology.orchestra.run.trial049.stdout: rbd-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:49.279 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:02:49.279 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-17T11:02:49.307 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install rbd-mirror 2026-02-17T11:02:49.617 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:40 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:02:49.698 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-17T11:02:49.698 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:02:49.698 INFO:teuthology.orchestra.run.trial049.stdout: Package Arch Version Repo Size 2026-02-17T11:02:49.699 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:02:49.699 INFO:teuthology.orchestra.run.trial049.stdout:Installing: 2026-02-17T11:02:49.699 INFO:teuthology.orchestra.run.trial049.stdout: rbd-mirror x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 3.1 M 2026-02-17T11:02:49.699 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:02:49.699 INFO:teuthology.orchestra.run.trial049.stdout:Transaction Summary 2026-02-17T11:02:49.699 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:02:49.699 INFO:teuthology.orchestra.run.trial049.stdout:Install 1 Package 2026-02-17T11:02:49.699 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:02:49.699 INFO:teuthology.orchestra.run.trial049.stdout:Total download size: 3.1 M 2026-02-17T11:02:49.700 INFO:teuthology.orchestra.run.trial049.stdout:Installed size: 13 M 2026-02-17T11:02:49.700 INFO:teuthology.orchestra.run.trial049.stdout:Downloading Packages: 2026-02-17T11:02:49.701 INFO:teuthology.orchestra.run.trial162.stdout:rbd-mirror-19.2.3-705.g04cf6dd4.el9.x86_64.rpm 4.5 MB/s | 3.1 MB 00:00 2026-02-17T11:02:49.701 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:02:49.701 INFO:teuthology.orchestra.run.trial162.stdout:Total 4.5 MB/s | 3.1 MB 00:00 2026-02-17T11:02:49.701 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-17T11:02:49.705 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-17T11:02:49.705 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-17T11:02:49.747 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-17T11:02:49.747 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-17T11:02:49.944 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-17T11:02:49.946 INFO:teuthology.orchestra.run.trial162.stdout: Installing : rbd-mirror-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:49.968 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: rbd-mirror-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:49.968 INFO:teuthology.orchestra.run.trial162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:02:49.968 INFO:teuthology.orchestra.run.trial162.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-17T11:02:49.969 INFO:teuthology.orchestra.run.trial162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T11:02:49.969 INFO:teuthology.orchestra.run.trial162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T11:02:49.969 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:02:50.261 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : rbd-mirror-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:50.261 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:02:50.261 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-17T11:02:50.261 INFO:teuthology.orchestra.run.trial162.stdout: rbd-mirror-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:50.261 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:02:50.261 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T11:02:50.288 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install rbd-nbd 2026-02-17T11:02:50.600 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:00:41 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:02:50.683 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T11:02:50.683 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:02:50.683 INFO:teuthology.orchestra.run.trial162.stdout: Package Architecture Version Repository Size 2026-02-17T11:02:50.683 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:02:50.683 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-17T11:02:50.683 INFO:teuthology.orchestra.run.trial162.stdout: rbd-nbd x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 171 k 2026-02-17T11:02:50.683 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:02:50.683 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-17T11:02:50.684 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:02:50.684 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-17T11:02:50.684 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:02:50.684 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 171 k 2026-02-17T11:02:50.684 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 490 k 2026-02-17T11:02:50.684 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-17T11:02:50.803 INFO:teuthology.orchestra.run.trial049.stdout:rbd-mirror-19.2.3-705.g04cf6dd4.el9.x86_64.rpm 2.8 MB/s | 3.1 MB 00:01 2026-02-17T11:02:50.803 INFO:teuthology.orchestra.run.trial049.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:02:50.803 INFO:teuthology.orchestra.run.trial049.stdout:Total 2.8 MB/s | 3.1 MB 00:01 2026-02-17T11:02:50.803 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction check 2026-02-17T11:02:50.807 INFO:teuthology.orchestra.run.trial049.stdout:Transaction check succeeded. 2026-02-17T11:02:50.807 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction test 2026-02-17T11:02:50.849 INFO:teuthology.orchestra.run.trial049.stdout:Transaction test succeeded. 2026-02-17T11:02:50.850 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction 2026-02-17T11:02:51.045 INFO:teuthology.orchestra.run.trial049.stdout: Preparing : 1/1 2026-02-17T11:02:51.046 INFO:teuthology.orchestra.run.trial049.stdout: Installing : rbd-mirror-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:51.069 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: rbd-mirror-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:51.069 INFO:teuthology.orchestra.run.trial049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:02:51.069 INFO:teuthology.orchestra.run.trial049.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-17T11:02:51.069 INFO:teuthology.orchestra.run.trial049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T11:02:51.069 INFO:teuthology.orchestra.run.trial049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T11:02:51.070 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:02:51.076 INFO:teuthology.orchestra.run.trial162.stdout:rbd-nbd-19.2.3-705.g04cf6dd4.el9.x86_64.rpm 435 kB/s | 171 kB 00:00 2026-02-17T11:02:51.077 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:02:51.077 INFO:teuthology.orchestra.run.trial162.stdout:Total 433 kB/s | 171 kB 00:00 2026-02-17T11:02:51.078 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-17T11:02:51.082 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-17T11:02:51.082 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-17T11:02:51.112 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-17T11:02:51.113 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-17T11:02:51.168 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-17T11:02:51.185 INFO:teuthology.orchestra.run.trial162.stdout: Installing : rbd-nbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:51.274 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: rbd-nbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:51.331 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : rbd-nbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:51.332 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:02:51.332 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-17T11:02:51.332 INFO:teuthology.orchestra.run.trial162.stdout: rbd-nbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:51.332 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:02:51.332 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T11:02:51.360 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install ceph-base-debuginfo 2026-02-17T11:02:51.368 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : rbd-mirror-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:51.368 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:02:51.368 INFO:teuthology.orchestra.run.trial049.stdout:Installed: 2026-02-17T11:02:51.369 INFO:teuthology.orchestra.run.trial049.stdout: rbd-mirror-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:51.369 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:02:51.369 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-17T11:02:51.397 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install rbd-nbd 2026-02-17T11:02:51.687 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:00:42 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:02:51.706 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:42 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:02:51.769 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T11:02:51.769 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:02:51.769 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repo Size 2026-02-17T11:02:51.769 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:02:51.769 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-17T11:02:51.769 INFO:teuthology.orchestra.run.trial162.stdout: ceph-base-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 72 M 2026-02-17T11:02:51.770 INFO:teuthology.orchestra.run.trial162.stdout:Installing dependencies: 2026-02-17T11:02:51.770 INFO:teuthology.orchestra.run.trial162.stdout: ceph-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 24 M 2026-02-17T11:02:51.770 INFO:teuthology.orchestra.run.trial162.stdout:Installing weak dependencies: 2026-02-17T11:02:51.770 INFO:teuthology.orchestra.run.trial162.stdout: ceph-debugsource x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 11 M 2026-02-17T11:02:51.770 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:02:51.770 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-17T11:02:51.770 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:02:51.770 INFO:teuthology.orchestra.run.trial162.stdout:Install 3 Packages 2026-02-17T11:02:51.770 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:02:51.770 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 107 M 2026-02-17T11:02:51.770 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 654 M 2026-02-17T11:02:51.771 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-17T11:02:51.787 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-17T11:02:51.787 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:02:51.787 INFO:teuthology.orchestra.run.trial049.stdout: Package Architecture Version Repository Size 2026-02-17T11:02:51.788 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:02:51.788 INFO:teuthology.orchestra.run.trial049.stdout:Installing: 2026-02-17T11:02:51.788 INFO:teuthology.orchestra.run.trial049.stdout: rbd-nbd x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 171 k 2026-02-17T11:02:51.788 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:02:51.788 INFO:teuthology.orchestra.run.trial049.stdout:Transaction Summary 2026-02-17T11:02:51.788 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:02:51.788 INFO:teuthology.orchestra.run.trial049.stdout:Install 1 Package 2026-02-17T11:02:51.788 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:02:51.788 INFO:teuthology.orchestra.run.trial049.stdout:Total download size: 171 k 2026-02-17T11:02:51.788 INFO:teuthology.orchestra.run.trial049.stdout:Installed size: 490 k 2026-02-17T11:02:51.788 INFO:teuthology.orchestra.run.trial049.stdout:Downloading Packages: 2026-02-17T11:02:52.052 INFO:teuthology.orchestra.run.trial049.stdout:rbd-nbd-19.2.3-705.g04cf6dd4.el9.x86_64.rpm 650 kB/s | 171 kB 00:00 2026-02-17T11:02:52.053 INFO:teuthology.orchestra.run.trial049.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:02:52.053 INFO:teuthology.orchestra.run.trial049.stdout:Total 647 kB/s | 171 kB 00:00 2026-02-17T11:02:52.053 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction check 2026-02-17T11:02:52.057 INFO:teuthology.orchestra.run.trial049.stdout:Transaction check succeeded. 2026-02-17T11:02:52.057 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction test 2026-02-17T11:02:52.088 INFO:teuthology.orchestra.run.trial049.stdout:Transaction test succeeded. 2026-02-17T11:02:52.088 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction 2026-02-17T11:02:52.143 INFO:teuthology.orchestra.run.trial049.stdout: Preparing : 1/1 2026-02-17T11:02:52.159 INFO:teuthology.orchestra.run.trial049.stdout: Installing : rbd-nbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:52.245 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: rbd-nbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:52.302 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : rbd-nbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:02:52.303 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:02:52.303 INFO:teuthology.orchestra.run.trial049.stdout:Installed: 2026-02-17T11:02:52.303 INFO:teuthology.orchestra.run.trial049.stdout: rbd-nbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:02:52.303 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:02:52.303 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-17T11:02:52.331 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-base-debuginfo 2026-02-17T11:02:52.647 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:43 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:02:52.732 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-17T11:02:52.733 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:02:52.733 INFO:teuthology.orchestra.run.trial049.stdout: Package Arch Version Repo Size 2026-02-17T11:02:52.734 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:02:52.734 INFO:teuthology.orchestra.run.trial049.stdout:Installing: 2026-02-17T11:02:52.734 INFO:teuthology.orchestra.run.trial049.stdout: ceph-base-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 72 M 2026-02-17T11:02:52.734 INFO:teuthology.orchestra.run.trial049.stdout:Installing dependencies: 2026-02-17T11:02:52.734 INFO:teuthology.orchestra.run.trial049.stdout: ceph-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 24 M 2026-02-17T11:02:52.734 INFO:teuthology.orchestra.run.trial049.stdout:Installing weak dependencies: 2026-02-17T11:02:52.734 INFO:teuthology.orchestra.run.trial049.stdout: ceph-debugsource x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 11 M 2026-02-17T11:02:52.735 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:02:52.735 INFO:teuthology.orchestra.run.trial049.stdout:Transaction Summary 2026-02-17T11:02:52.735 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:02:52.735 INFO:teuthology.orchestra.run.trial049.stdout:Install 3 Packages 2026-02-17T11:02:52.735 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:02:52.735 INFO:teuthology.orchestra.run.trial049.stdout:Total download size: 107 M 2026-02-17T11:02:52.735 INFO:teuthology.orchestra.run.trial049.stdout:Installed size: 654 M 2026-02-17T11:02:52.735 INFO:teuthology.orchestra.run.trial049.stdout:Downloading Packages: 2026-02-17T11:02:53.899 INFO:teuthology.orchestra.run.trial162.stdout:(1/3): ceph-debugsource-19.2.3-705.g04cf6dd4.el 5.1 MB/s | 11 MB 00:02 2026-02-17T11:02:55.782 INFO:teuthology.orchestra.run.trial162.stdout:(2/3): ceph-debuginfo-19.2.3-705.g04cf6dd4.el9. 6.1 MB/s | 24 MB 00:04 2026-02-17T11:02:57.085 INFO:teuthology.orchestra.run.trial049.stdout:(1/3): ceph-debugsource-19.2.3-705.g04cf6dd4.el 2.5 MB/s | 11 MB 00:04 2026-02-17T11:02:59.521 INFO:teuthology.orchestra.run.trial049.stdout:(2/3): ceph-base-debuginfo-19.2.3-705.g04cf6dd4 11 MB/s | 72 MB 00:06 2026-02-17T11:03:01.065 INFO:teuthology.orchestra.run.trial049.stdout:(3/3): ceph-debuginfo-19.2.3-705.g04cf6dd4.el9. 2.9 MB/s | 24 MB 00:08 2026-02-17T11:03:01.067 INFO:teuthology.orchestra.run.trial049.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:03:01.067 INFO:teuthology.orchestra.run.trial049.stdout:Total 13 MB/s | 107 MB 00:08 2026-02-17T11:03:01.067 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction check 2026-02-17T11:03:01.072 INFO:teuthology.orchestra.run.trial049.stdout:Transaction check succeeded. 2026-02-17T11:03:01.073 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction test 2026-02-17T11:03:01.264 INFO:teuthology.orchestra.run.trial157.stdout:ceph-common-debuginfo-19.2.3-705.g04cf6dd4.el9. 28 MB/s | 474 MB 00:17 2026-02-17T11:03:01.265 INFO:teuthology.orchestra.run.trial157.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:03:01.265 INFO:teuthology.orchestra.run.trial157.stdout:Total 28 MB/s | 474 MB 00:17 2026-02-17T11:03:01.265 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction check 2026-02-17T11:03:01.267 INFO:teuthology.orchestra.run.trial157.stdout:Transaction check succeeded. 2026-02-17T11:03:01.267 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction test 2026-02-17T11:03:01.453 INFO:teuthology.orchestra.run.trial049.stdout:Transaction test succeeded. 2026-02-17T11:03:01.453 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction 2026-02-17T11:03:01.670 INFO:teuthology.orchestra.run.trial162.stdout:(3/3): ceph-base-debuginfo-19.2.3-705.g04cf6dd4 7.2 MB/s | 72 MB 00:09 2026-02-17T11:03:01.671 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:03:01.672 INFO:teuthology.orchestra.run.trial162.stdout:Total 11 MB/s | 107 MB 00:09 2026-02-17T11:03:01.672 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-17T11:03:01.677 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-17T11:03:01.677 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-17T11:03:02.058 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-17T11:03:02.058 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-17T11:03:02.673 INFO:teuthology.orchestra.run.trial157.stdout:Transaction test succeeded. 2026-02-17T11:03:02.673 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction 2026-02-17T11:03:03.908 INFO:teuthology.orchestra.run.trial049.stdout: Preparing : 1/1 2026-02-17T11:03:04.516 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-17T11:03:05.173 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-debugsource-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/3 2026-02-17T11:03:05.805 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-debugsource-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/3 2026-02-17T11:03:08.851 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2/3 2026-02-17T11:03:08.870 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-base-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_6 3/3 2026-02-17T11:03:09.433 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-base-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_6 3/3 2026-02-17T11:03:09.434 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-base-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_6 1/3 2026-02-17T11:03:09.434 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2/3 2026-02-17T11:03:09.491 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-debugsource-2:19.2.3-705.g04cf6dd4.el9.x86_64 3/3 2026-02-17T11:03:09.491 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:03:09.491 INFO:teuthology.orchestra.run.trial049.stdout:Installed: 2026-02-17T11:03:09.491 INFO:teuthology.orchestra.run.trial049.stdout: ceph-base-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:03:09.491 INFO:teuthology.orchestra.run.trial049.stdout: ceph-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:03:09.492 INFO:teuthology.orchestra.run.trial049.stdout: ceph-debugsource-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:03:09.492 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:03:09.492 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-17T11:03:09.530 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-common-debuginfo 2026-02-17T11:03:09.547 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2/3 2026-02-17T11:03:09.566 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-base-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_6 3/3 2026-02-17T11:03:09.842 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:01:00 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:03:09.923 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-17T11:03:09.923 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:03:09.924 INFO:teuthology.orchestra.run.trial049.stdout: Package Arch Version Repo Size 2026-02-17T11:03:09.924 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:03:09.924 INFO:teuthology.orchestra.run.trial049.stdout:Installing: 2026-02-17T11:03:09.924 INFO:teuthology.orchestra.run.trial049.stdout: ceph-common-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 474 M 2026-02-17T11:03:09.924 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:03:09.924 INFO:teuthology.orchestra.run.trial049.stdout:Transaction Summary 2026-02-17T11:03:09.924 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:03:09.924 INFO:teuthology.orchestra.run.trial049.stdout:Install 1 Package 2026-02-17T11:03:09.924 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:03:09.924 INFO:teuthology.orchestra.run.trial049.stdout:Total download size: 474 M 2026-02-17T11:03:09.924 INFO:teuthology.orchestra.run.trial049.stdout:Installed size: 2.0 G 2026-02-17T11:03:09.925 INFO:teuthology.orchestra.run.trial049.stdout:Downloading Packages: 2026-02-17T11:03:10.116 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-base-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_6 3/3 2026-02-17T11:03:10.116 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-base-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_6 1/3 2026-02-17T11:03:10.116 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2/3 2026-02-17T11:03:10.175 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-debugsource-2:19.2.3-705.g04cf6dd4.el9.x86_64 3/3 2026-02-17T11:03:10.175 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:03:10.175 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-17T11:03:10.176 INFO:teuthology.orchestra.run.trial162.stdout: ceph-base-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:03:10.176 INFO:teuthology.orchestra.run.trial162.stdout: ceph-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:03:10.176 INFO:teuthology.orchestra.run.trial162.stdout: ceph-debugsource-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:03:10.176 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:03:10.176 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T11:03:10.215 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install ceph-common-debuginfo 2026-02-17T11:03:10.527 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:01:01 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:03:10.609 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T11:03:10.610 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:03:10.610 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repo Size 2026-02-17T11:03:10.610 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:03:10.610 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-17T11:03:10.610 INFO:teuthology.orchestra.run.trial162.stdout: ceph-common-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 474 M 2026-02-17T11:03:10.610 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:03:10.610 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-17T11:03:10.610 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:03:10.610 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-17T11:03:10.610 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:03:10.611 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 474 M 2026-02-17T11:03:10.611 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 2.0 G 2026-02-17T11:03:10.611 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-17T11:03:12.664 INFO:teuthology.orchestra.run.trial097.stdout: Preparing : 1/1 2026-02-17T11:03:12.683 INFO:teuthology.orchestra.run.trial097.stdout: Installing : ceph-common-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86 1/1 2026-02-17T11:03:14.200 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: ceph-common-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86 1/1 2026-02-17T11:03:14.258 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : ceph-common-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86 1/1 2026-02-17T11:03:14.258 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:03:14.258 INFO:teuthology.orchestra.run.trial097.stdout:Installed: 2026-02-17T11:03:14.258 INFO:teuthology.orchestra.run.trial097.stdout: ceph-common-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:03:14.259 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:03:14.259 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-17T11:03:14.326 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2026-02-17T11:03:14.640 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:01:32 ago on Tue 17 Feb 2026 11:01:42 AM UTC. 2026-02-17T11:03:14.721 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-17T11:03:14.722 INFO:teuthology.orchestra.run.trial097.stdout:======================================================================================= 2026-02-17T11:03:14.722 INFO:teuthology.orchestra.run.trial097.stdout: Package Arch Version Repo Size 2026-02-17T11:03:14.722 INFO:teuthology.orchestra.run.trial097.stdout:======================================================================================= 2026-02-17T11:03:14.723 INFO:teuthology.orchestra.run.trial097.stdout:Installing: 2026-02-17T11:03:14.723 INFO:teuthology.orchestra.run.trial097.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 1.5 M 2026-02-17T11:03:14.723 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:03:14.723 INFO:teuthology.orchestra.run.trial097.stdout:Transaction Summary 2026-02-17T11:03:14.723 INFO:teuthology.orchestra.run.trial097.stdout:======================================================================================= 2026-02-17T11:03:14.723 INFO:teuthology.orchestra.run.trial097.stdout:Install 1 Package 2026-02-17T11:03:14.723 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:03:14.723 INFO:teuthology.orchestra.run.trial097.stdout:Total download size: 1.5 M 2026-02-17T11:03:14.723 INFO:teuthology.orchestra.run.trial097.stdout:Installed size: 7.6 M 2026-02-17T11:03:14.723 INFO:teuthology.orchestra.run.trial097.stdout:Downloading Packages: 2026-02-17T11:03:16.200 INFO:teuthology.orchestra.run.trial097.stdout:ceph-immutable-object-cache-debuginfo-19.2.3-70 1.0 MB/s | 1.5 MB 00:01 2026-02-17T11:03:16.200 INFO:teuthology.orchestra.run.trial097.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:03:16.200 INFO:teuthology.orchestra.run.trial097.stdout:Total 1.0 MB/s | 1.5 MB 00:01 2026-02-17T11:03:16.200 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction check 2026-02-17T11:03:16.202 INFO:teuthology.orchestra.run.trial097.stdout:Transaction check succeeded. 2026-02-17T11:03:16.202 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction test 2026-02-17T11:03:16.224 INFO:teuthology.orchestra.run.trial097.stdout:Transaction test succeeded. 2026-02-17T11:03:16.224 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction 2026-02-17T11:03:16.337 INFO:teuthology.orchestra.run.trial097.stdout: Preparing : 1/1 2026-02-17T11:03:16.353 INFO:teuthology.orchestra.run.trial097.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:19.2.3-705.g 1/1 2026-02-17T11:03:16.413 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:19.2.3-705.g 1/1 2026-02-17T11:03:16.471 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:19.2.3-705.g 1/1 2026-02-17T11:03:16.471 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:03:16.471 INFO:teuthology.orchestra.run.trial097.stdout:Installed: 2026-02-17T11:03:16.471 INFO:teuthology.orchestra.run.trial097.stdout: ceph-immutable-object-cache-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:03:16.471 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:03:16.472 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-17T11:03:16.498 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install ceph-radosgw-debuginfo 2026-02-17T11:03:16.798 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:01:34 ago on Tue 17 Feb 2026 11:01:42 AM UTC. 2026-02-17T11:03:16.880 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-17T11:03:16.881 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:03:16.881 INFO:teuthology.orchestra.run.trial097.stdout: Package Arch Version Repo Size 2026-02-17T11:03:16.881 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:03:16.881 INFO:teuthology.orchestra.run.trial097.stdout:Installing: 2026-02-17T11:03:16.881 INFO:teuthology.orchestra.run.trial097.stdout: ceph-radosgw-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 200 M 2026-02-17T11:03:16.881 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:03:16.881 INFO:teuthology.orchestra.run.trial097.stdout:Transaction Summary 2026-02-17T11:03:16.882 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:03:16.882 INFO:teuthology.orchestra.run.trial097.stdout:Install 1 Package 2026-02-17T11:03:16.882 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:03:16.882 INFO:teuthology.orchestra.run.trial097.stdout:Total download size: 200 M 2026-02-17T11:03:16.882 INFO:teuthology.orchestra.run.trial097.stdout:Installed size: 893 M 2026-02-17T11:03:16.882 INFO:teuthology.orchestra.run.trial097.stdout:Downloading Packages: 2026-02-17T11:03:23.446 INFO:teuthology.orchestra.run.trial049.stdout:ceph-common-debuginfo-19.2.3-705.g04cf6dd4.el9. 35 MB/s | 474 MB 00:13 2026-02-17T11:03:23.447 INFO:teuthology.orchestra.run.trial049.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:03:23.447 INFO:teuthology.orchestra.run.trial049.stdout:Total 35 MB/s | 474 MB 00:13 2026-02-17T11:03:23.447 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction check 2026-02-17T11:03:23.449 INFO:teuthology.orchestra.run.trial049.stdout:Transaction check succeeded. 2026-02-17T11:03:23.449 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction test 2026-02-17T11:03:24.859 INFO:teuthology.orchestra.run.trial049.stdout:Transaction test succeeded. 2026-02-17T11:03:24.859 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction 2026-02-17T11:03:26.929 INFO:teuthology.orchestra.run.trial157.stdout: Preparing : 1/1 2026-02-17T11:03:26.947 INFO:teuthology.orchestra.run.trial157.stdout: Installing : ceph-common-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86 1/1 2026-02-17T11:03:28.457 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: ceph-common-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86 1/1 2026-02-17T11:03:28.516 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : ceph-common-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86 1/1 2026-02-17T11:03:28.516 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:03:28.516 INFO:teuthology.orchestra.run.trial157.stdout:Installed: 2026-02-17T11:03:28.516 INFO:teuthology.orchestra.run.trial157.stdout: ceph-common-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:03:28.516 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:03:28.516 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-17T11:03:28.585 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2026-02-17T11:03:28.894 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:01:43 ago on Tue 17 Feb 2026 11:01:45 AM UTC. 2026-02-17T11:03:28.976 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-17T11:03:28.977 INFO:teuthology.orchestra.run.trial157.stdout:======================================================================================= 2026-02-17T11:03:28.977 INFO:teuthology.orchestra.run.trial157.stdout: Package Arch Version Repo Size 2026-02-17T11:03:28.977 INFO:teuthology.orchestra.run.trial157.stdout:======================================================================================= 2026-02-17T11:03:28.977 INFO:teuthology.orchestra.run.trial157.stdout:Installing: 2026-02-17T11:03:28.977 INFO:teuthology.orchestra.run.trial157.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 1.5 M 2026-02-17T11:03:28.977 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:03:28.977 INFO:teuthology.orchestra.run.trial157.stdout:Transaction Summary 2026-02-17T11:03:28.977 INFO:teuthology.orchestra.run.trial157.stdout:======================================================================================= 2026-02-17T11:03:28.978 INFO:teuthology.orchestra.run.trial157.stdout:Install 1 Package 2026-02-17T11:03:28.978 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:03:28.978 INFO:teuthology.orchestra.run.trial157.stdout:Total download size: 1.5 M 2026-02-17T11:03:28.978 INFO:teuthology.orchestra.run.trial157.stdout:Installed size: 7.6 M 2026-02-17T11:03:28.978 INFO:teuthology.orchestra.run.trial157.stdout:Downloading Packages: 2026-02-17T11:03:29.557 INFO:teuthology.orchestra.run.trial157.stdout:ceph-immutable-object-cache-debuginfo-19.2.3-70 2.6 MB/s | 1.5 MB 00:00 2026-02-17T11:03:29.558 INFO:teuthology.orchestra.run.trial157.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:03:29.558 INFO:teuthology.orchestra.run.trial157.stdout:Total 2.6 MB/s | 1.5 MB 00:00 2026-02-17T11:03:29.559 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction check 2026-02-17T11:03:29.560 INFO:teuthology.orchestra.run.trial157.stdout:Transaction check succeeded. 2026-02-17T11:03:29.560 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction test 2026-02-17T11:03:29.581 INFO:teuthology.orchestra.run.trial157.stdout:Transaction test succeeded. 2026-02-17T11:03:29.582 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction 2026-02-17T11:03:29.694 INFO:teuthology.orchestra.run.trial157.stdout: Preparing : 1/1 2026-02-17T11:03:29.711 INFO:teuthology.orchestra.run.trial157.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:19.2.3-705.g 1/1 2026-02-17T11:03:29.771 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:19.2.3-705.g 1/1 2026-02-17T11:03:29.829 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:19.2.3-705.g 1/1 2026-02-17T11:03:29.829 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:03:29.829 INFO:teuthology.orchestra.run.trial157.stdout:Installed: 2026-02-17T11:03:29.829 INFO:teuthology.orchestra.run.trial157.stdout: ceph-immutable-object-cache-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:03:29.829 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:03:29.829 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-17T11:03:29.856 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install ceph-radosgw-debuginfo 2026-02-17T11:03:30.162 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:01:45 ago on Tue 17 Feb 2026 11:01:45 AM UTC. 2026-02-17T11:03:30.244 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-17T11:03:30.245 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:03:30.245 INFO:teuthology.orchestra.run.trial157.stdout: Package Arch Version Repo Size 2026-02-17T11:03:30.246 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:03:30.246 INFO:teuthology.orchestra.run.trial157.stdout:Installing: 2026-02-17T11:03:30.246 INFO:teuthology.orchestra.run.trial157.stdout: ceph-radosgw-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 200 M 2026-02-17T11:03:30.246 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:03:30.246 INFO:teuthology.orchestra.run.trial157.stdout:Transaction Summary 2026-02-17T11:03:30.246 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:03:30.246 INFO:teuthology.orchestra.run.trial157.stdout:Install 1 Package 2026-02-17T11:03:30.246 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:03:30.246 INFO:teuthology.orchestra.run.trial157.stdout:Total download size: 200 M 2026-02-17T11:03:30.246 INFO:teuthology.orchestra.run.trial157.stdout:Installed size: 893 M 2026-02-17T11:03:30.246 INFO:teuthology.orchestra.run.trial157.stdout:Downloading Packages: 2026-02-17T11:03:33.359 INFO:teuthology.orchestra.run.trial162.stdout:ceph-common-debuginfo-19.2.3-705.g04cf6dd4.el9. 21 MB/s | 474 MB 00:22 2026-02-17T11:03:33.360 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:03:33.360 INFO:teuthology.orchestra.run.trial162.stdout:Total 21 MB/s | 474 MB 00:22 2026-02-17T11:03:33.360 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-17T11:03:33.362 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-17T11:03:33.362 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-17T11:03:34.774 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-17T11:03:34.774 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-17T11:03:36.509 INFO:teuthology.orchestra.run.trial157.stdout:ceph-radosgw-debuginfo-19.2.3-705.g04cf6dd4.el9 32 MB/s | 200 MB 00:06 2026-02-17T11:03:36.509 INFO:teuthology.orchestra.run.trial157.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:03:36.510 INFO:teuthology.orchestra.run.trial157.stdout:Total 32 MB/s | 200 MB 00:06 2026-02-17T11:03:36.510 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction check 2026-02-17T11:03:36.512 INFO:teuthology.orchestra.run.trial157.stdout:Transaction check succeeded. 2026-02-17T11:03:36.512 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction test 2026-02-17T11:03:37.119 INFO:teuthology.orchestra.run.trial157.stdout:Transaction test succeeded. 2026-02-17T11:03:37.119 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction 2026-02-17T11:03:37.546 INFO:teuthology.orchestra.run.trial097.stdout:ceph-radosgw-debuginfo-19.2.3-705.g04cf6dd4.el9 9.7 MB/s | 200 MB 00:20 2026-02-17T11:03:37.547 INFO:teuthology.orchestra.run.trial097.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:03:37.547 INFO:teuthology.orchestra.run.trial097.stdout:Total 9.7 MB/s | 200 MB 00:20 2026-02-17T11:03:37.547 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction check 2026-02-17T11:03:37.549 INFO:teuthology.orchestra.run.trial097.stdout:Transaction check succeeded. 2026-02-17T11:03:37.549 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction test 2026-02-17T11:03:38.155 INFO:teuthology.orchestra.run.trial097.stdout:Transaction test succeeded. 2026-02-17T11:03:38.155 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction 2026-02-17T11:03:47.361 INFO:teuthology.orchestra.run.trial157.stdout: Preparing : 1/1 2026-02-17T11:03:47.379 INFO:teuthology.orchestra.run.trial157.stdout: Installing : ceph-radosgw-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x8 1/1 2026-02-17T11:03:48.062 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x8 1/1 2026-02-17T11:03:48.120 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : ceph-radosgw-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x8 1/1 2026-02-17T11:03:48.121 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:03:48.121 INFO:teuthology.orchestra.run.trial157.stdout:Installed: 2026-02-17T11:03:48.121 INFO:teuthology.orchestra.run.trial157.stdout: ceph-radosgw-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:03:48.121 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:03:48.121 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-17T11:03:48.167 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install ceph-test-debuginfo 2026-02-17T11:03:48.169 INFO:teuthology.orchestra.run.trial097.stdout: Preparing : 1/1 2026-02-17T11:03:48.185 INFO:teuthology.orchestra.run.trial097.stdout: Installing : ceph-radosgw-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x8 1/1 2026-02-17T11:03:48.392 INFO:teuthology.orchestra.run.trial049.stdout: Preparing : 1/1 2026-02-17T11:03:48.410 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-common-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86 1/1 2026-02-17T11:03:48.486 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:02:03 ago on Tue 17 Feb 2026 11:01:45 AM UTC. 2026-02-17T11:03:48.569 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-17T11:03:48.570 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:03:48.571 INFO:teuthology.orchestra.run.trial157.stdout: Package Arch Version Repo Size 2026-02-17T11:03:48.571 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:03:48.571 INFO:teuthology.orchestra.run.trial157.stdout:Installing: 2026-02-17T11:03:48.571 INFO:teuthology.orchestra.run.trial157.stdout: ceph-test-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 729 M 2026-02-17T11:03:48.571 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:03:48.571 INFO:teuthology.orchestra.run.trial157.stdout:Transaction Summary 2026-02-17T11:03:48.571 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:03:48.571 INFO:teuthology.orchestra.run.trial157.stdout:Install 1 Package 2026-02-17T11:03:48.571 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:03:48.571 INFO:teuthology.orchestra.run.trial157.stdout:Total download size: 729 M 2026-02-17T11:03:48.572 INFO:teuthology.orchestra.run.trial157.stdout:Installed size: 3.6 G 2026-02-17T11:03:48.572 INFO:teuthology.orchestra.run.trial157.stdout:Downloading Packages: 2026-02-17T11:03:48.882 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x8 1/1 2026-02-17T11:03:48.941 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : ceph-radosgw-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x8 1/1 2026-02-17T11:03:48.941 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:03:48.941 INFO:teuthology.orchestra.run.trial097.stdout:Installed: 2026-02-17T11:03:48.941 INFO:teuthology.orchestra.run.trial097.stdout: ceph-radosgw-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:03:48.941 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:03:48.942 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-17T11:03:48.988 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install ceph-test-debuginfo 2026-02-17T11:03:49.294 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:02:07 ago on Tue 17 Feb 2026 11:01:42 AM UTC. 2026-02-17T11:03:49.376 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-17T11:03:49.377 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:03:49.377 INFO:teuthology.orchestra.run.trial097.stdout: Package Arch Version Repo Size 2026-02-17T11:03:49.377 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:03:49.377 INFO:teuthology.orchestra.run.trial097.stdout:Installing: 2026-02-17T11:03:49.378 INFO:teuthology.orchestra.run.trial097.stdout: ceph-test-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 729 M 2026-02-17T11:03:49.378 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:03:49.378 INFO:teuthology.orchestra.run.trial097.stdout:Transaction Summary 2026-02-17T11:03:49.378 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:03:49.378 INFO:teuthology.orchestra.run.trial097.stdout:Install 1 Package 2026-02-17T11:03:49.378 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:03:49.378 INFO:teuthology.orchestra.run.trial097.stdout:Total download size: 729 M 2026-02-17T11:03:49.378 INFO:teuthology.orchestra.run.trial097.stdout:Installed size: 3.6 G 2026-02-17T11:03:49.378 INFO:teuthology.orchestra.run.trial097.stdout:Downloading Packages: 2026-02-17T11:03:49.915 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-common-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86 1/1 2026-02-17T11:03:49.974 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-common-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86 1/1 2026-02-17T11:03:49.974 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:03:49.974 INFO:teuthology.orchestra.run.trial049.stdout:Installed: 2026-02-17T11:03:49.974 INFO:teuthology.orchestra.run.trial049.stdout: ceph-common-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:03:49.974 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:03:49.974 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-17T11:03:50.050 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2026-02-17T11:03:50.364 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:01:41 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:03:50.446 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-17T11:03:50.447 INFO:teuthology.orchestra.run.trial049.stdout:======================================================================================= 2026-02-17T11:03:50.447 INFO:teuthology.orchestra.run.trial049.stdout: Package Arch Version Repo Size 2026-02-17T11:03:50.447 INFO:teuthology.orchestra.run.trial049.stdout:======================================================================================= 2026-02-17T11:03:50.447 INFO:teuthology.orchestra.run.trial049.stdout:Installing: 2026-02-17T11:03:50.447 INFO:teuthology.orchestra.run.trial049.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 1.5 M 2026-02-17T11:03:50.447 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:03:50.447 INFO:teuthology.orchestra.run.trial049.stdout:Transaction Summary 2026-02-17T11:03:50.447 INFO:teuthology.orchestra.run.trial049.stdout:======================================================================================= 2026-02-17T11:03:50.448 INFO:teuthology.orchestra.run.trial049.stdout:Install 1 Package 2026-02-17T11:03:50.448 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:03:50.448 INFO:teuthology.orchestra.run.trial049.stdout:Total download size: 1.5 M 2026-02-17T11:03:50.448 INFO:teuthology.orchestra.run.trial049.stdout:Installed size: 7.6 M 2026-02-17T11:03:50.448 INFO:teuthology.orchestra.run.trial049.stdout:Downloading Packages: 2026-02-17T11:03:51.088 INFO:teuthology.orchestra.run.trial049.stdout:ceph-immutable-object-cache-debuginfo-19.2.3-70 2.4 MB/s | 1.5 MB 00:00 2026-02-17T11:03:51.089 INFO:teuthology.orchestra.run.trial049.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:03:51.089 INFO:teuthology.orchestra.run.trial049.stdout:Total 2.4 MB/s | 1.5 MB 00:00 2026-02-17T11:03:51.089 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction check 2026-02-17T11:03:51.090 INFO:teuthology.orchestra.run.trial049.stdout:Transaction check succeeded. 2026-02-17T11:03:51.090 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction test 2026-02-17T11:03:51.112 INFO:teuthology.orchestra.run.trial049.stdout:Transaction test succeeded. 2026-02-17T11:03:51.112 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction 2026-02-17T11:03:51.225 INFO:teuthology.orchestra.run.trial049.stdout: Preparing : 1/1 2026-02-17T11:03:51.242 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:19.2.3-705.g 1/1 2026-02-17T11:03:51.300 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:19.2.3-705.g 1/1 2026-02-17T11:03:51.357 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:19.2.3-705.g 1/1 2026-02-17T11:03:51.358 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:03:51.358 INFO:teuthology.orchestra.run.trial049.stdout:Installed: 2026-02-17T11:03:51.358 INFO:teuthology.orchestra.run.trial049.stdout: ceph-immutable-object-cache-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:03:51.358 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:03:51.358 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-17T11:03:51.384 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-radosgw-debuginfo 2026-02-17T11:03:51.695 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:01:42 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:03:51.779 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-17T11:03:51.779 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:03:51.779 INFO:teuthology.orchestra.run.trial049.stdout: Package Arch Version Repo Size 2026-02-17T11:03:51.779 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:03:51.779 INFO:teuthology.orchestra.run.trial049.stdout:Installing: 2026-02-17T11:03:51.779 INFO:teuthology.orchestra.run.trial049.stdout: ceph-radosgw-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 200 M 2026-02-17T11:03:51.779 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:03:51.779 INFO:teuthology.orchestra.run.trial049.stdout:Transaction Summary 2026-02-17T11:03:51.780 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:03:51.780 INFO:teuthology.orchestra.run.trial049.stdout:Install 1 Package 2026-02-17T11:03:51.780 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:03:51.780 INFO:teuthology.orchestra.run.trial049.stdout:Total download size: 200 M 2026-02-17T11:03:51.780 INFO:teuthology.orchestra.run.trial049.stdout:Installed size: 893 M 2026-02-17T11:03:51.780 INFO:teuthology.orchestra.run.trial049.stdout:Downloading Packages: 2026-02-17T11:03:58.300 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-17T11:03:58.319 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-common-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86 1/1 2026-02-17T11:03:59.814 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-common-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86 1/1 2026-02-17T11:03:59.872 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-common-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86 1/1 2026-02-17T11:03:59.872 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:03:59.872 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-17T11:03:59.872 INFO:teuthology.orchestra.run.trial162.stdout: ceph-common-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:03:59.872 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:03:59.872 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T11:03:59.940 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2026-02-17T11:04:00.252 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:01:51 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:04:00.333 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T11:04:00.334 INFO:teuthology.orchestra.run.trial162.stdout:======================================================================================= 2026-02-17T11:04:00.334 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repo Size 2026-02-17T11:04:00.334 INFO:teuthology.orchestra.run.trial162.stdout:======================================================================================= 2026-02-17T11:04:00.334 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-17T11:04:00.334 INFO:teuthology.orchestra.run.trial162.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 1.5 M 2026-02-17T11:04:00.334 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:04:00.334 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-17T11:04:00.335 INFO:teuthology.orchestra.run.trial162.stdout:======================================================================================= 2026-02-17T11:04:00.335 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-17T11:04:00.335 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:04:00.335 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 1.5 M 2026-02-17T11:04:00.335 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 7.6 M 2026-02-17T11:04:00.335 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-17T11:04:00.743 INFO:teuthology.orchestra.run.trial162.stdout:ceph-immutable-object-cache-debuginfo-19.2.3-70 3.8 MB/s | 1.5 MB 00:00 2026-02-17T11:04:00.744 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:04:00.744 INFO:teuthology.orchestra.run.trial162.stdout:Total 3.8 MB/s | 1.5 MB 00:00 2026-02-17T11:04:00.744 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-17T11:04:00.745 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-17T11:04:00.745 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-17T11:04:00.767 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-17T11:04:00.767 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-17T11:04:00.881 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-17T11:04:00.898 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:19.2.3-705.g 1/1 2026-02-17T11:04:00.961 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:19.2.3-705.g 1/1 2026-02-17T11:04:01.019 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:19.2.3-705.g 1/1 2026-02-17T11:04:01.019 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:04:01.019 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-17T11:04:01.019 INFO:teuthology.orchestra.run.trial162.stdout: ceph-immutable-object-cache-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:04:01.020 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:04:01.020 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T11:04:01.047 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install ceph-radosgw-debuginfo 2026-02-17T11:04:01.358 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:01:52 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:04:01.441 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T11:04:01.442 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:04:01.442 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repo Size 2026-02-17T11:04:01.443 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:04:01.443 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-17T11:04:01.443 INFO:teuthology.orchestra.run.trial162.stdout: ceph-radosgw-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 200 M 2026-02-17T11:04:01.443 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:04:01.443 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-17T11:04:01.443 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:04:01.443 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-17T11:04:01.443 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:04:01.443 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 200 M 2026-02-17T11:04:01.443 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 893 M 2026-02-17T11:04:01.443 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-17T11:04:12.046 INFO:teuthology.orchestra.run.trial162.stdout:ceph-radosgw-debuginfo-19.2.3-705.g04cf6dd4.el9 19 MB/s | 200 MB 00:10 2026-02-17T11:04:12.046 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:04:12.047 INFO:teuthology.orchestra.run.trial162.stdout:Total 19 MB/s | 200 MB 00:10 2026-02-17T11:04:12.047 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-17T11:04:12.048 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-17T11:04:12.048 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-17T11:04:12.653 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-17T11:04:12.654 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-17T11:04:12.664 INFO:teuthology.orchestra.run.trial049.stdout:ceph-radosgw-debuginfo-19.2.3-705.g04cf6dd4.el9 9.6 MB/s | 200 MB 00:20 2026-02-17T11:04:12.665 INFO:teuthology.orchestra.run.trial049.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:04:12.665 INFO:teuthology.orchestra.run.trial049.stdout:Total 9.6 MB/s | 200 MB 00:20 2026-02-17T11:04:12.665 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction check 2026-02-17T11:04:12.667 INFO:teuthology.orchestra.run.trial049.stdout:Transaction check succeeded. 2026-02-17T11:04:12.667 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction test 2026-02-17T11:04:13.276 INFO:teuthology.orchestra.run.trial049.stdout:Transaction test succeeded. 2026-02-17T11:04:13.276 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction 2026-02-17T11:04:17.938 INFO:teuthology.orchestra.run.trial157.stdout:ceph-test-debuginfo-19.2.3-705.g04cf6dd4.el9.x8 25 MB/s | 729 MB 00:29 2026-02-17T11:04:17.939 INFO:teuthology.orchestra.run.trial157.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:04:17.939 INFO:teuthology.orchestra.run.trial157.stdout:Total 25 MB/s | 729 MB 00:29 2026-02-17T11:04:17.939 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction check 2026-02-17T11:04:17.942 INFO:teuthology.orchestra.run.trial157.stdout:Transaction check succeeded. 2026-02-17T11:04:17.942 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction test 2026-02-17T11:04:20.101 INFO:teuthology.orchestra.run.trial157.stdout:Transaction test succeeded. 2026-02-17T11:04:20.101 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction 2026-02-17T11:04:23.088 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-17T11:04:23.106 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-radosgw-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x8 1/1 2026-02-17T11:04:23.668 INFO:teuthology.orchestra.run.trial049.stdout: Preparing : 1/1 2026-02-17T11:04:23.685 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-radosgw-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x8 1/1 2026-02-17T11:04:23.756 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x8 1/1 2026-02-17T11:04:23.813 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-radosgw-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x8 1/1 2026-02-17T11:04:23.814 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:04:23.814 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-17T11:04:23.814 INFO:teuthology.orchestra.run.trial162.stdout: ceph-radosgw-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:04:23.814 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:04:23.814 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T11:04:23.857 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install ceph-test-debuginfo 2026-02-17T11:04:24.171 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:02:15 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:04:24.254 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T11:04:24.255 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:04:24.255 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repo Size 2026-02-17T11:04:24.255 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:04:24.255 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-17T11:04:24.255 INFO:teuthology.orchestra.run.trial162.stdout: ceph-test-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 729 M 2026-02-17T11:04:24.256 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:04:24.256 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-17T11:04:24.256 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:04:24.256 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-17T11:04:24.256 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:04:24.256 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 729 M 2026-02-17T11:04:24.256 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 3.6 G 2026-02-17T11:04:24.256 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-17T11:04:24.328 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x8 1/1 2026-02-17T11:04:24.388 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-radosgw-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x8 1/1 2026-02-17T11:04:24.388 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:04:24.388 INFO:teuthology.orchestra.run.trial049.stdout:Installed: 2026-02-17T11:04:24.388 INFO:teuthology.orchestra.run.trial049.stdout: ceph-radosgw-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:04:24.388 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:04:24.388 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-17T11:04:24.434 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-test-debuginfo 2026-02-17T11:04:24.746 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:02:15 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:04:24.830 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-17T11:04:24.830 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:04:24.830 INFO:teuthology.orchestra.run.trial049.stdout: Package Arch Version Repo Size 2026-02-17T11:04:24.831 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:04:24.831 INFO:teuthology.orchestra.run.trial049.stdout:Installing: 2026-02-17T11:04:24.831 INFO:teuthology.orchestra.run.trial049.stdout: ceph-test-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 729 M 2026-02-17T11:04:24.831 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:04:24.831 INFO:teuthology.orchestra.run.trial049.stdout:Transaction Summary 2026-02-17T11:04:24.831 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:04:24.831 INFO:teuthology.orchestra.run.trial049.stdout:Install 1 Package 2026-02-17T11:04:24.831 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:04:24.831 INFO:teuthology.orchestra.run.trial049.stdout:Total download size: 729 M 2026-02-17T11:04:24.831 INFO:teuthology.orchestra.run.trial049.stdout:Installed size: 3.6 G 2026-02-17T11:04:24.832 INFO:teuthology.orchestra.run.trial049.stdout:Downloading Packages: 2026-02-17T11:04:37.929 INFO:teuthology.orchestra.run.trial097.stdout:ceph-test-debuginfo-19.2.3-705.g04cf6dd4.el9.x8 15 MB/s | 729 MB 00:48 2026-02-17T11:04:37.930 INFO:teuthology.orchestra.run.trial097.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:04:37.930 INFO:teuthology.orchestra.run.trial097.stdout:Total 15 MB/s | 729 MB 00:48 2026-02-17T11:04:37.930 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction check 2026-02-17T11:04:37.933 INFO:teuthology.orchestra.run.trial097.stdout:Transaction check succeeded. 2026-02-17T11:04:37.933 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction test 2026-02-17T11:04:40.086 INFO:teuthology.orchestra.run.trial097.stdout:Transaction test succeeded. 2026-02-17T11:04:40.086 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction 2026-02-17T11:04:44.922 INFO:teuthology.orchestra.run.trial162.stdout:ceph-test-debuginfo-19.2.3-705.g04cf6dd4.el9.x8 35 MB/s | 729 MB 00:20 2026-02-17T11:04:44.923 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:04:44.923 INFO:teuthology.orchestra.run.trial162.stdout:Total 35 MB/s | 729 MB 00:20 2026-02-17T11:04:44.923 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-17T11:04:44.926 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-17T11:04:44.926 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-17T11:04:47.087 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-17T11:04:47.087 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-17T11:04:55.408 INFO:teuthology.orchestra.run.trial049.stdout:ceph-test-debuginfo-19.2.3-705.g04cf6dd4.el9.x8 24 MB/s | 729 MB 00:30 2026-02-17T11:04:55.409 INFO:teuthology.orchestra.run.trial049.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:04:55.409 INFO:teuthology.orchestra.run.trial049.stdout:Total 24 MB/s | 729 MB 00:30 2026-02-17T11:04:55.410 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction check 2026-02-17T11:04:55.412 INFO:teuthology.orchestra.run.trial049.stdout:Transaction check succeeded. 2026-02-17T11:04:55.413 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction test 2026-02-17T11:04:57.579 INFO:teuthology.orchestra.run.trial049.stdout:Transaction test succeeded. 2026-02-17T11:04:57.579 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction 2026-02-17T11:04:58.567 INFO:teuthology.orchestra.run.trial157.stdout: Preparing : 1/1 2026-02-17T11:04:58.586 INFO:teuthology.orchestra.run.trial157.stdout: Installing : ceph-test-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_6 1/1 2026-02-17T11:05:01.023 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: ceph-test-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_6 1/1 2026-02-17T11:05:01.081 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : ceph-test-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_6 1/1 2026-02-17T11:05:01.081 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:05:01.082 INFO:teuthology.orchestra.run.trial157.stdout:Installed: 2026-02-17T11:05:01.082 INFO:teuthology.orchestra.run.trial157.stdout: ceph-test-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:05:01.082 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:05:01.082 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-17T11:05:01.180 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install ceph-base-debuginfo 2026-02-17T11:05:01.495 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:03:16 ago on Tue 17 Feb 2026 11:01:45 AM UTC. 2026-02-17T11:05:01.561 INFO:teuthology.orchestra.run.trial157.stdout:Package ceph-base-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T11:05:01.579 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-17T11:05:01.580 INFO:teuthology.orchestra.run.trial157.stdout:Nothing to do. 2026-02-17T11:05:01.580 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-17T11:05:01.602 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install ceph-mgr-debuginfo 2026-02-17T11:05:01.913 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:03:16 ago on Tue 17 Feb 2026 11:01:45 AM UTC. 2026-02-17T11:05:01.995 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-17T11:05:01.996 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:05:01.996 INFO:teuthology.orchestra.run.trial157.stdout: Package Arch Version Repo Size 2026-02-17T11:05:01.996 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:05:01.996 INFO:teuthology.orchestra.run.trial157.stdout:Installing: 2026-02-17T11:05:01.996 INFO:teuthology.orchestra.run.trial157.stdout: ceph-mgr-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 18 M 2026-02-17T11:05:01.996 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:05:01.996 INFO:teuthology.orchestra.run.trial157.stdout:Transaction Summary 2026-02-17T11:05:01.996 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:05:01.996 INFO:teuthology.orchestra.run.trial157.stdout:Install 1 Package 2026-02-17T11:05:01.997 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:05:01.997 INFO:teuthology.orchestra.run.trial157.stdout:Total download size: 18 M 2026-02-17T11:05:01.997 INFO:teuthology.orchestra.run.trial157.stdout:Installed size: 110 M 2026-02-17T11:05:01.997 INFO:teuthology.orchestra.run.trial157.stdout:Downloading Packages: 2026-02-17T11:05:02.871 INFO:teuthology.orchestra.run.trial157.stdout:ceph-mgr-debuginfo-19.2.3-705.g04cf6dd4.el9.x86 21 MB/s | 18 MB 00:00 2026-02-17T11:05:02.872 INFO:teuthology.orchestra.run.trial157.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:05:02.872 INFO:teuthology.orchestra.run.trial157.stdout:Total 21 MB/s | 18 MB 00:00 2026-02-17T11:05:02.872 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction check 2026-02-17T11:05:02.874 INFO:teuthology.orchestra.run.trial157.stdout:Transaction check succeeded. 2026-02-17T11:05:02.874 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction test 2026-02-17T11:05:02.945 INFO:teuthology.orchestra.run.trial157.stdout:Transaction test succeeded. 2026-02-17T11:05:02.945 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction 2026-02-17T11:05:03.961 INFO:teuthology.orchestra.run.trial157.stdout: Preparing : 1/1 2026-02-17T11:05:03.978 INFO:teuthology.orchestra.run.trial157.stdout: Installing : ceph-mgr-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:05:04.115 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: ceph-mgr-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:05:04.173 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : ceph-mgr-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:05:04.173 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:05:04.173 INFO:teuthology.orchestra.run.trial157.stdout:Installed: 2026-02-17T11:05:04.174 INFO:teuthology.orchestra.run.trial157.stdout: ceph-mgr-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:05:04.174 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:05:04.174 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-17T11:05:04.203 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install ceph-mds-debuginfo 2026-02-17T11:05:04.514 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:03:19 ago on Tue 17 Feb 2026 11:01:45 AM UTC. 2026-02-17T11:05:04.595 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-17T11:05:04.596 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:05:04.596 INFO:teuthology.orchestra.run.trial157.stdout: Package Arch Version Repo Size 2026-02-17T11:05:04.596 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:05:04.596 INFO:teuthology.orchestra.run.trial157.stdout:Installing: 2026-02-17T11:05:04.597 INFO:teuthology.orchestra.run.trial157.stdout: ceph-mds-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 55 M 2026-02-17T11:05:04.597 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:05:04.597 INFO:teuthology.orchestra.run.trial157.stdout:Transaction Summary 2026-02-17T11:05:04.597 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:05:04.597 INFO:teuthology.orchestra.run.trial157.stdout:Install 1 Package 2026-02-17T11:05:04.597 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:05:04.597 INFO:teuthology.orchestra.run.trial157.stdout:Total download size: 55 M 2026-02-17T11:05:04.597 INFO:teuthology.orchestra.run.trial157.stdout:Installed size: 211 M 2026-02-17T11:05:04.597 INFO:teuthology.orchestra.run.trial157.stdout:Downloading Packages: 2026-02-17T11:05:05.947 INFO:teuthology.orchestra.run.trial157.stdout:ceph-mds-debuginfo-19.2.3-705.g04cf6dd4.el9.x86 41 MB/s | 55 MB 00:01 2026-02-17T11:05:05.948 INFO:teuthology.orchestra.run.trial157.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:05:05.948 INFO:teuthology.orchestra.run.trial157.stdout:Total 41 MB/s | 55 MB 00:01 2026-02-17T11:05:05.948 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction check 2026-02-17T11:05:05.950 INFO:teuthology.orchestra.run.trial157.stdout:Transaction check succeeded. 2026-02-17T11:05:05.950 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction test 2026-02-17T11:05:06.130 INFO:teuthology.orchestra.run.trial157.stdout:Transaction test succeeded. 2026-02-17T11:05:06.130 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction 2026-02-17T11:05:08.807 INFO:teuthology.orchestra.run.trial157.stdout: Preparing : 1/1 2026-02-17T11:05:08.824 INFO:teuthology.orchestra.run.trial157.stdout: Installing : ceph-mds-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:05:09.030 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: ceph-mds-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:05:09.089 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : ceph-mds-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:05:09.089 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:05:09.089 INFO:teuthology.orchestra.run.trial157.stdout:Installed: 2026-02-17T11:05:09.089 INFO:teuthology.orchestra.run.trial157.stdout: ceph-mds-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:05:09.089 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:05:09.089 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-17T11:05:09.120 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install ceph-mon-debuginfo 2026-02-17T11:05:09.437 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:03:24 ago on Tue 17 Feb 2026 11:01:45 AM UTC. 2026-02-17T11:05:09.519 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-17T11:05:09.520 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:05:09.520 INFO:teuthology.orchestra.run.trial157.stdout: Package Arch Version Repo Size 2026-02-17T11:05:09.520 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:05:09.520 INFO:teuthology.orchestra.run.trial157.stdout:Installing: 2026-02-17T11:05:09.521 INFO:teuthology.orchestra.run.trial157.stdout: ceph-mon-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 102 M 2026-02-17T11:05:09.521 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:05:09.521 INFO:teuthology.orchestra.run.trial157.stdout:Transaction Summary 2026-02-17T11:05:09.521 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:05:09.521 INFO:teuthology.orchestra.run.trial157.stdout:Install 1 Package 2026-02-17T11:05:09.521 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:05:09.521 INFO:teuthology.orchestra.run.trial157.stdout:Total download size: 102 M 2026-02-17T11:05:09.521 INFO:teuthology.orchestra.run.trial157.stdout:Installed size: 497 M 2026-02-17T11:05:09.521 INFO:teuthology.orchestra.run.trial157.stdout:Downloading Packages: 2026-02-17T11:05:11.701 INFO:teuthology.orchestra.run.trial157.stdout:ceph-mon-debuginfo-19.2.3-705.g04cf6dd4.el9.x86 47 MB/s | 102 MB 00:02 2026-02-17T11:05:11.702 INFO:teuthology.orchestra.run.trial157.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:05:11.702 INFO:teuthology.orchestra.run.trial157.stdout:Total 47 MB/s | 102 MB 00:02 2026-02-17T11:05:11.702 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction check 2026-02-17T11:05:11.704 INFO:teuthology.orchestra.run.trial157.stdout:Transaction check succeeded. 2026-02-17T11:05:11.704 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction test 2026-02-17T11:05:12.020 INFO:teuthology.orchestra.run.trial157.stdout:Transaction test succeeded. 2026-02-17T11:05:12.020 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction 2026-02-17T11:05:17.229 INFO:teuthology.orchestra.run.trial157.stdout: Preparing : 1/1 2026-02-17T11:05:17.247 INFO:teuthology.orchestra.run.trial157.stdout: Installing : ceph-mon-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:05:17.664 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: ceph-mon-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:05:17.723 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : ceph-mon-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:05:17.723 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:05:17.723 INFO:teuthology.orchestra.run.trial157.stdout:Installed: 2026-02-17T11:05:17.723 INFO:teuthology.orchestra.run.trial157.stdout: ceph-mon-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:05:17.723 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:05:17.723 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-17T11:05:17.759 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install ceph-osd-debuginfo 2026-02-17T11:05:18.071 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:03:33 ago on Tue 17 Feb 2026 11:01:45 AM UTC. 2026-02-17T11:05:18.154 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-17T11:05:18.155 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:05:18.156 INFO:teuthology.orchestra.run.trial157.stdout: Package Arch Version Repo Size 2026-02-17T11:05:18.156 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:05:18.156 INFO:teuthology.orchestra.run.trial157.stdout:Installing: 2026-02-17T11:05:18.156 INFO:teuthology.orchestra.run.trial157.stdout: ceph-osd-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 298 M 2026-02-17T11:05:18.156 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:05:18.156 INFO:teuthology.orchestra.run.trial157.stdout:Transaction Summary 2026-02-17T11:05:18.156 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:05:18.156 INFO:teuthology.orchestra.run.trial157.stdout:Install 1 Package 2026-02-17T11:05:18.156 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:05:18.157 INFO:teuthology.orchestra.run.trial157.stdout:Total download size: 298 M 2026-02-17T11:05:18.157 INFO:teuthology.orchestra.run.trial157.stdout:Installed size: 1.4 G 2026-02-17T11:05:18.157 INFO:teuthology.orchestra.run.trial157.stdout:Downloading Packages: 2026-02-17T11:05:19.572 INFO:teuthology.orchestra.run.trial097.stdout: Preparing : 1/1 2026-02-17T11:05:19.591 INFO:teuthology.orchestra.run.trial097.stdout: Installing : ceph-test-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_6 1/1 2026-02-17T11:05:20.586 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: ceph-test-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_6 1/1 2026-02-17T11:05:20.645 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : ceph-test-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_6 1/1 2026-02-17T11:05:20.645 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:05:20.645 INFO:teuthology.orchestra.run.trial097.stdout:Installed: 2026-02-17T11:05:20.645 INFO:teuthology.orchestra.run.trial097.stdout: ceph-test-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:05:20.645 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:05:20.646 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-17T11:05:20.745 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install ceph-base-debuginfo 2026-02-17T11:05:21.056 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:03:39 ago on Tue 17 Feb 2026 11:01:42 AM UTC. 2026-02-17T11:05:21.120 INFO:teuthology.orchestra.run.trial097.stdout:Package ceph-base-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T11:05:21.138 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-17T11:05:21.139 INFO:teuthology.orchestra.run.trial097.stdout:Nothing to do. 2026-02-17T11:05:21.139 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-17T11:05:21.161 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install ceph-mgr-debuginfo 2026-02-17T11:05:21.470 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:03:39 ago on Tue 17 Feb 2026 11:01:42 AM UTC. 2026-02-17T11:05:21.554 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-17T11:05:21.554 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:05:21.554 INFO:teuthology.orchestra.run.trial097.stdout: Package Arch Version Repo Size 2026-02-17T11:05:21.554 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:05:21.554 INFO:teuthology.orchestra.run.trial097.stdout:Installing: 2026-02-17T11:05:21.555 INFO:teuthology.orchestra.run.trial097.stdout: ceph-mgr-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 18 M 2026-02-17T11:05:21.555 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:05:21.555 INFO:teuthology.orchestra.run.trial097.stdout:Transaction Summary 2026-02-17T11:05:21.555 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:05:21.555 INFO:teuthology.orchestra.run.trial097.stdout:Install 1 Package 2026-02-17T11:05:21.555 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:05:21.555 INFO:teuthology.orchestra.run.trial097.stdout:Total download size: 18 M 2026-02-17T11:05:21.555 INFO:teuthology.orchestra.run.trial097.stdout:Installed size: 110 M 2026-02-17T11:05:21.555 INFO:teuthology.orchestra.run.trial097.stdout:Downloading Packages: 2026-02-17T11:05:23.306 INFO:teuthology.orchestra.run.trial097.stdout:ceph-mgr-debuginfo-19.2.3-705.g04cf6dd4.el9.x86 10 MB/s | 18 MB 00:01 2026-02-17T11:05:23.307 INFO:teuthology.orchestra.run.trial097.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:05:23.307 INFO:teuthology.orchestra.run.trial097.stdout:Total 10 MB/s | 18 MB 00:01 2026-02-17T11:05:23.307 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction check 2026-02-17T11:05:23.309 INFO:teuthology.orchestra.run.trial097.stdout:Transaction check succeeded. 2026-02-17T11:05:23.309 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction test 2026-02-17T11:05:23.380 INFO:teuthology.orchestra.run.trial097.stdout:Transaction test succeeded. 2026-02-17T11:05:23.380 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction 2026-02-17T11:05:24.211 INFO:teuthology.orchestra.run.trial157.stdout:ceph-osd-debuginfo-19.2.3-705.g04cf6dd4.el9.x86 49 MB/s | 298 MB 00:06 2026-02-17T11:05:24.212 INFO:teuthology.orchestra.run.trial157.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:05:24.212 INFO:teuthology.orchestra.run.trial157.stdout:Total 49 MB/s | 298 MB 00:06 2026-02-17T11:05:24.212 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction check 2026-02-17T11:05:24.214 INFO:teuthology.orchestra.run.trial157.stdout:Transaction check succeeded. 2026-02-17T11:05:24.214 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction test 2026-02-17T11:05:24.412 INFO:teuthology.orchestra.run.trial097.stdout: Preparing : 1/1 2026-02-17T11:05:24.429 INFO:teuthology.orchestra.run.trial097.stdout: Installing : ceph-mgr-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:05:24.560 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: ceph-mgr-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:05:24.618 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : ceph-mgr-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:05:24.619 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:05:24.619 INFO:teuthology.orchestra.run.trial097.stdout:Installed: 2026-02-17T11:05:24.619 INFO:teuthology.orchestra.run.trial097.stdout: ceph-mgr-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:05:24.619 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:05:24.619 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-17T11:05:24.649 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install ceph-mds-debuginfo 2026-02-17T11:05:24.758 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-17T11:05:24.778 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-test-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_6 1/1 2026-02-17T11:05:24.954 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:03:42 ago on Tue 17 Feb 2026 11:01:42 AM UTC. 2026-02-17T11:05:25.036 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-17T11:05:25.036 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:05:25.036 INFO:teuthology.orchestra.run.trial097.stdout: Package Arch Version Repo Size 2026-02-17T11:05:25.037 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:05:25.037 INFO:teuthology.orchestra.run.trial097.stdout:Installing: 2026-02-17T11:05:25.037 INFO:teuthology.orchestra.run.trial097.stdout: ceph-mds-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 55 M 2026-02-17T11:05:25.037 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:05:25.037 INFO:teuthology.orchestra.run.trial097.stdout:Transaction Summary 2026-02-17T11:05:25.037 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:05:25.037 INFO:teuthology.orchestra.run.trial097.stdout:Install 1 Package 2026-02-17T11:05:25.037 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:05:25.037 INFO:teuthology.orchestra.run.trial097.stdout:Total download size: 55 M 2026-02-17T11:05:25.037 INFO:teuthology.orchestra.run.trial097.stdout:Installed size: 211 M 2026-02-17T11:05:25.038 INFO:teuthology.orchestra.run.trial097.stdout:Downloading Packages: 2026-02-17T11:05:25.105 INFO:teuthology.orchestra.run.trial157.stdout:Transaction test succeeded. 2026-02-17T11:05:25.106 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction 2026-02-17T11:05:26.148 INFO:teuthology.orchestra.run.trial097.stdout:ceph-mds-debuginfo-19.2.3-705.g04cf6dd4.el9.x86 50 MB/s | 55 MB 00:01 2026-02-17T11:05:26.149 INFO:teuthology.orchestra.run.trial097.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:05:26.149 INFO:teuthology.orchestra.run.trial097.stdout:Total 50 MB/s | 55 MB 00:01 2026-02-17T11:05:26.149 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction check 2026-02-17T11:05:26.151 INFO:teuthology.orchestra.run.trial097.stdout:Transaction check succeeded. 2026-02-17T11:05:26.151 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction test 2026-02-17T11:05:26.332 INFO:teuthology.orchestra.run.trial097.stdout:Transaction test succeeded. 2026-02-17T11:05:26.332 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction 2026-02-17T11:05:27.216 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-test-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_6 1/1 2026-02-17T11:05:27.274 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-test-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_6 1/1 2026-02-17T11:05:27.274 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:05:27.274 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-17T11:05:27.274 INFO:teuthology.orchestra.run.trial162.stdout: ceph-test-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:05:27.274 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:05:27.274 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T11:05:27.370 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install ceph-base-debuginfo 2026-02-17T11:05:27.681 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:03:18 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:05:27.746 INFO:teuthology.orchestra.run.trial162.stdout:Package ceph-base-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T11:05:27.764 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T11:05:27.765 INFO:teuthology.orchestra.run.trial162.stdout:Nothing to do. 2026-02-17T11:05:27.765 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T11:05:27.786 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install ceph-mgr-debuginfo 2026-02-17T11:05:28.095 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:03:19 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:05:28.178 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T11:05:28.179 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:05:28.179 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repo Size 2026-02-17T11:05:28.179 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:05:28.179 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-17T11:05:28.179 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mgr-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 18 M 2026-02-17T11:05:28.179 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:05:28.180 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-17T11:05:28.180 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:05:28.180 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-17T11:05:28.180 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:05:28.180 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 18 M 2026-02-17T11:05:28.180 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 110 M 2026-02-17T11:05:28.180 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-17T11:05:28.606 INFO:teuthology.orchestra.run.trial162.stdout:ceph-mgr-debuginfo-19.2.3-705.g04cf6dd4.el9.x86 42 MB/s | 18 MB 00:00 2026-02-17T11:05:28.606 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:05:28.606 INFO:teuthology.orchestra.run.trial162.stdout:Total 42 MB/s | 18 MB 00:00 2026-02-17T11:05:28.606 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-17T11:05:28.608 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-17T11:05:28.608 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-17T11:05:28.679 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-17T11:05:28.679 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-17T11:05:29.056 INFO:teuthology.orchestra.run.trial097.stdout: Preparing : 1/1 2026-02-17T11:05:29.074 INFO:teuthology.orchestra.run.trial097.stdout: Installing : ceph-mds-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:05:29.266 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: ceph-mds-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:05:29.324 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : ceph-mds-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:05:29.324 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:05:29.324 INFO:teuthology.orchestra.run.trial097.stdout:Installed: 2026-02-17T11:05:29.325 INFO:teuthology.orchestra.run.trial097.stdout: ceph-mds-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:05:29.325 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:05:29.325 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-17T11:05:29.356 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install ceph-mon-debuginfo 2026-02-17T11:05:29.664 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:03:47 ago on Tue 17 Feb 2026 11:01:42 AM UTC. 2026-02-17T11:05:29.691 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-17T11:05:29.709 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-mgr-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:05:29.745 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-17T11:05:29.746 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:05:29.746 INFO:teuthology.orchestra.run.trial097.stdout: Package Arch Version Repo Size 2026-02-17T11:05:29.746 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:05:29.746 INFO:teuthology.orchestra.run.trial097.stdout:Installing: 2026-02-17T11:05:29.746 INFO:teuthology.orchestra.run.trial097.stdout: ceph-mon-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 102 M 2026-02-17T11:05:29.747 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:05:29.747 INFO:teuthology.orchestra.run.trial097.stdout:Transaction Summary 2026-02-17T11:05:29.747 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:05:29.747 INFO:teuthology.orchestra.run.trial097.stdout:Install 1 Package 2026-02-17T11:05:29.747 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:05:29.747 INFO:teuthology.orchestra.run.trial097.stdout:Total download size: 102 M 2026-02-17T11:05:29.747 INFO:teuthology.orchestra.run.trial097.stdout:Installed size: 497 M 2026-02-17T11:05:29.747 INFO:teuthology.orchestra.run.trial097.stdout:Downloading Packages: 2026-02-17T11:05:29.844 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-mgr-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:05:29.902 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-mgr-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:05:29.902 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:05:29.902 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-17T11:05:29.902 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mgr-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:05:29.902 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:05:29.902 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T11:05:29.930 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install ceph-mds-debuginfo 2026-02-17T11:05:30.240 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:03:21 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:05:30.323 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T11:05:30.323 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:05:30.323 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repo Size 2026-02-17T11:05:30.323 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:05:30.323 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-17T11:05:30.323 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mds-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 55 M 2026-02-17T11:05:30.324 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:05:30.324 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-17T11:05:30.324 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:05:30.324 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-17T11:05:30.324 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:05:30.324 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 55 M 2026-02-17T11:05:30.324 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 211 M 2026-02-17T11:05:30.324 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-17T11:05:31.758 INFO:teuthology.orchestra.run.trial097.stdout:ceph-mon-debuginfo-19.2.3-705.g04cf6dd4.el9.x86 51 MB/s | 102 MB 00:02 2026-02-17T11:05:31.759 INFO:teuthology.orchestra.run.trial097.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:05:31.759 INFO:teuthology.orchestra.run.trial097.stdout:Total 51 MB/s | 102 MB 00:02 2026-02-17T11:05:31.759 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction check 2026-02-17T11:05:31.760 INFO:teuthology.orchestra.run.trial097.stdout:Transaction check succeeded. 2026-02-17T11:05:31.761 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction test 2026-02-17T11:05:32.077 INFO:teuthology.orchestra.run.trial097.stdout:Transaction test succeeded. 2026-02-17T11:05:32.078 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction 2026-02-17T11:05:32.769 INFO:teuthology.orchestra.run.trial162.stdout:ceph-mds-debuginfo-19.2.3-705.g04cf6dd4.el9.x86 23 MB/s | 55 MB 00:02 2026-02-17T11:05:32.770 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:05:32.770 INFO:teuthology.orchestra.run.trial162.stdout:Total 23 MB/s | 55 MB 00:02 2026-02-17T11:05:32.770 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-17T11:05:32.772 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-17T11:05:32.772 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-17T11:05:32.952 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-17T11:05:32.952 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-17T11:05:35.294 INFO:teuthology.orchestra.run.trial049.stdout: Preparing : 1/1 2026-02-17T11:05:35.313 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-test-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_6 1/1 2026-02-17T11:05:35.687 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-17T11:05:35.705 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-mds-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:05:35.911 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-mds-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:05:35.968 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-mds-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:05:35.969 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:05:35.969 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-17T11:05:35.969 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mds-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:05:35.969 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:05:35.969 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T11:05:36.000 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install ceph-mon-debuginfo 2026-02-17T11:05:36.310 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:03:27 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:05:36.391 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T11:05:36.392 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:05:36.393 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repo Size 2026-02-17T11:05:36.393 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:05:36.393 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-17T11:05:36.393 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mon-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 102 M 2026-02-17T11:05:36.393 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:05:36.393 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-17T11:05:36.393 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:05:36.393 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-17T11:05:36.393 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:05:36.393 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 102 M 2026-02-17T11:05:36.394 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 497 M 2026-02-17T11:05:36.394 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-17T11:05:37.286 INFO:teuthology.orchestra.run.trial097.stdout: Preparing : 1/1 2026-02-17T11:05:37.304 INFO:teuthology.orchestra.run.trial097.stdout: Installing : ceph-mon-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:05:37.702 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: ceph-mon-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:05:37.759 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : ceph-mon-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:05:37.760 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:05:37.760 INFO:teuthology.orchestra.run.trial097.stdout:Installed: 2026-02-17T11:05:37.760 INFO:teuthology.orchestra.run.trial097.stdout: ceph-mon-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:05:37.760 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:05:37.760 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-17T11:05:37.764 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-test-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_6 1/1 2026-02-17T11:05:37.797 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install ceph-osd-debuginfo 2026-02-17T11:05:37.822 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-test-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_6 1/1 2026-02-17T11:05:37.822 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:05:37.822 INFO:teuthology.orchestra.run.trial049.stdout:Installed: 2026-02-17T11:05:37.822 INFO:teuthology.orchestra.run.trial049.stdout: ceph-test-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:05:37.822 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:05:37.822 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-17T11:05:37.923 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-base-debuginfo 2026-02-17T11:05:38.103 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:03:56 ago on Tue 17 Feb 2026 11:01:42 AM UTC. 2026-02-17T11:05:38.185 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-17T11:05:38.186 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:05:38.186 INFO:teuthology.orchestra.run.trial097.stdout: Package Arch Version Repo Size 2026-02-17T11:05:38.186 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:05:38.186 INFO:teuthology.orchestra.run.trial097.stdout:Installing: 2026-02-17T11:05:38.186 INFO:teuthology.orchestra.run.trial097.stdout: ceph-osd-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 298 M 2026-02-17T11:05:38.186 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:05:38.187 INFO:teuthology.orchestra.run.trial097.stdout:Transaction Summary 2026-02-17T11:05:38.187 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:05:38.187 INFO:teuthology.orchestra.run.trial097.stdout:Install 1 Package 2026-02-17T11:05:38.187 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:05:38.187 INFO:teuthology.orchestra.run.trial097.stdout:Total download size: 298 M 2026-02-17T11:05:38.188 INFO:teuthology.orchestra.run.trial097.stdout:Installed size: 1.4 G 2026-02-17T11:05:38.188 INFO:teuthology.orchestra.run.trial097.stdout:Downloading Packages: 2026-02-17T11:05:38.238 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:03:29 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:05:38.302 INFO:teuthology.orchestra.run.trial049.stdout:Package ceph-base-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T11:05:38.320 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-17T11:05:38.321 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-17T11:05:38.321 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-17T11:05:38.342 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-mgr-debuginfo 2026-02-17T11:05:38.376 INFO:teuthology.orchestra.run.trial162.stdout:ceph-mon-debuginfo-19.2.3-705.g04cf6dd4.el9.x86 51 MB/s | 102 MB 00:01 2026-02-17T11:05:38.377 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:05:38.378 INFO:teuthology.orchestra.run.trial162.stdout:Total 51 MB/s | 102 MB 00:01 2026-02-17T11:05:38.378 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-17T11:05:38.379 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-17T11:05:38.380 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-17T11:05:38.658 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:03:29 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:05:38.695 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-17T11:05:38.695 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-17T11:05:38.740 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-17T11:05:38.740 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:05:38.740 INFO:teuthology.orchestra.run.trial049.stdout: Package Arch Version Repo Size 2026-02-17T11:05:38.740 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:05:38.740 INFO:teuthology.orchestra.run.trial049.stdout:Installing: 2026-02-17T11:05:38.740 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mgr-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 18 M 2026-02-17T11:05:38.740 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:05:38.740 INFO:teuthology.orchestra.run.trial049.stdout:Transaction Summary 2026-02-17T11:05:38.741 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:05:38.741 INFO:teuthology.orchestra.run.trial049.stdout:Install 1 Package 2026-02-17T11:05:38.741 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:05:38.741 INFO:teuthology.orchestra.run.trial049.stdout:Total download size: 18 M 2026-02-17T11:05:38.741 INFO:teuthology.orchestra.run.trial049.stdout:Installed size: 110 M 2026-02-17T11:05:38.741 INFO:teuthology.orchestra.run.trial049.stdout:Downloading Packages: 2026-02-17T11:05:40.081 INFO:teuthology.orchestra.run.trial157.stdout: Preparing : 1/1 2026-02-17T11:05:40.099 INFO:teuthology.orchestra.run.trial157.stdout: Installing : ceph-osd-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:05:41.181 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: ceph-osd-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:05:41.240 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : ceph-osd-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:05:41.240 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:05:41.240 INFO:teuthology.orchestra.run.trial157.stdout:Installed: 2026-02-17T11:05:41.240 INFO:teuthology.orchestra.run.trial157.stdout: ceph-osd-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:05:41.240 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:05:41.241 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-17T11:05:41.298 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install ceph-fuse-debuginfo 2026-02-17T11:05:41.613 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:03:56 ago on Tue 17 Feb 2026 11:01:45 AM UTC. 2026-02-17T11:05:41.695 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-17T11:05:41.695 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:05:41.695 INFO:teuthology.orchestra.run.trial157.stdout: Package Arch Version Repo Size 2026-02-17T11:05:41.695 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:05:41.695 INFO:teuthology.orchestra.run.trial157.stdout:Installing: 2026-02-17T11:05:41.695 INFO:teuthology.orchestra.run.trial157.stdout: ceph-fuse-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 6.8 M 2026-02-17T11:05:41.695 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:05:41.695 INFO:teuthology.orchestra.run.trial157.stdout:Transaction Summary 2026-02-17T11:05:41.695 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:05:41.695 INFO:teuthology.orchestra.run.trial157.stdout:Install 1 Package 2026-02-17T11:05:41.695 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:05:41.695 INFO:teuthology.orchestra.run.trial157.stdout:Total download size: 6.8 M 2026-02-17T11:05:41.695 INFO:teuthology.orchestra.run.trial157.stdout:Installed size: 36 M 2026-02-17T11:05:41.695 INFO:teuthology.orchestra.run.trial157.stdout:Downloading Packages: 2026-02-17T11:05:42.332 INFO:teuthology.orchestra.run.trial049.stdout:ceph-mgr-debuginfo-19.2.3-705.g04cf6dd4.el9.x86 5.0 MB/s | 18 MB 00:03 2026-02-17T11:05:42.333 INFO:teuthology.orchestra.run.trial049.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:05:42.333 INFO:teuthology.orchestra.run.trial049.stdout:Total 5.0 MB/s | 18 MB 00:03 2026-02-17T11:05:42.334 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction check 2026-02-17T11:05:42.335 INFO:teuthology.orchestra.run.trial049.stdout:Transaction check succeeded. 2026-02-17T11:05:42.335 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction test 2026-02-17T11:05:42.406 INFO:teuthology.orchestra.run.trial049.stdout:Transaction test succeeded. 2026-02-17T11:05:42.406 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction 2026-02-17T11:05:43.245 INFO:teuthology.orchestra.run.trial157.stdout:ceph-fuse-debuginfo-19.2.3-705.g04cf6dd4.el9.x8 4.4 MB/s | 6.8 MB 00:01 2026-02-17T11:05:43.247 INFO:teuthology.orchestra.run.trial157.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:05:43.247 INFO:teuthology.orchestra.run.trial157.stdout:Total 4.4 MB/s | 6.8 MB 00:01 2026-02-17T11:05:43.247 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction check 2026-02-17T11:05:43.248 INFO:teuthology.orchestra.run.trial157.stdout:Transaction check succeeded. 2026-02-17T11:05:43.248 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction test 2026-02-17T11:05:43.285 INFO:teuthology.orchestra.run.trial157.stdout:Transaction test succeeded. 2026-02-17T11:05:43.286 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction 2026-02-17T11:05:43.441 INFO:teuthology.orchestra.run.trial049.stdout: Preparing : 1/1 2026-02-17T11:05:43.459 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-mgr-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:05:43.591 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-mgr-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:05:43.648 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-mgr-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:05:43.649 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:05:43.649 INFO:teuthology.orchestra.run.trial049.stdout:Installed: 2026-02-17T11:05:43.649 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mgr-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:05:43.649 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:05:43.649 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-17T11:05:43.676 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-mds-debuginfo 2026-02-17T11:05:43.684 INFO:teuthology.orchestra.run.trial157.stdout: Preparing : 1/1 2026-02-17T11:05:43.702 INFO:teuthology.orchestra.run.trial157.stdout: Installing : ceph-fuse-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_6 1/1 2026-02-17T11:05:43.784 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: ceph-fuse-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_6 1/1 2026-02-17T11:05:43.841 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : ceph-fuse-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_6 1/1 2026-02-17T11:05:43.842 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:05:43.842 INFO:teuthology.orchestra.run.trial157.stdout:Installed: 2026-02-17T11:05:43.842 INFO:teuthology.orchestra.run.trial157.stdout: ceph-fuse-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:05:43.842 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:05:43.842 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-17T11:05:43.870 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install librados-devel-debuginfo 2026-02-17T11:05:43.988 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:03:34 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:05:43.989 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-17T11:05:44.007 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-mon-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:05:44.070 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-17T11:05:44.070 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:05:44.071 INFO:teuthology.orchestra.run.trial049.stdout: Package Arch Version Repo Size 2026-02-17T11:05:44.071 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:05:44.071 INFO:teuthology.orchestra.run.trial049.stdout:Installing: 2026-02-17T11:05:44.071 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mds-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 55 M 2026-02-17T11:05:44.071 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:05:44.071 INFO:teuthology.orchestra.run.trial049.stdout:Transaction Summary 2026-02-17T11:05:44.071 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:05:44.071 INFO:teuthology.orchestra.run.trial049.stdout:Install 1 Package 2026-02-17T11:05:44.072 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:05:44.072 INFO:teuthology.orchestra.run.trial049.stdout:Total download size: 55 M 2026-02-17T11:05:44.072 INFO:teuthology.orchestra.run.trial049.stdout:Installed size: 211 M 2026-02-17T11:05:44.072 INFO:teuthology.orchestra.run.trial049.stdout:Downloading Packages: 2026-02-17T11:05:44.181 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:03:59 ago on Tue 17 Feb 2026 11:01:45 AM UTC. 2026-02-17T11:05:44.265 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-17T11:05:44.265 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:05:44.265 INFO:teuthology.orchestra.run.trial157.stdout: Package Arch Version Repo Size 2026-02-17T11:05:44.265 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:05:44.265 INFO:teuthology.orchestra.run.trial157.stdout:Installing: 2026-02-17T11:05:44.266 INFO:teuthology.orchestra.run.trial157.stdout: librados-devel-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 112 k 2026-02-17T11:05:44.266 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:05:44.266 INFO:teuthology.orchestra.run.trial157.stdout:Transaction Summary 2026-02-17T11:05:44.266 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:05:44.266 INFO:teuthology.orchestra.run.trial157.stdout:Install 1 Package 2026-02-17T11:05:44.266 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:05:44.266 INFO:teuthology.orchestra.run.trial157.stdout:Total download size: 112 k 2026-02-17T11:05:44.267 INFO:teuthology.orchestra.run.trial157.stdout:Installed size: 493 k 2026-02-17T11:05:44.267 INFO:teuthology.orchestra.run.trial157.stdout:Downloading Packages: 2026-02-17T11:05:44.292 INFO:teuthology.orchestra.run.trial097.stdout:ceph-osd-debuginfo-19.2.3-705.g04cf6dd4.el9.x86 49 MB/s | 298 MB 00:06 2026-02-17T11:05:44.293 INFO:teuthology.orchestra.run.trial097.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:05:44.293 INFO:teuthology.orchestra.run.trial097.stdout:Total 49 MB/s | 298 MB 00:06 2026-02-17T11:05:44.293 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction check 2026-02-17T11:05:44.295 INFO:teuthology.orchestra.run.trial097.stdout:Transaction check succeeded. 2026-02-17T11:05:44.295 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction test 2026-02-17T11:05:44.432 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-mon-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:05:44.490 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-mon-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:05:44.490 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:05:44.491 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-17T11:05:44.491 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mon-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:05:44.491 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:05:44.491 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T11:05:44.526 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install ceph-osd-debuginfo 2026-02-17T11:05:44.614 INFO:teuthology.orchestra.run.trial157.stdout:librados-devel-debuginfo-19.2.3-705.g04cf6dd4.e 320 kB/s | 112 kB 00:00 2026-02-17T11:05:44.615 INFO:teuthology.orchestra.run.trial157.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:05:44.615 INFO:teuthology.orchestra.run.trial157.stdout:Total 320 kB/s | 112 kB 00:00 2026-02-17T11:05:44.616 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction check 2026-02-17T11:05:44.617 INFO:teuthology.orchestra.run.trial157.stdout:Transaction check succeeded. 2026-02-17T11:05:44.617 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction test 2026-02-17T11:05:44.635 INFO:teuthology.orchestra.run.trial157.stdout:Transaction test succeeded. 2026-02-17T11:05:44.635 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction 2026-02-17T11:05:44.675 INFO:teuthology.orchestra.run.trial157.stdout: Preparing : 1/1 2026-02-17T11:05:44.692 INFO:teuthology.orchestra.run.trial157.stdout: Installing : librados-devel-debuginfo-2:19.2.3-705.g04cf6dd4.el9. 1/1 2026-02-17T11:05:44.748 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: librados-devel-debuginfo-2:19.2.3-705.g04cf6dd4.el9. 1/1 2026-02-17T11:05:44.807 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : librados-devel-debuginfo-2:19.2.3-705.g04cf6dd4.el9. 1/1 2026-02-17T11:05:44.807 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:05:44.807 INFO:teuthology.orchestra.run.trial157.stdout:Installed: 2026-02-17T11:05:44.807 INFO:teuthology.orchestra.run.trial157.stdout: librados-devel-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:05:44.807 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:05:44.807 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-17T11:05:44.834 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install libcephfs2-debuginfo 2026-02-17T11:05:44.842 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:03:35 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:05:44.925 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T11:05:44.925 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:05:44.925 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repo Size 2026-02-17T11:05:44.926 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:05:44.926 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-17T11:05:44.926 INFO:teuthology.orchestra.run.trial162.stdout: ceph-osd-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 298 M 2026-02-17T11:05:44.926 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:05:44.926 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-17T11:05:44.926 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:05:44.926 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-17T11:05:44.926 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:05:44.927 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 298 M 2026-02-17T11:05:44.927 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 1.4 G 2026-02-17T11:05:44.927 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-17T11:05:45.145 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:04:00 ago on Tue 17 Feb 2026 11:01:45 AM UTC. 2026-02-17T11:05:45.187 INFO:teuthology.orchestra.run.trial097.stdout:Transaction test succeeded. 2026-02-17T11:05:45.188 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction 2026-02-17T11:05:45.192 INFO:teuthology.orchestra.run.trial049.stdout:ceph-mds-debuginfo-19.2.3-705.g04cf6dd4.el9.x86 49 MB/s | 55 MB 00:01 2026-02-17T11:05:45.193 INFO:teuthology.orchestra.run.trial049.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:05:45.193 INFO:teuthology.orchestra.run.trial049.stdout:Total 49 MB/s | 55 MB 00:01 2026-02-17T11:05:45.193 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction check 2026-02-17T11:05:45.195 INFO:teuthology.orchestra.run.trial049.stdout:Transaction check succeeded. 2026-02-17T11:05:45.195 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction test 2026-02-17T11:05:45.228 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-17T11:05:45.228 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:05:45.229 INFO:teuthology.orchestra.run.trial157.stdout: Package Arch Version Repo Size 2026-02-17T11:05:45.229 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:05:45.229 INFO:teuthology.orchestra.run.trial157.stdout:Installing: 2026-02-17T11:05:45.229 INFO:teuthology.orchestra.run.trial157.stdout: libcephfs2-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 6.0 M 2026-02-17T11:05:45.229 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:05:45.229 INFO:teuthology.orchestra.run.trial157.stdout:Transaction Summary 2026-02-17T11:05:45.229 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:05:45.229 INFO:teuthology.orchestra.run.trial157.stdout:Install 1 Package 2026-02-17T11:05:45.229 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:05:45.229 INFO:teuthology.orchestra.run.trial157.stdout:Total download size: 6.0 M 2026-02-17T11:05:45.229 INFO:teuthology.orchestra.run.trial157.stdout:Installed size: 31 M 2026-02-17T11:05:45.229 INFO:teuthology.orchestra.run.trial157.stdout:Downloading Packages: 2026-02-17T11:05:45.375 INFO:teuthology.orchestra.run.trial049.stdout:Transaction test succeeded. 2026-02-17T11:05:45.376 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction 2026-02-17T11:05:47.333 INFO:teuthology.orchestra.run.trial157.stdout:libcephfs2-debuginfo-19.2.3-705.g04cf6dd4.el9.x 2.8 MB/s | 6.0 MB 00:02 2026-02-17T11:05:47.333 INFO:teuthology.orchestra.run.trial157.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:05:47.334 INFO:teuthology.orchestra.run.trial157.stdout:Total 2.8 MB/s | 6.0 MB 00:02 2026-02-17T11:05:47.334 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction check 2026-02-17T11:05:47.335 INFO:teuthology.orchestra.run.trial157.stdout:Transaction check succeeded. 2026-02-17T11:05:47.335 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction test 2026-02-17T11:05:47.370 INFO:teuthology.orchestra.run.trial157.stdout:Transaction test succeeded. 2026-02-17T11:05:47.370 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction 2026-02-17T11:05:47.716 INFO:teuthology.orchestra.run.trial157.stdout: Preparing : 1/1 2026-02-17T11:05:47.733 INFO:teuthology.orchestra.run.trial157.stdout: Installing : libcephfs2-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_ 1/1 2026-02-17T11:05:47.812 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: libcephfs2-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_ 1/1 2026-02-17T11:05:47.871 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : libcephfs2-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_ 1/1 2026-02-17T11:05:47.871 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:05:47.871 INFO:teuthology.orchestra.run.trial157.stdout:Installed: 2026-02-17T11:05:47.871 INFO:teuthology.orchestra.run.trial157.stdout: libcephfs2-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:05:47.871 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:05:47.871 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-17T11:05:47.898 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install librados2-debuginfo 2026-02-17T11:05:48.158 INFO:teuthology.orchestra.run.trial049.stdout: Preparing : 1/1 2026-02-17T11:05:48.175 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-mds-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:05:48.208 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:04:03 ago on Tue 17 Feb 2026 11:01:45 AM UTC. 2026-02-17T11:05:48.290 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-17T11:05:48.291 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:05:48.291 INFO:teuthology.orchestra.run.trial157.stdout: Package Arch Version Repo Size 2026-02-17T11:05:48.291 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:05:48.291 INFO:teuthology.orchestra.run.trial157.stdout:Installing: 2026-02-17T11:05:48.291 INFO:teuthology.orchestra.run.trial157.stdout: librados2-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 47 M 2026-02-17T11:05:48.291 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:05:48.291 INFO:teuthology.orchestra.run.trial157.stdout:Transaction Summary 2026-02-17T11:05:48.291 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:05:48.292 INFO:teuthology.orchestra.run.trial157.stdout:Install 1 Package 2026-02-17T11:05:48.292 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:05:48.292 INFO:teuthology.orchestra.run.trial157.stdout:Total download size: 47 M 2026-02-17T11:05:48.292 INFO:teuthology.orchestra.run.trial157.stdout:Installed size: 302 M 2026-02-17T11:05:48.292 INFO:teuthology.orchestra.run.trial157.stdout:Downloading Packages: 2026-02-17T11:05:48.380 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-mds-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:05:48.437 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-mds-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:05:48.437 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:05:48.437 INFO:teuthology.orchestra.run.trial049.stdout:Installed: 2026-02-17T11:05:48.437 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mds-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:05:48.438 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:05:48.438 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-17T11:05:48.467 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-mon-debuginfo 2026-02-17T11:05:48.781 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:03:39 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:05:48.864 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-17T11:05:48.864 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:05:48.864 INFO:teuthology.orchestra.run.trial049.stdout: Package Arch Version Repo Size 2026-02-17T11:05:48.864 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:05:48.864 INFO:teuthology.orchestra.run.trial049.stdout:Installing: 2026-02-17T11:05:48.864 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mon-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 102 M 2026-02-17T11:05:48.865 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:05:48.865 INFO:teuthology.orchestra.run.trial049.stdout:Transaction Summary 2026-02-17T11:05:48.865 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:05:48.865 INFO:teuthology.orchestra.run.trial049.stdout:Install 1 Package 2026-02-17T11:05:48.865 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:05:48.865 INFO:teuthology.orchestra.run.trial049.stdout:Total download size: 102 M 2026-02-17T11:05:48.865 INFO:teuthology.orchestra.run.trial049.stdout:Installed size: 497 M 2026-02-17T11:05:48.865 INFO:teuthology.orchestra.run.trial049.stdout:Downloading Packages: 2026-02-17T11:05:53.844 INFO:teuthology.orchestra.run.trial162.stdout:ceph-osd-debuginfo-19.2.3-705.g04cf6dd4.el9.x86 33 MB/s | 298 MB 00:08 2026-02-17T11:05:53.845 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:05:53.845 INFO:teuthology.orchestra.run.trial162.stdout:Total 33 MB/s | 298 MB 00:08 2026-02-17T11:05:53.845 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-17T11:05:53.847 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-17T11:05:53.847 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-17T11:05:53.863 INFO:teuthology.orchestra.run.trial049.stdout:ceph-mon-debuginfo-19.2.3-705.g04cf6dd4.el9.x86 20 MB/s | 102 MB 00:04 2026-02-17T11:05:53.864 INFO:teuthology.orchestra.run.trial049.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:05:53.864 INFO:teuthology.orchestra.run.trial049.stdout:Total 20 MB/s | 102 MB 00:04 2026-02-17T11:05:53.864 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction check 2026-02-17T11:05:53.866 INFO:teuthology.orchestra.run.trial049.stdout:Transaction check succeeded. 2026-02-17T11:05:53.866 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction test 2026-02-17T11:05:54.180 INFO:teuthology.orchestra.run.trial049.stdout:Transaction test succeeded. 2026-02-17T11:05:54.181 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction 2026-02-17T11:05:54.740 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-17T11:05:54.740 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-17T11:05:55.805 INFO:teuthology.orchestra.run.trial157.stdout:librados2-debuginfo-19.2.3-705.g04cf6dd4.el9.x8 6.3 MB/s | 47 MB 00:07 2026-02-17T11:05:55.806 INFO:teuthology.orchestra.run.trial157.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:05:55.806 INFO:teuthology.orchestra.run.trial157.stdout:Total 6.3 MB/s | 47 MB 00:07 2026-02-17T11:05:55.806 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction check 2026-02-17T11:05:55.807 INFO:teuthology.orchestra.run.trial157.stdout:Transaction check succeeded. 2026-02-17T11:05:55.807 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction test 2026-02-17T11:05:55.965 INFO:teuthology.orchestra.run.trial157.stdout:Transaction test succeeded. 2026-02-17T11:05:55.965 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction 2026-02-17T11:05:58.664 INFO:teuthology.orchestra.run.trial157.stdout: Preparing : 1/1 2026-02-17T11:05:58.681 INFO:teuthology.orchestra.run.trial157.stdout: Installing : librados2-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_6 1/1 2026-02-17T11:05:58.952 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: librados2-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_6 1/1 2026-02-17T11:05:59.009 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : librados2-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_6 1/1 2026-02-17T11:05:59.009 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:05:59.009 INFO:teuthology.orchestra.run.trial157.stdout:Installed: 2026-02-17T11:05:59.009 INFO:teuthology.orchestra.run.trial157.stdout: librados2-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:05:59.009 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:05:59.009 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-17T11:05:59.039 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install librbd1-debuginfo 2026-02-17T11:05:59.349 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:04:14 ago on Tue 17 Feb 2026 11:01:45 AM UTC. 2026-02-17T11:05:59.404 INFO:teuthology.orchestra.run.trial049.stdout: Preparing : 1/1 2026-02-17T11:05:59.423 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-mon-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:05:59.431 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-17T11:05:59.432 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:05:59.432 INFO:teuthology.orchestra.run.trial157.stdout: Package Arch Version Repo Size 2026-02-17T11:05:59.432 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:05:59.432 INFO:teuthology.orchestra.run.trial157.stdout:Installing: 2026-02-17T11:05:59.432 INFO:teuthology.orchestra.run.trial157.stdout: librbd1-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 54 M 2026-02-17T11:05:59.432 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:05:59.432 INFO:teuthology.orchestra.run.trial157.stdout:Transaction Summary 2026-02-17T11:05:59.432 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:05:59.432 INFO:teuthology.orchestra.run.trial157.stdout:Install 1 Package 2026-02-17T11:05:59.432 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:05:59.432 INFO:teuthology.orchestra.run.trial157.stdout:Total download size: 54 M 2026-02-17T11:05:59.432 INFO:teuthology.orchestra.run.trial157.stdout:Installed size: 374 M 2026-02-17T11:05:59.432 INFO:teuthology.orchestra.run.trial157.stdout:Downloading Packages: 2026-02-17T11:05:59.844 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-mon-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:05:59.901 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-mon-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:05:59.901 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:05:59.902 INFO:teuthology.orchestra.run.trial049.stdout:Installed: 2026-02-17T11:05:59.902 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mon-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:05:59.902 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:05:59.902 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-17T11:05:59.936 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-osd-debuginfo 2026-02-17T11:06:00.242 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:03:51 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:06:00.324 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-17T11:06:00.324 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:06:00.325 INFO:teuthology.orchestra.run.trial049.stdout: Package Arch Version Repo Size 2026-02-17T11:06:00.325 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:06:00.325 INFO:teuthology.orchestra.run.trial049.stdout:Installing: 2026-02-17T11:06:00.325 INFO:teuthology.orchestra.run.trial049.stdout: ceph-osd-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 298 M 2026-02-17T11:06:00.325 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:00.325 INFO:teuthology.orchestra.run.trial049.stdout:Transaction Summary 2026-02-17T11:06:00.326 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:06:00.326 INFO:teuthology.orchestra.run.trial049.stdout:Install 1 Package 2026-02-17T11:06:00.326 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:00.326 INFO:teuthology.orchestra.run.trial049.stdout:Total download size: 298 M 2026-02-17T11:06:00.326 INFO:teuthology.orchestra.run.trial049.stdout:Installed size: 1.4 G 2026-02-17T11:06:00.326 INFO:teuthology.orchestra.run.trial049.stdout:Downloading Packages: 2026-02-17T11:06:00.450 INFO:teuthology.orchestra.run.trial097.stdout: Preparing : 1/1 2026-02-17T11:06:00.470 INFO:teuthology.orchestra.run.trial097.stdout: Installing : ceph-osd-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:06:00.588 INFO:teuthology.orchestra.run.trial157.stdout:librbd1-debuginfo-19.2.3-705.g04cf6dd4.el9.x86_ 47 MB/s | 54 MB 00:01 2026-02-17T11:06:00.588 INFO:teuthology.orchestra.run.trial157.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:06:00.588 INFO:teuthology.orchestra.run.trial157.stdout:Total 47 MB/s | 54 MB 00:01 2026-02-17T11:06:00.589 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction check 2026-02-17T11:06:00.591 INFO:teuthology.orchestra.run.trial157.stdout:Transaction check succeeded. 2026-02-17T11:06:00.591 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction test 2026-02-17T11:06:00.769 INFO:teuthology.orchestra.run.trial157.stdout:Transaction test succeeded. 2026-02-17T11:06:00.770 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction 2026-02-17T11:06:01.477 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: ceph-osd-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:06:01.535 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : ceph-osd-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:06:01.535 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:01.536 INFO:teuthology.orchestra.run.trial097.stdout:Installed: 2026-02-17T11:06:01.536 INFO:teuthology.orchestra.run.trial097.stdout: ceph-osd-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:06:01.536 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:01.536 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-17T11:06:01.593 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install ceph-fuse-debuginfo 2026-02-17T11:06:01.904 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:04:19 ago on Tue 17 Feb 2026 11:01:42 AM UTC. 2026-02-17T11:06:01.986 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-17T11:06:01.986 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:06:01.986 INFO:teuthology.orchestra.run.trial097.stdout: Package Arch Version Repo Size 2026-02-17T11:06:01.986 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:06:01.986 INFO:teuthology.orchestra.run.trial097.stdout:Installing: 2026-02-17T11:06:01.987 INFO:teuthology.orchestra.run.trial097.stdout: ceph-fuse-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 6.8 M 2026-02-17T11:06:01.987 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:01.987 INFO:teuthology.orchestra.run.trial097.stdout:Transaction Summary 2026-02-17T11:06:01.987 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:06:01.987 INFO:teuthology.orchestra.run.trial097.stdout:Install 1 Package 2026-02-17T11:06:01.987 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:01.987 INFO:teuthology.orchestra.run.trial097.stdout:Total download size: 6.8 M 2026-02-17T11:06:01.987 INFO:teuthology.orchestra.run.trial097.stdout:Installed size: 36 M 2026-02-17T11:06:01.987 INFO:teuthology.orchestra.run.trial097.stdout:Downloading Packages: 2026-02-17T11:06:03.060 INFO:teuthology.orchestra.run.trial097.stdout:ceph-fuse-debuginfo-19.2.3-705.g04cf6dd4.el9.x8 6.4 MB/s | 6.8 MB 00:01 2026-02-17T11:06:03.060 INFO:teuthology.orchestra.run.trial097.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:06:03.060 INFO:teuthology.orchestra.run.trial097.stdout:Total 6.4 MB/s | 6.8 MB 00:01 2026-02-17T11:06:03.060 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction check 2026-02-17T11:06:03.062 INFO:teuthology.orchestra.run.trial097.stdout:Transaction check succeeded. 2026-02-17T11:06:03.062 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction test 2026-02-17T11:06:03.099 INFO:teuthology.orchestra.run.trial097.stdout:Transaction test succeeded. 2026-02-17T11:06:03.099 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction 2026-02-17T11:06:03.489 INFO:teuthology.orchestra.run.trial097.stdout: Preparing : 1/1 2026-02-17T11:06:03.507 INFO:teuthology.orchestra.run.trial097.stdout: Installing : ceph-fuse-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_6 1/1 2026-02-17T11:06:03.587 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: ceph-fuse-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_6 1/1 2026-02-17T11:06:03.645 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : ceph-fuse-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_6 1/1 2026-02-17T11:06:03.645 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:03.646 INFO:teuthology.orchestra.run.trial097.stdout:Installed: 2026-02-17T11:06:03.646 INFO:teuthology.orchestra.run.trial097.stdout: ceph-fuse-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:06:03.646 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:03.646 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-17T11:06:03.673 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install librados-devel-debuginfo 2026-02-17T11:06:03.907 INFO:teuthology.orchestra.run.trial157.stdout: Preparing : 1/1 2026-02-17T11:06:03.925 INFO:teuthology.orchestra.run.trial157.stdout: Installing : librbd1-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:06:03.979 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:04:21 ago on Tue 17 Feb 2026 11:01:42 AM UTC. 2026-02-17T11:06:04.061 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-17T11:06:04.061 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:06:04.062 INFO:teuthology.orchestra.run.trial097.stdout: Package Arch Version Repo Size 2026-02-17T11:06:04.062 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:06:04.062 INFO:teuthology.orchestra.run.trial097.stdout:Installing: 2026-02-17T11:06:04.062 INFO:teuthology.orchestra.run.trial097.stdout: librados-devel-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 112 k 2026-02-17T11:06:04.062 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:04.062 INFO:teuthology.orchestra.run.trial097.stdout:Transaction Summary 2026-02-17T11:06:04.062 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:06:04.062 INFO:teuthology.orchestra.run.trial097.stdout:Install 1 Package 2026-02-17T11:06:04.062 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:04.062 INFO:teuthology.orchestra.run.trial097.stdout:Total download size: 112 k 2026-02-17T11:06:04.062 INFO:teuthology.orchestra.run.trial097.stdout:Installed size: 493 k 2026-02-17T11:06:04.062 INFO:teuthology.orchestra.run.trial097.stdout:Downloading Packages: 2026-02-17T11:06:04.247 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: librbd1-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:06:04.306 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : librbd1-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:06:04.306 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:04.307 INFO:teuthology.orchestra.run.trial157.stdout:Installed: 2026-02-17T11:06:04.307 INFO:teuthology.orchestra.run.trial157.stdout: librbd1-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:06:04.307 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:04.307 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-17T11:06:04.341 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install python3-cephfs-debuginfo 2026-02-17T11:06:04.433 INFO:teuthology.orchestra.run.trial097.stdout:librados-devel-debuginfo-19.2.3-705.g04cf6dd4.e 302 kB/s | 112 kB 00:00 2026-02-17T11:06:04.434 INFO:teuthology.orchestra.run.trial097.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:06:04.434 INFO:teuthology.orchestra.run.trial097.stdout:Total 302 kB/s | 112 kB 00:00 2026-02-17T11:06:04.434 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction check 2026-02-17T11:06:04.436 INFO:teuthology.orchestra.run.trial097.stdout:Transaction check succeeded. 2026-02-17T11:06:04.436 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction test 2026-02-17T11:06:04.455 INFO:teuthology.orchestra.run.trial097.stdout:Transaction test succeeded. 2026-02-17T11:06:04.455 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction 2026-02-17T11:06:04.493 INFO:teuthology.orchestra.run.trial097.stdout: Preparing : 1/1 2026-02-17T11:06:04.510 INFO:teuthology.orchestra.run.trial097.stdout: Installing : librados-devel-debuginfo-2:19.2.3-705.g04cf6dd4.el9. 1/1 2026-02-17T11:06:04.564 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: librados-devel-debuginfo-2:19.2.3-705.g04cf6dd4.el9. 1/1 2026-02-17T11:06:04.622 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : librados-devel-debuginfo-2:19.2.3-705.g04cf6dd4.el9. 1/1 2026-02-17T11:06:04.622 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:04.622 INFO:teuthology.orchestra.run.trial097.stdout:Installed: 2026-02-17T11:06:04.622 INFO:teuthology.orchestra.run.trial097.stdout: librados-devel-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:06:04.623 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:04.623 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-17T11:06:04.645 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:04:19 ago on Tue 17 Feb 2026 11:01:45 AM UTC. 2026-02-17T11:06:04.650 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install libcephfs2-debuginfo 2026-02-17T11:06:04.726 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-17T11:06:04.726 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:06:04.727 INFO:teuthology.orchestra.run.trial157.stdout: Package Arch Version Repo Size 2026-02-17T11:06:04.727 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:06:04.727 INFO:teuthology.orchestra.run.trial157.stdout:Installing: 2026-02-17T11:06:04.727 INFO:teuthology.orchestra.run.trial157.stdout: python3-cephfs-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 629 k 2026-02-17T11:06:04.727 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:04.727 INFO:teuthology.orchestra.run.trial157.stdout:Transaction Summary 2026-02-17T11:06:04.727 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:06:04.727 INFO:teuthology.orchestra.run.trial157.stdout:Install 1 Package 2026-02-17T11:06:04.727 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:04.727 INFO:teuthology.orchestra.run.trial157.stdout:Total download size: 629 k 2026-02-17T11:06:04.728 INFO:teuthology.orchestra.run.trial157.stdout:Installed size: 2.1 M 2026-02-17T11:06:04.728 INFO:teuthology.orchestra.run.trial157.stdout:Downloading Packages: 2026-02-17T11:06:04.955 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:04:22 ago on Tue 17 Feb 2026 11:01:42 AM UTC. 2026-02-17T11:06:05.037 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-17T11:06:05.037 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:06:05.038 INFO:teuthology.orchestra.run.trial097.stdout: Package Arch Version Repo Size 2026-02-17T11:06:05.038 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:06:05.038 INFO:teuthology.orchestra.run.trial097.stdout:Installing: 2026-02-17T11:06:05.038 INFO:teuthology.orchestra.run.trial097.stdout: libcephfs2-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 6.0 M 2026-02-17T11:06:05.038 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:05.038 INFO:teuthology.orchestra.run.trial097.stdout:Transaction Summary 2026-02-17T11:06:05.038 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:06:05.038 INFO:teuthology.orchestra.run.trial097.stdout:Install 1 Package 2026-02-17T11:06:05.038 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:05.038 INFO:teuthology.orchestra.run.trial097.stdout:Total download size: 6.0 M 2026-02-17T11:06:05.039 INFO:teuthology.orchestra.run.trial097.stdout:Installed size: 31 M 2026-02-17T11:06:05.039 INFO:teuthology.orchestra.run.trial097.stdout:Downloading Packages: 2026-02-17T11:06:05.211 INFO:teuthology.orchestra.run.trial157.stdout:python3-cephfs-debuginfo-19.2.3-705.g04cf6dd4.e 1.3 MB/s | 629 kB 00:00 2026-02-17T11:06:05.211 INFO:teuthology.orchestra.run.trial157.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:06:05.211 INFO:teuthology.orchestra.run.trial157.stdout:Total 1.3 MB/s | 629 kB 00:00 2026-02-17T11:06:05.211 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction check 2026-02-17T11:06:05.213 INFO:teuthology.orchestra.run.trial157.stdout:Transaction check succeeded. 2026-02-17T11:06:05.213 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction test 2026-02-17T11:06:05.233 INFO:teuthology.orchestra.run.trial157.stdout:Transaction test succeeded. 2026-02-17T11:06:05.233 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction 2026-02-17T11:06:05.296 INFO:teuthology.orchestra.run.trial157.stdout: Preparing : 1/1 2026-02-17T11:06:05.314 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-cephfs-debuginfo-2:19.2.3-705.g04cf6dd4.el9. 1/1 2026-02-17T11:06:05.370 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: python3-cephfs-debuginfo-2:19.2.3-705.g04cf6dd4.el9. 1/1 2026-02-17T11:06:05.428 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-cephfs-debuginfo-2:19.2.3-705.g04cf6dd4.el9. 1/1 2026-02-17T11:06:05.428 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:05.428 INFO:teuthology.orchestra.run.trial157.stdout:Installed: 2026-02-17T11:06:05.428 INFO:teuthology.orchestra.run.trial157.stdout: python3-cephfs-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:06:05.428 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:05.428 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-17T11:06:05.455 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install python3-rados-debuginfo 2026-02-17T11:06:05.764 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:04:20 ago on Tue 17 Feb 2026 11:01:45 AM UTC. 2026-02-17T11:06:05.840 INFO:teuthology.orchestra.run.trial097.stdout:libcephfs2-debuginfo-19.2.3-705.g04cf6dd4.el9.x 7.5 MB/s | 6.0 MB 00:00 2026-02-17T11:06:05.840 INFO:teuthology.orchestra.run.trial097.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:06:05.841 INFO:teuthology.orchestra.run.trial097.stdout:Total 7.4 MB/s | 6.0 MB 00:00 2026-02-17T11:06:05.841 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction check 2026-02-17T11:06:05.842 INFO:teuthology.orchestra.run.trial097.stdout:Transaction check succeeded. 2026-02-17T11:06:05.842 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction test 2026-02-17T11:06:05.845 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-17T11:06:05.846 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:06:05.846 INFO:teuthology.orchestra.run.trial157.stdout: Package Arch Version Repo Size 2026-02-17T11:06:05.846 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:06:05.846 INFO:teuthology.orchestra.run.trial157.stdout:Installing: 2026-02-17T11:06:05.847 INFO:teuthology.orchestra.run.trial157.stdout: python3-rados-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 778 k 2026-02-17T11:06:05.847 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:05.847 INFO:teuthology.orchestra.run.trial157.stdout:Transaction Summary 2026-02-17T11:06:05.847 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:06:05.847 INFO:teuthology.orchestra.run.trial157.stdout:Install 1 Package 2026-02-17T11:06:05.847 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:05.847 INFO:teuthology.orchestra.run.trial157.stdout:Total download size: 778 k 2026-02-17T11:06:05.847 INFO:teuthology.orchestra.run.trial157.stdout:Installed size: 2.8 M 2026-02-17T11:06:05.848 INFO:teuthology.orchestra.run.trial157.stdout:Downloading Packages: 2026-02-17T11:06:05.877 INFO:teuthology.orchestra.run.trial097.stdout:Transaction test succeeded. 2026-02-17T11:06:05.877 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction 2026-02-17T11:06:06.050 INFO:teuthology.orchestra.run.trial157.stdout:python3-rados-debuginfo-19.2.3-705.g04cf6dd4.el 3.7 MB/s | 778 kB 00:00 2026-02-17T11:06:06.050 INFO:teuthology.orchestra.run.trial157.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:06:06.050 INFO:teuthology.orchestra.run.trial157.stdout:Total 3.7 MB/s | 778 kB 00:00 2026-02-17T11:06:06.051 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction check 2026-02-17T11:06:06.052 INFO:teuthology.orchestra.run.trial157.stdout:Transaction check succeeded. 2026-02-17T11:06:06.053 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction test 2026-02-17T11:06:06.073 INFO:teuthology.orchestra.run.trial157.stdout:Transaction test succeeded. 2026-02-17T11:06:06.074 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction 2026-02-17T11:06:06.144 INFO:teuthology.orchestra.run.trial157.stdout: Preparing : 1/1 2026-02-17T11:06:06.162 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-rados-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x 1/1 2026-02-17T11:06:06.223 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: python3-rados-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x 1/1 2026-02-17T11:06:06.223 INFO:teuthology.orchestra.run.trial097.stdout: Preparing : 1/1 2026-02-17T11:06:06.240 INFO:teuthology.orchestra.run.trial097.stdout: Installing : libcephfs2-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_ 1/1 2026-02-17T11:06:06.281 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-rados-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x 1/1 2026-02-17T11:06:06.281 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:06.281 INFO:teuthology.orchestra.run.trial157.stdout:Installed: 2026-02-17T11:06:06.282 INFO:teuthology.orchestra.run.trial157.stdout: python3-rados-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:06:06.282 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:06.282 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-17T11:06:06.307 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install python3-rbd-debuginfo 2026-02-17T11:06:06.317 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: libcephfs2-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_ 1/1 2026-02-17T11:06:06.375 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : libcephfs2-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_ 1/1 2026-02-17T11:06:06.375 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:06.375 INFO:teuthology.orchestra.run.trial097.stdout:Installed: 2026-02-17T11:06:06.375 INFO:teuthology.orchestra.run.trial097.stdout: libcephfs2-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:06:06.375 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:06.375 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-17T11:06:06.402 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install librados2-debuginfo 2026-02-17T11:06:06.411 INFO:teuthology.orchestra.run.trial049.stdout:ceph-osd-debuginfo-19.2.3-705.g04cf6dd4.el9.x86 49 MB/s | 298 MB 00:06 2026-02-17T11:06:06.412 INFO:teuthology.orchestra.run.trial049.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:06:06.412 INFO:teuthology.orchestra.run.trial049.stdout:Total 49 MB/s | 298 MB 00:06 2026-02-17T11:06:06.412 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction check 2026-02-17T11:06:06.414 INFO:teuthology.orchestra.run.trial049.stdout:Transaction check succeeded. 2026-02-17T11:06:06.414 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction test 2026-02-17T11:06:06.612 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:04:21 ago on Tue 17 Feb 2026 11:01:45 AM UTC. 2026-02-17T11:06:06.694 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-17T11:06:06.694 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:06:06.695 INFO:teuthology.orchestra.run.trial157.stdout: Package Arch Version Repo Size 2026-02-17T11:06:06.695 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:06:06.695 INFO:teuthology.orchestra.run.trial157.stdout:Installing: 2026-02-17T11:06:06.695 INFO:teuthology.orchestra.run.trial157.stdout: python3-rbd-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 1.1 M 2026-02-17T11:06:06.695 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:06.695 INFO:teuthology.orchestra.run.trial157.stdout:Transaction Summary 2026-02-17T11:06:06.695 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:06:06.695 INFO:teuthology.orchestra.run.trial157.stdout:Install 1 Package 2026-02-17T11:06:06.695 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:06.695 INFO:teuthology.orchestra.run.trial157.stdout:Total download size: 1.1 M 2026-02-17T11:06:06.695 INFO:teuthology.orchestra.run.trial157.stdout:Installed size: 4.3 M 2026-02-17T11:06:06.696 INFO:teuthology.orchestra.run.trial157.stdout:Downloading Packages: 2026-02-17T11:06:06.710 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:04:24 ago on Tue 17 Feb 2026 11:01:42 AM UTC. 2026-02-17T11:06:06.792 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-17T11:06:06.792 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:06:06.792 INFO:teuthology.orchestra.run.trial097.stdout: Package Arch Version Repo Size 2026-02-17T11:06:06.792 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:06:06.792 INFO:teuthology.orchestra.run.trial097.stdout:Installing: 2026-02-17T11:06:06.792 INFO:teuthology.orchestra.run.trial097.stdout: librados2-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 47 M 2026-02-17T11:06:06.793 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:06.793 INFO:teuthology.orchestra.run.trial097.stdout:Transaction Summary 2026-02-17T11:06:06.793 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:06:06.793 INFO:teuthology.orchestra.run.trial097.stdout:Install 1 Package 2026-02-17T11:06:06.793 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:06.793 INFO:teuthology.orchestra.run.trial097.stdout:Total download size: 47 M 2026-02-17T11:06:06.793 INFO:teuthology.orchestra.run.trial097.stdout:Installed size: 302 M 2026-02-17T11:06:06.793 INFO:teuthology.orchestra.run.trial097.stdout:Downloading Packages: 2026-02-17T11:06:06.814 INFO:teuthology.orchestra.run.trial157.stdout:python3-rbd-debuginfo-19.2.3-705.g04cf6dd4.el9. 9.5 MB/s | 1.1 MB 00:00 2026-02-17T11:06:06.815 INFO:teuthology.orchestra.run.trial157.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:06:06.815 INFO:teuthology.orchestra.run.trial157.stdout:Total 9.4 MB/s | 1.1 MB 00:00 2026-02-17T11:06:06.815 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction check 2026-02-17T11:06:06.817 INFO:teuthology.orchestra.run.trial157.stdout:Transaction check succeeded. 2026-02-17T11:06:06.817 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction test 2026-02-17T11:06:06.838 INFO:teuthology.orchestra.run.trial157.stdout:Transaction test succeeded. 2026-02-17T11:06:06.839 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction 2026-02-17T11:06:06.928 INFO:teuthology.orchestra.run.trial157.stdout: Preparing : 1/1 2026-02-17T11:06:06.946 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-rbd-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86 1/1 2026-02-17T11:06:07.003 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: python3-rbd-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86 1/1 2026-02-17T11:06:07.061 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-rbd-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86 1/1 2026-02-17T11:06:07.061 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:07.061 INFO:teuthology.orchestra.run.trial157.stdout:Installed: 2026-02-17T11:06:07.062 INFO:teuthology.orchestra.run.trial157.stdout: python3-rbd-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:06:07.062 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:07.062 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-17T11:06:07.089 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install python3-rgw-debuginfo 2026-02-17T11:06:07.357 INFO:teuthology.orchestra.run.trial049.stdout:Transaction test succeeded. 2026-02-17T11:06:07.357 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction 2026-02-17T11:06:07.403 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:04:22 ago on Tue 17 Feb 2026 11:01:45 AM UTC. 2026-02-17T11:06:07.486 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-17T11:06:07.486 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:06:07.486 INFO:teuthology.orchestra.run.trial157.stdout: Package Arch Version Repo Size 2026-02-17T11:06:07.487 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:06:07.487 INFO:teuthology.orchestra.run.trial157.stdout:Installing: 2026-02-17T11:06:07.487 INFO:teuthology.orchestra.run.trial157.stdout: python3-rgw-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 339 k 2026-02-17T11:06:07.487 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:07.487 INFO:teuthology.orchestra.run.trial157.stdout:Transaction Summary 2026-02-17T11:06:07.488 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:06:07.488 INFO:teuthology.orchestra.run.trial157.stdout:Install 1 Package 2026-02-17T11:06:07.488 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:07.488 INFO:teuthology.orchestra.run.trial157.stdout:Total download size: 339 k 2026-02-17T11:06:07.488 INFO:teuthology.orchestra.run.trial157.stdout:Installed size: 1.0 M 2026-02-17T11:06:07.488 INFO:teuthology.orchestra.run.trial157.stdout:Downloading Packages: 2026-02-17T11:06:07.729 INFO:teuthology.orchestra.run.trial157.stdout:python3-rgw-debuginfo-19.2.3-705.g04cf6dd4.el9. 1.4 MB/s | 339 kB 00:00 2026-02-17T11:06:07.730 INFO:teuthology.orchestra.run.trial157.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:06:07.730 INFO:teuthology.orchestra.run.trial157.stdout:Total 1.4 MB/s | 339 kB 00:00 2026-02-17T11:06:07.730 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction check 2026-02-17T11:06:07.731 INFO:teuthology.orchestra.run.trial157.stdout:Transaction check succeeded. 2026-02-17T11:06:07.732 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction test 2026-02-17T11:06:07.751 INFO:teuthology.orchestra.run.trial157.stdout:Transaction test succeeded. 2026-02-17T11:06:07.751 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction 2026-02-17T11:06:07.759 INFO:teuthology.orchestra.run.trial097.stdout:librados2-debuginfo-19.2.3-705.g04cf6dd4.el9.x8 49 MB/s | 47 MB 00:00 2026-02-17T11:06:07.760 INFO:teuthology.orchestra.run.trial097.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:06:07.760 INFO:teuthology.orchestra.run.trial097.stdout:Total 49 MB/s | 47 MB 00:00 2026-02-17T11:06:07.760 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction check 2026-02-17T11:06:07.762 INFO:teuthology.orchestra.run.trial097.stdout:Transaction check succeeded. 2026-02-17T11:06:07.762 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction test 2026-02-17T11:06:07.800 INFO:teuthology.orchestra.run.trial157.stdout: Preparing : 1/1 2026-02-17T11:06:07.818 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-rgw-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86 1/1 2026-02-17T11:06:07.870 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: python3-rgw-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86 1/1 2026-02-17T11:06:07.919 INFO:teuthology.orchestra.run.trial097.stdout:Transaction test succeeded. 2026-02-17T11:06:07.919 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction 2026-02-17T11:06:07.929 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-rgw-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86 1/1 2026-02-17T11:06:07.929 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:07.929 INFO:teuthology.orchestra.run.trial157.stdout:Installed: 2026-02-17T11:06:07.929 INFO:teuthology.orchestra.run.trial157.stdout: python3-rgw-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:06:07.929 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:07.929 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-17T11:06:07.956 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install rbd-fuse-debuginfo 2026-02-17T11:06:08.266 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:04:23 ago on Tue 17 Feb 2026 11:01:45 AM UTC. 2026-02-17T11:06:08.348 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-17T11:06:08.349 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:06:08.349 INFO:teuthology.orchestra.run.trial157.stdout: Package Arch Version Repo Size 2026-02-17T11:06:08.350 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:06:08.350 INFO:teuthology.orchestra.run.trial157.stdout:Installing: 2026-02-17T11:06:08.350 INFO:teuthology.orchestra.run.trial157.stdout: rbd-fuse-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 546 k 2026-02-17T11:06:08.350 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:08.350 INFO:teuthology.orchestra.run.trial157.stdout:Transaction Summary 2026-02-17T11:06:08.350 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:06:08.350 INFO:teuthology.orchestra.run.trial157.stdout:Install 1 Package 2026-02-17T11:06:08.350 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:08.350 INFO:teuthology.orchestra.run.trial157.stdout:Total download size: 546 k 2026-02-17T11:06:08.350 INFO:teuthology.orchestra.run.trial157.stdout:Installed size: 3.0 M 2026-02-17T11:06:08.351 INFO:teuthology.orchestra.run.trial157.stdout:Downloading Packages: 2026-02-17T11:06:08.457 INFO:teuthology.orchestra.run.trial157.stdout:rbd-fuse-debuginfo-19.2.3-705.g04cf6dd4.el9.x86 5.0 MB/s | 546 kB 00:00 2026-02-17T11:06:08.458 INFO:teuthology.orchestra.run.trial157.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:06:08.458 INFO:teuthology.orchestra.run.trial157.stdout:Total 4.9 MB/s | 546 kB 00:00 2026-02-17T11:06:08.458 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction check 2026-02-17T11:06:08.459 INFO:teuthology.orchestra.run.trial157.stdout:Transaction check succeeded. 2026-02-17T11:06:08.459 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction test 2026-02-17T11:06:08.479 INFO:teuthology.orchestra.run.trial157.stdout:Transaction test succeeded. 2026-02-17T11:06:08.479 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction 2026-02-17T11:06:08.541 INFO:teuthology.orchestra.run.trial157.stdout: Preparing : 1/1 2026-02-17T11:06:08.559 INFO:teuthology.orchestra.run.trial157.stdout: Installing : rbd-fuse-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:06:08.615 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: rbd-fuse-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:06:08.673 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : rbd-fuse-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:06:08.674 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:08.674 INFO:teuthology.orchestra.run.trial157.stdout:Installed: 2026-02-17T11:06:08.674 INFO:teuthology.orchestra.run.trial157.stdout: rbd-fuse-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:06:08.674 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:08.674 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-17T11:06:08.701 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install rbd-mirror-debuginfo 2026-02-17T11:06:09.009 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:04:24 ago on Tue 17 Feb 2026 11:01:45 AM UTC. 2026-02-17T11:06:09.093 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-17T11:06:09.093 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:06:09.093 INFO:teuthology.orchestra.run.trial157.stdout: Package Arch Version Repo Size 2026-02-17T11:06:09.093 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:06:09.093 INFO:teuthology.orchestra.run.trial157.stdout:Installing: 2026-02-17T11:06:09.093 INFO:teuthology.orchestra.run.trial157.stdout: rbd-mirror-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 54 M 2026-02-17T11:06:09.093 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:09.094 INFO:teuthology.orchestra.run.trial157.stdout:Transaction Summary 2026-02-17T11:06:09.094 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:06:09.094 INFO:teuthology.orchestra.run.trial157.stdout:Install 1 Package 2026-02-17T11:06:09.094 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:09.094 INFO:teuthology.orchestra.run.trial157.stdout:Total download size: 54 M 2026-02-17T11:06:09.094 INFO:teuthology.orchestra.run.trial157.stdout:Installed size: 353 M 2026-02-17T11:06:09.094 INFO:teuthology.orchestra.run.trial157.stdout:Downloading Packages: 2026-02-17T11:06:09.718 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-17T11:06:09.736 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-osd-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:06:10.182 INFO:teuthology.orchestra.run.trial157.stdout:rbd-mirror-debuginfo-19.2.3-705.g04cf6dd4.el9.x 49 MB/s | 54 MB 00:01 2026-02-17T11:06:10.183 INFO:teuthology.orchestra.run.trial157.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:06:10.183 INFO:teuthology.orchestra.run.trial157.stdout:Total 49 MB/s | 54 MB 00:01 2026-02-17T11:06:10.183 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction check 2026-02-17T11:06:10.185 INFO:teuthology.orchestra.run.trial157.stdout:Transaction check succeeded. 2026-02-17T11:06:10.185 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction test 2026-02-17T11:06:10.361 INFO:teuthology.orchestra.run.trial157.stdout:Transaction test succeeded. 2026-02-17T11:06:10.361 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction 2026-02-17T11:06:10.585 INFO:teuthology.orchestra.run.trial097.stdout: Preparing : 1/1 2026-02-17T11:06:10.603 INFO:teuthology.orchestra.run.trial097.stdout: Installing : librados2-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_6 1/1 2026-02-17T11:06:10.800 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-osd-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:06:10.857 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-osd-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:06:10.858 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:10.858 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-17T11:06:10.858 INFO:teuthology.orchestra.run.trial162.stdout: ceph-osd-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:06:10.858 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:10.858 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T11:06:10.877 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: librados2-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_6 1/1 2026-02-17T11:06:10.909 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install ceph-fuse-debuginfo 2026-02-17T11:06:10.936 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : librados2-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_6 1/1 2026-02-17T11:06:10.937 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:10.937 INFO:teuthology.orchestra.run.trial097.stdout:Installed: 2026-02-17T11:06:10.937 INFO:teuthology.orchestra.run.trial097.stdout: librados2-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:06:10.937 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:10.937 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-17T11:06:10.968 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install librbd1-debuginfo 2026-02-17T11:06:11.213 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:04:02 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:06:11.276 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:04:29 ago on Tue 17 Feb 2026 11:01:42 AM UTC. 2026-02-17T11:06:11.296 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T11:06:11.296 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:06:11.297 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repo Size 2026-02-17T11:06:11.297 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:06:11.297 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-17T11:06:11.297 INFO:teuthology.orchestra.run.trial162.stdout: ceph-fuse-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 6.8 M 2026-02-17T11:06:11.297 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:11.297 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-17T11:06:11.297 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:06:11.297 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-17T11:06:11.297 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:11.297 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 6.8 M 2026-02-17T11:06:11.298 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 36 M 2026-02-17T11:06:11.298 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-17T11:06:11.358 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-17T11:06:11.358 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:06:11.359 INFO:teuthology.orchestra.run.trial097.stdout: Package Arch Version Repo Size 2026-02-17T11:06:11.359 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:06:11.359 INFO:teuthology.orchestra.run.trial097.stdout:Installing: 2026-02-17T11:06:11.359 INFO:teuthology.orchestra.run.trial097.stdout: librbd1-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 54 M 2026-02-17T11:06:11.359 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:11.359 INFO:teuthology.orchestra.run.trial097.stdout:Transaction Summary 2026-02-17T11:06:11.359 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:06:11.359 INFO:teuthology.orchestra.run.trial097.stdout:Install 1 Package 2026-02-17T11:06:11.359 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:11.360 INFO:teuthology.orchestra.run.trial097.stdout:Total download size: 54 M 2026-02-17T11:06:11.360 INFO:teuthology.orchestra.run.trial097.stdout:Installed size: 374 M 2026-02-17T11:06:11.360 INFO:teuthology.orchestra.run.trial097.stdout:Downloading Packages: 2026-02-17T11:06:11.520 INFO:teuthology.orchestra.run.trial162.stdout:ceph-fuse-debuginfo-19.2.3-705.g04cf6dd4.el9.x8 31 MB/s | 6.8 MB 00:00 2026-02-17T11:06:11.521 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:06:11.521 INFO:teuthology.orchestra.run.trial162.stdout:Total 31 MB/s | 6.8 MB 00:00 2026-02-17T11:06:11.521 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-17T11:06:11.522 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-17T11:06:11.523 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-17T11:06:11.561 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-17T11:06:11.561 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-17T11:06:11.954 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-17T11:06:11.972 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-fuse-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_6 1/1 2026-02-17T11:06:12.058 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-fuse-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_6 1/1 2026-02-17T11:06:12.116 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-fuse-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_6 1/1 2026-02-17T11:06:12.116 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:12.116 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-17T11:06:12.116 INFO:teuthology.orchestra.run.trial162.stdout: ceph-fuse-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:06:12.117 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:12.117 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T11:06:12.143 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install librados-devel-debuginfo 2026-02-17T11:06:12.450 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:04:03 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:06:12.533 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T11:06:12.534 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:06:12.534 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repo Size 2026-02-17T11:06:12.534 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:06:12.534 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-17T11:06:12.534 INFO:teuthology.orchestra.run.trial162.stdout: librados-devel-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 112 k 2026-02-17T11:06:12.534 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:12.534 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-17T11:06:12.534 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:06:12.535 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-17T11:06:12.535 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:12.535 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 112 k 2026-02-17T11:06:12.535 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 493 k 2026-02-17T11:06:12.535 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-17T11:06:12.697 INFO:teuthology.orchestra.run.trial162.stdout:librados-devel-debuginfo-19.2.3-705.g04cf6dd4.e 688 kB/s | 112 kB 00:00 2026-02-17T11:06:12.698 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:06:12.698 INFO:teuthology.orchestra.run.trial162.stdout:Total 684 kB/s | 112 kB 00:00 2026-02-17T11:06:12.698 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-17T11:06:12.699 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-17T11:06:12.700 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-17T11:06:12.718 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-17T11:06:12.718 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-17T11:06:12.726 INFO:teuthology.orchestra.run.trial097.stdout:librbd1-debuginfo-19.2.3-705.g04cf6dd4.el9.x86_ 40 MB/s | 54 MB 00:01 2026-02-17T11:06:12.726 INFO:teuthology.orchestra.run.trial097.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:06:12.727 INFO:teuthology.orchestra.run.trial097.stdout:Total 40 MB/s | 54 MB 00:01 2026-02-17T11:06:12.727 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction check 2026-02-17T11:06:12.729 INFO:teuthology.orchestra.run.trial097.stdout:Transaction check succeeded. 2026-02-17T11:06:12.729 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction test 2026-02-17T11:06:12.758 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-17T11:06:12.775 INFO:teuthology.orchestra.run.trial162.stdout: Installing : librados-devel-debuginfo-2:19.2.3-705.g04cf6dd4.el9. 1/1 2026-02-17T11:06:12.830 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: librados-devel-debuginfo-2:19.2.3-705.g04cf6dd4.el9. 1/1 2026-02-17T11:06:12.888 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : librados-devel-debuginfo-2:19.2.3-705.g04cf6dd4.el9. 1/1 2026-02-17T11:06:12.888 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:12.888 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-17T11:06:12.888 INFO:teuthology.orchestra.run.trial162.stdout: librados-devel-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:06:12.888 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:12.889 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T11:06:12.908 INFO:teuthology.orchestra.run.trial097.stdout:Transaction test succeeded. 2026-02-17T11:06:12.908 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction 2026-02-17T11:06:12.915 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install libcephfs2-debuginfo 2026-02-17T11:06:13.226 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:04:04 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:06:13.309 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T11:06:13.309 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:06:13.309 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repo Size 2026-02-17T11:06:13.309 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:06:13.309 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-17T11:06:13.310 INFO:teuthology.orchestra.run.trial162.stdout: libcephfs2-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 6.0 M 2026-02-17T11:06:13.310 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:13.310 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-17T11:06:13.310 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:06:13.310 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-17T11:06:13.310 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:13.310 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 6.0 M 2026-02-17T11:06:13.310 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 31 M 2026-02-17T11:06:13.310 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-17T11:06:13.460 INFO:teuthology.orchestra.run.trial157.stdout: Preparing : 1/1 2026-02-17T11:06:13.479 INFO:teuthology.orchestra.run.trial157.stdout: Installing : rbd-mirror-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_ 1/1 2026-02-17T11:06:13.512 INFO:teuthology.orchestra.run.trial162.stdout:libcephfs2-debuginfo-19.2.3-705.g04cf6dd4.el9.x 30 MB/s | 6.0 MB 00:00 2026-02-17T11:06:13.512 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:06:13.512 INFO:teuthology.orchestra.run.trial162.stdout:Total 29 MB/s | 6.0 MB 00:00 2026-02-17T11:06:13.513 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-17T11:06:13.514 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-17T11:06:13.514 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-17T11:06:13.549 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-17T11:06:13.550 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-17T11:06:13.796 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: rbd-mirror-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_ 1/1 2026-02-17T11:06:13.854 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : rbd-mirror-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_ 1/1 2026-02-17T11:06:13.854 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:13.854 INFO:teuthology.orchestra.run.trial157.stdout:Installed: 2026-02-17T11:06:13.854 INFO:teuthology.orchestra.run.trial157.stdout: rbd-mirror-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:06:13.854 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:13.854 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-17T11:06:13.886 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install rbd-nbd-debuginfo 2026-02-17T11:06:13.898 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-17T11:06:13.916 INFO:teuthology.orchestra.run.trial162.stdout: Installing : libcephfs2-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_ 1/1 2026-02-17T11:06:13.994 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: libcephfs2-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_ 1/1 2026-02-17T11:06:14.051 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : libcephfs2-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_ 1/1 2026-02-17T11:06:14.052 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:14.052 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-17T11:06:14.052 INFO:teuthology.orchestra.run.trial162.stdout: libcephfs2-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:06:14.052 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:14.052 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T11:06:14.079 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install librados2-debuginfo 2026-02-17T11:06:14.199 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:04:29 ago on Tue 17 Feb 2026 11:01:45 AM UTC. 2026-02-17T11:06:14.284 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-17T11:06:14.284 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:06:14.284 INFO:teuthology.orchestra.run.trial157.stdout: Package Arch Version Repo Size 2026-02-17T11:06:14.284 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:06:14.284 INFO:teuthology.orchestra.run.trial157.stdout:Installing: 2026-02-17T11:06:14.284 INFO:teuthology.orchestra.run.trial157.stdout: rbd-nbd-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 1.4 M 2026-02-17T11:06:14.284 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:14.285 INFO:teuthology.orchestra.run.trial157.stdout:Transaction Summary 2026-02-17T11:06:14.285 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-17T11:06:14.285 INFO:teuthology.orchestra.run.trial157.stdout:Install 1 Package 2026-02-17T11:06:14.285 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:14.285 INFO:teuthology.orchestra.run.trial157.stdout:Total download size: 1.4 M 2026-02-17T11:06:14.285 INFO:teuthology.orchestra.run.trial157.stdout:Installed size: 6.6 M 2026-02-17T11:06:14.285 INFO:teuthology.orchestra.run.trial157.stdout:Downloading Packages: 2026-02-17T11:06:14.388 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:04:05 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:06:14.404 INFO:teuthology.orchestra.run.trial157.stdout:rbd-nbd-debuginfo-19.2.3-705.g04cf6dd4.el9.x86_ 11 MB/s | 1.4 MB 00:00 2026-02-17T11:06:14.404 INFO:teuthology.orchestra.run.trial157.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:06:14.405 INFO:teuthology.orchestra.run.trial157.stdout:Total 11 MB/s | 1.4 MB 00:00 2026-02-17T11:06:14.405 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction check 2026-02-17T11:06:14.406 INFO:teuthology.orchestra.run.trial157.stdout:Transaction check succeeded. 2026-02-17T11:06:14.406 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction test 2026-02-17T11:06:14.427 INFO:teuthology.orchestra.run.trial157.stdout:Transaction test succeeded. 2026-02-17T11:06:14.428 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction 2026-02-17T11:06:14.472 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T11:06:14.473 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:06:14.473 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repo Size 2026-02-17T11:06:14.473 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:06:14.473 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-17T11:06:14.473 INFO:teuthology.orchestra.run.trial162.stdout: librados2-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 47 M 2026-02-17T11:06:14.474 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:14.474 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-17T11:06:14.474 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:06:14.474 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-17T11:06:14.474 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:14.474 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 47 M 2026-02-17T11:06:14.474 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 302 M 2026-02-17T11:06:14.474 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-17T11:06:14.532 INFO:teuthology.orchestra.run.trial157.stdout: Preparing : 1/1 2026-02-17T11:06:14.549 INFO:teuthology.orchestra.run.trial157.stdout: Installing : rbd-nbd-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:06:14.614 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: rbd-nbd-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:06:14.673 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : rbd-nbd-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:06:14.673 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:14.673 INFO:teuthology.orchestra.run.trial157.stdout:Installed: 2026-02-17T11:06:14.673 INFO:teuthology.orchestra.run.trial157.stdout: rbd-nbd-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:06:14.673 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:14.673 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-17T11:06:14.704 DEBUG:teuthology.parallel:result is None 2026-02-17T11:06:15.442 INFO:teuthology.orchestra.run.trial162.stdout:librados2-debuginfo-19.2.3-705.g04cf6dd4.el9.x8 49 MB/s | 47 MB 00:00 2026-02-17T11:06:15.443 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:06:15.443 INFO:teuthology.orchestra.run.trial162.stdout:Total 49 MB/s | 47 MB 00:00 2026-02-17T11:06:15.443 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-17T11:06:15.445 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-17T11:06:15.445 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-17T11:06:15.603 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-17T11:06:15.604 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-17T11:06:16.052 INFO:teuthology.orchestra.run.trial097.stdout: Preparing : 1/1 2026-02-17T11:06:16.070 INFO:teuthology.orchestra.run.trial097.stdout: Installing : librbd1-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:06:16.378 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: librbd1-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:06:16.436 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : librbd1-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:06:16.436 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:16.436 INFO:teuthology.orchestra.run.trial097.stdout:Installed: 2026-02-17T11:06:16.436 INFO:teuthology.orchestra.run.trial097.stdout: librbd1-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:06:16.436 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:16.436 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-17T11:06:16.469 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install python3-cephfs-debuginfo 2026-02-17T11:06:16.778 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:04:34 ago on Tue 17 Feb 2026 11:01:42 AM UTC. 2026-02-17T11:06:16.860 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-17T11:06:16.860 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:06:16.860 INFO:teuthology.orchestra.run.trial097.stdout: Package Arch Version Repo Size 2026-02-17T11:06:16.861 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:06:16.861 INFO:teuthology.orchestra.run.trial097.stdout:Installing: 2026-02-17T11:06:16.861 INFO:teuthology.orchestra.run.trial097.stdout: python3-cephfs-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 629 k 2026-02-17T11:06:16.861 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:16.861 INFO:teuthology.orchestra.run.trial097.stdout:Transaction Summary 2026-02-17T11:06:16.861 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:06:16.861 INFO:teuthology.orchestra.run.trial097.stdout:Install 1 Package 2026-02-17T11:06:16.861 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:16.861 INFO:teuthology.orchestra.run.trial097.stdout:Total download size: 629 k 2026-02-17T11:06:16.861 INFO:teuthology.orchestra.run.trial097.stdout:Installed size: 2.1 M 2026-02-17T11:06:16.862 INFO:teuthology.orchestra.run.trial097.stdout:Downloading Packages: 2026-02-17T11:06:17.318 INFO:teuthology.orchestra.run.trial097.stdout:python3-cephfs-debuginfo-19.2.3-705.g04cf6dd4.e 1.3 MB/s | 629 kB 00:00 2026-02-17T11:06:17.320 INFO:teuthology.orchestra.run.trial097.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:06:17.320 INFO:teuthology.orchestra.run.trial097.stdout:Total 1.3 MB/s | 629 kB 00:00 2026-02-17T11:06:17.320 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction check 2026-02-17T11:06:17.323 INFO:teuthology.orchestra.run.trial097.stdout:Transaction check succeeded. 2026-02-17T11:06:17.323 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction test 2026-02-17T11:06:17.342 INFO:teuthology.orchestra.run.trial097.stdout:Transaction test succeeded. 2026-02-17T11:06:17.342 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction 2026-02-17T11:06:17.405 INFO:teuthology.orchestra.run.trial097.stdout: Preparing : 1/1 2026-02-17T11:06:17.423 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-cephfs-debuginfo-2:19.2.3-705.g04cf6dd4.el9. 1/1 2026-02-17T11:06:17.482 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: python3-cephfs-debuginfo-2:19.2.3-705.g04cf6dd4.el9. 1/1 2026-02-17T11:06:17.540 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-cephfs-debuginfo-2:19.2.3-705.g04cf6dd4.el9. 1/1 2026-02-17T11:06:17.541 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:17.541 INFO:teuthology.orchestra.run.trial097.stdout:Installed: 2026-02-17T11:06:17.541 INFO:teuthology.orchestra.run.trial097.stdout: python3-cephfs-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:06:17.541 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:17.541 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-17T11:06:17.568 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install python3-rados-debuginfo 2026-02-17T11:06:17.877 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:04:35 ago on Tue 17 Feb 2026 11:01:42 AM UTC. 2026-02-17T11:06:17.960 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-17T11:06:17.960 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:06:17.960 INFO:teuthology.orchestra.run.trial097.stdout: Package Arch Version Repo Size 2026-02-17T11:06:17.960 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:06:17.960 INFO:teuthology.orchestra.run.trial097.stdout:Installing: 2026-02-17T11:06:17.961 INFO:teuthology.orchestra.run.trial097.stdout: python3-rados-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 778 k 2026-02-17T11:06:17.961 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:17.961 INFO:teuthology.orchestra.run.trial097.stdout:Transaction Summary 2026-02-17T11:06:17.961 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:06:17.961 INFO:teuthology.orchestra.run.trial097.stdout:Install 1 Package 2026-02-17T11:06:17.961 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:17.961 INFO:teuthology.orchestra.run.trial097.stdout:Total download size: 778 k 2026-02-17T11:06:17.961 INFO:teuthology.orchestra.run.trial097.stdout:Installed size: 2.8 M 2026-02-17T11:06:17.961 INFO:teuthology.orchestra.run.trial097.stdout:Downloading Packages: 2026-02-17T11:06:18.294 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-17T11:06:18.312 INFO:teuthology.orchestra.run.trial162.stdout: Installing : librados2-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_6 1/1 2026-02-17T11:06:18.425 INFO:teuthology.orchestra.run.trial097.stdout:python3-rados-debuginfo-19.2.3-705.g04cf6dd4.el 1.6 MB/s | 778 kB 00:00 2026-02-17T11:06:18.425 INFO:teuthology.orchestra.run.trial097.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:06:18.425 INFO:teuthology.orchestra.run.trial097.stdout:Total 1.6 MB/s | 778 kB 00:00 2026-02-17T11:06:18.425 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction check 2026-02-17T11:06:18.427 INFO:teuthology.orchestra.run.trial097.stdout:Transaction check succeeded. 2026-02-17T11:06:18.427 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction test 2026-02-17T11:06:18.447 INFO:teuthology.orchestra.run.trial097.stdout:Transaction test succeeded. 2026-02-17T11:06:18.447 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction 2026-02-17T11:06:18.518 INFO:teuthology.orchestra.run.trial097.stdout: Preparing : 1/1 2026-02-17T11:06:18.535 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-rados-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x 1/1 2026-02-17T11:06:18.594 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: python3-rados-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x 1/1 2026-02-17T11:06:18.600 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: librados2-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_6 1/1 2026-02-17T11:06:18.651 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-rados-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x 1/1 2026-02-17T11:06:18.651 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:18.651 INFO:teuthology.orchestra.run.trial097.stdout:Installed: 2026-02-17T11:06:18.651 INFO:teuthology.orchestra.run.trial097.stdout: python3-rados-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:06:18.651 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:18.651 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-17T11:06:18.658 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : librados2-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_6 1/1 2026-02-17T11:06:18.659 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:18.659 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-17T11:06:18.659 INFO:teuthology.orchestra.run.trial162.stdout: librados2-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:06:18.659 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:18.659 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T11:06:18.679 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install python3-rbd-debuginfo 2026-02-17T11:06:18.691 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install librbd1-debuginfo 2026-02-17T11:06:19.000 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:04:36 ago on Tue 17 Feb 2026 11:01:42 AM UTC. 2026-02-17T11:06:19.002 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:04:10 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:06:19.083 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-17T11:06:19.084 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:06:19.084 INFO:teuthology.orchestra.run.trial097.stdout: Package Arch Version Repo Size 2026-02-17T11:06:19.084 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:06:19.084 INFO:teuthology.orchestra.run.trial097.stdout:Installing: 2026-02-17T11:06:19.084 INFO:teuthology.orchestra.run.trial097.stdout: python3-rbd-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 1.1 M 2026-02-17T11:06:19.084 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:19.084 INFO:teuthology.orchestra.run.trial097.stdout:Transaction Summary 2026-02-17T11:06:19.084 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:06:19.084 INFO:teuthology.orchestra.run.trial097.stdout:Install 1 Package 2026-02-17T11:06:19.084 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:19.084 INFO:teuthology.orchestra.run.trial097.stdout:Total download size: 1.1 M 2026-02-17T11:06:19.084 INFO:teuthology.orchestra.run.trial097.stdout:Installed size: 4.3 M 2026-02-17T11:06:19.084 INFO:teuthology.orchestra.run.trial097.stdout:Downloading Packages: 2026-02-17T11:06:19.086 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T11:06:19.086 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:06:19.086 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repo Size 2026-02-17T11:06:19.086 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:06:19.086 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-17T11:06:19.086 INFO:teuthology.orchestra.run.trial162.stdout: librbd1-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 54 M 2026-02-17T11:06:19.086 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:19.086 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-17T11:06:19.086 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:06:19.086 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-17T11:06:19.086 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:19.086 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 54 M 2026-02-17T11:06:19.087 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 374 M 2026-02-17T11:06:19.087 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-17T11:06:19.605 INFO:teuthology.orchestra.run.trial097.stdout:python3-rbd-debuginfo-19.2.3-705.g04cf6dd4.el9. 2.2 MB/s | 1.1 MB 00:00 2026-02-17T11:06:19.605 INFO:teuthology.orchestra.run.trial097.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:06:19.605 INFO:teuthology.orchestra.run.trial097.stdout:Total 2.2 MB/s | 1.1 MB 00:00 2026-02-17T11:06:19.605 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction check 2026-02-17T11:06:19.607 INFO:teuthology.orchestra.run.trial097.stdout:Transaction check succeeded. 2026-02-17T11:06:19.607 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction test 2026-02-17T11:06:19.629 INFO:teuthology.orchestra.run.trial097.stdout:Transaction test succeeded. 2026-02-17T11:06:19.629 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction 2026-02-17T11:06:19.719 INFO:teuthology.orchestra.run.trial097.stdout: Preparing : 1/1 2026-02-17T11:06:19.736 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-rbd-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86 1/1 2026-02-17T11:06:19.800 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: python3-rbd-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86 1/1 2026-02-17T11:06:19.857 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-rbd-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86 1/1 2026-02-17T11:06:19.858 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:19.858 INFO:teuthology.orchestra.run.trial097.stdout:Installed: 2026-02-17T11:06:19.858 INFO:teuthology.orchestra.run.trial097.stdout: python3-rbd-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:06:19.858 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:19.858 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-17T11:06:19.885 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install python3-rgw-debuginfo 2026-02-17T11:06:20.195 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:04:38 ago on Tue 17 Feb 2026 11:01:42 AM UTC. 2026-02-17T11:06:20.280 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-17T11:06:20.280 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:06:20.281 INFO:teuthology.orchestra.run.trial097.stdout: Package Arch Version Repo Size 2026-02-17T11:06:20.281 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:06:20.281 INFO:teuthology.orchestra.run.trial097.stdout:Installing: 2026-02-17T11:06:20.281 INFO:teuthology.orchestra.run.trial097.stdout: python3-rgw-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 339 k 2026-02-17T11:06:20.281 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:20.281 INFO:teuthology.orchestra.run.trial097.stdout:Transaction Summary 2026-02-17T11:06:20.281 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:06:20.281 INFO:teuthology.orchestra.run.trial097.stdout:Install 1 Package 2026-02-17T11:06:20.281 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:20.281 INFO:teuthology.orchestra.run.trial097.stdout:Total download size: 339 k 2026-02-17T11:06:20.282 INFO:teuthology.orchestra.run.trial097.stdout:Installed size: 1.0 M 2026-02-17T11:06:20.282 INFO:teuthology.orchestra.run.trial097.stdout:Downloading Packages: 2026-02-17T11:06:20.607 INFO:teuthology.orchestra.run.trial097.stdout:python3-rgw-debuginfo-19.2.3-705.g04cf6dd4.el9. 1.0 MB/s | 339 kB 00:00 2026-02-17T11:06:20.607 INFO:teuthology.orchestra.run.trial097.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:06:20.607 INFO:teuthology.orchestra.run.trial097.stdout:Total 1.0 MB/s | 339 kB 00:00 2026-02-17T11:06:20.607 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction check 2026-02-17T11:06:20.609 INFO:teuthology.orchestra.run.trial097.stdout:Transaction check succeeded. 2026-02-17T11:06:20.609 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction test 2026-02-17T11:06:20.627 INFO:teuthology.orchestra.run.trial097.stdout:Transaction test succeeded. 2026-02-17T11:06:20.628 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction 2026-02-17T11:06:20.655 INFO:teuthology.orchestra.run.trial162.stdout:librbd1-debuginfo-19.2.3-705.g04cf6dd4.el9.x86_ 35 MB/s | 54 MB 00:01 2026-02-17T11:06:20.655 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:06:20.655 INFO:teuthology.orchestra.run.trial162.stdout:Total 35 MB/s | 54 MB 00:01 2026-02-17T11:06:20.655 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-17T11:06:20.657 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-17T11:06:20.657 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-17T11:06:20.677 INFO:teuthology.orchestra.run.trial097.stdout: Preparing : 1/1 2026-02-17T11:06:20.694 INFO:teuthology.orchestra.run.trial097.stdout: Installing : python3-rgw-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86 1/1 2026-02-17T11:06:20.751 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: python3-rgw-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86 1/1 2026-02-17T11:06:20.809 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : python3-rgw-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86 1/1 2026-02-17T11:06:20.809 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:20.809 INFO:teuthology.orchestra.run.trial097.stdout:Installed: 2026-02-17T11:06:20.810 INFO:teuthology.orchestra.run.trial097.stdout: python3-rgw-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:06:20.810 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:20.810 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-17T11:06:20.837 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install rbd-fuse-debuginfo 2026-02-17T11:06:20.838 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-17T11:06:20.838 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-17T11:06:21.147 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:04:39 ago on Tue 17 Feb 2026 11:01:42 AM UTC. 2026-02-17T11:06:21.229 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-17T11:06:21.230 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:06:21.230 INFO:teuthology.orchestra.run.trial097.stdout: Package Arch Version Repo Size 2026-02-17T11:06:21.230 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:06:21.230 INFO:teuthology.orchestra.run.trial097.stdout:Installing: 2026-02-17T11:06:21.230 INFO:teuthology.orchestra.run.trial097.stdout: rbd-fuse-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 546 k 2026-02-17T11:06:21.230 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:21.231 INFO:teuthology.orchestra.run.trial097.stdout:Transaction Summary 2026-02-17T11:06:21.231 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:06:21.231 INFO:teuthology.orchestra.run.trial097.stdout:Install 1 Package 2026-02-17T11:06:21.231 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:21.231 INFO:teuthology.orchestra.run.trial097.stdout:Total download size: 546 k 2026-02-17T11:06:21.231 INFO:teuthology.orchestra.run.trial097.stdout:Installed size: 3.0 M 2026-02-17T11:06:21.231 INFO:teuthology.orchestra.run.trial097.stdout:Downloading Packages: 2026-02-17T11:06:21.419 INFO:teuthology.orchestra.run.trial097.stdout:rbd-fuse-debuginfo-19.2.3-705.g04cf6dd4.el9.x86 2.8 MB/s | 546 kB 00:00 2026-02-17T11:06:21.419 INFO:teuthology.orchestra.run.trial097.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:06:21.419 INFO:teuthology.orchestra.run.trial097.stdout:Total 2.8 MB/s | 546 kB 00:00 2026-02-17T11:06:21.419 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction check 2026-02-17T11:06:21.421 INFO:teuthology.orchestra.run.trial097.stdout:Transaction check succeeded. 2026-02-17T11:06:21.421 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction test 2026-02-17T11:06:21.440 INFO:teuthology.orchestra.run.trial097.stdout:Transaction test succeeded. 2026-02-17T11:06:21.440 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction 2026-02-17T11:06:21.504 INFO:teuthology.orchestra.run.trial097.stdout: Preparing : 1/1 2026-02-17T11:06:21.521 INFO:teuthology.orchestra.run.trial097.stdout: Installing : rbd-fuse-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:06:21.577 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: rbd-fuse-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:06:21.637 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : rbd-fuse-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:06:21.638 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:21.638 INFO:teuthology.orchestra.run.trial097.stdout:Installed: 2026-02-17T11:06:21.638 INFO:teuthology.orchestra.run.trial097.stdout: rbd-fuse-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:06:21.638 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:21.638 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-17T11:06:21.667 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install rbd-mirror-debuginfo 2026-02-17T11:06:21.976 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:04:39 ago on Tue 17 Feb 2026 11:01:42 AM UTC. 2026-02-17T11:06:22.059 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-17T11:06:22.059 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:06:22.059 INFO:teuthology.orchestra.run.trial097.stdout: Package Arch Version Repo Size 2026-02-17T11:06:22.060 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:06:22.060 INFO:teuthology.orchestra.run.trial097.stdout:Installing: 2026-02-17T11:06:22.060 INFO:teuthology.orchestra.run.trial097.stdout: rbd-mirror-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 54 M 2026-02-17T11:06:22.060 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:22.060 INFO:teuthology.orchestra.run.trial097.stdout:Transaction Summary 2026-02-17T11:06:22.060 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:06:22.060 INFO:teuthology.orchestra.run.trial097.stdout:Install 1 Package 2026-02-17T11:06:22.060 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:22.060 INFO:teuthology.orchestra.run.trial097.stdout:Total download size: 54 M 2026-02-17T11:06:22.060 INFO:teuthology.orchestra.run.trial097.stdout:Installed size: 353 M 2026-02-17T11:06:22.061 INFO:teuthology.orchestra.run.trial097.stdout:Downloading Packages: 2026-02-17T11:06:22.637 INFO:teuthology.orchestra.run.trial049.stdout: Preparing : 1/1 2026-02-17T11:06:22.655 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-osd-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:06:23.254 INFO:teuthology.orchestra.run.trial097.stdout:rbd-mirror-debuginfo-19.2.3-705.g04cf6dd4.el9.x 45 MB/s | 54 MB 00:01 2026-02-17T11:06:23.255 INFO:teuthology.orchestra.run.trial097.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:06:23.255 INFO:teuthology.orchestra.run.trial097.stdout:Total 45 MB/s | 54 MB 00:01 2026-02-17T11:06:23.255 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction check 2026-02-17T11:06:23.257 INFO:teuthology.orchestra.run.trial097.stdout:Transaction check succeeded. 2026-02-17T11:06:23.257 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction test 2026-02-17T11:06:23.433 INFO:teuthology.orchestra.run.trial097.stdout:Transaction test succeeded. 2026-02-17T11:06:23.433 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction 2026-02-17T11:06:23.717 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-osd-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:06:23.775 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-osd-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:06:23.775 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:23.775 INFO:teuthology.orchestra.run.trial049.stdout:Installed: 2026-02-17T11:06:23.775 INFO:teuthology.orchestra.run.trial049.stdout: ceph-osd-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:06:23.775 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:23.775 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-17T11:06:23.828 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-fuse-debuginfo 2026-02-17T11:06:24.026 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-17T11:06:24.044 INFO:teuthology.orchestra.run.trial162.stdout: Installing : librbd1-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:06:24.144 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:04:15 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:06:24.226 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-17T11:06:24.227 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:06:24.227 INFO:teuthology.orchestra.run.trial049.stdout: Package Arch Version Repo Size 2026-02-17T11:06:24.227 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:06:24.227 INFO:teuthology.orchestra.run.trial049.stdout:Installing: 2026-02-17T11:06:24.227 INFO:teuthology.orchestra.run.trial049.stdout: ceph-fuse-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 6.8 M 2026-02-17T11:06:24.227 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:24.227 INFO:teuthology.orchestra.run.trial049.stdout:Transaction Summary 2026-02-17T11:06:24.227 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:06:24.227 INFO:teuthology.orchestra.run.trial049.stdout:Install 1 Package 2026-02-17T11:06:24.228 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:24.228 INFO:teuthology.orchestra.run.trial049.stdout:Total download size: 6.8 M 2026-02-17T11:06:24.228 INFO:teuthology.orchestra.run.trial049.stdout:Installed size: 36 M 2026-02-17T11:06:24.228 INFO:teuthology.orchestra.run.trial049.stdout:Downloading Packages: 2026-02-17T11:06:24.363 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: librbd1-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:06:24.420 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : librbd1-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:06:24.421 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:24.421 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-17T11:06:24.421 INFO:teuthology.orchestra.run.trial162.stdout: librbd1-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:06:24.421 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:24.421 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T11:06:24.452 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install python3-cephfs-debuginfo 2026-02-17T11:06:24.501 INFO:teuthology.orchestra.run.trial049.stdout:ceph-fuse-debuginfo-19.2.3-705.g04cf6dd4.el9.x8 25 MB/s | 6.8 MB 00:00 2026-02-17T11:06:24.502 INFO:teuthology.orchestra.run.trial049.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:06:24.502 INFO:teuthology.orchestra.run.trial049.stdout:Total 25 MB/s | 6.8 MB 00:00 2026-02-17T11:06:24.502 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction check 2026-02-17T11:06:24.504 INFO:teuthology.orchestra.run.trial049.stdout:Transaction check succeeded. 2026-02-17T11:06:24.504 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction test 2026-02-17T11:06:24.541 INFO:teuthology.orchestra.run.trial049.stdout:Transaction test succeeded. 2026-02-17T11:06:24.541 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction 2026-02-17T11:06:24.758 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:04:15 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:06:24.840 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T11:06:24.840 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:06:24.841 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repo Size 2026-02-17T11:06:24.841 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:06:24.841 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-17T11:06:24.841 INFO:teuthology.orchestra.run.trial162.stdout: python3-cephfs-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 629 k 2026-02-17T11:06:24.841 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:24.841 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-17T11:06:24.841 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:06:24.841 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-17T11:06:24.841 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:24.841 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 629 k 2026-02-17T11:06:24.842 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 2.1 M 2026-02-17T11:06:24.842 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-17T11:06:24.933 INFO:teuthology.orchestra.run.trial049.stdout: Preparing : 1/1 2026-02-17T11:06:24.951 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-fuse-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_6 1/1 2026-02-17T11:06:25.002 INFO:teuthology.orchestra.run.trial162.stdout:python3-cephfs-debuginfo-19.2.3-705.g04cf6dd4.e 3.8 MB/s | 629 kB 00:00 2026-02-17T11:06:25.002 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:06:25.002 INFO:teuthology.orchestra.run.trial162.stdout:Total 3.8 MB/s | 629 kB 00:00 2026-02-17T11:06:25.002 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-17T11:06:25.004 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-17T11:06:25.004 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-17T11:06:25.023 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-17T11:06:25.024 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-17T11:06:25.032 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-fuse-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_6 1/1 2026-02-17T11:06:25.088 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-17T11:06:25.089 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-fuse-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_6 1/1 2026-02-17T11:06:25.090 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:25.090 INFO:teuthology.orchestra.run.trial049.stdout:Installed: 2026-02-17T11:06:25.090 INFO:teuthology.orchestra.run.trial049.stdout: ceph-fuse-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:06:25.090 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:25.090 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-17T11:06:25.105 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-cephfs-debuginfo-2:19.2.3-705.g04cf6dd4.el9. 1/1 2026-02-17T11:06:25.117 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install librados-devel-debuginfo 2026-02-17T11:06:25.161 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: python3-cephfs-debuginfo-2:19.2.3-705.g04cf6dd4.el9. 1/1 2026-02-17T11:06:25.218 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-cephfs-debuginfo-2:19.2.3-705.g04cf6dd4.el9. 1/1 2026-02-17T11:06:25.218 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:25.218 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-17T11:06:25.218 INFO:teuthology.orchestra.run.trial162.stdout: python3-cephfs-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:06:25.218 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:25.219 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T11:06:25.244 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install python3-rados-debuginfo 2026-02-17T11:06:25.426 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:04:16 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:06:25.507 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-17T11:06:25.508 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:06:25.508 INFO:teuthology.orchestra.run.trial049.stdout: Package Arch Version Repo Size 2026-02-17T11:06:25.508 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:06:25.508 INFO:teuthology.orchestra.run.trial049.stdout:Installing: 2026-02-17T11:06:25.508 INFO:teuthology.orchestra.run.trial049.stdout: librados-devel-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 112 k 2026-02-17T11:06:25.509 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:25.509 INFO:teuthology.orchestra.run.trial049.stdout:Transaction Summary 2026-02-17T11:06:25.509 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:06:25.509 INFO:teuthology.orchestra.run.trial049.stdout:Install 1 Package 2026-02-17T11:06:25.509 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:25.509 INFO:teuthology.orchestra.run.trial049.stdout:Total download size: 112 k 2026-02-17T11:06:25.509 INFO:teuthology.orchestra.run.trial049.stdout:Installed size: 493 k 2026-02-17T11:06:25.509 INFO:teuthology.orchestra.run.trial049.stdout:Downloading Packages: 2026-02-17T11:06:25.556 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:04:16 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:06:25.636 INFO:teuthology.orchestra.run.trial049.stdout:librados-devel-debuginfo-19.2.3-705.g04cf6dd4.e 879 kB/s | 112 kB 00:00 2026-02-17T11:06:25.637 INFO:teuthology.orchestra.run.trial049.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:06:25.637 INFO:teuthology.orchestra.run.trial049.stdout:Total 873 kB/s | 112 kB 00:00 2026-02-17T11:06:25.637 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction check 2026-02-17T11:06:25.638 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T11:06:25.638 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:06:25.639 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repo Size 2026-02-17T11:06:25.639 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:06:25.639 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-17T11:06:25.639 INFO:teuthology.orchestra.run.trial162.stdout: python3-rados-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 778 k 2026-02-17T11:06:25.639 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:25.639 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-17T11:06:25.639 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:06:25.639 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-17T11:06:25.639 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:25.640 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 778 k 2026-02-17T11:06:25.640 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 2.8 M 2026-02-17T11:06:25.640 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-17T11:06:25.640 INFO:teuthology.orchestra.run.trial049.stdout:Transaction check succeeded. 2026-02-17T11:06:25.640 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction test 2026-02-17T11:06:25.658 INFO:teuthology.orchestra.run.trial049.stdout:Transaction test succeeded. 2026-02-17T11:06:25.658 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction 2026-02-17T11:06:25.697 INFO:teuthology.orchestra.run.trial049.stdout: Preparing : 1/1 2026-02-17T11:06:25.714 INFO:teuthology.orchestra.run.trial049.stdout: Installing : librados-devel-debuginfo-2:19.2.3-705.g04cf6dd4.el9. 1/1 2026-02-17T11:06:25.768 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: librados-devel-debuginfo-2:19.2.3-705.g04cf6dd4.el9. 1/1 2026-02-17T11:06:25.801 INFO:teuthology.orchestra.run.trial162.stdout:python3-rados-debuginfo-19.2.3-705.g04cf6dd4.el 4.7 MB/s | 778 kB 00:00 2026-02-17T11:06:25.802 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:06:25.802 INFO:teuthology.orchestra.run.trial162.stdout:Total 4.7 MB/s | 778 kB 00:00 2026-02-17T11:06:25.802 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-17T11:06:25.803 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-17T11:06:25.804 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-17T11:06:25.824 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-17T11:06:25.824 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-17T11:06:25.825 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : librados-devel-debuginfo-2:19.2.3-705.g04cf6dd4.el9. 1/1 2026-02-17T11:06:25.825 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:25.826 INFO:teuthology.orchestra.run.trial049.stdout:Installed: 2026-02-17T11:06:25.826 INFO:teuthology.orchestra.run.trial049.stdout: librados-devel-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:06:25.826 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:25.826 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-17T11:06:25.852 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install libcephfs2-debuginfo 2026-02-17T11:06:25.895 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-17T11:06:25.912 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-rados-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x 1/1 2026-02-17T11:06:25.972 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: python3-rados-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x 1/1 2026-02-17T11:06:26.030 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-rados-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x 1/1 2026-02-17T11:06:26.031 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:26.031 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-17T11:06:26.031 INFO:teuthology.orchestra.run.trial162.stdout: python3-rados-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:06:26.031 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:26.031 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T11:06:26.057 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install python3-rbd-debuginfo 2026-02-17T11:06:26.167 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:04:17 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:06:26.249 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-17T11:06:26.249 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:06:26.249 INFO:teuthology.orchestra.run.trial049.stdout: Package Arch Version Repo Size 2026-02-17T11:06:26.249 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:06:26.249 INFO:teuthology.orchestra.run.trial049.stdout:Installing: 2026-02-17T11:06:26.249 INFO:teuthology.orchestra.run.trial049.stdout: libcephfs2-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 6.0 M 2026-02-17T11:06:26.249 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:26.250 INFO:teuthology.orchestra.run.trial049.stdout:Transaction Summary 2026-02-17T11:06:26.250 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:06:26.250 INFO:teuthology.orchestra.run.trial049.stdout:Install 1 Package 2026-02-17T11:06:26.250 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:26.250 INFO:teuthology.orchestra.run.trial049.stdout:Total download size: 6.0 M 2026-02-17T11:06:26.250 INFO:teuthology.orchestra.run.trial049.stdout:Installed size: 31 M 2026-02-17T11:06:26.250 INFO:teuthology.orchestra.run.trial049.stdout:Downloading Packages: 2026-02-17T11:06:26.360 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:04:17 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:06:26.443 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T11:06:26.443 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:06:26.443 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repo Size 2026-02-17T11:06:26.443 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:06:26.444 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-17T11:06:26.444 INFO:teuthology.orchestra.run.trial162.stdout: python3-rbd-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 1.1 M 2026-02-17T11:06:26.444 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:26.444 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-17T11:06:26.444 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:06:26.444 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-17T11:06:26.444 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:26.444 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 1.1 M 2026-02-17T11:06:26.444 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 4.3 M 2026-02-17T11:06:26.444 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-17T11:06:26.494 INFO:teuthology.orchestra.run.trial097.stdout: Preparing : 1/1 2026-02-17T11:06:26.512 INFO:teuthology.orchestra.run.trial097.stdout: Installing : rbd-mirror-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_ 1/1 2026-02-17T11:06:26.518 INFO:teuthology.orchestra.run.trial049.stdout:libcephfs2-debuginfo-19.2.3-705.g04cf6dd4.el9.x 22 MB/s | 6.0 MB 00:00 2026-02-17T11:06:26.519 INFO:teuthology.orchestra.run.trial049.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:06:26.519 INFO:teuthology.orchestra.run.trial049.stdout:Total 22 MB/s | 6.0 MB 00:00 2026-02-17T11:06:26.519 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction check 2026-02-17T11:06:26.521 INFO:teuthology.orchestra.run.trial049.stdout:Transaction check succeeded. 2026-02-17T11:06:26.521 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction test 2026-02-17T11:06:26.555 INFO:teuthology.orchestra.run.trial049.stdout:Transaction test succeeded. 2026-02-17T11:06:26.556 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction 2026-02-17T11:06:26.656 INFO:teuthology.orchestra.run.trial162.stdout:python3-rbd-debuginfo-19.2.3-705.g04cf6dd4.el9. 5.4 MB/s | 1.1 MB 00:00 2026-02-17T11:06:26.657 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:06:26.657 INFO:teuthology.orchestra.run.trial162.stdout:Total 5.3 MB/s | 1.1 MB 00:00 2026-02-17T11:06:26.657 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-17T11:06:26.658 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-17T11:06:26.658 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-17T11:06:26.680 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-17T11:06:26.680 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-17T11:06:26.771 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-17T11:06:26.788 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-rbd-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86 1/1 2026-02-17T11:06:26.821 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: rbd-mirror-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_ 1/1 2026-02-17T11:06:26.848 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: python3-rbd-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86 1/1 2026-02-17T11:06:26.880 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : rbd-mirror-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_ 1/1 2026-02-17T11:06:26.880 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:26.880 INFO:teuthology.orchestra.run.trial097.stdout:Installed: 2026-02-17T11:06:26.881 INFO:teuthology.orchestra.run.trial097.stdout: rbd-mirror-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:06:26.881 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:26.881 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-17T11:06:26.907 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-rbd-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86 1/1 2026-02-17T11:06:26.907 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:26.907 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-17T11:06:26.907 INFO:teuthology.orchestra.run.trial162.stdout: python3-rbd-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:06:26.907 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:26.907 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T11:06:26.908 INFO:teuthology.orchestra.run.trial049.stdout: Preparing : 1/1 2026-02-17T11:06:26.912 DEBUG:teuthology.orchestra.run.trial097:> sudo yum -y install rbd-nbd-debuginfo 2026-02-17T11:06:26.925 INFO:teuthology.orchestra.run.trial049.stdout: Installing : libcephfs2-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_ 1/1 2026-02-17T11:06:26.934 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install python3-rgw-debuginfo 2026-02-17T11:06:27.004 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: libcephfs2-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_ 1/1 2026-02-17T11:06:27.061 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : libcephfs2-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_ 1/1 2026-02-17T11:06:27.061 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:27.061 INFO:teuthology.orchestra.run.trial049.stdout:Installed: 2026-02-17T11:06:27.061 INFO:teuthology.orchestra.run.trial049.stdout: libcephfs2-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:06:27.061 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:27.061 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-17T11:06:27.087 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install librados2-debuginfo 2026-02-17T11:06:27.218 INFO:teuthology.orchestra.run.trial097.stdout:Last metadata expiration check: 0:04:45 ago on Tue 17 Feb 2026 11:01:42 AM UTC. 2026-02-17T11:06:27.249 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:04:18 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:06:27.300 INFO:teuthology.orchestra.run.trial097.stdout:Dependencies resolved. 2026-02-17T11:06:27.300 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:06:27.300 INFO:teuthology.orchestra.run.trial097.stdout: Package Arch Version Repo Size 2026-02-17T11:06:27.300 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:06:27.300 INFO:teuthology.orchestra.run.trial097.stdout:Installing: 2026-02-17T11:06:27.301 INFO:teuthology.orchestra.run.trial097.stdout: rbd-nbd-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 1.4 M 2026-02-17T11:06:27.301 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:27.301 INFO:teuthology.orchestra.run.trial097.stdout:Transaction Summary 2026-02-17T11:06:27.301 INFO:teuthology.orchestra.run.trial097.stdout:================================================================================ 2026-02-17T11:06:27.301 INFO:teuthology.orchestra.run.trial097.stdout:Install 1 Package 2026-02-17T11:06:27.301 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:27.301 INFO:teuthology.orchestra.run.trial097.stdout:Total download size: 1.4 M 2026-02-17T11:06:27.301 INFO:teuthology.orchestra.run.trial097.stdout:Installed size: 6.6 M 2026-02-17T11:06:27.301 INFO:teuthology.orchestra.run.trial097.stdout:Downloading Packages: 2026-02-17T11:06:27.331 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T11:06:27.331 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:06:27.331 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repo Size 2026-02-17T11:06:27.331 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:06:27.331 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-17T11:06:27.331 INFO:teuthology.orchestra.run.trial162.stdout: python3-rgw-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 339 k 2026-02-17T11:06:27.331 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:27.332 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-17T11:06:27.332 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:06:27.332 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-17T11:06:27.332 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:27.332 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 339 k 2026-02-17T11:06:27.332 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 1.0 M 2026-02-17T11:06:27.332 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-17T11:06:27.395 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:04:18 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:06:27.477 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-17T11:06:27.477 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:06:27.477 INFO:teuthology.orchestra.run.trial049.stdout: Package Arch Version Repo Size 2026-02-17T11:06:27.477 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:06:27.477 INFO:teuthology.orchestra.run.trial049.stdout:Installing: 2026-02-17T11:06:27.477 INFO:teuthology.orchestra.run.trial049.stdout: librados2-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 47 M 2026-02-17T11:06:27.478 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:27.478 INFO:teuthology.orchestra.run.trial049.stdout:Transaction Summary 2026-02-17T11:06:27.478 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:06:27.478 INFO:teuthology.orchestra.run.trial049.stdout:Install 1 Package 2026-02-17T11:06:27.478 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:27.478 INFO:teuthology.orchestra.run.trial049.stdout:Total download size: 47 M 2026-02-17T11:06:27.478 INFO:teuthology.orchestra.run.trial049.stdout:Installed size: 302 M 2026-02-17T11:06:27.478 INFO:teuthology.orchestra.run.trial049.stdout:Downloading Packages: 2026-02-17T11:06:27.485 INFO:teuthology.orchestra.run.trial162.stdout:python3-rgw-debuginfo-19.2.3-705.g04cf6dd4.el9. 2.2 MB/s | 339 kB 00:00 2026-02-17T11:06:27.486 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:06:27.486 INFO:teuthology.orchestra.run.trial162.stdout:Total 2.2 MB/s | 339 kB 00:00 2026-02-17T11:06:27.486 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-17T11:06:27.487 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-17T11:06:27.487 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-17T11:06:27.492 INFO:teuthology.orchestra.run.trial097.stdout:rbd-nbd-debuginfo-19.2.3-705.g04cf6dd4.el9.x86_ 7.1 MB/s | 1.4 MB 00:00 2026-02-17T11:06:27.493 INFO:teuthology.orchestra.run.trial097.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:06:27.493 INFO:teuthology.orchestra.run.trial097.stdout:Total 7.1 MB/s | 1.4 MB 00:00 2026-02-17T11:06:27.493 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction check 2026-02-17T11:06:27.495 INFO:teuthology.orchestra.run.trial097.stdout:Transaction check succeeded. 2026-02-17T11:06:27.495 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction test 2026-02-17T11:06:27.505 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-17T11:06:27.506 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-17T11:06:27.516 INFO:teuthology.orchestra.run.trial097.stdout:Transaction test succeeded. 2026-02-17T11:06:27.516 INFO:teuthology.orchestra.run.trial097.stdout:Running transaction 2026-02-17T11:06:27.556 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-17T11:06:27.573 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-rgw-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86 1/1 2026-02-17T11:06:27.620 INFO:teuthology.orchestra.run.trial097.stdout: Preparing : 1/1 2026-02-17T11:06:27.630 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: python3-rgw-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86 1/1 2026-02-17T11:06:27.637 INFO:teuthology.orchestra.run.trial097.stdout: Installing : rbd-nbd-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:06:27.688 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-rgw-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86 1/1 2026-02-17T11:06:27.688 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:27.688 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-17T11:06:27.688 INFO:teuthology.orchestra.run.trial162.stdout: python3-rgw-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:06:27.688 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:27.688 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T11:06:27.697 INFO:teuthology.orchestra.run.trial097.stdout: Running scriptlet: rbd-nbd-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:06:27.714 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install rbd-fuse-debuginfo 2026-02-17T11:06:27.755 INFO:teuthology.orchestra.run.trial097.stdout: Verifying : rbd-nbd-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:06:27.755 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:27.755 INFO:teuthology.orchestra.run.trial097.stdout:Installed: 2026-02-17T11:06:27.755 INFO:teuthology.orchestra.run.trial097.stdout: rbd-nbd-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:06:27.755 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:27.755 INFO:teuthology.orchestra.run.trial097.stdout:Complete! 2026-02-17T11:06:27.785 DEBUG:teuthology.parallel:result is None 2026-02-17T11:06:28.029 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:04:19 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:06:28.119 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T11:06:28.119 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:06:28.120 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repo Size 2026-02-17T11:06:28.120 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:06:28.120 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-17T11:06:28.120 INFO:teuthology.orchestra.run.trial162.stdout: rbd-fuse-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 546 k 2026-02-17T11:06:28.120 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:28.120 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-17T11:06:28.120 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:06:28.120 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-17T11:06:28.120 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:28.120 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 546 k 2026-02-17T11:06:28.120 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 3.0 M 2026-02-17T11:06:28.121 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-17T11:06:28.488 INFO:teuthology.orchestra.run.trial162.stdout:rbd-fuse-debuginfo-19.2.3-705.g04cf6dd4.el9.x86 1.4 MB/s | 546 kB 00:00 2026-02-17T11:06:28.489 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:06:28.489 INFO:teuthology.orchestra.run.trial162.stdout:Total 1.4 MB/s | 546 kB 00:00 2026-02-17T11:06:28.489 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-17T11:06:28.491 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-17T11:06:28.491 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-17T11:06:28.511 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-17T11:06:28.511 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-17T11:06:28.532 INFO:teuthology.orchestra.run.trial049.stdout:librados2-debuginfo-19.2.3-705.g04cf6dd4.el9.x8 45 MB/s | 47 MB 00:01 2026-02-17T11:06:28.533 INFO:teuthology.orchestra.run.trial049.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:06:28.533 INFO:teuthology.orchestra.run.trial049.stdout:Total 45 MB/s | 47 MB 00:01 2026-02-17T11:06:28.533 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction check 2026-02-17T11:06:28.535 INFO:teuthology.orchestra.run.trial049.stdout:Transaction check succeeded. 2026-02-17T11:06:28.535 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction test 2026-02-17T11:06:28.574 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-17T11:06:28.591 INFO:teuthology.orchestra.run.trial162.stdout: Installing : rbd-fuse-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:06:28.645 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: rbd-fuse-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:06:28.692 INFO:teuthology.orchestra.run.trial049.stdout:Transaction test succeeded. 2026-02-17T11:06:28.692 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction 2026-02-17T11:06:28.703 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : rbd-fuse-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:06:28.703 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:28.703 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-17T11:06:28.703 INFO:teuthology.orchestra.run.trial162.stdout: rbd-fuse-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:06:28.703 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:28.703 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T11:06:28.727 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install rbd-mirror-debuginfo 2026-02-17T11:06:29.038 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:04:20 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:06:29.120 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T11:06:29.121 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:06:29.121 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repo Size 2026-02-17T11:06:29.121 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:06:29.121 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-17T11:06:29.121 INFO:teuthology.orchestra.run.trial162.stdout: rbd-mirror-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 54 M 2026-02-17T11:06:29.121 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:29.121 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-17T11:06:29.121 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:06:29.121 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-17T11:06:29.121 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:29.121 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 54 M 2026-02-17T11:06:29.121 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 353 M 2026-02-17T11:06:29.121 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-17T11:06:30.251 INFO:teuthology.orchestra.run.trial162.stdout:rbd-mirror-debuginfo-19.2.3-705.g04cf6dd4.el9.x 47 MB/s | 54 MB 00:01 2026-02-17T11:06:30.252 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:06:30.252 INFO:teuthology.orchestra.run.trial162.stdout:Total 47 MB/s | 54 MB 00:01 2026-02-17T11:06:30.253 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-17T11:06:30.254 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-17T11:06:30.254 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-17T11:06:30.428 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-17T11:06:30.428 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-17T11:06:31.338 INFO:teuthology.orchestra.run.trial049.stdout: Preparing : 1/1 2026-02-17T11:06:31.356 INFO:teuthology.orchestra.run.trial049.stdout: Installing : librados2-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_6 1/1 2026-02-17T11:06:31.636 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: librados2-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_6 1/1 2026-02-17T11:06:31.695 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : librados2-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_6 1/1 2026-02-17T11:06:31.695 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:31.695 INFO:teuthology.orchestra.run.trial049.stdout:Installed: 2026-02-17T11:06:31.696 INFO:teuthology.orchestra.run.trial049.stdout: librados2-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:06:31.696 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:31.696 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-17T11:06:31.726 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install librbd1-debuginfo 2026-02-17T11:06:32.034 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:04:23 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:06:32.116 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-17T11:06:32.116 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:06:32.116 INFO:teuthology.orchestra.run.trial049.stdout: Package Arch Version Repo Size 2026-02-17T11:06:32.117 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:06:32.117 INFO:teuthology.orchestra.run.trial049.stdout:Installing: 2026-02-17T11:06:32.117 INFO:teuthology.orchestra.run.trial049.stdout: librbd1-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 54 M 2026-02-17T11:06:32.117 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:32.117 INFO:teuthology.orchestra.run.trial049.stdout:Transaction Summary 2026-02-17T11:06:32.117 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:06:32.117 INFO:teuthology.orchestra.run.trial049.stdout:Install 1 Package 2026-02-17T11:06:32.117 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:32.117 INFO:teuthology.orchestra.run.trial049.stdout:Total download size: 54 M 2026-02-17T11:06:32.117 INFO:teuthology.orchestra.run.trial049.stdout:Installed size: 374 M 2026-02-17T11:06:32.118 INFO:teuthology.orchestra.run.trial049.stdout:Downloading Packages: 2026-02-17T11:06:33.244 INFO:teuthology.orchestra.run.trial049.stdout:librbd1-debuginfo-19.2.3-705.g04cf6dd4.el9.x86_ 48 MB/s | 54 MB 00:01 2026-02-17T11:06:33.245 INFO:teuthology.orchestra.run.trial049.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:06:33.245 INFO:teuthology.orchestra.run.trial049.stdout:Total 48 MB/s | 54 MB 00:01 2026-02-17T11:06:33.245 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction check 2026-02-17T11:06:33.247 INFO:teuthology.orchestra.run.trial049.stdout:Transaction check succeeded. 2026-02-17T11:06:33.248 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction test 2026-02-17T11:06:33.426 INFO:teuthology.orchestra.run.trial049.stdout:Transaction test succeeded. 2026-02-17T11:06:33.427 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction 2026-02-17T11:06:33.476 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-17T11:06:33.494 INFO:teuthology.orchestra.run.trial162.stdout: Installing : rbd-mirror-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_ 1/1 2026-02-17T11:06:33.803 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: rbd-mirror-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_ 1/1 2026-02-17T11:06:33.861 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : rbd-mirror-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_ 1/1 2026-02-17T11:06:33.861 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:33.861 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-17T11:06:33.861 INFO:teuthology.orchestra.run.trial162.stdout: rbd-mirror-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:06:33.861 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:33.861 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T11:06:33.892 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install rbd-nbd-debuginfo 2026-02-17T11:06:34.199 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:04:25 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:06:34.281 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T11:06:34.281 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:06:34.281 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repo Size 2026-02-17T11:06:34.281 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:06:34.282 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-17T11:06:34.282 INFO:teuthology.orchestra.run.trial162.stdout: rbd-nbd-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 1.4 M 2026-02-17T11:06:34.282 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:34.282 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-17T11:06:34.282 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T11:06:34.282 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-17T11:06:34.282 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:34.282 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 1.4 M 2026-02-17T11:06:34.282 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 6.6 M 2026-02-17T11:06:34.282 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-17T11:06:34.434 INFO:teuthology.orchestra.run.trial162.stdout:rbd-nbd-debuginfo-19.2.3-705.g04cf6dd4.el9.x86_ 8.9 MB/s | 1.4 MB 00:00 2026-02-17T11:06:34.434 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:06:34.434 INFO:teuthology.orchestra.run.trial162.stdout:Total 8.9 MB/s | 1.4 MB 00:00 2026-02-17T11:06:34.434 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-17T11:06:34.436 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-17T11:06:34.436 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-17T11:06:34.457 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-17T11:06:34.457 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-17T11:06:34.562 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-17T11:06:34.579 INFO:teuthology.orchestra.run.trial162.stdout: Installing : rbd-nbd-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:06:34.644 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: rbd-nbd-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:06:34.702 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : rbd-nbd-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:06:34.702 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:34.702 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-17T11:06:34.702 INFO:teuthology.orchestra.run.trial162.stdout: rbd-nbd-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:06:34.702 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:34.702 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T11:06:34.732 DEBUG:teuthology.parallel:result is None 2026-02-17T11:06:36.604 INFO:teuthology.orchestra.run.trial049.stdout: Preparing : 1/1 2026-02-17T11:06:36.622 INFO:teuthology.orchestra.run.trial049.stdout: Installing : librbd1-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:06:36.944 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: librbd1-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:06:37.003 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : librbd1-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:06:37.003 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:37.003 INFO:teuthology.orchestra.run.trial049.stdout:Installed: 2026-02-17T11:06:37.003 INFO:teuthology.orchestra.run.trial049.stdout: librbd1-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:06:37.004 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:37.004 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-17T11:06:37.037 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install python3-cephfs-debuginfo 2026-02-17T11:06:37.339 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:04:28 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:06:37.423 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-17T11:06:37.424 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:06:37.424 INFO:teuthology.orchestra.run.trial049.stdout: Package Arch Version Repo Size 2026-02-17T11:06:37.424 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:06:37.424 INFO:teuthology.orchestra.run.trial049.stdout:Installing: 2026-02-17T11:06:37.424 INFO:teuthology.orchestra.run.trial049.stdout: python3-cephfs-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 629 k 2026-02-17T11:06:37.424 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:37.424 INFO:teuthology.orchestra.run.trial049.stdout:Transaction Summary 2026-02-17T11:06:37.424 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:06:37.424 INFO:teuthology.orchestra.run.trial049.stdout:Install 1 Package 2026-02-17T11:06:37.425 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:37.425 INFO:teuthology.orchestra.run.trial049.stdout:Total download size: 629 k 2026-02-17T11:06:37.425 INFO:teuthology.orchestra.run.trial049.stdout:Installed size: 2.1 M 2026-02-17T11:06:37.425 INFO:teuthology.orchestra.run.trial049.stdout:Downloading Packages: 2026-02-17T11:06:37.585 INFO:teuthology.orchestra.run.trial049.stdout:python3-cephfs-debuginfo-19.2.3-705.g04cf6dd4.e 3.8 MB/s | 629 kB 00:00 2026-02-17T11:06:37.586 INFO:teuthology.orchestra.run.trial049.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:06:37.586 INFO:teuthology.orchestra.run.trial049.stdout:Total 3.8 MB/s | 629 kB 00:00 2026-02-17T11:06:37.586 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction check 2026-02-17T11:06:37.587 INFO:teuthology.orchestra.run.trial049.stdout:Transaction check succeeded. 2026-02-17T11:06:37.587 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction test 2026-02-17T11:06:37.606 INFO:teuthology.orchestra.run.trial049.stdout:Transaction test succeeded. 2026-02-17T11:06:37.607 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction 2026-02-17T11:06:37.672 INFO:teuthology.orchestra.run.trial049.stdout: Preparing : 1/1 2026-02-17T11:06:37.689 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-cephfs-debuginfo-2:19.2.3-705.g04cf6dd4.el9. 1/1 2026-02-17T11:06:37.750 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: python3-cephfs-debuginfo-2:19.2.3-705.g04cf6dd4.el9. 1/1 2026-02-17T11:06:37.808 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-cephfs-debuginfo-2:19.2.3-705.g04cf6dd4.el9. 1/1 2026-02-17T11:06:37.808 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:37.808 INFO:teuthology.orchestra.run.trial049.stdout:Installed: 2026-02-17T11:06:37.809 INFO:teuthology.orchestra.run.trial049.stdout: python3-cephfs-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:06:37.809 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:37.809 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-17T11:06:37.834 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install python3-rados-debuginfo 2026-02-17T11:06:38.146 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:04:29 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:06:38.228 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-17T11:06:38.228 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:06:38.228 INFO:teuthology.orchestra.run.trial049.stdout: Package Arch Version Repo Size 2026-02-17T11:06:38.228 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:06:38.229 INFO:teuthology.orchestra.run.trial049.stdout:Installing: 2026-02-17T11:06:38.229 INFO:teuthology.orchestra.run.trial049.stdout: python3-rados-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 778 k 2026-02-17T11:06:38.229 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:38.229 INFO:teuthology.orchestra.run.trial049.stdout:Transaction Summary 2026-02-17T11:06:38.229 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:06:38.229 INFO:teuthology.orchestra.run.trial049.stdout:Install 1 Package 2026-02-17T11:06:38.229 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:38.229 INFO:teuthology.orchestra.run.trial049.stdout:Total download size: 778 k 2026-02-17T11:06:38.229 INFO:teuthology.orchestra.run.trial049.stdout:Installed size: 2.8 M 2026-02-17T11:06:38.229 INFO:teuthology.orchestra.run.trial049.stdout:Downloading Packages: 2026-02-17T11:06:38.393 INFO:teuthology.orchestra.run.trial049.stdout:python3-rados-debuginfo-19.2.3-705.g04cf6dd4.el 4.6 MB/s | 778 kB 00:00 2026-02-17T11:06:38.394 INFO:teuthology.orchestra.run.trial049.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:06:38.394 INFO:teuthology.orchestra.run.trial049.stdout:Total 4.6 MB/s | 778 kB 00:00 2026-02-17T11:06:38.394 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction check 2026-02-17T11:06:38.395 INFO:teuthology.orchestra.run.trial049.stdout:Transaction check succeeded. 2026-02-17T11:06:38.395 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction test 2026-02-17T11:06:38.415 INFO:teuthology.orchestra.run.trial049.stdout:Transaction test succeeded. 2026-02-17T11:06:38.415 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction 2026-02-17T11:06:38.487 INFO:teuthology.orchestra.run.trial049.stdout: Preparing : 1/1 2026-02-17T11:06:38.505 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-rados-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x 1/1 2026-02-17T11:06:38.560 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: python3-rados-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x 1/1 2026-02-17T11:06:38.617 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-rados-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x 1/1 2026-02-17T11:06:38.618 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:38.618 INFO:teuthology.orchestra.run.trial049.stdout:Installed: 2026-02-17T11:06:38.618 INFO:teuthology.orchestra.run.trial049.stdout: python3-rados-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:06:38.618 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:38.618 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-17T11:06:38.644 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install python3-rbd-debuginfo 2026-02-17T11:06:38.950 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:04:29 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:06:39.033 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-17T11:06:39.034 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:06:39.034 INFO:teuthology.orchestra.run.trial049.stdout: Package Arch Version Repo Size 2026-02-17T11:06:39.034 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:06:39.034 INFO:teuthology.orchestra.run.trial049.stdout:Installing: 2026-02-17T11:06:39.034 INFO:teuthology.orchestra.run.trial049.stdout: python3-rbd-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 1.1 M 2026-02-17T11:06:39.034 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:39.034 INFO:teuthology.orchestra.run.trial049.stdout:Transaction Summary 2026-02-17T11:06:39.034 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:06:39.035 INFO:teuthology.orchestra.run.trial049.stdout:Install 1 Package 2026-02-17T11:06:39.035 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:39.035 INFO:teuthology.orchestra.run.trial049.stdout:Total download size: 1.1 M 2026-02-17T11:06:39.035 INFO:teuthology.orchestra.run.trial049.stdout:Installed size: 4.3 M 2026-02-17T11:06:39.035 INFO:teuthology.orchestra.run.trial049.stdout:Downloading Packages: 2026-02-17T11:06:39.224 INFO:teuthology.orchestra.run.trial049.stdout:python3-rbd-debuginfo-19.2.3-705.g04cf6dd4.el9. 6.0 MB/s | 1.1 MB 00:00 2026-02-17T11:06:39.226 INFO:teuthology.orchestra.run.trial049.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:06:39.226 INFO:teuthology.orchestra.run.trial049.stdout:Total 5.9 MB/s | 1.1 MB 00:00 2026-02-17T11:06:39.226 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction check 2026-02-17T11:06:39.228 INFO:teuthology.orchestra.run.trial049.stdout:Transaction check succeeded. 2026-02-17T11:06:39.228 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction test 2026-02-17T11:06:39.249 INFO:teuthology.orchestra.run.trial049.stdout:Transaction test succeeded. 2026-02-17T11:06:39.250 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction 2026-02-17T11:06:39.340 INFO:teuthology.orchestra.run.trial049.stdout: Preparing : 1/1 2026-02-17T11:06:39.357 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-rbd-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86 1/1 2026-02-17T11:06:39.414 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: python3-rbd-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86 1/1 2026-02-17T11:06:39.471 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-rbd-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86 1/1 2026-02-17T11:06:39.472 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:39.472 INFO:teuthology.orchestra.run.trial049.stdout:Installed: 2026-02-17T11:06:39.472 INFO:teuthology.orchestra.run.trial049.stdout: python3-rbd-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:06:39.472 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:39.473 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-17T11:06:39.497 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install python3-rgw-debuginfo 2026-02-17T11:06:39.805 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:04:30 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:06:39.887 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-17T11:06:39.888 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:06:39.888 INFO:teuthology.orchestra.run.trial049.stdout: Package Arch Version Repo Size 2026-02-17T11:06:39.888 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:06:39.888 INFO:teuthology.orchestra.run.trial049.stdout:Installing: 2026-02-17T11:06:39.888 INFO:teuthology.orchestra.run.trial049.stdout: python3-rgw-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 339 k 2026-02-17T11:06:39.888 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:39.888 INFO:teuthology.orchestra.run.trial049.stdout:Transaction Summary 2026-02-17T11:06:39.888 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:06:39.888 INFO:teuthology.orchestra.run.trial049.stdout:Install 1 Package 2026-02-17T11:06:39.889 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:39.889 INFO:teuthology.orchestra.run.trial049.stdout:Total download size: 339 k 2026-02-17T11:06:39.889 INFO:teuthology.orchestra.run.trial049.stdout:Installed size: 1.0 M 2026-02-17T11:06:39.889 INFO:teuthology.orchestra.run.trial049.stdout:Downloading Packages: 2026-02-17T11:06:40.045 INFO:teuthology.orchestra.run.trial049.stdout:python3-rgw-debuginfo-19.2.3-705.g04cf6dd4.el9. 2.1 MB/s | 339 kB 00:00 2026-02-17T11:06:40.045 INFO:teuthology.orchestra.run.trial049.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:06:40.045 INFO:teuthology.orchestra.run.trial049.stdout:Total 2.1 MB/s | 339 kB 00:00 2026-02-17T11:06:40.045 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction check 2026-02-17T11:06:40.047 INFO:teuthology.orchestra.run.trial049.stdout:Transaction check succeeded. 2026-02-17T11:06:40.047 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction test 2026-02-17T11:06:40.068 INFO:teuthology.orchestra.run.trial049.stdout:Transaction test succeeded. 2026-02-17T11:06:40.068 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction 2026-02-17T11:06:40.118 INFO:teuthology.orchestra.run.trial049.stdout: Preparing : 1/1 2026-02-17T11:06:40.135 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-rgw-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86 1/1 2026-02-17T11:06:40.191 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: python3-rgw-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86 1/1 2026-02-17T11:06:40.248 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-rgw-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86 1/1 2026-02-17T11:06:40.248 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:40.248 INFO:teuthology.orchestra.run.trial049.stdout:Installed: 2026-02-17T11:06:40.248 INFO:teuthology.orchestra.run.trial049.stdout: python3-rgw-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:06:40.248 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:40.248 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-17T11:06:40.274 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install rbd-fuse-debuginfo 2026-02-17T11:06:40.580 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:04:31 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:06:40.664 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-17T11:06:40.665 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:06:40.665 INFO:teuthology.orchestra.run.trial049.stdout: Package Arch Version Repo Size 2026-02-17T11:06:40.665 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:06:40.665 INFO:teuthology.orchestra.run.trial049.stdout:Installing: 2026-02-17T11:06:40.665 INFO:teuthology.orchestra.run.trial049.stdout: rbd-fuse-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 546 k 2026-02-17T11:06:40.665 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:40.665 INFO:teuthology.orchestra.run.trial049.stdout:Transaction Summary 2026-02-17T11:06:40.665 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:06:40.665 INFO:teuthology.orchestra.run.trial049.stdout:Install 1 Package 2026-02-17T11:06:40.666 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:40.666 INFO:teuthology.orchestra.run.trial049.stdout:Total download size: 546 k 2026-02-17T11:06:40.666 INFO:teuthology.orchestra.run.trial049.stdout:Installed size: 3.0 M 2026-02-17T11:06:40.666 INFO:teuthology.orchestra.run.trial049.stdout:Downloading Packages: 2026-02-17T11:06:40.845 INFO:teuthology.orchestra.run.trial049.stdout:rbd-fuse-debuginfo-19.2.3-705.g04cf6dd4.el9.x86 3.0 MB/s | 546 kB 00:00 2026-02-17T11:06:40.846 INFO:teuthology.orchestra.run.trial049.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:06:40.846 INFO:teuthology.orchestra.run.trial049.stdout:Total 3.0 MB/s | 546 kB 00:00 2026-02-17T11:06:40.846 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction check 2026-02-17T11:06:40.847 INFO:teuthology.orchestra.run.trial049.stdout:Transaction check succeeded. 2026-02-17T11:06:40.847 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction test 2026-02-17T11:06:40.867 INFO:teuthology.orchestra.run.trial049.stdout:Transaction test succeeded. 2026-02-17T11:06:40.867 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction 2026-02-17T11:06:40.934 INFO:teuthology.orchestra.run.trial049.stdout: Preparing : 1/1 2026-02-17T11:06:40.951 INFO:teuthology.orchestra.run.trial049.stdout: Installing : rbd-fuse-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:06:41.007 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: rbd-fuse-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:06:41.065 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : rbd-fuse-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:06:41.065 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:41.065 INFO:teuthology.orchestra.run.trial049.stdout:Installed: 2026-02-17T11:06:41.065 INFO:teuthology.orchestra.run.trial049.stdout: rbd-fuse-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:06:41.065 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:41.065 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-17T11:06:41.092 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install rbd-mirror-debuginfo 2026-02-17T11:06:41.406 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:04:32 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:06:41.488 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-17T11:06:41.489 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:06:41.489 INFO:teuthology.orchestra.run.trial049.stdout: Package Arch Version Repo Size 2026-02-17T11:06:41.489 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:06:41.489 INFO:teuthology.orchestra.run.trial049.stdout:Installing: 2026-02-17T11:06:41.489 INFO:teuthology.orchestra.run.trial049.stdout: rbd-mirror-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 54 M 2026-02-17T11:06:41.489 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:41.489 INFO:teuthology.orchestra.run.trial049.stdout:Transaction Summary 2026-02-17T11:06:41.489 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:06:41.489 INFO:teuthology.orchestra.run.trial049.stdout:Install 1 Package 2026-02-17T11:06:41.489 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:41.490 INFO:teuthology.orchestra.run.trial049.stdout:Total download size: 54 M 2026-02-17T11:06:41.490 INFO:teuthology.orchestra.run.trial049.stdout:Installed size: 353 M 2026-02-17T11:06:41.490 INFO:teuthology.orchestra.run.trial049.stdout:Downloading Packages: 2026-02-17T11:06:42.669 INFO:teuthology.orchestra.run.trial049.stdout:rbd-mirror-debuginfo-19.2.3-705.g04cf6dd4.el9.x 45 MB/s | 54 MB 00:01 2026-02-17T11:06:42.671 INFO:teuthology.orchestra.run.trial049.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:06:42.671 INFO:teuthology.orchestra.run.trial049.stdout:Total 45 MB/s | 54 MB 00:01 2026-02-17T11:06:42.671 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction check 2026-02-17T11:06:42.672 INFO:teuthology.orchestra.run.trial049.stdout:Transaction check succeeded. 2026-02-17T11:06:42.672 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction test 2026-02-17T11:06:42.846 INFO:teuthology.orchestra.run.trial049.stdout:Transaction test succeeded. 2026-02-17T11:06:42.846 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction 2026-02-17T11:06:46.012 INFO:teuthology.orchestra.run.trial049.stdout: Preparing : 1/1 2026-02-17T11:06:46.029 INFO:teuthology.orchestra.run.trial049.stdout: Installing : rbd-mirror-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_ 1/1 2026-02-17T11:06:46.344 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: rbd-mirror-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_ 1/1 2026-02-17T11:06:46.401 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : rbd-mirror-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_ 1/1 2026-02-17T11:06:46.401 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:46.401 INFO:teuthology.orchestra.run.trial049.stdout:Installed: 2026-02-17T11:06:46.401 INFO:teuthology.orchestra.run.trial049.stdout: rbd-mirror-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:06:46.401 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:46.401 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-17T11:06:46.433 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install rbd-nbd-debuginfo 2026-02-17T11:06:46.741 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:04:37 ago on Tue 17 Feb 2026 11:02:09 AM UTC. 2026-02-17T11:06:46.823 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-17T11:06:46.824 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:06:46.824 INFO:teuthology.orchestra.run.trial049.stdout: Package Arch Version Repo Size 2026-02-17T11:06:46.824 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:06:46.824 INFO:teuthology.orchestra.run.trial049.stdout:Installing: 2026-02-17T11:06:46.824 INFO:teuthology.orchestra.run.trial049.stdout: rbd-nbd-debuginfo x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 1.4 M 2026-02-17T11:06:46.824 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:46.824 INFO:teuthology.orchestra.run.trial049.stdout:Transaction Summary 2026-02-17T11:06:46.824 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-17T11:06:46.825 INFO:teuthology.orchestra.run.trial049.stdout:Install 1 Package 2026-02-17T11:06:46.825 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:46.825 INFO:teuthology.orchestra.run.trial049.stdout:Total download size: 1.4 M 2026-02-17T11:06:46.825 INFO:teuthology.orchestra.run.trial049.stdout:Installed size: 6.6 M 2026-02-17T11:06:46.825 INFO:teuthology.orchestra.run.trial049.stdout:Downloading Packages: 2026-02-17T11:06:47.028 INFO:teuthology.orchestra.run.trial049.stdout:rbd-nbd-debuginfo-19.2.3-705.g04cf6dd4.el9.x86_ 6.7 MB/s | 1.4 MB 00:00 2026-02-17T11:06:47.028 INFO:teuthology.orchestra.run.trial049.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:06:47.028 INFO:teuthology.orchestra.run.trial049.stdout:Total 6.6 MB/s | 1.4 MB 00:00 2026-02-17T11:06:47.028 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction check 2026-02-17T11:06:47.029 INFO:teuthology.orchestra.run.trial049.stdout:Transaction check succeeded. 2026-02-17T11:06:47.030 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction test 2026-02-17T11:06:47.051 INFO:teuthology.orchestra.run.trial049.stdout:Transaction test succeeded. 2026-02-17T11:06:47.051 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction 2026-02-17T11:06:47.154 INFO:teuthology.orchestra.run.trial049.stdout: Preparing : 1/1 2026-02-17T11:06:47.172 INFO:teuthology.orchestra.run.trial049.stdout: Installing : rbd-nbd-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:06:47.231 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: rbd-nbd-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:06:47.289 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : rbd-nbd-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T11:06:47.290 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:47.290 INFO:teuthology.orchestra.run.trial049.stdout:Installed: 2026-02-17T11:06:47.290 INFO:teuthology.orchestra.run.trial049.stdout: rbd-nbd-debuginfo-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T11:06:47.290 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:47.290 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-17T11:06:47.320 DEBUG:teuthology.parallel:result is None 2026-02-17T11:06:47.321 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-17T11:06:47.490 DEBUG:teuthology.orchestra.run.trial049:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-17T11:06:47.510 INFO:teuthology.orchestra.run.trial049.stdout:19.2.3-705.g04cf6dd4.el9 2026-02-17T11:06:47.510 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-705.g04cf6dd4.el9 2026-02-17T11:06:47.510 INFO:teuthology.task.install:The correct ceph version 19.2.3-705.g04cf6dd4 is installed. 2026-02-17T11:06:47.512 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-17T11:06:47.632 DEBUG:teuthology.orchestra.run.trial097:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-17T11:06:47.653 INFO:teuthology.orchestra.run.trial097.stdout:19.2.3-705.g04cf6dd4.el9 2026-02-17T11:06:47.654 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-705.g04cf6dd4.el9 2026-02-17T11:06:47.654 INFO:teuthology.task.install:The correct ceph version 19.2.3-705.g04cf6dd4 is installed. 2026-02-17T11:06:47.656 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-17T11:06:47.778 DEBUG:teuthology.orchestra.run.trial157:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-17T11:06:47.799 INFO:teuthology.orchestra.run.trial157.stdout:19.2.3-705.g04cf6dd4.el9 2026-02-17T11:06:47.799 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-705.g04cf6dd4.el9 2026-02-17T11:06:47.799 INFO:teuthology.task.install:The correct ceph version 19.2.3-705.g04cf6dd4 is installed. 2026-02-17T11:06:47.801 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-17T11:06:47.946 DEBUG:teuthology.orchestra.run.trial162:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-17T11:06:47.969 INFO:teuthology.orchestra.run.trial162.stdout:19.2.3-705.g04cf6dd4.el9 2026-02-17T11:06:47.969 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-705.g04cf6dd4.el9 2026-02-17T11:06:47.969 INFO:teuthology.task.install:The correct ceph version 19.2.3-705.g04cf6dd4 is installed. 2026-02-17T11:06:47.972 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-17T11:06:47.972 DEBUG:teuthology.orchestra.run.trial049:> set -ex 2026-02-17T11:06:47.972 DEBUG:teuthology.orchestra.run.trial049:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-17T11:06:47.998 DEBUG:teuthology.orchestra.run.trial097:> set -ex 2026-02-17T11:06:47.998 DEBUG:teuthology.orchestra.run.trial097:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-17T11:06:48.025 DEBUG:teuthology.orchestra.run.trial157:> set -ex 2026-02-17T11:06:48.026 DEBUG:teuthology.orchestra.run.trial157:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-17T11:06:48.052 DEBUG:teuthology.orchestra.run.trial162:> set -ex 2026-02-17T11:06:48.052 DEBUG:teuthology.orchestra.run.trial162:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-17T11:06:48.079 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-17T11:06:48.079 DEBUG:teuthology.orchestra.run.trial049:> set -ex 2026-02-17T11:06:48.079 DEBUG:teuthology.orchestra.run.trial049:> sudo dd of=/usr/bin/daemon-helper 2026-02-17T11:06:48.105 DEBUG:teuthology.orchestra.run.trial049:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-17T11:06:48.167 DEBUG:teuthology.orchestra.run.trial097:> set -ex 2026-02-17T11:06:48.167 DEBUG:teuthology.orchestra.run.trial097:> sudo dd of=/usr/bin/daemon-helper 2026-02-17T11:06:48.192 DEBUG:teuthology.orchestra.run.trial097:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-17T11:06:48.255 DEBUG:teuthology.orchestra.run.trial157:> set -ex 2026-02-17T11:06:48.256 DEBUG:teuthology.orchestra.run.trial157:> sudo dd of=/usr/bin/daemon-helper 2026-02-17T11:06:48.281 DEBUG:teuthology.orchestra.run.trial157:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-17T11:06:48.344 DEBUG:teuthology.orchestra.run.trial162:> set -ex 2026-02-17T11:06:48.344 DEBUG:teuthology.orchestra.run.trial162:> sudo dd of=/usr/bin/daemon-helper 2026-02-17T11:06:48.370 DEBUG:teuthology.orchestra.run.trial162:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-17T11:06:48.436 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-17T11:06:48.436 DEBUG:teuthology.orchestra.run.trial049:> set -ex 2026-02-17T11:06:48.437 DEBUG:teuthology.orchestra.run.trial049:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-17T11:06:48.462 DEBUG:teuthology.orchestra.run.trial049:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-17T11:06:48.528 DEBUG:teuthology.orchestra.run.trial097:> set -ex 2026-02-17T11:06:48.528 DEBUG:teuthology.orchestra.run.trial097:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-17T11:06:48.554 DEBUG:teuthology.orchestra.run.trial097:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-17T11:06:48.619 DEBUG:teuthology.orchestra.run.trial157:> set -ex 2026-02-17T11:06:48.619 DEBUG:teuthology.orchestra.run.trial157:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-17T11:06:48.642 DEBUG:teuthology.orchestra.run.trial157:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-17T11:06:48.706 DEBUG:teuthology.orchestra.run.trial162:> set -ex 2026-02-17T11:06:48.707 DEBUG:teuthology.orchestra.run.trial162:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-17T11:06:48.731 DEBUG:teuthology.orchestra.run.trial162:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-17T11:06:48.793 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-17T11:06:48.794 DEBUG:teuthology.orchestra.run.trial049:> set -ex 2026-02-17T11:06:48.794 DEBUG:teuthology.orchestra.run.trial049:> sudo dd of=/usr/bin/stdin-killer 2026-02-17T11:06:48.818 DEBUG:teuthology.orchestra.run.trial049:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-17T11:06:48.882 DEBUG:teuthology.orchestra.run.trial097:> set -ex 2026-02-17T11:06:48.882 DEBUG:teuthology.orchestra.run.trial097:> sudo dd of=/usr/bin/stdin-killer 2026-02-17T11:06:48.906 DEBUG:teuthology.orchestra.run.trial097:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-17T11:06:48.969 DEBUG:teuthology.orchestra.run.trial157:> set -ex 2026-02-17T11:06:48.970 DEBUG:teuthology.orchestra.run.trial157:> sudo dd of=/usr/bin/stdin-killer 2026-02-17T11:06:48.994 DEBUG:teuthology.orchestra.run.trial157:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-17T11:06:49.059 DEBUG:teuthology.orchestra.run.trial162:> set -ex 2026-02-17T11:06:49.059 DEBUG:teuthology.orchestra.run.trial162:> sudo dd of=/usr/bin/stdin-killer 2026-02-17T11:06:49.084 DEBUG:teuthology.orchestra.run.trial162:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-17T11:06:49.149 INFO:teuthology.run_tasks:Running task ceph... 2026-02-17T11:06:49.222 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-17T11:06:49.222 DEBUG:teuthology.orchestra.run.trial049:> sudo chmod 777 /var/log/ceph 2026-02-17T11:06:49.224 DEBUG:teuthology.orchestra.run.trial097:> sudo chmod 777 /var/log/ceph 2026-02-17T11:06:49.225 DEBUG:teuthology.orchestra.run.trial157:> sudo chmod 777 /var/log/ceph 2026-02-17T11:06:49.227 DEBUG:teuthology.orchestra.run.trial162:> sudo chmod 777 /var/log/ceph 2026-02-17T11:06:49.252 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-17T11:06:49.252 DEBUG:teuthology.orchestra.run.trial049:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-17T11:06:49.288 DEBUG:teuthology.orchestra.run.trial097:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-17T11:06:49.290 DEBUG:teuthology.orchestra.run.trial157:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-17T11:06:49.292 DEBUG:teuthology.orchestra.run.trial162:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-17T11:06:49.315 INFO:tasks.ceph:Creating extra log directories... 2026-02-17T11:06:49.315 DEBUG:teuthology.orchestra.run.trial049:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-17T11:06:49.351 DEBUG:teuthology.orchestra.run.trial097:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-17T11:06:49.354 DEBUG:teuthology.orchestra.run.trial157:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-17T11:06:49.358 DEBUG:teuthology.orchestra.run.trial162:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-17T11:06:49.391 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-17T11:06:49.391 INFO:tasks.ceph:config {'conf': {'client': {'debug monc': 20, 'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd heartbeat grace': 160, 'osd op thread timeout': 150}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osd crush smoke test': False, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 10}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 1, 'debug bluestore': 1, 'debug monc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd client watch timeout': 240, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'reached quota', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(SLOW_OPS\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(OBJECT_MISPLACED\\)', 'slow request', 'overall HEALTH_', '\\(PG_', '\\(MON_DOWN\\)', '\\(SLOW_OPS\\)', 'slow request', 'OSD bench result'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-17T11:06:49.391 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51248', 'branch': 'wip-bharath19-testing-2026-02-13-0903-squid', 'description': 'rados/verify/{centos_latest ceph clusters/fixed-4 d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind}', 'email': 'skanta@redhat.com', 'first_in_suite': False, 'flavor': 'default', 'job_id': '51248', 'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'name': 'skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial', 'no_nested_subset': False, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-bharath19-testing-2026-02-13-0903-squid'}, 'ceph': {'conf': {'client': {'debug monc': 20, 'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd heartbeat grace': 160, 'osd op thread timeout': 150}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osd crush smoke test': False, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 10}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 1, 'debug bluestore': 1, 'debug monc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd client watch timeout': 240, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'reached quota', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(SLOW_OPS\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(OBJECT_MISPLACED\\)', 'slow request', 'overall HEALTH_', '\\(PG_', '\\(MON_DOWN\\)', '\\(SLOW_OPS\\)', 'slow request', 'OSD bench result'], 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e', 'stop-daemons-timeout': 1200, 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes'], 'osd': ['--tool=memcheck']}}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-bharath19-testing-2026-02-13-0903-squid', 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e'}}, 'owner': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'priority': 69, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'osd.0', 'osd.4', 'osd.8', 'osd.12'], ['mon.b', 'osd.1', 'osd.5', 'osd.9', 'osd.13'], ['mon.c', 'osd.2', 'osd.6', 'osd.10', 'osd.14'], ['mgr.x', 'osd.3', 'osd.7', 'osd.11', 'osd.15', 'client.0']], 'seed': 3603, 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-bharath19-testing-2026-02-13-0903-squid', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e', 'targets': {'trial049.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJjYN4M7NWTYnJPmNG+2Xoiiufi+7/RYJ4P6pU1HzV8o/A6udGqDw6wYcMJDuCHkm/sw275aLThiTjZpmd6HYXg=', 'trial097.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKPOjyd5Wlv1zY0q0agkiaMgL2X2x1JSS2ibcgzOY34afJj4Kojpm1tjTqlQHYrxZ32z/kp0naI37RvP7eLIgj4=', 'trial157.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNAXNyW6k63X3r5MnE+xpVNto3790b7OTnzzrXfpNfiOs4ivH1PDnDg29dUQsHfNazBbv3JS7WAnBwhPxZqyOok=', 'trial162.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBrW4Rt2QZ+kMjA6iyoN80YQt1vU5s/Zf1VPVDl/0A07VA6aJZR1mUcJOPqqpourj8hsXFaxvF8syIPkR6oJ3/c='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'workunit': {'clients': {'client.0': ['rados/test.sh']}, 'env': {'ALLOW_TIMEOUTS': '1'}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["-- Don't run this test on tiny clusters\nif py_len(yaml.roles) < 4 then reject() end\n"]}, 'teuthology_branch': 'main', 'teuthology_sha1': 'fa17720d0088c3ac28e473468bfc79eeaff5cd38', 'timestamp': '2026-02-17_04:03:08', 'tube': 'trial', 'user': 'skanta', 'verbose': True, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682'} 2026-02-17T11:06:49.391 DEBUG:teuthology.orchestra.run.trial049:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-17T11:06:49.415 DEBUG:teuthology.orchestra.run.trial097:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-17T11:06:49.417 DEBUG:teuthology.orchestra.run.trial157:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-17T11:06:49.422 DEBUG:teuthology.orchestra.run.trial162:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-17T11:06:49.439 DEBUG:teuthology.orchestra.run.trial049:> sudo install -d -m0777 -- /var/run/ceph 2026-02-17T11:06:49.471 DEBUG:teuthology.orchestra.run.trial097:> sudo install -d -m0777 -- /var/run/ceph 2026-02-17T11:06:49.473 DEBUG:teuthology.orchestra.run.trial157:> sudo install -d -m0777 -- /var/run/ceph 2026-02-17T11:06:49.479 DEBUG:teuthology.orchestra.run.trial162:> sudo install -d -m0777 -- /var/run/ceph 2026-02-17T11:06:49.502 DEBUG:teuthology.orchestra.run.trial049:> set -ex 2026-02-17T11:06:49.502 DEBUG:teuthology.orchestra.run.trial049:> dd if=/scratch_devs of=/dev/stdout 2026-02-17T11:06:49.549 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-17T11:06:49.549 DEBUG:teuthology.orchestra.run.trial049:> stat /dev/vg_nvme/lv_1 2026-02-17T11:06:49.607 INFO:teuthology.orchestra.run.trial049.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-17T11:06:49.607 INFO:teuthology.orchestra.run.trial049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T11:06:49.608 INFO:teuthology.orchestra.run.trial049.stdout:Device: 6h/6d Inode: 1314 Links: 1 2026-02-17T11:06:49.608 INFO:teuthology.orchestra.run.trial049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T11:06:49.608 INFO:teuthology.orchestra.run.trial049.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T11:06:49.608 INFO:teuthology.orchestra.run.trial049.stdout:Access: 2026-02-17 11:02:51.215395686 +0000 2026-02-17T11:06:49.608 INFO:teuthology.orchestra.run.trial049.stdout:Modify: 2026-02-17 11:02:15.696355936 +0000 2026-02-17T11:06:49.608 INFO:teuthology.orchestra.run.trial049.stdout:Change: 2026-02-17 11:02:15.696355936 +0000 2026-02-17T11:06:49.608 INFO:teuthology.orchestra.run.trial049.stdout: Birth: 2026-02-17 11:02:15.696355936 +0000 2026-02-17T11:06:49.609 DEBUG:teuthology.orchestra.run.trial049:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-17T11:06:49.671 INFO:teuthology.orchestra.run.trial049.stderr:1+0 records in 2026-02-17T11:06:49.671 INFO:teuthology.orchestra.run.trial049.stderr:1+0 records out 2026-02-17T11:06:49.671 INFO:teuthology.orchestra.run.trial049.stderr:512 bytes copied, 0.000160788 s, 3.2 MB/s 2026-02-17T11:06:49.673 DEBUG:teuthology.orchestra.run.trial049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-17T11:06:49.729 DEBUG:teuthology.orchestra.run.trial049:> stat /dev/vg_nvme/lv_2 2026-02-17T11:06:49.785 INFO:teuthology.orchestra.run.trial049.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-17T11:06:49.785 INFO:teuthology.orchestra.run.trial049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T11:06:49.785 INFO:teuthology.orchestra.run.trial049.stdout:Device: 6h/6d Inode: 1294 Links: 1 2026-02-17T11:06:49.785 INFO:teuthology.orchestra.run.trial049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T11:06:49.785 INFO:teuthology.orchestra.run.trial049.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T11:06:49.785 INFO:teuthology.orchestra.run.trial049.stdout:Access: 2026-02-17 11:02:51.216395651 +0000 2026-02-17T11:06:49.785 INFO:teuthology.orchestra.run.trial049.stdout:Modify: 2026-02-17 11:02:15.695355971 +0000 2026-02-17T11:06:49.785 INFO:teuthology.orchestra.run.trial049.stdout:Change: 2026-02-17 11:02:15.695355971 +0000 2026-02-17T11:06:49.785 INFO:teuthology.orchestra.run.trial049.stdout: Birth: 2026-02-17 11:02:15.695355971 +0000 2026-02-17T11:06:49.785 DEBUG:teuthology.orchestra.run.trial049:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-17T11:06:49.850 INFO:teuthology.orchestra.run.trial049.stderr:1+0 records in 2026-02-17T11:06:49.850 INFO:teuthology.orchestra.run.trial049.stderr:1+0 records out 2026-02-17T11:06:49.850 INFO:teuthology.orchestra.run.trial049.stderr:512 bytes copied, 0.000146432 s, 3.5 MB/s 2026-02-17T11:06:49.851 DEBUG:teuthology.orchestra.run.trial049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-17T11:06:49.908 DEBUG:teuthology.orchestra.run.trial049:> stat /dev/vg_nvme/lv_3 2026-02-17T11:06:49.964 INFO:teuthology.orchestra.run.trial049.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-17T11:06:49.964 INFO:teuthology.orchestra.run.trial049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T11:06:49.964 INFO:teuthology.orchestra.run.trial049.stdout:Device: 6h/6d Inode: 1308 Links: 1 2026-02-17T11:06:49.964 INFO:teuthology.orchestra.run.trial049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T11:06:49.964 INFO:teuthology.orchestra.run.trial049.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T11:06:49.964 INFO:teuthology.orchestra.run.trial049.stdout:Access: 2026-02-17 11:02:51.216395651 +0000 2026-02-17T11:06:49.965 INFO:teuthology.orchestra.run.trial049.stdout:Modify: 2026-02-17 11:02:15.695355971 +0000 2026-02-17T11:06:49.965 INFO:teuthology.orchestra.run.trial049.stdout:Change: 2026-02-17 11:02:15.695355971 +0000 2026-02-17T11:06:49.965 INFO:teuthology.orchestra.run.trial049.stdout: Birth: 2026-02-17 11:02:15.695355971 +0000 2026-02-17T11:06:49.965 DEBUG:teuthology.orchestra.run.trial049:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-17T11:06:50.029 INFO:teuthology.orchestra.run.trial049.stderr:1+0 records in 2026-02-17T11:06:50.029 INFO:teuthology.orchestra.run.trial049.stderr:1+0 records out 2026-02-17T11:06:50.029 INFO:teuthology.orchestra.run.trial049.stderr:512 bytes copied, 0.000164906 s, 3.1 MB/s 2026-02-17T11:06:50.030 DEBUG:teuthology.orchestra.run.trial049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-17T11:06:50.087 DEBUG:teuthology.orchestra.run.trial049:> stat /dev/vg_nvme/lv_4 2026-02-17T11:06:50.144 INFO:teuthology.orchestra.run.trial049.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-17T11:06:50.144 INFO:teuthology.orchestra.run.trial049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T11:06:50.145 INFO:teuthology.orchestra.run.trial049.stdout:Device: 6h/6d Inode: 1295 Links: 1 2026-02-17T11:06:50.145 INFO:teuthology.orchestra.run.trial049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T11:06:50.145 INFO:teuthology.orchestra.run.trial049.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T11:06:50.145 INFO:teuthology.orchestra.run.trial049.stdout:Access: 2026-02-17 11:02:51.216395651 +0000 2026-02-17T11:06:50.145 INFO:teuthology.orchestra.run.trial049.stdout:Modify: 2026-02-17 11:02:15.695355971 +0000 2026-02-17T11:06:50.145 INFO:teuthology.orchestra.run.trial049.stdout:Change: 2026-02-17 11:02:15.695355971 +0000 2026-02-17T11:06:50.145 INFO:teuthology.orchestra.run.trial049.stdout: Birth: 2026-02-17 11:02:15.695355971 +0000 2026-02-17T11:06:50.146 DEBUG:teuthology.orchestra.run.trial049:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-17T11:06:50.208 INFO:teuthology.orchestra.run.trial049.stderr:1+0 records in 2026-02-17T11:06:50.208 INFO:teuthology.orchestra.run.trial049.stderr:1+0 records out 2026-02-17T11:06:50.208 INFO:teuthology.orchestra.run.trial049.stderr:512 bytes copied, 0.000141423 s, 3.6 MB/s 2026-02-17T11:06:50.209 DEBUG:teuthology.orchestra.run.trial049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-17T11:06:50.266 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-17T11:06:50.266 DEBUG:teuthology.orchestra.run.trial097:> set -ex 2026-02-17T11:06:50.267 DEBUG:teuthology.orchestra.run.trial097:> dd if=/scratch_devs of=/dev/stdout 2026-02-17T11:06:50.285 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-17T11:06:50.285 DEBUG:teuthology.orchestra.run.trial097:> stat /dev/vg_nvme/lv_1 2026-02-17T11:06:50.342 INFO:teuthology.orchestra.run.trial097.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-17T11:06:50.342 INFO:teuthology.orchestra.run.trial097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T11:06:50.342 INFO:teuthology.orchestra.run.trial097.stdout:Device: 6h/6d Inode: 1316 Links: 1 2026-02-17T11:06:50.342 INFO:teuthology.orchestra.run.trial097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T11:06:50.342 INFO:teuthology.orchestra.run.trial097.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T11:06:50.342 INFO:teuthology.orchestra.run.trial097.stdout:Access: 2026-02-17 11:02:23.616287467 +0000 2026-02-17T11:06:50.342 INFO:teuthology.orchestra.run.trial097.stdout:Modify: 2026-02-17 11:01:48.295239590 +0000 2026-02-17T11:06:50.343 INFO:teuthology.orchestra.run.trial097.stdout:Change: 2026-02-17 11:01:48.295239590 +0000 2026-02-17T11:06:50.343 INFO:teuthology.orchestra.run.trial097.stdout: Birth: 2026-02-17 11:01:48.295239590 +0000 2026-02-17T11:06:50.343 DEBUG:teuthology.orchestra.run.trial097:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-17T11:06:50.404 INFO:teuthology.orchestra.run.trial097.stderr:1+0 records in 2026-02-17T11:06:50.404 INFO:teuthology.orchestra.run.trial097.stderr:1+0 records out 2026-02-17T11:06:50.404 INFO:teuthology.orchestra.run.trial097.stderr:512 bytes copied, 0.000146232 s, 3.5 MB/s 2026-02-17T11:06:50.406 DEBUG:teuthology.orchestra.run.trial097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-17T11:06:50.464 DEBUG:teuthology.orchestra.run.trial097:> stat /dev/vg_nvme/lv_2 2026-02-17T11:06:50.519 INFO:teuthology.orchestra.run.trial097.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-17T11:06:50.520 INFO:teuthology.orchestra.run.trial097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T11:06:50.520 INFO:teuthology.orchestra.run.trial097.stdout:Device: 6h/6d Inode: 1303 Links: 1 2026-02-17T11:06:50.520 INFO:teuthology.orchestra.run.trial097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T11:06:50.520 INFO:teuthology.orchestra.run.trial097.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T11:06:50.520 INFO:teuthology.orchestra.run.trial097.stdout:Access: 2026-02-17 11:02:23.616287467 +0000 2026-02-17T11:06:50.520 INFO:teuthology.orchestra.run.trial097.stdout:Modify: 2026-02-17 11:01:48.294239617 +0000 2026-02-17T11:06:50.520 INFO:teuthology.orchestra.run.trial097.stdout:Change: 2026-02-17 11:01:48.294239617 +0000 2026-02-17T11:06:50.520 INFO:teuthology.orchestra.run.trial097.stdout: Birth: 2026-02-17 11:01:48.294239617 +0000 2026-02-17T11:06:50.520 DEBUG:teuthology.orchestra.run.trial097:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-17T11:06:50.581 INFO:teuthology.orchestra.run.trial097.stderr:1+0 records in 2026-02-17T11:06:50.581 INFO:teuthology.orchestra.run.trial097.stderr:1+0 records out 2026-02-17T11:06:50.582 INFO:teuthology.orchestra.run.trial097.stderr:512 bytes copied, 0.000147334 s, 3.5 MB/s 2026-02-17T11:06:50.583 DEBUG:teuthology.orchestra.run.trial097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-17T11:06:50.641 DEBUG:teuthology.orchestra.run.trial097:> stat /dev/vg_nvme/lv_3 2026-02-17T11:06:50.696 INFO:teuthology.orchestra.run.trial097.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-17T11:06:50.696 INFO:teuthology.orchestra.run.trial097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T11:06:50.696 INFO:teuthology.orchestra.run.trial097.stdout:Device: 6h/6d Inode: 1308 Links: 1 2026-02-17T11:06:50.696 INFO:teuthology.orchestra.run.trial097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T11:06:50.696 INFO:teuthology.orchestra.run.trial097.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T11:06:50.696 INFO:teuthology.orchestra.run.trial097.stdout:Access: 2026-02-17 11:02:23.617287440 +0000 2026-02-17T11:06:50.696 INFO:teuthology.orchestra.run.trial097.stdout:Modify: 2026-02-17 11:01:48.295239590 +0000 2026-02-17T11:06:50.697 INFO:teuthology.orchestra.run.trial097.stdout:Change: 2026-02-17 11:01:48.295239590 +0000 2026-02-17T11:06:50.697 INFO:teuthology.orchestra.run.trial097.stdout: Birth: 2026-02-17 11:01:48.295239590 +0000 2026-02-17T11:06:50.697 DEBUG:teuthology.orchestra.run.trial097:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-17T11:06:50.759 INFO:teuthology.orchestra.run.trial097.stderr:1+0 records in 2026-02-17T11:06:50.759 INFO:teuthology.orchestra.run.trial097.stderr:1+0 records out 2026-02-17T11:06:50.759 INFO:teuthology.orchestra.run.trial097.stderr:512 bytes copied, 0.000159917 s, 3.2 MB/s 2026-02-17T11:06:50.760 DEBUG:teuthology.orchestra.run.trial097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-17T11:06:50.818 DEBUG:teuthology.orchestra.run.trial097:> stat /dev/vg_nvme/lv_4 2026-02-17T11:06:50.873 INFO:teuthology.orchestra.run.trial097.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-17T11:06:50.874 INFO:teuthology.orchestra.run.trial097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T11:06:50.874 INFO:teuthology.orchestra.run.trial097.stdout:Device: 6h/6d Inode: 1295 Links: 1 2026-02-17T11:06:50.874 INFO:teuthology.orchestra.run.trial097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T11:06:50.874 INFO:teuthology.orchestra.run.trial097.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T11:06:50.874 INFO:teuthology.orchestra.run.trial097.stdout:Access: 2026-02-17 11:02:23.617287440 +0000 2026-02-17T11:06:50.874 INFO:teuthology.orchestra.run.trial097.stdout:Modify: 2026-02-17 11:01:48.294239617 +0000 2026-02-17T11:06:50.874 INFO:teuthology.orchestra.run.trial097.stdout:Change: 2026-02-17 11:01:48.294239617 +0000 2026-02-17T11:06:50.874 INFO:teuthology.orchestra.run.trial097.stdout: Birth: 2026-02-17 11:01:48.294239617 +0000 2026-02-17T11:06:50.875 DEBUG:teuthology.orchestra.run.trial097:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-17T11:06:50.936 INFO:teuthology.orchestra.run.trial097.stderr:1+0 records in 2026-02-17T11:06:50.936 INFO:teuthology.orchestra.run.trial097.stderr:1+0 records out 2026-02-17T11:06:50.936 INFO:teuthology.orchestra.run.trial097.stderr:512 bytes copied, 0.000144698 s, 3.5 MB/s 2026-02-17T11:06:50.938 DEBUG:teuthology.orchestra.run.trial097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-17T11:06:50.994 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-17T11:06:50.995 DEBUG:teuthology.orchestra.run.trial157:> set -ex 2026-02-17T11:06:50.995 DEBUG:teuthology.orchestra.run.trial157:> dd if=/scratch_devs of=/dev/stdout 2026-02-17T11:06:51.013 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-17T11:06:51.014 DEBUG:teuthology.orchestra.run.trial157:> stat /dev/vg_nvme/lv_1 2026-02-17T11:06:51.072 INFO:teuthology.orchestra.run.trial157.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-17T11:06:51.072 INFO:teuthology.orchestra.run.trial157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T11:06:51.072 INFO:teuthology.orchestra.run.trial157.stdout:Device: 6h/6d Inode: 1311 Links: 1 2026-02-17T11:06:51.073 INFO:teuthology.orchestra.run.trial157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T11:06:51.073 INFO:teuthology.orchestra.run.trial157.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T11:06:51.073 INFO:teuthology.orchestra.run.trial157.stdout:Access: 2026-02-17 11:02:30.600583984 +0000 2026-02-17T11:06:51.073 INFO:teuthology.orchestra.run.trial157.stdout:Modify: 2026-02-17 11:01:55.869936615 +0000 2026-02-17T11:06:51.073 INFO:teuthology.orchestra.run.trial157.stdout:Change: 2026-02-17 11:01:55.869936615 +0000 2026-02-17T11:06:51.073 INFO:teuthology.orchestra.run.trial157.stdout: Birth: 2026-02-17 11:01:55.869936615 +0000 2026-02-17T11:06:51.074 DEBUG:teuthology.orchestra.run.trial157:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-17T11:06:51.135 INFO:teuthology.orchestra.run.trial157.stderr:1+0 records in 2026-02-17T11:06:51.135 INFO:teuthology.orchestra.run.trial157.stderr:1+0 records out 2026-02-17T11:06:51.135 INFO:teuthology.orchestra.run.trial157.stderr:512 bytes copied, 0.000161392 s, 3.2 MB/s 2026-02-17T11:06:51.136 DEBUG:teuthology.orchestra.run.trial157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-17T11:06:51.193 DEBUG:teuthology.orchestra.run.trial157:> stat /dev/vg_nvme/lv_2 2026-02-17T11:06:51.251 INFO:teuthology.orchestra.run.trial157.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-17T11:06:51.251 INFO:teuthology.orchestra.run.trial157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T11:06:51.251 INFO:teuthology.orchestra.run.trial157.stdout:Device: 6h/6d Inode: 1314 Links: 1 2026-02-17T11:06:51.251 INFO:teuthology.orchestra.run.trial157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T11:06:51.251 INFO:teuthology.orchestra.run.trial157.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T11:06:51.251 INFO:teuthology.orchestra.run.trial157.stdout:Access: 2026-02-17 11:02:30.600583984 +0000 2026-02-17T11:06:51.251 INFO:teuthology.orchestra.run.trial157.stdout:Modify: 2026-02-17 11:01:55.869936615 +0000 2026-02-17T11:06:51.251 INFO:teuthology.orchestra.run.trial157.stdout:Change: 2026-02-17 11:01:55.869936615 +0000 2026-02-17T11:06:51.251 INFO:teuthology.orchestra.run.trial157.stdout: Birth: 2026-02-17 11:01:55.869936615 +0000 2026-02-17T11:06:51.251 DEBUG:teuthology.orchestra.run.trial157:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-17T11:06:51.313 INFO:teuthology.orchestra.run.trial157.stderr:1+0 records in 2026-02-17T11:06:51.313 INFO:teuthology.orchestra.run.trial157.stderr:1+0 records out 2026-02-17T11:06:51.313 INFO:teuthology.orchestra.run.trial157.stderr:512 bytes copied, 0.000188733 s, 2.7 MB/s 2026-02-17T11:06:51.314 DEBUG:teuthology.orchestra.run.trial157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-17T11:06:51.372 DEBUG:teuthology.orchestra.run.trial157:> stat /dev/vg_nvme/lv_3 2026-02-17T11:06:51.430 INFO:teuthology.orchestra.run.trial157.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-17T11:06:51.430 INFO:teuthology.orchestra.run.trial157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T11:06:51.430 INFO:teuthology.orchestra.run.trial157.stdout:Device: 6h/6d Inode: 1304 Links: 1 2026-02-17T11:06:51.430 INFO:teuthology.orchestra.run.trial157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T11:06:51.430 INFO:teuthology.orchestra.run.trial157.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T11:06:51.431 INFO:teuthology.orchestra.run.trial157.stdout:Access: 2026-02-17 11:02:30.601583974 +0000 2026-02-17T11:06:51.431 INFO:teuthology.orchestra.run.trial157.stdout:Modify: 2026-02-17 11:01:55.868936626 +0000 2026-02-17T11:06:51.431 INFO:teuthology.orchestra.run.trial157.stdout:Change: 2026-02-17 11:01:55.868936626 +0000 2026-02-17T11:06:51.431 INFO:teuthology.orchestra.run.trial157.stdout: Birth: 2026-02-17 11:01:55.868936626 +0000 2026-02-17T11:06:51.431 DEBUG:teuthology.orchestra.run.trial157:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-17T11:06:51.494 INFO:teuthology.orchestra.run.trial157.stderr:1+0 records in 2026-02-17T11:06:51.495 INFO:teuthology.orchestra.run.trial157.stderr:1+0 records out 2026-02-17T11:06:51.495 INFO:teuthology.orchestra.run.trial157.stderr:512 bytes copied, 0.000143768 s, 3.6 MB/s 2026-02-17T11:06:51.496 DEBUG:teuthology.orchestra.run.trial157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-17T11:06:51.553 DEBUG:teuthology.orchestra.run.trial157:> stat /dev/vg_nvme/lv_4 2026-02-17T11:06:51.611 INFO:teuthology.orchestra.run.trial157.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-17T11:06:51.611 INFO:teuthology.orchestra.run.trial157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T11:06:51.612 INFO:teuthology.orchestra.run.trial157.stdout:Device: 6h/6d Inode: 1296 Links: 1 2026-02-17T11:06:51.612 INFO:teuthology.orchestra.run.trial157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T11:06:51.612 INFO:teuthology.orchestra.run.trial157.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T11:06:51.612 INFO:teuthology.orchestra.run.trial157.stdout:Access: 2026-02-17 11:02:30.601583974 +0000 2026-02-17T11:06:51.612 INFO:teuthology.orchestra.run.trial157.stdout:Modify: 2026-02-17 11:01:55.868936626 +0000 2026-02-17T11:06:51.612 INFO:teuthology.orchestra.run.trial157.stdout:Change: 2026-02-17 11:01:55.868936626 +0000 2026-02-17T11:06:51.612 INFO:teuthology.orchestra.run.trial157.stdout: Birth: 2026-02-17 11:01:55.868936626 +0000 2026-02-17T11:06:51.612 DEBUG:teuthology.orchestra.run.trial157:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-17T11:06:51.674 INFO:teuthology.orchestra.run.trial157.stderr:1+0 records in 2026-02-17T11:06:51.674 INFO:teuthology.orchestra.run.trial157.stderr:1+0 records out 2026-02-17T11:06:51.674 INFO:teuthology.orchestra.run.trial157.stderr:512 bytes copied, 0.000134081 s, 3.8 MB/s 2026-02-17T11:06:51.675 DEBUG:teuthology.orchestra.run.trial157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-17T11:06:51.732 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-17T11:06:51.733 DEBUG:teuthology.orchestra.run.trial162:> set -ex 2026-02-17T11:06:51.733 DEBUG:teuthology.orchestra.run.trial162:> dd if=/scratch_devs of=/dev/stdout 2026-02-17T11:06:51.752 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-17T11:06:51.752 DEBUG:teuthology.orchestra.run.trial162:> stat /dev/vg_nvme/lv_1 2026-02-17T11:06:51.808 INFO:teuthology.orchestra.run.trial162.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-17T11:06:51.809 INFO:teuthology.orchestra.run.trial162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T11:06:51.809 INFO:teuthology.orchestra.run.trial162.stdout:Device: 6h/6d Inode: 1302 Links: 1 2026-02-17T11:06:51.809 INFO:teuthology.orchestra.run.trial162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T11:06:51.809 INFO:teuthology.orchestra.run.trial162.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T11:06:51.809 INFO:teuthology.orchestra.run.trial162.stdout:Access: 2026-02-17 11:02:50.106595645 +0000 2026-02-17T11:06:51.809 INFO:teuthology.orchestra.run.trial162.stdout:Modify: 2026-02-17 11:02:14.798556132 +0000 2026-02-17T11:06:51.809 INFO:teuthology.orchestra.run.trial162.stdout:Change: 2026-02-17 11:02:14.798556132 +0000 2026-02-17T11:06:51.809 INFO:teuthology.orchestra.run.trial162.stdout: Birth: 2026-02-17 11:02:14.798556132 +0000 2026-02-17T11:06:51.810 DEBUG:teuthology.orchestra.run.trial162:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-17T11:06:51.871 INFO:teuthology.orchestra.run.trial162.stderr:1+0 records in 2026-02-17T11:06:51.872 INFO:teuthology.orchestra.run.trial162.stderr:1+0 records out 2026-02-17T11:06:51.872 INFO:teuthology.orchestra.run.trial162.stderr:512 bytes copied, 0.000146592 s, 3.5 MB/s 2026-02-17T11:06:51.873 DEBUG:teuthology.orchestra.run.trial162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-17T11:06:51.932 DEBUG:teuthology.orchestra.run.trial162:> stat /dev/vg_nvme/lv_2 2026-02-17T11:06:51.989 INFO:teuthology.orchestra.run.trial162.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-17T11:06:51.989 INFO:teuthology.orchestra.run.trial162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T11:06:51.990 INFO:teuthology.orchestra.run.trial162.stdout:Device: 6h/6d Inode: 1314 Links: 1 2026-02-17T11:06:51.990 INFO:teuthology.orchestra.run.trial162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T11:06:51.990 INFO:teuthology.orchestra.run.trial162.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T11:06:51.990 INFO:teuthology.orchestra.run.trial162.stdout:Access: 2026-02-17 11:02:50.106595645 +0000 2026-02-17T11:06:51.990 INFO:teuthology.orchestra.run.trial162.stdout:Modify: 2026-02-17 11:02:14.799556095 +0000 2026-02-17T11:06:51.990 INFO:teuthology.orchestra.run.trial162.stdout:Change: 2026-02-17 11:02:14.799556095 +0000 2026-02-17T11:06:51.990 INFO:teuthology.orchestra.run.trial162.stdout: Birth: 2026-02-17 11:02:14.799556095 +0000 2026-02-17T11:06:51.990 DEBUG:teuthology.orchestra.run.trial162:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-17T11:06:52.052 INFO:teuthology.orchestra.run.trial162.stderr:1+0 records in 2026-02-17T11:06:52.052 INFO:teuthology.orchestra.run.trial162.stderr:1+0 records out 2026-02-17T11:06:52.052 INFO:teuthology.orchestra.run.trial162.stderr:512 bytes copied, 0.000141533 s, 3.6 MB/s 2026-02-17T11:06:52.054 DEBUG:teuthology.orchestra.run.trial162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-17T11:06:52.111 DEBUG:teuthology.orchestra.run.trial162:> stat /dev/vg_nvme/lv_3 2026-02-17T11:06:52.170 INFO:teuthology.orchestra.run.trial162.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-17T11:06:52.171 INFO:teuthology.orchestra.run.trial162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T11:06:52.171 INFO:teuthology.orchestra.run.trial162.stdout:Device: 6h/6d Inode: 1291 Links: 1 2026-02-17T11:06:52.171 INFO:teuthology.orchestra.run.trial162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T11:06:52.171 INFO:teuthology.orchestra.run.trial162.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T11:06:52.171 INFO:teuthology.orchestra.run.trial162.stdout:Access: 2026-02-17 11:02:50.107595608 +0000 2026-02-17T11:06:52.172 INFO:teuthology.orchestra.run.trial162.stdout:Modify: 2026-02-17 11:02:14.797556169 +0000 2026-02-17T11:06:52.172 INFO:teuthology.orchestra.run.trial162.stdout:Change: 2026-02-17 11:02:14.797556169 +0000 2026-02-17T11:06:52.172 INFO:teuthology.orchestra.run.trial162.stdout: Birth: 2026-02-17 11:02:14.797556169 +0000 2026-02-17T11:06:52.173 DEBUG:teuthology.orchestra.run.trial162:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-17T11:06:52.233 INFO:teuthology.orchestra.run.trial162.stderr:1+0 records in 2026-02-17T11:06:52.234 INFO:teuthology.orchestra.run.trial162.stderr:1+0 records out 2026-02-17T11:06:52.234 INFO:teuthology.orchestra.run.trial162.stderr:512 bytes copied, 0.000156271 s, 3.3 MB/s 2026-02-17T11:06:52.235 DEBUG:teuthology.orchestra.run.trial162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-17T11:06:52.292 DEBUG:teuthology.orchestra.run.trial162:> stat /dev/vg_nvme/lv_4 2026-02-17T11:06:52.350 INFO:teuthology.orchestra.run.trial162.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-17T11:06:52.350 INFO:teuthology.orchestra.run.trial162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T11:06:52.350 INFO:teuthology.orchestra.run.trial162.stdout:Device: 6h/6d Inode: 1300 Links: 1 2026-02-17T11:06:52.350 INFO:teuthology.orchestra.run.trial162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T11:06:52.351 INFO:teuthology.orchestra.run.trial162.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T11:06:52.351 INFO:teuthology.orchestra.run.trial162.stdout:Access: 2026-02-17 11:02:50.107595608 +0000 2026-02-17T11:06:52.351 INFO:teuthology.orchestra.run.trial162.stdout:Modify: 2026-02-17 11:02:14.798556132 +0000 2026-02-17T11:06:52.351 INFO:teuthology.orchestra.run.trial162.stdout:Change: 2026-02-17 11:02:14.798556132 +0000 2026-02-17T11:06:52.351 INFO:teuthology.orchestra.run.trial162.stdout: Birth: 2026-02-17 11:02:14.798556132 +0000 2026-02-17T11:06:52.351 DEBUG:teuthology.orchestra.run.trial162:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-17T11:06:52.414 INFO:teuthology.orchestra.run.trial162.stderr:1+0 records in 2026-02-17T11:06:52.414 INFO:teuthology.orchestra.run.trial162.stderr:1+0 records out 2026-02-17T11:06:52.414 INFO:teuthology.orchestra.run.trial162.stderr:512 bytes copied, 0.000140351 s, 3.6 MB/s 2026-02-17T11:06:52.415 DEBUG:teuthology.orchestra.run.trial162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-17T11:06:52.474 INFO:tasks.ceph:osd dev map: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-17T11:06:52.474 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial049.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial097.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial157.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial162.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'}} 2026-02-17T11:06:52.474 INFO:tasks.ceph:Generating config... 2026-02-17T11:06:52.477 INFO:tasks.ceph:[client] debug monc = 20 2026-02-17T11:06:52.477 INFO:tasks.ceph:[client] debug ms = 1 2026-02-17T11:06:52.477 INFO:tasks.ceph:[client] debug objecter = 20 2026-02-17T11:06:52.477 INFO:tasks.ceph:[client] debug rados = 20 2026-02-17T11:06:52.477 INFO:tasks.ceph:[global] mon client directed command retry = 5 2026-02-17T11:06:52.478 INFO:tasks.ceph:[global] mon election default strategy = 1 2026-02-17T11:06:52.478 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2026-02-17T11:06:52.478 INFO:tasks.ceph:[global] ms type = async 2026-02-17T11:06:52.478 INFO:tasks.ceph:[global] osd heartbeat grace = 160 2026-02-17T11:06:52.478 INFO:tasks.ceph:[global] osd op thread timeout = 150 2026-02-17T11:06:52.478 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-17T11:06:52.478 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-17T11:06:52.478 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-17T11:06:52.478 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-17T11:06:52.478 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-17T11:06:52.478 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2026-02-17T11:06:52.478 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2026-02-17T11:06:52.479 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2026-02-17T11:06:52.479 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2026-02-17T11:06:52.479 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2026-02-17T11:06:52.479 INFO:tasks.ceph:[mon] mon scrub interval = 300 2026-02-17T11:06:52.479 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2026-02-17T11:06:52.479 INFO:tasks.ceph:[mon] paxos service trim min = 10 2026-02-17T11:06:52.479 INFO:tasks.ceph:[osd] bdev async discard = True 2026-02-17T11:06:52.479 INFO:tasks.ceph:[osd] bdev enable discard = True 2026-02-17T11:06:52.479 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2026-02-17T11:06:52.479 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2026-02-17T11:06:52.479 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2026-02-17T11:06:52.479 INFO:tasks.ceph:[osd] debug bluefs = 1 2026-02-17T11:06:52.480 INFO:tasks.ceph:[osd] debug bluestore = 1 2026-02-17T11:06:52.480 INFO:tasks.ceph:[osd] debug monc = 20 2026-02-17T11:06:52.480 INFO:tasks.ceph:[osd] debug ms = 1 2026-02-17T11:06:52.480 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-17T11:06:52.480 INFO:tasks.ceph:[osd] debug rocksdb = 10 2026-02-17T11:06:52.480 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2026-02-17T11:06:52.480 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2026-02-17T11:06:52.480 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2026-02-17T11:06:52.480 INFO:tasks.ceph:[osd] osd class default list = * 2026-02-17T11:06:52.480 INFO:tasks.ceph:[osd] osd class load list = * 2026-02-17T11:06:52.480 INFO:tasks.ceph:[osd] osd client watch timeout = 240 2026-02-17T11:06:52.480 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2026-02-17T11:06:52.481 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2026-02-17T11:06:52.481 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2026-02-17T11:06:52.481 INFO:tasks.ceph:[osd] osd fast shutdown = False 2026-02-17T11:06:52.481 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2026-02-17T11:06:52.481 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2026-02-17T11:06:52.481 INFO:tasks.ceph:[osd] osd memory target = 1610612736 2026-02-17T11:06:52.481 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2026-02-17T11:06:52.481 INFO:tasks.ceph:[osd] osd op queue = debug_random 2026-02-17T11:06:52.481 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2026-02-17T11:06:52.481 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2026-02-17T11:06:52.482 INFO:tasks.ceph:Setting up mon.a... 2026-02-17T11:06:52.482 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-17T11:06:52.517 INFO:teuthology.orchestra.run.trial049.stdout:creating /etc/ceph/ceph.keyring 2026-02-17T11:06:52.520 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-17T11:06:52.595 DEBUG:teuthology.orchestra.run.trial049:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T11:06:52.660 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.49'), ('mon.b', '10.20.193.97'), ('mon.c', '10.20.193.157')] 2026-02-17T11:06:52.661 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.49,10.20.193.97,10.20.193.157', 'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd heartbeat grace': 160, 'osd op thread timeout': 150}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 1, 'debug bluestore': 1, 'debug monc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd client watch timeout': 240, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd mclock override recovery settings': True, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osd crush smoke test': False, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 10}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug monc': 20, 'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}} 2026-02-17T11:06:52.662 DEBUG:teuthology.orchestra.run.trial049:> set -ex 2026-02-17T11:06:52.662 DEBUG:teuthology.orchestra.run.trial049:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-17T11:06:52.716 DEBUG:teuthology.orchestra.run.trial049:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.49 --add b 10.20.193.97 --add c 10.20.193.157 --print /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:06:52.788 INFO:teuthology.orchestra.run.trial049.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:06:52.788 INFO:teuthology.orchestra.run.trial049.stdout:monmaptool: generated fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:06:52.788 INFO:teuthology.orchestra.run.trial049.stdout:setting min_mon_release = quincy 2026-02-17T11:06:52.788 INFO:teuthology.orchestra.run.trial049.stdout:epoch 0 2026-02-17T11:06:52.788 INFO:teuthology.orchestra.run.trial049.stdout:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:06:52.788 INFO:teuthology.orchestra.run.trial049.stdout:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:06:52.788 INFO:teuthology.orchestra.run.trial049.stdout:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:06:52.788 INFO:teuthology.orchestra.run.trial049.stdout:min_mon_release 17 (quincy) 2026-02-17T11:06:52.789 INFO:teuthology.orchestra.run.trial049.stdout:election_strategy: 1 2026-02-17T11:06:52.789 INFO:teuthology.orchestra.run.trial049.stdout:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:06:52.789 INFO:teuthology.orchestra.run.trial049.stdout:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:06:52.789 INFO:teuthology.orchestra.run.trial049.stdout:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:06:52.789 INFO:teuthology.orchestra.run.trial049.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2026-02-17T11:06:52.790 DEBUG:teuthology.orchestra.run.trial049:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-17T11:06:52.847 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 2799a57b-9ea3-46ae-8e91-1fe004a3651d... 2026-02-17T11:06:52.849 DEBUG:teuthology.orchestra.run.trial049:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-17T11:06:52.890 DEBUG:teuthology.orchestra.run.trial097:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-17T11:06:52.892 DEBUG:teuthology.orchestra.run.trial157:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-17T11:06:52.895 DEBUG:teuthology.orchestra.run.trial162:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-17T11:06:52.926 INFO:teuthology.orchestra.run.trial049.stdout:[global] 2026-02-17T11:06:52.927 INFO:teuthology.orchestra.run.trial049.stdout: chdir = "" 2026-02-17T11:06:52.927 INFO:teuthology.orchestra.run.trial049.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-17T11:06:52.927 INFO:teuthology.orchestra.run.trial049.stdout: auth supported = cephx 2026-02-17T11:06:52.927 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:52.927 INFO:teuthology.orchestra.run.trial049.stdout: filestore xattr use omap = true 2026-02-17T11:06:52.927 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:52.927 INFO:teuthology.orchestra.run.trial049.stdout: mon clock drift allowed = 1.000 2026-02-17T11:06:52.927 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:52.927 INFO:teuthology.orchestra.run.trial049.stdout: osd crush chooseleaf type = 0 2026-02-17T11:06:52.928 INFO:teuthology.orchestra.run.trial049.stdout: auth debug = true 2026-02-17T11:06:52.928 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:52.928 INFO:teuthology.orchestra.run.trial049.stdout: ms die on old message = true 2026-02-17T11:06:52.928 INFO:teuthology.orchestra.run.trial049.stdout: ms die on bug = true 2026-02-17T11:06:52.928 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:52.928 INFO:teuthology.orchestra.run.trial049.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-17T11:06:52.928 INFO:teuthology.orchestra.run.trial049.stdout: mon pg warn max object skew = 0 2026-02-17T11:06:52.928 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:52.928 INFO:teuthology.orchestra.run.trial049.stdout: # disable pg_autoscaler by default for new pools 2026-02-17T11:06:52.928 INFO:teuthology.orchestra.run.trial049.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-17T11:06:52.928 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:52.929 INFO:teuthology.orchestra.run.trial049.stdout: osd pool default size = 2 2026-02-17T11:06:52.929 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:52.929 INFO:teuthology.orchestra.run.trial049.stdout: mon osd allow primary affinity = true 2026-02-17T11:06:52.929 INFO:teuthology.orchestra.run.trial049.stdout: mon osd allow pg remap = true 2026-02-17T11:06:52.929 INFO:teuthology.orchestra.run.trial049.stdout: mon warn on legacy crush tunables = false 2026-02-17T11:06:52.929 INFO:teuthology.orchestra.run.trial049.stdout: mon warn on crush straw calc version zero = false 2026-02-17T11:06:52.929 INFO:teuthology.orchestra.run.trial049.stdout: mon warn on no sortbitwise = false 2026-02-17T11:06:52.929 INFO:teuthology.orchestra.run.trial049.stdout: mon warn on osd down out interval zero = false 2026-02-17T11:06:52.929 INFO:teuthology.orchestra.run.trial049.stdout: mon warn on too few osds = false 2026-02-17T11:06:52.929 INFO:teuthology.orchestra.run.trial049.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-17T11:06:52.929 INFO:teuthology.orchestra.run.trial049.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-17T11:06:52.929 INFO:teuthology.orchestra.run.trial049.stdout: mon_allow_pool_size_one = true 2026-02-17T11:06:52.930 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:52.930 INFO:teuthology.orchestra.run.trial049.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-17T11:06:52.930 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:52.930 INFO:teuthology.orchestra.run.trial049.stdout: osd default data pool replay window = 5 2026-02-17T11:06:52.930 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:52.930 INFO:teuthology.orchestra.run.trial049.stdout: mon allow pool delete = true 2026-02-17T11:06:52.930 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:52.930 INFO:teuthology.orchestra.run.trial049.stdout: mon cluster log file level = debug 2026-02-17T11:06:52.930 INFO:teuthology.orchestra.run.trial049.stdout: debug asserts on shutdown = true 2026-02-17T11:06:52.930 INFO:teuthology.orchestra.run.trial049.stdout: mon health detail to clog = false 2026-02-17T11:06:52.930 INFO:teuthology.orchestra.run.trial049.stdout: mon host = "10.20.193.49,10.20.193.97,10.20.193.157" 2026-02-17T11:06:52.930 INFO:teuthology.orchestra.run.trial049.stdout: mon client directed command retry = 5 2026-02-17T11:06:52.931 INFO:teuthology.orchestra.run.trial049.stdout: mon election default strategy = 1 2026-02-17T11:06:52.931 INFO:teuthology.orchestra.run.trial049.stdout: ms inject socket failures = 5000 2026-02-17T11:06:52.931 INFO:teuthology.orchestra.run.trial049.stdout: ms type = async 2026-02-17T11:06:52.931 INFO:teuthology.orchestra.run.trial049.stdout: osd heartbeat grace = 160 2026-02-17T11:06:52.931 INFO:teuthology.orchestra.run.trial049.stdout: osd op thread timeout = 150 2026-02-17T11:06:52.931 INFO:teuthology.orchestra.run.trial049.stdout: fsid = 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:06:52.931 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:52.931 INFO:teuthology.orchestra.run.trial049.stdout:[osd] 2026-02-17T11:06:52.931 INFO:teuthology.orchestra.run.trial049.stdout: osd journal size = 100 2026-02-17T11:06:52.931 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:52.931 INFO:teuthology.orchestra.run.trial049.stdout: osd scrub load threshold = 5.0 2026-02-17T11:06:52.931 INFO:teuthology.orchestra.run.trial049.stdout: osd scrub max interval = 600 2026-02-17T11:06:52.932 INFO:teuthology.orchestra.run.trial049.stdout: osd mclock profile = high_recovery_ops 2026-02-17T11:06:52.932 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:52.932 INFO:teuthology.orchestra.run.trial049.stdout: osd recover clone overlap = true 2026-02-17T11:06:52.932 INFO:teuthology.orchestra.run.trial049.stdout: osd recovery max chunk = 1048576 2026-02-17T11:06:52.932 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:52.932 INFO:teuthology.orchestra.run.trial049.stdout: osd debug shutdown = true 2026-02-17T11:06:52.932 INFO:teuthology.orchestra.run.trial049.stdout: osd debug op order = true 2026-02-17T11:06:52.932 INFO:teuthology.orchestra.run.trial049.stdout: osd debug verify stray on activate = true 2026-02-17T11:06:52.932 INFO:teuthology.orchestra.run.trial049.stdout: osd debug trim objects = true 2026-02-17T11:06:52.932 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:52.932 INFO:teuthology.orchestra.run.trial049.stdout: osd open classes on start = true 2026-02-17T11:06:52.932 INFO:teuthology.orchestra.run.trial049.stdout: osd debug pg log writeout = true 2026-02-17T11:06:52.933 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:52.933 INFO:teuthology.orchestra.run.trial049.stdout: osd deep scrub update digest min age = 30 2026-02-17T11:06:52.933 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:52.933 INFO:teuthology.orchestra.run.trial049.stdout: osd map max advance = 10 2026-02-17T11:06:52.933 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:52.933 INFO:teuthology.orchestra.run.trial049.stdout: journal zero on create = true 2026-02-17T11:06:52.933 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:52.933 INFO:teuthology.orchestra.run.trial049.stdout: filestore ondisk finisher threads = 3 2026-02-17T11:06:52.933 INFO:teuthology.orchestra.run.trial049.stdout: filestore apply finisher threads = 3 2026-02-17T11:06:52.933 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:52.933 INFO:teuthology.orchestra.run.trial049.stdout: bdev debug aio = true 2026-02-17T11:06:52.933 INFO:teuthology.orchestra.run.trial049.stdout: osd debug misdirected ops = true 2026-02-17T11:06:52.933 INFO:teuthology.orchestra.run.trial049.stdout: bdev async discard = True 2026-02-17T11:06:52.934 INFO:teuthology.orchestra.run.trial049.stdout: bdev enable discard = True 2026-02-17T11:06:52.934 INFO:teuthology.orchestra.run.trial049.stdout: bluestore block size = 96636764160 2026-02-17T11:06:52.934 INFO:teuthology.orchestra.run.trial049.stdout: bluestore fsck on mount = True 2026-02-17T11:06:52.934 INFO:teuthology.orchestra.run.trial049.stdout: bluestore zero block detection = True 2026-02-17T11:06:52.934 INFO:teuthology.orchestra.run.trial049.stdout: debug bluefs = 1 2026-02-17T11:06:52.934 INFO:teuthology.orchestra.run.trial049.stdout: debug bluestore = 1 2026-02-17T11:06:52.934 INFO:teuthology.orchestra.run.trial049.stdout: debug monc = 20 2026-02-17T11:06:52.934 INFO:teuthology.orchestra.run.trial049.stdout: debug ms = 1 2026-02-17T11:06:52.934 INFO:teuthology.orchestra.run.trial049.stdout: debug osd = 20 2026-02-17T11:06:52.934 INFO:teuthology.orchestra.run.trial049.stdout: debug rocksdb = 10 2026-02-17T11:06:52.934 INFO:teuthology.orchestra.run.trial049.stdout: mon osd backfillfull_ratio = 0.85 2026-02-17T11:06:52.934 INFO:teuthology.orchestra.run.trial049.stdout: mon osd full ratio = 0.9 2026-02-17T11:06:52.935 INFO:teuthology.orchestra.run.trial049.stdout: mon osd nearfull ratio = 0.8 2026-02-17T11:06:52.935 INFO:teuthology.orchestra.run.trial049.stdout: osd class default list = * 2026-02-17T11:06:52.935 INFO:teuthology.orchestra.run.trial049.stdout: osd class load list = * 2026-02-17T11:06:52.935 INFO:teuthology.orchestra.run.trial049.stdout: osd client watch timeout = 240 2026-02-17T11:06:52.935 INFO:teuthology.orchestra.run.trial049.stdout: osd debug verify cached snaps = True 2026-02-17T11:06:52.935 INFO:teuthology.orchestra.run.trial049.stdout: osd debug verify missing on start = True 2026-02-17T11:06:52.935 INFO:teuthology.orchestra.run.trial049.stdout: osd failsafe full ratio = 0.95 2026-02-17T11:06:52.935 INFO:teuthology.orchestra.run.trial049.stdout: osd fast shutdown = False 2026-02-17T11:06:52.935 INFO:teuthology.orchestra.run.trial049.stdout: osd mclock override recovery settings = True 2026-02-17T11:06:52.935 INFO:teuthology.orchestra.run.trial049.stdout: osd memory target = 1610612736 2026-02-17T11:06:52.935 INFO:teuthology.orchestra.run.trial049.stdout: osd objectstore = bluestore 2026-02-17T11:06:52.935 INFO:teuthology.orchestra.run.trial049.stdout: osd op queue = debug_random 2026-02-17T11:06:52.935 INFO:teuthology.orchestra.run.trial049.stdout: osd op queue cut off = debug_random 2026-02-17T11:06:52.935 INFO:teuthology.orchestra.run.trial049.stdout: osd shutdown pgref assert = True 2026-02-17T11:06:52.936 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:52.936 INFO:teuthology.orchestra.run.trial049.stdout:[mgr] 2026-02-17T11:06:52.936 INFO:teuthology.orchestra.run.trial049.stdout: debug ms = 1 2026-02-17T11:06:52.936 INFO:teuthology.orchestra.run.trial049.stdout: debug mgr = 20 2026-02-17T11:06:52.936 INFO:teuthology.orchestra.run.trial049.stdout: debug mon = 20 2026-02-17T11:06:52.936 INFO:teuthology.orchestra.run.trial049.stdout: debug auth = 20 2026-02-17T11:06:52.936 INFO:teuthology.orchestra.run.trial049.stdout: mon reweight min pgs per osd = 4 2026-02-17T11:06:52.936 INFO:teuthology.orchestra.run.trial049.stdout: mon reweight min bytes per osd = 10 2026-02-17T11:06:52.936 INFO:teuthology.orchestra.run.trial049.stdout: mgr/telemetry/nag = false 2026-02-17T11:06:52.936 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:52.936 INFO:teuthology.orchestra.run.trial049.stdout:[mon] 2026-02-17T11:06:52.937 INFO:teuthology.orchestra.run.trial049.stdout: debug ms = 1 2026-02-17T11:06:52.937 INFO:teuthology.orchestra.run.trial049.stdout: debug mon = 20 2026-02-17T11:06:52.937 INFO:teuthology.orchestra.run.trial049.stdout: debug paxos = 20 2026-02-17T11:06:52.937 INFO:teuthology.orchestra.run.trial049.stdout: debug auth = 20 2026-02-17T11:06:52.937 INFO:teuthology.orchestra.run.trial049.stdout: mon data avail warn = 5 2026-02-17T11:06:52.937 INFO:teuthology.orchestra.run.trial049.stdout: mon mgr mkfs grace = 240 2026-02-17T11:06:52.937 INFO:teuthology.orchestra.run.trial049.stdout: mon reweight min pgs per osd = 4 2026-02-17T11:06:52.937 INFO:teuthology.orchestra.run.trial049.stdout: mon osd reporter subtree level = osd 2026-02-17T11:06:52.937 INFO:teuthology.orchestra.run.trial049.stdout: mon osd prime pg temp = true 2026-02-17T11:06:52.937 INFO:teuthology.orchestra.run.trial049.stdout: mon reweight min bytes per osd = 10 2026-02-17T11:06:52.937 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:52.937 INFO:teuthology.orchestra.run.trial049.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-17T11:06:52.938 INFO:teuthology.orchestra.run.trial049.stdout: auth mon ticket ttl = 660 # 11m 2026-02-17T11:06:52.938 INFO:teuthology.orchestra.run.trial049.stdout: auth service ticket ttl = 240 # 4m 2026-02-17T11:06:52.938 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:52.938 INFO:teuthology.orchestra.run.trial049.stdout: # don't complain about insecure global_id in the test suite 2026-02-17T11:06:52.938 INFO:teuthology.orchestra.run.trial049.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-17T11:06:52.938 INFO:teuthology.orchestra.run.trial049.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-17T11:06:52.938 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:52.938 INFO:teuthology.orchestra.run.trial049.stdout: # 1m isn't quite enough 2026-02-17T11:06:52.938 INFO:teuthology.orchestra.run.trial049.stdout: mon_down_mkfs_grace = 2m 2026-02-17T11:06:52.938 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:52.939 INFO:teuthology.orchestra.run.trial049.stdout: mon_warn_on_filestore_osds = false 2026-02-17T11:06:52.939 INFO:teuthology.orchestra.run.trial049.stdout: mon min osdmap epochs = 50 2026-02-17T11:06:52.939 INFO:teuthology.orchestra.run.trial049.stdout: mon osd crush smoke test = False 2026-02-17T11:06:52.939 INFO:teuthology.orchestra.run.trial049.stdout: mon osdmap full prune interval = 2 2026-02-17T11:06:52.939 INFO:teuthology.orchestra.run.trial049.stdout: mon osdmap full prune min = 15 2026-02-17T11:06:52.939 INFO:teuthology.orchestra.run.trial049.stdout: mon osdmap full prune txsize = 2 2026-02-17T11:06:52.939 INFO:teuthology.orchestra.run.trial049.stdout: mon scrub interval = 300 2026-02-17T11:06:52.939 INFO:teuthology.orchestra.run.trial049.stdout: mon warn on pool no app = False 2026-02-17T11:06:52.939 INFO:teuthology.orchestra.run.trial049.stdout: paxos service trim min = 10 2026-02-17T11:06:52.939 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:06:52.939 INFO:teuthology.orchestra.run.trial049.stdout:[client] 2026-02-17T11:06:52.939 INFO:teuthology.orchestra.run.trial049.stdout: rgw cache enabled = true 2026-02-17T11:06:52.940 INFO:teuthology.orchestra.run.trial049.stdout: rgw enable ops log = true 2026-02-17T11:06:52.940 INFO:teuthology.orchestra.run.trial049.stdout: rgw enable usage log = true 2026-02-17T11:06:52.940 INFO:teuthology.orchestra.run.trial049.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-17T11:06:52.940 INFO:teuthology.orchestra.run.trial049.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-17T11:06:52.940 INFO:teuthology.orchestra.run.trial049.stdout: debug monc = 20 2026-02-17T11:06:52.940 INFO:teuthology.orchestra.run.trial049.stdout: debug ms = 1 2026-02-17T11:06:52.940 INFO:teuthology.orchestra.run.trial049.stdout: debug objecter = 20 2026-02-17T11:06:52.940 INFO:teuthology.orchestra.run.trial049.stdout: debug rados = 20 2026-02-17T11:06:52.940 INFO:teuthology.orchestra.run.trial049.stdout:[mon.a] 2026-02-17T11:06:52.940 INFO:teuthology.orchestra.run.trial049.stdout:[mon.b] 2026-02-17T11:06:52.940 INFO:teuthology.orchestra.run.trial049.stdout:[mon.c] 2026-02-17T11:06:52.942 INFO:teuthology.orchestra.run.trial162.stdout:[global] 2026-02-17T11:06:52.942 INFO:teuthology.orchestra.run.trial162.stdout: chdir = "" 2026-02-17T11:06:52.942 INFO:teuthology.orchestra.run.trial162.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-17T11:06:52.942 INFO:teuthology.orchestra.run.trial162.stdout: auth supported = cephx 2026-02-17T11:06:52.942 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:52.942 INFO:teuthology.orchestra.run.trial162.stdout: filestore xattr use omap = true 2026-02-17T11:06:52.942 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:52.942 INFO:teuthology.orchestra.run.trial162.stdout: mon clock drift allowed = 1.000 2026-02-17T11:06:52.942 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:52.942 INFO:teuthology.orchestra.run.trial162.stdout: osd crush chooseleaf type = 0 2026-02-17T11:06:52.943 INFO:teuthology.orchestra.run.trial162.stdout: auth debug = true 2026-02-17T11:06:52.943 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:52.943 INFO:teuthology.orchestra.run.trial162.stdout: ms die on old message = true 2026-02-17T11:06:52.943 INFO:teuthology.orchestra.run.trial162.stdout: ms die on bug = true 2026-02-17T11:06:52.943 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:52.943 INFO:teuthology.orchestra.run.trial162.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-17T11:06:52.943 INFO:teuthology.orchestra.run.trial162.stdout: mon pg warn max object skew = 0 2026-02-17T11:06:52.943 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:52.943 INFO:teuthology.orchestra.run.trial162.stdout: # disable pg_autoscaler by default for new pools 2026-02-17T11:06:52.943 INFO:teuthology.orchestra.run.trial162.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-17T11:06:52.944 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:52.944 INFO:teuthology.orchestra.run.trial162.stdout: osd pool default size = 2 2026-02-17T11:06:52.944 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:52.944 INFO:teuthology.orchestra.run.trial162.stdout: mon osd allow primary affinity = true 2026-02-17T11:06:52.944 INFO:teuthology.orchestra.run.trial162.stdout: mon osd allow pg remap = true 2026-02-17T11:06:52.944 INFO:teuthology.orchestra.run.trial162.stdout: mon warn on legacy crush tunables = false 2026-02-17T11:06:52.945 INFO:teuthology.orchestra.run.trial162.stdout: mon warn on crush straw calc version zero = false 2026-02-17T11:06:52.945 INFO:teuthology.orchestra.run.trial162.stdout: mon warn on no sortbitwise = false 2026-02-17T11:06:52.945 INFO:teuthology.orchestra.run.trial162.stdout: mon warn on osd down out interval zero = false 2026-02-17T11:06:52.945 INFO:teuthology.orchestra.run.trial162.stdout: mon warn on too few osds = false 2026-02-17T11:06:52.945 INFO:teuthology.orchestra.run.trial162.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-17T11:06:52.945 INFO:teuthology.orchestra.run.trial162.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-17T11:06:52.945 INFO:teuthology.orchestra.run.trial162.stdout: mon_allow_pool_size_one = true 2026-02-17T11:06:52.946 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:52.946 INFO:teuthology.orchestra.run.trial162.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-17T11:06:52.946 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:52.946 INFO:teuthology.orchestra.run.trial162.stdout: osd default data pool replay window = 5 2026-02-17T11:06:52.946 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:52.946 INFO:teuthology.orchestra.run.trial162.stdout: mon allow pool delete = true 2026-02-17T11:06:52.947 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:52.947 INFO:teuthology.orchestra.run.trial162.stdout: mon cluster log file level = debug 2026-02-17T11:06:52.947 INFO:teuthology.orchestra.run.trial162.stdout: debug asserts on shutdown = true 2026-02-17T11:06:52.947 INFO:teuthology.orchestra.run.trial162.stdout: mon health detail to clog = false 2026-02-17T11:06:52.947 INFO:teuthology.orchestra.run.trial162.stdout: mon host = "10.20.193.49,10.20.193.97,10.20.193.157" 2026-02-17T11:06:52.947 INFO:teuthology.orchestra.run.trial162.stdout: mon client directed command retry = 5 2026-02-17T11:06:52.947 INFO:teuthology.orchestra.run.trial162.stdout: mon election default strategy = 1 2026-02-17T11:06:52.947 INFO:teuthology.orchestra.run.trial162.stdout: ms inject socket failures = 5000 2026-02-17T11:06:52.947 INFO:teuthology.orchestra.run.trial162.stdout: ms type = async 2026-02-17T11:06:52.947 INFO:teuthology.orchestra.run.trial162.stdout: osd heartbeat grace = 160 2026-02-17T11:06:52.947 INFO:teuthology.orchestra.run.trial162.stdout: osd op thread timeout = 150 2026-02-17T11:06:52.947 INFO:teuthology.orchestra.run.trial162.stdout: fsid = 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:06:52.948 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:52.948 INFO:teuthology.orchestra.run.trial162.stdout:[osd] 2026-02-17T11:06:52.948 INFO:teuthology.orchestra.run.trial162.stdout: osd journal size = 100 2026-02-17T11:06:52.948 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:52.948 INFO:teuthology.orchestra.run.trial162.stdout: osd scrub load threshold = 5.0 2026-02-17T11:06:52.948 INFO:teuthology.orchestra.run.trial162.stdout: osd scrub max interval = 600 2026-02-17T11:06:52.948 INFO:teuthology.orchestra.run.trial162.stdout: osd mclock profile = high_recovery_ops 2026-02-17T11:06:52.948 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:52.948 INFO:teuthology.orchestra.run.trial162.stdout: osd recover clone overlap = true 2026-02-17T11:06:52.948 INFO:teuthology.orchestra.run.trial162.stdout: osd recovery max chunk = 1048576 2026-02-17T11:06:52.948 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:52.948 INFO:teuthology.orchestra.run.trial162.stdout: osd debug shutdown = true 2026-02-17T11:06:52.949 INFO:teuthology.orchestra.run.trial162.stdout: osd debug op order = true 2026-02-17T11:06:52.949 INFO:teuthology.orchestra.run.trial162.stdout: osd debug verify stray on activate = true 2026-02-17T11:06:52.949 INFO:teuthology.orchestra.run.trial162.stdout: osd debug trim objects = true 2026-02-17T11:06:52.949 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:52.949 INFO:teuthology.orchestra.run.trial162.stdout: osd open classes on start = true 2026-02-17T11:06:52.949 INFO:teuthology.orchestra.run.trial162.stdout: osd debug pg log writeout = true 2026-02-17T11:06:52.949 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:52.949 INFO:teuthology.orchestra.run.trial162.stdout: osd deep scrub update digest min age = 30 2026-02-17T11:06:52.949 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:52.949 INFO:teuthology.orchestra.run.trial162.stdout: osd map max advance = 10 2026-02-17T11:06:52.949 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:52.949 INFO:teuthology.orchestra.run.trial162.stdout: journal zero on create = true 2026-02-17T11:06:52.949 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:52.950 INFO:teuthology.orchestra.run.trial162.stdout: filestore ondisk finisher threads = 3 2026-02-17T11:06:52.950 INFO:teuthology.orchestra.run.trial162.stdout: filestore apply finisher threads = 3 2026-02-17T11:06:52.950 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:52.950 INFO:teuthology.orchestra.run.trial162.stdout: bdev debug aio = true 2026-02-17T11:06:52.950 INFO:teuthology.orchestra.run.trial162.stdout: osd debug misdirected ops = true 2026-02-17T11:06:52.950 INFO:teuthology.orchestra.run.trial162.stdout: bdev async discard = True 2026-02-17T11:06:52.950 INFO:teuthology.orchestra.run.trial162.stdout: bdev enable discard = True 2026-02-17T11:06:52.950 INFO:teuthology.orchestra.run.trial162.stdout: bluestore block size = 96636764160 2026-02-17T11:06:52.950 INFO:teuthology.orchestra.run.trial162.stdout: bluestore fsck on mount = True 2026-02-17T11:06:52.950 INFO:teuthology.orchestra.run.trial162.stdout: bluestore zero block detection = True 2026-02-17T11:06:52.950 INFO:teuthology.orchestra.run.trial162.stdout: debug bluefs = 1 2026-02-17T11:06:52.950 INFO:teuthology.orchestra.run.trial162.stdout: debug bluestore = 1 2026-02-17T11:06:52.951 INFO:teuthology.orchestra.run.trial162.stdout: debug monc = 20 2026-02-17T11:06:52.951 INFO:teuthology.orchestra.run.trial162.stdout: debug ms = 1 2026-02-17T11:06:52.951 INFO:teuthology.orchestra.run.trial162.stdout: debug osd = 20 2026-02-17T11:06:52.951 INFO:teuthology.orchestra.run.trial162.stdout: debug rocksdb = 10 2026-02-17T11:06:52.951 INFO:teuthology.orchestra.run.trial162.stdout: mon osd backfillfull_ratio = 0.85 2026-02-17T11:06:52.951 INFO:teuthology.orchestra.run.trial162.stdout: mon osd full ratio = 0.9 2026-02-17T11:06:52.951 INFO:teuthology.orchestra.run.trial162.stdout: mon osd nearfull ratio = 0.8 2026-02-17T11:06:52.951 INFO:teuthology.orchestra.run.trial162.stdout: osd class default list = * 2026-02-17T11:06:52.951 INFO:teuthology.orchestra.run.trial162.stdout: osd class load list = * 2026-02-17T11:06:52.951 INFO:teuthology.orchestra.run.trial162.stdout: osd client watch timeout = 240 2026-02-17T11:06:52.951 INFO:teuthology.orchestra.run.trial162.stdout: osd debug verify cached snaps = True 2026-02-17T11:06:52.951 INFO:teuthology.orchestra.run.trial162.stdout: osd debug verify missing on start = True 2026-02-17T11:06:52.951 INFO:teuthology.orchestra.run.trial162.stdout: osd failsafe full ratio = 0.95 2026-02-17T11:06:52.952 INFO:teuthology.orchestra.run.trial162.stdout: osd fast shutdown = False 2026-02-17T11:06:52.952 INFO:teuthology.orchestra.run.trial162.stdout: osd mclock override recovery settings = True 2026-02-17T11:06:52.952 INFO:teuthology.orchestra.run.trial162.stdout: osd memory target = 1610612736 2026-02-17T11:06:52.952 INFO:teuthology.orchestra.run.trial162.stdout: osd objectstore = bluestore 2026-02-17T11:06:52.952 INFO:teuthology.orchestra.run.trial162.stdout: osd op queue = debug_random 2026-02-17T11:06:52.952 INFO:teuthology.orchestra.run.trial162.stdout: osd op queue cut off = debug_random 2026-02-17T11:06:52.952 INFO:teuthology.orchestra.run.trial162.stdout: osd shutdown pgref assert = True 2026-02-17T11:06:52.952 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:52.952 INFO:teuthology.orchestra.run.trial162.stdout:[mgr] 2026-02-17T11:06:52.952 INFO:teuthology.orchestra.run.trial162.stdout: debug ms = 1 2026-02-17T11:06:52.952 INFO:teuthology.orchestra.run.trial162.stdout: debug mgr = 20 2026-02-17T11:06:52.952 INFO:teuthology.orchestra.run.trial162.stdout: debug mon = 20 2026-02-17T11:06:52.953 INFO:teuthology.orchestra.run.trial162.stdout: debug auth = 20 2026-02-17T11:06:52.953 INFO:teuthology.orchestra.run.trial162.stdout: mon reweight min pgs per osd = 4 2026-02-17T11:06:52.953 INFO:teuthology.orchestra.run.trial162.stdout: mon reweight min bytes per osd = 10 2026-02-17T11:06:52.953 INFO:teuthology.orchestra.run.trial162.stdout: mgr/telemetry/nag = false 2026-02-17T11:06:52.953 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:52.953 INFO:teuthology.orchestra.run.trial162.stdout:[mon] 2026-02-17T11:06:52.953 INFO:teuthology.orchestra.run.trial162.stdout: debug ms = 1 2026-02-17T11:06:52.953 INFO:teuthology.orchestra.run.trial162.stdout: debug mon = 20 2026-02-17T11:06:52.953 INFO:teuthology.orchestra.run.trial162.stdout: debug paxos = 20 2026-02-17T11:06:52.953 INFO:teuthology.orchestra.run.trial162.stdout: debug auth = 20 2026-02-17T11:06:52.953 INFO:teuthology.orchestra.run.trial162.stdout: mon data avail warn = 5 2026-02-17T11:06:52.953 INFO:teuthology.orchestra.run.trial162.stdout: mon mgr mkfs grace = 240 2026-02-17T11:06:52.953 INFO:teuthology.orchestra.run.trial162.stdout: mon reweight min pgs per osd = 4 2026-02-17T11:06:52.954 INFO:teuthology.orchestra.run.trial162.stdout: mon osd reporter subtree level = osd 2026-02-17T11:06:52.954 INFO:teuthology.orchestra.run.trial162.stdout: mon osd prime pg temp = true 2026-02-17T11:06:52.954 INFO:teuthology.orchestra.run.trial162.stdout: mon reweight min bytes per osd = 10 2026-02-17T11:06:52.954 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:52.954 INFO:teuthology.orchestra.run.trial162.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-17T11:06:52.954 INFO:teuthology.orchestra.run.trial162.stdout: auth mon ticket ttl = 660 # 11m 2026-02-17T11:06:52.954 INFO:teuthology.orchestra.run.trial162.stdout: auth service ticket ttl = 240 # 4m 2026-02-17T11:06:52.954 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:52.954 INFO:teuthology.orchestra.run.trial162.stdout: # don't complain about insecure global_id in the test suite 2026-02-17T11:06:52.954 INFO:teuthology.orchestra.run.trial162.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-17T11:06:52.954 INFO:teuthology.orchestra.run.trial162.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-17T11:06:52.955 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:52.955 INFO:teuthology.orchestra.run.trial162.stdout: # 1m isn't quite enough 2026-02-17T11:06:52.955 INFO:teuthology.orchestra.run.trial162.stdout: mon_down_mkfs_grace = 2m 2026-02-17T11:06:52.955 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:52.955 INFO:teuthology.orchestra.run.trial162.stdout: mon_warn_on_filestore_osds = false 2026-02-17T11:06:52.955 INFO:teuthology.orchestra.run.trial162.stdout: mon min osdmap epochs = 50 2026-02-17T11:06:52.955 INFO:teuthology.orchestra.run.trial162.stdout: mon osd crush smoke test = False 2026-02-17T11:06:52.955 INFO:teuthology.orchestra.run.trial162.stdout: mon osdmap full prune interval = 2 2026-02-17T11:06:52.955 INFO:teuthology.orchestra.run.trial162.stdout: mon osdmap full prune min = 15 2026-02-17T11:06:52.955 INFO:teuthology.orchestra.run.trial162.stdout: mon osdmap full prune txsize = 2 2026-02-17T11:06:52.955 INFO:teuthology.orchestra.run.trial162.stdout: mon scrub interval = 300 2026-02-17T11:06:52.955 INFO:teuthology.orchestra.run.trial162.stdout: mon warn on pool no app = False 2026-02-17T11:06:52.956 INFO:teuthology.orchestra.run.trial162.stdout: paxos service trim min = 10 2026-02-17T11:06:52.956 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T11:06:52.956 INFO:teuthology.orchestra.run.trial162.stdout:[client] 2026-02-17T11:06:52.956 INFO:teuthology.orchestra.run.trial162.stdout: rgw cache enabled = true 2026-02-17T11:06:52.956 INFO:teuthology.orchestra.run.trial162.stdout: rgw enable ops log = true 2026-02-17T11:06:52.956 INFO:teuthology.orchestra.run.trial162.stdout: rgw enable usage log = true 2026-02-17T11:06:52.956 INFO:teuthology.orchestra.run.trial162.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-17T11:06:52.956 INFO:teuthology.orchestra.run.trial162.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-17T11:06:52.956 INFO:teuthology.orchestra.run.trial162.stdout: debug monc = 20 2026-02-17T11:06:52.956 INFO:teuthology.orchestra.run.trial162.stdout: debug ms = 1 2026-02-17T11:06:52.956 INFO:teuthology.orchestra.run.trial162.stdout: debug objecter = 20 2026-02-17T11:06:52.956 INFO:teuthology.orchestra.run.trial162.stdout: debug rados = 20 2026-02-17T11:06:52.956 INFO:teuthology.orchestra.run.trial162.stdout:[mon.a] 2026-02-17T11:06:52.957 INFO:teuthology.orchestra.run.trial162.stdout:[mon.b] 2026-02-17T11:06:52.957 INFO:teuthology.orchestra.run.trial162.stdout:[mon.c] 2026-02-17T11:06:52.957 INFO:teuthology.orchestra.run.trial157.stdout:[global] 2026-02-17T11:06:52.957 INFO:teuthology.orchestra.run.trial157.stdout: chdir = "" 2026-02-17T11:06:52.957 INFO:teuthology.orchestra.run.trial157.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-17T11:06:52.957 INFO:teuthology.orchestra.run.trial157.stdout: auth supported = cephx 2026-02-17T11:06:52.957 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:52.957 INFO:teuthology.orchestra.run.trial157.stdout: filestore xattr use omap = true 2026-02-17T11:06:52.957 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:52.958 INFO:teuthology.orchestra.run.trial157.stdout: mon clock drift allowed = 1.000 2026-02-17T11:06:52.958 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:52.958 INFO:teuthology.orchestra.run.trial157.stdout: osd crush chooseleaf type = 0 2026-02-17T11:06:52.958 INFO:teuthology.orchestra.run.trial157.stdout: auth debug = true 2026-02-17T11:06:52.958 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:52.958 INFO:teuthology.orchestra.run.trial157.stdout: ms die on old message = true 2026-02-17T11:06:52.958 INFO:teuthology.orchestra.run.trial157.stdout: ms die on bug = true 2026-02-17T11:06:52.958 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:52.958 INFO:teuthology.orchestra.run.trial157.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-17T11:06:52.958 INFO:teuthology.orchestra.run.trial157.stdout: mon pg warn max object skew = 0 2026-02-17T11:06:52.958 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:52.958 INFO:teuthology.orchestra.run.trial157.stdout: # disable pg_autoscaler by default for new pools 2026-02-17T11:06:52.958 INFO:teuthology.orchestra.run.trial157.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-17T11:06:52.958 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:52.959 INFO:teuthology.orchestra.run.trial157.stdout: osd pool default size = 2 2026-02-17T11:06:52.959 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:52.959 INFO:teuthology.orchestra.run.trial157.stdout: mon osd allow primary affinity = true 2026-02-17T11:06:52.959 INFO:teuthology.orchestra.run.trial157.stdout: mon osd allow pg remap = true 2026-02-17T11:06:52.959 INFO:teuthology.orchestra.run.trial157.stdout: mon warn on legacy crush tunables = false 2026-02-17T11:06:52.959 INFO:teuthology.orchestra.run.trial157.stdout: mon warn on crush straw calc version zero = false 2026-02-17T11:06:52.959 INFO:teuthology.orchestra.run.trial157.stdout: mon warn on no sortbitwise = false 2026-02-17T11:06:52.959 INFO:teuthology.orchestra.run.trial157.stdout: mon warn on osd down out interval zero = false 2026-02-17T11:06:52.959 INFO:teuthology.orchestra.run.trial157.stdout: mon warn on too few osds = false 2026-02-17T11:06:52.959 INFO:teuthology.orchestra.run.trial157.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-17T11:06:52.959 INFO:teuthology.orchestra.run.trial157.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-17T11:06:52.959 INFO:teuthology.orchestra.run.trial157.stdout: mon_allow_pool_size_one = true 2026-02-17T11:06:52.959 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:52.959 INFO:teuthology.orchestra.run.trial157.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-17T11:06:52.960 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:52.960 INFO:teuthology.orchestra.run.trial157.stdout: osd default data pool replay window = 5 2026-02-17T11:06:52.960 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:52.960 INFO:teuthology.orchestra.run.trial157.stdout: mon allow pool delete = true 2026-02-17T11:06:52.960 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:52.960 INFO:teuthology.orchestra.run.trial157.stdout: mon cluster log file level = debug 2026-02-17T11:06:52.960 INFO:teuthology.orchestra.run.trial157.stdout: debug asserts on shutdown = true 2026-02-17T11:06:52.960 INFO:teuthology.orchestra.run.trial157.stdout: mon health detail to clog = false 2026-02-17T11:06:52.960 INFO:teuthology.orchestra.run.trial157.stdout: mon host = "10.20.193.49,10.20.193.97,10.20.193.157" 2026-02-17T11:06:52.960 INFO:teuthology.orchestra.run.trial157.stdout: mon client directed command retry = 5 2026-02-17T11:06:52.960 INFO:teuthology.orchestra.run.trial157.stdout: mon election default strategy = 1 2026-02-17T11:06:52.960 INFO:teuthology.orchestra.run.trial157.stdout: ms inject socket failures = 5000 2026-02-17T11:06:52.960 INFO:teuthology.orchestra.run.trial157.stdout: ms type = async 2026-02-17T11:06:52.961 INFO:teuthology.orchestra.run.trial157.stdout: osd heartbeat grace = 160 2026-02-17T11:06:52.961 INFO:teuthology.orchestra.run.trial157.stdout: osd op thread timeout = 150 2026-02-17T11:06:52.961 INFO:teuthology.orchestra.run.trial157.stdout: fsid = 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:06:52.961 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:52.961 INFO:teuthology.orchestra.run.trial157.stdout:[osd] 2026-02-17T11:06:52.961 INFO:teuthology.orchestra.run.trial157.stdout: osd journal size = 100 2026-02-17T11:06:52.961 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:52.961 INFO:teuthology.orchestra.run.trial157.stdout: osd scrub load threshold = 5.0 2026-02-17T11:06:52.961 INFO:teuthology.orchestra.run.trial157.stdout: osd scrub max interval = 600 2026-02-17T11:06:52.961 INFO:teuthology.orchestra.run.trial157.stdout: osd mclock profile = high_recovery_ops 2026-02-17T11:06:52.961 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:52.961 INFO:teuthology.orchestra.run.trial157.stdout: osd recover clone overlap = true 2026-02-17T11:06:52.961 INFO:teuthology.orchestra.run.trial157.stdout: osd recovery max chunk = 1048576 2026-02-17T11:06:52.961 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:52.961 INFO:teuthology.orchestra.run.trial157.stdout: osd debug shutdown = true 2026-02-17T11:06:52.962 INFO:teuthology.orchestra.run.trial157.stdout: osd debug op order = true 2026-02-17T11:06:52.962 INFO:teuthology.orchestra.run.trial157.stdout: osd debug verify stray on activate = true 2026-02-17T11:06:52.962 INFO:teuthology.orchestra.run.trial157.stdout: osd debug trim objects = true 2026-02-17T11:06:52.962 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:52.962 INFO:teuthology.orchestra.run.trial157.stdout: osd open classes on start = true 2026-02-17T11:06:52.962 INFO:teuthology.orchestra.run.trial157.stdout: osd debug pg log writeout = true 2026-02-17T11:06:52.962 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:52.962 INFO:teuthology.orchestra.run.trial157.stdout: osd deep scrub update digest min age = 30 2026-02-17T11:06:52.962 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:52.962 INFO:teuthology.orchestra.run.trial157.stdout: osd map max advance = 10 2026-02-17T11:06:52.962 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:52.962 INFO:teuthology.orchestra.run.trial157.stdout: journal zero on create = true 2026-02-17T11:06:52.962 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:52.962 INFO:teuthology.orchestra.run.trial157.stdout: filestore ondisk finisher threads = 3 2026-02-17T11:06:52.962 INFO:teuthology.orchestra.run.trial157.stdout: filestore apply finisher threads = 3 2026-02-17T11:06:52.963 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:52.963 INFO:teuthology.orchestra.run.trial157.stdout: bdev debug aio = true 2026-02-17T11:06:52.963 INFO:teuthology.orchestra.run.trial157.stdout: osd debug misdirected ops = true 2026-02-17T11:06:52.963 INFO:teuthology.orchestra.run.trial157.stdout: bdev async discard = True 2026-02-17T11:06:52.963 INFO:teuthology.orchestra.run.trial157.stdout: bdev enable discard = True 2026-02-17T11:06:52.963 INFO:teuthology.orchestra.run.trial157.stdout: bluestore block size = 96636764160 2026-02-17T11:06:52.963 INFO:teuthology.orchestra.run.trial157.stdout: bluestore fsck on mount = True 2026-02-17T11:06:52.963 INFO:teuthology.orchestra.run.trial157.stdout: bluestore zero block detection = True 2026-02-17T11:06:52.963 INFO:teuthology.orchestra.run.trial157.stdout: debug bluefs = 1 2026-02-17T11:06:52.963 INFO:teuthology.orchestra.run.trial157.stdout: debug bluestore = 1 2026-02-17T11:06:52.963 INFO:teuthology.orchestra.run.trial157.stdout: debug monc = 20 2026-02-17T11:06:52.963 INFO:teuthology.orchestra.run.trial157.stdout: debug ms = 1 2026-02-17T11:06:52.963 INFO:teuthology.orchestra.run.trial157.stdout: debug osd = 20 2026-02-17T11:06:52.963 INFO:teuthology.orchestra.run.trial157.stdout: debug rocksdb = 10 2026-02-17T11:06:52.963 INFO:teuthology.orchestra.run.trial157.stdout: mon osd backfillfull_ratio = 0.85 2026-02-17T11:06:52.964 INFO:teuthology.orchestra.run.trial157.stdout: mon osd full ratio = 0.9 2026-02-17T11:06:52.964 INFO:teuthology.orchestra.run.trial157.stdout: mon osd nearfull ratio = 0.8 2026-02-17T11:06:52.964 INFO:teuthology.orchestra.run.trial157.stdout: osd class default list = * 2026-02-17T11:06:52.964 INFO:teuthology.orchestra.run.trial157.stdout: osd class load list = * 2026-02-17T11:06:52.964 INFO:teuthology.orchestra.run.trial157.stdout: osd client watch timeout = 240 2026-02-17T11:06:52.964 INFO:teuthology.orchestra.run.trial157.stdout: osd debug verify cached snaps = True 2026-02-17T11:06:52.964 INFO:teuthology.orchestra.run.trial157.stdout: osd debug verify missing on start = True 2026-02-17T11:06:52.964 INFO:teuthology.orchestra.run.trial157.stdout: osd failsafe full ratio = 0.95 2026-02-17T11:06:52.964 INFO:teuthology.orchestra.run.trial157.stdout: osd fast shutdown = False 2026-02-17T11:06:52.964 INFO:teuthology.orchestra.run.trial157.stdout: osd mclock override recovery settings = True 2026-02-17T11:06:52.964 INFO:teuthology.orchestra.run.trial157.stdout: osd memory target = 1610612736 2026-02-17T11:06:52.964 INFO:teuthology.orchestra.run.trial157.stdout: osd objectstore = bluestore 2026-02-17T11:06:52.964 INFO:teuthology.orchestra.run.trial157.stdout: osd op queue = debug_random 2026-02-17T11:06:52.964 INFO:teuthology.orchestra.run.trial157.stdout: osd op queue cut off = debug_random 2026-02-17T11:06:52.964 INFO:teuthology.orchestra.run.trial157.stdout: osd shutdown pgref assert = True 2026-02-17T11:06:52.964 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:52.965 INFO:teuthology.orchestra.run.trial157.stdout:[mgr] 2026-02-17T11:06:52.965 INFO:teuthology.orchestra.run.trial157.stdout: debug ms = 1 2026-02-17T11:06:52.965 INFO:teuthology.orchestra.run.trial157.stdout: debug mgr = 20 2026-02-17T11:06:52.965 INFO:teuthology.orchestra.run.trial157.stdout: debug mon = 20 2026-02-17T11:06:52.965 INFO:teuthology.orchestra.run.trial157.stdout: debug auth = 20 2026-02-17T11:06:52.965 INFO:teuthology.orchestra.run.trial157.stdout: mon reweight min pgs per osd = 4 2026-02-17T11:06:52.965 INFO:teuthology.orchestra.run.trial157.stdout: mon reweight min bytes per osd = 10 2026-02-17T11:06:52.965 INFO:teuthology.orchestra.run.trial157.stdout: mgr/telemetry/nag = false 2026-02-17T11:06:52.965 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:52.965 INFO:teuthology.orchestra.run.trial157.stdout:[mon] 2026-02-17T11:06:52.965 INFO:teuthology.orchestra.run.trial157.stdout: debug ms = 1 2026-02-17T11:06:52.965 INFO:teuthology.orchestra.run.trial157.stdout: debug mon = 20 2026-02-17T11:06:52.965 INFO:teuthology.orchestra.run.trial157.stdout: debug paxos = 20 2026-02-17T11:06:52.965 INFO:teuthology.orchestra.run.trial157.stdout: debug auth = 20 2026-02-17T11:06:52.965 INFO:teuthology.orchestra.run.trial157.stdout: mon data avail warn = 5 2026-02-17T11:06:52.965 INFO:teuthology.orchestra.run.trial157.stdout: mon mgr mkfs grace = 240 2026-02-17T11:06:52.966 INFO:teuthology.orchestra.run.trial157.stdout: mon reweight min pgs per osd = 4 2026-02-17T11:06:52.966 INFO:teuthology.orchestra.run.trial157.stdout: mon osd reporter subtree level = osd 2026-02-17T11:06:52.966 INFO:teuthology.orchestra.run.trial157.stdout: mon osd prime pg temp = true 2026-02-17T11:06:52.966 INFO:teuthology.orchestra.run.trial157.stdout: mon reweight min bytes per osd = 10 2026-02-17T11:06:52.966 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:52.966 INFO:teuthology.orchestra.run.trial157.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-17T11:06:52.966 INFO:teuthology.orchestra.run.trial157.stdout: auth mon ticket ttl = 660 # 11m 2026-02-17T11:06:52.966 INFO:teuthology.orchestra.run.trial157.stdout: auth service ticket ttl = 240 # 4m 2026-02-17T11:06:52.966 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:52.966 INFO:teuthology.orchestra.run.trial157.stdout: # don't complain about insecure global_id in the test suite 2026-02-17T11:06:52.966 INFO:teuthology.orchestra.run.trial157.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-17T11:06:52.966 INFO:teuthology.orchestra.run.trial157.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-17T11:06:52.966 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:52.966 INFO:teuthology.orchestra.run.trial157.stdout: # 1m isn't quite enough 2026-02-17T11:06:52.966 INFO:teuthology.orchestra.run.trial157.stdout: mon_down_mkfs_grace = 2m 2026-02-17T11:06:52.967 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:52.967 INFO:teuthology.orchestra.run.trial157.stdout: mon_warn_on_filestore_osds = false 2026-02-17T11:06:52.967 INFO:teuthology.orchestra.run.trial157.stdout: mon min osdmap epochs = 50 2026-02-17T11:06:52.967 INFO:teuthology.orchestra.run.trial157.stdout: mon osd crush smoke test = False 2026-02-17T11:06:52.967 INFO:teuthology.orchestra.run.trial157.stdout: mon osdmap full prune interval = 2 2026-02-17T11:06:52.967 INFO:teuthology.orchestra.run.trial157.stdout: mon osdmap full prune min = 15 2026-02-17T11:06:52.967 INFO:teuthology.orchestra.run.trial157.stdout: mon osdmap full prune txsize = 2 2026-02-17T11:06:52.967 INFO:teuthology.orchestra.run.trial157.stdout: mon scrub interval = 300 2026-02-17T11:06:52.967 INFO:teuthology.orchestra.run.trial157.stdout: mon warn on pool no app = False 2026-02-17T11:06:52.967 INFO:teuthology.orchestra.run.trial157.stdout: paxos service trim min = 10 2026-02-17T11:06:52.967 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-17T11:06:52.967 INFO:teuthology.orchestra.run.trial157.stdout:[client] 2026-02-17T11:06:52.967 INFO:teuthology.orchestra.run.trial157.stdout: rgw cache enabled = true 2026-02-17T11:06:52.967 INFO:teuthology.orchestra.run.trial157.stdout: rgw enable ops log = true 2026-02-17T11:06:52.967 INFO:teuthology.orchestra.run.trial157.stdout: rgw enable usage log = true 2026-02-17T11:06:52.967 INFO:teuthology.orchestra.run.trial157.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-17T11:06:52.967 INFO:teuthology.orchestra.run.trial157.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-17T11:06:52.968 INFO:teuthology.orchestra.run.trial157.stdout: debug monc = 20 2026-02-17T11:06:52.968 INFO:teuthology.orchestra.run.trial157.stdout: debug ms = 1 2026-02-17T11:06:52.968 INFO:teuthology.orchestra.run.trial157.stdout: debug objecter = 20 2026-02-17T11:06:52.968 INFO:teuthology.orchestra.run.trial157.stdout: debug rados = 20 2026-02-17T11:06:52.968 INFO:teuthology.orchestra.run.trial157.stdout:[mon.a] 2026-02-17T11:06:52.968 INFO:teuthology.orchestra.run.trial157.stdout:[mon.b] 2026-02-17T11:06:52.968 INFO:teuthology.orchestra.run.trial157.stdout:[mon.c] 2026-02-17T11:06:52.969 INFO:teuthology.orchestra.run.trial097.stdout:[global] 2026-02-17T11:06:52.969 INFO:teuthology.orchestra.run.trial097.stdout: chdir = "" 2026-02-17T11:06:52.969 INFO:teuthology.orchestra.run.trial097.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-17T11:06:52.969 INFO:teuthology.orchestra.run.trial097.stdout: auth supported = cephx 2026-02-17T11:06:52.969 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:52.970 INFO:teuthology.orchestra.run.trial097.stdout: filestore xattr use omap = true 2026-02-17T11:06:52.970 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:52.970 INFO:teuthology.orchestra.run.trial097.stdout: mon clock drift allowed = 1.000 2026-02-17T11:06:52.970 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:52.970 INFO:teuthology.orchestra.run.trial097.stdout: osd crush chooseleaf type = 0 2026-02-17T11:06:52.970 INFO:teuthology.orchestra.run.trial097.stdout: auth debug = true 2026-02-17T11:06:52.970 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:52.970 INFO:teuthology.orchestra.run.trial097.stdout: ms die on old message = true 2026-02-17T11:06:52.970 INFO:teuthology.orchestra.run.trial097.stdout: ms die on bug = true 2026-02-17T11:06:52.970 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:52.970 INFO:teuthology.orchestra.run.trial097.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-17T11:06:52.970 INFO:teuthology.orchestra.run.trial097.stdout: mon pg warn max object skew = 0 2026-02-17T11:06:52.970 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:52.970 INFO:teuthology.orchestra.run.trial097.stdout: # disable pg_autoscaler by default for new pools 2026-02-17T11:06:52.970 INFO:teuthology.orchestra.run.trial097.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-17T11:06:52.970 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:52.971 INFO:teuthology.orchestra.run.trial097.stdout: osd pool default size = 2 2026-02-17T11:06:52.971 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:52.971 INFO:teuthology.orchestra.run.trial097.stdout: mon osd allow primary affinity = true 2026-02-17T11:06:52.971 INFO:teuthology.orchestra.run.trial097.stdout: mon osd allow pg remap = true 2026-02-17T11:06:52.971 INFO:teuthology.orchestra.run.trial097.stdout: mon warn on legacy crush tunables = false 2026-02-17T11:06:52.971 INFO:teuthology.orchestra.run.trial097.stdout: mon warn on crush straw calc version zero = false 2026-02-17T11:06:52.971 INFO:teuthology.orchestra.run.trial097.stdout: mon warn on no sortbitwise = false 2026-02-17T11:06:52.971 INFO:teuthology.orchestra.run.trial097.stdout: mon warn on osd down out interval zero = false 2026-02-17T11:06:52.971 INFO:teuthology.orchestra.run.trial097.stdout: mon warn on too few osds = false 2026-02-17T11:06:52.971 INFO:teuthology.orchestra.run.trial097.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-17T11:06:52.971 INFO:teuthology.orchestra.run.trial097.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-17T11:06:52.971 INFO:teuthology.orchestra.run.trial097.stdout: mon_allow_pool_size_one = true 2026-02-17T11:06:52.971 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:52.971 INFO:teuthology.orchestra.run.trial097.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-17T11:06:52.971 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:52.971 INFO:teuthology.orchestra.run.trial097.stdout: osd default data pool replay window = 5 2026-02-17T11:06:52.971 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:52.971 INFO:teuthology.orchestra.run.trial097.stdout: mon allow pool delete = true 2026-02-17T11:06:52.972 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:52.972 INFO:teuthology.orchestra.run.trial097.stdout: mon cluster log file level = debug 2026-02-17T11:06:52.972 INFO:teuthology.orchestra.run.trial097.stdout: debug asserts on shutdown = true 2026-02-17T11:06:52.972 INFO:teuthology.orchestra.run.trial097.stdout: mon health detail to clog = false 2026-02-17T11:06:52.972 INFO:teuthology.orchestra.run.trial097.stdout: mon host = "10.20.193.49,10.20.193.97,10.20.193.157" 2026-02-17T11:06:52.972 INFO:teuthology.orchestra.run.trial097.stdout: mon client directed command retry = 5 2026-02-17T11:06:52.972 INFO:teuthology.orchestra.run.trial097.stdout: mon election default strategy = 1 2026-02-17T11:06:52.972 INFO:teuthology.orchestra.run.trial097.stdout: ms inject socket failures = 5000 2026-02-17T11:06:52.972 INFO:teuthology.orchestra.run.trial097.stdout: ms type = async 2026-02-17T11:06:52.972 INFO:teuthology.orchestra.run.trial097.stdout: osd heartbeat grace = 160 2026-02-17T11:06:52.972 INFO:teuthology.orchestra.run.trial097.stdout: osd op thread timeout = 150 2026-02-17T11:06:52.972 INFO:teuthology.orchestra.run.trial097.stdout: fsid = 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:06:52.972 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:52.972 INFO:teuthology.orchestra.run.trial097.stdout:[osd] 2026-02-17T11:06:52.973 INFO:teuthology.orchestra.run.trial097.stdout: osd journal size = 100 2026-02-17T11:06:52.973 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:52.973 INFO:teuthology.orchestra.run.trial097.stdout: osd scrub load threshold = 5.0 2026-02-17T11:06:52.973 INFO:teuthology.orchestra.run.trial097.stdout: osd scrub max interval = 600 2026-02-17T11:06:52.973 INFO:teuthology.orchestra.run.trial097.stdout: osd mclock profile = high_recovery_ops 2026-02-17T11:06:52.973 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:52.973 INFO:teuthology.orchestra.run.trial097.stdout: osd recover clone overlap = true 2026-02-17T11:06:52.973 INFO:teuthology.orchestra.run.trial097.stdout: osd recovery max chunk = 1048576 2026-02-17T11:06:52.973 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:52.973 INFO:teuthology.orchestra.run.trial097.stdout: osd debug shutdown = true 2026-02-17T11:06:52.973 INFO:teuthology.orchestra.run.trial097.stdout: osd debug op order = true 2026-02-17T11:06:52.973 INFO:teuthology.orchestra.run.trial097.stdout: osd debug verify stray on activate = true 2026-02-17T11:06:52.973 INFO:teuthology.orchestra.run.trial097.stdout: osd debug trim objects = true 2026-02-17T11:06:52.973 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:52.973 INFO:teuthology.orchestra.run.trial097.stdout: osd open classes on start = true 2026-02-17T11:06:52.973 INFO:teuthology.orchestra.run.trial097.stdout: osd debug pg log writeout = true 2026-02-17T11:06:52.973 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:52.973 INFO:teuthology.orchestra.run.trial097.stdout: osd deep scrub update digest min age = 30 2026-02-17T11:06:52.974 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:52.974 INFO:teuthology.orchestra.run.trial097.stdout: osd map max advance = 10 2026-02-17T11:06:52.974 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:52.974 INFO:teuthology.orchestra.run.trial097.stdout: journal zero on create = true 2026-02-17T11:06:52.974 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:52.974 INFO:teuthology.orchestra.run.trial097.stdout: filestore ondisk finisher threads = 3 2026-02-17T11:06:52.974 INFO:teuthology.orchestra.run.trial097.stdout: filestore apply finisher threads = 3 2026-02-17T11:06:52.974 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:52.974 INFO:teuthology.orchestra.run.trial097.stdout: bdev debug aio = true 2026-02-17T11:06:52.974 INFO:teuthology.orchestra.run.trial097.stdout: osd debug misdirected ops = true 2026-02-17T11:06:52.974 INFO:teuthology.orchestra.run.trial097.stdout: bdev async discard = True 2026-02-17T11:06:52.974 INFO:teuthology.orchestra.run.trial097.stdout: bdev enable discard = True 2026-02-17T11:06:52.974 INFO:teuthology.orchestra.run.trial097.stdout: bluestore block size = 96636764160 2026-02-17T11:06:52.974 INFO:teuthology.orchestra.run.trial097.stdout: bluestore fsck on mount = True 2026-02-17T11:06:52.974 INFO:teuthology.orchestra.run.trial097.stdout: bluestore zero block detection = True 2026-02-17T11:06:52.974 INFO:teuthology.orchestra.run.trial097.stdout: debug bluefs = 1 2026-02-17T11:06:52.974 INFO:teuthology.orchestra.run.trial097.stdout: debug bluestore = 1 2026-02-17T11:06:52.974 INFO:teuthology.orchestra.run.trial097.stdout: debug monc = 20 2026-02-17T11:06:52.974 INFO:teuthology.orchestra.run.trial097.stdout: debug ms = 1 2026-02-17T11:06:52.974 INFO:teuthology.orchestra.run.trial097.stdout: debug osd = 20 2026-02-17T11:06:52.974 INFO:teuthology.orchestra.run.trial097.stdout: debug rocksdb = 10 2026-02-17T11:06:52.975 INFO:teuthology.orchestra.run.trial097.stdout: mon osd backfillfull_ratio = 0.85 2026-02-17T11:06:52.975 INFO:teuthology.orchestra.run.trial097.stdout: mon osd full ratio = 0.9 2026-02-17T11:06:52.975 INFO:teuthology.orchestra.run.trial097.stdout: mon osd nearfull ratio = 0.8 2026-02-17T11:06:52.975 INFO:teuthology.orchestra.run.trial097.stdout: osd class default list = * 2026-02-17T11:06:52.975 INFO:teuthology.orchestra.run.trial097.stdout: osd class load list = * 2026-02-17T11:06:52.975 INFO:teuthology.orchestra.run.trial097.stdout: osd client watch timeout = 240 2026-02-17T11:06:52.975 INFO:teuthology.orchestra.run.trial097.stdout: osd debug verify cached snaps = True 2026-02-17T11:06:52.975 INFO:teuthology.orchestra.run.trial097.stdout: osd debug verify missing on start = True 2026-02-17T11:06:52.975 INFO:teuthology.orchestra.run.trial097.stdout: osd failsafe full ratio = 0.95 2026-02-17T11:06:52.975 INFO:teuthology.orchestra.run.trial097.stdout: osd fast shutdown = False 2026-02-17T11:06:52.975 INFO:teuthology.orchestra.run.trial097.stdout: osd mclock override recovery settings = True 2026-02-17T11:06:52.975 INFO:teuthology.orchestra.run.trial097.stdout: osd memory target = 1610612736 2026-02-17T11:06:52.975 INFO:teuthology.orchestra.run.trial097.stdout: osd objectstore = bluestore 2026-02-17T11:06:52.975 INFO:teuthology.orchestra.run.trial097.stdout: osd op queue = debug_random 2026-02-17T11:06:52.975 INFO:teuthology.orchestra.run.trial097.stdout: osd op queue cut off = debug_random 2026-02-17T11:06:52.975 INFO:teuthology.orchestra.run.trial097.stdout: osd shutdown pgref assert = True 2026-02-17T11:06:52.975 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:52.975 INFO:teuthology.orchestra.run.trial097.stdout:[mgr] 2026-02-17T11:06:52.975 INFO:teuthology.orchestra.run.trial097.stdout: debug ms = 1 2026-02-17T11:06:52.975 INFO:teuthology.orchestra.run.trial097.stdout: debug mgr = 20 2026-02-17T11:06:52.976 INFO:teuthology.orchestra.run.trial097.stdout: debug mon = 20 2026-02-17T11:06:52.976 INFO:teuthology.orchestra.run.trial097.stdout: debug auth = 20 2026-02-17T11:06:52.976 INFO:teuthology.orchestra.run.trial097.stdout: mon reweight min pgs per osd = 4 2026-02-17T11:06:52.976 INFO:teuthology.orchestra.run.trial097.stdout: mon reweight min bytes per osd = 10 2026-02-17T11:06:52.976 INFO:teuthology.orchestra.run.trial097.stdout: mgr/telemetry/nag = false 2026-02-17T11:06:52.976 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:52.976 INFO:teuthology.orchestra.run.trial097.stdout:[mon] 2026-02-17T11:06:52.976 INFO:teuthology.orchestra.run.trial097.stdout: debug ms = 1 2026-02-17T11:06:52.976 INFO:teuthology.orchestra.run.trial097.stdout: debug mon = 20 2026-02-17T11:06:52.976 INFO:teuthology.orchestra.run.trial097.stdout: debug paxos = 20 2026-02-17T11:06:52.976 INFO:teuthology.orchestra.run.trial097.stdout: debug auth = 20 2026-02-17T11:06:52.976 INFO:teuthology.orchestra.run.trial097.stdout: mon data avail warn = 5 2026-02-17T11:06:52.976 INFO:teuthology.orchestra.run.trial097.stdout: mon mgr mkfs grace = 240 2026-02-17T11:06:52.976 INFO:teuthology.orchestra.run.trial097.stdout: mon reweight min pgs per osd = 4 2026-02-17T11:06:52.976 INFO:teuthology.orchestra.run.trial097.stdout: mon osd reporter subtree level = osd 2026-02-17T11:06:52.976 INFO:teuthology.orchestra.run.trial097.stdout: mon osd prime pg temp = true 2026-02-17T11:06:52.976 INFO:teuthology.orchestra.run.trial097.stdout: mon reweight min bytes per osd = 10 2026-02-17T11:06:52.976 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:52.976 INFO:teuthology.orchestra.run.trial097.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-17T11:06:52.976 INFO:teuthology.orchestra.run.trial097.stdout: auth mon ticket ttl = 660 # 11m 2026-02-17T11:06:52.976 INFO:teuthology.orchestra.run.trial097.stdout: auth service ticket ttl = 240 # 4m 2026-02-17T11:06:52.977 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:52.977 INFO:teuthology.orchestra.run.trial097.stdout: # don't complain about insecure global_id in the test suite 2026-02-17T11:06:52.977 INFO:teuthology.orchestra.run.trial097.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-17T11:06:52.977 INFO:teuthology.orchestra.run.trial097.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-17T11:06:52.977 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:52.977 INFO:teuthology.orchestra.run.trial097.stdout: # 1m isn't quite enough 2026-02-17T11:06:52.977 INFO:teuthology.orchestra.run.trial097.stdout: mon_down_mkfs_grace = 2m 2026-02-17T11:06:52.977 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:52.977 INFO:teuthology.orchestra.run.trial097.stdout: mon_warn_on_filestore_osds = false 2026-02-17T11:06:52.977 INFO:teuthology.orchestra.run.trial097.stdout: mon min osdmap epochs = 50 2026-02-17T11:06:52.977 INFO:teuthology.orchestra.run.trial097.stdout: mon osd crush smoke test = False 2026-02-17T11:06:52.977 INFO:teuthology.orchestra.run.trial097.stdout: mon osdmap full prune interval = 2 2026-02-17T11:06:52.977 INFO:teuthology.orchestra.run.trial097.stdout: mon osdmap full prune min = 15 2026-02-17T11:06:52.977 INFO:teuthology.orchestra.run.trial097.stdout: mon osdmap full prune txsize = 2 2026-02-17T11:06:52.977 INFO:teuthology.orchestra.run.trial097.stdout: mon scrub interval = 300 2026-02-17T11:06:52.977 INFO:teuthology.orchestra.run.trial097.stdout: mon warn on pool no app = False 2026-02-17T11:06:52.977 INFO:teuthology.orchestra.run.trial097.stdout: paxos service trim min = 10 2026-02-17T11:06:52.977 INFO:teuthology.orchestra.run.trial097.stdout: 2026-02-17T11:06:52.977 INFO:teuthology.orchestra.run.trial097.stdout:[client] 2026-02-17T11:06:52.977 INFO:teuthology.orchestra.run.trial097.stdout: rgw cache enabled = true 2026-02-17T11:06:52.977 INFO:teuthology.orchestra.run.trial097.stdout: rgw enable ops log = true 2026-02-17T11:06:52.977 INFO:teuthology.orchestra.run.trial097.stdout: rgw enable usage log = true 2026-02-17T11:06:52.978 INFO:teuthology.orchestra.run.trial097.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-17T11:06:52.978 INFO:teuthology.orchestra.run.trial097.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-17T11:06:52.978 INFO:teuthology.orchestra.run.trial097.stdout: debug monc = 20 2026-02-17T11:06:52.978 INFO:teuthology.orchestra.run.trial097.stdout: debug ms = 1 2026-02-17T11:06:52.978 INFO:teuthology.orchestra.run.trial097.stdout: debug objecter = 20 2026-02-17T11:06:52.978 INFO:teuthology.orchestra.run.trial097.stdout: debug rados = 20 2026-02-17T11:06:52.978 INFO:teuthology.orchestra.run.trial097.stdout:[mon.a] 2026-02-17T11:06:52.978 INFO:teuthology.orchestra.run.trial097.stdout:[mon.b] 2026-02-17T11:06:52.978 INFO:teuthology.orchestra.run.trial097.stdout:[mon.c] 2026-02-17T11:06:52.979 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-17T11:06:52.979 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-17T11:06:53.053 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-17T11:06:53.053 DEBUG:teuthology.orchestra.run.trial049:> set -ex 2026-02-17T11:06:53.053 DEBUG:teuthology.orchestra.run.trial049:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-17T11:06:53.110 DEBUG:teuthology.orchestra.run.trial049:> set -ex 2026-02-17T11:06:53.110 DEBUG:teuthology.orchestra.run.trial049:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-17T11:06:53.165 INFO:tasks.ceph:Sending monmap to node ubuntu@trial049.front.sepia.ceph.com 2026-02-17T11:06:53.166 DEBUG:teuthology.orchestra.run.trial049:> set -ex 2026-02-17T11:06:53.166 DEBUG:teuthology.orchestra.run.trial049:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-17T11:06:53.166 DEBUG:teuthology.orchestra.run.trial049:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T11:06:53.237 DEBUG:teuthology.orchestra.run.trial049:> set -ex 2026-02-17T11:06:53.238 DEBUG:teuthology.orchestra.run.trial049:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:06:53.293 INFO:tasks.ceph:Sending monmap to node ubuntu@trial097.front.sepia.ceph.com 2026-02-17T11:06:53.293 DEBUG:teuthology.orchestra.run.trial097:> set -ex 2026-02-17T11:06:53.293 DEBUG:teuthology.orchestra.run.trial097:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-17T11:06:53.293 DEBUG:teuthology.orchestra.run.trial097:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T11:06:53.328 DEBUG:teuthology.orchestra.run.trial097:> set -ex 2026-02-17T11:06:53.328 DEBUG:teuthology.orchestra.run.trial097:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:06:53.384 INFO:tasks.ceph:Sending monmap to node ubuntu@trial157.front.sepia.ceph.com 2026-02-17T11:06:53.384 DEBUG:teuthology.orchestra.run.trial157:> set -ex 2026-02-17T11:06:53.384 DEBUG:teuthology.orchestra.run.trial157:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-17T11:06:53.384 DEBUG:teuthology.orchestra.run.trial157:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T11:06:53.418 DEBUG:teuthology.orchestra.run.trial157:> set -ex 2026-02-17T11:06:53.418 DEBUG:teuthology.orchestra.run.trial157:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:06:53.475 INFO:tasks.ceph:Sending monmap to node ubuntu@trial162.front.sepia.ceph.com 2026-02-17T11:06:53.475 DEBUG:teuthology.orchestra.run.trial162:> set -ex 2026-02-17T11:06:53.476 DEBUG:teuthology.orchestra.run.trial162:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-17T11:06:53.476 DEBUG:teuthology.orchestra.run.trial162:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T11:06:53.510 DEBUG:teuthology.orchestra.run.trial162:> set -ex 2026-02-17T11:06:53.510 DEBUG:teuthology.orchestra.run.trial162:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:06:53.566 INFO:tasks.ceph:Setting up mon nodes... 2026-02-17T11:06:53.567 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-17T11:06:53.567 DEBUG:teuthology.orchestra.run.trial049:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2026-02-17T11:06:53.610 INFO:teuthology.orchestra.run.trial049.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2026-02-17T11:06:53.613 DEBUG:teuthology.orchestra.run.trial162:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-17T11:06:53.656 INFO:teuthology.orchestra.run.trial162.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-17T11:06:53.660 INFO:tasks.ceph:Setting up mds nodes... 2026-02-17T11:06:53.660 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-17T11:06:53.661 DEBUG:teuthology.orchestra.run.trial162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-17T11:06:53.733 INFO:teuthology.orchestra.run.trial162.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-17T11:06:53.743 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-17T11:06:53.744 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial049.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial097.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial157.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial162.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'}} 2026-02-17T11:06:53.744 DEBUG:teuthology.orchestra.run.trial049:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-17T11:06:53.769 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-17T11:06:53.769 INFO:tasks.ceph:role: osd.0 2026-02-17T11:06:53.769 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial049.front.sepia.ceph.com 2026-02-17T11:06:53.770 DEBUG:teuthology.orchestra.run.trial049:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-17T11:06:53.834 INFO:teuthology.orchestra.run.trial049.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T11:06:53.834 INFO:teuthology.orchestra.run.trial049.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T11:06:53.834 INFO:teuthology.orchestra.run.trial049.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T11:06:53.834 INFO:teuthology.orchestra.run.trial049.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T11:06:53.834 INFO:teuthology.orchestra.run.trial049.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T11:06:53.834 INFO:teuthology.orchestra.run.trial049.stdout: = sunit=0 swidth=0 blks 2026-02-17T11:06:53.835 INFO:teuthology.orchestra.run.trial049.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T11:06:53.835 INFO:teuthology.orchestra.run.trial049.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T11:06:53.835 INFO:teuthology.orchestra.run.trial049.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T11:06:53.835 INFO:teuthology.orchestra.run.trial049.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T11:06:54.411 INFO:teuthology.orchestra.run.trial049.stdout:Discarding blocks...Done. 2026-02-17T11:06:54.413 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial049.front.sepia.ceph.com -o noatime 2026-02-17T11:06:54.414 DEBUG:teuthology.orchestra.run.trial049:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-17T11:06:54.483 DEBUG:teuthology.orchestra.run.trial049:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-17T11:06:54.549 DEBUG:teuthology.orchestra.run.trial049:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2026-02-17T11:06:54.613 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-17T11:06:54.613 INFO:tasks.ceph:role: osd.4 2026-02-17T11:06:54.613 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial049.front.sepia.ceph.com 2026-02-17T11:06:54.613 DEBUG:teuthology.orchestra.run.trial049:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-17T11:06:54.677 INFO:teuthology.orchestra.run.trial049.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T11:06:54.678 INFO:teuthology.orchestra.run.trial049.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T11:06:54.678 INFO:teuthology.orchestra.run.trial049.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T11:06:54.678 INFO:teuthology.orchestra.run.trial049.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T11:06:54.678 INFO:teuthology.orchestra.run.trial049.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T11:06:54.678 INFO:teuthology.orchestra.run.trial049.stdout: = sunit=0 swidth=0 blks 2026-02-17T11:06:54.678 INFO:teuthology.orchestra.run.trial049.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T11:06:54.678 INFO:teuthology.orchestra.run.trial049.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T11:06:54.678 INFO:teuthology.orchestra.run.trial049.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T11:06:54.679 INFO:teuthology.orchestra.run.trial049.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T11:06:55.237 INFO:teuthology.orchestra.run.trial049.stdout:Discarding blocks...Done. 2026-02-17T11:06:55.239 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial049.front.sepia.ceph.com -o noatime 2026-02-17T11:06:55.239 DEBUG:teuthology.orchestra.run.trial049:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2026-02-17T11:06:55.307 DEBUG:teuthology.orchestra.run.trial049:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2026-02-17T11:06:55.372 DEBUG:teuthology.orchestra.run.trial049:> sudo mkdir -p /var/lib/ceph/osd/ceph-8 2026-02-17T11:06:55.437 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-17T11:06:55.437 INFO:tasks.ceph:role: osd.8 2026-02-17T11:06:55.437 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial049.front.sepia.ceph.com 2026-02-17T11:06:55.437 DEBUG:teuthology.orchestra.run.trial049:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-17T11:06:55.501 INFO:teuthology.orchestra.run.trial049.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T11:06:55.501 INFO:teuthology.orchestra.run.trial049.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T11:06:55.501 INFO:teuthology.orchestra.run.trial049.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T11:06:55.501 INFO:teuthology.orchestra.run.trial049.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T11:06:55.501 INFO:teuthology.orchestra.run.trial049.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T11:06:55.502 INFO:teuthology.orchestra.run.trial049.stdout: = sunit=0 swidth=0 blks 2026-02-17T11:06:55.502 INFO:teuthology.orchestra.run.trial049.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T11:06:55.502 INFO:teuthology.orchestra.run.trial049.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T11:06:55.502 INFO:teuthology.orchestra.run.trial049.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T11:06:55.502 INFO:teuthology.orchestra.run.trial049.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T11:06:56.063 INFO:teuthology.orchestra.run.trial049.stdout:Discarding blocks...Done. 2026-02-17T11:06:56.065 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial049.front.sepia.ceph.com -o noatime 2026-02-17T11:06:56.065 DEBUG:teuthology.orchestra.run.trial049:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-8 2026-02-17T11:06:56.132 DEBUG:teuthology.orchestra.run.trial049:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-8 2026-02-17T11:06:56.199 DEBUG:teuthology.orchestra.run.trial049:> sudo mkdir -p /var/lib/ceph/osd/ceph-12 2026-02-17T11:06:56.262 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-17T11:06:56.262 INFO:tasks.ceph:role: osd.12 2026-02-17T11:06:56.263 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial049.front.sepia.ceph.com 2026-02-17T11:06:56.263 DEBUG:teuthology.orchestra.run.trial049:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-17T11:06:56.329 INFO:teuthology.orchestra.run.trial049.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T11:06:56.329 INFO:teuthology.orchestra.run.trial049.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T11:06:56.329 INFO:teuthology.orchestra.run.trial049.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T11:06:56.329 INFO:teuthology.orchestra.run.trial049.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T11:06:56.329 INFO:teuthology.orchestra.run.trial049.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T11:06:56.329 INFO:teuthology.orchestra.run.trial049.stdout: = sunit=0 swidth=0 blks 2026-02-17T11:06:56.330 INFO:teuthology.orchestra.run.trial049.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T11:06:56.330 INFO:teuthology.orchestra.run.trial049.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T11:06:56.330 INFO:teuthology.orchestra.run.trial049.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T11:06:56.330 INFO:teuthology.orchestra.run.trial049.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T11:06:56.883 INFO:teuthology.orchestra.run.trial049.stdout:Discarding blocks...Done. 2026-02-17T11:06:56.884 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial049.front.sepia.ceph.com -o noatime 2026-02-17T11:06:56.884 DEBUG:teuthology.orchestra.run.trial049:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-12 2026-02-17T11:06:56.961 DEBUG:teuthology.orchestra.run.trial049:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-12 2026-02-17T11:06:57.030 DEBUG:teuthology.orchestra.run.trial049:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:06:57.107 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:06:57.105+0000 7f69d0811780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2026-02-17T11:06:57.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:06:57.105+0000 7f69d0811780 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2026-02-17T11:06:57.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:06:57.106+0000 7f69d0811780 -1 bdev(0x5601a0443800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2026-02-17T11:06:57.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:06:57.106+0000 7f69d0811780 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2026-02-17T11:07:00.987 DEBUG:teuthology.orchestra.run.trial049:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-17T11:07:01.051 DEBUG:teuthology.orchestra.run.trial049:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:07:01.128 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:07:01.125+0000 7feec8e27780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2026-02-17T11:07:01.128 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:07:01.125+0000 7feec8e27780 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2026-02-17T11:07:01.128 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:07:01.125+0000 7feec8e27780 -1 bdev(0x55e5198af800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2026-02-17T11:07:01.128 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:07:01.126+0000 7feec8e27780 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2026-02-17T11:07:05.013 DEBUG:teuthology.orchestra.run.trial049:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2026-02-17T11:07:05.078 DEBUG:teuthology.orchestra.run.trial049:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 8 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:07:05.155 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:07:05.154+0000 7f8782299780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-8/keyring: can't open /var/lib/ceph/osd/ceph-8/keyring: (2) No such file or directory 2026-02-17T11:07:05.156 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:07:05.154+0000 7f8782299780 -1 created new key in keyring /var/lib/ceph/osd/ceph-8/keyring 2026-02-17T11:07:05.156 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:07:05.154+0000 7f8782299780 -1 bdev(0x55f9cdc7b800 /var/lib/ceph/osd/ceph-8/block) open stat got: (1) Operation not permitted 2026-02-17T11:07:05.156 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:07:05.154+0000 7f8782299780 -1 bluestore(/var/lib/ceph/osd/ceph-8) _read_fsid unparsable uuid 2026-02-17T11:07:09.037 DEBUG:teuthology.orchestra.run.trial049:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-8 2026-02-17T11:07:09.102 DEBUG:teuthology.orchestra.run.trial049:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 12 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:07:09.182 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:07:09.180+0000 7f1a2f4e9780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-12/keyring: can't open /var/lib/ceph/osd/ceph-12/keyring: (2) No such file or directory 2026-02-17T11:07:09.182 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:07:09.180+0000 7f1a2f4e9780 -1 created new key in keyring /var/lib/ceph/osd/ceph-12/keyring 2026-02-17T11:07:09.182 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:07:09.180+0000 7f1a2f4e9780 -1 bdev(0x557aa4439800 /var/lib/ceph/osd/ceph-12/block) open stat got: (1) Operation not permitted 2026-02-17T11:07:09.182 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:07:09.180+0000 7f1a2f4e9780 -1 bluestore(/var/lib/ceph/osd/ceph-12) _read_fsid unparsable uuid 2026-02-17T11:07:13.071 DEBUG:teuthology.orchestra.run.trial049:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-12 2026-02-17T11:07:13.135 DEBUG:teuthology.orchestra.run.trial097:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-17T11:07:13.160 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-17T11:07:13.160 INFO:tasks.ceph:role: osd.1 2026-02-17T11:07:13.160 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial097.front.sepia.ceph.com 2026-02-17T11:07:13.160 DEBUG:teuthology.orchestra.run.trial097:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-17T11:07:13.226 INFO:teuthology.orchestra.run.trial097.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T11:07:13.226 INFO:teuthology.orchestra.run.trial097.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T11:07:13.226 INFO:teuthology.orchestra.run.trial097.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T11:07:13.226 INFO:teuthology.orchestra.run.trial097.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T11:07:13.226 INFO:teuthology.orchestra.run.trial097.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T11:07:13.226 INFO:teuthology.orchestra.run.trial097.stdout: = sunit=0 swidth=0 blks 2026-02-17T11:07:13.226 INFO:teuthology.orchestra.run.trial097.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T11:07:13.227 INFO:teuthology.orchestra.run.trial097.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T11:07:13.227 INFO:teuthology.orchestra.run.trial097.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T11:07:13.227 INFO:teuthology.orchestra.run.trial097.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T11:07:13.794 INFO:teuthology.orchestra.run.trial097.stdout:Discarding blocks...Done. 2026-02-17T11:07:13.796 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial097.front.sepia.ceph.com -o noatime 2026-02-17T11:07:13.796 DEBUG:teuthology.orchestra.run.trial097:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2026-02-17T11:07:13.868 DEBUG:teuthology.orchestra.run.trial097:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-17T11:07:13.938 DEBUG:teuthology.orchestra.run.trial097:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2026-02-17T11:07:14.002 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-17T11:07:14.002 INFO:tasks.ceph:role: osd.5 2026-02-17T11:07:14.002 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial097.front.sepia.ceph.com 2026-02-17T11:07:14.003 DEBUG:teuthology.orchestra.run.trial097:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-17T11:07:14.066 INFO:teuthology.orchestra.run.trial097.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T11:07:14.067 INFO:teuthology.orchestra.run.trial097.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T11:07:14.067 INFO:teuthology.orchestra.run.trial097.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T11:07:14.067 INFO:teuthology.orchestra.run.trial097.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T11:07:14.067 INFO:teuthology.orchestra.run.trial097.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T11:07:14.067 INFO:teuthology.orchestra.run.trial097.stdout: = sunit=0 swidth=0 blks 2026-02-17T11:07:14.067 INFO:teuthology.orchestra.run.trial097.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T11:07:14.067 INFO:teuthology.orchestra.run.trial097.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T11:07:14.067 INFO:teuthology.orchestra.run.trial097.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T11:07:14.067 INFO:teuthology.orchestra.run.trial097.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T11:07:14.633 INFO:teuthology.orchestra.run.trial097.stdout:Discarding blocks...Done. 2026-02-17T11:07:14.635 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial097.front.sepia.ceph.com -o noatime 2026-02-17T11:07:14.635 DEBUG:teuthology.orchestra.run.trial097:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2026-02-17T11:07:14.705 DEBUG:teuthology.orchestra.run.trial097:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2026-02-17T11:07:14.771 DEBUG:teuthology.orchestra.run.trial097:> sudo mkdir -p /var/lib/ceph/osd/ceph-9 2026-02-17T11:07:14.836 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-17T11:07:14.836 INFO:tasks.ceph:role: osd.9 2026-02-17T11:07:14.836 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial097.front.sepia.ceph.com 2026-02-17T11:07:14.836 DEBUG:teuthology.orchestra.run.trial097:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-17T11:07:14.901 INFO:teuthology.orchestra.run.trial097.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T11:07:14.901 INFO:teuthology.orchestra.run.trial097.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T11:07:14.902 INFO:teuthology.orchestra.run.trial097.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T11:07:14.902 INFO:teuthology.orchestra.run.trial097.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T11:07:14.902 INFO:teuthology.orchestra.run.trial097.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T11:07:14.902 INFO:teuthology.orchestra.run.trial097.stdout: = sunit=0 swidth=0 blks 2026-02-17T11:07:14.902 INFO:teuthology.orchestra.run.trial097.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T11:07:14.902 INFO:teuthology.orchestra.run.trial097.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T11:07:14.902 INFO:teuthology.orchestra.run.trial097.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T11:07:14.902 INFO:teuthology.orchestra.run.trial097.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T11:07:15.457 INFO:teuthology.orchestra.run.trial097.stdout:Discarding blocks...Done. 2026-02-17T11:07:15.459 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial097.front.sepia.ceph.com -o noatime 2026-02-17T11:07:15.459 DEBUG:teuthology.orchestra.run.trial097:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-9 2026-02-17T11:07:15.531 DEBUG:teuthology.orchestra.run.trial097:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-9 2026-02-17T11:07:15.597 DEBUG:teuthology.orchestra.run.trial097:> sudo mkdir -p /var/lib/ceph/osd/ceph-13 2026-02-17T11:07:15.663 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-17T11:07:15.663 INFO:tasks.ceph:role: osd.13 2026-02-17T11:07:15.663 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial097.front.sepia.ceph.com 2026-02-17T11:07:15.663 DEBUG:teuthology.orchestra.run.trial097:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-17T11:07:15.729 INFO:teuthology.orchestra.run.trial097.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T11:07:15.729 INFO:teuthology.orchestra.run.trial097.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T11:07:15.729 INFO:teuthology.orchestra.run.trial097.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T11:07:15.729 INFO:teuthology.orchestra.run.trial097.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T11:07:15.729 INFO:teuthology.orchestra.run.trial097.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T11:07:15.730 INFO:teuthology.orchestra.run.trial097.stdout: = sunit=0 swidth=0 blks 2026-02-17T11:07:15.730 INFO:teuthology.orchestra.run.trial097.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T11:07:15.730 INFO:teuthology.orchestra.run.trial097.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T11:07:15.730 INFO:teuthology.orchestra.run.trial097.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T11:07:15.730 INFO:teuthology.orchestra.run.trial097.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T11:07:16.285 INFO:teuthology.orchestra.run.trial097.stdout:Discarding blocks...Done. 2026-02-17T11:07:16.287 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial097.front.sepia.ceph.com -o noatime 2026-02-17T11:07:16.288 DEBUG:teuthology.orchestra.run.trial097:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-13 2026-02-17T11:07:16.362 DEBUG:teuthology.orchestra.run.trial097:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-13 2026-02-17T11:07:16.430 DEBUG:teuthology.orchestra.run.trial097:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:07:16.510 INFO:teuthology.orchestra.run.trial097.stderr:2026-02-17T11:07:16.508+0000 7fbcc9612780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2026-02-17T11:07:16.511 INFO:teuthology.orchestra.run.trial097.stderr:2026-02-17T11:07:16.508+0000 7fbcc9612780 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2026-02-17T11:07:16.511 INFO:teuthology.orchestra.run.trial097.stderr:2026-02-17T11:07:16.508+0000 7fbcc9612780 -1 bdev(0x5641b710d800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2026-02-17T11:07:16.511 INFO:teuthology.orchestra.run.trial097.stderr:2026-02-17T11:07:16.508+0000 7fbcc9612780 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2026-02-17T11:07:20.391 DEBUG:teuthology.orchestra.run.trial097:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-17T11:07:20.456 DEBUG:teuthology.orchestra.run.trial097:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:07:20.534 INFO:teuthology.orchestra.run.trial097.stderr:2026-02-17T11:07:20.532+0000 7fb08d0d2780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2026-02-17T11:07:20.534 INFO:teuthology.orchestra.run.trial097.stderr:2026-02-17T11:07:20.532+0000 7fb08d0d2780 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2026-02-17T11:07:20.534 INFO:teuthology.orchestra.run.trial097.stderr:2026-02-17T11:07:20.532+0000 7fb08d0d2780 -1 bdev(0x559810617800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2026-02-17T11:07:20.535 INFO:teuthology.orchestra.run.trial097.stderr:2026-02-17T11:07:20.532+0000 7fb08d0d2780 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2026-02-17T11:07:24.416 DEBUG:teuthology.orchestra.run.trial097:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2026-02-17T11:07:24.480 DEBUG:teuthology.orchestra.run.trial097:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 9 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:07:24.561 INFO:teuthology.orchestra.run.trial097.stderr:2026-02-17T11:07:24.558+0000 7fcb4ec1c780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-9/keyring: can't open /var/lib/ceph/osd/ceph-9/keyring: (2) No such file or directory 2026-02-17T11:07:24.561 INFO:teuthology.orchestra.run.trial097.stderr:2026-02-17T11:07:24.559+0000 7fcb4ec1c780 -1 created new key in keyring /var/lib/ceph/osd/ceph-9/keyring 2026-02-17T11:07:24.561 INFO:teuthology.orchestra.run.trial097.stderr:2026-02-17T11:07:24.559+0000 7fcb4ec1c780 -1 bdev(0x55a53b973800 /var/lib/ceph/osd/ceph-9/block) open stat got: (1) Operation not permitted 2026-02-17T11:07:24.561 INFO:teuthology.orchestra.run.trial097.stderr:2026-02-17T11:07:24.559+0000 7fcb4ec1c780 -1 bluestore(/var/lib/ceph/osd/ceph-9) _read_fsid unparsable uuid 2026-02-17T11:07:28.445 DEBUG:teuthology.orchestra.run.trial097:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-9 2026-02-17T11:07:28.511 DEBUG:teuthology.orchestra.run.trial097:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 13 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:07:28.590 INFO:teuthology.orchestra.run.trial097.stderr:2026-02-17T11:07:28.588+0000 7f3525f10780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-13/keyring: can't open /var/lib/ceph/osd/ceph-13/keyring: (2) No such file or directory 2026-02-17T11:07:28.591 INFO:teuthology.orchestra.run.trial097.stderr:2026-02-17T11:07:28.588+0000 7f3525f10780 -1 created new key in keyring /var/lib/ceph/osd/ceph-13/keyring 2026-02-17T11:07:28.591 INFO:teuthology.orchestra.run.trial097.stderr:2026-02-17T11:07:28.588+0000 7f3525f10780 -1 bdev(0x555e02fc9800 /var/lib/ceph/osd/ceph-13/block) open stat got: (1) Operation not permitted 2026-02-17T11:07:28.591 INFO:teuthology.orchestra.run.trial097.stderr:2026-02-17T11:07:28.588+0000 7f3525f10780 -1 bluestore(/var/lib/ceph/osd/ceph-13) _read_fsid unparsable uuid 2026-02-17T11:07:32.480 DEBUG:teuthology.orchestra.run.trial097:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-13 2026-02-17T11:07:32.546 DEBUG:teuthology.orchestra.run.trial157:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-17T11:07:32.573 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-17T11:07:32.573 INFO:tasks.ceph:role: osd.2 2026-02-17T11:07:32.573 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial157.front.sepia.ceph.com 2026-02-17T11:07:32.573 DEBUG:teuthology.orchestra.run.trial157:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-17T11:07:32.638 INFO:teuthology.orchestra.run.trial157.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T11:07:32.638 INFO:teuthology.orchestra.run.trial157.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T11:07:32.638 INFO:teuthology.orchestra.run.trial157.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T11:07:32.638 INFO:teuthology.orchestra.run.trial157.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T11:07:32.638 INFO:teuthology.orchestra.run.trial157.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T11:07:32.638 INFO:teuthology.orchestra.run.trial157.stdout: = sunit=0 swidth=0 blks 2026-02-17T11:07:32.638 INFO:teuthology.orchestra.run.trial157.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T11:07:32.638 INFO:teuthology.orchestra.run.trial157.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T11:07:32.639 INFO:teuthology.orchestra.run.trial157.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T11:07:32.639 INFO:teuthology.orchestra.run.trial157.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T11:07:33.207 INFO:teuthology.orchestra.run.trial157.stdout:Discarding blocks...Done. 2026-02-17T11:07:33.209 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial157.front.sepia.ceph.com -o noatime 2026-02-17T11:07:33.209 DEBUG:teuthology.orchestra.run.trial157:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2026-02-17T11:07:33.277 DEBUG:teuthology.orchestra.run.trial157:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-17T11:07:33.345 DEBUG:teuthology.orchestra.run.trial157:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2026-02-17T11:07:33.409 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-17T11:07:33.409 INFO:tasks.ceph:role: osd.6 2026-02-17T11:07:33.409 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial157.front.sepia.ceph.com 2026-02-17T11:07:33.409 DEBUG:teuthology.orchestra.run.trial157:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-17T11:07:33.475 INFO:teuthology.orchestra.run.trial157.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T11:07:33.475 INFO:teuthology.orchestra.run.trial157.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T11:07:33.475 INFO:teuthology.orchestra.run.trial157.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T11:07:33.475 INFO:teuthology.orchestra.run.trial157.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T11:07:33.475 INFO:teuthology.orchestra.run.trial157.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T11:07:33.475 INFO:teuthology.orchestra.run.trial157.stdout: = sunit=0 swidth=0 blks 2026-02-17T11:07:33.475 INFO:teuthology.orchestra.run.trial157.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T11:07:33.475 INFO:teuthology.orchestra.run.trial157.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T11:07:33.475 INFO:teuthology.orchestra.run.trial157.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T11:07:33.475 INFO:teuthology.orchestra.run.trial157.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T11:07:34.035 INFO:teuthology.orchestra.run.trial157.stdout:Discarding blocks...Done. 2026-02-17T11:07:34.037 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial157.front.sepia.ceph.com -o noatime 2026-02-17T11:07:34.037 DEBUG:teuthology.orchestra.run.trial157:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6 2026-02-17T11:07:34.107 DEBUG:teuthology.orchestra.run.trial157:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2026-02-17T11:07:34.173 DEBUG:teuthology.orchestra.run.trial157:> sudo mkdir -p /var/lib/ceph/osd/ceph-10 2026-02-17T11:07:34.238 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-17T11:07:34.238 INFO:tasks.ceph:role: osd.10 2026-02-17T11:07:34.238 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial157.front.sepia.ceph.com 2026-02-17T11:07:34.238 DEBUG:teuthology.orchestra.run.trial157:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-17T11:07:34.304 INFO:teuthology.orchestra.run.trial157.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T11:07:34.304 INFO:teuthology.orchestra.run.trial157.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T11:07:34.304 INFO:teuthology.orchestra.run.trial157.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T11:07:34.304 INFO:teuthology.orchestra.run.trial157.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T11:07:34.304 INFO:teuthology.orchestra.run.trial157.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T11:07:34.304 INFO:teuthology.orchestra.run.trial157.stdout: = sunit=0 swidth=0 blks 2026-02-17T11:07:34.305 INFO:teuthology.orchestra.run.trial157.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T11:07:34.305 INFO:teuthology.orchestra.run.trial157.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T11:07:34.305 INFO:teuthology.orchestra.run.trial157.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T11:07:34.305 INFO:teuthology.orchestra.run.trial157.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T11:07:34.860 INFO:teuthology.orchestra.run.trial157.stdout:Discarding blocks...Done. 2026-02-17T11:07:34.862 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial157.front.sepia.ceph.com -o noatime 2026-02-17T11:07:34.862 DEBUG:teuthology.orchestra.run.trial157:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-10 2026-02-17T11:07:34.932 DEBUG:teuthology.orchestra.run.trial157:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-10 2026-02-17T11:07:34.998 DEBUG:teuthology.orchestra.run.trial157:> sudo mkdir -p /var/lib/ceph/osd/ceph-14 2026-02-17T11:07:35.062 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-17T11:07:35.062 INFO:tasks.ceph:role: osd.14 2026-02-17T11:07:35.062 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial157.front.sepia.ceph.com 2026-02-17T11:07:35.062 DEBUG:teuthology.orchestra.run.trial157:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-17T11:07:35.126 INFO:teuthology.orchestra.run.trial157.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T11:07:35.126 INFO:teuthology.orchestra.run.trial157.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T11:07:35.127 INFO:teuthology.orchestra.run.trial157.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T11:07:35.127 INFO:teuthology.orchestra.run.trial157.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T11:07:35.127 INFO:teuthology.orchestra.run.trial157.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T11:07:35.127 INFO:teuthology.orchestra.run.trial157.stdout: = sunit=0 swidth=0 blks 2026-02-17T11:07:35.127 INFO:teuthology.orchestra.run.trial157.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T11:07:35.127 INFO:teuthology.orchestra.run.trial157.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T11:07:35.127 INFO:teuthology.orchestra.run.trial157.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T11:07:35.127 INFO:teuthology.orchestra.run.trial157.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T11:07:35.682 INFO:teuthology.orchestra.run.trial157.stdout:Discarding blocks...Done. 2026-02-17T11:07:35.684 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial157.front.sepia.ceph.com -o noatime 2026-02-17T11:07:35.684 DEBUG:teuthology.orchestra.run.trial157:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-14 2026-02-17T11:07:35.766 DEBUG:teuthology.orchestra.run.trial157:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-14 2026-02-17T11:07:35.834 DEBUG:teuthology.orchestra.run.trial157:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:07:35.912 INFO:teuthology.orchestra.run.trial157.stderr:2026-02-17T11:07:35.910+0000 7f35bea16780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2026-02-17T11:07:35.912 INFO:teuthology.orchestra.run.trial157.stderr:2026-02-17T11:07:35.910+0000 7f35bea16780 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2026-02-17T11:07:35.912 INFO:teuthology.orchestra.run.trial157.stderr:2026-02-17T11:07:35.910+0000 7f35bea16780 -1 bdev(0x5555aba87800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2026-02-17T11:07:35.912 INFO:teuthology.orchestra.run.trial157.stderr:2026-02-17T11:07:35.910+0000 7f35bea16780 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2026-02-17T11:07:39.799 DEBUG:teuthology.orchestra.run.trial157:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-17T11:07:39.865 DEBUG:teuthology.orchestra.run.trial157:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:07:39.943 INFO:teuthology.orchestra.run.trial157.stderr:2026-02-17T11:07:39.941+0000 7fe67ab19780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2026-02-17T11:07:39.944 INFO:teuthology.orchestra.run.trial157.stderr:2026-02-17T11:07:39.941+0000 7fe67ab19780 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2026-02-17T11:07:39.944 INFO:teuthology.orchestra.run.trial157.stderr:2026-02-17T11:07:39.941+0000 7fe67ab19780 -1 bdev(0x55c9066b9800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2026-02-17T11:07:39.944 INFO:teuthology.orchestra.run.trial157.stderr:2026-02-17T11:07:39.941+0000 7fe67ab19780 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2026-02-17T11:07:43.829 DEBUG:teuthology.orchestra.run.trial157:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2026-02-17T11:07:43.894 DEBUG:teuthology.orchestra.run.trial157:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 10 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:07:43.973 INFO:teuthology.orchestra.run.trial157.stderr:2026-02-17T11:07:43.971+0000 7fefe9e10780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-10/keyring: can't open /var/lib/ceph/osd/ceph-10/keyring: (2) No such file or directory 2026-02-17T11:07:43.974 INFO:teuthology.orchestra.run.trial157.stderr:2026-02-17T11:07:43.971+0000 7fefe9e10780 -1 created new key in keyring /var/lib/ceph/osd/ceph-10/keyring 2026-02-17T11:07:43.974 INFO:teuthology.orchestra.run.trial157.stderr:2026-02-17T11:07:43.971+0000 7fefe9e10780 -1 bdev(0x5571c9457800 /var/lib/ceph/osd/ceph-10/block) open stat got: (1) Operation not permitted 2026-02-17T11:07:43.974 INFO:teuthology.orchestra.run.trial157.stderr:2026-02-17T11:07:43.971+0000 7fefe9e10780 -1 bluestore(/var/lib/ceph/osd/ceph-10) _read_fsid unparsable uuid 2026-02-17T11:07:47.858 DEBUG:teuthology.orchestra.run.trial157:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-10 2026-02-17T11:07:47.924 DEBUG:teuthology.orchestra.run.trial157:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 14 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:07:48.002 INFO:teuthology.orchestra.run.trial157.stderr:2026-02-17T11:07:47.999+0000 7f528a42f780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-14/keyring: can't open /var/lib/ceph/osd/ceph-14/keyring: (2) No such file or directory 2026-02-17T11:07:48.002 INFO:teuthology.orchestra.run.trial157.stderr:2026-02-17T11:07:48.000+0000 7f528a42f780 -1 created new key in keyring /var/lib/ceph/osd/ceph-14/keyring 2026-02-17T11:07:48.002 INFO:teuthology.orchestra.run.trial157.stderr:2026-02-17T11:07:48.000+0000 7f528a42f780 -1 bdev(0x555e785c7800 /var/lib/ceph/osd/ceph-14/block) open stat got: (1) Operation not permitted 2026-02-17T11:07:48.002 INFO:teuthology.orchestra.run.trial157.stderr:2026-02-17T11:07:48.000+0000 7f528a42f780 -1 bluestore(/var/lib/ceph/osd/ceph-14) _read_fsid unparsable uuid 2026-02-17T11:07:51.883 DEBUG:teuthology.orchestra.run.trial157:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-14 2026-02-17T11:07:51.948 DEBUG:teuthology.orchestra.run.trial162:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2026-02-17T11:07:51.973 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-17T11:07:51.973 INFO:tasks.ceph:role: osd.3 2026-02-17T11:07:51.974 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial162.front.sepia.ceph.com 2026-02-17T11:07:51.974 DEBUG:teuthology.orchestra.run.trial162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-17T11:07:52.041 INFO:teuthology.orchestra.run.trial162.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T11:07:52.041 INFO:teuthology.orchestra.run.trial162.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T11:07:52.041 INFO:teuthology.orchestra.run.trial162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T11:07:52.042 INFO:teuthology.orchestra.run.trial162.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T11:07:52.042 INFO:teuthology.orchestra.run.trial162.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T11:07:52.042 INFO:teuthology.orchestra.run.trial162.stdout: = sunit=0 swidth=0 blks 2026-02-17T11:07:52.042 INFO:teuthology.orchestra.run.trial162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T11:07:52.042 INFO:teuthology.orchestra.run.trial162.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T11:07:52.042 INFO:teuthology.orchestra.run.trial162.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T11:07:52.042 INFO:teuthology.orchestra.run.trial162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T11:07:52.612 INFO:teuthology.orchestra.run.trial162.stdout:Discarding blocks...Done. 2026-02-17T11:07:52.614 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial162.front.sepia.ceph.com -o noatime 2026-02-17T11:07:52.614 DEBUG:teuthology.orchestra.run.trial162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3 2026-02-17T11:07:52.683 DEBUG:teuthology.orchestra.run.trial162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2026-02-17T11:07:52.750 DEBUG:teuthology.orchestra.run.trial162:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2026-02-17T11:07:52.814 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-17T11:07:52.814 INFO:tasks.ceph:role: osd.7 2026-02-17T11:07:52.814 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial162.front.sepia.ceph.com 2026-02-17T11:07:52.814 DEBUG:teuthology.orchestra.run.trial162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-17T11:07:52.878 INFO:teuthology.orchestra.run.trial162.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T11:07:52.879 INFO:teuthology.orchestra.run.trial162.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T11:07:52.879 INFO:teuthology.orchestra.run.trial162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T11:07:52.879 INFO:teuthology.orchestra.run.trial162.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T11:07:52.879 INFO:teuthology.orchestra.run.trial162.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T11:07:52.879 INFO:teuthology.orchestra.run.trial162.stdout: = sunit=0 swidth=0 blks 2026-02-17T11:07:52.879 INFO:teuthology.orchestra.run.trial162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T11:07:52.879 INFO:teuthology.orchestra.run.trial162.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T11:07:52.879 INFO:teuthology.orchestra.run.trial162.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T11:07:52.879 INFO:teuthology.orchestra.run.trial162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T11:07:53.440 INFO:teuthology.orchestra.run.trial162.stdout:Discarding blocks...Done. 2026-02-17T11:07:53.442 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial162.front.sepia.ceph.com -o noatime 2026-02-17T11:07:53.442 DEBUG:teuthology.orchestra.run.trial162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-7 2026-02-17T11:07:53.510 DEBUG:teuthology.orchestra.run.trial162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2026-02-17T11:07:53.576 DEBUG:teuthology.orchestra.run.trial162:> sudo mkdir -p /var/lib/ceph/osd/ceph-11 2026-02-17T11:07:53.641 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-17T11:07:53.642 INFO:tasks.ceph:role: osd.11 2026-02-17T11:07:53.642 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial162.front.sepia.ceph.com 2026-02-17T11:07:53.642 DEBUG:teuthology.orchestra.run.trial162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-17T11:07:53.707 INFO:teuthology.orchestra.run.trial162.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T11:07:53.707 INFO:teuthology.orchestra.run.trial162.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T11:07:53.707 INFO:teuthology.orchestra.run.trial162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T11:07:53.707 INFO:teuthology.orchestra.run.trial162.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T11:07:53.707 INFO:teuthology.orchestra.run.trial162.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T11:07:53.707 INFO:teuthology.orchestra.run.trial162.stdout: = sunit=0 swidth=0 blks 2026-02-17T11:07:53.707 INFO:teuthology.orchestra.run.trial162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T11:07:53.707 INFO:teuthology.orchestra.run.trial162.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T11:07:53.708 INFO:teuthology.orchestra.run.trial162.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T11:07:53.708 INFO:teuthology.orchestra.run.trial162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T11:07:54.266 INFO:teuthology.orchestra.run.trial162.stdout:Discarding blocks...Done. 2026-02-17T11:07:54.267 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial162.front.sepia.ceph.com -o noatime 2026-02-17T11:07:54.267 DEBUG:teuthology.orchestra.run.trial162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-11 2026-02-17T11:07:54.336 DEBUG:teuthology.orchestra.run.trial162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-11 2026-02-17T11:07:54.403 DEBUG:teuthology.orchestra.run.trial162:> sudo mkdir -p /var/lib/ceph/osd/ceph-15 2026-02-17T11:07:54.467 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-17T11:07:54.467 INFO:tasks.ceph:role: osd.15 2026-02-17T11:07:54.467 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial162.front.sepia.ceph.com 2026-02-17T11:07:54.468 DEBUG:teuthology.orchestra.run.trial162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-17T11:07:54.532 INFO:teuthology.orchestra.run.trial162.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T11:07:54.532 INFO:teuthology.orchestra.run.trial162.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T11:07:54.532 INFO:teuthology.orchestra.run.trial162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T11:07:54.533 INFO:teuthology.orchestra.run.trial162.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T11:07:54.533 INFO:teuthology.orchestra.run.trial162.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T11:07:54.533 INFO:teuthology.orchestra.run.trial162.stdout: = sunit=0 swidth=0 blks 2026-02-17T11:07:54.533 INFO:teuthology.orchestra.run.trial162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T11:07:54.533 INFO:teuthology.orchestra.run.trial162.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T11:07:54.533 INFO:teuthology.orchestra.run.trial162.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T11:07:54.533 INFO:teuthology.orchestra.run.trial162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T11:07:55.088 INFO:teuthology.orchestra.run.trial162.stdout:Discarding blocks...Done. 2026-02-17T11:07:55.090 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial162.front.sepia.ceph.com -o noatime 2026-02-17T11:07:55.091 DEBUG:teuthology.orchestra.run.trial162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-15 2026-02-17T11:07:55.173 DEBUG:teuthology.orchestra.run.trial162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-15 2026-02-17T11:07:55.242 DEBUG:teuthology.orchestra.run.trial162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:07:55.322 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:07:55.320+0000 7f607c9b4780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2026-02-17T11:07:55.322 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:07:55.320+0000 7f607c9b4780 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2026-02-17T11:07:55.322 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:07:55.320+0000 7f607c9b4780 -1 bdev(0x5593c6719800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2026-02-17T11:07:55.322 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:07:55.321+0000 7f607c9b4780 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2026-02-17T11:07:59.203 DEBUG:teuthology.orchestra.run.trial162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2026-02-17T11:07:59.267 DEBUG:teuthology.orchestra.run.trial162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:07:59.346 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:07:59.345+0000 7f8761811780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2026-02-17T11:07:59.347 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:07:59.345+0000 7f8761811780 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2026-02-17T11:07:59.347 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:07:59.345+0000 7f8761811780 -1 bdev(0x56291bf05800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2026-02-17T11:07:59.347 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:07:59.345+0000 7f8761811780 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2026-02-17T11:08:03.234 DEBUG:teuthology.orchestra.run.trial162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2026-02-17T11:08:03.299 DEBUG:teuthology.orchestra.run.trial162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 11 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:08:03.377 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:03.375+0000 7f8e05a19780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-11/keyring: can't open /var/lib/ceph/osd/ceph-11/keyring: (2) No such file or directory 2026-02-17T11:08:03.378 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:03.375+0000 7f8e05a19780 -1 created new key in keyring /var/lib/ceph/osd/ceph-11/keyring 2026-02-17T11:08:03.378 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:03.375+0000 7f8e05a19780 -1 bdev(0x55fd59d83800 /var/lib/ceph/osd/ceph-11/block) open stat got: (1) Operation not permitted 2026-02-17T11:08:03.378 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:03.375+0000 7f8e05a19780 -1 bluestore(/var/lib/ceph/osd/ceph-11) _read_fsid unparsable uuid 2026-02-17T11:08:07.257 DEBUG:teuthology.orchestra.run.trial162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-11 2026-02-17T11:08:07.322 DEBUG:teuthology.orchestra.run.trial162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 15 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:08:07.401 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:07.398+0000 7ff89d1b4780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-15/keyring: can't open /var/lib/ceph/osd/ceph-15/keyring: (2) No such file or directory 2026-02-17T11:08:07.401 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:07.398+0000 7ff89d1b4780 -1 created new key in keyring /var/lib/ceph/osd/ceph-15/keyring 2026-02-17T11:08:07.401 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:07.398+0000 7ff89d1b4780 -1 bdev(0x55e762f63800 /var/lib/ceph/osd/ceph-15/block) open stat got: (1) Operation not permitted 2026-02-17T11:08:07.401 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:07.399+0000 7ff89d1b4780 -1 bluestore(/var/lib/ceph/osd/ceph-15) _read_fsid unparsable uuid 2026-02-17T11:08:11.288 DEBUG:teuthology.orchestra.run.trial162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-15 2026-02-17T11:08:11.352 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-17T11:08:11.353 DEBUG:teuthology.orchestra.run.trial049:> set -ex 2026-02-17T11:08:11.353 DEBUG:teuthology.orchestra.run.trial049:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2026-02-17T11:08:11.378 DEBUG:teuthology.orchestra.run.trial049:> set -ex 2026-02-17T11:08:11.379 DEBUG:teuthology.orchestra.run.trial049:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-17T11:08:11.442 DEBUG:teuthology.orchestra.run.trial049:> set -ex 2026-02-17T11:08:11.442 DEBUG:teuthology.orchestra.run.trial049:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2026-02-17T11:08:11.506 DEBUG:teuthology.orchestra.run.trial049:> set -ex 2026-02-17T11:08:11.506 DEBUG:teuthology.orchestra.run.trial049:> sudo dd if=/var/lib/ceph/osd/ceph-8/keyring of=/dev/stdout 2026-02-17T11:08:11.569 DEBUG:teuthology.orchestra.run.trial049:> set -ex 2026-02-17T11:08:11.569 DEBUG:teuthology.orchestra.run.trial049:> sudo dd if=/var/lib/ceph/osd/ceph-12/keyring of=/dev/stdout 2026-02-17T11:08:11.632 DEBUG:teuthology.orchestra.run.trial097:> set -ex 2026-02-17T11:08:11.632 DEBUG:teuthology.orchestra.run.trial097:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-17T11:08:11.658 DEBUG:teuthology.orchestra.run.trial097:> set -ex 2026-02-17T11:08:11.658 DEBUG:teuthology.orchestra.run.trial097:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2026-02-17T11:08:11.722 DEBUG:teuthology.orchestra.run.trial097:> set -ex 2026-02-17T11:08:11.722 DEBUG:teuthology.orchestra.run.trial097:> sudo dd if=/var/lib/ceph/osd/ceph-9/keyring of=/dev/stdout 2026-02-17T11:08:11.788 DEBUG:teuthology.orchestra.run.trial097:> set -ex 2026-02-17T11:08:11.788 DEBUG:teuthology.orchestra.run.trial097:> sudo dd if=/var/lib/ceph/osd/ceph-13/keyring of=/dev/stdout 2026-02-17T11:08:11.851 DEBUG:teuthology.orchestra.run.trial157:> set -ex 2026-02-17T11:08:11.852 DEBUG:teuthology.orchestra.run.trial157:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-17T11:08:11.878 DEBUG:teuthology.orchestra.run.trial157:> set -ex 2026-02-17T11:08:11.878 DEBUG:teuthology.orchestra.run.trial157:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2026-02-17T11:08:11.944 DEBUG:teuthology.orchestra.run.trial157:> set -ex 2026-02-17T11:08:11.944 DEBUG:teuthology.orchestra.run.trial157:> sudo dd if=/var/lib/ceph/osd/ceph-10/keyring of=/dev/stdout 2026-02-17T11:08:12.009 DEBUG:teuthology.orchestra.run.trial157:> set -ex 2026-02-17T11:08:12.009 DEBUG:teuthology.orchestra.run.trial157:> sudo dd if=/var/lib/ceph/osd/ceph-14/keyring of=/dev/stdout 2026-02-17T11:08:12.074 DEBUG:teuthology.orchestra.run.trial162:> set -ex 2026-02-17T11:08:12.074 DEBUG:teuthology.orchestra.run.trial162:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-17T11:08:12.101 DEBUG:teuthology.orchestra.run.trial162:> set -ex 2026-02-17T11:08:12.101 DEBUG:teuthology.orchestra.run.trial162:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2026-02-17T11:08:12.166 DEBUG:teuthology.orchestra.run.trial162:> set -ex 2026-02-17T11:08:12.166 DEBUG:teuthology.orchestra.run.trial162:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2026-02-17T11:08:12.231 DEBUG:teuthology.orchestra.run.trial162:> set -ex 2026-02-17T11:08:12.231 DEBUG:teuthology.orchestra.run.trial162:> sudo dd if=/var/lib/ceph/osd/ceph-11/keyring of=/dev/stdout 2026-02-17T11:08:12.296 DEBUG:teuthology.orchestra.run.trial162:> set -ex 2026-02-17T11:08:12.296 DEBUG:teuthology.orchestra.run.trial162:> sudo dd if=/var/lib/ceph/osd/ceph-15/keyring of=/dev/stdout 2026-02-17T11:08:12.362 DEBUG:teuthology.orchestra.run.trial162:> set -ex 2026-02-17T11:08:12.362 DEBUG:teuthology.orchestra.run.trial162:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-17T11:08:12.417 INFO:tasks.ceph:Adding keys to all mons... 2026-02-17T11:08:12.417 DEBUG:teuthology.orchestra.run.trial049:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-17T11:08:12.420 DEBUG:teuthology.orchestra.run.trial097:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-17T11:08:12.424 DEBUG:teuthology.orchestra.run.trial157:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-17T11:08:12.441 INFO:teuthology.orchestra.run.trial049.stdout:[mgr.y] 2026-02-17T11:08:12.442 INFO:teuthology.orchestra.run.trial049.stdout: key = AQDNS5Rpy1BdJBAAfQ4hUqwA7i8E4RRYyl7RyQ== 2026-02-17T11:08:12.442 INFO:teuthology.orchestra.run.trial049.stdout:[osd.0] 2026-02-17T11:08:12.442 INFO:teuthology.orchestra.run.trial049.stdout: key = AQDRS5RpuJpjBhAAvj34anCoQjxufrbLCZeUww== 2026-02-17T11:08:12.442 INFO:teuthology.orchestra.run.trial049.stdout:[osd.4] 2026-02-17T11:08:12.442 INFO:teuthology.orchestra.run.trial049.stdout: key = AQDVS5RpKKSUBxAAYzdJuz+1H0gc6zndvaKKvA== 2026-02-17T11:08:12.442 INFO:teuthology.orchestra.run.trial049.stdout:[osd.8] 2026-02-17T11:08:12.442 INFO:teuthology.orchestra.run.trial049.stdout: key = AQDZS5Rplzw3CRAAhXx6ChMiur+DW6mG/jr2Iw== 2026-02-17T11:08:12.442 INFO:teuthology.orchestra.run.trial049.stdout:[osd.12] 2026-02-17T11:08:12.443 INFO:teuthology.orchestra.run.trial049.stdout: key = AQDdS5RpHujHChAA9AdFv1DsQ7M2GraKxUSJ+g== 2026-02-17T11:08:12.443 INFO:teuthology.orchestra.run.trial049.stdout:[osd.1] 2026-02-17T11:08:12.443 INFO:teuthology.orchestra.run.trial049.stdout: key = AQDkS5Rp7/1oHhAAENoiGvJ3NS3EzbXpf4s/nA== 2026-02-17T11:08:12.443 INFO:teuthology.orchestra.run.trial049.stdout:[osd.5] 2026-02-17T11:08:12.443 INFO:teuthology.orchestra.run.trial049.stdout: key = AQDoS5RpAxfPHxAAA/RiJUBplV7Hm8Gp3QWGGQ== 2026-02-17T11:08:12.443 INFO:teuthology.orchestra.run.trial049.stdout:[osd.9] 2026-02-17T11:08:12.443 INFO:teuthology.orchestra.run.trial049.stdout: key = AQDsS5RpmzFoIRAADKOVde1sDkz3XJHngGD+pA== 2026-02-17T11:08:12.443 INFO:teuthology.orchestra.run.trial049.stdout:[osd.13] 2026-02-17T11:08:12.443 INFO:teuthology.orchestra.run.trial049.stdout: key = AQDwS5RpdAstIxAAqUpks5+vLF/UEPmITuIxJg== 2026-02-17T11:08:12.443 INFO:teuthology.orchestra.run.trial049.stdout:[osd.2] 2026-02-17T11:08:12.444 INFO:teuthology.orchestra.run.trial049.stdout: key = AQD3S5Rp2ZZaNhAA60oLF/pf5PCP4/W7dxu0Hw== 2026-02-17T11:08:12.444 INFO:teuthology.orchestra.run.trial049.stdout:[osd.6] 2026-02-17T11:08:12.444 INFO:teuthology.orchestra.run.trial049.stdout: key = AQD7S5RpSE4xOBAAI8e2wk4Sv9O0GiWCy8wKzw== 2026-02-17T11:08:12.444 INFO:teuthology.orchestra.run.trial049.stdout:[osd.10] 2026-02-17T11:08:12.444 INFO:teuthology.orchestra.run.trial049.stdout: key = AQD/S5Rp2kr7ORAA1T/6eqEfRfHfgHtAxbAkJw== 2026-02-17T11:08:12.444 INFO:teuthology.orchestra.run.trial049.stdout:[osd.14] 2026-02-17T11:08:12.444 INFO:teuthology.orchestra.run.trial049.stdout: key = AQAETJRpA7UUABAAifNik/0PTgj3YGLyR4M+Rg== 2026-02-17T11:08:12.444 INFO:teuthology.orchestra.run.trial049.stdout:[mgr.x] 2026-02-17T11:08:12.444 INFO:teuthology.orchestra.run.trial049.stdout: key = AQDNS5Rpf2AZJxAAR22vamQRtvAivlpNaQZE4A== 2026-02-17T11:08:12.444 INFO:teuthology.orchestra.run.trial049.stdout:[osd.3] 2026-02-17T11:08:12.445 INFO:teuthology.orchestra.run.trial049.stdout: key = AQALTJRprcckExAAhEMcOJauOzWbZyP38q59iQ== 2026-02-17T11:08:12.445 INFO:teuthology.orchestra.run.trial049.stdout:[osd.7] 2026-02-17T11:08:12.445 INFO:teuthology.orchestra.run.trial049.stdout: key = AQAPTJRp0fiZFBAAJOE+zhAr4o8bIde1Qe919g== 2026-02-17T11:08:12.445 INFO:teuthology.orchestra.run.trial049.stdout:[osd.11] 2026-02-17T11:08:12.445 INFO:teuthology.orchestra.run.trial049.stdout: key = AQATTJRp+Sp2FhAADdXytosP7UrVU7RXHPpVtQ== 2026-02-17T11:08:12.445 INFO:teuthology.orchestra.run.trial049.stdout:[osd.15] 2026-02-17T11:08:12.445 INFO:teuthology.orchestra.run.trial049.stdout: key = AQAXTJRpn7jaFxAAmRoQF/8+Pq1rKU30r0zOvw== 2026-02-17T11:08:12.445 INFO:teuthology.orchestra.run.trial049.stdout:[client.0] 2026-02-17T11:08:12.445 INFO:teuthology.orchestra.run.trial049.stdout: key = AQDNS5RpRfGmKxAAvIVCoPNQAljX+OIzmi8ESQ== 2026-02-17T11:08:12.446 INFO:teuthology.orchestra.run.trial097.stdout:[mgr.y] 2026-02-17T11:08:12.446 INFO:teuthology.orchestra.run.trial097.stdout: key = AQDNS5Rpy1BdJBAAfQ4hUqwA7i8E4RRYyl7RyQ== 2026-02-17T11:08:12.446 INFO:teuthology.orchestra.run.trial097.stdout:[osd.0] 2026-02-17T11:08:12.446 INFO:teuthology.orchestra.run.trial097.stdout: key = AQDRS5RpuJpjBhAAvj34anCoQjxufrbLCZeUww== 2026-02-17T11:08:12.446 INFO:teuthology.orchestra.run.trial097.stdout:[osd.4] 2026-02-17T11:08:12.446 INFO:teuthology.orchestra.run.trial097.stdout: key = AQDVS5RpKKSUBxAAYzdJuz+1H0gc6zndvaKKvA== 2026-02-17T11:08:12.447 INFO:teuthology.orchestra.run.trial097.stdout:[osd.8] 2026-02-17T11:08:12.447 INFO:teuthology.orchestra.run.trial097.stdout: key = AQDZS5Rplzw3CRAAhXx6ChMiur+DW6mG/jr2Iw== 2026-02-17T11:08:12.447 INFO:teuthology.orchestra.run.trial097.stdout:[osd.12] 2026-02-17T11:08:12.447 INFO:teuthology.orchestra.run.trial097.stdout: key = AQDdS5RpHujHChAA9AdFv1DsQ7M2GraKxUSJ+g== 2026-02-17T11:08:12.447 INFO:teuthology.orchestra.run.trial097.stdout:[osd.1] 2026-02-17T11:08:12.447 INFO:teuthology.orchestra.run.trial097.stdout: key = AQDkS5Rp7/1oHhAAENoiGvJ3NS3EzbXpf4s/nA== 2026-02-17T11:08:12.447 INFO:teuthology.orchestra.run.trial097.stdout:[osd.5] 2026-02-17T11:08:12.447 INFO:teuthology.orchestra.run.trial097.stdout: key = AQDoS5RpAxfPHxAAA/RiJUBplV7Hm8Gp3QWGGQ== 2026-02-17T11:08:12.447 INFO:teuthology.orchestra.run.trial097.stdout:[osd.9] 2026-02-17T11:08:12.448 INFO:teuthology.orchestra.run.trial097.stdout: key = AQDsS5RpmzFoIRAADKOVde1sDkz3XJHngGD+pA== 2026-02-17T11:08:12.448 INFO:teuthology.orchestra.run.trial097.stdout:[osd.13] 2026-02-17T11:08:12.448 INFO:teuthology.orchestra.run.trial097.stdout: key = AQDwS5RpdAstIxAAqUpks5+vLF/UEPmITuIxJg== 2026-02-17T11:08:12.448 INFO:teuthology.orchestra.run.trial097.stdout:[osd.2] 2026-02-17T11:08:12.448 INFO:teuthology.orchestra.run.trial097.stdout: key = AQD3S5Rp2ZZaNhAA60oLF/pf5PCP4/W7dxu0Hw== 2026-02-17T11:08:12.448 INFO:teuthology.orchestra.run.trial097.stdout:[osd.6] 2026-02-17T11:08:12.448 INFO:teuthology.orchestra.run.trial097.stdout: key = AQD7S5RpSE4xOBAAI8e2wk4Sv9O0GiWCy8wKzw== 2026-02-17T11:08:12.448 INFO:teuthology.orchestra.run.trial097.stdout:[osd.10] 2026-02-17T11:08:12.448 INFO:teuthology.orchestra.run.trial097.stdout: key = AQD/S5Rp2kr7ORAA1T/6eqEfRfHfgHtAxbAkJw== 2026-02-17T11:08:12.448 INFO:teuthology.orchestra.run.trial097.stdout:[osd.14] 2026-02-17T11:08:12.448 INFO:teuthology.orchestra.run.trial097.stdout: key = AQAETJRpA7UUABAAifNik/0PTgj3YGLyR4M+Rg== 2026-02-17T11:08:12.448 INFO:teuthology.orchestra.run.trial097.stdout:[mgr.x] 2026-02-17T11:08:12.448 INFO:teuthology.orchestra.run.trial097.stdout: key = AQDNS5Rpf2AZJxAAR22vamQRtvAivlpNaQZE4A== 2026-02-17T11:08:12.449 INFO:teuthology.orchestra.run.trial097.stdout:[osd.3] 2026-02-17T11:08:12.449 INFO:teuthology.orchestra.run.trial097.stdout: key = AQALTJRprcckExAAhEMcOJauOzWbZyP38q59iQ== 2026-02-17T11:08:12.449 INFO:teuthology.orchestra.run.trial097.stdout:[osd.7] 2026-02-17T11:08:12.449 INFO:teuthology.orchestra.run.trial097.stdout: key = AQAPTJRp0fiZFBAAJOE+zhAr4o8bIde1Qe919g== 2026-02-17T11:08:12.449 INFO:teuthology.orchestra.run.trial097.stdout:[osd.11] 2026-02-17T11:08:12.449 INFO:teuthology.orchestra.run.trial097.stdout: key = AQATTJRp+Sp2FhAADdXytosP7UrVU7RXHPpVtQ== 2026-02-17T11:08:12.449 INFO:teuthology.orchestra.run.trial097.stdout:[osd.15] 2026-02-17T11:08:12.449 INFO:teuthology.orchestra.run.trial097.stdout: key = AQAXTJRpn7jaFxAAmRoQF/8+Pq1rKU30r0zOvw== 2026-02-17T11:08:12.449 INFO:teuthology.orchestra.run.trial097.stdout:[client.0] 2026-02-17T11:08:12.449 INFO:teuthology.orchestra.run.trial097.stdout: key = AQDNS5RpRfGmKxAAvIVCoPNQAljX+OIzmi8ESQ== 2026-02-17T11:08:12.452 INFO:teuthology.orchestra.run.trial157.stdout:[mgr.y] 2026-02-17T11:08:12.452 INFO:teuthology.orchestra.run.trial157.stdout: key = AQDNS5Rpy1BdJBAAfQ4hUqwA7i8E4RRYyl7RyQ== 2026-02-17T11:08:12.452 INFO:teuthology.orchestra.run.trial157.stdout:[osd.0] 2026-02-17T11:08:12.452 INFO:teuthology.orchestra.run.trial157.stdout: key = AQDRS5RpuJpjBhAAvj34anCoQjxufrbLCZeUww== 2026-02-17T11:08:12.452 INFO:teuthology.orchestra.run.trial157.stdout:[osd.4] 2026-02-17T11:08:12.452 INFO:teuthology.orchestra.run.trial157.stdout: key = AQDVS5RpKKSUBxAAYzdJuz+1H0gc6zndvaKKvA== 2026-02-17T11:08:12.453 INFO:teuthology.orchestra.run.trial157.stdout:[osd.8] 2026-02-17T11:08:12.453 INFO:teuthology.orchestra.run.trial157.stdout: key = AQDZS5Rplzw3CRAAhXx6ChMiur+DW6mG/jr2Iw== 2026-02-17T11:08:12.453 INFO:teuthology.orchestra.run.trial157.stdout:[osd.12] 2026-02-17T11:08:12.453 INFO:teuthology.orchestra.run.trial157.stdout: key = AQDdS5RpHujHChAA9AdFv1DsQ7M2GraKxUSJ+g== 2026-02-17T11:08:12.453 INFO:teuthology.orchestra.run.trial157.stdout:[osd.1] 2026-02-17T11:08:12.453 INFO:teuthology.orchestra.run.trial157.stdout: key = AQDkS5Rp7/1oHhAAENoiGvJ3NS3EzbXpf4s/nA== 2026-02-17T11:08:12.453 INFO:teuthology.orchestra.run.trial157.stdout:[osd.5] 2026-02-17T11:08:12.453 INFO:teuthology.orchestra.run.trial157.stdout: key = AQDoS5RpAxfPHxAAA/RiJUBplV7Hm8Gp3QWGGQ== 2026-02-17T11:08:12.453 INFO:teuthology.orchestra.run.trial157.stdout:[osd.9] 2026-02-17T11:08:12.453 INFO:teuthology.orchestra.run.trial157.stdout: key = AQDsS5RpmzFoIRAADKOVde1sDkz3XJHngGD+pA== 2026-02-17T11:08:12.453 INFO:teuthology.orchestra.run.trial157.stdout:[osd.13] 2026-02-17T11:08:12.454 INFO:teuthology.orchestra.run.trial157.stdout: key = AQDwS5RpdAstIxAAqUpks5+vLF/UEPmITuIxJg== 2026-02-17T11:08:12.454 INFO:teuthology.orchestra.run.trial157.stdout:[osd.2] 2026-02-17T11:08:12.454 INFO:teuthology.orchestra.run.trial157.stdout: key = AQD3S5Rp2ZZaNhAA60oLF/pf5PCP4/W7dxu0Hw== 2026-02-17T11:08:12.454 INFO:teuthology.orchestra.run.trial157.stdout:[osd.6] 2026-02-17T11:08:12.454 INFO:teuthology.orchestra.run.trial157.stdout: key = AQD7S5RpSE4xOBAAI8e2wk4Sv9O0GiWCy8wKzw== 2026-02-17T11:08:12.454 INFO:teuthology.orchestra.run.trial157.stdout:[osd.10] 2026-02-17T11:08:12.454 INFO:teuthology.orchestra.run.trial157.stdout: key = AQD/S5Rp2kr7ORAA1T/6eqEfRfHfgHtAxbAkJw== 2026-02-17T11:08:12.454 INFO:teuthology.orchestra.run.trial157.stdout:[osd.14] 2026-02-17T11:08:12.454 INFO:teuthology.orchestra.run.trial157.stdout: key = AQAETJRpA7UUABAAifNik/0PTgj3YGLyR4M+Rg== 2026-02-17T11:08:12.454 INFO:teuthology.orchestra.run.trial157.stdout:[mgr.x] 2026-02-17T11:08:12.454 INFO:teuthology.orchestra.run.trial157.stdout: key = AQDNS5Rpf2AZJxAAR22vamQRtvAivlpNaQZE4A== 2026-02-17T11:08:12.455 INFO:teuthology.orchestra.run.trial157.stdout:[osd.3] 2026-02-17T11:08:12.455 INFO:teuthology.orchestra.run.trial157.stdout: key = AQALTJRprcckExAAhEMcOJauOzWbZyP38q59iQ== 2026-02-17T11:08:12.455 INFO:teuthology.orchestra.run.trial157.stdout:[osd.7] 2026-02-17T11:08:12.455 INFO:teuthology.orchestra.run.trial157.stdout: key = AQAPTJRp0fiZFBAAJOE+zhAr4o8bIde1Qe919g== 2026-02-17T11:08:12.455 INFO:teuthology.orchestra.run.trial157.stdout:[osd.11] 2026-02-17T11:08:12.455 INFO:teuthology.orchestra.run.trial157.stdout: key = AQATTJRp+Sp2FhAADdXytosP7UrVU7RXHPpVtQ== 2026-02-17T11:08:12.455 INFO:teuthology.orchestra.run.trial157.stdout:[osd.15] 2026-02-17T11:08:12.455 INFO:teuthology.orchestra.run.trial157.stdout: key = AQAXTJRpn7jaFxAAmRoQF/8+Pq1rKU30r0zOvw== 2026-02-17T11:08:12.455 INFO:teuthology.orchestra.run.trial157.stdout:[client.0] 2026-02-17T11:08:12.455 INFO:teuthology.orchestra.run.trial157.stdout: key = AQDNS5RpRfGmKxAAvIVCoPNQAljX+OIzmi8ESQ== 2026-02-17T11:08:12.456 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-17T11:08:12.493 DEBUG:teuthology.orchestra.run.trial097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-17T11:08:12.496 DEBUG:teuthology.orchestra.run.trial157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-17T11:08:12.536 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:08:12.575 DEBUG:teuthology.orchestra.run.trial097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:08:12.578 DEBUG:teuthology.orchestra.run.trial157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:08:12.618 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:08:12.654 DEBUG:teuthology.orchestra.run.trial097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:08:12.657 DEBUG:teuthology.orchestra.run.trial157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:08:12.699 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:08:12.732 DEBUG:teuthology.orchestra.run.trial097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:08:12.737 DEBUG:teuthology.orchestra.run.trial157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:08:12.782 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.12 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:08:12.810 DEBUG:teuthology.orchestra.run.trial097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.12 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:08:12.818 DEBUG:teuthology.orchestra.run.trial157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.12 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:08:12.863 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:08:12.888 DEBUG:teuthology.orchestra.run.trial097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:08:12.897 DEBUG:teuthology.orchestra.run.trial157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:08:12.942 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:08:12.970 DEBUG:teuthology.orchestra.run.trial097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:08:12.976 DEBUG:teuthology.orchestra.run.trial157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:08:13.021 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:08:13.051 DEBUG:teuthology.orchestra.run.trial097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:08:13.054 DEBUG:teuthology.orchestra.run.trial157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:08:13.099 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.13 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:08:13.131 DEBUG:teuthology.orchestra.run.trial097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.13 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:08:13.135 DEBUG:teuthology.orchestra.run.trial157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.13 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:08:13.179 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:08:13.209 DEBUG:teuthology.orchestra.run.trial097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:08:13.216 DEBUG:teuthology.orchestra.run.trial157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:08:13.259 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:08:13.289 DEBUG:teuthology.orchestra.run.trial097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:08:13.294 DEBUG:teuthology.orchestra.run.trial157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:08:13.337 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:08:13.369 DEBUG:teuthology.orchestra.run.trial097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:08:13.373 DEBUG:teuthology.orchestra.run.trial157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:08:13.420 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.14 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:08:13.448 DEBUG:teuthology.orchestra.run.trial097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.14 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:08:13.452 DEBUG:teuthology.orchestra.run.trial157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.14 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:08:13.497 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-17T11:08:13.528 DEBUG:teuthology.orchestra.run.trial097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-17T11:08:13.530 DEBUG:teuthology.orchestra.run.trial157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-17T11:08:13.576 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:08:13.609 DEBUG:teuthology.orchestra.run.trial097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:08:13.611 DEBUG:teuthology.orchestra.run.trial157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:08:13.654 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:08:13.688 DEBUG:teuthology.orchestra.run.trial097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:08:13.690 DEBUG:teuthology.orchestra.run.trial157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:08:13.732 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:08:13.766 DEBUG:teuthology.orchestra.run.trial097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:08:13.772 DEBUG:teuthology.orchestra.run.trial157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:08:13.811 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.15 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:08:13.845 DEBUG:teuthology.orchestra.run.trial097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.15 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:08:13.852 DEBUG:teuthology.orchestra.run.trial157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.15 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:08:13.893 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-17T11:08:13.924 DEBUG:teuthology.orchestra.run.trial097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-17T11:08:13.933 DEBUG:teuthology.orchestra.run.trial157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-17T11:08:13.974 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-17T11:08:13.974 DEBUG:teuthology.orchestra.run.trial049:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-17T11:08:14.025 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-17T11:08:14.111 DEBUG:teuthology.orchestra.run.trial049:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-17T11:08:14.137 DEBUG:teuthology.orchestra.run.trial097:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2026-02-17T11:08:14.162 DEBUG:teuthology.orchestra.run.trial097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-17T11:08:14.249 DEBUG:teuthology.orchestra.run.trial097:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2026-02-17T11:08:14.274 DEBUG:teuthology.orchestra.run.trial157:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2026-02-17T11:08:14.299 DEBUG:teuthology.orchestra.run.trial157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-17T11:08:14.385 DEBUG:teuthology.orchestra.run.trial157:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2026-02-17T11:08:14.410 DEBUG:teuthology.orchestra.run.trial049:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:08:14.413 DEBUG:teuthology.orchestra.run.trial097:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:08:14.416 DEBUG:teuthology.orchestra.run.trial157:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:08:14.468 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-17T11:08:14.468 DEBUG:tasks.ceph_manager:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2026-02-17T11:08:14.468 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-17T11:08:14.469 DEBUG:teuthology.orchestra.run.trial049:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2026-02-17T11:08:14.471 INFO:tasks.ceph.mon.a:Started 2026-02-17T11:08:14.471 DEBUG:tasks.ceph_manager:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2026-02-17T11:08:14.471 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-17T11:08:14.471 DEBUG:teuthology.orchestra.run.trial097:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2026-02-17T11:08:14.474 INFO:tasks.ceph.mon.b:Started 2026-02-17T11:08:14.474 DEBUG:tasks.ceph_manager:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2026-02-17T11:08:14.474 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-17T11:08:14.475 DEBUG:teuthology.orchestra.run.trial157:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2026-02-17T11:08:14.509 INFO:tasks.ceph.mon.c:Started 2026-02-17T11:08:14.510 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-17T11:08:14.510 INFO:tasks.ceph.mgr.y:Restarting daemon 2026-02-17T11:08:14.510 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2026-02-17T11:08:14.512 INFO:tasks.ceph.mgr.y:Started 2026-02-17T11:08:14.513 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-17T11:08:14.513 DEBUG:teuthology.orchestra.run.trial162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2026-02-17T11:08:14.515 INFO:tasks.ceph.mgr.x:Started 2026-02-17T11:08:14.515 INFO:tasks.ceph:Setting crush tunables to default 2026-02-17T11:08:14.515 DEBUG:teuthology.orchestra.run.trial049:> sudo ceph --cluster ceph osd crush tunables default 2026-02-17T11:08:14.582 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:14.580+0000 7f91eaeb7640 10 monclient: get_monmap_and_config 2026-02-17T11:08:14.582 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:14.580+0000 7f91eaeb7640 10 monclient: build_initial_monmap 2026-02-17T11:08:14.583 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:14.581+0000 7f91eaeb7640 10 monclient: monmap: 2026-02-17T11:08:14.583 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:08:14.583 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:14.583 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:08:14.581532+0000 2026-02-17T11:08:14.583 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:08:14.581532+0000 2026-02-17T11:08:14.583 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:08:14.583 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:08:14.583 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:08:14.583 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:08:14.584 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:08:14.584 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:08:14.584 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:08:14.584 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:08:14.584 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:08:14.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:14.581+0000 7f91eaeb7640 1 Processor -- start 2026-02-17T11:08:14.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:14.581+0000 7f91eaeb7640 1 -- start start 2026-02-17T11:08:14.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:14.581+0000 7f91eaeb7640 10 monclient: init 2026-02-17T11:08:14.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:14.582+0000 7f91eaeb7640 10 monclient: _reopen_session rank -1 2026-02-17T11:08:14.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:14.582+0000 7f91eaeb7640 10 monclient: _add_conns ranks=[5,3,1,2,0,4] 2026-02-17T11:08:14.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:14.582+0000 7f91eaeb7640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f91e40cb350 0x7f91e40cb730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:14.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:14.582+0000 7f91eaeb7640 10 monclient(hunting): picked mon.noname-c con 0x7f91e40cb350 addr v2:10.20.193.157:3300/0 2026-02-17T11:08:14.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:14.582+0000 7f91eaeb7640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f91e40714f0 0x7f91e406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:14.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:14.582+0000 7f91eaeb7640 10 monclient(hunting): picked mon.noname-a con 0x7f91e40714f0 addr v2:10.20.193.49:3300/0 2026-02-17T11:08:14.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:14.582+0000 7f91eaeb7640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f91e40c94a0 addr v1:10.20.193.97:6789/0 2026-02-17T11:08:14.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:14.582+0000 7f91eaeb7640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91e406c930 con 0x7f91e40c94a0 2026-02-17T11:08:14.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:14.582+0000 7f91eaeb7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:14.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:14.582+0000 7f91eaeb7640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f91e406cc60 con 0x7f91e40714f0 2026-02-17T11:08:14.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:14.582+0000 7f91eaeb7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:14.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:14.582+0000 7f91eaeb7640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f91e40cceb0 con 0x7f91e40cb350 2026-02-17T11:08:14.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:14.582+0000 7f91eaeb7640 10 monclient(hunting): _renew_subs 2026-02-17T11:08:14.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:14.582+0000 7f91eaeb7640 10 monclient(hunting): authenticate will time out at 971.245105s 2026-02-17T11:08:14.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:14.582+0000 7f91dbfff640 1 -- >> v2:10.20.193.49:3300/0 conn(0x7f91e40714f0 msgr2=0x7f91e406d0f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.49:3300/0 2026-02-17T11:08:14.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:14.582+0000 7f91dbfff640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f91e40714f0 0x7f91e406d0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:08:14.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:14.584+0000 7f91e8c2c640 1 -- >> v2:10.20.193.157:3300/0 conn(0x7f91e40cb350 msgr2=0x7f91e40cb730 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.157:3300/0 2026-02-17T11:08:14.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:14.584+0000 7f91e8c2c640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f91e40cb350 0x7f91e40cb730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:08:14.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:14.584+0000 7f91e942d640 1 -- >> v1:10.20.193.97:6789/0 conn(0x7f91e40c94a0 legacy=0x7f91e4159220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.97:6789/0 2026-02-17T11:08:14.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:14.783+0000 7f91dbfff640 1 -- >> v2:10.20.193.49:3300/0 conn(0x7f91e40714f0 msgr2=0x7f91e406d0f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.49:3300/0 2026-02-17T11:08:14.785 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:14.783+0000 7f91dbfff640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f91e40714f0 0x7f91e406d0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:08:14.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:14.785+0000 7f91e8c2c640 1 -- >> v2:10.20.193.157:3300/0 conn(0x7f91e40cb350 msgr2=0x7f91e40cb730 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.157:3300/0 2026-02-17T11:08:14.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:14.785+0000 7f91e8c2c640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f91e40cb350 0x7f91e40cb730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:08:14.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:14.785+0000 7f91e942d640 1 -- >> v1:10.20.193.97:6789/0 conn(0x7f91e40c94a0 legacy=0x7f91e4159220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.97:6789/0 2026-02-17T11:08:15.185 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:15.184+0000 7f91dbfff640 1 -- >> v2:10.20.193.49:3300/0 conn(0x7f91e40714f0 msgr2=0x7f91e406d0f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.49:3300/0 2026-02-17T11:08:15.186 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:15.184+0000 7f91dbfff640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f91e40714f0 0x7f91e406d0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:08:15.187 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:15.186+0000 7f91e942d640 1 -- >> v1:10.20.193.97:6789/0 conn(0x7f91e40c94a0 legacy=0x7f91e4159220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.97:6789/0 2026-02-17T11:08:15.187 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:15.186+0000 7f91e8c2c640 1 -- >> v2:10.20.193.157:3300/0 conn(0x7f91e40cb350 msgr2=0x7f91e40cb730 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.157:3300/0 2026-02-17T11:08:15.187 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:15.186+0000 7f91e8c2c640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f91e40cb350 0x7f91e40cb730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:08:15.987 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:15.984+0000 7f91dbfff640 1 -- >> v2:10.20.193.49:3300/0 conn(0x7f91e40714f0 msgr2=0x7f91e406d0f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.49:3300/0 2026-02-17T11:08:15.987 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:15.984+0000 7f91dbfff640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f91e40714f0 0x7f91e406d0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:08:15.988 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:15.986+0000 7f91e8c2c640 1 -- >> v2:10.20.193.157:3300/0 conn(0x7f91e40cb350 msgr2=0x7f91e40cb730 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.157:3300/0 2026-02-17T11:08:15.988 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:15.986+0000 7f91e942d640 1 -- >> v1:10.20.193.97:6789/0 conn(0x7f91e40c94a0 legacy=0x7f91e4159220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.97:6789/0 2026-02-17T11:08:15.989 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:15.986+0000 7f91e8c2c640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f91e40cb350 0x7f91e40cb730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:08:17.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:17.581+0000 7f91da7fc640 10 monclient(hunting): tick 2026-02-17T11:08:17.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:17.581+0000 7f91da7fc640 10 monclient(hunting): _check_auth_tickets 2026-02-17T11:08:17.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:17.581+0000 7f91da7fc640 1 monclient(hunting): continuing hunt 2026-02-17T11:08:17.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:17.581+0000 7f91da7fc640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T11:08:17.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:17.581+0000 7f91da7fc640 1 -- >> v2:10.20.193.157:3300/0 conn(0x7f91e40cb350 msgr2=0x7f91e40cb730 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:08:17.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:17.581+0000 7f91da7fc640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f91e40cb350 0x7f91e40cb730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:17.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:17.581+0000 7f91da7fc640 1 -- >> v2:10.20.193.49:3300/0 conn(0x7f91e40714f0 msgr2=0x7f91e406d0f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:08:17.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:17.581+0000 7f91da7fc640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f91e40714f0 0x7f91e406d0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:17.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:17.581+0000 7f91da7fc640 1 -- >> v1:10.20.193.97:6789/0 conn(0x7f91e40c94a0 legacy=0x7f91e4159220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:08:17.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:17.581+0000 7f91da7fc640 10 monclient: _add_conns ranks=[2,0,4] 2026-02-17T11:08:17.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:17.581+0000 7f91da7fc640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f91c80037c0 addr v1:10.20.193.157:6789/0 2026-02-17T11:08:17.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:17.581+0000 7f91da7fc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f91c8007440 addr v1:10.20.193.49:6789/0 2026-02-17T11:08:17.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:17.581+0000 7f91da7fc640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f91c800b1d0 0x7f91c800d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:17.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:17.581+0000 7f91da7fc640 10 monclient(hunting): picked mon.noname-b con 0x7f91c800b1d0 addr v2:10.20.193.97:3300/0 2026-02-17T11:08:17.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:17.581+0000 7f91da7fc640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91e415cdc0 con 0x7f91c8007440 2026-02-17T11:08:17.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:17.581+0000 7f91da7fc640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91e406c930 con 0x7f91c80037c0 2026-02-17T11:08:17.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:17.581+0000 7f91da7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:17.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:17.581+0000 7f91da7fc640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f91e406cc60 con 0x7f91c800b1d0 2026-02-17T11:08:17.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:17.581+0000 7f91da7fc640 10 monclient(hunting): _renew_subs 2026-02-17T11:08:17.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:17.581+0000 7f91dbfff640 1 -- >> v1:10.20.193.49:6789/0 conn(0x7f91c8007440 legacy=0x7f91c8009900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.49:6789/0 2026-02-17T11:08:17.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:17.581+0000 7f91e942d640 1 -- >> v2:10.20.193.97:3300/0 conn(0x7f91c800b1d0 msgr2=0x7f91c800d690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.97:3300/0 2026-02-17T11:08:17.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:17.581+0000 7f91e8c2c640 1 -- >> v1:10.20.193.157:6789/0 conn(0x7f91c80037c0 legacy=0x7f91c8005c10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.157:6789/0 2026-02-17T11:08:17.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:17.581+0000 7f91e942d640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f91c800b1d0 0x7f91c800d690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:08:17.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:17.782+0000 7f91dbfff640 1 -- >> v1:10.20.193.49:6789/0 conn(0x7f91c8007440 legacy=0x7f91c8009900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.49:6789/0 2026-02-17T11:08:17.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:17.782+0000 7f91e942d640 1 -- >> v2:10.20.193.97:3300/0 conn(0x7f91c800b1d0 msgr2=0x7f91c800d690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.97:3300/0 2026-02-17T11:08:17.785 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:17.782+0000 7f91e8c2c640 1 -- >> v1:10.20.193.157:6789/0 conn(0x7f91c80037c0 legacy=0x7f91c8005c10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.157:6789/0 2026-02-17T11:08:17.785 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:17.782+0000 7f91e942d640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f91c800b1d0 0x7f91c800d690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:08:18.185 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:18.183+0000 7f91dbfff640 1 -- >> v1:10.20.193.49:6789/0 conn(0x7f91c8007440 legacy=0x7f91c8009900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.49:6789/0 2026-02-17T11:08:18.186 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:18.183+0000 7f91e8c2c640 1 -- >> v1:10.20.193.157:6789/0 conn(0x7f91c80037c0 legacy=0x7f91c8005c10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.157:6789/0 2026-02-17T11:08:18.186 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:18.183+0000 7f91e942d640 1 -- >> v2:10.20.193.97:3300/0 conn(0x7f91c800b1d0 msgr2=0x7f91c800d690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.97:3300/0 2026-02-17T11:08:18.186 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:18.183+0000 7f91e942d640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f91c800b1d0 0x7f91c800d690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:08:18.986 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:18.984+0000 7f91dbfff640 1 -- >> v1:10.20.193.49:6789/0 conn(0x7f91c8007440 legacy=0x7f91c8009900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.49:6789/0 2026-02-17T11:08:18.986 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:18.984+0000 7f91e8c2c640 1 -- >> v1:10.20.193.157:6789/0 conn(0x7f91c80037c0 legacy=0x7f91c8005c10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.157:6789/0 2026-02-17T11:08:18.986 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:18.984+0000 7f91e942d640 1 -- >> v2:10.20.193.97:3300/0 conn(0x7f91c800b1d0 msgr2=0x7f91c800d690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.97:3300/0 2026-02-17T11:08:18.986 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:18.984+0000 7f91e942d640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f91c800b1d0 0x7f91c800d690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:08:20.583 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:20.581+0000 7f91da7fc640 10 monclient(hunting): tick 2026-02-17T11:08:20.583 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:20.581+0000 7f91da7fc640 10 monclient(hunting): _check_auth_tickets 2026-02-17T11:08:20.583 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:20.581+0000 7f91da7fc640 1 monclient(hunting): continuing hunt 2026-02-17T11:08:20.583 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:20.581+0000 7f91da7fc640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T11:08:20.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:20.581+0000 7f91da7fc640 1 -- >> v2:10.20.193.97:3300/0 conn(0x7f91c800b1d0 msgr2=0x7f91c800d690 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:08:20.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:20.581+0000 7f91da7fc640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f91c800b1d0 0x7f91c800d690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:20.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:20.581+0000 7f91da7fc640 1 -- >> v1:10.20.193.157:6789/0 conn(0x7f91c80037c0 legacy=0x7f91c8005c10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:08:20.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:20.581+0000 7f91da7fc640 1 -- >> v1:10.20.193.49:6789/0 conn(0x7f91c8007440 legacy=0x7f91c8009900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:08:20.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:20.581+0000 7f91e942d640 1 -- reap_dead start 2026-02-17T11:08:20.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:20.581+0000 7f91da7fc640 10 monclient: _add_conns ranks=[2,4,1,5,3,0] 2026-02-17T11:08:20.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:20.581+0000 7f91da7fc640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f91c8006340 addr v1:10.20.193.157:6789/0 2026-02-17T11:08:20.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:20.581+0000 7f91da7fc640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f91c8006ed0 0x7f91c8005bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:20.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:20.581+0000 7f91da7fc640 10 monclient(hunting): picked mon.noname-b con 0x7f91c8006ed0 addr v2:10.20.193.97:3300/0 2026-02-17T11:08:20.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:20.581+0000 7f91da7fc640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f91c800c690 addr v1:10.20.193.97:6789/0 2026-02-17T11:08:20.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:20.581+0000 7f91da7fc640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91c800ff10 con 0x7f91c800c690 2026-02-17T11:08:20.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:20.581+0000 7f91da7fc640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91e415cdc0 con 0x7f91c8006340 2026-02-17T11:08:20.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:20.581+0000 7f91da7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:20.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:20.581+0000 7f91da7fc640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f91e406cc60 con 0x7f91c8006ed0 2026-02-17T11:08:20.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:20.581+0000 7f91da7fc640 10 monclient(hunting): _renew_subs 2026-02-17T11:08:20.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:20.581+0000 7f91e942d640 1 -- >> v1:10.20.193.97:6789/0 conn(0x7f91c800c690 legacy=0x7f91c800cb40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.97:6789/0 2026-02-17T11:08:20.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:20.581+0000 7f91e8c2c640 1 -- >> v1:10.20.193.157:6789/0 conn(0x7f91c8006340 legacy=0x7f91c8006720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.157:6789/0 2026-02-17T11:08:20.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:20.581+0000 7f91dbfff640 1 -- >> v2:10.20.193.97:3300/0 conn(0x7f91c8006ed0 msgr2=0x7f91c8005bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.97:3300/0 2026-02-17T11:08:20.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:20.581+0000 7f91dbfff640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f91c8006ed0 0x7f91c8005bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:08:20.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:20.782+0000 7f91e942d640 1 -- >> v1:10.20.193.97:6789/0 conn(0x7f91c800c690 legacy=0x7f91c800cb40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.97:6789/0 2026-02-17T11:08:20.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:20.782+0000 7f91dbfff640 1 -- >> v2:10.20.193.97:3300/0 conn(0x7f91c8006ed0 msgr2=0x7f91c8005bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.97:3300/0 2026-02-17T11:08:20.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:20.782+0000 7f91dbfff640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f91c8006ed0 0x7f91c8005bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:08:20.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:20.782+0000 7f91e8c2c640 1 -- >> v1:10.20.193.157:6789/0 conn(0x7f91c8006340 legacy=0x7f91c8006720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.157:6789/0 2026-02-17T11:08:21.185 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:21.183+0000 7f91dbfff640 1 -- >> v2:10.20.193.97:3300/0 conn(0x7f91c8006ed0 msgr2=0x7f91c8005bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.97:3300/0 2026-02-17T11:08:21.186 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:21.183+0000 7f91e8c2c640 1 -- >> v1:10.20.193.157:6789/0 conn(0x7f91c8006340 legacy=0x7f91c8006720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.157:6789/0 2026-02-17T11:08:21.186 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:21.183+0000 7f91e942d640 1 -- >> v1:10.20.193.97:6789/0 conn(0x7f91c800c690 legacy=0x7f91c800cb40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.97:6789/0 2026-02-17T11:08:21.186 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:21.183+0000 7f91dbfff640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f91c8006ed0 0x7f91c8005bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:08:21.986 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:21.984+0000 7f91dbfff640 1 -- >> v2:10.20.193.97:3300/0 conn(0x7f91c8006ed0 msgr2=0x7f91c8005bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.97:3300/0 2026-02-17T11:08:21.987 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:21.984+0000 7f91e8c2c640 1 -- >> v1:10.20.193.157:6789/0 conn(0x7f91c8006340 legacy=0x7f91c8006720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.157:6789/0 2026-02-17T11:08:21.987 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:21.984+0000 7f91dbfff640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f91c8006ed0 0x7f91c8005bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:08:21.987 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:21.984+0000 7f91e942d640 1 -- >> v1:10.20.193.97:6789/0 conn(0x7f91c800c690 legacy=0x7f91c800cb40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.97:6789/0 2026-02-17T11:08:23.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:23.581+0000 7f91da7fc640 10 monclient(hunting): tick 2026-02-17T11:08:23.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:23.581+0000 7f91da7fc640 10 monclient(hunting): _check_auth_tickets 2026-02-17T11:08:23.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:23.581+0000 7f91da7fc640 1 monclient(hunting): continuing hunt 2026-02-17T11:08:23.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:23.581+0000 7f91da7fc640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T11:08:23.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:23.581+0000 7f91da7fc640 1 -- >> v2:10.20.193.97:3300/0 conn(0x7f91c8006ed0 msgr2=0x7f91c8005bb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:08:23.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:23.581+0000 7f91da7fc640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f91c8006ed0 0x7f91c8005bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:23.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:23.581+0000 7f91da7fc640 1 -- >> v1:10.20.193.157:6789/0 conn(0x7f91c8006340 legacy=0x7f91c8006720 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:08:23.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:23.581+0000 7f91da7fc640 1 -- >> v1:10.20.193.97:6789/0 conn(0x7f91c800c690 legacy=0x7f91c800cb40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:08:23.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:23.581+0000 7f91da7fc640 10 monclient: _add_conns ranks=[5,3,0] 2026-02-17T11:08:23.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:23.581+0000 7f91da7fc640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f91c800d3f0 0x7f91c8015270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:23.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:23.581+0000 7f91da7fc640 10 monclient(hunting): picked mon.noname-c con 0x7f91c800d3f0 addr v2:10.20.193.157:3300/0 2026-02-17T11:08:23.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:23.581+0000 7f91da7fc640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f91c80157b0 0x7f91c8017ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:23.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:23.581+0000 7f91da7fc640 10 monclient(hunting): picked mon.noname-a con 0x7f91c80157b0 addr v2:10.20.193.49:3300/0 2026-02-17T11:08:23.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:23.581+0000 7f91da7fc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f91c8007440 addr v1:10.20.193.49:6789/0 2026-02-17T11:08:23.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:23.581+0000 7f91da7fc640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91e406c930 con 0x7f91c8007440 2026-02-17T11:08:23.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:23.581+0000 7f91da7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:23.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:23.581+0000 7f91da7fc640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f91e406cc60 con 0x7f91c80157b0 2026-02-17T11:08:23.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:23.581+0000 7f91da7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:23.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:23.581+0000 7f91da7fc640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f91e40cceb0 con 0x7f91c800d3f0 2026-02-17T11:08:23.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:23.581+0000 7f91da7fc640 10 monclient(hunting): _renew_subs 2026-02-17T11:08:23.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:23.581+0000 7f91dbfff640 1 -- >> v2:10.20.193.49:3300/0 conn(0x7f91c80157b0 msgr2=0x7f91c8017ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.49:3300/0 2026-02-17T11:08:23.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:23.581+0000 7f91e942d640 1 -- >> v1:10.20.193.49:6789/0 conn(0x7f91c8007440 legacy=0x7f91c8009900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.49:6789/0 2026-02-17T11:08:23.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:23.581+0000 7f91dbfff640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f91c80157b0 0x7f91c8017ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:08:23.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:23.581+0000 7f91e8c2c640 1 -- >> v2:10.20.193.157:3300/0 conn(0x7f91c800d3f0 msgr2=0x7f91c8015270 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.157:3300/0 2026-02-17T11:08:23.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:23.581+0000 7f91e8c2c640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f91c800d3f0 0x7f91c8015270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:08:23.785 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:23.782+0000 7f91dbfff640 1 -- >> v2:10.20.193.49:3300/0 conn(0x7f91c80157b0 msgr2=0x7f91c8017ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.49:3300/0 2026-02-17T11:08:23.785 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:23.782+0000 7f91e942d640 1 -- >> v1:10.20.193.49:6789/0 conn(0x7f91c8007440 legacy=0x7f91c8009900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.49:6789/0 2026-02-17T11:08:23.785 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:23.782+0000 7f91dbfff640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f91c80157b0 0x7f91c8017ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:08:23.785 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:23.782+0000 7f91e8c2c640 1 -- >> v2:10.20.193.157:3300/0 conn(0x7f91c800d3f0 msgr2=0x7f91c8015270 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.157:3300/0 2026-02-17T11:08:23.785 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:23.782+0000 7f91e8c2c640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f91c800d3f0 0x7f91c8015270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:08:24.185 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:24.183+0000 7f91dbfff640 1 -- >> v2:10.20.193.49:3300/0 conn(0x7f91c80157b0 msgr2=0x7f91c8017ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.49:3300/0 2026-02-17T11:08:24.186 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:24.183+0000 7f91dbfff640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f91c80157b0 0x7f91c8017ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:08:24.186 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:24.183+0000 7f91e942d640 1 -- >> v1:10.20.193.49:6789/0 conn(0x7f91c8007440 legacy=0x7f91c8009900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.49:6789/0 2026-02-17T11:08:24.186 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:24.183+0000 7f91e8c2c640 1 -- >> v2:10.20.193.157:3300/0 conn(0x7f91c800d3f0 msgr2=0x7f91c8015270 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.157:3300/0 2026-02-17T11:08:24.186 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:24.183+0000 7f91e8c2c640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f91c800d3f0 0x7f91c8015270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:08:24.986 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:24.984+0000 7f91dbfff640 1 -- >> v2:10.20.193.49:3300/0 conn(0x7f91c80157b0 msgr2=0x7f91c8017ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.49:3300/0 2026-02-17T11:08:24.986 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:24.984+0000 7f91e942d640 1 -- >> v1:10.20.193.49:6789/0 conn(0x7f91c8007440 legacy=0x7f91c8009900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.49:6789/0 2026-02-17T11:08:24.986 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:24.984+0000 7f91dbfff640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f91c80157b0 0x7f91c8017ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:08:24.986 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:24.984+0000 7f91e8c2c640 1 -- >> v2:10.20.193.157:3300/0 conn(0x7f91c800d3f0 msgr2=0x7f91c8015270 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.157:3300/0 2026-02-17T11:08:24.986 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:24.984+0000 7f91e8c2c640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f91c800d3f0 0x7f91c8015270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:08:25.011 INFO:tasks.ceph.mon.b.trial097.stderr:--00:00:00:10.487 44633-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/47/c8811f81c8519af972c31a943fbe60655b3649.debug 2026-02-17T11:08:25.012 INFO:tasks.ceph.mon.a.trial049.stderr:--00:00:00:10.494 44972-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/47/c8811f81c8519af972c31a943fbe60655b3649.debug 2026-02-17T11:08:25.119 INFO:tasks.ceph.mon.c.trial157.stderr:--00:00:00:10.560 44061-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/47/c8811f81c8519af972c31a943fbe60655b3649.debug 2026-02-17T11:08:26.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:26.581+0000 7f91da7fc640 10 monclient(hunting): tick 2026-02-17T11:08:26.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:26.581+0000 7f91da7fc640 10 monclient(hunting): _check_auth_tickets 2026-02-17T11:08:26.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:26.581+0000 7f91da7fc640 1 monclient(hunting): continuing hunt 2026-02-17T11:08:26.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:26.581+0000 7f91da7fc640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T11:08:26.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:26.581+0000 7f91da7fc640 1 -- >> v2:10.20.193.157:3300/0 conn(0x7f91c800d3f0 msgr2=0x7f91c8015270 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:08:26.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:26.581+0000 7f91da7fc640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f91c800d3f0 0x7f91c8015270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:26.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:26.581+0000 7f91da7fc640 1 -- >> v2:10.20.193.49:3300/0 conn(0x7f91c80157b0 msgr2=0x7f91c8017ba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:08:26.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:26.581+0000 7f91da7fc640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f91c80157b0 0x7f91c8017ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:26.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:26.581+0000 7f91da7fc640 1 -- >> v1:10.20.193.49:6789/0 conn(0x7f91c8007440 legacy=0x7f91c8009900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:08:26.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:26.581+0000 7f91e942d640 1 -- reap_dead start 2026-02-17T11:08:26.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:26.581+0000 7f91da7fc640 10 monclient: _add_conns ranks=[3,1,5,4,2,0] 2026-02-17T11:08:26.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:26.581+0000 7f91e942d640 1 -- reap_dead start 2026-02-17T11:08:26.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:26.581+0000 7f91da7fc640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f91c8006ed0 0x7f91c800cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:26.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:26.581+0000 7f91da7fc640 10 monclient(hunting): picked mon.noname-a con 0x7f91c8006ed0 addr v2:10.20.193.49:3300/0 2026-02-17T11:08:26.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:26.581+0000 7f91da7fc640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f91c8006340 addr v1:10.20.193.97:6789/0 2026-02-17T11:08:26.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:26.581+0000 7f91da7fc640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f91c8005bb0 0x7f91c8017ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:26.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:26.581+0000 7f91da7fc640 10 monclient(hunting): picked mon.noname-c con 0x7f91c8005bb0 addr v2:10.20.193.157:3300/0 2026-02-17T11:08:26.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:26.581+0000 7f91da7fc640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91c800ff10 con 0x7f91c8006340 2026-02-17T11:08:26.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:26.581+0000 7f91da7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:26.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:26.581+0000 7f91da7fc640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f91e406cc60 con 0x7f91c8006ed0 2026-02-17T11:08:26.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:26.581+0000 7f91da7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:26.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:26.581+0000 7f91da7fc640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f91e40cceb0 con 0x7f91c8005bb0 2026-02-17T11:08:26.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:26.581+0000 7f91da7fc640 10 monclient(hunting): _renew_subs 2026-02-17T11:08:26.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:26.581+0000 7f91e8c2c640 1 -- >> v2:10.20.193.49:3300/0 conn(0x7f91c8006ed0 msgr2=0x7f91c800cb40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.49:3300/0 2026-02-17T11:08:26.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:26.581+0000 7f91e8c2c640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f91c8006ed0 0x7f91c800cb40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:08:26.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:26.581+0000 7f91dbfff640 1 -- >> v1:10.20.193.97:6789/0 conn(0x7f91c8006340 legacy=0x7f91c8006720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.97:6789/0 2026-02-17T11:08:26.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:26.581+0000 7f91e942d640 1 -- >> v2:10.20.193.157:3300/0 conn(0x7f91c8005bb0 msgr2=0x7f91c8017ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.157:3300/0 2026-02-17T11:08:26.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:26.581+0000 7f91e942d640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f91c8005bb0 0x7f91c8017ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:08:26.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:26.782+0000 7f91e8c2c640 1 -- >> v2:10.20.193.49:3300/0 conn(0x7f91c8006ed0 msgr2=0x7f91c800cb40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.49:3300/0 2026-02-17T11:08:26.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:26.782+0000 7f91e8c2c640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f91c8006ed0 0x7f91c800cb40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:08:26.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:26.782+0000 7f91e942d640 1 -- >> v2:10.20.193.157:3300/0 conn(0x7f91c8005bb0 msgr2=0x7f91c8017ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.157:3300/0 2026-02-17T11:08:26.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:26.782+0000 7f91dbfff640 1 -- >> v1:10.20.193.97:6789/0 conn(0x7f91c8006340 legacy=0x7f91c8006720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.97:6789/0 2026-02-17T11:08:26.785 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:26.782+0000 7f91e942d640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f91c8005bb0 0x7f91c8017ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:08:27.186 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:27.183+0000 7f91e8c2c640 1 -- >> v2:10.20.193.49:3300/0 conn(0x7f91c8006ed0 msgr2=0x7f91c800cb40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.49:3300/0 2026-02-17T11:08:27.186 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:27.183+0000 7f91e8c2c640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f91c8006ed0 0x7f91c800cb40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:08:27.186 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:27.183+0000 7f91dbfff640 1 -- >> v1:10.20.193.97:6789/0 conn(0x7f91c8006340 legacy=0x7f91c8006720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.97:6789/0 2026-02-17T11:08:27.186 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:27.183+0000 7f91e942d640 1 -- >> v2:10.20.193.157:3300/0 conn(0x7f91c8005bb0 msgr2=0x7f91c8017ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.157:3300/0 2026-02-17T11:08:27.186 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:27.183+0000 7f91e942d640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f91c8005bb0 0x7f91c8017ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:08:27.987 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:27.984+0000 7f91e8c2c640 1 -- >> v2:10.20.193.49:3300/0 conn(0x7f91c8006ed0 msgr2=0x7f91c800cb40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.49:3300/0 2026-02-17T11:08:27.987 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:27.984+0000 7f91e8c2c640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f91c8006ed0 0x7f91c800cb40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:08:27.987 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:27.984+0000 7f91e942d640 1 -- >> v2:10.20.193.157:3300/0 conn(0x7f91c8005bb0 msgr2=0x7f91c8017ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.157:3300/0 2026-02-17T11:08:27.987 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:27.984+0000 7f91e942d640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f91c8005bb0 0x7f91c8017ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:08:27.987 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:27.984+0000 7f91dbfff640 1 -- >> v1:10.20.193.97:6789/0 conn(0x7f91c8006340 legacy=0x7f91c8006720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.97:6789/0 2026-02-17T11:08:29.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:29.581+0000 7f91da7fc640 10 monclient(hunting): tick 2026-02-17T11:08:29.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:29.581+0000 7f91da7fc640 10 monclient(hunting): _check_auth_tickets 2026-02-17T11:08:29.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:29.581+0000 7f91da7fc640 1 monclient(hunting): continuing hunt 2026-02-17T11:08:29.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:29.581+0000 7f91da7fc640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T11:08:29.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:29.581+0000 7f91da7fc640 1 -- >> v2:10.20.193.157:3300/0 conn(0x7f91c8005bb0 msgr2=0x7f91c8017ba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:08:29.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:29.581+0000 7f91da7fc640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f91c8005bb0 0x7f91c8017ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:29.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:29.581+0000 7f91da7fc640 1 -- >> v2:10.20.193.49:3300/0 conn(0x7f91c8006ed0 msgr2=0x7f91c800cb40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:08:29.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:29.581+0000 7f91da7fc640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f91c8006ed0 0x7f91c800cb40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:29.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:29.581+0000 7f91da7fc640 1 -- >> v1:10.20.193.97:6789/0 conn(0x7f91c8006340 legacy=0x7f91c8006720 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:08:29.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:29.581+0000 7f91da7fc640 10 monclient: _add_conns ranks=[4,2,0] 2026-02-17T11:08:29.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:29.581+0000 7f91da7fc640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f91c8007440 0x7f91c80098e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:29.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:29.581+0000 7f91da7fc640 10 monclient(hunting): picked mon.noname-b con 0x7f91c8007440 addr v2:10.20.193.97:3300/0 2026-02-17T11:08:29.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:29.581+0000 7f91da7fc640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f91c800a0b0 addr v1:10.20.193.157:6789/0 2026-02-17T11:08:29.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:29.581+0000 7f91da7fc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f91c800abd0 addr v1:10.20.193.49:6789/0 2026-02-17T11:08:29.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:29.581+0000 7f91da7fc640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91e406c930 con 0x7f91c800abd0 2026-02-17T11:08:29.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:29.581+0000 7f91da7fc640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91c800ff10 con 0x7f91c800a0b0 2026-02-17T11:08:29.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:29.581+0000 7f91da7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:29.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:29.581+0000 7f91da7fc640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f91e406cc60 con 0x7f91c8007440 2026-02-17T11:08:29.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:29.581+0000 7f91da7fc640 10 monclient(hunting): _renew_subs 2026-02-17T11:08:29.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:29.581+0000 7f91e942d640 1 -- >> v1:10.20.193.49:6789/0 conn(0x7f91c800abd0 legacy=0x7f91c8018120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.49:6789/0 2026-02-17T11:08:29.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:29.581+0000 7f91e8c2c640 1 -- >> v2:10.20.193.97:3300/0 conn(0x7f91c8007440 msgr2=0x7f91c80098e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.97:3300/0 2026-02-17T11:08:29.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:29.581+0000 7f91dbfff640 1 -- >> v1:10.20.193.157:6789/0 conn(0x7f91c800a0b0 legacy=0x7f91c800a4c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.157:6789/0 2026-02-17T11:08:29.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:29.581+0000 7f91e8c2c640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f91c8007440 0x7f91c80098e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:08:29.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:29.782+0000 7f91e942d640 1 -- >> v1:10.20.193.49:6789/0 conn(0x7f91c800abd0 legacy=0x7f91c8018120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.49:6789/0 2026-02-17T11:08:29.785 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:29.782+0000 7f91dbfff640 1 -- >> v1:10.20.193.157:6789/0 conn(0x7f91c800a0b0 legacy=0x7f91c800a4c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.157:6789/0 2026-02-17T11:08:29.785 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:29.782+0000 7f91e8c2c640 1 -- >> v2:10.20.193.97:3300/0 conn(0x7f91c8007440 msgr2=0x7f91c80098e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.97:3300/0 2026-02-17T11:08:29.785 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:29.782+0000 7f91e8c2c640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f91c8007440 0x7f91c80098e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:08:30.184 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:30.183+0000 7f91e942d640 1 -- >> v1:10.20.193.49:6789/0 conn(0x7f91c800abd0 legacy=0x7f91c8018120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.49:6789/0 2026-02-17T11:08:30.185 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:30.183+0000 7f91e8c2c640 1 -- >> v2:10.20.193.97:3300/0 conn(0x7f91c8007440 msgr2=0x7f91c80098e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.97:3300/0 2026-02-17T11:08:30.185 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:30.183+0000 7f91e8c2c640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f91c8007440 0x7f91c80098e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:08:30.185 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:30.183+0000 7f91dbfff640 1 -- >> v1:10.20.193.157:6789/0 conn(0x7f91c800a0b0 legacy=0x7f91c800a4c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.157:6789/0 2026-02-17T11:08:30.614 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:00:16.095 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:08:30.630 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:00:16.106 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:08:30.740 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:00:16.182 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:08:30.763 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:00:16.244 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:08:30.780 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:00:16.257 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:08:30.891 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:00:16.332 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:08:30.985 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:30.984+0000 7f91e942d640 1 -- >> v1:10.20.193.49:6789/0 conn(0x7f91c800abd0 legacy=0x7f91c8018120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.49:6789/0 2026-02-17T11:08:30.986 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:30.984+0000 7f91e8c2c640 1 -- >> v2:10.20.193.97:3300/0 conn(0x7f91c8007440 msgr2=0x7f91c80098e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.97:3300/0 2026-02-17T11:08:30.986 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:30.984+0000 7f91e8c2c640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f91c8007440 0x7f91c80098e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:08:30.986 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:30.984+0000 7f91dbfff640 1 -- >> v1:10.20.193.157:6789/0 conn(0x7f91c800a0b0 legacy=0x7f91c800a4c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.157:6789/0 2026-02-17T11:08:32.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.582+0000 7f91da7fc640 10 monclient(hunting): tick 2026-02-17T11:08:32.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.582+0000 7f91da7fc640 10 monclient(hunting): _check_auth_tickets 2026-02-17T11:08:32.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.582+0000 7f91da7fc640 1 monclient(hunting): continuing hunt 2026-02-17T11:08:32.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.582+0000 7f91da7fc640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T11:08:32.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.582+0000 7f91da7fc640 1 -- >> v2:10.20.193.97:3300/0 conn(0x7f91c8007440 msgr2=0x7f91c80098e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:08:32.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.582+0000 7f91da7fc640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f91c8007440 0x7f91c80098e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:32.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.582+0000 7f91da7fc640 1 -- >> v1:10.20.193.157:6789/0 conn(0x7f91c800a0b0 legacy=0x7f91c800a4c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:08:32.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.582+0000 7f91da7fc640 1 -- >> v1:10.20.193.49:6789/0 conn(0x7f91c800abd0 legacy=0x7f91c8018120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:08:32.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.582+0000 7f91e942d640 1 -- reap_dead start 2026-02-17T11:08:32.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.582+0000 7f91da7fc640 10 monclient: _add_conns ranks=[3,0,4,5,1,2] 2026-02-17T11:08:32.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.582+0000 7f91e942d640 1 -- reap_dead start 2026-02-17T11:08:32.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.582+0000 7f91da7fc640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f91c8006ed0 0x7f91c800cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:32.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.582+0000 7f91da7fc640 10 monclient(hunting): picked mon.noname-a con 0x7f91c8006ed0 addr v2:10.20.193.49:3300/0 2026-02-17T11:08:32.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.582+0000 7f91da7fc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f91c8006340 addr v1:10.20.193.49:6789/0 2026-02-17T11:08:32.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.582+0000 7f91da7fc640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f91c8005bb0 0x7f91c8017ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:32.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.582+0000 7f91da7fc640 10 monclient(hunting): picked mon.noname-b con 0x7f91c8005bb0 addr v2:10.20.193.97:3300/0 2026-02-17T11:08:32.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.582+0000 7f91da7fc640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91e415cdc0 con 0x7f91c8006340 2026-02-17T11:08:32.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.582+0000 7f91da7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:32.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.582+0000 7f91da7fc640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f91e406cc60 con 0x7f91c8006ed0 2026-02-17T11:08:32.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.582+0000 7f91da7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:32.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.582+0000 7f91da7fc640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f91e40cceb0 con 0x7f91c8005bb0 2026-02-17T11:08:32.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.582+0000 7f91da7fc640 10 monclient(hunting): _renew_subs 2026-02-17T11:08:32.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.587+0000 7f91e942d640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f91c8005bb0 0x7f91c8017ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:32.589 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.588+0000 7f91e8c2c640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f91c8006ed0 0x7f91c800cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:32.590 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.589+0000 7f91e942d640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f91c8005bb0 0x7f91c8017ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:36012/0 (socket says 10.20.193.49:36012) 2026-02-17T11:08:32.590 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.589+0000 7f91e942d640 1 -- 10.20.193.49:0/582980728 learned_addr learned my addr 10.20.193.49:0/582980728 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:08:32.590 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.589+0000 7f91e942d640 10 monclient(hunting): get_auth_request con 0x7f91c8005bb0 auth_method 0 2026-02-17T11:08:32.590 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.589+0000 7f91e942d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:32.590 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.589+0000 7f91e942d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:32.590 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.589+0000 7f91e942d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:32.590 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.589+0000 7f91e8c2c640 10 monclient(hunting): get_auth_request con 0x7f91c8006ed0 auth_method 0 2026-02-17T11:08:32.590 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.589+0000 7f91e8c2c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:32.590 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.589+0000 7f91e8c2c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:32.590 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.589+0000 7f91e8c2c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:32.590 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.589+0000 7f91e8c2c640 1 -- 10.20.193.49:0/582980728 >> v2:10.20.193.49:3300/0 conn(0x7f91c8006ed0 msgr2=0x7f91c800cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:08:32.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.589+0000 7f91e8c2c640 1 -- 10.20.193.49:0/582980728 >> v2:10.20.193.49:3300/0 conn(0x7f91c8006ed0 msgr2=0x7f91c800cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:08:32.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.589+0000 7f91e8c2c640 1 --2- 10.20.193.49:0/582980728 >> v2:10.20.193.49:3300/0 conn(0x7f91c8006ed0 0x7f91c800cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:08:32.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.589+0000 7f91e8c2c640 1 --2- 10.20.193.49:0/582980728 >> v2:10.20.193.49:3300/0 conn(0x7f91c8006ed0 0x7f91c800cb40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:08:32.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.590+0000 7f91e942d640 1 -- 10.20.193.49:0/582980728 >> v2:10.20.193.97:3300/0 conn(0x7f91c8005bb0 msgr2=0x7f91c8017ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T11:08:32.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.590+0000 7f91e942d640 1 -- 10.20.193.49:0/582980728 >> v2:10.20.193.97:3300/0 conn(0x7f91c8005bb0 msgr2=0x7f91c8017ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:08:32.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.590+0000 7f91e942d640 1 --2- 10.20.193.49:0/582980728 >> v2:10.20.193.97:3300/0 conn(0x7f91c8005bb0 0x7f91c8017ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:08:32.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.590+0000 7f91e942d640 1 --2- 10.20.193.49:0/582980728 >> v2:10.20.193.97:3300/0 conn(0x7f91c8005bb0 0x7f91c8017ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:08:32.792 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.790+0000 7f91e8c2c640 1 --2- 10.20.193.49:0/582980728 >> v2:10.20.193.49:3300/0 conn(0x7f91c8006ed0 0x7f91c800cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:32.792 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.790+0000 7f91e8c2c640 10 monclient(hunting): get_auth_request con 0x7f91c8006ed0 auth_method 0 2026-02-17T11:08:32.793 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.790+0000 7f91e8c2c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:32.793 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.790+0000 7f91e8c2c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:32.793 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.790+0000 7f91e8c2c640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:08:32.793 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.791+0000 7f91e8c2c640 1 -- 10.20.193.49:0/582980728 >> v2:10.20.193.49:3300/0 conn(0x7f91c8006ed0 msgr2=0x7f91c800cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:08:32.793 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.791+0000 7f91e8c2c640 1 -- 10.20.193.49:0/582980728 >> v2:10.20.193.49:3300/0 conn(0x7f91c8006ed0 msgr2=0x7f91c800cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:08:32.793 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.791+0000 7f91e8c2c640 1 --2- 10.20.193.49:0/582980728 >> v2:10.20.193.49:3300/0 conn(0x7f91c8006ed0 0x7f91c800cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:08:32.793 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.791+0000 7f91e8c2c640 1 --2- 10.20.193.49:0/582980728 >> v2:10.20.193.49:3300/0 conn(0x7f91c8006ed0 0x7f91c800cb40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:08:32.797 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.795+0000 7f91e942d640 1 --2- 10.20.193.49:0/582980728 >> v2:10.20.193.97:3300/0 conn(0x7f91c8005bb0 0x7f91c8017ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:32.797 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.796+0000 7f91e942d640 10 monclient(hunting): get_auth_request con 0x7f91c8005bb0 auth_method 0 2026-02-17T11:08:32.797 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.796+0000 7f91e942d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:32.797 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.796+0000 7f91e942d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:32.797 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.796+0000 7f91e942d640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:08:32.798 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.796+0000 7f91e942d640 1 -- 10.20.193.49:0/582980728 >> v2:10.20.193.97:3300/0 conn(0x7f91c8005bb0 msgr2=0x7f91c8017ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T11:08:32.798 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.796+0000 7f91e942d640 1 -- 10.20.193.49:0/582980728 >> v2:10.20.193.97:3300/0 conn(0x7f91c8005bb0 msgr2=0x7f91c8017ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:08:32.798 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.796+0000 7f91e942d640 1 --2- 10.20.193.49:0/582980728 >> v2:10.20.193.97:3300/0 conn(0x7f91c8005bb0 0x7f91c8017ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:08:32.798 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:32.796+0000 7f91e942d640 1 --2- 10.20.193.49:0/582980728 >> v2:10.20.193.97:3300/0 conn(0x7f91c8005bb0 0x7f91c8017ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:08:33.194 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:33.192+0000 7f91e8c2c640 1 --2- 10.20.193.49:0/582980728 >> v2:10.20.193.49:3300/0 conn(0x7f91c8006ed0 0x7f91c800cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:33.194 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:33.192+0000 7f91e8c2c640 10 monclient(hunting): get_auth_request con 0x7f91c8006ed0 auth_method 0 2026-02-17T11:08:33.194 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:33.192+0000 7f91e8c2c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:33.194 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:33.192+0000 7f91e8c2c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:33.195 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:33.192+0000 7f91e8c2c640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:08:33.195 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:33.192+0000 7f91e8c2c640 1 -- 10.20.193.49:0/582980728 >> v2:10.20.193.49:3300/0 conn(0x7f91c8006ed0 msgr2=0x7f91c800cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:08:33.195 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:33.192+0000 7f91e8c2c640 1 -- 10.20.193.49:0/582980728 >> v2:10.20.193.49:3300/0 conn(0x7f91c8006ed0 msgr2=0x7f91c800cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:08:33.195 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:33.192+0000 7f91e8c2c640 1 --2- 10.20.193.49:0/582980728 >> v2:10.20.193.49:3300/0 conn(0x7f91c8006ed0 0x7f91c800cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:08:33.195 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:33.192+0000 7f91e8c2c640 1 --2- 10.20.193.49:0/582980728 >> v2:10.20.193.49:3300/0 conn(0x7f91c8006ed0 0x7f91c800cb40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:08:33.199 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:33.197+0000 7f91e942d640 1 --2- 10.20.193.49:0/582980728 >> v2:10.20.193.97:3300/0 conn(0x7f91c8005bb0 0x7f91c8017ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:33.199 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:33.197+0000 7f91e942d640 10 monclient(hunting): get_auth_request con 0x7f91c8005bb0 auth_method 0 2026-02-17T11:08:33.199 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:33.197+0000 7f91e942d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:33.199 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:33.197+0000 7f91e942d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:33.199 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:33.197+0000 7f91e942d640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:08:33.199 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:33.198+0000 7f91e942d640 1 -- 10.20.193.49:0/582980728 >> v2:10.20.193.97:3300/0 conn(0x7f91c8005bb0 msgr2=0x7f91c8017ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:08:33.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:33.198+0000 7f91e942d640 1 -- 10.20.193.49:0/582980728 >> v2:10.20.193.97:3300/0 conn(0x7f91c8005bb0 msgr2=0x7f91c8017ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:08:33.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:33.198+0000 7f91e942d640 1 --2- 10.20.193.49:0/582980728 >> v2:10.20.193.97:3300/0 conn(0x7f91c8005bb0 0x7f91c8017ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:08:33.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:33.198+0000 7f91e942d640 1 --2- 10.20.193.49:0/582980728 >> v2:10.20.193.97:3300/0 conn(0x7f91c8005bb0 0x7f91c8017ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:08:33.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:33.994+0000 7f91e8c2c640 1 --2- 10.20.193.49:0/582980728 >> v2:10.20.193.49:3300/0 conn(0x7f91c8006ed0 0x7f91c800cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:33.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:33.994+0000 7f91e8c2c640 10 monclient(hunting): get_auth_request con 0x7f91c8006ed0 auth_method 0 2026-02-17T11:08:33.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:33.994+0000 7f91e8c2c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:33.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:33.994+0000 7f91e8c2c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:33.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:33.994+0000 7f91e8c2c640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:08:33.997 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:33.995+0000 7f91e8c2c640 1 -- 10.20.193.49:0/582980728 >> v2:10.20.193.49:3300/0 conn(0x7f91c8006ed0 msgr2=0x7f91c800cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:08:33.997 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:33.995+0000 7f91e8c2c640 1 -- 10.20.193.49:0/582980728 >> v2:10.20.193.49:3300/0 conn(0x7f91c8006ed0 msgr2=0x7f91c800cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:08:33.997 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:33.995+0000 7f91e8c2c640 1 --2- 10.20.193.49:0/582980728 >> v2:10.20.193.49:3300/0 conn(0x7f91c8006ed0 0x7f91c800cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:08:33.997 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:33.995+0000 7f91e8c2c640 1 --2- 10.20.193.49:0/582980728 >> v2:10.20.193.49:3300/0 conn(0x7f91c8006ed0 0x7f91c800cb40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:08:34.000 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:33.999+0000 7f91e942d640 1 --2- 10.20.193.49:0/582980728 >> v2:10.20.193.97:3300/0 conn(0x7f91c8005bb0 0x7f91c8017ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:34.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:33.999+0000 7f91e942d640 10 monclient(hunting): get_auth_request con 0x7f91c8005bb0 auth_method 0 2026-02-17T11:08:34.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:33.999+0000 7f91e942d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:34.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:33.999+0000 7f91e942d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:34.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:33.999+0000 7f91e942d640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:08:34.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:34.000+0000 7f91e942d640 1 -- 10.20.193.49:0/582980728 >> v2:10.20.193.97:3300/0 conn(0x7f91c8005bb0 msgr2=0x7f91c8017ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T11:08:34.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:34.000+0000 7f91e942d640 1 -- 10.20.193.49:0/582980728 >> v2:10.20.193.97:3300/0 conn(0x7f91c8005bb0 msgr2=0x7f91c8017ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:08:34.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:34.000+0000 7f91e942d640 1 --2- 10.20.193.49:0/582980728 >> v2:10.20.193.97:3300/0 conn(0x7f91c8005bb0 0x7f91c8017ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:08:34.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:34.000+0000 7f91e942d640 1 --2- 10.20.193.49:0/582980728 >> v2:10.20.193.97:3300/0 conn(0x7f91c8005bb0 0x7f91c8017ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:08:35.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:35.582+0000 7f91da7fc640 10 monclient(hunting): tick 2026-02-17T11:08:35.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:35.582+0000 7f91da7fc640 10 monclient(hunting): _check_auth_tickets 2026-02-17T11:08:35.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:35.582+0000 7f91da7fc640 1 monclient(hunting): continuing hunt 2026-02-17T11:08:35.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:35.582+0000 7f91da7fc640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T11:08:35.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:35.582+0000 7f91da7fc640 1 -- 10.20.193.49:0/582980728 >> v2:10.20.193.97:3300/0 conn(0x7f91c8005bb0 msgr2=0x7f91c8017ba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:08:35.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:35.582+0000 7f91da7fc640 1 --2- 10.20.193.49:0/582980728 >> v2:10.20.193.97:3300/0 conn(0x7f91c8005bb0 0x7f91c8017ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:35.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:35.582+0000 7f91da7fc640 1 -- 10.20.193.49:0/582980728 >> v2:10.20.193.49:3300/0 conn(0x7f91c8006ed0 msgr2=0x7f91c800cb40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:08:35.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:35.582+0000 7f91da7fc640 1 --2- 10.20.193.49:0/582980728 >> v2:10.20.193.49:3300/0 conn(0x7f91c8006ed0 0x7f91c800cb40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:35.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:35.582+0000 7f91da7fc640 1 -- 10.20.193.49:0/582980728 >> v1:10.20.193.49:6789/0 conn(0x7f91c8006340 legacy=0x7f91c8006720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:35.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:35.582+0000 7f91da7fc640 10 monclient: _add_conns ranks=[2,5,1] 2026-02-17T11:08:35.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:35.582+0000 7f91da7fc640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f91c800a4c0 addr v1:10.20.193.157:6789/0 2026-02-17T11:08:35.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:35.582+0000 7f91da7fc640 1 --2- 10.20.193.49:0/582980728 >> v2:10.20.193.157:3300/0 conn(0x7f91c80098c0 0x7f91c80131c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:35.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:35.582+0000 7f91da7fc640 10 monclient(hunting): picked mon.noname-c con 0x7f91c80098c0 addr v2:10.20.193.157:3300/0 2026-02-17T11:08:35.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:35.582+0000 7f91da7fc640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f91c8013700 addr v1:10.20.193.97:6789/0 2026-02-17T11:08:35.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:35.582+0000 7f91da7fc640 1 -- 10.20.193.49:0/582980728 --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91e406c930 con 0x7f91c8013700 2026-02-17T11:08:35.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:35.582+0000 7f91da7fc640 1 -- 10.20.193.49:0/582980728 --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91c800ff10 con 0x7f91c800a4c0 2026-02-17T11:08:35.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:35.582+0000 7f91da7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:35.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:35.582+0000 7f91da7fc640 1 -- 10.20.193.49:0/582980728 --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f91e406cc60 con 0x7f91c80098c0 2026-02-17T11:08:35.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:35.582+0000 7f91da7fc640 10 monclient(hunting): _renew_subs 2026-02-17T11:08:35.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:35.583+0000 7f91dbfff640 1 --2- 10.20.193.49:0/582980728 >> v2:10.20.193.157:3300/0 conn(0x7f91c80098c0 0x7f91c80131c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:35.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:35.583+0000 7f91dbfff640 10 monclient(hunting): get_auth_request con 0x7f91c80098c0 auth_method 0 2026-02-17T11:08:35.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:35.583+0000 7f91dbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:35.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:35.583+0000 7f91dbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:35.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:35.583+0000 7f91dbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:35.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:35.584+0000 7f91dbfff640 1 -- 10.20.193.49:0/582980728 >> v2:10.20.193.157:3300/0 conn(0x7f91c80098c0 msgr2=0x7f91c80131c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T11:08:35.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:35.584+0000 7f91dbfff640 1 -- 10.20.193.49:0/582980728 >> v2:10.20.193.157:3300/0 conn(0x7f91c80098c0 msgr2=0x7f91c80131c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:08:35.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:35.584+0000 7f91dbfff640 1 --2- 10.20.193.49:0/582980728 >> v2:10.20.193.157:3300/0 conn(0x7f91c80098c0 0x7f91c80131c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:08:35.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:35.584+0000 7f91dbfff640 1 --2- 10.20.193.49:0/582980728 >> v2:10.20.193.157:3300/0 conn(0x7f91c80098c0 0x7f91c80131c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:08:35.787 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:35.785+0000 7f91dbfff640 1 --2- 10.20.193.49:0/582980728 >> v2:10.20.193.157:3300/0 conn(0x7f91c80098c0 0x7f91c80131c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:35.787 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:35.785+0000 7f91dbfff640 10 monclient(hunting): get_auth_request con 0x7f91c80098c0 auth_method 0 2026-02-17T11:08:35.788 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:35.785+0000 7f91dbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:35.788 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:35.785+0000 7f91dbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:35.788 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:35.785+0000 7f91dbfff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:08:35.788 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:35.786+0000 7f91dbfff640 1 -- 10.20.193.49:0/582980728 >> v2:10.20.193.157:3300/0 conn(0x7f91c80098c0 msgr2=0x7f91c80131c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T11:08:35.788 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:35.786+0000 7f91dbfff640 1 -- 10.20.193.49:0/582980728 >> v2:10.20.193.157:3300/0 conn(0x7f91c80098c0 msgr2=0x7f91c80131c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:08:35.788 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:35.786+0000 7f91dbfff640 1 --2- 10.20.193.49:0/582980728 >> v2:10.20.193.157:3300/0 conn(0x7f91c80098c0 0x7f91c80131c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:08:35.788 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:35.786+0000 7f91dbfff640 1 --2- 10.20.193.49:0/582980728 >> v2:10.20.193.157:3300/0 conn(0x7f91c80098c0 0x7f91c80131c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T11:08:36.189 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:36.187+0000 7f91dbfff640 1 --2- 10.20.193.49:0/582980728 >> v2:10.20.193.157:3300/0 conn(0x7f91c80098c0 0x7f91c80131c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:36.189 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:36.187+0000 7f91dbfff640 10 monclient(hunting): get_auth_request con 0x7f91c80098c0 auth_method 0 2026-02-17T11:08:36.189 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:36.187+0000 7f91dbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:36.189 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:36.187+0000 7f91dbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:36.190 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:36.187+0000 7f91dbfff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:08:36.190 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:36.187+0000 7f91dbfff640 1 -- 10.20.193.49:0/582980728 >> v2:10.20.193.157:3300/0 conn(0x7f91c80098c0 msgr2=0x7f91c80131c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T11:08:36.190 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:36.187+0000 7f91dbfff640 1 -- 10.20.193.49:0/582980728 >> v2:10.20.193.157:3300/0 conn(0x7f91c80098c0 msgr2=0x7f91c80131c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:08:36.190 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:36.187+0000 7f91dbfff640 1 --2- 10.20.193.49:0/582980728 >> v2:10.20.193.157:3300/0 conn(0x7f91c80098c0 0x7f91c80131c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:08:36.190 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:36.187+0000 7f91dbfff640 1 --2- 10.20.193.49:0/582980728 >> v2:10.20.193.157:3300/0 conn(0x7f91c80098c0 0x7f91c80131c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T11:08:36.999 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:36.997+0000 7f91dbfff640 1 --2- 10.20.193.49:0/582980728 >> v2:10.20.193.157:3300/0 conn(0x7f91c80098c0 0x7f91c80131c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:36.999 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:36.997+0000 7f91dbfff640 10 monclient(hunting): get_auth_request con 0x7f91c80098c0 auth_method 0 2026-02-17T11:08:36.999 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:36.997+0000 7f91dbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:36.999 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:36.997+0000 7f91dbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:37.000 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:36.997+0000 7f91dbfff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:08:37.000 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:36.998+0000 7f91dbfff640 1 -- 10.20.193.49:0/582980728 >> v2:10.20.193.157:3300/0 conn(0x7f91c80098c0 msgr2=0x7f91c80131c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T11:08:37.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:36.998+0000 7f91dbfff640 1 -- 10.20.193.49:0/582980728 >> v2:10.20.193.157:3300/0 conn(0x7f91c80098c0 msgr2=0x7f91c80131c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:08:37.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:36.998+0000 7f91dbfff640 1 --2- 10.20.193.49:0/582980728 >> v2:10.20.193.157:3300/0 conn(0x7f91c80098c0 0x7f91c80131c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:08:37.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:36.998+0000 7f91dbfff640 1 --2- 10.20.193.49:0/582980728 >> v2:10.20.193.157:3300/0 conn(0x7f91c80098c0 0x7f91c80131c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T11:08:37.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:37.992+0000 7f91db7fe640 1 -- 10.20.193.49:0/582980728 <== mon.1 v1:10.20.193.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 578114472 0 0) 0x7f91e406c930 con 0x7f91c8013700 2026-02-17T11:08:37.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:37.992+0000 7f91db7fe640 10 monclient(hunting): _negotiate 2026-02-17T11:08:37.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:37.992+0000 7f91db7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:37.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:37.992+0000 7f91db7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:37.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:37.992+0000 7f91db7fe640 10 monclient(hunting): my global_id is 4102 2026-02-17T11:08:37.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:37.992+0000 7f91db7fe640 1 -- 10.20.193.49:0/582980728 --> v1:10.20.193.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91d0003620 con 0x7f91c8013700 2026-02-17T11:08:38.000 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:37.999+0000 7f91db7fe640 1 -- 10.20.193.49:0/582980728 <== mon.2 v1:10.20.193.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1013551577 0 0) 0x7f91c800ff10 con 0x7f91c800a4c0 2026-02-17T11:08:38.000 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:37.999+0000 7f91db7fe640 10 monclient(hunting): _negotiate 2026-02-17T11:08:38.000 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:37.999+0000 7f91db7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:38.000 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:37.999+0000 7f91db7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:38.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:37.999+0000 7f91db7fe640 10 monclient(hunting): my global_id is 4103 2026-02-17T11:08:38.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:37.999+0000 7f91db7fe640 1 -- 10.20.193.49:0/582980728 --> v1:10.20.193.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91e406c930 con 0x7f91c800a4c0 2026-02-17T11:08:38.067 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.065+0000 7f91db7fe640 1 -- 10.20.193.49:0/582980728 <== mon.1 v1:10.20.193.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2720552406 0 0) 0x7f91d0003620 con 0x7f91c8013700 2026-02-17T11:08:38.067 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.065+0000 7f91db7fe640 1 -- 10.20.193.49:0/582980728 >> v2:10.20.193.157:3300/0 conn(0x7f91c80098c0 msgr2=0x7f91c80131c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:08:38.067 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.065+0000 7f91db7fe640 1 --2- 10.20.193.49:0/582980728 >> v2:10.20.193.157:3300/0 conn(0x7f91c80098c0 0x7f91c80131c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:38.067 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.065+0000 7f91db7fe640 1 -- 10.20.193.49:0/582980728 >> v1:10.20.193.157:6789/0 conn(0x7f91c800a4c0 legacy=0x7f91c800a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:38.067 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.065+0000 7f91db7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:08:38.067 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.065+0000 7f91db7fe640 1 monclient: found mon.noname-b-legacy 2026-02-17T11:08:38.067 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.065+0000 7f91db7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:08:38.067 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.065+0000 7f91db7fe640 10 monclient: _send_mon_message to mon.noname-b-legacy at v1:10.20.193.97:6789/0 2026-02-17T11:08:38.067 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.065+0000 7f91db7fe640 1 -- 10.20.193.49:0/582980728 --> v1:10.20.193.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91c8015400 con 0x7f91c8013700 2026-02-17T11:08:38.067 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.065+0000 7f91e942d640 1 -- 10.20.193.49:0/582980728 reap_dead start 2026-02-17T11:08:38.067 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.065+0000 7f91db7fe640 10 monclient: _finish_auth 0 2026-02-17T11:08:38.068 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.065+0000 7f91db7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:08:38.068 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.065+0000 7f91db7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:08:38.068 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.065+0000 7f91eaeb7640 5 monclient: authenticate success, global_id 4102 2026-02-17T11:08:38.068 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.065+0000 7f91eaeb7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:08:38.072 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.069+0000 7f91db7fe640 1 -- 10.20.193.49:0/582980728 <== mon.1 v1:10.20.193.97:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2462710995 0 0) 0x7f91e00078a0 con 0x7f91c8013700 2026-02-17T11:08:38.072 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.069+0000 7f91db7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:38.072 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.069+0000 7f91db7fe640 10 monclient: got monmap 1 from mon.noname-b-legacy (according to old e1) 2026-02-17T11:08:38.073 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.069+0000 7f91db7fe640 10 monclient: dump: 2026-02-17T11:08:38.073 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:08:38.073 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:38.073 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:38.073 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:38.073 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:38.073 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:08:38.073 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:38.073 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:38.073 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:38.073 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:08:38.074 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.069+0000 7f91db7fe640 1 monclient: mon.b has (v2) addrs [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] but i'm connected to v1:10.20.193.97:6789/0, reconnecting 2026-02-17T11:08:38.074 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.069+0000 7f91db7fe640 10 monclient: _reopen_session rank -1 2026-02-17T11:08:38.074 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.069+0000 7f91db7fe640 1 -- 10.20.193.49:0/582980728 >> v1:10.20.193.97:6789/0 conn(0x7f91c8013700 legacy=0x7f91c8013b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:38.074 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.069+0000 7f91db7fe640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:08:38.074 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.069+0000 7f91db7fe640 1 --2- 10.20.193.49:0/582980728 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f91d0003c40 0x7f91d0004040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:38.074 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.069+0000 7f91db7fe640 10 monclient(hunting): picked mon.a con 0x7f91d0003c40 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:08:38.074 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.069+0000 7f91db7fe640 1 --2- 10.20.193.49:0/582980728 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f91d0004900 0x7f91d0004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:38.074 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.069+0000 7f91db7fe640 10 monclient(hunting): picked mon.c con 0x7f91d0004900 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:08:38.074 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.069+0000 7f91db7fe640 1 --2- 10.20.193.49:0/582980728 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f91d00053e0 0x7f91d000bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:38.074 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.069+0000 7f91db7fe640 10 monclient(hunting): picked mon.b con 0x7f91d00053e0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:08:38.074 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.069+0000 7f91db7fe640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:38.074 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.069+0000 7f91db7fe640 1 -- 10.20.193.49:0/582980728 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f91e406cc60 con 0x7f91d0003c40 2026-02-17T11:08:38.075 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.069+0000 7f91db7fe640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:38.075 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.069+0000 7f91db7fe640 1 -- 10.20.193.49:0/582980728 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f91d000c330 con 0x7f91d00053e0 2026-02-17T11:08:38.075 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.069+0000 7f91db7fe640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:38.075 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.069+0000 7f91db7fe640 1 -- 10.20.193.49:0/582980728 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f91d000c530 con 0x7f91d0004900 2026-02-17T11:08:38.075 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.069+0000 7f91db7fe640 10 monclient(hunting): _renew_subs 2026-02-17T11:08:38.075 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.069+0000 7f91db7fe640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:08:38.075 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.069+0000 7f91eaeb7640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2026-02-17T11:08:38.075 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.069+0000 7f91e8c2c640 1 --2- 10.20.193.49:0/582980728 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f91d0003c40 0x7f91d0004040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:38.075 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.069+0000 7f91e8c2c640 10 monclient(hunting): get_auth_request con 0x7f91d0003c40 auth_method 0 2026-02-17T11:08:38.075 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.069+0000 7f91e8c2c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:38.075 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.069+0000 7f91e8c2c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:38.075 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.069+0000 7f91e8c2c640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:08:38.075 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.070+0000 7f91e8c2c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:38.076 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.070+0000 7f91e8c2c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:38.076 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.070+0000 7f91e8c2c640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:08:38.076 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.071+0000 7f91e8c2c640 10 monclient(hunting): handle_auth_done global_id 4102 payload 293 2026-02-17T11:08:38.076 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.071+0000 7f91e8c2c640 1 -- 10.20.193.49:0/582980728 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f91d0004900 msgr2=0x7f91d0004d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:08:38.076 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.071+0000 7f91e8c2c640 1 --2- 10.20.193.49:0/582980728 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f91d0004900 0x7f91d0004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:38.076 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.071+0000 7f91e8c2c640 1 -- 10.20.193.49:0/582980728 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f91d00053e0 msgr2=0x7f91d000bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:08:38.076 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.071+0000 7f91e8c2c640 1 --2- 10.20.193.49:0/582980728 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f91d00053e0 0x7f91d000bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:38.076 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.071+0000 7f91e8c2c640 10 monclient: _finish_hunting 0 2026-02-17T11:08:38.076 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.071+0000 7f91e8c2c640 1 monclient: found mon.a 2026-02-17T11:08:38.076 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.071+0000 7f91e8c2c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:08:38.076 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.071+0000 7f91e8c2c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:08:38.076 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.071+0000 7f91e8c2c640 1 -- 10.20.193.49:0/582980728 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91d0003620 con 0x7f91d0003c40 2026-02-17T11:08:38.076 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.071+0000 7f91e8c2c640 10 monclient: _finish_auth 0 2026-02-17T11:08:38.077 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.071+0000 7f91e8c2c640 10 monclient: _check_auth_tickets 2026-02-17T11:08:38.077 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.071+0000 7f91e8c2c640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:08:38.077 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.074+0000 7f91e8c2c640 1 --2- 10.20.193.49:0/582980728 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f91d0003c40 0x7f91d0004040 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f91c80072e0 tx=0x7f91d402fed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da809bd778efc369 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:08:38.096 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.091+0000 7f91db7fe640 1 -- 10.20.193.49:0/582980728 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d4036070 con 0x7f91d0003c40 2026-02-17T11:08:38.096 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.091+0000 7f91db7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:38.096 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.091+0000 7f91db7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:08:38.096 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.091+0000 7f91db7fe640 10 monclient: dump: 2026-02-17T11:08:38.096 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:08:38.096 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:38.096 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:38.096 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:38.097 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:38.097 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:08:38.097 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:38.097 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:38.097 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:38.097 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:08:38.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.091+0000 7f91db7fe640 1 -- 10.20.193.49:0/582980728 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91d4030730 con 0x7f91d0003c40 2026-02-17T11:08:38.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.091+0000 7f91db7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:08:38.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.091+0000 7f91eaeb7640 10 monclient: get_monmap_and_config success 2026-02-17T11:08:38.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.091+0000 7f91db7fe640 1 -- 10.20.193.49:0/582980728 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d4009a60 con 0x7f91d0003c40 2026-02-17T11:08:38.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.091+0000 7f91db7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:38.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.091+0000 7f91eaeb7640 4 set_mon_vals no callback set 2026-02-17T11:08:38.098 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.091+0000 7f91db7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:08:38.098 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.091+0000 7f91db7fe640 10 monclient: dump: 2026-02-17T11:08:38.098 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:08:38.098 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:38.098 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:38.098 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:38.098 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:38.098 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:08:38.098 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:38.098 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:38.098 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:38.098 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:08:38.098 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.092+0000 7f91eaeb7640 10 monclient: shutdown 2026-02-17T11:08:38.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.092+0000 7f91eaeb7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:08:38.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.092+0000 7f91eaeb7640 1 -- 10.20.193.49:0/582980728 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f91d0003c40 msgr2=0x7f91d0004040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:38.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.092+0000 7f91eaeb7640 1 --2- 10.20.193.49:0/582980728 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f91d0003c40 0x7f91d0004040 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f91c80072e0 tx=0x7f91d402fed0 comp rx=0 tx=0).stop 2026-02-17T11:08:38.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.092+0000 7f91eaeb7640 1 -- 10.20.193.49:0/582980728 shutdown_connections 2026-02-17T11:08:38.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.092+0000 7f91eaeb7640 1 --2- 10.20.193.49:0/582980728 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f91d00053e0 0x7f91d000bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:38.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.092+0000 7f91eaeb7640 1 --2- 10.20.193.49:0/582980728 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f91d0003c40 0x7f91d0004040 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:38.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.092+0000 7f91eaeb7640 1 --2- 10.20.193.49:0/582980728 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f91d0004900 0x7f91d0004d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:38.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.092+0000 7f91eaeb7640 1 -- 10.20.193.49:0/582980728 >> 10.20.193.49:0/582980728 conn(0x7f91e40cc1d0 msgr2=0x7f91e40cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:08:38.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.092+0000 7f91eaeb7640 1 -- 10.20.193.49:0/582980728 shutdown_connections 2026-02-17T11:08:38.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.092+0000 7f91eaeb7640 1 -- 10.20.193.49:0/582980728 wait complete. 2026-02-17T11:08:38.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.093+0000 7f91eaeb7640 10 monclient: build_initial_monmap 2026-02-17T11:08:38.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.093+0000 7f91eaeb7640 10 monclient: monmap: 2026-02-17T11:08:38.100 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:08:38.100 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:08:38.100 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:08:38.100 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:08:38.100 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:08:38.100 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:08:38.100 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:08:38.100 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:08:38.100 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:08:38.100 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:08:38.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.093+0000 7f91eaeb7640 1 librados: starting msgr at 2026-02-17T11:08:38.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.093+0000 7f91eaeb7640 1 librados: starting objecter 2026-02-17T11:08:38.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.093+0000 7f91eaeb7640 1 Processor -- start 2026-02-17T11:08:38.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.093+0000 7f91eaeb7640 1 -- start start 2026-02-17T11:08:38.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.093+0000 7f91eaeb7640 1 librados: setting wanted keys 2026-02-17T11:08:38.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.093+0000 7f91eaeb7640 1 librados: calling monclient init 2026-02-17T11:08:38.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.093+0000 7f91eaeb7640 10 monclient: init 2026-02-17T11:08:38.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.093+0000 7f91eaeb7640 10 monclient: _reopen_session rank -1 2026-02-17T11:08:38.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.093+0000 7f91eaeb7640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:08:38.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.093+0000 7f91eaeb7640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f91c8013700 0x7f91e40c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:38.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.093+0000 7f91eaeb7640 10 monclient(hunting): picked mon.noname-b con 0x7f91c8013700 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:08:38.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.093+0000 7f91eaeb7640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f91d0003c40 0x7f91e41f14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:38.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.093+0000 7f91eaeb7640 10 monclient(hunting): picked mon.noname-c con 0x7f91d0003c40 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:08:38.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.093+0000 7f91eaeb7640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f91d0004900 0x7f91e41f19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:38.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.093+0000 7f91eaeb7640 10 monclient(hunting): picked mon.noname-a con 0x7f91d0004900 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:08:38.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.093+0000 7f91eaeb7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:38.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.093+0000 7f91eaeb7640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f91e40cccf0 con 0x7f91d0004900 2026-02-17T11:08:38.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.093+0000 7f91eaeb7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:38.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.093+0000 7f91eaeb7640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f91e415cc20 con 0x7f91c8013700 2026-02-17T11:08:38.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.093+0000 7f91eaeb7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:38.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.093+0000 7f91eaeb7640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f91e40cd030 con 0x7f91d0003c40 2026-02-17T11:08:38.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.093+0000 7f91eaeb7640 10 monclient(hunting): _renew_subs 2026-02-17T11:08:38.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.093+0000 7f91eaeb7640 10 monclient(hunting): authenticate will time out at 994.756848s 2026-02-17T11:08:38.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.094+0000 7f91e8c2c640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f91c8013700 0x7f91e40c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:38.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.094+0000 7f91e8c2c640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f91c8013700 0x7f91e40c84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:52238/0 (socket says 10.20.193.49:52238) 2026-02-17T11:08:38.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.094+0000 7f91e8c2c640 1 -- 10.20.193.49:0/2128297699 learned_addr learned my addr 10.20.193.49:0/2128297699 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:08:38.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.094+0000 7f91e8c2c640 10 monclient(hunting): get_auth_request con 0x7f91c8013700 auth_method 0 2026-02-17T11:08:38.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.094+0000 7f91e8c2c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:38.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.094+0000 7f91e8c2c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:38.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.094+0000 7f91e8c2c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:38.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.094+0000 7f91e8c2c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:38.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.094+0000 7f91e8c2c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:38.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.094+0000 7f91e8c2c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:38.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.096+0000 7f91dbfff640 1 --2- 10.20.193.49:0/2128297699 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f91d0003c40 0x7f91e41f14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:38.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.096+0000 7f91dbfff640 10 monclient(hunting): get_auth_request con 0x7f91d0003c40 auth_method 0 2026-02-17T11:08:38.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.096+0000 7f91dbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:38.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.096+0000 7f91dbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:38.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.096+0000 7f91dbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:38.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.097+0000 7f91dbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:38.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.097+0000 7f91dbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:38.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.097+0000 7f91dbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:38.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.100+0000 7f91e8c2c640 10 monclient(hunting): handle_auth_done global_id 4105 payload 824 2026-02-17T11:08:38.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.100+0000 7f91e8c2c640 1 -- 10.20.193.49:0/2128297699 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f91d0003c40 msgr2=0x7f91e41f14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:38.107 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.100+0000 7f91e8c2c640 1 --2- 10.20.193.49:0/2128297699 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f91d0003c40 0x7f91e41f14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:38.107 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.100+0000 7f91e8c2c640 1 -- 10.20.193.49:0/2128297699 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f91d0004900 msgr2=0x7f91e41f19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:38.107 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.100+0000 7f91e8c2c640 1 --2- 10.20.193.49:0/2128297699 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f91d0004900 0x7f91e41f19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:38.107 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.100+0000 7f91e8c2c640 10 monclient: _finish_hunting 0 2026-02-17T11:08:38.107 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.100+0000 7f91e8c2c640 1 monclient: found mon.noname-b 2026-02-17T11:08:38.107 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.100+0000 7f91e8c2c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:08:38.107 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.100+0000 7f91e8c2c640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:08:38.107 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.100+0000 7f91e8c2c640 1 -- 10.20.193.49:0/2128297699 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91e41f56d0 con 0x7f91c8013700 2026-02-17T11:08:38.107 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.101+0000 7f91e8c2c640 1 --2- 10.20.193.49:0/2128297699 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f91c8013700 0x7f91e40c84d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f91d403c040 tx=0x7f91d40023d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:08:38.107 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.101+0000 7f91d97fa640 10 client.?.objecter ms_handle_connect 0x7f91c8013700 2026-02-17T11:08:38.107 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.101+0000 7f91d97fa640 10 client.?.objecter resend_mon_ops 2026-02-17T11:08:38.107 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.103+0000 7f91d97fa640 1 -- 10.20.193.49:0/2128297699 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d4049070 con 0x7f91c8013700 2026-02-17T11:08:38.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.103+0000 7f91d97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:38.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.103+0000 7f91d97fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:08:38.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.103+0000 7f91d97fa640 10 monclient: dump: 2026-02-17T11:08:38.108 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:08:38.108 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:38.108 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:38.108 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:38.108 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:38.108 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:08:38.108 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:38.108 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:38.108 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:38.109 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:08:38.109 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.103+0000 7f91d97fa640 10 monclient: _finish_auth 0 2026-02-17T11:08:38.109 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.103+0000 7f91d97fa640 10 monclient: _check_auth_tickets 2026-02-17T11:08:38.109 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.103+0000 7f91d97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:08:38.109 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.103+0000 7f91eaeb7640 5 monclient: authenticate success, global_id 4105 2026-02-17T11:08:38.109 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.103+0000 7f91eaeb7640 10 monclient: _renew_subs 2026-02-17T11:08:38.109 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.103+0000 7f91eaeb7640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:08:38.109 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.103+0000 7f91eaeb7640 1 -- 10.20.193.49:0/2128297699 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91e41f59b0 con 0x7f91c8013700 2026-02-17T11:08:38.109 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.103+0000 7f91eaeb7640 10 client.4105.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:08:38.109 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.103+0000 7f91eaeb7640 10 monclient: _renew_subs 2026-02-17T11:08:38.109 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.103+0000 7f91eaeb7640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:08:38.109 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.103+0000 7f91eaeb7640 1 -- 10.20.193.49:0/2128297699 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91e41f5f70 con 0x7f91c8013700 2026-02-17T11:08:38.110 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.103+0000 7f91eaeb7640 1 librados: init done 2026-02-17T11:08:38.110 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.104+0000 7f91eaeb7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:38.110 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.104+0000 7f91eaeb7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:38.110 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.104+0000 7f91eaeb7640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:08:38.110 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.104+0000 7f91eaeb7640 1 -- 10.20.193.49:0/2128297699 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91e4073ac0 con 0x7f91c8013700 2026-02-17T11:08:38.111 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.108+0000 7f91d97fa640 1 -- 10.20.193.49:0/2128297699 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91d4030730 con 0x7f91c8013700 2026-02-17T11:08:38.111 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.108+0000 7f91d97fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:08:38.111 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.108+0000 7f91d97fa640 1 -- 10.20.193.49:0/2128297699 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d4053060 con 0x7f91c8013700 2026-02-17T11:08:38.111 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.108+0000 7f91d97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:38.111 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.108+0000 7f91d97fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:08:38.111 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.108+0000 7f91d97fa640 10 monclient: dump: 2026-02-17T11:08:38.111 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:08:38.111 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:38.111 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:38.111 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:38.111 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:38.112 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:08:38.112 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:38.112 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:38.112 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:38.112 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:08:38.112 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.108+0000 7f91daffd640 4 set_mon_vals no callback set 2026-02-17T11:08:38.206 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.204+0000 7f91d97fa640 1 -- 10.20.193.49:0/2128297699 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f91d4004ce0 con 0x7f91c8013700 2026-02-17T11:08:38.206 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.204+0000 7f91d97fa640 1 -- 10.20.193.49:0/2128297699 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f91d4058a20 con 0x7f91c8013700 2026-02-17T11:08:38.206 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.204+0000 7f91d97fa640 10 client.4105.objecter ms_dispatch2 0x7f91e4000b90 osd_map(1..1 src has 1..1) 2026-02-17T11:08:38.206 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.204+0000 7f91d97fa640 3 client.4105.objecter handle_osd_map got epochs [1,1] > 0 2026-02-17T11:08:38.206 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.204+0000 7f91d97fa640 3 client.4105.objecter handle_osd_map decoding full epoch 1 2026-02-17T11:08:38.206 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.204+0000 7f91d97fa640 20 client.4105.objecter dump_active .. 0 homeless 2026-02-17T11:08:38.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.208+0000 7f91d97fa640 1 -- 10.20.193.49:0/2128297699 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f91e4073ac0 con 0x7f91c8013700 2026-02-17T11:08:38.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.208+0000 7f91d97fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:38.210 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.208+0000 7f91d97fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:08:38.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.239+0000 7f91eaeb7640 10 start_mon_command cmd=[{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-17T11:08:38.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.239+0000 7f91eaeb7640 10 monclient: _send_command 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-17T11:08:38.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.239+0000 7f91eaeb7640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:08:38.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.239+0000 7f91eaeb7640 1 -- 10.20.193.49:0/2128297699 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f91e40d05a0 con 0x7f91c8013700 2026-02-17T11:08:38.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.405+0000 7f91d97fa640 1 -- 10.20.193.49:0/2128297699 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f91d4045cd0 con 0x7f91c8013700 2026-02-17T11:08:38.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.405+0000 7f91d97fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-17T11:08:38.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.405+0000 7f91d97fa640 10 monclient: _finish_command 2 = system:0 adjusted tunables profile to default 2026-02-17T11:08:38.407 INFO:teuthology.orchestra.run.trial049.stderr:adjusted tunables profile to default 2026-02-17T11:08:38.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.405+0000 7f91eaeb7640 10 librados: watch_flush enter 2026-02-17T11:08:38.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.405+0000 7f91eaeb7640 10 librados: watch_flush exit 2026-02-17T11:08:38.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.405+0000 7f91eaeb7640 20 client.4105.objecter shutdown clearing up homeless session... 2026-02-17T11:08:38.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.405+0000 7f91eaeb7640 10 client.4105.objecter successfully canceled tick 2026-02-17T11:08:38.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.405+0000 7f91eaeb7640 10 monclient: shutdown 2026-02-17T11:08:38.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.405+0000 7f91eaeb7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:08:38.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.405+0000 7f91eaeb7640 1 -- 10.20.193.49:0/2128297699 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f91c8013700 msgr2=0x7f91e40c84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:38.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.406+0000 7f91eaeb7640 1 --2- 10.20.193.49:0/2128297699 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f91c8013700 0x7f91e40c84d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f91d403c040 tx=0x7f91d40023d0 comp rx=0 tx=0).stop 2026-02-17T11:08:38.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.406+0000 7f91eaeb7640 1 -- 10.20.193.49:0/2128297699 shutdown_connections 2026-02-17T11:08:38.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.406+0000 7f91eaeb7640 1 --2- 10.20.193.49:0/2128297699 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f91d0004900 0x7f91e41f19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:38.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.406+0000 7f91eaeb7640 1 --2- 10.20.193.49:0/2128297699 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f91d0003c40 0x7f91e41f14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:38.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.406+0000 7f91eaeb7640 1 --2- 10.20.193.49:0/2128297699 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f91c8013700 0x7f91e40c84d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:38.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.406+0000 7f91eaeb7640 1 -- 10.20.193.49:0/2128297699 >> 10.20.193.49:0/2128297699 conn(0x7f91e40cc1d0 msgr2=0x7f91e40cddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:08:38.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.406+0000 7f91eaeb7640 1 -- 10.20.193.49:0/2128297699 shutdown_connections 2026-02-17T11:08:38.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.406+0000 7f91eaeb7640 1 -- 10.20.193.49:0/2128297699 wait complete. 2026-02-17T11:08:38.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:38.406+0000 7f91eaeb7640 1 librados: shutdown 2026-02-17T11:08:38.416 INFO:tasks.ceph:check_enable_crimson: False 2026-02-17T11:08:38.416 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-17T11:08:38.416 DEBUG:teuthology.orchestra.run.trial049:> set -ex 2026-02-17T11:08:38.417 DEBUG:teuthology.orchestra.run.trial049:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-17T11:08:38.442 DEBUG:teuthology.orchestra.run.trial049:> set -ex 2026-02-17T11:08:38.442 DEBUG:teuthology.orchestra.run.trial049:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2026-02-17T11:08:38.479 INFO:tasks.ceph.mgr.x.trial162.stderr:2026-02-17T11:08:38.478+0000 7efc3f612140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-17T11:08:38.505 DEBUG:teuthology.orchestra.run.trial049:> set -ex 2026-02-17T11:08:38.505 DEBUG:teuthology.orchestra.run.trial049:> sudo dd if=/var/lib/ceph/osd/ceph-8/fsid of=/dev/stdout 2026-02-17T11:08:38.566 INFO:tasks.ceph.mgr.y.trial049.stderr:2026-02-17T11:08:38.564+0000 7f5cf3fdc140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-17T11:08:38.567 DEBUG:teuthology.orchestra.run.trial049:> set -ex 2026-02-17T11:08:38.567 DEBUG:teuthology.orchestra.run.trial049:> sudo dd if=/var/lib/ceph/osd/ceph-12/fsid of=/dev/stdout 2026-02-17T11:08:38.602 INFO:tasks.ceph.mgr.x.trial162.stderr:2026-02-17T11:08:38.599+0000 7efc3f612140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-17T11:08:38.628 INFO:tasks.ceph.mgr.x.trial162.stderr:2026-02-17T11:08:38.626+0000 7efc3f612140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-17T11:08:38.633 DEBUG:teuthology.orchestra.run.trial097:> set -ex 2026-02-17T11:08:38.633 DEBUG:teuthology.orchestra.run.trial097:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-17T11:08:38.661 DEBUG:teuthology.orchestra.run.trial097:> set -ex 2026-02-17T11:08:38.661 DEBUG:teuthology.orchestra.run.trial097:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2026-02-17T11:08:38.661 INFO:tasks.ceph.mgr.x.trial162.stderr:2026-02-17T11:08:38.659+0000 7efc3f612140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-17T11:08:38.683 INFO:tasks.ceph.mgr.x.trial162.stderr:2026-02-17T11:08:38.681+0000 7efc3f612140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-17T11:08:38.685 INFO:tasks.ceph.mgr.y.trial049.stderr:2026-02-17T11:08:38.684+0000 7f5cf3fdc140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-17T11:08:38.709 INFO:tasks.ceph.mgr.x.trial162.stderr:2026-02-17T11:08:38.707+0000 7efc3f612140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-17T11:08:38.711 INFO:tasks.ceph.mgr.y.trial049.stderr:2026-02-17T11:08:38.710+0000 7f5cf3fdc140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-17T11:08:38.726 DEBUG:teuthology.orchestra.run.trial097:> set -ex 2026-02-17T11:08:38.727 DEBUG:teuthology.orchestra.run.trial097:> sudo dd if=/var/lib/ceph/osd/ceph-9/fsid of=/dev/stdout 2026-02-17T11:08:38.744 INFO:tasks.ceph.mgr.y.trial049.stderr:2026-02-17T11:08:38.743+0000 7f5cf3fdc140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-17T11:08:38.765 INFO:tasks.ceph.mgr.x.trial162.stderr:2026-02-17T11:08:38.763+0000 7efc3f612140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-17T11:08:38.766 INFO:tasks.ceph.mgr.y.trial049.stderr:2026-02-17T11:08:38.765+0000 7f5cf3fdc140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-17T11:08:38.792 INFO:tasks.ceph.mgr.y.trial049.stderr:2026-02-17T11:08:38.791+0000 7f5cf3fdc140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-17T11:08:38.793 DEBUG:teuthology.orchestra.run.trial097:> set -ex 2026-02-17T11:08:38.793 DEBUG:teuthology.orchestra.run.trial097:> sudo dd if=/var/lib/ceph/osd/ceph-13/fsid of=/dev/stdout 2026-02-17T11:08:38.826 INFO:tasks.ceph.mgr.x.trial162.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-17T11:08:38.826 INFO:tasks.ceph.mgr.x.trial162.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-17T11:08:38.826 INFO:tasks.ceph.mgr.x.trial162.stderr: from numpy import show_config as show_numpy_config 2026-02-17T11:08:38.829 INFO:tasks.ceph.mgr.x.trial162.stderr:2026-02-17T11:08:38.827+0000 7efc3f612140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-17T11:08:38.847 INFO:tasks.ceph.mgr.y.trial049.stderr:2026-02-17T11:08:38.845+0000 7f5cf3fdc140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-17T11:08:38.854 INFO:tasks.ceph.mgr.x.trial162.stderr:2026-02-17T11:08:38.852+0000 7efc3f612140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-17T11:08:38.858 DEBUG:teuthology.orchestra.run.trial157:> set -ex 2026-02-17T11:08:38.858 DEBUG:teuthology.orchestra.run.trial157:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-17T11:08:38.887 DEBUG:teuthology.orchestra.run.trial157:> set -ex 2026-02-17T11:08:38.887 DEBUG:teuthology.orchestra.run.trial157:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2026-02-17T11:08:38.906 INFO:tasks.ceph.mgr.y.trial049.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-17T11:08:38.907 INFO:tasks.ceph.mgr.y.trial049.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-17T11:08:38.907 INFO:tasks.ceph.mgr.y.trial049.stderr: from numpy import show_config as show_numpy_config 2026-02-17T11:08:38.909 INFO:tasks.ceph.mgr.x.trial162.stderr:2026-02-17T11:08:38.907+0000 7efc3f612140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-17T11:08:38.910 INFO:tasks.ceph.mgr.y.trial049.stderr:2026-02-17T11:08:38.909+0000 7f5cf3fdc140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-17T11:08:38.935 INFO:tasks.ceph.mgr.y.trial049.stderr:2026-02-17T11:08:38.933+0000 7f5cf3fdc140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-17T11:08:38.951 INFO:tasks.ceph.mgr.x.trial162.stderr:2026-02-17T11:08:38.949+0000 7efc3f612140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-17T11:08:38.951 DEBUG:teuthology.orchestra.run.trial157:> set -ex 2026-02-17T11:08:38.951 DEBUG:teuthology.orchestra.run.trial157:> sudo dd if=/var/lib/ceph/osd/ceph-10/fsid of=/dev/stdout 2026-02-17T11:08:38.976 INFO:tasks.ceph.mgr.x.trial162.stderr:2026-02-17T11:08:38.974+0000 7efc3f612140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-17T11:08:38.990 INFO:tasks.ceph.mgr.y.trial049.stderr:2026-02-17T11:08:38.988+0000 7f5cf3fdc140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-17T11:08:39.000 INFO:tasks.ceph.mgr.x.trial162.stderr:2026-02-17T11:08:38.998+0000 7efc3f612140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-17T11:08:39.015 DEBUG:teuthology.orchestra.run.trial157:> set -ex 2026-02-17T11:08:39.015 DEBUG:teuthology.orchestra.run.trial157:> sudo dd if=/var/lib/ceph/osd/ceph-14/fsid of=/dev/stdout 2026-02-17T11:08:39.026 INFO:tasks.ceph.mgr.x.trial162.stderr:2026-02-17T11:08:39.024+0000 7efc3f612140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-17T11:08:39.031 INFO:tasks.ceph.mgr.y.trial049.stderr:2026-02-17T11:08:39.030+0000 7f5cf3fdc140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-17T11:08:39.048 INFO:tasks.ceph.mgr.x.trial162.stderr:2026-02-17T11:08:39.046+0000 7efc3f612140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-17T11:08:39.056 INFO:tasks.ceph.mgr.y.trial049.stderr:2026-02-17T11:08:39.055+0000 7f5cf3fdc140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-17T11:08:39.079 DEBUG:teuthology.orchestra.run.trial162:> set -ex 2026-02-17T11:08:39.079 DEBUG:teuthology.orchestra.run.trial162:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2026-02-17T11:08:39.080 INFO:tasks.ceph.mgr.y.trial049.stderr:2026-02-17T11:08:39.079+0000 7f5cf3fdc140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-17T11:08:39.103 DEBUG:teuthology.orchestra.run.trial162:> set -ex 2026-02-17T11:08:39.103 DEBUG:teuthology.orchestra.run.trial162:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2026-02-17T11:08:39.105 INFO:tasks.ceph.mgr.y.trial049.stderr:2026-02-17T11:08:39.104+0000 7f5cf3fdc140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-17T11:08:39.127 INFO:tasks.ceph.mgr.y.trial049.stderr:2026-02-17T11:08:39.125+0000 7f5cf3fdc140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-17T11:08:39.168 DEBUG:teuthology.orchestra.run.trial162:> set -ex 2026-02-17T11:08:39.168 DEBUG:teuthology.orchestra.run.trial162:> sudo dd if=/var/lib/ceph/osd/ceph-11/fsid of=/dev/stdout 2026-02-17T11:08:39.231 DEBUG:teuthology.orchestra.run.trial162:> set -ex 2026-02-17T11:08:39.231 DEBUG:teuthology.orchestra.run.trial162:> sudo dd if=/var/lib/ceph/osd/ceph-15/fsid of=/dev/stdout 2026-02-17T11:08:39.244 INFO:tasks.ceph.mgr.x.trial162.stderr:2026-02-17T11:08:39.242+0000 7efc3f612140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-02-17T11:08:39.266 DEBUG:teuthology.orchestra.run.trial162:> sudo ceph --cluster ceph osd new 30bc819e-140a-433e-b860-eaa88e282a11 0 2026-02-17T11:08:39.299 INFO:tasks.ceph.mgr.x.trial162.stderr:2026-02-17T11:08:39.297+0000 7efc3f612140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-17T11:08:39.319 INFO:tasks.ceph.mgr.y.trial049.stderr:2026-02-17T11:08:39.318+0000 7f5cf3fdc140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-02-17T11:08:39.320 INFO:tasks.ceph.mgr.x.trial162.stderr:2026-02-17T11:08:39.318+0000 7efc3f612140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-17T11:08:39.343 INFO:tasks.ceph.mgr.x.trial162.stderr:2026-02-17T11:08:39.341+0000 7efc3f612140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-17T11:08:39.363 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.359+0000 7f91f007c640 10 monclient: get_monmap_and_config 2026-02-17T11:08:39.363 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.359+0000 7f91f007c640 10 monclient: build_initial_monmap 2026-02-17T11:08:39.364 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.359+0000 7f91f007c640 10 monclient: monmap: 2026-02-17T11:08:39.364 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-17T11:08:39.364 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:39.364 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:08:39.360941+0000 2026-02-17T11:08:39.364 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:08:39.360941+0000 2026-02-17T11:08:39.364 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-17T11:08:39.364 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:39.364 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:08:39.364 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:08:39.364 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:08:39.365 INFO:teuthology.orchestra.run.trial162.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:08:39.365 INFO:teuthology.orchestra.run.trial162.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:08:39.365 INFO:teuthology.orchestra.run.trial162.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:08:39.365 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:39.365 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.359+0000 7f91f007c640 1 Processor -- start 2026-02-17T11:08:39.365 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.359+0000 7f91f007c640 1 -- start start 2026-02-17T11:08:39.365 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.359+0000 7f91f007c640 10 monclient: init 2026-02-17T11:08:39.365 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.359+0000 7f91f007c640 10 monclient: _reopen_session rank -1 2026-02-17T11:08:39.365 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.359+0000 7f91f007c640 10 monclient: _add_conns ranks=[3,4,0,2,5,1] 2026-02-17T11:08:39.365 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.359+0000 7f91f007c640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f91e81123f0 0x7f91e81127d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:39.365 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.359+0000 7f91f007c640 10 monclient(hunting): picked mon.noname-a con 0x7f91e81123f0 addr v2:10.20.193.49:3300/0 2026-02-17T11:08:39.365 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.359+0000 7f91f007c640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f91e81192c0 0x7f91e811b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:39.366 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.359+0000 7f91f007c640 10 monclient(hunting): picked mon.noname-b con 0x7f91e81192c0 addr v2:10.20.193.97:3300/0 2026-02-17T11:08:39.366 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.359+0000 7f91f007c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f91e811bbf0 addr v1:10.20.193.49:6789/0 2026-02-17T11:08:39.366 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.359+0000 7f91f007c640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91e811f790 con 0x7f91e811bbf0 2026-02-17T11:08:39.366 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.359+0000 7f91f007c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:39.366 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.359+0000 7f91f007c640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f91e8120990 con 0x7f91e81123f0 2026-02-17T11:08:39.366 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.359+0000 7f91f007c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:39.366 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.359+0000 7f91f007c640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f91e8120b10 con 0x7f91e81192c0 2026-02-17T11:08:39.366 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.359+0000 7f91f007c640 10 monclient(hunting): _renew_subs 2026-02-17T11:08:39.366 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.359+0000 7f91f007c640 10 monclient(hunting): authenticate will time out at 957.098964s 2026-02-17T11:08:39.366 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.360+0000 7f91ed5f0640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f91e81192c0 0x7f91e811b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:39.366 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.360+0000 7f91eddf1640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f91e81123f0 0x7f91e81127d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:39.366 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.360+0000 7f91ed5f0640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f91e81192c0 0x7f91e811b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.162:48366/0 (socket says 10.20.193.162:48366) 2026-02-17T11:08:39.367 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.360+0000 7f91ed5f0640 1 -- 10.20.193.162:0/1382850449 learned_addr learned my addr 10.20.193.162:0/1382850449 (peer_addr_for_me v2:10.20.193.162:0/0) 2026-02-17T11:08:39.367 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.360+0000 7f91ed5f0640 10 monclient(hunting): get_auth_request con 0x7f91e81192c0 auth_method 0 2026-02-17T11:08:39.367 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.360+0000 7f91ed5f0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:39.367 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.360+0000 7f91ed5f0640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:39.367 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.360+0000 7f91ed5f0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:39.367 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.360+0000 7f91eddf1640 10 monclient(hunting): get_auth_request con 0x7f91e81123f0 auth_method 0 2026-02-17T11:08:39.367 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.360+0000 7f91eddf1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:39.367 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.360+0000 7f91eddf1640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:39.367 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.360+0000 7f91eddf1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:39.367 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.360+0000 7f91ed5f0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:39.367 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.360+0000 7f91ed5f0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:39.368 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.361+0000 7f91ed5f0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:39.368 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.361+0000 7f91eddf1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:39.368 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.361+0000 7f91eddf1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:39.368 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.361+0000 7f91eddf1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:39.374 INFO:tasks.ceph.mgr.y.trial049.stderr:2026-02-17T11:08:39.371+0000 7f5cf3fdc140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-17T11:08:39.376 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.362+0000 7f91ed5f0640 10 monclient(hunting): handle_auth_done global_id 4114 payload 274 2026-02-17T11:08:39.376 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.362+0000 7f91ed5f0640 1 -- 10.20.193.162:0/1382850449 >> v2:10.20.193.49:3300/0 conn(0x7f91e81123f0 msgr2=0x7f91e81127d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:08:39.376 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.362+0000 7f91ed5f0640 1 --2- 10.20.193.162:0/1382850449 >> v2:10.20.193.49:3300/0 conn(0x7f91e81123f0 0x7f91e81127d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:39.377 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.362+0000 7f91ed5f0640 1 -- 10.20.193.162:0/1382850449 >> v1:10.20.193.49:6789/0 conn(0x7f91e811bbf0 legacy=0x7f91e811dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:39.377 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.362+0000 7f91ed5f0640 10 monclient: _finish_hunting 0 2026-02-17T11:08:39.377 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.362+0000 7f91ed5f0640 1 monclient: found mon.noname-b 2026-02-17T11:08:39.377 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.362+0000 7f91ed5f0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:08:39.377 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.362+0000 7f91ed5f0640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:08:39.377 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.362+0000 7f91ed5f0640 1 -- 10.20.193.162:0/1382850449 --> v2:10.20.193.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91e8120cc0 con 0x7f91e81192c0 2026-02-17T11:08:39.377 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.363+0000 7f91ed5f0640 1 --2- 10.20.193.162:0/1382850449 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f91e81192c0 0x7f91e811b6b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f91e8112da0 tx=0x7f91dc02ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41cebe68d133cdce server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:08:39.377 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.365+0000 7f91ecdef640 1 -- 10.20.193.162:0/1382850449 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91dc03c070 con 0x7f91e81192c0 2026-02-17T11:08:39.377 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.365+0000 7f91ecdef640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:39.377 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.365+0000 7f91ecdef640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:08:39.377 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.365+0000 7f91ecdef640 10 monclient: dump: 2026-02-17T11:08:39.378 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:39.378 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:39.378 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:39.378 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:39.378 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:39.378 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:39.378 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:39.378 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:39.378 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:39.378 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:39.378 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.365+0000 7f91ecdef640 10 monclient: _finish_auth 0 2026-02-17T11:08:39.378 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.365+0000 7f91ecdef640 10 monclient: _check_auth_tickets 2026-02-17T11:08:39.379 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.365+0000 7f91ecdef640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:08:39.379 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.365+0000 7f91f007c640 5 monclient: authenticate success, global_id 4114 2026-02-17T11:08:39.379 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.365+0000 7f91ecdef640 1 -- 10.20.193.162:0/1382850449 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91dc02fb30 con 0x7f91e81192c0 2026-02-17T11:08:39.379 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.365+0000 7f91ecdef640 10 monclient: handle_config config(0 keys) 2026-02-17T11:08:39.379 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.365+0000 7f91f007c640 10 monclient: get_monmap_and_config success 2026-02-17T11:08:39.379 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.365+0000 7f91f007c640 4 set_mon_vals no callback set 2026-02-17T11:08:39.379 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.365+0000 7f91ecdef640 1 -- 10.20.193.162:0/1382850449 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91dc037440 con 0x7f91e81192c0 2026-02-17T11:08:39.379 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.365+0000 7f91ecdef640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:39.379 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.365+0000 7f91ecdef640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:08:39.379 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.365+0000 7f91ecdef640 10 monclient: dump: 2026-02-17T11:08:39.379 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:39.379 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:39.379 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:39.380 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:39.380 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:39.380 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:39.380 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:39.380 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:39.380 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:39.380 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:39.380 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.365+0000 7f91f007c640 10 monclient: shutdown 2026-02-17T11:08:39.380 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.365+0000 7f91f007c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:08:39.380 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.365+0000 7f91f007c640 1 -- 10.20.193.162:0/1382850449 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f91e81192c0 msgr2=0x7f91e811b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:39.380 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.365+0000 7f91f007c640 1 --2- 10.20.193.162:0/1382850449 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f91e81192c0 0x7f91e811b6b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f91e8112da0 tx=0x7f91dc02ee60 comp rx=0 tx=0).stop 2026-02-17T11:08:39.380 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.365+0000 7f91f007c640 1 -- 10.20.193.162:0/1382850449 shutdown_connections 2026-02-17T11:08:39.381 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.365+0000 7f91f007c640 1 --2- 10.20.193.162:0/1382850449 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f91e81192c0 0x7f91e811b6b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:39.381 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.365+0000 7f91f007c640 1 --2- 10.20.193.162:0/1382850449 >> v2:10.20.193.49:3300/0 conn(0x7f91e81123f0 0x7f91e81127d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:39.381 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.365+0000 7f91f007c640 1 -- 10.20.193.162:0/1382850449 >> 10.20.193.162:0/1382850449 conn(0x7f91e806f660 msgr2=0x7f91e8071a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:08:39.381 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.365+0000 7f91f007c640 1 -- 10.20.193.162:0/1382850449 shutdown_connections 2026-02-17T11:08:39.381 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.365+0000 7f91f007c640 1 -- 10.20.193.162:0/1382850449 wait complete. 2026-02-17T11:08:39.381 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.365+0000 7f91f007c640 10 monclient: build_initial_monmap 2026-02-17T11:08:39.381 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.365+0000 7f91f007c640 10 monclient: monmap: 2026-02-17T11:08:39.381 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-17T11:08:39.381 INFO:teuthology.orchestra.run.trial162.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:08:39.381 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 0.000000 2026-02-17T11:08:39.381 INFO:teuthology.orchestra.run.trial162.stderr:created 0.000000 2026-02-17T11:08:39.381 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-17T11:08:39.382 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:39.382 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:08:39.382 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:08:39.382 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:08:39.382 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:39.382 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.365+0000 7f91f007c640 1 librados: starting msgr at 2026-02-17T11:08:39.382 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.365+0000 7f91f007c640 1 librados: starting objecter 2026-02-17T11:08:39.382 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.366+0000 7f91f007c640 1 Processor -- start 2026-02-17T11:08:39.382 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.366+0000 7f91f007c640 1 -- start start 2026-02-17T11:08:39.382 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.366+0000 7f91f007c640 1 librados: setting wanted keys 2026-02-17T11:08:39.382 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.366+0000 7f91f007c640 1 librados: calling monclient init 2026-02-17T11:08:39.382 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.366+0000 7f91f007c640 10 monclient: init 2026-02-17T11:08:39.383 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.366+0000 7f91f007c640 10 monclient: _reopen_session rank -1 2026-02-17T11:08:39.383 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.366+0000 7f91f007c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:08:39.383 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.366+0000 7f91f007c640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f91e81123f0 0x7f91e81aa0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:39.383 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.366+0000 7f91f007c640 10 monclient(hunting): picked mon.noname-b con 0x7f91e81123f0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:08:39.383 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.366+0000 7f91f007c640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f91e81192c0 0x7f91e81aa710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:39.383 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.366+0000 7f91f007c640 10 monclient(hunting): picked mon.noname-c con 0x7f91e81192c0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:08:39.383 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.366+0000 7f91f007c640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f91e811bbf0 0x7f91e81aee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:39.383 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.366+0000 7f91f007c640 10 monclient(hunting): picked mon.noname-a con 0x7f91e811bbf0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:08:39.383 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.366+0000 7f91f007c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:39.383 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.366+0000 7f91f007c640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f91e811fdc0 con 0x7f91e811bbf0 2026-02-17T11:08:39.383 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.366+0000 7f91f007c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:39.383 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.366+0000 7f91f007c640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f91e811fc40 con 0x7f91e81123f0 2026-02-17T11:08:39.383 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.366+0000 7f91f007c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:39.384 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.366+0000 7f91f007c640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f91e811ff40 con 0x7f91e81192c0 2026-02-17T11:08:39.384 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.366+0000 7f91f007c640 10 monclient(hunting): _renew_subs 2026-02-17T11:08:39.384 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.366+0000 7f91f007c640 10 monclient(hunting): authenticate will time out at 957.105218s 2026-02-17T11:08:39.384 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.366+0000 7f91ee5f2640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f91e811bbf0 0x7f91e81aee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:39.384 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.366+0000 7f91eddf1640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f91e81123f0 0x7f91e81aa0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:39.384 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.366+0000 7f91eddf1640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f91e81123f0 0x7f91e81aa0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.162:48380/0 (socket says 10.20.193.162:48380) 2026-02-17T11:08:39.384 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.366+0000 7f91ee5f2640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f91e811bbf0 0x7f91e81aee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.162:57084/0 (socket says 10.20.193.162:57084) 2026-02-17T11:08:39.384 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.366+0000 7f91eddf1640 1 -- 10.20.193.162:0/1712350640 learned_addr learned my addr 10.20.193.162:0/1712350640 (peer_addr_for_me v2:10.20.193.162:0/0) 2026-02-17T11:08:39.384 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.366+0000 7f91eddf1640 10 monclient(hunting): get_auth_request con 0x7f91e81123f0 auth_method 0 2026-02-17T11:08:39.384 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.366+0000 7f91eddf1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:39.384 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.366+0000 7f91eddf1640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:39.384 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.366+0000 7f91eddf1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:39.385 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.366+0000 7f91ee5f2640 10 monclient(hunting): get_auth_request con 0x7f91e811bbf0 auth_method 0 2026-02-17T11:08:39.385 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.366+0000 7f91ee5f2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:39.385 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.366+0000 7f91ee5f2640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:39.385 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.366+0000 7f91ee5f2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:39.385 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.366+0000 7f91ed5f0640 1 --2- 10.20.193.162:0/1712350640 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f91e81192c0 0x7f91e81aa710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:39.385 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.366+0000 7f91ed5f0640 10 monclient(hunting): get_auth_request con 0x7f91e81192c0 auth_method 0 2026-02-17T11:08:39.385 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.366+0000 7f91ed5f0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:39.385 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.366+0000 7f91ed5f0640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:39.385 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.366+0000 7f91ed5f0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:39.385 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.366+0000 7f91ee5f2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:39.385 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.366+0000 7f91ee5f2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:39.385 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.366+0000 7f91ee5f2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:39.385 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.367+0000 7f91eddf1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:39.386 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.367+0000 7f91eddf1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:39.386 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.367+0000 7f91eddf1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:39.386 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.367+0000 7f91ed5f0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:39.386 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.367+0000 7f91ed5f0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:39.386 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.367+0000 7f91ed5f0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:39.386 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.368+0000 7f91eddf1640 10 monclient(hunting): handle_auth_done global_id 4117 payload 824 2026-02-17T11:08:39.386 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.368+0000 7f91eddf1640 1 -- 10.20.193.162:0/1712350640 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f91e81192c0 msgr2=0x7f91e81aa710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:39.386 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.368+0000 7f91eddf1640 1 --2- 10.20.193.162:0/1712350640 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f91e81192c0 0x7f91e81aa710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:39.386 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.368+0000 7f91eddf1640 1 -- 10.20.193.162:0/1712350640 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f91e811bbf0 msgr2=0x7f91e81aee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:39.386 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.368+0000 7f91eddf1640 1 --2- 10.20.193.162:0/1712350640 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f91e811bbf0 0x7f91e81aee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:39.386 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.368+0000 7f91eddf1640 10 monclient: _finish_hunting 0 2026-02-17T11:08:39.386 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.368+0000 7f91eddf1640 1 monclient: found mon.noname-b 2026-02-17T11:08:39.386 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.368+0000 7f91eddf1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:08:39.387 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.368+0000 7f91eddf1640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:08:39.387 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.368+0000 7f91eddf1640 1 -- 10.20.193.162:0/1712350640 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91e81af740 con 0x7f91e81123f0 2026-02-17T11:08:39.387 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.369+0000 7f91eddf1640 1 --2- 10.20.193.162:0/1712350640 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f91e81123f0 0x7f91e81aa0a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f91d800ebe0 tx=0x7f91d800c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:08:39.387 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.369+0000 7f91d67fc640 10 client.?.objecter ms_handle_connect 0x7f91e81123f0 2026-02-17T11:08:39.387 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.369+0000 7f91d67fc640 10 client.?.objecter resend_mon_ops 2026-02-17T11:08:39.387 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.370+0000 7f91d67fc640 1 -- 10.20.193.162:0/1712350640 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d8017070 con 0x7f91e81123f0 2026-02-17T11:08:39.387 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.370+0000 7f91d67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:39.387 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.370+0000 7f91d67fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:08:39.387 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.370+0000 7f91d67fc640 10 monclient: dump: 2026-02-17T11:08:39.387 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:39.387 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:39.387 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:39.387 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:39.388 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:39.388 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:39.388 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:39.388 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:39.388 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:39.388 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:39.388 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.370+0000 7f91d67fc640 10 monclient: _finish_auth 0 2026-02-17T11:08:39.388 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.370+0000 7f91d67fc640 10 monclient: _check_auth_tickets 2026-02-17T11:08:39.388 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.370+0000 7f91d67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:08:39.388 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.370+0000 7f91d67fc640 1 -- 10.20.193.162:0/1712350640 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91d800cc40 con 0x7f91e81123f0 2026-02-17T11:08:39.388 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.370+0000 7f91d67fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:08:39.388 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.370+0000 7f91d67fc640 1 -- 10.20.193.162:0/1712350640 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d8013470 con 0x7f91e81123f0 2026-02-17T11:08:39.389 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.371+0000 7f91d67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:39.389 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.371+0000 7f91d67fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:08:39.389 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.371+0000 7f91d7fff640 4 set_mon_vals no callback set 2026-02-17T11:08:39.389 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.371+0000 7f91d67fc640 10 monclient: dump: 2026-02-17T11:08:39.389 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:39.389 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:39.389 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:39.389 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:39.389 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:39.389 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:39.389 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:39.389 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:39.389 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:39.390 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:39.390 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.371+0000 7f91f007c640 5 monclient: authenticate success, global_id 4117 2026-02-17T11:08:39.390 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.371+0000 7f91f007c640 10 monclient: _renew_subs 2026-02-17T11:08:39.390 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.371+0000 7f91f007c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:08:39.390 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.371+0000 7f91f007c640 1 -- 10.20.193.162:0/1712350640 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91e81af9d0 con 0x7f91e81123f0 2026-02-17T11:08:39.390 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.371+0000 7f91f007c640 10 client.4117.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:08:39.390 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.371+0000 7f91f007c640 10 monclient: _renew_subs 2026-02-17T11:08:39.390 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.371+0000 7f91f007c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:08:39.390 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.371+0000 7f91f007c640 1 -- 10.20.193.162:0/1712350640 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91e81b6220 con 0x7f91e81123f0 2026-02-17T11:08:39.390 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.371+0000 7f91f007c640 1 librados: init done 2026-02-17T11:08:39.390 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.371+0000 7f91f007c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:39.390 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.371+0000 7f91f007c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:39.391 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.371+0000 7f91f007c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:08:39.391 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.371+0000 7f91f007c640 1 -- 10.20.193.162:0/1712350640 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91e81127d0 con 0x7f91e81123f0 2026-02-17T11:08:39.391 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.372+0000 7f91d67fc640 1 -- 10.20.193.162:0/1712350640 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f91d8024060 con 0x7f91e81123f0 2026-02-17T11:08:39.391 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.372+0000 7f91d67fc640 1 -- 10.20.193.162:0/1712350640 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f91d8006030 con 0x7f91e81123f0 2026-02-17T11:08:39.391 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.373+0000 7f91d67fc640 10 client.4117.objecter ms_dispatch2 0x7f91e8000b90 osd_map(2..2 src has 1..2) 2026-02-17T11:08:39.391 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.373+0000 7f91d67fc640 3 client.4117.objecter handle_osd_map got epochs [2,2] > 0 2026-02-17T11:08:39.391 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.373+0000 7f91d67fc640 3 client.4117.objecter handle_osd_map decoding full epoch 2 2026-02-17T11:08:39.391 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.373+0000 7f91d67fc640 20 client.4117.objecter dump_active .. 0 homeless 2026-02-17T11:08:39.394 INFO:tasks.ceph.mgr.y.trial049.stderr:2026-02-17T11:08:39.393+0000 7f5cf3fdc140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-17T11:08:39.396 INFO:tasks.ceph.mgr.x.trial162.stderr:2026-02-17T11:08:39.394+0000 7efc3f612140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-17T11:08:39.414 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.412+0000 7f91d67fc640 1 -- 10.20.193.162:0/1712350640 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f91d8013610 con 0x7f91e81123f0 2026-02-17T11:08:39.414 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.412+0000 7f91d67fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:39.414 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.412+0000 7f91d67fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:08:39.417 INFO:tasks.ceph.mgr.x.trial162.stderr:2026-02-17T11:08:39.415+0000 7efc3f612140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-17T11:08:39.417 INFO:tasks.ceph.mgr.y.trial049.stderr:2026-02-17T11:08:39.416+0000 7f5cf3fdc140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-17T11:08:39.449 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.446+0000 7f91f007c640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "30bc819e-140a-433e-b860-eaa88e282a11", "id": 0}] 2026-02-17T11:08:39.449 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.446+0000 7f91f007c640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "30bc819e-140a-433e-b860-eaa88e282a11", "id": 0}] 2026-02-17T11:08:39.449 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.446+0000 7f91f007c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:08:39.449 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.446+0000 7f91f007c640 1 -- 10.20.193.162:0/1712350640 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "osd new", "uuid": "30bc819e-140a-433e-b860-eaa88e282a11", "id": 0} v 0) -- 0x7f91e80722e0 con 0x7f91e81123f0 2026-02-17T11:08:39.468 INFO:tasks.ceph.mgr.x.trial162.stderr:2026-02-17T11:08:39.466+0000 7efc3f612140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-17T11:08:39.470 INFO:tasks.ceph.mgr.y.trial049.stderr:2026-02-17T11:08:39.468+0000 7f5cf3fdc140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-17T11:08:39.490 INFO:tasks.ceph.mgr.y.trial049.stderr:2026-02-17T11:08:39.488+0000 7f5cf3fdc140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-17T11:08:39.520 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.517+0000 7f91d67fc640 1 -- 10.20.193.162:0/1712350640 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "30bc819e-140a-433e-b860-eaa88e282a11", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f91d8005a90 con 0x7f91e81123f0 2026-02-17T11:08:39.520 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.517+0000 7f91d67fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "30bc819e-140a-433e-b860-eaa88e282a11", "id": 0}] 2026-02-17T11:08:39.520 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.517+0000 7f91d67fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:08:39.520 INFO:teuthology.orchestra.run.trial162.stdout:0 2026-02-17T11:08:39.522 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.518+0000 7f91f007c640 10 librados: watch_flush enter 2026-02-17T11:08:39.522 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.518+0000 7f91f007c640 10 librados: watch_flush exit 2026-02-17T11:08:39.522 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.518+0000 7f91f007c640 20 client.4117.objecter shutdown clearing up homeless session... 2026-02-17T11:08:39.523 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.518+0000 7f91f007c640 10 client.4117.objecter successfully canceled tick 2026-02-17T11:08:39.523 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.518+0000 7f91f007c640 10 monclient: shutdown 2026-02-17T11:08:39.523 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.518+0000 7f91f007c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:08:39.523 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.518+0000 7f91f007c640 1 -- 10.20.193.162:0/1712350640 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f91e81123f0 msgr2=0x7f91e81aa0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:39.523 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.518+0000 7f91f007c640 1 --2- 10.20.193.162:0/1712350640 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f91e81123f0 0x7f91e81aa0a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f91d800ebe0 tx=0x7f91d800c520 comp rx=0 tx=0).stop 2026-02-17T11:08:39.523 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.518+0000 7f91f007c640 1 -- 10.20.193.162:0/1712350640 shutdown_connections 2026-02-17T11:08:39.523 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.518+0000 7f91f007c640 1 --2- 10.20.193.162:0/1712350640 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f91e811bbf0 0x7f91e81aee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:39.523 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.518+0000 7f91f007c640 1 --2- 10.20.193.162:0/1712350640 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f91e81192c0 0x7f91e81aa710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:39.523 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.518+0000 7f91f007c640 1 --2- 10.20.193.162:0/1712350640 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f91e81123f0 0x7f91e81aa0a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:39.523 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.518+0000 7f91f007c640 1 -- 10.20.193.162:0/1712350640 >> 10.20.193.162:0/1712350640 conn(0x7f91e806f660 msgr2=0x7f91e806fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:08:39.523 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.518+0000 7f91f007c640 1 -- 10.20.193.162:0/1712350640 shutdown_connections 2026-02-17T11:08:39.523 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.518+0000 7f91f007c640 1 -- 10.20.193.162:0/1712350640 wait complete. 2026-02-17T11:08:39.524 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.518+0000 7f91f007c640 1 librados: shutdown 2026-02-17T11:08:39.528 DEBUG:teuthology.orchestra.run.trial162:> sudo ceph --cluster ceph osd new 2f7f1f11-f256-4094-82a9-5d21882e6e0e 1 2026-02-17T11:08:39.541 INFO:tasks.ceph.mgr.y.trial049.stderr:2026-02-17T11:08:39.540+0000 7f5cf3fdc140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-17T11:08:39.633 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.629+0000 7fc69896a640 10 monclient: get_monmap_and_config 2026-02-17T11:08:39.633 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.629+0000 7fc69896a640 10 monclient: build_initial_monmap 2026-02-17T11:08:39.633 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.629+0000 7fc69896a640 10 monclient: monmap: 2026-02-17T11:08:39.633 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-17T11:08:39.634 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:39.634 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:08:39.631214+0000 2026-02-17T11:08:39.634 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:08:39.631214+0000 2026-02-17T11:08:39.634 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-17T11:08:39.634 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:39.634 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:08:39.634 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:08:39.634 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:08:39.634 INFO:teuthology.orchestra.run.trial162.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:08:39.635 INFO:teuthology.orchestra.run.trial162.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:08:39.635 INFO:teuthology.orchestra.run.trial162.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:08:39.635 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:39.635 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.630+0000 7fc69896a640 1 Processor -- start 2026-02-17T11:08:39.635 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.630+0000 7fc69896a640 1 -- start start 2026-02-17T11:08:39.635 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.630+0000 7fc69896a640 10 monclient: init 2026-02-17T11:08:39.635 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.630+0000 7fc69896a640 10 monclient: _reopen_session rank -1 2026-02-17T11:08:39.635 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.630+0000 7fc69896a640 10 monclient: _add_conns ranks=[0,5,2,1,3,4] 2026-02-17T11:08:39.635 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.630+0000 7fc69896a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc6901149f0 addr v1:10.20.193.49:6789/0 2026-02-17T11:08:39.635 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.630+0000 7fc69896a640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7fc69011d5c0 0x7fc69011f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:39.635 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.630+0000 7fc69896a640 10 monclient(hunting): picked mon.noname-c con 0x7fc69011d5c0 addr v2:10.20.193.157:3300/0 2026-02-17T11:08:39.635 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.630+0000 7fc69896a640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fc69011ff80 addr v1:10.20.193.157:6789/0 2026-02-17T11:08:39.636 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.630+0000 7fc69896a640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc690123d40 con 0x7fc6901149f0 2026-02-17T11:08:39.636 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.630+0000 7fc69896a640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc690124f60 con 0x7fc69011ff80 2026-02-17T11:08:39.636 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.630+0000 7fc69896a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:39.636 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.630+0000 7fc69896a640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7fc690126160 con 0x7fc69011d5c0 2026-02-17T11:08:39.636 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.630+0000 7fc69896a640 10 monclient(hunting): _renew_subs 2026-02-17T11:08:39.636 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.630+0000 7fc69896a640 10 monclient(hunting): authenticate will time out at 957.369283s 2026-02-17T11:08:39.636 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.630+0000 7fc6966df640 1 --1- >> v1:10.20.193.49:6789/0 conn(0x7fc6901149f0 0x7fc690114dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.49:6789/0 says I am v1:10.20.193.162:48970/0 (socket says 10.20.193.162:48970) 2026-02-17T11:08:39.636 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.630+0000 7fc6966df640 1 -- 10.20.193.162:0/795145540 learned_addr learned my addr 10.20.193.162:0/795145540 (peer_addr_for_me v1:10.20.193.162:0/0) 2026-02-17T11:08:39.636 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.631+0000 7fc695ede640 1 --2- 10.20.193.162:0/795145540 >> v2:10.20.193.157:3300/0 conn(0x7fc69011d5c0 0x7fc69011f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:39.638 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.631+0000 7fc695ede640 10 monclient(hunting): get_auth_request con 0x7fc69011d5c0 auth_method 0 2026-02-17T11:08:39.639 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.631+0000 7fc695ede640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:39.639 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.631+0000 7fc695ede640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:39.639 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.631+0000 7fc695ede640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:39.639 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.631+0000 7fc696ee0640 1 -- 10.20.193.162:0/795145540 >> v1:10.20.193.157:6789/0 conn(0x7fc69011ff80 legacy=0x7fc690122440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2026-02-17T11:08:39.639 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.632+0000 7fc696ee0640 1 -- 10.20.193.162:0/795145540 >> v1:10.20.193.157:6789/0 conn(0x7fc69011ff80 legacy=0x7fc690122440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:08:39.639 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.632+0000 7fc696ee0640 1 --1- 10.20.193.162:0/795145540 >> v1:10.20.193.157:6789/0 conn(0x7fc69011ff80 0x7fc690122440 :-1 s=OPENED pgs=14 cs=1 l=1).handle_message read tag failed 2026-02-17T11:08:39.639 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.632+0000 7fc696ee0640 1 --1- 10.20.193.162:0/795145540 >> v1:10.20.193.157:6789/0 conn(0x7fc69011ff80 0x7fc690122440 :-1 s=OPENED pgs=14 cs=1 l=1).fault on lossy channel, failing 2026-02-17T11:08:39.639 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.632+0000 7fc6956dd640 10 monclient(hunting): ms_handle_reset hunted mon v1:10.20.193.157:6789/0 2026-02-17T11:08:39.639 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.632+0000 7fc695ede640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:39.639 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.632+0000 7fc695ede640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:39.639 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.632+0000 7fc695ede640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:39.640 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.632+0000 7fc6956dd640 1 -- 10.20.193.162:0/795145540 <== mon.0 v1:10.20.193.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2143180595 0 0) 0x7fc690123d40 con 0x7fc6901149f0 2026-02-17T11:08:39.640 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.632+0000 7fc6956dd640 10 monclient(hunting): _negotiate 2026-02-17T11:08:39.640 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.632+0000 7fc6956dd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:39.640 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.632+0000 7fc6956dd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:39.640 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.632+0000 7fc6956dd640 10 monclient(hunting): my global_id is 4110 2026-02-17T11:08:39.640 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.632+0000 7fc6956dd640 1 -- 10.20.193.162:0/795145540 --> v1:10.20.193.49:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc680003620 con 0x7fc6901149f0 2026-02-17T11:08:39.640 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.633+0000 7fc695ede640 10 monclient(hunting): handle_auth_done global_id 4115 payload 274 2026-02-17T11:08:39.640 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.633+0000 7fc695ede640 1 -- 10.20.193.162:0/795145540 >> v1:10.20.193.157:6789/0 conn(0x7fc69011ff80 legacy=0x7fc690122440 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:08:39.640 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.633+0000 7fc695ede640 1 -- 10.20.193.162:0/795145540 >> v1:10.20.193.49:6789/0 conn(0x7fc6901149f0 legacy=0x7fc690114dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:39.640 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.633+0000 7fc695ede640 10 monclient: _finish_hunting 0 2026-02-17T11:08:39.640 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.633+0000 7fc695ede640 1 monclient: found mon.noname-c 2026-02-17T11:08:39.640 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.633+0000 7fc695ede640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:08:39.641 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.633+0000 7fc695ede640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:08:39.641 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.633+0000 7fc695ede640 1 -- 10.20.193.162:0/795145540 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6901262e0 con 0x7fc69011d5c0 2026-02-17T11:08:39.641 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.635+0000 7fc695ede640 1 --2- 10.20.193.162:0/795145540 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc69011d5c0 0x7fc69011f9b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc6901146b0 tx=0x7fc67c02edc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b4482f370d0d282 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:08:39.641 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.636+0000 7fc6956dd640 1 -- 10.20.193.162:0/795145540 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc67c03c070 con 0x7fc69011d5c0 2026-02-17T11:08:39.641 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.636+0000 7fc6956dd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:39.641 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.636+0000 7fc6956dd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:08:39.641 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.636+0000 7fc6956dd640 10 monclient: dump: 2026-02-17T11:08:39.641 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:39.641 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:39.641 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:39.641 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:39.641 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:39.641 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:39.642 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:39.642 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:39.642 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:39.642 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:39.642 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.636+0000 7fc6956dd640 10 monclient: _finish_auth 0 2026-02-17T11:08:39.642 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.636+0000 7fc6956dd640 10 monclient: _check_auth_tickets 2026-02-17T11:08:39.642 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.636+0000 7fc6956dd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:08:39.642 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.636+0000 7fc69896a640 5 monclient: authenticate success, global_id 4115 2026-02-17T11:08:39.642 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.636+0000 7fc69896a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:08:39.649 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.637+0000 7fc6956dd640 1 -- 10.20.193.162:0/795145540 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc67c02fad0 con 0x7fc69011d5c0 2026-02-17T11:08:39.649 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.637+0000 7fc6956dd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:08:39.649 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.637+0000 7fc6956dd640 1 -- 10.20.193.162:0/795145540 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc67c037440 con 0x7fc69011d5c0 2026-02-17T11:08:39.650 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.637+0000 7fc69896a640 10 monclient: get_monmap_and_config success 2026-02-17T11:08:39.650 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.637+0000 7fc6956dd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:39.650 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.637+0000 7fc69896a640 4 set_mon_vals no callback set 2026-02-17T11:08:39.650 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.637+0000 7fc6956dd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:08:39.650 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.637+0000 7fc6956dd640 10 monclient: dump: 2026-02-17T11:08:39.650 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:39.650 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:39.650 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:39.650 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:39.650 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:39.650 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:39.650 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:39.651 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:39.651 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:39.651 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:39.651 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.637+0000 7fc69896a640 10 monclient: shutdown 2026-02-17T11:08:39.651 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.637+0000 7fc69896a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:08:39.651 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.637+0000 7fc69896a640 1 -- 10.20.193.162:0/795145540 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc69011d5c0 msgr2=0x7fc69011f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:39.651 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.637+0000 7fc69896a640 1 --2- 10.20.193.162:0/795145540 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc69011d5c0 0x7fc69011f9b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc6901146b0 tx=0x7fc67c02edc0 comp rx=0 tx=0).stop 2026-02-17T11:08:39.651 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.637+0000 7fc69896a640 1 -- 10.20.193.162:0/795145540 shutdown_connections 2026-02-17T11:08:39.651 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.637+0000 7fc69896a640 1 --2- 10.20.193.162:0/795145540 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc69011d5c0 0x7fc69011f9b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:39.651 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.637+0000 7fc69896a640 1 -- 10.20.193.162:0/795145540 >> 10.20.193.162:0/795145540 conn(0x7fc690073660 msgr2=0x7fc690073a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:08:39.651 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.637+0000 7fc69896a640 1 -- 10.20.193.162:0/795145540 shutdown_connections 2026-02-17T11:08:39.651 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.637+0000 7fc69896a640 1 -- 10.20.193.162:0/795145540 wait complete. 2026-02-17T11:08:39.652 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.638+0000 7fc69896a640 10 monclient: build_initial_monmap 2026-02-17T11:08:39.652 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.638+0000 7fc69896a640 10 monclient: monmap: 2026-02-17T11:08:39.652 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-17T11:08:39.652 INFO:teuthology.orchestra.run.trial162.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:08:39.652 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 0.000000 2026-02-17T11:08:39.652 INFO:teuthology.orchestra.run.trial162.stderr:created 0.000000 2026-02-17T11:08:39.652 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-17T11:08:39.652 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:39.652 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:08:39.652 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:08:39.652 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:08:39.652 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:39.653 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.638+0000 7fc69896a640 1 librados: starting msgr at 2026-02-17T11:08:39.653 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.638+0000 7fc69896a640 1 librados: starting objecter 2026-02-17T11:08:39.653 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.638+0000 7fc69896a640 1 Processor -- start 2026-02-17T11:08:39.653 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.638+0000 7fc69896a640 1 -- start start 2026-02-17T11:08:39.653 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.638+0000 7fc69896a640 1 librados: setting wanted keys 2026-02-17T11:08:39.653 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.638+0000 7fc69896a640 1 librados: calling monclient init 2026-02-17T11:08:39.653 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.638+0000 7fc69896a640 10 monclient: init 2026-02-17T11:08:39.653 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.638+0000 7fc69896a640 10 monclient: _reopen_session rank -1 2026-02-17T11:08:39.653 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.638+0000 7fc69896a640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:08:39.653 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.638+0000 7fc69896a640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc6901149f0 0x7fc6901177c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:39.653 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.638+0000 7fc69896a640 10 monclient(hunting): picked mon.noname-b con 0x7fc6901149f0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:08:39.653 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.638+0000 7fc69896a640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc69011d5c0 0x7fc690117e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:39.654 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.638+0000 7fc69896a640 10 monclient(hunting): picked mon.noname-c con 0x7fc69011d5c0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:08:39.654 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.638+0000 7fc69896a640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc69011ff80 0x7fc6901b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:39.654 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.638+0000 7fc69896a640 10 monclient(hunting): picked mon.noname-a con 0x7fc69011ff80 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:08:39.654 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.638+0000 7fc69896a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:39.654 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.638+0000 7fc69896a640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc6901255b0 con 0x7fc69011ff80 2026-02-17T11:08:39.654 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.638+0000 7fc69896a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:39.654 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.638+0000 7fc69896a640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc690125430 con 0x7fc6901149f0 2026-02-17T11:08:39.654 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.638+0000 7fc69896a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:39.654 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.638+0000 7fc69896a640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc690125730 con 0x7fc69011d5c0 2026-02-17T11:08:39.654 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.638+0000 7fc69896a640 10 monclient(hunting): _renew_subs 2026-02-17T11:08:39.654 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.638+0000 7fc69896a640 10 monclient(hunting): authenticate will time out at 957.377448s 2026-02-17T11:08:39.654 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.638+0000 7fc695ede640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc69011d5c0 0x7fc690117e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:39.654 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.638+0000 7fc6966df640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc6901149f0 0x7fc6901177c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:39.655 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.638+0000 7fc695ede640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc69011d5c0 0x7fc690117e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.162:47180/0 (socket says 10.20.193.162:47180) 2026-02-17T11:08:39.655 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.638+0000 7fc695ede640 1 -- 10.20.193.162:0/3027977177 learned_addr learned my addr 10.20.193.162:0/3027977177 (peer_addr_for_me v2:10.20.193.162:0/0) 2026-02-17T11:08:39.655 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.638+0000 7fc695ede640 10 monclient(hunting): get_auth_request con 0x7fc69011d5c0 auth_method 0 2026-02-17T11:08:39.655 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.638+0000 7fc695ede640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:39.655 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.638+0000 7fc695ede640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:39.655 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.638+0000 7fc695ede640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:39.655 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.638+0000 7fc696ee0640 1 --2- 10.20.193.162:0/3027977177 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc69011ff80 0x7fc6901b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:39.655 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.639+0000 7fc6966df640 10 monclient(hunting): get_auth_request con 0x7fc6901149f0 auth_method 0 2026-02-17T11:08:39.655 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.639+0000 7fc6966df640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:39.655 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.639+0000 7fc6966df640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:39.656 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.639+0000 7fc6966df640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:39.656 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.639+0000 7fc695ede640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:39.656 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.639+0000 7fc695ede640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:39.656 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.639+0000 7fc695ede640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:39.656 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.639+0000 7fc696ee0640 10 monclient(hunting): get_auth_request con 0x7fc69011ff80 auth_method 0 2026-02-17T11:08:39.656 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.639+0000 7fc696ee0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:39.656 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.639+0000 7fc696ee0640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:39.656 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.639+0000 7fc696ee0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:39.656 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.639+0000 7fc6966df640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:39.656 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.639+0000 7fc6966df640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:39.656 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.639+0000 7fc6966df640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:39.656 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.639+0000 7fc696ee0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:39.657 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.639+0000 7fc696ee0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:39.657 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.639+0000 7fc696ee0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:39.657 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.640+0000 7fc695ede640 10 monclient(hunting): handle_auth_done global_id 4118 payload 824 2026-02-17T11:08:39.657 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.640+0000 7fc695ede640 1 -- 10.20.193.162:0/3027977177 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc6901149f0 msgr2=0x7fc6901177c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:39.657 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.640+0000 7fc695ede640 1 --2- 10.20.193.162:0/3027977177 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc6901149f0 0x7fc6901177c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:39.657 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.640+0000 7fc695ede640 1 -- 10.20.193.162:0/3027977177 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc69011ff80 msgr2=0x7fc6901b7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:39.657 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.640+0000 7fc695ede640 1 --2- 10.20.193.162:0/3027977177 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc69011ff80 0x7fc6901b7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:39.657 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.640+0000 7fc695ede640 10 monclient: _finish_hunting 0 2026-02-17T11:08:39.657 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.640+0000 7fc695ede640 1 monclient: found mon.noname-c 2026-02-17T11:08:39.657 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.640+0000 7fc695ede640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:08:39.657 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.640+0000 7fc695ede640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:08:39.657 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.640+0000 7fc695ede640 1 -- 10.20.193.162:0/3027977177 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6901b7a50 con 0x7fc69011d5c0 2026-02-17T11:08:39.658 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.641+0000 7fc695ede640 1 --2- 10.20.193.162:0/3027977177 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc69011d5c0 0x7fc690117e30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc67c009130 tx=0x7fc67c0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:08:39.658 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.641+0000 7fc67affd640 10 client.?.objecter ms_handle_connect 0x7fc69011d5c0 2026-02-17T11:08:39.658 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.641+0000 7fc67affd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:08:39.658 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.642+0000 7fc67affd640 1 -- 10.20.193.162:0/3027977177 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc67c03c040 con 0x7fc69011d5c0 2026-02-17T11:08:39.658 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.642+0000 7fc67affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:39.658 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.642+0000 7fc67affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:08:39.658 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.642+0000 7fc67affd640 10 monclient: dump: 2026-02-17T11:08:39.658 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:39.658 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:39.658 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:39.658 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:39.658 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:39.659 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:39.659 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:39.659 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:39.659 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:39.659 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:39.659 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.642+0000 7fc67affd640 10 monclient: _finish_auth 0 2026-02-17T11:08:39.659 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.642+0000 7fc67affd640 10 monclient: _check_auth_tickets 2026-02-17T11:08:39.659 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.642+0000 7fc67affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:08:39.659 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.642+0000 7fc69896a640 5 monclient: authenticate success, global_id 4118 2026-02-17T11:08:39.659 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.642+0000 7fc69896a640 10 monclient: _renew_subs 2026-02-17T11:08:39.659 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.642+0000 7fc69896a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:08:39.659 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.642+0000 7fc69896a640 1 -- 10.20.193.162:0/3027977177 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6901b7c80 con 0x7fc69011d5c0 2026-02-17T11:08:39.659 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.642+0000 7fc69896a640 10 client.4118.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:08:39.660 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.642+0000 7fc69896a640 10 monclient: _renew_subs 2026-02-17T11:08:39.660 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.642+0000 7fc69896a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:08:39.660 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.642+0000 7fc69896a640 1 -- 10.20.193.162:0/3027977177 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6901b8190 con 0x7fc69011d5c0 2026-02-17T11:08:39.660 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.642+0000 7fc69896a640 1 librados: init done 2026-02-17T11:08:39.660 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.642+0000 7fc69896a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:39.660 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.642+0000 7fc69896a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:39.660 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.642+0000 7fc69896a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:08:39.660 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.642+0000 7fc69896a640 1 -- 10.20.193.162:0/3027977177 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc690125c10 con 0x7fc69011d5c0 2026-02-17T11:08:39.660 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.643+0000 7fc67affd640 1 -- 10.20.193.162:0/3027977177 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc67c02faa0 con 0x7fc69011d5c0 2026-02-17T11:08:39.660 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.643+0000 7fc67affd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:08:39.660 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.643+0000 7fc67affd640 1 -- 10.20.193.162:0/3027977177 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc67c02fe50 con 0x7fc69011d5c0 2026-02-17T11:08:39.660 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.643+0000 7fc67affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:39.661 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.643+0000 7fc694edc640 4 set_mon_vals no callback set 2026-02-17T11:08:39.661 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.643+0000 7fc67affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:08:39.661 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.643+0000 7fc67affd640 10 monclient: dump: 2026-02-17T11:08:39.661 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:39.661 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:39.661 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:39.661 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:39.661 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:39.661 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:39.661 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:39.661 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:39.661 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:39.661 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:39.718 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.715+0000 7fc67affd640 1 -- 10.20.193.162:0/3027977177 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fc67c003a50 con 0x7fc69011d5c0 2026-02-17T11:08:39.718 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.715+0000 7fc67affd640 1 -- 10.20.193.162:0/3027977177 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fc67c042820 con 0x7fc69011d5c0 2026-02-17T11:08:39.718 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.715+0000 7fc67affd640 10 client.4118.objecter ms_dispatch2 0x7fc690000b90 osd_map(3..3 src has 1..3) 2026-02-17T11:08:39.718 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.715+0000 7fc67affd640 3 client.4118.objecter handle_osd_map got epochs [3,3] > 0 2026-02-17T11:08:39.718 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.715+0000 7fc67affd640 3 client.4118.objecter handle_osd_map decoding full epoch 3 2026-02-17T11:08:39.718 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.715+0000 7fc67affd640 20 client.4118.objecter dump_active .. 0 homeless 2026-02-17T11:08:39.721 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.719+0000 7fc67affd640 1 -- 10.20.193.162:0/3027977177 <== mon.2 v2:10.20.193.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7fc67c003d70 con 0x7fc69011d5c0 2026-02-17T11:08:39.722 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.719+0000 7fc67affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:39.722 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.719+0000 7fc67affd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:08:39.754 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.752+0000 7fc69896a640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "2f7f1f11-f256-4094-82a9-5d21882e6e0e", "id": 1}] 2026-02-17T11:08:39.754 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.752+0000 7fc69896a640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "2f7f1f11-f256-4094-82a9-5d21882e6e0e", "id": 1}] 2026-02-17T11:08:39.754 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.752+0000 7fc69896a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:08:39.754 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.752+0000 7fc69896a640 1 -- 10.20.193.162:0/3027977177 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2f7f1f11-f256-4094-82a9-5d21882e6e0e", "id": 1} v 0) -- 0x7fc69011c6f0 con 0x7fc69011d5c0 2026-02-17T11:08:39.812 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.810+0000 7fc67affd640 1 -- 10.20.193.162:0/3027977177 <== mon.2 v2:10.20.193.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2f7f1f11-f256-4094-82a9-5d21882e6e0e", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fc69011c6f0 con 0x7fc69011d5c0 2026-02-17T11:08:39.812 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.810+0000 7fc67affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "2f7f1f11-f256-4094-82a9-5d21882e6e0e", "id": 1}] 2026-02-17T11:08:39.812 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.810+0000 7fc67affd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:08:39.812 INFO:teuthology.orchestra.run.trial162.stdout:1 2026-02-17T11:08:39.813 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.810+0000 7fc69896a640 10 librados: watch_flush enter 2026-02-17T11:08:39.813 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.810+0000 7fc69896a640 10 librados: watch_flush exit 2026-02-17T11:08:39.813 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.810+0000 7fc69896a640 20 client.4118.objecter shutdown clearing up homeless session... 2026-02-17T11:08:39.813 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.810+0000 7fc69896a640 10 client.4118.objecter successfully canceled tick 2026-02-17T11:08:39.813 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.810+0000 7fc69896a640 10 monclient: shutdown 2026-02-17T11:08:39.813 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.810+0000 7fc69896a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:08:39.814 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.810+0000 7fc69896a640 1 -- 10.20.193.162:0/3027977177 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc69011d5c0 msgr2=0x7fc690117e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:39.814 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.810+0000 7fc69896a640 1 --2- 10.20.193.162:0/3027977177 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc69011d5c0 0x7fc690117e30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc67c009130 tx=0x7fc67c0047c0 comp rx=0 tx=0).stop 2026-02-17T11:08:39.814 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.811+0000 7fc69896a640 1 -- 10.20.193.162:0/3027977177 shutdown_connections 2026-02-17T11:08:39.814 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.811+0000 7fc69896a640 1 --2- 10.20.193.162:0/3027977177 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc69011ff80 0x7fc6901b7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:39.814 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.811+0000 7fc69896a640 1 --2- 10.20.193.162:0/3027977177 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc69011d5c0 0x7fc690117e30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:39.814 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.811+0000 7fc69896a640 1 --2- 10.20.193.162:0/3027977177 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc6901149f0 0x7fc6901177c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:39.814 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.811+0000 7fc69896a640 1 -- 10.20.193.162:0/3027977177 >> 10.20.193.162:0/3027977177 conn(0x7fc690073660 msgr2=0x7fc6901245c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:08:39.814 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.811+0000 7fc69896a640 1 -- 10.20.193.162:0/3027977177 shutdown_connections 2026-02-17T11:08:39.814 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.811+0000 7fc69896a640 1 -- 10.20.193.162:0/3027977177 wait complete. 2026-02-17T11:08:39.814 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.811+0000 7fc69896a640 1 librados: shutdown 2026-02-17T11:08:39.821 DEBUG:teuthology.orchestra.run.trial162:> sudo ceph --cluster ceph osd new 26bd1274-fe52-42cb-876b-df9920880f95 2 2026-02-17T11:08:39.865 INFO:tasks.ceph.mgr.x.trial162.stderr:2026-02-17T11:08:39.863+0000 7efc3f612140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-17T11:08:39.887 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.883+0000 7f39f3ff7640 10 monclient: get_monmap_and_config 2026-02-17T11:08:39.888 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.883+0000 7f39f3ff7640 10 monclient: build_initial_monmap 2026-02-17T11:08:39.888 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.883+0000 7f39f3ff7640 10 monclient: monmap: 2026-02-17T11:08:39.888 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-17T11:08:39.888 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:39.888 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:08:39.885484+0000 2026-02-17T11:08:39.888 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:08:39.885484+0000 2026-02-17T11:08:39.888 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-17T11:08:39.888 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:39.888 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:08:39.888 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:08:39.889 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:08:39.889 INFO:teuthology.orchestra.run.trial162.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:08:39.889 INFO:teuthology.orchestra.run.trial162.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:08:39.889 INFO:teuthology.orchestra.run.trial162.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:08:39.889 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:39.889 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.884+0000 7f39f3ff7640 1 Processor -- start 2026-02-17T11:08:39.889 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.884+0000 7f39f3ff7640 1 -- start start 2026-02-17T11:08:39.889 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.884+0000 7f39f3ff7640 10 monclient: init 2026-02-17T11:08:39.889 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.884+0000 7f39f3ff7640 10 monclient: _reopen_session rank -1 2026-02-17T11:08:39.889 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.884+0000 7f39f3ff7640 10 monclient: _add_conns ranks=[3,2,5,4,0,1] 2026-02-17T11:08:39.889 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.884+0000 7f39f3ff7640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f39ec073830 0x7f39ec1181d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:39.889 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.884+0000 7f39f3ff7640 10 monclient(hunting): picked mon.noname-a con 0x7f39ec073830 addr v2:10.20.193.49:3300/0 2026-02-17T11:08:39.889 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.884+0000 7f39f3ff7640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f39ec073c10 addr v1:10.20.193.157:6789/0 2026-02-17T11:08:39.890 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.884+0000 7f39f3ff7640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f39ec074080 0x7f39ec126a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:39.890 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.884+0000 7f39f3ff7640 10 monclient(hunting): picked mon.noname-c con 0x7f39ec074080 addr v2:10.20.193.157:3300/0 2026-02-17T11:08:39.890 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.884+0000 7f39f3ff7640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39ec127070 con 0x7f39ec073c10 2026-02-17T11:08:39.890 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.884+0000 7f39f3ff7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:39.890 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.884+0000 7f39f3ff7640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f39ec128290 con 0x7f39ec073830 2026-02-17T11:08:39.890 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.884+0000 7f39f3ff7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:39.890 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.884+0000 7f39f3ff7640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f39ec128410 con 0x7f39ec074080 2026-02-17T11:08:39.890 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.884+0000 7f39f3ff7640 10 monclient(hunting): _renew_subs 2026-02-17T11:08:39.890 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.884+0000 7f39f3ff7640 10 monclient(hunting): authenticate will time out at 957.623505s 2026-02-17T11:08:39.890 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.884+0000 7f39f156b640 1 --1- >> v1:10.20.193.157:6789/0 conn(0x7f39ec073c10 0x7f39ec123340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.157:6789/0 says I am v1:10.20.193.162:39438/0 (socket says 10.20.193.162:39438) 2026-02-17T11:08:39.891 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.884+0000 7f39f156b640 1 -- 10.20.193.162:0/4104997127 learned_addr learned my addr 10.20.193.162:0/4104997127 (peer_addr_for_me v1:10.20.193.162:0/0) 2026-02-17T11:08:39.891 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.885+0000 7f39f1d6c640 1 --2- 10.20.193.162:0/4104997127 >> v2:10.20.193.49:3300/0 conn(0x7f39ec073830 0x7f39ec1181d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:39.891 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.885+0000 7f39f1d6c640 10 monclient(hunting): get_auth_request con 0x7f39ec073830 auth_method 0 2026-02-17T11:08:39.891 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.885+0000 7f39f1d6c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:39.891 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.885+0000 7f39f1d6c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:39.891 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.885+0000 7f39f1d6c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:39.891 INFO:tasks.ceph.mgr.x.trial162.stderr:2026-02-17T11:08:39.885+0000 7efc3f612140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-17T11:08:39.902 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.885+0000 7f39f1d6c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:39.902 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.885+0000 7f39f1d6c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:39.902 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.885+0000 7f39f1d6c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:39.902 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.886+0000 7f39f256d640 1 --2- 10.20.193.162:0/4104997127 >> v2:10.20.193.157:3300/0 conn(0x7f39ec074080 0x7f39ec126a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:39.902 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.886+0000 7f39f0d6a640 1 -- 10.20.193.162:0/4104997127 <== mon.2 v1:10.20.193.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3577213449 0 0) 0x7f39ec127070 con 0x7f39ec073c10 2026-02-17T11:08:39.902 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.886+0000 7f39f0d6a640 10 monclient(hunting): _negotiate 2026-02-17T11:08:39.902 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.886+0000 7f39f0d6a640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:39.902 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.886+0000 7f39f0d6a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:39.902 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.886+0000 7f39f0d6a640 10 monclient(hunting): my global_id is 4121 2026-02-17T11:08:39.902 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.886+0000 7f39f0d6a640 1 -- 10.20.193.162:0/4104997127 --> v1:10.20.193.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f39d4003620 con 0x7f39ec073c10 2026-02-17T11:08:39.902 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.886+0000 7f39f256d640 10 monclient(hunting): get_auth_request con 0x7f39ec074080 auth_method 0 2026-02-17T11:08:39.902 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.886+0000 7f39f256d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:39.902 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.886+0000 7f39f256d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:39.902 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.886+0000 7f39f256d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:39.902 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.886+0000 7f39f1d6c640 10 monclient(hunting): handle_auth_done global_id 4116 payload 274 2026-02-17T11:08:39.902 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.886+0000 7f39f1d6c640 1 -- 10.20.193.162:0/4104997127 >> v2:10.20.193.157:3300/0 conn(0x7f39ec074080 msgr2=0x7f39ec126a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:08:39.902 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.886+0000 7f39f1d6c640 1 --2- 10.20.193.162:0/4104997127 >> v2:10.20.193.157:3300/0 conn(0x7f39ec074080 0x7f39ec126a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:39.902 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.886+0000 7f39f1d6c640 1 -- 10.20.193.162:0/4104997127 >> v1:10.20.193.157:6789/0 conn(0x7f39ec073c10 legacy=0x7f39ec123340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:39.902 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.886+0000 7f39f1d6c640 10 monclient: _finish_hunting 0 2026-02-17T11:08:39.902 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.886+0000 7f39f1d6c640 1 monclient: found mon.noname-a 2026-02-17T11:08:39.902 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.886+0000 7f39f1d6c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:08:39.902 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.886+0000 7f39f1d6c640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:08:39.902 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.886+0000 7f39f1d6c640 1 -- 10.20.193.162:0/4104997127 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39ec1285c0 con 0x7f39ec073830 2026-02-17T11:08:39.902 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.887+0000 7f39f1d6c640 1 --2- 10.20.193.162:0/4104997127 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f39ec073830 0x7f39ec1181d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f39ec118830 tx=0x7f39dc02ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aeac927ecd00803 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:08:39.903 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.889+0000 7f39f0d6a640 1 -- 10.20.193.162:0/4104997127 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39dc03c070 con 0x7f39ec073830 2026-02-17T11:08:39.903 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.889+0000 7f39f0d6a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:39.903 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.889+0000 7f39f0d6a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:08:39.903 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.889+0000 7f39f0d6a640 10 monclient: dump: 2026-02-17T11:08:39.903 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:39.903 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:39.903 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:39.903 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:39.903 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:39.903 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:39.903 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:39.903 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:39.903 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:39.903 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:39.903 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.889+0000 7f39f0d6a640 10 monclient: _finish_auth 0 2026-02-17T11:08:39.903 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.889+0000 7f39f0d6a640 10 monclient: _check_auth_tickets 2026-02-17T11:08:39.903 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.889+0000 7f39f0d6a640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:08:39.903 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.889+0000 7f39f3ff7640 5 monclient: authenticate success, global_id 4116 2026-02-17T11:08:39.903 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.889+0000 7f39f3ff7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:08:39.903 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.889+0000 7f39f0d6a640 1 -- 10.20.193.162:0/4104997127 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39dc02fa60 con 0x7f39ec073830 2026-02-17T11:08:39.903 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.889+0000 7f39f0d6a640 10 monclient: handle_config config(0 keys) 2026-02-17T11:08:39.903 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.889+0000 7f39f0d6a640 1 -- 10.20.193.162:0/4104997127 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39dc02fe10 con 0x7f39ec073830 2026-02-17T11:08:39.903 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.889+0000 7f39f3ff7640 10 monclient: get_monmap_and_config success 2026-02-17T11:08:39.903 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.889+0000 7f39f3ff7640 4 set_mon_vals no callback set 2026-02-17T11:08:39.903 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.889+0000 7f39f0d6a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:39.903 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.889+0000 7f39f0d6a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:08:39.903 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.889+0000 7f39f0d6a640 10 monclient: dump: 2026-02-17T11:08:39.903 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:39.903 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:39.903 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:39.903 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:39.903 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:39.903 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:39.903 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:39.903 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:39.903 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:39.903 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:39.903 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.889+0000 7f39f3ff7640 10 monclient: shutdown 2026-02-17T11:08:39.903 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.889+0000 7f39f3ff7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:08:39.903 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.889+0000 7f39f3ff7640 1 -- 10.20.193.162:0/4104997127 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f39ec073830 msgr2=0x7f39ec1181d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:39.903 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.889+0000 7f39f3ff7640 1 --2- 10.20.193.162:0/4104997127 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f39ec073830 0x7f39ec1181d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f39ec118830 tx=0x7f39dc02ed50 comp rx=0 tx=0).stop 2026-02-17T11:08:39.904 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.890+0000 7f39f3ff7640 1 -- 10.20.193.162:0/4104997127 shutdown_connections 2026-02-17T11:08:39.904 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.890+0000 7f39f3ff7640 1 --2- 10.20.193.162:0/4104997127 >> v2:10.20.193.157:3300/0 conn(0x7f39ec074080 0x7f39ec126a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:39.904 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.890+0000 7f39f3ff7640 1 --2- 10.20.193.162:0/4104997127 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f39ec073830 0x7f39ec1181d0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:39.904 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.890+0000 7f39f3ff7640 1 -- 10.20.193.162:0/4104997127 >> 10.20.193.162:0/4104997127 conn(0x7f39ec06f660 msgr2=0x7f39ec071a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:08:39.904 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.890+0000 7f39f3ff7640 1 -- 10.20.193.162:0/4104997127 shutdown_connections 2026-02-17T11:08:39.904 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.890+0000 7f39f3ff7640 1 -- 10.20.193.162:0/4104997127 wait complete. 2026-02-17T11:08:39.904 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.890+0000 7f39f3ff7640 10 monclient: build_initial_monmap 2026-02-17T11:08:39.904 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.890+0000 7f39f3ff7640 10 monclient: monmap: 2026-02-17T11:08:39.904 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-17T11:08:39.904 INFO:teuthology.orchestra.run.trial162.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:08:39.904 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 0.000000 2026-02-17T11:08:39.904 INFO:teuthology.orchestra.run.trial162.stderr:created 0.000000 2026-02-17T11:08:39.904 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-17T11:08:39.904 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:39.904 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:08:39.904 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:08:39.904 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:08:39.904 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:39.904 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.890+0000 7f39f3ff7640 1 librados: starting msgr at 2026-02-17T11:08:39.904 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.890+0000 7f39f3ff7640 1 librados: starting objecter 2026-02-17T11:08:39.904 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.890+0000 7f39f3ff7640 1 Processor -- start 2026-02-17T11:08:39.904 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.890+0000 7f39f3ff7640 1 -- start start 2026-02-17T11:08:39.904 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.890+0000 7f39f3ff7640 1 librados: setting wanted keys 2026-02-17T11:08:39.904 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.890+0000 7f39f3ff7640 1 librados: calling monclient init 2026-02-17T11:08:39.904 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.890+0000 7f39f3ff7640 10 monclient: init 2026-02-17T11:08:39.904 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.890+0000 7f39f3ff7640 10 monclient: _reopen_session rank -1 2026-02-17T11:08:39.904 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.890+0000 7f39f3ff7640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:08:39.904 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.890+0000 7f39f3ff7640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f39ec073830 0x7f39ec1afb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:39.904 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.890+0000 7f39f3ff7640 10 monclient(hunting): picked mon.noname-c con 0x7f39ec073830 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:08:39.904 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.890+0000 7f39f3ff7640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f39ec073c10 0x7f39ec1b01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:39.904 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.890+0000 7f39f3ff7640 10 monclient(hunting): picked mon.noname-a con 0x7f39ec073c10 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:08:39.904 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.890+0000 7f39f3ff7640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f39ec074080 0x7f39ec1b4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:39.904 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.890+0000 7f39f3ff7640 10 monclient(hunting): picked mon.noname-b con 0x7f39ec074080 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:08:39.904 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.890+0000 7f39f3ff7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:39.904 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.890+0000 7f39f3ff7640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f39ec127700 con 0x7f39ec073c10 2026-02-17T11:08:39.904 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.890+0000 7f39f3ff7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:39.904 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.890+0000 7f39f3ff7640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f39ec127580 con 0x7f39ec074080 2026-02-17T11:08:39.904 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.890+0000 7f39f3ff7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:39.904 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.890+0000 7f39f3ff7640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f39ec127880 con 0x7f39ec073830 2026-02-17T11:08:39.904 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.890+0000 7f39f3ff7640 10 monclient(hunting): _renew_subs 2026-02-17T11:08:39.904 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.890+0000 7f39f3ff7640 10 monclient(hunting): authenticate will time out at 957.629790s 2026-02-17T11:08:39.904 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.891+0000 7f39f156b640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f39ec073c10 0x7f39ec1b01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:39.904 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.891+0000 7f39f256d640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f39ec074080 0x7f39ec1b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:39.905 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.891+0000 7f39f1d6c640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f39ec073830 0x7f39ec1afb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:39.905 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.891+0000 7f39f156b640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f39ec073c10 0x7f39ec1b01f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.162:57120/0 (socket says 10.20.193.162:57120) 2026-02-17T11:08:39.905 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.891+0000 7f39f156b640 1 -- 10.20.193.162:0/3596055147 learned_addr learned my addr 10.20.193.162:0/3596055147 (peer_addr_for_me v2:10.20.193.162:0/0) 2026-02-17T11:08:39.905 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.891+0000 7f39f156b640 10 monclient(hunting): get_auth_request con 0x7f39ec073c10 auth_method 0 2026-02-17T11:08:39.905 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.891+0000 7f39f156b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:39.905 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.891+0000 7f39f156b640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:39.905 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.891+0000 7f39f156b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:39.905 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.891+0000 7f39f256d640 10 monclient(hunting): get_auth_request con 0x7f39ec074080 auth_method 0 2026-02-17T11:08:39.905 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.891+0000 7f39f256d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:39.905 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.891+0000 7f39f256d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:39.905 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.891+0000 7f39f256d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:39.905 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.891+0000 7f39f1d6c640 10 monclient(hunting): get_auth_request con 0x7f39ec073830 auth_method 0 2026-02-17T11:08:39.905 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.891+0000 7f39f1d6c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:39.905 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.891+0000 7f39f1d6c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:39.905 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.891+0000 7f39f1d6c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:39.905 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.891+0000 7f39f156b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:39.905 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.891+0000 7f39f156b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:39.905 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.891+0000 7f39f156b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:39.905 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.891+0000 7f39f256d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:39.905 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.891+0000 7f39f256d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:39.905 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.891+0000 7f39f256d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:39.905 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.891+0000 7f39f1d6c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:39.905 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.891+0000 7f39f1d6c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:39.905 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.891+0000 7f39f1d6c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:39.905 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.892+0000 7f39f156b640 10 monclient(hunting): handle_auth_done global_id 4119 payload 824 2026-02-17T11:08:39.905 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.892+0000 7f39f156b640 1 -- 10.20.193.162:0/3596055147 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f39ec073830 msgr2=0x7f39ec1afb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:39.905 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.892+0000 7f39f156b640 1 --2- 10.20.193.162:0/3596055147 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f39ec073830 0x7f39ec1afb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:39.905 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.892+0000 7f39f156b640 1 -- 10.20.193.162:0/3596055147 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f39ec074080 msgr2=0x7f39ec1b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:39.905 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.892+0000 7f39f156b640 1 --2- 10.20.193.162:0/3596055147 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f39ec074080 0x7f39ec1b4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:39.905 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.892+0000 7f39f156b640 10 monclient: _finish_hunting 0 2026-02-17T11:08:39.905 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.892+0000 7f39f156b640 1 monclient: found mon.noname-a 2026-02-17T11:08:39.905 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.892+0000 7f39f156b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:08:39.905 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.892+0000 7f39f156b640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:08:39.905 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.892+0000 7f39f156b640 1 -- 10.20.193.162:0/3596055147 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39ec1b4b50 con 0x7f39ec073c10 2026-02-17T11:08:39.905 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.893+0000 7f39f156b640 1 --2- 10.20.193.162:0/3596055147 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f39ec073c10 0x7f39ec1b01f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f39e000c730 tx=0x7f39e000cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:08:39.905 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.893+0000 7f39da7fc640 10 client.?.objecter ms_handle_connect 0x7f39ec073c10 2026-02-17T11:08:39.905 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.893+0000 7f39da7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T11:08:39.905 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.894+0000 7f39da7fc640 1 -- 10.20.193.162:0/3596055147 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e0017070 con 0x7f39ec073c10 2026-02-17T11:08:39.905 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.894+0000 7f39da7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:39.905 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.894+0000 7f39da7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:08:39.905 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.894+0000 7f39da7fc640 10 monclient: dump: 2026-02-17T11:08:39.905 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:39.905 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:39.905 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:39.906 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:39.906 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:39.906 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:39.906 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:39.906 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:39.906 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:39.906 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:39.906 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.894+0000 7f39da7fc640 10 monclient: _finish_auth 0 2026-02-17T11:08:39.906 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.894+0000 7f39da7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:08:39.906 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.894+0000 7f39da7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:08:39.906 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.894+0000 7f39f3ff7640 5 monclient: authenticate success, global_id 4119 2026-02-17T11:08:39.906 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.894+0000 7f39f3ff7640 10 monclient: _renew_subs 2026-02-17T11:08:39.906 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.894+0000 7f39f3ff7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:08:39.906 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.894+0000 7f39f3ff7640 1 -- 10.20.193.162:0/3596055147 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39ec1b4e40 con 0x7f39ec073c10 2026-02-17T11:08:39.906 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.894+0000 7f39f3ff7640 10 client.4119.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:08:39.906 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.894+0000 7f39f3ff7640 10 monclient: _renew_subs 2026-02-17T11:08:39.906 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.894+0000 7f39f3ff7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:08:39.906 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.894+0000 7f39f3ff7640 1 -- 10.20.193.162:0/3596055147 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39ec1bc5c0 con 0x7f39ec073c10 2026-02-17T11:08:39.906 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.894+0000 7f39f3ff7640 1 librados: init done 2026-02-17T11:08:39.906 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.895+0000 7f39da7fc640 1 -- 10.20.193.162:0/3596055147 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39e0005bb0 con 0x7f39ec073c10 2026-02-17T11:08:39.906 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.895+0000 7f39da7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:08:39.906 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.895+0000 7f39dbfff640 4 set_mon_vals no callback set 2026-02-17T11:08:39.906 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.895+0000 7f39da7fc640 1 -- 10.20.193.162:0/3596055147 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e0007070 con 0x7f39ec073c10 2026-02-17T11:08:39.906 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.895+0000 7f39da7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:39.906 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.895+0000 7f39da7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:08:39.906 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.895+0000 7f39da7fc640 10 monclient: dump: 2026-02-17T11:08:39.906 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:39.906 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:39.906 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:39.906 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:39.906 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:39.906 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:39.906 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:39.906 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:39.906 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:39.906 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:39.906 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.895+0000 7f39f3ff7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:39.906 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.895+0000 7f39f3ff7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:39.906 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.895+0000 7f39f3ff7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:08:39.906 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.895+0000 7f39f3ff7640 1 -- 10.20.193.162:0/3596055147 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39ec127c90 con 0x7f39ec073c10 2026-02-17T11:08:39.907 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.904+0000 7f39da7fc640 1 -- 10.20.193.162:0/3596055147 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f39e0007210 con 0x7f39ec073c10 2026-02-17T11:08:39.907 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.904+0000 7f39da7fc640 1 -- 10.20.193.162:0/3596055147 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f39e000adf0 con 0x7f39ec073c10 2026-02-17T11:08:39.907 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.904+0000 7f39da7fc640 10 client.4119.objecter ms_dispatch2 0x7f39ec000b90 osd_map(4..4 src has 1..4) 2026-02-17T11:08:39.907 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.904+0000 7f39da7fc640 3 client.4119.objecter handle_osd_map got epochs [4,4] > 0 2026-02-17T11:08:39.907 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.904+0000 7f39da7fc640 3 client.4119.objecter handle_osd_map decoding full epoch 4 2026-02-17T11:08:39.907 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.904+0000 7f39da7fc640 20 client.4119.objecter dump_active .. 0 homeless 2026-02-17T11:08:39.932 INFO:tasks.ceph.mgr.y.trial049.stderr:2026-02-17T11:08:39.931+0000 7f5cf3fdc140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-17T11:08:39.953 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.951+0000 7f39da7fc640 1 -- 10.20.193.162:0/3596055147 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f39e0022070 con 0x7f39ec073c10 2026-02-17T11:08:39.953 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.951+0000 7f39da7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:39.953 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.951+0000 7f39da7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:08:39.953 INFO:tasks.ceph.mgr.y.trial049.stderr:2026-02-17T11:08:39.952+0000 7f5cf3fdc140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-17T11:08:39.986 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.984+0000 7f39f3ff7640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "26bd1274-fe52-42cb-876b-df9920880f95", "id": 2}] 2026-02-17T11:08:39.986 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.984+0000 7f39f3ff7640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "26bd1274-fe52-42cb-876b-df9920880f95", "id": 2}] 2026-02-17T11:08:39.986 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.984+0000 7f39f3ff7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:08:39.986 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:39.984+0000 7f39f3ff7640 1 -- 10.20.193.162:0/3596055147 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "osd new", "uuid": "26bd1274-fe52-42cb-876b-df9920880f95", "id": 2} v 0) -- 0x7f39ec112330 con 0x7f39ec073c10 2026-02-17T11:08:40.007 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.005+0000 7f39da7fc640 1 -- 10.20.193.162:0/3596055147 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "26bd1274-fe52-42cb-876b-df9920880f95", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f39e00076c0 con 0x7f39ec073c10 2026-02-17T11:08:40.007 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.005+0000 7f39da7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "26bd1274-fe52-42cb-876b-df9920880f95", "id": 2}] 2026-02-17T11:08:40.007 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.005+0000 7f39da7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:08:40.008 INFO:teuthology.orchestra.run.trial162.stdout:2 2026-02-17T11:08:40.008 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.006+0000 7f39f3ff7640 10 librados: watch_flush enter 2026-02-17T11:08:40.008 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.006+0000 7f39f3ff7640 10 librados: watch_flush exit 2026-02-17T11:08:40.008 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.006+0000 7f39f3ff7640 20 client.4119.objecter shutdown clearing up homeless session... 2026-02-17T11:08:40.008 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.006+0000 7f39f3ff7640 10 client.4119.objecter successfully canceled tick 2026-02-17T11:08:40.008 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.006+0000 7f39f3ff7640 10 monclient: shutdown 2026-02-17T11:08:40.008 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.006+0000 7f39f3ff7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:08:40.008 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.006+0000 7f39f3ff7640 1 -- 10.20.193.162:0/3596055147 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f39ec073c10 msgr2=0x7f39ec1b01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:40.008 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.006+0000 7f39f3ff7640 1 --2- 10.20.193.162:0/3596055147 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f39ec073c10 0x7f39ec1b01f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f39e000c730 tx=0x7f39e000cc00 comp rx=0 tx=0).stop 2026-02-17T11:08:40.008 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.006+0000 7f39f3ff7640 1 -- 10.20.193.162:0/3596055147 shutdown_connections 2026-02-17T11:08:40.008 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.006+0000 7f39f3ff7640 1 --2- 10.20.193.162:0/3596055147 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f39ec074080 0x7f39ec1b4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:40.008 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.006+0000 7f39f3ff7640 1 --2- 10.20.193.162:0/3596055147 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f39ec073c10 0x7f39ec1b01f0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:40.008 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.006+0000 7f39f3ff7640 1 --2- 10.20.193.162:0/3596055147 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f39ec073830 0x7f39ec1afb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:40.008 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.006+0000 7f39f3ff7640 1 -- 10.20.193.162:0/3596055147 >> 10.20.193.162:0/3596055147 conn(0x7f39ec06f660 msgr2=0x7f39ec1245b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:08:40.008 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.006+0000 7f39f3ff7640 1 -- 10.20.193.162:0/3596055147 shutdown_connections 2026-02-17T11:08:40.008 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.006+0000 7f39f3ff7640 1 -- 10.20.193.162:0/3596055147 wait complete. 2026-02-17T11:08:40.008 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.006+0000 7f39f3ff7640 1 librados: shutdown 2026-02-17T11:08:40.017 DEBUG:teuthology.orchestra.run.trial162:> sudo ceph --cluster ceph osd new c78a5263-3b0d-4b22-a848-bcd6a1e4f6b0 3 2026-02-17T11:08:40.084 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.079+0000 7f07adce1640 10 monclient: get_monmap_and_config 2026-02-17T11:08:40.085 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.079+0000 7f07adce1640 10 monclient: build_initial_monmap 2026-02-17T11:08:40.085 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.079+0000 7f07adce1640 10 monclient: monmap: 2026-02-17T11:08:40.085 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-17T11:08:40.085 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:40.085 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:08:40.081095+0000 2026-02-17T11:08:40.085 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:08:40.081095+0000 2026-02-17T11:08:40.085 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-17T11:08:40.085 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:40.085 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:08:40.085 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:08:40.085 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:08:40.086 INFO:teuthology.orchestra.run.trial162.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:08:40.086 INFO:teuthology.orchestra.run.trial162.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:08:40.086 INFO:teuthology.orchestra.run.trial162.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:08:40.086 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:40.086 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.079+0000 7f07adce1640 1 Processor -- start 2026-02-17T11:08:40.086 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.079+0000 7f07adce1640 1 -- start start 2026-02-17T11:08:40.086 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.079+0000 7f07adce1640 10 monclient: init 2026-02-17T11:08:40.086 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.080+0000 7f07adce1640 10 monclient: _reopen_session rank -1 2026-02-17T11:08:40.086 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.080+0000 7f07adce1640 10 monclient: _add_conns ranks=[3,4,1,5,0,2] 2026-02-17T11:08:40.086 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.080+0000 7f07adce1640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f07a8117560 0x7f07a8117940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:40.086 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.080+0000 7f07adce1640 10 monclient(hunting): picked mon.noname-a con 0x7f07a8117560 addr v2:10.20.193.49:3300/0 2026-02-17T11:08:40.086 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.080+0000 7f07adce1640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f07a8116090 0x7f07a81164f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:40.087 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.080+0000 7f07adce1640 10 monclient(hunting): picked mon.noname-b con 0x7f07a8116090 addr v2:10.20.193.97:3300/0 2026-02-17T11:08:40.087 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.080+0000 7f07adce1640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f07a8116a30 addr v1:10.20.193.97:6789/0 2026-02-17T11:08:40.087 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.080+0000 7f07adce1640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07a8120a20 con 0x7f07a8116a30 2026-02-17T11:08:40.087 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.080+0000 7f07adce1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:40.087 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.080+0000 7f07adce1640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f07a8121c00 con 0x7f07a8117560 2026-02-17T11:08:40.087 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.080+0000 7f07adce1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:40.087 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.080+0000 7f07adce1640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f07a8121d80 con 0x7f07a8116090 2026-02-17T11:08:40.087 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.080+0000 7f07adce1640 10 monclient(hunting): _renew_subs 2026-02-17T11:08:40.087 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.080+0000 7f07adce1640 10 monclient(hunting): authenticate will time out at 957.819164s 2026-02-17T11:08:40.088 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.080+0000 7f07a6ffd640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f07a8116090 0x7f07a81164f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:40.088 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.080+0000 7f07a77fe640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f07a8117560 0x7f07a8117940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:40.088 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.080+0000 7f07a6ffd640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f07a8116090 0x7f07a81164f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.162:48418/0 (socket says 10.20.193.162:48418) 2026-02-17T11:08:40.088 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.080+0000 7f07a6ffd640 1 -- 10.20.193.162:0/3392992748 learned_addr learned my addr 10.20.193.162:0/3392992748 (peer_addr_for_me v2:10.20.193.162:0/0) 2026-02-17T11:08:40.088 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.080+0000 7f07a6ffd640 10 monclient(hunting): get_auth_request con 0x7f07a8116090 auth_method 0 2026-02-17T11:08:40.088 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.080+0000 7f07a6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:40.088 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.080+0000 7f07a6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:40.089 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.080+0000 7f07a6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:40.089 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.080+0000 7f07a77fe640 10 monclient(hunting): get_auth_request con 0x7f07a8117560 auth_method 0 2026-02-17T11:08:40.089 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.080+0000 7f07a77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:40.089 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.080+0000 7f07a77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:40.089 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.080+0000 7f07a77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:40.089 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.081+0000 7f07a6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:40.090 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.081+0000 7f07a6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:40.090 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.081+0000 7f07a6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:40.090 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.081+0000 7f07a77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:40.090 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.081+0000 7f07a77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:40.090 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.081+0000 7f07a77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:40.090 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.081+0000 7f07a6ffd640 10 monclient(hunting): handle_auth_done global_id 4126 payload 274 2026-02-17T11:08:40.090 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.081+0000 7f07a6ffd640 1 -- 10.20.193.162:0/3392992748 >> v2:10.20.193.49:3300/0 conn(0x7f07a8117560 msgr2=0x7f07a8117940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:08:40.090 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.081+0000 7f07a6ffd640 1 --2- 10.20.193.162:0/3392992748 >> v2:10.20.193.49:3300/0 conn(0x7f07a8117560 0x7f07a8117940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:40.090 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.081+0000 7f07a6ffd640 1 -- 10.20.193.162:0/3392992748 >> v1:10.20.193.97:6789/0 conn(0x7f07a8116a30 legacy=0x7f07a811f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:08:40.090 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.081+0000 7f07a6ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:08:40.091 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.081+0000 7f07a6ffd640 1 monclient: found mon.noname-b 2026-02-17T11:08:40.091 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.081+0000 7f07a6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:08:40.091 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.081+0000 7f07a6ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:08:40.091 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.081+0000 7f07a6ffd640 1 -- 10.20.193.162:0/3392992748 --> v2:10.20.193.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07a8121f00 con 0x7f07a8116090 2026-02-17T11:08:40.098 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.084+0000 7f07a6ffd640 1 --2- 10.20.193.162:0/3392992748 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f07a8116090 0x7f07a81164f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f07a8119250 tx=0x7f079802ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c09ae4a0efda465 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:08:40.098 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.085+0000 7f07a67fc640 1 -- 10.20.193.162:0/3392992748 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f079803c070 con 0x7f07a8116090 2026-02-17T11:08:40.098 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.085+0000 7f07a67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:40.098 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.085+0000 7f07a67fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:08:40.098 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.085+0000 7f07a67fc640 10 monclient: dump: 2026-02-17T11:08:40.098 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:40.098 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:40.098 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:40.098 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:40.098 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:40.099 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:40.099 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:40.099 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:40.099 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:40.099 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:40.099 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.085+0000 7f07a67fc640 10 monclient: _finish_auth 0 2026-02-17T11:08:40.099 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.085+0000 7f07a67fc640 10 monclient: _check_auth_tickets 2026-02-17T11:08:40.099 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.085+0000 7f07a67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:08:40.099 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.085+0000 7f07adce1640 5 monclient: authenticate success, global_id 4126 2026-02-17T11:08:40.099 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.085+0000 7f07adce1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:08:40.099 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.086+0000 7f07a67fc640 1 -- 10.20.193.162:0/3392992748 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f079802fa90 con 0x7f07a8116090 2026-02-17T11:08:40.099 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.086+0000 7f07a67fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:08:40.100 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.086+0000 7f07a67fc640 1 -- 10.20.193.162:0/3392992748 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f079802fe60 con 0x7f07a8116090 2026-02-17T11:08:40.100 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.086+0000 7f07a67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:40.100 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.086+0000 7f07a67fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:08:40.100 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.086+0000 7f07a67fc640 10 monclient: dump: 2026-02-17T11:08:40.100 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:40.100 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:40.100 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:40.100 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:40.100 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:40.100 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:40.100 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:40.100 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:40.100 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:40.101 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:40.101 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.086+0000 7f07adce1640 10 monclient: get_monmap_and_config success 2026-02-17T11:08:40.101 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.086+0000 7f07adce1640 4 set_mon_vals no callback set 2026-02-17T11:08:40.101 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.086+0000 7f07adce1640 10 monclient: shutdown 2026-02-17T11:08:40.101 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.086+0000 7f07adce1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:08:40.101 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.086+0000 7f07adce1640 1 -- 10.20.193.162:0/3392992748 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f07a8116090 msgr2=0x7f07a81164f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:40.101 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.086+0000 7f07adce1640 1 --2- 10.20.193.162:0/3392992748 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f07a8116090 0x7f07a81164f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f07a8119250 tx=0x7f079802ee60 comp rx=0 tx=0).stop 2026-02-17T11:08:40.101 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.086+0000 7f07adce1640 1 -- 10.20.193.162:0/3392992748 shutdown_connections 2026-02-17T11:08:40.101 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.086+0000 7f07adce1640 1 --2- 10.20.193.162:0/3392992748 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f07a8116090 0x7f07a81164f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:40.101 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.086+0000 7f07adce1640 1 --2- 10.20.193.162:0/3392992748 >> v2:10.20.193.49:3300/0 conn(0x7f07a8117560 0x7f07a8117940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:40.101 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.086+0000 7f07adce1640 1 -- 10.20.193.162:0/3392992748 >> 10.20.193.162:0/3392992748 conn(0x7f07a8071500 msgr2=0x7f07a8073920 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:08:40.102 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.086+0000 7f07adce1640 1 -- 10.20.193.162:0/3392992748 shutdown_connections 2026-02-17T11:08:40.102 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.086+0000 7f07adce1640 1 -- 10.20.193.162:0/3392992748 wait complete. 2026-02-17T11:08:40.102 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.087+0000 7f07adce1640 10 monclient: build_initial_monmap 2026-02-17T11:08:40.102 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.087+0000 7f07adce1640 10 monclient: monmap: 2026-02-17T11:08:40.102 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-17T11:08:40.102 INFO:teuthology.orchestra.run.trial162.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:08:40.102 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 0.000000 2026-02-17T11:08:40.102 INFO:teuthology.orchestra.run.trial162.stderr:created 0.000000 2026-02-17T11:08:40.102 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-17T11:08:40.102 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:40.102 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:08:40.102 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:08:40.102 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:08:40.103 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:40.103 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.087+0000 7f07adce1640 1 librados: starting msgr at 2026-02-17T11:08:40.103 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.087+0000 7f07adce1640 1 librados: starting objecter 2026-02-17T11:08:40.103 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.087+0000 7f07adce1640 1 Processor -- start 2026-02-17T11:08:40.103 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.087+0000 7f07adce1640 1 -- start start 2026-02-17T11:08:40.103 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.087+0000 7f07adce1640 1 librados: setting wanted keys 2026-02-17T11:08:40.103 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.087+0000 7f07adce1640 1 librados: calling monclient init 2026-02-17T11:08:40.103 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.087+0000 7f07adce1640 10 monclient: init 2026-02-17T11:08:40.103 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.087+0000 7f07adce1640 10 monclient: _reopen_session rank -1 2026-02-17T11:08:40.103 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.087+0000 7f07adce1640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:08:40.103 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.087+0000 7f07adce1640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f07a8116090 0x7f07a806c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:40.103 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.087+0000 7f07adce1640 10 monclient(hunting): picked mon.noname-b con 0x7f07a8116090 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:08:40.103 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.087+0000 7f07adce1640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f07a8116a30 0x7f07a806cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:40.103 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.087+0000 7f07adce1640 10 monclient(hunting): picked mon.noname-c con 0x7f07a8116a30 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:08:40.104 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.087+0000 7f07adce1640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f07a8117560 0x7f07a81b7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:40.104 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.087+0000 7f07adce1640 10 monclient(hunting): picked mon.noname-a con 0x7f07a8117560 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:08:40.104 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.087+0000 7f07adce1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:40.104 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.087+0000 7f07adce1640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f07a8121050 con 0x7f07a8117560 2026-02-17T11:08:40.104 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.087+0000 7f07adce1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:40.104 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.087+0000 7f07adce1640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f07a8120ed0 con 0x7f07a8116090 2026-02-17T11:08:40.104 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.087+0000 7f07adce1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:40.104 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.087+0000 7f07adce1640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f07a81211d0 con 0x7f07a8116a30 2026-02-17T11:08:40.104 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.087+0000 7f07adce1640 10 monclient(hunting): _renew_subs 2026-02-17T11:08:40.104 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.087+0000 7f07adce1640 10 monclient(hunting): authenticate will time out at 957.826467s 2026-02-17T11:08:40.104 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.087+0000 7f07a77fe640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f07a8116090 0x7f07a806c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:40.104 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.087+0000 7f07a6ffd640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f07a8116a30 0x7f07a806cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:40.105 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.087+0000 7f07a7fff640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f07a8117560 0x7f07a81b7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:40.105 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.087+0000 7f07a77fe640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f07a8116090 0x7f07a806c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.162:48428/0 (socket says 10.20.193.162:48428) 2026-02-17T11:08:40.105 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.087+0000 7f07a77fe640 1 -- 10.20.193.162:0/2676393072 learned_addr learned my addr 10.20.193.162:0/2676393072 (peer_addr_for_me v2:10.20.193.162:0/0) 2026-02-17T11:08:40.105 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.087+0000 7f07a77fe640 10 monclient(hunting): get_auth_request con 0x7f07a8116090 auth_method 0 2026-02-17T11:08:40.105 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.087+0000 7f07a77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:40.105 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.087+0000 7f07a77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:40.105 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.087+0000 7f07a77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:40.105 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.088+0000 7f07a6ffd640 10 monclient(hunting): get_auth_request con 0x7f07a8116a30 auth_method 0 2026-02-17T11:08:40.105 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.088+0000 7f07a6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:40.105 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.088+0000 7f07a6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:40.105 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.088+0000 7f07a6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:40.105 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.088+0000 7f07a7fff640 10 monclient(hunting): get_auth_request con 0x7f07a8117560 auth_method 0 2026-02-17T11:08:40.105 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.088+0000 7f07a7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:40.106 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.088+0000 7f07a7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:40.106 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.088+0000 7f07a7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:40.106 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.088+0000 7f07a77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:40.106 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.088+0000 7f07a77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:40.106 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.088+0000 7f07a77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:40.106 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.088+0000 7f07a7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:40.106 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.088+0000 7f07a7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:40.106 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.088+0000 7f07a7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:40.106 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.088+0000 7f07a6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:40.106 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.088+0000 7f07a6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:40.106 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.088+0000 7f07a6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:40.106 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.089+0000 7f07a77fe640 10 monclient(hunting): handle_auth_done global_id 4129 payload 824 2026-02-17T11:08:40.106 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.089+0000 7f07a77fe640 1 -- 10.20.193.162:0/2676393072 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f07a8116a30 msgr2=0x7f07a806cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:40.106 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.089+0000 7f07a77fe640 1 --2- 10.20.193.162:0/2676393072 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f07a8116a30 0x7f07a806cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:40.107 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.089+0000 7f07a77fe640 1 -- 10.20.193.162:0/2676393072 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f07a8117560 msgr2=0x7f07a81b7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:40.107 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.089+0000 7f07a77fe640 1 --2- 10.20.193.162:0/2676393072 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f07a8117560 0x7f07a81b7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:40.107 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.089+0000 7f07a77fe640 10 monclient: _finish_hunting 0 2026-02-17T11:08:40.107 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.089+0000 7f07a77fe640 1 monclient: found mon.noname-b 2026-02-17T11:08:40.107 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.089+0000 7f07a77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:08:40.107 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.089+0000 7f07a77fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:08:40.107 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.089+0000 7f07a77fe640 1 -- 10.20.193.162:0/2676393072 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07a81b7c70 con 0x7f07a8116090 2026-02-17T11:08:40.107 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.090+0000 7f07a77fe640 1 --2- 10.20.193.162:0/2676393072 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f07a8116090 0x7f07a806c960 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f079400ebe0 tx=0x7f079400c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:08:40.107 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.090+0000 7f0783fff640 10 client.?.objecter ms_handle_connect 0x7f07a8116090 2026-02-17T11:08:40.107 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.090+0000 7f0783fff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:08:40.107 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.092+0000 7f0783fff640 1 -- 10.20.193.162:0/2676393072 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0794017070 con 0x7f07a8116090 2026-02-17T11:08:40.107 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.092+0000 7f0783fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:40.107 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.092+0000 7f0783fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:08:40.107 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.092+0000 7f0783fff640 10 monclient: dump: 2026-02-17T11:08:40.107 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:40.108 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:40.108 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:40.108 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:40.108 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:40.108 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:40.108 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:40.108 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:40.108 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:40.108 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:40.108 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.092+0000 7f0783fff640 10 monclient: _finish_auth 0 2026-02-17T11:08:40.108 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.092+0000 7f0783fff640 10 monclient: _check_auth_tickets 2026-02-17T11:08:40.108 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.092+0000 7f0783fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:08:40.108 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.092+0000 7f0783fff640 1 -- 10.20.193.162:0/2676393072 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f079400cc40 con 0x7f07a8116090 2026-02-17T11:08:40.108 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.092+0000 7f0783fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:08:40.108 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.092+0000 7f0783fff640 1 -- 10.20.193.162:0/2676393072 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0794013470 con 0x7f07a8116090 2026-02-17T11:08:40.108 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.092+0000 7f0783fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:40.109 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.092+0000 7f0783fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:08:40.109 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.092+0000 7f0783fff640 10 monclient: dump: 2026-02-17T11:08:40.109 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:40.109 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:40.109 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:40.109 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:40.109 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:40.109 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:40.109 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:40.109 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:40.109 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:40.109 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:40.109 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.092+0000 7f07a5ffb640 4 set_mon_vals no callback set 2026-02-17T11:08:40.109 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.092+0000 7f07adce1640 5 monclient: authenticate success, global_id 4129 2026-02-17T11:08:40.109 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.092+0000 7f07adce1640 10 monclient: _renew_subs 2026-02-17T11:08:40.110 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.092+0000 7f07adce1640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:08:40.110 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.092+0000 7f07adce1640 1 -- 10.20.193.162:0/2676393072 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07a81b7e40 con 0x7f07a8116090 2026-02-17T11:08:40.110 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.092+0000 7f07adce1640 10 client.4129.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:08:40.110 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.092+0000 7f07adce1640 10 monclient: _renew_subs 2026-02-17T11:08:40.110 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.092+0000 7f07adce1640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:08:40.110 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.092+0000 7f07adce1640 1 -- 10.20.193.162:0/2676393072 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07a81b81f0 con 0x7f07a8116090 2026-02-17T11:08:40.110 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.092+0000 7f07adce1640 1 librados: init done 2026-02-17T11:08:40.110 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.092+0000 7f07adce1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:40.110 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.092+0000 7f07adce1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:40.110 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.092+0000 7f07adce1640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:08:40.110 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.092+0000 7f07adce1640 1 -- 10.20.193.162:0/2676393072 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07a81164f0 con 0x7f07a8116090 2026-02-17T11:08:40.110 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.093+0000 7f0783fff640 1 -- 10.20.193.162:0/2676393072 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f0794024060 con 0x7f07a8116090 2026-02-17T11:08:40.110 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.093+0000 7f0783fff640 1 -- 10.20.193.162:0/2676393072 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f0794013c80 con 0x7f07a8116090 2026-02-17T11:08:40.110 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.093+0000 7f0783fff640 10 client.4129.objecter ms_dispatch2 0x7f07a8000b90 osd_map(5..5 src has 1..5) 2026-02-17T11:08:40.110 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.093+0000 7f0783fff640 3 client.4129.objecter handle_osd_map got epochs [5,5] > 0 2026-02-17T11:08:40.110 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.093+0000 7f0783fff640 3 client.4129.objecter handle_osd_map decoding full epoch 5 2026-02-17T11:08:40.111 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.093+0000 7f0783fff640 20 client.4129.objecter dump_active .. 0 homeless 2026-02-17T11:08:40.135 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.133+0000 7f0783fff640 1 -- 10.20.193.162:0/2676393072 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f0794013610 con 0x7f07a8116090 2026-02-17T11:08:40.136 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.133+0000 7f0783fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:40.136 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.133+0000 7f0783fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:08:40.168 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.166+0000 7f07adce1640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "c78a5263-3b0d-4b22-a848-bcd6a1e4f6b0", "id": 3}] 2026-02-17T11:08:40.168 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.166+0000 7f07adce1640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "c78a5263-3b0d-4b22-a848-bcd6a1e4f6b0", "id": 3}] 2026-02-17T11:08:40.168 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.166+0000 7f07adce1640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:08:40.168 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.166+0000 7f07adce1640 1 -- 10.20.193.162:0/2676393072 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c78a5263-3b0d-4b22-a848-bcd6a1e4f6b0", "id": 3} v 0) -- 0x7f07a81b8480 con 0x7f07a8116090 2026-02-17T11:08:40.202 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.199+0000 7f0783fff640 1 -- 10.20.193.162:0/2676393072 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c78a5263-3b0d-4b22-a848-bcd6a1e4f6b0", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f0794005a90 con 0x7f07a8116090 2026-02-17T11:08:40.202 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.199+0000 7f0783fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "c78a5263-3b0d-4b22-a848-bcd6a1e4f6b0", "id": 3}] 2026-02-17T11:08:40.202 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.199+0000 7f0783fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:08:40.203 INFO:teuthology.orchestra.run.trial162.stdout:3 2026-02-17T11:08:40.205 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.200+0000 7f07adce1640 10 librados: watch_flush enter 2026-02-17T11:08:40.206 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.200+0000 7f07adce1640 10 librados: watch_flush exit 2026-02-17T11:08:40.206 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.200+0000 7f07adce1640 20 client.4129.objecter shutdown clearing up homeless session... 2026-02-17T11:08:40.206 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.200+0000 7f07adce1640 10 client.4129.objecter successfully canceled tick 2026-02-17T11:08:40.206 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.200+0000 7f07adce1640 10 monclient: shutdown 2026-02-17T11:08:40.206 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.200+0000 7f07adce1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:08:40.207 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.200+0000 7f07adce1640 1 -- 10.20.193.162:0/2676393072 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f07a8116090 msgr2=0x7f07a806c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:40.207 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.200+0000 7f07adce1640 1 --2- 10.20.193.162:0/2676393072 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f07a8116090 0x7f07a806c960 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f079400ebe0 tx=0x7f079400c520 comp rx=0 tx=0).stop 2026-02-17T11:08:40.207 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.200+0000 7f07adce1640 1 -- 10.20.193.162:0/2676393072 shutdown_connections 2026-02-17T11:08:40.207 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.200+0000 7f07adce1640 1 --2- 10.20.193.162:0/2676393072 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f07a8117560 0x7f07a81b7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:40.207 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.200+0000 7f07adce1640 1 --2- 10.20.193.162:0/2676393072 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f07a8116a30 0x7f07a806cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:40.207 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.200+0000 7f07adce1640 1 --2- 10.20.193.162:0/2676393072 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f07a8116090 0x7f07a806c960 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:40.207 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.200+0000 7f07adce1640 1 -- 10.20.193.162:0/2676393072 >> 10.20.193.162:0/2676393072 conn(0x7f07a8071500 msgr2=0x7f07a8073a90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:08:40.208 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.200+0000 7f07adce1640 1 -- 10.20.193.162:0/2676393072 shutdown_connections 2026-02-17T11:08:40.208 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.200+0000 7f07adce1640 1 -- 10.20.193.162:0/2676393072 wait complete. 2026-02-17T11:08:40.208 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.200+0000 7f07adce1640 1 librados: shutdown 2026-02-17T11:08:40.211 DEBUG:teuthology.orchestra.run.trial162:> sudo ceph --cluster ceph osd new f0fdfadd-2f39-4ad8-ac88-cb588c5e8ee0 4 2026-02-17T11:08:40.230 INFO:tasks.ceph.mgr.x.trial162.stderr:2026-02-17T11:08:40.227+0000 7efc3f612140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-17T11:08:40.276 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.273+0000 7f3910172640 10 monclient: get_monmap_and_config 2026-02-17T11:08:40.276 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.273+0000 7f3910172640 10 monclient: build_initial_monmap 2026-02-17T11:08:40.276 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.273+0000 7f3910172640 10 monclient: monmap: 2026-02-17T11:08:40.277 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-17T11:08:40.277 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:40.277 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:08:40.274876+0000 2026-02-17T11:08:40.277 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:08:40.274876+0000 2026-02-17T11:08:40.277 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-17T11:08:40.277 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:40.277 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:08:40.277 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:08:40.277 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:08:40.277 INFO:teuthology.orchestra.run.trial162.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:08:40.277 INFO:teuthology.orchestra.run.trial162.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:08:40.277 INFO:teuthology.orchestra.run.trial162.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:08:40.277 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:40.278 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.273+0000 7f3910172640 1 Processor -- start 2026-02-17T11:08:40.278 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.273+0000 7f3910172640 1 -- start start 2026-02-17T11:08:40.278 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.273+0000 7f3910172640 10 monclient: init 2026-02-17T11:08:40.278 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.273+0000 7f3910172640 10 monclient: _reopen_session rank -1 2026-02-17T11:08:40.278 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.273+0000 7f3910172640 10 monclient: _add_conns ranks=[0,2,5,3,4,1] 2026-02-17T11:08:40.278 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.273+0000 7f3910172640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f3908073590 addr v1:10.20.193.49:6789/0 2026-02-17T11:08:40.278 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.273+0000 7f3910172640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f3908074080 addr v1:10.20.193.157:6789/0 2026-02-17T11:08:40.278 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.273+0000 7f3910172640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f3908121180 0x7f3908123620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:40.278 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.273+0000 7f3910172640 10 monclient(hunting): picked mon.noname-c con 0x7f3908121180 addr v2:10.20.193.157:3300/0 2026-02-17T11:08:40.278 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.273+0000 7f3910172640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3908123d40 con 0x7f3908073590 2026-02-17T11:08:40.278 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.273+0000 7f3910172640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3908124f60 con 0x7f3908074080 2026-02-17T11:08:40.278 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.273+0000 7f3910172640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:40.278 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.273+0000 7f3910172640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f3908126160 con 0x7f3908121180 2026-02-17T11:08:40.279 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.273+0000 7f3910172640 10 monclient(hunting): _renew_subs 2026-02-17T11:08:40.279 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.273+0000 7f3910172640 10 monclient(hunting): authenticate will time out at 958.012914s 2026-02-17T11:08:40.279 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.274+0000 7f390d6e6640 1 --1- >> v1:10.20.193.157:6789/0 conn(0x7f3908074080 0x7f390811f970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.157:6789/0 says I am v1:10.20.193.162:39452/0 (socket says 10.20.193.162:39452) 2026-02-17T11:08:40.279 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.274+0000 7f390d6e6640 1 -- 10.20.193.162:0/2955994351 learned_addr learned my addr 10.20.193.162:0/2955994351 (peer_addr_for_me v1:10.20.193.162:0/0) 2026-02-17T11:08:40.280 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.275+0000 7f390e6e8640 1 --2- 10.20.193.162:0/2955994351 >> v2:10.20.193.157:3300/0 conn(0x7f3908121180 0x7f3908123620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:40.280 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.276+0000 7f390cee5640 1 -- 10.20.193.162:0/2955994351 <== mon.2 v1:10.20.193.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 61548355 0 0) 0x7f3908124f60 con 0x7f3908074080 2026-02-17T11:08:40.280 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.276+0000 7f390cee5640 10 monclient(hunting): _negotiate 2026-02-17T11:08:40.281 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.276+0000 7f390cee5640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:40.281 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.276+0000 7f390cee5640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:40.281 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.276+0000 7f390cee5640 10 monclient(hunting): my global_id is 4133 2026-02-17T11:08:40.281 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.276+0000 7f390cee5640 1 -- 10.20.193.162:0/2955994351 --> v1:10.20.193.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38f0003620 con 0x7f3908074080 2026-02-17T11:08:40.281 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.276+0000 7f390e6e8640 10 monclient(hunting): get_auth_request con 0x7f3908121180 auth_method 0 2026-02-17T11:08:40.281 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.276+0000 7f390e6e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:40.281 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.276+0000 7f390e6e8640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:40.281 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.276+0000 7f390e6e8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:40.281 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.276+0000 7f390e6e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:40.281 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.276+0000 7f390e6e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:40.281 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.276+0000 7f390e6e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:40.281 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.278+0000 7f390e6e8640 10 monclient(hunting): handle_auth_done global_id 4136 payload 274 2026-02-17T11:08:40.281 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.278+0000 7f390e6e8640 1 -- 10.20.193.162:0/2955994351 >> v1:10.20.193.157:6789/0 conn(0x7f3908074080 legacy=0x7f390811f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:40.282 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.278+0000 7f390e6e8640 1 -- 10.20.193.162:0/2955994351 >> v1:10.20.193.49:6789/0 conn(0x7f3908073590 legacy=0x7f3908073970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:08:40.282 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.278+0000 7f390e6e8640 10 monclient: _finish_hunting 0 2026-02-17T11:08:40.282 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.278+0000 7f390e6e8640 1 monclient: found mon.noname-c 2026-02-17T11:08:40.282 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.278+0000 7f390e6e8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:08:40.282 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.278+0000 7f390e6e8640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:08:40.282 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.278+0000 7f390e6e8640 1 -- 10.20.193.162:0/2955994351 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39081262e0 con 0x7f3908121180 2026-02-17T11:08:40.282 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.279+0000 7f390e6e8640 1 --2- 10.20.193.162:0/2955994351 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f3908121180 0x7f3908123620 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3904009d90 tx=0x7f390402f190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=baabdf67e90398bb server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:08:40.287 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.281+0000 7f390cee5640 1 -- 10.20.193.162:0/2955994351 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f390403c070 con 0x7f3908121180 2026-02-17T11:08:40.287 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.281+0000 7f390cee5640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:40.287 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.281+0000 7f390cee5640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:08:40.287 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.281+0000 7f390cee5640 10 monclient: dump: 2026-02-17T11:08:40.287 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:40.287 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:40.287 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:40.287 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:40.287 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:40.287 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:40.288 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:40.288 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:40.288 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:40.288 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:40.288 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.281+0000 7f390cee5640 10 monclient: _finish_auth 0 2026-02-17T11:08:40.288 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.281+0000 7f390cee5640 10 monclient: _check_auth_tickets 2026-02-17T11:08:40.288 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.281+0000 7f390cee5640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:08:40.288 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.281+0000 7f3910172640 5 monclient: authenticate success, global_id 4136 2026-02-17T11:08:40.288 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.281+0000 7f390cee5640 1 -- 10.20.193.162:0/2955994351 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f390402fe10 con 0x7f3908121180 2026-02-17T11:08:40.288 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.281+0000 7f3910172640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:08:40.288 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.281+0000 7f390cee5640 10 monclient: handle_config config(0 keys) 2026-02-17T11:08:40.288 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.281+0000 7f3910172640 10 monclient: get_monmap_and_config success 2026-02-17T11:08:40.288 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.281+0000 7f390cee5640 1 -- 10.20.193.162:0/2955994351 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3904037660 con 0x7f3908121180 2026-02-17T11:08:40.289 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.281+0000 7f3910172640 4 set_mon_vals no callback set 2026-02-17T11:08:40.289 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.281+0000 7f390cee5640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:40.289 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.281+0000 7f390cee5640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:08:40.289 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.281+0000 7f390cee5640 10 monclient: dump: 2026-02-17T11:08:40.289 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:40.289 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:40.289 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:40.289 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:40.289 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:40.289 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:40.289 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:40.289 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:40.289 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:40.289 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:40.290 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.281+0000 7f3910172640 10 monclient: shutdown 2026-02-17T11:08:40.290 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.281+0000 7f3910172640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:08:40.290 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.281+0000 7f3910172640 1 -- 10.20.193.162:0/2955994351 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f3908121180 msgr2=0x7f3908123620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:40.290 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.281+0000 7f3910172640 1 --2- 10.20.193.162:0/2955994351 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f3908121180 0x7f3908123620 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3904009d90 tx=0x7f390402f190 comp rx=0 tx=0).stop 2026-02-17T11:08:40.290 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.281+0000 7f3910172640 1 -- 10.20.193.162:0/2955994351 shutdown_connections 2026-02-17T11:08:40.290 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.281+0000 7f3910172640 1 --2- 10.20.193.162:0/2955994351 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f3908121180 0x7f3908123620 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:40.290 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.281+0000 7f3910172640 1 -- 10.20.193.162:0/2955994351 >> 10.20.193.162:0/2955994351 conn(0x7f390806f660 msgr2=0x7f3908071a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:08:40.290 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.281+0000 7f3910172640 1 -- 10.20.193.162:0/2955994351 shutdown_connections 2026-02-17T11:08:40.290 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.281+0000 7f3910172640 1 -- 10.20.193.162:0/2955994351 wait complete. 2026-02-17T11:08:40.290 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.282+0000 7f3910172640 10 monclient: build_initial_monmap 2026-02-17T11:08:40.290 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.282+0000 7f3910172640 10 monclient: monmap: 2026-02-17T11:08:40.290 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-17T11:08:40.290 INFO:teuthology.orchestra.run.trial162.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:08:40.291 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 0.000000 2026-02-17T11:08:40.291 INFO:teuthology.orchestra.run.trial162.stderr:created 0.000000 2026-02-17T11:08:40.291 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-17T11:08:40.291 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:40.291 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:08:40.291 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:08:40.291 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:08:40.291 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:40.291 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.282+0000 7f3910172640 1 librados: starting msgr at 2026-02-17T11:08:40.291 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.282+0000 7f3910172640 1 librados: starting objecter 2026-02-17T11:08:40.291 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.282+0000 7f3910172640 1 Processor -- start 2026-02-17T11:08:40.291 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.282+0000 7f3910172640 1 -- start start 2026-02-17T11:08:40.291 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.282+0000 7f3910172640 1 librados: setting wanted keys 2026-02-17T11:08:40.291 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.282+0000 7f3910172640 1 librados: calling monclient init 2026-02-17T11:08:40.291 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.282+0000 7f3910172640 10 monclient: init 2026-02-17T11:08:40.292 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.282+0000 7f3910172640 10 monclient: _reopen_session rank -1 2026-02-17T11:08:40.292 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.282+0000 7f3910172640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:08:40.292 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.282+0000 7f3910172640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f3908073590 0x7f390811f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:40.292 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.282+0000 7f3910172640 10 monclient(hunting): picked mon.noname-b con 0x7f3908073590 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:08:40.292 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.282+0000 7f3910172640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f3908074080 0x7f390811fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:40.292 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.282+0000 7f3910172640 10 monclient(hunting): picked mon.noname-a con 0x7f3908074080 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:08:40.292 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.282+0000 7f3910172640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f3908121180 0x7f39081b71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:40.292 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.282+0000 7f3910172640 10 monclient(hunting): picked mon.noname-c con 0x7f3908121180 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:08:40.292 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.282+0000 7f3910172640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:40.292 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.282+0000 7f3910172640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f39081243d0 con 0x7f3908074080 2026-02-17T11:08:40.292 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.282+0000 7f3910172640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:40.292 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.282+0000 7f3910172640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f3908124250 con 0x7f3908073590 2026-02-17T11:08:40.292 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.282+0000 7f3910172640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:40.292 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.282+0000 7f3910172640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f3908124550 con 0x7f3908121180 2026-02-17T11:08:40.293 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.282+0000 7f3910172640 10 monclient(hunting): _renew_subs 2026-02-17T11:08:40.293 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.282+0000 7f3910172640 10 monclient(hunting): authenticate will time out at 958.021727s 2026-02-17T11:08:40.293 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.283+0000 7f390e6e8640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f3908121180 0x7f39081b71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:40.293 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.283+0000 7f390dee7640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f3908073590 0x7f390811f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:40.293 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.283+0000 7f390e6e8640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f3908121180 0x7f39081b71d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.162:47236/0 (socket says 10.20.193.162:47236) 2026-02-17T11:08:40.293 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.283+0000 7f390e6e8640 1 -- 10.20.193.162:0/3661064235 learned_addr learned my addr 10.20.193.162:0/3661064235 (peer_addr_for_me v2:10.20.193.162:0/0) 2026-02-17T11:08:40.293 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.283+0000 7f390e6e8640 10 monclient(hunting): get_auth_request con 0x7f3908121180 auth_method 0 2026-02-17T11:08:40.293 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.283+0000 7f390e6e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:40.293 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.283+0000 7f390e6e8640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:40.293 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.283+0000 7f390e6e8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:40.293 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.283+0000 7f390dee7640 10 monclient(hunting): get_auth_request con 0x7f3908073590 auth_method 0 2026-02-17T11:08:40.293 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.283+0000 7f390dee7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:40.293 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.283+0000 7f390dee7640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:40.294 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.283+0000 7f390dee7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:40.294 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.283+0000 7f390e6e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:40.294 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.283+0000 7f390e6e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:40.294 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.283+0000 7f390e6e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:40.294 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.283+0000 7f390dee7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:40.294 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.283+0000 7f390dee7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:40.294 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.283+0000 7f390dee7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:40.294 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.284+0000 7f390dee7640 10 monclient(hunting): handle_auth_done global_id 4132 payload 824 2026-02-17T11:08:40.294 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.284+0000 7f390dee7640 1 -- 10.20.193.162:0/3661064235 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f3908121180 msgr2=0x7f39081b71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:40.294 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.284+0000 7f390dee7640 1 --2- 10.20.193.162:0/3661064235 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f3908121180 0x7f39081b71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:40.294 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.284+0000 7f390dee7640 1 -- 10.20.193.162:0/3661064235 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f3908074080 msgr2=0x7f390811fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:40.294 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.284+0000 7f390dee7640 1 --2- 10.20.193.162:0/3661064235 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f3908074080 0x7f390811fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:40.294 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.284+0000 7f390dee7640 10 monclient: _finish_hunting 0 2026-02-17T11:08:40.294 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.284+0000 7f390dee7640 1 monclient: found mon.noname-b 2026-02-17T11:08:40.295 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.284+0000 7f390dee7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:08:40.295 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.284+0000 7f390dee7640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:08:40.295 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.284+0000 7f390dee7640 1 -- 10.20.193.162:0/3661064235 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39081b7990 con 0x7f3908073590 2026-02-17T11:08:40.295 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.284+0000 7f390e6e8640 1 --2- 10.20.193.162:0/3661064235 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f3908121180 0x7f39081b71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:08:40.295 INFO:tasks.ceph.mgr.y.trial049.stderr:2026-02-17T11:08:40.291+0000 7f5cf3fdc140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-17T11:08:40.298 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.285+0000 7f390dee7640 1 --2- 10.20.193.162:0/3661064235 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f3908073590 0x7f390811f530 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f38f800b580 tx=0x7f38f800ba50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:08:40.298 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.285+0000 7f38f67fc640 10 client.?.objecter ms_handle_connect 0x7f3908073590 2026-02-17T11:08:40.298 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.285+0000 7f38f67fc640 10 client.?.objecter resend_mon_ops 2026-02-17T11:08:40.298 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.287+0000 7f38f67fc640 1 -- 10.20.193.162:0/3661064235 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f80044e0 con 0x7f3908073590 2026-02-17T11:08:40.298 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.287+0000 7f38f67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:40.298 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.287+0000 7f38f67fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:08:40.298 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.287+0000 7f38f67fc640 10 monclient: dump: 2026-02-17T11:08:40.298 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:40.298 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:40.298 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:40.298 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:40.298 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:40.299 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:40.299 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:40.299 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:40.299 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:40.299 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:40.299 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.287+0000 7f38f67fc640 10 monclient: _finish_auth 0 2026-02-17T11:08:40.299 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.287+0000 7f38f67fc640 10 monclient: _check_auth_tickets 2026-02-17T11:08:40.299 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.287+0000 7f38f67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:08:40.299 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.287+0000 7f38f67fc640 1 -- 10.20.193.162:0/3661064235 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38f8014070 con 0x7f3908073590 2026-02-17T11:08:40.299 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.287+0000 7f38f67fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:08:40.299 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.287+0000 7f38f67fc640 1 -- 10.20.193.162:0/3661064235 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f80029c0 con 0x7f3908073590 2026-02-17T11:08:40.299 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.287+0000 7f3910172640 5 monclient: authenticate success, global_id 4132 2026-02-17T11:08:40.299 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.287+0000 7f38f7fff640 4 set_mon_vals no callback set 2026-02-17T11:08:40.299 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.287+0000 7f3910172640 10 monclient: _renew_subs 2026-02-17T11:08:40.300 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.287+0000 7f3910172640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:08:40.300 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.287+0000 7f3910172640 1 -- 10.20.193.162:0/3661064235 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39081b7c20 con 0x7f3908073590 2026-02-17T11:08:40.300 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.287+0000 7f38f67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:40.300 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.287+0000 7f38f67fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:08:40.300 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.287+0000 7f38f67fc640 10 monclient: dump: 2026-02-17T11:08:40.300 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:40.300 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:40.300 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:40.300 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:40.300 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:40.300 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:40.300 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:40.300 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:40.300 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:40.301 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:40.301 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.287+0000 7f3910172640 10 client.4132.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:08:40.301 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.287+0000 7f3910172640 10 monclient: _renew_subs 2026-02-17T11:08:40.301 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.287+0000 7f3910172640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:08:40.301 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.287+0000 7f3910172640 1 -- 10.20.193.162:0/3661064235 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39081b81c0 con 0x7f3908073590 2026-02-17T11:08:40.301 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.287+0000 7f3910172640 1 librados: init done 2026-02-17T11:08:40.301 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.288+0000 7f3910172640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:40.301 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.288+0000 7f3910172640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:40.301 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.288+0000 7f3910172640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:08:40.301 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.288+0000 7f3910172640 1 -- 10.20.193.162:0/3661064235 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3908124a30 con 0x7f3908073590 2026-02-17T11:08:40.301 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.289+0000 7f38f67fc640 1 -- 10.20.193.162:0/3661064235 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f38f8002b60 con 0x7f3908073590 2026-02-17T11:08:40.301 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.289+0000 7f38f67fc640 1 -- 10.20.193.162:0/3661064235 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f38f800f910 con 0x7f3908073590 2026-02-17T11:08:40.301 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.289+0000 7f38f67fc640 10 client.4132.objecter ms_dispatch2 0x7f3908000b90 osd_map(6..6 src has 1..6) 2026-02-17T11:08:40.301 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.289+0000 7f38f67fc640 3 client.4132.objecter handle_osd_map got epochs [6,6] > 0 2026-02-17T11:08:40.302 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.289+0000 7f38f67fc640 3 client.4132.objecter handle_osd_map decoding full epoch 6 2026-02-17T11:08:40.302 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.289+0000 7f38f67fc640 20 client.4132.objecter dump_active .. 0 homeless 2026-02-17T11:08:40.332 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.329+0000 7f38f67fc640 1 -- 10.20.193.162:0/3661064235 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f38f800fb10 con 0x7f3908073590 2026-02-17T11:08:40.332 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.329+0000 7f38f67fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:40.332 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.329+0000 7f38f67fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:08:40.363 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.361+0000 7f3910172640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "f0fdfadd-2f39-4ad8-ac88-cb588c5e8ee0", "id": 4}] 2026-02-17T11:08:40.363 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.361+0000 7f3910172640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "f0fdfadd-2f39-4ad8-ac88-cb588c5e8ee0", "id": 4}] 2026-02-17T11:08:40.364 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.361+0000 7f3910172640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:08:40.364 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.361+0000 7f3910172640 1 -- 10.20.193.162:0/3661064235 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f0fdfadd-2f39-4ad8-ac88-cb588c5e8ee0", "id": 4} v 0) -- 0x7f39081b8390 con 0x7f3908073590 2026-02-17T11:08:40.409 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.407+0000 7f38f67fc640 1 -- 10.20.193.162:0/3661064235 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mgrmap(e 2) ==== 50049+0+0 (secure 0 0 0) 0x7f38f800f400 con 0x7f3908073590 2026-02-17T11:08:40.571 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.569+0000 7f38f67fc640 1 -- 10.20.193.162:0/3661064235 <== mon.1 v2:10.20.193.97:3300/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f0fdfadd-2f39-4ad8-ac88-cb588c5e8ee0", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f38f8021db0 con 0x7f3908073590 2026-02-17T11:08:40.571 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.569+0000 7f38f67fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "f0fdfadd-2f39-4ad8-ac88-cb588c5e8ee0", "id": 4}] 2026-02-17T11:08:40.571 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.569+0000 7f38f67fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:08:40.572 INFO:teuthology.orchestra.run.trial162.stdout:4 2026-02-17T11:08:40.573 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.569+0000 7f3910172640 10 librados: watch_flush enter 2026-02-17T11:08:40.573 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.569+0000 7f3910172640 10 librados: watch_flush exit 2026-02-17T11:08:40.573 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.569+0000 7f3910172640 20 client.4132.objecter shutdown clearing up homeless session... 2026-02-17T11:08:40.573 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.569+0000 7f3910172640 10 client.4132.objecter successfully canceled tick 2026-02-17T11:08:40.573 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.569+0000 7f3910172640 10 monclient: shutdown 2026-02-17T11:08:40.574 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.569+0000 7f3910172640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:08:40.574 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.569+0000 7f3910172640 1 -- 10.20.193.162:0/3661064235 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f3908073590 msgr2=0x7f390811f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:40.574 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.569+0000 7f3910172640 1 --2- 10.20.193.162:0/3661064235 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f3908073590 0x7f390811f530 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f38f800b580 tx=0x7f38f800ba50 comp rx=0 tx=0).stop 2026-02-17T11:08:40.574 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.569+0000 7f3910172640 1 -- 10.20.193.162:0/3661064235 shutdown_connections 2026-02-17T11:08:40.574 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.569+0000 7f3910172640 1 --2- 10.20.193.162:0/3661064235 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f3908121180 0x7f39081b71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:40.574 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.569+0000 7f3910172640 1 --2- 10.20.193.162:0/3661064235 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f3908074080 0x7f390811fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:40.574 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.569+0000 7f3910172640 1 --2- 10.20.193.162:0/3661064235 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f3908073590 0x7f390811f530 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:40.574 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.569+0000 7f3910172640 1 -- 10.20.193.162:0/3661064235 >> 10.20.193.162:0/3661064235 conn(0x7f390806f660 msgr2=0x7f3908122480 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:08:40.574 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.569+0000 7f3910172640 1 -- 10.20.193.162:0/3661064235 shutdown_connections 2026-02-17T11:08:40.574 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.569+0000 7f3910172640 1 -- 10.20.193.162:0/3661064235 wait complete. 2026-02-17T11:08:40.574 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.569+0000 7f3910172640 1 librados: shutdown 2026-02-17T11:08:40.580 DEBUG:teuthology.orchestra.run.trial162:> sudo ceph --cluster ceph osd new 65872639-d6c0-482d-95d1-1d9f250781c9 5 2026-02-17T11:08:40.685 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.682+0000 7fe7cfa32640 10 monclient: get_monmap_and_config 2026-02-17T11:08:40.685 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.682+0000 7fe7cfa32640 10 monclient: build_initial_monmap 2026-02-17T11:08:40.686 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.682+0000 7fe7cfa32640 10 monclient: monmap: 2026-02-17T11:08:40.686 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-17T11:08:40.686 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:40.686 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:08:40.683650+0000 2026-02-17T11:08:40.686 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:08:40.683650+0000 2026-02-17T11:08:40.686 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-17T11:08:40.686 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:40.686 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:08:40.686 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:08:40.686 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:08:40.686 INFO:teuthology.orchestra.run.trial162.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:08:40.686 INFO:teuthology.orchestra.run.trial162.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:08:40.687 INFO:teuthology.orchestra.run.trial162.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:08:40.687 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:40.687 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.682+0000 7fe7cfa32640 1 Processor -- start 2026-02-17T11:08:40.687 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.682+0000 7fe7cfa32640 1 -- start start 2026-02-17T11:08:40.687 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.682+0000 7fe7cfa32640 10 monclient: init 2026-02-17T11:08:40.687 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.682+0000 7fe7cfa32640 10 monclient: _reopen_session rank -1 2026-02-17T11:08:40.687 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.682+0000 7fe7cfa32640 10 monclient: _add_conns ranks=[1,2,3,5,4,0] 2026-02-17T11:08:40.687 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.682+0000 7fe7cfa32640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fe7c8073590 addr v1:10.20.193.97:6789/0 2026-02-17T11:08:40.687 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.682+0000 7fe7cfa32640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fe7c8074080 addr v1:10.20.193.157:6789/0 2026-02-17T11:08:40.687 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.682+0000 7fe7cfa32640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fe7c8121180 0x7fe7c8123620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:40.687 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.682+0000 7fe7cfa32640 10 monclient(hunting): picked mon.noname-a con 0x7fe7c8121180 addr v2:10.20.193.49:3300/0 2026-02-17T11:08:40.687 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.682+0000 7fe7cfa32640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7c8123d40 con 0x7fe7c8073590 2026-02-17T11:08:40.688 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.682+0000 7fe7cfa32640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7c8124f60 con 0x7fe7c8074080 2026-02-17T11:08:40.688 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.682+0000 7fe7cfa32640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:40.688 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.682+0000 7fe7cfa32640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7fe7c8126160 con 0x7fe7c8121180 2026-02-17T11:08:40.688 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.682+0000 7fe7cfa32640 10 monclient(hunting): _renew_subs 2026-02-17T11:08:40.688 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.682+0000 7fe7cfa32640 10 monclient(hunting): authenticate will time out at 958.421683s 2026-02-17T11:08:40.688 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.683+0000 7fe7cd7a7640 1 --1- >> v1:10.20.193.97:6789/0 conn(0x7fe7c8073590 0x7fe7c8073970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.97:6789/0 says I am v1:10.20.193.162:33822/0 (socket says 10.20.193.162:33822) 2026-02-17T11:08:40.688 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.683+0000 7fe7cd7a7640 1 -- 10.20.193.162:0/2101961680 learned_addr learned my addr 10.20.193.162:0/2101961680 (peer_addr_for_me v1:10.20.193.162:0/0) 2026-02-17T11:08:40.710 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.709+0000 7fe7cdfa8640 1 --2- 10.20.193.162:0/2101961680 >> v2:10.20.193.49:3300/0 conn(0x7fe7c8121180 0x7fe7c8123620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:40.711 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.709+0000 7fe7cdfa8640 10 monclient(hunting): get_auth_request con 0x7fe7c8121180 auth_method 0 2026-02-17T11:08:40.711 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.709+0000 7fe7cdfa8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:40.711 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.709+0000 7fe7cdfa8640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:40.711 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.709+0000 7fe7cdfa8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:40.711 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.709+0000 7fe7cdfa8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:40.711 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.709+0000 7fe7cdfa8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:40.711 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.709+0000 7fe7cdfa8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:40.712 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.709+0000 7fe7cdfa8640 10 monclient(hunting): handle_auth_done global_id 4140 payload 274 2026-02-17T11:08:40.712 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.709+0000 7fe7cdfa8640 1 -- 10.20.193.162:0/2101961680 >> v1:10.20.193.157:6789/0 conn(0x7fe7c8074080 legacy=0x7fe7c811f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:40.712 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.709+0000 7fe7cdfa8640 1 -- 10.20.193.162:0/2101961680 >> v1:10.20.193.97:6789/0 conn(0x7fe7c8073590 legacy=0x7fe7c8073970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:40.712 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.709+0000 7fe7cdfa8640 10 monclient: _finish_hunting 0 2026-02-17T11:08:40.713 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.709+0000 7fe7cdfa8640 1 monclient: found mon.noname-a 2026-02-17T11:08:40.713 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.709+0000 7fe7cdfa8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:08:40.713 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.709+0000 7fe7cdfa8640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:08:40.713 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.709+0000 7fe7cdfa8640 1 -- 10.20.193.162:0/2101961680 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7c81262e0 con 0x7fe7c8121180 2026-02-17T11:08:40.713 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.710+0000 7fe7cdfa8640 1 --2- 10.20.193.162:0/2101961680 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe7c8121180 0x7fe7c8123620 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4009d90 tx=0x7fe7c402f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55c5a045ec2584d0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:08:40.719 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.712+0000 7fe7b7fff640 1 -- 10.20.193.162:0/2101961680 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c403c070 con 0x7fe7c8121180 2026-02-17T11:08:40.719 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.712+0000 7fe7b7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:40.719 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.712+0000 7fe7b7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:08:40.719 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.712+0000 7fe7b7fff640 10 monclient: dump: 2026-02-17T11:08:40.719 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:40.719 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:40.719 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:40.719 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:40.720 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:40.720 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:40.720 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:40.720 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:40.720 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:40.720 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:40.720 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.712+0000 7fe7b7fff640 10 monclient: _finish_auth 0 2026-02-17T11:08:40.720 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.712+0000 7fe7b7fff640 10 monclient: _check_auth_tickets 2026-02-17T11:08:40.720 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.712+0000 7fe7b7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:08:40.720 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.712+0000 7fe7cfa32640 5 monclient: authenticate success, global_id 4140 2026-02-17T11:08:40.720 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.712+0000 7fe7b7fff640 1 -- 10.20.193.162:0/2101961680 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7c4037440 con 0x7fe7c8121180 2026-02-17T11:08:40.721 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.712+0000 7fe7cfa32640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:08:40.721 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.712+0000 7fe7b7fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:08:40.721 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.712+0000 7fe7b7fff640 1 -- 10.20.193.162:0/2101961680 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c4037810 con 0x7fe7c8121180 2026-02-17T11:08:40.721 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.712+0000 7fe7cfa32640 10 monclient: get_monmap_and_config success 2026-02-17T11:08:40.721 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.712+0000 7fe7cfa32640 4 set_mon_vals no callback set 2026-02-17T11:08:40.721 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.712+0000 7fe7b7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:40.721 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.712+0000 7fe7b7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:08:40.721 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.712+0000 7fe7b7fff640 10 monclient: dump: 2026-02-17T11:08:40.721 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:40.721 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:40.721 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:40.721 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:40.722 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:40.722 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:40.722 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:40.722 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:40.722 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:40.722 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:40.722 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.712+0000 7fe7cfa32640 10 monclient: shutdown 2026-02-17T11:08:40.722 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.712+0000 7fe7cfa32640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:08:40.722 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.712+0000 7fe7cfa32640 1 -- 10.20.193.162:0/2101961680 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe7c8121180 msgr2=0x7fe7c8123620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:40.722 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.712+0000 7fe7cfa32640 1 --2- 10.20.193.162:0/2101961680 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe7c8121180 0x7fe7c8123620 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4009d90 tx=0x7fe7c402f1e0 comp rx=0 tx=0).stop 2026-02-17T11:08:40.722 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.712+0000 7fe7cfa32640 1 -- 10.20.193.162:0/2101961680 shutdown_connections 2026-02-17T11:08:40.722 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.712+0000 7fe7cfa32640 1 --2- 10.20.193.162:0/2101961680 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe7c8121180 0x7fe7c8123620 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:40.723 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.712+0000 7fe7cfa32640 1 -- 10.20.193.162:0/2101961680 >> 10.20.193.162:0/2101961680 conn(0x7fe7c806f660 msgr2=0x7fe7c8071a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:08:40.723 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.712+0000 7fe7cfa32640 1 -- 10.20.193.162:0/2101961680 shutdown_connections 2026-02-17T11:08:40.723 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.712+0000 7fe7cfa32640 1 -- 10.20.193.162:0/2101961680 wait complete. 2026-02-17T11:08:40.723 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.713+0000 7fe7cfa32640 10 monclient: build_initial_monmap 2026-02-17T11:08:40.723 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.713+0000 7fe7cfa32640 10 monclient: monmap: 2026-02-17T11:08:40.723 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-17T11:08:40.723 INFO:teuthology.orchestra.run.trial162.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:08:40.723 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 0.000000 2026-02-17T11:08:40.723 INFO:teuthology.orchestra.run.trial162.stderr:created 0.000000 2026-02-17T11:08:40.723 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-17T11:08:40.723 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:40.723 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:08:40.724 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:08:40.724 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:08:40.724 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:40.724 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.713+0000 7fe7cfa32640 1 librados: starting msgr at 2026-02-17T11:08:40.724 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.713+0000 7fe7cfa32640 1 librados: starting objecter 2026-02-17T11:08:40.724 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.713+0000 7fe7cfa32640 1 Processor -- start 2026-02-17T11:08:40.724 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.713+0000 7fe7cfa32640 1 -- start start 2026-02-17T11:08:40.724 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.713+0000 7fe7cfa32640 1 librados: setting wanted keys 2026-02-17T11:08:40.724 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.713+0000 7fe7cfa32640 1 librados: calling monclient init 2026-02-17T11:08:40.724 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.713+0000 7fe7cfa32640 10 monclient: init 2026-02-17T11:08:40.724 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.713+0000 7fe7cfa32640 10 monclient: _reopen_session rank -1 2026-02-17T11:08:40.724 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.713+0000 7fe7cfa32640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:08:40.725 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.713+0000 7fe7cfa32640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe7c8073590 0x7fe7c81b15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:40.725 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.713+0000 7fe7cfa32640 10 monclient(hunting): picked mon.noname-c con 0x7fe7c8073590 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:08:40.725 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.713+0000 7fe7cfa32640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe7c8074080 0x7fe7c81b1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:40.725 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.713+0000 7fe7cfa32640 10 monclient(hunting): picked mon.noname-a con 0x7fe7c8074080 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:08:40.725 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.713+0000 7fe7cfa32640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe7c8121180 0x7fe7c811f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:40.725 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.713+0000 7fe7cfa32640 10 monclient(hunting): picked mon.noname-b con 0x7fe7c8121180 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:08:40.725 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.713+0000 7fe7cfa32640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:40.725 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.713+0000 7fe7cfa32640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c81255f0 con 0x7fe7c8074080 2026-02-17T11:08:40.725 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.713+0000 7fe7cfa32640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:40.725 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.713+0000 7fe7cfa32640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c8125470 con 0x7fe7c8121180 2026-02-17T11:08:40.725 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.713+0000 7fe7cfa32640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:40.725 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.713+0000 7fe7cfa32640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c8125770 con 0x7fe7c8073590 2026-02-17T11:08:40.725 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.713+0000 7fe7cfa32640 10 monclient(hunting): _renew_subs 2026-02-17T11:08:40.726 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.713+0000 7fe7cfa32640 10 monclient(hunting): authenticate will time out at 958.452791s 2026-02-17T11:08:40.726 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.714+0000 7fe7ccfa6640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe7c8074080 0x7fe7c81b1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:40.726 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.714+0000 7fe7ccfa6640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe7c8074080 0x7fe7c81b1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.162:57262/0 (socket says 10.20.193.162:57262) 2026-02-17T11:08:40.726 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.714+0000 7fe7ccfa6640 1 -- 10.20.193.162:0/2558076865 learned_addr learned my addr 10.20.193.162:0/2558076865 (peer_addr_for_me v2:10.20.193.162:0/0) 2026-02-17T11:08:40.726 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.714+0000 7fe7ccfa6640 10 monclient(hunting): get_auth_request con 0x7fe7c8074080 auth_method 0 2026-02-17T11:08:40.726 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.714+0000 7fe7ccfa6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:40.726 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.714+0000 7fe7ccfa6640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:40.726 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.714+0000 7fe7ccfa6640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:40.726 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.714+0000 7fe7ccfa6640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:40.726 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.714+0000 7fe7ccfa6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:40.726 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.714+0000 7fe7ccfa6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:40.726 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.715+0000 7fe7ccfa6640 10 monclient(hunting): handle_auth_done global_id 4143 payload 824 2026-02-17T11:08:40.727 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.715+0000 7fe7ccfa6640 1 -- 10.20.193.162:0/2558076865 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe7c8073590 msgr2=0x7fe7c81b15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:40.727 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.715+0000 7fe7ccfa6640 1 --2- 10.20.193.162:0/2558076865 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe7c8073590 0x7fe7c81b15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:40.727 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.715+0000 7fe7ccfa6640 1 -- 10.20.193.162:0/2558076865 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe7c8121180 msgr2=0x7fe7c811f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:40.727 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.715+0000 7fe7ccfa6640 1 --2- 10.20.193.162:0/2558076865 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe7c8121180 0x7fe7c811f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:40.727 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.715+0000 7fe7ccfa6640 10 monclient: _finish_hunting 0 2026-02-17T11:08:40.727 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.715+0000 7fe7ccfa6640 1 monclient: found mon.noname-a 2026-02-17T11:08:40.727 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.715+0000 7fe7ccfa6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:08:40.727 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.715+0000 7fe7ccfa6640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:08:40.727 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.715+0000 7fe7ccfa6640 1 -- 10.20.193.162:0/2558076865 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7c811fe90 con 0x7fe7c8074080 2026-02-17T11:08:40.727 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.716+0000 7fe7ccfa6640 1 --2- 10.20.193.162:0/2558076865 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe7c8074080 0x7fe7c81b1c50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc00c580 tx=0x7fe7bc00ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:08:40.727 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.716+0000 7fe7b5ffb640 10 client.?.objecter ms_handle_connect 0x7fe7c8074080 2026-02-17T11:08:40.727 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.716+0000 7fe7b5ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T11:08:40.730 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.718+0000 7fe7b5ffb640 1 -- 10.20.193.162:0/2558076865 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7bc017070 con 0x7fe7c8074080 2026-02-17T11:08:40.730 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.718+0000 7fe7b5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:40.730 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.718+0000 7fe7b5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:08:40.730 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.718+0000 7fe7b5ffb640 10 monclient: dump: 2026-02-17T11:08:40.730 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:40.731 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:40.731 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:40.731 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:40.731 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:40.731 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:40.731 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:40.731 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:40.731 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:40.731 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:40.731 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.718+0000 7fe7b5ffb640 10 monclient: _finish_auth 0 2026-02-17T11:08:40.731 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.718+0000 7fe7b5ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:08:40.731 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.718+0000 7fe7b5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:08:40.732 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.718+0000 7fe7b5ffb640 1 -- 10.20.193.162:0/2558076865 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7bc0052d0 con 0x7fe7c8074080 2026-02-17T11:08:40.732 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.718+0000 7fe7cfa32640 5 monclient: authenticate success, global_id 4143 2026-02-17T11:08:40.732 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.718+0000 7fe7b5ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:08:40.732 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.718+0000 7fe7b5ffb640 1 -- 10.20.193.162:0/2558076865 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7bc0036b0 con 0x7fe7c8074080 2026-02-17T11:08:40.732 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.718+0000 7fe7b5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:40.732 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.718+0000 7fe7b5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:08:40.732 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.718+0000 7fe7b5ffb640 10 monclient: dump: 2026-02-17T11:08:40.732 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:40.732 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:40.732 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:40.732 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:40.732 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:40.733 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:40.733 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:40.733 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:40.733 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:40.733 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:40.733 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.718+0000 7fe7b77fe640 4 set_mon_vals no callback set 2026-02-17T11:08:40.733 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.718+0000 7fe7cfa32640 10 monclient: _renew_subs 2026-02-17T11:08:40.733 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.718+0000 7fe7cfa32640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:08:40.733 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.718+0000 7fe7cfa32640 1 -- 10.20.193.162:0/2558076865 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7c8120120 con 0x7fe7c8074080 2026-02-17T11:08:40.733 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.718+0000 7fe7cfa32640 10 client.4143.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:08:40.733 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.718+0000 7fe7cfa32640 10 monclient: _renew_subs 2026-02-17T11:08:40.733 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.718+0000 7fe7cfa32640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:08:40.733 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.718+0000 7fe7cfa32640 1 -- 10.20.193.162:0/2558076865 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7c81b8540 con 0x7fe7c8074080 2026-02-17T11:08:40.734 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.718+0000 7fe7cfa32640 1 librados: init done 2026-02-17T11:08:40.734 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.718+0000 7fe7cfa32640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:40.734 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.718+0000 7fe7cfa32640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:40.734 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.718+0000 7fe7cfa32640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:08:40.734 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.718+0000 7fe7cfa32640 1 -- 10.20.193.162:0/2558076865 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7c8125c50 con 0x7fe7c8074080 2026-02-17T11:08:40.734 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.725+0000 7fe7b5ffb640 1 -- 10.20.193.162:0/2558076865 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 2) ==== 50049+0+0 (secure 0 0 0) 0x7fe7bc003850 con 0x7fe7c8074080 2026-02-17T11:08:40.734 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.725+0000 7fe7b5ffb640 1 -- 10.20.193.162:0/2558076865 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fe7bc011df0 con 0x7fe7c8074080 2026-02-17T11:08:40.734 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.725+0000 7fe7b5ffb640 10 client.4143.objecter ms_dispatch2 0x7fe7c8000b90 osd_map(7..7 src has 1..7) 2026-02-17T11:08:40.734 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.725+0000 7fe7b5ffb640 3 client.4143.objecter handle_osd_map got epochs [7,7] > 0 2026-02-17T11:08:40.734 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.725+0000 7fe7b5ffb640 3 client.4143.objecter handle_osd_map decoding full epoch 7 2026-02-17T11:08:40.734 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.725+0000 7fe7b5ffb640 20 client.4143.objecter dump_active .. 0 homeless 2026-02-17T11:08:40.768 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.766+0000 7fe7b5ffb640 1 -- 10.20.193.162:0/2558076865 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7fe7bc021080 con 0x7fe7c8074080 2026-02-17T11:08:40.768 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.766+0000 7fe7b5ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:40.768 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.766+0000 7fe7b5ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:08:40.800 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.798+0000 7fe7cfa32640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "65872639-d6c0-482d-95d1-1d9f250781c9", "id": 5}] 2026-02-17T11:08:40.800 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.798+0000 7fe7cfa32640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "65872639-d6c0-482d-95d1-1d9f250781c9", "id": 5}] 2026-02-17T11:08:40.801 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.798+0000 7fe7cfa32640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:08:40.801 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.798+0000 7fe7cfa32640 1 -- 10.20.193.162:0/2558076865 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "osd new", "uuid": "65872639-d6c0-482d-95d1-1d9f250781c9", "id": 5} v 0) -- 0x7fe7c81b8710 con 0x7fe7c8074080 2026-02-17T11:08:40.829 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.826+0000 7fe7b5ffb640 1 -- 10.20.193.162:0/2558076865 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "65872639-d6c0-482d-95d1-1d9f250781c9", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fe7bc01b3b0 con 0x7fe7c8074080 2026-02-17T11:08:40.829 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.826+0000 7fe7b5ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "65872639-d6c0-482d-95d1-1d9f250781c9", "id": 5}] 2026-02-17T11:08:40.829 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.826+0000 7fe7b5ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:08:40.830 INFO:teuthology.orchestra.run.trial162.stdout:5 2026-02-17T11:08:40.831 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.827+0000 7fe7cfa32640 10 librados: watch_flush enter 2026-02-17T11:08:40.831 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.827+0000 7fe7cfa32640 10 librados: watch_flush exit 2026-02-17T11:08:40.831 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.827+0000 7fe7cfa32640 20 client.4143.objecter shutdown clearing up homeless session... 2026-02-17T11:08:40.831 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.827+0000 7fe7cfa32640 10 client.4143.objecter successfully canceled tick 2026-02-17T11:08:40.831 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.827+0000 7fe7cfa32640 10 monclient: shutdown 2026-02-17T11:08:40.832 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.827+0000 7fe7cfa32640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:08:40.832 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.827+0000 7fe7cfa32640 1 -- 10.20.193.162:0/2558076865 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe7c8074080 msgr2=0x7fe7c81b1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:40.832 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.827+0000 7fe7cfa32640 1 --2- 10.20.193.162:0/2558076865 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe7c8074080 0x7fe7c81b1c50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc00c580 tx=0x7fe7bc00ca50 comp rx=0 tx=0).stop 2026-02-17T11:08:40.832 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.827+0000 7fe7cfa32640 1 -- 10.20.193.162:0/2558076865 shutdown_connections 2026-02-17T11:08:40.832 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.827+0000 7fe7cfa32640 1 --2- 10.20.193.162:0/2558076865 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe7c8121180 0x7fe7c811f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:40.832 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.827+0000 7fe7cfa32640 1 --2- 10.20.193.162:0/2558076865 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe7c8074080 0x7fe7c81b1c50 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:40.832 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.827+0000 7fe7cfa32640 1 --2- 10.20.193.162:0/2558076865 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe7c8073590 0x7fe7c81b15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:40.832 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.827+0000 7fe7cfa32640 1 -- 10.20.193.162:0/2558076865 >> 10.20.193.162:0/2558076865 conn(0x7fe7c806f660 msgr2=0x7fe7c8121630 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:08:40.832 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.827+0000 7fe7cfa32640 1 -- 10.20.193.162:0/2558076865 shutdown_connections 2026-02-17T11:08:40.832 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.827+0000 7fe7cfa32640 1 -- 10.20.193.162:0/2558076865 wait complete. 2026-02-17T11:08:40.832 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.827+0000 7fe7cfa32640 1 librados: shutdown 2026-02-17T11:08:40.837 DEBUG:teuthology.orchestra.run.trial162:> sudo ceph --cluster ceph osd new 43091d3e-638d-4462-867b-cade02a315e3 6 2026-02-17T11:08:40.902 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.897+0000 7fbb45243640 10 monclient: get_monmap_and_config 2026-02-17T11:08:40.902 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.897+0000 7fbb45243640 10 monclient: build_initial_monmap 2026-02-17T11:08:40.902 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.897+0000 7fbb45243640 10 monclient: monmap: 2026-02-17T11:08:40.902 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-17T11:08:40.902 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:40.902 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:08:40.898869+0000 2026-02-17T11:08:40.902 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:08:40.898869+0000 2026-02-17T11:08:40.902 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-17T11:08:40.903 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:40.903 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:08:40.903 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:08:40.903 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:08:40.903 INFO:teuthology.orchestra.run.trial162.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:08:40.903 INFO:teuthology.orchestra.run.trial162.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:08:40.903 INFO:teuthology.orchestra.run.trial162.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:08:40.903 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:40.903 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.897+0000 7fbb45243640 1 Processor -- start 2026-02-17T11:08:40.903 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.897+0000 7fbb45243640 1 -- start start 2026-02-17T11:08:40.903 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.897+0000 7fbb45243640 10 monclient: init 2026-02-17T11:08:40.903 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.897+0000 7fbb45243640 10 monclient: _reopen_session rank -1 2026-02-17T11:08:40.904 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.897+0000 7fbb45243640 10 monclient: _add_conns ranks=[3,5,2,4,0,1] 2026-02-17T11:08:40.904 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.897+0000 7fbb45243640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fbb40073830 0x7fbb40073c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:40.904 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.897+0000 7fbb45243640 10 monclient(hunting): picked mon.noname-a con 0x7fbb40073830 addr v2:10.20.193.49:3300/0 2026-02-17T11:08:40.904 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.897+0000 7fbb45243640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7fbb40074150 0x7fbb4011c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:40.904 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.897+0000 7fbb45243640 10 monclient(hunting): picked mon.noname-c con 0x7fbb40074150 addr v2:10.20.193.157:3300/0 2026-02-17T11:08:40.904 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.897+0000 7fbb45243640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fbb4011cb30 addr v1:10.20.193.157:6789/0 2026-02-17T11:08:40.904 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.897+0000 7fbb45243640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb401208f0 con 0x7fbb4011cb30 2026-02-17T11:08:40.904 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.897+0000 7fbb45243640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:40.905 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.897+0000 7fbb45243640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7fbb40121b10 con 0x7fbb40073830 2026-02-17T11:08:40.905 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.897+0000 7fbb45243640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:40.905 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.897+0000 7fbb45243640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7fbb40121c90 con 0x7fbb40074150 2026-02-17T11:08:40.905 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.897+0000 7fbb45243640 10 monclient(hunting): _renew_subs 2026-02-17T11:08:40.905 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.897+0000 7fbb45243640 10 monclient(hunting): authenticate will time out at 958.636921s 2026-02-17T11:08:40.905 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.898+0000 7fbb3ed76640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fbb40073830 0x7fbb40073c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:40.905 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.898+0000 7fbb3ed76640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fbb40073830 0x7fbb40073c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.162:57278/0 (socket says 10.20.193.162:57278) 2026-02-17T11:08:40.905 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.898+0000 7fbb3ed76640 1 -- 10.20.193.162:0/3404134264 learned_addr learned my addr 10.20.193.162:0/3404134264 (peer_addr_for_me v2:10.20.193.162:0/0) 2026-02-17T11:08:40.905 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.898+0000 7fbb3ed76640 10 monclient(hunting): get_auth_request con 0x7fbb40073830 auth_method 0 2026-02-17T11:08:40.905 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.898+0000 7fbb3ed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:40.906 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.898+0000 7fbb3ed76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:40.906 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.898+0000 7fbb3ed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:40.906 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.898+0000 7fbb3ed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:40.906 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.898+0000 7fbb3ed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:40.906 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.898+0000 7fbb3ed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:40.906 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.899+0000 7fbb3e575640 1 --2- 10.20.193.162:0/3404134264 >> v2:10.20.193.157:3300/0 conn(0x7fbb40074150 0x7fbb4011c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:40.906 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.899+0000 7fbb3ed76640 10 monclient(hunting): handle_auth_done global_id 4146 payload 274 2026-02-17T11:08:40.906 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.899+0000 7fbb3ed76640 1 -- 10.20.193.162:0/3404134264 >> v2:10.20.193.157:3300/0 conn(0x7fbb40074150 msgr2=0x7fbb4011c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:08:40.906 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.899+0000 7fbb3ed76640 1 --2- 10.20.193.162:0/3404134264 >> v2:10.20.193.157:3300/0 conn(0x7fbb40074150 0x7fbb4011c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:40.906 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.899+0000 7fbb3ed76640 1 -- 10.20.193.162:0/3404134264 >> v1:10.20.193.157:6789/0 conn(0x7fbb4011cb30 legacy=0x7fbb4011eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:08:40.906 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.899+0000 7fbb3ed76640 10 monclient: _finish_hunting 0 2026-02-17T11:08:40.906 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.899+0000 7fbb3ed76640 1 monclient: found mon.noname-a 2026-02-17T11:08:40.906 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.899+0000 7fbb3ed76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:08:40.907 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.899+0000 7fbb3ed76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:08:40.907 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.899+0000 7fbb3ed76640 1 -- 10.20.193.162:0/3404134264 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb40121e40 con 0x7fbb40073830 2026-02-17T11:08:40.914 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.900+0000 7fbb3ed76640 1 --2- 10.20.193.162:0/3404134264 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbb40073830 0x7fbb40073c10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbb400752c0 tx=0x7fbb3402ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d5587401ef13504 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:08:40.914 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.901+0000 7fbb3dd74640 1 -- 10.20.193.162:0/3404134264 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb3403c070 con 0x7fbb40073830 2026-02-17T11:08:40.914 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.901+0000 7fbb3dd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:40.914 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.901+0000 7fbb3dd74640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:08:40.914 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.901+0000 7fbb3dd74640 10 monclient: dump: 2026-02-17T11:08:40.914 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:40.915 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:40.915 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:40.915 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:40.915 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:40.915 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:40.915 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:40.915 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:40.915 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:40.915 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:40.915 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.901+0000 7fbb3dd74640 10 monclient: _finish_auth 0 2026-02-17T11:08:40.915 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.901+0000 7fbb3dd74640 10 monclient: _check_auth_tickets 2026-02-17T11:08:40.916 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.901+0000 7fbb3dd74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:08:40.916 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.901+0000 7fbb45243640 5 monclient: authenticate success, global_id 4146 2026-02-17T11:08:40.916 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.901+0000 7fbb45243640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:08:40.916 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.902+0000 7fbb3dd74640 1 -- 10.20.193.162:0/3404134264 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb3402fa90 con 0x7fbb40073830 2026-02-17T11:08:40.916 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.902+0000 7fbb3dd74640 10 monclient: handle_config config(0 keys) 2026-02-17T11:08:40.916 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.902+0000 7fbb3dd74640 1 -- 10.20.193.162:0/3404134264 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb3402fe60 con 0x7fbb40073830 2026-02-17T11:08:40.916 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.902+0000 7fbb3dd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:40.916 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.902+0000 7fbb3dd74640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:08:40.916 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.902+0000 7fbb3dd74640 10 monclient: dump: 2026-02-17T11:08:40.916 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:40.916 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:40.917 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:40.917 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:40.917 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:40.917 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:40.917 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:40.917 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:40.917 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:40.917 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:40.917 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.902+0000 7fbb45243640 10 monclient: get_monmap_and_config success 2026-02-17T11:08:40.917 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.902+0000 7fbb45243640 4 set_mon_vals no callback set 2026-02-17T11:08:40.917 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.902+0000 7fbb45243640 10 monclient: shutdown 2026-02-17T11:08:40.917 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.902+0000 7fbb45243640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:08:40.918 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.902+0000 7fbb45243640 1 -- 10.20.193.162:0/3404134264 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbb40073830 msgr2=0x7fbb40073c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:40.918 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.902+0000 7fbb45243640 1 --2- 10.20.193.162:0/3404134264 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbb40073830 0x7fbb40073c10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbb400752c0 tx=0x7fbb3402ee60 comp rx=0 tx=0).stop 2026-02-17T11:08:40.918 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.902+0000 7fbb45243640 1 -- 10.20.193.162:0/3404134264 shutdown_connections 2026-02-17T11:08:40.918 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.902+0000 7fbb45243640 1 --2- 10.20.193.162:0/3404134264 >> v2:10.20.193.157:3300/0 conn(0x7fbb40074150 0x7fbb4011c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:40.918 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.902+0000 7fbb45243640 1 --2- 10.20.193.162:0/3404134264 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbb40073830 0x7fbb40073c10 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:40.918 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.902+0000 7fbb45243640 1 -- 10.20.193.162:0/3404134264 >> 10.20.193.162:0/3404134264 conn(0x7fbb4006f660 msgr2=0x7fbb40071a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:08:40.918 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.902+0000 7fbb45243640 1 -- 10.20.193.162:0/3404134264 shutdown_connections 2026-02-17T11:08:40.918 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.902+0000 7fbb45243640 1 -- 10.20.193.162:0/3404134264 wait complete. 2026-02-17T11:08:40.918 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.903+0000 7fbb45243640 10 monclient: build_initial_monmap 2026-02-17T11:08:40.918 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.903+0000 7fbb45243640 10 monclient: monmap: 2026-02-17T11:08:40.918 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-17T11:08:40.918 INFO:teuthology.orchestra.run.trial162.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:08:40.918 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 0.000000 2026-02-17T11:08:40.919 INFO:teuthology.orchestra.run.trial162.stderr:created 0.000000 2026-02-17T11:08:40.919 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-17T11:08:40.919 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:40.919 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:08:40.919 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:08:40.919 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:08:40.919 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:40.919 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.903+0000 7fbb45243640 1 librados: starting msgr at 2026-02-17T11:08:40.919 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.903+0000 7fbb45243640 1 librados: starting objecter 2026-02-17T11:08:40.919 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.903+0000 7fbb45243640 1 Processor -- start 2026-02-17T11:08:40.919 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.903+0000 7fbb45243640 1 -- start start 2026-02-17T11:08:40.919 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.903+0000 7fbb45243640 1 librados: setting wanted keys 2026-02-17T11:08:40.920 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.903+0000 7fbb45243640 1 librados: calling monclient init 2026-02-17T11:08:40.920 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.903+0000 7fbb45243640 10 monclient: init 2026-02-17T11:08:40.920 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.903+0000 7fbb45243640 10 monclient: _reopen_session rank -1 2026-02-17T11:08:40.920 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.903+0000 7fbb45243640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:08:40.920 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.903+0000 7fbb45243640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fbb40073830 0x7fbb40112250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:40.920 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.903+0000 7fbb45243640 10 monclient(hunting): picked mon.noname-c con 0x7fbb40073830 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:08:40.920 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.903+0000 7fbb45243640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fbb40074150 0x7fbb40112790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:40.920 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.903+0000 7fbb45243640 10 monclient(hunting): picked mon.noname-b con 0x7fbb40074150 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:08:40.920 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.903+0000 7fbb45243640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbb4011cb30 0x7fbb401b7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:40.920 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.903+0000 7fbb45243640 10 monclient(hunting): picked mon.noname-a con 0x7fbb4011cb30 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:08:40.920 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.903+0000 7fbb45243640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:40.920 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.903+0000 7fbb45243640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fbb40120f80 con 0x7fbb4011cb30 2026-02-17T11:08:40.921 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.903+0000 7fbb45243640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:40.921 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.903+0000 7fbb45243640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fbb40120e00 con 0x7fbb40074150 2026-02-17T11:08:40.921 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.903+0000 7fbb45243640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:40.921 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.903+0000 7fbb45243640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fbb40121100 con 0x7fbb40073830 2026-02-17T11:08:40.921 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.903+0000 7fbb45243640 10 monclient(hunting): _renew_subs 2026-02-17T11:08:40.921 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.903+0000 7fbb45243640 10 monclient(hunting): authenticate will time out at 958.642313s 2026-02-17T11:08:40.921 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.903+0000 7fbb3ed76640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fbb40073830 0x7fbb40112250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:40.921 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.903+0000 7fbb3e575640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fbb40074150 0x7fbb40112790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:40.921 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.903+0000 7fbb3ed76640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fbb40073830 0x7fbb40112250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.162:47320/0 (socket says 10.20.193.162:47320) 2026-02-17T11:08:40.921 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.903+0000 7fbb3ed76640 1 -- 10.20.193.162:0/167624704 learned_addr learned my addr 10.20.193.162:0/167624704 (peer_addr_for_me v2:10.20.193.162:0/0) 2026-02-17T11:08:40.921 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.903+0000 7fbb3ed76640 10 monclient(hunting): get_auth_request con 0x7fbb40073830 auth_method 0 2026-02-17T11:08:40.921 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.903+0000 7fbb3ed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:40.922 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.903+0000 7fbb3ed76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:40.922 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.903+0000 7fbb3ed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:40.922 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.903+0000 7fbb3f577640 1 --2- 10.20.193.162:0/167624704 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbb4011cb30 0x7fbb401b7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:40.922 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.903+0000 7fbb3e575640 10 monclient(hunting): get_auth_request con 0x7fbb40074150 auth_method 0 2026-02-17T11:08:40.922 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.903+0000 7fbb3e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:40.922 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.903+0000 7fbb3e575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:40.922 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.903+0000 7fbb3e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:40.922 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.903+0000 7fbb3f577640 10 monclient(hunting): get_auth_request con 0x7fbb4011cb30 auth_method 0 2026-02-17T11:08:40.922 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.903+0000 7fbb3f577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:40.922 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.903+0000 7fbb3f577640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:40.922 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.903+0000 7fbb3f577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:40.922 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.904+0000 7fbb3ed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:40.923 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.904+0000 7fbb3ed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:40.923 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.904+0000 7fbb3ed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:40.923 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.904+0000 7fbb3e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:40.923 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.904+0000 7fbb3e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:40.923 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.904+0000 7fbb3e575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:40.923 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.904+0000 7fbb3f577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:40.923 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.904+0000 7fbb3f577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:40.923 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.904+0000 7fbb3f577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:40.923 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.905+0000 7fbb3f577640 10 monclient(hunting): handle_auth_done global_id 4149 payload 824 2026-02-17T11:08:40.923 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.905+0000 7fbb3f577640 1 -- 10.20.193.162:0/167624704 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fbb40073830 msgr2=0x7fbb40112250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:40.923 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.905+0000 7fbb3f577640 1 --2- 10.20.193.162:0/167624704 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fbb40073830 0x7fbb40112250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:40.923 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.905+0000 7fbb3f577640 1 -- 10.20.193.162:0/167624704 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fbb40074150 msgr2=0x7fbb40112790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:40.923 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.905+0000 7fbb3f577640 1 --2- 10.20.193.162:0/167624704 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fbb40074150 0x7fbb40112790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:40.924 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.905+0000 7fbb3f577640 10 monclient: _finish_hunting 0 2026-02-17T11:08:40.924 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.905+0000 7fbb3f577640 1 monclient: found mon.noname-a 2026-02-17T11:08:40.924 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.905+0000 7fbb3f577640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:08:40.924 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.905+0000 7fbb3f577640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:08:40.924 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.905+0000 7fbb3f577640 1 -- 10.20.193.162:0/167624704 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb401b7c80 con 0x7fbb4011cb30 2026-02-17T11:08:40.924 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.905+0000 7fbb3ed76640 1 --2- 10.20.193.162:0/167624704 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fbb40073830 0x7fbb40112250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:08:40.924 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.906+0000 7fbb3f577640 1 --2- 10.20.193.162:0/167624704 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbb4011cb30 0x7fbb401b7740 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbb3000be20 tx=0x7fbb3000bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:08:40.924 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.906+0000 7fbb1f7fe640 10 client.?.objecter ms_handle_connect 0x7fbb4011cb30 2026-02-17T11:08:40.924 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.906+0000 7fbb1f7fe640 10 client.?.objecter resend_mon_ops 2026-02-17T11:08:40.924 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.907+0000 7fbb1f7fe640 1 -- 10.20.193.162:0/167624704 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb30006e60 con 0x7fbb4011cb30 2026-02-17T11:08:40.924 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.907+0000 7fbb1f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:40.924 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.907+0000 7fbb1f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:08:40.924 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.907+0000 7fbb1f7fe640 10 monclient: dump: 2026-02-17T11:08:40.925 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:40.925 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:40.925 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:40.925 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:40.925 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:40.925 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:40.925 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:40.925 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:40.925 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:40.925 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:40.925 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.907+0000 7fbb1f7fe640 10 monclient: _finish_auth 0 2026-02-17T11:08:40.925 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.907+0000 7fbb1f7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:08:40.926 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.907+0000 7fbb1f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:08:40.926 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.907+0000 7fbb1f7fe640 1 -- 10.20.193.162:0/167624704 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb30010070 con 0x7fbb4011cb30 2026-02-17T11:08:40.926 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.907+0000 7fbb1f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:08:40.926 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.907+0000 7fbb1f7fe640 1 -- 10.20.193.162:0/167624704 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb3000ccf0 con 0x7fbb4011cb30 2026-02-17T11:08:40.926 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.907+0000 7fbb1f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:40.926 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.907+0000 7fbb1f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:08:40.926 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.907+0000 7fbb3d573640 4 set_mon_vals no callback set 2026-02-17T11:08:40.926 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.907+0000 7fbb1f7fe640 10 monclient: dump: 2026-02-17T11:08:40.926 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:40.926 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:40.926 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:40.926 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:40.926 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:40.927 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:40.927 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:40.927 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:40.927 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:40.927 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:40.927 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.907+0000 7fbb45243640 5 monclient: authenticate success, global_id 4149 2026-02-17T11:08:40.927 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.907+0000 7fbb45243640 10 monclient: _renew_subs 2026-02-17T11:08:40.927 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.907+0000 7fbb45243640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:08:40.927 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.907+0000 7fbb45243640 1 -- 10.20.193.162:0/167624704 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb401b7e50 con 0x7fbb4011cb30 2026-02-17T11:08:40.927 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.908+0000 7fbb45243640 10 client.4149.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:08:40.927 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.908+0000 7fbb45243640 10 monclient: _renew_subs 2026-02-17T11:08:40.927 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.908+0000 7fbb45243640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:08:40.928 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.908+0000 7fbb45243640 1 -- 10.20.193.162:0/167624704 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb401b8200 con 0x7fbb4011cb30 2026-02-17T11:08:40.928 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.908+0000 7fbb45243640 1 librados: init done 2026-02-17T11:08:40.928 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.908+0000 7fbb45243640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:40.928 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.908+0000 7fbb45243640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:40.928 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.908+0000 7fbb45243640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:08:40.928 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.908+0000 7fbb45243640 1 -- 10.20.193.162:0/167624704 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb40073c10 con 0x7fbb4011cb30 2026-02-17T11:08:40.928 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.913+0000 7fbb1f7fe640 1 -- 10.20.193.162:0/167624704 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 2) ==== 50049+0+0 (secure 0 0 0) 0x7fbb30004070 con 0x7fbb4011cb30 2026-02-17T11:08:40.955 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.954+0000 7fbb1f7fe640 1 -- 10.20.193.162:0/167624704 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fbb300045d0 con 0x7fbb4011cb30 2026-02-17T11:08:40.956 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.954+0000 7fbb1f7fe640 10 client.4149.objecter ms_dispatch2 0x7fbb40000b90 osd_map(8..8 src has 1..8) 2026-02-17T11:08:40.956 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.954+0000 7fbb1f7fe640 3 client.4149.objecter handle_osd_map got epochs [8,8] > 0 2026-02-17T11:08:40.956 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.954+0000 7fbb1f7fe640 3 client.4149.objecter handle_osd_map decoding full epoch 8 2026-02-17T11:08:40.956 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.954+0000 7fbb1f7fe640 20 client.4149.objecter dump_active .. 0 homeless 2026-02-17T11:08:40.956 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.954+0000 7fbb1f7fe640 1 -- 10.20.193.162:0/167624704 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7fbb30014cd0 con 0x7fbb4011cb30 2026-02-17T11:08:40.956 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.954+0000 7fbb1f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:40.956 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.954+0000 7fbb1f7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:08:40.989 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.986+0000 7fbb45243640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "43091d3e-638d-4462-867b-cade02a315e3", "id": 6}] 2026-02-17T11:08:40.989 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.986+0000 7fbb45243640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "43091d3e-638d-4462-867b-cade02a315e3", "id": 6}] 2026-02-17T11:08:40.989 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.987+0000 7fbb45243640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:08:40.989 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:40.987+0000 7fbb45243640 1 -- 10.20.193.162:0/167624704 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "osd new", "uuid": "43091d3e-638d-4462-867b-cade02a315e3", "id": 6} v 0) -- 0x7fbb40116cb0 con 0x7fbb4011cb30 2026-02-17T11:08:41.044 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.042+0000 7fbb1f7fe640 1 -- 10.20.193.162:0/167624704 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "43091d3e-638d-4462-867b-cade02a315e3", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fbb40116cb0 con 0x7fbb4011cb30 2026-02-17T11:08:41.044 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.042+0000 7fbb1f7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "43091d3e-638d-4462-867b-cade02a315e3", "id": 6}] 2026-02-17T11:08:41.044 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.042+0000 7fbb1f7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:08:41.044 INFO:teuthology.orchestra.run.trial162.stdout:6 2026-02-17T11:08:41.046 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.043+0000 7fbb45243640 10 librados: watch_flush enter 2026-02-17T11:08:41.046 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.043+0000 7fbb45243640 10 librados: watch_flush exit 2026-02-17T11:08:41.046 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.043+0000 7fbb45243640 20 client.4149.objecter shutdown clearing up homeless session... 2026-02-17T11:08:41.046 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.043+0000 7fbb45243640 10 client.4149.objecter successfully canceled tick 2026-02-17T11:08:41.047 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.043+0000 7fbb45243640 10 monclient: shutdown 2026-02-17T11:08:41.047 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.043+0000 7fbb45243640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:08:41.047 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.043+0000 7fbb45243640 1 -- 10.20.193.162:0/167624704 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbb4011cb30 msgr2=0x7fbb401b7740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:41.047 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.043+0000 7fbb45243640 1 --2- 10.20.193.162:0/167624704 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbb4011cb30 0x7fbb401b7740 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbb3000be20 tx=0x7fbb3000bf20 comp rx=0 tx=0).stop 2026-02-17T11:08:41.047 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.043+0000 7fbb45243640 1 -- 10.20.193.162:0/167624704 shutdown_connections 2026-02-17T11:08:41.047 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.043+0000 7fbb45243640 1 --2- 10.20.193.162:0/167624704 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbb4011cb30 0x7fbb401b7740 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:41.047 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.043+0000 7fbb45243640 1 --2- 10.20.193.162:0/167624704 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fbb40074150 0x7fbb40112790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:41.047 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.043+0000 7fbb45243640 1 --2- 10.20.193.162:0/167624704 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fbb40073830 0x7fbb40112250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:41.047 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.043+0000 7fbb45243640 1 -- 10.20.193.162:0/167624704 >> 10.20.193.162:0/167624704 conn(0x7fbb4006f660 msgr2=0x7fbb40114410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:08:41.047 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.043+0000 7fbb45243640 1 -- 10.20.193.162:0/167624704 shutdown_connections 2026-02-17T11:08:41.047 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.043+0000 7fbb45243640 1 -- 10.20.193.162:0/167624704 wait complete. 2026-02-17T11:08:41.047 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.043+0000 7fbb45243640 1 librados: shutdown 2026-02-17T11:08:41.054 DEBUG:teuthology.orchestra.run.trial162:> sudo ceph --cluster ceph osd new 890ae4d6-33c9-4515-a896-a689647330dd 7 2026-02-17T11:08:41.119 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.115+0000 7fac8dd7e640 10 monclient: get_monmap_and_config 2026-02-17T11:08:41.119 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.115+0000 7fac8dd7e640 10 monclient: build_initial_monmap 2026-02-17T11:08:41.120 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.115+0000 7fac8dd7e640 10 monclient: monmap: 2026-02-17T11:08:41.120 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-17T11:08:41.120 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:41.120 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:08:41.116616+0000 2026-02-17T11:08:41.120 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:08:41.116616+0000 2026-02-17T11:08:41.120 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-17T11:08:41.120 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:41.120 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:08:41.120 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:08:41.120 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:08:41.120 INFO:teuthology.orchestra.run.trial162.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:08:41.120 INFO:teuthology.orchestra.run.trial162.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:08:41.121 INFO:teuthology.orchestra.run.trial162.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:08:41.121 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:41.121 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.115+0000 7fac8dd7e640 1 Processor -- start 2026-02-17T11:08:41.121 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.115+0000 7fac8dd7e640 1 -- start start 2026-02-17T11:08:41.121 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.115+0000 7fac8dd7e640 10 monclient: init 2026-02-17T11:08:41.121 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.115+0000 7fac8dd7e640 10 monclient: _reopen_session rank -1 2026-02-17T11:08:41.121 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.115+0000 7fac8dd7e640 10 monclient: _add_conns ranks=[4,2,1,5,0,3] 2026-02-17T11:08:41.121 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.115+0000 7fac8dd7e640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7fac88073590 0x7fac88073970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:41.121 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.115+0000 7fac8dd7e640 10 monclient(hunting): picked mon.noname-b con 0x7fac88073590 addr v2:10.20.193.97:3300/0 2026-02-17T11:08:41.121 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.115+0000 7fac8dd7e640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fac88073eb0 addr v1:10.20.193.157:6789/0 2026-02-17T11:08:41.121 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.115+0000 7fac8dd7e640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fac88120080 addr v1:10.20.193.97:6789/0 2026-02-17T11:08:41.121 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.115+0000 7fac8dd7e640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac88123d50 con 0x7fac88120080 2026-02-17T11:08:41.122 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.115+0000 7fac8dd7e640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac88124f70 con 0x7fac88073eb0 2026-02-17T11:08:41.122 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.115+0000 7fac8dd7e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:41.122 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.115+0000 7fac8dd7e640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7fac88126170 con 0x7fac88073590 2026-02-17T11:08:41.122 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.115+0000 7fac8dd7e640 10 monclient(hunting): _renew_subs 2026-02-17T11:08:41.122 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.115+0000 7fac8dd7e640 10 monclient(hunting): authenticate will time out at 958.854685s 2026-02-17T11:08:41.122 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.116+0000 7fac86ffd640 1 --1- >> v1:10.20.193.157:6789/0 conn(0x7fac88073eb0 0x7fac8811e960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.157:6789/0 says I am v1:10.20.193.162:39486/0 (socket says 10.20.193.162:39486) 2026-02-17T11:08:41.122 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.116+0000 7fac86ffd640 1 -- 10.20.193.162:0/868970004 learned_addr learned my addr 10.20.193.162:0/868970004 (peer_addr_for_me v1:10.20.193.162:0/0) 2026-02-17T11:08:41.122 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.116+0000 7fac877fe640 1 --2- 10.20.193.162:0/868970004 >> v2:10.20.193.97:3300/0 conn(0x7fac88073590 0x7fac88073970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:41.122 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.116+0000 7fac877fe640 10 monclient(hunting): get_auth_request con 0x7fac88073590 auth_method 0 2026-02-17T11:08:41.122 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.116+0000 7fac877fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:41.122 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.116+0000 7fac877fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:41.122 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.116+0000 7fac877fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:41.123 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.116+0000 7fac877fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:41.123 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.116+0000 7fac877fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:41.123 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.117+0000 7fac877fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:41.123 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.117+0000 7fac867fc640 1 -- 10.20.193.162:0/868970004 <== mon.2 v1:10.20.193.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1727687887 0 0) 0x7fac88124f70 con 0x7fac88073eb0 2026-02-17T11:08:41.123 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.117+0000 7fac867fc640 10 monclient(hunting): _negotiate 2026-02-17T11:08:41.123 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.117+0000 7fac867fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:41.123 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.117+0000 7fac867fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:41.123 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.117+0000 7fac867fc640 10 monclient(hunting): my global_id is 4160 2026-02-17T11:08:41.123 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.117+0000 7fac867fc640 1 -- 10.20.193.162:0/868970004 --> v1:10.20.193.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac6c003620 con 0x7fac88073eb0 2026-02-17T11:08:41.124 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.118+0000 7fac877fe640 10 monclient(hunting): handle_auth_done global_id 4141 payload 274 2026-02-17T11:08:41.124 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.118+0000 7fac877fe640 1 -- 10.20.193.162:0/868970004 >> v1:10.20.193.157:6789/0 conn(0x7fac88073eb0 legacy=0x7fac8811e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:41.124 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.118+0000 7fac877fe640 1 -- 10.20.193.162:0/868970004 >> v1:10.20.193.97:6789/0 conn(0x7fac88120080 legacy=0x7fac88122470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:41.125 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.118+0000 7fac877fe640 10 monclient: _finish_hunting 0 2026-02-17T11:08:41.125 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.118+0000 7fac877fe640 1 monclient: found mon.noname-b 2026-02-17T11:08:41.125 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.118+0000 7fac877fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:08:41.125 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.118+0000 7fac877fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:08:41.125 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.118+0000 7fac877fe640 1 -- 10.20.193.162:0/868970004 --> v2:10.20.193.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac881262f0 con 0x7fac88073590 2026-02-17T11:08:41.125 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.120+0000 7fac877fe640 1 --2- 10.20.193.162:0/868970004 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fac88073590 0x7fac88073970 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fac740098a0 tx=0x7fac7402edd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb639063fdaeac7e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:08:41.132 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.123+0000 7fac867fc640 1 -- 10.20.193.162:0/868970004 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7403c070 con 0x7fac88073590 2026-02-17T11:08:41.133 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.123+0000 7fac867fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:41.133 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.123+0000 7fac867fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:08:41.133 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.123+0000 7fac867fc640 10 monclient: dump: 2026-02-17T11:08:41.133 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:41.133 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:41.133 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:41.133 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:41.133 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:41.133 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:41.133 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:41.133 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:41.134 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:41.134 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:41.134 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.123+0000 7fac867fc640 10 monclient: _finish_auth 0 2026-02-17T11:08:41.134 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.123+0000 7fac867fc640 10 monclient: _check_auth_tickets 2026-02-17T11:08:41.134 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.123+0000 7fac867fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:08:41.134 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.123+0000 7fac867fc640 1 -- 10.20.193.162:0/868970004 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac7402fae0 con 0x7fac88073590 2026-02-17T11:08:41.134 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.123+0000 7fac867fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:08:41.134 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.123+0000 7fac8dd7e640 5 monclient: authenticate success, global_id 4141 2026-02-17T11:08:41.134 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.123+0000 7fac867fc640 1 -- 10.20.193.162:0/868970004 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac74037440 con 0x7fac88073590 2026-02-17T11:08:41.134 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.123+0000 7fac8dd7e640 10 monclient: get_monmap_and_config success 2026-02-17T11:08:41.134 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.123+0000 7fac8dd7e640 4 set_mon_vals no callback set 2026-02-17T11:08:41.135 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.123+0000 7fac867fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:41.135 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.123+0000 7fac867fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:08:41.135 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.123+0000 7fac867fc640 10 monclient: dump: 2026-02-17T11:08:41.135 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:41.135 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:41.135 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:41.135 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:41.135 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:41.135 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:41.135 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:41.135 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:41.135 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:41.135 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:41.136 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.123+0000 7fac8dd7e640 10 monclient: shutdown 2026-02-17T11:08:41.136 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.123+0000 7fac8dd7e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:08:41.136 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.123+0000 7fac8dd7e640 1 -- 10.20.193.162:0/868970004 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fac88073590 msgr2=0x7fac88073970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:41.136 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.123+0000 7fac8dd7e640 1 --2- 10.20.193.162:0/868970004 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fac88073590 0x7fac88073970 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fac740098a0 tx=0x7fac7402edd0 comp rx=0 tx=0).stop 2026-02-17T11:08:41.136 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.123+0000 7fac8dd7e640 1 -- 10.20.193.162:0/868970004 shutdown_connections 2026-02-17T11:08:41.136 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.123+0000 7fac8dd7e640 1 --2- 10.20.193.162:0/868970004 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fac88073590 0x7fac88073970 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:41.136 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.123+0000 7fac8dd7e640 1 -- 10.20.193.162:0/868970004 >> 10.20.193.162:0/868970004 conn(0x7fac8806f660 msgr2=0x7fac88071a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:08:41.136 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.123+0000 7fac8dd7e640 1 -- 10.20.193.162:0/868970004 shutdown_connections 2026-02-17T11:08:41.136 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.123+0000 7fac8dd7e640 1 -- 10.20.193.162:0/868970004 wait complete. 2026-02-17T11:08:41.136 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.124+0000 7fac8dd7e640 10 monclient: build_initial_monmap 2026-02-17T11:08:41.136 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.124+0000 7fac8dd7e640 10 monclient: monmap: 2026-02-17T11:08:41.136 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-17T11:08:41.137 INFO:teuthology.orchestra.run.trial162.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:08:41.137 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 0.000000 2026-02-17T11:08:41.137 INFO:teuthology.orchestra.run.trial162.stderr:created 0.000000 2026-02-17T11:08:41.137 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-17T11:08:41.137 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:41.137 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:08:41.137 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:08:41.137 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:08:41.137 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:41.137 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.124+0000 7fac8dd7e640 1 librados: starting msgr at 2026-02-17T11:08:41.137 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.124+0000 7fac8dd7e640 1 librados: starting objecter 2026-02-17T11:08:41.137 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.124+0000 7fac8dd7e640 1 Processor -- start 2026-02-17T11:08:41.137 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.124+0000 7fac8dd7e640 1 -- start start 2026-02-17T11:08:41.138 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.124+0000 7fac8dd7e640 1 librados: setting wanted keys 2026-02-17T11:08:41.138 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.124+0000 7fac8dd7e640 1 librados: calling monclient init 2026-02-17T11:08:41.138 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.124+0000 7fac8dd7e640 10 monclient: init 2026-02-17T11:08:41.138 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.124+0000 7fac8dd7e640 10 monclient: _reopen_session rank -1 2026-02-17T11:08:41.138 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.124+0000 7fac8dd7e640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:08:41.138 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.124+0000 7fac8dd7e640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fac88073590 0x7fac8811e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:41.138 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.124+0000 7fac8dd7e640 10 monclient(hunting): picked mon.noname-a con 0x7fac88073590 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:08:41.138 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.124+0000 7fac8dd7e640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fac88073eb0 0x7fac8811ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:41.138 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.124+0000 7fac8dd7e640 10 monclient(hunting): picked mon.noname-c con 0x7fac88073eb0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:08:41.138 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.124+0000 7fac8dd7e640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fac88120080 0x7fac881b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:41.138 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.124+0000 7fac8dd7e640 10 monclient(hunting): picked mon.noname-b con 0x7fac88120080 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:08:41.138 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.124+0000 7fac8dd7e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:41.138 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.124+0000 7fac8dd7e640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fac881243e0 con 0x7fac88073590 2026-02-17T11:08:41.139 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.124+0000 7fac8dd7e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:41.139 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.124+0000 7fac8dd7e640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fac88124260 con 0x7fac88120080 2026-02-17T11:08:41.139 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.124+0000 7fac8dd7e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:41.139 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.124+0000 7fac8dd7e640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fac88124560 con 0x7fac88073eb0 2026-02-17T11:08:41.139 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.124+0000 7fac8dd7e640 10 monclient(hunting): _renew_subs 2026-02-17T11:08:41.139 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.124+0000 7fac8dd7e640 10 monclient(hunting): authenticate will time out at 958.863528s 2026-02-17T11:08:41.139 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.124+0000 7fac87fff640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fac88120080 0x7fac881b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:41.139 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.124+0000 7fac87fff640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fac88120080 0x7fac881b71e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.162:48562/0 (socket says 10.20.193.162:48562) 2026-02-17T11:08:41.139 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.124+0000 7fac87fff640 1 -- 10.20.193.162:0/2779243476 learned_addr learned my addr 10.20.193.162:0/2779243476 (peer_addr_for_me v2:10.20.193.162:0/0) 2026-02-17T11:08:41.139 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.124+0000 7fac87fff640 10 monclient(hunting): get_auth_request con 0x7fac88120080 auth_method 0 2026-02-17T11:08:41.139 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.124+0000 7fac87fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:41.139 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.124+0000 7fac87fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:41.140 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.124+0000 7fac87fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:41.140 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.124+0000 7fac86ffd640 1 --2- 10.20.193.162:0/2779243476 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fac88073eb0 0x7fac8811ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:41.140 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.125+0000 7fac877fe640 1 --2- 10.20.193.162:0/2779243476 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fac88073590 0x7fac8811e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:41.140 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.125+0000 7fac86ffd640 10 monclient(hunting): get_auth_request con 0x7fac88073eb0 auth_method 0 2026-02-17T11:08:41.140 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.125+0000 7fac86ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:41.140 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.125+0000 7fac86ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:41.140 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.125+0000 7fac86ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:41.140 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.125+0000 7fac87fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:41.140 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.125+0000 7fac87fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:41.140 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.125+0000 7fac87fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:41.140 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.125+0000 7fac877fe640 10 monclient(hunting): get_auth_request con 0x7fac88073590 auth_method 0 2026-02-17T11:08:41.141 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.125+0000 7fac877fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:41.141 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.125+0000 7fac877fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:41.141 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.125+0000 7fac877fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:41.141 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.125+0000 7fac86ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:41.141 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.125+0000 7fac86ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:41.141 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.125+0000 7fac86ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:41.141 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.125+0000 7fac877fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:41.141 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.125+0000 7fac877fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:41.141 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.125+0000 7fac877fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:41.141 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.126+0000 7fac87fff640 10 monclient(hunting): handle_auth_done global_id 4147 payload 824 2026-02-17T11:08:41.141 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.126+0000 7fac87fff640 1 -- 10.20.193.162:0/2779243476 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fac88073eb0 msgr2=0x7fac8811ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:41.142 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.126+0000 7fac87fff640 1 --2- 10.20.193.162:0/2779243476 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fac88073eb0 0x7fac8811ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:41.142 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.126+0000 7fac87fff640 1 -- 10.20.193.162:0/2779243476 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fac88073590 msgr2=0x7fac8811e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:41.142 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.126+0000 7fac87fff640 1 --2- 10.20.193.162:0/2779243476 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fac88073590 0x7fac8811e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:41.142 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.126+0000 7fac87fff640 10 monclient: _finish_hunting 0 2026-02-17T11:08:41.142 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.126+0000 7fac87fff640 1 monclient: found mon.noname-b 2026-02-17T11:08:41.142 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.126+0000 7fac87fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:08:41.142 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.126+0000 7fac87fff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:08:41.142 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.126+0000 7fac87fff640 1 -- 10.20.193.162:0/2779243476 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac881b7a20 con 0x7fac88120080 2026-02-17T11:08:41.142 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.127+0000 7fac87fff640 1 --2- 10.20.193.162:0/2779243476 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fac88120080 0x7fac881b71e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fac7c00cc50 tx=0x7fac7c00a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:08:41.142 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.127+0000 7fac63fff640 10 client.?.objecter ms_handle_connect 0x7fac88120080 2026-02-17T11:08:41.142 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.127+0000 7fac63fff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:08:41.142 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.129+0000 7fac63fff640 1 -- 10.20.193.162:0/2779243476 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7c003a30 con 0x7fac88120080 2026-02-17T11:08:41.143 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.129+0000 7fac63fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:41.143 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.129+0000 7fac63fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:08:41.143 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.129+0000 7fac63fff640 10 monclient: dump: 2026-02-17T11:08:41.143 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:41.143 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:41.143 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:41.143 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:41.143 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:41.143 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:41.143 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:41.143 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:41.143 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:41.143 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:41.144 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.129+0000 7fac63fff640 10 monclient: _finish_auth 0 2026-02-17T11:08:41.144 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.129+0000 7fac63fff640 10 monclient: _check_auth_tickets 2026-02-17T11:08:41.144 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.129+0000 7fac63fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:08:41.144 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.129+0000 7fac63fff640 1 -- 10.20.193.162:0/2779243476 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac7c003bd0 con 0x7fac88120080 2026-02-17T11:08:41.144 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.129+0000 7fac63fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:08:41.144 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.129+0000 7fac63fff640 1 -- 10.20.193.162:0/2779243476 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7c0050d0 con 0x7fac88120080 2026-02-17T11:08:41.144 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.129+0000 7fac8dd7e640 5 monclient: authenticate success, global_id 4147 2026-02-17T11:08:41.144 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.129+0000 7fac8dd7e640 10 monclient: _renew_subs 2026-02-17T11:08:41.144 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.129+0000 7fac8dd7e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:08:41.144 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.129+0000 7fac85ffb640 4 set_mon_vals no callback set 2026-02-17T11:08:41.144 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.129+0000 7fac8dd7e640 1 -- 10.20.193.162:0/2779243476 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac881b7cb0 con 0x7fac88120080 2026-02-17T11:08:41.144 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.129+0000 7fac63fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:41.145 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.129+0000 7fac63fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:08:41.145 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.129+0000 7fac63fff640 10 monclient: dump: 2026-02-17T11:08:41.145 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:41.145 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:41.145 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:41.145 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:41.145 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:41.145 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:41.145 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:41.145 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:41.145 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:41.145 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:41.146 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.129+0000 7fac8dd7e640 10 client.4147.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:08:41.146 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.129+0000 7fac8dd7e640 10 monclient: _renew_subs 2026-02-17T11:08:41.146 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.129+0000 7fac8dd7e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:08:41.146 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.129+0000 7fac8dd7e640 1 -- 10.20.193.162:0/2779243476 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac881b8270 con 0x7fac88120080 2026-02-17T11:08:41.146 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.129+0000 7fac8dd7e640 1 librados: init done 2026-02-17T11:08:41.146 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.129+0000 7fac8dd7e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:41.146 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.129+0000 7fac8dd7e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:41.146 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.129+0000 7fac8dd7e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:08:41.146 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.129+0000 7fac8dd7e640 1 -- 10.20.193.162:0/2779243476 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac880739f0 con 0x7fac88120080 2026-02-17T11:08:41.173 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.172+0000 7fac63fff640 1 -- 10.20.193.162:0/2779243476 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 2) ==== 50049+0+0 (secure 0 0 0) 0x7fac7c005270 con 0x7fac88120080 2026-02-17T11:08:41.177 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.175+0000 7fac63fff640 1 -- 10.20.193.162:0/2779243476 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fac7c012cf0 con 0x7fac88120080 2026-02-17T11:08:41.177 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.175+0000 7fac63fff640 10 client.4147.objecter ms_dispatch2 0x7fac88000b90 osd_map(9..9 src has 1..9) 2026-02-17T11:08:41.177 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.175+0000 7fac63fff640 3 client.4147.objecter handle_osd_map got epochs [9,9] > 0 2026-02-17T11:08:41.177 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.175+0000 7fac63fff640 3 client.4147.objecter handle_osd_map decoding full epoch 9 2026-02-17T11:08:41.177 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.175+0000 7fac63fff640 20 client.4147.objecter dump_active .. 0 homeless 2026-02-17T11:08:41.178 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.175+0000 7fac63fff640 1 -- 10.20.193.162:0/2779243476 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7fac7c0243e0 con 0x7fac88120080 2026-02-17T11:08:41.178 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.175+0000 7fac63fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:41.178 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.175+0000 7fac63fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:08:41.210 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.208+0000 7fac8dd7e640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "890ae4d6-33c9-4515-a896-a689647330dd", "id": 7}] 2026-02-17T11:08:41.211 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.208+0000 7fac8dd7e640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "890ae4d6-33c9-4515-a896-a689647330dd", "id": 7}] 2026-02-17T11:08:41.211 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.208+0000 7fac8dd7e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:08:41.211 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.208+0000 7fac8dd7e640 1 -- 10.20.193.162:0/2779243476 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "osd new", "uuid": "890ae4d6-33c9-4515-a896-a689647330dd", "id": 7} v 0) -- 0x7fac880722e0 con 0x7fac88120080 2026-02-17T11:08:41.253 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.252+0000 7fac63fff640 1 -- 10.20.193.162:0/2779243476 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "890ae4d6-33c9-4515-a896-a689647330dd", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fac880722e0 con 0x7fac88120080 2026-02-17T11:08:41.253 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.252+0000 7fac63fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "890ae4d6-33c9-4515-a896-a689647330dd", "id": 7}] 2026-02-17T11:08:41.253 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.252+0000 7fac63fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:08:41.254 INFO:teuthology.orchestra.run.trial162.stdout:7 2026-02-17T11:08:41.255 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.252+0000 7fac8dd7e640 10 librados: watch_flush enter 2026-02-17T11:08:41.255 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.252+0000 7fac8dd7e640 10 librados: watch_flush exit 2026-02-17T11:08:41.255 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.252+0000 7fac8dd7e640 20 client.4147.objecter shutdown clearing up homeless session... 2026-02-17T11:08:41.256 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.252+0000 7fac8dd7e640 10 client.4147.objecter successfully canceled tick 2026-02-17T11:08:41.256 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.252+0000 7fac8dd7e640 10 monclient: shutdown 2026-02-17T11:08:41.256 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.252+0000 7fac8dd7e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:08:41.256 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.252+0000 7fac8dd7e640 1 -- 10.20.193.162:0/2779243476 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fac88120080 msgr2=0x7fac881b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:41.256 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.252+0000 7fac8dd7e640 1 --2- 10.20.193.162:0/2779243476 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fac88120080 0x7fac881b71e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fac7c00cc50 tx=0x7fac7c00a430 comp rx=0 tx=0).stop 2026-02-17T11:08:41.256 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.252+0000 7fac8dd7e640 1 -- 10.20.193.162:0/2779243476 shutdown_connections 2026-02-17T11:08:41.256 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.252+0000 7fac8dd7e640 1 --2- 10.20.193.162:0/2779243476 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fac88120080 0x7fac881b71e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:41.256 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.252+0000 7fac8dd7e640 1 --2- 10.20.193.162:0/2779243476 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fac88073eb0 0x7fac8811ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:41.256 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.252+0000 7fac8dd7e640 1 --2- 10.20.193.162:0/2779243476 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fac88073590 0x7fac8811e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:41.256 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.252+0000 7fac8dd7e640 1 -- 10.20.193.162:0/2779243476 >> 10.20.193.162:0/2779243476 conn(0x7fac8806f660 msgr2=0x7fac8806fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:08:41.256 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.252+0000 7fac8dd7e640 1 -- 10.20.193.162:0/2779243476 shutdown_connections 2026-02-17T11:08:41.257 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.252+0000 7fac8dd7e640 1 -- 10.20.193.162:0/2779243476 wait complete. 2026-02-17T11:08:41.257 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.252+0000 7fac8dd7e640 1 librados: shutdown 2026-02-17T11:08:41.260 DEBUG:teuthology.orchestra.run.trial162:> sudo ceph --cluster ceph osd new f04abc9b-ed75-4582-b47d-07a9890f52bb 8 2026-02-17T11:08:41.325 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.322+0000 7f5a921c1640 10 monclient: get_monmap_and_config 2026-02-17T11:08:41.326 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.322+0000 7f5a921c1640 10 monclient: build_initial_monmap 2026-02-17T11:08:41.326 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.322+0000 7f5a921c1640 10 monclient: monmap: 2026-02-17T11:08:41.326 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-17T11:08:41.326 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:41.326 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:08:41.323616+0000 2026-02-17T11:08:41.326 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:08:41.323616+0000 2026-02-17T11:08:41.326 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-17T11:08:41.326 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:41.326 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:08:41.327 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:08:41.327 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:08:41.327 INFO:teuthology.orchestra.run.trial162.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:08:41.327 INFO:teuthology.orchestra.run.trial162.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:08:41.327 INFO:teuthology.orchestra.run.trial162.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:08:41.327 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:41.327 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.322+0000 7f5a921c1640 1 Processor -- start 2026-02-17T11:08:41.327 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.322+0000 7f5a921c1640 1 -- start start 2026-02-17T11:08:41.327 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.322+0000 7f5a921c1640 10 monclient: init 2026-02-17T11:08:41.327 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.322+0000 7f5a921c1640 10 monclient: _reopen_session rank -1 2026-02-17T11:08:41.327 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.322+0000 7f5a921c1640 10 monclient: _add_conns ranks=[2,0,1,4,3,5] 2026-02-17T11:08:41.327 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.322+0000 7f5a921c1640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f5a8c06e670 addr v1:10.20.193.157:6789/0 2026-02-17T11:08:41.328 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.322+0000 7f5a921c1640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f5a8c06cfa0 addr v1:10.20.193.49:6789/0 2026-02-17T11:08:41.328 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.322+0000 7f5a921c1640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f5a8c1259d0 addr v1:10.20.193.97:6789/0 2026-02-17T11:08:41.328 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.322+0000 7f5a921c1640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a8c1294e0 con 0x7f5a8c06cfa0 2026-02-17T11:08:41.328 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.322+0000 7f5a921c1640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a8c12a6c0 con 0x7f5a8c1259d0 2026-02-17T11:08:41.328 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.322+0000 7f5a921c1640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a8c12b8a0 con 0x7f5a8c06e670 2026-02-17T11:08:41.328 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.322+0000 7f5a921c1640 10 monclient(hunting): _renew_subs 2026-02-17T11:08:41.328 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.322+0000 7f5a921c1640 10 monclient(hunting): authenticate will time out at 959.061750s 2026-02-17T11:08:41.328 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.323+0000 7f5a8b7fe640 1 --1- >> v1:10.20.193.157:6789/0 conn(0x7f5a8c06e670 0x7f5a8c06c890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.157:6789/0 says I am v1:10.20.193.162:39488/0 (socket says 10.20.193.162:39488) 2026-02-17T11:08:41.328 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.323+0000 7f5a8b7fe640 1 -- 10.20.193.162:0/3037487541 learned_addr learned my addr 10.20.193.162:0/3037487541 (peer_addr_for_me v1:10.20.193.162:0/0) 2026-02-17T11:08:41.340 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.324+0000 7f5a8a7fc640 1 -- 10.20.193.162:0/3037487541 <== mon.1 v1:10.20.193.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 49937449 0 0) 0x7f5a8c12a6c0 con 0x7f5a8c1259d0 2026-02-17T11:08:41.340 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.324+0000 7f5a8a7fc640 10 monclient(hunting): _negotiate 2026-02-17T11:08:41.340 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.324+0000 7f5a8a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:41.340 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.324+0000 7f5a8a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:41.340 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.324+0000 7f5a8a7fc640 10 monclient(hunting): my global_id is 4150 2026-02-17T11:08:41.340 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.324+0000 7f5a8a7fc640 1 -- 10.20.193.162:0/3037487541 --> v1:10.20.193.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a70003620 con 0x7f5a8c1259d0 2026-02-17T11:08:41.340 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.324+0000 7f5a8a7fc640 1 -- 10.20.193.162:0/3037487541 <== mon.0 v1:10.20.193.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1364490692 0 0) 0x7f5a8c1294e0 con 0x7f5a8c06cfa0 2026-02-17T11:08:41.340 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.324+0000 7f5a8a7fc640 10 monclient(hunting): _negotiate 2026-02-17T11:08:41.340 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.324+0000 7f5a8a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:41.341 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.324+0000 7f5a8a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:41.341 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.324+0000 7f5a8a7fc640 10 monclient(hunting): my global_id is 4155 2026-02-17T11:08:41.341 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.324+0000 7f5a8a7fc640 1 -- 10.20.193.162:0/3037487541 --> v1:10.20.193.49:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a8c12a6c0 con 0x7f5a8c06cfa0 2026-02-17T11:08:41.341 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.324+0000 7f5a8a7fc640 1 -- 10.20.193.162:0/3037487541 <== mon.2 v1:10.20.193.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1286103354 0 0) 0x7f5a8c12b8a0 con 0x7f5a8c06e670 2026-02-17T11:08:41.341 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.324+0000 7f5a8a7fc640 10 monclient(hunting): _negotiate 2026-02-17T11:08:41.341 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.324+0000 7f5a8a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:41.341 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.324+0000 7f5a8a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:41.341 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.324+0000 7f5a8a7fc640 10 monclient(hunting): my global_id is 4166 2026-02-17T11:08:41.341 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.324+0000 7f5a8a7fc640 1 -- 10.20.193.162:0/3037487541 --> v1:10.20.193.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a8c1294e0 con 0x7f5a8c06e670 2026-02-17T11:08:41.341 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.326+0000 7f5a8a7fc640 1 -- 10.20.193.162:0/3037487541 <== mon.0 v1:10.20.193.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 316473517 0 0) 0x7f5a8c12a6c0 con 0x7f5a8c06cfa0 2026-02-17T11:08:41.341 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.326+0000 7f5a8a7fc640 1 -- 10.20.193.162:0/3037487541 >> v1:10.20.193.157:6789/0 conn(0x7f5a8c06e670 legacy=0x7f5a8c06c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:41.342 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.326+0000 7f5a8a7fc640 1 -- 10.20.193.162:0/3037487541 >> v1:10.20.193.97:6789/0 conn(0x7f5a8c1259d0 legacy=0x7f5a8c127dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:41.342 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.326+0000 7f5a8a7fc640 10 monclient: _finish_hunting 0 2026-02-17T11:08:41.342 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.326+0000 7f5a8a7fc640 1 monclient: found mon.noname-a-legacy 2026-02-17T11:08:41.342 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.326+0000 7f5a8a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:08:41.342 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.326+0000 7f5a8a7fc640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.49:6789/0 2026-02-17T11:08:41.342 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.326+0000 7f5a8a7fc640 1 -- 10.20.193.162:0/3037487541 --> v1:10.20.193.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a8c12ca80 con 0x7f5a8c06cfa0 2026-02-17T11:08:41.342 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.326+0000 7f5a8a7fc640 10 monclient: _finish_auth 0 2026-02-17T11:08:41.342 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.326+0000 7f5a8a7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:08:41.342 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.326+0000 7f5a8a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:08:41.342 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.326+0000 7f5a8a7fc640 1 -- 10.20.193.162:0/3037487541 <== mon.0 v1:10.20.193.49:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2462710995 0 0) 0x7f5a7c002ee0 con 0x7f5a8c06cfa0 2026-02-17T11:08:41.342 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.326+0000 7f5a8a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:41.342 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.326+0000 7f5a8a7fc640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T11:08:41.342 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.326+0000 7f5a8a7fc640 10 monclient: dump: 2026-02-17T11:08:41.343 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:41.343 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:41.343 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:41.343 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:41.343 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:41.343 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:41.343 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:41.343 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:41.343 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:41.343 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:41.343 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.326+0000 7f5a8a7fc640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] but i'm connected to v1:10.20.193.49:6789/0, reconnecting 2026-02-17T11:08:41.343 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.326+0000 7f5a8a7fc640 10 monclient: _reopen_session rank -1 2026-02-17T11:08:41.344 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.326+0000 7f5a8a7fc640 1 -- 10.20.193.162:0/3037487541 >> v1:10.20.193.49:6789/0 conn(0x7f5a8c06cfa0 legacy=0x7f5a8c1242b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:41.344 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.326+0000 7f5a8a7fc640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:08:41.344 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.326+0000 7f5a8a7fc640 1 --2- 10.20.193.162:0/3037487541 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5a70005040 0x7f5a700038a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:41.344 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.326+0000 7f5a8a7fc640 10 monclient(hunting): picked mon.b con 0x7f5a70005040 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:08:41.344 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.326+0000 7f5a8a7fc640 1 --2- 10.20.193.162:0/3037487541 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5a70003de0 0x7f5a70004260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:41.344 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.326+0000 7f5a8a7fc640 10 monclient(hunting): picked mon.c con 0x7f5a70003de0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:08:41.344 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.326+0000 7f5a8a7fc640 1 --2- 10.20.193.162:0/3037487541 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5a70009ab0 0x7f5a7000bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:41.344 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.326+0000 7f5a8a7fc640 10 monclient(hunting): picked mon.a con 0x7f5a70009ab0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:08:41.344 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.326+0000 7f5a8a7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:41.344 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.326+0000 7f5a8a7fc640 1 -- 10.20.193.162:0/3037487541 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7000c5c0 con 0x7f5a70009ab0 2026-02-17T11:08:41.344 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.326+0000 7f5a8a7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:41.344 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.326+0000 7f5a8a7fc640 1 -- 10.20.193.162:0/3037487541 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7000c770 con 0x7f5a70005040 2026-02-17T11:08:41.345 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.326+0000 7f5a8a7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:41.345 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.326+0000 7f5a8a7fc640 1 -- 10.20.193.162:0/3037487541 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7000c970 con 0x7f5a70003de0 2026-02-17T11:08:41.345 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.326+0000 7f5a8a7fc640 10 monclient(hunting): _renew_subs 2026-02-17T11:08:41.345 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.326+0000 7f5a8a7fc640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:08:41.345 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.327+0000 7f5a8affd640 1 --2- 10.20.193.162:0/3037487541 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5a70003de0 0x7f5a70004260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:41.345 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.327+0000 7f5a8b7fe640 1 --2- 10.20.193.162:0/3037487541 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5a70005040 0x7f5a700038a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:41.345 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.327+0000 7f5a8affd640 10 monclient(hunting): get_auth_request con 0x7f5a70003de0 auth_method 0 2026-02-17T11:08:41.345 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.327+0000 7f5a8affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:41.345 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.327+0000 7f5a8affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:41.345 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.327+0000 7f5a8affd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:08:41.345 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.327+0000 7f5a8b7fe640 10 monclient(hunting): get_auth_request con 0x7f5a70005040 auth_method 0 2026-02-17T11:08:41.346 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.327+0000 7f5a8b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:41.346 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.327+0000 7f5a8b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:41.346 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.327+0000 7f5a8b7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:08:41.346 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.327+0000 7f5a8affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:41.346 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.327+0000 7f5a8affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:41.346 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.327+0000 7f5a8affd640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:08:41.346 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.327+0000 7f5a8bfff640 1 --2- 10.20.193.162:0/3037487541 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5a70009ab0 0x7f5a7000bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:41.346 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.327+0000 7f5a8b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:41.346 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.327+0000 7f5a8b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:41.346 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.327+0000 7f5a8b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:08:41.346 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.327+0000 7f5a8bfff640 10 monclient(hunting): get_auth_request con 0x7f5a70009ab0 auth_method 0 2026-02-17T11:08:41.346 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.327+0000 7f5a8bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:41.347 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.327+0000 7f5a8bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:41.347 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.327+0000 7f5a8bfff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:08:41.347 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.328+0000 7f5a8bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:41.347 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.328+0000 7f5a8bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:41.347 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.328+0000 7f5a8bfff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:08:41.347 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.328+0000 7f5a8affd640 10 monclient(hunting): handle_auth_done global_id 4155 payload 293 2026-02-17T11:08:41.347 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.328+0000 7f5a8affd640 1 -- 10.20.193.162:0/3037487541 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5a70005040 msgr2=0x7f5a700038a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:08:41.347 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.328+0000 7f5a8affd640 1 --2- 10.20.193.162:0/3037487541 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5a70005040 0x7f5a700038a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:41.347 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.328+0000 7f5a8affd640 1 -- 10.20.193.162:0/3037487541 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5a70009ab0 msgr2=0x7f5a7000bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:08:41.347 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.328+0000 7f5a8affd640 1 --2- 10.20.193.162:0/3037487541 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5a70009ab0 0x7f5a7000bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:41.347 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.328+0000 7f5a8affd640 10 monclient: _finish_hunting 0 2026-02-17T11:08:41.347 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.328+0000 7f5a8affd640 1 monclient: found mon.c 2026-02-17T11:08:41.347 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.328+0000 7f5a8affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:08:41.348 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.328+0000 7f5a8affd640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:08:41.348 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.328+0000 7f5a8affd640 1 -- 10.20.193.162:0/3037487541 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a8c12a6c0 con 0x7f5a70003de0 2026-02-17T11:08:41.348 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.328+0000 7f5a8bfff640 1 -- 10.20.193.162:0/3037487541 reap_dead start 2026-02-17T11:08:41.348 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.328+0000 7f5a8affd640 10 monclient: _finish_auth 0 2026-02-17T11:08:41.348 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.328+0000 7f5a8affd640 10 monclient: _check_auth_tickets 2026-02-17T11:08:41.348 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.328+0000 7f5a8affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:08:41.348 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.328+0000 7f5a921c1640 5 monclient: authenticate success, global_id 4155 2026-02-17T11:08:41.348 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.328+0000 7f5a921c1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:08:41.348 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.329+0000 7f5a8affd640 1 --2- 10.20.193.162:0/3037487541 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5a70003de0 0x7f5a70004260 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c007fa0 tx=0x7f5a7c02f3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=389121699e0da3f7 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:08:41.348 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.330+0000 7f5a8a7fc640 1 -- 10.20.193.162:0/3037487541 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a7c03c070 con 0x7f5a70003de0 2026-02-17T11:08:41.348 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.330+0000 7f5a8a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:41.348 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.330+0000 7f5a8a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:08:41.349 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.330+0000 7f5a8a7fc640 10 monclient: dump: 2026-02-17T11:08:41.349 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:41.349 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:41.349 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:41.349 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:41.349 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:41.349 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:41.349 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:41.349 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:41.349 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:41.349 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:41.349 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.330+0000 7f5a921c1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:08:41.350 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.331+0000 7f5a8a7fc640 1 -- 10.20.193.162:0/3037487541 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a7c02fe30 con 0x7f5a70003de0 2026-02-17T11:08:41.350 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.331+0000 7f5a8a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:08:41.350 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.331+0000 7f5a8a7fc640 1 -- 10.20.193.162:0/3037487541 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a7c007bf0 con 0x7f5a70003de0 2026-02-17T11:08:41.350 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.331+0000 7f5a8a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:41.350 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.331+0000 7f5a8a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:08:41.350 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.331+0000 7f5a8a7fc640 10 monclient: dump: 2026-02-17T11:08:41.350 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:41.350 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:41.350 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:41.350 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:41.350 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:41.350 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:41.350 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:41.351 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:41.351 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:41.351 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:41.351 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.331+0000 7f5a921c1640 10 monclient: get_monmap_and_config success 2026-02-17T11:08:41.351 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.331+0000 7f5a921c1640 4 set_mon_vals no callback set 2026-02-17T11:08:41.351 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.331+0000 7f5a921c1640 10 monclient: shutdown 2026-02-17T11:08:41.351 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.331+0000 7f5a921c1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:08:41.351 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.331+0000 7f5a921c1640 1 -- 10.20.193.162:0/3037487541 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5a70003de0 msgr2=0x7f5a70004260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:41.351 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.331+0000 7f5a921c1640 1 --2- 10.20.193.162:0/3037487541 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5a70003de0 0x7f5a70004260 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c007fa0 tx=0x7f5a7c02f3b0 comp rx=0 tx=0).stop 2026-02-17T11:08:41.351 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.331+0000 7f5a921c1640 1 -- 10.20.193.162:0/3037487541 shutdown_connections 2026-02-17T11:08:41.351 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.331+0000 7f5a921c1640 1 --2- 10.20.193.162:0/3037487541 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5a70003de0 0x7f5a70004260 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:41.351 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.331+0000 7f5a921c1640 1 -- 10.20.193.162:0/3037487541 >> 10.20.193.162:0/3037487541 conn(0x7f5a8c071500 msgr2=0x7f5a8c073920 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:08:41.352 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.331+0000 7f5a921c1640 1 -- 10.20.193.162:0/3037487541 shutdown_connections 2026-02-17T11:08:41.352 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.331+0000 7f5a921c1640 1 -- 10.20.193.162:0/3037487541 wait complete. 2026-02-17T11:08:41.352 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.331+0000 7f5a921c1640 10 monclient: build_initial_monmap 2026-02-17T11:08:41.352 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.331+0000 7f5a921c1640 10 monclient: monmap: 2026-02-17T11:08:41.352 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-17T11:08:41.352 INFO:teuthology.orchestra.run.trial162.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:08:41.352 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 0.000000 2026-02-17T11:08:41.352 INFO:teuthology.orchestra.run.trial162.stderr:created 0.000000 2026-02-17T11:08:41.352 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-17T11:08:41.352 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:41.352 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:08:41.353 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:08:41.353 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:08:41.353 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:41.353 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.331+0000 7f5a921c1640 1 librados: starting msgr at 2026-02-17T11:08:41.353 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.331+0000 7f5a921c1640 1 librados: starting objecter 2026-02-17T11:08:41.353 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.331+0000 7f5a921c1640 1 Processor -- start 2026-02-17T11:08:41.353 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.331+0000 7f5a921c1640 1 -- start start 2026-02-17T11:08:41.353 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.331+0000 7f5a921c1640 1 librados: setting wanted keys 2026-02-17T11:08:41.353 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.331+0000 7f5a921c1640 1 librados: calling monclient init 2026-02-17T11:08:41.353 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.331+0000 7f5a921c1640 10 monclient: init 2026-02-17T11:08:41.353 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.332+0000 7f5a921c1640 10 monclient: _reopen_session rank -1 2026-02-17T11:08:41.353 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.332+0000 7f5a921c1640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:08:41.354 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.332+0000 7f5a921c1640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5a70003de0 0x7f5a8c121eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:41.354 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.332+0000 7f5a921c1640 10 monclient(hunting): picked mon.noname-b con 0x7f5a70003de0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:08:41.354 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.332+0000 7f5a921c1640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5a8c122480 0x7f5a8c1b9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:41.354 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.332+0000 7f5a921c1640 10 monclient(hunting): picked mon.noname-c con 0x7f5a8c122480 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:08:41.354 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.332+0000 7f5a921c1640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5a8c1b9e80 0x7f5a8c1bc270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:41.354 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.332+0000 7f5a921c1640 10 monclient(hunting): picked mon.noname-a con 0x7f5a8c1b9e80 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:08:41.354 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.332+0000 7f5a921c1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:41.354 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.332+0000 7f5a921c1640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5a8c06cce0 con 0x7f5a8c1b9e80 2026-02-17T11:08:41.354 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.332+0000 7f5a921c1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:41.354 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.332+0000 7f5a921c1640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f5a8c06cb60 con 0x7f5a70003de0 2026-02-17T11:08:41.354 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.332+0000 7f5a921c1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:41.354 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.332+0000 7f5a921c1640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f5a8c12a890 con 0x7f5a8c122480 2026-02-17T11:08:41.354 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.332+0000 7f5a921c1640 10 monclient(hunting): _renew_subs 2026-02-17T11:08:41.355 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.332+0000 7f5a921c1640 10 monclient(hunting): authenticate will time out at 959.071162s 2026-02-17T11:08:41.355 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.332+0000 7f5a8affd640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5a8c122480 0x7f5a8c1b9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:41.355 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.332+0000 7f5a8b7fe640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5a70003de0 0x7f5a8c121eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:41.355 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.332+0000 7f5a8affd640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5a8c122480 0x7f5a8c1b9940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.162:47344/0 (socket says 10.20.193.162:47344) 2026-02-17T11:08:41.355 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.332+0000 7f5a8affd640 1 -- 10.20.193.162:0/2224495908 learned_addr learned my addr 10.20.193.162:0/2224495908 (peer_addr_for_me v2:10.20.193.162:0/0) 2026-02-17T11:08:41.355 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.332+0000 7f5a8affd640 10 monclient(hunting): get_auth_request con 0x7f5a8c122480 auth_method 0 2026-02-17T11:08:41.355 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.332+0000 7f5a8affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:41.355 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.332+0000 7f5a8affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:41.355 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.332+0000 7f5a8affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:41.355 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.332+0000 7f5a8bfff640 1 --2- 10.20.193.162:0/2224495908 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5a8c1b9e80 0x7f5a8c1bc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:41.355 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.332+0000 7f5a8b7fe640 10 monclient(hunting): get_auth_request con 0x7f5a70003de0 auth_method 0 2026-02-17T11:08:41.355 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.332+0000 7f5a8b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:41.356 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.332+0000 7f5a8b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:41.356 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.332+0000 7f5a8b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:41.356 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.332+0000 7f5a8affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:41.356 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.332+0000 7f5a8affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:41.356 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.332+0000 7f5a8affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:41.356 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.332+0000 7f5a8b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:41.356 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.332+0000 7f5a8b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:41.356 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.332+0000 7f5a8b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:41.356 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.332+0000 7f5a8bfff640 10 monclient(hunting): get_auth_request con 0x7f5a8c1b9e80 auth_method 0 2026-02-17T11:08:41.356 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.332+0000 7f5a8bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:41.356 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.332+0000 7f5a8bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:41.356 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.332+0000 7f5a8bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:41.356 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.333+0000 7f5a8bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:41.357 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.333+0000 7f5a8bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:41.357 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.333+0000 7f5a8bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:41.357 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.333+0000 7f5a8affd640 10 monclient(hunting): handle_auth_done global_id 4169 payload 824 2026-02-17T11:08:41.357 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.333+0000 7f5a8affd640 1 -- 10.20.193.162:0/2224495908 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5a70003de0 msgr2=0x7f5a8c121eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:41.357 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.333+0000 7f5a8affd640 1 --2- 10.20.193.162:0/2224495908 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5a70003de0 0x7f5a8c121eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:41.357 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.333+0000 7f5a8affd640 1 -- 10.20.193.162:0/2224495908 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5a8c1b9e80 msgr2=0x7f5a8c1bc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:41.357 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.333+0000 7f5a8affd640 1 --2- 10.20.193.162:0/2224495908 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5a8c1b9e80 0x7f5a8c1bc270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:41.357 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.333+0000 7f5a8affd640 10 monclient: _finish_hunting 0 2026-02-17T11:08:41.357 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.333+0000 7f5a8affd640 1 monclient: found mon.noname-c 2026-02-17T11:08:41.357 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.333+0000 7f5a8affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:08:41.357 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.333+0000 7f5a8affd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:08:41.357 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.333+0000 7f5a8affd640 1 -- 10.20.193.162:0/2224495908 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a8c1bc8e0 con 0x7f5a8c122480 2026-02-17T11:08:41.358 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.334+0000 7f5a8affd640 1 --2- 10.20.193.162:0/2224495908 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5a8c122480 0x7f5a8c1b9940 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c03a040 tx=0x7f5a7c031070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:08:41.358 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.334+0000 7f5a67fff640 10 client.?.objecter ms_handle_connect 0x7f5a8c122480 2026-02-17T11:08:41.358 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.334+0000 7f5a67fff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:08:41.358 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.335+0000 7f5a67fff640 1 -- 10.20.193.162:0/2224495908 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a7c046070 con 0x7f5a8c122480 2026-02-17T11:08:41.358 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.335+0000 7f5a67fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:41.358 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.335+0000 7f5a67fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:08:41.358 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.335+0000 7f5a67fff640 10 monclient: dump: 2026-02-17T11:08:41.358 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:41.358 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:41.358 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:41.358 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:41.358 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:41.358 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:41.359 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:41.359 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:41.359 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:41.359 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:41.359 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.335+0000 7f5a67fff640 10 monclient: _finish_auth 0 2026-02-17T11:08:41.359 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.335+0000 7f5a67fff640 10 monclient: _check_auth_tickets 2026-02-17T11:08:41.359 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.335+0000 7f5a67fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:08:41.359 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.335+0000 7f5a921c1640 5 monclient: authenticate success, global_id 4169 2026-02-17T11:08:41.359 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.335+0000 7f5a921c1640 10 monclient: _renew_subs 2026-02-17T11:08:41.359 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.335+0000 7f5a921c1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:08:41.359 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.335+0000 7f5a921c1640 1 -- 10.20.193.162:0/2224495908 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a8c1bcb10 con 0x7f5a8c122480 2026-02-17T11:08:41.359 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.335+0000 7f5a921c1640 10 client.4169.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:08:41.359 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.335+0000 7f5a921c1640 10 monclient: _renew_subs 2026-02-17T11:08:41.359 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.335+0000 7f5a921c1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:08:41.360 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.335+0000 7f5a921c1640 1 -- 10.20.193.162:0/2224495908 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a8c1bd010 con 0x7f5a8c122480 2026-02-17T11:08:41.360 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.335+0000 7f5a921c1640 1 librados: init done 2026-02-17T11:08:41.360 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.336+0000 7f5a921c1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:41.360 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.336+0000 7f5a921c1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:41.360 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.336+0000 7f5a921c1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:08:41.360 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.336+0000 7f5a921c1640 1 -- 10.20.193.162:0/2224495908 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a8c12acf0 con 0x7f5a8c122480 2026-02-17T11:08:41.360 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.336+0000 7f5a67fff640 1 -- 10.20.193.162:0/2224495908 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a7c03d040 con 0x7f5a8c122480 2026-02-17T11:08:41.360 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.336+0000 7f5a67fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:08:41.360 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.336+0000 7f5a67fff640 1 -- 10.20.193.162:0/2224495908 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a7c03c070 con 0x7f5a8c122480 2026-02-17T11:08:41.360 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.336+0000 7f5a67fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:41.360 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.336+0000 7f5a67fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:08:41.360 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.336+0000 7f5a67fff640 10 monclient: dump: 2026-02-17T11:08:41.360 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:41.360 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:41.360 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:41.361 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:41.361 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:41.361 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:41.361 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:41.361 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:41.361 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:41.361 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:41.361 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.336+0000 7f5a89ffb640 4 set_mon_vals no callback set 2026-02-17T11:08:41.382 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.380+0000 7f5a67fff640 1 -- 10.20.193.162:0/2224495908 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 2) ==== 50049+0+0 (secure 0 0 0) 0x7f5a7c003ad0 con 0x7f5a8c122480 2026-02-17T11:08:41.383 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.380+0000 7f5a67fff640 1 -- 10.20.193.162:0/2224495908 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f5a7c041440 con 0x7f5a8c122480 2026-02-17T11:08:41.383 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.380+0000 7f5a67fff640 10 client.4169.objecter ms_dispatch2 0x7f5a8c000b90 osd_map(10..10 src has 1..10) 2026-02-17T11:08:41.383 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.380+0000 7f5a67fff640 3 client.4169.objecter handle_osd_map got epochs [10,10] > 0 2026-02-17T11:08:41.383 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.380+0000 7f5a67fff640 3 client.4169.objecter handle_osd_map decoding full epoch 10 2026-02-17T11:08:41.383 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.380+0000 7f5a67fff640 20 client.4169.objecter dump_active .. 0 homeless 2026-02-17T11:08:41.385 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.383+0000 7f5a67fff640 1 -- 10.20.193.162:0/2224495908 <== mon.2 v2:10.20.193.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f5a7c041bf0 con 0x7f5a8c122480 2026-02-17T11:08:41.385 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.383+0000 7f5a67fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:41.385 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.383+0000 7f5a67fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:08:41.417 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.415+0000 7f5a921c1640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "f04abc9b-ed75-4582-b47d-07a9890f52bb", "id": 8}] 2026-02-17T11:08:41.417 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.415+0000 7f5a921c1640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "f04abc9b-ed75-4582-b47d-07a9890f52bb", "id": 8}] 2026-02-17T11:08:41.417 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.415+0000 7f5a921c1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:08:41.417 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.415+0000 7f5a921c1640 1 -- 10.20.193.162:0/2224495908 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f04abc9b-ed75-4582-b47d-07a9890f52bb", "id": 8} v 0) -- 0x7f5a8c1bd290 con 0x7f5a8c122480 2026-02-17T11:08:41.573 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.571+0000 7f5a67fff640 1 -- 10.20.193.162:0/2224495908 <== mon.2 v2:10.20.193.157:3300/0 7 ==== mgrmap(e 3) ==== 99895+0+0 (secure 0 0 0) 0x7f5a7c0416d0 con 0x7f5a8c122480 2026-02-17T11:08:41.574 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.571+0000 7f5a67fff640 1 --2- 10.20.193.162:0/2224495908 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5a5c079630 0x7f5a5c07ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:41.574 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.571+0000 7f5a8b7fe640 1 --2- 10.20.193.162:0/2224495908 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5a5c079630 0x7f5a5c07ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:41.574 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.571+0000 7f5a8b7fe640 10 monclient: get_auth_request con 0x7f5a5c079630 auth_method 0 2026-02-17T11:08:41.574 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.571+0000 7f5a67fff640 10 client.4169.objecter ms_handle_connect 0x7f5a5c079630 2026-02-17T11:08:41.574 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.571+0000 7f5a8b7fe640 1 --2- 10.20.193.162:0/2224495908 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5a5c079630 0x7f5a5c07ba20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5a78002770 tx=0x7f5a78002700 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:08:41.575 INFO:tasks.ceph.mgr.x.trial162.stderr:2026-02-17T11:08:41.573+0000 7efb5c133640 -1 mgr.server handle_report got status from non-daemon mon.b 2026-02-17T11:08:41.613 INFO:tasks.ceph.mgr.x.trial162.stderr:2026-02-17T11:08:41.612+0000 7efb5c133640 -1 mgr.server handle_report got status from non-daemon mon.c 2026-02-17T11:08:41.647 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.646+0000 7f5a67fff640 1 -- 10.20.193.162:0/2224495908 <== mon.2 v2:10.20.193.157:3300/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f04abc9b-ed75-4582-b47d-07a9890f52bb", "id": 8}]=0 v11) ==== 112+0+2 (secure 0 0 0) 0x7f5a7c051070 con 0x7f5a8c122480 2026-02-17T11:08:41.647 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.646+0000 7f5a67fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "f04abc9b-ed75-4582-b47d-07a9890f52bb", "id": 8}] 2026-02-17T11:08:41.647 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.646+0000 7f5a67fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:08:41.647 INFO:teuthology.orchestra.run.trial162.stdout:8 2026-02-17T11:08:41.648 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.646+0000 7f5a921c1640 10 librados: watch_flush enter 2026-02-17T11:08:41.648 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.646+0000 7f5a921c1640 10 librados: watch_flush exit 2026-02-17T11:08:41.648 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.646+0000 7f5a921c1640 20 client.4169.objecter shutdown clearing up homeless session... 2026-02-17T11:08:41.648 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.646+0000 7f5a921c1640 10 client.4169.objecter successfully canceled tick 2026-02-17T11:08:41.648 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.646+0000 7f5a921c1640 1 -- 10.20.193.162:0/2224495908 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5a5c079630 msgr2=0x7f5a5c07ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:41.648 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.646+0000 7f5a921c1640 1 --2- 10.20.193.162:0/2224495908 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5a5c079630 0x7f5a5c07ba20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5a78002770 tx=0x7f5a78002700 comp rx=0 tx=0).stop 2026-02-17T11:08:41.648 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.646+0000 7f5a921c1640 10 monclient: shutdown 2026-02-17T11:08:41.648 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.646+0000 7f5a921c1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:08:41.648 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.646+0000 7f5a921c1640 1 -- 10.20.193.162:0/2224495908 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5a8c122480 msgr2=0x7f5a8c1b9940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:41.649 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.646+0000 7f5a921c1640 1 --2- 10.20.193.162:0/2224495908 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5a8c122480 0x7f5a8c1b9940 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c03a040 tx=0x7f5a7c031070 comp rx=0 tx=0).stop 2026-02-17T11:08:41.649 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.646+0000 7f5a921c1640 1 -- 10.20.193.162:0/2224495908 shutdown_connections 2026-02-17T11:08:41.649 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.646+0000 7f5a921c1640 1 --2- 10.20.193.162:0/2224495908 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5a5c079630 0x7f5a5c07ba20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:41.649 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.646+0000 7f5a921c1640 1 --2- 10.20.193.162:0/2224495908 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5a8c1b9e80 0x7f5a8c1bc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:41.649 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.646+0000 7f5a921c1640 1 --2- 10.20.193.162:0/2224495908 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5a8c122480 0x7f5a8c1b9940 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:41.649 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.646+0000 7f5a921c1640 1 --2- 10.20.193.162:0/2224495908 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5a70003de0 0x7f5a8c121eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:41.649 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.646+0000 7f5a921c1640 1 -- 10.20.193.162:0/2224495908 >> 10.20.193.162:0/2224495908 conn(0x7f5a8c071500 msgr2=0x7f5a8c0738f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:08:41.649 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.646+0000 7f5a921c1640 1 -- 10.20.193.162:0/2224495908 shutdown_connections 2026-02-17T11:08:41.649 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.646+0000 7f5a921c1640 1 -- 10.20.193.162:0/2224495908 wait complete. 2026-02-17T11:08:41.649 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.646+0000 7f5a921c1640 1 librados: shutdown 2026-02-17T11:08:41.656 DEBUG:teuthology.orchestra.run.trial162:> sudo ceph --cluster ceph osd new 7dfbb00a-6b89-4de3-9f30-6aadd91b4408 9 2026-02-17T11:08:41.718 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.716+0000 7f6ece432640 10 monclient: get_monmap_and_config 2026-02-17T11:08:41.718 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.716+0000 7f6ece432640 10 monclient: build_initial_monmap 2026-02-17T11:08:41.718 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.716+0000 7f6ece432640 10 monclient: monmap: 2026-02-17T11:08:41.718 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-17T11:08:41.718 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:41.718 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:08:41.717529+0000 2026-02-17T11:08:41.719 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:08:41.717529+0000 2026-02-17T11:08:41.719 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-17T11:08:41.719 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:41.719 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:08:41.719 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:08:41.719 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:08:41.719 INFO:teuthology.orchestra.run.trial162.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:08:41.719 INFO:teuthology.orchestra.run.trial162.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:08:41.719 INFO:teuthology.orchestra.run.trial162.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:08:41.719 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:41.719 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.716+0000 7f6ece432640 1 Processor -- start 2026-02-17T11:08:41.719 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.716+0000 7f6ece432640 1 -- start start 2026-02-17T11:08:41.719 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.716+0000 7f6ece432640 10 monclient: init 2026-02-17T11:08:41.719 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.716+0000 7f6ece432640 10 monclient: _reopen_session rank -1 2026-02-17T11:08:41.719 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.716+0000 7f6ece432640 10 monclient: _add_conns ranks=[3,1,4,0,2,5] 2026-02-17T11:08:41.719 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.716+0000 7f6ece432640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f6ec8073590 0x7f6ec8073970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:41.719 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.716+0000 7f6ece432640 10 monclient(hunting): picked mon.noname-a con 0x7f6ec8073590 addr v2:10.20.193.49:3300/0 2026-02-17T11:08:41.719 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.716+0000 7f6ece432640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f6ec8073eb0 addr v1:10.20.193.97:6789/0 2026-02-17T11:08:41.719 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.716+0000 7f6ece432640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f6ec8120080 0x7f6ec8122470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:41.719 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.716+0000 7f6ece432640 10 monclient(hunting): picked mon.noname-b con 0x7f6ec8120080 addr v2:10.20.193.97:3300/0 2026-02-17T11:08:41.719 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.716+0000 7f6ece432640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ec8122b70 con 0x7f6ec8073eb0 2026-02-17T11:08:41.719 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.716+0000 7f6ece432640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:41.719 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.716+0000 7f6ece432640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f6ec8123d90 con 0x7f6ec8073590 2026-02-17T11:08:41.719 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.716+0000 7f6ece432640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:41.719 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.716+0000 7f6ece432640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f6ec8123f10 con 0x7f6ec8120080 2026-02-17T11:08:41.719 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.716+0000 7f6ece432640 10 monclient(hunting): _renew_subs 2026-02-17T11:08:41.719 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.716+0000 7f6ece432640 10 monclient(hunting): authenticate will time out at 959.455567s 2026-02-17T11:08:41.720 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.716+0000 7f6ec7fff640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f6ec8073590 0x7f6ec8073970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:41.720 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.717+0000 7f6ecc9a8640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f6ec8120080 0x7f6ec8122470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:41.721 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.717+0000 7f6ec7fff640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f6ec8073590 0x7f6ec8073970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.162:57336/0 (socket says 10.20.193.162:57336) 2026-02-17T11:08:41.721 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.717+0000 7f6ec7fff640 1 -- 10.20.193.162:0/1785909281 learned_addr learned my addr 10.20.193.162:0/1785909281 (peer_addr_for_me v2:10.20.193.162:0/0) 2026-02-17T11:08:41.721 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.717+0000 7f6ec7fff640 10 monclient(hunting): get_auth_request con 0x7f6ec8073590 auth_method 0 2026-02-17T11:08:41.721 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.717+0000 7f6ec7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:41.721 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.717+0000 7f6ec7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:41.721 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.717+0000 7f6ec7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:41.721 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.717+0000 7f6ecc9a8640 10 monclient(hunting): get_auth_request con 0x7f6ec8120080 auth_method 0 2026-02-17T11:08:41.721 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.717+0000 7f6ecc9a8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:41.721 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.717+0000 7f6ecc9a8640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:41.721 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.717+0000 7f6ecc9a8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:41.721 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.717+0000 7f6ec7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:41.721 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.717+0000 7f6ec7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:41.721 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.717+0000 7f6ec7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:41.721 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.717+0000 7f6ecc9a8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:41.721 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.717+0000 7f6ecc9a8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:41.721 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.717+0000 7f6ecc9a8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:41.721 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.718+0000 7f6ec7fff640 10 monclient(hunting): handle_auth_done global_id 4161 payload 274 2026-02-17T11:08:41.721 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.718+0000 7f6ec7fff640 1 -- 10.20.193.162:0/1785909281 >> v2:10.20.193.97:3300/0 conn(0x7f6ec8120080 msgr2=0x7f6ec8122470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:08:41.721 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.718+0000 7f6ec7fff640 1 --2- 10.20.193.162:0/1785909281 >> v2:10.20.193.97:3300/0 conn(0x7f6ec8120080 0x7f6ec8122470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:41.721 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.718+0000 7f6ec7fff640 1 -- 10.20.193.162:0/1785909281 >> v1:10.20.193.97:6789/0 conn(0x7f6ec8073eb0 legacy=0x7f6ec811e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:41.721 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.718+0000 7f6ec7fff640 10 monclient: _finish_hunting 0 2026-02-17T11:08:41.721 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.718+0000 7f6ec7fff640 1 monclient: found mon.noname-a 2026-02-17T11:08:41.721 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.718+0000 7f6ec7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:08:41.721 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.718+0000 7f6ec7fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:08:41.721 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.718+0000 7f6ec7fff640 1 -- 10.20.193.162:0/1785909281 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ec81240c0 con 0x7f6ec8073590 2026-02-17T11:08:41.722 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.719+0000 7f6ec7fff640 1 --2- 10.20.193.162:0/1785909281 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f6ec8073590 0x7f6ec8073970 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6ec8074490 tx=0x7f6eb402ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afb62c338349e2d0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:08:41.723 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.721+0000 7f6ec6ffd640 1 -- 10.20.193.162:0/1785909281 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb403c070 con 0x7f6ec8073590 2026-02-17T11:08:41.723 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.721+0000 7f6ec6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:41.723 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.721+0000 7f6ec6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:08:41.723 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.721+0000 7f6ec6ffd640 10 monclient: dump: 2026-02-17T11:08:41.724 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:41.724 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:41.724 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:41.724 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:41.724 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:41.724 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:41.724 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:41.724 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:41.724 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:41.724 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:41.724 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.721+0000 7f6ec6ffd640 10 monclient: _finish_auth 0 2026-02-17T11:08:41.724 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.721+0000 7f6ec6ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:08:41.724 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.721+0000 7f6ec6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:08:41.724 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.721+0000 7f6ec6ffd640 1 -- 10.20.193.162:0/1785909281 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6eb402fb30 con 0x7f6ec8073590 2026-02-17T11:08:41.724 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.721+0000 7f6ece432640 5 monclient: authenticate success, global_id 4161 2026-02-17T11:08:41.724 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.721+0000 7f6ec6ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:08:41.724 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.721+0000 7f6ec6ffd640 1 -- 10.20.193.162:0/1785909281 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb4037440 con 0x7f6ec8073590 2026-02-17T11:08:41.724 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.721+0000 7f6ece432640 10 monclient: get_monmap_and_config success 2026-02-17T11:08:41.724 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.721+0000 7f6ece432640 4 set_mon_vals no callback set 2026-02-17T11:08:41.724 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.721+0000 7f6ec6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:41.724 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.721+0000 7f6ec6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:08:41.724 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.721+0000 7f6ec6ffd640 10 monclient: dump: 2026-02-17T11:08:41.724 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:41.724 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:41.724 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:41.724 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:41.724 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:41.725 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:41.725 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:41.725 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:41.725 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:41.725 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:41.725 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.721+0000 7f6ece432640 10 monclient: shutdown 2026-02-17T11:08:41.725 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.721+0000 7f6ece432640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:08:41.725 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.721+0000 7f6ece432640 1 -- 10.20.193.162:0/1785909281 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f6ec8073590 msgr2=0x7f6ec8073970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:41.725 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.721+0000 7f6ece432640 1 --2- 10.20.193.162:0/1785909281 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f6ec8073590 0x7f6ec8073970 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6ec8074490 tx=0x7f6eb402ee60 comp rx=0 tx=0).stop 2026-02-17T11:08:41.725 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.721+0000 7f6ece432640 1 -- 10.20.193.162:0/1785909281 shutdown_connections 2026-02-17T11:08:41.725 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.721+0000 7f6ece432640 1 --2- 10.20.193.162:0/1785909281 >> v2:10.20.193.97:3300/0 conn(0x7f6ec8120080 0x7f6ec8122470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:41.725 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.721+0000 7f6ece432640 1 --2- 10.20.193.162:0/1785909281 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f6ec8073590 0x7f6ec8073970 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:41.725 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.721+0000 7f6ece432640 1 -- 10.20.193.162:0/1785909281 >> 10.20.193.162:0/1785909281 conn(0x7f6ec806f660 msgr2=0x7f6ec8071a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:08:41.725 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.721+0000 7f6ece432640 1 -- 10.20.193.162:0/1785909281 shutdown_connections 2026-02-17T11:08:41.725 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.721+0000 7f6ece432640 1 -- 10.20.193.162:0/1785909281 wait complete. 2026-02-17T11:08:41.725 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.721+0000 7f6ece432640 10 monclient: build_initial_monmap 2026-02-17T11:08:41.725 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.721+0000 7f6ece432640 10 monclient: monmap: 2026-02-17T11:08:41.725 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-17T11:08:41.725 INFO:teuthology.orchestra.run.trial162.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:08:41.725 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 0.000000 2026-02-17T11:08:41.725 INFO:teuthology.orchestra.run.trial162.stderr:created 0.000000 2026-02-17T11:08:41.725 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-17T11:08:41.725 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:41.725 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:08:41.725 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:08:41.725 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:08:41.725 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:41.726 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.721+0000 7f6ece432640 1 librados: starting msgr at 2026-02-17T11:08:41.726 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.721+0000 7f6ece432640 1 librados: starting objecter 2026-02-17T11:08:41.726 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.721+0000 7f6ece432640 1 Processor -- start 2026-02-17T11:08:41.726 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.721+0000 7f6ece432640 1 -- start start 2026-02-17T11:08:41.726 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.721+0000 7f6ece432640 1 librados: setting wanted keys 2026-02-17T11:08:41.726 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.721+0000 7f6ece432640 1 librados: calling monclient init 2026-02-17T11:08:41.726 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.721+0000 7f6ece432640 10 monclient: init 2026-02-17T11:08:41.727 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.722+0000 7f6ece432640 10 monclient: _reopen_session rank -1 2026-02-17T11:08:41.727 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.722+0000 7f6ece432640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:08:41.727 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.722+0000 7f6ece432640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f6ec8073590 0x7f6ec81b1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:41.728 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.722+0000 7f6ece432640 10 monclient(hunting): picked mon.noname-a con 0x7f6ec8073590 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:08:41.728 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.722+0000 7f6ece432640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f6ec8073eb0 0x7f6ec81b1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:41.728 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.722+0000 7f6ece432640 10 monclient(hunting): picked mon.noname-c con 0x7f6ec8073eb0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:08:41.728 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.722+0000 7f6ece432640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f6ec8120080 0x7f6ec81ab4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:41.728 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.722+0000 7f6ece432640 10 monclient(hunting): picked mon.noname-b con 0x7f6ec8120080 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:08:41.728 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.722+0000 7f6ece432640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:41.728 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.722+0000 7f6ece432640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6ec8123200 con 0x7f6ec8073590 2026-02-17T11:08:41.728 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.722+0000 7f6ece432640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:41.728 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.722+0000 7f6ece432640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6ec8123080 con 0x7f6ec8120080 2026-02-17T11:08:41.728 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.722+0000 7f6ece432640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:41.728 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.722+0000 7f6ece432640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f6ec8123380 con 0x7f6ec8073eb0 2026-02-17T11:08:41.728 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.722+0000 7f6ece432640 10 monclient(hunting): _renew_subs 2026-02-17T11:08:41.729 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.722+0000 7f6ece432640 10 monclient(hunting): authenticate will time out at 959.461274s 2026-02-17T11:08:41.729 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.722+0000 7f6ecc9a8640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f6ec8120080 0x7f6ec81ab4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:41.729 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.722+0000 7f6ec77fe640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f6ec8073eb0 0x7f6ec81b1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:41.729 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.722+0000 7f6ec7fff640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f6ec8073590 0x7f6ec81b1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:41.729 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.722+0000 7f6ecc9a8640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f6ec8120080 0x7f6ec81ab4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.162:48618/0 (socket says 10.20.193.162:48618) 2026-02-17T11:08:41.729 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.722+0000 7f6ecc9a8640 1 -- 10.20.193.162:0/2464179942 learned_addr learned my addr 10.20.193.162:0/2464179942 (peer_addr_for_me v2:10.20.193.162:0/0) 2026-02-17T11:08:41.729 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.722+0000 7f6ecc9a8640 10 monclient(hunting): get_auth_request con 0x7f6ec8120080 auth_method 0 2026-02-17T11:08:41.729 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.722+0000 7f6ecc9a8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:41.729 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.722+0000 7f6ecc9a8640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:41.729 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.722+0000 7f6ecc9a8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:41.729 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.722+0000 7f6ec7fff640 10 monclient(hunting): get_auth_request con 0x7f6ec8073590 auth_method 0 2026-02-17T11:08:41.729 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.722+0000 7f6ec7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:41.730 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.722+0000 7f6ec7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:41.730 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.722+0000 7f6ec7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:41.730 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.722+0000 7f6ec77fe640 10 monclient(hunting): get_auth_request con 0x7f6ec8073eb0 auth_method 0 2026-02-17T11:08:41.730 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.722+0000 7f6ec77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:41.730 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.722+0000 7f6ec77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:41.730 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.722+0000 7f6ec77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:41.730 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.722+0000 7f6ecc9a8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:41.730 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.722+0000 7f6ecc9a8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:41.730 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.722+0000 7f6ecc9a8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:41.730 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.723+0000 7f6ec7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:41.730 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.723+0000 7f6ec7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:41.730 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.723+0000 7f6ec7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:41.730 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.723+0000 7f6ec77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:41.731 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.723+0000 7f6ec77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:41.731 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.723+0000 7f6ec77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:41.731 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.724+0000 7f6ec7fff640 10 monclient(hunting): handle_auth_done global_id 4164 payload 824 2026-02-17T11:08:41.731 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.724+0000 7f6ec7fff640 1 -- 10.20.193.162:0/2464179942 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f6ec8073eb0 msgr2=0x7f6ec81b1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:41.731 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.724+0000 7f6ec7fff640 1 --2- 10.20.193.162:0/2464179942 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f6ec8073eb0 0x7f6ec81b1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:41.731 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.724+0000 7f6ec7fff640 1 -- 10.20.193.162:0/2464179942 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f6ec8120080 msgr2=0x7f6ec81ab4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:41.731 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.724+0000 7f6ec7fff640 1 --2- 10.20.193.162:0/2464179942 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f6ec8120080 0x7f6ec81ab4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:41.731 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.724+0000 7f6ec7fff640 10 monclient: _finish_hunting 0 2026-02-17T11:08:41.731 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.724+0000 7f6ec7fff640 1 monclient: found mon.noname-a 2026-02-17T11:08:41.731 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.724+0000 7f6ec7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:08:41.731 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.724+0000 7f6ec7fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:08:41.731 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.724+0000 7f6ec7fff640 1 -- 10.20.193.162:0/2464179942 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ec81abda0 con 0x7f6ec8073590 2026-02-17T11:08:41.732 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.725+0000 7f6ec7fff640 1 --2- 10.20.193.162:0/2464179942 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f6ec8073590 0x7f6ec81b1430 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6ec8075310 tx=0x7f6eb40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:08:41.732 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.725+0000 7f6ec4ff9640 10 client.?.objecter ms_handle_connect 0x7f6ec8073590 2026-02-17T11:08:41.732 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.725+0000 7f6ec4ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T11:08:41.733 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.726+0000 7f6ec4ff9640 1 -- 10.20.193.162:0/2464179942 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb403c040 con 0x7f6ec8073590 2026-02-17T11:08:41.734 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.726+0000 7f6ec4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:41.734 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.726+0000 7f6ec4ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:08:41.734 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.726+0000 7f6ec4ff9640 10 monclient: dump: 2026-02-17T11:08:41.734 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:41.734 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:41.734 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:41.734 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:41.734 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:41.734 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:41.734 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:41.734 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:41.734 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:41.735 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:41.735 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.726+0000 7f6ec4ff9640 10 monclient: _finish_auth 0 2026-02-17T11:08:41.735 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.726+0000 7f6ec4ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:08:41.735 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.726+0000 7f6ec4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:08:41.735 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.726+0000 7f6ec4ff9640 1 -- 10.20.193.162:0/2464179942 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6eb4042670 con 0x7f6ec8073590 2026-02-17T11:08:41.735 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.726+0000 7f6ece432640 5 monclient: authenticate success, global_id 4164 2026-02-17T11:08:41.735 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.726+0000 7f6ece432640 10 monclient: _renew_subs 2026-02-17T11:08:41.735 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.726+0000 7f6ece432640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:08:41.735 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.726+0000 7f6ece432640 1 -- 10.20.193.162:0/2464179942 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ec81abfd0 con 0x7f6ec8073590 2026-02-17T11:08:41.735 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.726+0000 7f6ec4ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:08:41.735 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.726+0000 7f6ec4ff9640 1 -- 10.20.193.162:0/2464179942 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb4042a60 con 0x7f6ec8073590 2026-02-17T11:08:41.735 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.726+0000 7f6ec4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:41.736 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.726+0000 7f6ec4ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:08:41.736 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.726+0000 7f6ec4ff9640 10 monclient: dump: 2026-02-17T11:08:41.736 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:41.736 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:41.736 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:41.736 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:41.736 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:41.736 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:41.736 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:41.736 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:41.736 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:41.736 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:41.737 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.726+0000 7f6ec67fc640 4 set_mon_vals no callback set 2026-02-17T11:08:41.737 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.726+0000 7f6ece432640 10 client.4164.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:08:41.737 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.726+0000 7f6ece432640 10 monclient: _renew_subs 2026-02-17T11:08:41.737 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.726+0000 7f6ece432640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:08:41.737 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.726+0000 7f6ece432640 1 -- 10.20.193.162:0/2464179942 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ec81b81e0 con 0x7f6ec8073590 2026-02-17T11:08:41.737 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.726+0000 7f6ece432640 1 librados: init done 2026-02-17T11:08:41.737 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.727+0000 7f6ece432640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:41.737 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.727+0000 7f6ece432640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:41.737 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.727+0000 7f6ece432640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:08:41.737 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.727+0000 7f6ece432640 1 -- 10.20.193.162:0/2464179942 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ec8073970 con 0x7f6ec8073590 2026-02-17T11:08:41.833 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.830+0000 7f6ec4ff9640 1 -- 10.20.193.162:0/2464179942 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 3) ==== 99895+0+0 (secure 0 0 0) 0x7f6eb402fce0 con 0x7f6ec8073590 2026-02-17T11:08:41.834 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.831+0000 7f6ec4ff9640 1 --2- 10.20.193.162:0/2464179942 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f6e98078fe0 0x7f6e9807b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:41.834 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.831+0000 7f6ec77fe640 1 --2- 10.20.193.162:0/2464179942 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f6e98078fe0 0x7f6e9807b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:41.834 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.831+0000 7f6ec77fe640 10 monclient: get_auth_request con 0x7f6e98078fe0 auth_method 0 2026-02-17T11:08:41.834 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.831+0000 7f6ec4ff9640 10 client.4164.objecter ms_handle_connect 0x7f6e98078fe0 2026-02-17T11:08:41.834 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.831+0000 7f6ec77fe640 1 --2- 10.20.193.162:0/2464179942 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f6e98078fe0 0x7f6e9807b4a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6ec81b0fc0 tx=0x7f6eb8007f30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:08:41.840 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.837+0000 7f6ec4ff9640 1 -- 10.20.193.162:0/2464179942 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 1760+0+0 (secure 0 0 0) 0x7f6eb4047070 con 0x7f6ec8073590 2026-02-17T11:08:41.840 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.837+0000 7f6ec4ff9640 10 client.4164.objecter ms_dispatch2 0x7f6ec8000b90 osd_map(11..11 src has 1..11) 2026-02-17T11:08:41.840 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.837+0000 7f6ec4ff9640 3 client.4164.objecter handle_osd_map got epochs [11,11] > 0 2026-02-17T11:08:41.840 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.837+0000 7f6ec4ff9640 3 client.4164.objecter handle_osd_map decoding full epoch 11 2026-02-17T11:08:41.840 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.837+0000 7f6ec4ff9640 20 client.4164.objecter dump_active .. 0 homeless 2026-02-17T11:08:41.840 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.838+0000 7f6ec4ff9640 1 -- 10.20.193.162:0/2464179942 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f6eb4086760 con 0x7f6ec8073590 2026-02-17T11:08:41.840 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.838+0000 7f6ec4ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:41.840 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.838+0000 7f6ec4ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:08:41.927 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.924+0000 7f6ece432640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "7dfbb00a-6b89-4de3-9f30-6aadd91b4408", "id": 9}] 2026-02-17T11:08:41.927 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.924+0000 7f6ece432640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "7dfbb00a-6b89-4de3-9f30-6aadd91b4408", "id": 9}] 2026-02-17T11:08:41.927 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.924+0000 7f6ece432640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:08:41.927 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.924+0000 7f6ece432640 1 -- 10.20.193.162:0/2464179942 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7dfbb00a-6b89-4de3-9f30-6aadd91b4408", "id": 9} v 0) -- 0x7f6ec8119a50 con 0x7f6ec8073590 2026-02-17T11:08:41.944 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.942+0000 7f6ec4ff9640 1 -- 10.20.193.162:0/2464179942 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7dfbb00a-6b89-4de3-9f30-6aadd91b4408", "id": 9}]=0 v12) ==== 112+0+2 (secure 0 0 0) 0x7f6eb408aa60 con 0x7f6ec8073590 2026-02-17T11:08:41.944 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.942+0000 7f6ec4ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "7dfbb00a-6b89-4de3-9f30-6aadd91b4408", "id": 9}] 2026-02-17T11:08:41.944 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.942+0000 7f6ec4ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:08:41.945 INFO:teuthology.orchestra.run.trial162.stdout:9 2026-02-17T11:08:41.946 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.943+0000 7f6ece432640 10 librados: watch_flush enter 2026-02-17T11:08:41.946 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.943+0000 7f6ece432640 10 librados: watch_flush exit 2026-02-17T11:08:41.946 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.943+0000 7f6ece432640 20 client.4164.objecter shutdown clearing up homeless session... 2026-02-17T11:08:41.946 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.943+0000 7f6ece432640 10 client.4164.objecter successfully canceled tick 2026-02-17T11:08:41.947 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.943+0000 7f6ece432640 1 -- 10.20.193.162:0/2464179942 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f6e98078fe0 msgr2=0x7f6e9807b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:41.947 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.943+0000 7f6ece432640 1 --2- 10.20.193.162:0/2464179942 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f6e98078fe0 0x7f6e9807b4a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6ec81b0fc0 tx=0x7f6eb8007f30 comp rx=0 tx=0).stop 2026-02-17T11:08:41.947 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.943+0000 7f6ece432640 10 monclient: shutdown 2026-02-17T11:08:41.947 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.943+0000 7f6ece432640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:08:41.947 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.943+0000 7f6ece432640 1 -- 10.20.193.162:0/2464179942 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f6ec8073590 msgr2=0x7f6ec81b1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:41.947 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.943+0000 7f6ece432640 1 --2- 10.20.193.162:0/2464179942 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f6ec8073590 0x7f6ec81b1430 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6ec8075310 tx=0x7f6eb40047c0 comp rx=0 tx=0).stop 2026-02-17T11:08:41.947 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.943+0000 7f6ece432640 1 -- 10.20.193.162:0/2464179942 shutdown_connections 2026-02-17T11:08:41.947 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.943+0000 7f6ece432640 1 --2- 10.20.193.162:0/2464179942 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f6e98078fe0 0x7f6e9807b4a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:41.947 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.943+0000 7f6ece432640 1 --2- 10.20.193.162:0/2464179942 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f6ec8120080 0x7f6ec81ab4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:41.947 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.943+0000 7f6ece432640 1 --2- 10.20.193.162:0/2464179942 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f6ec8073eb0 0x7f6ec81b1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:41.947 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.943+0000 7f6ece432640 1 --2- 10.20.193.162:0/2464179942 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f6ec8073590 0x7f6ec81b1430 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:41.947 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.943+0000 7f6ece432640 1 -- 10.20.193.162:0/2464179942 >> 10.20.193.162:0/2464179942 conn(0x7f6ec806f660 msgr2=0x7f6ec8071b50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:08:41.948 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.943+0000 7f6ece432640 1 -- 10.20.193.162:0/2464179942 shutdown_connections 2026-02-17T11:08:41.948 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.943+0000 7f6ece432640 1 -- 10.20.193.162:0/2464179942 wait complete. 2026-02-17T11:08:41.948 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:41.943+0000 7f6ece432640 1 librados: shutdown 2026-02-17T11:08:41.952 DEBUG:teuthology.orchestra.run.trial162:> sudo ceph --cluster ceph osd new e497a4fd-a944-489b-9cb3-30f5acaeb53e 10 2026-02-17T11:08:42.015 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.013+0000 7fe856d0a640 10 monclient: get_monmap_and_config 2026-02-17T11:08:42.015 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.013+0000 7fe856d0a640 10 monclient: build_initial_monmap 2026-02-17T11:08:42.015 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.013+0000 7fe856d0a640 10 monclient: monmap: 2026-02-17T11:08:42.015 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-17T11:08:42.015 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:42.015 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:08:42.015034+0000 2026-02-17T11:08:42.015 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:08:42.015034+0000 2026-02-17T11:08:42.015 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-17T11:08:42.015 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:42.015 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:08:42.015 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:08:42.015 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:08:42.015 INFO:teuthology.orchestra.run.trial162.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:08:42.015 INFO:teuthology.orchestra.run.trial162.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:08:42.016 INFO:teuthology.orchestra.run.trial162.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:08:42.016 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:42.016 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.013+0000 7fe856d0a640 1 Processor -- start 2026-02-17T11:08:42.016 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.013+0000 7fe856d0a640 1 -- start start 2026-02-17T11:08:42.016 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.013+0000 7fe856d0a640 10 monclient: init 2026-02-17T11:08:42.016 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.014+0000 7fe856d0a640 10 monclient: _reopen_session rank -1 2026-02-17T11:08:42.016 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.014+0000 7fe856d0a640 10 monclient: _add_conns ranks=[1,5,3,2,0,4] 2026-02-17T11:08:42.016 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.014+0000 7fe856d0a640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fe850073830 addr v1:10.20.193.97:6789/0 2026-02-17T11:08:42.016 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.014+0000 7fe856d0a640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7fe850073c10 0x7fe850124350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:42.016 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.014+0000 7fe856d0a640 10 monclient(hunting): picked mon.noname-c con 0x7fe850073c10 addr v2:10.20.193.157:3300/0 2026-02-17T11:08:42.016 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.014+0000 7fe856d0a640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fe850124890 0x7fe850126c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:42.016 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.014+0000 7fe856d0a640 10 monclient(hunting): picked mon.noname-a con 0x7fe850124890 addr v2:10.20.193.49:3300/0 2026-02-17T11:08:42.016 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.014+0000 7fe856d0a640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8501271c0 con 0x7fe850073830 2026-02-17T11:08:42.016 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.014+0000 7fe856d0a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:42.016 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.014+0000 7fe856d0a640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7fe8501283a0 con 0x7fe850124890 2026-02-17T11:08:42.016 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.014+0000 7fe856d0a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:42.016 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.014+0000 7fe856d0a640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7fe850128520 con 0x7fe850073c10 2026-02-17T11:08:42.016 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.014+0000 7fe856d0a640 10 monclient(hunting): _renew_subs 2026-02-17T11:08:42.016 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.014+0000 7fe856d0a640 10 monclient(hunting): authenticate will time out at 959.753105s 2026-02-17T11:08:42.017 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.014+0000 7fe847fff640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7fe850073c10 0x7fe850124350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:42.017 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.015+0000 7fe847fff640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7fe850073c10 0x7fe850124350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.162:47348/0 (socket says 10.20.193.162:47348) 2026-02-17T11:08:42.017 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.015+0000 7fe847fff640 1 -- 10.20.193.162:0/3002656365 learned_addr learned my addr 10.20.193.162:0/3002656365 (peer_addr_for_me v2:10.20.193.162:0/0) 2026-02-17T11:08:42.017 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.015+0000 7fe847fff640 10 monclient(hunting): get_auth_request con 0x7fe850073c10 auth_method 0 2026-02-17T11:08:42.017 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.015+0000 7fe847fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:42.017 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.015+0000 7fe847fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:42.017 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.015+0000 7fe847fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:42.017 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.015+0000 7fe855280640 1 --2- 10.20.193.162:0/3002656365 >> v2:10.20.193.49:3300/0 conn(0x7fe850124890 0x7fe850126c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:42.017 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.015+0000 7fe847fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:42.017 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.015+0000 7fe847fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:42.017 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.015+0000 7fe847fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:42.017 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.015+0000 7fe855280640 10 monclient(hunting): get_auth_request con 0x7fe850124890 auth_method 0 2026-02-17T11:08:42.017 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.015+0000 7fe855280640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:42.017 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.015+0000 7fe855280640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:42.018 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.015+0000 7fe855280640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:42.018 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.016+0000 7fe855280640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:42.018 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.016+0000 7fe855280640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:42.018 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.016+0000 7fe855280640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:42.018 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.016+0000 7fe847fff640 10 monclient(hunting): handle_auth_done global_id 4175 payload 274 2026-02-17T11:08:42.018 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.016+0000 7fe847fff640 1 -- 10.20.193.162:0/3002656365 >> v2:10.20.193.49:3300/0 conn(0x7fe850124890 msgr2=0x7fe850126c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:08:42.018 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.016+0000 7fe847fff640 1 --2- 10.20.193.162:0/3002656365 >> v2:10.20.193.49:3300/0 conn(0x7fe850124890 0x7fe850126c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:42.018 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.016+0000 7fe847fff640 1 -- 10.20.193.162:0/3002656365 >> v1:10.20.193.97:6789/0 conn(0x7fe850073830 legacy=0x7fe8501181d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:42.018 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.016+0000 7fe847fff640 10 monclient: _finish_hunting 0 2026-02-17T11:08:42.018 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.016+0000 7fe847fff640 1 monclient: found mon.noname-c 2026-02-17T11:08:42.018 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.016+0000 7fe847fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:08:42.019 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.016+0000 7fe847fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:08:42.019 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.016+0000 7fe847fff640 1 -- 10.20.193.162:0/3002656365 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8501286a0 con 0x7fe850073c10 2026-02-17T11:08:42.020 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.018+0000 7fe847fff640 1 --2- 10.20.193.162:0/3002656365 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe850073c10 0x7fe850124350 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe85006a420 tx=0x7fe83802ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58cad72076b93292 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:08:42.043 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.041+0000 7fe8477fe640 1 -- 10.20.193.162:0/3002656365 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe83803c070 con 0x7fe850073c10 2026-02-17T11:08:42.043 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.041+0000 7fe8477fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:42.043 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.041+0000 7fe8477fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:08:42.043 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.041+0000 7fe8477fe640 10 monclient: dump: 2026-02-17T11:08:42.043 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:42.043 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:42.043 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:42.043 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:42.043 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:42.043 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:42.043 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:42.043 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:42.043 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:42.043 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:42.043 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.041+0000 7fe8477fe640 10 monclient: _finish_auth 0 2026-02-17T11:08:42.043 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.041+0000 7fe8477fe640 10 monclient: _check_auth_tickets 2026-02-17T11:08:42.043 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.041+0000 7fe8477fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:08:42.043 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.041+0000 7fe8477fe640 1 -- 10.20.193.162:0/3002656365 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe83802fb30 con 0x7fe850073c10 2026-02-17T11:08:42.043 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.041+0000 7fe8477fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:08:42.044 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.041+0000 7fe856d0a640 5 monclient: authenticate success, global_id 4175 2026-02-17T11:08:42.044 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.041+0000 7fe8477fe640 1 -- 10.20.193.162:0/3002656365 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe838037440 con 0x7fe850073c10 2026-02-17T11:08:42.044 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.041+0000 7fe856d0a640 10 monclient: get_monmap_and_config success 2026-02-17T11:08:42.044 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.041+0000 7fe856d0a640 4 set_mon_vals no callback set 2026-02-17T11:08:42.044 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.041+0000 7fe8477fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:42.044 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.041+0000 7fe8477fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:08:42.044 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.041+0000 7fe8477fe640 10 monclient: dump: 2026-02-17T11:08:42.044 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:42.044 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:42.044 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:42.044 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:42.044 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:42.044 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:42.044 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:42.044 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:42.044 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:42.044 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:42.044 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.041+0000 7fe856d0a640 10 monclient: shutdown 2026-02-17T11:08:42.044 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.041+0000 7fe856d0a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:08:42.044 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.041+0000 7fe856d0a640 1 -- 10.20.193.162:0/3002656365 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe850073c10 msgr2=0x7fe850124350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:42.044 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.041+0000 7fe856d0a640 1 --2- 10.20.193.162:0/3002656365 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe850073c10 0x7fe850124350 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe85006a420 tx=0x7fe83802ee60 comp rx=0 tx=0).stop 2026-02-17T11:08:42.044 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.041+0000 7fe856d0a640 1 -- 10.20.193.162:0/3002656365 shutdown_connections 2026-02-17T11:08:42.044 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.041+0000 7fe856d0a640 1 --2- 10.20.193.162:0/3002656365 >> v2:10.20.193.49:3300/0 conn(0x7fe850124890 0x7fe850126c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:42.044 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.041+0000 7fe856d0a640 1 --2- 10.20.193.162:0/3002656365 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe850073c10 0x7fe850124350 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:42.044 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.041+0000 7fe856d0a640 1 -- 10.20.193.162:0/3002656365 >> 10.20.193.162:0/3002656365 conn(0x7fe85006f660 msgr2=0x7fe850071a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:08:42.044 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.041+0000 7fe856d0a640 1 -- 10.20.193.162:0/3002656365 shutdown_connections 2026-02-17T11:08:42.045 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.041+0000 7fe856d0a640 1 -- 10.20.193.162:0/3002656365 wait complete. 2026-02-17T11:08:42.046 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.041+0000 7fe856d0a640 10 monclient: build_initial_monmap 2026-02-17T11:08:42.046 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.041+0000 7fe856d0a640 10 monclient: monmap: 2026-02-17T11:08:42.046 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-17T11:08:42.046 INFO:teuthology.orchestra.run.trial162.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:08:42.046 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 0.000000 2026-02-17T11:08:42.046 INFO:teuthology.orchestra.run.trial162.stderr:created 0.000000 2026-02-17T11:08:42.046 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-17T11:08:42.046 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:42.046 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:08:42.046 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:08:42.046 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:08:42.046 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:42.046 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.041+0000 7fe856d0a640 1 librados: starting msgr at 2026-02-17T11:08:42.046 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.041+0000 7fe856d0a640 1 librados: starting objecter 2026-02-17T11:08:42.046 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.041+0000 7fe856d0a640 1 Processor -- start 2026-02-17T11:08:42.046 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.041+0000 7fe856d0a640 1 -- start start 2026-02-17T11:08:42.046 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.041+0000 7fe856d0a640 1 librados: setting wanted keys 2026-02-17T11:08:42.047 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.041+0000 7fe856d0a640 1 librados: calling monclient init 2026-02-17T11:08:42.047 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.041+0000 7fe856d0a640 10 monclient: init 2026-02-17T11:08:42.047 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.041+0000 7fe856d0a640 10 monclient: _reopen_session rank -1 2026-02-17T11:08:42.047 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.041+0000 7fe856d0a640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:08:42.047 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.041+0000 7fe856d0a640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe850073830 0x7fe8501afd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:42.047 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.041+0000 7fe856d0a640 10 monclient(hunting): picked mon.noname-b con 0x7fe850073830 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:08:42.047 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.041+0000 7fe856d0a640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe850073c10 0x7fe8501b03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:42.047 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.041+0000 7fe856d0a640 10 monclient(hunting): picked mon.noname-c con 0x7fe850073c10 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:08:42.047 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.041+0000 7fe856d0a640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe850124890 0x7fe8501b4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:42.047 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.041+0000 7fe856d0a640 10 monclient(hunting): picked mon.noname-a con 0x7fe850124890 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:08:42.047 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.041+0000 7fe856d0a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:42.047 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.041+0000 7fe856d0a640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe850127810 con 0x7fe850124890 2026-02-17T11:08:42.047 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.041+0000 7fe856d0a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:42.047 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.041+0000 7fe856d0a640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe850127690 con 0x7fe850073830 2026-02-17T11:08:42.047 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.041+0000 7fe856d0a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:42.047 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.041+0000 7fe856d0a640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe850127990 con 0x7fe850073c10 2026-02-17T11:08:42.047 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.041+0000 7fe856d0a640 10 monclient(hunting): _renew_subs 2026-02-17T11:08:42.047 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.041+0000 7fe856d0a640 10 monclient(hunting): authenticate will time out at 959.780890s 2026-02-17T11:08:42.047 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.042+0000 7fe847fff640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe850073c10 0x7fe8501b03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:42.047 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.042+0000 7fe847fff640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe850073c10 0x7fe8501b03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.162:47352/0 (socket says 10.20.193.162:47352) 2026-02-17T11:08:42.047 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.042+0000 7fe847fff640 1 -- 10.20.193.162:0/1777160912 learned_addr learned my addr 10.20.193.162:0/1777160912 (peer_addr_for_me v2:10.20.193.162:0/0) 2026-02-17T11:08:42.047 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.042+0000 7fe847fff640 10 monclient(hunting): get_auth_request con 0x7fe850073c10 auth_method 0 2026-02-17T11:08:42.047 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.042+0000 7fe847fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:42.047 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.042+0000 7fe847fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:42.047 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.042+0000 7fe847fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:42.047 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.042+0000 7fe847fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:42.047 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.042+0000 7fe847fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:42.047 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.042+0000 7fe847fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:42.048 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.043+0000 7fe847fff640 10 monclient(hunting): handle_auth_done global_id 4178 payload 824 2026-02-17T11:08:42.048 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.043+0000 7fe847fff640 1 -- 10.20.193.162:0/1777160912 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe850073830 msgr2=0x7fe8501afd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:42.048 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.043+0000 7fe847fff640 1 --2- 10.20.193.162:0/1777160912 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe850073830 0x7fe8501afd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:42.048 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.043+0000 7fe847fff640 1 -- 10.20.193.162:0/1777160912 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe850124890 msgr2=0x7fe8501b4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:42.048 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.043+0000 7fe847fff640 1 --2- 10.20.193.162:0/1777160912 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe850124890 0x7fe8501b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:42.048 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.043+0000 7fe847fff640 10 monclient: _finish_hunting 0 2026-02-17T11:08:42.048 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.043+0000 7fe847fff640 1 monclient: found mon.noname-c 2026-02-17T11:08:42.048 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.043+0000 7fe847fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:08:42.048 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.043+0000 7fe847fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:08:42.048 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.043+0000 7fe847fff640 1 -- 10.20.193.162:0/1777160912 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8501b4d40 con 0x7fe850073c10 2026-02-17T11:08:42.049 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.044+0000 7fe847fff640 1 --2- 10.20.193.162:0/1777160912 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe850073c10 0x7fe8501b03e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe838009a70 tx=0x7fe8380047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:08:42.049 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.044+0000 7fe8457fa640 10 client.?.objecter ms_handle_connect 0x7fe850073c10 2026-02-17T11:08:42.049 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.044+0000 7fe8457fa640 10 client.?.objecter resend_mon_ops 2026-02-17T11:08:42.049 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.046+0000 7fe8457fa640 1 -- 10.20.193.162:0/1777160912 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe83803c040 con 0x7fe850073c10 2026-02-17T11:08:42.049 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.046+0000 7fe8457fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:42.049 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.046+0000 7fe8457fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:08:42.049 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.046+0000 7fe8457fa640 10 monclient: dump: 2026-02-17T11:08:42.049 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:42.049 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:42.049 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:42.049 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:42.049 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:42.049 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:42.049 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:42.049 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:42.049 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:42.049 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:42.049 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.046+0000 7fe8457fa640 10 monclient: _finish_auth 0 2026-02-17T11:08:42.049 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.046+0000 7fe8457fa640 10 monclient: _check_auth_tickets 2026-02-17T11:08:42.049 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.046+0000 7fe8457fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:08:42.049 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.046+0000 7fe856d0a640 5 monclient: authenticate success, global_id 4178 2026-02-17T11:08:42.049 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.046+0000 7fe856d0a640 10 monclient: _renew_subs 2026-02-17T11:08:42.049 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.046+0000 7fe856d0a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:08:42.049 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.046+0000 7fe856d0a640 1 -- 10.20.193.162:0/1777160912 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8501b4fd0 con 0x7fe850073c10 2026-02-17T11:08:42.049 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.046+0000 7fe856d0a640 10 client.4178.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:08:42.049 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.046+0000 7fe856d0a640 10 monclient: _renew_subs 2026-02-17T11:08:42.049 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.046+0000 7fe856d0a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:08:42.050 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.046+0000 7fe856d0a640 1 -- 10.20.193.162:0/1777160912 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8501bc7b0 con 0x7fe850073c10 2026-02-17T11:08:42.050 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.046+0000 7fe856d0a640 1 librados: init done 2026-02-17T11:08:42.050 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.046+0000 7fe8457fa640 1 -- 10.20.193.162:0/1777160912 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe83802f9f0 con 0x7fe850073c10 2026-02-17T11:08:42.050 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.046+0000 7fe8457fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:08:42.050 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.046+0000 7fe8457fa640 1 -- 10.20.193.162:0/1777160912 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe838042830 con 0x7fe850073c10 2026-02-17T11:08:42.050 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.046+0000 7fe8457fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:42.050 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.046+0000 7fe846ffd640 4 set_mon_vals no callback set 2026-02-17T11:08:42.050 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.046+0000 7fe8457fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:08:42.050 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.046+0000 7fe8457fa640 10 monclient: dump: 2026-02-17T11:08:42.050 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:42.050 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:42.050 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:42.050 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:42.050 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:42.050 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:42.050 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:42.050 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:42.050 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:42.050 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:42.050 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.046+0000 7fe856d0a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:42.050 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.046+0000 7fe856d0a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:42.050 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.046+0000 7fe856d0a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:08:42.050 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.046+0000 7fe856d0a640 1 -- 10.20.193.162:0/1777160912 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe850127d50 con 0x7fe850073c10 2026-02-17T11:08:42.060 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.058+0000 7fe8457fa640 1 -- 10.20.193.162:0/1777160912 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 3) ==== 99895+0+0 (secure 0 0 0) 0x7fe83802fce0 con 0x7fe850073c10 2026-02-17T11:08:42.061 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.059+0000 7fe8457fa640 1 --2- 10.20.193.162:0/1777160912 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fe820078f90 0x7fe82007b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:42.061 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.059+0000 7fe854a7f640 1 --2- 10.20.193.162:0/1777160912 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fe820078f90 0x7fe82007b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:42.061 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.059+0000 7fe854a7f640 10 monclient: get_auth_request con 0x7fe820078f90 auth_method 0 2026-02-17T11:08:42.061 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.059+0000 7fe854a7f640 1 --2- 10.20.193.162:0/1777160912 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fe820078f90 0x7fe82007b450 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe840002f00 tx=0x7fe840007a70 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:08:42.061 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.059+0000 7fe8457fa640 10 client.4178.objecter ms_handle_connect 0x7fe820078f90 2026-02-17T11:08:42.062 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.060+0000 7fe8457fa640 1 -- 10.20.193.162:0/1777160912 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 1875+0+0 (secure 0 0 0) 0x7fe8380836c0 con 0x7fe850073c10 2026-02-17T11:08:42.062 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.060+0000 7fe8457fa640 10 client.4178.objecter ms_dispatch2 0x7fe850000b90 osd_map(12..12 src has 1..12) 2026-02-17T11:08:42.062 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.060+0000 7fe8457fa640 3 client.4178.objecter handle_osd_map got epochs [12,12] > 0 2026-02-17T11:08:42.062 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.060+0000 7fe8457fa640 3 client.4178.objecter handle_osd_map decoding full epoch 12 2026-02-17T11:08:42.062 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.060+0000 7fe8457fa640 20 client.4178.objecter dump_active .. 0 homeless 2026-02-17T11:08:42.164 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.162+0000 7fe8457fa640 1 -- 10.20.193.162:0/1777160912 <== mon.2 v2:10.20.193.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe838035340 con 0x7fe850073c10 2026-02-17T11:08:42.164 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.162+0000 7fe8457fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:42.165 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.162+0000 7fe8457fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:08:42.251 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.249+0000 7fe856d0a640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "e497a4fd-a944-489b-9cb3-30f5acaeb53e", "id": 10}] 2026-02-17T11:08:42.251 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.249+0000 7fe856d0a640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "e497a4fd-a944-489b-9cb3-30f5acaeb53e", "id": 10}] 2026-02-17T11:08:42.252 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.249+0000 7fe856d0a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:08:42.252 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.249+0000 7fe856d0a640 1 -- 10.20.193.162:0/1777160912 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e497a4fd-a944-489b-9cb3-30f5acaeb53e", "id": 10} v 0) -- 0x7fe8501bc980 con 0x7fe850073c10 2026-02-17T11:08:42.300 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.298+0000 7fe8457fa640 1 -- 10.20.193.162:0/1777160912 <== mon.2 v2:10.20.193.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e497a4fd-a944-489b-9cb3-30f5acaeb53e", "id": 10}]=0 v13) ==== 113+0+3 (secure 0 0 0) 0x7fe838087d80 con 0x7fe850073c10 2026-02-17T11:08:42.300 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.298+0000 7fe8457fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "e497a4fd-a944-489b-9cb3-30f5acaeb53e", "id": 10}] 2026-02-17T11:08:42.300 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.298+0000 7fe8457fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:08:42.300 INFO:teuthology.orchestra.run.trial162.stdout:10 2026-02-17T11:08:42.302 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.298+0000 7fe856d0a640 10 librados: watch_flush enter 2026-02-17T11:08:42.302 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.298+0000 7fe856d0a640 10 librados: watch_flush exit 2026-02-17T11:08:42.302 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.298+0000 7fe856d0a640 20 client.4178.objecter shutdown clearing up homeless session... 2026-02-17T11:08:42.302 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.298+0000 7fe856d0a640 10 client.4178.objecter successfully canceled tick 2026-02-17T11:08:42.302 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.298+0000 7fe856d0a640 1 -- 10.20.193.162:0/1777160912 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fe820078f90 msgr2=0x7fe82007b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:42.303 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.298+0000 7fe856d0a640 1 --2- 10.20.193.162:0/1777160912 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fe820078f90 0x7fe82007b450 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe840002f00 tx=0x7fe840007a70 comp rx=0 tx=0).stop 2026-02-17T11:08:42.303 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.298+0000 7fe856d0a640 10 monclient: shutdown 2026-02-17T11:08:42.303 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.298+0000 7fe856d0a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:08:42.303 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.298+0000 7fe856d0a640 1 -- 10.20.193.162:0/1777160912 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe850073c10 msgr2=0x7fe8501b03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:42.303 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.298+0000 7fe856d0a640 1 --2- 10.20.193.162:0/1777160912 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe850073c10 0x7fe8501b03e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe838009a70 tx=0x7fe8380047c0 comp rx=0 tx=0).stop 2026-02-17T11:08:42.303 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.298+0000 7fe856d0a640 1 -- 10.20.193.162:0/1777160912 shutdown_connections 2026-02-17T11:08:42.303 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.298+0000 7fe856d0a640 1 --2- 10.20.193.162:0/1777160912 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fe820078f90 0x7fe82007b450 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:42.303 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.298+0000 7fe856d0a640 1 --2- 10.20.193.162:0/1777160912 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe850124890 0x7fe8501b4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:42.303 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.298+0000 7fe856d0a640 1 --2- 10.20.193.162:0/1777160912 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe850073c10 0x7fe8501b03e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:42.303 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.298+0000 7fe856d0a640 1 --2- 10.20.193.162:0/1777160912 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe850073830 0x7fe8501afd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:42.303 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.298+0000 7fe856d0a640 1 -- 10.20.193.162:0/1777160912 >> 10.20.193.162:0/1777160912 conn(0x7fe85006f660 msgr2=0x7fe850121af0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:08:42.304 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.298+0000 7fe856d0a640 1 -- 10.20.193.162:0/1777160912 shutdown_connections 2026-02-17T11:08:42.304 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.298+0000 7fe856d0a640 1 -- 10.20.193.162:0/1777160912 wait complete. 2026-02-17T11:08:42.304 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.298+0000 7fe856d0a640 1 librados: shutdown 2026-02-17T11:08:42.308 DEBUG:teuthology.orchestra.run.trial162:> sudo ceph --cluster ceph osd new 7371d50f-36f9-477d-8d4d-853f481dd6db 11 2026-02-17T11:08:42.373 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.369+0000 7f76b30fa640 10 monclient: get_monmap_and_config 2026-02-17T11:08:42.373 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.369+0000 7f76b30fa640 10 monclient: build_initial_monmap 2026-02-17T11:08:42.373 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.369+0000 7f76b30fa640 10 monclient: monmap: 2026-02-17T11:08:42.373 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-17T11:08:42.373 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:42.373 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:08:42.370708+0000 2026-02-17T11:08:42.373 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:08:42.370708+0000 2026-02-17T11:08:42.374 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-17T11:08:42.374 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:42.374 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:08:42.374 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:08:42.374 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:08:42.374 INFO:teuthology.orchestra.run.trial162.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:08:42.374 INFO:teuthology.orchestra.run.trial162.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:08:42.374 INFO:teuthology.orchestra.run.trial162.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:08:42.374 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:42.374 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.369+0000 7f76b30fa640 1 Processor -- start 2026-02-17T11:08:42.374 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.369+0000 7f76b30fa640 1 -- start start 2026-02-17T11:08:42.375 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.369+0000 7f76b30fa640 10 monclient: init 2026-02-17T11:08:42.375 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.369+0000 7f76b30fa640 10 monclient: _reopen_session rank -1 2026-02-17T11:08:42.375 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.369+0000 7f76b30fa640 10 monclient: _add_conns ranks=[0,2,4,1,5,3] 2026-02-17T11:08:42.375 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.369+0000 7f76b30fa640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f76ac1123f0 addr v1:10.20.193.49:6789/0 2026-02-17T11:08:42.375 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.369+0000 7f76b30fa640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f76ac11a2d0 addr v1:10.20.193.157:6789/0 2026-02-17T11:08:42.375 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.369+0000 7f76b30fa640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f76ac11dde0 0x7f76ac120230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:42.375 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.369+0000 7f76b30fa640 10 monclient(hunting): picked mon.noname-b con 0x7f76ac11dde0 addr v2:10.20.193.97:3300/0 2026-02-17T11:08:42.375 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.369+0000 7f76b30fa640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76ac120950 con 0x7f76ac1123f0 2026-02-17T11:08:42.375 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.369+0000 7f76b30fa640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76ac121b70 con 0x7f76ac11a2d0 2026-02-17T11:08:42.375 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.369+0000 7f76b30fa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:42.375 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.369+0000 7f76b30fa640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f76ac122d70 con 0x7f76ac11dde0 2026-02-17T11:08:42.375 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.369+0000 7f76b30fa640 10 monclient(hunting): _renew_subs 2026-02-17T11:08:42.376 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.369+0000 7f76b30fa640 10 monclient(hunting): authenticate will time out at 960.108764s 2026-02-17T11:08:42.376 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.370+0000 7f76b0e6f640 1 --1- >> v1:10.20.193.49:6789/0 conn(0x7f76ac1123f0 0x7f76ac1127d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.49:6789/0 says I am v1:10.20.193.162:48976/0 (socket says 10.20.193.162:48976) 2026-02-17T11:08:42.376 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.370+0000 7f76b0e6f640 1 -- 10.20.193.162:0/953457757 learned_addr learned my addr 10.20.193.162:0/953457757 (peer_addr_for_me v1:10.20.193.162:0/0) 2026-02-17T11:08:42.376 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.370+0000 7f76b1670640 1 --2- 10.20.193.162:0/953457757 >> v2:10.20.193.97:3300/0 conn(0x7f76ac11dde0 0x7f76ac120230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:42.376 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.370+0000 7f76b1670640 10 monclient(hunting): get_auth_request con 0x7f76ac11dde0 auth_method 0 2026-02-17T11:08:42.376 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.370+0000 7f76b1670640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:42.376 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.370+0000 7f76b1670640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:42.376 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.370+0000 7f76b1670640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:42.376 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.370+0000 7f76b1670640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:42.376 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.370+0000 7f76b1670640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:42.376 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.370+0000 7f76b1670640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:42.384 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.371+0000 7f76b1670640 10 monclient(hunting): handle_auth_done global_id 4165 payload 274 2026-02-17T11:08:42.384 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.371+0000 7f76b1670640 1 -- 10.20.193.162:0/953457757 >> v1:10.20.193.157:6789/0 conn(0x7f76ac11a2d0 legacy=0x7f76ac11c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:42.384 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.371+0000 7f76b1670640 1 -- 10.20.193.162:0/953457757 >> v1:10.20.193.49:6789/0 conn(0x7f76ac1123f0 legacy=0x7f76ac1127d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:42.384 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.371+0000 7f76b1670640 10 monclient: _finish_hunting 0 2026-02-17T11:08:42.384 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.371+0000 7f76b1670640 1 monclient: found mon.noname-b 2026-02-17T11:08:42.384 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.371+0000 7f76b1670640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:08:42.384 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.371+0000 7f76b1670640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:08:42.384 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.371+0000 7f76b1670640 1 -- 10.20.193.162:0/953457757 --> v2:10.20.193.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76ac122ef0 con 0x7f76ac11dde0 2026-02-17T11:08:42.384 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.372+0000 7f76b1670640 1 --2- 10.20.193.162:0/953457757 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f76ac11dde0 0x7f76ac120230 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f76a8009d90 tx=0x7f76a8031470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1caa7b0f8640e009 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:08:42.384 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.374+0000 7f76a37fe640 1 -- 10.20.193.162:0/953457757 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76a8007740 con 0x7f76ac11dde0 2026-02-17T11:08:42.385 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.374+0000 7f76a37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:42.385 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.374+0000 7f76a37fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:08:42.385 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.374+0000 7f76a37fe640 10 monclient: dump: 2026-02-17T11:08:42.385 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:42.385 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:42.385 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:42.385 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:42.385 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:42.385 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:42.385 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:42.385 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:42.385 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:42.386 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:42.386 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.374+0000 7f76a37fe640 10 monclient: _finish_auth 0 2026-02-17T11:08:42.386 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.374+0000 7f76a37fe640 10 monclient: _check_auth_tickets 2026-02-17T11:08:42.386 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.374+0000 7f76a37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:08:42.386 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.374+0000 7f76a37fe640 1 -- 10.20.193.162:0/953457757 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76a80078e0 con 0x7f76ac11dde0 2026-02-17T11:08:42.386 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.374+0000 7f76b30fa640 5 monclient: authenticate success, global_id 4165 2026-02-17T11:08:42.386 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.374+0000 7f76b30fa640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:08:42.386 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.374+0000 7f76a37fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:08:42.386 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.374+0000 7f76a37fe640 1 -- 10.20.193.162:0/953457757 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76a8007cb0 con 0x7f76ac11dde0 2026-02-17T11:08:42.386 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.374+0000 7f76b30fa640 10 monclient: get_monmap_and_config success 2026-02-17T11:08:42.386 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.374+0000 7f76a37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:42.387 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.374+0000 7f76b30fa640 4 set_mon_vals no callback set 2026-02-17T11:08:42.387 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.374+0000 7f76a37fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:08:42.387 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.374+0000 7f76a37fe640 10 monclient: dump: 2026-02-17T11:08:42.387 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:42.387 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:42.387 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:42.387 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:42.387 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:42.387 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:42.387 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:42.387 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:42.387 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:42.387 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:42.388 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.374+0000 7f76b30fa640 10 monclient: shutdown 2026-02-17T11:08:42.388 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.374+0000 7f76b30fa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:08:42.388 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.374+0000 7f76b30fa640 1 -- 10.20.193.162:0/953457757 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f76ac11dde0 msgr2=0x7f76ac120230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:42.388 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.374+0000 7f76b30fa640 1 --2- 10.20.193.162:0/953457757 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f76ac11dde0 0x7f76ac120230 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f76a8009d90 tx=0x7f76a8031470 comp rx=0 tx=0).stop 2026-02-17T11:08:42.388 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.374+0000 7f76b30fa640 1 -- 10.20.193.162:0/953457757 shutdown_connections 2026-02-17T11:08:42.388 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.374+0000 7f76b30fa640 1 --2- 10.20.193.162:0/953457757 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f76ac11dde0 0x7f76ac120230 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:42.388 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.374+0000 7f76b30fa640 1 -- 10.20.193.162:0/953457757 >> 10.20.193.162:0/953457757 conn(0x7f76ac06f660 msgr2=0x7f76ac071a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:08:42.388 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.374+0000 7f76b30fa640 1 -- 10.20.193.162:0/953457757 shutdown_connections 2026-02-17T11:08:42.388 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.374+0000 7f76b30fa640 1 -- 10.20.193.162:0/953457757 wait complete. 2026-02-17T11:08:42.388 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.374+0000 7f76b30fa640 10 monclient: build_initial_monmap 2026-02-17T11:08:42.388 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.374+0000 7f76b30fa640 10 monclient: monmap: 2026-02-17T11:08:42.388 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-17T11:08:42.389 INFO:teuthology.orchestra.run.trial162.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:08:42.389 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 0.000000 2026-02-17T11:08:42.389 INFO:teuthology.orchestra.run.trial162.stderr:created 0.000000 2026-02-17T11:08:42.389 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-17T11:08:42.389 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:42.389 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:08:42.389 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:08:42.389 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:08:42.389 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:42.389 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.375+0000 7f76b30fa640 1 librados: starting msgr at 2026-02-17T11:08:42.389 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.375+0000 7f76b30fa640 1 librados: starting objecter 2026-02-17T11:08:42.390 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.375+0000 7f76b30fa640 1 Processor -- start 2026-02-17T11:08:42.390 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.375+0000 7f76b30fa640 1 -- start start 2026-02-17T11:08:42.390 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.375+0000 7f76b30fa640 1 librados: setting wanted keys 2026-02-17T11:08:42.390 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.375+0000 7f76b30fa640 1 librados: calling monclient init 2026-02-17T11:08:42.390 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.375+0000 7f76b30fa640 10 monclient: init 2026-02-17T11:08:42.390 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.375+0000 7f76b30fa640 10 monclient: _reopen_session rank -1 2026-02-17T11:08:42.390 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.375+0000 7f76b30fa640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:08:42.390 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.375+0000 7f76b30fa640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f76ac1123f0 0x7f76ac1194c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:42.390 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.375+0000 7f76b30fa640 10 monclient(hunting): picked mon.noname-a con 0x7f76ac1123f0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:08:42.390 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.375+0000 7f76b30fa640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f76ac11a2d0 0x7f76ac119b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:42.390 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.375+0000 7f76b30fa640 10 monclient(hunting): picked mon.noname-b con 0x7f76ac11a2d0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:08:42.390 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.375+0000 7f76b30fa640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f76ac11dde0 0x7f76ac1176b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:42.391 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.375+0000 7f76b30fa640 10 monclient(hunting): picked mon.noname-c con 0x7f76ac11dde0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:08:42.391 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.375+0000 7f76b30fa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:42.391 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.375+0000 7f76b30fa640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f76ac122200 con 0x7f76ac1123f0 2026-02-17T11:08:42.391 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.375+0000 7f76b30fa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:42.391 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.375+0000 7f76b30fa640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f76ac122080 con 0x7f76ac11a2d0 2026-02-17T11:08:42.391 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.375+0000 7f76b30fa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:42.391 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.375+0000 7f76b30fa640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f76ac122380 con 0x7f76ac11dde0 2026-02-17T11:08:42.391 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.375+0000 7f76b30fa640 10 monclient(hunting): _renew_subs 2026-02-17T11:08:42.391 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.375+0000 7f76b30fa640 10 monclient(hunting): authenticate will time out at 960.114376s 2026-02-17T11:08:42.391 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.375+0000 7f76b1670640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f76ac11dde0 0x7f76ac1176b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:42.391 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.375+0000 7f76b0e6f640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f76ac1123f0 0x7f76ac1194c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:42.391 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.375+0000 7f76a3fff640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f76ac11a2d0 0x7f76ac119b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:42.392 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.375+0000 7f76b1670640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f76ac11dde0 0x7f76ac1176b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.162:47356/0 (socket says 10.20.193.162:47356) 2026-02-17T11:08:42.392 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.375+0000 7f76b1670640 1 -- 10.20.193.162:0/2456091587 learned_addr learned my addr 10.20.193.162:0/2456091587 (peer_addr_for_me v2:10.20.193.162:0/0) 2026-02-17T11:08:42.392 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.375+0000 7f76b1670640 10 monclient(hunting): get_auth_request con 0x7f76ac11dde0 auth_method 0 2026-02-17T11:08:42.392 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.375+0000 7f76b1670640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:42.392 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.375+0000 7f76b1670640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:42.392 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.375+0000 7f76b1670640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:42.392 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.375+0000 7f76b0e6f640 10 monclient(hunting): get_auth_request con 0x7f76ac1123f0 auth_method 0 2026-02-17T11:08:42.392 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.375+0000 7f76b0e6f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:42.392 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.375+0000 7f76b0e6f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:42.392 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.375+0000 7f76b0e6f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:42.392 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.376+0000 7f76a3fff640 10 monclient(hunting): get_auth_request con 0x7f76ac11a2d0 auth_method 0 2026-02-17T11:08:42.392 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.376+0000 7f76a3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:42.393 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.376+0000 7f76a3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:42.393 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.376+0000 7f76a3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:42.393 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.376+0000 7f76b1670640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:42.393 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.376+0000 7f76b1670640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:42.393 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.376+0000 7f76b1670640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:42.393 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.376+0000 7f76a3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:42.393 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.376+0000 7f76a3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:42.393 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.376+0000 7f76a3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:42.393 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.376+0000 7f76b0e6f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:42.393 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.376+0000 7f76b0e6f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:42.393 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.376+0000 7f76b0e6f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:42.393 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.377+0000 7f76a3fff640 10 monclient(hunting): handle_auth_done global_id 4168 payload 824 2026-02-17T11:08:42.393 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.377+0000 7f76a3fff640 1 -- 10.20.193.162:0/2456091587 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f76ac11dde0 msgr2=0x7f76ac1176b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:42.394 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.377+0000 7f76a3fff640 1 --2- 10.20.193.162:0/2456091587 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f76ac11dde0 0x7f76ac1176b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:42.394 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.377+0000 7f76a3fff640 1 -- 10.20.193.162:0/2456091587 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f76ac1123f0 msgr2=0x7f76ac1194c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:42.394 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.377+0000 7f76a3fff640 1 --2- 10.20.193.162:0/2456091587 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f76ac1123f0 0x7f76ac1194c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:42.394 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.377+0000 7f76a3fff640 10 monclient: _finish_hunting 0 2026-02-17T11:08:42.394 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.377+0000 7f76a3fff640 1 monclient: found mon.noname-b 2026-02-17T11:08:42.394 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.377+0000 7f76a3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:08:42.394 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.377+0000 7f76a3fff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:08:42.394 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.377+0000 7f76a3fff640 1 -- 10.20.193.162:0/2456091587 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76ac117f70 con 0x7f76ac11a2d0 2026-02-17T11:08:42.394 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.378+0000 7f76a3fff640 1 --2- 10.20.193.162:0/2456091587 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f76ac11a2d0 0x7f76ac119b30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f76ac06a440 tx=0x7f769400c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:08:42.394 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.378+0000 7f76a17fa640 10 client.?.objecter ms_handle_connect 0x7f76ac11a2d0 2026-02-17T11:08:42.394 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.378+0000 7f76a17fa640 10 client.?.objecter resend_mon_ops 2026-02-17T11:08:42.394 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.379+0000 7f76a17fa640 1 -- 10.20.193.162:0/2456091587 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7694016020 con 0x7f76ac11a2d0 2026-02-17T11:08:42.395 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.379+0000 7f76a17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:42.395 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.379+0000 7f76a17fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:08:42.395 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.379+0000 7f76a17fa640 10 monclient: dump: 2026-02-17T11:08:42.395 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:42.395 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:42.395 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:42.395 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:42.395 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:42.395 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:42.395 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:42.395 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:42.395 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:42.396 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:42.396 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.379+0000 7f76a17fa640 10 monclient: _finish_auth 0 2026-02-17T11:08:42.396 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.379+0000 7f76a17fa640 10 monclient: _check_auth_tickets 2026-02-17T11:08:42.396 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.379+0000 7f76a17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:08:42.396 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.379+0000 7f76b30fa640 5 monclient: authenticate success, global_id 4168 2026-02-17T11:08:42.396 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.379+0000 7f76b30fa640 10 monclient: _renew_subs 2026-02-17T11:08:42.396 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.379+0000 7f76b30fa640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:08:42.396 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.379+0000 7f76b30fa640 1 -- 10.20.193.162:0/2456091587 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76ac118200 con 0x7f76ac11a2d0 2026-02-17T11:08:42.396 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.379+0000 7f76b30fa640 10 client.4168.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:08:42.396 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.379+0000 7f76b30fa640 10 monclient: _renew_subs 2026-02-17T11:08:42.396 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.379+0000 7f76b30fa640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:08:42.396 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.379+0000 7f76b30fa640 1 -- 10.20.193.162:0/2456091587 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76ac1b8530 con 0x7f76ac11a2d0 2026-02-17T11:08:42.396 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.379+0000 7f76b30fa640 1 librados: init done 2026-02-17T11:08:42.397 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.379+0000 7f76b30fa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:42.397 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.379+0000 7f76b30fa640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:42.397 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.379+0000 7f76b30fa640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:08:42.397 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.379+0000 7f76b30fa640 1 -- 10.20.193.162:0/2456091587 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76ac122810 con 0x7f76ac11a2d0 2026-02-17T11:08:42.397 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.380+0000 7f76a17fa640 1 -- 10.20.193.162:0/2456091587 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76940052d0 con 0x7f76ac11a2d0 2026-02-17T11:08:42.397 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.380+0000 7f76a17fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:08:42.397 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.380+0000 7f76a17fa640 1 -- 10.20.193.162:0/2456091587 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76940068d0 con 0x7f76ac11a2d0 2026-02-17T11:08:42.397 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.380+0000 7f76a17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:42.397 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.380+0000 7f76a17fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:08:42.397 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.380+0000 7f76a2ffd640 4 set_mon_vals no callback set 2026-02-17T11:08:42.397 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.380+0000 7f76a17fa640 10 monclient: dump: 2026-02-17T11:08:42.397 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:42.398 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:42.398 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:42.398 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:42.398 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:42.398 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:42.398 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:42.398 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:42.398 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:42.398 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:42.486 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.484+0000 7f76a17fa640 1 -- 10.20.193.162:0/2456091587 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 3) ==== 99895+0+0 (secure 0 0 0) 0x7f7694023070 con 0x7f76ac11a2d0 2026-02-17T11:08:42.488 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.485+0000 7f76a17fa640 1 --2- 10.20.193.162:0/2456091587 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f767c078f90 0x7f767c07b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:42.488 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.485+0000 7f76b0e6f640 1 --2- 10.20.193.162:0/2456091587 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f767c078f90 0x7f767c07b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:42.488 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.485+0000 7f76b0e6f640 10 monclient: get_auth_request con 0x7f767c078f90 auth_method 0 2026-02-17T11:08:42.488 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.485+0000 7f76b0e6f640 1 --2- 10.20.193.162:0/2456091587 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f767c078f90 0x7f767c07b450 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f769c002770 tx=0x7f769c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:08:42.488 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.485+0000 7f76a17fa640 10 client.4168.objecter ms_handle_connect 0x7f767c078f90 2026-02-17T11:08:42.488 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.485+0000 7f76a17fa640 1 -- 10.20.193.162:0/2456091587 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 1990+0+0 (secure 0 0 0) 0x7f769405dab0 con 0x7f76ac11a2d0 2026-02-17T11:08:42.488 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.485+0000 7f76a17fa640 10 client.4168.objecter ms_dispatch2 0x7f76ac000b90 osd_map(13..13 src has 1..13) 2026-02-17T11:08:42.488 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.485+0000 7f76a17fa640 3 client.4168.objecter handle_osd_map got epochs [13,13] > 0 2026-02-17T11:08:42.489 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.485+0000 7f76a17fa640 3 client.4168.objecter handle_osd_map decoding full epoch 13 2026-02-17T11:08:42.489 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.485+0000 7f76a17fa640 20 client.4168.objecter dump_active .. 0 homeless 2026-02-17T11:08:42.494 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.492+0000 7f76a17fa640 1 -- 10.20.193.162:0/2456091587 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f7694020020 con 0x7f76ac11a2d0 2026-02-17T11:08:42.494 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.492+0000 7f76a17fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:42.494 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.492+0000 7f76a17fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:08:42.584 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.582+0000 7f76b30fa640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "7371d50f-36f9-477d-8d4d-853f481dd6db", "id": 11}] 2026-02-17T11:08:42.584 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.582+0000 7f76b30fa640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "7371d50f-36f9-477d-8d4d-853f481dd6db", "id": 11}] 2026-02-17T11:08:42.584 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.582+0000 7f76b30fa640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:08:42.584 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.582+0000 7f76b30fa640 1 -- 10.20.193.162:0/2456091587 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7371d50f-36f9-477d-8d4d-853f481dd6db", "id": 11} v 0) -- 0x7f76ac070bc0 con 0x7f76ac11a2d0 2026-02-17T11:08:42.631 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.629+0000 7f76a17fa640 1 -- 10.20.193.162:0/2456091587 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7371d50f-36f9-477d-8d4d-853f481dd6db", "id": 11}]=0 v14) ==== 113+0+3 (secure 0 0 0) 0x7f76ac070bc0 con 0x7f76ac11a2d0 2026-02-17T11:08:42.631 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.629+0000 7f76a17fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "7371d50f-36f9-477d-8d4d-853f481dd6db", "id": 11}] 2026-02-17T11:08:42.631 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.629+0000 7f76a17fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:08:42.632 INFO:teuthology.orchestra.run.trial162.stdout:11 2026-02-17T11:08:42.633 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.630+0000 7f76b30fa640 10 librados: watch_flush enter 2026-02-17T11:08:42.633 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.630+0000 7f76b30fa640 10 librados: watch_flush exit 2026-02-17T11:08:42.633 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.630+0000 7f76b30fa640 20 client.4168.objecter shutdown clearing up homeless session... 2026-02-17T11:08:42.634 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.630+0000 7f76b30fa640 10 client.4168.objecter successfully canceled tick 2026-02-17T11:08:42.634 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.630+0000 7f76b30fa640 1 -- 10.20.193.162:0/2456091587 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f767c078f90 msgr2=0x7f767c07b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:42.634 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.630+0000 7f76b30fa640 1 --2- 10.20.193.162:0/2456091587 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f767c078f90 0x7f767c07b450 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f769c002770 tx=0x7f769c009040 comp rx=0 tx=0).stop 2026-02-17T11:08:42.634 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.630+0000 7f76b30fa640 10 monclient: shutdown 2026-02-17T11:08:42.634 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.630+0000 7f76b30fa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:08:42.634 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.630+0000 7f76b30fa640 1 -- 10.20.193.162:0/2456091587 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f76ac11a2d0 msgr2=0x7f76ac119b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:42.634 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.630+0000 7f76b30fa640 1 --2- 10.20.193.162:0/2456091587 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f76ac11a2d0 0x7f76ac119b30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f76ac06a440 tx=0x7f769400c8f0 comp rx=0 tx=0).stop 2026-02-17T11:08:42.634 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.630+0000 7f76b30fa640 1 -- 10.20.193.162:0/2456091587 shutdown_connections 2026-02-17T11:08:42.634 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.630+0000 7f76b30fa640 1 --2- 10.20.193.162:0/2456091587 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f767c078f90 0x7f767c07b450 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:42.634 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.630+0000 7f76b30fa640 1 --2- 10.20.193.162:0/2456091587 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f76ac11dde0 0x7f76ac1176b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:42.634 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.630+0000 7f76b30fa640 1 --2- 10.20.193.162:0/2456091587 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f76ac11a2d0 0x7f76ac119b30 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:42.634 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.630+0000 7f76b30fa640 1 --2- 10.20.193.162:0/2456091587 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f76ac1123f0 0x7f76ac1194c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:42.635 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.630+0000 7f76b30fa640 1 -- 10.20.193.162:0/2456091587 >> 10.20.193.162:0/2456091587 conn(0x7f76ac06f660 msgr2=0x7f76ac11c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:08:42.635 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.630+0000 7f76b30fa640 1 -- 10.20.193.162:0/2456091587 shutdown_connections 2026-02-17T11:08:42.635 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.630+0000 7f76b30fa640 1 -- 10.20.193.162:0/2456091587 wait complete. 2026-02-17T11:08:42.635 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.630+0000 7f76b30fa640 1 librados: shutdown 2026-02-17T11:08:42.641 DEBUG:teuthology.orchestra.run.trial162:> sudo ceph --cluster ceph osd new 3cf4fded-49db-4d95-956b-77acc868a3ed 12 2026-02-17T11:08:42.705 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.702+0000 7efeec876640 10 monclient: get_monmap_and_config 2026-02-17T11:08:42.705 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.702+0000 7efeec876640 10 monclient: build_initial_monmap 2026-02-17T11:08:42.705 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.702+0000 7efeec876640 10 monclient: monmap: 2026-02-17T11:08:42.705 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-17T11:08:42.705 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:42.706 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:08:42.704154+0000 2026-02-17T11:08:42.706 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:08:42.704154+0000 2026-02-17T11:08:42.706 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-17T11:08:42.706 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:42.706 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:08:42.706 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:08:42.706 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:08:42.706 INFO:teuthology.orchestra.run.trial162.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:08:42.706 INFO:teuthology.orchestra.run.trial162.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:08:42.706 INFO:teuthology.orchestra.run.trial162.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:08:42.706 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:42.707 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.702+0000 7efeec876640 1 Processor -- start 2026-02-17T11:08:42.707 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.703+0000 7efeec876640 1 -- start start 2026-02-17T11:08:42.707 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.703+0000 7efeec876640 10 monclient: init 2026-02-17T11:08:42.707 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.703+0000 7efeec876640 10 monclient: _reopen_session rank -1 2026-02-17T11:08:42.707 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.703+0000 7efeec876640 10 monclient: _add_conns ranks=[2,1,5,0,3,4] 2026-02-17T11:08:42.707 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.703+0000 7efeec876640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7efee4073830 addr v1:10.20.193.157:6789/0 2026-02-17T11:08:42.707 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.703+0000 7efeec876640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7efee411b470 addr v1:10.20.193.97:6789/0 2026-02-17T11:08:42.707 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.703+0000 7efeec876640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7efee411ef80 0x7efee41213b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:42.707 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.703+0000 7efeec876640 10 monclient(hunting): picked mon.noname-c con 0x7efee411ef80 addr v2:10.20.193.157:3300/0 2026-02-17T11:08:42.707 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.703+0000 7efeec876640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efee4121ad0 con 0x7efee411b470 2026-02-17T11:08:42.707 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.703+0000 7efeec876640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efee4122cf0 con 0x7efee4073830 2026-02-17T11:08:42.708 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.703+0000 7efeec876640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:42.708 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.703+0000 7efeec876640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7efee4123ef0 con 0x7efee411ef80 2026-02-17T11:08:42.708 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.703+0000 7efeec876640 10 monclient(hunting): _renew_subs 2026-02-17T11:08:42.708 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.703+0000 7efeec876640 10 monclient(hunting): authenticate will time out at 960.442198s 2026-02-17T11:08:42.710 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.703+0000 7efeeadec640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7efee411ef80 0x7efee41213b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:42.710 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.703+0000 7efee9dea640 1 --1- >> v1:10.20.193.97:6789/0 conn(0x7efee411b470 0x7efee411d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.97:6789/0 says I am v1:10.20.193.162:33862/0 (socket says 10.20.193.162:33862) 2026-02-17T11:08:42.710 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.703+0000 7efee9dea640 1 -- 10.20.193.162:0/3184168840 learned_addr learned my addr 10.20.193.162:0/3184168840 (peer_addr_for_me v1:10.20.193.162:0/0) 2026-02-17T11:08:42.710 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.703+0000 7efeeadec640 10 monclient(hunting): get_auth_request con 0x7efee411ef80 auth_method 0 2026-02-17T11:08:42.710 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.703+0000 7efeeadec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:42.710 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.703+0000 7efeeadec640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:42.710 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.703+0000 7efeeadec640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:42.711 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.704+0000 7efeeadec640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:42.711 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.704+0000 7efeeadec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:42.711 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.704+0000 7efeeadec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:42.711 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.705+0000 7efee95e9640 1 -- 10.20.193.162:0/3184168840 <== mon.1 v1:10.20.193.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1655165916 0 0) 0x7efee4121ad0 con 0x7efee411b470 2026-02-17T11:08:42.711 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.705+0000 7efee95e9640 10 monclient(hunting): _negotiate 2026-02-17T11:08:42.711 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.705+0000 7efee95e9640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:42.711 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.705+0000 7efee95e9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:42.711 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.705+0000 7efee95e9640 10 monclient(hunting): my global_id is 4171 2026-02-17T11:08:42.711 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.705+0000 7efee95e9640 1 -- 10.20.193.162:0/3184168840 --> v1:10.20.193.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efed4003620 con 0x7efee411b470 2026-02-17T11:08:42.712 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.706+0000 7efeeadec640 10 monclient(hunting): handle_auth_done global_id 4187 payload 274 2026-02-17T11:08:42.712 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.706+0000 7efeeadec640 1 -- 10.20.193.162:0/3184168840 >> v1:10.20.193.157:6789/0 conn(0x7efee4073830 legacy=0x7efee4073c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:42.712 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.706+0000 7efeeadec640 1 -- 10.20.193.162:0/3184168840 >> v1:10.20.193.97:6789/0 conn(0x7efee411b470 legacy=0x7efee411d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:42.712 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.706+0000 7efeeadec640 10 monclient: _finish_hunting 0 2026-02-17T11:08:42.712 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.706+0000 7efeeadec640 1 monclient: found mon.noname-c 2026-02-17T11:08:42.712 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.706+0000 7efeeadec640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:08:42.712 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.706+0000 7efeeadec640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:08:42.712 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.706+0000 7efeeadec640 1 -- 10.20.193.162:0/3184168840 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efee4124070 con 0x7efee411ef80 2026-02-17T11:08:42.712 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.707+0000 7efeeadec640 1 --2- 10.20.193.162:0/3184168840 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7efee411ef80 0x7efee41213b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7efed8009d90 tx=0x7efed802f1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44044a265b302d59 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:08:42.720 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.709+0000 7efee95e9640 1 -- 10.20.193.162:0/3184168840 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed803c070 con 0x7efee411ef80 2026-02-17T11:08:42.720 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.709+0000 7efee95e9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:42.721 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.709+0000 7efee95e9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:08:42.721 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.709+0000 7efee95e9640 10 monclient: dump: 2026-02-17T11:08:42.721 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:42.721 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:42.721 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:42.721 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:42.721 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:42.721 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:42.721 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:42.721 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:42.721 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:42.722 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:42.722 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.709+0000 7efee95e9640 10 monclient: _finish_auth 0 2026-02-17T11:08:42.722 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.709+0000 7efee95e9640 10 monclient: _check_auth_tickets 2026-02-17T11:08:42.722 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.709+0000 7efee95e9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:08:42.722 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.709+0000 7efee95e9640 1 -- 10.20.193.162:0/3184168840 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efed8037440 con 0x7efee411ef80 2026-02-17T11:08:42.722 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.709+0000 7efeec876640 5 monclient: authenticate success, global_id 4187 2026-02-17T11:08:42.722 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.709+0000 7efeec876640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:08:42.722 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.709+0000 7efee95e9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:08:42.722 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.709+0000 7efeec876640 10 monclient: get_monmap_and_config success 2026-02-17T11:08:42.722 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.709+0000 7efeec876640 4 set_mon_vals no callback set 2026-02-17T11:08:42.723 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.709+0000 7efee95e9640 1 -- 10.20.193.162:0/3184168840 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed8037810 con 0x7efee411ef80 2026-02-17T11:08:42.723 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.709+0000 7efee95e9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:42.723 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.709+0000 7efee95e9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:08:42.723 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.709+0000 7efee95e9640 10 monclient: dump: 2026-02-17T11:08:42.723 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:42.723 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:42.723 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:42.723 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:42.723 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:42.723 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:42.723 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:42.723 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:42.723 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:42.724 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:42.724 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.709+0000 7efeec876640 10 monclient: shutdown 2026-02-17T11:08:42.724 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.709+0000 7efeec876640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:08:42.724 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.709+0000 7efeec876640 1 -- 10.20.193.162:0/3184168840 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7efee411ef80 msgr2=0x7efee41213b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:42.724 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.709+0000 7efeec876640 1 --2- 10.20.193.162:0/3184168840 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7efee411ef80 0x7efee41213b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7efed8009d90 tx=0x7efed802f1e0 comp rx=0 tx=0).stop 2026-02-17T11:08:42.724 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.709+0000 7efeec876640 1 -- 10.20.193.162:0/3184168840 shutdown_connections 2026-02-17T11:08:42.724 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.709+0000 7efeec876640 1 --2- 10.20.193.162:0/3184168840 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7efee411ef80 0x7efee41213b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:42.724 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.709+0000 7efeec876640 1 -- 10.20.193.162:0/3184168840 >> 10.20.193.162:0/3184168840 conn(0x7efee406f660 msgr2=0x7efee4071a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:08:42.724 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.709+0000 7efeec876640 1 -- 10.20.193.162:0/3184168840 shutdown_connections 2026-02-17T11:08:42.724 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.709+0000 7efeec876640 1 -- 10.20.193.162:0/3184168840 wait complete. 2026-02-17T11:08:42.724 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.710+0000 7efeec876640 10 monclient: build_initial_monmap 2026-02-17T11:08:42.724 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.710+0000 7efeec876640 10 monclient: monmap: 2026-02-17T11:08:42.725 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-17T11:08:42.725 INFO:teuthology.orchestra.run.trial162.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:08:42.725 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 0.000000 2026-02-17T11:08:42.725 INFO:teuthology.orchestra.run.trial162.stderr:created 0.000000 2026-02-17T11:08:42.725 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-17T11:08:42.725 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:42.725 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:08:42.725 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:08:42.725 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:08:42.725 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:42.725 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.710+0000 7efeec876640 1 librados: starting msgr at 2026-02-17T11:08:42.725 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.710+0000 7efeec876640 1 librados: starting objecter 2026-02-17T11:08:42.726 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.710+0000 7efeec876640 1 Processor -- start 2026-02-17T11:08:42.726 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.710+0000 7efeec876640 1 -- start start 2026-02-17T11:08:42.726 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.710+0000 7efeec876640 1 librados: setting wanted keys 2026-02-17T11:08:42.726 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.710+0000 7efeec876640 1 librados: calling monclient init 2026-02-17T11:08:42.726 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.710+0000 7efeec876640 10 monclient: init 2026-02-17T11:08:42.726 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.710+0000 7efeec876640 10 monclient: _reopen_session rank -1 2026-02-17T11:08:42.726 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.710+0000 7efeec876640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:08:42.726 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.710+0000 7efeec876640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7efee4073830 0x7efee41b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:42.726 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.710+0000 7efeec876640 10 monclient(hunting): picked mon.noname-a con 0x7efee4073830 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:08:42.726 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.710+0000 7efeec876640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7efee411b470 0x7efee41b1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:42.726 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.710+0000 7efeec876640 10 monclient(hunting): picked mon.noname-b con 0x7efee411b470 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:08:42.726 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.710+0000 7efeec876640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7efee411ef80 0x7efee41ab4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:42.727 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.710+0000 7efeec876640 10 monclient(hunting): picked mon.noname-c con 0x7efee411ef80 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:08:42.727 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.710+0000 7efeec876640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:42.727 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.710+0000 7efeec876640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7efee4123380 con 0x7efee4073830 2026-02-17T11:08:42.727 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.710+0000 7efeec876640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:42.727 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.710+0000 7efeec876640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7efee4123200 con 0x7efee411b470 2026-02-17T11:08:42.727 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.710+0000 7efeec876640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:42.727 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.710+0000 7efeec876640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7efee4123500 con 0x7efee411ef80 2026-02-17T11:08:42.727 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.710+0000 7efeec876640 10 monclient(hunting): _renew_subs 2026-02-17T11:08:42.727 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.710+0000 7efeec876640 10 monclient(hunting): authenticate will time out at 960.449520s 2026-02-17T11:08:42.727 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.710+0000 7efeeadec640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7efee411ef80 0x7efee41ab4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:42.727 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.710+0000 7efee9dea640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7efee411b470 0x7efee41b1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:42.727 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.710+0000 7efeea5eb640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7efee4073830 0x7efee41b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:42.728 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.711+0000 7efeeadec640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7efee411ef80 0x7efee41ab4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.162:47368/0 (socket says 10.20.193.162:47368) 2026-02-17T11:08:42.728 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.711+0000 7efeeadec640 1 -- 10.20.193.162:0/4257059812 learned_addr learned my addr 10.20.193.162:0/4257059812 (peer_addr_for_me v2:10.20.193.162:0/0) 2026-02-17T11:08:42.728 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.711+0000 7efeeadec640 10 monclient(hunting): get_auth_request con 0x7efee411ef80 auth_method 0 2026-02-17T11:08:42.728 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.711+0000 7efeeadec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:42.728 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.711+0000 7efeeadec640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:42.728 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.711+0000 7efeeadec640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:42.728 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.711+0000 7efee9dea640 10 monclient(hunting): get_auth_request con 0x7efee411b470 auth_method 0 2026-02-17T11:08:42.728 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.711+0000 7efee9dea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:42.728 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.711+0000 7efee9dea640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:42.728 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.711+0000 7efee9dea640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:42.728 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.711+0000 7efeea5eb640 10 monclient(hunting): get_auth_request con 0x7efee4073830 auth_method 0 2026-02-17T11:08:42.729 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.711+0000 7efeea5eb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:42.729 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.711+0000 7efeea5eb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:42.729 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.711+0000 7efeea5eb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:42.729 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.711+0000 7efeeadec640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:42.729 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.711+0000 7efeeadec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:42.729 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.711+0000 7efeeadec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:42.729 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.711+0000 7efee9dea640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:42.729 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.711+0000 7efee9dea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:42.729 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.711+0000 7efee9dea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:42.729 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.711+0000 7efeea5eb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:42.729 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.711+0000 7efeea5eb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:42.729 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.711+0000 7efeea5eb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:42.729 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.712+0000 7efeeadec640 10 monclient(hunting): handle_auth_done global_id 4193 payload 824 2026-02-17T11:08:42.730 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.712+0000 7efeeadec640 1 -- 10.20.193.162:0/4257059812 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7efee411b470 msgr2=0x7efee41b1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:42.730 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.712+0000 7efeeadec640 1 --2- 10.20.193.162:0/4257059812 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7efee411b470 0x7efee41b1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:42.730 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.712+0000 7efeeadec640 1 -- 10.20.193.162:0/4257059812 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7efee4073830 msgr2=0x7efee41b13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:42.730 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.712+0000 7efeeadec640 1 --2- 10.20.193.162:0/4257059812 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7efee4073830 0x7efee41b13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:42.730 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.712+0000 7efeeadec640 10 monclient: _finish_hunting 0 2026-02-17T11:08:42.730 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.712+0000 7efeeadec640 1 monclient: found mon.noname-c 2026-02-17T11:08:42.730 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.712+0000 7efeeadec640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:08:42.730 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.712+0000 7efeeadec640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:08:42.730 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.712+0000 7efeeadec640 1 -- 10.20.193.162:0/4257059812 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efee41abd60 con 0x7efee411ef80 2026-02-17T11:08:42.730 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.713+0000 7efeeadec640 1 --2- 10.20.193.162:0/4257059812 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7efee411ef80 0x7efee41ab4a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7efed803a040 tx=0x7efed8004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:08:42.730 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.713+0000 7efeceffd640 10 client.?.objecter ms_handle_connect 0x7efee411ef80 2026-02-17T11:08:42.730 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.713+0000 7efeceffd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:08:42.731 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.714+0000 7efeceffd640 1 -- 10.20.193.162:0/4257059812 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed803c050 con 0x7efee411ef80 2026-02-17T11:08:42.731 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.714+0000 7efeceffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:42.731 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.714+0000 7efeceffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:08:42.731 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.714+0000 7efeceffd640 10 monclient: dump: 2026-02-17T11:08:42.731 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:42.731 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:42.731 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:42.731 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:42.731 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:42.731 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:42.731 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:42.731 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:42.732 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:42.732 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:42.732 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.714+0000 7efeceffd640 10 monclient: _finish_auth 0 2026-02-17T11:08:42.732 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.714+0000 7efeceffd640 10 monclient: _check_auth_tickets 2026-02-17T11:08:42.732 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.714+0000 7efeceffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:08:42.732 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.714+0000 7efeec876640 5 monclient: authenticate success, global_id 4193 2026-02-17T11:08:42.732 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.714+0000 7efeec876640 10 monclient: _renew_subs 2026-02-17T11:08:42.732 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.714+0000 7efeec876640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:08:42.732 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.714+0000 7efeec876640 1 -- 10.20.193.162:0/4257059812 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efee41abf90 con 0x7efee411ef80 2026-02-17T11:08:42.732 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.714+0000 7efeec876640 10 client.4193.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:08:42.732 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.714+0000 7efeec876640 10 monclient: _renew_subs 2026-02-17T11:08:42.732 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.714+0000 7efeec876640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:08:42.733 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.714+0000 7efeec876640 1 -- 10.20.193.162:0/4257059812 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efee41b8220 con 0x7efee411ef80 2026-02-17T11:08:42.733 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.714+0000 7efeec876640 1 librados: init done 2026-02-17T11:08:42.733 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.714+0000 7efeceffd640 1 -- 10.20.193.162:0/4257059812 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efed8048070 con 0x7efee411ef80 2026-02-17T11:08:42.733 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.714+0000 7efeceffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:08:42.733 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.714+0000 7efeceffd640 1 -- 10.20.193.162:0/4257059812 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed8035a50 con 0x7efee411ef80 2026-02-17T11:08:42.733 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.714+0000 7efeceffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:42.733 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.714+0000 7efeceffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:08:42.733 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.714+0000 7efeceffd640 10 monclient: dump: 2026-02-17T11:08:42.733 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:42.733 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:42.733 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:42.733 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:42.733 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:42.734 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:42.734 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:42.734 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:42.734 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:42.734 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:42.734 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.714+0000 7efee8de8640 4 set_mon_vals no callback set 2026-02-17T11:08:42.734 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.715+0000 7efeec876640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:42.734 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.715+0000 7efeec876640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:42.734 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.715+0000 7efeec876640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:08:42.734 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.715+0000 7efeec876640 1 -- 10.20.193.162:0/4257059812 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efee41239e0 con 0x7efee411ef80 2026-02-17T11:08:42.736 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.725+0000 7efeceffd640 1 -- 10.20.193.162:0/4257059812 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 3) ==== 99895+0+0 (secure 0 0 0) 0x7efed8035bf0 con 0x7efee411ef80 2026-02-17T11:08:42.736 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.726+0000 7efeceffd640 1 --2- 10.20.193.162:0/4257059812 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7efeb4078f90 0x7efeb407b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:42.736 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.726+0000 7efeea5eb640 1 --2- 10.20.193.162:0/4257059812 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7efeb4078f90 0x7efeb407b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:42.736 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.726+0000 7efeea5eb640 10 monclient: get_auth_request con 0x7efeb4078f90 auth_method 0 2026-02-17T11:08:42.736 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.726+0000 7efeea5eb640 1 --2- 10.20.193.162:0/4257059812 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7efeb4078f90 0x7efeb407b450 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7efedc002770 tx=0x7efedc007ef0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:08:42.736 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.726+0000 7efeceffd640 10 client.4193.objecter ms_handle_connect 0x7efeb4078f90 2026-02-17T11:08:42.736 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.726+0000 7efeceffd640 1 -- 10.20.193.162:0/4257059812 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2105+0+0 (secure 0 0 0) 0x7efed80846e0 con 0x7efee411ef80 2026-02-17T11:08:42.736 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.726+0000 7efeceffd640 10 client.4193.objecter ms_dispatch2 0x7efee4000b90 osd_map(14..14 src has 1..14) 2026-02-17T11:08:42.736 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.726+0000 7efeceffd640 3 client.4193.objecter handle_osd_map got epochs [14,14] > 0 2026-02-17T11:08:42.737 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.726+0000 7efeceffd640 3 client.4193.objecter handle_osd_map decoding full epoch 14 2026-02-17T11:08:42.737 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.726+0000 7efeceffd640 20 client.4193.objecter dump_active .. 0 homeless 2026-02-17T11:08:42.826 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.825+0000 7efeceffd640 1 -- 10.20.193.162:0/4257059812 <== mon.2 v2:10.20.193.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7efed80886a0 con 0x7efee411ef80 2026-02-17T11:08:42.826 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.825+0000 7efeceffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:42.827 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.825+0000 7efeceffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:08:42.914 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.912+0000 7efeec876640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "3cf4fded-49db-4d95-956b-77acc868a3ed", "id": 12}] 2026-02-17T11:08:42.914 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.912+0000 7efeec876640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "3cf4fded-49db-4d95-956b-77acc868a3ed", "id": 12}] 2026-02-17T11:08:42.914 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.912+0000 7efeec876640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:08:42.914 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.912+0000 7efeec876640 1 -- 10.20.193.162:0/4257059812 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3cf4fded-49db-4d95-956b-77acc868a3ed", "id": 12} v 0) -- 0x7efee411c430 con 0x7efee411ef80 2026-02-17T11:08:42.962 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.960+0000 7efeceffd640 1 -- 10.20.193.162:0/4257059812 <== mon.2 v2:10.20.193.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3cf4fded-49db-4d95-956b-77acc868a3ed", "id": 12}]=0 v15) ==== 113+0+3 (secure 0 0 0) 0x7efed808c9a0 con 0x7efee411ef80 2026-02-17T11:08:42.962 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.960+0000 7efeceffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "3cf4fded-49db-4d95-956b-77acc868a3ed", "id": 12}] 2026-02-17T11:08:42.962 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.960+0000 7efeceffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:08:42.963 INFO:teuthology.orchestra.run.trial162.stdout:12 2026-02-17T11:08:42.964 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.960+0000 7efeec876640 10 librados: watch_flush enter 2026-02-17T11:08:42.964 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.960+0000 7efeec876640 10 librados: watch_flush exit 2026-02-17T11:08:42.964 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.960+0000 7efeec876640 20 client.4193.objecter shutdown clearing up homeless session... 2026-02-17T11:08:42.964 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.960+0000 7efeec876640 10 client.4193.objecter successfully canceled tick 2026-02-17T11:08:42.965 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.960+0000 7efeec876640 1 -- 10.20.193.162:0/4257059812 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7efeb4078f90 msgr2=0x7efeb407b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:42.965 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.960+0000 7efeec876640 1 --2- 10.20.193.162:0/4257059812 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7efeb4078f90 0x7efeb407b450 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7efedc002770 tx=0x7efedc007ef0 comp rx=0 tx=0).stop 2026-02-17T11:08:42.965 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.960+0000 7efeec876640 10 monclient: shutdown 2026-02-17T11:08:42.965 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.960+0000 7efeec876640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:08:42.965 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.960+0000 7efeec876640 1 -- 10.20.193.162:0/4257059812 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7efee411ef80 msgr2=0x7efee41ab4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:42.965 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.961+0000 7efeec876640 1 --2- 10.20.193.162:0/4257059812 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7efee411ef80 0x7efee41ab4a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7efed803a040 tx=0x7efed8004b40 comp rx=0 tx=0).stop 2026-02-17T11:08:42.965 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.961+0000 7efeec876640 1 -- 10.20.193.162:0/4257059812 shutdown_connections 2026-02-17T11:08:42.965 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.961+0000 7efeec876640 1 --2- 10.20.193.162:0/4257059812 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7efeb4078f90 0x7efeb407b450 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:42.965 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.961+0000 7efeec876640 1 --2- 10.20.193.162:0/4257059812 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7efee411ef80 0x7efee41ab4a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:42.965 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.961+0000 7efeec876640 1 --2- 10.20.193.162:0/4257059812 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7efee411b470 0x7efee41b1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:42.965 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.961+0000 7efeec876640 1 --2- 10.20.193.162:0/4257059812 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7efee4073830 0x7efee41b13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:42.966 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.961+0000 7efeec876640 1 -- 10.20.193.162:0/4257059812 >> 10.20.193.162:0/4257059812 conn(0x7efee406f660 msgr2=0x7efee411a930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:08:42.966 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.961+0000 7efeec876640 1 -- 10.20.193.162:0/4257059812 shutdown_connections 2026-02-17T11:08:42.966 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.961+0000 7efeec876640 1 -- 10.20.193.162:0/4257059812 wait complete. 2026-02-17T11:08:42.966 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:42.961+0000 7efeec876640 1 librados: shutdown 2026-02-17T11:08:42.970 DEBUG:teuthology.orchestra.run.trial162:> sudo ceph --cluster ceph osd new 7dc53473-594f-4cfb-8444-eab205e2e0f9 13 2026-02-17T11:08:43.033 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.030+0000 7f2f628a7640 10 monclient: get_monmap_and_config 2026-02-17T11:08:43.033 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.030+0000 7f2f628a7640 10 monclient: build_initial_monmap 2026-02-17T11:08:43.033 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.030+0000 7f2f628a7640 10 monclient: monmap: 2026-02-17T11:08:43.033 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-17T11:08:43.033 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:43.033 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:08:43.032376+0000 2026-02-17T11:08:43.034 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:08:43.032376+0000 2026-02-17T11:08:43.034 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-17T11:08:43.034 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:43.034 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:08:43.034 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:08:43.034 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:08:43.034 INFO:teuthology.orchestra.run.trial162.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:08:43.034 INFO:teuthology.orchestra.run.trial162.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:08:43.034 INFO:teuthology.orchestra.run.trial162.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:08:43.034 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:43.037 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.031+0000 7f2f628a7640 1 Processor -- start 2026-02-17T11:08:43.038 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.031+0000 7f2f628a7640 1 -- start start 2026-02-17T11:08:43.038 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.031+0000 7f2f628a7640 10 monclient: init 2026-02-17T11:08:43.038 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.031+0000 7f2f628a7640 10 monclient: _reopen_session rank -1 2026-02-17T11:08:43.038 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.031+0000 7f2f628a7640 10 monclient: _add_conns ranks=[5,1,3,4,0,2] 2026-02-17T11:08:43.038 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.031+0000 7f2f628a7640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f2f5c1149f0 0x7f2f5c114dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:43.038 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.031+0000 7f2f628a7640 10 monclient(hunting): picked mon.noname-c con 0x7f2f5c1149f0 addr v2:10.20.193.157:3300/0 2026-02-17T11:08:43.038 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.031+0000 7f2f628a7640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f2f5c1192f0 addr v1:10.20.193.97:6789/0 2026-02-17T11:08:43.038 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.031+0000 7f2f628a7640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f2f5c119e70 0x7f2f5c1225f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:43.038 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.031+0000 7f2f628a7640 10 monclient(hunting): picked mon.noname-a con 0x7f2f5c119e70 addr v2:10.20.193.49:3300/0 2026-02-17T11:08:43.038 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.031+0000 7f2f628a7640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f5c122bc0 con 0x7f2f5c1192f0 2026-02-17T11:08:43.039 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.031+0000 7f2f628a7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:43.039 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.031+0000 7f2f628a7640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f2f5c123da0 con 0x7f2f5c119e70 2026-02-17T11:08:43.039 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.031+0000 7f2f628a7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:43.039 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.031+0000 7f2f628a7640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f2f5c123f20 con 0x7f2f5c1149f0 2026-02-17T11:08:43.039 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.031+0000 7f2f628a7640 10 monclient(hunting): _renew_subs 2026-02-17T11:08:43.039 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.031+0000 7f2f628a7640 10 monclient(hunting): authenticate will time out at 960.770608s 2026-02-17T11:08:43.039 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.031+0000 7f2f5bfff640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f2f5c1149f0 0x7f2f5c114dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:43.039 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.032+0000 7f2f5b7fe640 1 --1- >> v1:10.20.193.97:6789/0 conn(0x7f2f5c1192f0 0x7f2f5c119760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.97:6789/0 says I am v1:10.20.193.162:33864/0 (socket says 10.20.193.162:33864) 2026-02-17T11:08:43.039 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.032+0000 7f2f5b7fe640 1 -- 10.20.193.162:0/2085409036 learned_addr learned my addr 10.20.193.162:0/2085409036 (peer_addr_for_me v1:10.20.193.162:0/0) 2026-02-17T11:08:43.039 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.032+0000 7f2f5bfff640 10 monclient(hunting): get_auth_request con 0x7f2f5c1149f0 auth_method 0 2026-02-17T11:08:43.040 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.032+0000 7f2f5bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:43.040 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.032+0000 7f2f5bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:43.040 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.032+0000 7f2f5bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:43.040 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.032+0000 7f2f5bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:43.040 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.032+0000 7f2f5bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:43.040 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.032+0000 7f2f5bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:43.040 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.034+0000 7f2f5bfff640 10 monclient(hunting): handle_auth_done global_id 4196 payload 274 2026-02-17T11:08:43.040 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.034+0000 7f2f5bfff640 1 -- 10.20.193.162:0/2085409036 >> v2:10.20.193.49:3300/0 conn(0x7f2f5c119e70 msgr2=0x7f2f5c1225f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:08:43.040 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.034+0000 7f2f5bfff640 1 --2- 10.20.193.162:0/2085409036 >> v2:10.20.193.49:3300/0 conn(0x7f2f5c119e70 0x7f2f5c1225f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:43.040 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.034+0000 7f2f5bfff640 1 -- 10.20.193.162:0/2085409036 >> v1:10.20.193.97:6789/0 conn(0x7f2f5c1192f0 legacy=0x7f2f5c119760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:43.040 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.034+0000 7f2f5bfff640 10 monclient: _finish_hunting 0 2026-02-17T11:08:43.040 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.034+0000 7f2f5bfff640 1 monclient: found mon.noname-c 2026-02-17T11:08:43.040 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.034+0000 7f2f5bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:08:43.041 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.034+0000 7f2f5bfff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:08:43.041 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.034+0000 7f2f5bfff640 1 -- 10.20.193.162:0/2085409036 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f5c1240a0 con 0x7f2f5c1149f0 2026-02-17T11:08:43.041 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.034+0000 7f2f5bfff640 1 --2- 10.20.193.162:0/2085409036 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f2f5c1149f0 0x7f2f5c114dd0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c1156c0 tx=0x7f2f4802ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9532da35a65ed88c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:08:43.041 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.035+0000 7f2f5affd640 1 -- 10.20.193.162:0/2085409036 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f4803c070 con 0x7f2f5c1149f0 2026-02-17T11:08:43.041 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.035+0000 7f2f5affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:43.041 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.035+0000 7f2f5affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:08:43.041 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.035+0000 7f2f5affd640 10 monclient: dump: 2026-02-17T11:08:43.041 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:43.041 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:43.041 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:43.041 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:43.041 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:43.042 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:43.042 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:43.042 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:43.042 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:43.042 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:43.042 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.035+0000 7f2f5affd640 10 monclient: _finish_auth 0 2026-02-17T11:08:43.042 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.035+0000 7f2f5affd640 10 monclient: _check_auth_tickets 2026-02-17T11:08:43.042 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.035+0000 7f2f5affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:08:43.042 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.035+0000 7f2f628a7640 5 monclient: authenticate success, global_id 4196 2026-02-17T11:08:43.042 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.035+0000 7f2f628a7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:08:43.049 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.036+0000 7f2f5affd640 1 -- 10.20.193.162:0/2085409036 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f4802fa60 con 0x7f2f5c1149f0 2026-02-17T11:08:43.049 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.036+0000 7f2f5affd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:08:43.049 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.036+0000 7f2f5affd640 1 -- 10.20.193.162:0/2085409036 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f4802fe30 con 0x7f2f5c1149f0 2026-02-17T11:08:43.049 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.036+0000 7f2f5affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:43.049 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.036+0000 7f2f5affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:08:43.049 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.036+0000 7f2f5affd640 10 monclient: dump: 2026-02-17T11:08:43.049 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:43.049 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:43.050 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:43.050 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:43.050 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:43.050 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:43.050 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:43.050 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:43.050 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:43.050 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:43.050 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.036+0000 7f2f628a7640 10 monclient: get_monmap_and_config success 2026-02-17T11:08:43.050 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.036+0000 7f2f628a7640 4 set_mon_vals no callback set 2026-02-17T11:08:43.050 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.036+0000 7f2f628a7640 10 monclient: shutdown 2026-02-17T11:08:43.050 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.036+0000 7f2f628a7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:08:43.051 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.036+0000 7f2f628a7640 1 -- 10.20.193.162:0/2085409036 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f2f5c1149f0 msgr2=0x7f2f5c114dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:43.051 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.036+0000 7f2f628a7640 1 --2- 10.20.193.162:0/2085409036 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f2f5c1149f0 0x7f2f5c114dd0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c1156c0 tx=0x7f2f4802ed50 comp rx=0 tx=0).stop 2026-02-17T11:08:43.051 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.036+0000 7f2f628a7640 1 -- 10.20.193.162:0/2085409036 shutdown_connections 2026-02-17T11:08:43.051 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.036+0000 7f2f628a7640 1 --2- 10.20.193.162:0/2085409036 >> v2:10.20.193.49:3300/0 conn(0x7f2f5c119e70 0x7f2f5c1225f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:43.051 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.036+0000 7f2f628a7640 1 --2- 10.20.193.162:0/2085409036 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f2f5c1149f0 0x7f2f5c114dd0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:43.051 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.036+0000 7f2f628a7640 1 -- 10.20.193.162:0/2085409036 >> 10.20.193.162:0/2085409036 conn(0x7f2f5c073660 msgr2=0x7f2f5c073a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:08:43.051 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.036+0000 7f2f628a7640 1 -- 10.20.193.162:0/2085409036 shutdown_connections 2026-02-17T11:08:43.051 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.036+0000 7f2f628a7640 1 -- 10.20.193.162:0/2085409036 wait complete. 2026-02-17T11:08:43.051 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.036+0000 7f2f628a7640 10 monclient: build_initial_monmap 2026-02-17T11:08:43.051 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.036+0000 7f2f628a7640 10 monclient: monmap: 2026-02-17T11:08:43.051 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-17T11:08:43.051 INFO:teuthology.orchestra.run.trial162.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:08:43.052 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 0.000000 2026-02-17T11:08:43.052 INFO:teuthology.orchestra.run.trial162.stderr:created 0.000000 2026-02-17T11:08:43.052 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-17T11:08:43.052 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:43.052 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:08:43.052 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:08:43.052 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:08:43.052 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:43.052 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.038+0000 7f2f628a7640 1 librados: starting msgr at 2026-02-17T11:08:43.052 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.038+0000 7f2f628a7640 1 librados: starting objecter 2026-02-17T11:08:43.052 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.038+0000 7f2f628a7640 1 Processor -- start 2026-02-17T11:08:43.052 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.038+0000 7f2f628a7640 1 -- start start 2026-02-17T11:08:43.052 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.038+0000 7f2f628a7640 1 librados: setting wanted keys 2026-02-17T11:08:43.053 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.038+0000 7f2f628a7640 1 librados: calling monclient init 2026-02-17T11:08:43.053 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.038+0000 7f2f628a7640 10 monclient: init 2026-02-17T11:08:43.053 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.038+0000 7f2f628a7640 10 monclient: _reopen_session rank -1 2026-02-17T11:08:43.053 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.038+0000 7f2f628a7640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:08:43.053 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.038+0000 7f2f628a7640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f2f5c1149f0 0x7f2f5c1ab9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:43.053 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.038+0000 7f2f628a7640 10 monclient(hunting): picked mon.noname-b con 0x7f2f5c1149f0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:08:43.053 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.038+0000 7f2f628a7640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f2f5c1192f0 0x7f2f5c1abf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:43.053 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.038+0000 7f2f628a7640 10 monclient(hunting): picked mon.noname-a con 0x7f2f5c1192f0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:08:43.053 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.038+0000 7f2f628a7640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f2f5c119e70 0x7f2f5c1b00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:43.053 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.038+0000 7f2f628a7640 10 monclient(hunting): picked mon.noname-c con 0x7f2f5c119e70 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:08:43.053 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.038+0000 7f2f628a7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:43.053 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.038+0000 7f2f628a7640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5c123210 con 0x7f2f5c1192f0 2026-02-17T11:08:43.054 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.038+0000 7f2f628a7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:43.054 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.038+0000 7f2f628a7640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5c123090 con 0x7f2f5c1149f0 2026-02-17T11:08:43.054 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.038+0000 7f2f628a7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:43.054 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.038+0000 7f2f628a7640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5c123390 con 0x7f2f5c119e70 2026-02-17T11:08:43.054 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.038+0000 7f2f628a7640 10 monclient(hunting): _renew_subs 2026-02-17T11:08:43.054 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.038+0000 7f2f628a7640 10 monclient(hunting): authenticate will time out at 960.776479s 2026-02-17T11:08:43.054 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.038+0000 7f2f5bfff640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f2f5c1149f0 0x7f2f5c1ab9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:43.054 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.038+0000 7f2f5bfff640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f2f5c1149f0 0x7f2f5c1ab9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.162:48660/0 (socket says 10.20.193.162:48660) 2026-02-17T11:08:43.054 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.038+0000 7f2f5bfff640 1 -- 10.20.193.162:0/2670514252 learned_addr learned my addr 10.20.193.162:0/2670514252 (peer_addr_for_me v2:10.20.193.162:0/0) 2026-02-17T11:08:43.054 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.038+0000 7f2f5bfff640 10 monclient(hunting): get_auth_request con 0x7f2f5c1149f0 auth_method 0 2026-02-17T11:08:43.054 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.038+0000 7f2f5bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:43.054 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.038+0000 7f2f5bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:43.054 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.038+0000 7f2f5bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:43.055 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.038+0000 7f2f5bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:43.055 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.038+0000 7f2f5bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:43.055 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.038+0000 7f2f5bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:43.055 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.039+0000 7f2f5bfff640 10 monclient(hunting): handle_auth_done global_id 4177 payload 824 2026-02-17T11:08:43.055 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.039+0000 7f2f5bfff640 1 -- 10.20.193.162:0/2670514252 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f2f5c119e70 msgr2=0x7f2f5c1b00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:43.055 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.039+0000 7f2f5bfff640 1 --2- 10.20.193.162:0/2670514252 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f2f5c119e70 0x7f2f5c1b00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:43.055 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.039+0000 7f2f5bfff640 1 -- 10.20.193.162:0/2670514252 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f2f5c1192f0 msgr2=0x7f2f5c1abf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:43.055 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.039+0000 7f2f5bfff640 1 --2- 10.20.193.162:0/2670514252 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f2f5c1192f0 0x7f2f5c1abf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:43.055 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.039+0000 7f2f5bfff640 10 monclient: _finish_hunting 0 2026-02-17T11:08:43.055 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.039+0000 7f2f5bfff640 1 monclient: found mon.noname-b 2026-02-17T11:08:43.055 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.039+0000 7f2f5bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:08:43.056 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.039+0000 7f2f5bfff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:08:43.056 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.039+0000 7f2f5bfff640 1 -- 10.20.193.162:0/2670514252 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f5c1b0990 con 0x7f2f5c1149f0 2026-02-17T11:08:43.056 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.040+0000 7f2f5bfff640 1 --2- 10.20.193.162:0/2670514252 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f2f5c1149f0 0x7f2f5c1ab9d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2f4802f280 tx=0x7f2f480047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:08:43.056 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.040+0000 7f2f58ff9640 10 client.?.objecter ms_handle_connect 0x7f2f5c1149f0 2026-02-17T11:08:43.056 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.040+0000 7f2f58ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T11:08:43.056 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.041+0000 7f2f58ff9640 1 -- 10.20.193.162:0/2670514252 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f4803c040 con 0x7f2f5c1149f0 2026-02-17T11:08:43.056 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.041+0000 7f2f58ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:43.056 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.041+0000 7f2f58ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:08:43.056 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.041+0000 7f2f58ff9640 10 monclient: dump: 2026-02-17T11:08:43.056 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:43.056 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:43.056 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:43.056 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:43.057 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:43.057 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:43.057 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:43.057 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:43.057 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:43.057 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:43.057 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.041+0000 7f2f58ff9640 10 monclient: _finish_auth 0 2026-02-17T11:08:43.057 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.041+0000 7f2f58ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:08:43.057 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.041+0000 7f2f58ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:08:43.057 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.041+0000 7f2f628a7640 5 monclient: authenticate success, global_id 4177 2026-02-17T11:08:43.057 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.041+0000 7f2f628a7640 10 monclient: _renew_subs 2026-02-17T11:08:43.057 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.041+0000 7f2f628a7640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:08:43.058 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.041+0000 7f2f628a7640 1 -- 10.20.193.162:0/2670514252 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f5c1b0c20 con 0x7f2f5c1149f0 2026-02-17T11:08:43.058 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.041+0000 7f2f628a7640 10 client.4177.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:08:43.058 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.041+0000 7f2f628a7640 10 monclient: _renew_subs 2026-02-17T11:08:43.058 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.041+0000 7f2f628a7640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:08:43.058 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.041+0000 7f2f628a7640 1 -- 10.20.193.162:0/2670514252 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f5c1b8510 con 0x7f2f5c1149f0 2026-02-17T11:08:43.058 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.041+0000 7f2f628a7640 1 librados: init done 2026-02-17T11:08:43.058 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.042+0000 7f2f628a7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:43.058 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.042+0000 7f2f628a7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:43.058 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.042+0000 7f2f628a7640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:08:43.058 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.042+0000 7f2f628a7640 1 -- 10.20.193.162:0/2670514252 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f5c114e50 con 0x7f2f5c1149f0 2026-02-17T11:08:43.058 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.042+0000 7f2f58ff9640 1 -- 10.20.193.162:0/2670514252 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f48047070 con 0x7f2f5c1149f0 2026-02-17T11:08:43.058 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.042+0000 7f2f58ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:08:43.058 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.042+0000 7f2f5a7fc640 4 set_mon_vals no callback set 2026-02-17T11:08:43.059 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.043+0000 7f2f58ff9640 1 -- 10.20.193.162:0/2670514252 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f48035900 con 0x7f2f5c1149f0 2026-02-17T11:08:43.059 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.043+0000 7f2f58ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:43.059 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.043+0000 7f2f58ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:08:43.059 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.043+0000 7f2f58ff9640 10 monclient: dump: 2026-02-17T11:08:43.059 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:43.059 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:43.059 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:43.059 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:43.059 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:43.059 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:43.059 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:43.059 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:43.059 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:43.060 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:43.061 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.057+0000 7f2f58ff9640 1 -- 10.20.193.162:0/2670514252 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 3) ==== 99895+0+0 (secure 0 0 0) 0x7f2f48035aa0 con 0x7f2f5c1149f0 2026-02-17T11:08:43.061 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.058+0000 7f2f58ff9640 1 --2- 10.20.193.162:0/2670514252 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f2f2c078f90 0x7f2f2c07b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:43.061 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.058+0000 7f2f5b7fe640 1 --2- 10.20.193.162:0/2670514252 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f2f2c078f90 0x7f2f2c07b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:43.061 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.058+0000 7f2f5b7fe640 10 monclient: get_auth_request con 0x7f2f2c078f90 auth_method 0 2026-02-17T11:08:43.061 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.058+0000 7f2f5b7fe640 1 --2- 10.20.193.162:0/2670514252 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f2f2c078f90 0x7f2f2c07b450 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c007fd0 tx=0x7f2f4c007b40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:08:43.061 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.058+0000 7f2f58ff9640 10 client.4177.objecter ms_handle_connect 0x7f2f2c078f90 2026-02-17T11:08:43.214 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.213+0000 7f2f58ff9640 1 -- 10.20.193.162:0/2670514252 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2220+0+0 (secure 0 0 0) 0x7f2f48035dc0 con 0x7f2f5c1149f0 2026-02-17T11:08:43.214 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.213+0000 7f2f58ff9640 10 client.4177.objecter ms_dispatch2 0x7f2f5c000b90 osd_map(15..15 src has 1..15) 2026-02-17T11:08:43.215 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.213+0000 7f2f58ff9640 3 client.4177.objecter handle_osd_map got epochs [15,15] > 0 2026-02-17T11:08:43.215 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.213+0000 7f2f58ff9640 3 client.4177.objecter handle_osd_map decoding full epoch 15 2026-02-17T11:08:43.215 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.213+0000 7f2f58ff9640 20 client.4177.objecter dump_active .. 0 homeless 2026-02-17T11:08:43.215 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.213+0000 7f2f58ff9640 1 -- 10.20.193.162:0/2670514252 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f2f48087ea0 con 0x7f2f5c1149f0 2026-02-17T11:08:43.215 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.213+0000 7f2f58ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:43.216 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.213+0000 7f2f58ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:08:43.302 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.301+0000 7f2f628a7640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "7dc53473-594f-4cfb-8444-eab205e2e0f9", "id": 13}] 2026-02-17T11:08:43.303 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.301+0000 7f2f628a7640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "7dc53473-594f-4cfb-8444-eab205e2e0f9", "id": 13}] 2026-02-17T11:08:43.303 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.301+0000 7f2f628a7640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:08:43.303 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.301+0000 7f2f628a7640 1 -- 10.20.193.162:0/2670514252 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7dc53473-594f-4cfb-8444-eab205e2e0f9", "id": 13} v 0) -- 0x7f2f5c1b86e0 con 0x7f2f5c1149f0 2026-02-17T11:08:43.323 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.322+0000 7f2f58ff9640 1 -- 10.20.193.162:0/2670514252 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mgrmap(e 4) ==== 100001+0+0 (secure 0 0 0) 0x7f2f48083ee0 con 0x7f2f5c1149f0 2026-02-17T11:08:43.379 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.378+0000 7f2f58ff9640 1 -- 10.20.193.162:0/2670514252 <== mon.1 v2:10.20.193.97:3300/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7dc53473-594f-4cfb-8444-eab205e2e0f9", "id": 13}]=0 v16) ==== 113+0+3 (secure 0 0 0) 0x7f2f48092c80 con 0x7f2f5c1149f0 2026-02-17T11:08:43.379 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.378+0000 7f2f58ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "7dc53473-594f-4cfb-8444-eab205e2e0f9", "id": 13}] 2026-02-17T11:08:43.379 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.378+0000 7f2f58ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:08:43.379 INFO:teuthology.orchestra.run.trial162.stdout:13 2026-02-17T11:08:43.381 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.379+0000 7f2f628a7640 10 librados: watch_flush enter 2026-02-17T11:08:43.381 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.379+0000 7f2f628a7640 10 librados: watch_flush exit 2026-02-17T11:08:43.381 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.379+0000 7f2f628a7640 20 client.4177.objecter shutdown clearing up homeless session... 2026-02-17T11:08:43.381 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.379+0000 7f2f628a7640 10 client.4177.objecter successfully canceled tick 2026-02-17T11:08:43.381 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.379+0000 7f2f628a7640 1 -- 10.20.193.162:0/2670514252 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f2f2c078f90 msgr2=0x7f2f2c07b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:43.382 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.379+0000 7f2f628a7640 1 --2- 10.20.193.162:0/2670514252 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f2f2c078f90 0x7f2f2c07b450 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c007fd0 tx=0x7f2f4c007b40 comp rx=0 tx=0).stop 2026-02-17T11:08:43.382 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.379+0000 7f2f628a7640 10 monclient: shutdown 2026-02-17T11:08:43.382 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.379+0000 7f2f628a7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:08:43.382 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.379+0000 7f2f628a7640 1 -- 10.20.193.162:0/2670514252 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f2f5c1149f0 msgr2=0x7f2f5c1ab9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:43.382 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.379+0000 7f2f628a7640 1 --2- 10.20.193.162:0/2670514252 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f2f5c1149f0 0x7f2f5c1ab9d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2f4802f280 tx=0x7f2f480047c0 comp rx=0 tx=0).stop 2026-02-17T11:08:43.382 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.379+0000 7f2f628a7640 1 -- 10.20.193.162:0/2670514252 shutdown_connections 2026-02-17T11:08:43.382 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.379+0000 7f2f628a7640 1 --2- 10.20.193.162:0/2670514252 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f2f2c078f90 0x7f2f2c07b450 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:43.382 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.379+0000 7f2f628a7640 1 --2- 10.20.193.162:0/2670514252 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f2f5c119e70 0x7f2f5c1b00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:43.382 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.379+0000 7f2f628a7640 1 --2- 10.20.193.162:0/2670514252 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f2f5c1192f0 0x7f2f5c1abf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:43.382 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.379+0000 7f2f628a7640 1 --2- 10.20.193.162:0/2670514252 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f2f5c1149f0 0x7f2f5c1ab9d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:43.382 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.379+0000 7f2f628a7640 1 -- 10.20.193.162:0/2670514252 >> 10.20.193.162:0/2670514252 conn(0x7f2f5c073660 msgr2=0x7f2f5c1181e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:08:43.383 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.379+0000 7f2f628a7640 1 -- 10.20.193.162:0/2670514252 shutdown_connections 2026-02-17T11:08:43.383 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.379+0000 7f2f628a7640 1 -- 10.20.193.162:0/2670514252 wait complete. 2026-02-17T11:08:43.383 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.379+0000 7f2f628a7640 1 librados: shutdown 2026-02-17T11:08:43.390 DEBUG:teuthology.orchestra.run.trial162:> sudo ceph --cluster ceph osd new e8ab3e8f-29a8-4c79-bf86-d29543aac56a 14 2026-02-17T11:08:43.456 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.452+0000 7fafb98c7640 10 monclient: get_monmap_and_config 2026-02-17T11:08:43.456 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.452+0000 7fafb98c7640 10 monclient: build_initial_monmap 2026-02-17T11:08:43.456 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.452+0000 7fafb98c7640 10 monclient: monmap: 2026-02-17T11:08:43.456 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-17T11:08:43.456 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:43.456 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:08:43.452897+0000 2026-02-17T11:08:43.456 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:08:43.452897+0000 2026-02-17T11:08:43.456 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-17T11:08:43.457 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:43.457 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:08:43.457 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:08:43.457 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:08:43.457 INFO:teuthology.orchestra.run.trial162.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:08:43.457 INFO:teuthology.orchestra.run.trial162.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:08:43.457 INFO:teuthology.orchestra.run.trial162.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:08:43.457 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:43.457 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.452+0000 7fafb98c7640 1 Processor -- start 2026-02-17T11:08:43.457 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.452+0000 7fafb98c7640 1 -- start start 2026-02-17T11:08:43.457 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.452+0000 7fafb98c7640 10 monclient: init 2026-02-17T11:08:43.457 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.452+0000 7fafb98c7640 10 monclient: _reopen_session rank -1 2026-02-17T11:08:43.458 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.452+0000 7fafb98c7640 10 monclient: _add_conns ranks=[4,1,3,0,2,5] 2026-02-17T11:08:43.458 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.452+0000 7fafb98c7640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7fafb4073830 0x7fafb4073c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:43.458 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.452+0000 7fafb98c7640 10 monclient(hunting): picked mon.noname-b con 0x7fafb4073830 addr v2:10.20.193.97:3300/0 2026-02-17T11:08:43.458 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.452+0000 7fafb98c7640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fafb4074150 addr v1:10.20.193.97:6789/0 2026-02-17T11:08:43.458 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.452+0000 7fafb98c7640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fafb411dd10 0x7fafb41201d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:43.458 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.452+0000 7fafb98c7640 10 monclient(hunting): picked mon.noname-a con 0x7fafb411dd10 addr v2:10.20.193.49:3300/0 2026-02-17T11:08:43.458 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.452+0000 7fafb98c7640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafb41208f0 con 0x7fafb4074150 2026-02-17T11:08:43.458 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.452+0000 7fafb98c7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:43.458 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.452+0000 7fafb98c7640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7fafb4121b10 con 0x7fafb411dd10 2026-02-17T11:08:43.458 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.452+0000 7fafb98c7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:43.458 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.452+0000 7fafb98c7640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7fafb4121c90 con 0x7fafb4073830 2026-02-17T11:08:43.458 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.452+0000 7fafb98c7640 10 monclient(hunting): _renew_subs 2026-02-17T11:08:43.459 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.452+0000 7fafb98c7640 10 monclient(hunting): authenticate will time out at 961.190926s 2026-02-17T11:08:43.459 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.453+0000 7fafb37fe640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fafb411dd10 0x7fafb41201d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:43.459 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.453+0000 7fafb2ffd640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7fafb4073830 0x7fafb4073c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:43.459 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.453+0000 7fafb37fe640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fafb411dd10 0x7fafb41201d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.162:57396/0 (socket says 10.20.193.162:57396) 2026-02-17T11:08:43.459 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.453+0000 7fafb37fe640 1 -- 10.20.193.162:0/3736994610 learned_addr learned my addr 10.20.193.162:0/3736994610 (peer_addr_for_me v2:10.20.193.162:0/0) 2026-02-17T11:08:43.459 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.453+0000 7fafb37fe640 10 monclient(hunting): get_auth_request con 0x7fafb411dd10 auth_method 0 2026-02-17T11:08:43.459 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.453+0000 7fafb37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:43.459 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.453+0000 7fafb37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:43.459 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.453+0000 7fafb37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:43.459 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.453+0000 7fafb37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:43.459 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.453+0000 7fafb37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:43.460 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.453+0000 7fafb37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:43.460 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.453+0000 7fafb2ffd640 10 monclient(hunting): get_auth_request con 0x7fafb4073830 auth_method 0 2026-02-17T11:08:43.460 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.453+0000 7fafb2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:43.460 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.453+0000 7fafb2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:43.460 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.453+0000 7fafb2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:43.460 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.454+0000 7fafb2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:43.460 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.454+0000 7fafb2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:43.460 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.454+0000 7fafb2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:43.460 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.454+0000 7fafb37fe640 10 monclient(hunting): handle_auth_done global_id 4179 payload 274 2026-02-17T11:08:43.460 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.454+0000 7fafb37fe640 1 -- 10.20.193.162:0/3736994610 >> v2:10.20.193.97:3300/0 conn(0x7fafb4073830 msgr2=0x7fafb4073c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:08:43.460 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.454+0000 7fafb37fe640 1 --2- 10.20.193.162:0/3736994610 >> v2:10.20.193.97:3300/0 conn(0x7fafb4073830 0x7fafb4073c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:43.460 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.454+0000 7fafb37fe640 1 -- 10.20.193.162:0/3736994610 >> v1:10.20.193.97:6789/0 conn(0x7fafb4074150 legacy=0x7fafb411c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:43.460 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.454+0000 7fafb37fe640 10 monclient: _finish_hunting 0 2026-02-17T11:08:43.461 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.454+0000 7fafb37fe640 1 monclient: found mon.noname-a 2026-02-17T11:08:43.461 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.454+0000 7fafb37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:08:43.461 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.454+0000 7fafb37fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:08:43.461 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.454+0000 7fafb37fe640 1 -- 10.20.193.162:0/3736994610 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafb4121e40 con 0x7fafb411dd10 2026-02-17T11:08:43.468 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.455+0000 7fafb37fe640 1 --2- 10.20.193.162:0/3736994610 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fafb411dd10 0x7fafb41201d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fafb4076ab0 tx=0x7fafa402f230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f134a39c28f3e8a5 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:08:43.468 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.457+0000 7fafb1ffb640 1 -- 10.20.193.162:0/3736994610 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa402fcf0 con 0x7fafb411dd10 2026-02-17T11:08:43.468 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.457+0000 7fafb1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:43.468 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.457+0000 7fafb1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:08:43.468 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.457+0000 7fafb1ffb640 10 monclient: dump: 2026-02-17T11:08:43.468 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:43.468 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:43.469 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:43.469 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:43.469 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:43.469 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:43.469 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:43.469 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:43.469 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:43.469 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:43.469 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.457+0000 7fafb1ffb640 10 monclient: _finish_auth 0 2026-02-17T11:08:43.469 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.457+0000 7fafb1ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:08:43.469 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.457+0000 7fafb1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:08:43.469 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.457+0000 7fafb98c7640 5 monclient: authenticate success, global_id 4179 2026-02-17T11:08:43.470 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.457+0000 7fafb1ffb640 1 -- 10.20.193.162:0/3736994610 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafa40373f0 con 0x7fafb411dd10 2026-02-17T11:08:43.470 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.457+0000 7fafb1ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:08:43.470 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.457+0000 7fafb98c7640 10 monclient: get_monmap_and_config success 2026-02-17T11:08:43.470 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.457+0000 7fafb98c7640 4 set_mon_vals no callback set 2026-02-17T11:08:43.470 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.457+0000 7fafb1ffb640 1 -- 10.20.193.162:0/3736994610 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa40377c0 con 0x7fafb411dd10 2026-02-17T11:08:43.470 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.457+0000 7fafb1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:43.470 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.457+0000 7fafb1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:08:43.470 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.457+0000 7fafb1ffb640 10 monclient: dump: 2026-02-17T11:08:43.470 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:43.470 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:43.470 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:43.470 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:43.471 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:43.471 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:43.471 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:43.471 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:43.471 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:43.471 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:43.471 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.457+0000 7fafb98c7640 10 monclient: shutdown 2026-02-17T11:08:43.471 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.457+0000 7fafb98c7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:08:43.471 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.457+0000 7fafb98c7640 1 -- 10.20.193.162:0/3736994610 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fafb411dd10 msgr2=0x7fafb41201d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:43.471 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.457+0000 7fafb98c7640 1 --2- 10.20.193.162:0/3736994610 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fafb411dd10 0x7fafb41201d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fafb4076ab0 tx=0x7fafa402f230 comp rx=0 tx=0).stop 2026-02-17T11:08:43.471 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.457+0000 7fafb98c7640 1 -- 10.20.193.162:0/3736994610 shutdown_connections 2026-02-17T11:08:43.471 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.457+0000 7fafb98c7640 1 --2- 10.20.193.162:0/3736994610 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fafb411dd10 0x7fafb41201d0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:43.472 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.457+0000 7fafb98c7640 1 --2- 10.20.193.162:0/3736994610 >> v2:10.20.193.97:3300/0 conn(0x7fafb4073830 0x7fafb4073c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:43.472 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.457+0000 7fafb98c7640 1 -- 10.20.193.162:0/3736994610 >> 10.20.193.162:0/3736994610 conn(0x7fafb406f660 msgr2=0x7fafb4071a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:08:43.472 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.457+0000 7fafb98c7640 1 -- 10.20.193.162:0/3736994610 shutdown_connections 2026-02-17T11:08:43.472 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.457+0000 7fafb98c7640 1 -- 10.20.193.162:0/3736994610 wait complete. 2026-02-17T11:08:43.472 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.457+0000 7fafb98c7640 10 monclient: build_initial_monmap 2026-02-17T11:08:43.472 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.457+0000 7fafb98c7640 10 monclient: monmap: 2026-02-17T11:08:43.472 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-17T11:08:43.472 INFO:teuthology.orchestra.run.trial162.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:08:43.472 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 0.000000 2026-02-17T11:08:43.472 INFO:teuthology.orchestra.run.trial162.stderr:created 0.000000 2026-02-17T11:08:43.472 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-17T11:08:43.473 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:43.473 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:08:43.473 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:08:43.473 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:08:43.473 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:43.473 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.457+0000 7fafb98c7640 1 librados: starting msgr at 2026-02-17T11:08:43.473 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.457+0000 7fafb98c7640 1 librados: starting objecter 2026-02-17T11:08:43.473 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.457+0000 7fafb98c7640 1 Processor -- start 2026-02-17T11:08:43.473 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.457+0000 7fafb98c7640 1 -- start start 2026-02-17T11:08:43.473 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.457+0000 7fafb98c7640 1 librados: setting wanted keys 2026-02-17T11:08:43.473 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.457+0000 7fafb98c7640 1 librados: calling monclient init 2026-02-17T11:08:43.473 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.457+0000 7fafb98c7640 10 monclient: init 2026-02-17T11:08:43.474 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.458+0000 7fafb98c7640 10 monclient: _reopen_session rank -1 2026-02-17T11:08:43.474 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.458+0000 7fafb98c7640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:08:43.474 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.458+0000 7fafb98c7640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fafb4073830 0x7fafb41af0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:43.474 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.458+0000 7fafb98c7640 10 monclient(hunting): picked mon.noname-a con 0x7fafb4073830 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:08:43.474 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.458+0000 7fafb98c7640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fafb4074150 0x7fafb41af720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:43.474 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.458+0000 7fafb98c7640 10 monclient(hunting): picked mon.noname-b con 0x7fafb4074150 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:08:43.474 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.458+0000 7fafb98c7640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fafb411dd10 0x7fafb41a91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:43.474 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.458+0000 7fafb98c7640 10 monclient(hunting): picked mon.noname-c con 0x7fafb411dd10 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:08:43.474 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.458+0000 7fafb98c7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:43.474 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.458+0000 7fafb98c7640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fafb4120f20 con 0x7fafb4073830 2026-02-17T11:08:43.474 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.458+0000 7fafb98c7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:43.474 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.458+0000 7fafb98c7640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fafb4120da0 con 0x7fafb4074150 2026-02-17T11:08:43.475 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.458+0000 7fafb98c7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:43.475 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.458+0000 7fafb98c7640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fafb41210a0 con 0x7fafb411dd10 2026-02-17T11:08:43.475 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.458+0000 7fafb98c7640 10 monclient(hunting): _renew_subs 2026-02-17T11:08:43.475 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.458+0000 7fafb98c7640 10 monclient(hunting): authenticate will time out at 961.196152s 2026-02-17T11:08:43.475 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.458+0000 7fafb2ffd640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fafb4073830 0x7fafb41af0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:43.475 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.458+0000 7fafb27fc640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fafb4074150 0x7fafb41af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:43.475 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.458+0000 7fafb37fe640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fafb411dd10 0x7fafb41a91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:43.475 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.458+0000 7fafb2ffd640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fafb4073830 0x7fafb41af0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.162:57412/0 (socket says 10.20.193.162:57412) 2026-02-17T11:08:43.475 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.458+0000 7fafb2ffd640 1 -- 10.20.193.162:0/2139049862 learned_addr learned my addr 10.20.193.162:0/2139049862 (peer_addr_for_me v2:10.20.193.162:0/0) 2026-02-17T11:08:43.475 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.458+0000 7fafb2ffd640 10 monclient(hunting): get_auth_request con 0x7fafb4073830 auth_method 0 2026-02-17T11:08:43.475 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.458+0000 7fafb2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:43.476 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.458+0000 7fafb2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:43.476 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.458+0000 7fafb2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:43.476 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.458+0000 7fafb27fc640 10 monclient(hunting): get_auth_request con 0x7fafb4074150 auth_method 0 2026-02-17T11:08:43.476 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.458+0000 7fafb27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:43.476 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.458+0000 7fafb27fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:43.476 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.458+0000 7fafb27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:43.476 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.458+0000 7fafb37fe640 10 monclient(hunting): get_auth_request con 0x7fafb411dd10 auth_method 0 2026-02-17T11:08:43.476 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.458+0000 7fafb37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:43.476 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.458+0000 7fafb37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:43.476 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.458+0000 7fafb37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:43.476 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.458+0000 7fafb2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:43.476 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.458+0000 7fafb2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:43.477 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.458+0000 7fafb2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:43.477 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.458+0000 7fafb27fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:43.477 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.458+0000 7fafb27fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:43.477 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.458+0000 7fafb27fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:43.477 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.458+0000 7fafb37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:43.477 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.458+0000 7fafb37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:43.477 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.458+0000 7fafb37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:43.477 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.459+0000 7fafb2ffd640 10 monclient(hunting): handle_auth_done global_id 4182 payload 824 2026-02-17T11:08:43.477 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.459+0000 7fafb2ffd640 1 -- 10.20.193.162:0/2139049862 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fafb411dd10 msgr2=0x7fafb41a91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:43.477 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.459+0000 7fafb2ffd640 1 --2- 10.20.193.162:0/2139049862 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fafb411dd10 0x7fafb41a91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:43.477 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.459+0000 7fafb2ffd640 1 -- 10.20.193.162:0/2139049862 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fafb4074150 msgr2=0x7fafb41af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:43.477 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.459+0000 7fafb2ffd640 1 --2- 10.20.193.162:0/2139049862 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fafb4074150 0x7fafb41af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:43.477 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.459+0000 7fafb2ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:08:43.478 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.459+0000 7fafb2ffd640 1 monclient: found mon.noname-a 2026-02-17T11:08:43.478 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.459+0000 7fafb2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:08:43.478 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.459+0000 7fafb2ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:08:43.478 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.459+0000 7fafb2ffd640 1 -- 10.20.193.162:0/2139049862 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafb41a9a70 con 0x7fafb4073830 2026-02-17T11:08:43.478 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.460+0000 7fafb2ffd640 1 --2- 10.20.193.162:0/2139049862 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fafb4073830 0x7fafb41af0b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fafa800ebe0 tx=0x7fafa800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:08:43.478 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.460+0000 7faf8bfff640 10 client.?.objecter ms_handle_connect 0x7fafb4073830 2026-02-17T11:08:43.478 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.460+0000 7faf8bfff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:08:43.478 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.462+0000 7faf8bfff640 1 -- 10.20.193.162:0/2139049862 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa8017070 con 0x7fafb4073830 2026-02-17T11:08:43.478 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.462+0000 7faf8bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:43.478 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.462+0000 7faf8bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:08:43.478 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.462+0000 7faf8bfff640 10 monclient: dump: 2026-02-17T11:08:43.478 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:43.479 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:43.479 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:43.479 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:43.479 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:43.479 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:43.479 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:43.479 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:43.479 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:43.479 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:43.479 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.462+0000 7faf8bfff640 10 monclient: _finish_auth 0 2026-02-17T11:08:43.479 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.462+0000 7faf8bfff640 10 monclient: _check_auth_tickets 2026-02-17T11:08:43.479 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.462+0000 7faf8bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:08:43.480 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.462+0000 7faf8bfff640 1 -- 10.20.193.162:0/2139049862 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafa800cc40 con 0x7fafb4073830 2026-02-17T11:08:43.480 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.462+0000 7faf8bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:08:43.480 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.462+0000 7faf8bfff640 1 -- 10.20.193.162:0/2139049862 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa8013470 con 0x7fafb4073830 2026-02-17T11:08:43.480 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.462+0000 7faf8bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:43.480 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.462+0000 7faf8bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:08:43.480 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.462+0000 7fafb17fa640 4 set_mon_vals no callback set 2026-02-17T11:08:43.480 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.462+0000 7faf8bfff640 10 monclient: dump: 2026-02-17T11:08:43.480 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:43.480 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:43.480 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:43.480 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:43.480 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:43.481 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:43.481 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:43.481 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:43.481 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:43.481 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:43.481 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.462+0000 7fafb98c7640 5 monclient: authenticate success, global_id 4182 2026-02-17T11:08:43.481 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.462+0000 7fafb98c7640 10 monclient: _renew_subs 2026-02-17T11:08:43.481 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.462+0000 7fafb98c7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:08:43.481 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.462+0000 7fafb98c7640 1 -- 10.20.193.162:0/2139049862 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafb41a9d00 con 0x7fafb4073830 2026-02-17T11:08:43.481 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.462+0000 7fafb98c7640 10 client.4182.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:08:43.481 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.462+0000 7fafb98c7640 10 monclient: _renew_subs 2026-02-17T11:08:43.481 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.462+0000 7fafb98c7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:08:43.482 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.462+0000 7fafb98c7640 1 -- 10.20.193.162:0/2139049862 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafb41b6040 con 0x7fafb4073830 2026-02-17T11:08:43.482 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.462+0000 7fafb98c7640 1 librados: init done 2026-02-17T11:08:43.482 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.463+0000 7fafb98c7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:43.482 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.463+0000 7fafb98c7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:43.482 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.463+0000 7fafb98c7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:08:43.482 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.463+0000 7fafb98c7640 1 -- 10.20.193.162:0/2139049862 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafb4073c10 con 0x7fafb4073830 2026-02-17T11:08:43.568 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.566+0000 7faf8bfff640 1 -- 10.20.193.162:0/2139049862 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 4) ==== 100001+0+0 (secure 0 0 0) 0x7fafa8024060 con 0x7fafb4073830 2026-02-17T11:08:43.569 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.567+0000 7faf8bfff640 1 --2- 10.20.193.162:0/2139049862 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7faf840790b0 0x7faf8407b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:43.569 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.567+0000 7fafb27fc640 1 --2- 10.20.193.162:0/2139049862 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7faf840790b0 0x7faf8407b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:43.569 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.567+0000 7fafb27fc640 10 monclient: get_auth_request con 0x7faf840790b0 auth_method 0 2026-02-17T11:08:43.569 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.568+0000 7fafb27fc640 1 --2- 10.20.193.162:0/2139049862 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7faf840790b0 0x7faf8407b570 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fafb41aec40 tx=0x7faf9c007f30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:08:43.569 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.568+0000 7faf8bfff640 10 client.4182.objecter ms_handle_connect 0x7faf840790b0 2026-02-17T11:08:43.575 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.574+0000 7faf8bfff640 1 -- 10.20.193.162:0/2139049862 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 2335+0+0 (secure 0 0 0) 0x7fafa805e450 con 0x7fafb4073830 2026-02-17T11:08:43.575 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.574+0000 7faf8bfff640 10 client.4182.objecter ms_dispatch2 0x7fafb4000b90 osd_map(16..16 src has 1..16) 2026-02-17T11:08:43.576 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.574+0000 7faf8bfff640 3 client.4182.objecter handle_osd_map got epochs [16,16] > 0 2026-02-17T11:08:43.576 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.574+0000 7faf8bfff640 3 client.4182.objecter handle_osd_map decoding full epoch 16 2026-02-17T11:08:43.576 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.574+0000 7faf8bfff640 20 client.4182.objecter dump_active .. 0 homeless 2026-02-17T11:08:43.576 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.575+0000 7faf8bfff640 1 -- 10.20.193.162:0/2139049862 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fafa8062410 con 0x7fafb4073830 2026-02-17T11:08:43.576 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.575+0000 7faf8bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:43.577 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.575+0000 7faf8bfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:08:43.668 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.667+0000 7fafb98c7640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "e8ab3e8f-29a8-4c79-bf86-d29543aac56a", "id": 14}] 2026-02-17T11:08:43.669 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.667+0000 7fafb98c7640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "e8ab3e8f-29a8-4c79-bf86-d29543aac56a", "id": 14}] 2026-02-17T11:08:43.669 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.667+0000 7fafb98c7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:08:43.669 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.667+0000 7fafb98c7640 1 -- 10.20.193.162:0/2139049862 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e8ab3e8f-29a8-4c79-bf86-d29543aac56a", "id": 14} v 0) -- 0x7fafb41175c0 con 0x7fafb4073830 2026-02-17T11:08:43.686 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.684+0000 7faf8bfff640 1 -- 10.20.193.162:0/2139049862 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e8ab3e8f-29a8-4c79-bf86-d29543aac56a", "id": 14}]=0 v17) ==== 113+0+3 (secure 0 0 0) 0x7fafa8066710 con 0x7fafb4073830 2026-02-17T11:08:43.686 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.684+0000 7faf8bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "e8ab3e8f-29a8-4c79-bf86-d29543aac56a", "id": 14}] 2026-02-17T11:08:43.686 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.684+0000 7faf8bfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:08:43.686 INFO:teuthology.orchestra.run.trial162.stdout:14 2026-02-17T11:08:43.688 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.686+0000 7fafb98c7640 10 librados: watch_flush enter 2026-02-17T11:08:43.688 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.686+0000 7fafb98c7640 10 librados: watch_flush exit 2026-02-17T11:08:43.688 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.686+0000 7fafb98c7640 20 client.4182.objecter shutdown clearing up homeless session... 2026-02-17T11:08:43.689 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.686+0000 7fafb98c7640 10 client.4182.objecter successfully canceled tick 2026-02-17T11:08:43.689 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.686+0000 7fafb98c7640 1 -- 10.20.193.162:0/2139049862 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7faf840790b0 msgr2=0x7faf8407b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:43.689 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.686+0000 7fafb98c7640 1 --2- 10.20.193.162:0/2139049862 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7faf840790b0 0x7faf8407b570 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fafb41aec40 tx=0x7faf9c007f30 comp rx=0 tx=0).stop 2026-02-17T11:08:43.689 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.686+0000 7fafb98c7640 10 monclient: shutdown 2026-02-17T11:08:43.689 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.686+0000 7fafb98c7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:08:43.689 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.686+0000 7fafb98c7640 1 -- 10.20.193.162:0/2139049862 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fafb4073830 msgr2=0x7fafb41af0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:43.689 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.686+0000 7fafb98c7640 1 --2- 10.20.193.162:0/2139049862 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fafb4073830 0x7fafb41af0b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fafa800ebe0 tx=0x7fafa800c520 comp rx=0 tx=0).stop 2026-02-17T11:08:43.689 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.686+0000 7fafb98c7640 1 -- 10.20.193.162:0/2139049862 shutdown_connections 2026-02-17T11:08:43.689 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.686+0000 7fafb98c7640 1 --2- 10.20.193.162:0/2139049862 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7faf840790b0 0x7faf8407b570 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:43.689 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.686+0000 7fafb98c7640 1 --2- 10.20.193.162:0/2139049862 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fafb411dd10 0x7fafb41a91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:43.689 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.686+0000 7fafb98c7640 1 --2- 10.20.193.162:0/2139049862 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fafb4074150 0x7fafb41af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:43.690 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.686+0000 7fafb98c7640 1 --2- 10.20.193.162:0/2139049862 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fafb4073830 0x7fafb41af0b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:43.690 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.686+0000 7fafb98c7640 1 -- 10.20.193.162:0/2139049862 >> 10.20.193.162:0/2139049862 conn(0x7fafb406f660 msgr2=0x7fafb4071580 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:08:43.690 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.686+0000 7fafb98c7640 1 -- 10.20.193.162:0/2139049862 shutdown_connections 2026-02-17T11:08:43.690 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.686+0000 7fafb98c7640 1 -- 10.20.193.162:0/2139049862 wait complete. 2026-02-17T11:08:43.690 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.686+0000 7fafb98c7640 1 librados: shutdown 2026-02-17T11:08:43.695 DEBUG:teuthology.orchestra.run.trial162:> sudo ceph --cluster ceph osd new 300a4696-aa54-4b47-b9f3-87dec719bcfa 15 2026-02-17T11:08:43.762 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.759+0000 7fb936b9e640 10 monclient: get_monmap_and_config 2026-02-17T11:08:43.762 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.759+0000 7fb936b9e640 10 monclient: build_initial_monmap 2026-02-17T11:08:43.762 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.759+0000 7fb936b9e640 10 monclient: monmap: 2026-02-17T11:08:43.762 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-17T11:08:43.762 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:43.762 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:08:43.759824+0000 2026-02-17T11:08:43.762 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:08:43.759824+0000 2026-02-17T11:08:43.762 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-17T11:08:43.762 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:43.763 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:08:43.763 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:08:43.763 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:08:43.763 INFO:teuthology.orchestra.run.trial162.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:08:43.763 INFO:teuthology.orchestra.run.trial162.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:08:43.763 INFO:teuthology.orchestra.run.trial162.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:08:43.763 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:43.763 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.759+0000 7fb936b9e640 1 Processor -- start 2026-02-17T11:08:43.763 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.759+0000 7fb936b9e640 1 -- start start 2026-02-17T11:08:43.763 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.759+0000 7fb936b9e640 10 monclient: init 2026-02-17T11:08:43.763 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.759+0000 7fb936b9e640 10 monclient: _reopen_session rank -1 2026-02-17T11:08:43.764 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.759+0000 7fb936b9e640 10 monclient: _add_conns ranks=[1,3,4,2,0,5] 2026-02-17T11:08:43.764 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.759+0000 7fb936b9e640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fb930073830 addr v1:10.20.193.97:6789/0 2026-02-17T11:08:43.764 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.759+0000 7fb936b9e640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fb930073c10 0x7fb930124350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:43.764 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.759+0000 7fb936b9e640 10 monclient(hunting): picked mon.noname-a con 0x7fb930073c10 addr v2:10.20.193.49:3300/0 2026-02-17T11:08:43.764 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.759+0000 7fb936b9e640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7fb930124890 0x7fb930126c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:43.764 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.759+0000 7fb936b9e640 10 monclient(hunting): picked mon.noname-b con 0x7fb930124890 addr v2:10.20.193.97:3300/0 2026-02-17T11:08:43.764 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.759+0000 7fb936b9e640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9301271c0 con 0x7fb930073830 2026-02-17T11:08:43.764 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.759+0000 7fb936b9e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:43.764 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.759+0000 7fb936b9e640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7fb9301283a0 con 0x7fb930073c10 2026-02-17T11:08:43.764 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.759+0000 7fb936b9e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:43.764 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.759+0000 7fb936b9e640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7fb930128520 con 0x7fb930124890 2026-02-17T11:08:43.764 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.759+0000 7fb936b9e640 10 monclient(hunting): _renew_subs 2026-02-17T11:08:43.765 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.759+0000 7fb936b9e640 10 monclient(hunting): authenticate will time out at 961.497873s 2026-02-17T11:08:43.765 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.760+0000 7fb935114640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7fb930124890 0x7fb930126c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:43.765 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.760+0000 7fb935114640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7fb930124890 0x7fb930126c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.162:48698/0 (socket says 10.20.193.162:48698) 2026-02-17T11:08:43.765 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.760+0000 7fb935114640 1 -- 10.20.193.162:0/961436903 learned_addr learned my addr 10.20.193.162:0/961436903 (peer_addr_for_me v2:10.20.193.162:0/0) 2026-02-17T11:08:43.765 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.760+0000 7fb935114640 10 monclient(hunting): get_auth_request con 0x7fb930124890 auth_method 0 2026-02-17T11:08:43.765 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.760+0000 7fb935114640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:43.765 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.760+0000 7fb935114640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:43.765 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.760+0000 7fb935114640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:43.765 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.760+0000 7fb935114640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:43.765 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.760+0000 7fb935114640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:43.765 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.760+0000 7fb935114640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:43.771 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.761+0000 7fb935114640 10 monclient(hunting): handle_auth_done global_id 4186 payload 274 2026-02-17T11:08:43.771 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.761+0000 7fb935114640 1 -- 10.20.193.162:0/961436903 >> v2:10.20.193.49:3300/0 conn(0x7fb930073c10 msgr2=0x7fb930124350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:08:43.771 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.761+0000 7fb935114640 1 --2- 10.20.193.162:0/961436903 >> v2:10.20.193.49:3300/0 conn(0x7fb930073c10 0x7fb930124350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:43.771 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.761+0000 7fb935114640 1 -- 10.20.193.162:0/961436903 >> v1:10.20.193.97:6789/0 conn(0x7fb930073830 legacy=0x7fb9301181d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:43.771 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.761+0000 7fb935114640 10 monclient: _finish_hunting 0 2026-02-17T11:08:43.771 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.761+0000 7fb935114640 1 monclient: found mon.noname-b 2026-02-17T11:08:43.771 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.761+0000 7fb935114640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:08:43.772 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.761+0000 7fb935114640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:08:43.772 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.761+0000 7fb935114640 1 -- 10.20.193.162:0/961436903 --> v2:10.20.193.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9301286a0 con 0x7fb930124890 2026-02-17T11:08:43.772 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.763+0000 7fb935114640 1 --2- 10.20.193.162:0/961436903 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb930124890 0x7fb930126c80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb9300741a0 tx=0x7fb92c02f230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5e790c4f40865e8 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:08:43.772 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.765+0000 7fb9277fe640 1 -- 10.20.193.162:0/961436903 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb92c02fcf0 con 0x7fb930124890 2026-02-17T11:08:43.772 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.765+0000 7fb9277fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:43.772 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.765+0000 7fb9277fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:08:43.772 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.765+0000 7fb9277fe640 10 monclient: dump: 2026-02-17T11:08:43.772 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:43.772 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:43.772 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:43.772 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:43.772 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:43.773 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:43.773 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:43.773 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:43.773 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:43.773 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:43.773 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.765+0000 7fb9277fe640 10 monclient: _finish_auth 0 2026-02-17T11:08:43.773 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.765+0000 7fb9277fe640 10 monclient: _check_auth_tickets 2026-02-17T11:08:43.773 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.765+0000 7fb9277fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:08:43.773 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.765+0000 7fb9277fe640 1 -- 10.20.193.162:0/961436903 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb92c0373f0 con 0x7fb930124890 2026-02-17T11:08:43.773 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.765+0000 7fb9277fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:08:43.773 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.765+0000 7fb936b9e640 5 monclient: authenticate success, global_id 4186 2026-02-17T11:08:43.773 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.765+0000 7fb9277fe640 1 -- 10.20.193.162:0/961436903 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb92c0377c0 con 0x7fb930124890 2026-02-17T11:08:43.774 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.765+0000 7fb9277fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:43.774 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.765+0000 7fb9277fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:08:43.774 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.765+0000 7fb9277fe640 10 monclient: dump: 2026-02-17T11:08:43.774 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:43.774 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:43.774 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:43.774 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:43.774 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:43.774 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:43.774 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:43.774 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:43.774 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:43.775 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:43.775 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.765+0000 7fb936b9e640 10 monclient: get_monmap_and_config success 2026-02-17T11:08:43.775 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.765+0000 7fb936b9e640 4 set_mon_vals no callback set 2026-02-17T11:08:43.775 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.765+0000 7fb936b9e640 10 monclient: shutdown 2026-02-17T11:08:43.775 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.765+0000 7fb936b9e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:08:43.775 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.765+0000 7fb936b9e640 1 -- 10.20.193.162:0/961436903 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb930124890 msgr2=0x7fb930126c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:43.775 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.765+0000 7fb936b9e640 1 --2- 10.20.193.162:0/961436903 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb930124890 0x7fb930126c80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb9300741a0 tx=0x7fb92c02f230 comp rx=0 tx=0).stop 2026-02-17T11:08:43.775 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.765+0000 7fb936b9e640 1 -- 10.20.193.162:0/961436903 shutdown_connections 2026-02-17T11:08:43.775 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.765+0000 7fb936b9e640 1 --2- 10.20.193.162:0/961436903 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb930124890 0x7fb930126c80 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:43.775 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.765+0000 7fb936b9e640 1 --2- 10.20.193.162:0/961436903 >> v2:10.20.193.49:3300/0 conn(0x7fb930073c10 0x7fb930124350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:43.775 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.765+0000 7fb936b9e640 1 -- 10.20.193.162:0/961436903 >> 10.20.193.162:0/961436903 conn(0x7fb93006f660 msgr2=0x7fb930071a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:08:43.775 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.765+0000 7fb936b9e640 1 -- 10.20.193.162:0/961436903 shutdown_connections 2026-02-17T11:08:43.776 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.765+0000 7fb936b9e640 1 -- 10.20.193.162:0/961436903 wait complete. 2026-02-17T11:08:43.776 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.766+0000 7fb936b9e640 10 monclient: build_initial_monmap 2026-02-17T11:08:43.776 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.766+0000 7fb936b9e640 10 monclient: monmap: 2026-02-17T11:08:43.776 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-17T11:08:43.776 INFO:teuthology.orchestra.run.trial162.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:08:43.776 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 0.000000 2026-02-17T11:08:43.776 INFO:teuthology.orchestra.run.trial162.stderr:created 0.000000 2026-02-17T11:08:43.776 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-17T11:08:43.776 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:43.776 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:08:43.776 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:08:43.776 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:08:43.776 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:43.777 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.766+0000 7fb936b9e640 1 librados: starting msgr at 2026-02-17T11:08:43.777 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.766+0000 7fb936b9e640 1 librados: starting objecter 2026-02-17T11:08:43.777 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.766+0000 7fb936b9e640 1 Processor -- start 2026-02-17T11:08:43.777 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.766+0000 7fb936b9e640 1 -- start start 2026-02-17T11:08:43.777 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.766+0000 7fb936b9e640 1 librados: setting wanted keys 2026-02-17T11:08:43.777 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.766+0000 7fb936b9e640 1 librados: calling monclient init 2026-02-17T11:08:43.777 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.766+0000 7fb936b9e640 10 monclient: init 2026-02-17T11:08:43.777 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.766+0000 7fb936b9e640 10 monclient: _reopen_session rank -1 2026-02-17T11:08:43.777 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.766+0000 7fb936b9e640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:08:43.777 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.766+0000 7fb936b9e640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb930073830 0x7fb9301afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:43.777 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.766+0000 7fb936b9e640 10 monclient(hunting): picked mon.noname-b con 0x7fb930073830 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:08:43.777 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.766+0000 7fb936b9e640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb930073c10 0x7fb9301b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:43.778 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.766+0000 7fb936b9e640 10 monclient(hunting): picked mon.noname-c con 0x7fb930073c10 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:08:43.778 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.766+0000 7fb936b9e640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb930124890 0x7fb9301b4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:43.778 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.766+0000 7fb936b9e640 10 monclient(hunting): picked mon.noname-a con 0x7fb930124890 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:08:43.778 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.766+0000 7fb936b9e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:43.778 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.766+0000 7fb936b9e640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb9301277b0 con 0x7fb930124890 2026-02-17T11:08:43.778 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.766+0000 7fb936b9e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:43.778 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.766+0000 7fb936b9e640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb930127630 con 0x7fb930073830 2026-02-17T11:08:43.778 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.766+0000 7fb936b9e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:43.778 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.766+0000 7fb936b9e640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb930127930 con 0x7fb930073c10 2026-02-17T11:08:43.778 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.766+0000 7fb936b9e640 10 monclient(hunting): _renew_subs 2026-02-17T11:08:43.778 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.766+0000 7fb936b9e640 10 monclient(hunting): authenticate will time out at 961.504500s 2026-02-17T11:08:43.778 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.766+0000 7fb934913640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb930073830 0x7fb9301afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:43.779 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.766+0000 7fb927fff640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb930073c10 0x7fb9301b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:43.779 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.766+0000 7fb934913640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb930073830 0x7fb9301afdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.162:48714/0 (socket says 10.20.193.162:48714) 2026-02-17T11:08:43.779 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.766+0000 7fb934913640 1 -- 10.20.193.162:0/1204348107 learned_addr learned my addr 10.20.193.162:0/1204348107 (peer_addr_for_me v2:10.20.193.162:0/0) 2026-02-17T11:08:43.779 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.766+0000 7fb934913640 10 monclient(hunting): get_auth_request con 0x7fb930073830 auth_method 0 2026-02-17T11:08:43.779 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.766+0000 7fb934913640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:43.779 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.766+0000 7fb934913640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:43.779 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.766+0000 7fb934913640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:43.779 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.767+0000 7fb927fff640 10 monclient(hunting): get_auth_request con 0x7fb930073c10 auth_method 0 2026-02-17T11:08:43.779 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.767+0000 7fb927fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:43.779 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.767+0000 7fb927fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:43.779 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.767+0000 7fb927fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:43.779 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.767+0000 7fb934913640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:43.780 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.767+0000 7fb934913640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:43.780 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.767+0000 7fb934913640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:43.780 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.767+0000 7fb927fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:43.780 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.767+0000 7fb927fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:43.780 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.767+0000 7fb927fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:43.780 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.768+0000 7fb934913640 10 monclient(hunting): handle_auth_done global_id 4192 payload 824 2026-02-17T11:08:43.780 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.768+0000 7fb934913640 1 -- 10.20.193.162:0/1204348107 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb930073c10 msgr2=0x7fb9301b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:43.780 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.768+0000 7fb934913640 1 --2- 10.20.193.162:0/1204348107 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb930073c10 0x7fb9301b02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:43.780 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.768+0000 7fb934913640 1 -- 10.20.193.162:0/1204348107 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb930124890 msgr2=0x7fb9301b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:43.780 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.768+0000 7fb934913640 1 --2- 10.20.193.162:0/1204348107 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb930124890 0x7fb9301b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:43.780 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.768+0000 7fb934913640 10 monclient: _finish_hunting 0 2026-02-17T11:08:43.780 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.768+0000 7fb934913640 1 monclient: found mon.noname-b 2026-02-17T11:08:43.780 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.768+0000 7fb934913640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:08:43.781 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.768+0000 7fb934913640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:08:43.781 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.768+0000 7fb934913640 1 -- 10.20.193.162:0/1204348107 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9301b4d10 con 0x7fb930073830 2026-02-17T11:08:43.781 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.769+0000 7fb934913640 1 --2- 10.20.193.162:0/1204348107 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb930073830 0x7fb9301afdb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb92000c580 tx=0x7fb92000ca50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:08:43.781 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.769+0000 7fb9257fa640 10 client.?.objecter ms_handle_connect 0x7fb930073830 2026-02-17T11:08:43.781 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.769+0000 7fb9257fa640 10 client.?.objecter resend_mon_ops 2026-02-17T11:08:43.783 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.770+0000 7fb9257fa640 1 -- 10.20.193.162:0/1204348107 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb920017070 con 0x7fb930073830 2026-02-17T11:08:43.783 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.770+0000 7fb9257fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:43.783 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.770+0000 7fb9257fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:08:43.783 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.770+0000 7fb9257fa640 10 monclient: dump: 2026-02-17T11:08:43.783 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:43.783 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:43.783 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:43.783 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:43.783 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:43.784 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:43.784 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:43.784 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:43.784 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:43.784 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:43.784 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.770+0000 7fb9257fa640 10 monclient: _finish_auth 0 2026-02-17T11:08:43.784 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.770+0000 7fb9257fa640 10 monclient: _check_auth_tickets 2026-02-17T11:08:43.784 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.770+0000 7fb9257fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:08:43.784 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.770+0000 7fb9257fa640 1 -- 10.20.193.162:0/1204348107 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9200052d0 con 0x7fb930073830 2026-02-17T11:08:43.784 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.770+0000 7fb9257fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:08:43.784 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.770+0000 7fb9257fa640 1 -- 10.20.193.162:0/1204348107 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9200036b0 con 0x7fb930073830 2026-02-17T11:08:43.784 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.770+0000 7fb9257fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:43.785 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.770+0000 7fb9257fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:08:43.785 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.770+0000 7fb926ffd640 4 set_mon_vals no callback set 2026-02-17T11:08:43.785 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.770+0000 7fb9257fa640 10 monclient: dump: 2026-02-17T11:08:43.785 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-17T11:08:43.785 INFO:teuthology.orchestra.run.trial162.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:43.785 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:43.785 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:43.785 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:43.785 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-17T11:08:43.785 INFO:teuthology.orchestra.run.trial162.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:43.785 INFO:teuthology.orchestra.run.trial162.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:43.785 INFO:teuthology.orchestra.run.trial162.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:43.786 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:08:43.786 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.770+0000 7fb936b9e640 5 monclient: authenticate success, global_id 4192 2026-02-17T11:08:43.786 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.770+0000 7fb936b9e640 10 monclient: _renew_subs 2026-02-17T11:08:43.786 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.770+0000 7fb936b9e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:08:43.786 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.770+0000 7fb936b9e640 1 -- 10.20.193.162:0/1204348107 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9301b5000 con 0x7fb930073830 2026-02-17T11:08:43.786 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.771+0000 7fb936b9e640 10 client.4192.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:08:43.786 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.771+0000 7fb936b9e640 10 monclient: _renew_subs 2026-02-17T11:08:43.786 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.771+0000 7fb936b9e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:08:43.786 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.771+0000 7fb936b9e640 1 -- 10.20.193.162:0/1204348107 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9301bc760 con 0x7fb930073830 2026-02-17T11:08:43.786 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.771+0000 7fb936b9e640 1 librados: init done 2026-02-17T11:08:43.786 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.771+0000 7fb936b9e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:43.786 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.771+0000 7fb936b9e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:43.787 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.771+0000 7fb936b9e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:08:43.787 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.771+0000 7fb936b9e640 1 -- 10.20.193.162:0/1204348107 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb930127d70 con 0x7fb930073830 2026-02-17T11:08:43.788 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.783+0000 7fb9257fa640 1 -- 10.20.193.162:0/1204348107 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 4) ==== 100001+0+0 (secure 0 0 0) 0x7fb920003850 con 0x7fb930073830 2026-02-17T11:08:43.788 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.784+0000 7fb9257fa640 1 --2- 10.20.193.162:0/1204348107 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb900079100 0x7fb90007b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:43.788 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.784+0000 7fb927fff640 1 --2- 10.20.193.162:0/1204348107 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb900079100 0x7fb90007b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:43.788 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.784+0000 7fb927fff640 10 monclient: get_auth_request con 0x7fb900079100 auth_method 0 2026-02-17T11:08:43.788 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.784+0000 7fb9257fa640 10 client.4192.objecter ms_handle_connect 0x7fb900079100 2026-02-17T11:08:43.788 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.784+0000 7fb927fff640 1 --2- 10.20.193.162:0/1204348107 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb900079100 0x7fb90007b5c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb9301afb10 tx=0x7fb918009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:08:43.889 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.887+0000 7fb9257fa640 1 -- 10.20.193.162:0/1204348107 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2450+0+0 (secure 0 0 0) 0x7fb92005d3e0 con 0x7fb930073830 2026-02-17T11:08:43.889 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.887+0000 7fb9257fa640 10 client.4192.objecter ms_dispatch2 0x7fb930000b90 osd_map(17..17 src has 1..17) 2026-02-17T11:08:43.889 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.887+0000 7fb9257fa640 3 client.4192.objecter handle_osd_map got epochs [17,17] > 0 2026-02-17T11:08:43.889 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.887+0000 7fb9257fa640 3 client.4192.objecter handle_osd_map decoding full epoch 17 2026-02-17T11:08:43.889 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.887+0000 7fb9257fa640 20 client.4192.objecter dump_active .. 0 homeless 2026-02-17T11:08:43.890 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.889+0000 7fb9257fa640 1 -- 10.20.193.162:0/1204348107 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb920021080 con 0x7fb930073830 2026-02-17T11:08:43.890 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.889+0000 7fb9257fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:43.891 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.889+0000 7fb9257fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:08:43.979 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.977+0000 7fb936b9e640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "300a4696-aa54-4b47-b9f3-87dec719bcfa", "id": 15}] 2026-02-17T11:08:43.979 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.977+0000 7fb936b9e640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "300a4696-aa54-4b47-b9f3-87dec719bcfa", "id": 15}] 2026-02-17T11:08:43.979 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.977+0000 7fb936b9e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:08:43.979 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:43.977+0000 7fb936b9e640 1 -- 10.20.193.162:0/1204348107 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "osd new", "uuid": "300a4696-aa54-4b47-b9f3-87dec719bcfa", "id": 15} v 0) -- 0x7fb9301bc9f0 con 0x7fb930073830 2026-02-17T11:08:44.027 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:44.026+0000 7fb9257fa640 1 -- 10.20.193.162:0/1204348107 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "300a4696-aa54-4b47-b9f3-87dec719bcfa", "id": 15}]=0 v18) ==== 113+0+3 (secure 0 0 0) 0x7fb9200613a0 con 0x7fb930073830 2026-02-17T11:08:44.028 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:44.026+0000 7fb9257fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "300a4696-aa54-4b47-b9f3-87dec719bcfa", "id": 15}] 2026-02-17T11:08:44.028 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:44.026+0000 7fb9257fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:08:44.028 INFO:teuthology.orchestra.run.trial162.stdout:15 2026-02-17T11:08:44.030 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:44.027+0000 7fb936b9e640 10 librados: watch_flush enter 2026-02-17T11:08:44.030 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:44.027+0000 7fb936b9e640 10 librados: watch_flush exit 2026-02-17T11:08:44.030 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:44.027+0000 7fb936b9e640 20 client.4192.objecter shutdown clearing up homeless session... 2026-02-17T11:08:44.030 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:44.027+0000 7fb936b9e640 10 client.4192.objecter successfully canceled tick 2026-02-17T11:08:44.030 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:44.027+0000 7fb936b9e640 1 -- 10.20.193.162:0/1204348107 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb900079100 msgr2=0x7fb90007b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:44.030 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:44.027+0000 7fb936b9e640 1 --2- 10.20.193.162:0/1204348107 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb900079100 0x7fb90007b5c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb9301afb10 tx=0x7fb918009210 comp rx=0 tx=0).stop 2026-02-17T11:08:44.030 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:44.027+0000 7fb936b9e640 10 monclient: shutdown 2026-02-17T11:08:44.031 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:44.027+0000 7fb936b9e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:08:44.031 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:44.027+0000 7fb936b9e640 1 -- 10.20.193.162:0/1204348107 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb930073830 msgr2=0x7fb9301afdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:44.031 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:44.027+0000 7fb936b9e640 1 --2- 10.20.193.162:0/1204348107 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb930073830 0x7fb9301afdb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb92000c580 tx=0x7fb92000ca50 comp rx=0 tx=0).stop 2026-02-17T11:08:44.031 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:44.027+0000 7fb936b9e640 1 -- 10.20.193.162:0/1204348107 shutdown_connections 2026-02-17T11:08:44.031 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:44.027+0000 7fb936b9e640 1 --2- 10.20.193.162:0/1204348107 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb900079100 0x7fb90007b5c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:44.031 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:44.027+0000 7fb936b9e640 1 --2- 10.20.193.162:0/1204348107 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb930124890 0x7fb9301b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:44.031 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:44.027+0000 7fb936b9e640 1 --2- 10.20.193.162:0/1204348107 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb930073c10 0x7fb9301b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:44.031 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:44.027+0000 7fb936b9e640 1 --2- 10.20.193.162:0/1204348107 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb930073830 0x7fb9301afdb0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:44.031 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:44.027+0000 7fb936b9e640 1 -- 10.20.193.162:0/1204348107 >> 10.20.193.162:0/1204348107 conn(0x7fb93006f660 msgr2=0x7fb930121b30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:08:44.031 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:44.027+0000 7fb936b9e640 1 -- 10.20.193.162:0/1204348107 shutdown_connections 2026-02-17T11:08:44.032 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:44.027+0000 7fb936b9e640 1 -- 10.20.193.162:0/1204348107 wait complete. 2026-02-17T11:08:44.032 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-17T11:08:44.027+0000 7fb936b9e640 1 librados: shutdown 2026-02-17T11:08:44.038 DEBUG:tasks.ceph_manager:running osd.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.0.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T11:08:44.038 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-17T11:08:44.039 DEBUG:teuthology.orchestra.run.trial049:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 0 2026-02-17T11:08:44.041 INFO:tasks.ceph.osd.0:Started 2026-02-17T11:08:44.041 DEBUG:tasks.ceph_manager:running osd.4 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.4.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T11:08:44.041 INFO:tasks.ceph.osd.4:Restarting daemon 2026-02-17T11:08:44.042 DEBUG:teuthology.orchestra.run.trial049:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.4.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 4 2026-02-17T11:08:44.044 INFO:tasks.ceph.osd.4:Started 2026-02-17T11:08:44.044 DEBUG:tasks.ceph_manager:running osd.8 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.8.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T11:08:44.044 INFO:tasks.ceph.osd.8:Restarting daemon 2026-02-17T11:08:44.045 DEBUG:teuthology.orchestra.run.trial049:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.8.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 8 2026-02-17T11:08:44.047 INFO:tasks.ceph.osd.8:Started 2026-02-17T11:08:44.047 DEBUG:tasks.ceph_manager:running osd.12 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.12.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T11:08:44.047 INFO:tasks.ceph.osd.12:Restarting daemon 2026-02-17T11:08:44.047 DEBUG:teuthology.orchestra.run.trial049:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.12.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 12 2026-02-17T11:08:44.049 INFO:tasks.ceph.osd.12:Started 2026-02-17T11:08:44.050 DEBUG:tasks.ceph_manager:running osd.1 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.1.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T11:08:44.050 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-17T11:08:44.050 DEBUG:teuthology.orchestra.run.trial097:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.1.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 1 2026-02-17T11:08:44.052 INFO:tasks.ceph.osd.1:Started 2026-02-17T11:08:44.052 DEBUG:tasks.ceph_manager:running osd.5 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.5.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T11:08:44.052 INFO:tasks.ceph.osd.5:Restarting daemon 2026-02-17T11:08:44.052 DEBUG:teuthology.orchestra.run.trial097:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.5.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 5 2026-02-17T11:08:44.054 INFO:tasks.ceph.osd.5:Started 2026-02-17T11:08:44.054 DEBUG:tasks.ceph_manager:running osd.9 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.9.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T11:08:44.054 INFO:tasks.ceph.osd.9:Restarting daemon 2026-02-17T11:08:44.054 DEBUG:teuthology.orchestra.run.trial097:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.9.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 9 2026-02-17T11:08:44.055 INFO:tasks.ceph.osd.9:Started 2026-02-17T11:08:44.055 DEBUG:tasks.ceph_manager:running osd.13 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.13.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T11:08:44.055 INFO:tasks.ceph.osd.13:Restarting daemon 2026-02-17T11:08:44.055 DEBUG:teuthology.orchestra.run.trial097:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.13.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 13 2026-02-17T11:08:44.122 INFO:tasks.ceph.osd.13:Started 2026-02-17T11:08:44.122 DEBUG:tasks.ceph_manager:running osd.2 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.2.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T11:08:44.122 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-17T11:08:44.122 DEBUG:teuthology.orchestra.run.trial157:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.2.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 2 2026-02-17T11:08:44.124 INFO:tasks.ceph.osd.2:Started 2026-02-17T11:08:44.124 DEBUG:tasks.ceph_manager:running osd.6 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.6.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T11:08:44.124 INFO:tasks.ceph.osd.6:Restarting daemon 2026-02-17T11:08:44.124 DEBUG:teuthology.orchestra.run.trial157:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.6.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 6 2026-02-17T11:08:44.125 INFO:tasks.ceph.osd.6:Started 2026-02-17T11:08:44.125 DEBUG:tasks.ceph_manager:running osd.10 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.10.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T11:08:44.125 INFO:tasks.ceph.osd.10:Restarting daemon 2026-02-17T11:08:44.126 DEBUG:teuthology.orchestra.run.trial157:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.10.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 10 2026-02-17T11:08:44.127 INFO:tasks.ceph.osd.10:Started 2026-02-17T11:08:44.127 DEBUG:tasks.ceph_manager:running osd.14 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.14.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T11:08:44.127 INFO:tasks.ceph.osd.14:Restarting daemon 2026-02-17T11:08:44.127 DEBUG:teuthology.orchestra.run.trial157:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.14.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 14 2026-02-17T11:08:44.128 INFO:tasks.ceph.osd.14:Started 2026-02-17T11:08:44.128 DEBUG:tasks.ceph_manager:running osd.3 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.3.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T11:08:44.128 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-17T11:08:44.129 DEBUG:teuthology.orchestra.run.trial162:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.3.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 3 2026-02-17T11:08:44.130 INFO:tasks.ceph.osd.3:Started 2026-02-17T11:08:44.130 DEBUG:tasks.ceph_manager:running osd.7 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.7.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T11:08:44.131 INFO:tasks.ceph.osd.7:Restarting daemon 2026-02-17T11:08:44.131 DEBUG:teuthology.orchestra.run.trial162:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.7.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 7 2026-02-17T11:08:44.133 INFO:tasks.ceph.osd.7:Started 2026-02-17T11:08:44.133 DEBUG:tasks.ceph_manager:running osd.11 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.11.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T11:08:44.133 INFO:tasks.ceph.osd.11:Restarting daemon 2026-02-17T11:08:44.133 DEBUG:teuthology.orchestra.run.trial162:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.11.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 11 2026-02-17T11:08:44.135 INFO:tasks.ceph.osd.11:Started 2026-02-17T11:08:44.135 DEBUG:tasks.ceph_manager:running osd.15 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.15.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T11:08:44.135 INFO:tasks.ceph.osd.15:Restarting daemon 2026-02-17T11:08:44.135 DEBUG:teuthology.orchestra.run.trial162:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.15.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 15 2026-02-17T11:08:44.137 INFO:tasks.ceph.osd.15:Started 2026-02-17T11:08:44.137 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:08:44.203 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.202+0000 7fc9575bc640 10 monclient: get_monmap_and_config 2026-02-17T11:08:44.203 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.202+0000 7fc9575bc640 10 monclient: build_initial_monmap 2026-02-17T11:08:44.204 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.202+0000 7fc9575bc640 10 monclient: monmap: 2026-02-17T11:08:44.204 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:08:44.204 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:44.204 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:08:44.202787+0000 2026-02-17T11:08:44.204 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:08:44.202787+0000 2026-02-17T11:08:44.204 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:08:44.204 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:08:44.204 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:08:44.204 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:08:44.204 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:08:44.204 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:08:44.204 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:08:44.205 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:08:44.205 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:08:44.207 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.202+0000 7fc9575bc640 1 Processor -- start 2026-02-17T11:08:44.207 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.202+0000 7fc9575bc640 1 -- start start 2026-02-17T11:08:44.207 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.202+0000 7fc9575bc640 10 monclient: init 2026-02-17T11:08:44.207 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.203+0000 7fc9575bc640 10 monclient: _reopen_session rank -1 2026-02-17T11:08:44.207 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.203+0000 7fc9575bc640 10 monclient: _add_conns ranks=[5,3,4,2,1,0] 2026-02-17T11:08:44.207 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.203+0000 7fc9575bc640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7fc9501561c0 0x7fc9500cb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:44.207 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.203+0000 7fc9575bc640 10 monclient(hunting): picked mon.noname-c con 0x7fc9501561c0 addr v2:10.20.193.157:3300/0 2026-02-17T11:08:44.207 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.203+0000 7fc9575bc640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fc95006e5b0 0x7fc9500c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:44.207 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.203+0000 7fc9575bc640 10 monclient(hunting): picked mon.noname-a con 0x7fc95006e5b0 addr v2:10.20.193.49:3300/0 2026-02-17T11:08:44.207 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.203+0000 7fc9575bc640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7fc9500ca020 0x7fc95015bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:44.207 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.203+0000 7fc9575bc640 10 monclient(hunting): picked mon.noname-b con 0x7fc9500ca020 addr v2:10.20.193.97:3300/0 2026-02-17T11:08:44.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.203+0000 7fc9575bc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:44.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.203+0000 7fc9575bc640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7fc9500c8db0 con 0x7fc95006e5b0 2026-02-17T11:08:44.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.203+0000 7fc9575bc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:44.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.203+0000 7fc9575bc640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7fc9500c9650 con 0x7fc9500ca020 2026-02-17T11:08:44.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.203+0000 7fc9575bc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:44.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.203+0000 7fc9575bc640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7fc9500cee70 con 0x7fc9501561c0 2026-02-17T11:08:44.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.203+0000 7fc9575bc640 10 monclient(hunting): _renew_subs 2026-02-17T11:08:44.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.203+0000 7fc9575bc640 10 monclient(hunting): authenticate will time out at 1000.866522s 2026-02-17T11:08:44.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.203+0000 7fc954b30640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fc95006e5b0 0x7fc9500c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:44.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.204+0000 7fc955b32640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7fc9500ca020 0x7fc95015bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:44.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.204+0000 7fc955331640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7fc9501561c0 0x7fc9500cb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:44.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.204+0000 7fc954b30640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fc95006e5b0 0x7fc9500c9ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:55446/0 (socket says 10.20.193.49:55446) 2026-02-17T11:08:44.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.204+0000 7fc954b30640 1 -- 10.20.193.49:0/541326446 learned_addr learned my addr 10.20.193.49:0/541326446 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:08:44.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.204+0000 7fc954b30640 10 monclient(hunting): get_auth_request con 0x7fc95006e5b0 auth_method 0 2026-02-17T11:08:44.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.204+0000 7fc954b30640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:44.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.204+0000 7fc954b30640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:44.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.204+0000 7fc954b30640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:44.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.204+0000 7fc955331640 10 monclient(hunting): get_auth_request con 0x7fc9501561c0 auth_method 0 2026-02-17T11:08:44.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.204+0000 7fc955331640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:44.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.204+0000 7fc955331640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:44.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.204+0000 7fc955331640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:44.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.204+0000 7fc954b30640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:44.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.204+0000 7fc954b30640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:44.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.204+0000 7fc954b30640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:44.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.204+0000 7fc955b32640 10 monclient(hunting): get_auth_request con 0x7fc9500ca020 auth_method 0 2026-02-17T11:08:44.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.204+0000 7fc955b32640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:44.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.204+0000 7fc955b32640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:44.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.204+0000 7fc955b32640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:44.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.204+0000 7fc955331640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:44.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.204+0000 7fc955331640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:44.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.204+0000 7fc955331640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:44.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.205+0000 7fc955b32640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:44.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.205+0000 7fc955b32640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:44.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.205+0000 7fc955b32640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:44.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.205+0000 7fc954b30640 10 monclient(hunting): handle_auth_done global_id 4185 payload 274 2026-02-17T11:08:44.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.205+0000 7fc954b30640 1 -- 10.20.193.49:0/541326446 >> v2:10.20.193.157:3300/0 conn(0x7fc9501561c0 msgr2=0x7fc9500cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:08:44.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.205+0000 7fc954b30640 1 --2- 10.20.193.49:0/541326446 >> v2:10.20.193.157:3300/0 conn(0x7fc9501561c0 0x7fc9500cb7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:44.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.205+0000 7fc954b30640 1 -- 10.20.193.49:0/541326446 >> v2:10.20.193.97:3300/0 conn(0x7fc9500ca020 msgr2=0x7fc95015bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:08:44.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.205+0000 7fc954b30640 1 --2- 10.20.193.49:0/541326446 >> v2:10.20.193.97:3300/0 conn(0x7fc9500ca020 0x7fc95015bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:44.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.205+0000 7fc954b30640 10 monclient: _finish_hunting 0 2026-02-17T11:08:44.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.205+0000 7fc954b30640 1 monclient: found mon.noname-a 2026-02-17T11:08:44.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.205+0000 7fc954b30640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:08:44.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.205+0000 7fc954b30640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:08:44.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.205+0000 7fc954b30640 1 -- 10.20.193.49:0/541326446 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9500cbce0 con 0x7fc95006e5b0 2026-02-17T11:08:44.210 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.207+0000 7fc954b30640 1 --2- 10.20.193.49:0/541326446 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc95006e5b0 0x7fc9500c9ae0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc950051320 tx=0x7fc94402ef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=566d86e887b357f5 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:08:44.212 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.210+0000 7fc93ffff640 1 -- 10.20.193.49:0/541326446 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc94403c070 con 0x7fc95006e5b0 2026-02-17T11:08:44.212 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.210+0000 7fc93ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:44.212 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.210+0000 7fc93ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:08:44.212 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.210+0000 7fc93ffff640 10 monclient: dump: 2026-02-17T11:08:44.212 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:08:44.212 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:44.212 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:44.212 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:44.213 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:44.213 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:08:44.213 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:44.213 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:44.213 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:44.213 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:08:44.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.210+0000 7fc93ffff640 10 monclient: _finish_auth 0 2026-02-17T11:08:44.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.210+0000 7fc93ffff640 10 monclient: _check_auth_tickets 2026-02-17T11:08:44.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.210+0000 7fc93ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:08:44.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.210+0000 7fc93ffff640 1 -- 10.20.193.49:0/541326446 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc94402fbd0 con 0x7fc95006e5b0 2026-02-17T11:08:44.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.210+0000 7fc93ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:08:44.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.210+0000 7fc93ffff640 1 -- 10.20.193.49:0/541326446 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc944037440 con 0x7fc95006e5b0 2026-02-17T11:08:44.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.210+0000 7fc9575bc640 5 monclient: authenticate success, global_id 4185 2026-02-17T11:08:44.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.210+0000 7fc93ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:44.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.210+0000 7fc93ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:08:44.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.210+0000 7fc93ffff640 10 monclient: dump: 2026-02-17T11:08:44.213 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:08:44.213 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:44.213 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:44.213 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:44.214 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:44.214 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:08:44.214 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:44.214 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:44.214 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:44.214 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:08:44.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.210+0000 7fc9575bc640 10 monclient: get_monmap_and_config success 2026-02-17T11:08:44.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.210+0000 7fc9575bc640 4 set_mon_vals no callback set 2026-02-17T11:08:44.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.210+0000 7fc9575bc640 10 monclient: shutdown 2026-02-17T11:08:44.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.210+0000 7fc9575bc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:08:44.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.210+0000 7fc9575bc640 1 -- 10.20.193.49:0/541326446 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc95006e5b0 msgr2=0x7fc9500c9ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:44.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.210+0000 7fc9575bc640 1 --2- 10.20.193.49:0/541326446 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc95006e5b0 0x7fc9500c9ae0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc950051320 tx=0x7fc94402ef50 comp rx=0 tx=0).stop 2026-02-17T11:08:44.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.210+0000 7fc9575bc640 1 -- 10.20.193.49:0/541326446 shutdown_connections 2026-02-17T11:08:44.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.210+0000 7fc9575bc640 1 --2- 10.20.193.49:0/541326446 >> v2:10.20.193.97:3300/0 conn(0x7fc9500ca020 0x7fc95015bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:44.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.210+0000 7fc9575bc640 1 --2- 10.20.193.49:0/541326446 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc95006e5b0 0x7fc9500c9ae0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:44.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.210+0000 7fc9575bc640 1 --2- 10.20.193.49:0/541326446 >> v2:10.20.193.157:3300/0 conn(0x7fc9501561c0 0x7fc9500cb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:44.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.210+0000 7fc9575bc640 1 -- 10.20.193.49:0/541326446 >> 10.20.193.49:0/541326446 conn(0x7fc95006da90 msgr2=0x7fc95006dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:08:44.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.210+0000 7fc9575bc640 1 -- 10.20.193.49:0/541326446 shutdown_connections 2026-02-17T11:08:44.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.210+0000 7fc9575bc640 1 -- 10.20.193.49:0/541326446 wait complete. 2026-02-17T11:08:44.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.211+0000 7fc9575bc640 10 monclient: build_initial_monmap 2026-02-17T11:08:44.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.211+0000 7fc9575bc640 10 monclient: monmap: 2026-02-17T11:08:44.215 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:08:44.215 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:08:44.215 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:08:44.215 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:08:44.215 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:08:44.215 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:08:44.215 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:08:44.215 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:08:44.215 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:08:44.215 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:08:44.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.211+0000 7fc9575bc640 1 librados: starting msgr at 2026-02-17T11:08:44.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.211+0000 7fc9575bc640 1 librados: starting objecter 2026-02-17T11:08:44.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.211+0000 7fc9575bc640 1 Processor -- start 2026-02-17T11:08:44.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.211+0000 7fc9575bc640 1 -- start start 2026-02-17T11:08:44.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.211+0000 7fc9575bc640 1 librados: setting wanted keys 2026-02-17T11:08:44.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.211+0000 7fc9575bc640 1 librados: calling monclient init 2026-02-17T11:08:44.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.211+0000 7fc9575bc640 10 monclient: init 2026-02-17T11:08:44.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.211+0000 7fc9575bc640 10 monclient: _reopen_session rank -1 2026-02-17T11:08:44.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.211+0000 7fc9575bc640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:08:44.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.211+0000 7fc9575bc640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc95006e5b0 0x7fc9501f43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:44.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.211+0000 7fc9575bc640 10 monclient(hunting): picked mon.noname-a con 0x7fc95006e5b0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:08:44.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.211+0000 7fc9575bc640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc9500ca020 0x7fc95014dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:44.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.211+0000 7fc9575bc640 10 monclient(hunting): picked mon.noname-b con 0x7fc9500ca020 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:08:44.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.211+0000 7fc9575bc640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc9501561c0 0x7fc950146530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:44.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.211+0000 7fc9575bc640 10 monclient(hunting): picked mon.noname-c con 0x7fc9501561c0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:08:44.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.211+0000 7fc9575bc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:44.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.211+0000 7fc9575bc640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc9500c92e0 con 0x7fc95006e5b0 2026-02-17T11:08:44.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.211+0000 7fc9575bc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:44.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.211+0000 7fc9575bc640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc9500c9000 con 0x7fc9500ca020 2026-02-17T11:08:44.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.211+0000 7fc9575bc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:44.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.211+0000 7fc9575bc640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc9501565a0 con 0x7fc9501561c0 2026-02-17T11:08:44.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.211+0000 7fc9575bc640 10 monclient(hunting): _renew_subs 2026-02-17T11:08:44.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.211+0000 7fc9575bc640 10 monclient(hunting): authenticate will time out at 1000.874832s 2026-02-17T11:08:44.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.212+0000 7fc955331640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc95006e5b0 0x7fc9501f43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:44.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.212+0000 7fc955b32640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc9501561c0 0x7fc950146530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:44.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.212+0000 7fc954b30640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc9500ca020 0x7fc95014dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:44.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.212+0000 7fc955331640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc95006e5b0 0x7fc9501f43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:55450/0 (socket says 10.20.193.49:55450) 2026-02-17T11:08:44.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.212+0000 7fc955331640 1 -- 10.20.193.49:0/1324039756 learned_addr learned my addr 10.20.193.49:0/1324039756 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:08:44.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.212+0000 7fc955331640 10 monclient(hunting): get_auth_request con 0x7fc95006e5b0 auth_method 0 2026-02-17T11:08:44.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.212+0000 7fc955331640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:44.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.212+0000 7fc955331640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:44.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.212+0000 7fc955331640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:44.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.212+0000 7fc955b32640 10 monclient(hunting): get_auth_request con 0x7fc9501561c0 auth_method 0 2026-02-17T11:08:44.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.212+0000 7fc955b32640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:44.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.212+0000 7fc955b32640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:44.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.212+0000 7fc955b32640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:44.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.212+0000 7fc954b30640 10 monclient(hunting): get_auth_request con 0x7fc9500ca020 auth_method 0 2026-02-17T11:08:44.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.212+0000 7fc954b30640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:44.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.212+0000 7fc954b30640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:44.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.212+0000 7fc954b30640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:44.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.212+0000 7fc955331640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:44.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.212+0000 7fc955331640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:44.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.212+0000 7fc955331640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:44.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.212+0000 7fc955b32640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:44.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.212+0000 7fc955b32640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:44.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.212+0000 7fc955b32640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:44.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.212+0000 7fc954b30640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:44.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.212+0000 7fc954b30640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:44.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.212+0000 7fc954b30640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:44.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.214+0000 7fc955b32640 10 monclient(hunting): handle_auth_done global_id 4208 payload 824 2026-02-17T11:08:44.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.214+0000 7fc955b32640 1 -- 10.20.193.49:0/1324039756 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc9500ca020 msgr2=0x7fc95014dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:44.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.214+0000 7fc955b32640 1 --2- 10.20.193.49:0/1324039756 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc9500ca020 0x7fc95014dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:44.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.214+0000 7fc955b32640 1 -- 10.20.193.49:0/1324039756 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc95006e5b0 msgr2=0x7fc9501f43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:44.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.214+0000 7fc955b32640 1 --2- 10.20.193.49:0/1324039756 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc95006e5b0 0x7fc9501f43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:44.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.214+0000 7fc955b32640 10 monclient: _finish_hunting 0 2026-02-17T11:08:44.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.214+0000 7fc955b32640 1 monclient: found mon.noname-c 2026-02-17T11:08:44.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.214+0000 7fc955b32640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:08:44.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.214+0000 7fc955b32640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:08:44.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.214+0000 7fc955b32640 1 -- 10.20.193.49:0/1324039756 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9501f48e0 con 0x7fc9501561c0 2026-02-17T11:08:44.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.215+0000 7fc955b32640 1 --2- 10.20.193.49:0/1324039756 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc9501561c0 0x7fc950146530 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc94c00eed0 tx=0x7fc94c00b480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:08:44.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.215+0000 7fc93dffb640 10 client.?.objecter ms_handle_connect 0x7fc9501561c0 2026-02-17T11:08:44.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.215+0000 7fc93dffb640 10 client.?.objecter resend_mon_ops 2026-02-17T11:08:44.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.216+0000 7fc93dffb640 1 -- 10.20.193.49:0/1324039756 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc94c018020 con 0x7fc9501561c0 2026-02-17T11:08:44.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.216+0000 7fc93dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:44.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.216+0000 7fc93dffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:08:44.221 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.216+0000 7fc93dffb640 10 monclient: dump: 2026-02-17T11:08:44.221 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:08:44.221 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:44.221 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:44.221 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:44.221 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:44.221 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:08:44.221 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:44.221 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:44.221 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:44.221 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:08:44.221 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.216+0000 7fc93dffb640 10 monclient: _finish_auth 0 2026-02-17T11:08:44.221 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.216+0000 7fc93dffb640 10 monclient: _check_auth_tickets 2026-02-17T11:08:44.221 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.216+0000 7fc93dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:08:44.221 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.216+0000 7fc9575bc640 5 monclient: authenticate success, global_id 4208 2026-02-17T11:08:44.221 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.216+0000 7fc9575bc640 10 monclient: _renew_subs 2026-02-17T11:08:44.221 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.216+0000 7fc9575bc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:08:44.221 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.216+0000 7fc9575bc640 1 -- 10.20.193.49:0/1324039756 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc950146f30 con 0x7fc9501561c0 2026-02-17T11:08:44.221 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.216+0000 7fc9575bc640 10 client.4208.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:08:44.221 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.216+0000 7fc9575bc640 10 monclient: _renew_subs 2026-02-17T11:08:44.221 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.216+0000 7fc9575bc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:08:44.222 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.216+0000 7fc9575bc640 1 -- 10.20.193.49:0/1324039756 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc950143170 con 0x7fc9501561c0 2026-02-17T11:08:44.222 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.216+0000 7fc9575bc640 1 librados: init done 2026-02-17T11:08:44.222 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.217+0000 7fc9575bc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:44.222 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.217+0000 7fc9575bc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:44.222 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.217+0000 7fc9575bc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:08:44.222 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.217+0000 7fc9575bc640 1 -- 10.20.193.49:0/1324039756 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc950160640 con 0x7fc9501561c0 2026-02-17T11:08:44.222 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.217+0000 7fc93dffb640 1 -- 10.20.193.49:0/1324039756 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc94c01d400 con 0x7fc9501561c0 2026-02-17T11:08:44.223 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.217+0000 7fc93dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:08:44.223 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.217+0000 7fc93dffb640 1 -- 10.20.193.49:0/1324039756 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc94c009e60 con 0x7fc9501561c0 2026-02-17T11:08:44.223 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.217+0000 7fc93dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:44.223 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.217+0000 7fc93dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:08:44.223 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.217+0000 7fc93f7fe640 4 set_mon_vals no callback set 2026-02-17T11:08:44.223 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.217+0000 7fc93dffb640 10 monclient: dump: 2026-02-17T11:08:44.223 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:08:44.223 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:44.223 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:44.223 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:44.223 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:44.223 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:08:44.223 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:44.223 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:44.223 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:44.223 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:08:44.328 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.326+0000 7fc93dffb640 1 -- 10.20.193.49:0/1324039756 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 4) ==== 100001+0+0 (secure 0 0 0) 0x7fc94c01d7b0 con 0x7fc9501561c0 2026-02-17T11:08:44.328 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.327+0000 7fc93dffb640 1 --2- 10.20.193.49:0/1324039756 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fc9200790b0 0x7fc92007b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:44.329 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.327+0000 7fc955331640 1 --2- 10.20.193.49:0/1324039756 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fc9200790b0 0x7fc92007b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:44.329 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.327+0000 7fc955331640 10 monclient: get_auth_request con 0x7fc9200790b0 auth_method 0 2026-02-17T11:08:44.329 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.328+0000 7fc93dffb640 10 client.4208.objecter ms_handle_connect 0x7fc9200790b0 2026-02-17T11:08:44.329 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.328+0000 7fc955331640 1 --2- 10.20.193.49:0/1324039756 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fc9200790b0 0x7fc92007b570 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc940009c60 tx=0x7fc940009290 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:08:44.331 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.329+0000 7fc93dffb640 1 -- 10.20.193.49:0/1324039756 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2565+0+0 (secure 0 0 0) 0x7fc94c05ec00 con 0x7fc9501561c0 2026-02-17T11:08:44.331 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.329+0000 7fc93dffb640 10 client.4208.objecter ms_dispatch2 0x7fc950000b90 osd_map(18..18 src has 1..18) 2026-02-17T11:08:44.331 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.329+0000 7fc93dffb640 3 client.4208.objecter handle_osd_map got epochs [18,18] > 0 2026-02-17T11:08:44.331 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.329+0000 7fc93dffb640 3 client.4208.objecter handle_osd_map decoding full epoch 18 2026-02-17T11:08:44.331 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.329+0000 7fc93dffb640 20 client.4208.objecter dump_active .. 0 homeless 2026-02-17T11:08:44.336 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.335+0000 7fc93dffb640 1 -- 10.20.193.49:0/1324039756 <== mon.2 v2:10.20.193.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc950160640 con 0x7fc9501561c0 2026-02-17T11:08:44.337 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.335+0000 7fc93dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:44.337 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.335+0000 7fc93dffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:08:44.425 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.423+0000 7fc9575bc640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:08:44.425 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.423+0000 7fc9575bc640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:08:44.425 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.423+0000 7fc9575bc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:08:44.425 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.423+0000 7fc9575bc640 1 -- 10.20.193.49:0/1324039756 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc9500cc330 con 0x7fc9501561c0 2026-02-17T11:08:44.451 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.450+0000 7fc93dffb640 1 -- 10.20.193.49:0/1324039756 <== mon.2 v2:10.20.193.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12879 (secure 0 0 0) 0x7fc94c06b020 con 0x7fc9501561c0 2026-02-17T11:08:44.451 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.450+0000 7fc93dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:08:44.452 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.450+0000 7fc93dffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:08:44.452 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:08:44.452 INFO:teuthology.orchestra.run.trial049.stdout:{"epoch":18,"fsid":"2799a57b-9ea3-46ae-8e91-1fe004a3651d","created":"2026-02-17T11:08:37.595499+0000","modified":"2026-02-17T11:08:43.985163+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T11:08:43.985163+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"30bc819e-140a-433e-b860-eaa88e282a11","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2f7f1f11-f256-4094-82a9-5d21882e6e0e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"26bd1274-fe52-42cb-876b-df9920880f95","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c78a5263-3b0d-4b22-a848-bcd6a1e4f6b0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f0fdfadd-2f39-4ad8-ac88-cb588c5e8ee0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"65872639-d6c0-482d-95d1-1d9f250781c9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"43091d3e-638d-4462-867b-cade02a315e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"890ae4d6-33c9-4515-a896-a689647330dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"f04abc9b-ed75-4582-b47d-07a9890f52bb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"7dfbb00a-6b89-4de3-9f30-6aadd91b4408","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"e497a4fd-a944-489b-9cb3-30f5acaeb53e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"7371d50f-36f9-477d-8d4d-853f481dd6db","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"3cf4fded-49db-4d95-956b-77acc868a3ed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"7dc53473-594f-4cfb-8444-eab205e2e0f9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"e8ab3e8f-29a8-4c79-bf86-d29543aac56a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"300a4696-aa54-4b47-b9f3-87dec719bcfa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:08:44.455 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.452+0000 7fc9575bc640 10 librados: watch_flush enter 2026-02-17T11:08:44.455 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.452+0000 7fc9575bc640 10 librados: watch_flush exit 2026-02-17T11:08:44.455 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.452+0000 7fc9575bc640 20 client.4208.objecter shutdown clearing up homeless session... 2026-02-17T11:08:44.455 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.452+0000 7fc9575bc640 10 client.4208.objecter successfully canceled tick 2026-02-17T11:08:44.455 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.452+0000 7fc9575bc640 1 -- 10.20.193.49:0/1324039756 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fc9200790b0 msgr2=0x7fc92007b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:44.455 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.452+0000 7fc9575bc640 1 --2- 10.20.193.49:0/1324039756 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fc9200790b0 0x7fc92007b570 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc940009c60 tx=0x7fc940009290 comp rx=0 tx=0).stop 2026-02-17T11:08:44.455 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.452+0000 7fc9575bc640 10 monclient: shutdown 2026-02-17T11:08:44.455 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.452+0000 7fc9575bc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:08:44.455 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.452+0000 7fc9575bc640 1 -- 10.20.193.49:0/1324039756 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc9501561c0 msgr2=0x7fc950146530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:44.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.452+0000 7fc9575bc640 1 --2- 10.20.193.49:0/1324039756 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc9501561c0 0x7fc950146530 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc94c00eed0 tx=0x7fc94c00b480 comp rx=0 tx=0).stop 2026-02-17T11:08:44.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.452+0000 7fc9575bc640 1 -- 10.20.193.49:0/1324039756 shutdown_connections 2026-02-17T11:08:44.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.452+0000 7fc9575bc640 1 --2- 10.20.193.49:0/1324039756 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fc9200790b0 0x7fc92007b570 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:44.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.452+0000 7fc9575bc640 1 --2- 10.20.193.49:0/1324039756 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc9501561c0 0x7fc950146530 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:44.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.452+0000 7fc9575bc640 1 --2- 10.20.193.49:0/1324039756 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc9500ca020 0x7fc95014dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:44.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.452+0000 7fc9575bc640 1 --2- 10.20.193.49:0/1324039756 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc95006e5b0 0x7fc9501f43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:44.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.452+0000 7fc9575bc640 1 -- 10.20.193.49:0/1324039756 >> 10.20.193.49:0/1324039756 conn(0x7fc95006da90 msgr2=0x7fc9501550b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:08:44.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.452+0000 7fc9575bc640 1 -- 10.20.193.49:0/1324039756 shutdown_connections 2026-02-17T11:08:44.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.452+0000 7fc9575bc640 1 -- 10.20.193.49:0/1324039756 wait complete. 2026-02-17T11:08:44.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:08:44.452+0000 7fc9575bc640 1 librados: shutdown 2026-02-17T11:08:44.462 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-17T11:08:44.463 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-17T11:08:46.076 DEBUG:teuthology.orchestra.run.trial049:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T11:08:46.137 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.135+0000 7f97644e8640 10 monclient: get_monmap_and_config 2026-02-17T11:08:46.138 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.135+0000 7f97644e8640 10 monclient: build_initial_monmap 2026-02-17T11:08:46.138 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.135+0000 7f97644e8640 10 monclient: monmap: 2026-02-17T11:08:46.138 INFO:teuthology.misc.health.trial049.stderr:epoch 0 2026-02-17T11:08:46.138 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:46.138 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:08:46.136766+0000 2026-02-17T11:08:46.138 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:08:46.136766+0000 2026-02-17T11:08:46.138 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:08:46.138 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:08:46.138 INFO:teuthology.misc.health.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:08:46.138 INFO:teuthology.misc.health.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:08:46.139 INFO:teuthology.misc.health.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:08:46.139 INFO:teuthology.misc.health.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:08:46.139 INFO:teuthology.misc.health.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:08:46.139 INFO:teuthology.misc.health.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:08:46.139 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:08:46.142 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.135+0000 7f97644e8640 1 Processor -- start 2026-02-17T11:08:46.142 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.135+0000 7f97644e8640 1 -- start start 2026-02-17T11:08:46.142 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.135+0000 7f97644e8640 10 monclient: init 2026-02-17T11:08:46.142 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.136+0000 7f97644e8640 10 monclient: _reopen_session rank -1 2026-02-17T11:08:46.143 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.136+0000 7f97644e8640 10 monclient: _add_conns ranks=[4,1,2,3,0,5] 2026-02-17T11:08:46.143 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.136+0000 7f97644e8640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f975c156c00 0x7f975c0726b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:46.143 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.136+0000 7f97644e8640 10 monclient(hunting): picked mon.noname-b con 0x7f975c156c00 addr v2:10.20.193.97:3300/0 2026-02-17T11:08:46.143 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.136+0000 7f97644e8640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f975c1617a0 addr v1:10.20.193.97:6789/0 2026-02-17T11:08:46.143 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.136+0000 7f97644e8640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f975c161bf0 addr v1:10.20.193.157:6789/0 2026-02-17T11:08:46.143 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.136+0000 7f97644e8640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f975c072f50 con 0x7f975c1617a0 2026-02-17T11:08:46.143 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.136+0000 7f97644e8640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f975c073230 con 0x7f975c161bf0 2026-02-17T11:08:46.143 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.136+0000 7f97644e8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:46.143 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.136+0000 7f97644e8640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f975c073510 con 0x7f975c156c00 2026-02-17T11:08:46.143 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.136+0000 7f97644e8640 10 monclient(hunting): _renew_subs 2026-02-17T11:08:46.143 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.136+0000 7f97644e8640 10 monclient(hunting): authenticate will time out at 1002.800402s 2026-02-17T11:08:46.144 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.136+0000 7f9762a5e640 1 --1- >> v1:10.20.193.157:6789/0 conn(0x7f975c161bf0 0x7f975c0c8e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.157:6789/0 says I am v1:10.20.193.49:39552/0 (socket says 10.20.193.49:39552) 2026-02-17T11:08:46.144 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.136+0000 7f9762a5e640 1 -- 10.20.193.49:0/1754414101 learned_addr learned my addr 10.20.193.49:0/1754414101 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:08:46.144 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.136+0000 7f976225d640 1 --2- 10.20.193.49:0/1754414101 >> v2:10.20.193.97:3300/0 conn(0x7f975c156c00 0x7f975c0726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:46.144 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.137+0000 7f976225d640 10 monclient(hunting): get_auth_request con 0x7f975c156c00 auth_method 0 2026-02-17T11:08:46.144 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.137+0000 7f976225d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:46.144 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.137+0000 7f976225d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:46.144 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.137+0000 7f976225d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:46.144 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.137+0000 7f976225d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:46.144 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.137+0000 7f976225d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:46.144 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.137+0000 7f976225d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:46.144 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.138+0000 7f976125b640 1 -- 10.20.193.49:0/1754414101 <== mon.2 v1:10.20.193.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3773210241 0 0) 0x7f975c073230 con 0x7f975c161bf0 2026-02-17T11:08:46.144 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.138+0000 7f976125b640 10 monclient(hunting): _negotiate 2026-02-17T11:08:46.144 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.138+0000 7f976125b640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:46.145 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.138+0000 7f976125b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:46.145 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.138+0000 7f976125b640 10 monclient(hunting): my global_id is 4211 2026-02-17T11:08:46.145 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.138+0000 7f976125b640 1 -- 10.20.193.49:0/1754414101 --> v1:10.20.193.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9744003620 con 0x7f975c161bf0 2026-02-17T11:08:46.145 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.139+0000 7f976225d640 10 monclient(hunting): handle_auth_done global_id 4201 payload 274 2026-02-17T11:08:46.145 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.139+0000 7f976225d640 1 -- 10.20.193.49:0/1754414101 >> v1:10.20.193.157:6789/0 conn(0x7f975c161bf0 legacy=0x7f975c0c8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:46.145 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.139+0000 7f976225d640 1 -- 10.20.193.49:0/1754414101 >> v1:10.20.193.97:6789/0 conn(0x7f975c1617a0 legacy=0x7f975c1638a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:46.145 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.139+0000 7f976225d640 10 monclient: _finish_hunting 0 2026-02-17T11:08:46.145 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.139+0000 7f976225d640 1 monclient: found mon.noname-b 2026-02-17T11:08:46.145 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.139+0000 7f976225d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:08:46.145 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.139+0000 7f976225d640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:08:46.145 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.139+0000 7f976225d640 1 -- 10.20.193.49:0/1754414101 --> v2:10.20.193.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f975c0737f0 con 0x7f975c156c00 2026-02-17T11:08:46.151 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.141+0000 7f976225d640 1 --2- 10.20.193.49:0/1754414101 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f975c156c00 0x7f975c0726b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f974c0098a0 tx=0x7f974c02ef00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25ac74fb23b6eb7f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:08:46.151 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.143+0000 7f976125b640 1 -- 10.20.193.49:0/1754414101 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f974c03c070 con 0x7f975c156c00 2026-02-17T11:08:46.151 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.143+0000 7f976125b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:46.151 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.143+0000 7f976125b640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:08:46.151 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.143+0000 7f976125b640 10 monclient: dump: 2026-02-17T11:08:46.151 INFO:teuthology.misc.health.trial049.stderr:epoch 1 2026-02-17T11:08:46.151 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:46.151 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:46.152 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:46.152 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:46.152 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:08:46.152 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:46.152 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:46.152 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:46.152 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:08:46.152 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.143+0000 7f976125b640 10 monclient: _finish_auth 0 2026-02-17T11:08:46.152 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.143+0000 7f976125b640 10 monclient: _check_auth_tickets 2026-02-17T11:08:46.152 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.143+0000 7f976125b640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:08:46.152 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.143+0000 7f976125b640 1 -- 10.20.193.49:0/1754414101 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f974c02fc10 con 0x7f975c156c00 2026-02-17T11:08:46.152 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.143+0000 7f976125b640 10 monclient: handle_config config(0 keys) 2026-02-17T11:08:46.153 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.143+0000 7f976125b640 1 -- 10.20.193.49:0/1754414101 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f974c037440 con 0x7f975c156c00 2026-02-17T11:08:46.153 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.143+0000 7f976125b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:46.153 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.143+0000 7f976125b640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:08:46.153 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.143+0000 7f976125b640 10 monclient: dump: 2026-02-17T11:08:46.153 INFO:teuthology.misc.health.trial049.stderr:epoch 1 2026-02-17T11:08:46.153 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:46.153 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:46.153 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:46.153 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:46.153 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:08:46.153 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:46.153 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:46.154 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:46.154 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:08:46.154 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.143+0000 7f97644e8640 5 monclient: authenticate success, global_id 4201 2026-02-17T11:08:46.154 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.143+0000 7f97644e8640 10 monclient: get_monmap_and_config success 2026-02-17T11:08:46.154 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.143+0000 7f97644e8640 4 set_mon_vals no callback set 2026-02-17T11:08:46.154 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.143+0000 7f97644e8640 10 monclient: shutdown 2026-02-17T11:08:46.154 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.143+0000 7f97644e8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:08:46.154 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.143+0000 7f97644e8640 1 -- 10.20.193.49:0/1754414101 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f975c156c00 msgr2=0x7f975c0726b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:46.154 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.143+0000 7f97644e8640 1 --2- 10.20.193.49:0/1754414101 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f975c156c00 0x7f975c0726b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f974c0098a0 tx=0x7f974c02ef00 comp rx=0 tx=0).stop 2026-02-17T11:08:46.154 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.143+0000 7f97644e8640 1 -- 10.20.193.49:0/1754414101 shutdown_connections 2026-02-17T11:08:46.154 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.143+0000 7f97644e8640 1 --2- 10.20.193.49:0/1754414101 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f975c156c00 0x7f975c0726b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:46.154 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.143+0000 7f97644e8640 1 -- 10.20.193.49:0/1754414101 >> 10.20.193.49:0/1754414101 conn(0x7f975c0c9f30 msgr2=0x7f975c0ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:08:46.155 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.144+0000 7f97644e8640 1 -- 10.20.193.49:0/1754414101 shutdown_connections 2026-02-17T11:08:46.155 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.144+0000 7f97644e8640 1 -- 10.20.193.49:0/1754414101 wait complete. 2026-02-17T11:08:46.155 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.144+0000 7f97644e8640 10 monclient: build_initial_monmap 2026-02-17T11:08:46.155 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.144+0000 7f97644e8640 10 monclient: monmap: 2026-02-17T11:08:46.155 INFO:teuthology.misc.health.trial049.stderr:epoch 0 2026-02-17T11:08:46.155 INFO:teuthology.misc.health.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:08:46.155 INFO:teuthology.misc.health.trial049.stderr:last_changed 0.000000 2026-02-17T11:08:46.155 INFO:teuthology.misc.health.trial049.stderr:created 0.000000 2026-02-17T11:08:46.155 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:08:46.155 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:08:46.155 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:08:46.155 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:08:46.155 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:08:46.156 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:08:46.156 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.144+0000 7f97644e8640 1 librados: starting msgr at 2026-02-17T11:08:46.156 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.144+0000 7f97644e8640 1 librados: starting objecter 2026-02-17T11:08:46.156 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.144+0000 7f97644e8640 1 Processor -- start 2026-02-17T11:08:46.156 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.144+0000 7f97644e8640 1 -- start start 2026-02-17T11:08:46.156 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.144+0000 7f97644e8640 1 librados: setting wanted keys 2026-02-17T11:08:46.156 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.144+0000 7f97644e8640 1 librados: calling monclient init 2026-02-17T11:08:46.156 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.144+0000 7f97644e8640 10 monclient: init 2026-02-17T11:08:46.156 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.145+0000 7f97644e8640 10 monclient: _reopen_session rank -1 2026-02-17T11:08:46.156 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.145+0000 7f97644e8640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:08:46.156 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.145+0000 7f97644e8640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f975c156c00 0x7f975c1ef380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:46.156 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.145+0000 7f97644e8640 10 monclient(hunting): picked mon.noname-c con 0x7f975c156c00 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:08:46.156 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.145+0000 7f97644e8640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f975c1617a0 0x7f975c14bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:46.157 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.145+0000 7f97644e8640 10 monclient(hunting): picked mon.noname-b con 0x7f975c1617a0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:08:46.157 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.145+0000 7f97644e8640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f975c161bf0 0x7f975c162760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:46.157 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.145+0000 7f97644e8640 10 monclient(hunting): picked mon.noname-a con 0x7f975c161bf0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:08:46.157 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.145+0000 7f97644e8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:46.157 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.145+0000 7f97644e8640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f975c0742d0 con 0x7f975c161bf0 2026-02-17T11:08:46.157 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.145+0000 7f97644e8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:46.157 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.145+0000 7f97644e8640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f975c073db0 con 0x7f975c1617a0 2026-02-17T11:08:46.157 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.145+0000 7f97644e8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:46.157 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.145+0000 7f97644e8640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f975c072bf0 con 0x7f975c156c00 2026-02-17T11:08:46.157 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.145+0000 7f97644e8640 10 monclient(hunting): _renew_subs 2026-02-17T11:08:46.157 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.145+0000 7f97644e8640 10 monclient(hunting): authenticate will time out at 1002.809201s 2026-02-17T11:08:46.157 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.145+0000 7f9761a5c640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f975c1617a0 0x7f975c14bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:46.158 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.145+0000 7f976225d640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f975c156c00 0x7f975c1ef380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:46.158 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.145+0000 7f9762a5e640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f975c161bf0 0x7f975c162760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:46.158 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.145+0000 7f9761a5c640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f975c1617a0 0x7f975c14bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:46660/0 (socket says 10.20.193.49:46660) 2026-02-17T11:08:46.158 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.145+0000 7f9761a5c640 1 -- 10.20.193.49:0/3255547924 learned_addr learned my addr 10.20.193.49:0/3255547924 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:08:46.158 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.145+0000 7f9761a5c640 10 monclient(hunting): get_auth_request con 0x7f975c1617a0 auth_method 0 2026-02-17T11:08:46.158 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.145+0000 7f9761a5c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:46.158 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.145+0000 7f9761a5c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:46.158 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.145+0000 7f9761a5c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:46.158 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.145+0000 7f976225d640 10 monclient(hunting): get_auth_request con 0x7f975c156c00 auth_method 0 2026-02-17T11:08:46.158 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.145+0000 7f976225d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:46.159 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.145+0000 7f976225d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:46.159 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.145+0000 7f976225d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:46.159 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.146+0000 7f9761a5c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:46.159 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.146+0000 7f9761a5c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:46.159 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.146+0000 7f9761a5c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:46.159 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.146+0000 7f9762a5e640 10 monclient(hunting): get_auth_request con 0x7f975c161bf0 auth_method 0 2026-02-17T11:08:46.159 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.146+0000 7f9762a5e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:46.159 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.146+0000 7f9762a5e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:46.159 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.146+0000 7f9762a5e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:46.159 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.146+0000 7f976225d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:46.159 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.146+0000 7f976225d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:46.160 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.146+0000 7f976225d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:46.160 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.146+0000 7f9762a5e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:46.160 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.146+0000 7f9762a5e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:46.160 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.146+0000 7f9762a5e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:46.160 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.147+0000 7f9761a5c640 10 monclient(hunting): handle_auth_done global_id 4207 payload 824 2026-02-17T11:08:46.160 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.147+0000 7f9761a5c640 1 -- 10.20.193.49:0/3255547924 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f975c156c00 msgr2=0x7f975c1ef380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:46.160 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.147+0000 7f9761a5c640 1 --2- 10.20.193.49:0/3255547924 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f975c156c00 0x7f975c1ef380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:46.160 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.147+0000 7f9761a5c640 1 -- 10.20.193.49:0/3255547924 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f975c161bf0 msgr2=0x7f975c162760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:46.160 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.147+0000 7f9761a5c640 1 --2- 10.20.193.49:0/3255547924 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f975c161bf0 0x7f975c162760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:46.160 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.147+0000 7f9761a5c640 10 monclient: _finish_hunting 0 2026-02-17T11:08:46.160 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.147+0000 7f9761a5c640 1 monclient: found mon.noname-b 2026-02-17T11:08:46.160 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.147+0000 7f9761a5c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:08:46.161 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.147+0000 7f9761a5c640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:08:46.161 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.147+0000 7f9761a5c640 1 -- 10.20.193.49:0/3255547924 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f975c1ef8c0 con 0x7f975c1617a0 2026-02-17T11:08:46.161 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.148+0000 7f9761a5c640 1 --2- 10.20.193.49:0/3255547924 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f975c1617a0 0x7f975c14bb50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f975000c730 tx=0x7f975000cc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:08:46.161 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.148+0000 7f9742ffd640 10 client.?.objecter ms_handle_connect 0x7f975c1617a0 2026-02-17T11:08:46.161 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.148+0000 7f9742ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:08:46.163 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.150+0000 7f9742ffd640 1 -- 10.20.193.49:0/3255547924 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97500052d0 con 0x7f975c1617a0 2026-02-17T11:08:46.163 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.150+0000 7f9742ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:46.163 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.150+0000 7f9742ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:08:46.163 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.150+0000 7f9742ffd640 10 monclient: dump: 2026-02-17T11:08:46.163 INFO:teuthology.misc.health.trial049.stderr:epoch 1 2026-02-17T11:08:46.163 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:46.163 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:46.163 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:46.163 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:46.164 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:08:46.164 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:46.164 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:46.164 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:46.164 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:08:46.164 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.150+0000 7f9742ffd640 10 monclient: _finish_auth 0 2026-02-17T11:08:46.164 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.150+0000 7f9742ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:08:46.164 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.150+0000 7f9742ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:08:46.164 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.150+0000 7f9742ffd640 1 -- 10.20.193.49:0/3255547924 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9750005470 con 0x7f975c1617a0 2026-02-17T11:08:46.164 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.150+0000 7f9742ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:08:46.164 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.150+0000 7f9742ffd640 1 -- 10.20.193.49:0/3255547924 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97500038d0 con 0x7f975c1617a0 2026-02-17T11:08:46.165 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.150+0000 7f97644e8640 5 monclient: authenticate success, global_id 4207 2026-02-17T11:08:46.165 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.150+0000 7f97644e8640 10 monclient: _renew_subs 2026-02-17T11:08:46.165 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.150+0000 7f97644e8640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:08:46.165 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.150+0000 7f97644e8640 1 -- 10.20.193.49:0/3255547924 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f975c1edd20 con 0x7f975c1617a0 2026-02-17T11:08:46.165 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.150+0000 7f9760a5a640 4 set_mon_vals no callback set 2026-02-17T11:08:46.165 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.150+0000 7f9742ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:46.165 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.150+0000 7f9742ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:08:46.165 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.150+0000 7f9742ffd640 10 monclient: dump: 2026-02-17T11:08:46.165 INFO:teuthology.misc.health.trial049.stderr:epoch 1 2026-02-17T11:08:46.165 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:46.165 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:46.165 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:46.165 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:46.166 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:08:46.166 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:46.166 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:46.166 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:46.166 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:08:46.166 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.150+0000 7f97644e8640 10 client.4207.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:08:46.166 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.150+0000 7f97644e8640 10 monclient: _renew_subs 2026-02-17T11:08:46.166 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.150+0000 7f97644e8640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:08:46.166 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.150+0000 7f97644e8640 1 -- 10.20.193.49:0/3255547924 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f975c1ee2e0 con 0x7f975c1617a0 2026-02-17T11:08:46.166 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.150+0000 7f97644e8640 1 librados: init done 2026-02-17T11:08:46.166 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.151+0000 7f97644e8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:46.166 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.151+0000 7f97644e8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:46.167 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.151+0000 7f97644e8640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:08:46.167 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.151+0000 7f97644e8640 1 -- 10.20.193.49:0/3255547924 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f975c156fe0 con 0x7f975c1617a0 2026-02-17T11:08:46.168 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.162+0000 7f9742ffd640 1 -- 10.20.193.49:0/3255547924 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 4) ==== 100001+0+0 (secure 0 0 0) 0x7f9750003a70 con 0x7f975c1617a0 2026-02-17T11:08:46.168 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.162+0000 7f9742ffd640 1 --2- 10.20.193.49:0/3255547924 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f972c0790b0 0x7f972c07b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:46.168 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.163+0000 7f976225d640 1 --2- 10.20.193.49:0/3255547924 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f972c0790b0 0x7f972c07b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:46.168 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.163+0000 7f976225d640 10 monclient: get_auth_request con 0x7f972c0790b0 auth_method 0 2026-02-17T11:08:46.168 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.163+0000 7f9742ffd640 1 -- 10.20.193.49:0/3255547924 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2565+0+0 (secure 0 0 0) 0x7f975005e2c0 con 0x7f975c1617a0 2026-02-17T11:08:46.168 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.163+0000 7f9742ffd640 10 client.4207.objecter ms_dispatch2 0x7f975c000b90 osd_map(18..18 src has 1..18) 2026-02-17T11:08:46.168 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.163+0000 7f9742ffd640 3 client.4207.objecter handle_osd_map got epochs [18,18] > 0 2026-02-17T11:08:46.168 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.163+0000 7f9742ffd640 3 client.4207.objecter handle_osd_map decoding full epoch 18 2026-02-17T11:08:46.169 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.163+0000 7f9742ffd640 20 client.4207.objecter dump_active .. 0 homeless 2026-02-17T11:08:46.169 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.163+0000 7f9742ffd640 10 client.4207.objecter ms_handle_connect 0x7f972c0790b0 2026-02-17T11:08:46.169 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.163+0000 7f976225d640 1 --2- 10.20.193.49:0/3255547924 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f972c0790b0 0x7f972c07b570 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f974c039000 tx=0x7f974c033000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:08:46.277 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.275+0000 7f9742ffd640 1 -- 10.20.193.49:0/3255547924 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f975c1ef8c0 con 0x7f975c1617a0 2026-02-17T11:08:46.277 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.275+0000 7f9742ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:46.277 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.275+0000 7f9742ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:08:46.368 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.366+0000 7f97644e8640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:08:46.369 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.366+0000 7f97644e8640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:08:46.369 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.366+0000 7f97644e8640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:08:46.369 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.366+0000 7f97644e8640 1 -- 10.20.193.49:0/3255547924 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f975c1649b0 con 0x7f975c1617a0 2026-02-17T11:08:46.393 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.391+0000 7f9742ffd640 1 -- 10.20.193.49:0/3255547924 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12879 (secure 0 0 0) 0x7f9750062280 con 0x7f975c1617a0 2026-02-17T11:08:46.393 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.391+0000 7f9742ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:08:46.393 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.391+0000 7f9742ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:08:46.394 INFO:teuthology.misc.health.trial049.stdout: 2026-02-17T11:08:46.394 INFO:teuthology.misc.health.trial049.stdout:{"epoch":18,"fsid":"2799a57b-9ea3-46ae-8e91-1fe004a3651d","created":"2026-02-17T11:08:37.595499+0000","modified":"2026-02-17T11:08:43.985163+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T11:08:43.985163+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"30bc819e-140a-433e-b860-eaa88e282a11","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2f7f1f11-f256-4094-82a9-5d21882e6e0e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"26bd1274-fe52-42cb-876b-df9920880f95","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c78a5263-3b0d-4b22-a848-bcd6a1e4f6b0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f0fdfadd-2f39-4ad8-ac88-cb588c5e8ee0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"65872639-d6c0-482d-95d1-1d9f250781c9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"43091d3e-638d-4462-867b-cade02a315e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"890ae4d6-33c9-4515-a896-a689647330dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"f04abc9b-ed75-4582-b47d-07a9890f52bb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"7dfbb00a-6b89-4de3-9f30-6aadd91b4408","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"e497a4fd-a944-489b-9cb3-30f5acaeb53e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"7371d50f-36f9-477d-8d4d-853f481dd6db","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"3cf4fded-49db-4d95-956b-77acc868a3ed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"7dc53473-594f-4cfb-8444-eab205e2e0f9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"e8ab3e8f-29a8-4c79-bf86-d29543aac56a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"300a4696-aa54-4b47-b9f3-87dec719bcfa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:08:46.397 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.393+0000 7f97644e8640 10 librados: watch_flush enter 2026-02-17T11:08:46.397 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.393+0000 7f97644e8640 10 librados: watch_flush exit 2026-02-17T11:08:46.397 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.393+0000 7f97644e8640 20 client.4207.objecter shutdown clearing up homeless session... 2026-02-17T11:08:46.397 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.393+0000 7f97644e8640 10 client.4207.objecter successfully canceled tick 2026-02-17T11:08:46.397 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.393+0000 7f97644e8640 1 -- 10.20.193.49:0/3255547924 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f972c0790b0 msgr2=0x7f972c07b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:46.397 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.393+0000 7f97644e8640 1 --2- 10.20.193.49:0/3255547924 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f972c0790b0 0x7f972c07b570 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f974c039000 tx=0x7f974c033000 comp rx=0 tx=0).stop 2026-02-17T11:08:46.397 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.393+0000 7f97644e8640 10 monclient: shutdown 2026-02-17T11:08:46.397 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.393+0000 7f97644e8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:08:46.397 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.393+0000 7f97644e8640 1 -- 10.20.193.49:0/3255547924 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f975c1617a0 msgr2=0x7f975c14bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:46.398 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.393+0000 7f97644e8640 1 --2- 10.20.193.49:0/3255547924 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f975c1617a0 0x7f975c14bb50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f975000c730 tx=0x7f975000cc00 comp rx=0 tx=0).stop 2026-02-17T11:08:46.398 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.393+0000 7f97644e8640 1 -- 10.20.193.49:0/3255547924 shutdown_connections 2026-02-17T11:08:46.398 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.393+0000 7f97644e8640 1 --2- 10.20.193.49:0/3255547924 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f972c0790b0 0x7f972c07b570 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:46.398 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.393+0000 7f97644e8640 1 --2- 10.20.193.49:0/3255547924 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f975c161bf0 0x7f975c162760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:46.398 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.393+0000 7f97644e8640 1 --2- 10.20.193.49:0/3255547924 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f975c1617a0 0x7f975c14bb50 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:46.398 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.393+0000 7f97644e8640 1 --2- 10.20.193.49:0/3255547924 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f975c156c00 0x7f975c1ef380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:46.398 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.393+0000 7f97644e8640 1 -- 10.20.193.49:0/3255547924 >> 10.20.193.49:0/3255547924 conn(0x7f975c0c9f30 msgr2=0x7f975c0ca310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:08:46.398 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.393+0000 7f97644e8640 1 -- 10.20.193.49:0/3255547924 shutdown_connections 2026-02-17T11:08:46.398 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.393+0000 7f97644e8640 1 -- 10.20.193.49:0/3255547924 wait complete. 2026-02-17T11:08:46.398 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:46.393+0000 7f97644e8640 1 librados: shutdown 2026-02-17T11:08:46.404 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-17T11:08:54.018 DEBUG:teuthology.orchestra.run.trial049:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T11:08:54.057 INFO:tasks.ceph.osd.9.trial097.stderr:--00:00:00:09.954 44852-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/ef/ee4a9c333705c9516f2b13939f82e08af4fbfc.debug 2026-02-17T11:08:54.058 INFO:tasks.ceph.osd.5.trial097.stderr:--00:00:00:09.958 44851-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/ef/ee4a9c333705c9516f2b13939f82e08af4fbfc.debug 2026-02-17T11:08:54.058 INFO:tasks.ceph.osd.1.trial097.stderr:--00:00:00:09.961 44850-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/ef/ee4a9c333705c9516f2b13939f82e08af4fbfc.debug 2026-02-17T11:08:54.077 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.074+0000 7f04d897e640 10 monclient: get_monmap_and_config 2026-02-17T11:08:54.077 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.074+0000 7f04d897e640 10 monclient: build_initial_monmap 2026-02-17T11:08:54.077 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.074+0000 7f04d897e640 10 monclient: monmap: 2026-02-17T11:08:54.077 INFO:teuthology.misc.health.trial049.stderr:epoch 0 2026-02-17T11:08:54.077 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:54.077 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:08:54.076256+0000 2026-02-17T11:08:54.077 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:08:54.076256+0000 2026-02-17T11:08:54.077 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:08:54.077 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:08:54.077 INFO:teuthology.misc.health.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:08:54.078 INFO:teuthology.misc.health.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:08:54.078 INFO:teuthology.misc.health.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:08:54.078 INFO:teuthology.misc.health.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:08:54.078 INFO:teuthology.misc.health.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:08:54.078 INFO:teuthology.misc.health.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:08:54.078 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:08:54.081 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.075+0000 7f04d897e640 1 Processor -- start 2026-02-17T11:08:54.081 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.075+0000 7f04d897e640 1 -- start start 2026-02-17T11:08:54.082 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.075+0000 7f04d897e640 10 monclient: init 2026-02-17T11:08:54.082 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.075+0000 7f04d897e640 10 monclient: _reopen_session rank -1 2026-02-17T11:08:54.082 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.075+0000 7f04d897e640 10 monclient: _add_conns ranks=[3,5,4,0,2,1] 2026-02-17T11:08:54.082 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.075+0000 7f04d897e640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f04d015f640 0x7f04d015fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:54.082 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.075+0000 7f04d897e640 10 monclient(hunting): picked mon.noname-a con 0x7f04d015f640 addr v2:10.20.193.49:3300/0 2026-02-17T11:08:54.082 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.075+0000 7f04d897e640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f04d00726b0 0x7f04d015d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:54.082 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.075+0000 7f04d897e640 10 monclient(hunting): picked mon.noname-c con 0x7f04d00726b0 addr v2:10.20.193.157:3300/0 2026-02-17T11:08:54.082 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.075+0000 7f04d897e640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f04d0072b40 0x7f04d00c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:54.082 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.075+0000 7f04d897e640 10 monclient(hunting): picked mon.noname-b con 0x7f04d0072b40 addr v2:10.20.193.97:3300/0 2026-02-17T11:08:54.082 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.075+0000 7f04d897e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:54.082 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.075+0000 7f04d897e640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f04d00743a0 con 0x7f04d015f640 2026-02-17T11:08:54.082 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.075+0000 7f04d897e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:54.083 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.075+0000 7f04d897e640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f04d0073040 con 0x7f04d0072b40 2026-02-17T11:08:54.083 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.075+0000 7f04d897e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:54.083 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.075+0000 7f04d897e640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f04d0073320 con 0x7f04d00726b0 2026-02-17T11:08:54.083 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.075+0000 7f04d897e640 10 monclient(hunting): _renew_subs 2026-02-17T11:08:54.083 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.075+0000 7f04d897e640 10 monclient(hunting): authenticate will time out at 1010.739698s 2026-02-17T11:08:54.083 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.076+0000 7f04d66f3640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f04d015f640 0x7f04d015fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:54.083 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.076+0000 7f04d5ef2640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f04d00726b0 0x7f04d015d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:54.083 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.076+0000 7f04d6ef4640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f04d0072b40 0x7f04d00c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:54.083 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.076+0000 7f04d66f3640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f04d015f640 0x7f04d015fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:47212/0 (socket says 10.20.193.49:47212) 2026-02-17T11:08:54.083 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.076+0000 7f04d66f3640 1 -- 10.20.193.49:0/1738330420 learned_addr learned my addr 10.20.193.49:0/1738330420 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:08:54.083 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.076+0000 7f04d66f3640 10 monclient(hunting): get_auth_request con 0x7f04d015f640 auth_method 0 2026-02-17T11:08:54.083 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.076+0000 7f04d66f3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:54.083 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.076+0000 7f04d66f3640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:54.083 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.076+0000 7f04d66f3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:54.084 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.076+0000 7f04d5ef2640 10 monclient(hunting): get_auth_request con 0x7f04d00726b0 auth_method 0 2026-02-17T11:08:54.084 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.076+0000 7f04d5ef2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:54.084 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.076+0000 7f04d5ef2640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:54.084 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.076+0000 7f04d5ef2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:54.084 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.076+0000 7f04d6ef4640 10 monclient(hunting): get_auth_request con 0x7f04d0072b40 auth_method 0 2026-02-17T11:08:54.084 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.076+0000 7f04d6ef4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:54.084 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.076+0000 7f04d6ef4640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:54.084 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.076+0000 7f04d6ef4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:54.084 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.076+0000 7f04d66f3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:54.084 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.076+0000 7f04d66f3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:54.084 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.076+0000 7f04d66f3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:54.084 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.076+0000 7f04d5ef2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:54.084 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.076+0000 7f04d5ef2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:54.084 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.076+0000 7f04d5ef2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:54.085 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.077+0000 7f04d6ef4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:54.085 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.077+0000 7f04d6ef4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:54.085 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.077+0000 7f04d6ef4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:54.085 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.077+0000 7f04d66f3640 10 monclient(hunting): handle_auth_done global_id 4194 payload 274 2026-02-17T11:08:54.085 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.077+0000 7f04d66f3640 1 -- 10.20.193.49:0/1738330420 >> v2:10.20.193.157:3300/0 conn(0x7f04d00726b0 msgr2=0x7f04d015d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:08:54.085 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.077+0000 7f04d66f3640 1 --2- 10.20.193.49:0/1738330420 >> v2:10.20.193.157:3300/0 conn(0x7f04d00726b0 0x7f04d015d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:54.085 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.077+0000 7f04d66f3640 1 -- 10.20.193.49:0/1738330420 >> v2:10.20.193.97:3300/0 conn(0x7f04d0072b40 msgr2=0x7f04d00c8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:08:54.085 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.077+0000 7f04d66f3640 1 --2- 10.20.193.49:0/1738330420 >> v2:10.20.193.97:3300/0 conn(0x7f04d0072b40 0x7f04d00c8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:54.085 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.077+0000 7f04d66f3640 10 monclient: _finish_hunting 0 2026-02-17T11:08:54.085 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.077+0000 7f04d66f3640 1 monclient: found mon.noname-a 2026-02-17T11:08:54.085 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.078+0000 7f04d66f3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:08:54.085 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.078+0000 7f04d66f3640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:08:54.085 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.078+0000 7f04d66f3640 1 -- 10.20.193.49:0/1738330420 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04d0073600 con 0x7f04d015f640 2026-02-17T11:08:54.085 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.079+0000 7f04d66f3640 1 --2- 10.20.193.49:0/1738330420 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f04d015f640 0x7f04d015fa20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f04d00c4cc0 tx=0x7f04c802edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=144dc2fea942ef8b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:08:54.087 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.080+0000 7f04d56f1640 1 -- 10.20.193.49:0/1738330420 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04c803c070 con 0x7f04d015f640 2026-02-17T11:08:54.087 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.080+0000 7f04d56f1640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:54.087 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.080+0000 7f04d56f1640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:08:54.087 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.080+0000 7f04d56f1640 10 monclient: dump: 2026-02-17T11:08:54.087 INFO:teuthology.misc.health.trial049.stderr:epoch 1 2026-02-17T11:08:54.087 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:54.087 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:54.088 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:54.088 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:54.088 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:08:54.088 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:54.088 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:54.088 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:54.088 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:08:54.088 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.080+0000 7f04d56f1640 10 monclient: _finish_auth 0 2026-02-17T11:08:54.088 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.080+0000 7f04d56f1640 10 monclient: _check_auth_tickets 2026-02-17T11:08:54.088 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.080+0000 7f04d56f1640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:08:54.088 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.080+0000 7f04d56f1640 1 -- 10.20.193.49:0/1738330420 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04c802fab0 con 0x7f04d015f640 2026-02-17T11:08:54.088 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.080+0000 7f04d56f1640 10 monclient: handle_config config(0 keys) 2026-02-17T11:08:54.088 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.080+0000 7f04d897e640 5 monclient: authenticate success, global_id 4194 2026-02-17T11:08:54.089 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.080+0000 7f04d897e640 10 monclient: get_monmap_and_config success 2026-02-17T11:08:54.089 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.080+0000 7f04d56f1640 1 -- 10.20.193.49:0/1738330420 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04c8037440 con 0x7f04d015f640 2026-02-17T11:08:54.089 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.080+0000 7f04d897e640 4 set_mon_vals no callback set 2026-02-17T11:08:54.089 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.080+0000 7f04d56f1640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:54.089 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.080+0000 7f04d56f1640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:08:54.089 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.080+0000 7f04d56f1640 10 monclient: dump: 2026-02-17T11:08:54.089 INFO:teuthology.misc.health.trial049.stderr:epoch 1 2026-02-17T11:08:54.089 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:54.089 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:54.089 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:54.089 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:54.089 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:08:54.089 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:54.089 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:54.090 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:54.090 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:08:54.090 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.081+0000 7f04d897e640 10 monclient: shutdown 2026-02-17T11:08:54.090 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.081+0000 7f04d897e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:08:54.090 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.081+0000 7f04d897e640 1 -- 10.20.193.49:0/1738330420 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f04d015f640 msgr2=0x7f04d015fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:54.090 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.081+0000 7f04d897e640 1 --2- 10.20.193.49:0/1738330420 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f04d015f640 0x7f04d015fa20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f04d00c4cc0 tx=0x7f04c802edf0 comp rx=0 tx=0).stop 2026-02-17T11:08:54.090 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.081+0000 7f04d897e640 1 -- 10.20.193.49:0/1738330420 shutdown_connections 2026-02-17T11:08:54.090 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.081+0000 7f04d897e640 1 --2- 10.20.193.49:0/1738330420 >> v2:10.20.193.97:3300/0 conn(0x7f04d0072b40 0x7f04d00c8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:54.090 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.081+0000 7f04d897e640 1 --2- 10.20.193.49:0/1738330420 >> v2:10.20.193.157:3300/0 conn(0x7f04d00726b0 0x7f04d015d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:54.090 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.081+0000 7f04d897e640 1 --2- 10.20.193.49:0/1738330420 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f04d015f640 0x7f04d015fa20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:54.090 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.081+0000 7f04d897e640 1 -- 10.20.193.49:0/1738330420 >> 10.20.193.49:0/1738330420 conn(0x7f04d00c9f30 msgr2=0x7f04d00ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:08:54.090 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.081+0000 7f04d897e640 1 -- 10.20.193.49:0/1738330420 shutdown_connections 2026-02-17T11:08:54.090 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.081+0000 7f04d897e640 1 -- 10.20.193.49:0/1738330420 wait complete. 2026-02-17T11:08:54.091 INFO:tasks.ceph.osd.4.trial049.stderr:--00:00:00:09.996 45321-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/ef/ee4a9c333705c9516f2b13939f82e08af4fbfc.debug 2026-02-17T11:08:54.091 INFO:tasks.ceph.osd.8.trial049.stderr:--00:00:00:09.991 45322-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/ef/ee4a9c333705c9516f2b13939f82e08af4fbfc.debug 2026-02-17T11:08:54.091 INFO:tasks.ceph.osd.0.trial049.stderr:--00:00:00:09.998 45320-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/ef/ee4a9c333705c9516f2b13939f82e08af4fbfc.debug 2026-02-17T11:08:54.092 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.082+0000 7f04d897e640 10 monclient: build_initial_monmap 2026-02-17T11:08:54.092 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.082+0000 7f04d897e640 10 monclient: monmap: 2026-02-17T11:08:54.092 INFO:teuthology.misc.health.trial049.stderr:epoch 0 2026-02-17T11:08:54.092 INFO:teuthology.misc.health.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:08:54.092 INFO:teuthology.misc.health.trial049.stderr:last_changed 0.000000 2026-02-17T11:08:54.092 INFO:teuthology.misc.health.trial049.stderr:created 0.000000 2026-02-17T11:08:54.093 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:08:54.093 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:08:54.093 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:08:54.093 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:08:54.093 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:08:54.093 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:08:54.093 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.082+0000 7f04d897e640 1 librados: starting msgr at 2026-02-17T11:08:54.093 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.082+0000 7f04d897e640 1 librados: starting objecter 2026-02-17T11:08:54.093 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.082+0000 7f04d897e640 1 Processor -- start 2026-02-17T11:08:54.093 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.082+0000 7f04d897e640 1 -- start start 2026-02-17T11:08:54.093 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.082+0000 7f04d897e640 1 librados: setting wanted keys 2026-02-17T11:08:54.093 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.082+0000 7f04d897e640 1 librados: calling monclient init 2026-02-17T11:08:54.093 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.082+0000 7f04d897e640 10 monclient: init 2026-02-17T11:08:54.093 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.083+0000 7f04d897e640 10 monclient: _reopen_session rank -1 2026-02-17T11:08:54.093 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.083+0000 7f04d897e640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:08:54.093 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.083+0000 7f04d897e640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f04d00726b0 0x7f04d0159070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:54.093 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.083+0000 7f04d897e640 10 monclient(hunting): picked mon.noname-a con 0x7f04d00726b0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:08:54.093 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.083+0000 7f04d897e640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f04d0072b40 0x7f04d014e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:54.093 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.083+0000 7f04d897e640 10 monclient(hunting): picked mon.noname-b con 0x7f04d0072b40 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:08:54.093 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.083+0000 7f04d897e640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f04d015f640 0x7f04d01e8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:54.093 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.083+0000 7f04d897e640 10 monclient(hunting): picked mon.noname-c con 0x7f04d015f640 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:08:54.093 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.083+0000 7f04d897e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:54.093 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.083+0000 7f04d897e640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f04d015d7e0 con 0x7f04d00726b0 2026-02-17T11:08:54.093 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.083+0000 7f04d897e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:54.093 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.083+0000 7f04d897e640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f04d0073bc0 con 0x7f04d0072b40 2026-02-17T11:08:54.093 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.083+0000 7f04d897e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:08:54.093 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.083+0000 7f04d897e640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f04d015d960 con 0x7f04d015f640 2026-02-17T11:08:54.093 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.083+0000 7f04d897e640 10 monclient(hunting): _renew_subs 2026-02-17T11:08:54.093 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.083+0000 7f04d897e640 10 monclient(hunting): authenticate will time out at 1010.747164s 2026-02-17T11:08:54.093 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.083+0000 7f04d66f3640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f04d00726b0 0x7f04d0159070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:54.093 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.083+0000 7f04d6ef4640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f04d015f640 0x7f04d01e8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:54.094 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.083+0000 7f04d66f3640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f04d00726b0 0x7f04d0159070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:47224/0 (socket says 10.20.193.49:47224) 2026-02-17T11:08:54.094 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.083+0000 7f04d66f3640 1 -- 10.20.193.49:0/3332670217 learned_addr learned my addr 10.20.193.49:0/3332670217 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:08:54.094 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.083+0000 7f04d66f3640 10 monclient(hunting): get_auth_request con 0x7f04d00726b0 auth_method 0 2026-02-17T11:08:54.094 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.083+0000 7f04d66f3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:54.094 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.083+0000 7f04d66f3640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:54.094 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.083+0000 7f04d66f3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:54.094 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.083+0000 7f04d5ef2640 1 --2- 10.20.193.49:0/3332670217 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f04d0072b40 0x7f04d014e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:54.094 INFO:tasks.ceph.osd.12.trial049.stderr:--00:00:00:09.990 45323-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/ef/ee4a9c333705c9516f2b13939f82e08af4fbfc.debug 2026-02-17T11:08:54.095 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.083+0000 7f04d6ef4640 10 monclient(hunting): get_auth_request con 0x7f04d015f640 auth_method 0 2026-02-17T11:08:54.095 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.083+0000 7f04d6ef4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:54.095 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.083+0000 7f04d6ef4640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:54.095 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.083+0000 7f04d6ef4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:54.095 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.083+0000 7f04d66f3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:54.095 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.083+0000 7f04d66f3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:54.095 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.083+0000 7f04d66f3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:54.095 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.083+0000 7f04d5ef2640 10 monclient(hunting): get_auth_request con 0x7f04d0072b40 auth_method 0 2026-02-17T11:08:54.095 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.083+0000 7f04d5ef2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:08:54.095 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.083+0000 7f04d5ef2640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:08:54.095 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.083+0000 7f04d5ef2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:08:54.095 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.084+0000 7f04d6ef4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:54.095 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.084+0000 7f04d6ef4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:54.095 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.084+0000 7f04d6ef4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:54.095 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.084+0000 7f04d5ef2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:08:54.095 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.084+0000 7f04d5ef2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:08:54.095 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.084+0000 7f04d5ef2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:08:54.095 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.085+0000 7f04d66f3640 10 monclient(hunting): handle_auth_done global_id 4197 payload 824 2026-02-17T11:08:54.096 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.085+0000 7f04d66f3640 1 -- 10.20.193.49:0/3332670217 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f04d015f640 msgr2=0x7f04d01e8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:54.096 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.085+0000 7f04d66f3640 1 --2- 10.20.193.49:0/3332670217 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f04d015f640 0x7f04d01e8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:54.096 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.085+0000 7f04d66f3640 1 -- 10.20.193.49:0/3332670217 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f04d0072b40 msgr2=0x7f04d014e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:54.096 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.085+0000 7f04d66f3640 1 --2- 10.20.193.49:0/3332670217 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f04d0072b40 0x7f04d014e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:54.096 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.085+0000 7f04d66f3640 10 monclient: _finish_hunting 0 2026-02-17T11:08:54.096 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.085+0000 7f04d66f3640 1 monclient: found mon.noname-a 2026-02-17T11:08:54.096 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.085+0000 7f04d66f3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:08:54.096 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.085+0000 7f04d66f3640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:08:54.096 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.085+0000 7f04d66f3640 1 -- 10.20.193.49:0/3332670217 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04d01f7cf0 con 0x7f04d00726b0 2026-02-17T11:08:54.096 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.086+0000 7f04d66f3640 1 --2- 10.20.193.49:0/3332670217 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f04d00726b0 0x7f04d0159070 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f04c802f350 tx=0x7f04c80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:08:54.096 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.086+0000 7f04baffd640 10 client.?.objecter ms_handle_connect 0x7f04d00726b0 2026-02-17T11:08:54.096 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.086+0000 7f04baffd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:08:54.096 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.088+0000 7f04baffd640 1 -- 10.20.193.49:0/3332670217 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04c803c040 con 0x7f04d00726b0 2026-02-17T11:08:54.096 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.088+0000 7f04baffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:54.096 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.088+0000 7f04baffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:08:54.096 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.088+0000 7f04baffd640 10 monclient: dump: 2026-02-17T11:08:54.096 INFO:teuthology.misc.health.trial049.stderr:epoch 1 2026-02-17T11:08:54.096 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:54.096 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:54.096 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:54.096 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:54.096 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:08:54.096 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:54.096 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:54.096 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:54.096 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:08:54.096 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.088+0000 7f04baffd640 10 monclient: _finish_auth 0 2026-02-17T11:08:54.096 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.088+0000 7f04baffd640 10 monclient: _check_auth_tickets 2026-02-17T11:08:54.096 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.088+0000 7f04baffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:08:54.096 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.088+0000 7f04baffd640 1 -- 10.20.193.49:0/3332670217 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04c8042650 con 0x7f04d00726b0 2026-02-17T11:08:54.096 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.088+0000 7f04baffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:08:54.096 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.088+0000 7f04baffd640 1 -- 10.20.193.49:0/3332670217 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04c8042a40 con 0x7f04d00726b0 2026-02-17T11:08:54.097 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.088+0000 7f04d4ef0640 4 set_mon_vals no callback set 2026-02-17T11:08:54.097 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.088+0000 7f04d897e640 5 monclient: authenticate success, global_id 4197 2026-02-17T11:08:54.097 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.088+0000 7f04d897e640 10 monclient: _renew_subs 2026-02-17T11:08:54.097 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.088+0000 7f04d897e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:08:54.097 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.088+0000 7f04d897e640 1 -- 10.20.193.49:0/3332670217 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04d01f6b80 con 0x7f04d00726b0 2026-02-17T11:08:54.097 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.088+0000 7f04baffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:08:54.097 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.088+0000 7f04baffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:08:54.097 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.088+0000 7f04baffd640 10 monclient: dump: 2026-02-17T11:08:54.097 INFO:teuthology.misc.health.trial049.stderr:epoch 1 2026-02-17T11:08:54.097 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:08:54.097 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:54.097 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:08:54.097 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:08:54.097 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:08:54.097 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:08:54.097 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:08:54.097 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:08:54.097 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:08:54.097 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.088+0000 7f04d897e640 10 client.4197.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:08:54.097 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.088+0000 7f04d897e640 10 monclient: _renew_subs 2026-02-17T11:08:54.097 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.088+0000 7f04d897e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:08:54.097 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.088+0000 7f04d897e640 1 -- 10.20.193.49:0/3332670217 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04d01e7e90 con 0x7f04d00726b0 2026-02-17T11:08:54.097 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.088+0000 7f04d897e640 1 librados: init done 2026-02-17T11:08:54.097 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.088+0000 7f04d897e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:54.097 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.088+0000 7f04d897e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:54.097 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.088+0000 7f04d897e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:08:54.097 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.088+0000 7f04d897e640 1 -- 10.20.193.49:0/3332670217 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04d015d2a0 con 0x7f04d00726b0 2026-02-17T11:08:54.102 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.100+0000 7f04baffd640 1 -- 10.20.193.49:0/3332670217 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 4) ==== 100001+0+0 (secure 0 0 0) 0x7f04c802f930 con 0x7f04d00726b0 2026-02-17T11:08:54.103 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.100+0000 7f04baffd640 1 --2- 10.20.193.49:0/3332670217 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f04a00790b0 0x7f04a007b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:08:54.103 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.101+0000 7f04d5ef2640 1 --2- 10.20.193.49:0/3332670217 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f04a00790b0 0x7f04a007b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:08:54.103 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.101+0000 7f04d5ef2640 10 monclient: get_auth_request con 0x7f04a00790b0 auth_method 0 2026-02-17T11:08:54.103 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.101+0000 7f04d5ef2640 1 --2- 10.20.193.49:0/3332670217 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f04a00790b0 0x7f04a007b570 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f04d01e9970 tx=0x7f04bc009290 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:08:54.103 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.101+0000 7f04baffd640 10 client.4197.objecter ms_handle_connect 0x7f04a00790b0 2026-02-17T11:08:54.136 INFO:tasks.ceph.osd.15.trial162.stderr:--00:00:00:09.951 44733-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/ef/ee4a9c333705c9516f2b13939f82e08af4fbfc.debug 2026-02-17T11:08:54.136 INFO:tasks.ceph.osd.11.trial162.stderr:--00:00:00:09.954 44732-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/ef/ee4a9c333705c9516f2b13939f82e08af4fbfc.debug 2026-02-17T11:08:54.138 INFO:tasks.ceph.osd.3.trial162.stderr:--00:00:00:09.956 44730-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/ef/ee4a9c333705c9516f2b13939f82e08af4fbfc.debug 2026-02-17T11:08:54.140 INFO:tasks.ceph.osd.7.trial162.stderr:--00:00:00:09.958 44731-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/ef/ee4a9c333705c9516f2b13939f82e08af4fbfc.debug 2026-02-17T11:08:54.146 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.143+0000 7f04baffd640 1 -- 10.20.193.49:0/3332670217 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2565+0+0 (secure 0 0 0) 0x7f04c8083980 con 0x7f04d00726b0 2026-02-17T11:08:54.146 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.143+0000 7f04baffd640 10 client.4197.objecter ms_dispatch2 0x7f04d0000b90 osd_map(18..18 src has 1..18) 2026-02-17T11:08:54.146 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.143+0000 7f04baffd640 3 client.4197.objecter handle_osd_map got epochs [18,18] > 0 2026-02-17T11:08:54.146 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.143+0000 7f04baffd640 3 client.4197.objecter handle_osd_map decoding full epoch 18 2026-02-17T11:08:54.146 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.143+0000 7f04baffd640 20 client.4197.objecter dump_active .. 0 homeless 2026-02-17T11:08:54.185 INFO:tasks.ceph.osd.13.trial097.stderr:--00:00:00:10.020 44879-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/ef/ee4a9c333705c9516f2b13939f82e08af4fbfc.debug 2026-02-17T11:08:54.214 INFO:tasks.ceph.osd.10.trial157.stderr:--00:00:00:10.040 44307-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/ef/ee4a9c333705c9516f2b13939f82e08af4fbfc.debug 2026-02-17T11:08:54.214 INFO:tasks.ceph.osd.6.trial157.stderr:--00:00:00:10.043 44305-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/ef/ee4a9c333705c9516f2b13939f82e08af4fbfc.debug 2026-02-17T11:08:54.215 INFO:tasks.ceph.osd.14.trial157.stderr:--00:00:00:10.040 44308-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/ef/ee4a9c333705c9516f2b13939f82e08af4fbfc.debug 2026-02-17T11:08:54.215 INFO:tasks.ceph.osd.2.trial157.stderr:--00:00:00:10.046 44306-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/ef/ee4a9c333705c9516f2b13939f82e08af4fbfc.debug 2026-02-17T11:08:54.233 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.231+0000 7f04baffd640 1 -- 10.20.193.49:0/3332670217 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f04d01f7cf0 con 0x7f04d00726b0 2026-02-17T11:08:54.233 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.231+0000 7f04baffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:08:54.233 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.231+0000 7f04baffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:08:54.320 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.317+0000 7f04d897e640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:08:54.320 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.317+0000 7f04d897e640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:08:54.320 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.317+0000 7f04d897e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:08:54.320 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.317+0000 7f04d897e640 1 -- 10.20.193.49:0/3332670217 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f04d01602a0 con 0x7f04d00726b0 2026-02-17T11:08:54.350 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.348+0000 7f04baffd640 1 -- 10.20.193.49:0/3332670217 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12879 (secure 0 0 0) 0x7f04c8087940 con 0x7f04d00726b0 2026-02-17T11:08:54.350 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.348+0000 7f04baffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:08:54.350 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.348+0000 7f04baffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:08:54.350 INFO:teuthology.misc.health.trial049.stdout: 2026-02-17T11:08:54.350 INFO:teuthology.misc.health.trial049.stdout:{"epoch":18,"fsid":"2799a57b-9ea3-46ae-8e91-1fe004a3651d","created":"2026-02-17T11:08:37.595499+0000","modified":"2026-02-17T11:08:43.985163+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T11:08:43.985163+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"30bc819e-140a-433e-b860-eaa88e282a11","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2f7f1f11-f256-4094-82a9-5d21882e6e0e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"26bd1274-fe52-42cb-876b-df9920880f95","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c78a5263-3b0d-4b22-a848-bcd6a1e4f6b0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f0fdfadd-2f39-4ad8-ac88-cb588c5e8ee0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"65872639-d6c0-482d-95d1-1d9f250781c9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"43091d3e-638d-4462-867b-cade02a315e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"890ae4d6-33c9-4515-a896-a689647330dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"f04abc9b-ed75-4582-b47d-07a9890f52bb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"7dfbb00a-6b89-4de3-9f30-6aadd91b4408","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"e497a4fd-a944-489b-9cb3-30f5acaeb53e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"7371d50f-36f9-477d-8d4d-853f481dd6db","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"3cf4fded-49db-4d95-956b-77acc868a3ed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"7dc53473-594f-4cfb-8444-eab205e2e0f9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"e8ab3e8f-29a8-4c79-bf86-d29543aac56a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"300a4696-aa54-4b47-b9f3-87dec719bcfa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:08:54.353 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.350+0000 7f04d897e640 10 librados: watch_flush enter 2026-02-17T11:08:54.353 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.350+0000 7f04d897e640 10 librados: watch_flush exit 2026-02-17T11:08:54.353 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.350+0000 7f04d897e640 20 client.4197.objecter shutdown clearing up homeless session... 2026-02-17T11:08:54.353 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.350+0000 7f04d897e640 10 client.4197.objecter successfully canceled tick 2026-02-17T11:08:54.353 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.350+0000 7f04d897e640 1 -- 10.20.193.49:0/3332670217 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f04a00790b0 msgr2=0x7f04a007b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:54.353 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.350+0000 7f04d897e640 1 --2- 10.20.193.49:0/3332670217 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f04a00790b0 0x7f04a007b570 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f04d01e9970 tx=0x7f04bc009290 comp rx=0 tx=0).stop 2026-02-17T11:08:54.353 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.350+0000 7f04d897e640 10 monclient: shutdown 2026-02-17T11:08:54.353 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.350+0000 7f04d897e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:08:54.353 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.350+0000 7f04d897e640 1 -- 10.20.193.49:0/3332670217 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f04d00726b0 msgr2=0x7f04d0159070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:08:54.353 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.350+0000 7f04d897e640 1 --2- 10.20.193.49:0/3332670217 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f04d00726b0 0x7f04d0159070 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f04c802f350 tx=0x7f04c80047c0 comp rx=0 tx=0).stop 2026-02-17T11:08:54.353 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.350+0000 7f04d897e640 1 -- 10.20.193.49:0/3332670217 shutdown_connections 2026-02-17T11:08:54.353 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.350+0000 7f04d897e640 1 --2- 10.20.193.49:0/3332670217 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f04a00790b0 0x7f04a007b570 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:54.353 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.350+0000 7f04d897e640 1 --2- 10.20.193.49:0/3332670217 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f04d015f640 0x7f04d01e8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:54.353 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.350+0000 7f04d897e640 1 --2- 10.20.193.49:0/3332670217 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f04d0072b40 0x7f04d014e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:54.353 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.350+0000 7f04d897e640 1 --2- 10.20.193.49:0/3332670217 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f04d00726b0 0x7f04d0159070 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:08:54.353 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.350+0000 7f04d897e640 1 -- 10.20.193.49:0/3332670217 >> 10.20.193.49:0/3332670217 conn(0x7f04d00c9f30 msgr2=0x7f04d0155f60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:08:54.353 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.350+0000 7f04d897e640 1 -- 10.20.193.49:0/3332670217 shutdown_connections 2026-02-17T11:08:54.353 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.350+0000 7f04d897e640 1 -- 10.20.193.49:0/3332670217 wait complete. 2026-02-17T11:08:54.353 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:08:54.350+0000 7f04d897e640 1 librados: shutdown 2026-02-17T11:08:54.361 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-17T11:08:58.642 INFO:tasks.ceph.osd.0.trial049.stderr:==00:00:00:14.555 45320== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:58.653 INFO:tasks.ceph.osd.9.trial097.stderr:==00:00:00:14.550 44852== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:58.679 INFO:tasks.ceph.osd.4.trial049.stderr:==00:00:00:14.591 45321== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:58.679 INFO:tasks.ceph.osd.8.trial049.stderr:==00:00:00:14.585 45322== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:58.685 INFO:tasks.ceph.osd.12.trial049.stderr:==00:00:00:14.590 45323== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:58.689 INFO:tasks.ceph.osd.1.trial097.stderr:==00:00:00:14.592 44850== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:58.701 INFO:tasks.ceph.osd.7.trial162.stderr:==00:00:00:14.518 44731== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:58.701 INFO:tasks.ceph.osd.11.trial162.stderr:==00:00:00:14.518 44732== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:58.720 INFO:tasks.ceph.osd.3.trial162.stderr:==00:00:00:14.537 44730== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:58.721 INFO:tasks.ceph.osd.15.trial162.stderr:==00:00:00:14.536 44733== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:58.726 INFO:tasks.ceph.osd.5.trial097.stderr:==00:00:00:14.625 44851== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:58.778 INFO:tasks.ceph.osd.13.trial097.stderr:==00:00:00:14.613 44879== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:58.850 INFO:tasks.ceph.osd.10.trial157.stderr:==00:00:00:14.677 44307== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:58.871 INFO:tasks.ceph.osd.14.trial157.stderr:==00:00:00:14.697 44308== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:58.871 INFO:tasks.ceph.osd.6.trial157.stderr:==00:00:00:14.702 44305== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:58.911 INFO:tasks.ceph.osd.2.trial157.stderr:==00:00:00:14.741 44306== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:58.929 INFO:tasks.ceph.osd.0.trial049.stderr:==00:00:00:14.843 45320== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:58.936 INFO:tasks.ceph.osd.9.trial097.stderr:==00:00:00:14.834 44852== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:58.956 INFO:tasks.ceph.osd.9.trial097.stderr:==00:00:00:14.853 44852== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:58.968 INFO:tasks.ceph.osd.8.trial049.stderr:==00:00:00:14.875 45322== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:58.969 INFO:tasks.ceph.osd.4.trial049.stderr:==00:00:00:14.880 45321== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:58.972 INFO:tasks.ceph.osd.12.trial049.stderr:==00:00:00:14.877 45323== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:58.987 INFO:tasks.ceph.osd.1.trial097.stderr:==00:00:00:14.890 44850== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:58.987 INFO:tasks.ceph.osd.7.trial162.stderr:==00:00:00:14.805 44731== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:58.989 INFO:tasks.ceph.osd.8.trial049.stderr:==00:00:00:14.896 45322== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:58.994 INFO:tasks.ceph.osd.12.trial049.stderr:==00:00:00:14.900 45323== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:58.996 INFO:tasks.ceph.osd.11.trial162.stderr:==00:00:00:14.813 44732== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.012 INFO:tasks.ceph.osd.1.trial097.stderr:==00:00:00:14.915 44850== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.014 INFO:tasks.ceph.osd.8.trial049.stderr:==00:00:00:14.920 45322== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.014 INFO:tasks.ceph.osd.5.trial097.stderr:==00:00:00:14.914 44851== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.016 INFO:tasks.ceph.osd.3.trial162.stderr:==00:00:00:14.833 44730== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.017 INFO:tasks.ceph.osd.7.trial162.stderr:==00:00:00:14.835 44731== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.020 INFO:tasks.ceph.osd.15.trial162.stderr:==00:00:00:14.835 44733== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.038 INFO:tasks.ceph.osd.5.trial097.stderr:==00:00:00:14.937 44851== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.039 INFO:tasks.ceph.osd.3.trial162.stderr:==00:00:00:14.857 44730== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.043 INFO:tasks.ceph.osd.15.trial162.stderr:==00:00:00:14.859 44733== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.060 INFO:tasks.ceph.osd.5.trial097.stderr:==00:00:00:14.959 44851== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.067 INFO:tasks.ceph.osd.13.trial097.stderr:==00:00:00:14.901 44879== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.087 INFO:tasks.ceph.osd.13.trial097.stderr:==00:00:00:14.922 44879== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.134 INFO:tasks.ceph.osd.10.trial157.stderr:==00:00:00:14.961 44307== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.158 INFO:tasks.ceph.osd.10.trial157.stderr:==00:00:00:14.985 44307== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.161 INFO:tasks.ceph.osd.14.trial157.stderr:==00:00:00:14.987 44308== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.169 INFO:tasks.ceph.osd.6.trial157.stderr:==00:00:00:14.999 44305== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.190 INFO:tasks.ceph.osd.14.trial157.stderr:==00:00:00:15.016 44308== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.190 INFO:tasks.ceph.osd.10.trial157.stderr:==00:00:00:15.017 44307== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.194 INFO:tasks.ceph.osd.0.trial049.stderr:==00:00:00:15.107 45320== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.195 INFO:tasks.ceph.osd.6.trial157.stderr:==00:00:00:15.025 44305== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.202 INFO:tasks.ceph.osd.2.trial157.stderr:==00:00:00:15.032 44306== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.220 INFO:tasks.ceph.osd.6.trial157.stderr:==00:00:00:15.050 44305== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.220 INFO:tasks.ceph.osd.9.trial097.stderr:==00:00:00:15.118 44852== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.223 INFO:tasks.ceph.osd.2.trial157.stderr:==00:00:00:15.054 44306== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.233 INFO:tasks.ceph.osd.4.trial049.stderr:==00:00:00:15.145 45321== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.252 INFO:tasks.ceph.osd.2.trial157.stderr:==00:00:00:15.082 44306== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.256 INFO:tasks.ceph.osd.4.trial049.stderr:==00:00:00:15.168 45321== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.259 INFO:tasks.ceph.osd.11.trial162.stderr:==00:00:00:15.077 44732== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.260 INFO:tasks.ceph.osd.12.trial049.stderr:==00:00:00:15.166 45323== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.275 INFO:tasks.ceph.osd.1.trial097.stderr:==00:00:00:15.178 44850== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.281 INFO:tasks.ceph.osd.11.trial162.stderr:==00:00:00:15.099 44732== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.284 INFO:tasks.ceph.osd.8.trial049.stderr:==00:00:00:15.191 45322== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.288 INFO:tasks.ceph.osd.7.trial162.stderr:==00:00:00:15.106 44731== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.309 INFO:tasks.ceph.osd.8.trial049.stderr:==00:00:00:15.215 45322== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.315 INFO:tasks.ceph.osd.3.trial162.stderr:==00:00:00:15.133 44730== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.315 INFO:tasks.ceph.osd.15.trial162.stderr:==00:00:00:15.131 44733== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.323 INFO:tasks.ceph.osd.8.trial049.stderr:==00:00:00:15.230 45322== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.327 INFO:tasks.ceph.osd.5.trial097.stderr:==00:00:00:15.226 44851== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.351 INFO:tasks.ceph.osd.13.trial097.stderr:==00:00:00:15.185 44879== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.457 INFO:tasks.ceph.osd.14.trial157.stderr:==00:00:00:15.283 44308== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.458 INFO:tasks.ceph.osd.0.trial049.stderr:==00:00:00:15.371 45320== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.461 INFO:tasks.ceph.osd.10.trial157.stderr:==00:00:00:15.288 44307== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.484 INFO:tasks.ceph.osd.9.trial097.stderr:==00:00:00:15.382 44852== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.487 INFO:tasks.ceph.osd.6.trial157.stderr:==00:00:00:15.317 44305== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.512 INFO:tasks.ceph.osd.6.trial157.stderr:==00:00:00:15.342 44305== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.515 INFO:tasks.ceph.osd.2.trial157.stderr:==00:00:00:15.346 44306== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.528 INFO:tasks.ceph.osd.6.trial157.stderr:==00:00:00:15.358 44305== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.529 INFO:tasks.ceph.osd.4.trial049.stderr:==00:00:00:15.442 45321== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.534 INFO:tasks.ceph.osd.12.trial049.stderr:==00:00:00:15.440 45323== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.540 INFO:tasks.ceph.osd.1.trial097.stderr:==00:00:00:15.443 44850== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.551 INFO:tasks.ceph.osd.11.trial162.stderr:==00:00:00:15.369 44732== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.556 INFO:tasks.ceph.osd.7.trial162.stderr:==00:00:00:15.374 44731== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.582 INFO:tasks.ceph.osd.3.trial162.stderr:==00:00:00:15.400 44730== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.583 INFO:tasks.ceph.osd.15.trial162.stderr:==00:00:00:15.398 44733== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.593 INFO:tasks.ceph.osd.5.trial097.stderr:==00:00:00:15.492 44851== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.608 INFO:tasks.ceph.osd.5.trial097.stderr:==00:00:00:15.507 44851== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.618 INFO:tasks.ceph.osd.13.trial097.stderr:==00:00:00:15.452 44879== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.722 INFO:tasks.ceph.osd.0.trial049.stderr:==00:00:00:15.635 45320== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.724 INFO:tasks.ceph.osd.14.trial157.stderr:==00:00:00:15.550 44308== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.731 INFO:tasks.ceph.osd.10.trial157.stderr:==00:00:00:15.557 44307== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.746 INFO:tasks.ceph.osd.10.trial157.stderr:==00:00:00:15.572 44307== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.750 INFO:tasks.ceph.osd.9.trial097.stderr:==00:00:00:15.648 44852== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.765 INFO:tasks.ceph.osd.9.trial097.stderr:==00:00:00:15.663 44852== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.792 INFO:tasks.ceph.osd.2.trial157.stderr:==00:00:00:15.623 44306== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.799 INFO:tasks.ceph.osd.4.trial049.stderr:==00:00:00:15.711 45321== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.802 INFO:tasks.ceph.osd.12.trial049.stderr:==00:00:00:15.707 45323== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.807 INFO:tasks.ceph.osd.2.trial157.stderr:==00:00:00:15.637 44306== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.808 INFO:tasks.ceph.osd.1.trial097.stderr:==00:00:00:15.711 44850== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.814 INFO:tasks.ceph.osd.4.trial049.stderr:==00:00:00:15.726 45321== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.817 INFO:tasks.ceph.osd.12.trial049.stderr:==00:00:00:15.722 45323== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.823 INFO:tasks.ceph.osd.1.trial097.stderr:==00:00:00:15.726 44850== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.824 INFO:tasks.ceph.osd.11.trial162.stderr:==00:00:00:15.641 44732== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.828 INFO:tasks.ceph.osd.7.trial162.stderr:==00:00:00:15.646 44731== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.840 INFO:tasks.ceph.osd.11.trial162.stderr:==00:00:00:15.657 44732== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.844 INFO:tasks.ceph.osd.7.trial162.stderr:==00:00:00:15.661 44731== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.869 INFO:tasks.ceph.osd.8.trial049.stderr:2026-02-17T11:08:59.864+0000 77b6940 -1 Falling back to public interface 2026-02-17T11:08:59.873 INFO:tasks.ceph.osd.15.trial162.stderr:==00:00:00:15.689 44733== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.874 INFO:tasks.ceph.osd.3.trial162.stderr:==00:00:00:15.691 44730== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.885 INFO:tasks.ceph.osd.13.trial097.stderr:==00:00:00:15.720 44879== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.889 INFO:tasks.ceph.osd.3.trial162.stderr:==00:00:00:15.706 44730== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.890 INFO:tasks.ceph.osd.15.trial162.stderr:==00:00:00:15.706 44733== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.900 INFO:tasks.ceph.osd.13.trial097.stderr:==00:00:00:15.734 44879== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.989 INFO:tasks.ceph.osd.0.trial049.stderr:==00:00:00:15.903 45320== Warning: unimplemented fcntl command: 1038 2026-02-17T11:08:59.990 INFO:tasks.ceph.osd.14.trial157.stderr:==00:00:00:15.816 44308== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:00.005 INFO:tasks.ceph.osd.0.trial049.stderr:==00:00:00:15.918 45320== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:00.005 INFO:tasks.ceph.osd.14.trial157.stderr:==00:00:00:15.831 44308== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:00.056 INFO:tasks.ceph.osd.6.trial157.stderr:2026-02-17T11:09:00.051+0000 77b6940 -1 Falling back to public interface 2026-02-17T11:09:00.138 INFO:tasks.ceph.osd.5.trial097.stderr:2026-02-17T11:09:00.134+0000 77b6940 -1 Falling back to public interface 2026-02-17T11:09:00.278 INFO:tasks.ceph.osd.10.trial157.stderr:2026-02-17T11:09:00.273+0000 77b6940 -1 Falling back to public interface 2026-02-17T11:09:00.302 INFO:tasks.ceph.osd.9.trial097.stderr:2026-02-17T11:09:00.299+0000 77b6940 -1 Falling back to public interface 2026-02-17T11:09:00.346 INFO:tasks.ceph.osd.4.trial049.stderr:2026-02-17T11:09:00.342+0000 77b6940 -1 Falling back to public interface 2026-02-17T11:09:00.349 INFO:tasks.ceph.osd.2.trial157.stderr:2026-02-17T11:09:00.344+0000 77b6940 -1 Falling back to public interface 2026-02-17T11:09:00.354 INFO:tasks.ceph.osd.12.trial049.stderr:2026-02-17T11:09:00.348+0000 77b6940 -1 Falling back to public interface 2026-02-17T11:09:00.366 INFO:tasks.ceph.osd.1.trial097.stderr:2026-02-17T11:09:00.363+0000 77b6940 -1 Falling back to public interface 2026-02-17T11:09:00.370 INFO:tasks.ceph.osd.11.trial162.stderr:2026-02-17T11:09:00.365+0000 77b6940 -1 Falling back to public interface 2026-02-17T11:09:00.374 INFO:tasks.ceph.osd.7.trial162.stderr:2026-02-17T11:09:00.369+0000 77b6940 -1 Falling back to public interface 2026-02-17T11:09:00.423 INFO:tasks.ceph.osd.15.trial162.stderr:2026-02-17T11:09:00.418+0000 77b6940 -1 Falling back to public interface 2026-02-17T11:09:00.423 INFO:tasks.ceph.osd.3.trial162.stderr:2026-02-17T11:09:00.418+0000 77b6940 -1 Falling back to public interface 2026-02-17T11:09:00.444 INFO:tasks.ceph.osd.13.trial097.stderr:2026-02-17T11:09:00.440+0000 77b6940 -1 Falling back to public interface 2026-02-17T11:09:00.534 INFO:tasks.ceph.osd.0.trial049.stderr:2026-02-17T11:09:00.529+0000 77b6940 -1 Falling back to public interface 2026-02-17T11:09:00.542 INFO:tasks.ceph.osd.14.trial157.stderr:2026-02-17T11:09:00.537+0000 77b6940 -1 Falling back to public interface 2026-02-17T11:09:01.970 DEBUG:teuthology.orchestra.run.trial049:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T11:09:02.031 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.029+0000 7fe81a824640 10 monclient: get_monmap_and_config 2026-02-17T11:09:02.031 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.029+0000 7fe81a824640 10 monclient: build_initial_monmap 2026-02-17T11:09:02.031 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.029+0000 7fe81a824640 10 monclient: monmap: 2026-02-17T11:09:02.032 INFO:teuthology.misc.health.trial049.stderr:epoch 0 2026-02-17T11:09:02.032 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:09:02.032 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:09:02.030291+0000 2026-02-17T11:09:02.032 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:09:02.030291+0000 2026-02-17T11:09:02.032 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:09:02.032 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:09:02.032 INFO:teuthology.misc.health.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:09:02.032 INFO:teuthology.misc.health.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:09:02.032 INFO:teuthology.misc.health.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:09:02.032 INFO:teuthology.misc.health.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:09:02.032 INFO:teuthology.misc.health.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:09:02.033 INFO:teuthology.misc.health.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:09:02.033 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:09:02.033 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.030+0000 7fe81a824640 1 Processor -- start 2026-02-17T11:09:02.033 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.030+0000 7fe81a824640 1 -- start start 2026-02-17T11:09:02.033 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.030+0000 7fe81a824640 10 monclient: init 2026-02-17T11:09:02.036 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.030+0000 7fe81a824640 10 monclient: _reopen_session rank -1 2026-02-17T11:09:02.036 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.030+0000 7fe81a824640 10 monclient: _add_conns ranks=[0,5,1,2,3,4] 2026-02-17T11:09:02.036 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.030+0000 7fe81a824640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe8141504c0 addr v1:10.20.193.49:6789/0 2026-02-17T11:09:02.036 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.030+0000 7fe81a824640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7fe8140c7120 0x7fe8140c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:09:02.036 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.030+0000 7fe81a824640 10 monclient(hunting): picked mon.noname-c con 0x7fe8140c7120 addr v2:10.20.193.157:3300/0 2026-02-17T11:09:02.036 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.030+0000 7fe81a824640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fe8140c9050 addr v1:10.20.193.97:6789/0 2026-02-17T11:09:02.036 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.030+0000 7fe81a824640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8140c59d0 con 0x7fe8141504c0 2026-02-17T11:09:02.036 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.030+0000 7fe81a824640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe81415def0 con 0x7fe8140c9050 2026-02-17T11:09:02.036 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.030+0000 7fe81a824640 10 monclient(hunting): start opening mon connection 2026-02-17T11:09:02.037 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.030+0000 7fe81a824640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7fe8140c5c70 con 0x7fe8140c7120 2026-02-17T11:09:02.037 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.030+0000 7fe81a824640 10 monclient(hunting): _renew_subs 2026-02-17T11:09:02.037 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.030+0000 7fe81a824640 10 monclient(hunting): authenticate will time out at 1018.693774s 2026-02-17T11:09:02.037 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.031+0000 7fe813fff640 1 --1- >> v1:10.20.193.49:6789/0 conn(0x7fe8141504c0 0x7fe8140c52c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.49:6789/0 says I am v1:10.20.193.49:43940/0 (socket says 10.20.193.49:43940) 2026-02-17T11:09:02.037 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.031+0000 7fe813fff640 1 -- 10.20.193.49:0/265959969 learned_addr learned my addr 10.20.193.49:0/265959969 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:09:02.037 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.031+0000 7fe8137fe640 1 --2- 10.20.193.49:0/265959969 >> v2:10.20.193.157:3300/0 conn(0x7fe8140c7120 0x7fe8140c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:09:02.037 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.031+0000 7fe8137fe640 10 monclient(hunting): get_auth_request con 0x7fe8140c7120 auth_method 0 2026-02-17T11:09:02.037 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.031+0000 7fe8137fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:09:02.037 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.031+0000 7fe8137fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:09:02.037 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.031+0000 7fe8137fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:09:02.037 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.031+0000 7fe8137fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:09:02.037 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.031+0000 7fe8137fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:09:02.038 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.032+0000 7fe8137fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:09:02.038 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.032+0000 7fe812ffd640 1 -- 10.20.193.49:0/265959969 <== mon.0 v1:10.20.193.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3071028377 0 0) 0x7fe8140c59d0 con 0x7fe8141504c0 2026-02-17T11:09:02.038 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.032+0000 7fe812ffd640 10 monclient(hunting): _negotiate 2026-02-17T11:09:02.038 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.032+0000 7fe812ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:09:02.038 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.032+0000 7fe812ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:09:02.038 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.032+0000 7fe812ffd640 10 monclient(hunting): my global_id is 4248 2026-02-17T11:09:02.038 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.032+0000 7fe812ffd640 1 -- 10.20.193.49:0/265959969 --> v1:10.20.193.49:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7f8003620 con 0x7fe8141504c0 2026-02-17T11:09:02.038 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.033+0000 7fe812ffd640 1 -- 10.20.193.49:0/265959969 <== mon.1 v1:10.20.193.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 68822313 0 0) 0x7fe81415def0 con 0x7fe8140c9050 2026-02-17T11:09:02.038 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.033+0000 7fe812ffd640 10 monclient(hunting): _negotiate 2026-02-17T11:09:02.038 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.033+0000 7fe812ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:09:02.038 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.033+0000 7fe812ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:09:02.038 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.033+0000 7fe812ffd640 10 monclient(hunting): my global_id is 4267 2026-02-17T11:09:02.039 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.033+0000 7fe812ffd640 1 -- 10.20.193.49:0/265959969 --> v1:10.20.193.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8140c59d0 con 0x7fe8140c9050 2026-02-17T11:09:02.039 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.033+0000 7fe8137fe640 10 monclient(hunting): handle_auth_done global_id 4265 payload 274 2026-02-17T11:09:02.039 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.033+0000 7fe8137fe640 1 -- 10.20.193.49:0/265959969 >> v1:10.20.193.97:6789/0 conn(0x7fe8140c9050 legacy=0x7fe81415d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:09:02.039 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.033+0000 7fe8137fe640 1 -- 10.20.193.49:0/265959969 >> v1:10.20.193.49:6789/0 conn(0x7fe8141504c0 legacy=0x7fe8140c52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:09:02.039 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.033+0000 7fe8137fe640 10 monclient: _finish_hunting 0 2026-02-17T11:09:02.039 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.033+0000 7fe8137fe640 1 monclient: found mon.noname-c 2026-02-17T11:09:02.039 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.033+0000 7fe8137fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:09:02.039 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.033+0000 7fe8137fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:09:02.039 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.033+0000 7fe8137fe640 1 -- 10.20.193.49:0/265959969 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8140c7fb0 con 0x7fe8140c7120 2026-02-17T11:09:02.039 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.034+0000 7fe8137fe640 1 --2- 10.20.193.49:0/265959969 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe8140c7120 0x7fe8140c7550 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe8040098a0 tx=0x7fe80402ef90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b52e2d33007cf0c7 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:09:02.046 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.036+0000 7fe812ffd640 1 -- 10.20.193.49:0/265959969 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe80403c070 con 0x7fe8140c7120 2026-02-17T11:09:02.046 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.036+0000 7fe812ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:09:02.046 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.036+0000 7fe812ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:09:02.046 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.036+0000 7fe812ffd640 10 monclient: dump: 2026-02-17T11:09:02.046 INFO:teuthology.misc.health.trial049.stderr:epoch 1 2026-02-17T11:09:02.047 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:09:02.047 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:02.047 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:02.047 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:09:02.047 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:09:02.047 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:09:02.047 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:09:02.047 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:09:02.047 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:09:02.047 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.036+0000 7fe812ffd640 10 monclient: _finish_auth 0 2026-02-17T11:09:02.047 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.036+0000 7fe812ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:09:02.047 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.036+0000 7fe812ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:09:02.048 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.036+0000 7fe81a824640 5 monclient: authenticate success, global_id 4265 2026-02-17T11:09:02.048 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.036+0000 7fe81a824640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:09:02.048 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.036+0000 7fe812ffd640 1 -- 10.20.193.49:0/265959969 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe80402fca0 con 0x7fe8140c7120 2026-02-17T11:09:02.048 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.036+0000 7fe812ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:09:02.048 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.036+0000 7fe812ffd640 1 -- 10.20.193.49:0/265959969 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe804037640 con 0x7fe8140c7120 2026-02-17T11:09:02.048 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.036+0000 7fe812ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:09:02.048 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.036+0000 7fe812ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:09:02.048 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.036+0000 7fe812ffd640 10 monclient: dump: 2026-02-17T11:09:02.048 INFO:teuthology.misc.health.trial049.stderr:epoch 1 2026-02-17T11:09:02.048 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:09:02.048 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:02.049 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:02.049 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:09:02.049 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:09:02.049 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:09:02.049 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:09:02.049 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:09:02.049 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:09:02.049 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.036+0000 7fe81a824640 10 monclient: get_monmap_and_config success 2026-02-17T11:09:02.049 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.036+0000 7fe81a824640 4 set_mon_vals no callback set 2026-02-17T11:09:02.049 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.037+0000 7fe81a824640 10 monclient: shutdown 2026-02-17T11:09:02.049 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.037+0000 7fe81a824640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:09:02.049 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.037+0000 7fe81a824640 1 -- 10.20.193.49:0/265959969 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe8140c7120 msgr2=0x7fe8140c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:09:02.050 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.037+0000 7fe81a824640 1 --2- 10.20.193.49:0/265959969 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe8140c7120 0x7fe8140c7550 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe8040098a0 tx=0x7fe80402ef90 comp rx=0 tx=0).stop 2026-02-17T11:09:02.050 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.037+0000 7fe81a824640 1 -- 10.20.193.49:0/265959969 shutdown_connections 2026-02-17T11:09:02.050 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.037+0000 7fe81a824640 1 --2- 10.20.193.49:0/265959969 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe8140c7120 0x7fe8140c7550 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:02.050 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.037+0000 7fe81a824640 1 -- 10.20.193.49:0/265959969 >> 10.20.193.49:0/265959969 conn(0x7fe8140c9f30 msgr2=0x7fe8140ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:09:02.050 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.037+0000 7fe81a824640 1 -- 10.20.193.49:0/265959969 shutdown_connections 2026-02-17T11:09:02.050 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.037+0000 7fe81a824640 1 -- 10.20.193.49:0/265959969 wait complete. 2026-02-17T11:09:02.050 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.037+0000 7fe81a824640 10 monclient: build_initial_monmap 2026-02-17T11:09:02.050 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.037+0000 7fe81a824640 10 monclient: monmap: 2026-02-17T11:09:02.050 INFO:teuthology.misc.health.trial049.stderr:epoch 0 2026-02-17T11:09:02.050 INFO:teuthology.misc.health.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:09:02.050 INFO:teuthology.misc.health.trial049.stderr:last_changed 0.000000 2026-02-17T11:09:02.050 INFO:teuthology.misc.health.trial049.stderr:created 0.000000 2026-02-17T11:09:02.051 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:09:02.051 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:09:02.051 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:09:02.051 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:09:02.051 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:09:02.051 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:09:02.051 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.037+0000 7fe81a824640 1 librados: starting msgr at 2026-02-17T11:09:02.051 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.037+0000 7fe81a824640 1 librados: starting objecter 2026-02-17T11:09:02.051 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.037+0000 7fe81a824640 1 Processor -- start 2026-02-17T11:09:02.051 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.038+0000 7fe81a824640 1 -- start start 2026-02-17T11:09:02.051 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.038+0000 7fe81a824640 1 librados: setting wanted keys 2026-02-17T11:09:02.051 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.038+0000 7fe81a824640 1 librados: calling monclient init 2026-02-17T11:09:02.051 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.038+0000 7fe81a824640 10 monclient: init 2026-02-17T11:09:02.052 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.038+0000 7fe81a824640 10 monclient: _reopen_session rank -1 2026-02-17T11:09:02.052 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.038+0000 7fe81a824640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:09:02.052 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.038+0000 7fe81a824640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe8140c7120 0x7fe814140cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:09:02.052 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.038+0000 7fe81a824640 10 monclient(hunting): picked mon.noname-c con 0x7fe8140c7120 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:09:02.052 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.038+0000 7fe81a824640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe8140c9050 0x7fe81406db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:09:02.052 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.038+0000 7fe81a824640 10 monclient(hunting): picked mon.noname-a con 0x7fe8140c9050 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:09:02.052 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.038+0000 7fe81a824640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe8141504c0 0x7fe8141f4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:09:02.052 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.038+0000 7fe81a824640 10 monclient(hunting): picked mon.noname-b con 0x7fe8141504c0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:09:02.052 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.038+0000 7fe81a824640 10 monclient(hunting): start opening mon connection 2026-02-17T11:09:02.052 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.038+0000 7fe81a824640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe8140c8850 con 0x7fe8140c9050 2026-02-17T11:09:02.052 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.038+0000 7fe81a824640 10 monclient(hunting): start opening mon connection 2026-02-17T11:09:02.052 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.038+0000 7fe81a824640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe8140c8570 con 0x7fe8141504c0 2026-02-17T11:09:02.052 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.038+0000 7fe81a824640 10 monclient(hunting): start opening mon connection 2026-02-17T11:09:02.053 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.038+0000 7fe81a824640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe8140c8b30 con 0x7fe8140c7120 2026-02-17T11:09:02.053 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.038+0000 7fe81a824640 10 monclient(hunting): _renew_subs 2026-02-17T11:09:02.053 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.038+0000 7fe81a824640 10 monclient(hunting): authenticate will time out at 1018.701404s 2026-02-17T11:09:02.053 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.038+0000 7fe8137fe640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe8140c9050 0x7fe81406db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:09:02.053 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.038+0000 7fe813fff640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe8140c7120 0x7fe814140cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:09:02.053 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.038+0000 7fe8137fe640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe8140c9050 0x7fe81406db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:35680/0 (socket says 10.20.193.49:35680) 2026-02-17T11:09:02.053 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.038+0000 7fe8137fe640 1 -- 10.20.193.49:0/1194033990 learned_addr learned my addr 10.20.193.49:0/1194033990 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:09:02.053 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.038+0000 7fe8137fe640 10 monclient(hunting): get_auth_request con 0x7fe8140c9050 auth_method 0 2026-02-17T11:09:02.053 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.038+0000 7fe8137fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:09:02.053 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.038+0000 7fe8137fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:09:02.053 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.038+0000 7fe8137fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:09:02.054 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.038+0000 7fe813fff640 10 monclient(hunting): get_auth_request con 0x7fe8140c7120 auth_method 0 2026-02-17T11:09:02.054 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.038+0000 7fe813fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:09:02.054 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.038+0000 7fe813fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:09:02.054 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.038+0000 7fe813fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:09:02.054 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.038+0000 7fe818d9a640 1 --2- 10.20.193.49:0/1194033990 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe8141504c0 0x7fe8141f4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:09:02.054 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.039+0000 7fe818d9a640 10 monclient(hunting): get_auth_request con 0x7fe8141504c0 auth_method 0 2026-02-17T11:09:02.054 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.039+0000 7fe818d9a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:09:02.054 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.039+0000 7fe818d9a640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:09:02.054 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.039+0000 7fe818d9a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:09:02.054 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.039+0000 7fe8137fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:09:02.054 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.039+0000 7fe8137fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:09:02.054 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.039+0000 7fe8137fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:09:02.054 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.039+0000 7fe813fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:09:02.055 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.039+0000 7fe813fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:09:02.055 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.039+0000 7fe813fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:09:02.055 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.039+0000 7fe818d9a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:09:02.055 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.039+0000 7fe818d9a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:09:02.055 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.039+0000 7fe818d9a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:09:02.055 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.041+0000 7fe8137fe640 10 monclient(hunting): handle_auth_done global_id 4251 payload 824 2026-02-17T11:09:02.055 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.041+0000 7fe8137fe640 1 -- 10.20.193.49:0/1194033990 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe8140c7120 msgr2=0x7fe814140cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:09:02.055 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.041+0000 7fe8137fe640 1 --2- 10.20.193.49:0/1194033990 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe8140c7120 0x7fe814140cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:02.055 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.041+0000 7fe8137fe640 1 -- 10.20.193.49:0/1194033990 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe8141504c0 msgr2=0x7fe8141f4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:09:02.055 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.041+0000 7fe8137fe640 1 --2- 10.20.193.49:0/1194033990 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe8141504c0 0x7fe8141f4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:02.055 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.041+0000 7fe8137fe640 10 monclient: _finish_hunting 0 2026-02-17T11:09:02.055 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.041+0000 7fe8137fe640 1 monclient: found mon.noname-a 2026-02-17T11:09:02.055 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.041+0000 7fe8137fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:09:02.056 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.041+0000 7fe8137fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:09:02.056 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.041+0000 7fe8137fe640 1 -- 10.20.193.49:0/1194033990 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe814141b30 con 0x7fe8140c9050 2026-02-17T11:09:02.056 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.042+0000 7fe8137fe640 1 --2- 10.20.193.49:0/1194033990 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe8140c9050 0x7fe81406db50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe80403a040 tx=0x7fe8040047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:09:02.056 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.042+0000 7fe810ff9640 10 client.?.objecter ms_handle_connect 0x7fe8140c9050 2026-02-17T11:09:02.056 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.042+0000 7fe810ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T11:09:02.056 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.043+0000 7fe810ff9640 1 -- 10.20.193.49:0/1194033990 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe804046020 con 0x7fe8140c9050 2026-02-17T11:09:02.056 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.043+0000 7fe810ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:09:02.056 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.043+0000 7fe810ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:09:02.056 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.043+0000 7fe810ff9640 10 monclient: dump: 2026-02-17T11:09:02.056 INFO:teuthology.misc.health.trial049.stderr:epoch 1 2026-02-17T11:09:02.056 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:09:02.056 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:02.057 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:02.057 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:09:02.057 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:09:02.057 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:09:02.057 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:09:02.057 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:09:02.057 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:09:02.057 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.043+0000 7fe810ff9640 10 monclient: _finish_auth 0 2026-02-17T11:09:02.057 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.043+0000 7fe810ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:09:02.057 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.043+0000 7fe810ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:09:02.057 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.043+0000 7fe810ff9640 1 -- 10.20.193.49:0/1194033990 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe80402fe50 con 0x7fe8140c9050 2026-02-17T11:09:02.057 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.043+0000 7fe810ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:09:02.057 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.043+0000 7fe810ff9640 1 -- 10.20.193.49:0/1194033990 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe80403c040 con 0x7fe8140c9050 2026-02-17T11:09:02.058 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.043+0000 7fe810ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:09:02.058 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.043+0000 7fe810ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:09:02.058 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.043+0000 7fe810ff9640 10 monclient: dump: 2026-02-17T11:09:02.058 INFO:teuthology.misc.health.trial049.stderr:epoch 1 2026-02-17T11:09:02.058 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:09:02.058 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:02.058 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:02.058 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:09:02.058 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:09:02.058 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:09:02.058 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:09:02.058 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:09:02.059 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:09:02.059 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.043+0000 7fe8127fc640 4 set_mon_vals no callback set 2026-02-17T11:09:02.059 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.043+0000 7fe81a824640 5 monclient: authenticate success, global_id 4251 2026-02-17T11:09:02.059 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.043+0000 7fe81a824640 10 monclient: _renew_subs 2026-02-17T11:09:02.059 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.043+0000 7fe81a824640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:09:02.059 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.043+0000 7fe81a824640 1 -- 10.20.193.49:0/1194033990 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe81413d550 con 0x7fe8140c9050 2026-02-17T11:09:02.059 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.044+0000 7fe81a824640 10 client.4251.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:09:02.059 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.044+0000 7fe81a824640 10 monclient: _renew_subs 2026-02-17T11:09:02.059 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.044+0000 7fe81a824640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:09:02.059 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.044+0000 7fe81a824640 1 -- 10.20.193.49:0/1194033990 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe81413ff10 con 0x7fe8140c9050 2026-02-17T11:09:02.059 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.044+0000 7fe81a824640 1 librados: init done 2026-02-17T11:09:02.059 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.044+0000 7fe81a824640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:09:02.059 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.044+0000 7fe81a824640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:09:02.060 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.044+0000 7fe81a824640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:09:02.060 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.044+0000 7fe81a824640 1 -- 10.20.193.49:0/1194033990 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe81415e1d0 con 0x7fe8140c9050 2026-02-17T11:09:02.061 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.056+0000 7fe810ff9640 1 -- 10.20.193.49:0/1194033990 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 4) ==== 100001+0+0 (secure 0 0 0) 0x7fe804053070 con 0x7fe8140c9050 2026-02-17T11:09:02.061 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.057+0000 7fe810ff9640 1 --2- 10.20.193.49:0/1194033990 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fe7e40790b0 0x7fe7e407b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:09:02.061 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.057+0000 7fe813fff640 1 --2- 10.20.193.49:0/1194033990 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fe7e40790b0 0x7fe7e407b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:09:02.061 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.057+0000 7fe813fff640 10 monclient: get_auth_request con 0x7fe7e40790b0 auth_method 0 2026-02-17T11:09:02.062 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.058+0000 7fe813fff640 1 --2- 10.20.193.49:0/1194033990 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fe7e40790b0 0x7fe7e407b570 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe800005980 tx=0x7fe800009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:09:02.062 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.058+0000 7fe810ff9640 10 client.4251.objecter ms_handle_connect 0x7fe7e40790b0 2026-02-17T11:09:02.062 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.059+0000 7fe810ff9640 1 -- 10.20.193.49:0/1194033990 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2565+0+0 (secure 0 0 0) 0x7fe80402fb60 con 0x7fe8140c9050 2026-02-17T11:09:02.062 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.059+0000 7fe810ff9640 10 client.4251.objecter ms_dispatch2 0x7fe814000b90 osd_map(18..18 src has 1..18) 2026-02-17T11:09:02.062 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.059+0000 7fe810ff9640 3 client.4251.objecter handle_osd_map got epochs [18,18] > 0 2026-02-17T11:09:02.062 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.059+0000 7fe810ff9640 3 client.4251.objecter handle_osd_map decoding full epoch 18 2026-02-17T11:09:02.062 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.059+0000 7fe810ff9640 20 client.4251.objecter dump_active .. 0 homeless 2026-02-17T11:09:02.163 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.161+0000 7fe810ff9640 1 -- 10.20.193.49:0/1194033990 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe81415e1d0 con 0x7fe8140c9050 2026-02-17T11:09:02.163 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.161+0000 7fe810ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:09:02.163 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.161+0000 7fe810ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:09:02.252 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.250+0000 7fe81a824640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:09:02.252 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.250+0000 7fe81a824640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:09:02.252 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.250+0000 7fe81a824640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:09:02.253 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.250+0000 7fe81a824640 1 -- 10.20.193.49:0/1194033990 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe8141508a0 con 0x7fe8140c9050 2026-02-17T11:09:02.271 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.270+0000 7fe810ff9640 1 -- 10.20.193.49:0/1194033990 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12879 (secure 0 0 0) 0x7fe804050020 con 0x7fe8140c9050 2026-02-17T11:09:02.272 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.270+0000 7fe810ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:09:02.272 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.270+0000 7fe810ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:09:02.272 INFO:teuthology.misc.health.trial049.stdout: 2026-02-17T11:09:02.272 INFO:teuthology.misc.health.trial049.stdout:{"epoch":18,"fsid":"2799a57b-9ea3-46ae-8e91-1fe004a3651d","created":"2026-02-17T11:08:37.595499+0000","modified":"2026-02-17T11:08:43.985163+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T11:08:43.985163+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"30bc819e-140a-433e-b860-eaa88e282a11","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2f7f1f11-f256-4094-82a9-5d21882e6e0e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"26bd1274-fe52-42cb-876b-df9920880f95","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c78a5263-3b0d-4b22-a848-bcd6a1e4f6b0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f0fdfadd-2f39-4ad8-ac88-cb588c5e8ee0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"65872639-d6c0-482d-95d1-1d9f250781c9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"43091d3e-638d-4462-867b-cade02a315e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"890ae4d6-33c9-4515-a896-a689647330dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"f04abc9b-ed75-4582-b47d-07a9890f52bb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"7dfbb00a-6b89-4de3-9f30-6aadd91b4408","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"e497a4fd-a944-489b-9cb3-30f5acaeb53e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"7371d50f-36f9-477d-8d4d-853f481dd6db","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"3cf4fded-49db-4d95-956b-77acc868a3ed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"7dc53473-594f-4cfb-8444-eab205e2e0f9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"e8ab3e8f-29a8-4c79-bf86-d29543aac56a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"300a4696-aa54-4b47-b9f3-87dec719bcfa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:09:02.275 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.272+0000 7fe81a824640 10 librados: watch_flush enter 2026-02-17T11:09:02.275 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.272+0000 7fe81a824640 10 librados: watch_flush exit 2026-02-17T11:09:02.275 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.272+0000 7fe81a824640 20 client.4251.objecter shutdown clearing up homeless session... 2026-02-17T11:09:02.275 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.272+0000 7fe81a824640 10 client.4251.objecter successfully canceled tick 2026-02-17T11:09:02.275 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.272+0000 7fe81a824640 1 -- 10.20.193.49:0/1194033990 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fe7e40790b0 msgr2=0x7fe7e407b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:09:02.275 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.272+0000 7fe81a824640 1 --2- 10.20.193.49:0/1194033990 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fe7e40790b0 0x7fe7e407b570 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe800005980 tx=0x7fe800009040 comp rx=0 tx=0).stop 2026-02-17T11:09:02.275 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.272+0000 7fe81a824640 10 monclient: shutdown 2026-02-17T11:09:02.276 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.272+0000 7fe81a824640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:09:02.276 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.272+0000 7fe81a824640 1 -- 10.20.193.49:0/1194033990 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe8140c9050 msgr2=0x7fe81406db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:09:02.276 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.272+0000 7fe81a824640 1 --2- 10.20.193.49:0/1194033990 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe8140c9050 0x7fe81406db50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe80403a040 tx=0x7fe8040047c0 comp rx=0 tx=0).stop 2026-02-17T11:09:02.276 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.272+0000 7fe81a824640 1 -- 10.20.193.49:0/1194033990 shutdown_connections 2026-02-17T11:09:02.276 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.272+0000 7fe81a824640 1 --2- 10.20.193.49:0/1194033990 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fe7e40790b0 0x7fe7e407b570 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:02.276 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.273+0000 7fe81a824640 1 --2- 10.20.193.49:0/1194033990 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe8141504c0 0x7fe8141f4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:02.276 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.273+0000 7fe81a824640 1 --2- 10.20.193.49:0/1194033990 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe8140c9050 0x7fe81406db50 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:02.276 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.273+0000 7fe81a824640 1 --2- 10.20.193.49:0/1194033990 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe8140c7120 0x7fe814140cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:02.276 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.273+0000 7fe81a824640 1 -- 10.20.193.49:0/1194033990 >> 10.20.193.49:0/1194033990 conn(0x7fe8140c9f30 msgr2=0x7fe8141e8270 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:09:02.276 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.273+0000 7fe81a824640 1 -- 10.20.193.49:0/1194033990 shutdown_connections 2026-02-17T11:09:02.276 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.273+0000 7fe81a824640 1 -- 10.20.193.49:0/1194033990 wait complete. 2026-02-17T11:09:02.277 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:02.273+0000 7fe81a824640 1 librados: shutdown 2026-02-17T11:09:02.283 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-17T11:09:04.695 INFO:tasks.ceph.osd.8.trial049.stderr:==00:00:00:20.601 45322== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:05.012 INFO:tasks.ceph.osd.8.trial049.stderr:==00:00:00:20.918 45322== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:05.031 INFO:tasks.ceph.osd.6.trial157.stderr:==00:00:00:20.861 44305== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:05.064 INFO:tasks.ceph.osd.5.trial097.stderr:==00:00:00:20.964 44851== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:05.196 INFO:tasks.ceph.osd.7.trial162.stderr:==00:00:00:21.013 44731== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:05.196 INFO:tasks.ceph.osd.11.trial162.stderr:==00:00:00:21.013 44732== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:05.233 INFO:tasks.ceph.osd.12.trial049.stderr:==00:00:00:21.138 45323== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:05.234 INFO:tasks.ceph.osd.4.trial049.stderr:==00:00:00:21.145 45321== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:05.236 INFO:tasks.ceph.osd.9.trial097.stderr:==00:00:00:21.134 44852== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:05.246 INFO:tasks.ceph.osd.10.trial157.stderr:==00:00:00:21.072 44307== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:05.249 INFO:tasks.ceph.osd.3.trial162.stderr:==00:00:00:21.066 44730== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:05.251 INFO:tasks.ceph.osd.15.trial162.stderr:==00:00:00:21.066 44733== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:05.305 INFO:tasks.ceph.osd.8.trial049.stderr:==00:00:00:21.211 45322== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:05.306 INFO:tasks.ceph.osd.1.trial097.stderr:==00:00:00:21.209 44850== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:05.337 INFO:tasks.ceph.osd.2.trial157.stderr:==00:00:00:21.167 44306== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:05.345 INFO:tasks.ceph.osd.6.trial157.stderr:==00:00:00:21.175 44305== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:05.384 INFO:tasks.ceph.osd.5.trial097.stderr:==00:00:00:21.283 44851== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:05.409 INFO:tasks.ceph.osd.13.trial097.stderr:==00:00:00:21.244 44879== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:05.432 INFO:tasks.ceph.osd.0.trial049.stderr:==00:00:00:21.346 45320== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:05.509 INFO:tasks.ceph.osd.7.trial162.stderr:==00:00:00:21.326 44731== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:05.510 INFO:tasks.ceph.osd.11.trial162.stderr:==00:00:00:21.327 44732== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:05.542 INFO:tasks.ceph.osd.14.trial157.stderr:==00:00:00:21.368 44308== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:05.542 INFO:tasks.ceph.osd.12.trial049.stderr:==00:00:00:21.447 45323== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:05.543 INFO:tasks.ceph.osd.4.trial049.stderr:==00:00:00:21.454 45321== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:05.546 INFO:tasks.ceph.osd.9.trial097.stderr:==00:00:00:21.443 44852== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:05.559 INFO:tasks.ceph.osd.10.trial157.stderr:==00:00:00:21.385 44307== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:05.577 INFO:tasks.ceph.osd.15.trial162.stderr:==00:00:00:21.392 44733== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:05.577 INFO:tasks.ceph.osd.3.trial162.stderr:==00:00:00:21.394 44730== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:05.582 INFO:tasks.ceph.osd.8.trial049.stderr:==00:00:00:21.488 45322== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:05.622 INFO:tasks.ceph.osd.1.trial097.stderr:==00:00:00:21.525 44850== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:05.646 INFO:tasks.ceph.osd.2.trial157.stderr:==00:00:00:21.476 44306== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:05.661 INFO:tasks.ceph.osd.6.trial157.stderr:==00:00:00:21.491 44305== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:05.668 INFO:tasks.ceph.osd.5.trial097.stderr:==00:00:00:21.568 44851== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:05.729 INFO:tasks.ceph.osd.13.trial097.stderr:==00:00:00:21.563 44879== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:05.742 INFO:tasks.ceph.osd.0.trial049.stderr:==00:00:00:21.655 45320== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:05.824 INFO:tasks.ceph.osd.7.trial162.stderr:==00:00:00:21.642 44731== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:05.830 INFO:tasks.ceph.osd.11.trial162.stderr:==00:00:00:21.647 44732== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:05.831 INFO:tasks.ceph.osd.9.trial097.stderr:==00:00:00:21.728 44852== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:05.834 INFO:tasks.ceph.osd.4.trial049.stderr:==00:00:00:21.746 45321== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:05.851 INFO:tasks.ceph.osd.14.trial157.stderr:==00:00:00:21.677 44308== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:05.851 INFO:tasks.ceph.osd.12.trial049.stderr:==00:00:00:21.756 45323== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:05.859 INFO:tasks.ceph.osd.8.trial049.stderr:==00:00:00:21.766 45322== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:05.862 INFO:tasks.ceph.osd.15.trial162.stderr:==00:00:00:21.678 44733== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:05.865 INFO:tasks.ceph.osd.10.trial157.stderr:==00:00:00:21.691 44307== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:05.883 INFO:tasks.ceph.osd.3.trial162.stderr:==00:00:00:21.701 44730== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:05.906 INFO:tasks.ceph.osd.1.trial097.stderr:==00:00:00:21.809 44850== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:05.933 INFO:tasks.ceph.osd.5.trial097.stderr:==00:00:00:21.832 44851== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:05.934 INFO:tasks.ceph.osd.2.trial157.stderr:==00:00:00:21.764 44306== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:05.940 INFO:tasks.ceph.osd.6.trial157.stderr:==00:00:00:21.770 44305== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.017 INFO:tasks.ceph.osd.13.trial097.stderr:==00:00:00:21.852 44879== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.048 INFO:tasks.ceph.osd.0.trial049.stderr:==00:00:00:21.961 45320== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.094 INFO:tasks.ceph.osd.9.trial097.stderr:==00:00:00:21.991 44852== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.098 INFO:tasks.ceph.osd.4.trial049.stderr:==00:00:00:22.009 45321== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.102 INFO:tasks.ceph.osd.7.trial162.stderr:==00:00:00:21.919 44731== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.111 INFO:tasks.ceph.osd.11.trial162.stderr:==00:00:00:21.928 44732== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.127 INFO:tasks.ceph.osd.8.trial049.stderr:==00:00:00:22.033 45322== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.131 INFO:tasks.ceph.osd.12.trial049.stderr:==00:00:00:22.036 45323== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.138 INFO:tasks.ceph.osd.15.trial162.stderr:==00:00:00:21.954 44733== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.143 INFO:tasks.ceph.osd.14.trial157.stderr:==00:00:00:21.969 44308== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.147 INFO:tasks.ceph.osd.10.trial157.stderr:==00:00:00:21.974 44307== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.162 INFO:tasks.ceph.osd.3.trial162.stderr:==00:00:00:21.979 44730== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.170 INFO:tasks.ceph.osd.1.trial097.stderr:==00:00:00:22.073 44850== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.197 INFO:tasks.ceph.osd.5.trial097.stderr:==00:00:00:22.096 44851== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.197 INFO:tasks.ceph.osd.2.trial157.stderr:==00:00:00:22.027 44306== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.214 INFO:tasks.ceph.osd.6.trial157.stderr:==00:00:00:22.044 44305== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.281 INFO:tasks.ceph.osd.13.trial097.stderr:==00:00:00:22.115 44879== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.326 INFO:tasks.ceph.osd.0.trial049.stderr:==00:00:00:22.240 45320== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.358 INFO:tasks.ceph.osd.9.trial097.stderr:==00:00:00:22.255 44852== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.362 INFO:tasks.ceph.osd.4.trial049.stderr:==00:00:00:22.273 45321== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.376 INFO:tasks.ceph.osd.7.trial162.stderr:==00:00:00:22.193 44731== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.392 INFO:tasks.ceph.osd.11.trial162.stderr:==00:00:00:22.209 44732== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.393 INFO:tasks.ceph.osd.8.trial049.stderr:==00:00:00:22.300 45322== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.408 INFO:tasks.ceph.osd.12.trial049.stderr:==00:00:00:22.313 45323== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.410 INFO:tasks.ceph.osd.14.trial157.stderr:==00:00:00:22.236 44308== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.423 INFO:tasks.ceph.osd.15.trial162.stderr:==00:00:00:22.239 44733== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.427 INFO:tasks.ceph.osd.10.trial157.stderr:==00:00:00:22.253 44307== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.436 INFO:tasks.ceph.osd.1.trial097.stderr:==00:00:00:22.339 44850== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.441 INFO:tasks.ceph.osd.3.trial162.stderr:==00:00:00:22.258 44730== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.461 INFO:tasks.ceph.osd.2.trial157.stderr:==00:00:00:22.291 44306== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.468 INFO:tasks.ceph.osd.5.trial097.stderr:==00:00:00:22.367 44851== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.488 INFO:tasks.ceph.osd.6.trial157.stderr:==00:00:00:22.318 44305== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.544 INFO:tasks.ceph.osd.13.trial097.stderr:==00:00:00:22.378 44879== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.600 INFO:tasks.ceph.osd.0.trial049.stderr:==00:00:00:22.513 45320== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.621 INFO:tasks.ceph.osd.9.trial097.stderr:==00:00:00:22.519 44852== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.629 INFO:tasks.ceph.osd.4.trial049.stderr:==00:00:00:22.541 45321== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.654 INFO:tasks.ceph.osd.7.trial162.stderr:==00:00:00:22.471 44731== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.659 INFO:tasks.ceph.osd.8.trial049.stderr:==00:00:00:22.566 45322== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.683 INFO:tasks.ceph.osd.11.trial162.stderr:==00:00:00:22.500 44732== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.684 INFO:tasks.ceph.osd.14.trial157.stderr:==00:00:00:22.510 44308== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.685 INFO:tasks.ceph.osd.12.trial049.stderr:==00:00:00:22.590 45323== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.692 INFO:tasks.ceph.osd.15.trial162.stderr:==00:00:00:22.508 44733== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.699 INFO:tasks.ceph.osd.1.trial097.stderr:==00:00:00:22.602 44850== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.710 INFO:tasks.ceph.osd.10.trial157.stderr:==00:00:00:22.536 44307== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.715 INFO:tasks.ceph.osd.3.trial162.stderr:==00:00:00:22.533 44730== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.729 INFO:tasks.ceph.osd.2.trial157.stderr:==00:00:00:22.559 44306== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.731 INFO:tasks.ceph.osd.5.trial097.stderr:==00:00:00:22.630 44851== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.763 INFO:tasks.ceph.osd.6.trial157.stderr:==00:00:00:22.593 44305== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.812 INFO:tasks.ceph.osd.13.trial097.stderr:==00:00:00:22.646 44879== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.874 INFO:tasks.ceph.osd.0.trial049.stderr:==00:00:00:22.788 45320== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.889 INFO:tasks.ceph.osd.9.trial097.stderr:==00:00:00:22.786 44852== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.901 INFO:tasks.ceph.osd.4.trial049.stderr:==00:00:00:22.812 45321== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.924 INFO:tasks.ceph.osd.8.trial049.stderr:==00:00:00:22.831 45322== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.931 INFO:tasks.ceph.osd.7.trial162.stderr:==00:00:00:22.749 44731== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.949 INFO:tasks.ceph.osd.14.trial157.stderr:==00:00:00:22.775 44308== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.959 INFO:tasks.ceph.osd.12.trial049.stderr:==00:00:00:22.864 45323== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.962 INFO:tasks.ceph.osd.15.trial162.stderr:==00:00:00:22.778 44733== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.963 INFO:tasks.ceph.osd.11.trial162.stderr:==00:00:00:22.780 44732== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.963 INFO:tasks.ceph.osd.1.trial097.stderr:==00:00:00:22.866 44850== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.987 INFO:tasks.ceph.osd.10.trial157.stderr:==00:00:00:22.813 44307== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.994 INFO:tasks.ceph.osd.3.trial162.stderr:==00:00:00:22.811 44730== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:06.995 INFO:tasks.ceph.osd.5.trial097.stderr:==00:00:00:22.894 44851== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:07.003 INFO:tasks.ceph.osd.2.trial157.stderr:==00:00:00:22.833 44306== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:07.037 INFO:tasks.ceph.osd.6.trial157.stderr:==00:00:00:22.867 44305== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:07.076 INFO:tasks.ceph.osd.13.trial097.stderr:==00:00:00:22.910 44879== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:07.148 INFO:tasks.ceph.osd.0.trial049.stderr:==00:00:00:23.062 45320== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:07.153 INFO:tasks.ceph.osd.9.trial097.stderr:==00:00:00:23.050 44852== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:07.175 INFO:tasks.ceph.osd.4.trial049.stderr:==00:00:00:23.087 45321== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:07.207 INFO:tasks.ceph.osd.7.trial162.stderr:==00:00:00:23.024 44731== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:07.213 INFO:tasks.ceph.osd.14.trial157.stderr:==00:00:00:23.039 44308== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:07.226 INFO:tasks.ceph.osd.1.trial097.stderr:==00:00:00:23.129 44850== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:07.237 INFO:tasks.ceph.osd.12.trial049.stderr:==00:00:00:23.142 45323== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:07.238 INFO:tasks.ceph.osd.15.trial162.stderr:==00:00:00:23.054 44733== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:07.243 INFO:tasks.ceph.osd.11.trial162.stderr:==00:00:00:23.061 44732== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:07.258 INFO:tasks.ceph.osd.5.trial097.stderr:==00:00:00:23.157 44851== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:07.261 INFO:tasks.ceph.osd.10.trial157.stderr:==00:00:00:23.087 44307== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:07.266 INFO:tasks.ceph.osd.2.trial157.stderr:==00:00:00:23.096 44306== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:07.272 INFO:tasks.ceph.osd.3.trial162.stderr:==00:00:00:23.089 44730== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:07.287 INFO:tasks.ceph.osd.8.trial049.stderr:==00:00:00:23.193 45322== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:07.311 INFO:tasks.ceph.osd.6.trial157.stderr:==00:00:00:23.141 44305== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:07.339 INFO:tasks.ceph.osd.13.trial097.stderr:==00:00:00:23.173 44879== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:07.417 INFO:tasks.ceph.osd.9.trial097.stderr:==00:00:00:23.314 44852== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:07.422 INFO:tasks.ceph.osd.0.trial049.stderr:==00:00:00:23.336 45320== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:07.449 INFO:tasks.ceph.osd.4.trial049.stderr:==00:00:00:23.360 45321== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:07.479 INFO:tasks.ceph.osd.14.trial157.stderr:==00:00:00:23.306 44308== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:07.481 INFO:tasks.ceph.osd.7.trial162.stderr:==00:00:00:23.298 44731== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:07.495 INFO:tasks.ceph.osd.1.trial097.stderr:==00:00:00:23.398 44850== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:07.511 INFO:tasks.ceph.osd.12.trial049.stderr:==00:00:00:23.416 45323== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:07.511 INFO:tasks.ceph.osd.15.trial162.stderr:==00:00:00:23.327 44733== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:07.517 INFO:tasks.ceph.osd.11.trial162.stderr:==00:00:00:23.335 44732== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:07.532 INFO:tasks.ceph.osd.2.trial157.stderr:==00:00:00:23.362 44306== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:07.538 INFO:tasks.ceph.osd.10.trial157.stderr:==00:00:00:23.364 44307== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:07.552 INFO:tasks.ceph.osd.3.trial162.stderr:==00:00:00:23.369 44730== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:07.573 INFO:tasks.ceph.osd.8.trial049.stderr:==00:00:00:23.480 45322== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:07.603 INFO:tasks.ceph.osd.8.trial049.stderr:==00:00:00:23.510 45322== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:07.613 INFO:tasks.ceph.osd.13.trial097.stderr:==00:00:00:23.447 44879== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:07.614 INFO:tasks.ceph.osd.5.trial097.stderr:==00:00:00:23.514 44851== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:07.626 INFO:tasks.ceph.osd.8.trial049.stderr:==00:00:00:23.533 45322== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:07.631 INFO:tasks.ceph.osd.8.trial049.stderr:==00:00:00:23.538 45322== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:07.693 INFO:tasks.ceph.osd.6.trial157.stderr:==00:00:00:23.523 44305== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:07.700 INFO:tasks.ceph.osd.0.trial049.stderr:==00:00:00:23.614 45320== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:07.743 INFO:tasks.ceph.osd.14.trial157.stderr:==00:00:00:23.569 44308== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:07.769 INFO:tasks.ceph.osd.9.trial097.stderr:==00:00:00:23.667 44852== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:07.811 INFO:tasks.ceph.osd.4.trial049.stderr:==00:00:00:23.723 45321== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:07.851 INFO:tasks.ceph.osd.1.trial097.stderr:==00:00:00:23.754 44850== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:07.855 INFO:tasks.ceph.osd.7.trial162.stderr:==00:00:00:23.672 44731== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:07.860 INFO:tasks.ceph.osd.4.trial049.stderr:==00:00:00:23.772 45321== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:07.875 INFO:tasks.ceph.osd.15.trial162.stderr:==00:00:00:23.690 44733== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:07.887 INFO:tasks.ceph.osd.2.trial157.stderr:==00:00:00:23.717 44306== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:07.899 INFO:tasks.ceph.osd.12.trial049.stderr:==00:00:00:23.804 45323== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:07.910 INFO:tasks.ceph.osd.5.trial097.stderr:==00:00:00:23.809 44851== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:07.915 INFO:tasks.ceph.osd.11.trial162.stderr:==00:00:00:23.732 44732== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:07.934 INFO:tasks.ceph.osd.10.trial157.stderr:==00:00:00:23.761 44307== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:07.936 INFO:tasks.ceph.osd.3.trial162.stderr:==00:00:00:23.754 44730== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:07.938 INFO:tasks.ceph.osd.12.trial049.stderr:==00:00:00:23.843 45323== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:07.950 INFO:tasks.ceph.osd.2.trial157.stderr:==00:00:00:23.780 44306== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:07.961 INFO:tasks.ceph.osd.12.trial049.stderr:==00:00:00:23.866 45323== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:07.969 INFO:tasks.ceph.osd.13.trial097.stderr:==00:00:00:23.803 44879== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:07.981 INFO:tasks.ceph.osd.2.trial157.stderr:==00:00:00:23.811 44306== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:07.983 INFO:tasks.ceph.osd.6.trial157.stderr:==00:00:00:23.813 44305== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:08.003 INFO:tasks.ceph.osd.6.trial157.stderr:==00:00:00:23.833 44305== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:08.013 INFO:tasks.ceph.osd.2.trial157.stderr:==00:00:00:23.843 44306== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:08.018 INFO:tasks.ceph.osd.2.trial157.stderr:==00:00:00:23.848 44306== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:08.057 INFO:tasks.ceph.osd.9.trial097.stderr:==00:00:00:23.954 44852== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:08.082 INFO:tasks.ceph.osd.9.trial097.stderr:==00:00:00:23.980 44852== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:08.099 INFO:tasks.ceph.osd.0.trial049.stderr:==00:00:00:24.013 45320== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:08.106 INFO:tasks.ceph.osd.9.trial097.stderr:==00:00:00:24.004 44852== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:08.111 INFO:tasks.ceph.osd.14.trial157.stderr:==00:00:00:23.937 44308== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:08.111 INFO:tasks.ceph.osd.9.trial097.stderr:==00:00:00:24.009 44852== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:08.135 INFO:tasks.ceph.osd.4.trial049.stderr:==00:00:00:24.047 45321== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:08.142 INFO:tasks.ceph.osd.0.trial049.stderr:==00:00:00:24.056 45320== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:08.145 INFO:tasks.ceph.osd.1.trial097.stderr:==00:00:00:24.048 44850== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:08.147 INFO:tasks.ceph.osd.7.trial162.stderr:==00:00:00:23.964 44731== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:08.152 INFO:tasks.ceph.osd.14.trial157.stderr:==00:00:00:23.978 44308== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:08.164 INFO:tasks.ceph.osd.4.trial049.stderr:==00:00:00:24.076 45321== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:08.169 INFO:tasks.ceph.osd.15.trial162.stderr:==00:00:00:23.985 44733== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:08.169 INFO:tasks.ceph.osd.4.trial049.stderr:==00:00:00:24.081 45321== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:08.171 INFO:tasks.ceph.osd.0.trial049.stderr:==00:00:00:24.085 45320== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:08.172 INFO:tasks.ceph.osd.1.trial097.stderr:==00:00:00:24.074 44850== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:08.176 INFO:tasks.ceph.osd.7.trial162.stderr:==00:00:00:23.993 44731== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:08.178 INFO:tasks.ceph.osd.14.trial157.stderr:==00:00:00:24.004 44308== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:08.188 INFO:tasks.ceph.osd.5.trial097.stderr:==00:00:00:24.088 44851== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:08.193 INFO:tasks.ceph.osd.1.trial097.stderr:==00:00:00:24.096 44850== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:08.198 INFO:tasks.ceph.osd.1.trial097.stderr:==00:00:00:24.101 44850== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:08.204 INFO:tasks.ceph.osd.7.trial162.stderr:==00:00:00:24.021 44731== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:08.209 INFO:tasks.ceph.osd.7.trial162.stderr:==00:00:00:24.026 44731== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:08.210 INFO:tasks.ceph.osd.11.trial162.stderr:==00:00:00:24.027 44732== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:08.212 INFO:tasks.ceph.osd.14.trial157.stderr:==00:00:00:24.038 44308== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:08.217 INFO:tasks.ceph.osd.14.trial157.stderr:==00:00:00:24.044 44308== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:08.233 INFO:tasks.ceph.osd.12.trial049.stderr:==00:00:00:24.138 45323== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:08.236 INFO:tasks.ceph.osd.11.trial162.stderr:==00:00:00:24.053 44732== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:08.237 INFO:tasks.ceph.osd.10.trial157.stderr:==00:00:00:24.063 44307== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:08.238 INFO:tasks.ceph.osd.3.trial162.stderr:==00:00:00:24.056 44730== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:08.238 INFO:tasks.ceph.osd.12.trial049.stderr:==00:00:00:24.143 45323== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:08.264 INFO:tasks.ceph.osd.13.trial097.stderr:==00:00:00:24.099 44879== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:08.280 INFO:tasks.ceph.osd.13.trial097.stderr:==00:00:00:24.115 44879== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:08.282 INFO:tasks.ceph.osd.6.trial157.stderr:==00:00:00:24.112 44305== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:08.287 INFO:tasks.ceph.osd.6.trial157.stderr:==00:00:00:24.117 44305== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:08.308 INFO:tasks.ceph.osd.13.trial097.stderr:==00:00:00:24.143 44879== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:08.313 INFO:tasks.ceph.osd.13.trial097.stderr:==00:00:00:24.147 44879== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:08.433 INFO:tasks.ceph.osd.15.trial162.stderr:==00:00:00:24.249 44733== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:08.453 INFO:tasks.ceph.osd.0.trial049.stderr:==00:00:00:24.367 45320== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:08.458 INFO:tasks.ceph.osd.0.trial049.stderr:==00:00:00:24.371 45320== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:08.464 INFO:tasks.ceph.osd.5.trial097.stderr:==00:00:00:24.363 44851== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:08.468 INFO:tasks.ceph.osd.5.trial097.stderr:==00:00:00:24.368 44851== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:08.471 INFO:tasks.ceph.osd.15.trial162.stderr:==00:00:00:24.286 44733== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:08.476 INFO:tasks.ceph.osd.15.trial162.stderr:==00:00:00:24.291 44733== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:08.509 INFO:tasks.ceph.osd.3.trial162.stderr:==00:00:00:24.326 44730== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:08.514 INFO:tasks.ceph.osd.11.trial162.stderr:==00:00:00:24.331 44732== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:08.519 INFO:tasks.ceph.osd.11.trial162.stderr:==00:00:00:24.336 44732== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:08.520 INFO:tasks.ceph.osd.10.trial157.stderr:==00:00:00:24.346 44307== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:08.530 INFO:tasks.ceph.osd.3.trial162.stderr:==00:00:00:24.347 44730== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:08.535 INFO:tasks.ceph.osd.3.trial162.stderr:==00:00:00:24.352 44730== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:08.800 INFO:tasks.ceph.osd.10.trial157.stderr:==00:00:00:24.626 44307== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:08.805 INFO:tasks.ceph.osd.10.trial157.stderr:==00:00:00:24.631 44307== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:09.895 DEBUG:teuthology.orchestra.run.trial049:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T11:09:09.955 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.954+0000 7f18c81d3640 10 monclient: get_monmap_and_config 2026-02-17T11:09:09.955 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.954+0000 7f18c81d3640 10 monclient: build_initial_monmap 2026-02-17T11:09:09.955 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.954+0000 7f18c81d3640 10 monclient: monmap: 2026-02-17T11:09:09.955 INFO:teuthology.misc.health.trial049.stderr:epoch 0 2026-02-17T11:09:09.955 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:09:09.955 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:09:09.954560+0000 2026-02-17T11:09:09.955 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:09:09.954560+0000 2026-02-17T11:09:09.955 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:09:09.955 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:09:09.955 INFO:teuthology.misc.health.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:09:09.955 INFO:teuthology.misc.health.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:09:09.956 INFO:teuthology.misc.health.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:09:09.956 INFO:teuthology.misc.health.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:09:09.956 INFO:teuthology.misc.health.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:09:09.956 INFO:teuthology.misc.health.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:09:09.956 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:09:09.957 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.954+0000 7f18c81d3640 1 Processor -- start 2026-02-17T11:09:09.957 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.954+0000 7f18c81d3640 1 -- start start 2026-02-17T11:09:09.957 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.954+0000 7f18c81d3640 10 monclient: init 2026-02-17T11:09:09.957 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.955+0000 7f18c81d3640 10 monclient: _reopen_session rank -1 2026-02-17T11:09:09.957 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.955+0000 7f18c81d3640 10 monclient: _add_conns ranks=[2,0,4,5,1,3] 2026-02-17T11:09:09.957 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.955+0000 7f18c81d3640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f18c015f640 addr v1:10.20.193.157:6789/0 2026-02-17T11:09:09.957 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.955+0000 7f18c81d3640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f18c015fa20 addr v1:10.20.193.49:6789/0 2026-02-17T11:09:09.957 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.955+0000 7f18c81d3640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f18c00c8f10 0x7f18c00c9380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:09:09.957 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.955+0000 7f18c81d3640 10 monclient(hunting): picked mon.noname-b con 0x7f18c00c8f10 addr v2:10.20.193.97:3300/0 2026-02-17T11:09:09.957 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.955+0000 7f18c81d3640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18c0072dc0 con 0x7f18c015fa20 2026-02-17T11:09:09.957 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.955+0000 7f18c81d3640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18c00c98c0 con 0x7f18c015f640 2026-02-17T11:09:09.957 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.955+0000 7f18c81d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:09:09.957 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.955+0000 7f18c81d3640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f18c00743a0 con 0x7f18c00c8f10 2026-02-17T11:09:09.957 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.955+0000 7f18c81d3640 10 monclient(hunting): _renew_subs 2026-02-17T11:09:09.957 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.955+0000 7f18c81d3640 10 monclient(hunting): authenticate will time out at 1026.618104s 2026-02-17T11:09:09.957 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.955+0000 7f18c5747640 1 --1- >> v1:10.20.193.49:6789/0 conn(0x7f18c015fa20 0x7f18c015d2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.49:6789/0 says I am v1:10.20.193.49:48800/0 (socket says 10.20.193.49:48800) 2026-02-17T11:09:09.957 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.955+0000 7f18c5747640 1 -- 10.20.193.49:0/2274065785 learned_addr learned my addr 10.20.193.49:0/2274065785 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:09:09.957 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.955+0000 7f18c6749640 1 --2- 10.20.193.49:0/2274065785 >> v2:10.20.193.97:3300/0 conn(0x7f18c00c8f10 0x7f18c00c9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:09:09.958 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.955+0000 7f18c6749640 10 monclient(hunting): get_auth_request con 0x7f18c00c8f10 auth_method 0 2026-02-17T11:09:09.958 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.955+0000 7f18c6749640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:09:09.958 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.955+0000 7f18c6749640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:09:09.958 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.955+0000 7f18c6749640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:09:09.959 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.956+0000 7f18c6749640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:09:09.959 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.956+0000 7f18c6749640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:09:09.959 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.956+0000 7f18c6749640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:09:09.959 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.957+0000 7f18c4f46640 1 -- 10.20.193.49:0/2274065785 <== mon.0 v1:10.20.193.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3963168081 0 0) 0x7f18b4002920 con 0x7f18c015fa20 2026-02-17T11:09:09.959 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.957+0000 7f18c4f46640 10 monclient(hunting): _negotiate 2026-02-17T11:09:09.959 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.957+0000 7f18c4f46640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:09:09.959 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.957+0000 7f18c4f46640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:09:09.959 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.957+0000 7f18c4f46640 10 monclient(hunting): my global_id is 4254 2026-02-17T11:09:09.959 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.957+0000 7f18c4f46640 1 -- 10.20.193.49:0/2274065785 --> v1:10.20.193.49:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f18a8003620 con 0x7f18c015fa20 2026-02-17T11:09:09.959 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.957+0000 7f18c4f46640 1 -- 10.20.193.49:0/2274065785 <== mon.2 v1:10.20.193.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2091672981 0 0) 0x7f18c00c98c0 con 0x7f18c015f640 2026-02-17T11:09:09.959 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.957+0000 7f18c4f46640 10 monclient(hunting): _negotiate 2026-02-17T11:09:09.959 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.957+0000 7f18c4f46640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:09:09.959 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.957+0000 7f18c4f46640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:09:09.959 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.957+0000 7f18c4f46640 10 monclient(hunting): my global_id is 4271 2026-02-17T11:09:09.959 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.957+0000 7f18c4f46640 1 -- 10.20.193.49:0/2274065785 --> v1:10.20.193.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f18b4002920 con 0x7f18c015f640 2026-02-17T11:09:09.959 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.957+0000 7f18c6749640 10 monclient(hunting): handle_auth_done global_id 4273 payload 274 2026-02-17T11:09:09.959 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.957+0000 7f18c6749640 1 -- 10.20.193.49:0/2274065785 >> v1:10.20.193.157:6789/0 conn(0x7f18c015f640 legacy=0x7f18c00726b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:09:09.959 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.957+0000 7f18c6749640 1 -- 10.20.193.49:0/2274065785 >> v1:10.20.193.49:6789/0 conn(0x7f18c015fa20 legacy=0x7f18c015d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:09:09.959 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.957+0000 7f18c6749640 10 monclient: _finish_hunting 0 2026-02-17T11:09:09.959 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.957+0000 7f18c6749640 1 monclient: found mon.noname-b 2026-02-17T11:09:09.959 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.957+0000 7f18c6749640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:09:09.959 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.957+0000 7f18c6749640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:09:09.959 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.957+0000 7f18c6749640 1 -- 10.20.193.49:0/2274065785 --> v2:10.20.193.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c0073040 con 0x7f18c00c8f10 2026-02-17T11:09:09.960 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.958+0000 7f18c6749640 1 --2- 10.20.193.49:0/2274065785 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f18c00c8f10 0x7f18c00c9380 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f18bc009d90 tx=0x7f18bc02f1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c90ddddab68c4f61 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:09:09.961 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.960+0000 7f18c4f46640 1 -- 10.20.193.49:0/2274065785 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18bc03c070 con 0x7f18c00c8f10 2026-02-17T11:09:09.961 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.960+0000 7f18c4f46640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:09:09.961 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.960+0000 7f18c4f46640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:09:09.961 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.960+0000 7f18c4f46640 10 monclient: dump: 2026-02-17T11:09:09.961 INFO:teuthology.misc.health.trial049.stderr:epoch 1 2026-02-17T11:09:09.961 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:09:09.961 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:09.961 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:09.961 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:09:09.961 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:09:09.961 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:09:09.961 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:09:09.961 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:09:09.961 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:09:09.962 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.960+0000 7f18c4f46640 10 monclient: _finish_auth 0 2026-02-17T11:09:09.962 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.960+0000 7f18c4f46640 10 monclient: _check_auth_tickets 2026-02-17T11:09:09.962 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.960+0000 7f18c4f46640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:09:09.962 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.960+0000 7f18c4f46640 1 -- 10.20.193.49:0/2274065785 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18bc037440 con 0x7f18c00c8f10 2026-02-17T11:09:09.962 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.960+0000 7f18c4f46640 10 monclient: handle_config config(0 keys) 2026-02-17T11:09:09.962 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.960+0000 7f18c4f46640 1 -- 10.20.193.49:0/2274065785 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18bc037810 con 0x7f18c00c8f10 2026-02-17T11:09:09.962 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.960+0000 7f18c81d3640 5 monclient: authenticate success, global_id 4273 2026-02-17T11:09:09.962 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.960+0000 7f18c81d3640 10 monclient: get_monmap_and_config success 2026-02-17T11:09:09.962 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.960+0000 7f18c81d3640 4 set_mon_vals no callback set 2026-02-17T11:09:09.962 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.960+0000 7f18c4f46640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:09:09.962 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.960+0000 7f18c4f46640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:09:09.962 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.960+0000 7f18c4f46640 10 monclient: dump: 2026-02-17T11:09:09.962 INFO:teuthology.misc.health.trial049.stderr:epoch 1 2026-02-17T11:09:09.962 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:09:09.962 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:09.962 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:09.962 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:09:09.962 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:09:09.962 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:09:09.962 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:09:09.962 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:09:09.962 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:09:09.963 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.960+0000 7f18c81d3640 10 monclient: shutdown 2026-02-17T11:09:09.963 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.960+0000 7f18c81d3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:09:09.963 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.960+0000 7f18c81d3640 1 -- 10.20.193.49:0/2274065785 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f18c00c8f10 msgr2=0x7f18c00c9380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:09:09.963 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.960+0000 7f18c81d3640 1 --2- 10.20.193.49:0/2274065785 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f18c00c8f10 0x7f18c00c9380 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f18bc009d90 tx=0x7f18bc02f1e0 comp rx=0 tx=0).stop 2026-02-17T11:09:09.963 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.960+0000 7f18c81d3640 1 -- 10.20.193.49:0/2274065785 shutdown_connections 2026-02-17T11:09:09.963 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.960+0000 7f18c81d3640 1 --2- 10.20.193.49:0/2274065785 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f18c00c8f10 0x7f18c00c9380 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:09.963 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.960+0000 7f18c81d3640 1 -- 10.20.193.49:0/2274065785 >> 10.20.193.49:0/2274065785 conn(0x7f18c00c9f30 msgr2=0x7f18c00ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:09:09.963 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.960+0000 7f18c81d3640 1 -- 10.20.193.49:0/2274065785 shutdown_connections 2026-02-17T11:09:09.963 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.960+0000 7f18c81d3640 1 -- 10.20.193.49:0/2274065785 wait complete. 2026-02-17T11:09:09.963 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.961+0000 7f18c81d3640 10 monclient: build_initial_monmap 2026-02-17T11:09:09.963 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.961+0000 7f18c81d3640 10 monclient: monmap: 2026-02-17T11:09:09.963 INFO:teuthology.misc.health.trial049.stderr:epoch 0 2026-02-17T11:09:09.963 INFO:teuthology.misc.health.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:09:09.963 INFO:teuthology.misc.health.trial049.stderr:last_changed 0.000000 2026-02-17T11:09:09.963 INFO:teuthology.misc.health.trial049.stderr:created 0.000000 2026-02-17T11:09:09.963 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:09:09.963 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:09:09.963 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:09:09.963 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:09:09.963 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:09:09.963 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:09:09.963 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.961+0000 7f18c81d3640 1 librados: starting msgr at 2026-02-17T11:09:09.963 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.961+0000 7f18c81d3640 1 librados: starting objecter 2026-02-17T11:09:09.963 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.961+0000 7f18c81d3640 1 Processor -- start 2026-02-17T11:09:09.963 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.961+0000 7f18c81d3640 1 -- start start 2026-02-17T11:09:09.963 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.961+0000 7f18c81d3640 1 librados: setting wanted keys 2026-02-17T11:09:09.963 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.961+0000 7f18c81d3640 1 librados: calling monclient init 2026-02-17T11:09:09.963 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.961+0000 7f18c81d3640 10 monclient: init 2026-02-17T11:09:09.963 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.961+0000 7f18c81d3640 10 monclient: _reopen_session rank -1 2026-02-17T11:09:09.963 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.961+0000 7f18c81d3640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:09:09.963 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.961+0000 7f18c81d3640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f18c00c8f10 0x7f18c01f73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:09:09.963 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.961+0000 7f18c81d3640 10 monclient(hunting): picked mon.noname-c con 0x7f18c00c8f10 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:09:09.963 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.961+0000 7f18c81d3640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f18c015f640 0x7f18c00cb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:09:09.963 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.961+0000 7f18c81d3640 10 monclient(hunting): picked mon.noname-b con 0x7f18c015f640 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:09:09.963 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.961+0000 7f18c81d3640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f18c015fa20 0x7f18c0149c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:09:09.963 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.961+0000 7f18c81d3640 10 monclient(hunting): picked mon.noname-a con 0x7f18c015fa20 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:09:09.963 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.961+0000 7f18c81d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:09:09.964 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.961+0000 7f18c81d3640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f18c00738e0 con 0x7f18c015fa20 2026-02-17T11:09:09.964 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.961+0000 7f18c81d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:09:09.964 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.961+0000 7f18c81d3640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f18c0073600 con 0x7f18c015f640 2026-02-17T11:09:09.964 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.961+0000 7f18c81d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:09:09.964 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.961+0000 7f18c81d3640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f18c0073bc0 con 0x7f18c00c8f10 2026-02-17T11:09:09.964 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.961+0000 7f18c81d3640 10 monclient(hunting): _renew_subs 2026-02-17T11:09:09.964 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.961+0000 7f18c81d3640 10 monclient(hunting): authenticate will time out at 1026.624938s 2026-02-17T11:09:09.964 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.962+0000 7f18c6749640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f18c015fa20 0x7f18c0149c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:09:09.964 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.962+0000 7f18c5f48640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f18c00c8f10 0x7f18c01f73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:09:09.964 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.962+0000 7f18c5747640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f18c015f640 0x7f18c00cb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:09:09.964 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.962+0000 7f18c6749640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f18c015fa20 0x7f18c0149c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:59738/0 (socket says 10.20.193.49:59738) 2026-02-17T11:09:09.964 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.962+0000 7f18c6749640 1 -- 10.20.193.49:0/1265193545 learned_addr learned my addr 10.20.193.49:0/1265193545 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:09:09.964 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.962+0000 7f18c6749640 10 monclient(hunting): get_auth_request con 0x7f18c015fa20 auth_method 0 2026-02-17T11:09:09.964 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.962+0000 7f18c6749640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:09:09.964 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.962+0000 7f18c6749640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:09:09.964 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.962+0000 7f18c6749640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:09:09.964 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.962+0000 7f18c5f48640 10 monclient(hunting): get_auth_request con 0x7f18c00c8f10 auth_method 0 2026-02-17T11:09:09.964 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.962+0000 7f18c5f48640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:09:09.964 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.962+0000 7f18c5f48640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:09:09.964 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.962+0000 7f18c5f48640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:09:09.964 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.962+0000 7f18c5747640 10 monclient(hunting): get_auth_request con 0x7f18c015f640 auth_method 0 2026-02-17T11:09:09.964 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.962+0000 7f18c5747640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:09:09.964 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.962+0000 7f18c5747640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:09:09.964 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.962+0000 7f18c5747640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:09:09.965 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.962+0000 7f18c5747640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:09:09.965 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.962+0000 7f18c5747640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:09:09.965 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.962+0000 7f18c5747640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:09:09.965 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.962+0000 7f18c5f48640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:09:09.965 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.962+0000 7f18c5f48640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:09:09.965 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.962+0000 7f18c5f48640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:09:09.965 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.962+0000 7f18c6749640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:09:09.965 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.962+0000 7f18c6749640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:09:09.965 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.962+0000 7f18c6749640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:09:09.965 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.964+0000 7f18c5f48640 10 monclient(hunting): handle_auth_done global_id 4274 payload 824 2026-02-17T11:09:09.965 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.964+0000 7f18c5f48640 1 -- 10.20.193.49:0/1265193545 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f18c015f640 msgr2=0x7f18c00cb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:09:09.965 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.964+0000 7f18c5f48640 1 --2- 10.20.193.49:0/1265193545 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f18c015f640 0x7f18c00cb6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:09.965 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.964+0000 7f18c5f48640 1 -- 10.20.193.49:0/1265193545 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f18c015fa20 msgr2=0x7f18c0149c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:09:09.965 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.964+0000 7f18c5f48640 1 --2- 10.20.193.49:0/1265193545 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f18c015fa20 0x7f18c0149c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:09.965 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.964+0000 7f18c5f48640 10 monclient: _finish_hunting 0 2026-02-17T11:09:09.965 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.964+0000 7f18c5f48640 1 monclient: found mon.noname-c 2026-02-17T11:09:09.965 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.964+0000 7f18c5f48640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:09:09.965 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.964+0000 7f18c5f48640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:09:09.965 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.964+0000 7f18c5f48640 1 -- 10.20.193.49:0/1265193545 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c01f5630 con 0x7f18c00c8f10 2026-02-17T11:09:09.965 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.964+0000 7f18c5747640 1 --2- 10.20.193.49:0/1265193545 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f18c015f640 0x7f18c00cb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:09:09.966 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.965+0000 7f18c5f48640 1 --2- 10.20.193.49:0/1265193545 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f18c00c8f10 0x7f18c01f73e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f18b000c4d0 tx=0x7f18b000c9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:09:09.966 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.965+0000 7f18ae7fc640 10 client.?.objecter ms_handle_connect 0x7f18c00c8f10 2026-02-17T11:09:09.966 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.965+0000 7f18ae7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T11:09:09.967 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.966+0000 7f18ae7fc640 1 -- 10.20.193.49:0/1265193545 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b00052d0 con 0x7f18c00c8f10 2026-02-17T11:09:09.967 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.966+0000 7f18ae7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:09:09.968 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.966+0000 7f18ae7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:09:09.968 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.966+0000 7f18ae7fc640 10 monclient: dump: 2026-02-17T11:09:09.968 INFO:teuthology.misc.health.trial049.stderr:epoch 1 2026-02-17T11:09:09.968 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:09:09.968 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:09.968 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:09.968 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:09:09.968 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:09:09.968 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:09:09.968 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:09:09.968 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:09:09.968 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:09:09.968 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.966+0000 7f18ae7fc640 10 monclient: _finish_auth 0 2026-02-17T11:09:09.968 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.966+0000 7f18ae7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:09:09.968 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.966+0000 7f18ae7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:09:09.968 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.966+0000 7f18c81d3640 5 monclient: authenticate success, global_id 4274 2026-02-17T11:09:09.968 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.966+0000 7f18c81d3640 10 monclient: _renew_subs 2026-02-17T11:09:09.968 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.966+0000 7f18c81d3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:09:09.968 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.966+0000 7f18c81d3640 1 -- 10.20.193.49:0/1265193545 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18c01f5910 con 0x7f18c00c8f10 2026-02-17T11:09:09.968 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.966+0000 7f18c81d3640 10 client.4274.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:09:09.968 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.966+0000 7f18c81d3640 10 monclient: _renew_subs 2026-02-17T11:09:09.968 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.966+0000 7f18c81d3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:09:09.968 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.966+0000 7f18c81d3640 1 -- 10.20.193.49:0/1265193545 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18c01f5ed0 con 0x7f18c00c8f10 2026-02-17T11:09:09.968 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.966+0000 7f18c81d3640 1 librados: init done 2026-02-17T11:09:09.968 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.967+0000 7f18ae7fc640 1 -- 10.20.193.49:0/1265193545 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18b0005470 con 0x7f18c00c8f10 2026-02-17T11:09:09.968 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.967+0000 7f18ae7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:09:09.968 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.967+0000 7f18ae7fc640 1 -- 10.20.193.49:0/1265193545 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b00038f0 con 0x7f18c00c8f10 2026-02-17T11:09:09.968 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.967+0000 7f18ae7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:09:09.968 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.967+0000 7f18ae7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:09:09.968 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.967+0000 7f18ae7fc640 10 monclient: dump: 2026-02-17T11:09:09.968 INFO:teuthology.misc.health.trial049.stderr:epoch 1 2026-02-17T11:09:09.968 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:09:09.968 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:09.969 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:09.969 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:09:09.969 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:09:09.969 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:09:09.969 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:09:09.969 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:09:09.969 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:09:09.969 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.967+0000 7f18affff640 4 set_mon_vals no callback set 2026-02-17T11:09:09.969 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.967+0000 7f18c81d3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:09:09.969 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.967+0000 7f18c81d3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:09:09.969 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.967+0000 7f18c81d3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:09:09.969 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.967+0000 7f18c81d3640 1 -- 10.20.193.49:0/1265193545 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18c00c9380 con 0x7f18c00c8f10 2026-02-17T11:09:09.980 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.979+0000 7f18ae7fc640 1 -- 10.20.193.49:0/1265193545 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 4) ==== 100001+0+0 (secure 0 0 0) 0x7f18b0003a90 con 0x7f18c00c8f10 2026-02-17T11:09:09.980 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.979+0000 7f18ae7fc640 1 --2- 10.20.193.49:0/1265193545 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f18900790b0 0x7f189007b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:09:09.981 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.980+0000 7f18c5747640 1 --2- 10.20.193.49:0/1265193545 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f18900790b0 0x7f189007b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:09:09.981 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.980+0000 7f18c5747640 10 monclient: get_auth_request con 0x7f18900790b0 auth_method 0 2026-02-17T11:09:09.982 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.981+0000 7f18c5747640 1 --2- 10.20.193.49:0/1265193545 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f18900790b0 0x7f189007b570 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f18b4002410 tx=0x7f18b4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:09:09.982 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.981+0000 7f18ae7fc640 10 client.4274.objecter ms_handle_connect 0x7f18900790b0 2026-02-17T11:09:09.982 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.981+0000 7f18ae7fc640 1 -- 10.20.193.49:0/1265193545 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2565+0+0 (secure 0 0 0) 0x7f18b0097be0 con 0x7f18c00c8f10 2026-02-17T11:09:09.982 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.981+0000 7f18ae7fc640 10 client.4274.objecter ms_dispatch2 0x7f18c0000b90 osd_map(18..18 src has 1..18) 2026-02-17T11:09:09.982 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.981+0000 7f18ae7fc640 3 client.4274.objecter handle_osd_map got epochs [18,18] > 0 2026-02-17T11:09:09.982 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.981+0000 7f18ae7fc640 3 client.4274.objecter handle_osd_map decoding full epoch 18 2026-02-17T11:09:09.982 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:09.981+0000 7f18ae7fc640 20 client.4274.objecter dump_active .. 0 homeless 2026-02-17T11:09:10.094 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:10.093+0000 7f18ae7fc640 1 -- 10.20.193.49:0/1265193545 <== mon.2 v2:10.20.193.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f18b00622a0 con 0x7f18c00c8f10 2026-02-17T11:09:10.094 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:10.093+0000 7f18ae7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:09:10.094 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:10.093+0000 7f18ae7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:09:10.178 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:10.177+0000 7f18c81d3640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:09:10.179 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:10.177+0000 7f18c81d3640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:09:10.179 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:10.177+0000 7f18c81d3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:09:10.179 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:10.177+0000 7f18c81d3640 1 -- 10.20.193.49:0/1265193545 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f18c0070cf0 con 0x7f18c00c8f10 2026-02-17T11:09:10.189 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:10.188+0000 7f18ae7fc640 1 -- 10.20.193.49:0/1265193545 <== mon.2 v2:10.20.193.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12879 (secure 0 0 0) 0x7f18b00665a0 con 0x7f18c00c8f10 2026-02-17T11:09:10.189 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:10.188+0000 7f18ae7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:09:10.189 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:10.188+0000 7f18ae7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:09:10.189 INFO:teuthology.misc.health.trial049.stdout: 2026-02-17T11:09:10.190 INFO:teuthology.misc.health.trial049.stdout:{"epoch":18,"fsid":"2799a57b-9ea3-46ae-8e91-1fe004a3651d","created":"2026-02-17T11:08:37.595499+0000","modified":"2026-02-17T11:08:43.985163+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T11:08:43.985163+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"30bc819e-140a-433e-b860-eaa88e282a11","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2f7f1f11-f256-4094-82a9-5d21882e6e0e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"26bd1274-fe52-42cb-876b-df9920880f95","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c78a5263-3b0d-4b22-a848-bcd6a1e4f6b0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f0fdfadd-2f39-4ad8-ac88-cb588c5e8ee0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"65872639-d6c0-482d-95d1-1d9f250781c9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"43091d3e-638d-4462-867b-cade02a315e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"890ae4d6-33c9-4515-a896-a689647330dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"f04abc9b-ed75-4582-b47d-07a9890f52bb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"7dfbb00a-6b89-4de3-9f30-6aadd91b4408","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"e497a4fd-a944-489b-9cb3-30f5acaeb53e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"7371d50f-36f9-477d-8d4d-853f481dd6db","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"3cf4fded-49db-4d95-956b-77acc868a3ed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"7dc53473-594f-4cfb-8444-eab205e2e0f9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"e8ab3e8f-29a8-4c79-bf86-d29543aac56a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"300a4696-aa54-4b47-b9f3-87dec719bcfa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:09:10.192 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:10.190+0000 7f18c81d3640 10 librados: watch_flush enter 2026-02-17T11:09:10.192 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:10.190+0000 7f18c81d3640 10 librados: watch_flush exit 2026-02-17T11:09:10.192 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:10.190+0000 7f18c81d3640 20 client.4274.objecter shutdown clearing up homeless session... 2026-02-17T11:09:10.192 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:10.190+0000 7f18c81d3640 10 client.4274.objecter successfully canceled tick 2026-02-17T11:09:10.192 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:10.190+0000 7f18c81d3640 1 -- 10.20.193.49:0/1265193545 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f18900790b0 msgr2=0x7f189007b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:09:10.192 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:10.190+0000 7f18c81d3640 1 --2- 10.20.193.49:0/1265193545 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f18900790b0 0x7f189007b570 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f18b4002410 tx=0x7f18b4009040 comp rx=0 tx=0).stop 2026-02-17T11:09:10.192 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:10.190+0000 7f18c81d3640 10 monclient: shutdown 2026-02-17T11:09:10.192 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:10.190+0000 7f18c81d3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:09:10.192 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:10.190+0000 7f18c81d3640 1 -- 10.20.193.49:0/1265193545 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f18c00c8f10 msgr2=0x7f18c01f73e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:09:10.192 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:10.190+0000 7f18c81d3640 1 --2- 10.20.193.49:0/1265193545 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f18c00c8f10 0x7f18c01f73e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f18b000c4d0 tx=0x7f18b000c9a0 comp rx=0 tx=0).stop 2026-02-17T11:09:10.192 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:10.190+0000 7f18c81d3640 1 -- 10.20.193.49:0/1265193545 shutdown_connections 2026-02-17T11:09:10.192 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:10.190+0000 7f18c81d3640 1 --2- 10.20.193.49:0/1265193545 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f18900790b0 0x7f189007b570 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:10.192 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:10.190+0000 7f18c81d3640 1 --2- 10.20.193.49:0/1265193545 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f18c015fa20 0x7f18c0149c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:10.192 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:10.190+0000 7f18c81d3640 1 --2- 10.20.193.49:0/1265193545 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f18c015f640 0x7f18c00cb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:10.192 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:10.190+0000 7f18c81d3640 1 --2- 10.20.193.49:0/1265193545 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f18c00c8f10 0x7f18c01f73e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:10.192 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:10.190+0000 7f18c81d3640 1 -- 10.20.193.49:0/1265193545 >> 10.20.193.49:0/1265193545 conn(0x7f18c00c9f30 msgr2=0x7f18c0155eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:09:10.192 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:10.190+0000 7f18c81d3640 1 -- 10.20.193.49:0/1265193545 shutdown_connections 2026-02-17T11:09:10.192 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:10.190+0000 7f18c81d3640 1 -- 10.20.193.49:0/1265193545 wait complete. 2026-02-17T11:09:10.192 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:10.190+0000 7f18c81d3640 1 librados: shutdown 2026-02-17T11:09:10.200 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-17T11:09:17.813 DEBUG:teuthology.orchestra.run.trial049:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T11:09:17.874 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.872+0000 7f55b70db640 10 monclient: get_monmap_and_config 2026-02-17T11:09:17.874 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.872+0000 7f55b70db640 10 monclient: build_initial_monmap 2026-02-17T11:09:17.874 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.872+0000 7f55b70db640 10 monclient: monmap: 2026-02-17T11:09:17.875 INFO:teuthology.misc.health.trial049.stderr:epoch 0 2026-02-17T11:09:17.875 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:09:17.875 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:09:17.873696+0000 2026-02-17T11:09:17.875 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:09:17.873696+0000 2026-02-17T11:09:17.875 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:09:17.875 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:09:17.875 INFO:teuthology.misc.health.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:09:17.875 INFO:teuthology.misc.health.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:09:17.875 INFO:teuthology.misc.health.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:09:17.875 INFO:teuthology.misc.health.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:09:17.875 INFO:teuthology.misc.health.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:09:17.876 INFO:teuthology.misc.health.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:09:17.876 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:09:17.878 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.872+0000 7f55b70db640 1 Processor -- start 2026-02-17T11:09:17.878 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.872+0000 7f55b70db640 1 -- start start 2026-02-17T11:09:17.878 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.872+0000 7f55b70db640 10 monclient: init 2026-02-17T11:09:17.878 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.873+0000 7f55b70db640 10 monclient: _reopen_session rank -1 2026-02-17T11:09:17.878 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.873+0000 7f55b70db640 10 monclient: _add_conns ranks=[3,2,0,4,5,1] 2026-02-17T11:09:17.878 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.873+0000 7f55b70db640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f55b015f640 0x7f55b015fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:09:17.879 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.873+0000 7f55b70db640 10 monclient(hunting): picked mon.noname-a con 0x7f55b015f640 addr v2:10.20.193.49:3300/0 2026-02-17T11:09:17.879 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.873+0000 7f55b70db640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f55b00726b0 addr v1:10.20.193.157:6789/0 2026-02-17T11:09:17.879 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.873+0000 7f55b70db640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f55b0072b40 addr v1:10.20.193.49:6789/0 2026-02-17T11:09:17.879 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.873+0000 7f55b70db640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55b0073040 con 0x7f55b0072b40 2026-02-17T11:09:17.879 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.873+0000 7f55b70db640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55b0073320 con 0x7f55b00726b0 2026-02-17T11:09:17.879 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.873+0000 7f55b70db640 10 monclient(hunting): start opening mon connection 2026-02-17T11:09:17.879 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.873+0000 7f55b70db640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f55b00743a0 con 0x7f55b015f640 2026-02-17T11:09:17.879 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.873+0000 7f55b70db640 10 monclient(hunting): _renew_subs 2026-02-17T11:09:17.879 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.873+0000 7f55b70db640 10 monclient(hunting): authenticate will time out at 1034.537249s 2026-02-17T11:09:17.879 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.873+0000 7f55a7fff640 1 --1- >> v1:10.20.193.157:6789/0 conn(0x7f55b00726b0 0x7f55b015d2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.157:6789/0 says I am v1:10.20.193.49:57732/0 (socket says 10.20.193.49:57732) 2026-02-17T11:09:17.879 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.873+0000 7f55a7fff640 1 -- 10.20.193.49:0/3410976262 learned_addr learned my addr 10.20.193.49:0/3410976262 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:09:17.880 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.873+0000 7f55b4e50640 1 --2- 10.20.193.49:0/3410976262 >> v2:10.20.193.49:3300/0 conn(0x7f55b015f640 0x7f55b015fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:09:17.880 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.874+0000 7f55b4e50640 10 monclient(hunting): get_auth_request con 0x7f55b015f640 auth_method 0 2026-02-17T11:09:17.880 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.874+0000 7f55b4e50640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:09:17.880 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.874+0000 7f55b4e50640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:09:17.880 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.874+0000 7f55b4e50640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:09:17.880 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.874+0000 7f55b4e50640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:09:17.880 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.874+0000 7f55b4e50640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:09:17.880 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.874+0000 7f55b4e50640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:09:17.880 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.875+0000 7f55a77fe640 1 -- 10.20.193.49:0/3410976262 <== mon.2 v1:10.20.193.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3297520213 0 0) 0x7f55b0073320 con 0x7f55b00726b0 2026-02-17T11:09:17.880 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.875+0000 7f55a77fe640 10 monclient(hunting): _negotiate 2026-02-17T11:09:17.880 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.875+0000 7f55a77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:09:17.880 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.875+0000 7f55a77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:09:17.880 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.875+0000 7f55a77fe640 10 monclient(hunting): my global_id is 4277 2026-02-17T11:09:17.881 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.875+0000 7f55a77fe640 1 -- 10.20.193.49:0/3410976262 --> v1:10.20.193.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f559c003620 con 0x7f55b00726b0 2026-02-17T11:09:17.886 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.876+0000 7f55b4e50640 10 monclient(hunting): handle_auth_done global_id 4260 payload 274 2026-02-17T11:09:17.886 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.876+0000 7f55b4e50640 1 -- 10.20.193.49:0/3410976262 >> v1:10.20.193.157:6789/0 conn(0x7f55b00726b0 legacy=0x7f55b015d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:09:17.886 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.876+0000 7f55b4e50640 1 -- 10.20.193.49:0/3410976262 >> v1:10.20.193.49:6789/0 conn(0x7f55b0072b40 legacy=0x7f55b00c8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:09:17.886 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.876+0000 7f55b4e50640 10 monclient: _finish_hunting 0 2026-02-17T11:09:17.886 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.876+0000 7f55b4e50640 1 monclient: found mon.noname-a 2026-02-17T11:09:17.887 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.876+0000 7f55b4e50640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:09:17.887 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.876+0000 7f55b4e50640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:09:17.887 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.876+0000 7f55b4e50640 1 -- 10.20.193.49:0/3410976262 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55b0073600 con 0x7f55b015f640 2026-02-17T11:09:17.887 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.877+0000 7f55b4e50640 1 --2- 10.20.193.49:0/3410976262 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f55b015f640 0x7f55b015fa20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f55a00098a0 tx=0x7f55a002edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81452d43c42af027 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:09:17.887 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.879+0000 7f55a77fe640 1 -- 10.20.193.49:0/3410976262 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a003c070 con 0x7f55b015f640 2026-02-17T11:09:17.887 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.879+0000 7f55a77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:09:17.887 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.879+0000 7f55a77fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:09:17.887 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.879+0000 7f55a77fe640 10 monclient: dump: 2026-02-17T11:09:17.887 INFO:teuthology.misc.health.trial049.stderr:epoch 1 2026-02-17T11:09:17.887 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:09:17.887 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:17.888 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:17.888 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:09:17.888 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:09:17.888 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:09:17.888 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:09:17.888 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:09:17.888 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:09:17.888 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.879+0000 7f55a77fe640 10 monclient: _finish_auth 0 2026-02-17T11:09:17.888 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.879+0000 7f55a77fe640 10 monclient: _check_auth_tickets 2026-02-17T11:09:17.888 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.879+0000 7f55a77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:09:17.888 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.879+0000 7f55a77fe640 1 -- 10.20.193.49:0/3410976262 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55a002fae0 con 0x7f55b015f640 2026-02-17T11:09:17.889 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.879+0000 7f55a77fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:09:17.889 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.879+0000 7f55a77fe640 1 -- 10.20.193.49:0/3410976262 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a0037440 con 0x7f55b015f640 2026-02-17T11:09:17.889 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.879+0000 7f55b70db640 5 monclient: authenticate success, global_id 4260 2026-02-17T11:09:17.889 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.879+0000 7f55b70db640 10 monclient: get_monmap_and_config success 2026-02-17T11:09:17.889 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.879+0000 7f55b70db640 4 set_mon_vals no callback set 2026-02-17T11:09:17.889 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.879+0000 7f55a77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:09:17.889 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.879+0000 7f55a77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:09:17.889 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.879+0000 7f55a77fe640 10 monclient: dump: 2026-02-17T11:09:17.889 INFO:teuthology.misc.health.trial049.stderr:epoch 1 2026-02-17T11:09:17.889 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:09:17.889 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:17.889 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:17.889 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:09:17.890 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:09:17.890 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:09:17.890 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:09:17.890 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:09:17.890 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:09:17.890 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.880+0000 7f55b70db640 10 monclient: shutdown 2026-02-17T11:09:17.890 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.880+0000 7f55b70db640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:09:17.890 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.880+0000 7f55b70db640 1 -- 10.20.193.49:0/3410976262 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f55b015f640 msgr2=0x7f55b015fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:09:17.890 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.880+0000 7f55b70db640 1 --2- 10.20.193.49:0/3410976262 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f55b015f640 0x7f55b015fa20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f55a00098a0 tx=0x7f55a002edd0 comp rx=0 tx=0).stop 2026-02-17T11:09:17.890 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.880+0000 7f55b70db640 1 -- 10.20.193.49:0/3410976262 shutdown_connections 2026-02-17T11:09:17.890 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.880+0000 7f55b70db640 1 --2- 10.20.193.49:0/3410976262 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f55b015f640 0x7f55b015fa20 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:17.890 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.880+0000 7f55b70db640 1 -- 10.20.193.49:0/3410976262 >> 10.20.193.49:0/3410976262 conn(0x7f55b00c9f30 msgr2=0x7f55b00ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:09:17.891 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.880+0000 7f55b70db640 1 -- 10.20.193.49:0/3410976262 shutdown_connections 2026-02-17T11:09:17.891 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.880+0000 7f55b70db640 1 -- 10.20.193.49:0/3410976262 wait complete. 2026-02-17T11:09:17.891 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.880+0000 7f55b70db640 10 monclient: build_initial_monmap 2026-02-17T11:09:17.891 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.880+0000 7f55b70db640 10 monclient: monmap: 2026-02-17T11:09:17.891 INFO:teuthology.misc.health.trial049.stderr:epoch 0 2026-02-17T11:09:17.891 INFO:teuthology.misc.health.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:09:17.891 INFO:teuthology.misc.health.trial049.stderr:last_changed 0.000000 2026-02-17T11:09:17.891 INFO:teuthology.misc.health.trial049.stderr:created 0.000000 2026-02-17T11:09:17.891 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:09:17.891 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:09:17.891 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:09:17.891 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:09:17.892 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:09:17.892 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:09:17.892 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.880+0000 7f55b70db640 1 librados: starting msgr at 2026-02-17T11:09:17.892 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.880+0000 7f55b70db640 1 librados: starting objecter 2026-02-17T11:09:17.892 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.880+0000 7f55b70db640 1 Processor -- start 2026-02-17T11:09:17.892 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.881+0000 7f55b70db640 1 -- start start 2026-02-17T11:09:17.892 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.881+0000 7f55b70db640 1 librados: setting wanted keys 2026-02-17T11:09:17.892 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.881+0000 7f55b70db640 1 librados: calling monclient init 2026-02-17T11:09:17.892 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.881+0000 7f55b70db640 10 monclient: init 2026-02-17T11:09:17.892 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.881+0000 7f55b70db640 10 monclient: _reopen_session rank -1 2026-02-17T11:09:17.892 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.881+0000 7f55b70db640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:09:17.892 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.881+0000 7f55b70db640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f55b00726b0 0x7f55b015a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:09:17.893 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.881+0000 7f55b70db640 10 monclient(hunting): picked mon.noname-b con 0x7f55b00726b0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:09:17.893 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.881+0000 7f55b70db640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f55b0072b40 0x7f55b00c67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:09:17.893 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.881+0000 7f55b70db640 10 monclient(hunting): picked mon.noname-a con 0x7f55b0072b40 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:09:17.893 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.881+0000 7f55b70db640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f55b015f640 0x7f55b01f4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:09:17.893 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.881+0000 7f55b70db640 10 monclient(hunting): picked mon.noname-c con 0x7f55b015f640 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:09:17.893 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.881+0000 7f55b70db640 10 monclient(hunting): start opening mon connection 2026-02-17T11:09:17.893 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.881+0000 7f55b70db640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f55b015d9b0 con 0x7f55b0072b40 2026-02-17T11:09:17.893 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.881+0000 7f55b70db640 10 monclient(hunting): start opening mon connection 2026-02-17T11:09:17.893 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.881+0000 7f55b70db640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f55b0073bc0 con 0x7f55b00726b0 2026-02-17T11:09:17.893 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.881+0000 7f55b70db640 10 monclient(hunting): start opening mon connection 2026-02-17T11:09:17.893 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.881+0000 7f55b70db640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f55b015adc0 con 0x7f55b015f640 2026-02-17T11:09:17.893 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.881+0000 7f55b70db640 10 monclient(hunting): _renew_subs 2026-02-17T11:09:17.894 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.881+0000 7f55b70db640 10 monclient(hunting): authenticate will time out at 1034.545467s 2026-02-17T11:09:17.894 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.881+0000 7f55a7fff640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f55b0072b40 0x7f55b00c67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:09:17.894 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.881+0000 7f55a7fff640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f55b0072b40 0x7f55b00c67d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:35538/0 (socket says 10.20.193.49:35538) 2026-02-17T11:09:17.894 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.881+0000 7f55a7fff640 1 -- 10.20.193.49:0/2392383198 learned_addr learned my addr 10.20.193.49:0/2392383198 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:09:17.894 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.881+0000 7f55a7fff640 10 monclient(hunting): get_auth_request con 0x7f55b0072b40 auth_method 0 2026-02-17T11:09:17.894 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.881+0000 7f55a7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:09:17.894 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.881+0000 7f55a7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:09:17.894 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.881+0000 7f55a7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:09:17.894 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.881+0000 7f55b5651640 1 --2- 10.20.193.49:0/2392383198 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f55b015f640 0x7f55b01f4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:09:17.894 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.882+0000 7f55b5651640 10 monclient(hunting): get_auth_request con 0x7f55b015f640 auth_method 0 2026-02-17T11:09:17.894 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.882+0000 7f55b5651640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:09:17.894 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.882+0000 7f55b5651640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:09:17.895 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.882+0000 7f55b5651640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:09:17.895 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.882+0000 7f55a7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:09:17.895 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.882+0000 7f55a7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:09:17.895 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.882+0000 7f55a7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:09:17.895 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.882+0000 7f55b5651640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:09:17.895 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.882+0000 7f55b5651640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:09:17.895 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.882+0000 7f55b5651640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:09:17.895 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.882+0000 7f55b4e50640 1 --2- 10.20.193.49:0/2392383198 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f55b00726b0 0x7f55b015a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:09:17.895 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.882+0000 7f55b4e50640 10 monclient(hunting): get_auth_request con 0x7f55b00726b0 auth_method 0 2026-02-17T11:09:17.895 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.882+0000 7f55b4e50640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:09:17.895 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.882+0000 7f55b4e50640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:09:17.895 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.882+0000 7f55b4e50640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:09:17.896 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.883+0000 7f55b4e50640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:09:17.896 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.883+0000 7f55b4e50640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:09:17.896 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.883+0000 7f55b4e50640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:09:17.896 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.883+0000 7f55a7fff640 10 monclient(hunting): handle_auth_done global_id 4266 payload 824 2026-02-17T11:09:17.896 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.883+0000 7f55a7fff640 1 -- 10.20.193.49:0/2392383198 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f55b015f640 msgr2=0x7f55b01f4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:09:17.896 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.883+0000 7f55a7fff640 1 --2- 10.20.193.49:0/2392383198 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f55b015f640 0x7f55b01f4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:17.896 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.883+0000 7f55a7fff640 1 -- 10.20.193.49:0/2392383198 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f55b00726b0 msgr2=0x7f55b015a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:09:17.896 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.883+0000 7f55a7fff640 1 --2- 10.20.193.49:0/2392383198 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f55b00726b0 0x7f55b015a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:17.896 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.883+0000 7f55a7fff640 10 monclient: _finish_hunting 0 2026-02-17T11:09:17.896 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.883+0000 7f55a7fff640 1 monclient: found mon.noname-a 2026-02-17T11:09:17.896 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.883+0000 7f55a7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:09:17.896 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.883+0000 7f55a7fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:09:17.896 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.883+0000 7f55a7fff640 1 -- 10.20.193.49:0/2392383198 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55b015b0a0 con 0x7f55b0072b40 2026-02-17T11:09:17.898 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.884+0000 7f55a7fff640 1 --2- 10.20.193.49:0/2392383198 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f55b0072b40 0x7f55b00c67d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f559800c4d0 tx=0x7f559800c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:09:17.898 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.884+0000 7f55a57fa640 10 client.?.objecter ms_handle_connect 0x7f55b0072b40 2026-02-17T11:09:17.898 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.884+0000 7f55a57fa640 10 client.?.objecter resend_mon_ops 2026-02-17T11:09:17.898 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.886+0000 7f55a57fa640 1 -- 10.20.193.49:0/2392383198 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5598017070 con 0x7f55b0072b40 2026-02-17T11:09:17.898 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.886+0000 7f55a57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:09:17.898 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.886+0000 7f55a57fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:09:17.899 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.886+0000 7f55a57fa640 10 monclient: dump: 2026-02-17T11:09:17.899 INFO:teuthology.misc.health.trial049.stderr:epoch 1 2026-02-17T11:09:17.899 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:09:17.899 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:17.899 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:17.899 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:09:17.899 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:09:17.899 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:09:17.899 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:09:17.899 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:09:17.899 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:09:17.899 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.886+0000 7f55a57fa640 10 monclient: _finish_auth 0 2026-02-17T11:09:17.900 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.886+0000 7f55a57fa640 10 monclient: _check_auth_tickets 2026-02-17T11:09:17.900 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.886+0000 7f55a57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:09:17.900 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.886+0000 7f55a57fa640 1 -- 10.20.193.49:0/2392383198 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5598005e00 con 0x7f55b0072b40 2026-02-17T11:09:17.900 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.886+0000 7f55a57fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:09:17.900 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.886+0000 7f55a57fa640 1 -- 10.20.193.49:0/2392383198 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55980072b0 con 0x7f55b0072b40 2026-02-17T11:09:17.900 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.886+0000 7f55a57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:09:17.900 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.886+0000 7f55a57fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:09:17.900 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.886+0000 7f55a6ffd640 4 set_mon_vals no callback set 2026-02-17T11:09:17.900 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.886+0000 7f55a57fa640 10 monclient: dump: 2026-02-17T11:09:17.900 INFO:teuthology.misc.health.trial049.stderr:epoch 1 2026-02-17T11:09:17.900 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:09:17.900 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:17.900 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:17.901 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:09:17.901 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:09:17.901 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:09:17.901 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:09:17.901 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:09:17.901 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:09:17.901 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.886+0000 7f55b70db640 5 monclient: authenticate success, global_id 4266 2026-02-17T11:09:17.901 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.886+0000 7f55b70db640 10 monclient: _renew_subs 2026-02-17T11:09:17.901 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.886+0000 7f55b70db640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:09:17.901 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.886+0000 7f55b70db640 1 -- 10.20.193.49:0/2392383198 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55b015b380 con 0x7f55b0072b40 2026-02-17T11:09:17.901 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.886+0000 7f55b70db640 10 client.4266.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:09:17.901 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.886+0000 7f55b70db640 10 monclient: _renew_subs 2026-02-17T11:09:17.902 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.886+0000 7f55b70db640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:09:17.902 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.886+0000 7f55b70db640 1 -- 10.20.193.49:0/2392383198 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55b015b940 con 0x7f55b0072b40 2026-02-17T11:09:17.902 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.886+0000 7f55b70db640 1 librados: init done 2026-02-17T11:09:17.902 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.887+0000 7f55b70db640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:09:17.902 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.887+0000 7f55b70db640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:09:17.902 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.887+0000 7f55b70db640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:09:17.902 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.887+0000 7f55b70db640 1 -- 10.20.193.49:0/2392383198 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55b015bd20 con 0x7f55b0072b40 2026-02-17T11:09:17.903 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.898+0000 7f55a57fa640 1 -- 10.20.193.49:0/2392383198 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 4) ==== 100001+0+0 (secure 0 0 0) 0x7f5598007450 con 0x7f55b0072b40 2026-02-17T11:09:17.903 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.899+0000 7f55a57fa640 1 --2- 10.20.193.49:0/2392383198 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5580079100 0x7f558007b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:09:17.903 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.899+0000 7f55b4e50640 1 --2- 10.20.193.49:0/2392383198 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5580079100 0x7f558007b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:09:17.903 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.899+0000 7f55b4e50640 10 monclient: get_auth_request con 0x7f5580079100 auth_method 0 2026-02-17T11:09:17.903 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.899+0000 7f55b4e50640 1 --2- 10.20.193.49:0/2392383198 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5580079100 0x7f558007b5c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f55a0039000 tx=0x7f55a0033000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:09:17.904 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:17.899+0000 7f55a57fa640 10 client.4266.objecter ms_handle_connect 0x7f5580079100 2026-02-17T11:09:18.008 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:18.005+0000 7f55a57fa640 1 -- 10.20.193.49:0/2392383198 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2565+0+0 (secure 0 0 0) 0x7f5598007770 con 0x7f55b0072b40 2026-02-17T11:09:18.008 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:18.005+0000 7f55a57fa640 10 client.4266.objecter ms_dispatch2 0x7f55b0000b90 osd_map(18..18 src has 1..18) 2026-02-17T11:09:18.008 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:18.005+0000 7f55a57fa640 3 client.4266.objecter handle_osd_map got epochs [18,18] > 0 2026-02-17T11:09:18.008 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:18.005+0000 7f55a57fa640 3 client.4266.objecter handle_osd_map decoding full epoch 18 2026-02-17T11:09:18.009 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:18.005+0000 7f55a57fa640 20 client.4266.objecter dump_active .. 0 homeless 2026-02-17T11:09:18.009 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:18.005+0000 7f55a57fa640 1 -- 10.20.193.49:0/2392383198 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f55b015bd20 con 0x7f55b0072b40 2026-02-17T11:09:18.009 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:18.005+0000 7f55a57fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:09:18.009 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:18.005+0000 7f55a57fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:09:18.097 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:18.094+0000 7f55b70db640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:09:18.097 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:18.094+0000 7f55b70db640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:09:18.097 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:18.094+0000 7f55b70db640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:09:18.097 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:18.094+0000 7f55b70db640 1 -- 10.20.193.49:0/2392383198 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f55b00c9740 con 0x7f55b0072b40 2026-02-17T11:09:18.108 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:18.105+0000 7f55a57fa640 1 -- 10.20.193.49:0/2392383198 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12879 (secure 0 0 0) 0x7f5598021020 con 0x7f55b0072b40 2026-02-17T11:09:18.108 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:18.105+0000 7f55a57fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:09:18.108 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:18.105+0000 7f55a57fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:09:18.108 INFO:teuthology.misc.health.trial049.stdout: 2026-02-17T11:09:18.109 INFO:teuthology.misc.health.trial049.stdout:{"epoch":18,"fsid":"2799a57b-9ea3-46ae-8e91-1fe004a3651d","created":"2026-02-17T11:08:37.595499+0000","modified":"2026-02-17T11:08:43.985163+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T11:08:43.985163+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"30bc819e-140a-433e-b860-eaa88e282a11","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2f7f1f11-f256-4094-82a9-5d21882e6e0e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"26bd1274-fe52-42cb-876b-df9920880f95","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c78a5263-3b0d-4b22-a848-bcd6a1e4f6b0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f0fdfadd-2f39-4ad8-ac88-cb588c5e8ee0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"65872639-d6c0-482d-95d1-1d9f250781c9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"43091d3e-638d-4462-867b-cade02a315e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"890ae4d6-33c9-4515-a896-a689647330dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"f04abc9b-ed75-4582-b47d-07a9890f52bb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"7dfbb00a-6b89-4de3-9f30-6aadd91b4408","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"e497a4fd-a944-489b-9cb3-30f5acaeb53e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"7371d50f-36f9-477d-8d4d-853f481dd6db","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"3cf4fded-49db-4d95-956b-77acc868a3ed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"7dc53473-594f-4cfb-8444-eab205e2e0f9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"e8ab3e8f-29a8-4c79-bf86-d29543aac56a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"300a4696-aa54-4b47-b9f3-87dec719bcfa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:09:18.111 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:18.108+0000 7f55b70db640 10 librados: watch_flush enter 2026-02-17T11:09:18.111 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:18.108+0000 7f55b70db640 10 librados: watch_flush exit 2026-02-17T11:09:18.111 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:18.108+0000 7f55b70db640 20 client.4266.objecter shutdown clearing up homeless session... 2026-02-17T11:09:18.111 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:18.108+0000 7f55b70db640 10 client.4266.objecter successfully canceled tick 2026-02-17T11:09:18.111 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:18.108+0000 7f55b70db640 1 -- 10.20.193.49:0/2392383198 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5580079100 msgr2=0x7f558007b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:09:18.111 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:18.108+0000 7f55b70db640 1 --2- 10.20.193.49:0/2392383198 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5580079100 0x7f558007b5c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f55a0039000 tx=0x7f55a0033000 comp rx=0 tx=0).stop 2026-02-17T11:09:18.112 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:18.108+0000 7f55b70db640 10 monclient: shutdown 2026-02-17T11:09:18.112 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:18.108+0000 7f55b70db640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:09:18.112 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:18.108+0000 7f55b70db640 1 -- 10.20.193.49:0/2392383198 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f55b0072b40 msgr2=0x7f55b00c67d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:09:18.112 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:18.108+0000 7f55b70db640 1 --2- 10.20.193.49:0/2392383198 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f55b0072b40 0x7f55b00c67d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f559800c4d0 tx=0x7f559800c9a0 comp rx=0 tx=0).stop 2026-02-17T11:09:18.112 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:18.108+0000 7f55b70db640 1 -- 10.20.193.49:0/2392383198 shutdown_connections 2026-02-17T11:09:18.112 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:18.108+0000 7f55b70db640 1 --2- 10.20.193.49:0/2392383198 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5580079100 0x7f558007b5c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:18.112 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:18.108+0000 7f55b70db640 1 --2- 10.20.193.49:0/2392383198 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f55b015f640 0x7f55b01f4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:18.112 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:18.108+0000 7f55b70db640 1 --2- 10.20.193.49:0/2392383198 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f55b0072b40 0x7f55b00c67d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:18.112 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:18.108+0000 7f55b70db640 1 --2- 10.20.193.49:0/2392383198 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f55b00726b0 0x7f55b015a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:18.112 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:18.108+0000 7f55b70db640 1 -- 10.20.193.49:0/2392383198 >> 10.20.193.49:0/2392383198 conn(0x7f55b00c9f30 msgr2=0x7f55b00ca310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:09:18.112 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:18.108+0000 7f55b70db640 1 -- 10.20.193.49:0/2392383198 shutdown_connections 2026-02-17T11:09:18.113 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:18.108+0000 7f55b70db640 1 -- 10.20.193.49:0/2392383198 wait complete. 2026-02-17T11:09:18.113 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:18.108+0000 7f55b70db640 1 librados: shutdown 2026-02-17T11:09:18.119 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-17T11:09:19.367 INFO:tasks.ceph.osd.8.trial049.stderr:==00:00:00:35.273 45322== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:19.929 INFO:tasks.ceph.osd.4.trial049.stderr:==00:00:00:35.841 45321== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:19.965 INFO:tasks.ceph.osd.2.trial157.stderr:==00:00:00:35.795 44306== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:19.965 INFO:tasks.ceph.osd.7.trial162.stderr:==00:00:00:35.783 44731== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:19.970 INFO:tasks.ceph.osd.12.trial049.stderr:==00:00:00:35.876 45323== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:20.000 INFO:tasks.ceph.osd.9.trial097.stderr:==00:00:00:35.897 44852== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:20.064 INFO:tasks.ceph.osd.1.trial097.stderr:==00:00:00:35.967 44850== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:20.196 INFO:tasks.ceph.osd.15.trial162.stderr:==00:00:00:36.011 44733== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:20.206 INFO:tasks.ceph.osd.14.trial157.stderr:==00:00:00:36.032 44308== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:20.219 INFO:tasks.ceph.osd.0.trial049.stderr:==00:00:00:36.133 45320== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:20.244 INFO:tasks.ceph.osd.13.trial097.stderr:==00:00:00:36.079 44879== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:20.271 INFO:tasks.ceph.osd.3.trial162.stderr:==00:00:00:36.088 44730== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:20.271 INFO:tasks.ceph.osd.11.trial162.stderr:==00:00:00:36.088 44732== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:20.275 INFO:tasks.ceph.osd.5.trial097.stderr:==00:00:00:36.174 44851== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:20.276 INFO:tasks.ceph.osd.6.trial157.stderr:==00:00:00:36.106 44305== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:20.796 INFO:tasks.ceph.osd.10.trial157.stderr:==00:00:00:36.622 44307== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:21.710 INFO:tasks.ceph.osd.8.trial049.stderr:==00:00:00:37.616 45322== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:21.742 INFO:tasks.ceph.osd.8.trial049.stderr:==00:00:00:37.649 45322== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:21.745 INFO:tasks.ceph.osd.8.trial049.stderr:==00:00:00:37.651 45322== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:22.084 INFO:tasks.ceph.osd.2.trial157.stderr:==00:00:00:37.914 44306== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:22.115 INFO:tasks.ceph.osd.2.trial157.stderr:==00:00:00:37.945 44306== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:22.118 INFO:tasks.ceph.osd.2.trial157.stderr:==00:00:00:37.948 44306== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:22.176 INFO:tasks.ceph.osd.4.trial049.stderr:==00:00:00:38.088 45321== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:22.207 INFO:tasks.ceph.osd.4.trial049.stderr:==00:00:00:38.119 45321== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:22.210 INFO:tasks.ceph.osd.4.trial049.stderr:==00:00:00:38.122 45321== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:22.262 INFO:tasks.ceph.osd.12.trial049.stderr:==00:00:00:38.167 45323== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:22.271 INFO:tasks.ceph.osd.0.trial049.stderr:==00:00:00:38.184 45320== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:22.287 INFO:tasks.ceph.osd.12.trial049.stderr:==00:00:00:38.192 45323== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:22.288 INFO:tasks.ceph.osd.9.trial097.stderr:==00:00:00:38.186 44852== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:22.289 INFO:tasks.ceph.osd.12.trial049.stderr:==00:00:00:38.195 45323== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:22.300 INFO:tasks.ceph.osd.7.trial162.stderr:==00:00:00:38.117 44731== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:22.322 INFO:tasks.ceph.osd.7.trial162.stderr:==00:00:00:38.140 44731== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:22.325 INFO:tasks.ceph.osd.7.trial162.stderr:==00:00:00:38.143 44731== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:22.369 INFO:tasks.ceph.osd.1.trial097.stderr:==00:00:00:38.272 44850== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:22.396 INFO:tasks.ceph.osd.1.trial097.stderr:==00:00:00:38.299 44850== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:22.399 INFO:tasks.ceph.osd.1.trial097.stderr:==00:00:00:38.302 44850== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:22.531 INFO:tasks.ceph.osd.14.trial157.stderr:==00:00:00:38.357 44308== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:22.550 INFO:tasks.ceph.osd.0.trial049.stderr:==00:00:00:38.463 45320== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:22.553 INFO:tasks.ceph.osd.0.trial049.stderr:==00:00:00:38.467 45320== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:22.563 INFO:tasks.ceph.osd.9.trial097.stderr:==00:00:00:38.460 44852== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:22.566 INFO:tasks.ceph.osd.9.trial097.stderr:==00:00:00:38.464 44852== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:22.571 INFO:tasks.ceph.osd.15.trial162.stderr:==00:00:00:38.386 44733== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:22.584 INFO:tasks.ceph.osd.5.trial097.stderr:==00:00:00:38.484 44851== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:22.597 INFO:tasks.ceph.osd.13.trial097.stderr:==00:00:00:38.431 44879== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:22.602 INFO:tasks.ceph.osd.6.trial157.stderr:==00:00:00:38.432 44305== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:22.612 INFO:tasks.ceph.osd.5.trial097.stderr:==00:00:00:38.511 44851== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:22.615 INFO:tasks.ceph.osd.5.trial097.stderr:==00:00:00:38.514 44851== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:22.624 INFO:tasks.ceph.osd.13.trial097.stderr:==00:00:00:38.458 44879== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:22.627 INFO:tasks.ceph.osd.13.trial097.stderr:==00:00:00:38.461 44879== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:22.633 INFO:tasks.ceph.osd.6.trial157.stderr:==00:00:00:38.463 44305== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:22.636 INFO:tasks.ceph.osd.6.trial157.stderr:==00:00:00:38.466 44305== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:22.652 INFO:tasks.ceph.osd.3.trial162.stderr:==00:00:00:38.469 44730== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:22.660 INFO:tasks.ceph.osd.11.trial162.stderr:==00:00:00:38.477 44732== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:22.690 INFO:tasks.ceph.osd.3.trial162.stderr:==00:00:00:38.507 44730== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:22.693 INFO:tasks.ceph.osd.3.trial162.stderr:==00:00:00:38.510 44730== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:22.814 INFO:tasks.ceph.osd.14.trial157.stderr:==00:00:00:38.640 44308== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:22.817 INFO:tasks.ceph.osd.14.trial157.stderr:==00:00:00:38.643 44308== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:22.848 INFO:tasks.ceph.osd.15.trial162.stderr:==00:00:00:38.664 44733== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:22.852 INFO:tasks.ceph.osd.15.trial162.stderr:==00:00:00:38.667 44733== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:22.930 INFO:tasks.ceph.osd.11.trial162.stderr:==00:00:00:38.747 44732== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:22.933 INFO:tasks.ceph.osd.11.trial162.stderr:==00:00:00:38.751 44732== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:23.155 INFO:tasks.ceph.osd.10.trial157.stderr:==00:00:00:38.981 44307== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:23.190 INFO:tasks.ceph.osd.10.trial157.stderr:==00:00:00:39.016 44307== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:23.192 INFO:tasks.ceph.osd.10.trial157.stderr:==00:00:00:39.019 44307== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:23.546 INFO:tasks.ceph.osd.8.trial049.stderr:==00:00:00:39.453 45322== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:23.794 INFO:tasks.ceph.osd.4.trial049.stderr:==00:00:00:39.706 45321== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:23.954 INFO:tasks.ceph.osd.2.trial157.stderr:==00:00:00:39.784 44306== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:24.050 INFO:tasks.ceph.osd.7.trial162.stderr:==00:00:00:39.867 44731== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:24.086 INFO:tasks.ceph.osd.12.trial049.stderr:==00:00:00:39.991 45323== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:24.218 INFO:tasks.ceph.osd.1.trial097.stderr:==00:00:00:40.121 44850== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:24.228 INFO:tasks.ceph.osd.13.trial097.stderr:==00:00:00:40.062 44879== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:24.277 INFO:tasks.ceph.osd.9.trial097.stderr:==00:00:00:40.175 44852== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:24.332 INFO:tasks.ceph.osd.5.trial097.stderr:==00:00:00:40.232 44851== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:24.337 INFO:tasks.ceph.osd.6.trial157.stderr:==00:00:00:40.167 44305== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:24.340 INFO:tasks.ceph.osd.0.trial049.stderr:==00:00:00:40.254 45320== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:24.473 INFO:tasks.ceph.osd.3.trial162.stderr:==00:00:00:40.290 44730== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:24.663 INFO:tasks.ceph.osd.14.trial157.stderr:==00:00:00:40.489 44308== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:24.698 INFO:tasks.ceph.osd.11.trial162.stderr:==00:00:00:40.515 44732== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:24.699 INFO:tasks.ceph.osd.15.trial162.stderr:==00:00:00:40.514 44733== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:24.939 INFO:tasks.ceph.osd.10.trial157.stderr:==00:00:00:40.765 44307== Warning: unimplemented fcntl command: 1038 2026-02-17T11:09:25.731 DEBUG:teuthology.orchestra.run.trial049:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T11:09:25.792 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.789+0000 7f37f1cf1640 10 monclient: get_monmap_and_config 2026-02-17T11:09:25.792 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.789+0000 7f37f1cf1640 10 monclient: build_initial_monmap 2026-02-17T11:09:25.792 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.789+0000 7f37f1cf1640 10 monclient: monmap: 2026-02-17T11:09:25.792 INFO:teuthology.misc.health.trial049.stderr:epoch 0 2026-02-17T11:09:25.793 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:09:25.793 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:09:25.790794+0000 2026-02-17T11:09:25.793 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:09:25.790794+0000 2026-02-17T11:09:25.793 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:09:25.793 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:09:25.793 INFO:teuthology.misc.health.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:09:25.793 INFO:teuthology.misc.health.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:09:25.793 INFO:teuthology.misc.health.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:09:25.793 INFO:teuthology.misc.health.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:09:25.793 INFO:teuthology.misc.health.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:09:25.793 INFO:teuthology.misc.health.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:09:25.794 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:09:25.794 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.789+0000 7f37f1cf1640 1 Processor -- start 2026-02-17T11:09:25.794 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.789+0000 7f37f1cf1640 1 -- start start 2026-02-17T11:09:25.794 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.789+0000 7f37f1cf1640 10 monclient: init 2026-02-17T11:09:25.801 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.790+0000 7f37f1cf1640 10 monclient: _reopen_session rank -1 2026-02-17T11:09:25.801 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.790+0000 7f37f1cf1640 10 monclient: _add_conns ranks=[0,5,3,2,4,1] 2026-02-17T11:09:25.801 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.790+0000 7f37f1cf1640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f37ec0c8950 addr v1:10.20.193.49:6789/0 2026-02-17T11:09:25.801 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.790+0000 7f37f1cf1640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f37ec0c8d30 0x7f37ec151ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:09:25.801 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.790+0000 7f37f1cf1640 10 monclient(hunting): picked mon.noname-c con 0x7f37ec0c8d30 addr v2:10.20.193.157:3300/0 2026-02-17T11:09:25.801 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.790+0000 7f37f1cf1640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f37ec152220 0x7f37ec158130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:09:25.801 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.790+0000 7f37f1cf1640 10 monclient(hunting): picked mon.noname-a con 0x7f37ec152220 addr v2:10.20.193.49:3300/0 2026-02-17T11:09:25.801 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.790+0000 7f37f1cf1640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37ec074ce0 con 0x7f37ec0c8950 2026-02-17T11:09:25.801 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.790+0000 7f37f1cf1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:09:25.801 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.790+0000 7f37f1cf1640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f37ec073960 con 0x7f37ec152220 2026-02-17T11:09:25.802 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.790+0000 7f37f1cf1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:09:25.802 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.790+0000 7f37f1cf1640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f37ec073c40 con 0x7f37ec0c8d30 2026-02-17T11:09:25.802 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.790+0000 7f37f1cf1640 10 monclient(hunting): _renew_subs 2026-02-17T11:09:25.802 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.790+0000 7f37f1cf1640 10 monclient(hunting): authenticate will time out at 1042.454255s 2026-02-17T11:09:25.802 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.790+0000 7f37eaffd640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f37ec0c8d30 0x7f37ec151ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:09:25.802 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.790+0000 7f37eb7fe640 1 --1- >> v1:10.20.193.49:6789/0 conn(0x7f37ec0c8950 0x7f37ec1595b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.49:6789/0 says I am v1:10.20.193.49:58584/0 (socket says 10.20.193.49:58584) 2026-02-17T11:09:25.802 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.790+0000 7f37eb7fe640 1 -- 10.20.193.49:0/4148323397 learned_addr learned my addr 10.20.193.49:0/4148323397 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:09:25.802 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.790+0000 7f37eaffd640 10 monclient(hunting): get_auth_request con 0x7f37ec0c8d30 auth_method 0 2026-02-17T11:09:25.802 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.790+0000 7f37eaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:09:25.802 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.790+0000 7f37eaffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:09:25.802 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.790+0000 7f37eaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:09:25.803 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.791+0000 7f37ebfff640 1 --2- 10.20.193.49:0/4148323397 >> v2:10.20.193.49:3300/0 conn(0x7f37ec152220 0x7f37ec158130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:09:25.803 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.791+0000 7f37eaffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:09:25.803 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.791+0000 7f37eaffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:09:25.803 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.791+0000 7f37eaffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:09:25.803 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.791+0000 7f37ebfff640 10 monclient(hunting): get_auth_request con 0x7f37ec152220 auth_method 0 2026-02-17T11:09:25.803 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.791+0000 7f37ebfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:09:25.803 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.791+0000 7f37ebfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:09:25.803 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.791+0000 7f37ebfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:09:25.803 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.792+0000 7f37eaffd640 10 monclient(hunting): handle_auth_done global_id 4283 payload 274 2026-02-17T11:09:25.803 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.792+0000 7f37eaffd640 1 -- 10.20.193.49:0/4148323397 >> v2:10.20.193.49:3300/0 conn(0x7f37ec152220 msgr2=0x7f37ec158130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:09:25.803 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.792+0000 7f37eaffd640 1 --2- 10.20.193.49:0/4148323397 >> v2:10.20.193.49:3300/0 conn(0x7f37ec152220 0x7f37ec158130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:25.803 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.792+0000 7f37eaffd640 1 -- 10.20.193.49:0/4148323397 >> v1:10.20.193.49:6789/0 conn(0x7f37ec0c8950 legacy=0x7f37ec1595b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:09:25.804 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.792+0000 7f37eaffd640 10 monclient: _finish_hunting 0 2026-02-17T11:09:25.804 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.792+0000 7f37eaffd640 1 monclient: found mon.noname-c 2026-02-17T11:09:25.804 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.792+0000 7f37eaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:09:25.804 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.792+0000 7f37eaffd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:09:25.804 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.792+0000 7f37eaffd640 1 -- 10.20.193.49:0/4148323397 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37ec073f20 con 0x7f37ec0c8d30 2026-02-17T11:09:25.804 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.793+0000 7f37eaffd640 1 --2- 10.20.193.49:0/4148323397 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f37ec0c8d30 0x7f37ec151ce0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f37ec0c4780 tx=0x7f37dc02ede0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be8d83c0ff56a970 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:09:25.804 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.794+0000 7f37ea7fc640 1 -- 10.20.193.49:0/4148323397 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37dc03c070 con 0x7f37ec0c8d30 2026-02-17T11:09:25.804 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.794+0000 7f37ea7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:09:25.804 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.794+0000 7f37ea7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:09:25.804 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.794+0000 7f37ea7fc640 10 monclient: dump: 2026-02-17T11:09:25.804 INFO:teuthology.misc.health.trial049.stderr:epoch 1 2026-02-17T11:09:25.805 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:09:25.805 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:25.805 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:25.805 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:09:25.805 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:09:25.805 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:09:25.805 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:09:25.805 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:09:25.805 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:09:25.805 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.794+0000 7f37ea7fc640 10 monclient: _finish_auth 0 2026-02-17T11:09:25.805 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.794+0000 7f37ea7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:09:25.805 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.794+0000 7f37ea7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:09:25.806 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.794+0000 7f37f1cf1640 5 monclient: authenticate success, global_id 4283 2026-02-17T11:09:25.806 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.794+0000 7f37f1cf1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:09:25.806 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.795+0000 7f37ea7fc640 1 -- 10.20.193.49:0/4148323397 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37dc02faf0 con 0x7f37ec0c8d30 2026-02-17T11:09:25.806 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.795+0000 7f37ea7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:09:25.806 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.795+0000 7f37ea7fc640 1 -- 10.20.193.49:0/4148323397 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37dc037440 con 0x7f37ec0c8d30 2026-02-17T11:09:25.806 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.795+0000 7f37ea7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:09:25.806 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.795+0000 7f37ea7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:09:25.806 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.795+0000 7f37ea7fc640 10 monclient: dump: 2026-02-17T11:09:25.806 INFO:teuthology.misc.health.trial049.stderr:epoch 1 2026-02-17T11:09:25.806 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:09:25.806 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:25.806 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:25.807 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:09:25.807 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:09:25.807 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:09:25.807 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:09:25.807 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:09:25.807 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:09:25.807 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.795+0000 7f37f1cf1640 10 monclient: get_monmap_and_config success 2026-02-17T11:09:25.807 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.795+0000 7f37f1cf1640 4 set_mon_vals no callback set 2026-02-17T11:09:25.807 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.795+0000 7f37f1cf1640 10 monclient: shutdown 2026-02-17T11:09:25.807 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.795+0000 7f37f1cf1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:09:25.807 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.795+0000 7f37f1cf1640 1 -- 10.20.193.49:0/4148323397 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f37ec0c8d30 msgr2=0x7f37ec151ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:09:25.808 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.795+0000 7f37f1cf1640 1 --2- 10.20.193.49:0/4148323397 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f37ec0c8d30 0x7f37ec151ce0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f37ec0c4780 tx=0x7f37dc02ede0 comp rx=0 tx=0).stop 2026-02-17T11:09:25.808 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.795+0000 7f37f1cf1640 1 -- 10.20.193.49:0/4148323397 shutdown_connections 2026-02-17T11:09:25.808 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.795+0000 7f37f1cf1640 1 --2- 10.20.193.49:0/4148323397 >> v2:10.20.193.49:3300/0 conn(0x7f37ec152220 0x7f37ec158130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:25.808 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.795+0000 7f37f1cf1640 1 --2- 10.20.193.49:0/4148323397 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f37ec0c8d30 0x7f37ec151ce0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:25.808 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.795+0000 7f37f1cf1640 1 -- 10.20.193.49:0/4148323397 >> 10.20.193.49:0/4148323397 conn(0x7f37ec0c9f30 msgr2=0x7f37ec0ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:09:25.808 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.795+0000 7f37f1cf1640 1 -- 10.20.193.49:0/4148323397 shutdown_connections 2026-02-17T11:09:25.808 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.795+0000 7f37f1cf1640 1 -- 10.20.193.49:0/4148323397 wait complete. 2026-02-17T11:09:25.808 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.796+0000 7f37f1cf1640 10 monclient: build_initial_monmap 2026-02-17T11:09:25.808 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.796+0000 7f37f1cf1640 10 monclient: monmap: 2026-02-17T11:09:25.808 INFO:teuthology.misc.health.trial049.stderr:epoch 0 2026-02-17T11:09:25.809 INFO:teuthology.misc.health.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:09:25.809 INFO:teuthology.misc.health.trial049.stderr:last_changed 0.000000 2026-02-17T11:09:25.809 INFO:teuthology.misc.health.trial049.stderr:created 0.000000 2026-02-17T11:09:25.809 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:09:25.809 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:09:25.809 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:09:25.809 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:09:25.809 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:09:25.809 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:09:25.809 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.796+0000 7f37f1cf1640 1 librados: starting msgr at 2026-02-17T11:09:25.809 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.796+0000 7f37f1cf1640 1 librados: starting objecter 2026-02-17T11:09:25.809 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.796+0000 7f37f1cf1640 1 Processor -- start 2026-02-17T11:09:25.810 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.796+0000 7f37f1cf1640 1 -- start start 2026-02-17T11:09:25.810 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.796+0000 7f37f1cf1640 1 librados: setting wanted keys 2026-02-17T11:09:25.810 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.796+0000 7f37f1cf1640 1 librados: calling monclient init 2026-02-17T11:09:25.810 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.796+0000 7f37f1cf1640 10 monclient: init 2026-02-17T11:09:25.810 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.796+0000 7f37f1cf1640 10 monclient: _reopen_session rank -1 2026-02-17T11:09:25.810 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.796+0000 7f37f1cf1640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:09:25.810 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.796+0000 7f37f1cf1640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f37ec0c8950 0x7f37ec14d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:09:25.810 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.796+0000 7f37f1cf1640 10 monclient(hunting): picked mon.noname-a con 0x7f37ec0c8950 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:09:25.810 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.796+0000 7f37f1cf1640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f37ec0c8d30 0x7f37ec1550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:09:25.810 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.796+0000 7f37f1cf1640 10 monclient(hunting): picked mon.noname-b con 0x7f37ec0c8d30 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:09:25.810 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.796+0000 7f37f1cf1640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f37ec152220 0x7f37ec1f5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:09:25.810 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.796+0000 7f37f1cf1640 10 monclient(hunting): picked mon.noname-c con 0x7f37ec152220 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:09:25.811 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.796+0000 7f37f1cf1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:09:25.811 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.796+0000 7f37f1cf1640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f37ec0747c0 con 0x7f37ec0c8950 2026-02-17T11:09:25.811 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.796+0000 7f37f1cf1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:09:25.811 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.796+0000 7f37f1cf1640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f37ec0744e0 con 0x7f37ec0c8d30 2026-02-17T11:09:25.811 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.796+0000 7f37f1cf1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:09:25.811 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.796+0000 7f37f1cf1640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f37ec159cc0 con 0x7f37ec152220 2026-02-17T11:09:25.811 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.796+0000 7f37f1cf1640 10 monclient(hunting): _renew_subs 2026-02-17T11:09:25.811 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.796+0000 7f37f1cf1640 10 monclient(hunting): authenticate will time out at 1042.460921s 2026-02-17T11:09:25.811 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.797+0000 7f37eb7fe640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f37ec0c8950 0x7f37ec14d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:09:25.811 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.797+0000 7f37eb7fe640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f37ec0c8950 0x7f37ec14d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:35558/0 (socket says 10.20.193.49:35558) 2026-02-17T11:09:25.811 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.797+0000 7f37eb7fe640 1 -- 10.20.193.49:0/3109919444 learned_addr learned my addr 10.20.193.49:0/3109919444 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:09:25.811 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.797+0000 7f37eb7fe640 10 monclient(hunting): get_auth_request con 0x7f37ec0c8950 auth_method 0 2026-02-17T11:09:25.812 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.797+0000 7f37eb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:09:25.812 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.797+0000 7f37eb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:09:25.812 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.797+0000 7f37eb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:09:25.812 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.797+0000 7f37ebfff640 1 --2- 10.20.193.49:0/3109919444 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f37ec152220 0x7f37ec1f5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:09:25.812 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.798+0000 7f37ebfff640 10 monclient(hunting): get_auth_request con 0x7f37ec152220 auth_method 0 2026-02-17T11:09:25.812 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.798+0000 7f37ebfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:09:25.812 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.798+0000 7f37ebfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:09:25.812 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.798+0000 7f37ebfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:09:25.812 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.798+0000 7f37eb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:09:25.812 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.798+0000 7f37eb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:09:25.812 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.798+0000 7f37eb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:09:25.812 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.798+0000 7f37eaffd640 1 --2- 10.20.193.49:0/3109919444 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f37ec0c8d30 0x7f37ec1550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:09:25.812 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.798+0000 7f37ebfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:09:25.813 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.798+0000 7f37ebfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:09:25.813 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.798+0000 7f37ebfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:09:25.815 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.798+0000 7f37eaffd640 10 monclient(hunting): get_auth_request con 0x7f37ec0c8d30 auth_method 0 2026-02-17T11:09:25.816 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.798+0000 7f37eaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:09:25.816 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.798+0000 7f37eaffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:09:25.816 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.798+0000 7f37eaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:09:25.816 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.799+0000 7f37eaffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:09:25.816 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.799+0000 7f37eaffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:09:25.816 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.799+0000 7f37eaffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:09:25.816 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.800+0000 7f37ebfff640 10 monclient(hunting): handle_auth_done global_id 4286 payload 824 2026-02-17T11:09:25.816 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.800+0000 7f37ebfff640 1 -- 10.20.193.49:0/3109919444 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f37ec0c8d30 msgr2=0x7f37ec1550a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:09:25.816 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.800+0000 7f37ebfff640 1 --2- 10.20.193.49:0/3109919444 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f37ec0c8d30 0x7f37ec1550a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:25.816 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.800+0000 7f37ebfff640 1 -- 10.20.193.49:0/3109919444 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f37ec0c8950 msgr2=0x7f37ec14d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:09:25.816 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.800+0000 7f37ebfff640 1 --2- 10.20.193.49:0/3109919444 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f37ec0c8950 0x7f37ec14d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:25.817 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.800+0000 7f37ebfff640 10 monclient: _finish_hunting 0 2026-02-17T11:09:25.817 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.800+0000 7f37ebfff640 1 monclient: found mon.noname-c 2026-02-17T11:09:25.817 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.800+0000 7f37ebfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:09:25.817 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.800+0000 7f37ebfff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:09:25.817 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.800+0000 7f37ebfff640 1 -- 10.20.193.49:0/3109919444 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37ec0c74c0 con 0x7f37ec152220 2026-02-17T11:09:25.817 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.801+0000 7f37ebfff640 1 --2- 10.20.193.49:0/3109919444 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f37ec152220 0x7f37ec1f5d00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f37e0007d50 tx=0x7f37e000d490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:09:25.817 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.801+0000 7f37c7fff640 10 client.?.objecter ms_handle_connect 0x7f37ec152220 2026-02-17T11:09:25.817 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.801+0000 7f37c7fff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:09:25.817 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.802+0000 7f37c7fff640 1 -- 10.20.193.49:0/3109919444 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e000a2e0 con 0x7f37ec152220 2026-02-17T11:09:25.817 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.802+0000 7f37c7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:09:25.817 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.802+0000 7f37c7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:09:25.817 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.802+0000 7f37c7fff640 10 monclient: dump: 2026-02-17T11:09:25.818 INFO:teuthology.misc.health.trial049.stderr:epoch 1 2026-02-17T11:09:25.818 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:09:25.818 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:25.818 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:25.818 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:09:25.818 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:09:25.818 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:09:25.818 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:09:25.818 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:09:25.818 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:09:25.818 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.802+0000 7f37c7fff640 10 monclient: _finish_auth 0 2026-02-17T11:09:25.818 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.802+0000 7f37c7fff640 10 monclient: _check_auth_tickets 2026-02-17T11:09:25.819 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.802+0000 7f37c7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:09:25.819 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.802+0000 7f37f1cf1640 5 monclient: authenticate success, global_id 4286 2026-02-17T11:09:25.819 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.802+0000 7f37f1cf1640 10 monclient: _renew_subs 2026-02-17T11:09:25.819 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.802+0000 7f37f1cf1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:09:25.819 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.802+0000 7f37f1cf1640 1 -- 10.20.193.49:0/3109919444 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37ec0c77a0 con 0x7f37ec152220 2026-02-17T11:09:25.819 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.802+0000 7f37f1cf1640 10 client.4286.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:09:25.819 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.802+0000 7f37f1cf1640 10 monclient: _renew_subs 2026-02-17T11:09:25.819 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.802+0000 7f37f1cf1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:09:25.819 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.802+0000 7f37f1cf1640 1 -- 10.20.193.49:0/3109919444 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37ec1545c0 con 0x7f37ec152220 2026-02-17T11:09:25.819 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.802+0000 7f37f1cf1640 1 librados: init done 2026-02-17T11:09:25.819 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.802+0000 7f37f1cf1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:09:25.819 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.802+0000 7f37f1cf1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:09:25.820 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.802+0000 7f37f1cf1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:09:25.820 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.802+0000 7f37f1cf1640 1 -- 10.20.193.49:0/3109919444 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37ec152670 con 0x7f37ec152220 2026-02-17T11:09:25.820 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.803+0000 7f37c7fff640 1 -- 10.20.193.49:0/3109919444 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37e000db50 con 0x7f37ec152220 2026-02-17T11:09:25.820 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.803+0000 7f37c7fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:09:25.820 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.803+0000 7f37c7fff640 1 -- 10.20.193.49:0/3109919444 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e0003a90 con 0x7f37ec152220 2026-02-17T11:09:25.820 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.803+0000 7f37c7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:09:25.820 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.803+0000 7f37c7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:09:25.820 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.803+0000 7f37e9ffb640 4 set_mon_vals no callback set 2026-02-17T11:09:25.820 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.803+0000 7f37c7fff640 10 monclient: dump: 2026-02-17T11:09:25.820 INFO:teuthology.misc.health.trial049.stderr:epoch 1 2026-02-17T11:09:25.820 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:09:25.820 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:25.821 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:25.821 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:09:25.821 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:09:25.821 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:09:25.821 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:09:25.821 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:09:25.821 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:09:25.919 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.916+0000 7f37c7fff640 1 -- 10.20.193.49:0/3109919444 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 4) ==== 100001+0+0 (secure 0 0 0) 0x7f37e0003c30 con 0x7f37ec152220 2026-02-17T11:09:25.919 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.917+0000 7f37c7fff640 1 --2- 10.20.193.49:0/3109919444 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f37bc0790b0 0x7f37bc07b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:09:25.920 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.917+0000 7f37eb7fe640 1 --2- 10.20.193.49:0/3109919444 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f37bc0790b0 0x7f37bc07b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:09:25.920 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.917+0000 7f37eb7fe640 10 monclient: get_auth_request con 0x7f37bc0790b0 auth_method 0 2026-02-17T11:09:25.920 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.917+0000 7f37eb7fe640 1 --2- 10.20.193.49:0/3109919444 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f37bc0790b0 0x7f37bc07b570 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f37d8002770 tx=0x7f37d8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:09:25.921 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.917+0000 7f37c7fff640 10 client.4286.objecter ms_handle_connect 0x7f37bc0790b0 2026-02-17T11:09:25.921 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.918+0000 7f37c7fff640 1 -- 10.20.193.49:0/3109919444 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2565+0+0 (secure 0 0 0) 0x7f37e005ea90 con 0x7f37ec152220 2026-02-17T11:09:25.922 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.918+0000 7f37c7fff640 10 client.4286.objecter ms_dispatch2 0x7f37ec000b90 osd_map(18..18 src has 1..18) 2026-02-17T11:09:25.922 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.918+0000 7f37c7fff640 3 client.4286.objecter handle_osd_map got epochs [18,18] > 0 2026-02-17T11:09:25.922 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.918+0000 7f37c7fff640 3 client.4286.objecter handle_osd_map decoding full epoch 18 2026-02-17T11:09:25.922 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.918+0000 7f37c7fff640 20 client.4286.objecter dump_active .. 0 homeless 2026-02-17T11:09:25.929 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.927+0000 7f37c7fff640 1 -- 10.20.193.49:0/3109919444 <== mon.2 v2:10.20.193.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f37e0062a50 con 0x7f37ec152220 2026-02-17T11:09:25.929 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.927+0000 7f37c7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:09:25.929 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:25.927+0000 7f37c7fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:09:26.020 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:26.017+0000 7f37f1cf1640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:09:26.020 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:26.017+0000 7f37f1cf1640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:09:26.020 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:26.017+0000 7f37f1cf1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:09:26.020 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:26.017+0000 7f37f1cf1640 1 -- 10.20.193.49:0/3109919444 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f37ec155ae0 con 0x7f37ec152220 2026-02-17T11:09:26.031 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:26.029+0000 7f37c7fff640 1 -- 10.20.193.49:0/3109919444 <== mon.2 v2:10.20.193.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12879 (secure 0 0 0) 0x7f37e0066d50 con 0x7f37ec152220 2026-02-17T11:09:26.031 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:26.029+0000 7f37c7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:09:26.031 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:26.029+0000 7f37c7fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:09:26.031 INFO:teuthology.misc.health.trial049.stdout: 2026-02-17T11:09:26.031 INFO:teuthology.misc.health.trial049.stdout:{"epoch":18,"fsid":"2799a57b-9ea3-46ae-8e91-1fe004a3651d","created":"2026-02-17T11:08:37.595499+0000","modified":"2026-02-17T11:08:43.985163+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T11:08:43.985163+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"30bc819e-140a-433e-b860-eaa88e282a11","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2f7f1f11-f256-4094-82a9-5d21882e6e0e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"26bd1274-fe52-42cb-876b-df9920880f95","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c78a5263-3b0d-4b22-a848-bcd6a1e4f6b0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f0fdfadd-2f39-4ad8-ac88-cb588c5e8ee0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"65872639-d6c0-482d-95d1-1d9f250781c9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"43091d3e-638d-4462-867b-cade02a315e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"890ae4d6-33c9-4515-a896-a689647330dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"f04abc9b-ed75-4582-b47d-07a9890f52bb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"7dfbb00a-6b89-4de3-9f30-6aadd91b4408","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"e497a4fd-a944-489b-9cb3-30f5acaeb53e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"7371d50f-36f9-477d-8d4d-853f481dd6db","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"3cf4fded-49db-4d95-956b-77acc868a3ed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"7dc53473-594f-4cfb-8444-eab205e2e0f9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"e8ab3e8f-29a8-4c79-bf86-d29543aac56a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"300a4696-aa54-4b47-b9f3-87dec719bcfa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:09:26.034 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:26.031+0000 7f37f1cf1640 10 librados: watch_flush enter 2026-02-17T11:09:26.034 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:26.031+0000 7f37f1cf1640 10 librados: watch_flush exit 2026-02-17T11:09:26.034 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:26.031+0000 7f37f1cf1640 20 client.4286.objecter shutdown clearing up homeless session... 2026-02-17T11:09:26.034 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:26.031+0000 7f37f1cf1640 10 client.4286.objecter successfully canceled tick 2026-02-17T11:09:26.034 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:26.031+0000 7f37f1cf1640 1 -- 10.20.193.49:0/3109919444 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f37bc0790b0 msgr2=0x7f37bc07b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:09:26.034 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:26.031+0000 7f37f1cf1640 1 --2- 10.20.193.49:0/3109919444 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f37bc0790b0 0x7f37bc07b570 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f37d8002770 tx=0x7f37d8009040 comp rx=0 tx=0).stop 2026-02-17T11:09:26.034 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:26.031+0000 7f37f1cf1640 10 monclient: shutdown 2026-02-17T11:09:26.034 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:26.031+0000 7f37f1cf1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:09:26.034 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:26.031+0000 7f37f1cf1640 1 -- 10.20.193.49:0/3109919444 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f37ec152220 msgr2=0x7f37ec1f5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:09:26.034 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:26.031+0000 7f37f1cf1640 1 --2- 10.20.193.49:0/3109919444 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f37ec152220 0x7f37ec1f5d00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f37e0007d50 tx=0x7f37e000d490 comp rx=0 tx=0).stop 2026-02-17T11:09:26.034 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:26.031+0000 7f37f1cf1640 1 -- 10.20.193.49:0/3109919444 shutdown_connections 2026-02-17T11:09:26.034 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:26.031+0000 7f37f1cf1640 1 --2- 10.20.193.49:0/3109919444 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f37bc0790b0 0x7f37bc07b570 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:26.034 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:26.031+0000 7f37f1cf1640 1 --2- 10.20.193.49:0/3109919444 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f37ec152220 0x7f37ec1f5d00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:26.034 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:26.031+0000 7f37f1cf1640 1 --2- 10.20.193.49:0/3109919444 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f37ec0c8d30 0x7f37ec1550a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:26.034 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:26.031+0000 7f37f1cf1640 1 --2- 10.20.193.49:0/3109919444 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f37ec0c8950 0x7f37ec14d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:26.034 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:26.031+0000 7f37f1cf1640 1 -- 10.20.193.49:0/3109919444 >> 10.20.193.49:0/3109919444 conn(0x7f37ec0c9f30 msgr2=0x7f37ec0ca310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:09:26.034 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:26.031+0000 7f37f1cf1640 1 -- 10.20.193.49:0/3109919444 shutdown_connections 2026-02-17T11:09:26.034 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:26.031+0000 7f37f1cf1640 1 -- 10.20.193.49:0/3109919444 wait complete. 2026-02-17T11:09:26.034 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:26.031+0000 7f37f1cf1640 1 librados: shutdown 2026-02-17T11:09:26.041 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-17T11:09:31.557 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:01:17.038 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:09:31.587 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:01:17.068 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:09:31.609 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:01:17.085 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:09:31.609 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:01:17.051 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:09:31.642 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:01:17.118 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:09:31.643 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:01:17.084 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:09:31.701 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:01:17.183 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:09:31.760 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:01:17.236 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:09:31.761 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:01:17.202 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:09:33.653 DEBUG:teuthology.orchestra.run.trial049:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T11:09:33.713 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.712+0000 7f527c840640 10 monclient: get_monmap_and_config 2026-02-17T11:09:33.714 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.712+0000 7f527c840640 10 monclient: build_initial_monmap 2026-02-17T11:09:33.714 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.712+0000 7f527c840640 10 monclient: monmap: 2026-02-17T11:09:33.714 INFO:teuthology.misc.health.trial049.stderr:epoch 0 2026-02-17T11:09:33.714 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:09:33.714 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:09:33.712685+0000 2026-02-17T11:09:33.714 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:09:33.712685+0000 2026-02-17T11:09:33.714 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:09:33.714 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:09:33.715 INFO:teuthology.misc.health.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:09:33.715 INFO:teuthology.misc.health.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:09:33.715 INFO:teuthology.misc.health.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:09:33.715 INFO:teuthology.misc.health.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:09:33.715 INFO:teuthology.misc.health.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:09:33.715 INFO:teuthology.misc.health.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:09:33.715 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:09:33.715 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.712+0000 7f527c840640 1 Processor -- start 2026-02-17T11:09:33.715 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.712+0000 7f527c840640 1 -- start start 2026-02-17T11:09:33.715 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.712+0000 7f527c840640 10 monclient: init 2026-02-17T11:09:33.717 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.713+0000 7f527c840640 10 monclient: _reopen_session rank -1 2026-02-17T11:09:33.718 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.713+0000 7f527c840640 10 monclient: _add_conns ranks=[5,1,2,4,0,3] 2026-02-17T11:09:33.718 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.713+0000 7f527c840640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f52741504c0 0x7f52740c52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:09:33.718 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.713+0000 7f527c840640 10 monclient(hunting): picked mon.noname-c con 0x7f52741504c0 addr v2:10.20.193.157:3300/0 2026-02-17T11:09:33.718 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.713+0000 7f527c840640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f52740c7120 addr v1:10.20.193.97:6789/0 2026-02-17T11:09:33.718 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.713+0000 7f527c840640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f52740c7550 addr v1:10.20.193.157:6789/0 2026-02-17T11:09:33.718 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.713+0000 7f527c840640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52740c7930 con 0x7f52740c7120 2026-02-17T11:09:33.718 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.713+0000 7f527c840640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f527415def0 con 0x7f52740c7550 2026-02-17T11:09:33.718 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.713+0000 7f527c840640 10 monclient(hunting): start opening mon connection 2026-02-17T11:09:33.718 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.713+0000 7f527c840640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f52740c5c70 con 0x7f52741504c0 2026-02-17T11:09:33.718 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.713+0000 7f527c840640 10 monclient(hunting): _renew_subs 2026-02-17T11:09:33.718 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.713+0000 7f527c840640 10 monclient(hunting): authenticate will time out at 1050.376238s 2026-02-17T11:09:33.719 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.713+0000 7f5279db4640 1 --1- >> v1:10.20.193.97:6789/0 conn(0x7f52740c7120 0x7f52740c9050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.97:6789/0 says I am v1:10.20.193.49:54730/0 (socket says 10.20.193.49:54730) 2026-02-17T11:09:33.719 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.713+0000 7f5279db4640 1 -- 10.20.193.49:0/244545804 learned_addr learned my addr 10.20.193.49:0/244545804 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:09:33.719 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.714+0000 7f527a5b5640 1 --2- 10.20.193.49:0/244545804 >> v2:10.20.193.157:3300/0 conn(0x7f52741504c0 0x7f52740c52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:09:33.719 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.714+0000 7f527a5b5640 10 monclient(hunting): get_auth_request con 0x7f52741504c0 auth_method 0 2026-02-17T11:09:33.719 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.714+0000 7f527a5b5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:09:33.719 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.714+0000 7f527a5b5640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:09:33.719 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.714+0000 7f527a5b5640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:09:33.719 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.715+0000 7f527a5b5640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:09:33.719 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.715+0000 7f527a5b5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:09:33.719 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.715+0000 7f527a5b5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:09:33.719 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.715+0000 7f52795b3640 1 -- 10.20.193.49:0/244545804 <== mon.1 v1:10.20.193.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1416043717 0 0) 0x7f52740c7930 con 0x7f52740c7120 2026-02-17T11:09:33.719 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.715+0000 7f52795b3640 10 monclient(hunting): _negotiate 2026-02-17T11:09:33.720 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.715+0000 7f52795b3640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:09:33.720 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.715+0000 7f52795b3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:09:33.720 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.715+0000 7f52795b3640 10 monclient(hunting): my global_id is 4285 2026-02-17T11:09:33.720 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.715+0000 7f52795b3640 1 -- 10.20.193.49:0/244545804 --> v1:10.20.193.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5264003620 con 0x7f52740c7120 2026-02-17T11:09:33.723 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.717+0000 7f52795b3640 1 -- 10.20.193.49:0/244545804 <== mon.1 v1:10.20.193.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 826834991 0 0) 0x7f5264003620 con 0x7f52740c7120 2026-02-17T11:09:33.724 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.717+0000 7f52795b3640 1 -- 10.20.193.49:0/244545804 >> v2:10.20.193.157:3300/0 conn(0x7f52741504c0 msgr2=0x7f52740c52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:09:33.724 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.717+0000 7f52795b3640 1 --2- 10.20.193.49:0/244545804 >> v2:10.20.193.157:3300/0 conn(0x7f52741504c0 0x7f52740c52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:33.724 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.717+0000 7f52795b3640 1 -- 10.20.193.49:0/244545804 >> v1:10.20.193.157:6789/0 conn(0x7f52740c7550 legacy=0x7f527415d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:09:33.724 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.717+0000 7f52795b3640 10 monclient: _finish_hunting 0 2026-02-17T11:09:33.724 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.717+0000 7f52795b3640 1 monclient: found mon.noname-b-legacy 2026-02-17T11:09:33.724 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.717+0000 7f52795b3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:09:33.724 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.717+0000 7f52795b3640 10 monclient: _send_mon_message to mon.noname-b-legacy at v1:10.20.193.97:6789/0 2026-02-17T11:09:33.724 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.717+0000 7f52795b3640 1 -- 10.20.193.49:0/244545804 --> v1:10.20.193.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52740c7fb0 con 0x7f52740c7120 2026-02-17T11:09:33.724 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.717+0000 7f52795b3640 10 monclient: _finish_auth 0 2026-02-17T11:09:33.724 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.717+0000 7f52795b3640 10 monclient: _check_auth_tickets 2026-02-17T11:09:33.724 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.717+0000 7f52795b3640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:09:33.725 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.717+0000 7f52795b3640 1 -- 10.20.193.49:0/244545804 <== mon.1 v1:10.20.193.97:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2462710995 0 0) 0x7f5260002f00 con 0x7f52740c7120 2026-02-17T11:09:33.725 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.717+0000 7f52795b3640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:09:33.725 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.717+0000 7f52795b3640 10 monclient: got monmap 1 from mon.noname-b-legacy (according to old e1) 2026-02-17T11:09:33.725 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.717+0000 7f52795b3640 10 monclient: dump: 2026-02-17T11:09:33.725 INFO:teuthology.misc.health.trial049.stderr:epoch 1 2026-02-17T11:09:33.725 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:09:33.725 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:33.725 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:33.725 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:09:33.725 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:09:33.725 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:09:33.725 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:09:33.726 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:09:33.726 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:09:33.726 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.717+0000 7f52795b3640 1 monclient: mon.b has (v2) addrs [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] but i'm connected to v1:10.20.193.97:6789/0, reconnecting 2026-02-17T11:09:33.726 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.717+0000 7f52795b3640 10 monclient: _reopen_session rank -1 2026-02-17T11:09:33.726 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.717+0000 7f52795b3640 1 -- 10.20.193.49:0/244545804 >> v1:10.20.193.97:6789/0 conn(0x7f52740c7120 legacy=0x7f52740c9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:09:33.726 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.717+0000 7f52795b3640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:09:33.726 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.717+0000 7f52795b3640 1 --2- 10.20.193.49:0/244545804 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5264003ba0 0x7f5264003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:09:33.726 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.717+0000 7f52795b3640 10 monclient(hunting): picked mon.c con 0x7f5264003ba0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:09:33.726 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.717+0000 7f52795b3640 1 --2- 10.20.193.49:0/244545804 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5264004900 0x7f5264004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:09:33.726 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.717+0000 7f52795b3640 10 monclient(hunting): picked mon.a con 0x7f5264004900 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:09:33.726 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.717+0000 7f52795b3640 1 --2- 10.20.193.49:0/244545804 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5264005310 0x7f526400bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:09:33.726 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.717+0000 7f52795b3640 10 monclient(hunting): picked mon.b con 0x7f5264005310 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:09:33.727 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.717+0000 7f52795b3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:09:33.727 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.717+0000 7f52795b3640 1 -- 10.20.193.49:0/244545804 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f52740c5c70 con 0x7f5264004900 2026-02-17T11:09:33.727 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.717+0000 7f52795b3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:09:33.727 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.717+0000 7f52795b3640 1 -- 10.20.193.49:0/244545804 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f526400c250 con 0x7f5264005310 2026-02-17T11:09:33.727 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.717+0000 7f52795b3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:09:33.727 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.717+0000 7f52795b3640 1 -- 10.20.193.49:0/244545804 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f526400c450 con 0x7f5264003ba0 2026-02-17T11:09:33.727 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.717+0000 7f52795b3640 10 monclient(hunting): _renew_subs 2026-02-17T11:09:33.727 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.717+0000 7f52795b3640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:09:33.727 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.717+0000 7f5279db4640 1 --2- 10.20.193.49:0/244545804 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5264004900 0x7f5264004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:09:33.727 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.718+0000 7f5279db4640 10 monclient(hunting): get_auth_request con 0x7f5264004900 auth_method 0 2026-02-17T11:09:33.727 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.718+0000 7f5279db4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:09:33.727 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.718+0000 7f5279db4640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:09:33.728 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.718+0000 7f5279db4640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:09:33.728 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.718+0000 7f5279db4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:09:33.728 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.718+0000 7f5279db4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:09:33.728 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.718+0000 7f5279db4640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:09:33.728 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.718+0000 7f527adb6640 1 --2- 10.20.193.49:0/244545804 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5264005310 0x7f526400bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:09:33.728 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.718+0000 7f527adb6640 10 monclient(hunting): get_auth_request con 0x7f5264005310 auth_method 0 2026-02-17T11:09:33.728 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.718+0000 7f527adb6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:09:33.728 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.718+0000 7f527adb6640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:09:33.728 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.718+0000 7f527adb6640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:09:33.728 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.719+0000 7f527adb6640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:09:33.728 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.719+0000 7f527adb6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:09:33.728 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.719+0000 7f527adb6640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:09:33.728 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.719+0000 7f5279db4640 10 monclient(hunting): handle_auth_done global_id 4285 payload 293 2026-02-17T11:09:33.729 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.719+0000 7f5279db4640 1 -- 10.20.193.49:0/244545804 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5264003ba0 msgr2=0x7f5264003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:09:33.729 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.719+0000 7f5279db4640 1 --2- 10.20.193.49:0/244545804 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5264003ba0 0x7f5264003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:33.729 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.719+0000 7f5279db4640 1 -- 10.20.193.49:0/244545804 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5264005310 msgr2=0x7f526400bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:09:33.729 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.719+0000 7f5279db4640 1 --2- 10.20.193.49:0/244545804 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5264005310 0x7f526400bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:33.729 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.719+0000 7f5279db4640 10 monclient: _finish_hunting 0 2026-02-17T11:09:33.729 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.719+0000 7f5279db4640 1 monclient: found mon.a 2026-02-17T11:09:33.729 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.719+0000 7f5279db4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:09:33.729 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.719+0000 7f5279db4640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:09:33.729 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.719+0000 7f527adb6640 1 -- 10.20.193.49:0/244545804 reap_dead start 2026-02-17T11:09:33.729 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.719+0000 7f5279db4640 1 -- 10.20.193.49:0/244545804 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5264003620 con 0x7f5264004900 2026-02-17T11:09:33.729 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.719+0000 7f5279db4640 10 monclient: _finish_auth 0 2026-02-17T11:09:33.729 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.719+0000 7f5279db4640 10 monclient: _check_auth_tickets 2026-02-17T11:09:33.730 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.719+0000 7f5279db4640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:09:33.730 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.719+0000 7f527c840640 5 monclient: authenticate success, global_id 4285 2026-02-17T11:09:33.730 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.719+0000 7f527c840640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:09:33.730 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.720+0000 7f5279db4640 1 --2- 10.20.193.49:0/244545804 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5264004900 0x7f5264004d80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f52600036c0 tx=0x7f526002f6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c786e90db658e5d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:09:33.730 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.722+0000 7f52795b3640 1 -- 10.20.193.49:0/244545804 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f526000c0e0 con 0x7f5264004900 2026-02-17T11:09:33.730 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.722+0000 7f52795b3640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:09:33.730 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.722+0000 7f52795b3640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:09:33.730 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.722+0000 7f52795b3640 10 monclient: dump: 2026-02-17T11:09:33.730 INFO:teuthology.misc.health.trial049.stderr:epoch 1 2026-02-17T11:09:33.730 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:09:33.730 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:33.730 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:33.730 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:09:33.731 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:09:33.731 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:09:33.731 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:09:33.731 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:09:33.731 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:09:33.731 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.722+0000 7f527c840640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:09:33.737 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.722+0000 7f52795b3640 1 -- 10.20.193.49:0/244545804 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5260005bf0 con 0x7f5264004900 2026-02-17T11:09:33.737 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.722+0000 7f52795b3640 10 monclient: handle_config config(0 keys) 2026-02-17T11:09:33.737 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.722+0000 7f52795b3640 1 -- 10.20.193.49:0/244545804 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5260007070 con 0x7f5264004900 2026-02-17T11:09:33.737 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.722+0000 7f52795b3640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:09:33.737 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.722+0000 7f52795b3640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:09:33.737 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.722+0000 7f52795b3640 10 monclient: dump: 2026-02-17T11:09:33.738 INFO:teuthology.misc.health.trial049.stderr:epoch 1 2026-02-17T11:09:33.738 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:09:33.738 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:33.738 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:33.738 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:09:33.738 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:09:33.738 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:09:33.738 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:09:33.738 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:09:33.738 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:09:33.738 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.722+0000 7f527c840640 10 monclient: get_monmap_and_config success 2026-02-17T11:09:33.739 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.722+0000 7f527c840640 4 set_mon_vals no callback set 2026-02-17T11:09:33.739 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.723+0000 7f527c840640 10 monclient: shutdown 2026-02-17T11:09:33.739 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.723+0000 7f527c840640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:09:33.739 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.723+0000 7f527c840640 1 -- 10.20.193.49:0/244545804 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5264004900 msgr2=0x7f5264004d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:09:33.739 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.723+0000 7f527c840640 1 --2- 10.20.193.49:0/244545804 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5264004900 0x7f5264004d80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f52600036c0 tx=0x7f526002f6a0 comp rx=0 tx=0).stop 2026-02-17T11:09:33.739 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.723+0000 7f527c840640 1 -- 10.20.193.49:0/244545804 shutdown_connections 2026-02-17T11:09:33.739 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.723+0000 7f527c840640 1 --2- 10.20.193.49:0/244545804 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5264004900 0x7f5264004d80 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:33.739 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.723+0000 7f527c840640 1 -- 10.20.193.49:0/244545804 >> 10.20.193.49:0/244545804 conn(0x7f52740c9f30 msgr2=0x7f52740ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:09:33.739 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.723+0000 7f527c840640 1 -- 10.20.193.49:0/244545804 shutdown_connections 2026-02-17T11:09:33.739 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.723+0000 7f527c840640 1 -- 10.20.193.49:0/244545804 wait complete. 2026-02-17T11:09:33.739 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.723+0000 7f527c840640 10 monclient: build_initial_monmap 2026-02-17T11:09:33.739 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.723+0000 7f527c840640 10 monclient: monmap: 2026-02-17T11:09:33.740 INFO:teuthology.misc.health.trial049.stderr:epoch 0 2026-02-17T11:09:33.740 INFO:teuthology.misc.health.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:09:33.740 INFO:teuthology.misc.health.trial049.stderr:last_changed 0.000000 2026-02-17T11:09:33.740 INFO:teuthology.misc.health.trial049.stderr:created 0.000000 2026-02-17T11:09:33.740 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:09:33.740 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:09:33.740 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:09:33.740 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:09:33.740 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:09:33.740 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:09:33.740 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.723+0000 7f527c840640 1 librados: starting msgr at 2026-02-17T11:09:33.740 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.723+0000 7f527c840640 1 librados: starting objecter 2026-02-17T11:09:33.741 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.723+0000 7f527c840640 1 Processor -- start 2026-02-17T11:09:33.741 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.723+0000 7f527c840640 1 -- start start 2026-02-17T11:09:33.741 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.723+0000 7f527c840640 1 librados: setting wanted keys 2026-02-17T11:09:33.741 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.723+0000 7f527c840640 1 librados: calling monclient init 2026-02-17T11:09:33.741 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.723+0000 7f527c840640 10 monclient: init 2026-02-17T11:09:33.741 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.724+0000 7f527c840640 10 monclient: _reopen_session rank -1 2026-02-17T11:09:33.741 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.724+0000 7f527c840640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:09:33.741 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.724+0000 7f527c840640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5264004900 0x7f5274140cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:09:33.741 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.724+0000 7f527c840640 10 monclient(hunting): picked mon.noname-b con 0x7f5264004900 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:09:33.741 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.724+0000 7f527c840640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f52741f3100 0x7f52741f3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:09:33.741 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.724+0000 7f527c840640 10 monclient(hunting): picked mon.noname-a con 0x7f52741f3100 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:09:33.741 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.724+0000 7f527c840640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5274149e30 0x7f527414a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:09:33.742 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.724+0000 7f527c840640 10 monclient(hunting): picked mon.noname-c con 0x7f5274149e30 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:09:33.742 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.724+0000 7f527c840640 10 monclient(hunting): start opening mon connection 2026-02-17T11:09:33.742 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.724+0000 7f527c840640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f52740c8850 con 0x7f52741f3100 2026-02-17T11:09:33.742 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.724+0000 7f527c840640 10 monclient(hunting): start opening mon connection 2026-02-17T11:09:33.742 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.724+0000 7f527c840640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f52740c8570 con 0x7f5264004900 2026-02-17T11:09:33.742 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.724+0000 7f527c840640 10 monclient(hunting): start opening mon connection 2026-02-17T11:09:33.742 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.724+0000 7f527c840640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f52740c8b30 con 0x7f5274149e30 2026-02-17T11:09:33.742 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.724+0000 7f527c840640 10 monclient(hunting): _renew_subs 2026-02-17T11:09:33.742 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.724+0000 7f527c840640 10 monclient(hunting): authenticate will time out at 1050.387414s 2026-02-17T11:09:33.742 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.724+0000 7f5279db4640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f52741f3100 0x7f52741f3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:09:33.742 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.724+0000 7f527a5b5640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5264004900 0x7f5274140cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:09:33.742 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.724+0000 7f527adb6640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5274149e30 0x7f527414a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:09:33.743 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.724+0000 7f5279db4640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f52741f3100 0x7f52741f3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:48296/0 (socket says 10.20.193.49:48296) 2026-02-17T11:09:33.743 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.724+0000 7f5279db4640 1 -- 10.20.193.49:0/477633753 learned_addr learned my addr 10.20.193.49:0/477633753 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:09:33.743 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.724+0000 7f5279db4640 10 monclient(hunting): get_auth_request con 0x7f52741f3100 auth_method 0 2026-02-17T11:09:33.743 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.724+0000 7f5279db4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:09:33.743 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.724+0000 7f5279db4640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:09:33.743 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.724+0000 7f5279db4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:09:33.743 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.724+0000 7f527adb6640 10 monclient(hunting): get_auth_request con 0x7f5274149e30 auth_method 0 2026-02-17T11:09:33.743 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.724+0000 7f527adb6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:09:33.743 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.724+0000 7f527adb6640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:09:33.743 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.724+0000 7f527adb6640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:09:33.743 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.724+0000 7f527a5b5640 10 monclient(hunting): get_auth_request con 0x7f5264004900 auth_method 0 2026-02-17T11:09:33.743 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.724+0000 7f527a5b5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:09:33.743 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.724+0000 7f527a5b5640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:09:33.744 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.724+0000 7f527a5b5640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:09:33.744 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.725+0000 7f5279db4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:09:33.744 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.725+0000 7f5279db4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:09:33.744 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.725+0000 7f5279db4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:09:33.744 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.725+0000 7f527adb6640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:09:33.744 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.725+0000 7f527adb6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:09:33.744 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.725+0000 7f527adb6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:09:33.744 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.725+0000 7f527a5b5640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:09:33.744 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.725+0000 7f527a5b5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:09:33.744 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.725+0000 7f527a5b5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:09:33.744 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.726+0000 7f5279db4640 10 monclient(hunting): handle_auth_done global_id 4275 payload 824 2026-02-17T11:09:33.744 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.726+0000 7f5279db4640 1 -- 10.20.193.49:0/477633753 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5274149e30 msgr2=0x7f527414a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:09:33.745 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.726+0000 7f5279db4640 1 --2- 10.20.193.49:0/477633753 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5274149e30 0x7f527414a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:33.745 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.726+0000 7f5279db4640 1 -- 10.20.193.49:0/477633753 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5264004900 msgr2=0x7f5274140cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:09:33.745 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.726+0000 7f5279db4640 1 --2- 10.20.193.49:0/477633753 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5264004900 0x7f5274140cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:33.745 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.726+0000 7f5279db4640 10 monclient: _finish_hunting 0 2026-02-17T11:09:33.745 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.726+0000 7f5279db4640 1 monclient: found mon.noname-a 2026-02-17T11:09:33.745 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.726+0000 7f5279db4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:09:33.745 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.726+0000 7f5279db4640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:09:33.745 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.726+0000 7f5279db4640 1 -- 10.20.193.49:0/477633753 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52741f3ac0 con 0x7f52741f3100 2026-02-17T11:09:33.745 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.726+0000 7f527a5b5640 1 --2- 10.20.193.49:0/477633753 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5264004900 0x7f5274140cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:09:33.745 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.727+0000 7f5279db4640 1 --2- 10.20.193.49:0/477633753 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f52741f3100 0x7f52741f3580 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f52600036e0 tx=0x7f5260003200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:09:33.745 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.727+0000 7f525effd640 10 client.?.objecter ms_handle_connect 0x7f52741f3100 2026-02-17T11:09:33.745 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.727+0000 7f525effd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:09:33.746 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.729+0000 7f525effd640 1 -- 10.20.193.49:0/477633753 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5260007270 con 0x7f52741f3100 2026-02-17T11:09:33.746 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.729+0000 7f525effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:09:33.746 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.729+0000 7f525effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:09:33.746 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.729+0000 7f525effd640 10 monclient: dump: 2026-02-17T11:09:33.746 INFO:teuthology.misc.health.trial049.stderr:epoch 1 2026-02-17T11:09:33.746 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:09:33.746 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:33.746 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:33.746 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:09:33.746 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:09:33.746 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:09:33.747 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:09:33.747 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:09:33.747 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:09:33.747 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.729+0000 7f525effd640 10 monclient: _finish_auth 0 2026-02-17T11:09:33.747 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.729+0000 7f525effd640 10 monclient: _check_auth_tickets 2026-02-17T11:09:33.747 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.729+0000 7f525effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:09:33.747 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.729+0000 7f525effd640 1 -- 10.20.193.49:0/477633753 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5260007410 con 0x7f52741f3100 2026-02-17T11:09:33.747 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.729+0000 7f525effd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:09:33.747 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.729+0000 7f525effd640 1 -- 10.20.193.49:0/477633753 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52600077e0 con 0x7f52741f3100 2026-02-17T11:09:33.747 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.729+0000 7f525effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:09:33.748 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.729+0000 7f525effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:09:33.748 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.729+0000 7f5278db2640 4 set_mon_vals no callback set 2026-02-17T11:09:33.748 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.729+0000 7f525effd640 10 monclient: dump: 2026-02-17T11:09:33.748 INFO:teuthology.misc.health.trial049.stderr:epoch 1 2026-02-17T11:09:33.748 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:09:33.748 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:33.748 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:33.748 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:09:33.748 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:09:33.748 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:09:33.748 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:09:33.748 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:09:33.749 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:09:33.749 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.729+0000 7f527c840640 5 monclient: authenticate success, global_id 4275 2026-02-17T11:09:33.749 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.729+0000 7f527c840640 10 monclient: _renew_subs 2026-02-17T11:09:33.749 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.729+0000 7f527c840640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:09:33.749 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.729+0000 7f527c840640 1 -- 10.20.193.49:0/477633753 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52741f25f0 con 0x7f52741f3100 2026-02-17T11:09:33.749 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.729+0000 7f527c840640 10 client.4275.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:09:33.749 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.729+0000 7f527c840640 10 monclient: _renew_subs 2026-02-17T11:09:33.749 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.729+0000 7f527c840640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:09:33.749 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.729+0000 7f527c840640 1 -- 10.20.193.49:0/477633753 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52741f1a70 con 0x7f52741f3100 2026-02-17T11:09:33.749 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.729+0000 7f527c840640 1 librados: init done 2026-02-17T11:09:33.749 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.730+0000 7f527c840640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:09:33.749 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.730+0000 7f527c840640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:09:33.750 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.730+0000 7f527c840640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:09:33.750 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.730+0000 7f527c840640 1 -- 10.20.193.49:0/477633753 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52741508a0 con 0x7f52741f3100 2026-02-17T11:09:33.751 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.743+0000 7f525effd640 1 -- 10.20.193.49:0/477633753 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 4) ==== 100001+0+0 (secure 0 0 0) 0x7f5260037430 con 0x7f52741f3100 2026-02-17T11:09:33.751 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.743+0000 7f525effd640 1 --2- 10.20.193.49:0/477633753 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5244079100 0x7f524407b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:09:33.751 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.744+0000 7f527a5b5640 1 --2- 10.20.193.49:0/477633753 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5244079100 0x7f524407b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:09:33.751 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.744+0000 7f527a5b5640 10 monclient: get_auth_request con 0x7f5244079100 auth_method 0 2026-02-17T11:09:33.751 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.744+0000 7f525effd640 10 client.4275.objecter ms_handle_connect 0x7f5244079100 2026-02-17T11:09:33.751 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.744+0000 7f527a5b5640 1 --2- 10.20.193.49:0/477633753 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5244079100 0x7f524407b5c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f526c0113d0 tx=0x7f526c0095a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:09:33.752 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.747+0000 7f525effd640 1 -- 10.20.193.49:0/477633753 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2565+0+0 (secure 0 0 0) 0x7f5260083420 con 0x7f52741f3100 2026-02-17T11:09:33.752 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.747+0000 7f525effd640 10 client.4275.objecter ms_dispatch2 0x7f5274000b90 osd_map(18..18 src has 1..18) 2026-02-17T11:09:33.752 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.747+0000 7f525effd640 3 client.4275.objecter handle_osd_map got epochs [18,18] > 0 2026-02-17T11:09:33.752 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.747+0000 7f525effd640 3 client.4275.objecter handle_osd_map decoding full epoch 18 2026-02-17T11:09:33.752 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.747+0000 7f525effd640 20 client.4275.objecter dump_active .. 0 homeless 2026-02-17T11:09:33.853 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.852+0000 7f525effd640 1 -- 10.20.193.49:0/477633753 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f52741f3ac0 con 0x7f52741f3100 2026-02-17T11:09:33.853 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.852+0000 7f525effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:09:33.854 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.852+0000 7f525effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:09:33.944 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.942+0000 7f527c840640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:09:33.945 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.942+0000 7f527c840640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:09:33.945 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.942+0000 7f527c840640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:09:33.945 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.942+0000 7f527c840640 1 -- 10.20.193.49:0/477633753 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f52740c8d70 con 0x7f52741f3100 2026-02-17T11:09:33.977 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.975+0000 7f525effd640 1 -- 10.20.193.49:0/477633753 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12879 (secure 0 0 0) 0x7f5260087ae0 con 0x7f52741f3100 2026-02-17T11:09:33.977 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.975+0000 7f525effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:09:33.977 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.975+0000 7f525effd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:09:33.977 INFO:teuthology.misc.health.trial049.stdout: 2026-02-17T11:09:33.978 INFO:teuthology.misc.health.trial049.stdout:{"epoch":18,"fsid":"2799a57b-9ea3-46ae-8e91-1fe004a3651d","created":"2026-02-17T11:08:37.595499+0000","modified":"2026-02-17T11:08:43.985163+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T11:08:43.985163+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"30bc819e-140a-433e-b860-eaa88e282a11","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2f7f1f11-f256-4094-82a9-5d21882e6e0e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"26bd1274-fe52-42cb-876b-df9920880f95","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c78a5263-3b0d-4b22-a848-bcd6a1e4f6b0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f0fdfadd-2f39-4ad8-ac88-cb588c5e8ee0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"65872639-d6c0-482d-95d1-1d9f250781c9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"43091d3e-638d-4462-867b-cade02a315e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"890ae4d6-33c9-4515-a896-a689647330dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"f04abc9b-ed75-4582-b47d-07a9890f52bb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"7dfbb00a-6b89-4de3-9f30-6aadd91b4408","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"e497a4fd-a944-489b-9cb3-30f5acaeb53e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"7371d50f-36f9-477d-8d4d-853f481dd6db","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"3cf4fded-49db-4d95-956b-77acc868a3ed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"7dc53473-594f-4cfb-8444-eab205e2e0f9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"e8ab3e8f-29a8-4c79-bf86-d29543aac56a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"300a4696-aa54-4b47-b9f3-87dec719bcfa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:09:33.980 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.978+0000 7f527c840640 10 librados: watch_flush enter 2026-02-17T11:09:33.980 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.978+0000 7f527c840640 10 librados: watch_flush exit 2026-02-17T11:09:33.980 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.978+0000 7f527c840640 20 client.4275.objecter shutdown clearing up homeless session... 2026-02-17T11:09:33.980 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.978+0000 7f527c840640 10 client.4275.objecter successfully canceled tick 2026-02-17T11:09:33.980 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.978+0000 7f527c840640 1 -- 10.20.193.49:0/477633753 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5244079100 msgr2=0x7f524407b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:09:33.980 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.978+0000 7f527c840640 1 --2- 10.20.193.49:0/477633753 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5244079100 0x7f524407b5c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f526c0113d0 tx=0x7f526c0095a0 comp rx=0 tx=0).stop 2026-02-17T11:09:33.980 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.978+0000 7f527c840640 10 monclient: shutdown 2026-02-17T11:09:33.980 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.978+0000 7f527c840640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:09:33.981 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.978+0000 7f527c840640 1 -- 10.20.193.49:0/477633753 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f52741f3100 msgr2=0x7f52741f3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:09:33.981 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.978+0000 7f527c840640 1 --2- 10.20.193.49:0/477633753 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f52741f3100 0x7f52741f3580 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f52600036e0 tx=0x7f5260003200 comp rx=0 tx=0).stop 2026-02-17T11:09:33.981 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.978+0000 7f527c840640 1 -- 10.20.193.49:0/477633753 shutdown_connections 2026-02-17T11:09:33.981 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.978+0000 7f527c840640 1 --2- 10.20.193.49:0/477633753 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5244079100 0x7f524407b5c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:33.981 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.978+0000 7f527c840640 1 --2- 10.20.193.49:0/477633753 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5274149e30 0x7f527414a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:33.981 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.978+0000 7f527c840640 1 --2- 10.20.193.49:0/477633753 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f52741f3100 0x7f52741f3580 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:33.981 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.978+0000 7f527c840640 1 --2- 10.20.193.49:0/477633753 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5264004900 0x7f5274140cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:33.981 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.978+0000 7f527c840640 1 -- 10.20.193.49:0/477633753 >> 10.20.193.49:0/477633753 conn(0x7f52740c9f30 msgr2=0x7f52740c9710 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:09:33.981 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.978+0000 7f527c840640 1 -- 10.20.193.49:0/477633753 shutdown_connections 2026-02-17T11:09:33.981 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.978+0000 7f527c840640 1 -- 10.20.193.49:0/477633753 wait complete. 2026-02-17T11:09:33.981 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:33.978+0000 7f527c840640 1 librados: shutdown 2026-02-17T11:09:33.987 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-17T11:09:41.600 DEBUG:teuthology.orchestra.run.trial049:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T11:09:41.658 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.657+0000 7fec03f9e640 10 monclient: get_monmap_and_config 2026-02-17T11:09:41.658 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.657+0000 7fec03f9e640 10 monclient: build_initial_monmap 2026-02-17T11:09:41.658 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.657+0000 7fec03f9e640 10 monclient: monmap: 2026-02-17T11:09:41.658 INFO:teuthology.misc.health.trial049.stderr:epoch 0 2026-02-17T11:09:41.658 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:09:41.659 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:09:41.657819+0000 2026-02-17T11:09:41.659 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:09:41.657819+0000 2026-02-17T11:09:41.659 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:09:41.659 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:09:41.659 INFO:teuthology.misc.health.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:09:41.659 INFO:teuthology.misc.health.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:09:41.659 INFO:teuthology.misc.health.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:09:41.659 INFO:teuthology.misc.health.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:09:41.659 INFO:teuthology.misc.health.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:09:41.659 INFO:teuthology.misc.health.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:09:41.659 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:09:41.660 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.657+0000 7fec03f9e640 1 Processor -- start 2026-02-17T11:09:41.660 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.657+0000 7fec03f9e640 1 -- start start 2026-02-17T11:09:41.660 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.657+0000 7fec03f9e640 10 monclient: init 2026-02-17T11:09:41.660 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.658+0000 7fec03f9e640 10 monclient: _reopen_session rank -1 2026-02-17T11:09:41.660 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.658+0000 7fec03f9e640 10 monclient: _add_conns ranks=[5,1,2,0,3,4] 2026-02-17T11:09:41.660 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.658+0000 7fec03f9e640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7febfc15c2c0 0x7febfc15c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:09:41.660 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.658+0000 7fec03f9e640 10 monclient(hunting): picked mon.noname-c con 0x7febfc15c2c0 addr v2:10.20.193.157:3300/0 2026-02-17T11:09:41.660 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.658+0000 7fec03f9e640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7febfc0c6aa0 addr v1:10.20.193.97:6789/0 2026-02-17T11:09:41.660 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.658+0000 7fec03f9e640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7febfc0c7e30 addr v1:10.20.193.157:6789/0 2026-02-17T11:09:41.660 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.658+0000 7fec03f9e640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febfc06d5c0 con 0x7febfc0c6aa0 2026-02-17T11:09:41.660 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.658+0000 7fec03f9e640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febfc0c6fb0 con 0x7febfc0c7e30 2026-02-17T11:09:41.660 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.658+0000 7fec03f9e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:09:41.660 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.658+0000 7fec03f9e640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7febfc0c7290 con 0x7febfc15c2c0 2026-02-17T11:09:41.660 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.658+0000 7fec03f9e640 10 monclient(hunting): _renew_subs 2026-02-17T11:09:41.660 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.658+0000 7fec03f9e640 10 monclient(hunting): authenticate will time out at 1058.321276s 2026-02-17T11:09:41.660 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.658+0000 7fec01d13640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7febfc15c2c0 0x7febfc15c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:09:41.660 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.658+0000 7fec02514640 1 --1- >> v1:10.20.193.157:6789/0 conn(0x7febfc0c7e30 0x7febfc06dd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.157:6789/0 says I am v1:10.20.193.49:32884/0 (socket says 10.20.193.49:32884) 2026-02-17T11:09:41.660 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.658+0000 7fec02514640 1 -- 10.20.193.49:0/981158811 learned_addr learned my addr 10.20.193.49:0/981158811 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:09:41.661 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.659+0000 7fec01d13640 10 monclient(hunting): get_auth_request con 0x7febfc15c2c0 auth_method 0 2026-02-17T11:09:41.661 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.659+0000 7fec01d13640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:09:41.661 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.659+0000 7fec01d13640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:09:41.661 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.659+0000 7fec01d13640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:09:41.661 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.659+0000 7fec01d13640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:09:41.661 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.659+0000 7fec01d13640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:09:41.661 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.659+0000 7fec01d13640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:09:41.661 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.660+0000 7fec00d11640 1 -- 10.20.193.49:0/981158811 <== mon.1 v1:10.20.193.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 450713305 0 0) 0x7febfc06d5c0 con 0x7febfc0c6aa0 2026-02-17T11:09:41.661 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.660+0000 7fec00d11640 10 monclient(hunting): _negotiate 2026-02-17T11:09:41.661 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.660+0000 7fec00d11640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:09:41.662 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.660+0000 7fec00d11640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:09:41.662 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.660+0000 7fec00d11640 10 monclient(hunting): my global_id is 4291 2026-02-17T11:09:41.662 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.660+0000 7fec00d11640 1 -- 10.20.193.49:0/981158811 --> v1:10.20.193.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7febe4003620 con 0x7febfc0c6aa0 2026-02-17T11:09:41.662 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.661+0000 7fec01d13640 10 monclient(hunting): handle_auth_done global_id 4298 payload 274 2026-02-17T11:09:41.662 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.661+0000 7fec01d13640 1 -- 10.20.193.49:0/981158811 >> v1:10.20.193.157:6789/0 conn(0x7febfc0c7e30 legacy=0x7febfc06dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:09:41.662 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.661+0000 7fec01d13640 1 -- 10.20.193.49:0/981158811 >> v1:10.20.193.97:6789/0 conn(0x7febfc0c6aa0 legacy=0x7febfc070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:09:41.662 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.661+0000 7fec01d13640 10 monclient: _finish_hunting 0 2026-02-17T11:09:41.662 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.661+0000 7fec01d13640 1 monclient: found mon.noname-c 2026-02-17T11:09:41.662 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.661+0000 7fec01d13640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:09:41.662 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.661+0000 7fec01d13640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:09:41.662 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.661+0000 7fec01d13640 1 -- 10.20.193.49:0/981158811 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febfc0c7570 con 0x7febfc15c2c0 2026-02-17T11:09:41.663 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.662+0000 7fec01d13640 1 --2- 10.20.193.49:0/981158811 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7febfc15c2c0 0x7febfc15c6a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7febec0098a0 tx=0x7febec02ef00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=819935595c984734 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:09:41.670 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.665+0000 7fec00d11640 1 -- 10.20.193.49:0/981158811 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febec03c070 con 0x7febfc15c2c0 2026-02-17T11:09:41.670 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.665+0000 7fec00d11640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:09:41.670 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.665+0000 7fec00d11640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:09:41.670 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.665+0000 7fec00d11640 10 monclient: dump: 2026-02-17T11:09:41.670 INFO:teuthology.misc.health.trial049.stderr:epoch 1 2026-02-17T11:09:41.670 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:09:41.670 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:41.671 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:41.671 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:09:41.671 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:09:41.671 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:09:41.671 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:09:41.671 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:09:41.671 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:09:41.671 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.665+0000 7fec00d11640 10 monclient: _finish_auth 0 2026-02-17T11:09:41.671 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.665+0000 7fec00d11640 10 monclient: _check_auth_tickets 2026-02-17T11:09:41.671 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.665+0000 7fec00d11640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:09:41.671 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.665+0000 7fec00d11640 1 -- 10.20.193.49:0/981158811 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febec02fc10 con 0x7febfc15c2c0 2026-02-17T11:09:41.672 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.665+0000 7fec00d11640 10 monclient: handle_config config(0 keys) 2026-02-17T11:09:41.672 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.665+0000 7fec03f9e640 5 monclient: authenticate success, global_id 4298 2026-02-17T11:09:41.672 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.665+0000 7fec00d11640 1 -- 10.20.193.49:0/981158811 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febec037440 con 0x7febfc15c2c0 2026-02-17T11:09:41.672 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.665+0000 7fec00d11640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:09:41.672 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.665+0000 7fec00d11640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:09:41.672 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.665+0000 7fec00d11640 10 monclient: dump: 2026-02-17T11:09:41.672 INFO:teuthology.misc.health.trial049.stderr:epoch 1 2026-02-17T11:09:41.672 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:09:41.672 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:41.672 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:41.672 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:09:41.672 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:09:41.672 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:09:41.673 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:09:41.673 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:09:41.673 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:09:41.673 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.665+0000 7fec03f9e640 10 monclient: get_monmap_and_config success 2026-02-17T11:09:41.673 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.665+0000 7fec03f9e640 4 set_mon_vals no callback set 2026-02-17T11:09:41.673 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.665+0000 7fec03f9e640 10 monclient: shutdown 2026-02-17T11:09:41.673 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.665+0000 7fec03f9e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:09:41.673 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.665+0000 7fec03f9e640 1 -- 10.20.193.49:0/981158811 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7febfc15c2c0 msgr2=0x7febfc15c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:09:41.673 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.665+0000 7fec03f9e640 1 --2- 10.20.193.49:0/981158811 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7febfc15c2c0 0x7febfc15c6a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7febec0098a0 tx=0x7febec02ef00 comp rx=0 tx=0).stop 2026-02-17T11:09:41.673 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.665+0000 7fec03f9e640 1 -- 10.20.193.49:0/981158811 shutdown_connections 2026-02-17T11:09:41.673 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.665+0000 7fec03f9e640 1 --2- 10.20.193.49:0/981158811 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7febfc15c2c0 0x7febfc15c6a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:41.674 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.665+0000 7fec03f9e640 1 -- 10.20.193.49:0/981158811 >> 10.20.193.49:0/981158811 conn(0x7febfc0c9f30 msgr2=0x7febfc0ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:09:41.674 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.665+0000 7fec03f9e640 1 -- 10.20.193.49:0/981158811 shutdown_connections 2026-02-17T11:09:41.674 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.665+0000 7fec03f9e640 1 -- 10.20.193.49:0/981158811 wait complete. 2026-02-17T11:09:41.674 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.665+0000 7fec03f9e640 10 monclient: build_initial_monmap 2026-02-17T11:09:41.674 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.665+0000 7fec03f9e640 10 monclient: monmap: 2026-02-17T11:09:41.674 INFO:teuthology.misc.health.trial049.stderr:epoch 0 2026-02-17T11:09:41.674 INFO:teuthology.misc.health.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:09:41.674 INFO:teuthology.misc.health.trial049.stderr:last_changed 0.000000 2026-02-17T11:09:41.674 INFO:teuthology.misc.health.trial049.stderr:created 0.000000 2026-02-17T11:09:41.674 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:09:41.674 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:09:41.674 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:09:41.674 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:09:41.675 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:09:41.675 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:09:41.675 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.666+0000 7fec03f9e640 1 librados: starting msgr at 2026-02-17T11:09:41.675 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.666+0000 7fec03f9e640 1 librados: starting objecter 2026-02-17T11:09:41.675 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.666+0000 7fec03f9e640 1 Processor -- start 2026-02-17T11:09:41.675 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.666+0000 7fec03f9e640 1 -- start start 2026-02-17T11:09:41.675 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.666+0000 7fec03f9e640 1 librados: setting wanted keys 2026-02-17T11:09:41.675 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.666+0000 7fec03f9e640 1 librados: calling monclient init 2026-02-17T11:09:41.675 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.666+0000 7fec03f9e640 10 monclient: init 2026-02-17T11:09:41.675 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.666+0000 7fec03f9e640 10 monclient: _reopen_session rank -1 2026-02-17T11:09:41.675 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.666+0000 7fec03f9e640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:09:41.675 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.666+0000 7fec03f9e640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7febfc0c6aa0 0x7febfc149780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:09:41.676 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.666+0000 7fec03f9e640 10 monclient(hunting): picked mon.noname-a con 0x7febfc0c6aa0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:09:41.676 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.666+0000 7fec03f9e640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7febfc0c7e30 0x7febfc14a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:09:41.676 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.666+0000 7fec03f9e640 10 monclient(hunting): picked mon.noname-b con 0x7febfc0c7e30 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:09:41.676 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.666+0000 7fec03f9e640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7febfc15c2c0 0x7febfc1f7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:09:41.676 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.666+0000 7fec03f9e640 10 monclient(hunting): picked mon.noname-c con 0x7febfc15c2c0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:09:41.676 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.666+0000 7fec03f9e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:09:41.676 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.666+0000 7fec03f9e640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7febfc0c82a0 con 0x7febfc0c6aa0 2026-02-17T11:09:41.676 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.666+0000 7fec03f9e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:09:41.676 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.666+0000 7fec03f9e640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7febfc0c7850 con 0x7febfc0c7e30 2026-02-17T11:09:41.676 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.666+0000 7fec03f9e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:09:41.676 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.666+0000 7fec03f9e640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7febfc0c8420 con 0x7febfc15c2c0 2026-02-17T11:09:41.676 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.666+0000 7fec03f9e640 10 monclient(hunting): _renew_subs 2026-02-17T11:09:41.677 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.666+0000 7fec03f9e640 10 monclient(hunting): authenticate will time out at 1058.329579s 2026-02-17T11:09:41.677 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.666+0000 7fec02514640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7febfc15c2c0 0x7febfc1f7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:09:41.677 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.666+0000 7fec02514640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7febfc15c2c0 0x7febfc1f7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:42432/0 (socket says 10.20.193.49:42432) 2026-02-17T11:09:41.677 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.666+0000 7fec02514640 1 -- 10.20.193.49:0/4244541769 learned_addr learned my addr 10.20.193.49:0/4244541769 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:09:41.677 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.667+0000 7fec02514640 10 monclient(hunting): get_auth_request con 0x7febfc15c2c0 auth_method 0 2026-02-17T11:09:41.677 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.667+0000 7fec02514640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:09:41.677 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.667+0000 7fec02514640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:09:41.677 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.667+0000 7fec02514640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:09:41.677 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.667+0000 7fec01512640 1 --2- 10.20.193.49:0/4244541769 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7febfc0c7e30 0x7febfc14a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:09:41.677 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.667+0000 7fec01d13640 1 --2- 10.20.193.49:0/4244541769 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7febfc0c6aa0 0x7febfc149780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:09:41.678 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.667+0000 7fec01512640 10 monclient(hunting): get_auth_request con 0x7febfc0c7e30 auth_method 0 2026-02-17T11:09:41.678 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.667+0000 7fec01512640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:09:41.678 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.667+0000 7fec01512640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:09:41.678 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.667+0000 7fec01512640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:09:41.678 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.667+0000 7fec02514640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:09:41.678 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.667+0000 7fec02514640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:09:41.678 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.667+0000 7fec02514640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:09:41.678 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.667+0000 7fec01d13640 10 monclient(hunting): get_auth_request con 0x7febfc0c6aa0 auth_method 0 2026-02-17T11:09:41.678 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.667+0000 7fec01d13640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:09:41.678 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.667+0000 7fec01d13640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:09:41.678 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.667+0000 7fec01d13640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:09:41.678 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.667+0000 7fec01512640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:09:41.679 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.667+0000 7fec01512640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:09:41.679 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.667+0000 7fec01512640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:09:41.679 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.667+0000 7fec01d13640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:09:41.679 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.667+0000 7fec01d13640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:09:41.679 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.667+0000 7fec01d13640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:09:41.679 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.668+0000 7fec02514640 10 monclient(hunting): handle_auth_done global_id 4304 payload 824 2026-02-17T11:09:41.679 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.668+0000 7fec02514640 1 -- 10.20.193.49:0/4244541769 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7febfc0c7e30 msgr2=0x7febfc14a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:09:41.679 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.668+0000 7fec02514640 1 --2- 10.20.193.49:0/4244541769 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7febfc0c7e30 0x7febfc14a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:41.679 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.668+0000 7fec02514640 1 -- 10.20.193.49:0/4244541769 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7febfc0c6aa0 msgr2=0x7febfc149780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:09:41.679 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.668+0000 7fec02514640 1 --2- 10.20.193.49:0/4244541769 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7febfc0c6aa0 0x7febfc149780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:41.679 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.668+0000 7fec02514640 10 monclient: _finish_hunting 0 2026-02-17T11:09:41.679 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.668+0000 7fec02514640 1 monclient: found mon.noname-c 2026-02-17T11:09:41.679 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.668+0000 7fec02514640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:09:41.680 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.668+0000 7fec02514640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:09:41.680 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.668+0000 7fec02514640 1 -- 10.20.193.49:0/4244541769 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febfc1f81b0 con 0x7febfc15c2c0 2026-02-17T11:09:41.682 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.669+0000 7fec02514640 1 --2- 10.20.193.49:0/4244541769 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7febfc15c2c0 0x7febfc1f7c70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7febf800cb80 tx=0x7febf800a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:09:41.682 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.669+0000 7febea7fc640 10 client.?.objecter ms_handle_connect 0x7febfc15c2c0 2026-02-17T11:09:41.682 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.669+0000 7febea7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T11:09:41.682 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.670+0000 7febea7fc640 1 -- 10.20.193.49:0/4244541769 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf8017070 con 0x7febfc15c2c0 2026-02-17T11:09:41.682 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.670+0000 7febea7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:09:41.682 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.670+0000 7febea7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:09:41.682 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.670+0000 7febea7fc640 10 monclient: dump: 2026-02-17T11:09:41.683 INFO:teuthology.misc.health.trial049.stderr:epoch 1 2026-02-17T11:09:41.683 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:09:41.683 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:41.683 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:41.683 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:09:41.683 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:09:41.683 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:09:41.683 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:09:41.683 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:09:41.683 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:09:41.683 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.670+0000 7febea7fc640 10 monclient: _finish_auth 0 2026-02-17T11:09:41.683 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.670+0000 7febea7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:09:41.684 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.670+0000 7febea7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:09:41.684 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.670+0000 7fec03f9e640 5 monclient: authenticate success, global_id 4304 2026-02-17T11:09:41.684 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.670+0000 7fec03f9e640 10 monclient: _renew_subs 2026-02-17T11:09:41.684 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.670+0000 7fec03f9e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:09:41.684 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.670+0000 7fec03f9e640 1 -- 10.20.193.49:0/4244541769 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febfc1f4a60 con 0x7febfc15c2c0 2026-02-17T11:09:41.684 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.670+0000 7fec03f9e640 10 client.4304.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:09:41.684 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.670+0000 7fec03f9e640 10 monclient: _renew_subs 2026-02-17T11:09:41.684 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.670+0000 7fec03f9e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:09:41.684 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.670+0000 7fec03f9e640 1 -- 10.20.193.49:0/4244541769 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febfc148ca0 con 0x7febfc15c2c0 2026-02-17T11:09:41.684 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.670+0000 7fec03f9e640 1 librados: init done 2026-02-17T11:09:41.685 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.671+0000 7febea7fc640 1 -- 10.20.193.49:0/4244541769 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febf800ad50 con 0x7febfc15c2c0 2026-02-17T11:09:41.685 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.671+0000 7febea7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:09:41.685 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.671+0000 7febea7fc640 1 -- 10.20.193.49:0/4244541769 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf8021060 con 0x7febfc15c2c0 2026-02-17T11:09:41.685 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.671+0000 7febea7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:09:41.685 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.671+0000 7febea7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:09:41.685 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.671+0000 7febebfff640 4 set_mon_vals no callback set 2026-02-17T11:09:41.685 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.671+0000 7febea7fc640 10 monclient: dump: 2026-02-17T11:09:41.685 INFO:teuthology.misc.health.trial049.stderr:epoch 1 2026-02-17T11:09:41.685 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:09:41.685 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:41.686 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:41.686 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:09:41.686 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:09:41.686 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:09:41.686 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:09:41.686 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:09:41.686 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:09:41.686 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.671+0000 7fec03f9e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:09:41.686 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.671+0000 7fec03f9e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:09:41.686 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.671+0000 7fec03f9e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:09:41.686 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.671+0000 7fec03f9e640 1 -- 10.20.193.49:0/4244541769 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febfc15c6a0 con 0x7febfc15c2c0 2026-02-17T11:09:41.781 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.779+0000 7febea7fc640 1 -- 10.20.193.49:0/4244541769 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 4) ==== 100001+0+0 (secure 0 0 0) 0x7febf8024080 con 0x7febfc15c2c0 2026-02-17T11:09:41.782 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.780+0000 7febea7fc640 1 --2- 10.20.193.49:0/4244541769 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7febcc0790e0 0x7febcc07b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:09:41.782 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.780+0000 7fec01d13640 1 --2- 10.20.193.49:0/4244541769 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7febcc0790e0 0x7febcc07b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:09:41.782 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.780+0000 7fec01d13640 10 monclient: get_auth_request con 0x7febcc0790e0 auth_method 0 2026-02-17T11:09:41.782 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.780+0000 7febea7fc640 10 client.4304.objecter ms_handle_connect 0x7febcc0790e0 2026-02-17T11:09:41.782 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.780+0000 7fec01d13640 1 --2- 10.20.193.49:0/4244541769 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7febcc0790e0 0x7febcc07b5a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7febec039000 tx=0x7febec033000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:09:41.788 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.787+0000 7febea7fc640 1 -- 10.20.193.49:0/4244541769 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2565+0+0 (secure 0 0 0) 0x7febf805e010 con 0x7febfc15c2c0 2026-02-17T11:09:41.788 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.787+0000 7febea7fc640 10 client.4304.objecter ms_dispatch2 0x7febfc000b90 osd_map(18..18 src has 1..18) 2026-02-17T11:09:41.788 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.787+0000 7febea7fc640 3 client.4304.objecter handle_osd_map got epochs [18,18] > 0 2026-02-17T11:09:41.788 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.787+0000 7febea7fc640 3 client.4304.objecter handle_osd_map decoding full epoch 18 2026-02-17T11:09:41.789 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.787+0000 7febea7fc640 20 client.4304.objecter dump_active .. 0 homeless 2026-02-17T11:09:41.789 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.788+0000 7febea7fc640 1 -- 10.20.193.49:0/4244541769 <== mon.2 v2:10.20.193.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7febf8061fd0 con 0x7febfc15c2c0 2026-02-17T11:09:41.789 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.788+0000 7febea7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:09:41.789 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.788+0000 7febea7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:09:41.877 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.875+0000 7fec03f9e640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:09:41.877 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.875+0000 7fec03f9e640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:09:41.877 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.875+0000 7fec03f9e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:09:41.877 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.875+0000 7fec03f9e640 1 -- 10.20.193.49:0/4244541769 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7febfc15d160 con 0x7febfc15c2c0 2026-02-17T11:09:41.888 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.886+0000 7febea7fc640 1 -- 10.20.193.49:0/4244541769 <== mon.2 v2:10.20.193.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12879 (secure 0 0 0) 0x7febf80662d0 con 0x7febfc15c2c0 2026-02-17T11:09:41.888 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.886+0000 7febea7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:09:41.888 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.886+0000 7febea7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:09:41.888 INFO:teuthology.misc.health.trial049.stdout: 2026-02-17T11:09:41.889 INFO:teuthology.misc.health.trial049.stdout:{"epoch":18,"fsid":"2799a57b-9ea3-46ae-8e91-1fe004a3651d","created":"2026-02-17T11:08:37.595499+0000","modified":"2026-02-17T11:08:43.985163+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T11:08:43.985163+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"30bc819e-140a-433e-b860-eaa88e282a11","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2f7f1f11-f256-4094-82a9-5d21882e6e0e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"26bd1274-fe52-42cb-876b-df9920880f95","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c78a5263-3b0d-4b22-a848-bcd6a1e4f6b0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f0fdfadd-2f39-4ad8-ac88-cb588c5e8ee0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"65872639-d6c0-482d-95d1-1d9f250781c9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"43091d3e-638d-4462-867b-cade02a315e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"890ae4d6-33c9-4515-a896-a689647330dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"f04abc9b-ed75-4582-b47d-07a9890f52bb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"7dfbb00a-6b89-4de3-9f30-6aadd91b4408","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"e497a4fd-a944-489b-9cb3-30f5acaeb53e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"7371d50f-36f9-477d-8d4d-853f481dd6db","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"3cf4fded-49db-4d95-956b-77acc868a3ed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"7dc53473-594f-4cfb-8444-eab205e2e0f9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"e8ab3e8f-29a8-4c79-bf86-d29543aac56a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"300a4696-aa54-4b47-b9f3-87dec719bcfa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:09:41.890 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.888+0000 7fec03f9e640 10 librados: watch_flush enter 2026-02-17T11:09:41.890 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.888+0000 7fec03f9e640 10 librados: watch_flush exit 2026-02-17T11:09:41.890 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.888+0000 7fec03f9e640 20 client.4304.objecter shutdown clearing up homeless session... 2026-02-17T11:09:41.890 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.888+0000 7fec03f9e640 10 client.4304.objecter successfully canceled tick 2026-02-17T11:09:41.890 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.888+0000 7fec03f9e640 1 -- 10.20.193.49:0/4244541769 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7febcc0790e0 msgr2=0x7febcc07b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:09:41.890 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.888+0000 7fec03f9e640 1 --2- 10.20.193.49:0/4244541769 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7febcc0790e0 0x7febcc07b5a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7febec039000 tx=0x7febec033000 comp rx=0 tx=0).stop 2026-02-17T11:09:41.891 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.888+0000 7fec03f9e640 10 monclient: shutdown 2026-02-17T11:09:41.891 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.888+0000 7fec03f9e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:09:41.891 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.888+0000 7fec03f9e640 1 -- 10.20.193.49:0/4244541769 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7febfc15c2c0 msgr2=0x7febfc1f7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:09:41.891 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.888+0000 7fec03f9e640 1 --2- 10.20.193.49:0/4244541769 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7febfc15c2c0 0x7febfc1f7c70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7febf800cb80 tx=0x7febf800a430 comp rx=0 tx=0).stop 2026-02-17T11:09:41.891 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.888+0000 7fec03f9e640 1 -- 10.20.193.49:0/4244541769 shutdown_connections 2026-02-17T11:09:41.891 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.888+0000 7fec03f9e640 1 --2- 10.20.193.49:0/4244541769 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7febcc0790e0 0x7febcc07b5a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:41.891 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.888+0000 7fec03f9e640 1 --2- 10.20.193.49:0/4244541769 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7febfc15c2c0 0x7febfc1f7c70 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:41.891 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.888+0000 7fec03f9e640 1 --2- 10.20.193.49:0/4244541769 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7febfc0c7e30 0x7febfc14a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:41.891 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.888+0000 7fec03f9e640 1 --2- 10.20.193.49:0/4244541769 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7febfc0c6aa0 0x7febfc149780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:41.891 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.888+0000 7fec03f9e640 1 -- 10.20.193.49:0/4244541769 >> 10.20.193.49:0/4244541769 conn(0x7febfc0c9f30 msgr2=0x7febfc0c5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:09:41.891 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.888+0000 7fec03f9e640 1 -- 10.20.193.49:0/4244541769 shutdown_connections 2026-02-17T11:09:41.892 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.888+0000 7fec03f9e640 1 -- 10.20.193.49:0/4244541769 wait complete. 2026-02-17T11:09:41.892 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:41.888+0000 7fec03f9e640 1 librados: shutdown 2026-02-17T11:09:41.896 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-17T11:09:49.510 DEBUG:teuthology.orchestra.run.trial049:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T11:09:49.572 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.570+0000 7f8c149fb640 10 monclient: get_monmap_and_config 2026-02-17T11:09:49.572 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.570+0000 7f8c149fb640 10 monclient: build_initial_monmap 2026-02-17T11:09:49.572 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.570+0000 7f8c149fb640 10 monclient: monmap: 2026-02-17T11:09:49.572 INFO:teuthology.misc.health.trial049.stderr:epoch 0 2026-02-17T11:09:49.572 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:09:49.572 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:09:49.571623+0000 2026-02-17T11:09:49.572 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:09:49.571623+0000 2026-02-17T11:09:49.572 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:09:49.572 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:09:49.572 INFO:teuthology.misc.health.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:09:49.572 INFO:teuthology.misc.health.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:09:49.572 INFO:teuthology.misc.health.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:09:49.572 INFO:teuthology.misc.health.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:09:49.572 INFO:teuthology.misc.health.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:09:49.572 INFO:teuthology.misc.health.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:09:49.572 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:09:49.572 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.570+0000 7f8c149fb640 1 Processor -- start 2026-02-17T11:09:49.573 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.570+0000 7f8c149fb640 1 -- start start 2026-02-17T11:09:49.573 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.570+0000 7f8c149fb640 10 monclient: init 2026-02-17T11:09:49.574 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.571+0000 7f8c149fb640 10 monclient: _reopen_session rank -1 2026-02-17T11:09:49.575 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.571+0000 7f8c149fb640 10 monclient: _add_conns ranks=[3,0,4,1,5,2] 2026-02-17T11:09:49.575 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.571+0000 7f8c149fb640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f8c0c1504c0 0x7f8c0c0c52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:09:49.575 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.571+0000 7f8c149fb640 10 monclient(hunting): picked mon.noname-a con 0x7f8c0c1504c0 addr v2:10.20.193.49:3300/0 2026-02-17T11:09:49.575 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.571+0000 7f8c149fb640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f8c0c0c7120 addr v1:10.20.193.49:6789/0 2026-02-17T11:09:49.575 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.571+0000 7f8c149fb640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f8c0c0c7550 0x7f8c0c15d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:09:49.575 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.571+0000 7f8c149fb640 10 monclient(hunting): picked mon.noname-b con 0x7f8c0c0c7550 addr v2:10.20.193.97:3300/0 2026-02-17T11:09:49.575 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.571+0000 7f8c149fb640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c0c0c7930 con 0x7f8c0c0c7120 2026-02-17T11:09:49.575 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.571+0000 7f8c149fb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:09:49.575 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.571+0000 7f8c149fb640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f8c0c0c5c70 con 0x7f8c0c1504c0 2026-02-17T11:09:49.575 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.571+0000 7f8c149fb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:09:49.575 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.571+0000 7f8c149fb640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f8c0c15def0 con 0x7f8c0c0c7550 2026-02-17T11:09:49.576 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.571+0000 7f8c149fb640 10 monclient(hunting): _renew_subs 2026-02-17T11:09:49.576 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.571+0000 7f8c149fb640 10 monclient(hunting): authenticate will time out at 1066.235109s 2026-02-17T11:09:49.576 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.571+0000 7f8c12770640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f8c0c1504c0 0x7f8c0c0c52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:09:49.576 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.571+0000 7f8c11f6f640 1 --1- >> v1:10.20.193.49:6789/0 conn(0x7f8c0c0c7120 0x7f8c0c0c9050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.49:6789/0 says I am v1:10.20.193.49:57960/0 (socket says 10.20.193.49:57960) 2026-02-17T11:09:49.576 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.571+0000 7f8c11f6f640 1 -- 10.20.193.49:0/1450306992 learned_addr learned my addr 10.20.193.49:0/1450306992 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:09:49.576 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.571+0000 7f8c12f71640 1 --2- 10.20.193.49:0/1450306992 >> v2:10.20.193.97:3300/0 conn(0x7f8c0c0c7550 0x7f8c0c15d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:09:49.576 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.571+0000 7f8c12770640 10 monclient(hunting): get_auth_request con 0x7f8c0c1504c0 auth_method 0 2026-02-17T11:09:49.576 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.571+0000 7f8c12770640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:09:49.576 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.571+0000 7f8c12770640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:09:49.576 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.571+0000 7f8c12770640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:09:49.576 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.571+0000 7f8c12f71640 10 monclient(hunting): get_auth_request con 0x7f8c0c0c7550 auth_method 0 2026-02-17T11:09:49.576 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.571+0000 7f8c12f71640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:09:49.577 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.571+0000 7f8c12f71640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:09:49.577 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.571+0000 7f8c12f71640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:09:49.577 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.572+0000 7f8c12770640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:09:49.577 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.572+0000 7f8c12770640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:09:49.577 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.572+0000 7f8c12770640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:09:49.577 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.572+0000 7f8c12f71640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:09:49.577 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.572+0000 7f8c12f71640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:09:49.577 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.572+0000 7f8c12f71640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:09:49.583 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.573+0000 7f8c12f71640 10 monclient(hunting): handle_auth_done global_id 4297 payload 274 2026-02-17T11:09:49.583 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.573+0000 7f8c12f71640 1 -- 10.20.193.49:0/1450306992 >> v2:10.20.193.49:3300/0 conn(0x7f8c0c1504c0 msgr2=0x7f8c0c0c52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:09:49.583 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.573+0000 7f8c12f71640 1 --2- 10.20.193.49:0/1450306992 >> v2:10.20.193.49:3300/0 conn(0x7f8c0c1504c0 0x7f8c0c0c52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:49.583 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.573+0000 7f8c12f71640 1 -- 10.20.193.49:0/1450306992 >> v1:10.20.193.49:6789/0 conn(0x7f8c0c0c7120 legacy=0x7f8c0c0c9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:09:49.584 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.573+0000 7f8c12f71640 10 monclient: _finish_hunting 0 2026-02-17T11:09:49.584 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.573+0000 7f8c12f71640 1 monclient: found mon.noname-b 2026-02-17T11:09:49.584 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.573+0000 7f8c12f71640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:09:49.584 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.573+0000 7f8c12f71640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:09:49.584 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.573+0000 7f8c12f71640 1 -- 10.20.193.49:0/1450306992 --> v2:10.20.193.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c0c0c7fb0 con 0x7f8c0c0c7550 2026-02-17T11:09:49.584 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.574+0000 7f8c12f71640 1 --2- 10.20.193.49:0/1450306992 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f8c0c0c7550 0x7f8c0c15d080 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c0c9df0 tx=0x7f8c0002f2f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a397da427e97d3b8 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:09:49.584 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.576+0000 7f8c1176e640 1 -- 10.20.193.49:0/1450306992 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c0003c070 con 0x7f8c0c0c7550 2026-02-17T11:09:49.584 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.576+0000 7f8c1176e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:09:49.584 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.576+0000 7f8c1176e640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:09:49.584 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.576+0000 7f8c1176e640 10 monclient: dump: 2026-02-17T11:09:49.584 INFO:teuthology.misc.health.trial049.stderr:epoch 1 2026-02-17T11:09:49.584 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:09:49.585 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:49.585 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:49.585 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:09:49.585 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:09:49.585 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:09:49.585 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:09:49.585 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:09:49.585 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:09:49.585 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.576+0000 7f8c1176e640 10 monclient: _finish_auth 0 2026-02-17T11:09:49.585 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.576+0000 7f8c1176e640 10 monclient: _check_auth_tickets 2026-02-17T11:09:49.585 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.576+0000 7f8c1176e640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:09:49.585 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.576+0000 7f8c149fb640 5 monclient: authenticate success, global_id 4297 2026-02-17T11:09:49.586 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.576+0000 7f8c149fb640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:09:49.586 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.576+0000 7f8c1176e640 1 -- 10.20.193.49:0/1450306992 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c00037440 con 0x7f8c0c0c7550 2026-02-17T11:09:49.586 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.576+0000 7f8c1176e640 10 monclient: handle_config config(0 keys) 2026-02-17T11:09:49.586 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.576+0000 7f8c149fb640 10 monclient: get_monmap_and_config success 2026-02-17T11:09:49.586 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.576+0000 7f8c1176e640 1 -- 10.20.193.49:0/1450306992 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c00037810 con 0x7f8c0c0c7550 2026-02-17T11:09:49.586 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.576+0000 7f8c149fb640 4 set_mon_vals no callback set 2026-02-17T11:09:49.586 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.576+0000 7f8c1176e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:09:49.586 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.576+0000 7f8c1176e640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:09:49.586 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.576+0000 7f8c1176e640 10 monclient: dump: 2026-02-17T11:09:49.586 INFO:teuthology.misc.health.trial049.stderr:epoch 1 2026-02-17T11:09:49.586 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:09:49.586 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:49.586 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:49.587 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:09:49.587 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:09:49.587 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:09:49.587 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:09:49.587 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:09:49.587 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:09:49.587 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.576+0000 7f8c149fb640 10 monclient: shutdown 2026-02-17T11:09:49.587 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.576+0000 7f8c149fb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:09:49.587 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.576+0000 7f8c149fb640 1 -- 10.20.193.49:0/1450306992 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f8c0c0c7550 msgr2=0x7f8c0c15d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:09:49.587 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.576+0000 7f8c149fb640 1 --2- 10.20.193.49:0/1450306992 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f8c0c0c7550 0x7f8c0c15d080 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c0c9df0 tx=0x7f8c0002f2f0 comp rx=0 tx=0).stop 2026-02-17T11:09:49.587 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.576+0000 7f8c149fb640 1 -- 10.20.193.49:0/1450306992 shutdown_connections 2026-02-17T11:09:49.587 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.576+0000 7f8c149fb640 1 --2- 10.20.193.49:0/1450306992 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f8c0c0c7550 0x7f8c0c15d080 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:49.588 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.576+0000 7f8c149fb640 1 --2- 10.20.193.49:0/1450306992 >> v2:10.20.193.49:3300/0 conn(0x7f8c0c1504c0 0x7f8c0c0c52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:49.588 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.576+0000 7f8c149fb640 1 -- 10.20.193.49:0/1450306992 >> 10.20.193.49:0/1450306992 conn(0x7f8c0c0c9f30 msgr2=0x7f8c0c0ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:09:49.588 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.576+0000 7f8c149fb640 1 -- 10.20.193.49:0/1450306992 shutdown_connections 2026-02-17T11:09:49.588 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.576+0000 7f8c149fb640 1 -- 10.20.193.49:0/1450306992 wait complete. 2026-02-17T11:09:49.588 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.577+0000 7f8c149fb640 10 monclient: build_initial_monmap 2026-02-17T11:09:49.588 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.577+0000 7f8c149fb640 10 monclient: monmap: 2026-02-17T11:09:49.588 INFO:teuthology.misc.health.trial049.stderr:epoch 0 2026-02-17T11:09:49.588 INFO:teuthology.misc.health.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:09:49.588 INFO:teuthology.misc.health.trial049.stderr:last_changed 0.000000 2026-02-17T11:09:49.588 INFO:teuthology.misc.health.trial049.stderr:created 0.000000 2026-02-17T11:09:49.588 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:09:49.588 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:09:49.588 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:09:49.589 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:09:49.589 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:09:49.589 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:09:49.589 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.577+0000 7f8c149fb640 1 librados: starting msgr at 2026-02-17T11:09:49.589 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.577+0000 7f8c149fb640 1 librados: starting objecter 2026-02-17T11:09:49.589 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.577+0000 7f8c149fb640 1 Processor -- start 2026-02-17T11:09:49.589 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.577+0000 7f8c149fb640 1 -- start start 2026-02-17T11:09:49.589 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.577+0000 7f8c149fb640 1 librados: setting wanted keys 2026-02-17T11:09:49.589 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.577+0000 7f8c149fb640 1 librados: calling monclient init 2026-02-17T11:09:49.589 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.577+0000 7f8c149fb640 10 monclient: init 2026-02-17T11:09:49.589 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.577+0000 7f8c149fb640 10 monclient: _reopen_session rank -1 2026-02-17T11:09:49.589 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.577+0000 7f8c149fb640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:09:49.590 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.577+0000 7f8c149fb640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f8c0c0c7120 0x7f8c0c1f7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:09:49.590 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.577+0000 7f8c149fb640 10 monclient(hunting): picked mon.noname-a con 0x7f8c0c0c7120 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:09:49.590 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.577+0000 7f8c149fb640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f8c0c0c7550 0x7f8c0c1f4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:09:49.590 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.577+0000 7f8c149fb640 10 monclient(hunting): picked mon.noname-c con 0x7f8c0c0c7550 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:09:49.590 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.577+0000 7f8c149fb640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f8c0c1504c0 0x7f8c0c06d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:09:49.590 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.577+0000 7f8c149fb640 10 monclient(hunting): picked mon.noname-b con 0x7f8c0c1504c0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:09:49.590 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.577+0000 7f8c149fb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:09:49.590 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.577+0000 7f8c149fb640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8c0c0c8850 con 0x7f8c0c0c7120 2026-02-17T11:09:49.590 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.577+0000 7f8c149fb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:09:49.590 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.577+0000 7f8c149fb640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f8c0c0c8570 con 0x7f8c0c1504c0 2026-02-17T11:09:49.590 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.577+0000 7f8c149fb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:09:49.590 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.577+0000 7f8c149fb640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f8c0c0c8b30 con 0x7f8c0c0c7550 2026-02-17T11:09:49.591 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.577+0000 7f8c149fb640 10 monclient(hunting): _renew_subs 2026-02-17T11:09:49.591 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.577+0000 7f8c149fb640 10 monclient(hunting): authenticate will time out at 1066.241829s 2026-02-17T11:09:49.591 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.578+0000 7f8c12770640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f8c0c0c7120 0x7f8c0c1f7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:09:49.591 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.578+0000 7f8c12f71640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f8c0c1504c0 0x7f8c0c06d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:09:49.591 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.578+0000 7f8c12770640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f8c0c0c7120 0x7f8c0c1f7330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:60022/0 (socket says 10.20.193.49:60022) 2026-02-17T11:09:49.591 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.578+0000 7f8c12770640 1 -- 10.20.193.49:0/989257320 learned_addr learned my addr 10.20.193.49:0/989257320 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:09:49.591 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.578+0000 7f8c12770640 10 monclient(hunting): get_auth_request con 0x7f8c0c0c7120 auth_method 0 2026-02-17T11:09:49.591 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.578+0000 7f8c12770640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:09:49.591 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.578+0000 7f8c12770640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:09:49.591 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.578+0000 7f8c12770640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:09:49.591 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.578+0000 7f8c11f6f640 1 --2- 10.20.193.49:0/989257320 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f8c0c0c7550 0x7f8c0c1f4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:09:49.591 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.578+0000 7f8c12f71640 10 monclient(hunting): get_auth_request con 0x7f8c0c1504c0 auth_method 0 2026-02-17T11:09:49.592 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.578+0000 7f8c12f71640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:09:49.592 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.578+0000 7f8c12f71640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:09:49.592 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.578+0000 7f8c12f71640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:09:49.592 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.578+0000 7f8c12770640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:09:49.592 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.578+0000 7f8c12770640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:09:49.592 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.578+0000 7f8c12770640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:09:49.592 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.578+0000 7f8c11f6f640 10 monclient(hunting): get_auth_request con 0x7f8c0c0c7550 auth_method 0 2026-02-17T11:09:49.592 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.578+0000 7f8c11f6f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:09:49.592 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.578+0000 7f8c11f6f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:09:49.592 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.578+0000 7f8c11f6f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:09:49.592 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.578+0000 7f8c12f71640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:09:49.592 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.578+0000 7f8c12f71640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:09:49.592 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.578+0000 7f8c12f71640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:09:49.592 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.578+0000 7f8c11f6f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:09:49.593 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.578+0000 7f8c11f6f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:09:49.593 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.578+0000 7f8c11f6f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:09:49.593 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.579+0000 7f8c12770640 10 monclient(hunting): handle_auth_done global_id 4287 payload 824 2026-02-17T11:09:49.593 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.579+0000 7f8c12770640 1 -- 10.20.193.49:0/989257320 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f8c0c0c7550 msgr2=0x7f8c0c1f4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:09:49.593 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.579+0000 7f8c12770640 1 --2- 10.20.193.49:0/989257320 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f8c0c0c7550 0x7f8c0c1f4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:49.593 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.579+0000 7f8c12770640 1 -- 10.20.193.49:0/989257320 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f8c0c1504c0 msgr2=0x7f8c0c06d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:09:49.593 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.579+0000 7f8c12770640 1 --2- 10.20.193.49:0/989257320 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f8c0c1504c0 0x7f8c0c06d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:49.593 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.579+0000 7f8c12770640 10 monclient: _finish_hunting 0 2026-02-17T11:09:49.593 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.579+0000 7f8c12770640 1 monclient: found mon.noname-a 2026-02-17T11:09:49.593 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.579+0000 7f8c12770640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:09:49.593 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.579+0000 7f8c12770640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:09:49.593 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.579+0000 7f8c12770640 1 -- 10.20.193.49:0/989257320 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c0c06db60 con 0x7f8c0c0c7120 2026-02-17T11:09:49.594 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.580+0000 7f8c12770640 1 --2- 10.20.193.49:0/989257320 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f8c0c0c7120 0x7f8c0c1f7330 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8c0400e890 tx=0x7f8c0400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:09:49.594 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.580+0000 7f8bf6ffd640 10 client.?.objecter ms_handle_connect 0x7f8c0c0c7120 2026-02-17T11:09:49.594 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.580+0000 7f8bf6ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:09:49.595 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.582+0000 7f8bf6ffd640 1 -- 10.20.193.49:0/989257320 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c04017070 con 0x7f8c0c0c7120 2026-02-17T11:09:49.595 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.582+0000 7f8bf6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:09:49.595 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.582+0000 7f8bf6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:09:49.595 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.582+0000 7f8bf6ffd640 10 monclient: dump: 2026-02-17T11:09:49.595 INFO:teuthology.misc.health.trial049.stderr:epoch 1 2026-02-17T11:09:49.595 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:09:49.596 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:49.596 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:49.596 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:09:49.596 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:09:49.596 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:09:49.596 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:09:49.596 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:09:49.596 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:09:49.596 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.582+0000 7f8bf6ffd640 10 monclient: _finish_auth 0 2026-02-17T11:09:49.596 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.582+0000 7f8bf6ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:09:49.596 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.582+0000 7f8bf6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:09:49.596 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.582+0000 7f8bf6ffd640 1 -- 10.20.193.49:0/989257320 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c0400c940 con 0x7f8c0c0c7120 2026-02-17T11:09:49.596 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.582+0000 7f8bf6ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:09:49.597 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.582+0000 7f8bf6ffd640 1 -- 10.20.193.49:0/989257320 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c0400cd30 con 0x7f8c0c0c7120 2026-02-17T11:09:49.597 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.582+0000 7f8bf6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:09:49.597 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.582+0000 7f8bf6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:09:49.597 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.582+0000 7f8bf6ffd640 10 monclient: dump: 2026-02-17T11:09:49.597 INFO:teuthology.misc.health.trial049.stderr:epoch 1 2026-02-17T11:09:49.597 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:09:49.597 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:49.597 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:49.597 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:09:49.597 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:09:49.597 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:09:49.597 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:09:49.598 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:09:49.598 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:09:49.598 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.582+0000 7f8c149fb640 5 monclient: authenticate success, global_id 4287 2026-02-17T11:09:49.598 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.582+0000 7f8c10f6d640 4 set_mon_vals no callback set 2026-02-17T11:09:49.598 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.582+0000 7f8c149fb640 10 monclient: _renew_subs 2026-02-17T11:09:49.598 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.582+0000 7f8c149fb640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:09:49.598 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.582+0000 7f8c149fb640 1 -- 10.20.193.49:0/989257320 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c0c1f8230 con 0x7f8c0c0c7120 2026-02-17T11:09:49.598 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.582+0000 7f8c149fb640 10 client.4287.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:09:49.598 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.582+0000 7f8c149fb640 10 monclient: _renew_subs 2026-02-17T11:09:49.598 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.582+0000 7f8c149fb640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:09:49.598 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.582+0000 7f8c149fb640 1 -- 10.20.193.49:0/989257320 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c0c1f7c70 con 0x7f8c0c0c7120 2026-02-17T11:09:49.598 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.582+0000 7f8c149fb640 1 librados: init done 2026-02-17T11:09:49.598 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.583+0000 7f8c149fb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:09:49.599 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.583+0000 7f8c149fb640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:09:49.599 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.583+0000 7f8c149fb640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:09:49.599 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.583+0000 7f8c149fb640 1 -- 10.20.193.49:0/989257320 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c0c0c7b00 con 0x7f8c0c0c7120 2026-02-17T11:09:49.600 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.594+0000 7f8bf6ffd640 1 -- 10.20.193.49:0/989257320 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 4) ==== 100001+0+0 (secure 0 0 0) 0x7f8c04024060 con 0x7f8c0c0c7120 2026-02-17T11:09:49.600 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.595+0000 7f8bf6ffd640 1 --2- 10.20.193.49:0/989257320 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f8bdc0790b0 0x7f8bdc07b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:09:49.600 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.595+0000 7f8c11f6f640 1 --2- 10.20.193.49:0/989257320 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f8bdc0790b0 0x7f8bdc07b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:09:49.600 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.595+0000 7f8c11f6f640 10 monclient: get_auth_request con 0x7f8bdc0790b0 auth_method 0 2026-02-17T11:09:49.600 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.595+0000 7f8bf6ffd640 10 client.4287.objecter ms_handle_connect 0x7f8bdc0790b0 2026-02-17T11:09:49.600 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.595+0000 7f8c11f6f640 1 --2- 10.20.193.49:0/989257320 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f8bdc0790b0 0x7f8bdc07b570 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c073c70 tx=0x7f8bf8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:09:49.600 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.597+0000 7f8bf6ffd640 1 -- 10.20.193.49:0/989257320 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2565+0+0 (secure 0 0 0) 0x7f8c0405e2e0 con 0x7f8c0c0c7120 2026-02-17T11:09:49.601 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.597+0000 7f8bf6ffd640 10 client.4287.objecter ms_dispatch2 0x7f8c0c000b90 osd_map(18..18 src has 1..18) 2026-02-17T11:09:49.601 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.597+0000 7f8bf6ffd640 3 client.4287.objecter handle_osd_map got epochs [18,18] > 0 2026-02-17T11:09:49.601 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.597+0000 7f8bf6ffd640 3 client.4287.objecter handle_osd_map decoding full epoch 18 2026-02-17T11:09:49.601 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.597+0000 7f8bf6ffd640 20 client.4287.objecter dump_active .. 0 homeless 2026-02-17T11:09:49.703 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.700+0000 7f8bf6ffd640 1 -- 10.20.193.49:0/989257320 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f8c0c0c7b00 con 0x7f8c0c0c7120 2026-02-17T11:09:49.703 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.700+0000 7f8bf6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:09:49.703 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.700+0000 7f8bf6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:09:49.792 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.789+0000 7f8c149fb640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:09:49.792 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.789+0000 7f8c149fb640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:09:49.792 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.789+0000 7f8c149fb640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:09:49.792 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.789+0000 7f8c149fb640 1 -- 10.20.193.49:0/989257320 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8c0c1508a0 con 0x7f8c0c0c7120 2026-02-17T11:09:49.803 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.800+0000 7f8bf6ffd640 1 -- 10.20.193.49:0/989257320 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12879 (secure 0 0 0) 0x7f8c040622a0 con 0x7f8c0c0c7120 2026-02-17T11:09:49.803 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.800+0000 7f8bf6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:09:49.803 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.800+0000 7f8bf6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:09:49.803 INFO:teuthology.misc.health.trial049.stdout: 2026-02-17T11:09:49.804 INFO:teuthology.misc.health.trial049.stdout:{"epoch":18,"fsid":"2799a57b-9ea3-46ae-8e91-1fe004a3651d","created":"2026-02-17T11:08:37.595499+0000","modified":"2026-02-17T11:08:43.985163+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T11:08:43.985163+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"30bc819e-140a-433e-b860-eaa88e282a11","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2f7f1f11-f256-4094-82a9-5d21882e6e0e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"26bd1274-fe52-42cb-876b-df9920880f95","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c78a5263-3b0d-4b22-a848-bcd6a1e4f6b0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f0fdfadd-2f39-4ad8-ac88-cb588c5e8ee0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"65872639-d6c0-482d-95d1-1d9f250781c9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"43091d3e-638d-4462-867b-cade02a315e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"890ae4d6-33c9-4515-a896-a689647330dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"f04abc9b-ed75-4582-b47d-07a9890f52bb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"7dfbb00a-6b89-4de3-9f30-6aadd91b4408","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"e497a4fd-a944-489b-9cb3-30f5acaeb53e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"7371d50f-36f9-477d-8d4d-853f481dd6db","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"3cf4fded-49db-4d95-956b-77acc868a3ed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"7dc53473-594f-4cfb-8444-eab205e2e0f9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"e8ab3e8f-29a8-4c79-bf86-d29543aac56a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"300a4696-aa54-4b47-b9f3-87dec719bcfa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:09:49.806 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.803+0000 7f8c149fb640 10 librados: watch_flush enter 2026-02-17T11:09:49.806 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.803+0000 7f8c149fb640 10 librados: watch_flush exit 2026-02-17T11:09:49.806 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.803+0000 7f8c149fb640 20 client.4287.objecter shutdown clearing up homeless session... 2026-02-17T11:09:49.806 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.803+0000 7f8c149fb640 10 client.4287.objecter successfully canceled tick 2026-02-17T11:09:49.806 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.803+0000 7f8c149fb640 1 -- 10.20.193.49:0/989257320 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f8bdc0790b0 msgr2=0x7f8bdc07b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:09:49.807 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.803+0000 7f8c149fb640 1 --2- 10.20.193.49:0/989257320 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f8bdc0790b0 0x7f8bdc07b570 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c073c70 tx=0x7f8bf8009040 comp rx=0 tx=0).stop 2026-02-17T11:09:49.807 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.803+0000 7f8c149fb640 10 monclient: shutdown 2026-02-17T11:09:49.807 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.803+0000 7f8c149fb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:09:49.807 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.803+0000 7f8c149fb640 1 -- 10.20.193.49:0/989257320 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f8c0c0c7120 msgr2=0x7f8c0c1f7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:09:49.807 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.803+0000 7f8c149fb640 1 --2- 10.20.193.49:0/989257320 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f8c0c0c7120 0x7f8c0c1f7330 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8c0400e890 tx=0x7f8c0400ed60 comp rx=0 tx=0).stop 2026-02-17T11:09:49.807 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.803+0000 7f8c149fb640 1 -- 10.20.193.49:0/989257320 shutdown_connections 2026-02-17T11:09:49.807 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.803+0000 7f8c149fb640 1 --2- 10.20.193.49:0/989257320 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f8bdc0790b0 0x7f8bdc07b570 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:49.807 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.803+0000 7f8c149fb640 1 --2- 10.20.193.49:0/989257320 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f8c0c1504c0 0x7f8c0c06d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:49.807 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.803+0000 7f8c149fb640 1 --2- 10.20.193.49:0/989257320 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f8c0c0c7550 0x7f8c0c1f4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:49.807 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.803+0000 7f8c149fb640 1 --2- 10.20.193.49:0/989257320 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f8c0c0c7120 0x7f8c0c1f7330 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:49.807 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.803+0000 7f8c149fb640 1 -- 10.20.193.49:0/989257320 >> 10.20.193.49:0/989257320 conn(0x7f8c0c0c9f30 msgr2=0x7f8c0c0ca310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:09:49.807 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.803+0000 7f8c149fb640 1 -- 10.20.193.49:0/989257320 shutdown_connections 2026-02-17T11:09:49.808 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.803+0000 7f8c149fb640 1 -- 10.20.193.49:0/989257320 wait complete. 2026-02-17T11:09:49.808 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:49.803+0000 7f8c149fb640 1 librados: shutdown 2026-02-17T11:09:49.815 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-17T11:09:51.569 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:01:37.050 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:09:51.573 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:01:37.055 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:09:51.591 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:01:37.072 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:09:51.602 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:01:37.043 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:09:51.602 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:01:37.078 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:09:51.603 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:01:37.045 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:09:51.603 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:01:37.079 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:09:51.621 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:01:37.097 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:09:51.621 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:01:37.063 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:09:57.428 DEBUG:teuthology.orchestra.run.trial049:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T11:09:57.490 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.488+0000 7f834976a640 10 monclient: get_monmap_and_config 2026-02-17T11:09:57.490 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.488+0000 7f834976a640 10 monclient: build_initial_monmap 2026-02-17T11:09:57.490 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.488+0000 7f834976a640 10 monclient: monmap: 2026-02-17T11:09:57.490 INFO:teuthology.misc.health.trial049.stderr:epoch 0 2026-02-17T11:09:57.490 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:09:57.491 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:09:57.489274+0000 2026-02-17T11:09:57.491 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:09:57.489274+0000 2026-02-17T11:09:57.491 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:09:57.491 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:09:57.491 INFO:teuthology.misc.health.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:09:57.491 INFO:teuthology.misc.health.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:09:57.491 INFO:teuthology.misc.health.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:09:57.491 INFO:teuthology.misc.health.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:09:57.491 INFO:teuthology.misc.health.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:09:57.491 INFO:teuthology.misc.health.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:09:57.491 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:09:57.494 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.489+0000 7f834976a640 1 Processor -- start 2026-02-17T11:09:57.494 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.489+0000 7f834976a640 1 -- start start 2026-02-17T11:09:57.494 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.489+0000 7f834976a640 10 monclient: init 2026-02-17T11:09:57.494 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.489+0000 7f834976a640 10 monclient: _reopen_session rank -1 2026-02-17T11:09:57.495 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.489+0000 7f834976a640 10 monclient: _add_conns ranks=[3,4,0,5,2,1] 2026-02-17T11:09:57.495 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.489+0000 7f834976a640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f83441504c0 0x7f83440c52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:09:57.495 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.489+0000 7f834976a640 10 monclient(hunting): picked mon.noname-a con 0x7f83441504c0 addr v2:10.20.193.49:3300/0 2026-02-17T11:09:57.495 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.489+0000 7f834976a640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f83440c7120 0x7f83440c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:09:57.495 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.489+0000 7f834976a640 10 monclient(hunting): picked mon.noname-b con 0x7f83440c7120 addr v2:10.20.193.97:3300/0 2026-02-17T11:09:57.495 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.489+0000 7f834976a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f83440c9050 addr v1:10.20.193.49:6789/0 2026-02-17T11:09:57.495 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.489+0000 7f834976a640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f834415def0 con 0x7f83440c9050 2026-02-17T11:09:57.495 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.489+0000 7f834976a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:09:57.495 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.489+0000 7f834976a640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f83440c5c70 con 0x7f83441504c0 2026-02-17T11:09:57.495 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.489+0000 7f834976a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:09:57.495 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.489+0000 7f834976a640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f83440c7fb0 con 0x7f83440c7120 2026-02-17T11:09:57.496 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.489+0000 7f834976a640 10 monclient(hunting): _renew_subs 2026-02-17T11:09:57.496 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.489+0000 7f834976a640 10 monclient(hunting): authenticate will time out at 1074.152808s 2026-02-17T11:09:57.496 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.490+0000 7f8342ffd640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f83441504c0 0x7f83440c52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:09:57.496 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.490+0000 7f83437fe640 1 --1- >> v1:10.20.193.49:6789/0 conn(0x7f83440c9050 0x7f834415d080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.49:6789/0 says I am v1:10.20.193.49:58114/0 (socket says 10.20.193.49:58114) 2026-02-17T11:09:57.496 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.490+0000 7f83437fe640 1 -- 10.20.193.49:0/3263503778 learned_addr learned my addr 10.20.193.49:0/3263503778 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:09:57.496 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.490+0000 7f8342ffd640 10 monclient(hunting): get_auth_request con 0x7f83441504c0 auth_method 0 2026-02-17T11:09:57.496 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.490+0000 7f83427fc640 1 --2- 10.20.193.49:0/3263503778 >> v2:10.20.193.97:3300/0 conn(0x7f83440c7120 0x7f83440c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:09:57.496 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.490+0000 7f8342ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:09:57.496 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.490+0000 7f8342ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:09:57.496 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.490+0000 7f8342ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:09:57.496 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.490+0000 7f83427fc640 10 monclient(hunting): get_auth_request con 0x7f83440c7120 auth_method 0 2026-02-17T11:09:57.496 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.490+0000 7f83427fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:09:57.496 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.490+0000 7f83427fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:09:57.497 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.490+0000 7f83427fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:09:57.497 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.490+0000 7f8342ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:09:57.497 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.490+0000 7f8342ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:09:57.497 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.490+0000 7f8342ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:09:57.497 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.491+0000 7f83427fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:09:57.497 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.491+0000 7f83427fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:09:57.497 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.491+0000 7f83427fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:09:57.497 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.492+0000 7f8342ffd640 10 monclient(hunting): handle_auth_done global_id 4290 payload 274 2026-02-17T11:09:57.497 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.492+0000 7f8342ffd640 1 -- 10.20.193.49:0/3263503778 >> v2:10.20.193.97:3300/0 conn(0x7f83440c7120 msgr2=0x7f83440c7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:09:57.497 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.492+0000 7f8342ffd640 1 --2- 10.20.193.49:0/3263503778 >> v2:10.20.193.97:3300/0 conn(0x7f83440c7120 0x7f83440c7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:57.497 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.492+0000 7f8342ffd640 1 -- 10.20.193.49:0/3263503778 >> v1:10.20.193.49:6789/0 conn(0x7f83440c9050 legacy=0x7f834415d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:09:57.497 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.492+0000 7f8342ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:09:57.498 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.492+0000 7f8342ffd640 1 monclient: found mon.noname-a 2026-02-17T11:09:57.498 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.492+0000 7f8342ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:09:57.498 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.492+0000 7f8342ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:09:57.498 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.492+0000 7f8342ffd640 1 -- 10.20.193.49:0/3263503778 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83440c8290 con 0x7f83441504c0 2026-02-17T11:09:57.504 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.494+0000 7f8342ffd640 1 --2- 10.20.193.49:0/3263503778 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f83441504c0 0x7f83440c52c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8344070ea0 tx=0x7f833802ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3e7ce159f7a5f09 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:09:57.504 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.496+0000 7f8341ffb640 1 -- 10.20.193.49:0/3263503778 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f833803c070 con 0x7f83441504c0 2026-02-17T11:09:57.504 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.496+0000 7f8341ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:09:57.505 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.496+0000 7f8341ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:09:57.505 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.496+0000 7f8341ffb640 10 monclient: dump: 2026-02-17T11:09:57.505 INFO:teuthology.misc.health.trial049.stderr:epoch 1 2026-02-17T11:09:57.505 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:09:57.505 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:57.505 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:57.505 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:09:57.505 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:09:57.505 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:09:57.505 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:09:57.505 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:09:57.506 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:09:57.506 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.496+0000 7f8341ffb640 10 monclient: _finish_auth 0 2026-02-17T11:09:57.506 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.496+0000 7f8341ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:09:57.506 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.496+0000 7f8341ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:09:57.506 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.496+0000 7f834976a640 5 monclient: authenticate success, global_id 4290 2026-02-17T11:09:57.506 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.496+0000 7f834976a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:09:57.506 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.496+0000 7f8341ffb640 1 -- 10.20.193.49:0/3263503778 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f833802fc20 con 0x7f83441504c0 2026-02-17T11:09:57.506 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.496+0000 7f8341ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:09:57.506 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.496+0000 7f834976a640 10 monclient: get_monmap_and_config success 2026-02-17T11:09:57.506 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.496+0000 7f834976a640 4 set_mon_vals no callback set 2026-02-17T11:09:57.506 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.496+0000 7f8341ffb640 1 -- 10.20.193.49:0/3263503778 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8338037440 con 0x7f83441504c0 2026-02-17T11:09:57.506 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.496+0000 7f8341ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:09:57.507 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.496+0000 7f8341ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:09:57.507 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.496+0000 7f8341ffb640 10 monclient: dump: 2026-02-17T11:09:57.507 INFO:teuthology.misc.health.trial049.stderr:epoch 1 2026-02-17T11:09:57.507 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:09:57.507 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:57.507 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:57.507 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:09:57.507 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:09:57.507 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:09:57.507 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:09:57.507 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:09:57.507 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:09:57.507 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.496+0000 7f834976a640 10 monclient: shutdown 2026-02-17T11:09:57.508 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.496+0000 7f834976a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:09:57.508 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.496+0000 7f834976a640 1 -- 10.20.193.49:0/3263503778 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f83441504c0 msgr2=0x7f83440c52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:09:57.508 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.496+0000 7f834976a640 1 --2- 10.20.193.49:0/3263503778 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f83441504c0 0x7f83440c52c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8344070ea0 tx=0x7f833802ef10 comp rx=0 tx=0).stop 2026-02-17T11:09:57.508 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.496+0000 7f834976a640 1 -- 10.20.193.49:0/3263503778 shutdown_connections 2026-02-17T11:09:57.508 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.496+0000 7f834976a640 1 --2- 10.20.193.49:0/3263503778 >> v2:10.20.193.97:3300/0 conn(0x7f83440c7120 0x7f83440c7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:57.508 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.496+0000 7f834976a640 1 --2- 10.20.193.49:0/3263503778 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f83441504c0 0x7f83440c52c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:57.508 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.496+0000 7f834976a640 1 -- 10.20.193.49:0/3263503778 >> 10.20.193.49:0/3263503778 conn(0x7f83440c9f30 msgr2=0x7f83440ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:09:57.508 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.496+0000 7f834976a640 1 -- 10.20.193.49:0/3263503778 shutdown_connections 2026-02-17T11:09:57.508 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.496+0000 7f834976a640 1 -- 10.20.193.49:0/3263503778 wait complete. 2026-02-17T11:09:57.508 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.496+0000 7f834976a640 10 monclient: build_initial_monmap 2026-02-17T11:09:57.508 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.496+0000 7f834976a640 10 monclient: monmap: 2026-02-17T11:09:57.508 INFO:teuthology.misc.health.trial049.stderr:epoch 0 2026-02-17T11:09:57.509 INFO:teuthology.misc.health.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:09:57.509 INFO:teuthology.misc.health.trial049.stderr:last_changed 0.000000 2026-02-17T11:09:57.509 INFO:teuthology.misc.health.trial049.stderr:created 0.000000 2026-02-17T11:09:57.509 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:09:57.509 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:09:57.509 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:09:57.509 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:09:57.509 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:09:57.509 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:09:57.509 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.497+0000 7f834976a640 1 librados: starting msgr at 2026-02-17T11:09:57.509 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.497+0000 7f834976a640 1 librados: starting objecter 2026-02-17T11:09:57.509 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.497+0000 7f834976a640 1 Processor -- start 2026-02-17T11:09:57.510 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.497+0000 7f834976a640 1 -- start start 2026-02-17T11:09:57.510 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.497+0000 7f834976a640 1 librados: setting wanted keys 2026-02-17T11:09:57.510 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.497+0000 7f834976a640 1 librados: calling monclient init 2026-02-17T11:09:57.510 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.497+0000 7f834976a640 10 monclient: init 2026-02-17T11:09:57.510 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.497+0000 7f834976a640 10 monclient: _reopen_session rank -1 2026-02-17T11:09:57.510 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.497+0000 7f834976a640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:09:57.510 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.497+0000 7f834976a640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f83440c7120 0x7f83441f4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:09:57.510 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.497+0000 7f834976a640 10 monclient(hunting): picked mon.noname-a con 0x7f83440c7120 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:09:57.510 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.497+0000 7f834976a640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f83440c9050 0x7f834415b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:09:57.510 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.497+0000 7f834976a640 10 monclient(hunting): picked mon.noname-c con 0x7f83440c9050 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:09:57.510 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.497+0000 7f834976a640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f83441504c0 0x7f83440c3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:09:57.510 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.497+0000 7f834976a640 10 monclient(hunting): picked mon.noname-b con 0x7f83441504c0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:09:57.511 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.497+0000 7f834976a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:09:57.511 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.497+0000 7f834976a640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f83440c8b30 con 0x7f83440c7120 2026-02-17T11:09:57.511 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.497+0000 7f834976a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:09:57.511 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.497+0000 7f834976a640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f83440c8850 con 0x7f83441504c0 2026-02-17T11:09:57.511 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.497+0000 7f834976a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:09:57.511 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.497+0000 7f834976a640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f83441508a0 con 0x7f83440c9050 2026-02-17T11:09:57.511 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.497+0000 7f834976a640 10 monclient(hunting): _renew_subs 2026-02-17T11:09:57.511 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.497+0000 7f834976a640 10 monclient(hunting): authenticate will time out at 1074.160625s 2026-02-17T11:09:57.511 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.497+0000 7f8342ffd640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f83440c7120 0x7f83441f4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:09:57.511 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.497+0000 7f8342ffd640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f83440c7120 0x7f83441f4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:40208/0 (socket says 10.20.193.49:40208) 2026-02-17T11:09:57.511 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.497+0000 7f8342ffd640 1 -- 10.20.193.49:0/1321895618 learned_addr learned my addr 10.20.193.49:0/1321895618 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:09:57.511 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.497+0000 7f8342ffd640 10 monclient(hunting): get_auth_request con 0x7f83440c7120 auth_method 0 2026-02-17T11:09:57.512 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.497+0000 7f8342ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:09:57.512 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.497+0000 7f8342ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:09:57.512 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.497+0000 7f8342ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:09:57.512 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.498+0000 7f83427fc640 1 --2- 10.20.193.49:0/1321895618 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f83440c9050 0x7f834415b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:09:57.512 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.498+0000 7f83437fe640 1 --2- 10.20.193.49:0/1321895618 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f83441504c0 0x7f83440c3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:09:57.512 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.498+0000 7f8342ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:09:57.512 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.498+0000 7f8342ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:09:57.512 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.498+0000 7f8342ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:09:57.512 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.498+0000 7f83427fc640 10 monclient(hunting): get_auth_request con 0x7f83440c9050 auth_method 0 2026-02-17T11:09:57.512 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.498+0000 7f83427fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:09:57.512 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.498+0000 7f83427fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:09:57.512 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.498+0000 7f83427fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:09:57.512 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.498+0000 7f83437fe640 10 monclient(hunting): get_auth_request con 0x7f83441504c0 auth_method 0 2026-02-17T11:09:57.513 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.498+0000 7f83437fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:09:57.513 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.498+0000 7f83437fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:09:57.513 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.498+0000 7f83437fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:09:57.513 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.498+0000 7f83437fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:09:57.513 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.498+0000 7f83437fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:09:57.513 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.498+0000 7f83437fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:09:57.513 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.498+0000 7f83427fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:09:57.513 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.498+0000 7f83427fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:09:57.513 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.498+0000 7f83427fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:09:57.513 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.499+0000 7f8342ffd640 10 monclient(hunting): handle_auth_done global_id 4296 payload 824 2026-02-17T11:09:57.513 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.499+0000 7f8342ffd640 1 -- 10.20.193.49:0/1321895618 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f83440c9050 msgr2=0x7f834415b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:09:57.513 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.499+0000 7f8342ffd640 1 --2- 10.20.193.49:0/1321895618 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f83440c9050 0x7f834415b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:57.513 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.499+0000 7f8342ffd640 1 -- 10.20.193.49:0/1321895618 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f83441504c0 msgr2=0x7f83440c3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:09:57.514 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.499+0000 7f8342ffd640 1 --2- 10.20.193.49:0/1321895618 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f83441504c0 0x7f83440c3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:57.514 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.499+0000 7f8342ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:09:57.514 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.499+0000 7f8342ffd640 1 monclient: found mon.noname-a 2026-02-17T11:09:57.514 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.499+0000 7f8342ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:09:57.514 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.499+0000 7f8342ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:09:57.514 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.499+0000 7f8342ffd640 1 -- 10.20.193.49:0/1321895618 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83440ccdc0 con 0x7f83440c7120 2026-02-17T11:09:57.514 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.500+0000 7f8342ffd640 1 --2- 10.20.193.49:0/1321895618 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f83440c7120 0x7f83441f4610 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8338009130 tx=0x7f83380047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:09:57.514 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.500+0000 7f83237fe640 10 client.?.objecter ms_handle_connect 0x7f83440c7120 2026-02-17T11:09:57.514 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.500+0000 7f83237fe640 10 client.?.objecter resend_mon_ops 2026-02-17T11:09:57.514 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.502+0000 7f83237fe640 1 -- 10.20.193.49:0/1321895618 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f833803c040 con 0x7f83440c7120 2026-02-17T11:09:57.514 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.502+0000 7f83237fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:09:57.514 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.502+0000 7f83237fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:09:57.515 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.502+0000 7f83237fe640 10 monclient: dump: 2026-02-17T11:09:57.515 INFO:teuthology.misc.health.trial049.stderr:epoch 1 2026-02-17T11:09:57.515 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:09:57.515 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:57.515 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:57.515 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:09:57.515 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:09:57.515 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:09:57.515 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:09:57.515 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:09:57.515 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:09:57.515 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.502+0000 7f83237fe640 10 monclient: _finish_auth 0 2026-02-17T11:09:57.516 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.502+0000 7f83237fe640 10 monclient: _check_auth_tickets 2026-02-17T11:09:57.516 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.502+0000 7f83237fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:09:57.516 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.502+0000 7f83237fe640 1 -- 10.20.193.49:0/1321895618 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8338042610 con 0x7f83440c7120 2026-02-17T11:09:57.516 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.502+0000 7f83237fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:09:57.516 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.502+0000 7f83237fe640 1 -- 10.20.193.49:0/1321895618 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83380429e0 con 0x7f83440c7120 2026-02-17T11:09:57.516 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.502+0000 7f83237fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:09:57.516 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.502+0000 7f83237fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:09:57.516 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.502+0000 7f83237fe640 10 monclient: dump: 2026-02-17T11:09:57.516 INFO:teuthology.misc.health.trial049.stderr:epoch 1 2026-02-17T11:09:57.516 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:09:57.516 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:57.516 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:09:57.516 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:09:57.517 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:09:57.517 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:09:57.517 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:09:57.517 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:09:57.517 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:09:57.517 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.502+0000 7f83417fa640 4 set_mon_vals no callback set 2026-02-17T11:09:57.517 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.502+0000 7f834976a640 5 monclient: authenticate success, global_id 4296 2026-02-17T11:09:57.517 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.502+0000 7f834976a640 10 monclient: _renew_subs 2026-02-17T11:09:57.517 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.502+0000 7f834976a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:09:57.517 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.502+0000 7f834976a640 1 -- 10.20.193.49:0/1321895618 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8344144160 con 0x7f83440c7120 2026-02-17T11:09:57.517 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.502+0000 7f834976a640 10 client.4296.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:09:57.517 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.502+0000 7f834976a640 10 monclient: _renew_subs 2026-02-17T11:09:57.517 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.502+0000 7f834976a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:09:57.518 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.502+0000 7f834976a640 1 -- 10.20.193.49:0/1321895618 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f834406e970 con 0x7f83440c7120 2026-02-17T11:09:57.518 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.502+0000 7f834976a640 1 librados: init done 2026-02-17T11:09:57.518 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.502+0000 7f834976a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:09:57.518 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.502+0000 7f834976a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:09:57.518 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.502+0000 7f834976a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:09:57.518 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.502+0000 7f834976a640 1 -- 10.20.193.49:0/1321895618 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83440c7550 con 0x7f83440c7120 2026-02-17T11:09:57.519 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.514+0000 7f83237fe640 1 -- 10.20.193.49:0/1321895618 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 4) ==== 100001+0+0 (secure 0 0 0) 0x7f833804b450 con 0x7f83440c7120 2026-02-17T11:09:57.519 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.515+0000 7f83237fe640 1 --2- 10.20.193.49:0/1321895618 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f8310079130 0x7f831007b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:09:57.519 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.515+0000 7f83427fc640 1 --2- 10.20.193.49:0/1321895618 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f8310079130 0x7f831007b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:09:57.520 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.515+0000 7f83427fc640 10 monclient: get_auth_request con 0x7f8310079130 auth_method 0 2026-02-17T11:09:57.520 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.516+0000 7f83427fc640 1 --2- 10.20.193.49:0/1321895618 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f8310079130 0x7f831007b5f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f834414dc90 tx=0x7f832c009290 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:09:57.520 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.516+0000 7f83237fe640 10 client.4296.objecter ms_handle_connect 0x7f8310079130 2026-02-17T11:09:57.626 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.624+0000 7f83237fe640 1 -- 10.20.193.49:0/1321895618 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2565+0+0 (secure 0 0 0) 0x7f833802fba0 con 0x7f83440c7120 2026-02-17T11:09:57.626 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.624+0000 7f83237fe640 10 client.4296.objecter ms_dispatch2 0x7f8344000b90 osd_map(18..18 src has 1..18) 2026-02-17T11:09:57.627 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.624+0000 7f83237fe640 3 client.4296.objecter handle_osd_map got epochs [18,18] > 0 2026-02-17T11:09:57.627 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.624+0000 7f83237fe640 3 client.4296.objecter handle_osd_map decoding full epoch 18 2026-02-17T11:09:57.627 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.624+0000 7f83237fe640 20 client.4296.objecter dump_active .. 0 homeless 2026-02-17T11:09:57.627 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.624+0000 7f83237fe640 1 -- 10.20.193.49:0/1321895618 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f8338086a70 con 0x7f83440c7120 2026-02-17T11:09:57.627 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.624+0000 7f83237fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:09:57.627 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.624+0000 7f83237fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:09:57.714 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.712+0000 7f834976a640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:09:57.714 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.712+0000 7f834976a640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:09:57.714 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.712+0000 7f834976a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:09:57.714 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.712+0000 7f834976a640 1 -- 10.20.193.49:0/1321895618 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8344148a60 con 0x7f83440c7120 2026-02-17T11:09:57.725 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.723+0000 7f83237fe640 1 -- 10.20.193.49:0/1321895618 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12879 (secure 0 0 0) 0x7f833808ad70 con 0x7f83440c7120 2026-02-17T11:09:57.725 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.723+0000 7f83237fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:09:57.725 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.723+0000 7f83237fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:09:57.726 INFO:teuthology.misc.health.trial049.stdout: 2026-02-17T11:09:57.726 INFO:teuthology.misc.health.trial049.stdout:{"epoch":18,"fsid":"2799a57b-9ea3-46ae-8e91-1fe004a3651d","created":"2026-02-17T11:08:37.595499+0000","modified":"2026-02-17T11:08:43.985163+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T11:08:43.985163+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"30bc819e-140a-433e-b860-eaa88e282a11","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2f7f1f11-f256-4094-82a9-5d21882e6e0e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"26bd1274-fe52-42cb-876b-df9920880f95","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c78a5263-3b0d-4b22-a848-bcd6a1e4f6b0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f0fdfadd-2f39-4ad8-ac88-cb588c5e8ee0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"65872639-d6c0-482d-95d1-1d9f250781c9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"43091d3e-638d-4462-867b-cade02a315e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"890ae4d6-33c9-4515-a896-a689647330dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"f04abc9b-ed75-4582-b47d-07a9890f52bb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"7dfbb00a-6b89-4de3-9f30-6aadd91b4408","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"e497a4fd-a944-489b-9cb3-30f5acaeb53e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"7371d50f-36f9-477d-8d4d-853f481dd6db","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"3cf4fded-49db-4d95-956b-77acc868a3ed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"7dc53473-594f-4cfb-8444-eab205e2e0f9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"e8ab3e8f-29a8-4c79-bf86-d29543aac56a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"300a4696-aa54-4b47-b9f3-87dec719bcfa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:09:57.728 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.726+0000 7f834976a640 10 librados: watch_flush enter 2026-02-17T11:09:57.728 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.726+0000 7f834976a640 10 librados: watch_flush exit 2026-02-17T11:09:57.728 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.726+0000 7f834976a640 20 client.4296.objecter shutdown clearing up homeless session... 2026-02-17T11:09:57.728 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.726+0000 7f834976a640 10 client.4296.objecter successfully canceled tick 2026-02-17T11:09:57.729 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.726+0000 7f834976a640 1 -- 10.20.193.49:0/1321895618 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f8310079130 msgr2=0x7f831007b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:09:57.729 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.726+0000 7f834976a640 1 --2- 10.20.193.49:0/1321895618 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f8310079130 0x7f831007b5f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f834414dc90 tx=0x7f832c009290 comp rx=0 tx=0).stop 2026-02-17T11:09:57.729 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.726+0000 7f834976a640 10 monclient: shutdown 2026-02-17T11:09:57.729 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.726+0000 7f834976a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:09:57.729 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.726+0000 7f834976a640 1 -- 10.20.193.49:0/1321895618 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f83440c7120 msgr2=0x7f83441f4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:09:57.729 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.726+0000 7f834976a640 1 --2- 10.20.193.49:0/1321895618 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f83440c7120 0x7f83441f4610 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8338009130 tx=0x7f83380047c0 comp rx=0 tx=0).stop 2026-02-17T11:09:57.729 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.726+0000 7f834976a640 1 -- 10.20.193.49:0/1321895618 shutdown_connections 2026-02-17T11:09:57.729 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.726+0000 7f834976a640 1 --2- 10.20.193.49:0/1321895618 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f8310079130 0x7f831007b5f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:57.729 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.726+0000 7f834976a640 1 --2- 10.20.193.49:0/1321895618 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f83441504c0 0x7f83440c3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:57.729 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.726+0000 7f834976a640 1 --2- 10.20.193.49:0/1321895618 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f83440c9050 0x7f834415b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:57.729 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.726+0000 7f834976a640 1 --2- 10.20.193.49:0/1321895618 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f83440c7120 0x7f83441f4610 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:09:57.730 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.726+0000 7f834976a640 1 -- 10.20.193.49:0/1321895618 >> 10.20.193.49:0/1321895618 conn(0x7f83440c9f30 msgr2=0x7f83440c53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:09:57.730 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.726+0000 7f834976a640 1 -- 10.20.193.49:0/1321895618 shutdown_connections 2026-02-17T11:09:57.730 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.726+0000 7f834976a640 1 -- 10.20.193.49:0/1321895618 wait complete. 2026-02-17T11:09:57.730 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:09:57.726+0000 7f834976a640 1 librados: shutdown 2026-02-17T11:09:57.736 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-17T11:10:05.348 DEBUG:teuthology.orchestra.run.trial049:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T11:10:05.407 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.406+0000 7f7c99ddb640 10 monclient: get_monmap_and_config 2026-02-17T11:10:05.408 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.406+0000 7f7c99ddb640 10 monclient: build_initial_monmap 2026-02-17T11:10:05.408 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.406+0000 7f7c99ddb640 10 monclient: monmap: 2026-02-17T11:10:05.408 INFO:teuthology.misc.health.trial049.stderr:epoch 0 2026-02-17T11:10:05.408 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:05.408 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:10:05.406821+0000 2026-02-17T11:10:05.408 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:10:05.406821+0000 2026-02-17T11:10:05.408 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:05.408 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:10:05.408 INFO:teuthology.misc.health.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:05.408 INFO:teuthology.misc.health.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:05.409 INFO:teuthology.misc.health.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:05.409 INFO:teuthology.misc.health.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:05.409 INFO:teuthology.misc.health.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:05.409 INFO:teuthology.misc.health.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:05.409 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:10:05.412 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.406+0000 7f7c99ddb640 1 Processor -- start 2026-02-17T11:10:05.412 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.406+0000 7f7c99ddb640 1 -- start start 2026-02-17T11:10:05.412 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.406+0000 7f7c99ddb640 10 monclient: init 2026-02-17T11:10:05.412 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.407+0000 7f7c99ddb640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:05.412 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.407+0000 7f7c99ddb640 10 monclient: _add_conns ranks=[5,2,4,3,0,1] 2026-02-17T11:10:05.412 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.407+0000 7f7c99ddb640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f7c9406fcc0 0x7f7c940700a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:05.413 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.407+0000 7f7c99ddb640 10 monclient(hunting): picked mon.noname-c con 0x7f7c9406fcc0 addr v2:10.20.193.157:3300/0 2026-02-17T11:10:05.413 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.407+0000 7f7c99ddb640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f7c94159990 addr v1:10.20.193.157:6789/0 2026-02-17T11:10:05.413 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.407+0000 7f7c99ddb640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f7c940c8c00 0x7f7c94153320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:05.413 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.407+0000 7f7c99ddb640 10 monclient(hunting): picked mon.noname-b con 0x7f7c940c8c00 addr v2:10.20.193.97:3300/0 2026-02-17T11:10:05.413 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.407+0000 7f7c99ddb640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c9415a040 con 0x7f7c94159990 2026-02-17T11:10:05.413 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.407+0000 7f7c99ddb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:05.413 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.407+0000 7f7c99ddb640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f7c94159e00 con 0x7f7c940c8c00 2026-02-17T11:10:05.413 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.407+0000 7f7c99ddb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:05.413 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.407+0000 7f7c99ddb640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f7c9415a8e0 con 0x7f7c9406fcc0 2026-02-17T11:10:05.413 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.407+0000 7f7c99ddb640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:05.413 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.407+0000 7f7c99ddb640 10 monclient(hunting): authenticate will time out at 1082.070312s 2026-02-17T11:10:05.414 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.407+0000 7f7c995da640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f7c940c8c00 0x7f7c94153320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:05.414 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.407+0000 7f7c98dd9640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f7c9406fcc0 0x7f7c940700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:05.414 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.408+0000 7f7c8bfff640 1 --1- >> v1:10.20.193.157:6789/0 conn(0x7f7c94159990 0x7f7c940c84f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.157:6789/0 says I am v1:10.20.193.49:51454/0 (socket says 10.20.193.49:51454) 2026-02-17T11:10:05.414 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.408+0000 7f7c8bfff640 1 -- 10.20.193.49:0/1047464881 learned_addr learned my addr 10.20.193.49:0/1047464881 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:10:05.414 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.408+0000 7f7c995da640 10 monclient(hunting): get_auth_request con 0x7f7c940c8c00 auth_method 0 2026-02-17T11:10:05.414 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.408+0000 7f7c995da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:05.414 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.408+0000 7f7c995da640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:05.414 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.408+0000 7f7c995da640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:05.414 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.408+0000 7f7c98dd9640 10 monclient(hunting): get_auth_request con 0x7f7c9406fcc0 auth_method 0 2026-02-17T11:10:05.414 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.408+0000 7f7c98dd9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:05.414 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.408+0000 7f7c98dd9640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:05.414 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.408+0000 7f7c98dd9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:05.415 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.408+0000 7f7c995da640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:05.415 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.408+0000 7f7c995da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:05.415 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.408+0000 7f7c995da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:05.415 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.409+0000 7f7c98dd9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:05.415 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.409+0000 7f7c98dd9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:05.415 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.409+0000 7f7c98dd9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:05.415 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.409+0000 7f7c995da640 10 monclient(hunting): handle_auth_done global_id 4309 payload 274 2026-02-17T11:10:05.415 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.409+0000 7f7c995da640 1 -- 10.20.193.49:0/1047464881 >> v2:10.20.193.157:3300/0 conn(0x7f7c9406fcc0 msgr2=0x7f7c940700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:05.415 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.409+0000 7f7c995da640 1 --2- 10.20.193.49:0/1047464881 >> v2:10.20.193.157:3300/0 conn(0x7f7c9406fcc0 0x7f7c940700a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:05.415 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.409+0000 7f7c995da640 1 -- 10.20.193.49:0/1047464881 >> v1:10.20.193.157:6789/0 conn(0x7f7c94159990 legacy=0x7f7c940c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:05.415 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.409+0000 7f7c995da640 10 monclient: _finish_hunting 0 2026-02-17T11:10:05.415 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.409+0000 7f7c995da640 1 monclient: found mon.noname-b 2026-02-17T11:10:05.415 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.409+0000 7f7c995da640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:05.416 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.409+0000 7f7c995da640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:10:05.416 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.409+0000 7f7c995da640 1 -- 10.20.193.49:0/1047464881 --> v2:10.20.193.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c9415a320 con 0x7f7c940c8c00 2026-02-17T11:10:05.416 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.411+0000 7f7c995da640 1 --2- 10.20.193.49:0/1047464881 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f7c940c8c00 0x7f7c94153320 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7c940746b0 tx=0x7f7c9002f130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e60a84eb61126b07 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:05.422 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.413+0000 7f7c8b7fe640 1 -- 10.20.193.49:0/1047464881 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c9003c070 con 0x7f7c940c8c00 2026-02-17T11:10:05.422 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.413+0000 7f7c8b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:05.422 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.413+0000 7f7c8b7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:10:05.423 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.413+0000 7f7c8b7fe640 10 monclient: dump: 2026-02-17T11:10:05.423 INFO:teuthology.misc.health.trial049.stderr:epoch 1 2026-02-17T11:10:05.423 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:05.423 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:05.423 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:05.423 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:05.423 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:10:05.423 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:05.423 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:05.423 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:05.423 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:10:05.424 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.413+0000 7f7c8b7fe640 10 monclient: _finish_auth 0 2026-02-17T11:10:05.424 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.413+0000 7f7c8b7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:10:05.424 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.413+0000 7f7c8b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:05.424 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.413+0000 7f7c8b7fe640 1 -- 10.20.193.49:0/1047464881 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c9002fe40 con 0x7f7c940c8c00 2026-02-17T11:10:05.424 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.413+0000 7f7c99ddb640 5 monclient: authenticate success, global_id 4309 2026-02-17T11:10:05.424 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.413+0000 7f7c99ddb640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:10:05.424 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.413+0000 7f7c8b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:05.424 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.413+0000 7f7c8b7fe640 1 -- 10.20.193.49:0/1047464881 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c90037660 con 0x7f7c940c8c00 2026-02-17T11:10:05.424 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.413+0000 7f7c99ddb640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:05.424 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.413+0000 7f7c99ddb640 4 set_mon_vals no callback set 2026-02-17T11:10:05.424 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.413+0000 7f7c8b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:05.424 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.413+0000 7f7c8b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:05.425 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.413+0000 7f7c8b7fe640 10 monclient: dump: 2026-02-17T11:10:05.425 INFO:teuthology.misc.health.trial049.stderr:epoch 1 2026-02-17T11:10:05.425 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:05.425 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:05.425 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:05.425 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:05.425 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:10:05.425 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:05.425 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:05.425 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:05.425 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:10:05.425 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.413+0000 7f7c99ddb640 10 monclient: shutdown 2026-02-17T11:10:05.425 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.413+0000 7f7c99ddb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:05.426 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.413+0000 7f7c99ddb640 1 -- 10.20.193.49:0/1047464881 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f7c940c8c00 msgr2=0x7f7c94153320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:05.426 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.413+0000 7f7c99ddb640 1 --2- 10.20.193.49:0/1047464881 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f7c940c8c00 0x7f7c94153320 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7c940746b0 tx=0x7f7c9002f130 comp rx=0 tx=0).stop 2026-02-17T11:10:05.426 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.413+0000 7f7c99ddb640 1 -- 10.20.193.49:0/1047464881 shutdown_connections 2026-02-17T11:10:05.426 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.413+0000 7f7c99ddb640 1 --2- 10.20.193.49:0/1047464881 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f7c940c8c00 0x7f7c94153320 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:05.426 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.413+0000 7f7c99ddb640 1 --2- 10.20.193.49:0/1047464881 >> v2:10.20.193.157:3300/0 conn(0x7f7c9406fcc0 0x7f7c940700a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:05.426 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.413+0000 7f7c99ddb640 1 -- 10.20.193.49:0/1047464881 >> 10.20.193.49:0/1047464881 conn(0x7f7c940cd420 msgr2=0x7f7c940cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:05.426 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.413+0000 7f7c99ddb640 1 -- 10.20.193.49:0/1047464881 shutdown_connections 2026-02-17T11:10:05.426 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.413+0000 7f7c99ddb640 1 -- 10.20.193.49:0/1047464881 wait complete. 2026-02-17T11:10:05.426 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.414+0000 7f7c99ddb640 10 monclient: build_initial_monmap 2026-02-17T11:10:05.426 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.414+0000 7f7c99ddb640 10 monclient: monmap: 2026-02-17T11:10:05.426 INFO:teuthology.misc.health.trial049.stderr:epoch 0 2026-02-17T11:10:05.426 INFO:teuthology.misc.health.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:05.427 INFO:teuthology.misc.health.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:05.427 INFO:teuthology.misc.health.trial049.stderr:created 0.000000 2026-02-17T11:10:05.427 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:05.427 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:10:05.427 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:05.427 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:05.427 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:05.427 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:10:05.427 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.414+0000 7f7c99ddb640 1 librados: starting msgr at 2026-02-17T11:10:05.428 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.414+0000 7f7c99ddb640 1 librados: starting objecter 2026-02-17T11:10:05.428 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.414+0000 7f7c99ddb640 1 Processor -- start 2026-02-17T11:10:05.428 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.414+0000 7f7c99ddb640 1 -- start start 2026-02-17T11:10:05.428 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.414+0000 7f7c99ddb640 1 librados: setting wanted keys 2026-02-17T11:10:05.428 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.414+0000 7f7c99ddb640 1 librados: calling monclient init 2026-02-17T11:10:05.428 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.414+0000 7f7c99ddb640 10 monclient: init 2026-02-17T11:10:05.428 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.414+0000 7f7c99ddb640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:05.428 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.414+0000 7f7c99ddb640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:10:05.428 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.414+0000 7f7c99ddb640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f7c9406fcc0 0x7f7c94149f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:05.428 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.414+0000 7f7c99ddb640 10 monclient(hunting): picked mon.noname-a con 0x7f7c9406fcc0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:05.428 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.414+0000 7f7c99ddb640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f7c940c8c00 0x7f7c94145d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:05.428 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.414+0000 7f7c99ddb640 10 monclient(hunting): picked mon.noname-c con 0x7f7c940c8c00 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:05.429 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.414+0000 7f7c99ddb640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f7c94159990 0x7f7c940bf210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:05.429 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.414+0000 7f7c99ddb640 10 monclient(hunting): picked mon.noname-b con 0x7f7c94159990 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:05.429 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.414+0000 7f7c99ddb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:05.429 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.414+0000 7f7c99ddb640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7c940c7fd0 con 0x7f7c9406fcc0 2026-02-17T11:10:05.429 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.414+0000 7f7c99ddb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:05.429 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.414+0000 7f7c99ddb640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7c940c7cf0 con 0x7f7c94159990 2026-02-17T11:10:05.429 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.414+0000 7f7c99ddb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:05.429 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.414+0000 7f7c99ddb640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f7c94153860 con 0x7f7c940c8c00 2026-02-17T11:10:05.429 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.414+0000 7f7c99ddb640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:05.429 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.414+0000 7f7c99ddb640 10 monclient(hunting): authenticate will time out at 1082.077755s 2026-02-17T11:10:05.429 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.415+0000 7f7c98dd9640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f7c9406fcc0 0x7f7c94149f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:05.429 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.415+0000 7f7c995da640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f7c94159990 0x7f7c940bf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:05.429 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.415+0000 7f7c8bfff640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f7c940c8c00 0x7f7c94145d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:05.430 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.415+0000 7f7c98dd9640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f7c9406fcc0 0x7f7c94149f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:40218/0 (socket says 10.20.193.49:40218) 2026-02-17T11:10:05.430 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.415+0000 7f7c98dd9640 1 -- 10.20.193.49:0/3354170398 learned_addr learned my addr 10.20.193.49:0/3354170398 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:05.430 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.415+0000 7f7c98dd9640 10 monclient(hunting): get_auth_request con 0x7f7c9406fcc0 auth_method 0 2026-02-17T11:10:05.430 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.415+0000 7f7c98dd9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:05.430 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.415+0000 7f7c98dd9640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:05.430 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.415+0000 7f7c98dd9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:05.430 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.415+0000 7f7c995da640 10 monclient(hunting): get_auth_request con 0x7f7c94159990 auth_method 0 2026-02-17T11:10:05.430 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.415+0000 7f7c995da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:05.430 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.415+0000 7f7c995da640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:05.430 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.415+0000 7f7c995da640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:05.430 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.415+0000 7f7c8bfff640 10 monclient(hunting): get_auth_request con 0x7f7c940c8c00 auth_method 0 2026-02-17T11:10:05.431 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.415+0000 7f7c8bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:05.431 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.415+0000 7f7c8bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:05.431 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.415+0000 7f7c8bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:05.431 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.415+0000 7f7c98dd9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:05.431 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.415+0000 7f7c98dd9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:05.431 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.415+0000 7f7c98dd9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:05.431 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.415+0000 7f7c995da640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:05.431 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.415+0000 7f7c995da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:05.431 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.415+0000 7f7c995da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:05.431 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.415+0000 7f7c8bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:05.431 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.415+0000 7f7c8bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:05.431 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.415+0000 7f7c8bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:05.431 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.417+0000 7f7c995da640 10 monclient(hunting): handle_auth_done global_id 4312 payload 824 2026-02-17T11:10:05.432 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.417+0000 7f7c995da640 1 -- 10.20.193.49:0/3354170398 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f7c940c8c00 msgr2=0x7f7c94145d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:05.432 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.417+0000 7f7c995da640 1 --2- 10.20.193.49:0/3354170398 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f7c940c8c00 0x7f7c94145d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:05.432 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.417+0000 7f7c995da640 1 -- 10.20.193.49:0/3354170398 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f7c9406fcc0 msgr2=0x7f7c94149f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:05.432 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.417+0000 7f7c995da640 1 --2- 10.20.193.49:0/3354170398 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f7c9406fcc0 0x7f7c94149f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:05.432 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.417+0000 7f7c995da640 10 monclient: _finish_hunting 0 2026-02-17T11:10:05.432 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.417+0000 7f7c995da640 1 monclient: found mon.noname-b 2026-02-17T11:10:05.432 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.417+0000 7f7c995da640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:05.432 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.417+0000 7f7c995da640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:10:05.432 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.417+0000 7f7c995da640 1 -- 10.20.193.49:0/3354170398 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c9414b430 con 0x7f7c94159990 2026-02-17T11:10:05.432 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.418+0000 7f7c995da640 1 --2- 10.20.193.49:0/3354170398 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f7c94159990 0x7f7c940bf210 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7c90036000 tx=0x7f7c90004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:05.432 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.418+0000 7f7c897fa640 10 client.?.objecter ms_handle_connect 0x7f7c94159990 2026-02-17T11:10:05.433 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.418+0000 7f7c897fa640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:05.433 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.419+0000 7f7c897fa640 1 -- 10.20.193.49:0/3354170398 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c90047020 con 0x7f7c94159990 2026-02-17T11:10:05.433 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.419+0000 7f7c897fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:05.433 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.419+0000 7f7c897fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:10:05.433 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.419+0000 7f7c897fa640 10 monclient: dump: 2026-02-17T11:10:05.433 INFO:teuthology.misc.health.trial049.stderr:epoch 1 2026-02-17T11:10:05.433 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:05.433 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:05.433 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:05.433 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:05.433 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:10:05.433 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:05.434 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:05.434 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:05.434 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:10:05.434 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.419+0000 7f7c897fa640 10 monclient: _finish_auth 0 2026-02-17T11:10:05.434 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.419+0000 7f7c897fa640 10 monclient: _check_auth_tickets 2026-02-17T11:10:05.434 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.419+0000 7f7c897fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:05.434 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.419+0000 7f7c99ddb640 5 monclient: authenticate success, global_id 4312 2026-02-17T11:10:05.434 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.419+0000 7f7c99ddb640 10 monclient: _renew_subs 2026-02-17T11:10:05.434 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.419+0000 7f7c99ddb640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:05.434 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.419+0000 7f7c99ddb640 1 -- 10.20.193.49:0/3354170398 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c9414b710 con 0x7f7c94159990 2026-02-17T11:10:05.434 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.419+0000 7f7c99ddb640 10 client.4312.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:05.434 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.419+0000 7f7c99ddb640 10 monclient: _renew_subs 2026-02-17T11:10:05.434 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.419+0000 7f7c99ddb640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:05.435 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.419+0000 7f7c99ddb640 1 -- 10.20.193.49:0/3354170398 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c940bea10 con 0x7f7c94159990 2026-02-17T11:10:05.435 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.419+0000 7f7c99ddb640 1 librados: init done 2026-02-17T11:10:05.435 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.420+0000 7f7c99ddb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:05.435 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.420+0000 7f7c99ddb640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:05.435 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.420+0000 7f7c99ddb640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:05.435 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.420+0000 7f7c99ddb640 1 -- 10.20.193.49:0/3354170398 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c94153c40 con 0x7f7c94159990 2026-02-17T11:10:05.435 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.420+0000 7f7c897fa640 1 -- 10.20.193.49:0/3354170398 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c90042470 con 0x7f7c94159990 2026-02-17T11:10:05.435 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.420+0000 7f7c897fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:05.435 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.420+0000 7f7c897fa640 1 -- 10.20.193.49:0/3354170398 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c9003c040 con 0x7f7c94159990 2026-02-17T11:10:05.435 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.420+0000 7f7c897fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:05.435 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.420+0000 7f7c897fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:05.435 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.420+0000 7f7c8affd640 4 set_mon_vals no callback set 2026-02-17T11:10:05.435 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.420+0000 7f7c897fa640 10 monclient: dump: 2026-02-17T11:10:05.436 INFO:teuthology.misc.health.trial049.stderr:epoch 1 2026-02-17T11:10:05.436 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:05.436 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:05.436 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:05.436 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:05.436 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:10:05.436 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:05.436 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:05.436 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:05.436 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:10:05.535 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.533+0000 7f7c897fa640 1 -- 10.20.193.49:0/3354170398 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 4) ==== 100001+0+0 (secure 0 0 0) 0x7f7c90042860 con 0x7f7c94159990 2026-02-17T11:10:05.536 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.534+0000 7f7c897fa640 1 --2- 10.20.193.49:0/3354170398 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f7c640790b0 0x7f7c6407b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:05.536 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.534+0000 7f7c98dd9640 1 --2- 10.20.193.49:0/3354170398 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f7c640790b0 0x7f7c6407b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:05.536 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.534+0000 7f7c98dd9640 10 monclient: get_auth_request con 0x7f7c640790b0 auth_method 0 2026-02-17T11:10:05.536 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.534+0000 7f7c897fa640 10 client.4312.objecter ms_handle_connect 0x7f7c640790b0 2026-02-17T11:10:05.536 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.534+0000 7f7c98dd9640 1 --2- 10.20.193.49:0/3354170398 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f7c640790b0 0x7f7c6407b570 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7c9414d1f0 tx=0x7f7c84009290 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:05.545 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.543+0000 7f7c897fa640 1 -- 10.20.193.49:0/3354170398 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2565+0+0 (secure 0 0 0) 0x7f7c90083ec0 con 0x7f7c94159990 2026-02-17T11:10:05.545 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.543+0000 7f7c897fa640 10 client.4312.objecter ms_dispatch2 0x7f7c94000b90 osd_map(18..18 src has 1..18) 2026-02-17T11:10:05.545 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.543+0000 7f7c897fa640 3 client.4312.objecter handle_osd_map got epochs [18,18] > 0 2026-02-17T11:10:05.545 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.543+0000 7f7c897fa640 3 client.4312.objecter handle_osd_map decoding full epoch 18 2026-02-17T11:10:05.545 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.543+0000 7f7c897fa640 20 client.4312.objecter dump_active .. 0 homeless 2026-02-17T11:10:05.545 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.543+0000 7f7c897fa640 1 -- 10.20.193.49:0/3354170398 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f7c90051030 con 0x7f7c94159990 2026-02-17T11:10:05.545 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.543+0000 7f7c897fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:05.545 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.543+0000 7f7c897fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:05.634 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.632+0000 7f7c99ddb640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:10:05.634 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.632+0000 7f7c99ddb640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:10:05.634 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.632+0000 7f7c99ddb640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:05.634 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.632+0000 7f7c99ddb640 1 -- 10.20.193.49:0/3354170398 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7c940c9960 con 0x7f7c94159990 2026-02-17T11:10:05.650 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.649+0000 7f7c897fa640 1 -- 10.20.193.49:0/3354170398 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12879 (secure 0 0 0) 0x7f7c90087e80 con 0x7f7c94159990 2026-02-17T11:10:05.650 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.649+0000 7f7c897fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:10:05.651 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.649+0000 7f7c897fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:05.651 INFO:teuthology.misc.health.trial049.stdout: 2026-02-17T11:10:05.651 INFO:teuthology.misc.health.trial049.stdout:{"epoch":18,"fsid":"2799a57b-9ea3-46ae-8e91-1fe004a3651d","created":"2026-02-17T11:08:37.595499+0000","modified":"2026-02-17T11:08:43.985163+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T11:08:43.985163+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"30bc819e-140a-433e-b860-eaa88e282a11","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2f7f1f11-f256-4094-82a9-5d21882e6e0e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"26bd1274-fe52-42cb-876b-df9920880f95","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c78a5263-3b0d-4b22-a848-bcd6a1e4f6b0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f0fdfadd-2f39-4ad8-ac88-cb588c5e8ee0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"65872639-d6c0-482d-95d1-1d9f250781c9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"43091d3e-638d-4462-867b-cade02a315e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"890ae4d6-33c9-4515-a896-a689647330dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"f04abc9b-ed75-4582-b47d-07a9890f52bb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"7dfbb00a-6b89-4de3-9f30-6aadd91b4408","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"e497a4fd-a944-489b-9cb3-30f5acaeb53e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"7371d50f-36f9-477d-8d4d-853f481dd6db","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"3cf4fded-49db-4d95-956b-77acc868a3ed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"7dc53473-594f-4cfb-8444-eab205e2e0f9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"e8ab3e8f-29a8-4c79-bf86-d29543aac56a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"300a4696-aa54-4b47-b9f3-87dec719bcfa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:10:05.654 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.651+0000 7f7c99ddb640 10 librados: watch_flush enter 2026-02-17T11:10:05.654 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.651+0000 7f7c99ddb640 10 librados: watch_flush exit 2026-02-17T11:10:05.654 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.651+0000 7f7c99ddb640 20 client.4312.objecter shutdown clearing up homeless session... 2026-02-17T11:10:05.654 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.651+0000 7f7c99ddb640 10 client.4312.objecter successfully canceled tick 2026-02-17T11:10:05.654 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.651+0000 7f7c99ddb640 1 -- 10.20.193.49:0/3354170398 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f7c640790b0 msgr2=0x7f7c6407b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:05.654 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.651+0000 7f7c99ddb640 1 --2- 10.20.193.49:0/3354170398 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f7c640790b0 0x7f7c6407b570 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7c9414d1f0 tx=0x7f7c84009290 comp rx=0 tx=0).stop 2026-02-17T11:10:05.654 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.651+0000 7f7c99ddb640 10 monclient: shutdown 2026-02-17T11:10:05.655 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.651+0000 7f7c99ddb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:05.655 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.651+0000 7f7c99ddb640 1 -- 10.20.193.49:0/3354170398 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f7c94159990 msgr2=0x7f7c940bf210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:05.655 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.651+0000 7f7c99ddb640 1 --2- 10.20.193.49:0/3354170398 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f7c94159990 0x7f7c940bf210 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7c90036000 tx=0x7f7c90004b40 comp rx=0 tx=0).stop 2026-02-17T11:10:05.655 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.651+0000 7f7c99ddb640 1 -- 10.20.193.49:0/3354170398 shutdown_connections 2026-02-17T11:10:05.655 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.651+0000 7f7c99ddb640 1 --2- 10.20.193.49:0/3354170398 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f7c640790b0 0x7f7c6407b570 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:05.655 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.651+0000 7f7c99ddb640 1 --2- 10.20.193.49:0/3354170398 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f7c94159990 0x7f7c940bf210 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:05.655 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.651+0000 7f7c99ddb640 1 --2- 10.20.193.49:0/3354170398 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f7c940c8c00 0x7f7c94145d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:05.656 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.651+0000 7f7c99ddb640 1 --2- 10.20.193.49:0/3354170398 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f7c9406fcc0 0x7f7c94149f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:05.656 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.651+0000 7f7c99ddb640 1 -- 10.20.193.49:0/3354170398 >> 10.20.193.49:0/3354170398 conn(0x7f7c940cd420 msgr2=0x7f7c941530f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:05.656 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.651+0000 7f7c99ddb640 1 -- 10.20.193.49:0/3354170398 shutdown_connections 2026-02-17T11:10:05.656 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.651+0000 7f7c99ddb640 1 -- 10.20.193.49:0/3354170398 wait complete. 2026-02-17T11:10:05.656 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:05.651+0000 7f7c99ddb640 1 librados: shutdown 2026-02-17T11:10:05.662 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-17T11:10:11.602 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:01:57.084 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:10:11.604 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:01:57.086 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:10:11.611 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:01:57.093 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:10:11.632 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:01:57.074 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:10:11.635 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:01:57.111 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:10:11.636 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:01:57.078 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:10:11.636 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:01:57.112 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:10:11.643 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:01:57.085 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:10:11.644 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:01:57.120 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:10:13.274 DEBUG:teuthology.orchestra.run.trial049:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T11:10:13.336 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.333+0000 7fedc04b6640 10 monclient: get_monmap_and_config 2026-02-17T11:10:13.336 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.333+0000 7fedc04b6640 10 monclient: build_initial_monmap 2026-02-17T11:10:13.336 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.333+0000 7fedc04b6640 10 monclient: monmap: 2026-02-17T11:10:13.336 INFO:teuthology.misc.health.trial049.stderr:epoch 0 2026-02-17T11:10:13.336 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:13.336 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:10:13.335278+0000 2026-02-17T11:10:13.336 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:10:13.335278+0000 2026-02-17T11:10:13.336 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:13.336 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:10:13.336 INFO:teuthology.misc.health.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:13.336 INFO:teuthology.misc.health.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:13.336 INFO:teuthology.misc.health.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:13.336 INFO:teuthology.misc.health.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:13.336 INFO:teuthology.misc.health.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:13.336 INFO:teuthology.misc.health.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:13.336 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:10:13.336 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.334+0000 7fedc04b6640 1 Processor -- start 2026-02-17T11:10:13.337 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.334+0000 7fedc04b6640 1 -- start start 2026-02-17T11:10:13.337 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.334+0000 7fedc04b6640 10 monclient: init 2026-02-17T11:10:13.338 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.334+0000 7fedc04b6640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:13.339 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.334+0000 7fedc04b6640 10 monclient: _add_conns ranks=[3,2,4,0,5,1] 2026-02-17T11:10:13.339 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.335+0000 7fedc04b6640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fedb80c8950 0x7fedb80c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:13.339 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.335+0000 7fedc04b6640 10 monclient(hunting): picked mon.noname-a con 0x7fedb80c8950 addr v2:10.20.193.49:3300/0 2026-02-17T11:10:13.339 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.335+0000 7fedc04b6640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fedb81595b0 addr v1:10.20.193.157:6789/0 2026-02-17T11:10:13.339 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.335+0000 7fedc04b6640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7fedb81523f0 0x7fedb8159a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:13.339 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.335+0000 7fedc04b6640 10 monclient(hunting): picked mon.noname-b con 0x7fedb81523f0 addr v2:10.20.193.97:3300/0 2026-02-17T11:10:13.339 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.335+0000 7fedc04b6640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedb8074ce0 con 0x7fedb81595b0 2026-02-17T11:10:13.339 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.335+0000 7fedc04b6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:13.339 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.335+0000 7fedc04b6640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7fedb8073960 con 0x7fedb80c8950 2026-02-17T11:10:13.339 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.335+0000 7fedc04b6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:13.339 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.335+0000 7fedc04b6640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7fedb8073c40 con 0x7fedb81523f0 2026-02-17T11:10:13.339 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.335+0000 7fedc04b6640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:13.339 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.335+0000 7fedc04b6640 10 monclient(hunting): authenticate will time out at 1089.999053s 2026-02-17T11:10:13.339 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.335+0000 7fedbda2a640 1 --1- >> v1:10.20.193.157:6789/0 conn(0x7fedb81595b0 0x7fedb8151ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.157:6789/0 says I am v1:10.20.193.49:38420/0 (socket says 10.20.193.49:38420) 2026-02-17T11:10:13.339 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.335+0000 7fedbda2a640 1 -- 10.20.193.49:0/897520382 learned_addr learned my addr 10.20.193.49:0/897520382 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:10:13.339 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.335+0000 7fedbe22b640 1 --2- 10.20.193.49:0/897520382 >> v2:10.20.193.49:3300/0 conn(0x7fedb80c8950 0x7fedb80c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:13.339 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.335+0000 7fedbea2c640 1 --2- 10.20.193.49:0/897520382 >> v2:10.20.193.97:3300/0 conn(0x7fedb81523f0 0x7fedb8159a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:13.340 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.335+0000 7fedbe22b640 10 monclient(hunting): get_auth_request con 0x7fedb80c8950 auth_method 0 2026-02-17T11:10:13.340 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.335+0000 7fedbe22b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:13.340 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.335+0000 7fedbe22b640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:13.340 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.335+0000 7fedbe22b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:13.340 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.335+0000 7fedbea2c640 10 monclient(hunting): get_auth_request con 0x7fedb81523f0 auth_method 0 2026-02-17T11:10:13.340 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.335+0000 7fedbea2c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:13.340 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.335+0000 7fedbea2c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:13.340 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.335+0000 7fedbea2c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:13.340 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.336+0000 7fedbe22b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:13.340 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.336+0000 7fedbe22b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:13.340 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.336+0000 7fedbe22b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:13.340 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.336+0000 7fedbea2c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:13.340 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.336+0000 7fedbea2c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:13.340 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.336+0000 7fedbea2c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:13.341 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.337+0000 7fedbd229640 1 -- 10.20.193.49:0/897520382 <== mon.2 v1:10.20.193.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3192817080 0 0) 0x7fedb8074ce0 con 0x7fedb81595b0 2026-02-17T11:10:13.341 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.337+0000 7fedbd229640 10 monclient(hunting): _negotiate 2026-02-17T11:10:13.341 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.337+0000 7fedbd229640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:13.341 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.337+0000 7fedbd229640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:13.341 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.337+0000 7fedbd229640 10 monclient(hunting): my global_id is 4322 2026-02-17T11:10:13.341 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.337+0000 7fedbd229640 1 -- 10.20.193.49:0/897520382 --> v1:10.20.193.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feda0003620 con 0x7fedb81595b0 2026-02-17T11:10:13.341 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.337+0000 7fedbe22b640 10 monclient(hunting): handle_auth_done global_id 4302 payload 274 2026-02-17T11:10:13.342 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.337+0000 7fedbe22b640 1 -- 10.20.193.49:0/897520382 >> v2:10.20.193.97:3300/0 conn(0x7fedb81523f0 msgr2=0x7fedb8159a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:13.342 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.337+0000 7fedbe22b640 1 --2- 10.20.193.49:0/897520382 >> v2:10.20.193.97:3300/0 conn(0x7fedb81523f0 0x7fedb8159a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:13.342 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.337+0000 7fedbe22b640 1 -- 10.20.193.49:0/897520382 >> v1:10.20.193.157:6789/0 conn(0x7fedb81595b0 legacy=0x7fedb8151ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:13.342 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.337+0000 7fedbe22b640 10 monclient: _finish_hunting 0 2026-02-17T11:10:13.342 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.337+0000 7fedbe22b640 1 monclient: found mon.noname-a 2026-02-17T11:10:13.342 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.337+0000 7fedbe22b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:13.342 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.337+0000 7fedbe22b640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:10:13.342 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.337+0000 7fedbe22b640 1 -- 10.20.193.49:0/897520382 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedb8073f20 con 0x7fedb80c8950 2026-02-17T11:10:13.342 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.338+0000 7fedbe22b640 1 --2- 10.20.193.49:0/897520382 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fedb80c8950 0x7fedb80c8d30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fedb8073500 tx=0x7feda802ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae3585a13edcc36c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:13.345 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.340+0000 7fedbd229640 1 -- 10.20.193.49:0/897520382 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda803c070 con 0x7fedb80c8950 2026-02-17T11:10:13.345 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.340+0000 7fedbd229640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:13.345 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.340+0000 7fedbd229640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:10:13.345 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.340+0000 7fedbd229640 10 monclient: dump: 2026-02-17T11:10:13.345 INFO:teuthology.misc.health.trial049.stderr:epoch 1 2026-02-17T11:10:13.345 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:13.345 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:13.345 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:13.345 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:13.345 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:10:13.345 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:13.345 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:13.345 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:13.345 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:10:13.346 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.340+0000 7fedbd229640 10 monclient: _finish_auth 0 2026-02-17T11:10:13.346 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.340+0000 7fedbd229640 10 monclient: _check_auth_tickets 2026-02-17T11:10:13.346 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.340+0000 7fedbd229640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:13.346 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.340+0000 7fedbd229640 1 -- 10.20.193.49:0/897520382 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feda802fa60 con 0x7fedb80c8950 2026-02-17T11:10:13.346 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.340+0000 7fedbd229640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:13.346 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.340+0000 7fedc04b6640 5 monclient: authenticate success, global_id 4302 2026-02-17T11:10:13.346 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.340+0000 7fedbd229640 1 -- 10.20.193.49:0/897520382 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda802fe30 con 0x7fedb80c8950 2026-02-17T11:10:13.346 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.340+0000 7fedc04b6640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:13.346 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.340+0000 7fedc04b6640 4 set_mon_vals no callback set 2026-02-17T11:10:13.346 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.340+0000 7fedbd229640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:13.346 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.340+0000 7fedbd229640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:10:13.346 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.340+0000 7fedbd229640 10 monclient: dump: 2026-02-17T11:10:13.346 INFO:teuthology.misc.health.trial049.stderr:epoch 1 2026-02-17T11:10:13.346 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:13.346 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:13.346 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:13.346 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:13.346 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:10:13.346 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:13.346 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:13.347 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:13.347 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:10:13.347 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.340+0000 7fedc04b6640 10 monclient: shutdown 2026-02-17T11:10:13.347 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.340+0000 7fedc04b6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:13.347 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.340+0000 7fedc04b6640 1 -- 10.20.193.49:0/897520382 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fedb80c8950 msgr2=0x7fedb80c8d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:13.347 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.340+0000 7fedc04b6640 1 --2- 10.20.193.49:0/897520382 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fedb80c8950 0x7fedb80c8d30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fedb8073500 tx=0x7feda802ed50 comp rx=0 tx=0).stop 2026-02-17T11:10:13.347 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.340+0000 7fedc04b6640 1 -- 10.20.193.49:0/897520382 shutdown_connections 2026-02-17T11:10:13.347 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.340+0000 7fedc04b6640 1 --2- 10.20.193.49:0/897520382 >> v2:10.20.193.97:3300/0 conn(0x7fedb81523f0 0x7fedb8159a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:13.347 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.340+0000 7fedc04b6640 1 --2- 10.20.193.49:0/897520382 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fedb80c8950 0x7fedb80c8d30 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:13.347 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.340+0000 7fedc04b6640 1 -- 10.20.193.49:0/897520382 >> 10.20.193.49:0/897520382 conn(0x7fedb80c9f30 msgr2=0x7fedb80ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:13.347 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.340+0000 7fedc04b6640 1 -- 10.20.193.49:0/897520382 shutdown_connections 2026-02-17T11:10:13.347 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.340+0000 7fedc04b6640 1 -- 10.20.193.49:0/897520382 wait complete. 2026-02-17T11:10:13.347 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.341+0000 7fedc04b6640 10 monclient: build_initial_monmap 2026-02-17T11:10:13.347 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.341+0000 7fedc04b6640 10 monclient: monmap: 2026-02-17T11:10:13.347 INFO:teuthology.misc.health.trial049.stderr:epoch 0 2026-02-17T11:10:13.347 INFO:teuthology.misc.health.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:13.347 INFO:teuthology.misc.health.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:13.347 INFO:teuthology.misc.health.trial049.stderr:created 0.000000 2026-02-17T11:10:13.347 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:13.347 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:10:13.347 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:13.348 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:13.348 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:13.348 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:10:13.348 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.341+0000 7fedc04b6640 1 librados: starting msgr at 2026-02-17T11:10:13.348 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.341+0000 7fedc04b6640 1 librados: starting objecter 2026-02-17T11:10:13.348 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.341+0000 7fedc04b6640 1 Processor -- start 2026-02-17T11:10:13.348 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.341+0000 7fedc04b6640 1 -- start start 2026-02-17T11:10:13.348 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.341+0000 7fedc04b6640 1 librados: setting wanted keys 2026-02-17T11:10:13.348 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.341+0000 7fedc04b6640 1 librados: calling monclient init 2026-02-17T11:10:13.348 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.341+0000 7fedc04b6640 10 monclient: init 2026-02-17T11:10:13.348 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.341+0000 7fedc04b6640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:13.348 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.341+0000 7fedc04b6640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:10:13.348 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.341+0000 7fedc04b6640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fedb80c8950 0x7fedb80c6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:13.348 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.341+0000 7fedc04b6640 10 monclient(hunting): picked mon.noname-a con 0x7fedb80c8950 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:13.348 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.341+0000 7fedc04b6640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fedb81523f0 0x7fedb80c68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:13.348 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.341+0000 7fedc04b6640 10 monclient(hunting): picked mon.noname-c con 0x7fedb81523f0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:13.348 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.341+0000 7fedc04b6640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fedb81595b0 0x7fedb81504f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:13.348 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.341+0000 7fedc04b6640 10 monclient(hunting): picked mon.noname-b con 0x7fedb81595b0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:13.348 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.341+0000 7fedc04b6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:13.348 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.341+0000 7fedc04b6640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fedb80744e0 con 0x7fedb80c8950 2026-02-17T11:10:13.348 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.341+0000 7fedc04b6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:13.348 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.341+0000 7fedc04b6640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fedb8152800 con 0x7fedb81595b0 2026-02-17T11:10:13.348 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.341+0000 7fedc04b6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:13.349 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.341+0000 7fedc04b6640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fedb80747c0 con 0x7fedb81523f0 2026-02-17T11:10:13.349 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.341+0000 7fedc04b6640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:13.349 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.341+0000 7fedc04b6640 10 monclient(hunting): authenticate will time out at 1090.005796s 2026-02-17T11:10:13.349 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.342+0000 7fedbe22b640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fedb80c8950 0x7fedb80c6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:13.349 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.342+0000 7fedbe22b640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fedb80c8950 0x7fedb80c6380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:55448/0 (socket says 10.20.193.49:55448) 2026-02-17T11:10:13.349 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.342+0000 7fedbe22b640 1 -- 10.20.193.49:0/3949748124 learned_addr learned my addr 10.20.193.49:0/3949748124 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:13.349 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.342+0000 7fedbe22b640 10 monclient(hunting): get_auth_request con 0x7fedb80c8950 auth_method 0 2026-02-17T11:10:13.349 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.342+0000 7fedbe22b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:13.349 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.342+0000 7fedbe22b640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:13.349 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.342+0000 7fedbe22b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:13.349 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.342+0000 7fedbda2a640 1 --2- 10.20.193.49:0/3949748124 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fedb81523f0 0x7fedb80c68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:13.349 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.342+0000 7fedbea2c640 1 --2- 10.20.193.49:0/3949748124 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fedb81595b0 0x7fedb81504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:13.349 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.342+0000 7fedbda2a640 10 monclient(hunting): get_auth_request con 0x7fedb81523f0 auth_method 0 2026-02-17T11:10:13.349 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.342+0000 7fedbda2a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:13.349 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.342+0000 7fedbda2a640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:13.349 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.342+0000 7fedbda2a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:13.349 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.342+0000 7fedbe22b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:13.349 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.342+0000 7fedbe22b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:13.349 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.342+0000 7fedbe22b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:13.349 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.342+0000 7fedbea2c640 10 monclient(hunting): get_auth_request con 0x7fedb81595b0 auth_method 0 2026-02-17T11:10:13.349 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.342+0000 7fedbea2c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:13.349 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.342+0000 7fedbea2c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:13.350 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.342+0000 7fedbea2c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:13.350 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.342+0000 7fedbda2a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:13.350 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.342+0000 7fedbda2a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:13.350 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.342+0000 7fedbda2a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:13.350 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.342+0000 7fedbea2c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:13.350 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.342+0000 7fedbea2c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:13.350 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.342+0000 7fedbea2c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:13.351 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.344+0000 7fedbe22b640 10 monclient(hunting): handle_auth_done global_id 4305 payload 824 2026-02-17T11:10:13.351 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.344+0000 7fedbe22b640 1 -- 10.20.193.49:0/3949748124 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fedb81523f0 msgr2=0x7fedb80c68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:13.351 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.344+0000 7fedbe22b640 1 --2- 10.20.193.49:0/3949748124 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fedb81523f0 0x7fedb80c68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:13.351 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.344+0000 7fedbe22b640 1 -- 10.20.193.49:0/3949748124 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fedb81595b0 msgr2=0x7fedb81504f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:13.351 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.344+0000 7fedbe22b640 1 --2- 10.20.193.49:0/3949748124 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fedb81595b0 0x7fedb81504f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:13.351 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.344+0000 7fedbe22b640 10 monclient: _finish_hunting 0 2026-02-17T11:10:13.351 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.344+0000 7fedbe22b640 1 monclient: found mon.noname-a 2026-02-17T11:10:13.352 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.344+0000 7fedbe22b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:13.352 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.344+0000 7fedbe22b640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:10:13.352 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.344+0000 7fedbe22b640 1 -- 10.20.193.49:0/3949748124 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedb8153c00 con 0x7fedb80c8950 2026-02-17T11:10:13.352 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.345+0000 7fedbe22b640 1 --2- 10.20.193.49:0/3949748124 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fedb80c8950 0x7fedb80c6380 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7feda802f280 tx=0x7feda80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:13.352 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.345+0000 7fed9effd640 10 client.?.objecter ms_handle_connect 0x7fedb80c8950 2026-02-17T11:10:13.352 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.345+0000 7fed9effd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:13.352 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.347+0000 7fed9effd640 1 -- 10.20.193.49:0/3949748124 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda803c040 con 0x7fedb80c8950 2026-02-17T11:10:13.352 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.347+0000 7fed9effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:13.352 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.347+0000 7fed9effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:10:13.352 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.347+0000 7fed9effd640 10 monclient: dump: 2026-02-17T11:10:13.352 INFO:teuthology.misc.health.trial049.stderr:epoch 1 2026-02-17T11:10:13.352 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:13.352 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:13.352 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:13.352 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:13.352 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:10:13.352 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:13.352 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:13.352 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:13.352 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:10:13.352 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.347+0000 7fed9effd640 10 monclient: _finish_auth 0 2026-02-17T11:10:13.352 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.347+0000 7fed9effd640 10 monclient: _check_auth_tickets 2026-02-17T11:10:13.352 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.347+0000 7fed9effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:13.352 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.347+0000 7fed9effd640 1 -- 10.20.193.49:0/3949748124 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feda8042430 con 0x7fedb80c8950 2026-02-17T11:10:13.352 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.347+0000 7fed9effd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:13.353 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.347+0000 7fedc04b6640 5 monclient: authenticate success, global_id 4305 2026-02-17T11:10:13.353 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.347+0000 7fedbca28640 4 set_mon_vals no callback set 2026-02-17T11:10:13.353 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.347+0000 7fed9effd640 1 -- 10.20.193.49:0/3949748124 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda8042820 con 0x7fedb80c8950 2026-02-17T11:10:13.353 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.347+0000 7fedc04b6640 10 monclient: _renew_subs 2026-02-17T11:10:13.353 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.347+0000 7fedc04b6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:13.353 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.347+0000 7fedc04b6640 1 -- 10.20.193.49:0/3949748124 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedb8153ee0 con 0x7fedb80c8950 2026-02-17T11:10:13.353 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.347+0000 7fed9effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:13.353 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.347+0000 7fed9effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:10:13.353 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.347+0000 7fed9effd640 10 monclient: dump: 2026-02-17T11:10:13.353 INFO:teuthology.misc.health.trial049.stderr:epoch 1 2026-02-17T11:10:13.353 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:13.353 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:13.353 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:13.353 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:13.353 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:10:13.353 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:13.353 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:13.353 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:13.353 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:10:13.353 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.347+0000 7fedc04b6640 10 client.4305.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:13.353 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.347+0000 7fedc04b6640 10 monclient: _renew_subs 2026-02-17T11:10:13.353 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.347+0000 7fedc04b6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:13.353 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.347+0000 7fedc04b6640 1 -- 10.20.193.49:0/3949748124 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedb81544a0 con 0x7fedb80c8950 2026-02-17T11:10:13.353 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.347+0000 7fedc04b6640 1 librados: init done 2026-02-17T11:10:13.353 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.347+0000 7fedc04b6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:13.353 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.347+0000 7fedc04b6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:13.354 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.347+0000 7fedc04b6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:13.354 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.347+0000 7fedc04b6640 1 -- 10.20.193.49:0/3949748124 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedb8073550 con 0x7fedb80c8950 2026-02-17T11:10:13.361 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.359+0000 7fed9effd640 1 -- 10.20.193.49:0/3949748124 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 4) ==== 100001+0+0 (secure 0 0 0) 0x7feda80429c0 con 0x7fedb80c8950 2026-02-17T11:10:13.362 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.359+0000 7fed9effd640 1 --2- 10.20.193.49:0/3949748124 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fed880790b0 0x7fed8807b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:13.362 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.360+0000 7fedbda2a640 1 --2- 10.20.193.49:0/3949748124 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fed880790b0 0x7fed8807b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:13.362 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.360+0000 7fedbda2a640 10 monclient: get_auth_request con 0x7fed880790b0 auth_method 0 2026-02-17T11:10:13.362 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.360+0000 7fedbda2a640 1 --2- 10.20.193.49:0/3949748124 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fed880790b0 0x7fed8807b570 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fedac007b60 tx=0x7fedac007ab0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:13.362 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.360+0000 7fed9effd640 10 client.4305.objecter ms_handle_connect 0x7fed880790b0 2026-02-17T11:10:13.364 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.362+0000 7fed9effd640 1 -- 10.20.193.49:0/3949748124 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2565+0+0 (secure 0 0 0) 0x7feda8042ce0 con 0x7fedb80c8950 2026-02-17T11:10:13.364 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.362+0000 7fed9effd640 10 client.4305.objecter ms_dispatch2 0x7fedb8000b90 osd_map(18..18 src has 1..18) 2026-02-17T11:10:13.364 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.362+0000 7fed9effd640 3 client.4305.objecter handle_osd_map got epochs [18,18] > 0 2026-02-17T11:10:13.365 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.362+0000 7fed9effd640 3 client.4305.objecter handle_osd_map decoding full epoch 18 2026-02-17T11:10:13.365 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.362+0000 7fed9effd640 20 client.4305.objecter dump_active .. 0 homeless 2026-02-17T11:10:13.471 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.468+0000 7fed9effd640 1 -- 10.20.193.49:0/3949748124 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7feda8087940 con 0x7fedb80c8950 2026-02-17T11:10:13.471 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.468+0000 7fed9effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:13.471 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.468+0000 7fed9effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:13.558 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.556+0000 7fedc04b6640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:10:13.558 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.556+0000 7fedc04b6640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:10:13.559 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.556+0000 7fedc04b6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:13.559 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.556+0000 7fedc04b6640 1 -- 10.20.193.49:0/3949748124 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fedb8155ae0 con 0x7fedb80c8950 2026-02-17T11:10:13.574 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.572+0000 7fed9effd640 1 -- 10.20.193.49:0/3949748124 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12879 (secure 0 0 0) 0x7feda808bc40 con 0x7fedb80c8950 2026-02-17T11:10:13.575 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.572+0000 7fed9effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:10:13.575 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.572+0000 7fed9effd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:13.575 INFO:teuthology.misc.health.trial049.stdout: 2026-02-17T11:10:13.575 INFO:teuthology.misc.health.trial049.stdout:{"epoch":18,"fsid":"2799a57b-9ea3-46ae-8e91-1fe004a3651d","created":"2026-02-17T11:08:37.595499+0000","modified":"2026-02-17T11:08:43.985163+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T11:08:43.985163+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"30bc819e-140a-433e-b860-eaa88e282a11","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2f7f1f11-f256-4094-82a9-5d21882e6e0e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"26bd1274-fe52-42cb-876b-df9920880f95","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c78a5263-3b0d-4b22-a848-bcd6a1e4f6b0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f0fdfadd-2f39-4ad8-ac88-cb588c5e8ee0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"65872639-d6c0-482d-95d1-1d9f250781c9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"43091d3e-638d-4462-867b-cade02a315e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"890ae4d6-33c9-4515-a896-a689647330dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"f04abc9b-ed75-4582-b47d-07a9890f52bb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"7dfbb00a-6b89-4de3-9f30-6aadd91b4408","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"e497a4fd-a944-489b-9cb3-30f5acaeb53e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"7371d50f-36f9-477d-8d4d-853f481dd6db","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"3cf4fded-49db-4d95-956b-77acc868a3ed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"7dc53473-594f-4cfb-8444-eab205e2e0f9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"e8ab3e8f-29a8-4c79-bf86-d29543aac56a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"300a4696-aa54-4b47-b9f3-87dec719bcfa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:10:13.578 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.574+0000 7fedc04b6640 10 librados: watch_flush enter 2026-02-17T11:10:13.578 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.574+0000 7fedc04b6640 10 librados: watch_flush exit 2026-02-17T11:10:13.578 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.574+0000 7fedc04b6640 20 client.4305.objecter shutdown clearing up homeless session... 2026-02-17T11:10:13.578 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.574+0000 7fedc04b6640 10 client.4305.objecter successfully canceled tick 2026-02-17T11:10:13.578 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.574+0000 7fedc04b6640 1 -- 10.20.193.49:0/3949748124 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fed880790b0 msgr2=0x7fed8807b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:13.578 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.574+0000 7fedc04b6640 1 --2- 10.20.193.49:0/3949748124 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fed880790b0 0x7fed8807b570 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fedac007b60 tx=0x7fedac007ab0 comp rx=0 tx=0).stop 2026-02-17T11:10:13.578 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.574+0000 7fedc04b6640 10 monclient: shutdown 2026-02-17T11:10:13.578 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.574+0000 7fedc04b6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:13.578 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.574+0000 7fedc04b6640 1 -- 10.20.193.49:0/3949748124 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fedb80c8950 msgr2=0x7fedb80c6380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:13.579 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.574+0000 7fedc04b6640 1 --2- 10.20.193.49:0/3949748124 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fedb80c8950 0x7fedb80c6380 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7feda802f280 tx=0x7feda80047c0 comp rx=0 tx=0).stop 2026-02-17T11:10:13.579 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.574+0000 7fedc04b6640 1 -- 10.20.193.49:0/3949748124 shutdown_connections 2026-02-17T11:10:13.579 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.574+0000 7fedc04b6640 1 --2- 10.20.193.49:0/3949748124 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fed880790b0 0x7fed8807b570 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:13.579 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.574+0000 7fedc04b6640 1 --2- 10.20.193.49:0/3949748124 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fedb81595b0 0x7fedb81504f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:13.579 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.574+0000 7fedc04b6640 1 --2- 10.20.193.49:0/3949748124 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fedb81523f0 0x7fedb80c68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:13.579 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.574+0000 7fedc04b6640 1 --2- 10.20.193.49:0/3949748124 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fedb80c8950 0x7fedb80c6380 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:13.579 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.574+0000 7fedc04b6640 1 -- 10.20.193.49:0/3949748124 >> 10.20.193.49:0/3949748124 conn(0x7fedb80c9f30 msgr2=0x7fedb8070970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:13.579 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.574+0000 7fedc04b6640 1 -- 10.20.193.49:0/3949748124 shutdown_connections 2026-02-17T11:10:13.579 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.574+0000 7fedc04b6640 1 -- 10.20.193.49:0/3949748124 wait complete. 2026-02-17T11:10:13.579 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:13.574+0000 7fedc04b6640 1 librados: shutdown 2026-02-17T11:10:13.585 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-17T11:10:15.900 INFO:tasks.ceph.osd.8.trial049.stderr:2026-02-17T11:10:15.893+0000 77b6940 -1 osd.8 0 log_to_monitors true 2026-02-17T11:10:16.069 INFO:tasks.ceph.osd.7.trial162.stderr:2026-02-17T11:10:16.066+0000 77b6940 -1 osd.7 0 log_to_monitors true 2026-02-17T11:10:16.096 INFO:tasks.ceph.osd.4.trial049.stderr:2026-02-17T11:10:16.092+0000 77b6940 -1 osd.4 0 log_to_monitors true 2026-02-17T11:10:16.596 INFO:tasks.ceph.osd.11.trial162.stderr:2026-02-17T11:10:16.591+0000 77b6940 -1 osd.11 0 log_to_monitors true 2026-02-17T11:10:16.599 INFO:tasks.ceph.osd.3.trial162.stderr:2026-02-17T11:10:16.596+0000 77b6940 -1 osd.3 0 log_to_monitors true 2026-02-17T11:10:16.637 INFO:tasks.ceph.osd.12.trial049.stderr:2026-02-17T11:10:16.630+0000 77b6940 -1 osd.12 0 log_to_monitors true 2026-02-17T11:10:16.640 INFO:tasks.ceph.osd.1.trial097.stderr:2026-02-17T11:10:16.638+0000 77b6940 -1 osd.1 0 log_to_monitors true 2026-02-17T11:10:16.674 INFO:tasks.ceph.osd.15.trial162.stderr:2026-02-17T11:10:16.668+0000 77b6940 -1 osd.15 0 log_to_monitors true 2026-02-17T11:10:16.733 INFO:tasks.ceph.osd.5.trial097.stderr:2026-02-17T11:10:16.728+0000 77b6940 -1 osd.5 0 log_to_monitors true 2026-02-17T11:10:16.823 INFO:tasks.ceph.osd.9.trial097.stderr:2026-02-17T11:10:16.820+0000 77b6940 -1 osd.9 0 log_to_monitors true 2026-02-17T11:10:16.835 INFO:tasks.ceph.osd.0.trial049.stderr:2026-02-17T11:10:16.831+0000 77b6940 -1 osd.0 0 log_to_monitors true 2026-02-17T11:10:17.130 INFO:tasks.ceph.osd.2.trial157.stderr:2026-02-17T11:10:17.127+0000 77b6940 -1 osd.2 0 log_to_monitors true 2026-02-17T11:10:17.147 INFO:tasks.ceph.osd.13.trial097.stderr:2026-02-17T11:10:17.145+0000 77b6940 -1 osd.13 0 log_to_monitors true 2026-02-17T11:10:17.765 INFO:tasks.ceph.osd.6.trial157.stderr:2026-02-17T11:10:17.761+0000 77b6940 -1 osd.6 0 log_to_monitors true 2026-02-17T11:10:18.079 INFO:tasks.ceph.osd.4.trial049.stderr:2026-02-17T11:10:18.075+0000 ce9c640 -1 osd.4 0 waiting for initial osdmap 2026-02-17T11:10:18.197 INFO:tasks.ceph.osd.8.trial049.stderr:2026-02-17T11:10:18.193+0000 ce9c640 -1 osd.8 0 waiting for initial osdmap 2026-02-17T11:10:18.241 INFO:tasks.ceph.osd.14.trial157.stderr:2026-02-17T11:10:18.238+0000 77b6940 -1 osd.14 0 log_to_monitors true 2026-02-17T11:10:18.243 INFO:tasks.ceph.osd.10.trial157.stderr:2026-02-17T11:10:18.240+0000 77b6940 -1 osd.10 0 log_to_monitors true 2026-02-17T11:10:18.343 INFO:tasks.ceph.osd.4.trial049.stderr:2026-02-17T11:10:18.334+0000 11c74640 -1 osd.4 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T11:10:18.382 INFO:tasks.ceph.osd.8.trial049.stderr:2026-02-17T11:10:18.374+0000 11c74640 -1 osd.8 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T11:10:19.112 INFO:tasks.ceph.osd.15.trial162.stderr:2026-02-17T11:10:19.108+0000 ce9c640 -1 osd.15 0 waiting for initial osdmap 2026-02-17T11:10:19.119 INFO:tasks.ceph.osd.1.trial097.stderr:2026-02-17T11:10:19.116+0000 deb0640 -1 osd.1 0 waiting for initial osdmap 2026-02-17T11:10:19.124 INFO:tasks.ceph.osd.9.trial097.stderr:2026-02-17T11:10:19.122+0000 ce9c640 -1 osd.9 0 waiting for initial osdmap 2026-02-17T11:10:19.132 INFO:tasks.ceph.osd.5.trial097.stderr:2026-02-17T11:10:19.131+0000 ce9c640 -1 osd.5 0 waiting for initial osdmap 2026-02-17T11:10:19.146 INFO:tasks.ceph.osd.13.trial097.stderr:2026-02-17T11:10:19.144+0000 deb0640 -1 osd.13 0 waiting for initial osdmap 2026-02-17T11:10:19.147 INFO:tasks.ceph.osd.2.trial157.stderr:2026-02-17T11:10:19.145+0000 ce9c640 -1 osd.2 0 waiting for initial osdmap 2026-02-17T11:10:19.338 INFO:tasks.ceph.osd.15.trial162.stderr:2026-02-17T11:10:19.330+0000 11c74640 -1 osd.15 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T11:10:19.351 INFO:tasks.ceph.osd.5.trial097.stderr:2026-02-17T11:10:19.344+0000 11c74640 -1 osd.5 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T11:10:19.353 INFO:tasks.ceph.osd.1.trial097.stderr:2026-02-17T11:10:19.346+0000 11c74640 -1 osd.1 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T11:10:19.365 INFO:tasks.ceph.osd.9.trial097.stderr:2026-02-17T11:10:19.358+0000 11c74640 -1 osd.9 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T11:10:19.381 INFO:tasks.ceph.osd.13.trial097.stderr:2026-02-17T11:10:19.374+0000 11c74640 -1 osd.13 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T11:10:19.446 INFO:tasks.ceph.osd.2.trial157.stderr:2026-02-17T11:10:19.438+0000 11c74640 -1 osd.2 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T11:10:20.132 INFO:tasks.ceph.osd.14.trial157.stderr:2026-02-17T11:10:20.129+0000 ce9c640 -1 osd.14 0 waiting for initial osdmap 2026-02-17T11:10:20.377 INFO:tasks.ceph.osd.14.trial157.stderr:2026-02-17T11:10:20.370+0000 11c74640 -1 osd.14 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T11:10:21.194 DEBUG:teuthology.orchestra.run.trial049:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T11:10:21.255 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.251+0000 7fc559a29640 10 monclient: get_monmap_and_config 2026-02-17T11:10:21.255 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.251+0000 7fc559a29640 10 monclient: build_initial_monmap 2026-02-17T11:10:21.256 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.251+0000 7fc559a29640 10 monclient: monmap: 2026-02-17T11:10:21.256 INFO:teuthology.misc.health.trial049.stderr:epoch 0 2026-02-17T11:10:21.256 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:21.256 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:10:21.253155+0000 2026-02-17T11:10:21.256 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:10:21.253155+0000 2026-02-17T11:10:21.256 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:21.256 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:10:21.256 INFO:teuthology.misc.health.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:21.256 INFO:teuthology.misc.health.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:21.256 INFO:teuthology.misc.health.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:21.257 INFO:teuthology.misc.health.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:21.257 INFO:teuthology.misc.health.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:21.257 INFO:teuthology.misc.health.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:21.257 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:10:21.257 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.252+0000 7fc559a29640 1 Processor -- start 2026-02-17T11:10:21.257 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.252+0000 7fc559a29640 1 -- start start 2026-02-17T11:10:21.257 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.252+0000 7fc559a29640 10 monclient: init 2026-02-17T11:10:21.257 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.252+0000 7fc559a29640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:21.257 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.252+0000 7fc559a29640 10 monclient: _add_conns ranks=[3,0,1,5,4,2] 2026-02-17T11:10:21.257 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.252+0000 7fc559a29640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fc5541504c0 0x7fc5540c52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:21.257 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.252+0000 7fc559a29640 10 monclient(hunting): picked mon.noname-a con 0x7fc5541504c0 addr v2:10.20.193.49:3300/0 2026-02-17T11:10:21.257 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.252+0000 7fc559a29640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc5540c7120 addr v1:10.20.193.49:6789/0 2026-02-17T11:10:21.258 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.252+0000 7fc559a29640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fc5540c7550 addr v1:10.20.193.97:6789/0 2026-02-17T11:10:21.258 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.252+0000 7fc559a29640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5540c7930 con 0x7fc5540c7120 2026-02-17T11:10:21.258 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.252+0000 7fc559a29640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc55415def0 con 0x7fc5540c7550 2026-02-17T11:10:21.258 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.252+0000 7fc559a29640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:21.258 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.252+0000 7fc559a29640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7fc5540c5c70 con 0x7fc5541504c0 2026-02-17T11:10:21.258 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.252+0000 7fc559a29640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:21.258 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.252+0000 7fc559a29640 10 monclient(hunting): authenticate will time out at 1097.916624s 2026-02-17T11:10:21.258 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.253+0000 7fc5537fe640 1 --1- >> v1:10.20.193.97:6789/0 conn(0x7fc5540c7550 0x7fc55415d080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.97:6789/0 says I am v1:10.20.193.49:57320/0 (socket says 10.20.193.49:57320) 2026-02-17T11:10:21.258 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.253+0000 7fc5537fe640 1 -- 10.20.193.49:0/2542452814 learned_addr learned my addr 10.20.193.49:0/2542452814 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:10:21.259 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.255+0000 7fc552ffd640 1 --2- 10.20.193.49:0/2542452814 >> v2:10.20.193.49:3300/0 conn(0x7fc5541504c0 0x7fc5540c52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:21.259 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.256+0000 7fc552ffd640 10 monclient(hunting): get_auth_request con 0x7fc5541504c0 auth_method 0 2026-02-17T11:10:21.259 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.256+0000 7fc552ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:21.259 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.256+0000 7fc552ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:21.260 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.256+0000 7fc552ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:21.260 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.258+0000 7fc552ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:21.261 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.258+0000 7fc552ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:21.261 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.258+0000 7fc552ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:21.262 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.259+0000 7fc552ffd640 10 monclient(hunting): handle_auth_done global_id 4356 payload 274 2026-02-17T11:10:21.262 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.259+0000 7fc552ffd640 1 -- 10.20.193.49:0/2542452814 >> v1:10.20.193.97:6789/0 conn(0x7fc5540c7550 legacy=0x7fc55415d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:21.262 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.259+0000 7fc552ffd640 1 -- 10.20.193.49:0/2542452814 >> v1:10.20.193.49:6789/0 conn(0x7fc5540c7120 legacy=0x7fc5540c9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:21.262 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.259+0000 7fc552ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:10:21.262 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.259+0000 7fc552ffd640 1 monclient: found mon.noname-a 2026-02-17T11:10:21.262 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.259+0000 7fc552ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:21.263 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.259+0000 7fc552ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:10:21.263 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.259+0000 7fc552ffd640 1 -- 10.20.193.49:0/2542452814 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5540c7fb0 con 0x7fc5541504c0 2026-02-17T11:10:21.267 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.264+0000 7fc552ffd640 1 --2- 10.20.193.49:0/2542452814 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc5541504c0 0x7fc5540c52c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc5480098a0 tx=0x7fc54802ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5adc89691e1218cc server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:21.311 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.308+0000 7fc551ffb640 1 -- 10.20.193.49:0/2542452814 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc54803c070 con 0x7fc5541504c0 2026-02-17T11:10:21.311 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.308+0000 7fc551ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:21.311 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.308+0000 7fc551ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:10:21.312 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.308+0000 7fc551ffb640 10 monclient: dump: 2026-02-17T11:10:21.312 INFO:teuthology.misc.health.trial049.stderr:epoch 1 2026-02-17T11:10:21.312 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:21.312 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:21.312 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:21.312 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:21.312 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:10:21.312 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:21.312 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:21.312 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:21.312 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:10:21.312 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.308+0000 7fc551ffb640 10 monclient: _finish_auth 0 2026-02-17T11:10:21.313 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.308+0000 7fc551ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:10:21.313 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.308+0000 7fc551ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:21.313 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.308+0000 7fc559a29640 5 monclient: authenticate success, global_id 4356 2026-02-17T11:10:21.313 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.308+0000 7fc559a29640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:10:21.317 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.311+0000 7fc551ffb640 1 -- 10.20.193.49:0/2542452814 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc54802fca0 con 0x7fc5541504c0 2026-02-17T11:10:21.317 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.311+0000 7fc551ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:21.317 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.311+0000 7fc551ffb640 1 -- 10.20.193.49:0/2542452814 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc548037660 con 0x7fc5541504c0 2026-02-17T11:10:21.317 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.311+0000 7fc551ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:21.317 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.311+0000 7fc551ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:10:21.317 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.311+0000 7fc551ffb640 10 monclient: dump: 2026-02-17T11:10:21.318 INFO:teuthology.misc.health.trial049.stderr:epoch 1 2026-02-17T11:10:21.318 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:21.318 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:21.318 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:21.318 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:21.318 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:10:21.318 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:21.318 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:21.318 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:21.318 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:10:21.318 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.311+0000 7fc559a29640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:21.318 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.311+0000 7fc559a29640 4 set_mon_vals no callback set 2026-02-17T11:10:21.319 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.311+0000 7fc559a29640 10 monclient: shutdown 2026-02-17T11:10:21.319 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.311+0000 7fc559a29640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:21.319 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.311+0000 7fc559a29640 1 -- 10.20.193.49:0/2542452814 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc5541504c0 msgr2=0x7fc5540c52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:21.319 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.311+0000 7fc559a29640 1 --2- 10.20.193.49:0/2542452814 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc5541504c0 0x7fc5540c52c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc5480098a0 tx=0x7fc54802ef90 comp rx=0 tx=0).stop 2026-02-17T11:10:21.319 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.311+0000 7fc559a29640 1 -- 10.20.193.49:0/2542452814 shutdown_connections 2026-02-17T11:10:21.319 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.311+0000 7fc559a29640 1 --2- 10.20.193.49:0/2542452814 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc5541504c0 0x7fc5540c52c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:21.319 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.311+0000 7fc559a29640 1 -- 10.20.193.49:0/2542452814 >> 10.20.193.49:0/2542452814 conn(0x7fc5540c9f30 msgr2=0x7fc5540ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:21.319 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.311+0000 7fc559a29640 1 -- 10.20.193.49:0/2542452814 shutdown_connections 2026-02-17T11:10:21.319 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.311+0000 7fc559a29640 1 -- 10.20.193.49:0/2542452814 wait complete. 2026-02-17T11:10:21.319 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.312+0000 7fc559a29640 10 monclient: build_initial_monmap 2026-02-17T11:10:21.319 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.312+0000 7fc559a29640 10 monclient: monmap: 2026-02-17T11:10:21.319 INFO:teuthology.misc.health.trial049.stderr:epoch 0 2026-02-17T11:10:21.320 INFO:teuthology.misc.health.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:21.320 INFO:teuthology.misc.health.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:21.320 INFO:teuthology.misc.health.trial049.stderr:created 0.000000 2026-02-17T11:10:21.320 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:21.320 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:10:21.320 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:21.320 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:21.320 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:21.320 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:10:21.320 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.312+0000 7fc559a29640 1 librados: starting msgr at 2026-02-17T11:10:21.320 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.312+0000 7fc559a29640 1 librados: starting objecter 2026-02-17T11:10:21.321 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.312+0000 7fc559a29640 1 Processor -- start 2026-02-17T11:10:21.321 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.312+0000 7fc559a29640 1 -- start start 2026-02-17T11:10:21.321 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.312+0000 7fc559a29640 1 librados: setting wanted keys 2026-02-17T11:10:21.321 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.312+0000 7fc559a29640 1 librados: calling monclient init 2026-02-17T11:10:21.321 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.312+0000 7fc559a29640 10 monclient: init 2026-02-17T11:10:21.321 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.312+0000 7fc559a29640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:21.321 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.312+0000 7fc559a29640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:10:21.321 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.312+0000 7fc559a29640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc5540c7120 0x7fc5540c3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:21.321 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.313+0000 7fc559a29640 10 monclient(hunting): picked mon.noname-c con 0x7fc5540c7120 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:21.321 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.313+0000 7fc559a29640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc5540c7550 0x7fc554144ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:21.321 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.313+0000 7fc559a29640 10 monclient(hunting): picked mon.noname-a con 0x7fc5540c7550 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:21.321 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.313+0000 7fc559a29640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc5541504c0 0x7fc554140250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:21.322 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.313+0000 7fc559a29640 10 monclient(hunting): picked mon.noname-b con 0x7fc5541504c0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:21.322 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.313+0000 7fc559a29640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:21.322 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.313+0000 7fc559a29640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc5540c8850 con 0x7fc5540c7550 2026-02-17T11:10:21.322 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.313+0000 7fc559a29640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:21.322 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.313+0000 7fc559a29640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc5540c8570 con 0x7fc5541504c0 2026-02-17T11:10:21.322 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.313+0000 7fc559a29640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:21.322 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.313+0000 7fc559a29640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc5540c8b30 con 0x7fc5540c7120 2026-02-17T11:10:21.322 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.313+0000 7fc559a29640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:21.322 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.313+0000 7fc559a29640 10 monclient(hunting): authenticate will time out at 1097.977029s 2026-02-17T11:10:21.323 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.313+0000 7fc5527fc640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc5540c7550 0x7fc554144ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:21.323 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.313+0000 7fc5527fc640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc5540c7550 0x7fc554144ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:45338/0 (socket says 10.20.193.49:45338) 2026-02-17T11:10:21.323 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.313+0000 7fc5527fc640 1 -- 10.20.193.49:0/2527434157 learned_addr learned my addr 10.20.193.49:0/2527434157 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:21.323 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.313+0000 7fc5527fc640 10 monclient(hunting): get_auth_request con 0x7fc5540c7550 auth_method 0 2026-02-17T11:10:21.323 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.313+0000 7fc5527fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:21.323 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.313+0000 7fc5527fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:21.323 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.313+0000 7fc5527fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:21.323 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.313+0000 7fc5537fe640 1 --2- 10.20.193.49:0/2527434157 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc5541504c0 0x7fc554140250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:21.323 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.313+0000 7fc5537fe640 10 monclient(hunting): get_auth_request con 0x7fc5541504c0 auth_method 0 2026-02-17T11:10:21.323 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.313+0000 7fc5537fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:21.323 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.313+0000 7fc5537fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:21.323 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.313+0000 7fc5537fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:21.324 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.313+0000 7fc5527fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:21.324 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.313+0000 7fc5527fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:21.324 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.313+0000 7fc5527fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:21.324 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.314+0000 7fc5537fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:21.324 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.314+0000 7fc5537fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:21.324 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.314+0000 7fc5537fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:21.326 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.315+0000 7fc5527fc640 10 monclient(hunting): handle_auth_done global_id 4359 payload 824 2026-02-17T11:10:21.326 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.315+0000 7fc5527fc640 1 -- 10.20.193.49:0/2527434157 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc5540c7120 msgr2=0x7fc5540c3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:21.327 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.315+0000 7fc5527fc640 1 --2- 10.20.193.49:0/2527434157 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc5540c7120 0x7fc5540c3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:21.327 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.315+0000 7fc5527fc640 1 -- 10.20.193.49:0/2527434157 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc5541504c0 msgr2=0x7fc554140250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:21.327 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.315+0000 7fc5527fc640 1 --2- 10.20.193.49:0/2527434157 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc5541504c0 0x7fc554140250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:21.327 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.315+0000 7fc5527fc640 10 monclient: _finish_hunting 0 2026-02-17T11:10:21.327 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.315+0000 7fc5527fc640 1 monclient: found mon.noname-a 2026-02-17T11:10:21.327 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.315+0000 7fc5527fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:21.327 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.315+0000 7fc5527fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:10:21.327 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.315+0000 7fc5527fc640 1 -- 10.20.193.49:0/2527434157 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5541f8200 con 0x7fc5540c7550 2026-02-17T11:10:21.327 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.316+0000 7fc5527fc640 1 --2- 10.20.193.49:0/2527434157 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc5540c7550 0x7fc554144ae0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc53c00c580 tx=0x7fc53c00ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:21.327 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.316+0000 7fc52bfff640 10 client.?.objecter ms_handle_connect 0x7fc5540c7550 2026-02-17T11:10:21.327 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.316+0000 7fc52bfff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:21.328 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.318+0000 7fc52bfff640 1 -- 10.20.193.49:0/2527434157 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53c017070 con 0x7fc5540c7550 2026-02-17T11:10:21.328 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.318+0000 7fc52bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:21.328 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.318+0000 7fc52bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:10:21.328 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.318+0000 7fc52bfff640 10 monclient: dump: 2026-02-17T11:10:21.328 INFO:teuthology.misc.health.trial049.stderr:epoch 1 2026-02-17T11:10:21.328 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:21.328 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:21.328 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:21.328 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:21.328 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:10:21.329 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:21.329 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:21.329 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:21.329 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:10:21.329 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.318+0000 7fc52bfff640 10 monclient: _finish_auth 0 2026-02-17T11:10:21.329 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.318+0000 7fc52bfff640 10 monclient: _check_auth_tickets 2026-02-17T11:10:21.329 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.318+0000 7fc52bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:21.329 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.318+0000 7fc52bfff640 1 -- 10.20.193.49:0/2527434157 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc53c0052d0 con 0x7fc5540c7550 2026-02-17T11:10:21.329 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.318+0000 7fc559a29640 5 monclient: authenticate success, global_id 4359 2026-02-17T11:10:21.329 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.318+0000 7fc559a29640 10 monclient: _renew_subs 2026-02-17T11:10:21.329 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.318+0000 7fc559a29640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:21.329 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.318+0000 7fc559a29640 1 -- 10.20.193.49:0/2527434157 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5541f3f00 con 0x7fc5540c7550 2026-02-17T11:10:21.329 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.318+0000 7fc52bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:21.330 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.318+0000 7fc52bfff640 1 -- 10.20.193.49:0/2527434157 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53c0036b0 con 0x7fc5540c7550 2026-02-17T11:10:21.330 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.318+0000 7fc52bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:21.330 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.318+0000 7fc52bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:10:21.330 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.318+0000 7fc5517fa640 4 set_mon_vals no callback set 2026-02-17T11:10:21.330 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.318+0000 7fc52bfff640 10 monclient: dump: 2026-02-17T11:10:21.330 INFO:teuthology.misc.health.trial049.stderr:epoch 1 2026-02-17T11:10:21.330 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:21.330 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:21.330 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:21.330 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:21.330 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:10:21.330 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:21.330 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:21.331 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:21.331 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:10:21.331 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.318+0000 7fc559a29640 10 client.4359.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:21.331 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.318+0000 7fc559a29640 10 monclient: _renew_subs 2026-02-17T11:10:21.331 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.318+0000 7fc559a29640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:21.331 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.318+0000 7fc559a29640 1 -- 10.20.193.49:0/2527434157 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5541f44c0 con 0x7fc5540c7550 2026-02-17T11:10:21.331 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.318+0000 7fc559a29640 1 librados: init done 2026-02-17T11:10:21.331 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.318+0000 7fc559a29640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:21.331 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.318+0000 7fc559a29640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:21.331 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.318+0000 7fc559a29640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:21.331 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.318+0000 7fc559a29640 1 -- 10.20.193.49:0/2527434157 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc55406a1b0 con 0x7fc5540c7550 2026-02-17T11:10:21.332 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.329+0000 7fc52bfff640 1 -- 10.20.193.49:0/2527434157 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 4) ==== 100001+0+0 (secure 0 0 0) 0x7fc53c003850 con 0x7fc5540c7550 2026-02-17T11:10:21.332 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.330+0000 7fc52bfff640 1 --2- 10.20.193.49:0/2527434157 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fc5240790e0 0x7fc52407b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:21.333 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.330+0000 7fc552ffd640 1 --2- 10.20.193.49:0/2527434157 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fc5240790e0 0x7fc52407b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:21.333 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.330+0000 7fc552ffd640 10 monclient: get_auth_request con 0x7fc5240790e0 auth_method 0 2026-02-17T11:10:21.333 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.331+0000 7fc52bfff640 10 client.4359.objecter ms_handle_connect 0x7fc5240790e0 2026-02-17T11:10:21.333 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.331+0000 7fc552ffd640 1 --2- 10.20.193.49:0/2527434157 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fc5240790e0 0x7fc52407b5a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc548039000 tx=0x7fc548031000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:21.395 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.393+0000 7fc52bfff640 1 -- 10.20.193.49:0/2527434157 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6592+0+0 (secure 0 0 0) 0x7fc53c05d400 con 0x7fc5540c7550 2026-02-17T11:10:21.396 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.393+0000 7fc52bfff640 10 client.4359.objecter ms_dispatch2 0x7fc554000b90 osd_map(23..23 src has 1..23) 2026-02-17T11:10:21.396 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.393+0000 7fc52bfff640 3 client.4359.objecter handle_osd_map got epochs [23,23] > 0 2026-02-17T11:10:21.396 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.393+0000 7fc52bfff640 3 client.4359.objecter handle_osd_map decoding full epoch 23 2026-02-17T11:10:21.396 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.393+0000 7fc52bfff640 20 client.4359.objecter dump_active .. 0 homeless 2026-02-17T11:10:21.405 INFO:tasks.ceph.osd.7.trial162.stderr:2026-02-17T11:10:21.384+0000 77b6940 -1 bdev(0x16f3a610 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 2 2026-02-17T11:10:21.438 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.436+0000 7fc52bfff640 1 -- 10.20.193.49:0/2527434157 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc55406a1b0 con 0x7fc5540c7550 2026-02-17T11:10:21.438 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.436+0000 7fc52bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:21.438 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.436+0000 7fc52bfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:21.454 INFO:tasks.ceph.osd.7.trial162.stderr:2026-02-17T11:10:21.403+0000 77b6940 -1 bdev(0x16f3a610 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2026-02-17T11:10:21.454 INFO:tasks.ceph.osd.7.trial162.stderr:2026-02-17T11:10:21.419+0000 77b6940 -1 bdev(0x16f3a610 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2026-02-17T11:10:21.472 INFO:tasks.ceph.osd.7.trial162.stderr:2026-02-17T11:10:21.441+0000 77b6940 -1 bdev(0x16f3a610 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2026-02-17T11:10:21.499 INFO:tasks.ceph.osd.7.trial162.stderr:2026-02-17T11:10:21.452+0000 77b6940 -1 bdev(0x16f3a610 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2026-02-17T11:10:21.511 INFO:tasks.ceph.osd.7.trial162.stderr:2026-02-17T11:10:21.464+0000 77b6940 -1 bdev(0x16f3a610 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2026-02-17T11:10:21.512 INFO:tasks.ceph.osd.7.trial162.stderr:2026-02-17T11:10:21.491+0000 77b6940 -1 bdev(0x16f3a610 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2026-02-17T11:10:21.517 INFO:tasks.ceph.osd.7.trial162.stderr:2026-02-17T11:10:21.497+0000 77b6940 -1 bdev(0x16f3a610 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2026-02-17T11:10:21.524 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.521+0000 7fc559a29640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:10:21.524 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.521+0000 7fc559a29640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:10:21.524 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.521+0000 7fc559a29640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:21.524 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.521+0000 7fc559a29640 1 -- 10.20.193.49:0/2527434157 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc5541508a0 con 0x7fc5540c7550 2026-02-17T11:10:21.526 INFO:tasks.ceph.osd.7.trial162.stderr:2026-02-17T11:10:21.509+0000 77b6940 -1 bdev(0x16f3a610 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2026-02-17T11:10:21.531 INFO:tasks.ceph.osd.7.trial162.stderr:2026-02-17T11:10:21.515+0000 77b6940 -1 bdev(0x16f3a610 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2026-02-17T11:10:21.531 INFO:tasks.ceph.osd.7.trial162.stderr:2026-02-17T11:10:21.525+0000 77b6940 -1 bdev(0x16f3a610 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2026-02-17T11:10:21.543 INFO:tasks.ceph.osd.7.trial162.stderr:2026-02-17T11:10:21.529+0000 77b6940 -1 bdev(0x16f3a610 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2026-02-17T11:10:21.556 INFO:tasks.ceph.osd.7.trial162.stderr:2026-02-17T11:10:21.541+0000 77b6940 -1 bdev(0x16f3a610 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2026-02-17T11:10:21.569 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.566+0000 7fc52bfff640 1 -- 10.20.193.49:0/2527434157 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+19221 (secure 0 0 0) 0x7fc53c021080 con 0x7fc5540c7550 2026-02-17T11:10:21.569 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.566+0000 7fc52bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:10:21.569 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.566+0000 7fc52bfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:21.569 INFO:teuthology.misc.health.trial049.stdout: 2026-02-17T11:10:21.569 INFO:teuthology.misc.health.trial049.stdout:{"epoch":23,"fsid":"2799a57b-9ea3-46ae-8e91-1fe004a3651d","created":"2026-02-17T11:08:37.595499+0000","modified":"2026-02-17T11:10:20.960810+0000","last_up_change":"2026-02-17T11:10:20.960810+0000","last_in_change":"2026-02-17T11:08:43.985163+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T11:10:20.646344+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":16.670000076293945,"score_stable":16.670000076293945,"optimal_score":0.059999998658895493,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"30bc819e-140a-433e-b860-eaa88e282a11","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2f7f1f11-f256-4094-82a9-5d21882e6e0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6816","nonce":4259563897},{"type":"v1","addr":"10.20.193.97:6817","nonce":4259563897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6818","nonce":4259563897},{"type":"v1","addr":"10.20.193.97:6819","nonce":4259563897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6822","nonce":4259563897},{"type":"v1","addr":"10.20.193.97:6823","nonce":4259563897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6820","nonce":4259563897},{"type":"v1","addr":"10.20.193.97:6821","nonce":4259563897}]},"public_addr":"10.20.193.97:6817/4259563897","cluster_addr":"10.20.193.97:6819/4259563897","heartbeat_back_addr":"10.20.193.97:6823/4259563897","heartbeat_front_addr":"10.20.193.97:6821/4259563897","state":["exists","up"]},{"osd":2,"uuid":"26bd1274-fe52-42cb-876b-df9920880f95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6816","nonce":1377516118},{"type":"v1","addr":"10.20.193.157:6817","nonce":1377516118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6818","nonce":1377516118},{"type":"v1","addr":"10.20.193.157:6819","nonce":1377516118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6822","nonce":1377516118},{"type":"v1","addr":"10.20.193.157:6823","nonce":1377516118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6820","nonce":1377516118},{"type":"v1","addr":"10.20.193.157:6821","nonce":1377516118}]},"public_addr":"10.20.193.157:6817/1377516118","cluster_addr":"10.20.193.157:6819/1377516118","heartbeat_back_addr":"10.20.193.157:6823/1377516118","heartbeat_front_addr":"10.20.193.157:6821/1377516118","state":["exists","up"]},{"osd":3,"uuid":"c78a5263-3b0d-4b22-a848-bcd6a1e4f6b0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f0fdfadd-2f39-4ad8-ac88-cb588c5e8ee0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6808","nonce":2238942007},{"type":"v1","addr":"10.20.193.49:6809","nonce":2238942007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6810","nonce":2238942007},{"type":"v1","addr":"10.20.193.49:6811","nonce":2238942007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6816","nonce":2238942007},{"type":"v1","addr":"10.20.193.49:6817","nonce":2238942007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6813","nonce":2238942007},{"type":"v1","addr":"10.20.193.49:6815","nonce":2238942007}]},"public_addr":"10.20.193.49:6809/2238942007","cluster_addr":"10.20.193.49:6811/2238942007","heartbeat_back_addr":"10.20.193.49:6817/2238942007","heartbeat_front_addr":"10.20.193.49:6815/2238942007","state":["exists","up"]},{"osd":5,"uuid":"65872639-d6c0-482d-95d1-1d9f250781c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6800","nonce":3226749558},{"type":"v1","addr":"10.20.193.97:6801","nonce":3226749558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6802","nonce":3226749558},{"type":"v1","addr":"10.20.193.97:6803","nonce":3226749558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6806","nonce":3226749558},{"type":"v1","addr":"10.20.193.97:6807","nonce":3226749558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6804","nonce":3226749558},{"type":"v1","addr":"10.20.193.97:6805","nonce":3226749558}]},"public_addr":"10.20.193.97:6801/3226749558","cluster_addr":"10.20.193.97:6803/3226749558","heartbeat_back_addr":"10.20.193.97:6807/3226749558","heartbeat_front_addr":"10.20.193.97:6805/3226749558","state":["exists","up"]},{"osd":6,"uuid":"43091d3e-638d-4462-867b-cade02a315e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"890ae4d6-33c9-4515-a896-a689647330dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"f04abc9b-ed75-4582-b47d-07a9890f52bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6800","nonce":1386770137},{"type":"v1","addr":"10.20.193.49:6801","nonce":1386770137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6802","nonce":1386770137},{"type":"v1","addr":"10.20.193.49:6803","nonce":1386770137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6806","nonce":1386770137},{"type":"v1","addr":"10.20.193.49:6807","nonce":1386770137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6804","nonce":1386770137},{"type":"v1","addr":"10.20.193.49:6805","nonce":1386770137}]},"public_addr":"10.20.193.49:6801/1386770137","cluster_addr":"10.20.193.49:6803/1386770137","heartbeat_back_addr":"10.20.193.49:6807/1386770137","heartbeat_front_addr":"10.20.193.49:6805/1386770137","state":["exists","up"]},{"osd":9,"uuid":"7dfbb00a-6b89-4de3-9f30-6aadd91b4408","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6808","nonce":676086260},{"type":"v1","addr":"10.20.193.97:6809","nonce":676086260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6810","nonce":676086260},{"type":"v1","addr":"10.20.193.97:6811","nonce":676086260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6814","nonce":676086260},{"type":"v1","addr":"10.20.193.97:6815","nonce":676086260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6812","nonce":676086260},{"type":"v1","addr":"10.20.193.97:6813","nonce":676086260}]},"public_addr":"10.20.193.97:6809/676086260","cluster_addr":"10.20.193.97:6811/676086260","heartbeat_back_addr":"10.20.193.97:6815/676086260","heartbeat_front_addr":"10.20.193.97:6813/676086260","state":["exists","up"]},{"osd":10,"uuid":"e497a4fd-a944-489b-9cb3-30f5acaeb53e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"7371d50f-36f9-477d-8d4d-853f481dd6db","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"3cf4fded-49db-4d95-956b-77acc868a3ed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"7dc53473-594f-4cfb-8444-eab205e2e0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6824","nonce":409145483},{"type":"v1","addr":"10.20.193.97:6825","nonce":409145483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6826","nonce":409145483},{"type":"v1","addr":"10.20.193.97:6827","nonce":409145483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6830","nonce":409145483},{"type":"v1","addr":"10.20.193.97:6831","nonce":409145483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6828","nonce":409145483},{"type":"v1","addr":"10.20.193.97:6829","nonce":409145483}]},"public_addr":"10.20.193.97:6825/409145483","cluster_addr":"10.20.193.97:6827/409145483","heartbeat_back_addr":"10.20.193.97:6831/409145483","heartbeat_front_addr":"10.20.193.97:6829/409145483","state":["exists","up"]},{"osd":14,"uuid":"e8ab3e8f-29a8-4c79-bf86-d29543aac56a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6824","nonce":404726964},{"type":"v1","addr":"10.20.193.157:6825","nonce":404726964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6826","nonce":404726964},{"type":"v1","addr":"10.20.193.157:6827","nonce":404726964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6830","nonce":404726964},{"type":"v1","addr":"10.20.193.157:6831","nonce":404726964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6828","nonce":404726964},{"type":"v1","addr":"10.20.193.157:6829","nonce":404726964}]},"public_addr":"10.20.193.157:6825/404726964","cluster_addr":"10.20.193.157:6827/404726964","heartbeat_back_addr":"10.20.193.157:6831/404726964","heartbeat_front_addr":"10.20.193.157:6829/404726964","state":["exists","up"]},{"osd":15,"uuid":"300a4696-aa54-4b47-b9f3-87dec719bcfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6819","nonce":3057705174},{"type":"v1","addr":"10.20.193.162:6821","nonce":3057705174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6823","nonce":3057705174},{"type":"v1","addr":"10.20.193.162:6825","nonce":3057705174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6831","nonce":3057705174},{"type":"v1","addr":"10.20.193.162:6833","nonce":3057705174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6827","nonce":3057705174},{"type":"v1","addr":"10.20.193.162:6829","nonce":3057705174}]},"public_addr":"10.20.193.162:6821/3057705174","cluster_addr":"10.20.193.162:6825/3057705174","heartbeat_back_addr":"10.20.193.162:6833/3057705174","heartbeat_front_addr":"10.20.193.162:6829/3057705174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:17.998817+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:18.526566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:17.449438+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:18.134204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:17.321828+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:18.265266+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:18.477125+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:18.096729+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:10:21.572 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.569+0000 7fc559a29640 10 librados: watch_flush enter 2026-02-17T11:10:21.573 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.569+0000 7fc559a29640 10 librados: watch_flush exit 2026-02-17T11:10:21.573 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.569+0000 7fc559a29640 20 client.4359.objecter shutdown clearing up homeless session... 2026-02-17T11:10:21.573 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.569+0000 7fc559a29640 10 client.4359.objecter successfully canceled tick 2026-02-17T11:10:21.573 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.569+0000 7fc559a29640 1 -- 10.20.193.49:0/2527434157 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fc5240790e0 msgr2=0x7fc52407b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:21.573 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.569+0000 7fc559a29640 1 --2- 10.20.193.49:0/2527434157 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fc5240790e0 0x7fc52407b5a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc548039000 tx=0x7fc548031000 comp rx=0 tx=0).stop 2026-02-17T11:10:21.573 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.569+0000 7fc559a29640 10 monclient: shutdown 2026-02-17T11:10:21.573 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.569+0000 7fc559a29640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:21.573 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.569+0000 7fc559a29640 1 -- 10.20.193.49:0/2527434157 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc5540c7550 msgr2=0x7fc554144ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:21.573 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.569+0000 7fc559a29640 1 --2- 10.20.193.49:0/2527434157 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc5540c7550 0x7fc554144ae0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc53c00c580 tx=0x7fc53c00ca50 comp rx=0 tx=0).stop 2026-02-17T11:10:21.573 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.569+0000 7fc559a29640 1 -- 10.20.193.49:0/2527434157 shutdown_connections 2026-02-17T11:10:21.574 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.569+0000 7fc559a29640 1 --2- 10.20.193.49:0/2527434157 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fc5240790e0 0x7fc52407b5a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:21.574 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.569+0000 7fc559a29640 1 --2- 10.20.193.49:0/2527434157 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc5541504c0 0x7fc554140250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:21.574 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.569+0000 7fc559a29640 1 --2- 10.20.193.49:0/2527434157 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc5540c7550 0x7fc554144ae0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:21.574 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.569+0000 7fc559a29640 1 --2- 10.20.193.49:0/2527434157 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc5540c7120 0x7fc5540c3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:21.574 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.569+0000 7fc559a29640 1 -- 10.20.193.49:0/2527434157 >> 10.20.193.49:0/2527434157 conn(0x7fc5540c9f30 msgr2=0x7fc55414c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:21.574 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.569+0000 7fc559a29640 1 -- 10.20.193.49:0/2527434157 shutdown_connections 2026-02-17T11:10:21.574 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.569+0000 7fc559a29640 1 -- 10.20.193.49:0/2527434157 wait complete. 2026-02-17T11:10:21.574 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:21.569+0000 7fc559a29640 1 librados: shutdown 2026-02-17T11:10:21.580 DEBUG:teuthology.misc:9 of 16 OSDs are up 2026-02-17T11:10:21.583 INFO:tasks.ceph.osd.7.trial162.stderr:2026-02-17T11:10:21.554+0000 77b6940 -1 bdev(0x16f3a610 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2026-02-17T11:10:21.584 INFO:tasks.ceph.osd.7.trial162.stderr:2026-02-17T11:10:21.581+0000 77b6940 -1 bdev(0x16f3a610 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 2 2026-02-17T11:10:21.585 INFO:tasks.ceph.osd.7.trial162.stderr:2026-02-17T11:10:21.583+0000 77b6940 -1 bdev(0x16f3a610 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2026-02-17T11:10:21.613 INFO:tasks.ceph.osd.7.trial162.stderr:2026-02-17T11:10:21.602+0000 77b6940 -1 bdev(0x16f3a610 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2026-02-17T11:10:21.632 INFO:tasks.ceph.osd.7.trial162.stderr:2026-02-17T11:10:21.618+0000 77b6940 -1 bdev(0x16f3a610 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2026-02-17T11:10:21.632 INFO:tasks.ceph.osd.7.trial162.stderr:2026-02-17T11:10:21.630+0000 77b6940 -1 bdev(0x16f3a610 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2026-02-17T11:10:21.671 INFO:tasks.ceph.osd.7.trial162.stderr:2026-02-17T11:10:21.669+0000 77b6940 -1 bdev(0x16f3a610 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2026-02-17T11:10:21.731 INFO:tasks.ceph.osd.7.trial162.stderr:2026-02-17T11:10:21.692+0000 77b6940 -1 bdev(0x16f3a610 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 2 2026-02-17T11:10:21.743 INFO:tasks.ceph.osd.7.trial162.stderr:2026-02-17T11:10:21.729+0000 77b6940 -1 bdev(0x16f3a610 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2026-02-17T11:10:21.766 INFO:tasks.ceph.osd.7.trial162.stderr:2026-02-17T11:10:21.741+0000 77b6940 -1 bdev(0x16f3a610 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2026-02-17T11:10:21.766 INFO:tasks.ceph.osd.7.trial162.stderr:2026-02-17T11:10:21.752+0000 77b6940 -1 bdev(0x16f3a610 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2026-02-17T11:10:21.766 INFO:tasks.ceph.osd.7.trial162.stderr:2026-02-17T11:10:21.764+0000 77b6940 -1 bdev(0x16f3a610 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2026-02-17T11:10:21.820 INFO:tasks.ceph.osd.7.trial162.stderr:2026-02-17T11:10:21.802+0000 77b6940 -1 bdev(0x16f3a610 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2026-02-17T11:10:21.832 INFO:tasks.ceph.osd.7.trial162.stderr:2026-02-17T11:10:21.815+0000 77b6940 -1 bdev(0x16f3a610 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2026-02-17T11:10:21.838 INFO:tasks.ceph.osd.7.trial162.stderr:2026-02-17T11:10:21.818+0000 77b6940 -1 bdev(0x16f3a610 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2026-02-17T11:10:21.846 INFO:tasks.ceph.osd.7.trial162.stderr:2026-02-17T11:10:21.830+0000 77b6940 -1 bdev(0x16f3a610 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2026-02-17T11:10:21.859 INFO:tasks.ceph.osd.7.trial162.stderr:2026-02-17T11:10:21.850+0000 77b6940 -1 bdev(0x16f3a610 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2026-02-17T11:10:21.864 INFO:tasks.ceph.osd.7.trial162.stderr:2026-02-17T11:10:21.857+0000 77b6940 -1 bdev(0x16f3a610 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2026-02-17T11:10:22.277 INFO:tasks.ceph.osd.7.trial162.stderr:2026-02-17T11:10:22.273+0000 ce9c640 -1 osd.7 0 waiting for initial osdmap 2026-02-17T11:10:22.375 INFO:tasks.ceph.osd.0.trial049.stderr:2026-02-17T11:10:22.371+0000 77b6940 -1 bdev(0x16f61190 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-17T11:10:22.413 INFO:tasks.ceph.osd.0.trial049.stderr:2026-02-17T11:10:22.392+0000 77b6940 -1 bdev(0x16f61190 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-17T11:10:22.419 INFO:tasks.ceph.osd.0.trial049.stderr:2026-02-17T11:10:22.411+0000 77b6940 -1 bdev(0x16f61190 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-17T11:10:22.439 INFO:tasks.ceph.osd.11.trial162.stderr:2026-02-17T11:10:22.425+0000 77b6940 -1 bdev(0x16f3d3b0 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 1 2026-02-17T11:10:22.442 INFO:tasks.ceph.osd.0.trial049.stderr:2026-02-17T11:10:22.430+0000 77b6940 -1 bdev(0x16f61190 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-17T11:10:22.445 INFO:tasks.ceph.osd.11.trial162.stderr:2026-02-17T11:10:22.437+0000 77b6940 -1 bdev(0x16f3d3b0 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 1 2026-02-17T11:10:22.451 INFO:tasks.ceph.osd.0.trial049.stderr:2026-02-17T11:10:22.436+0000 77b6940 -1 bdev(0x16f61190 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-17T11:10:22.451 INFO:tasks.ceph.osd.11.trial162.stderr:2026-02-17T11:10:22.443+0000 77b6940 -1 bdev(0x16f3d3b0 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 1 2026-02-17T11:10:22.455 INFO:tasks.ceph.osd.11.trial162.stderr:2026-02-17T11:10:22.449+0000 77b6940 -1 bdev(0x16f3d3b0 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 1 2026-02-17T11:10:22.478 INFO:tasks.ceph.osd.11.trial162.stderr:2026-02-17T11:10:22.453+0000 77b6940 -1 bdev(0x16f3d3b0 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 1 2026-02-17T11:10:22.478 INFO:tasks.ceph.osd.11.trial162.stderr:2026-02-17T11:10:22.475+0000 77b6940 -1 bdev(0x16f3d3b0 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 1 2026-02-17T11:10:22.488 INFO:tasks.ceph.osd.0.trial049.stderr:2026-02-17T11:10:22.440+0000 77b6940 -1 bdev(0x16f61190 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-17T11:10:22.495 INFO:tasks.ceph.osd.11.trial162.stderr:2026-02-17T11:10:22.477+0000 77b6940 -1 bdev(0x16f3d3b0 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 1 2026-02-17T11:10:22.497 INFO:tasks.ceph.osd.3.trial162.stderr:2026-02-17T11:10:22.476+0000 77b6940 -1 bdev(0x1ab1f280 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 2 2026-02-17T11:10:22.499 INFO:tasks.ceph.osd.0.trial049.stderr:2026-02-17T11:10:22.449+0000 77b6940 -1 bdev(0x16f61190 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-17T11:10:22.500 INFO:tasks.ceph.osd.0.trial049.stderr:2026-02-17T11:10:22.461+0000 77b6940 -1 bdev(0x16f61190 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-17T11:10:22.506 INFO:tasks.ceph.osd.11.trial162.stderr:2026-02-17T11:10:22.493+0000 77b6940 -1 bdev(0x16f3d3b0 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 1 2026-02-17T11:10:22.507 INFO:tasks.ceph.osd.12.trial049.stderr:2026-02-17T11:10:22.477+0000 77b6940 -1 bdev(0x1adf5980 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 2 2026-02-17T11:10:22.508 INFO:tasks.ceph.osd.12.trial049.stderr:2026-02-17T11:10:22.500+0000 77b6940 -1 bdev(0x1adf5980 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-17T11:10:22.508 INFO:tasks.ceph.osd.0.trial049.stderr:2026-02-17T11:10:22.486+0000 77b6940 -1 bdev(0x16f61190 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-17T11:10:22.508 INFO:tasks.ceph.osd.0.trial049.stderr:2026-02-17T11:10:22.498+0000 77b6940 -1 bdev(0x16f61190 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-17T11:10:22.509 INFO:tasks.ceph.osd.12.trial049.stderr:2026-02-17T11:10:22.505+0000 77b6940 -1 bdev(0x1adf5980 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-17T11:10:22.518 INFO:tasks.ceph.osd.3.trial162.stderr:2026-02-17T11:10:22.495+0000 77b6940 -1 bdev(0x1ab1f280 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T11:10:22.522 INFO:tasks.ceph.osd.0.trial049.stderr:2026-02-17T11:10:22.506+0000 77b6940 -1 bdev(0x16f61190 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-17T11:10:22.523 INFO:tasks.ceph.osd.0.trial049.stderr:2026-02-17T11:10:22.507+0000 77b6940 -1 bdev(0x16f61190 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-17T11:10:22.526 INFO:tasks.ceph.osd.11.trial162.stderr:2026-02-17T11:10:22.505+0000 77b6940 -1 bdev(0x16f3d3b0 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 1 2026-02-17T11:10:22.526 INFO:tasks.ceph.osd.11.trial162.stderr:2026-02-17T11:10:22.523+0000 77b6940 -1 bdev(0x16f3d3b0 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 1 2026-02-17T11:10:22.526 INFO:tasks.ceph.osd.12.trial049.stderr:2026-02-17T11:10:22.506+0000 77b6940 -1 bdev(0x1adf5980 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-17T11:10:22.527 INFO:tasks.ceph.osd.11.trial162.stderr:2026-02-17T11:10:22.524+0000 77b6940 -1 bdev(0x16f3d3b0 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 1 2026-02-17T11:10:22.532 INFO:tasks.ceph.osd.0.trial049.stderr:2026-02-17T11:10:22.521+0000 77b6940 -1 bdev(0x16f61190 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-17T11:10:22.534 INFO:tasks.ceph.osd.3.trial162.stderr:2026-02-17T11:10:22.496+0000 77b6940 -1 bdev(0x1ab1f280 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T11:10:22.534 INFO:tasks.ceph.osd.0.trial049.stderr:2026-02-17T11:10:22.524+0000 77b6940 -1 bdev(0x16f61190 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-17T11:10:22.538 INFO:tasks.ceph.osd.3.trial162.stderr:2026-02-17T11:10:22.516+0000 77b6940 -1 bdev(0x1ab1f280 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T11:10:22.539 INFO:tasks.ceph.osd.3.trial162.stderr:2026-02-17T11:10:22.532+0000 77b6940 -1 bdev(0x1ab1f280 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T11:10:22.543 INFO:tasks.ceph.osd.3.trial162.stderr:2026-02-17T11:10:22.536+0000 77b6940 -1 bdev(0x1ab1f280 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T11:10:22.544 INFO:tasks.ceph.osd.3.trial162.stderr:2026-02-17T11:10:22.537+0000 77b6940 -1 bdev(0x1ab1f280 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T11:10:22.550 INFO:tasks.ceph.osd.12.trial049.stderr:2026-02-17T11:10:22.524+0000 77b6940 -1 bdev(0x1adf5980 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-17T11:10:22.551 INFO:tasks.ceph.osd.12.trial049.stderr:2026-02-17T11:10:22.548+0000 77b6940 -1 bdev(0x1adf5980 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-17T11:10:22.552 INFO:tasks.ceph.osd.11.trial162.stderr:2026-02-17T11:10:22.543+0000 77b6940 -1 bdev(0x16f3d3b0 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 4 2026-02-17T11:10:22.567 INFO:tasks.ceph.osd.7.trial162.stderr:2026-02-17T11:10:22.559+0000 15c7c640 -1 osd.7 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T11:10:22.570 INFO:tasks.ceph.osd.0.trial049.stderr:2026-02-17T11:10:22.532+0000 77b6940 -1 bdev(0x16f61190 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-17T11:10:22.570 INFO:tasks.ceph.osd.3.trial162.stderr:2026-02-17T11:10:22.542+0000 77b6940 -1 bdev(0x1ab1f280 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T11:10:22.571 INFO:tasks.ceph.osd.0.trial049.stderr:2026-02-17T11:10:22.562+0000 77b6940 -1 bdev(0x16f61190 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-17T11:10:22.579 INFO:tasks.ceph.osd.0.trial049.stderr:2026-02-17T11:10:22.569+0000 77b6940 -1 bdev(0x16f61190 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 2 2026-02-17T11:10:22.580 INFO:tasks.ceph.osd.12.trial049.stderr:2026-02-17T11:10:22.572+0000 77b6940 -1 bdev(0x1adf5980 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-17T11:10:22.582 INFO:tasks.ceph.osd.12.trial049.stderr:2026-02-17T11:10:22.577+0000 77b6940 -1 bdev(0x1adf5980 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-17T11:10:22.587 INFO:tasks.ceph.osd.0.trial049.stderr:2026-02-17T11:10:22.582+0000 77b6940 -1 bdev(0x16f61190 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 3 2026-02-17T11:10:22.597 INFO:tasks.ceph.osd.11.trial162.stderr:2026-02-17T11:10:22.586+0000 77b6940 -1 bdev(0x16f3d3b0 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 1 2026-02-17T11:10:22.609 INFO:tasks.ceph.osd.11.trial162.stderr:2026-02-17T11:10:22.596+0000 77b6940 -1 bdev(0x16f3d3b0 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 1 2026-02-17T11:10:22.613 INFO:tasks.ceph.osd.12.trial049.stderr:2026-02-17T11:10:22.581+0000 77b6940 -1 bdev(0x1adf5980 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 2 2026-02-17T11:10:22.613 INFO:tasks.ceph.osd.12.trial049.stderr:2026-02-17T11:10:22.590+0000 77b6940 -1 bdev(0x1adf5980 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-17T11:10:22.613 INFO:tasks.ceph.osd.12.trial049.stderr:2026-02-17T11:10:22.610+0000 77b6940 -1 bdev(0x1adf5980 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-17T11:10:22.620 INFO:tasks.ceph.osd.3.trial162.stderr:2026-02-17T11:10:22.570+0000 77b6940 -1 bdev(0x1ab1f280 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T11:10:22.620 INFO:tasks.ceph.osd.3.trial162.stderr:2026-02-17T11:10:22.584+0000 77b6940 -1 bdev(0x1ab1f280 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T11:10:22.621 INFO:tasks.ceph.osd.11.trial162.stderr:2026-02-17T11:10:22.607+0000 77b6940 -1 bdev(0x16f3d3b0 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 1 2026-02-17T11:10:22.622 INFO:tasks.ceph.osd.11.trial162.stderr:2026-02-17T11:10:22.613+0000 77b6940 -1 bdev(0x16f3d3b0 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 1 2026-02-17T11:10:22.624 INFO:tasks.ceph.osd.0.trial049.stderr:2026-02-17T11:10:22.598+0000 77b6940 -1 bdev(0x16f61190 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 2 2026-02-17T11:10:22.629 INFO:tasks.ceph.osd.3.trial162.stderr:2026-02-17T11:10:22.595+0000 77b6940 -1 bdev(0x1ab1f280 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T11:10:22.629 INFO:tasks.ceph.osd.3.trial162.stderr:2026-02-17T11:10:22.607+0000 77b6940 -1 bdev(0x1ab1f280 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T11:10:22.632 INFO:tasks.ceph.osd.0.trial049.stderr:2026-02-17T11:10:22.610+0000 77b6940 -1 bdev(0x16f61190 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-17T11:10:22.640 INFO:tasks.ceph.osd.11.trial162.stderr:2026-02-17T11:10:22.620+0000 77b6940 -1 bdev(0x16f3d3b0 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 1 2026-02-17T11:10:22.641 INFO:tasks.ceph.osd.11.trial162.stderr:2026-02-17T11:10:22.622+0000 77b6940 -1 bdev(0x16f3d3b0 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 1 2026-02-17T11:10:22.645 INFO:tasks.ceph.osd.3.trial162.stderr:2026-02-17T11:10:22.618+0000 77b6940 -1 bdev(0x1ab1f280 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T11:10:22.646 INFO:tasks.ceph.osd.3.trial162.stderr:2026-02-17T11:10:22.627+0000 77b6940 -1 bdev(0x1ab1f280 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T11:10:22.653 INFO:tasks.ceph.osd.12.trial049.stderr:2026-02-17T11:10:22.623+0000 77b6940 -1 bdev(0x1adf5980 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-17T11:10:22.653 INFO:tasks.ceph.osd.12.trial049.stderr:2026-02-17T11:10:22.640+0000 77b6940 -1 bdev(0x1adf5980 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-17T11:10:22.659 INFO:tasks.ceph.osd.12.trial049.stderr:2026-02-17T11:10:22.651+0000 77b6940 -1 bdev(0x1adf5980 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-17T11:10:22.661 INFO:tasks.ceph.osd.3.trial162.stderr:2026-02-17T11:10:22.653+0000 77b6940 -1 bdev(0x1ab1f280 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 3 2026-02-17T11:10:22.661 INFO:tasks.ceph.osd.0.trial049.stderr:2026-02-17T11:10:22.630+0000 77b6940 -1 bdev(0x16f61190 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 2 2026-02-17T11:10:22.667 INFO:tasks.ceph.osd.0.trial049.stderr:2026-02-17T11:10:22.648+0000 77b6940 -1 bdev(0x16f61190 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-17T11:10:22.674 INFO:tasks.ceph.osd.12.trial049.stderr:2026-02-17T11:10:22.657+0000 77b6940 -1 bdev(0x1adf5980 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-17T11:10:22.675 INFO:tasks.ceph.osd.12.trial049.stderr:2026-02-17T11:10:22.672+0000 77b6940 -1 bdev(0x1adf5980 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-17T11:10:22.681 INFO:tasks.ceph.osd.0.trial049.stderr:2026-02-17T11:10:22.659+0000 77b6940 -1 bdev(0x16f61190 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-17T11:10:22.689 INFO:tasks.ceph.osd.3.trial162.stderr:2026-02-17T11:10:22.659+0000 77b6940 -1 bdev(0x1ab1f280 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T11:10:22.692 INFO:tasks.ceph.osd.0.trial049.stderr:2026-02-17T11:10:22.665+0000 77b6940 -1 bdev(0x16f61190 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-17T11:10:22.692 INFO:tasks.ceph.osd.0.trial049.stderr:2026-02-17T11:10:22.676+0000 77b6940 -1 bdev(0x16f61190 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-17T11:10:22.695 INFO:tasks.ceph.osd.3.trial162.stderr:2026-02-17T11:10:22.687+0000 77b6940 -1 bdev(0x1ab1f280 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T11:10:22.701 INFO:tasks.ceph.osd.11.trial162.stderr:2026-02-17T11:10:22.672+0000 77b6940 -1 bdev(0x16f3d3b0 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 1 2026-02-17T11:10:22.701 INFO:tasks.ceph.osd.11.trial162.stderr:2026-02-17T11:10:22.678+0000 77b6940 -1 bdev(0x16f3d3b0 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 1 2026-02-17T11:10:22.701 INFO:tasks.ceph.osd.11.trial162.stderr:2026-02-17T11:10:22.693+0000 77b6940 -1 bdev(0x16f3d3b0 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 1 2026-02-17T11:10:22.702 INFO:tasks.ceph.osd.3.trial162.stderr:2026-02-17T11:10:22.694+0000 77b6940 -1 bdev(0x1ab1f280 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T11:10:22.708 INFO:tasks.ceph.osd.12.trial049.stderr:2026-02-17T11:10:22.689+0000 77b6940 -1 bdev(0x1adf5980 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-17T11:10:22.709 INFO:tasks.ceph.osd.11.trial162.stderr:2026-02-17T11:10:22.700+0000 77b6940 -1 bdev(0x16f3d3b0 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 1 2026-02-17T11:10:22.719 INFO:tasks.ceph.osd.12.trial049.stderr:2026-02-17T11:10:22.700+0000 77b6940 -1 bdev(0x1adf5980 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-17T11:10:22.720 INFO:tasks.ceph.osd.0.trial049.stderr:2026-02-17T11:10:22.678+0000 77b6940 -1 bdev(0x16f61190 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-17T11:10:22.721 INFO:tasks.ceph.osd.0.trial049.stderr:2026-02-17T11:10:22.690+0000 77b6940 -1 bdev(0x16f61190 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-17T11:10:22.721 INFO:tasks.ceph.osd.0.trial049.stderr:2026-02-17T11:10:22.711+0000 77b6940 -1 bdev(0x16f61190 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-17T11:10:22.721 INFO:tasks.ceph.osd.0.trial049.stderr:2026-02-17T11:10:22.718+0000 77b6940 -1 bdev(0x16f61190 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-17T11:10:22.723 INFO:tasks.ceph.osd.11.trial162.stderr:2026-02-17T11:10:22.707+0000 77b6940 -1 bdev(0x16f3d3b0 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 1 2026-02-17T11:10:22.731 INFO:tasks.ceph.osd.12.trial049.stderr:2026-02-17T11:10:22.706+0000 77b6940 -1 bdev(0x1adf5980 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-17T11:10:22.745 INFO:tasks.ceph.osd.12.trial049.stderr:2026-02-17T11:10:22.718+0000 77b6940 -1 bdev(0x1adf5980 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-17T11:10:22.745 INFO:tasks.ceph.osd.11.trial162.stderr:2026-02-17T11:10:22.721+0000 77b6940 -1 bdev(0x16f3d3b0 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 1 2026-02-17T11:10:22.746 INFO:tasks.ceph.osd.11.trial162.stderr:2026-02-17T11:10:22.737+0000 77b6940 -1 bdev(0x16f3d3b0 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 1 2026-02-17T11:10:22.751 INFO:tasks.ceph.osd.12.trial049.stderr:2026-02-17T11:10:22.729+0000 77b6940 -1 bdev(0x1adf5980 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-17T11:10:22.755 INFO:tasks.ceph.osd.3.trial162.stderr:2026-02-17T11:10:22.737+0000 77b6940 -1 bdev(0x1ab1f280 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T11:10:22.762 INFO:tasks.ceph.osd.12.trial049.stderr:2026-02-17T11:10:22.743+0000 77b6940 -1 bdev(0x1adf5980 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-17T11:10:22.768 INFO:tasks.ceph.osd.12.trial049.stderr:2026-02-17T11:10:22.749+0000 77b6940 -1 bdev(0x1adf5980 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-17T11:10:22.772 INFO:tasks.ceph.osd.12.trial049.stderr:2026-02-17T11:10:22.760+0000 77b6940 -1 bdev(0x1adf5980 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-17T11:10:22.775 INFO:tasks.ceph.osd.11.trial162.stderr:2026-02-17T11:10:22.744+0000 77b6940 -1 bdev(0x16f3d3b0 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 1 2026-02-17T11:10:22.775 INFO:tasks.ceph.osd.11.trial162.stderr:2026-02-17T11:10:22.773+0000 77b6940 -1 bdev(0x16f3d3b0 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 1 2026-02-17T11:10:22.777 INFO:tasks.ceph.osd.12.trial049.stderr:2026-02-17T11:10:22.766+0000 77b6940 -1 bdev(0x1adf5980 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-17T11:10:22.780 INFO:tasks.ceph.osd.12.trial049.stderr:2026-02-17T11:10:22.770+0000 77b6940 -1 bdev(0x1adf5980 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-17T11:10:22.782 INFO:tasks.ceph.osd.3.trial162.stderr:2026-02-17T11:10:22.754+0000 77b6940 -1 bdev(0x1ab1f280 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T11:10:22.783 INFO:tasks.ceph.osd.3.trial162.stderr:2026-02-17T11:10:22.780+0000 77b6940 -1 bdev(0x1ab1f280 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T11:10:22.788 INFO:tasks.ceph.osd.0.trial049.stderr:2026-02-17T11:10:22.722+0000 77b6940 -1 bdev(0x16f61190 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-17T11:10:22.788 INFO:tasks.ceph.osd.0.trial049.stderr:2026-02-17T11:10:22.738+0000 77b6940 -1 bdev(0x16f61190 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-17T11:10:22.794 INFO:tasks.ceph.osd.0.trial049.stderr:2026-02-17T11:10:22.769+0000 77b6940 -1 bdev(0x16f61190 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-17T11:10:22.801 INFO:tasks.ceph.osd.12.trial049.stderr:2026-02-17T11:10:22.791+0000 77b6940 -1 bdev(0x1adf5980 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-17T11:10:22.802 INFO:tasks.ceph.osd.0.trial049.stderr:2026-02-17T11:10:22.786+0000 77b6940 -1 bdev(0x16f61190 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-17T11:10:22.805 INFO:tasks.ceph.osd.3.trial162.stderr:2026-02-17T11:10:22.781+0000 77b6940 -1 bdev(0x1ab1f280 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 2 2026-02-17T11:10:22.805 INFO:tasks.ceph.osd.3.trial162.stderr:2026-02-17T11:10:22.798+0000 77b6940 -1 bdev(0x1ab1f280 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T11:10:22.814 INFO:tasks.ceph.osd.12.trial049.stderr:2026-02-17T11:10:22.799+0000 77b6940 -1 bdev(0x1adf5980 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-17T11:10:22.814 INFO:tasks.ceph.osd.3.trial162.stderr:2026-02-17T11:10:22.804+0000 77b6940 -1 bdev(0x1ab1f280 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T11:10:22.817 INFO:tasks.ceph.osd.12.trial049.stderr:2026-02-17T11:10:22.810+0000 77b6940 -1 bdev(0x1adf5980 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-17T11:10:22.818 INFO:tasks.ceph.osd.0.trial049.stderr:2026-02-17T11:10:22.792+0000 77b6940 -1 bdev(0x16f61190 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-17T11:10:22.819 INFO:tasks.ceph.osd.0.trial049.stderr:2026-02-17T11:10:22.799+0000 77b6940 -1 bdev(0x16f61190 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-17T11:10:22.822 INFO:tasks.ceph.osd.3.trial162.stderr:2026-02-17T11:10:22.820+0000 77b6940 -1 bdev(0x1ab1f280 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T11:10:22.828 INFO:tasks.ceph.osd.0.trial049.stderr:2026-02-17T11:10:22.825+0000 77b6940 -1 bdev(0x16f61190 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 2 2026-02-17T11:10:22.835 INFO:tasks.ceph.osd.3.trial162.stderr:2026-02-17T11:10:22.830+0000 77b6940 -1 bdev(0x1ab1f280 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T11:10:22.837 INFO:tasks.ceph.osd.11.trial162.stderr:2026-02-17T11:10:22.798+0000 77b6940 -1 bdev(0x16f3d3b0 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 1 2026-02-17T11:10:22.837 INFO:tasks.ceph.osd.11.trial162.stderr:2026-02-17T11:10:22.825+0000 77b6940 -1 bdev(0x16f3d3b0 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 1 2026-02-17T11:10:22.840 INFO:tasks.ceph.osd.12.trial049.stderr:2026-02-17T11:10:22.811+0000 77b6940 -1 bdev(0x1adf5980 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-17T11:10:22.840 INFO:tasks.ceph.osd.12.trial049.stderr:2026-02-17T11:10:22.815+0000 77b6940 -1 bdev(0x1adf5980 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-17T11:10:22.840 INFO:tasks.ceph.osd.12.trial049.stderr:2026-02-17T11:10:22.827+0000 77b6940 -1 bdev(0x1adf5980 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-17T11:10:22.841 INFO:tasks.ceph.osd.0.trial049.stderr:2026-02-17T11:10:22.838+0000 77b6940 -1 bdev(0x16f61190 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-17T11:10:22.851 INFO:tasks.ceph.osd.11.trial162.stderr:2026-02-17T11:10:22.835+0000 77b6940 -1 bdev(0x16f3d3b0 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 1 2026-02-17T11:10:22.853 INFO:tasks.ceph.osd.3.trial162.stderr:2026-02-17T11:10:22.844+0000 77b6940 -1 bdev(0x1ab1f280 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T11:10:22.863 INFO:tasks.ceph.osd.11.trial162.stderr:2026-02-17T11:10:22.844+0000 77b6940 -1 bdev(0x16f3d3b0 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 1 2026-02-17T11:10:22.872 INFO:tasks.ceph.osd.3.trial162.stderr:2026-02-17T11:10:22.852+0000 77b6940 -1 bdev(0x1ab1f280 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2026-02-17T11:10:22.875 INFO:tasks.ceph.osd.12.trial049.stderr:2026-02-17T11:10:22.838+0000 77b6940 -1 bdev(0x1adf5980 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-17T11:10:22.875 INFO:tasks.ceph.osd.12.trial049.stderr:2026-02-17T11:10:22.867+0000 77b6940 -1 bdev(0x1adf5980 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-17T11:10:22.880 INFO:tasks.ceph.osd.11.trial162.stderr:2026-02-17T11:10:22.849+0000 77b6940 -1 bdev(0x16f3d3b0 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 1 2026-02-17T11:10:22.880 INFO:tasks.ceph.osd.11.trial162.stderr:2026-02-17T11:10:22.861+0000 77b6940 -1 bdev(0x16f3d3b0 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 1 2026-02-17T11:10:22.880 INFO:tasks.ceph.osd.12.trial049.stderr:2026-02-17T11:10:22.873+0000 77b6940 -1 bdev(0x1adf5980 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-17T11:10:22.895 INFO:tasks.ceph.osd.3.trial162.stderr:2026-02-17T11:10:22.892+0000 77b6940 -1 bdev(0x1ab1f280 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 5 2026-02-17T11:10:22.902 INFO:tasks.ceph.osd.12.trial049.stderr:2026-02-17T11:10:22.899+0000 77b6940 -1 bdev(0x1adf5980 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 2 2026-02-17T11:10:22.911 INFO:tasks.ceph.osd.0.trial049.stderr:2026-02-17T11:10:22.870+0000 77b6940 -1 bdev(0x16f61190 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-17T11:10:22.926 INFO:tasks.ceph.osd.12.trial049.stderr:2026-02-17T11:10:22.900+0000 77b6940 -1 bdev(0x1adf5980 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-17T11:10:22.926 INFO:tasks.ceph.osd.12.trial049.stderr:2026-02-17T11:10:22.905+0000 77b6940 -1 bdev(0x1adf5980 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-17T11:10:22.933 INFO:tasks.ceph.osd.12.trial049.stderr:2026-02-17T11:10:22.924+0000 77b6940 -1 bdev(0x1adf5980 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-17T11:10:22.933 INFO:tasks.ceph.osd.12.trial049.stderr:2026-02-17T11:10:22.930+0000 77b6940 -1 bdev(0x1adf5980 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-17T11:10:22.967 INFO:tasks.ceph.osd.12.trial049.stderr:2026-02-17T11:10:22.946+0000 77b6940 -1 bdev(0x1adf5980 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-17T11:10:22.967 INFO:tasks.ceph.osd.12.trial049.stderr:2026-02-17T11:10:22.951+0000 77b6940 -1 bdev(0x1adf5980 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-17T11:10:23.301 INFO:tasks.ceph.osd.11.trial162.stderr:2026-02-17T11:10:23.297+0000 deb0640 -1 osd.11 0 waiting for initial osdmap 2026-02-17T11:10:23.314 INFO:tasks.ceph.osd.0.trial049.stderr:2026-02-17T11:10:23.310+0000 deb0640 -1 osd.0 0 waiting for initial osdmap 2026-02-17T11:10:23.330 INFO:tasks.ceph.osd.3.trial162.stderr:2026-02-17T11:10:23.326+0000 ce9c640 -1 osd.3 0 waiting for initial osdmap 2026-02-17T11:10:23.367 INFO:tasks.ceph.osd.12.trial049.stderr:2026-02-17T11:10:23.363+0000 deb0640 -1 osd.12 0 waiting for initial osdmap 2026-02-17T11:10:23.452 INFO:tasks.ceph.osd.6.trial157.stderr:2026-02-17T11:10:23.429+0000 77b6940 -1 bdev(0x16f32d10 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T11:10:23.458 INFO:tasks.ceph.osd.6.trial157.stderr:2026-02-17T11:10:23.451+0000 77b6940 -1 bdev(0x16f32d10 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T11:10:23.495 INFO:tasks.ceph.osd.10.trial157.stderr:2026-02-17T11:10:23.482+0000 77b6940 -1 bdev(0x16f429d0 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T11:10:23.497 INFO:tasks.ceph.osd.6.trial157.stderr:2026-02-17T11:10:23.457+0000 77b6940 -1 bdev(0x16f32d10 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T11:10:23.501 INFO:tasks.ceph.osd.10.trial157.stderr:2026-02-17T11:10:23.494+0000 77b6940 -1 bdev(0x16f429d0 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T11:10:23.514 INFO:tasks.ceph.osd.6.trial157.stderr:2026-02-17T11:10:23.469+0000 77b6940 -1 bdev(0x16f32d10 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T11:10:23.514 INFO:tasks.ceph.osd.6.trial157.stderr:2026-02-17T11:10:23.491+0000 77b6940 -1 bdev(0x16f32d10 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T11:10:23.520 INFO:tasks.ceph.osd.6.trial157.stderr:2026-02-17T11:10:23.513+0000 77b6940 -1 bdev(0x16f32d10 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T11:10:23.523 INFO:tasks.ceph.osd.10.trial157.stderr:2026-02-17T11:10:23.500+0000 77b6940 -1 bdev(0x16f429d0 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T11:10:23.524 INFO:tasks.ceph.osd.10.trial157.stderr:2026-02-17T11:10:23.506+0000 77b6940 -1 bdev(0x16f429d0 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T11:10:23.526 INFO:tasks.ceph.osd.6.trial157.stderr:2026-02-17T11:10:23.519+0000 77b6940 -1 bdev(0x16f32d10 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T11:10:23.537 INFO:tasks.ceph.osd.6.trial157.stderr:2026-02-17T11:10:23.525+0000 77b6940 -1 bdev(0x16f32d10 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T11:10:23.543 INFO:tasks.ceph.osd.6.trial157.stderr:2026-02-17T11:10:23.537+0000 77b6940 -1 bdev(0x16f32d10 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T11:10:23.546 INFO:tasks.ceph.osd.10.trial157.stderr:2026-02-17T11:10:23.522+0000 77b6940 -1 bdev(0x16f429d0 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T11:10:23.557 INFO:tasks.ceph.osd.10.trial157.stderr:2026-02-17T11:10:23.534+0000 77b6940 -1 bdev(0x16f429d0 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T11:10:23.565 INFO:tasks.ceph.osd.6.trial157.stderr:2026-02-17T11:10:23.543+0000 77b6940 -1 bdev(0x16f32d10 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T11:10:23.566 INFO:tasks.ceph.osd.11.trial162.stderr:2026-02-17T11:10:23.558+0000 15c7c640 -1 osd.11 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T11:10:23.574 INFO:tasks.ceph.osd.10.trial157.stderr:2026-02-17T11:10:23.545+0000 77b6940 -1 bdev(0x16f429d0 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T11:10:23.574 INFO:tasks.ceph.osd.10.trial157.stderr:2026-02-17T11:10:23.572+0000 77b6940 -1 bdev(0x16f429d0 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T11:10:23.576 INFO:tasks.ceph.osd.6.trial157.stderr:2026-02-17T11:10:23.564+0000 77b6940 -1 bdev(0x16f32d10 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 2 2026-02-17T11:10:23.583 INFO:tasks.ceph.osd.3.trial162.stderr:2026-02-17T11:10:23.574+0000 15c7c640 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T11:10:23.594 INFO:tasks.ceph.osd.0.trial049.stderr:2026-02-17T11:10:23.585+0000 15c7c640 -1 osd.0 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T11:10:23.596 INFO:tasks.ceph.osd.6.trial157.stderr:2026-02-17T11:10:23.588+0000 77b6940 -1 bdev(0x16f32d10 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 4 2026-02-17T11:10:23.599 INFO:tasks.ceph.osd.10.trial157.stderr:2026-02-17T11:10:23.573+0000 77b6940 -1 bdev(0x16f429d0 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T11:10:23.608 INFO:tasks.ceph.osd.6.trial157.stderr:2026-02-17T11:10:23.595+0000 77b6940 -1 bdev(0x16f32d10 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T11:10:23.616 INFO:tasks.ceph.osd.10.trial157.stderr:2026-02-17T11:10:23.598+0000 77b6940 -1 bdev(0x16f429d0 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T11:10:23.624 INFO:tasks.ceph.osd.12.trial049.stderr:2026-02-17T11:10:23.615+0000 15c7c640 -1 osd.12 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T11:10:23.626 INFO:tasks.ceph.osd.10.trial157.stderr:2026-02-17T11:10:23.609+0000 77b6940 -1 bdev(0x16f429d0 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T11:10:23.626 INFO:tasks.ceph.osd.6.trial157.stderr:2026-02-17T11:10:23.607+0000 77b6940 -1 bdev(0x16f32d10 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T11:10:23.626 INFO:tasks.ceph.osd.10.trial157.stderr:2026-02-17T11:10:23.624+0000 77b6940 -1 bdev(0x16f429d0 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T11:10:23.635 INFO:tasks.ceph.osd.6.trial157.stderr:2026-02-17T11:10:23.633+0000 77b6940 -1 bdev(0x16f32d10 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 4 2026-02-17T11:10:23.636 INFO:tasks.ceph.osd.10.trial157.stderr:2026-02-17T11:10:23.632+0000 77b6940 -1 bdev(0x16f429d0 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T11:10:23.678 INFO:tasks.ceph.osd.10.trial157.stderr:2026-02-17T11:10:23.666+0000 77b6940 -1 bdev(0x16f429d0 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 2 2026-02-17T11:10:23.700 INFO:tasks.ceph.osd.10.trial157.stderr:2026-02-17T11:10:23.683+0000 77b6940 -1 bdev(0x16f429d0 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 2 2026-02-17T11:10:23.701 INFO:tasks.ceph.osd.6.trial157.stderr:2026-02-17T11:10:23.683+0000 77b6940 -1 bdev(0x16f32d10 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 5 2026-02-17T11:10:23.701 INFO:tasks.ceph.osd.6.trial157.stderr:2026-02-17T11:10:23.694+0000 77b6940 -1 bdev(0x16f32d10 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T11:10:23.711 INFO:tasks.ceph.osd.10.trial157.stderr:2026-02-17T11:10:23.699+0000 77b6940 -1 bdev(0x16f429d0 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T11:10:23.718 INFO:tasks.ceph.osd.10.trial157.stderr:2026-02-17T11:10:23.711+0000 77b6940 -1 bdev(0x16f429d0 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T11:10:23.721 INFO:tasks.ceph.osd.10.trial157.stderr:2026-02-17T11:10:23.717+0000 77b6940 -1 bdev(0x16f429d0 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T11:10:23.722 INFO:tasks.ceph.osd.6.trial157.stderr:2026-02-17T11:10:23.700+0000 77b6940 -1 bdev(0x16f32d10 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T11:10:23.722 INFO:tasks.ceph.osd.6.trial157.stderr:2026-02-17T11:10:23.706+0000 77b6940 -1 bdev(0x16f32d10 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T11:10:23.736 INFO:tasks.ceph.osd.10.trial157.stderr:2026-02-17T11:10:23.720+0000 77b6940 -1 bdev(0x16f429d0 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T11:10:23.767 INFO:tasks.ceph.osd.10.trial157.stderr:2026-02-17T11:10:23.721+0000 77b6940 -1 bdev(0x16f429d0 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T11:10:23.773 INFO:tasks.ceph.osd.10.trial157.stderr:2026-02-17T11:10:23.735+0000 77b6940 -1 bdev(0x16f429d0 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 2 2026-02-17T11:10:23.773 INFO:tasks.ceph.osd.10.trial157.stderr:2026-02-17T11:10:23.766+0000 77b6940 -1 bdev(0x16f429d0 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T11:10:23.779 INFO:tasks.ceph.osd.6.trial157.stderr:2026-02-17T11:10:23.721+0000 77b6940 -1 bdev(0x16f32d10 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 2 2026-02-17T11:10:23.780 INFO:tasks.ceph.osd.6.trial157.stderr:2026-02-17T11:10:23.745+0000 77b6940 -1 bdev(0x16f32d10 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T11:10:23.784 INFO:tasks.ceph.osd.10.trial157.stderr:2026-02-17T11:10:23.772+0000 77b6940 -1 bdev(0x16f429d0 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T11:10:23.786 INFO:tasks.ceph.osd.6.trial157.stderr:2026-02-17T11:10:23.779+0000 77b6940 -1 bdev(0x16f32d10 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T11:10:23.793 INFO:tasks.ceph.osd.6.trial157.stderr:2026-02-17T11:10:23.785+0000 77b6940 -1 bdev(0x16f32d10 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T11:10:23.796 INFO:tasks.ceph.osd.10.trial157.stderr:2026-02-17T11:10:23.783+0000 77b6940 -1 bdev(0x16f429d0 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T11:10:23.812 INFO:tasks.ceph.osd.6.trial157.stderr:2026-02-17T11:10:23.792+0000 77b6940 -1 bdev(0x16f32d10 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T11:10:23.817 INFO:tasks.ceph.osd.10.trial157.stderr:2026-02-17T11:10:23.795+0000 77b6940 -1 bdev(0x16f429d0 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T11:10:23.822 INFO:tasks.ceph.osd.10.trial157.stderr:2026-02-17T11:10:23.817+0000 77b6940 -1 bdev(0x16f429d0 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T11:10:23.839 INFO:tasks.ceph.osd.10.trial157.stderr:2026-02-17T11:10:23.821+0000 77b6940 -1 bdev(0x16f429d0 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T11:10:23.845 INFO:tasks.ceph.osd.10.trial157.stderr:2026-02-17T11:10:23.838+0000 77b6940 -1 bdev(0x16f429d0 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T11:10:23.851 INFO:tasks.ceph.osd.10.trial157.stderr:2026-02-17T11:10:23.844+0000 77b6940 -1 bdev(0x16f429d0 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T11:10:23.862 INFO:tasks.ceph.osd.10.trial157.stderr:2026-02-17T11:10:23.850+0000 77b6940 -1 bdev(0x16f429d0 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T11:10:23.865 INFO:tasks.ceph.osd.6.trial157.stderr:2026-02-17T11:10:23.864+0000 77b6940 -1 bdev(0x16f32d10 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 2 2026-02-17T11:10:23.874 INFO:tasks.ceph.osd.10.trial157.stderr:2026-02-17T11:10:23.861+0000 77b6940 -1 bdev(0x16f429d0 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T11:10:23.878 INFO:tasks.ceph.osd.6.trial157.stderr:2026-02-17T11:10:23.875+0000 77b6940 -1 bdev(0x16f32d10 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 3 2026-02-17T11:10:23.879 INFO:tasks.ceph.osd.6.trial157.stderr:2026-02-17T11:10:23.877+0000 77b6940 -1 bdev(0x16f32d10 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T11:10:23.889 INFO:tasks.ceph.osd.10.trial157.stderr:2026-02-17T11:10:23.887+0000 77b6940 -1 bdev(0x16f429d0 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T11:10:23.891 INFO:tasks.ceph.osd.6.trial157.stderr:2026-02-17T11:10:23.888+0000 77b6940 -1 bdev(0x16f32d10 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2026-02-17T11:10:23.916 INFO:tasks.ceph.osd.6.trial157.stderr:2026-02-17T11:10:23.907+0000 77b6940 -1 bdev(0x16f32d10 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 2 2026-02-17T11:10:23.917 INFO:tasks.ceph.osd.10.trial157.stderr:2026-02-17T11:10:23.902+0000 77b6940 -1 bdev(0x16f429d0 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T11:10:23.923 INFO:tasks.ceph.osd.10.trial157.stderr:2026-02-17T11:10:23.916+0000 77b6940 -1 bdev(0x16f429d0 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-17T11:10:23.924 INFO:tasks.ceph.osd.6.trial157.stderr:2026-02-17T11:10:23.918+0000 77b6940 -1 bdev(0x16f32d10 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 3 2026-02-17T11:10:23.928 INFO:tasks.ceph.osd.6.trial157.stderr:2026-02-17T11:10:23.925+0000 77b6940 -1 bdev(0x16f32d10 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 3 2026-02-17T11:10:23.933 INFO:tasks.ceph.osd.10.trial157.stderr:2026-02-17T11:10:23.932+0000 77b6940 -1 bdev(0x16f429d0 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 3 2026-02-17T11:10:24.329 INFO:tasks.ceph.osd.6.trial157.stderr:2026-02-17T11:10:24.326+0000 deb0640 -1 osd.6 0 waiting for initial osdmap 2026-02-17T11:10:24.332 INFO:tasks.ceph.osd.10.trial157.stderr:2026-02-17T11:10:24.330+0000 ce9c640 -1 osd.10 0 waiting for initial osdmap 2026-02-17T11:10:24.570 INFO:tasks.ceph.osd.10.trial157.stderr:2026-02-17T11:10:24.563+0000 15c7c640 -1 osd.10 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T11:10:24.604 INFO:tasks.ceph.osd.6.trial157.stderr:2026-02-17T11:10:24.597+0000 15c7c640 -1 osd.6 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T11:10:29.188 DEBUG:teuthology.orchestra.run.trial049:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T11:10:29.246 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.244+0000 7f8055a22640 10 monclient: get_monmap_and_config 2026-02-17T11:10:29.246 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.244+0000 7f8055a22640 10 monclient: build_initial_monmap 2026-02-17T11:10:29.246 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.244+0000 7f8055a22640 10 monclient: monmap: 2026-02-17T11:10:29.246 INFO:teuthology.misc.health.trial049.stderr:epoch 0 2026-02-17T11:10:29.246 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:29.247 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:10:29.245200+0000 2026-02-17T11:10:29.247 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:10:29.245200+0000 2026-02-17T11:10:29.247 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:29.247 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:10:29.247 INFO:teuthology.misc.health.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:29.247 INFO:teuthology.misc.health.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:29.247 INFO:teuthology.misc.health.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:29.247 INFO:teuthology.misc.health.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:29.247 INFO:teuthology.misc.health.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:29.247 INFO:teuthology.misc.health.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:29.247 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:10:29.251 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.245+0000 7f8055a22640 1 Processor -- start 2026-02-17T11:10:29.251 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.245+0000 7f8055a22640 1 -- start start 2026-02-17T11:10:29.251 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.245+0000 7f8055a22640 10 monclient: init 2026-02-17T11:10:29.251 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.245+0000 7f8055a22640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:29.251 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.245+0000 7f8055a22640 10 monclient: _add_conns ranks=[1,5,0,4,2,3] 2026-02-17T11:10:29.251 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.245+0000 7f8055a22640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f805015f6e0 addr v1:10.20.193.97:6789/0 2026-02-17T11:10:29.251 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.245+0000 7f8055a22640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f80500d23f0 0x7f805015fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:29.251 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.245+0000 7f8055a22640 10 monclient(hunting): picked mon.noname-c con 0x7f80500d23f0 addr v2:10.20.193.157:3300/0 2026-02-17T11:10:29.252 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.245+0000 7f8055a22640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f8050160000 addr v1:10.20.193.49:6789/0 2026-02-17T11:10:29.252 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.245+0000 7f8055a22640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80500cd780 con 0x7f8050160000 2026-02-17T11:10:29.252 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.245+0000 7f8055a22640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80500ccd00 con 0x7f805015f6e0 2026-02-17T11:10:29.252 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.245+0000 7f8055a22640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:29.252 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.245+0000 7f8055a22640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f80500cd280 con 0x7f80500d23f0 2026-02-17T11:10:29.252 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.245+0000 7f8055a22640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:29.252 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.245+0000 7f8055a22640 10 monclient(hunting): authenticate will time out at 1105.908776s 2026-02-17T11:10:29.252 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.246+0000 7f804effd640 1 --1- >> v1:10.20.193.97:6789/0 conn(0x7f805015f6e0 0x7f80500cb6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.97:6789/0 says I am v1:10.20.193.49:51550/0 (socket says 10.20.193.49:51550) 2026-02-17T11:10:29.252 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.246+0000 7f804effd640 1 -- 10.20.193.49:0/4290648061 learned_addr learned my addr 10.20.193.49:0/4290648061 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:10:29.252 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.246+0000 7f804f7fe640 1 --1- 10.20.193.49:0/4290648061 >> v1:10.20.193.49:6789/0 conn(0x7f8050160000 0x7f80500c98e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.49:6789/0 says I am v1:10.20.193.49:50364/0 (socket says 10.20.193.49:50364) 2026-02-17T11:10:29.252 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.246+0000 7f804e7fc640 1 --2- 10.20.193.49:0/4290648061 >> v2:10.20.193.157:3300/0 conn(0x7f80500d23f0 0x7f805015fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:29.253 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.246+0000 7f804e7fc640 10 monclient(hunting): get_auth_request con 0x7f80500d23f0 auth_method 0 2026-02-17T11:10:29.253 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.246+0000 7f804e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:29.253 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.246+0000 7f804e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:29.253 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.246+0000 7f804e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:29.253 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.246+0000 7f804e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:29.253 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.246+0000 7f804e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:29.253 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.246+0000 7f804e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:29.253 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.247+0000 7f804dffb640 1 -- 10.20.193.49:0/4290648061 <== mon.0 v1:10.20.193.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 126324888 0 0) 0x7f80500cd780 con 0x7f8050160000 2026-02-17T11:10:29.253 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.247+0000 7f804dffb640 10 monclient(hunting): _negotiate 2026-02-17T11:10:29.253 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.247+0000 7f804dffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:29.253 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.247+0000 7f804dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:29.253 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.247+0000 7f804dffb640 10 monclient(hunting): my global_id is 4371 2026-02-17T11:10:29.254 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.247+0000 7f804dffb640 1 -- 10.20.193.49:0/4290648061 --> v1:10.20.193.49:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f803c003620 con 0x7f8050160000 2026-02-17T11:10:29.254 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.247+0000 7f804dffb640 1 -- 10.20.193.49:0/4290648061 <== mon.1 v1:10.20.193.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 844582713 0 0) 0x7f80500ccd00 con 0x7f805015f6e0 2026-02-17T11:10:29.254 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.247+0000 7f804dffb640 10 monclient(hunting): _negotiate 2026-02-17T11:10:29.254 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.247+0000 7f804dffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:29.254 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.247+0000 7f804dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:29.254 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.247+0000 7f804dffb640 10 monclient(hunting): my global_id is 4372 2026-02-17T11:10:29.254 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.247+0000 7f804dffb640 1 -- 10.20.193.49:0/4290648061 --> v1:10.20.193.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80500cd780 con 0x7f805015f6e0 2026-02-17T11:10:29.254 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.248+0000 7f804e7fc640 10 monclient(hunting): handle_auth_done global_id 4382 payload 274 2026-02-17T11:10:29.254 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.248+0000 7f804e7fc640 1 -- 10.20.193.49:0/4290648061 >> v1:10.20.193.97:6789/0 conn(0x7f805015f6e0 legacy=0x7f80500cb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:29.254 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.248+0000 7f804e7fc640 1 -- 10.20.193.49:0/4290648061 >> v1:10.20.193.49:6789/0 conn(0x7f8050160000 legacy=0x7f80500c98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:29.254 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.248+0000 7f804e7fc640 10 monclient: _finish_hunting 0 2026-02-17T11:10:29.255 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.248+0000 7f804e7fc640 1 monclient: found mon.noname-c 2026-02-17T11:10:29.255 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.248+0000 7f804e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:29.255 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.248+0000 7f804e7fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:10:29.255 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.248+0000 7f804e7fc640 1 -- 10.20.193.49:0/4290648061 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80500ccfa0 con 0x7f80500d23f0 2026-02-17T11:10:29.261 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.250+0000 7f804e7fc640 1 --2- 10.20.193.49:0/4290648061 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f80500d23f0 0x7f805015fac0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f80500cd400 tx=0x7f803802eee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55cf22304c601223 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:29.261 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.252+0000 7f804dffb640 1 -- 10.20.193.49:0/4290648061 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f803803c070 con 0x7f80500d23f0 2026-02-17T11:10:29.261 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.252+0000 7f804dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:29.261 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.252+0000 7f804dffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:10:29.261 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.252+0000 7f804dffb640 10 monclient: dump: 2026-02-17T11:10:29.262 INFO:teuthology.misc.health.trial049.stderr:epoch 1 2026-02-17T11:10:29.262 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:29.262 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:29.262 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:29.262 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:29.262 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:10:29.262 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:29.262 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:29.262 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:29.262 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:10:29.262 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.252+0000 7f804dffb640 10 monclient: _finish_auth 0 2026-02-17T11:10:29.262 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.252+0000 7f804dffb640 10 monclient: _check_auth_tickets 2026-02-17T11:10:29.262 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.252+0000 7f804dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:29.263 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.252+0000 7f8055a22640 5 monclient: authenticate success, global_id 4382 2026-02-17T11:10:29.263 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.252+0000 7f804dffb640 1 -- 10.20.193.49:0/4290648061 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f803802fbf0 con 0x7f80500d23f0 2026-02-17T11:10:29.263 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.252+0000 7f8055a22640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:10:29.263 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.252+0000 7f804dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:29.263 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.252+0000 7f8055a22640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:29.263 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.252+0000 7f804dffb640 1 -- 10.20.193.49:0/4290648061 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8038037440 con 0x7f80500d23f0 2026-02-17T11:10:29.263 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.252+0000 7f804dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:29.263 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.252+0000 7f8055a22640 4 set_mon_vals no callback set 2026-02-17T11:10:29.263 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.252+0000 7f804dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:10:29.263 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.252+0000 7f804dffb640 10 monclient: dump: 2026-02-17T11:10:29.263 INFO:teuthology.misc.health.trial049.stderr:epoch 1 2026-02-17T11:10:29.263 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:29.264 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:29.264 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:29.264 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:29.264 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:10:29.264 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:29.264 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:29.264 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:29.264 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:10:29.264 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.252+0000 7f8055a22640 10 monclient: shutdown 2026-02-17T11:10:29.264 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.252+0000 7f8055a22640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:29.264 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.252+0000 7f8055a22640 1 -- 10.20.193.49:0/4290648061 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f80500d23f0 msgr2=0x7f805015fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:29.264 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.252+0000 7f8055a22640 1 --2- 10.20.193.49:0/4290648061 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f80500d23f0 0x7f805015fac0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f80500cd400 tx=0x7f803802eee0 comp rx=0 tx=0).stop 2026-02-17T11:10:29.265 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.252+0000 7f8055a22640 1 -- 10.20.193.49:0/4290648061 shutdown_connections 2026-02-17T11:10:29.265 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.252+0000 7f8055a22640 1 --2- 10.20.193.49:0/4290648061 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f80500d23f0 0x7f805015fac0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:29.265 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.252+0000 7f8055a22640 1 -- 10.20.193.49:0/4290648061 >> 10.20.193.49:0/4290648061 conn(0x7f80500d18d0 msgr2=0x7f80500d1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:29.265 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.252+0000 7f8055a22640 1 -- 10.20.193.49:0/4290648061 shutdown_connections 2026-02-17T11:10:29.265 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.252+0000 7f8055a22640 1 -- 10.20.193.49:0/4290648061 wait complete. 2026-02-17T11:10:29.265 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.253+0000 7f8055a22640 10 monclient: build_initial_monmap 2026-02-17T11:10:29.265 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.253+0000 7f8055a22640 10 monclient: monmap: 2026-02-17T11:10:29.265 INFO:teuthology.misc.health.trial049.stderr:epoch 0 2026-02-17T11:10:29.265 INFO:teuthology.misc.health.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:29.265 INFO:teuthology.misc.health.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:29.265 INFO:teuthology.misc.health.trial049.stderr:created 0.000000 2026-02-17T11:10:29.265 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:29.266 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:10:29.266 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:29.266 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:29.266 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:29.266 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:10:29.266 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.253+0000 7f8055a22640 1 librados: starting msgr at 2026-02-17T11:10:29.266 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.253+0000 7f8055a22640 1 librados: starting objecter 2026-02-17T11:10:29.266 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.253+0000 7f8055a22640 1 Processor -- start 2026-02-17T11:10:29.266 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.253+0000 7f8055a22640 1 -- start start 2026-02-17T11:10:29.266 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.253+0000 7f8055a22640 1 librados: setting wanted keys 2026-02-17T11:10:29.266 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.253+0000 7f8055a22640 1 librados: calling monclient init 2026-02-17T11:10:29.266 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.253+0000 7f8055a22640 10 monclient: init 2026-02-17T11:10:29.267 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.253+0000 7f8055a22640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:29.267 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.253+0000 7f8055a22640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:10:29.267 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.253+0000 7f8055a22640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f80500d23f0 0x7f80501f7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:29.267 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.253+0000 7f8055a22640 10 monclient(hunting): picked mon.noname-a con 0x7f80500d23f0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:29.267 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.253+0000 7f8055a22640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f805015f6e0 0x7f80501450f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:29.267 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.253+0000 7f8055a22640 10 monclient(hunting): picked mon.noname-c con 0x7f805015f6e0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:29.267 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.253+0000 7f8055a22640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f8050160000 0x7f8050157940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:29.267 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.253+0000 7f8055a22640 10 monclient(hunting): picked mon.noname-b con 0x7f8050160000 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:29.267 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.253+0000 7f8055a22640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:29.267 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.253+0000 7f8055a22640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f80500c90e0 con 0x7f80500d23f0 2026-02-17T11:10:29.267 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.253+0000 7f8055a22640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:29.267 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.253+0000 7f8055a22640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f80500d2840 con 0x7f8050160000 2026-02-17T11:10:29.267 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.253+0000 7f8055a22640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:29.268 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.253+0000 7f8055a22640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f80500c93c0 con 0x7f805015f6e0 2026-02-17T11:10:29.268 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.253+0000 7f8055a22640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:29.268 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.253+0000 7f8055a22640 10 monclient(hunting): authenticate will time out at 1105.916905s 2026-02-17T11:10:29.268 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.254+0000 7f804effd640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f80500d23f0 0x7f80501f7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:29.268 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.254+0000 7f804f7fe640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f8050160000 0x7f8050157940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:29.268 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.254+0000 7f804e7fc640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f805015f6e0 0x7f80501450f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:29.268 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.254+0000 7f804effd640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f80500d23f0 0x7f80501f7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:60916/0 (socket says 10.20.193.49:60916) 2026-02-17T11:10:29.268 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.254+0000 7f804effd640 1 -- 10.20.193.49:0/3151892737 learned_addr learned my addr 10.20.193.49:0/3151892737 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:29.268 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.254+0000 7f804effd640 10 monclient(hunting): get_auth_request con 0x7f80500d23f0 auth_method 0 2026-02-17T11:10:29.268 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.254+0000 7f804effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:29.268 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.254+0000 7f804effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:29.268 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.254+0000 7f804effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:29.269 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.254+0000 7f804f7fe640 10 monclient(hunting): get_auth_request con 0x7f8050160000 auth_method 0 2026-02-17T11:10:29.269 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.254+0000 7f804f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:29.269 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.254+0000 7f804f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:29.269 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.254+0000 7f804f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:29.269 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.254+0000 7f804e7fc640 10 monclient(hunting): get_auth_request con 0x7f805015f6e0 auth_method 0 2026-02-17T11:10:29.269 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.254+0000 7f804e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:29.269 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.254+0000 7f804e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:29.269 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.254+0000 7f804e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:29.269 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.254+0000 7f804effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:29.269 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.254+0000 7f804effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:29.269 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.254+0000 7f804effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:29.269 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.254+0000 7f804e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:29.269 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.254+0000 7f804e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:29.270 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.254+0000 7f804e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:29.270 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.254+0000 7f804f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:29.270 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.254+0000 7f804f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:29.270 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.254+0000 7f804f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:29.270 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.256+0000 7f804e7fc640 10 monclient(hunting): handle_auth_done global_id 4385 payload 824 2026-02-17T11:10:29.270 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.256+0000 7f804e7fc640 1 -- 10.20.193.49:0/3151892737 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f8050160000 msgr2=0x7f8050157940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:29.270 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.256+0000 7f804e7fc640 1 --2- 10.20.193.49:0/3151892737 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f8050160000 0x7f8050157940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:29.270 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.256+0000 7f804e7fc640 1 -- 10.20.193.49:0/3151892737 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f80500d23f0 msgr2=0x7f80501f7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:29.270 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.256+0000 7f804e7fc640 1 --2- 10.20.193.49:0/3151892737 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f80500d23f0 0x7f80501f7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:29.270 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.256+0000 7f804e7fc640 10 monclient: _finish_hunting 0 2026-02-17T11:10:29.270 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.256+0000 7f804e7fc640 1 monclient: found mon.noname-c 2026-02-17T11:10:29.270 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.256+0000 7f804e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:29.270 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.256+0000 7f804e7fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:10:29.271 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.256+0000 7f804e7fc640 1 -- 10.20.193.49:0/3151892737 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80501568a0 con 0x7f805015f6e0 2026-02-17T11:10:29.271 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.257+0000 7f804e7fc640 1 --2- 10.20.193.49:0/3151892737 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f805015f6e0 0x7f80501450f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8038036000 tx=0x7f80380047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:29.271 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.257+0000 7f8027fff640 10 client.?.objecter ms_handle_connect 0x7f805015f6e0 2026-02-17T11:10:29.271 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.257+0000 7f8027fff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:29.271 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.258+0000 7f8027fff640 1 -- 10.20.193.49:0/3151892737 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8038046020 con 0x7f805015f6e0 2026-02-17T11:10:29.271 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.258+0000 7f8027fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:29.271 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.258+0000 7f8027fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:10:29.271 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.258+0000 7f8027fff640 10 monclient: dump: 2026-02-17T11:10:29.271 INFO:teuthology.misc.health.trial049.stderr:epoch 1 2026-02-17T11:10:29.271 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:29.271 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:29.271 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:29.272 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:29.272 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:10:29.272 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:29.272 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:29.272 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:29.272 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:10:29.272 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.258+0000 7f8027fff640 10 monclient: _finish_auth 0 2026-02-17T11:10:29.272 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.258+0000 7f8027fff640 10 monclient: _check_auth_tickets 2026-02-17T11:10:29.272 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.258+0000 7f8027fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:29.272 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.258+0000 7f8055a22640 5 monclient: authenticate success, global_id 4385 2026-02-17T11:10:29.272 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.258+0000 7f8055a22640 10 monclient: _renew_subs 2026-02-17T11:10:29.272 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.258+0000 7f8055a22640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:29.272 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.258+0000 7f8055a22640 1 -- 10.20.193.49:0/3151892737 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8050156b80 con 0x7f805015f6e0 2026-02-17T11:10:29.273 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.258+0000 7f8055a22640 10 client.4385.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:29.273 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.258+0000 7f8055a22640 10 monclient: _renew_subs 2026-02-17T11:10:29.273 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.258+0000 7f8055a22640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:29.273 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.258+0000 7f8055a22640 1 -- 10.20.193.49:0/3151892737 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8050157140 con 0x7f805015f6e0 2026-02-17T11:10:29.273 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.258+0000 7f8055a22640 1 librados: init done 2026-02-17T11:10:29.273 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.259+0000 7f8055a22640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:29.273 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.259+0000 7f8055a22640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:29.273 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.259+0000 7f8055a22640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:29.273 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.259+0000 7f8055a22640 1 -- 10.20.193.49:0/3151892737 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f805006a1b0 con 0x7f805015f6e0 2026-02-17T11:10:29.273 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.259+0000 7f8027fff640 1 -- 10.20.193.49:0/3151892737 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f803802fbf0 con 0x7f805015f6e0 2026-02-17T11:10:29.273 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.259+0000 7f8027fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:29.273 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.259+0000 7f8027fff640 1 -- 10.20.193.49:0/3151892737 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f803803c040 con 0x7f805015f6e0 2026-02-17T11:10:29.273 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.259+0000 7f8027fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:29.274 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.259+0000 7f8027fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:10:29.274 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.259+0000 7f8027fff640 10 monclient: dump: 2026-02-17T11:10:29.274 INFO:teuthology.misc.health.trial049.stderr:epoch 1 2026-02-17T11:10:29.274 INFO:teuthology.misc.health.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:29.274 INFO:teuthology.misc.health.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:29.274 INFO:teuthology.misc.health.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:29.274 INFO:teuthology.misc.health.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:29.274 INFO:teuthology.misc.health.trial049.stderr:election_strategy: 1 2026-02-17T11:10:29.274 INFO:teuthology.misc.health.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:29.274 INFO:teuthology.misc.health.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:29.274 INFO:teuthology.misc.health.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:29.274 INFO:teuthology.misc.health.trial049.stderr: 2026-02-17T11:10:29.275 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.259+0000 7f804d7fa640 4 set_mon_vals no callback set 2026-02-17T11:10:29.369 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.367+0000 7f8027fff640 1 -- 10.20.193.49:0/3151892737 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f803804a3b0 con 0x7f805015f6e0 2026-02-17T11:10:29.370 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.368+0000 7f8027fff640 1 --2- 10.20.193.49:0/3151892737 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f8020079170 0x7f802007b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:29.370 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.368+0000 7f804effd640 1 --2- 10.20.193.49:0/3151892737 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f8020079170 0x7f802007b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:29.370 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.368+0000 7f804effd640 10 monclient: get_auth_request con 0x7f8020079170 auth_method 0 2026-02-17T11:10:29.370 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.369+0000 7f804effd640 1 --2- 10.20.193.49:0/3151892737 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f8020079170 0x7f802007b630 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8044005980 tx=0x7f8044009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:29.370 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.369+0000 7f8027fff640 10 client.4385.objecter ms_handle_connect 0x7f8020079170 2026-02-17T11:10:29.371 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.369+0000 7f8027fff640 1 -- 10.20.193.49:0/3151892737 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 8563+0+0 (secure 0 0 0) 0x7f80380bc430 con 0x7f805015f6e0 2026-02-17T11:10:29.371 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.369+0000 7f8027fff640 10 client.4385.objecter ms_dispatch2 0x7f8050000b90 osd_map(29..29 src has 1..29) 2026-02-17T11:10:29.371 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.369+0000 7f8027fff640 3 client.4385.objecter handle_osd_map got epochs [29,29] > 0 2026-02-17T11:10:29.371 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.369+0000 7f8027fff640 3 client.4385.objecter handle_osd_map decoding full epoch 29 2026-02-17T11:10:29.372 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.370+0000 7f8027fff640 20 client.4385.objecter dump_active .. 0 homeless 2026-02-17T11:10:29.377 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.376+0000 7f8027fff640 1 -- 10.20.193.49:0/3151892737 <== mon.2 v2:10.20.193.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f805006a1b0 con 0x7f805015f6e0 2026-02-17T11:10:29.377 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.376+0000 7f8027fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:29.377 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.376+0000 7f8027fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:29.460 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.458+0000 7f8055a22640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:10:29.460 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.458+0000 7f8055a22640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:10:29.460 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.458+0000 7f8055a22640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:29.460 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.458+0000 7f8055a22640 1 -- 10.20.193.49:0/3151892737 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f80500ca3f0 con 0x7f805015f6e0 2026-02-17T11:10:29.528 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.526+0000 7f8027fff640 1 -- 10.20.193.49:0/3151892737 <== mon.2 v2:10.20.193.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+22767 (secure 0 0 0) 0x7f80500ca3f0 con 0x7f805015f6e0 2026-02-17T11:10:29.528 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.526+0000 7f8027fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:10:29.528 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.526+0000 7f8027fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:29.528 INFO:teuthology.misc.health.trial049.stdout: 2026-02-17T11:10:29.529 INFO:teuthology.misc.health.trial049.stdout:{"epoch":29,"fsid":"2799a57b-9ea3-46ae-8e91-1fe004a3651d","created":"2026-02-17T11:08:37.595499+0000","modified":"2026-02-17T11:10:28.361028+0000","last_up_change":"2026-02-17T11:10:25.779416+0000","last_in_change":"2026-02-17T11:08:43.985163+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T11:10:20.646344+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"30bc819e-140a-433e-b860-eaa88e282a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6824","nonce":3898931472},{"type":"v1","addr":"10.20.193.49:6825","nonce":3898931472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6826","nonce":3898931472},{"type":"v1","addr":"10.20.193.49:6827","nonce":3898931472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6830","nonce":3898931472},{"type":"v1","addr":"10.20.193.49:6831","nonce":3898931472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6828","nonce":3898931472},{"type":"v1","addr":"10.20.193.49:6829","nonce":3898931472}]},"public_addr":"10.20.193.49:6825/3898931472","cluster_addr":"10.20.193.49:6827/3898931472","heartbeat_back_addr":"10.20.193.49:6831/3898931472","heartbeat_front_addr":"10.20.193.49:6829/3898931472","state":["exists","up"]},{"osd":1,"uuid":"2f7f1f11-f256-4094-82a9-5d21882e6e0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6816","nonce":4259563897},{"type":"v1","addr":"10.20.193.97:6817","nonce":4259563897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6818","nonce":4259563897},{"type":"v1","addr":"10.20.193.97:6819","nonce":4259563897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6822","nonce":4259563897},{"type":"v1","addr":"10.20.193.97:6823","nonce":4259563897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6820","nonce":4259563897},{"type":"v1","addr":"10.20.193.97:6821","nonce":4259563897}]},"public_addr":"10.20.193.97:6817/4259563897","cluster_addr":"10.20.193.97:6819/4259563897","heartbeat_back_addr":"10.20.193.97:6823/4259563897","heartbeat_front_addr":"10.20.193.97:6821/4259563897","state":["exists","up"]},{"osd":2,"uuid":"26bd1274-fe52-42cb-876b-df9920880f95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6816","nonce":1377516118},{"type":"v1","addr":"10.20.193.157:6817","nonce":1377516118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6818","nonce":1377516118},{"type":"v1","addr":"10.20.193.157:6819","nonce":1377516118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6822","nonce":1377516118},{"type":"v1","addr":"10.20.193.157:6823","nonce":1377516118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6820","nonce":1377516118},{"type":"v1","addr":"10.20.193.157:6821","nonce":1377516118}]},"public_addr":"10.20.193.157:6817/1377516118","cluster_addr":"10.20.193.157:6819/1377516118","heartbeat_back_addr":"10.20.193.157:6823/1377516118","heartbeat_front_addr":"10.20.193.157:6821/1377516118","state":["exists","up"]},{"osd":3,"uuid":"c78a5263-3b0d-4b22-a848-bcd6a1e4f6b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6818","nonce":1543573918},{"type":"v1","addr":"10.20.193.162:6820","nonce":1543573918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6822","nonce":1543573918},{"type":"v1","addr":"10.20.193.162:6824","nonce":1543573918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6830","nonce":1543573918},{"type":"v1","addr":"10.20.193.162:6832","nonce":1543573918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6826","nonce":1543573918},{"type":"v1","addr":"10.20.193.162:6828","nonce":1543573918}]},"public_addr":"10.20.193.162:6820/1543573918","cluster_addr":"10.20.193.162:6824/1543573918","heartbeat_back_addr":"10.20.193.162:6832/1543573918","heartbeat_front_addr":"10.20.193.162:6828/1543573918","state":["exists","up"]},{"osd":4,"uuid":"f0fdfadd-2f39-4ad8-ac88-cb588c5e8ee0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6808","nonce":2238942007},{"type":"v1","addr":"10.20.193.49:6809","nonce":2238942007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6810","nonce":2238942007},{"type":"v1","addr":"10.20.193.49:6811","nonce":2238942007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6816","nonce":2238942007},{"type":"v1","addr":"10.20.193.49:6817","nonce":2238942007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6813","nonce":2238942007},{"type":"v1","addr":"10.20.193.49:6815","nonce":2238942007}]},"public_addr":"10.20.193.49:6809/2238942007","cluster_addr":"10.20.193.49:6811/2238942007","heartbeat_back_addr":"10.20.193.49:6817/2238942007","heartbeat_front_addr":"10.20.193.49:6815/2238942007","state":["exists","up"]},{"osd":5,"uuid":"65872639-d6c0-482d-95d1-1d9f250781c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6800","nonce":3226749558},{"type":"v1","addr":"10.20.193.97:6801","nonce":3226749558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6802","nonce":3226749558},{"type":"v1","addr":"10.20.193.97:6803","nonce":3226749558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6806","nonce":3226749558},{"type":"v1","addr":"10.20.193.97:6807","nonce":3226749558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6804","nonce":3226749558},{"type":"v1","addr":"10.20.193.97:6805","nonce":3226749558}]},"public_addr":"10.20.193.97:6801/3226749558","cluster_addr":"10.20.193.97:6803/3226749558","heartbeat_back_addr":"10.20.193.97:6807/3226749558","heartbeat_front_addr":"10.20.193.97:6805/3226749558","state":["exists","up"]},{"osd":6,"uuid":"43091d3e-638d-4462-867b-cade02a315e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6800","nonce":815989681},{"type":"v1","addr":"10.20.193.157:6801","nonce":815989681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6802","nonce":815989681},{"type":"v1","addr":"10.20.193.157:6803","nonce":815989681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6806","nonce":815989681},{"type":"v1","addr":"10.20.193.157:6807","nonce":815989681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6804","nonce":815989681},{"type":"v1","addr":"10.20.193.157:6805","nonce":815989681}]},"public_addr":"10.20.193.157:6801/815989681","cluster_addr":"10.20.193.157:6803/815989681","heartbeat_back_addr":"10.20.193.157:6807/815989681","heartbeat_front_addr":"10.20.193.157:6805/815989681","state":["exists","up"]},{"osd":7,"uuid":"890ae4d6-33c9-4515-a896-a689647330dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6806","nonce":2715110678},{"type":"v1","addr":"10.20.193.162:6808","nonce":2715110678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6812","nonce":2715110678},{"type":"v1","addr":"10.20.193.162:6813","nonce":2715110678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6816","nonce":2715110678},{"type":"v1","addr":"10.20.193.162:6817","nonce":2715110678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6814","nonce":2715110678},{"type":"v1","addr":"10.20.193.162:6815","nonce":2715110678}]},"public_addr":"10.20.193.162:6808/2715110678","cluster_addr":"10.20.193.162:6813/2715110678","heartbeat_back_addr":"10.20.193.162:6817/2715110678","heartbeat_front_addr":"10.20.193.162:6815/2715110678","state":["exists","up"]},{"osd":8,"uuid":"f04abc9b-ed75-4582-b47d-07a9890f52bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6800","nonce":1386770137},{"type":"v1","addr":"10.20.193.49:6801","nonce":1386770137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6802","nonce":1386770137},{"type":"v1","addr":"10.20.193.49:6803","nonce":1386770137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6806","nonce":1386770137},{"type":"v1","addr":"10.20.193.49:6807","nonce":1386770137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6804","nonce":1386770137},{"type":"v1","addr":"10.20.193.49:6805","nonce":1386770137}]},"public_addr":"10.20.193.49:6801/1386770137","cluster_addr":"10.20.193.49:6803/1386770137","heartbeat_back_addr":"10.20.193.49:6807/1386770137","heartbeat_front_addr":"10.20.193.49:6805/1386770137","state":["exists","up"]},{"osd":9,"uuid":"7dfbb00a-6b89-4de3-9f30-6aadd91b4408","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6808","nonce":676086260},{"type":"v1","addr":"10.20.193.97:6809","nonce":676086260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6810","nonce":676086260},{"type":"v1","addr":"10.20.193.97:6811","nonce":676086260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6814","nonce":676086260},{"type":"v1","addr":"10.20.193.97:6815","nonce":676086260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6812","nonce":676086260},{"type":"v1","addr":"10.20.193.97:6813","nonce":676086260}]},"public_addr":"10.20.193.97:6809/676086260","cluster_addr":"10.20.193.97:6811/676086260","heartbeat_back_addr":"10.20.193.97:6815/676086260","heartbeat_front_addr":"10.20.193.97:6813/676086260","state":["exists","up"]},{"osd":10,"uuid":"e497a4fd-a944-489b-9cb3-30f5acaeb53e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6808","nonce":3711386099},{"type":"v1","addr":"10.20.193.157:6809","nonce":3711386099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6810","nonce":3711386099},{"type":"v1","addr":"10.20.193.157:6811","nonce":3711386099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6814","nonce":3711386099},{"type":"v1","addr":"10.20.193.157:6815","nonce":3711386099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6812","nonce":3711386099},{"type":"v1","addr":"10.20.193.157:6813","nonce":3711386099}]},"public_addr":"10.20.193.157:6809/3711386099","cluster_addr":"10.20.193.157:6811/3711386099","heartbeat_back_addr":"10.20.193.157:6815/3711386099","heartbeat_front_addr":"10.20.193.157:6813/3711386099","state":["exists","up"]},{"osd":11,"uuid":"7371d50f-36f9-477d-8d4d-853f481dd6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6802","nonce":3400543064},{"type":"v1","addr":"10.20.193.162:6803","nonce":3400543064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6804","nonce":3400543064},{"type":"v1","addr":"10.20.193.162:6805","nonce":3400543064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6810","nonce":3400543064},{"type":"v1","addr":"10.20.193.162:6811","nonce":3400543064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6807","nonce":3400543064},{"type":"v1","addr":"10.20.193.162:6809","nonce":3400543064}]},"public_addr":"10.20.193.162:6803/3400543064","cluster_addr":"10.20.193.162:6805/3400543064","heartbeat_back_addr":"10.20.193.162:6811/3400543064","heartbeat_front_addr":"10.20.193.162:6809/3400543064","state":["exists","up"]},{"osd":12,"uuid":"3cf4fded-49db-4d95-956b-77acc868a3ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6812","nonce":4012737431},{"type":"v1","addr":"10.20.193.49:6814","nonce":4012737431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6818","nonce":4012737431},{"type":"v1","addr":"10.20.193.49:6819","nonce":4012737431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6822","nonce":4012737431},{"type":"v1","addr":"10.20.193.49:6823","nonce":4012737431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6820","nonce":4012737431},{"type":"v1","addr":"10.20.193.49:6821","nonce":4012737431}]},"public_addr":"10.20.193.49:6814/4012737431","cluster_addr":"10.20.193.49:6819/4012737431","heartbeat_back_addr":"10.20.193.49:6823/4012737431","heartbeat_front_addr":"10.20.193.49:6821/4012737431","state":["exists","up"]},{"osd":13,"uuid":"7dc53473-594f-4cfb-8444-eab205e2e0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6824","nonce":409145483},{"type":"v1","addr":"10.20.193.97:6825","nonce":409145483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6826","nonce":409145483},{"type":"v1","addr":"10.20.193.97:6827","nonce":409145483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6830","nonce":409145483},{"type":"v1","addr":"10.20.193.97:6831","nonce":409145483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6828","nonce":409145483},{"type":"v1","addr":"10.20.193.97:6829","nonce":409145483}]},"public_addr":"10.20.193.97:6825/409145483","cluster_addr":"10.20.193.97:6827/409145483","heartbeat_back_addr":"10.20.193.97:6831/409145483","heartbeat_front_addr":"10.20.193.97:6829/409145483","state":["exists","up"]},{"osd":14,"uuid":"e8ab3e8f-29a8-4c79-bf86-d29543aac56a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6824","nonce":404726964},{"type":"v1","addr":"10.20.193.157:6825","nonce":404726964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6826","nonce":404726964},{"type":"v1","addr":"10.20.193.157:6827","nonce":404726964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6830","nonce":404726964},{"type":"v1","addr":"10.20.193.157:6831","nonce":404726964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6828","nonce":404726964},{"type":"v1","addr":"10.20.193.157:6829","nonce":404726964}]},"public_addr":"10.20.193.157:6825/404726964","cluster_addr":"10.20.193.157:6827/404726964","heartbeat_back_addr":"10.20.193.157:6831/404726964","heartbeat_front_addr":"10.20.193.157:6829/404726964","state":["exists","up"]},{"osd":15,"uuid":"300a4696-aa54-4b47-b9f3-87dec719bcfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6819","nonce":3057705174},{"type":"v1","addr":"10.20.193.162:6821","nonce":3057705174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6823","nonce":3057705174},{"type":"v1","addr":"10.20.193.162:6825","nonce":3057705174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6831","nonce":3057705174},{"type":"v1","addr":"10.20.193.162:6833","nonce":3057705174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6827","nonce":3057705174},{"type":"v1","addr":"10.20.193.162:6829","nonce":3057705174}]},"public_addr":"10.20.193.162:6821/3057705174","cluster_addr":"10.20.193.162:6825/3057705174","heartbeat_back_addr":"10.20.193.162:6833/3057705174","heartbeat_front_addr":"10.20.193.162:6829/3057705174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:18.201964+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:17.998817+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:18.526566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:18.016485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:17.449438+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:18.134204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:19.177012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:17.496419+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:17.321828+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:18.265266+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:19.587499+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:17.978701+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:18.041032+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:18.477125+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:19.577746+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:18.096729+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:10:29.531 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.528+0000 7f8055a22640 10 librados: watch_flush enter 2026-02-17T11:10:29.531 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.528+0000 7f8055a22640 10 librados: watch_flush exit 2026-02-17T11:10:29.531 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.528+0000 7f8055a22640 20 client.4385.objecter shutdown clearing up homeless session... 2026-02-17T11:10:29.531 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.528+0000 7f8055a22640 10 client.4385.objecter successfully canceled tick 2026-02-17T11:10:29.531 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.528+0000 7f8055a22640 1 -- 10.20.193.49:0/3151892737 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f8020079170 msgr2=0x7f802007b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:29.531 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.528+0000 7f8055a22640 1 --2- 10.20.193.49:0/3151892737 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f8020079170 0x7f802007b630 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8044005980 tx=0x7f8044009040 comp rx=0 tx=0).stop 2026-02-17T11:10:29.531 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.528+0000 7f8055a22640 10 monclient: shutdown 2026-02-17T11:10:29.531 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.528+0000 7f8055a22640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:29.532 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.528+0000 7f8055a22640 1 -- 10.20.193.49:0/3151892737 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f805015f6e0 msgr2=0x7f80501450f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:29.532 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.528+0000 7f8055a22640 1 --2- 10.20.193.49:0/3151892737 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f805015f6e0 0x7f80501450f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8038036000 tx=0x7f80380047c0 comp rx=0 tx=0).stop 2026-02-17T11:10:29.532 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.528+0000 7f8055a22640 1 -- 10.20.193.49:0/3151892737 shutdown_connections 2026-02-17T11:10:29.532 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.528+0000 7f8055a22640 1 --2- 10.20.193.49:0/3151892737 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f8020079170 0x7f802007b630 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:29.532 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.528+0000 7f8055a22640 1 --2- 10.20.193.49:0/3151892737 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f8050160000 0x7f8050157940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:29.532 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.528+0000 7f8055a22640 1 --2- 10.20.193.49:0/3151892737 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f805015f6e0 0x7f80501450f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:29.532 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.528+0000 7f8055a22640 1 --2- 10.20.193.49:0/3151892737 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f80500d23f0 0x7f80501f7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:29.532 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.528+0000 7f8055a22640 1 -- 10.20.193.49:0/3151892737 >> 10.20.193.49:0/3151892737 conn(0x7f80500d18d0 msgr2=0x7f80500d05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:29.532 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.528+0000 7f8055a22640 1 -- 10.20.193.49:0/3151892737 shutdown_connections 2026-02-17T11:10:29.532 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.528+0000 7f8055a22640 1 -- 10.20.193.49:0/3151892737 wait complete. 2026-02-17T11:10:29.532 INFO:teuthology.misc.health.trial049.stderr:2026-02-17T11:10:29.528+0000 7f8055a22640 1 librados: shutdown 2026-02-17T11:10:29.537 DEBUG:teuthology.misc:16 of 16 OSDs are up 2026-02-17T11:10:29.538 INFO:tasks.ceph:Creating RBD pool 2026-02-17T11:10:29.538 DEBUG:teuthology.orchestra.run.trial049:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-17T11:10:29.603 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.602+0000 7f1678df5640 10 monclient: get_monmap_and_config 2026-02-17T11:10:29.604 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.602+0000 7f1678df5640 10 monclient: build_initial_monmap 2026-02-17T11:10:29.604 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.602+0000 7f1678df5640 10 monclient: monmap: 2026-02-17T11:10:29.604 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:29.604 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:29.604 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:29.602535+0000 2026-02-17T11:10:29.604 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:29.602535+0000 2026-02-17T11:10:29.604 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:29.604 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:29.605 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:29.605 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:29.605 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:29.605 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:29.605 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:29.605 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:29.605 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:29.605 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.602+0000 7f1678df5640 1 Processor -- start 2026-02-17T11:10:29.605 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.602+0000 7f1678df5640 1 -- start start 2026-02-17T11:10:29.605 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.602+0000 7f1678df5640 10 monclient: init 2026-02-17T11:10:29.608 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.602+0000 7f1678df5640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:29.608 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.602+0000 7f1678df5640 10 monclient: _add_conns ranks=[2,4,0,1,3,5] 2026-02-17T11:10:29.608 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.602+0000 7f1678df5640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f16740c7170 addr v1:10.20.193.157:6789/0 2026-02-17T11:10:29.608 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.602+0000 7f1678df5640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f16740c7550 0x7f16740749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:29.608 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.603+0000 7f1678df5640 10 monclient(hunting): picked mon.noname-b con 0x7f16740c7550 addr v2:10.20.193.97:3300/0 2026-02-17T11:10:29.608 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.603+0000 7f1678df5640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f1674074ef0 addr v1:10.20.193.49:6789/0 2026-02-17T11:10:29.608 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.603+0000 7f1678df5640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16740c4fd0 con 0x7f1674074ef0 2026-02-17T11:10:29.609 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.603+0000 7f1678df5640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f167415a9a0 con 0x7f16740c7170 2026-02-17T11:10:29.609 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.603+0000 7f1678df5640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:29.609 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.603+0000 7f1678df5640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f16740c8530 con 0x7f16740c7550 2026-02-17T11:10:29.609 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.603+0000 7f1678df5640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:29.609 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.603+0000 7f1678df5640 10 monclient(hunting): authenticate will time out at 1106.266033s 2026-02-17T11:10:29.609 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.603+0000 7f1671d74640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f16740c7550 0x7f16740749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:29.609 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.603+0000 7f1672d76640 1 --1- >> v1:10.20.193.49:6789/0 conn(0x7f1674074ef0 0x7f16740c89c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.49:6789/0 says I am v1:10.20.193.49:50366/0 (socket says 10.20.193.49:50366) 2026-02-17T11:10:29.609 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.603+0000 7f1672d76640 1 -- 10.20.193.49:0/14861107 learned_addr learned my addr 10.20.193.49:0/14861107 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:10:29.609 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.603+0000 7f1671d74640 10 monclient(hunting): get_auth_request con 0x7f16740c7550 auth_method 0 2026-02-17T11:10:29.609 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.603+0000 7f1671d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:29.609 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.603+0000 7f1671d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:29.610 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.603+0000 7f1671d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:29.610 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.604+0000 7f1671d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:29.610 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.604+0000 7f1671d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:29.610 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.604+0000 7f1671d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:29.610 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.604+0000 7f1671d74640 10 monclient(hunting): handle_auth_done global_id 4378 payload 274 2026-02-17T11:10:29.610 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.604+0000 7f1671d74640 1 -- 10.20.193.49:0/14861107 >> v1:10.20.193.157:6789/0 conn(0x7f16740c7170 legacy=0x7f16740c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:29.610 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.604+0000 7f1671573640 1 -- 10.20.193.49:0/14861107 <== mon.2 v1:10.20.193.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4266645870 0 0) 0x7f167415a9a0 con 0x7f16740c7170 2026-02-17T11:10:29.610 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.604+0000 7f1671d74640 1 -- 10.20.193.49:0/14861107 >> v1:10.20.193.49:6789/0 conn(0x7f1674074ef0 legacy=0x7f16740c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:29.610 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.604+0000 7f1671d74640 10 monclient: _finish_hunting 0 2026-02-17T11:10:29.610 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.604+0000 7f1671d74640 1 monclient: found mon.noname-b 2026-02-17T11:10:29.610 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.604+0000 7f1671d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:29.610 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.604+0000 7f1671d74640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:10:29.611 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.604+0000 7f1671d74640 1 -- 10.20.193.49:0/14861107 --> v2:10.20.193.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16740c5270 con 0x7f16740c7550 2026-02-17T11:10:29.611 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.604+0000 7f1671573640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-17T11:10:29.611 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.605+0000 7f1671d74640 1 --2- 10.20.193.49:0/14861107 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f16740c7550 0x7f16740749b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f165c0098a0 tx=0x7f165c02ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=932489e03b201edf server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:29.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.607+0000 7f1671573640 1 -- 10.20.193.49:0/14861107 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f165c03c070 con 0x7f16740c7550 2026-02-17T11:10:29.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.607+0000 7f1671573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:29.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.607+0000 7f1671573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:10:29.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.607+0000 7f1671573640 10 monclient: dump: 2026-02-17T11:10:29.618 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:29.618 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:29.618 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:29.618 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:29.618 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:29.619 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:29.619 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:29.619 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:29.619 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:29.619 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:29.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.607+0000 7f1671573640 10 monclient: _finish_auth 0 2026-02-17T11:10:29.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.607+0000 7f1671573640 10 monclient: _check_auth_tickets 2026-02-17T11:10:29.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.607+0000 7f1671573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:29.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.607+0000 7f1671573640 1 -- 10.20.193.49:0/14861107 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f165c02fb70 con 0x7f16740c7550 2026-02-17T11:10:29.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.607+0000 7f1671573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:29.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.607+0000 7f1671573640 1 -- 10.20.193.49:0/14861107 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f165c037440 con 0x7f16740c7550 2026-02-17T11:10:29.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.607+0000 7f1671573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:29.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.607+0000 7f1671573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:29.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.607+0000 7f1671573640 10 monclient: dump: 2026-02-17T11:10:29.620 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:29.620 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:29.620 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:29.620 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:29.620 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:29.620 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:29.620 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:29.620 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:29.620 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:29.620 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:29.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.607+0000 7f1678df5640 5 monclient: authenticate success, global_id 4378 2026-02-17T11:10:29.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.607+0000 7f1678df5640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:29.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.607+0000 7f1678df5640 4 set_mon_vals no callback set 2026-02-17T11:10:29.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.608+0000 7f1678df5640 10 monclient: shutdown 2026-02-17T11:10:29.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.608+0000 7f1678df5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:29.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.608+0000 7f1678df5640 1 -- 10.20.193.49:0/14861107 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f16740c7550 msgr2=0x7f16740749b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:29.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.608+0000 7f1678df5640 1 --2- 10.20.193.49:0/14861107 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f16740c7550 0x7f16740749b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f165c0098a0 tx=0x7f165c02ee60 comp rx=0 tx=0).stop 2026-02-17T11:10:29.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.608+0000 7f1678df5640 1 -- 10.20.193.49:0/14861107 shutdown_connections 2026-02-17T11:10:29.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.608+0000 7f1678df5640 1 --2- 10.20.193.49:0/14861107 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f16740c7550 0x7f16740749b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:29.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.608+0000 7f1678df5640 1 -- 10.20.193.49:0/14861107 >> 10.20.193.49:0/14861107 conn(0x7f16740c9f40 msgr2=0x7f16740ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:29.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.608+0000 7f1678df5640 1 -- 10.20.193.49:0/14861107 shutdown_connections 2026-02-17T11:10:29.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.608+0000 7f1678df5640 1 -- 10.20.193.49:0/14861107 wait complete. 2026-02-17T11:10:29.622 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.608+0000 7f1678df5640 10 monclient: build_initial_monmap 2026-02-17T11:10:29.622 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.608+0000 7f1678df5640 10 monclient: monmap: 2026-02-17T11:10:29.622 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:29.622 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:29.622 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:29.622 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:29.622 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:29.622 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:29.622 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:29.622 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:29.622 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:29.622 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:29.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.608+0000 7f1678df5640 1 librados: starting msgr at 2026-02-17T11:10:29.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.608+0000 7f1678df5640 1 librados: starting objecter 2026-02-17T11:10:29.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.608+0000 7f1678df5640 1 Processor -- start 2026-02-17T11:10:29.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.609+0000 7f1678df5640 1 -- start start 2026-02-17T11:10:29.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.609+0000 7f1678df5640 1 librados: setting wanted keys 2026-02-17T11:10:29.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.609+0000 7f1678df5640 1 librados: calling monclient init 2026-02-17T11:10:29.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.609+0000 7f1678df5640 10 monclient: init 2026-02-17T11:10:29.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.609+0000 7f1678df5640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:29.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.609+0000 7f1678df5640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:10:29.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.609+0000 7f1678df5640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f1674074ef0 0x7f1674156a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:29.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.609+0000 7f1678df5640 10 monclient(hunting): picked mon.noname-b con 0x7f1674074ef0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:29.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.609+0000 7f1678df5640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f16740c7170 0x7f16741585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:29.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.609+0000 7f1678df5640 10 monclient(hunting): picked mon.noname-a con 0x7f16740c7170 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:29.624 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.609+0000 7f1678df5640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f16740c7550 0x7f167414cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:29.624 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.609+0000 7f1678df5640 10 monclient(hunting): picked mon.noname-c con 0x7f16740c7550 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:29.624 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.609+0000 7f1678df5640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:29.624 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.609+0000 7f1678df5640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f16740c7ee0 con 0x7f16740c7170 2026-02-17T11:10:29.624 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.609+0000 7f1678df5640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:29.624 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.609+0000 7f1678df5640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f16740c5830 con 0x7f1674074ef0 2026-02-17T11:10:29.624 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.609+0000 7f1678df5640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:29.624 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.609+0000 7f1678df5640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f16740c81c0 con 0x7f16740c7550 2026-02-17T11:10:29.624 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.609+0000 7f1678df5640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:29.624 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.609+0000 7f1678df5640 10 monclient(hunting): authenticate will time out at 1106.272584s 2026-02-17T11:10:29.624 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.609+0000 7f1671d74640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f16740c7170 0x7f16741585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:29.624 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.609+0000 7f1672575640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f1674074ef0 0x7f1674156a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:29.624 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.610+0000 7f1672575640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f1674074ef0 0x7f1674156a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:47876/0 (socket says 10.20.193.49:47876) 2026-02-17T11:10:29.625 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.610+0000 7f1672d76640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f16740c7550 0x7f167414cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:29.625 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.610+0000 7f1672575640 1 -- 10.20.193.49:0/3838207278 learned_addr learned my addr 10.20.193.49:0/3838207278 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:29.625 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.610+0000 7f1672575640 10 monclient(hunting): get_auth_request con 0x7f1674074ef0 auth_method 0 2026-02-17T11:10:29.625 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.610+0000 7f1672575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:29.625 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.610+0000 7f1672575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:29.625 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.610+0000 7f1672575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:29.625 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.610+0000 7f1671d74640 10 monclient(hunting): get_auth_request con 0x7f16740c7170 auth_method 0 2026-02-17T11:10:29.625 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.610+0000 7f1671d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:29.625 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.610+0000 7f1671d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:29.625 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.610+0000 7f1671d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:29.625 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.610+0000 7f1672d76640 10 monclient(hunting): get_auth_request con 0x7f16740c7550 auth_method 0 2026-02-17T11:10:29.625 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.610+0000 7f1672d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:29.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.610+0000 7f1672d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:29.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.610+0000 7f1672d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:29.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.610+0000 7f1672575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:29.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.610+0000 7f1672575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:29.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.610+0000 7f1672575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:29.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.610+0000 7f1671d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:29.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.610+0000 7f1671d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:29.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.610+0000 7f1671d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:29.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.610+0000 7f1672d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:29.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.610+0000 7f1672d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:29.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.610+0000 7f1672d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:29.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.611+0000 7f1672575640 10 monclient(hunting): handle_auth_done global_id 4381 payload 824 2026-02-17T11:10:29.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.611+0000 7f1672575640 1 -- 10.20.193.49:0/3838207278 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f16740c7550 msgr2=0x7f167414cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:29.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.611+0000 7f1672575640 1 --2- 10.20.193.49:0/3838207278 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f16740c7550 0x7f167414cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:29.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.611+0000 7f1672575640 1 -- 10.20.193.49:0/3838207278 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f16740c7170 msgr2=0x7f16741585c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:29.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.611+0000 7f1672575640 1 --2- 10.20.193.49:0/3838207278 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f16740c7170 0x7f16741585c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:29.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.611+0000 7f1672575640 10 monclient: _finish_hunting 0 2026-02-17T11:10:29.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.611+0000 7f1672575640 1 monclient: found mon.noname-b 2026-02-17T11:10:29.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.611+0000 7f1672575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:29.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.611+0000 7f1672575640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:10:29.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.611+0000 7f1672575640 1 -- 10.20.193.49:0/3838207278 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1674156f70 con 0x7f1674074ef0 2026-02-17T11:10:29.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.612+0000 7f1672575640 1 --2- 10.20.193.49:0/3838207278 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f1674074ef0 0x7f1674156a30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f166800c550 tx=0x7f166800ca20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:29.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.612+0000 7f165affd640 10 client.?.objecter ms_handle_connect 0x7f1674074ef0 2026-02-17T11:10:29.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.612+0000 7f165affd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:29.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.613+0000 7f165affd640 1 -- 10.20.193.49:0/3838207278 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1668005480 con 0x7f1674074ef0 2026-02-17T11:10:29.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.613+0000 7f165affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:29.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.613+0000 7f165affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:10:29.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.613+0000 7f165affd640 10 monclient: dump: 2026-02-17T11:10:29.628 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:29.628 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:29.628 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:29.628 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:29.628 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:29.628 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:29.628 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:29.628 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:29.628 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:29.628 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:29.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.613+0000 7f165affd640 10 monclient: _finish_auth 0 2026-02-17T11:10:29.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.613+0000 7f165affd640 10 monclient: _check_auth_tickets 2026-02-17T11:10:29.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.613+0000 7f165affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:29.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.613+0000 7f1678df5640 5 monclient: authenticate success, global_id 4381 2026-02-17T11:10:29.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.613+0000 7f1678df5640 10 monclient: _renew_subs 2026-02-17T11:10:29.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.613+0000 7f1678df5640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:29.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.613+0000 7f1678df5640 1 -- 10.20.193.49:0/3838207278 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16741559b0 con 0x7f1674074ef0 2026-02-17T11:10:29.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.613+0000 7f1678df5640 10 client.4381.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:29.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.613+0000 7f1678df5640 10 monclient: _renew_subs 2026-02-17T11:10:29.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.613+0000 7f1678df5640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:29.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.613+0000 7f1678df5640 1 -- 10.20.193.49:0/3838207278 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1674155c70 con 0x7f1674074ef0 2026-02-17T11:10:29.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.613+0000 7f1678df5640 1 librados: init done 2026-02-17T11:10:29.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.614+0000 7f1678df5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:29.630 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.614+0000 7f1678df5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:29.630 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.614+0000 7f1678df5640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:29.630 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.614+0000 7f1678df5640 1 -- 10.20.193.49:0/3838207278 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f167415a9a0 con 0x7f1674074ef0 2026-02-17T11:10:29.630 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.614+0000 7f165affd640 1 -- 10.20.193.49:0/3838207278 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16680036f0 con 0x7f1674074ef0 2026-02-17T11:10:29.630 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.614+0000 7f165affd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:29.630 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.614+0000 7f165affd640 1 -- 10.20.193.49:0/3838207278 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1668003ae0 con 0x7f1674074ef0 2026-02-17T11:10:29.630 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.614+0000 7f165affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:29.630 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.614+0000 7f165affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:29.630 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.614+0000 7f1670d72640 4 set_mon_vals no callback set 2026-02-17T11:10:29.630 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.614+0000 7f165affd640 10 monclient: dump: 2026-02-17T11:10:29.630 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:29.630 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:29.630 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:29.631 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:29.631 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:29.631 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:29.631 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:29.631 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:29.631 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:29.631 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:29.723 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.722+0000 7f165affd640 1 -- 10.20.193.49:0/3838207278 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f1668025430 con 0x7f1674074ef0 2026-02-17T11:10:29.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.722+0000 7f165affd640 1 --2- 10.20.193.49:0/3838207278 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f1640079140 0x7f164007b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:29.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.723+0000 7f1671d74640 1 --2- 10.20.193.49:0/3838207278 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f1640079140 0x7f164007b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:29.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.723+0000 7f1671d74640 10 monclient: get_auth_request con 0x7f1640079140 auth_method 0 2026-02-17T11:10:29.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.723+0000 7f165affd640 10 client.4381.objecter ms_handle_connect 0x7f1640079140 2026-02-17T11:10:29.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.723+0000 7f1671d74640 1 --2- 10.20.193.49:0/3838207278 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f1640079140 0x7f164007b600 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f165c039000 tx=0x7f165c033000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:29.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.723+0000 7f165affd640 1 -- 10.20.193.49:0/3838207278 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 8563+0+0 (secure 0 0 0) 0x7f166805e310 con 0x7f1674074ef0 2026-02-17T11:10:29.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.723+0000 7f165affd640 10 client.4381.objecter ms_dispatch2 0x7f1674000b90 osd_map(29..29 src has 1..29) 2026-02-17T11:10:29.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.723+0000 7f165affd640 3 client.4381.objecter handle_osd_map got epochs [29,29] > 0 2026-02-17T11:10:29.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.723+0000 7f165affd640 3 client.4381.objecter handle_osd_map decoding full epoch 29 2026-02-17T11:10:29.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.724+0000 7f165affd640 20 client.4381.objecter dump_active .. 0 homeless 2026-02-17T11:10:29.732 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.730+0000 7f165affd640 1 -- 10.20.193.49:0/3838207278 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f16680622d0 con 0x7f1674074ef0 2026-02-17T11:10:29.732 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.730+0000 7f165affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:29.732 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.730+0000 7f165affd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:29.814 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.812+0000 7f1678df5640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-17T11:10:29.814 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.812+0000 7f1678df5640 10 monclient: _send_command 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-17T11:10:29.814 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.812+0000 7f1678df5640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:29.815 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:29.812+0000 7f1678df5640 1 -- 10.20.193.49:0/3838207278 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f1674153140 con 0x7f1674074ef0 2026-02-17T11:10:30.545 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.543+0000 7f165affd640 1 -- 10.20.193.49:0/3838207278 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v30) ==== 109+0+0 (secure 0 0 0) 0x7f16680665d0 con 0x7f1674074ef0 2026-02-17T11:10:30.545 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.543+0000 7f165affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-17T11:10:30.545 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.543+0000 7f165affd640 10 monclient: _finish_command 2 = system:0 pool 'rbd' created 2026-02-17T11:10:30.545 INFO:teuthology.orchestra.run.trial049.stderr:pool 'rbd' created 2026-02-17T11:10:30.547 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.545+0000 7f1678df5640 10 librados: watch_flush enter 2026-02-17T11:10:30.547 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.545+0000 7f1678df5640 10 librados: watch_flush exit 2026-02-17T11:10:30.547 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.545+0000 7f1678df5640 20 client.4381.objecter shutdown clearing up homeless session... 2026-02-17T11:10:30.548 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.545+0000 7f1678df5640 10 client.4381.objecter successfully canceled tick 2026-02-17T11:10:30.548 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.545+0000 7f1678df5640 1 -- 10.20.193.49:0/3838207278 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f1640079140 msgr2=0x7f164007b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:30.548 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.545+0000 7f1678df5640 1 --2- 10.20.193.49:0/3838207278 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f1640079140 0x7f164007b600 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f165c039000 tx=0x7f165c033000 comp rx=0 tx=0).stop 2026-02-17T11:10:30.548 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.545+0000 7f1678df5640 10 monclient: shutdown 2026-02-17T11:10:30.548 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.545+0000 7f1678df5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:30.548 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.545+0000 7f1678df5640 1 -- 10.20.193.49:0/3838207278 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f1674074ef0 msgr2=0x7f1674156a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:30.548 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.545+0000 7f1678df5640 1 --2- 10.20.193.49:0/3838207278 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f1674074ef0 0x7f1674156a30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f166800c550 tx=0x7f166800ca20 comp rx=0 tx=0).stop 2026-02-17T11:10:30.548 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.545+0000 7f1678df5640 1 -- 10.20.193.49:0/3838207278 shutdown_connections 2026-02-17T11:10:30.548 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.545+0000 7f1678df5640 1 --2- 10.20.193.49:0/3838207278 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f1640079140 0x7f164007b600 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:30.548 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.545+0000 7f1678df5640 1 --2- 10.20.193.49:0/3838207278 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f16740c7550 0x7f167414cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:30.548 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.545+0000 7f1678df5640 1 --2- 10.20.193.49:0/3838207278 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f16740c7170 0x7f16741585c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:30.549 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.545+0000 7f1678df5640 1 --2- 10.20.193.49:0/3838207278 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f1674074ef0 0x7f1674156a30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:30.549 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.545+0000 7f1678df5640 1 -- 10.20.193.49:0/3838207278 >> 10.20.193.49:0/3838207278 conn(0x7f16740c9f40 msgr2=0x7f16740cbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:30.549 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.545+0000 7f1678df5640 1 -- 10.20.193.49:0/3838207278 shutdown_connections 2026-02-17T11:10:30.549 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.545+0000 7f1678df5640 1 -- 10.20.193.49:0/3838207278 wait complete. 2026-02-17T11:10:30.549 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.545+0000 7f1678df5640 1 librados: shutdown 2026-02-17T11:10:30.555 DEBUG:teuthology.orchestra.run.trial049:> rbd --cluster ceph pool init rbd 2026-02-17T11:10:30.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.584+0000 7fa8268a90c0 10 monclient: get_monmap_and_config 2026-02-17T11:10:30.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.584+0000 7fa8268a90c0 10 monclient: build_initial_monmap 2026-02-17T11:10:30.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.584+0000 7fa8268a90c0 10 monclient: monmap: 2026-02-17T11:10:30.586 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:30.586 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:30.586 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:30.584724+0000 2026-02-17T11:10:30.587 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:30.584724+0000 2026-02-17T11:10:30.587 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:30.587 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:30.587 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:30.587 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:30.587 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:30.587 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:30.587 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:30.587 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:30.587 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:30.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.584+0000 7fa8268a90c0 1 Processor -- start 2026-02-17T11:10:30.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.584+0000 7fa8268a90c0 1 -- start start 2026-02-17T11:10:30.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.584+0000 7fa8268a90c0 10 monclient: init 2026-02-17T11:10:30.590 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.585+0000 7fa8268a90c0 10 monclient: _reopen_session rank -1 2026-02-17T11:10:30.590 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.585+0000 7fa8268a90c0 10 monclient: _add_conns ranks=[0,2,4,5,1,3] 2026-02-17T11:10:30.590 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.585+0000 7fa8268a90c0 10 monclient(hunting): picked mon.noname-a-legacy con 0x55e9c9992e60 addr v1:10.20.193.49:6789/0 2026-02-17T11:10:30.590 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.585+0000 7fa8268a90c0 10 monclient(hunting): picked mon.noname-c-legacy con 0x55e9c9993240 addr v1:10.20.193.157:6789/0 2026-02-17T11:10:30.590 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.585+0000 7fa8268a90c0 1 --2- >> v2:10.20.193.97:3300/0 conn(0x55e9c99a0220 0x55e9c990e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:30.590 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.585+0000 7fa8268a90c0 10 monclient(hunting): picked mon.noname-b con 0x55e9c99a0220 addr v2:10.20.193.97:3300/0 2026-02-17T11:10:30.590 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.585+0000 7fa8268a90c0 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55e9c972ed20 con 0x55e9c9992e60 2026-02-17T11:10:30.590 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.585+0000 7fa8268a90c0 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55e9c990cf30 con 0x55e9c9993240 2026-02-17T11:10:30.590 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.585+0000 7fa8268a90c0 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:30.590 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.585+0000 7fa8268a90c0 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x55e9c975b720 con 0x55e9c99a0220 2026-02-17T11:10:30.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.585+0000 7fa8268a90c0 10 monclient(hunting): _renew_subs 2026-02-17T11:10:30.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.585+0000 7fa8268a90c0 10 monclient(hunting): authenticate will time out at 1107.248523s 2026-02-17T11:10:30.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.586+0000 7fa824b70640 1 --1- >> v1:10.20.193.157:6789/0 conn(0x55e9c9993240 0x55e9c990a030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.157:6789/0 says I am v1:10.20.193.49:43246/0 (socket says 10.20.193.49:43246) 2026-02-17T11:10:30.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.586+0000 7fa824b70640 1 -- 10.20.193.49:0/3613249320 learned_addr learned my addr 10.20.193.49:0/3613249320 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:10:30.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.586+0000 7fa8265fa640 1 --2- 10.20.193.49:0/3613249320 >> v2:10.20.193.97:3300/0 conn(0x55e9c99a0220 0x55e9c990e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:30.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.586+0000 7fa8265fa640 10 monclient(hunting): get_auth_request con 0x55e9c99a0220 auth_method 0 2026-02-17T11:10:30.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.586+0000 7fa8265fa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:30.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.586+0000 7fa8265fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:30.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.586+0000 7fa8265fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:30.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.586+0000 7fa8265fa640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:30.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.586+0000 7fa8265fa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:30.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.586+0000 7fa8265fa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:30.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.587+0000 7fa8265fa640 10 monclient(hunting): handle_auth_done global_id 4384 payload 274 2026-02-17T11:10:30.592 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.587+0000 7fa8265fa640 1 -- 10.20.193.49:0/3613249320 >> v1:10.20.193.157:6789/0 conn(0x55e9c9993240 legacy=0x55e9c990a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:30.592 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.587+0000 7fa8265fa640 1 -- 10.20.193.49:0/3613249320 >> v1:10.20.193.49:6789/0 conn(0x55e9c9992e60 legacy=0x55e9c999fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:30.592 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.587+0000 7fa8265fa640 10 monclient: _finish_hunting 0 2026-02-17T11:10:30.592 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.587+0000 7fa8265fa640 1 monclient: found mon.noname-b 2026-02-17T11:10:30.592 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.587+0000 7fa8265fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:30.592 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.587+0000 7fa8265fa640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:10:30.592 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.587+0000 7fa8265fa640 1 -- 10.20.193.49:0/3613249320 --> v2:10.20.193.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9c990d210 con 0x55e9c99a0220 2026-02-17T11:10:30.597 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.589+0000 7fa8265fa640 1 --2- 10.20.193.49:0/3613249320 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x55e9c99a0220 0x55e9c990e2b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa818005fd0 tx=0x7fa8180585c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f79b28dff8c840de server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:30.597 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.591+0000 7fa817fff640 1 -- 10.20.193.49:0/3613249320 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa81806d070 con 0x55e9c99a0220 2026-02-17T11:10:30.598 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.591+0000 7fa817fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:30.598 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.591+0000 7fa817fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:10:30.598 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.591+0000 7fa817fff640 10 monclient: dump: 2026-02-17T11:10:30.598 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:30.598 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:30.598 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:30.598 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:30.598 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:30.598 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:30.598 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:30.598 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:30.599 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:30.599 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:30.599 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.591+0000 7fa817fff640 10 monclient: _finish_auth 0 2026-02-17T11:10:30.599 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.591+0000 7fa817fff640 10 monclient: _check_auth_tickets 2026-02-17T11:10:30.599 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.591+0000 7fa817fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:30.599 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.591+0000 7fa817fff640 1 -- 10.20.193.49:0/3613249320 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa818060cb0 con 0x55e9c99a0220 2026-02-17T11:10:30.599 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.591+0000 7fa817fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:30.599 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.591+0000 7fa817fff640 1 -- 10.20.193.49:0/3613249320 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa818060e60 con 0x55e9c99a0220 2026-02-17T11:10:30.599 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.591+0000 7fa817fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:30.599 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.591+0000 7fa817fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:30.599 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.591+0000 7fa817fff640 10 monclient: dump: 2026-02-17T11:10:30.599 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:30.600 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:30.600 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:30.600 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:30.600 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:30.600 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:30.600 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:30.600 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:30.600 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:30.600 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:30.601 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.591+0000 7fa8268a90c0 5 monclient: authenticate success, global_id 4384 2026-02-17T11:10:30.601 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.591+0000 7fa8268a90c0 10 monclient: get_monmap_and_config success 2026-02-17T11:10:30.601 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.591+0000 7fa8268a90c0 4 set_mon_vals no callback set 2026-02-17T11:10:30.601 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.591+0000 7fa8268a90c0 10 monclient: shutdown 2026-02-17T11:10:30.601 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.591+0000 7fa8268a90c0 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:30.601 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.591+0000 7fa8268a90c0 1 -- 10.20.193.49:0/3613249320 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x55e9c99a0220 msgr2=0x55e9c990e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:30.601 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.591+0000 7fa8268a90c0 1 --2- 10.20.193.49:0/3613249320 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x55e9c99a0220 0x55e9c990e2b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa818005fd0 tx=0x7fa8180585c0 comp rx=0 tx=0).stop 2026-02-17T11:10:30.601 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.591+0000 7fa8268a90c0 1 -- 10.20.193.49:0/3613249320 shutdown_connections 2026-02-17T11:10:30.601 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.591+0000 7fa8268a90c0 1 --2- 10.20.193.49:0/3613249320 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x55e9c99a0220 0x55e9c990e2b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:30.601 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.591+0000 7fa8268a90c0 1 -- 10.20.193.49:0/3613249320 >> 10.20.193.49:0/3613249320 conn(0x55e9c98c4e90 msgr2=0x55e9c98c52a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:30.602 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.591+0000 7fa8268a90c0 1 -- 10.20.193.49:0/3613249320 shutdown_connections 2026-02-17T11:10:30.602 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.592+0000 7fa8268a90c0 1 -- 10.20.193.49:0/3613249320 wait complete. 2026-02-17T11:10:30.602 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.592+0000 7fa8268a90c0 10 monclient: build_initial_monmap 2026-02-17T11:10:30.602 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.592+0000 7fa8268a90c0 10 monclient: monmap: 2026-02-17T11:10:30.602 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:30.602 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:30.602 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:30.602 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:30.602 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:30.602 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:30.602 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:30.602 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:30.603 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:30.603 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:30.603 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.592+0000 7fa8268a90c0 1 librados: starting msgr at 2026-02-17T11:10:30.603 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.592+0000 7fa8268a90c0 1 librados: starting objecter 2026-02-17T11:10:30.603 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.592+0000 7fa8268a90c0 1 Processor -- start 2026-02-17T11:10:30.603 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.592+0000 7fa8268a90c0 1 -- start start 2026-02-17T11:10:30.603 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.592+0000 7fa8268a90c0 1 librados: setting wanted keys 2026-02-17T11:10:30.603 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.592+0000 7fa8268a90c0 1 librados: calling monclient init 2026-02-17T11:10:30.603 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.592+0000 7fa8268a90c0 10 monclient: init 2026-02-17T11:10:30.603 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.593+0000 7fa8268a90c0 10 monclient: _reopen_session rank -1 2026-02-17T11:10:30.603 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.593+0000 7fa8268a90c0 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:10:30.603 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.593+0000 7fa8268a90c0 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x55e9c9992e60 0x55e9c9908db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:30.604 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.593+0000 7fa8268a90c0 10 monclient(hunting): picked mon.noname-a con 0x55e9c9992e60 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:30.604 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.593+0000 7fa8268a90c0 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x55e9c9993240 0x55e9c99af380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:30.604 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.593+0000 7fa8268a90c0 10 monclient(hunting): picked mon.noname-b con 0x55e9c9993240 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:30.604 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.593+0000 7fa8268a90c0 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x55e9c99a0220 0x55e9c99af8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:30.604 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.593+0000 7fa8268a90c0 10 monclient(hunting): picked mon.noname-c con 0x55e9c99a0220 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:30.604 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.593+0000 7fa8268a90c0 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:30.604 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.593+0000 7fa8268a90c0 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x55e9c97abdb0 con 0x55e9c9992e60 2026-02-17T11:10:30.604 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.593+0000 7fa8268a90c0 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:30.604 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.593+0000 7fa8268a90c0 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x55e9c97afe80 con 0x55e9c9993240 2026-02-17T11:10:30.604 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.593+0000 7fa8268a90c0 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:30.604 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.593+0000 7fa8268a90c0 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x55e9c974ae50 con 0x55e9c99a0220 2026-02-17T11:10:30.604 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.593+0000 7fa8268a90c0 10 monclient(hunting): _renew_subs 2026-02-17T11:10:30.604 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.593+0000 7fa8268a90c0 10 monclient(hunting): authenticate will time out at 1107.256341s 2026-02-17T11:10:30.605 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.593+0000 7fa824b70640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x55e9c9993240 0x55e9c99af380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:30.605 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.593+0000 7fa8265fa640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x55e9c99a0220 0x55e9c99af8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:30.605 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.593+0000 7fa824b70640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x55e9c9993240 0x55e9c99af380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:47896/0 (socket says 10.20.193.49:47896) 2026-02-17T11:10:30.605 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.593+0000 7fa824b70640 1 -- 10.20.193.49:0/1212774508 learned_addr learned my addr 10.20.193.49:0/1212774508 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:30.605 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.593+0000 7fa824b70640 10 monclient(hunting): get_auth_request con 0x55e9c9993240 auth_method 0 2026-02-17T11:10:30.605 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.593+0000 7fa824b70640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:30.605 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.593+0000 7fa824b70640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:30.605 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.593+0000 7fa824b70640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:30.605 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.593+0000 7fa8265fa640 10 monclient(hunting): get_auth_request con 0x55e9c99a0220 auth_method 0 2026-02-17T11:10:30.605 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.593+0000 7fa8265fa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:30.605 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.593+0000 7fa8265fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:30.606 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.593+0000 7fa8265fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:30.606 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.594+0000 7fa824b70640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:30.606 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.594+0000 7fa824b70640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:30.606 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.594+0000 7fa824b70640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:30.606 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.594+0000 7fa8265fa640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:30.606 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.594+0000 7fa8265fa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:30.606 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.594+0000 7fa8265fa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:30.606 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.595+0000 7fa824b70640 10 monclient(hunting): handle_auth_done global_id 4387 payload 824 2026-02-17T11:10:30.606 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.595+0000 7fa824b70640 1 -- 10.20.193.49:0/1212774508 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x55e9c99a0220 msgr2=0x55e9c99af8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:30.606 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.595+0000 7fa824b70640 1 --2- 10.20.193.49:0/1212774508 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x55e9c99a0220 0x55e9c99af8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:30.606 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.595+0000 7fa824b70640 1 -- 10.20.193.49:0/1212774508 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x55e9c9992e60 msgr2=0x55e9c9908db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:30.606 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.595+0000 7fa824b70640 1 --2- 10.20.193.49:0/1212774508 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x55e9c9992e60 0x55e9c9908db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:30.606 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.595+0000 7fa824b70640 10 monclient: _finish_hunting 0 2026-02-17T11:10:30.607 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.595+0000 7fa824b70640 1 monclient: found mon.noname-b 2026-02-17T11:10:30.607 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.595+0000 7fa824b70640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:30.607 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.595+0000 7fa824b70640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:10:30.607 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.595+0000 7fa824b70640 1 -- 10.20.193.49:0/1212774508 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9c99936c0 con 0x55e9c9993240 2026-02-17T11:10:30.607 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.597+0000 7fa824b70640 1 --2- 10.20.193.49:0/1212774508 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x55e9c9993240 0x55e9c99af380 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa81000bc50 tx=0x7fa810009640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:30.608 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.597+0000 7fa8157fa640 10 client.?.objecter ms_handle_connect 0x55e9c9993240 2026-02-17T11:10:30.608 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.597+0000 7fa8157fa640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:30.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.626+0000 7fa8157fa640 1 -- 10.20.193.49:0/1212774508 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa810012070 con 0x55e9c9993240 2026-02-17T11:10:30.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.626+0000 7fa8157fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:30.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.626+0000 7fa8157fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:10:30.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.626+0000 7fa8157fa640 10 monclient: dump: 2026-02-17T11:10:30.629 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:30.629 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:30.629 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:30.629 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:30.630 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:30.630 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:30.630 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:30.630 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:30.630 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:30.630 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:30.630 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.626+0000 7fa8157fa640 10 monclient: _finish_auth 0 2026-02-17T11:10:30.630 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.626+0000 7fa8157fa640 10 monclient: _check_auth_tickets 2026-02-17T11:10:30.630 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.626+0000 7fa8157fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:30.630 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.626+0000 7fa8157fa640 1 -- 10.20.193.49:0/1212774508 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa81000e690 con 0x55e9c9993240 2026-02-17T11:10:30.630 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.626+0000 7fa8157fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:30.630 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.626+0000 7fa8157fa640 1 -- 10.20.193.49:0/1212774508 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa81000ea80 con 0x55e9c9993240 2026-02-17T11:10:30.631 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.626+0000 7fa8157fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:30.631 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.626+0000 7fa8157fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:30.631 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.626+0000 7fa8157fa640 10 monclient: dump: 2026-02-17T11:10:30.631 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:30.631 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:30.631 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:30.631 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:30.631 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:30.631 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:30.631 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:30.631 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:30.631 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:30.632 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:30.632 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.626+0000 7fa8268a90c0 5 monclient: authenticate success, global_id 4387 2026-02-17T11:10:30.632 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.626+0000 7fa8268a90c0 10 monclient: _renew_subs 2026-02-17T11:10:30.632 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.626+0000 7fa8177fe640 4 set_mon_vals no callback set 2026-02-17T11:10:30.632 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.626+0000 7fa8268a90c0 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:30.632 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.626+0000 7fa8268a90c0 1 -- 10.20.193.49:0/1212774508 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e9c9991690 con 0x55e9c9993240 2026-02-17T11:10:30.632 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.627+0000 7fa8268a90c0 10 client.4387.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:30.632 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.627+0000 7fa8268a90c0 10 monclient: _renew_subs 2026-02-17T11:10:30.632 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.627+0000 7fa8268a90c0 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:30.632 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.627+0000 7fa8268a90c0 1 -- 10.20.193.49:0/1212774508 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9c9993c40 con 0x55e9c9993240 2026-02-17T11:10:30.632 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.627+0000 7fa8268a90c0 1 librados: init done 2026-02-17T11:10:30.632 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.627+0000 7fa8268a90c0 10 librados: wait_for_osdmap waiting 2026-02-17T11:10:30.640 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.639+0000 7fa8157fa640 1 -- 10.20.193.49:0/1212774508 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7fa81000c040 con 0x55e9c9993240 2026-02-17T11:10:30.641 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.639+0000 7fa8157fa640 1 --2- 10.20.193.49:0/1212774508 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fa8040771c0 0x7fa804079680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:30.641 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.639+0000 7fa825371640 1 --2- 10.20.193.49:0/1212774508 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fa8040771c0 0x7fa804079680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:30.641 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.639+0000 7fa825371640 10 monclient: get_auth_request con 0x7fa8040771c0 auth_method 0 2026-02-17T11:10:30.642 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.640+0000 7fa825371640 1 --2- 10.20.193.49:0/1212774508 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fa8040771c0 0x7fa804079680 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa81c00a450 tx=0x7fa81c005530 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:30.642 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.640+0000 7fa8157fa640 10 client.4387.objecter ms_handle_connect 0x7fa8040771c0 2026-02-17T11:10:30.643 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.641+0000 7fa8157fa640 1 -- 10.20.193.49:0/1212774508 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 8905+0+0 (secure 0 0 0) 0x7fa81005c970 con 0x55e9c9993240 2026-02-17T11:10:30.643 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.641+0000 7fa8157fa640 10 client.4387.objecter ms_dispatch2 0x55e9c97c65a0 osd_map(30..30 src has 1..30) 2026-02-17T11:10:30.643 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.641+0000 7fa8157fa640 3 client.4387.objecter handle_osd_map got epochs [30,30] > 0 2026-02-17T11:10:30.643 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.641+0000 7fa8157fa640 3 client.4387.objecter handle_osd_map decoding full epoch 30 2026-02-17T11:10:30.643 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.641+0000 7fa8157fa640 20 client.4387.objecter dump_active .. 0 homeless 2026-02-17T11:10:30.643 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.641+0000 7fa8268a90c0 10 librados: wait_for_osdmap done waiting 2026-02-17T11:10:30.644 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.641+0000 7fa8268a90c0 10 start_mon_command cmd=[{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-17T11:10:30.644 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.641+0000 7fa8268a90c0 10 monclient: _send_command 1 [{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-17T11:10:30.644 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.641+0000 7fa8268a90c0 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:30.644 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:30.641+0000 7fa8268a90c0 1 -- 10.20.193.49:0/1212774508 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x55e9c9991970 con 0x55e9c9993240 2026-02-17T11:10:31.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:31.614+0000 7fa8157fa640 1 -- 10.20.193.49:0/1212774508 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v31) ==== 141+0+0 (secure 0 0 0) 0x7fa810060930 con 0x55e9c9993240 2026-02-17T11:10:31.616 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:31.614+0000 7fa8157fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-17T11:10:31.616 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:31.614+0000 7fa8157fa640 10 monclient: _finish_command 1 = system:0 enabled application 'rbd' on pool 'rbd' 2026-02-17T11:10:31.616 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:31.614+0000 7fa8268a90c0 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:31.616 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:31.614+0000 7fa8268a90c0 1 -- 10.20.193.49:0/1212774508 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa818060cb0 con 0x55e9c9993240 2026-02-17T11:10:31.617 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:31.616+0000 7fa8157fa640 1 -- 10.20.193.49:0/1212774508 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fa81001c0a0 con 0x55e9c9993240 2026-02-17T11:10:31.617 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:31.616+0000 7fa8157fa640 10 monclient: handle_get_version_reply finishing 1 version 31 2026-02-17T11:10:31.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:31.616+0000 7fa8177fe640 10 client.4387.objecter _get_latest_version latest 31, waiting 2026-02-17T11:10:31.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:31.616+0000 7fa8177fe640 10 client.4387.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:31.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:31.616+0000 7fa8177fe640 10 monclient: _renew_subs 2026-02-17T11:10:31.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:31.616+0000 7fa8177fe640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:31.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:31.616+0000 7fa8177fe640 1 -- 10.20.193.49:0/1212774508 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=31}) -- 0x7fa7fc003c90 con 0x55e9c9993240 2026-02-17T11:10:31.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:31.617+0000 7fa8157fa640 1 -- 10.20.193.49:0/1212774508 <== mon.1 v2:10.20.193.97:3300/0 8 ==== osd_map(31..31 src has 1..31) ==== 674+0+0 (secure 0 0 0) 0x7fa8100670c0 con 0x55e9c9993240 2026-02-17T11:10:31.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:31.617+0000 7fa8157fa640 10 client.4387.objecter ms_dispatch2 0x55e9c97c65a0 osd_map(31..31 src has 1..31) 2026-02-17T11:10:31.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:31.617+0000 7fa8157fa640 3 client.4387.objecter handle_osd_map got epochs [31,31] > 30 2026-02-17T11:10:31.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:31.617+0000 7fa8157fa640 3 client.4387.objecter handle_osd_map decoding incremental epoch 31 2026-02-17T11:10:31.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:31.617+0000 7fa8157fa640 20 client.4387.objecter dump_active .. 0 homeless 2026-02-17T11:10:31.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:31.617+0000 7fa8268a90c0 10 librados: create oid=rbd_trash nspace= 2026-02-17T11:10:31.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:31.617+0000 7fa8268a90c0 10 client.4387.objecter _op_submit op 0x55e9c99945f0 2026-02-17T11:10:31.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:31.617+0000 7fa8268a90c0 20 client.4387.objecter _calc_target epoch 31 base rbd_trash @2 precalc_pgid 0 pgid 0.0 is_write 2026-02-17T11:10:31.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:31.617+0000 7fa8268a90c0 20 client.4387.objecter _calc_target target rbd_trash @2 -> pgid 2.5a749323 2026-02-17T11:10:31.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:31.617+0000 7fa8268a90c0 10 client.4387.objecter _calc_target raw pgid 2.5a749323 -> actual 2.3 acting [14,15] primary 14 2026-02-17T11:10:31.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:31.617+0000 7fa8268a90c0 1 --2- 10.20.193.49:0/1212774508 >> [v2:10.20.193.157:6824/404726964,v1:10.20.193.157:6825/404726964] conn(0x55e9c998a640 0x55e9c998aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:31.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:31.617+0000 7fa8268a90c0 20 client.4387.objecter _get_session s=0x55e9c974b230 osd=14 3 2026-02-17T11:10:31.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:31.617+0000 7fa8268a90c0 10 client.4387.objecter _op_submit oid rbd_trash '@2' '@2' [create] tid 1 osd.14 2026-02-17T11:10:31.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:31.617+0000 7fa8268a90c0 20 client.4387.objecter get_session s=0x55e9c974b230 osd=14 3 2026-02-17T11:10:31.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:31.617+0000 7fa8268a90c0 15 client.4387.objecter _session_op_assign 14 1 2026-02-17T11:10:31.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:31.617+0000 7fa8268a90c0 15 client.4387.objecter _send_op 1 to 2.3 on osd.14 2026-02-17T11:10:31.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:31.617+0000 7fa8268a90c0 1 -- 10.20.193.49:0/1212774508 --> [v2:10.20.193.157:6824/404726964,v1:10.20.193.157:6825/404726964] -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e9c9990810 con 0x55e9c998a640 2026-02-17T11:10:31.622 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:31.617+0000 7fa8268a90c0 20 client.4387.objecter put_session s=0x55e9c974b230 osd=14 4 2026-02-17T11:10:31.622 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:31.617+0000 7fa8268a90c0 5 client.4387.objecter 1 in flight 2026-02-17T11:10:31.622 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:31.617+0000 7fa8265fa640 1 --2- 10.20.193.49:0/1212774508 >> [v2:10.20.193.157:6824/404726964,v1:10.20.193.157:6825/404726964] conn(0x55e9c998a640 0x55e9c998aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:31.622 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:31.618+0000 7fa8265fa640 10 monclient: get_auth_request con 0x55e9c998a640 auth_method 0 2026-02-17T11:10:31.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:31.622+0000 7fa8265fa640 1 --2- 10.20.193.49:0/1212774508 >> [v2:10.20.193.157:6824/404726964,v1:10.20.193.157:6825/404726964] conn(0x55e9c998a640 0x55e9c998aa20 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.14 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:31.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:31.622+0000 7fa8157fa640 10 client.4387.objecter ms_handle_connect 0x55e9c998a640 2026-02-17T11:10:31.661 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:02:17.143 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:10:31.663 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:02:17.145 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:10:31.692 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:02:17.167 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:10:31.692 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:02:17.174 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:10:31.693 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:02:17.169 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:10:31.695 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:02:17.137 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:10:31.696 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:02:17.138 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:10:31.723 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:02:17.199 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:10:31.725 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:02:17.167 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:10:32.066 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.064+0000 7fa8265fa640 1 -- 10.20.193.49:0/1212774508 <== osd.14 v2:10.20.193.157:6824/404726964 1 ==== osd_op_reply(1 rbd_trash [create] v31'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7fa818070040 con 0x55e9c998a640 2026-02-17T11:10:32.066 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.064+0000 7fa8265fa640 10 client.4387.objecter ms_dispatch2 0x55e9c97c65a0 osd_op_reply(1 rbd_trash [create] v31'1 uv1 ondisk = 0) 2026-02-17T11:10:32.066 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.064+0000 7fa8265fa640 10 client.4387.objecter in handle_osd_op_reply 2026-02-17T11:10:32.067 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.064+0000 7fa8265fa640 7 client.4387.objecter handle_osd_op_reply 1 ondisk uv 1 in 2.3 attempt 0 2026-02-17T11:10:32.067 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.064+0000 7fa8265fa640 10 client.4387.objecter op 0 rval 0 len 0 2026-02-17T11:10:32.067 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.064+0000 7fa8265fa640 15 client.4387.objecter handle_osd_op_reply completed tid 1 2026-02-17T11:10:32.067 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.064+0000 7fa8265fa640 15 client.4387.objecter _finish_op 1 2026-02-17T11:10:32.067 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.064+0000 7fa8265fa640 20 client.4387.objecter put_session s=0x55e9c974b230 osd=14 4 2026-02-17T11:10:32.067 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.064+0000 7fa8265fa640 15 client.4387.objecter _session_op_remove 14 1 2026-02-17T11:10:32.067 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.064+0000 7fa8265fa640 5 client.4387.objecter 0 in flight 2026-02-17T11:10:32.067 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.064+0000 7fa8268a90c0 10 librados: Objecter returned from create r=0 2026-02-17T11:10:32.068 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.065+0000 7fa8268a90c0 10 client.4387.objecter _op_submit op 0x55e9c9a08b40 2026-02-17T11:10:32.069 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.065+0000 7fa8268a90c0 20 client.4387.objecter _calc_target epoch 31 base rbd_info @2 precalc_pgid 0 pgid 0.0 is_read 2026-02-17T11:10:32.069 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.065+0000 7fa8268a90c0 20 client.4387.objecter _calc_target target rbd_info @2 -> pgid 2.ac0e573a 2026-02-17T11:10:32.069 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.065+0000 7fa8268a90c0 10 client.4387.objecter _calc_target raw pgid 2.ac0e573a -> actual 2.2 acting [3,12] primary 3 2026-02-17T11:10:32.069 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.065+0000 7fa8268a90c0 1 --2- 10.20.193.49:0/1212774508 >> [v2:10.20.193.162:6818/1543573918,v1:10.20.193.162:6820/1543573918] conn(0x55e9c9a096f0 0x55e9c9a0bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:32.069 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.065+0000 7fa8268a90c0 20 client.4387.objecter _get_session s=0x55e9c9a09070 osd=3 3 2026-02-17T11:10:32.069 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.065+0000 7fa8268a90c0 10 client.4387.objecter _op_submit oid rbd_info '@2' '@2' [call rbd.metadata_list in=33b] tid 2 osd.3 2026-02-17T11:10:32.069 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.065+0000 7fa8268a90c0 20 client.4387.objecter get_session s=0x55e9c9a09070 osd=3 3 2026-02-17T11:10:32.069 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.065+0000 7fa8268a90c0 15 client.4387.objecter _session_op_assign 3 2 2026-02-17T11:10:32.069 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.065+0000 7fa8268a90c0 15 client.4387.objecter _send_op 2 to 2.2 on osd.3 2026-02-17T11:10:32.069 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.065+0000 7fa8268a90c0 1 -- 10.20.193.49:0/1212774508 --> [v2:10.20.193.162:6818/1543573918,v1:10.20.193.162:6820/1543573918] -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e9c9a0c100 con 0x55e9c9a096f0 2026-02-17T11:10:32.070 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.065+0000 7fa8268a90c0 20 client.4387.objecter put_session s=0x55e9c9a09070 osd=3 4 2026-02-17T11:10:32.070 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.065+0000 7fa8268a90c0 5 client.4387.objecter 1 in flight 2026-02-17T11:10:32.070 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.066+0000 7fa825371640 1 --2- 10.20.193.49:0/1212774508 >> [v2:10.20.193.162:6818/1543573918,v1:10.20.193.162:6820/1543573918] conn(0x55e9c9a096f0 0x55e9c9a0bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:32.070 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.066+0000 7fa825371640 10 monclient: get_auth_request con 0x55e9c9a096f0 auth_method 0 2026-02-17T11:10:32.070 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.069+0000 7fa825371640 1 --2- 10.20.193.49:0/1212774508 >> [v2:10.20.193.162:6818/1543573918,v1:10.20.193.162:6820/1543573918] conn(0x55e9c9a096f0 0x55e9c9a0bb80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:32.070 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.069+0000 7fa8157fa640 10 client.4387.objecter ms_handle_connect 0x55e9c9a096f0 2026-02-17T11:10:32.127 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.125+0000 7fa825371640 1 -- 10.20.193.49:0/1212774508 <== osd.3 v2:10.20.193.162:6818/1543573918 1 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fa81c008950 con 0x55e9c9a096f0 2026-02-17T11:10:32.128 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.125+0000 7fa825371640 10 client.4387.objecter ms_dispatch2 0x55e9c97c65a0 osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-17T11:10:32.128 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.125+0000 7fa825371640 10 client.4387.objecter in handle_osd_op_reply 2026-02-17T11:10:32.128 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.125+0000 7fa825371640 7 client.4387.objecter handle_osd_op_reply 2 ondisk uv 0 in 2.2 attempt 0 2026-02-17T11:10:32.128 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.125+0000 7fa825371640 10 client.4387.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-17T11:10:32.128 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.125+0000 7fa825371640 10 client.4387.objecter op 0 rval 0 len 0 2026-02-17T11:10:32.128 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.125+0000 7fa825371640 15 client.4387.objecter handle_osd_op_reply completed tid 2 2026-02-17T11:10:32.128 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.125+0000 7fa825371640 15 client.4387.objecter _finish_op 2 2026-02-17T11:10:32.128 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.125+0000 7fa825371640 20 client.4387.objecter put_session s=0x55e9c9a09070 osd=3 4 2026-02-17T11:10:32.128 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.125+0000 7fa825371640 15 client.4387.objecter _session_op_remove 3 2 2026-02-17T11:10:32.128 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.125+0000 7fa825371640 5 client.4387.objecter 0 in flight 2026-02-17T11:10:32.128 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.125+0000 7fa8268a90c0 10 client.4387.objecter _op_submit op 0x55e9c9a07d20 2026-02-17T11:10:32.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.125+0000 7fa8268a90c0 20 client.4387.objecter _calc_target epoch 31 base rbd_info @2 precalc_pgid 0 pgid 0.0 is_read 2026-02-17T11:10:32.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.125+0000 7fa8268a90c0 20 client.4387.objecter _calc_target target rbd_info @2 -> pgid 2.ac0e573a 2026-02-17T11:10:32.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.125+0000 7fa8268a90c0 10 client.4387.objecter _calc_target raw pgid 2.ac0e573a -> actual 2.2 acting [3,12] primary 3 2026-02-17T11:10:32.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.125+0000 7fa8268a90c0 20 client.4387.objecter _get_session s=0x55e9c9a09070 osd=3 3 2026-02-17T11:10:32.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.125+0000 7fa8268a90c0 10 client.4387.objecter _op_submit oid rbd_info '@2' '@2' [read 0~0] tid 3 osd.3 2026-02-17T11:10:32.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.125+0000 7fa8268a90c0 20 client.4387.objecter get_session s=0x55e9c9a09070 osd=3 3 2026-02-17T11:10:32.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.125+0000 7fa8268a90c0 15 client.4387.objecter _session_op_assign 3 3 2026-02-17T11:10:32.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.125+0000 7fa8268a90c0 15 client.4387.objecter _send_op 3 to 2.2 on osd.3 2026-02-17T11:10:32.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.125+0000 7fa8268a90c0 1 -- 10.20.193.49:0/1212774508 --> [v2:10.20.193.162:6818/1543573918,v1:10.20.193.162:6820/1543573918] -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e9c9a081d0 con 0x55e9c9a096f0 2026-02-17T11:10:32.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.125+0000 7fa8268a90c0 20 client.4387.objecter put_session s=0x55e9c9a09070 osd=3 4 2026-02-17T11:10:32.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.125+0000 7fa8268a90c0 5 client.4387.objecter 1 in flight 2026-02-17T11:10:32.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.129+0000 7fa825371640 1 -- 10.20.193.49:0/1212774508 <== osd.3 v2:10.20.193.162:6818/1543573918 2 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fa81c008950 con 0x55e9c9a096f0 2026-02-17T11:10:32.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.129+0000 7fa825371640 10 client.4387.objecter ms_dispatch2 0x55e9c97c65a0 osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-17T11:10:32.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.129+0000 7fa825371640 10 client.4387.objecter in handle_osd_op_reply 2026-02-17T11:10:32.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.129+0000 7fa825371640 7 client.4387.objecter handle_osd_op_reply 3 ondisk uv 0 in 2.2 attempt 0 2026-02-17T11:10:32.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.129+0000 7fa825371640 10 client.4387.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-17T11:10:32.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.129+0000 7fa825371640 10 client.4387.objecter op 0 rval 0 len 0 2026-02-17T11:10:32.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.129+0000 7fa825371640 15 client.4387.objecter handle_osd_op_reply completed tid 3 2026-02-17T11:10:32.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.129+0000 7fa825371640 15 client.4387.objecter _finish_op 3 2026-02-17T11:10:32.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.129+0000 7fa825371640 20 client.4387.objecter put_session s=0x55e9c9a09070 osd=3 4 2026-02-17T11:10:32.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.129+0000 7fa825371640 15 client.4387.objecter _session_op_remove 3 3 2026-02-17T11:10:32.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.129+0000 7fa825371640 5 client.4387.objecter 0 in flight 2026-02-17T11:10:32.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.129+0000 7fa816ffd640 10 client.4387.objecter allocate_selfmanaged_snap; pool: 2 2026-02-17T11:10:32.133 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.129+0000 7fa816ffd640 10 client.4387.objecter pool_op_submit 4 2026-02-17T11:10:32.133 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.129+0000 7fa816ffd640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:32.133 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.129+0000 7fa816ffd640 1 -- 10.20.193.49:0/1212774508 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7fa8000030d0 con 0x55e9c9993240 2026-02-17T11:10:32.749 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.747+0000 7fa8157fa640 1 -- 10.20.193.49:0/1212774508 <== mon.1 v2:10.20.193.97:3300/0 9 ==== pool_op_reply(tid 4 (0) Success v32) ==== 55+0+0 (secure 0 0 0) 0x7fa810064c30 con 0x55e9c9993240 2026-02-17T11:10:32.749 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.747+0000 7fa8157fa640 10 client.4387.objecter ms_dispatch2 0x55e9c97c65a0 pool_op_reply(tid 4 (0) Success v32) 2026-02-17T11:10:32.750 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.747+0000 7fa8157fa640 10 client.4387.objecter handle_pool_op_reply pool_op_reply(tid 4 (0) Success v32) 2026-02-17T11:10:32.750 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.747+0000 7fa8157fa640 10 client.4387.objecter have request 4 at 0x7fa800003060 Op: create unmanaged snap 2026-02-17T11:10:32.750 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.747+0000 7fa8157fa640 20 client.4387.objecter waiting for client to reach epoch 32 before calling back 2026-02-17T11:10:32.750 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.747+0000 7fa8157fa640 10 client.4387.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:32.750 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.747+0000 7fa8157fa640 10 monclient: _renew_subs 2026-02-17T11:10:32.750 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.747+0000 7fa8157fa640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:32.750 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.747+0000 7fa8157fa640 1 -- 10.20.193.49:0/1212774508 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=32}) -- 0x7fa80407f890 con 0x55e9c9993240 2026-02-17T11:10:32.750 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.747+0000 7fa8157fa640 10 client.4387.objecter done 2026-02-17T11:10:32.751 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.749+0000 7fa8157fa640 1 -- 10.20.193.49:0/1212774508 <== mon.1 v2:10.20.193.97:3300/0 10 ==== osd_map(32..32 src has 1..32) ==== 626+0+0 (secure 0 0 0) 0x7fa810069650 con 0x55e9c9993240 2026-02-17T11:10:32.752 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.749+0000 7fa8157fa640 10 client.4387.objecter ms_dispatch2 0x55e9c97c65a0 osd_map(32..32 src has 1..32) 2026-02-17T11:10:32.752 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.749+0000 7fa8157fa640 3 client.4387.objecter handle_osd_map got epochs [32,32] > 31 2026-02-17T11:10:32.752 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.749+0000 7fa8157fa640 3 client.4387.objecter handle_osd_map decoding incremental epoch 32 2026-02-17T11:10:32.752 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.749+0000 7fa8157fa640 20 client.4387.objecter dump_active .. 0 homeless 2026-02-17T11:10:32.752 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.749+0000 7fa8177fe640 20 librados: queue_aio_write 0x55e9c9a040d0 completion 0x55e9c976f5f0 write_seq 1 2026-02-17T11:10:32.752 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.749+0000 7fa8177fe640 10 client.4387.objecter _op_submit op 0x7fa7fc006380 2026-02-17T11:10:32.752 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.749+0000 7fa8177fe640 20 client.4387.objecter _calc_target epoch 32 base rbd_info @2 precalc_pgid 0 pgid 0.0 is_write 2026-02-17T11:10:32.752 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.749+0000 7fa8177fe640 20 client.4387.objecter _calc_target target rbd_info @2 -> pgid 2.ac0e573a 2026-02-17T11:10:32.752 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.749+0000 7fa8177fe640 10 client.4387.objecter _calc_target raw pgid 2.ac0e573a -> actual 2.2 acting [3,12] primary 3 2026-02-17T11:10:32.752 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.749+0000 7fa8177fe640 20 client.4387.objecter _get_session s=0x55e9c9a09070 osd=3 3 2026-02-17T11:10:32.752 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.749+0000 7fa8177fe640 10 client.4387.objecter _op_submit oid rbd_info '@2' '@2' [create,write 0~8 in=8b] tid 5 osd.3 2026-02-17T11:10:32.752 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.749+0000 7fa8177fe640 20 client.4387.objecter get_session s=0x55e9c9a09070 osd=3 3 2026-02-17T11:10:32.753 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.749+0000 7fa8177fe640 15 client.4387.objecter _session_op_assign 3 5 2026-02-17T11:10:32.753 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.749+0000 7fa8177fe640 15 client.4387.objecter _send_op 5 to 2.2 on osd.3 2026-02-17T11:10:32.753 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.749+0000 7fa8177fe640 1 -- 10.20.193.49:0/1212774508 --> [v2:10.20.193.162:6818/1543573918,v1:10.20.193.162:6820/1543573918] -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x7fa7fc006a80 con 0x55e9c9a096f0 2026-02-17T11:10:32.753 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.749+0000 7fa8177fe640 20 client.4387.objecter put_session s=0x55e9c9a09070 osd=3 4 2026-02-17T11:10:32.753 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.749+0000 7fa8177fe640 5 client.4387.objecter 1 in flight 2026-02-17T11:10:32.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.992+0000 7fa825371640 1 -- 10.20.193.49:0/1212774508 <== osd.3 v2:10.20.193.162:6818/1543573918 3 ==== osd_op_reply(5 rbd_info [create,write 0~8] v32'1 uv1 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa81c008950 con 0x55e9c9a096f0 2026-02-17T11:10:32.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.992+0000 7fa825371640 10 client.4387.objecter ms_dispatch2 0x55e9c97c65a0 osd_op_reply(5 rbd_info [create,write 0~8] v32'1 uv1 ondisk = 0) 2026-02-17T11:10:32.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.992+0000 7fa825371640 10 client.4387.objecter in handle_osd_op_reply 2026-02-17T11:10:32.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.992+0000 7fa825371640 7 client.4387.objecter handle_osd_op_reply 5 ondisk uv 1 in 2.2 attempt 0 2026-02-17T11:10:32.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.992+0000 7fa825371640 10 client.4387.objecter op 0 rval 0 len 0 2026-02-17T11:10:32.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.992+0000 7fa825371640 10 client.4387.objecter op 1 rval 0 len 0 2026-02-17T11:10:32.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.992+0000 7fa825371640 15 client.4387.objecter handle_osd_op_reply completed tid 5 2026-02-17T11:10:32.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.992+0000 7fa825371640 15 client.4387.objecter _finish_op 5 2026-02-17T11:10:32.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.992+0000 7fa825371640 20 client.4387.objecter put_session s=0x55e9c9a09070 osd=3 4 2026-02-17T11:10:32.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.992+0000 7fa825371640 15 client.4387.objecter _session_op_remove 3 5 2026-02-17T11:10:32.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.992+0000 7fa825371640 5 client.4387.objecter 0 in flight 2026-02-17T11:10:32.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.992+0000 7fa825371640 20 librados: complete_aio_write 0x55e9c976f5f0 2026-02-17T11:10:32.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.992+0000 7fa816ffd640 10 client.4387.objecter delete_selfmanaged_snap; pool: 2; snap: 2 2026-02-17T11:10:32.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.992+0000 7fa816ffd640 10 client.4387.objecter pool_op_submit 6 2026-02-17T11:10:32.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.992+0000 7fa816ffd640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:32.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:32.992+0000 7fa816ffd640 1 -- 10.20.193.49:0/1212774508 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- pool_op(delete unmanaged snap pool 2 tid 6 name v32) -- 0x7fa800004520 con 0x55e9c9993240 2026-02-17T11:10:33.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.593+0000 7fa80bfff640 10 monclient: tick 2026-02-17T11:10:33.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.593+0000 7fa80bfff640 10 monclient: _check_auth_tickets 2026-02-17T11:10:33.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.593+0000 7fa80bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:33.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.593+0000 7fa80bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:33.769 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.767+0000 7fa8157fa640 1 -- 10.20.193.49:0/1212774508 <== mon.1 v2:10.20.193.97:3300/0 11 ==== pool_op_reply(tid 6 (0) Success v33) ==== 43+0+0 (secure 0 0 0) 0x7fa810069ae0 con 0x55e9c9993240 2026-02-17T11:10:33.769 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.767+0000 7fa8157fa640 10 client.4387.objecter ms_dispatch2 0x55e9c97c65a0 pool_op_reply(tid 6 (0) Success v33) 2026-02-17T11:10:33.769 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.767+0000 7fa8157fa640 10 client.4387.objecter handle_pool_op_reply pool_op_reply(tid 6 (0) Success v33) 2026-02-17T11:10:33.770 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.767+0000 7fa8157fa640 10 client.4387.objecter have request 6 at 0x7fa800003060 Op: delete unmanaged snap 2026-02-17T11:10:33.770 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.767+0000 7fa8157fa640 20 client.4387.objecter waiting for client to reach epoch 33 before calling back 2026-02-17T11:10:33.770 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.767+0000 7fa8157fa640 10 client.4387.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:33.770 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.767+0000 7fa8157fa640 10 monclient: _renew_subs 2026-02-17T11:10:33.770 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.767+0000 7fa8157fa640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:33.770 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.767+0000 7fa8157fa640 1 -- 10.20.193.49:0/1212774508 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=33}) -- 0x7fa80407fb70 con 0x55e9c9993240 2026-02-17T11:10:33.770 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.767+0000 7fa8157fa640 10 client.4387.objecter done 2026-02-17T11:10:33.771 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.768+0000 7fa8157fa640 1 -- 10.20.193.49:0/1212774508 <== mon.1 v2:10.20.193.97:3300/0 12 ==== osd_map(33..33 src has 1..33) ==== 654+0+0 (secure 0 0 0) 0x7fa810069850 con 0x55e9c9993240 2026-02-17T11:10:33.771 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.768+0000 7fa8157fa640 10 client.4387.objecter ms_dispatch2 0x55e9c97c65a0 osd_map(33..33 src has 1..33) 2026-02-17T11:10:33.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.768+0000 7fa8157fa640 3 client.4387.objecter handle_osd_map got epochs [33,33] > 32 2026-02-17T11:10:33.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.768+0000 7fa8157fa640 3 client.4387.objecter handle_osd_map decoding incremental epoch 33 2026-02-17T11:10:33.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.768+0000 7fa8157fa640 20 client.4387.objecter dump_active .. 0 homeless 2026-02-17T11:10:33.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.768+0000 7fa8177fe640 20 librados: queue_aio_write 0x55e9c9a040d0 completion 0x7fa800001d60 write_seq 2 2026-02-17T11:10:33.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.768+0000 7fa8177fe640 10 client.4387.objecter _op_submit op 0x7fa7fc006380 2026-02-17T11:10:33.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.768+0000 7fa8177fe640 20 client.4387.objecter _calc_target epoch 33 base rbd_info @2 precalc_pgid 0 pgid 0.0 is_write 2026-02-17T11:10:33.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.768+0000 7fa8177fe640 20 client.4387.objecter _calc_target target rbd_info @2 -> pgid 2.ac0e573a 2026-02-17T11:10:33.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.768+0000 7fa8177fe640 10 client.4387.objecter _calc_target raw pgid 2.ac0e573a -> actual 2.2 acting [3,12] primary 3 2026-02-17T11:10:33.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.768+0000 7fa8177fe640 20 client.4387.objecter _get_session s=0x55e9c9a09070 osd=3 3 2026-02-17T11:10:33.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.768+0000 7fa8177fe640 10 client.4387.objecter _op_submit oid rbd_info '@2' '@2' [write 0~19 in=19b] tid 7 osd.3 2026-02-17T11:10:33.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.768+0000 7fa8177fe640 20 client.4387.objecter get_session s=0x55e9c9a09070 osd=3 3 2026-02-17T11:10:33.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.768+0000 7fa8177fe640 15 client.4387.objecter _session_op_assign 3 7 2026-02-17T11:10:33.773 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.768+0000 7fa8177fe640 15 client.4387.objecter _send_op 7 to 2.2 on osd.3 2026-02-17T11:10:33.773 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.768+0000 7fa8177fe640 1 -- 10.20.193.49:0/1212774508 --> [v2:10.20.193.162:6818/1543573918,v1:10.20.193.162:6820/1543573918] -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x7fa7fc006e20 con 0x55e9c9a096f0 2026-02-17T11:10:33.773 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.768+0000 7fa8177fe640 20 client.4387.objecter put_session s=0x55e9c9a09070 osd=3 4 2026-02-17T11:10:33.773 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.768+0000 7fa8177fe640 5 client.4387.objecter 1 in flight 2026-02-17T11:10:33.860 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.856+0000 7fa825371640 1 -- 10.20.193.49:0/1212774508 <== osd.3 v2:10.20.193.162:6818/1543573918 4 ==== osd_op_reply(7 rbd_info [write 0~19] v33'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa81c008950 con 0x55e9c9a096f0 2026-02-17T11:10:33.860 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.856+0000 7fa825371640 10 client.4387.objecter ms_dispatch2 0x55e9c97c65a0 osd_op_reply(7 rbd_info [write 0~19] v33'2 uv2 ondisk = 0) 2026-02-17T11:10:33.860 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.856+0000 7fa825371640 10 client.4387.objecter in handle_osd_op_reply 2026-02-17T11:10:33.860 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.856+0000 7fa825371640 7 client.4387.objecter handle_osd_op_reply 7 ondisk uv 2 in 2.2 attempt 0 2026-02-17T11:10:33.860 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.856+0000 7fa825371640 10 client.4387.objecter op 0 rval 0 len 0 2026-02-17T11:10:33.860 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.856+0000 7fa825371640 15 client.4387.objecter handle_osd_op_reply completed tid 7 2026-02-17T11:10:33.860 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.856+0000 7fa825371640 15 client.4387.objecter _finish_op 7 2026-02-17T11:10:33.860 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.856+0000 7fa825371640 20 client.4387.objecter put_session s=0x55e9c9a09070 osd=3 4 2026-02-17T11:10:33.861 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.856+0000 7fa825371640 15 client.4387.objecter _session_op_remove 3 7 2026-02-17T11:10:33.861 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.856+0000 7fa825371640 5 client.4387.objecter 0 in flight 2026-02-17T11:10:33.861 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.856+0000 7fa825371640 20 librados: complete_aio_write 0x7fa800001d60 2026-02-17T11:10:33.861 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.856+0000 7fa8268a90c0 10 librados: watch_flush enter 2026-02-17T11:10:33.861 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.857+0000 7fa8268a90c0 10 librados: watch_flush exit 2026-02-17T11:10:33.861 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.857+0000 7fa8268a90c0 10 client.4387.objecter close_session for osd.3 2026-02-17T11:10:33.861 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.857+0000 7fa8268a90c0 1 -- 10.20.193.49:0/1212774508 >> [v2:10.20.193.162:6818/1543573918,v1:10.20.193.162:6820/1543573918] conn(0x55e9c9a096f0 msgr2=0x55e9c9a0bb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:33.861 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.857+0000 7fa8268a90c0 1 --2- 10.20.193.49:0/1212774508 >> [v2:10.20.193.162:6818/1543573918,v1:10.20.193.162:6820/1543573918] conn(0x55e9c9a096f0 0x55e9c9a0bb80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:33.861 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.857+0000 7fa8268a90c0 20 client.4387.objecter put_session s=0x55e9c9a09070 osd=3 1 2026-02-17T11:10:33.861 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.857+0000 7fa8268a90c0 10 client.4387.objecter close_session for osd.14 2026-02-17T11:10:33.861 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.857+0000 7fa8268a90c0 1 -- 10.20.193.49:0/1212774508 >> [v2:10.20.193.157:6824/404726964,v1:10.20.193.157:6825/404726964] conn(0x55e9c998a640 msgr2=0x55e9c998aa20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:33.862 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.857+0000 7fa8268a90c0 1 --2- 10.20.193.49:0/1212774508 >> [v2:10.20.193.157:6824/404726964,v1:10.20.193.157:6825/404726964] conn(0x55e9c998a640 0x55e9c998aa20 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:33.862 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.857+0000 7fa8268a90c0 20 client.4387.objecter put_session s=0x55e9c974b230 osd=14 1 2026-02-17T11:10:33.862 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.857+0000 7fa8268a90c0 20 client.4387.objecter shutdown clearing up homeless session... 2026-02-17T11:10:33.862 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.857+0000 7fa8268a90c0 10 client.4387.objecter successfully canceled tick 2026-02-17T11:10:33.862 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.857+0000 7fa8268a90c0 1 -- 10.20.193.49:0/1212774508 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fa8040771c0 msgr2=0x7fa804079680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:33.862 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.857+0000 7fa8268a90c0 1 --2- 10.20.193.49:0/1212774508 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fa8040771c0 0x7fa804079680 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa81c00a450 tx=0x7fa81c005530 comp rx=0 tx=0).stop 2026-02-17T11:10:33.862 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.857+0000 7fa8268a90c0 10 monclient: shutdown 2026-02-17T11:10:33.862 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.857+0000 7fa8268a90c0 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:33.862 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.857+0000 7fa8268a90c0 1 -- 10.20.193.49:0/1212774508 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x55e9c9993240 msgr2=0x55e9c99af380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:33.862 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.857+0000 7fa8268a90c0 1 --2- 10.20.193.49:0/1212774508 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x55e9c9993240 0x55e9c99af380 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa81000bc50 tx=0x7fa810009640 comp rx=0 tx=0).stop 2026-02-17T11:10:33.862 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.857+0000 7fa8265fa640 1 -- 10.20.193.49:0/1212774508 reap_dead start 2026-02-17T11:10:33.862 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.857+0000 7fa8265fa640 1 -- 10.20.193.49:0/1212774508 reap_dead start 2026-02-17T11:10:33.863 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.857+0000 7fa8268a90c0 1 -- 10.20.193.49:0/1212774508 shutdown_connections 2026-02-17T11:10:33.863 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.857+0000 7fa8268a90c0 1 -- 10.20.193.49:0/1212774508 >> 10.20.193.49:0/1212774508 conn(0x55e9c98c4e90 msgr2=0x55e9c999fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:33.863 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.857+0000 7fa8268a90c0 1 -- 10.20.193.49:0/1212774508 shutdown_connections 2026-02-17T11:10:33.863 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.857+0000 7fa8268a90c0 1 -- 10.20.193.49:0/1212774508 wait complete. 2026-02-17T11:10:33.863 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.857+0000 7fa8268a90c0 1 librados: shutdown 2026-02-17T11:10:33.864 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-17T11:10:33.865 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-17T11:10:33.865 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-17T11:10:33.865 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-17T11:10:33.866 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-17T11:10:33.971 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.970+0000 7f79a6922640 10 monclient: get_monmap_and_config 2026-02-17T11:10:33.972 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.970+0000 7f79a6922640 10 monclient: build_initial_monmap 2026-02-17T11:10:33.972 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.970+0000 7f79a6922640 10 monclient: monmap: 2026-02-17T11:10:33.972 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:33.972 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:33.972 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:33.970934+0000 2026-02-17T11:10:33.972 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:33.970934+0000 2026-02-17T11:10:33.972 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:33.972 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:33.972 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:33.973 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:33.973 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:33.973 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:33.973 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:33.973 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:33.973 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:33.976 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.970+0000 7f79a6922640 1 Processor -- start 2026-02-17T11:10:33.976 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.970+0000 7f79a6922640 1 -- start start 2026-02-17T11:10:33.976 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.970+0000 7f79a6922640 10 monclient: init 2026-02-17T11:10:33.976 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.971+0000 7f79a6922640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:33.976 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.971+0000 7f79a6922640 10 monclient: _add_conns ranks=[0,5,1,4,2,3] 2026-02-17T11:10:33.976 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.971+0000 7f79a6922640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f79a0152580 addr v1:10.20.193.49:6789/0 2026-02-17T11:10:33.976 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.971+0000 7f79a6922640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f79a0152960 0x7f79a00c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:33.976 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.971+0000 7f79a6922640 10 monclient(hunting): picked mon.noname-c con 0x7f79a0152960 addr v2:10.20.193.157:3300/0 2026-02-17T11:10:33.976 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.971+0000 7f79a6922640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f79a006eb50 addr v1:10.20.193.97:6789/0 2026-02-17T11:10:33.976 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.971+0000 7f79a6922640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79a006efa0 con 0x7f79a0152580 2026-02-17T11:10:33.977 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.971+0000 7f79a6922640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79a015cc30 con 0x7f79a006eb50 2026-02-17T11:10:33.977 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.971+0000 7f79a6922640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:33.977 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.971+0000 7f79a6922640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f79a006ddd0 con 0x7f79a0152960 2026-02-17T11:10:33.977 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.971+0000 7f79a6922640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:33.977 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.971+0000 7f79a6922640 10 monclient(hunting): authenticate will time out at 1110.634507s 2026-02-17T11:10:33.977 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.971+0000 7f79a4e98640 1 --1- >> v1:10.20.193.97:6789/0 conn(0x7f79a006eb50 0x7f79a0070730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.97:6789/0 says I am v1:10.20.193.49:51554/0 (socket says 10.20.193.49:51554) 2026-02-17T11:10:33.977 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.971+0000 7f79a4e98640 1 -- 10.20.193.49:0/1558754735 learned_addr learned my addr 10.20.193.49:0/1558754735 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:10:33.977 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.972+0000 7f799f7fe640 1 --2- 10.20.193.49:0/1558754735 >> v2:10.20.193.157:3300/0 conn(0x7f79a0152960 0x7f79a00c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:33.977 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.972+0000 7f799f7fe640 10 monclient(hunting): get_auth_request con 0x7f79a0152960 auth_method 0 2026-02-17T11:10:33.977 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.972+0000 7f799f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:33.977 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.972+0000 7f799f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:33.978 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.972+0000 7f799f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:33.978 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.972+0000 7f799f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:33.978 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.972+0000 7f799f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:33.978 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.972+0000 7f799f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:33.978 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.973+0000 7f799effd640 1 -- 10.20.193.49:0/1558754735 <== mon.0 v1:10.20.193.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3759900442 0 0) 0x7f79a006efa0 con 0x7f79a0152580 2026-02-17T11:10:33.978 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.973+0000 7f799effd640 10 monclient(hunting): _negotiate 2026-02-17T11:10:33.978 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.973+0000 7f799effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:33.978 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.973+0000 7f799effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:33.978 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.973+0000 7f799effd640 10 monclient(hunting): my global_id is 4383 2026-02-17T11:10:33.978 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.973+0000 7f799effd640 1 -- 10.20.193.49:0/1558754735 --> v1:10.20.193.49:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7984003620 con 0x7f79a0152580 2026-02-17T11:10:33.978 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.973+0000 7f799effd640 1 -- 10.20.193.49:0/1558754735 <== mon.1 v1:10.20.193.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1897515883 0 0) 0x7f79a015cc30 con 0x7f79a006eb50 2026-02-17T11:10:33.978 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.973+0000 7f799effd640 10 monclient(hunting): _negotiate 2026-02-17T11:10:33.978 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.973+0000 7f799effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:33.979 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.973+0000 7f799effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:33.979 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.973+0000 7f799effd640 10 monclient(hunting): my global_id is 4390 2026-02-17T11:10:33.979 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.973+0000 7f799effd640 1 -- 10.20.193.49:0/1558754735 --> v1:10.20.193.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f79a006efa0 con 0x7f79a006eb50 2026-02-17T11:10:33.979 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.973+0000 7f799f7fe640 10 monclient(hunting): handle_auth_done global_id 4397 payload 274 2026-02-17T11:10:33.979 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.973+0000 7f799f7fe640 1 -- 10.20.193.49:0/1558754735 >> v1:10.20.193.97:6789/0 conn(0x7f79a006eb50 legacy=0x7f79a0070730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:33.979 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.973+0000 7f799f7fe640 1 -- 10.20.193.49:0/1558754735 >> v1:10.20.193.49:6789/0 conn(0x7f79a0152580 legacy=0x7f79a00cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:33.979 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.973+0000 7f799f7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:10:33.979 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.973+0000 7f799f7fe640 1 monclient: found mon.noname-c 2026-02-17T11:10:33.979 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.973+0000 7f799f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:33.979 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.973+0000 7f799f7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:10:33.979 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.973+0000 7f799f7fe640 1 -- 10.20.193.49:0/1558754735 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79a015c950 con 0x7f79a0152960 2026-02-17T11:10:33.986 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.975+0000 7f799f7fe640 1 --2- 10.20.193.49:0/1558754735 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f79a0152960 0x7f79a00c85d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f79900098a0 tx=0x7f799002edd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ce484ea6a131ca2 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:33.986 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.976+0000 7f799effd640 1 -- 10.20.193.49:0/1558754735 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f799003c070 con 0x7f79a0152960 2026-02-17T11:10:33.986 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.976+0000 7f799effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:33.986 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.976+0000 7f799effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:10:33.987 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.976+0000 7f799effd640 10 monclient: dump: 2026-02-17T11:10:33.987 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:33.987 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:33.987 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:33.987 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:33.987 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:33.987 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:33.987 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:33.987 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:33.987 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:33.987 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:33.987 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.976+0000 7f799effd640 10 monclient: _finish_auth 0 2026-02-17T11:10:33.988 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.976+0000 7f799effd640 10 monclient: _check_auth_tickets 2026-02-17T11:10:33.988 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.976+0000 7f799effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:33.988 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.976+0000 7f799effd640 1 -- 10.20.193.49:0/1558754735 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f799002fae0 con 0x7f79a0152960 2026-02-17T11:10:33.988 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.976+0000 7f799effd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:33.988 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.976+0000 7f799effd640 1 -- 10.20.193.49:0/1558754735 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7990037440 con 0x7f79a0152960 2026-02-17T11:10:33.988 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.976+0000 7f79a6922640 5 monclient: authenticate success, global_id 4397 2026-02-17T11:10:33.988 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.976+0000 7f799effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:33.988 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.976+0000 7f799effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:10:33.988 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.976+0000 7f799effd640 10 monclient: dump: 2026-02-17T11:10:33.988 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:33.988 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:33.988 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:33.989 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:33.989 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:33.989 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:33.989 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:33.989 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:33.989 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:33.989 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:33.989 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.976+0000 7f79a6922640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:33.989 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.976+0000 7f79a6922640 4 set_mon_vals no callback set 2026-02-17T11:10:33.989 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.977+0000 7f79a6922640 10 monclient: shutdown 2026-02-17T11:10:33.989 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.977+0000 7f79a6922640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:33.989 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.977+0000 7f79a6922640 1 -- 10.20.193.49:0/1558754735 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f79a0152960 msgr2=0x7f79a00c85d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:33.990 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.977+0000 7f79a6922640 1 --2- 10.20.193.49:0/1558754735 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f79a0152960 0x7f79a00c85d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f79900098a0 tx=0x7f799002edd0 comp rx=0 tx=0).stop 2026-02-17T11:10:33.990 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.977+0000 7f79a6922640 1 -- 10.20.193.49:0/1558754735 shutdown_connections 2026-02-17T11:10:33.990 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.977+0000 7f79a6922640 1 --2- 10.20.193.49:0/1558754735 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f79a0152960 0x7f79a00c85d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:33.990 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.977+0000 7f79a6922640 1 -- 10.20.193.49:0/1558754735 >> 10.20.193.49:0/1558754735 conn(0x7f79a00ce070 msgr2=0x7f79a00ce480 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:33.990 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.977+0000 7f79a6922640 1 -- 10.20.193.49:0/1558754735 shutdown_connections 2026-02-17T11:10:33.990 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.977+0000 7f79a6922640 1 -- 10.20.193.49:0/1558754735 wait complete. 2026-02-17T11:10:33.990 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.977+0000 7f79a6922640 10 monclient: build_initial_monmap 2026-02-17T11:10:33.990 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.977+0000 7f79a6922640 10 monclient: monmap: 2026-02-17T11:10:33.990 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:33.990 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:33.990 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:33.990 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:33.990 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:33.991 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:33.991 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:33.991 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:33.991 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:33.991 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:33.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.978+0000 7f79a6922640 1 librados: starting msgr at 2026-02-17T11:10:33.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.978+0000 7f79a6922640 1 librados: starting objecter 2026-02-17T11:10:33.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.978+0000 7f79a6922640 1 Processor -- start 2026-02-17T11:10:33.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.978+0000 7f79a6922640 1 -- start start 2026-02-17T11:10:33.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.978+0000 7f79a6922640 1 librados: setting wanted keys 2026-02-17T11:10:33.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.978+0000 7f79a6922640 1 librados: calling monclient init 2026-02-17T11:10:33.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.978+0000 7f79a6922640 10 monclient: init 2026-02-17T11:10:33.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.978+0000 7f79a6922640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:33.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.978+0000 7f79a6922640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:10:33.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.978+0000 7f79a6922640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f79a006eb50 0x7f79a015e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:33.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.978+0000 7f79a6922640 10 monclient(hunting): picked mon.noname-c con 0x7f79a006eb50 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:33.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.978+0000 7f79a6922640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f79a0152580 0x7f79a014b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:33.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.978+0000 7f79a6922640 10 monclient(hunting): picked mon.noname-b con 0x7f79a0152580 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:33.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.978+0000 7f79a6922640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f79a0152960 0x7f79a014b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:33.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.978+0000 7f79a6922640 10 monclient(hunting): picked mon.noname-a con 0x7f79a0152960 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:33.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.978+0000 7f79a6922640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:33.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.978+0000 7f79a6922640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f79a006e630 con 0x7f79a0152960 2026-02-17T11:10:33.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.978+0000 7f79a6922640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:33.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.978+0000 7f79a6922640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f79a006e350 con 0x7f79a0152580 2026-02-17T11:10:33.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.978+0000 7f79a6922640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:33.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.978+0000 7f79a6922640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f79a0160030 con 0x7f79a006eb50 2026-02-17T11:10:33.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.978+0000 7f79a6922640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:33.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.978+0000 7f79a6922640 10 monclient(hunting): authenticate will time out at 1110.641704s 2026-02-17T11:10:33.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.978+0000 7f79a4e98640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f79a0152960 0x7f79a014b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:33.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.979+0000 7f799ffff640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f79a006eb50 0x7f79a015e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:33.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.979+0000 7f799f7fe640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f79a0152580 0x7f79a014b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:33.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.979+0000 7f799ffff640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f79a006eb50 0x7f79a015e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:55708/0 (socket says 10.20.193.49:55708) 2026-02-17T11:10:33.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.979+0000 7f799ffff640 1 -- 10.20.193.49:0/2687571482 learned_addr learned my addr 10.20.193.49:0/2687571482 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:33.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.979+0000 7f799ffff640 10 monclient(hunting): get_auth_request con 0x7f79a006eb50 auth_method 0 2026-02-17T11:10:33.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.979+0000 7f799ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:33.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.979+0000 7f799ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:33.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.979+0000 7f799ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:33.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.979+0000 7f79a4e98640 10 monclient(hunting): get_auth_request con 0x7f79a0152960 auth_method 0 2026-02-17T11:10:33.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.979+0000 7f79a4e98640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:33.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.979+0000 7f79a4e98640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:33.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.979+0000 7f79a4e98640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:33.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.979+0000 7f799f7fe640 10 monclient(hunting): get_auth_request con 0x7f79a0152580 auth_method 0 2026-02-17T11:10:33.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.979+0000 7f799f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:33.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.979+0000 7f799f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:33.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.979+0000 7f799f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:33.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.979+0000 7f799ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:33.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.979+0000 7f799ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:33.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.979+0000 7f799ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:33.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.979+0000 7f79a4e98640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:33.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.979+0000 7f79a4e98640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:33.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.979+0000 7f79a4e98640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:33.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.979+0000 7f799f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:33.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.979+0000 7f799f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:33.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.979+0000 7f799f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:33.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.980+0000 7f79a4e98640 10 monclient(hunting): handle_auth_done global_id 4386 payload 824 2026-02-17T11:10:33.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.980+0000 7f79a4e98640 1 -- 10.20.193.49:0/2687571482 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f79a006eb50 msgr2=0x7f79a015e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:33.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.980+0000 7f79a4e98640 1 --2- 10.20.193.49:0/2687571482 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f79a006eb50 0x7f79a015e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:33.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.980+0000 7f79a4e98640 1 -- 10.20.193.49:0/2687571482 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f79a0152580 msgr2=0x7f79a014b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:33.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.980+0000 7f79a4e98640 1 --2- 10.20.193.49:0/2687571482 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f79a0152580 0x7f79a014b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:33.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.980+0000 7f79a4e98640 10 monclient: _finish_hunting 0 2026-02-17T11:10:33.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.980+0000 7f79a4e98640 1 monclient: found mon.noname-a 2026-02-17T11:10:33.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.980+0000 7f79a4e98640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:33.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.980+0000 7f79a4e98640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:10:33.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.980+0000 7f79a4e98640 1 -- 10.20.193.49:0/2687571482 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79a01f35f0 con 0x7f79a0152960 2026-02-17T11:10:33.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.980+0000 7f799ffff640 1 --2- 10.20.193.49:0/2687571482 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f79a006eb50 0x7f79a015e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:10:33.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.981+0000 7f79a4e98640 1 --2- 10.20.193.49:0/2687571482 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f79a0152960 0x7f79a014b990 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f799400cad0 tx=0x7f79940039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:33.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.981+0000 7f799cff9640 10 client.?.objecter ms_handle_connect 0x7f79a0152960 2026-02-17T11:10:33.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.981+0000 7f799cff9640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:33.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.983+0000 7f799cff9640 1 -- 10.20.193.49:0/2687571482 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f799400abe0 con 0x7f79a0152960 2026-02-17T11:10:33.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.983+0000 7f799cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:33.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.983+0000 7f799cff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:10:33.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.983+0000 7f799cff9640 10 monclient: dump: 2026-02-17T11:10:33.997 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:33.997 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:33.997 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:33.997 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:33.997 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:33.997 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:33.997 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:33.997 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:33.997 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:33.997 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:33.997 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.983+0000 7f799cff9640 10 monclient: _finish_auth 0 2026-02-17T11:10:33.997 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.983+0000 7f799cff9640 10 monclient: _check_auth_tickets 2026-02-17T11:10:33.997 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.983+0000 7f799cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:33.998 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.983+0000 7f79a6922640 5 monclient: authenticate success, global_id 4386 2026-02-17T11:10:33.998 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.983+0000 7f799cff9640 1 -- 10.20.193.49:0/2687571482 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f799400ad80 con 0x7f79a0152960 2026-02-17T11:10:33.998 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.983+0000 7f79a6922640 10 monclient: _renew_subs 2026-02-17T11:10:33.998 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.983+0000 7f79a6922640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:33.998 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.983+0000 7f79a6922640 1 -- 10.20.193.49:0/2687571482 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79a01f38d0 con 0x7f79a0152960 2026-02-17T11:10:33.998 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.983+0000 7f799cff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:33.998 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.983+0000 7f799cff9640 1 -- 10.20.193.49:0/2687571482 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7994012620 con 0x7f79a0152960 2026-02-17T11:10:33.998 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.983+0000 7f799cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:33.998 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.983+0000 7f799cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:10:33.998 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.983+0000 7f799e7fc640 4 set_mon_vals no callback set 2026-02-17T11:10:33.998 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.983+0000 7f799cff9640 10 monclient: dump: 2026-02-17T11:10:33.999 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:33.999 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:33.999 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:33.999 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:33.999 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:33.999 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:33.999 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:33.999 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:33.999 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:33.999 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:33.999 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.983+0000 7f79a6922640 10 client.4386.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:33.999 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.983+0000 7f79a6922640 10 monclient: _renew_subs 2026-02-17T11:10:34.000 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.983+0000 7f79a6922640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:34.000 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.983+0000 7f79a6922640 1 -- 10.20.193.49:0/2687571482 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79a01f3e90 con 0x7f79a0152960 2026-02-17T11:10:34.000 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.983+0000 7f79a6922640 1 librados: init done 2026-02-17T11:10:34.000 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.984+0000 7f79a6922640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:34.000 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.984+0000 7f79a6922640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:34.000 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.984+0000 7f79a6922640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:34.000 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.984+0000 7f79a6922640 1 -- 10.20.193.49:0/2687571482 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79a00c85d0 con 0x7f79a0152960 2026-02-17T11:10:34.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.995+0000 7f799cff9640 1 -- 10.20.193.49:0/2687571482 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f79940127c0 con 0x7f79a0152960 2026-02-17T11:10:34.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.995+0000 7f799cff9640 1 --2- 10.20.193.49:0/2687571482 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f7970079140 0x7f797007b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:34.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.996+0000 7f799ffff640 1 --2- 10.20.193.49:0/2687571482 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f7970079140 0x7f797007b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:34.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.996+0000 7f799ffff640 10 monclient: get_auth_request con 0x7f7970079140 auth_method 0 2026-02-17T11:10:34.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.996+0000 7f799ffff640 1 --2- 10.20.193.49:0/2687571482 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f7970079140 0x7f797007b600 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f798c005690 tx=0x7f798c005040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:34.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.996+0000 7f799cff9640 10 client.4386.objecter ms_handle_connect 0x7f7970079140 2026-02-17T11:10:34.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.997+0000 7f799cff9640 1 -- 10.20.193.49:0/2687571482 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7f799405e9b0 con 0x7f79a0152960 2026-02-17T11:10:34.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.997+0000 7f799cff9640 10 client.4386.objecter ms_dispatch2 0x7f79a0000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:34.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.997+0000 7f799cff9640 3 client.4386.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:34.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.997+0000 7f799cff9640 3 client.4386.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:34.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:33.997+0000 7f799cff9640 20 client.4386.objecter dump_active .. 0 homeless 2026-02-17T11:10:34.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.095+0000 7f799cff9640 1 -- 10.20.193.49:0/2687571482 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f7994062970 con 0x7f79a0152960 2026-02-17T11:10:34.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.095+0000 7f799cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:34.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.095+0000 7f799cff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:34.203 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.202+0000 7f79a6922640 10 start_mon_command cmd=[{"prefix": "mgr dump", "format": "json"}] 2026-02-17T11:10:34.204 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.202+0000 7f79a6922640 10 monclient: _send_command 2 [{"prefix": "mgr dump", "format": "json"}] 2026-02-17T11:10:34.204 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.202+0000 7f79a6922640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:34.204 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.202+0000 7f79a6922640 1 -- 10.20.193.49:0/2687571482 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f79a00cb480 con 0x7f79a0152960 2026-02-17T11:10:34.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.266+0000 7f799cff9640 1 -- 10.20.193.49:0/2687571482 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+192269 (secure 0 0 0) 0x7f7994066c70 con 0x7f79a0152960 2026-02-17T11:10:34.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.266+0000 7f799cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mgr dump", "format": "json"}] 2026-02-17T11:10:34.269 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.266+0000 7f799cff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:34.270 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:10:34.273 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.268+0000 7f79a6922640 10 librados: watch_flush enter 2026-02-17T11:10:34.273 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.268+0000 7f79a6922640 10 librados: watch_flush exit 2026-02-17T11:10:34.273 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.268+0000 7f79a6922640 20 client.4386.objecter shutdown clearing up homeless session... 2026-02-17T11:10:34.273 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.268+0000 7f79a6922640 10 client.4386.objecter successfully canceled tick 2026-02-17T11:10:34.273 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.268+0000 7f79a6922640 1 -- 10.20.193.49:0/2687571482 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f7970079140 msgr2=0x7f797007b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:34.273 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.268+0000 7f79a6922640 1 --2- 10.20.193.49:0/2687571482 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f7970079140 0x7f797007b600 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f798c005690 tx=0x7f798c005040 comp rx=0 tx=0).stop 2026-02-17T11:10:34.273 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.268+0000 7f79a6922640 10 monclient: shutdown 2026-02-17T11:10:34.273 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.268+0000 7f79a6922640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:34.274 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.268+0000 7f79a6922640 1 -- 10.20.193.49:0/2687571482 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f79a0152960 msgr2=0x7f79a014b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:34.274 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.268+0000 7f79a6922640 1 --2- 10.20.193.49:0/2687571482 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f79a0152960 0x7f79a014b990 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f799400cad0 tx=0x7f79940039b0 comp rx=0 tx=0).stop 2026-02-17T11:10:34.274 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.268+0000 7f79a6922640 1 -- 10.20.193.49:0/2687571482 shutdown_connections 2026-02-17T11:10:34.274 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.268+0000 7f79a6922640 1 --2- 10.20.193.49:0/2687571482 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f7970079140 0x7f797007b600 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:34.274 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.268+0000 7f79a6922640 1 --2- 10.20.193.49:0/2687571482 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f79a0152960 0x7f79a014b990 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:34.274 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.268+0000 7f79a6922640 1 --2- 10.20.193.49:0/2687571482 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f79a0152580 0x7f79a014b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:34.274 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.268+0000 7f79a6922640 1 --2- 10.20.193.49:0/2687571482 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f79a006eb50 0x7f79a015e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:34.274 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.268+0000 7f79a6922640 1 -- 10.20.193.49:0/2687571482 >> 10.20.193.49:0/2687571482 conn(0x7f79a00ce070 msgr2=0x7f79a0151080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:34.274 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.268+0000 7f79a6922640 1 -- 10.20.193.49:0/2687571482 shutdown_connections 2026-02-17T11:10:34.274 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.268+0000 7f79a6922640 1 -- 10.20.193.49:0/2687571482 wait complete. 2026-02-17T11:10:34.274 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.268+0000 7f79a6922640 1 librados: shutdown 2026-02-17T11:10:34.278 INFO:teuthology.orchestra.run.trial049.stdout:{"epoch":5,"flags":0,"active_gid":4106,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6800","nonce":2614632098},{"type":"v1","addr":"10.20.193.162:6801","nonce":2614632098}]},"active_addr":"10.20.193.162:6801/2614632098","active_change":"2026-02-17T11:08:40.286138+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4108,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":true,"error_string":"","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":true,"error_string":"","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.162:0","nonce":2044049344}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.162:0","nonce":147124597}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.162:0","nonce":2313560425}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.162:0","nonce":3738667084}]}]} 2026-02-17T11:10:34.286 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-17T11:10:34.286 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-17T11:10:34.286 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:10:34.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.384+0000 7f01be0e8640 10 monclient: get_monmap_and_config 2026-02-17T11:10:34.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.384+0000 7f01be0e8640 10 monclient: build_initial_monmap 2026-02-17T11:10:34.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.384+0000 7f01be0e8640 10 monclient: monmap: 2026-02-17T11:10:34.387 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:34.387 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:34.387 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:34.385152+0000 2026-02-17T11:10:34.387 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:34.385152+0000 2026-02-17T11:10:34.387 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:34.387 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:34.387 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:34.387 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:34.387 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:34.387 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:34.387 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:34.388 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:34.388 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:34.388 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.385+0000 7f01be0e8640 1 Processor -- start 2026-02-17T11:10:34.388 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.385+0000 7f01be0e8640 1 -- start start 2026-02-17T11:10:34.388 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.385+0000 7f01be0e8640 10 monclient: init 2026-02-17T11:10:34.391 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.385+0000 7f01be0e8640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:34.391 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.385+0000 7f01be0e8640 10 monclient: _add_conns ranks=[1,2,3,5,4,0] 2026-02-17T11:10:34.391 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.385+0000 7f01be0e8640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f01b80c7170 addr v1:10.20.193.97:6789/0 2026-02-17T11:10:34.391 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.385+0000 7f01be0e8640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f01b80c7550 addr v1:10.20.193.157:6789/0 2026-02-17T11:10:34.391 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.385+0000 7f01be0e8640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f01b80c89c0 0x7f01b80c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:34.391 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.385+0000 7f01be0e8640 10 monclient(hunting): picked mon.noname-a con 0x7f01b80c89c0 addr v2:10.20.193.49:3300/0 2026-02-17T11:10:34.391 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.385+0000 7f01be0e8640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01b80c4fd0 con 0x7f01b80c7170 2026-02-17T11:10:34.391 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.385+0000 7f01be0e8640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01b815a9a0 con 0x7f01b80c7550 2026-02-17T11:10:34.391 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.385+0000 7f01be0e8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:34.391 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.385+0000 7f01be0e8640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f01b80c8530 con 0x7f01b80c89c0 2026-02-17T11:10:34.392 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.385+0000 7f01be0e8640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:34.392 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.385+0000 7f01be0e8640 10 monclient(hunting): authenticate will time out at 1111.048608s 2026-02-17T11:10:34.392 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.385+0000 7f01b77fe640 1 --1- >> v1:10.20.193.97:6789/0 conn(0x7f01b80c7170 0x7f01b80c48c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.97:6789/0 says I am v1:10.20.193.49:51556/0 (socket says 10.20.193.49:51556) 2026-02-17T11:10:34.392 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.385+0000 7f01b77fe640 1 -- 10.20.193.49:0/2950774854 learned_addr learned my addr 10.20.193.49:0/2950774854 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:10:34.392 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.386+0000 7f01b7fff640 1 --2- 10.20.193.49:0/2950774854 >> v2:10.20.193.49:3300/0 conn(0x7f01b80c89c0 0x7f01b80c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:34.392 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.386+0000 7f01b7fff640 10 monclient(hunting): get_auth_request con 0x7f01b80c89c0 auth_method 0 2026-02-17T11:10:34.392 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.386+0000 7f01b7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:34.392 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.386+0000 7f01b7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:34.392 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.386+0000 7f01b7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:34.393 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.386+0000 7f01b7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:34.393 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.386+0000 7f01b7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:34.393 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.386+0000 7f01b7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:34.393 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.387+0000 7f01b67fc640 1 -- 10.20.193.49:0/2950774854 <== mon.2 v1:10.20.193.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 739972064 0 0) 0x7f01b815a9a0 con 0x7f01b80c7550 2026-02-17T11:10:34.393 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.387+0000 7f01b67fc640 10 monclient(hunting): _negotiate 2026-02-17T11:10:34.393 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.387+0000 7f01b67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:34.393 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.387+0000 7f01b67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:34.393 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.387+0000 7f01b67fc640 10 monclient(hunting): my global_id is 4403 2026-02-17T11:10:34.393 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.387+0000 7f01b67fc640 1 -- 10.20.193.49:0/2950774854 --> v1:10.20.193.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f019c003620 con 0x7f01b80c7550 2026-02-17T11:10:34.393 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.387+0000 7f01b67fc640 1 -- 10.20.193.49:0/2950774854 <== mon.1 v1:10.20.193.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3374599725 0 0) 0x7f01b80c4fd0 con 0x7f01b80c7170 2026-02-17T11:10:34.393 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.387+0000 7f01b67fc640 10 monclient(hunting): _negotiate 2026-02-17T11:10:34.393 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.387+0000 7f01b67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:34.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.387+0000 7f01b67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:34.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.387+0000 7f01b67fc640 10 monclient(hunting): my global_id is 4396 2026-02-17T11:10:34.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.387+0000 7f01b67fc640 1 -- 10.20.193.49:0/2950774854 --> v1:10.20.193.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f01b815a9a0 con 0x7f01b80c7170 2026-02-17T11:10:34.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.387+0000 7f01b7fff640 10 monclient(hunting): handle_auth_done global_id 4389 payload 274 2026-02-17T11:10:34.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.387+0000 7f01b7fff640 1 -- 10.20.193.49:0/2950774854 >> v1:10.20.193.157:6789/0 conn(0x7f01b80c7550 legacy=0x7f01b80749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:34.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.387+0000 7f01b7fff640 1 -- 10.20.193.49:0/2950774854 >> v1:10.20.193.97:6789/0 conn(0x7f01b80c7170 legacy=0x7f01b80c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:34.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.387+0000 7f01b7fff640 10 monclient: _finish_hunting 0 2026-02-17T11:10:34.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.387+0000 7f01b7fff640 1 monclient: found mon.noname-a 2026-02-17T11:10:34.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.387+0000 7f01b7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:34.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.387+0000 7f01b7fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:10:34.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.387+0000 7f01b7fff640 1 -- 10.20.193.49:0/2950774854 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01b80c5270 con 0x7f01b80c89c0 2026-02-17T11:10:34.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.388+0000 7f01b7fff640 1 --2- 10.20.193.49:0/2950774854 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f01b80c89c0 0x7f01b80c8e70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f01ac009d90 tx=0x7f01ac02f230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20666130c1548e0d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:34.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.390+0000 7f01b67fc640 1 -- 10.20.193.49:0/2950774854 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ac03c070 con 0x7f01b80c89c0 2026-02-17T11:10:34.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.390+0000 7f01b67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:34.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.390+0000 7f01b67fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:10:34.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.390+0000 7f01b67fc640 10 monclient: dump: 2026-02-17T11:10:34.401 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:34.401 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:34.402 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:34.402 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:34.402 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:34.402 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:34.402 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:34.402 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:34.402 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:34.402 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:34.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.390+0000 7f01b67fc640 10 monclient: _finish_auth 0 2026-02-17T11:10:34.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.390+0000 7f01b67fc640 10 monclient: _check_auth_tickets 2026-02-17T11:10:34.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.390+0000 7f01b67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:34.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.390+0000 7f01b67fc640 1 -- 10.20.193.49:0/2950774854 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01ac037440 con 0x7f01b80c89c0 2026-02-17T11:10:34.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.390+0000 7f01be0e8640 5 monclient: authenticate success, global_id 4389 2026-02-17T11:10:34.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.390+0000 7f01be0e8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:10:34.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.390+0000 7f01b67fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:34.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.390+0000 7f01b67fc640 1 -- 10.20.193.49:0/2950774854 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ac037810 con 0x7f01b80c89c0 2026-02-17T11:10:34.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.390+0000 7f01b67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:34.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.390+0000 7f01b67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:10:34.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.390+0000 7f01b67fc640 10 monclient: dump: 2026-02-17T11:10:34.403 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:34.403 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:34.403 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:34.403 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:34.403 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:34.403 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:34.404 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:34.404 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:34.404 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:34.404 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:34.404 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.390+0000 7f01be0e8640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:34.404 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.390+0000 7f01be0e8640 4 set_mon_vals no callback set 2026-02-17T11:10:34.404 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.390+0000 7f01be0e8640 10 monclient: shutdown 2026-02-17T11:10:34.404 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.390+0000 7f01be0e8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:34.404 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.390+0000 7f01be0e8640 1 -- 10.20.193.49:0/2950774854 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f01b80c89c0 msgr2=0x7f01b80c8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:34.404 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.390+0000 7f01be0e8640 1 --2- 10.20.193.49:0/2950774854 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f01b80c89c0 0x7f01b80c8e70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f01ac009d90 tx=0x7f01ac02f230 comp rx=0 tx=0).stop 2026-02-17T11:10:34.404 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.390+0000 7f01be0e8640 1 -- 10.20.193.49:0/2950774854 shutdown_connections 2026-02-17T11:10:34.404 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.390+0000 7f01be0e8640 1 --2- 10.20.193.49:0/2950774854 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f01b80c89c0 0x7f01b80c8e70 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:34.405 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.390+0000 7f01be0e8640 1 -- 10.20.193.49:0/2950774854 >> 10.20.193.49:0/2950774854 conn(0x7f01b80c9f40 msgr2=0x7f01b80ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:34.405 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.390+0000 7f01be0e8640 1 -- 10.20.193.49:0/2950774854 shutdown_connections 2026-02-17T11:10:34.405 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.390+0000 7f01be0e8640 1 -- 10.20.193.49:0/2950774854 wait complete. 2026-02-17T11:10:34.405 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.391+0000 7f01be0e8640 10 monclient: build_initial_monmap 2026-02-17T11:10:34.405 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.391+0000 7f01be0e8640 10 monclient: monmap: 2026-02-17T11:10:34.405 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:34.405 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:34.405 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:34.405 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:34.405 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:34.405 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:34.405 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:34.406 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:34.406 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:34.406 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:34.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.391+0000 7f01be0e8640 1 librados: starting msgr at 2026-02-17T11:10:34.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.391+0000 7f01be0e8640 1 librados: starting objecter 2026-02-17T11:10:34.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.391+0000 7f01be0e8640 1 Processor -- start 2026-02-17T11:10:34.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.391+0000 7f01be0e8640 1 -- start start 2026-02-17T11:10:34.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.391+0000 7f01be0e8640 1 librados: setting wanted keys 2026-02-17T11:10:34.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.391+0000 7f01be0e8640 1 librados: calling monclient init 2026-02-17T11:10:34.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.391+0000 7f01be0e8640 10 monclient: init 2026-02-17T11:10:34.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.392+0000 7f01be0e8640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:34.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.392+0000 7f01be0e8640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:10:34.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.392+0000 7f01be0e8640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f01b80c7170 0x7f01b80c0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:34.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.392+0000 7f01be0e8640 10 monclient(hunting): picked mon.noname-b con 0x7f01b80c7170 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:34.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.392+0000 7f01be0e8640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f01b80c7550 0x7f01b80c3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:34.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.392+0000 7f01be0e8640 10 monclient(hunting): picked mon.noname-a con 0x7f01b80c7550 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:34.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.392+0000 7f01be0e8640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f01b80c89c0 0x7f01b80cb940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:34.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.392+0000 7f01be0e8640 10 monclient(hunting): picked mon.noname-c con 0x7f01b80c89c0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:34.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.392+0000 7f01be0e8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:34.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.392+0000 7f01be0e8640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f01b80c5830 con 0x7f01b80c7550 2026-02-17T11:10:34.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.392+0000 7f01be0e8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:34.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.392+0000 7f01be0e8640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f01b80c93b0 con 0x7f01b80c7170 2026-02-17T11:10:34.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.392+0000 7f01be0e8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:34.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.392+0000 7f01be0e8640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f01b80c7ee0 con 0x7f01b80c89c0 2026-02-17T11:10:34.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.392+0000 7f01be0e8640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:34.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.392+0000 7f01be0e8640 10 monclient(hunting): authenticate will time out at 1111.055078s 2026-02-17T11:10:34.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.392+0000 7f01b6ffd640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f01b80c7550 0x7f01b80c3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:34.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.392+0000 7f01b77fe640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f01b80c7170 0x7f01b80c0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:34.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.392+0000 7f01b77fe640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f01b80c7170 0x7f01b80c0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:47922/0 (socket says 10.20.193.49:47922) 2026-02-17T11:10:34.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.392+0000 7f01b77fe640 1 -- 10.20.193.49:0/460438251 learned_addr learned my addr 10.20.193.49:0/460438251 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:34.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.392+0000 7f01b6ffd640 10 monclient(hunting): get_auth_request con 0x7f01b80c7550 auth_method 0 2026-02-17T11:10:34.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.392+0000 7f01b6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:34.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.392+0000 7f01b6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:34.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.392+0000 7f01b6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:34.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.392+0000 7f01b77fe640 10 monclient(hunting): get_auth_request con 0x7f01b80c7170 auth_method 0 2026-02-17T11:10:34.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.392+0000 7f01b77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:34.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.392+0000 7f01b77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:34.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.392+0000 7f01b77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:34.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.392+0000 7f01b7fff640 1 --2- 10.20.193.49:0/460438251 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f01b80c89c0 0x7f01b80cb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:34.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.392+0000 7f01b6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:34.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.392+0000 7f01b6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:34.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.392+0000 7f01b6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:34.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.392+0000 7f01b77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:34.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.392+0000 7f01b77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:34.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.392+0000 7f01b77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:34.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.392+0000 7f01b7fff640 10 monclient(hunting): get_auth_request con 0x7f01b80c89c0 auth_method 0 2026-02-17T11:10:34.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.392+0000 7f01b7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:34.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.392+0000 7f01b7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:34.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.392+0000 7f01b7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:34.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.393+0000 7f01b7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:34.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.393+0000 7f01b7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:34.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.393+0000 7f01b7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:34.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.394+0000 7f01b77fe640 10 monclient(hunting): handle_auth_done global_id 4399 payload 824 2026-02-17T11:10:34.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.394+0000 7f01b77fe640 1 -- 10.20.193.49:0/460438251 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f01b80c89c0 msgr2=0x7f01b80cb940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:34.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.394+0000 7f01b77fe640 1 --2- 10.20.193.49:0/460438251 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f01b80c89c0 0x7f01b80cb940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:34.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.394+0000 7f01b77fe640 1 -- 10.20.193.49:0/460438251 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f01b80c7550 msgr2=0x7f01b80c3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:34.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.394+0000 7f01b77fe640 1 --2- 10.20.193.49:0/460438251 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f01b80c7550 0x7f01b80c3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:34.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.394+0000 7f01b77fe640 10 monclient: _finish_hunting 0 2026-02-17T11:10:34.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.394+0000 7f01b77fe640 1 monclient: found mon.noname-b 2026-02-17T11:10:34.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.394+0000 7f01b77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:34.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.394+0000 7f01b77fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:10:34.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.394+0000 7f01b77fe640 1 -- 10.20.193.49:0/460438251 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01b80c14f0 con 0x7f01b80c7170 2026-02-17T11:10:34.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.395+0000 7f01b77fe640 1 --2- 10.20.193.49:0/460438251 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f01b80c7170 0x7f01b80c0fb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f01a400c730 tx=0x7f01a400cc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:34.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.395+0000 7f0193fff640 10 client.?.objecter ms_handle_connect 0x7f01b80c7170 2026-02-17T11:10:34.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.395+0000 7f0193fff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:34.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.396+0000 7f0193fff640 1 -- 10.20.193.49:0/460438251 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a4017070 con 0x7f01b80c7170 2026-02-17T11:10:34.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.396+0000 7f0193fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:34.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.396+0000 7f0193fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:10:34.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.396+0000 7f0193fff640 10 monclient: dump: 2026-02-17T11:10:34.411 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:34.411 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:34.411 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:34.411 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:34.411 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:34.411 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:34.411 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:34.412 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:34.412 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:34.412 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:34.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.396+0000 7f0193fff640 10 monclient: _finish_auth 0 2026-02-17T11:10:34.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.396+0000 7f0193fff640 10 monclient: _check_auth_tickets 2026-02-17T11:10:34.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.396+0000 7f0193fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:34.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.396+0000 7f01be0e8640 5 monclient: authenticate success, global_id 4399 2026-02-17T11:10:34.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.396+0000 7f01be0e8640 10 monclient: _renew_subs 2026-02-17T11:10:34.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.396+0000 7f01be0e8640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:34.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.396+0000 7f01be0e8640 1 -- 10.20.193.49:0/460438251 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01b80c17c0 con 0x7f01b80c7170 2026-02-17T11:10:34.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.396+0000 7f01be0e8640 10 client.4399.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:34.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.396+0000 7f01be0e8640 10 monclient: _renew_subs 2026-02-17T11:10:34.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.396+0000 7f01be0e8640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:34.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.396+0000 7f01be0e8640 1 -- 10.20.193.49:0/460438251 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01b80c1d80 con 0x7f01b80c7170 2026-02-17T11:10:34.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.396+0000 7f01be0e8640 1 librados: init done 2026-02-17T11:10:34.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.396+0000 7f0193fff640 1 -- 10.20.193.49:0/460438251 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01a4005bb0 con 0x7f01b80c7170 2026-02-17T11:10:34.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.396+0000 7f0193fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:34.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.396+0000 7f0193fff640 1 -- 10.20.193.49:0/460438251 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a4021060 con 0x7f01b80c7170 2026-02-17T11:10:34.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.396+0000 7f0193fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:34.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.396+0000 7f0193fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:34.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.396+0000 7f0193fff640 10 monclient: dump: 2026-02-17T11:10:34.413 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:34.413 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:34.413 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:34.413 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:34.413 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:34.414 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:34.414 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:34.414 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:34.414 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:34.414 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:34.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.396+0000 7f01b5ffb640 4 set_mon_vals no callback set 2026-02-17T11:10:34.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.397+0000 7f01be0e8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:34.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.397+0000 7f01be0e8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:34.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.397+0000 7f01be0e8640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:34.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.397+0000 7f01be0e8640 1 -- 10.20.193.49:0/460438251 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01b80c81c0 con 0x7f01b80c7170 2026-02-17T11:10:34.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.408+0000 7f0193fff640 1 -- 10.20.193.49:0/460438251 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f01a4024080 con 0x7f01b80c7170 2026-02-17T11:10:34.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.409+0000 7f0193fff640 1 --2- 10.20.193.49:0/460438251 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0188079140 0x7f018807b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:34.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.409+0000 7f01b6ffd640 1 --2- 10.20.193.49:0/460438251 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0188079140 0x7f018807b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:34.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.409+0000 7f01b6ffd640 10 monclient: get_auth_request con 0x7f0188079140 auth_method 0 2026-02-17T11:10:34.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.410+0000 7f01b6ffd640 1 --2- 10.20.193.49:0/460438251 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0188079140 0x7f018807b600 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f01b81edd10 tx=0x7f01a8003d70 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:34.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.410+0000 7f0193fff640 10 client.4399.objecter ms_handle_connect 0x7f0188079140 2026-02-17T11:10:34.503 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.501+0000 7f0193fff640 1 -- 10.20.193.49:0/460438251 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7f01a4096fe0 con 0x7f01b80c7170 2026-02-17T11:10:34.503 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.501+0000 7f0193fff640 10 client.4399.objecter ms_dispatch2 0x7f01b8000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:34.503 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.501+0000 7f0193fff640 3 client.4399.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:34.503 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.501+0000 7f0193fff640 3 client.4399.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:34.503 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.501+0000 7f0193fff640 20 client.4399.objecter dump_active .. 0 homeless 2026-02-17T11:10:34.508 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.507+0000 7f0193fff640 1 -- 10.20.193.49:0/460438251 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f01a4061610 con 0x7f01b80c7170 2026-02-17T11:10:34.509 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.507+0000 7f0193fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:34.509 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.507+0000 7f0193fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:34.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.589+0000 7f01be0e8640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:10:34.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.589+0000 7f01be0e8640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:10:34.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.589+0000 7f01be0e8640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:34.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.589+0000 7f01be0e8640 1 -- 10.20.193.49:0/460438251 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f01b80c9190 con 0x7f01b80c7170 2026-02-17T11:10:34.642 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.641+0000 7f0193fff640 1 -- 10.20.193.49:0/460438251 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+24720 (secure 0 0 0) 0x7f01a4065910 con 0x7f01b80c7170 2026-02-17T11:10:34.643 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.641+0000 7f0193fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:10:34.643 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.641+0000 7f0193fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:34.643 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:10:34.643 INFO:teuthology.orchestra.run.trial049.stdout:{"epoch":33,"fsid":"2799a57b-9ea3-46ae-8e91-1fe004a3651d","created":"2026-02-17T11:08:37.595499+0000","modified":"2026-02-17T11:10:33.710872+0000","last_up_change":"2026-02-17T11:10:25.779416+0000","last_in_change":"2026-02-17T11:08:43.985163+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T11:10:20.646344+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-17T11:10:29.823842+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":33,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":3.9900000095367432,"score_stable":3.9900000095367432,"optimal_score":0.68999999761581421,"raw_score_acting":2.75,"raw_score_stable":2.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"30bc819e-140a-433e-b860-eaa88e282a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6824","nonce":3898931472},{"type":"v1","addr":"10.20.193.49:6825","nonce":3898931472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6826","nonce":3898931472},{"type":"v1","addr":"10.20.193.49:6827","nonce":3898931472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6830","nonce":3898931472},{"type":"v1","addr":"10.20.193.49:6831","nonce":3898931472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6828","nonce":3898931472},{"type":"v1","addr":"10.20.193.49:6829","nonce":3898931472}]},"public_addr":"10.20.193.49:6825/3898931472","cluster_addr":"10.20.193.49:6827/3898931472","heartbeat_back_addr":"10.20.193.49:6831/3898931472","heartbeat_front_addr":"10.20.193.49:6829/3898931472","state":["exists","up"]},{"osd":1,"uuid":"2f7f1f11-f256-4094-82a9-5d21882e6e0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6816","nonce":4259563897},{"type":"v1","addr":"10.20.193.97:6817","nonce":4259563897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6818","nonce":4259563897},{"type":"v1","addr":"10.20.193.97:6819","nonce":4259563897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6822","nonce":4259563897},{"type":"v1","addr":"10.20.193.97:6823","nonce":4259563897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6820","nonce":4259563897},{"type":"v1","addr":"10.20.193.97:6821","nonce":4259563897}]},"public_addr":"10.20.193.97:6817/4259563897","cluster_addr":"10.20.193.97:6819/4259563897","heartbeat_back_addr":"10.20.193.97:6823/4259563897","heartbeat_front_addr":"10.20.193.97:6821/4259563897","state":["exists","up"]},{"osd":2,"uuid":"26bd1274-fe52-42cb-876b-df9920880f95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6816","nonce":1377516118},{"type":"v1","addr":"10.20.193.157:6817","nonce":1377516118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6818","nonce":1377516118},{"type":"v1","addr":"10.20.193.157:6819","nonce":1377516118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6822","nonce":1377516118},{"type":"v1","addr":"10.20.193.157:6823","nonce":1377516118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6820","nonce":1377516118},{"type":"v1","addr":"10.20.193.157:6821","nonce":1377516118}]},"public_addr":"10.20.193.157:6817/1377516118","cluster_addr":"10.20.193.157:6819/1377516118","heartbeat_back_addr":"10.20.193.157:6823/1377516118","heartbeat_front_addr":"10.20.193.157:6821/1377516118","state":["exists","up"]},{"osd":3,"uuid":"c78a5263-3b0d-4b22-a848-bcd6a1e4f6b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6818","nonce":1543573918},{"type":"v1","addr":"10.20.193.162:6820","nonce":1543573918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6822","nonce":1543573918},{"type":"v1","addr":"10.20.193.162:6824","nonce":1543573918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6830","nonce":1543573918},{"type":"v1","addr":"10.20.193.162:6832","nonce":1543573918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6826","nonce":1543573918},{"type":"v1","addr":"10.20.193.162:6828","nonce":1543573918}]},"public_addr":"10.20.193.162:6820/1543573918","cluster_addr":"10.20.193.162:6824/1543573918","heartbeat_back_addr":"10.20.193.162:6832/1543573918","heartbeat_front_addr":"10.20.193.162:6828/1543573918","state":["exists","up"]},{"osd":4,"uuid":"f0fdfadd-2f39-4ad8-ac88-cb588c5e8ee0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6808","nonce":2238942007},{"type":"v1","addr":"10.20.193.49:6809","nonce":2238942007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6810","nonce":2238942007},{"type":"v1","addr":"10.20.193.49:6811","nonce":2238942007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6816","nonce":2238942007},{"type":"v1","addr":"10.20.193.49:6817","nonce":2238942007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6813","nonce":2238942007},{"type":"v1","addr":"10.20.193.49:6815","nonce":2238942007}]},"public_addr":"10.20.193.49:6809/2238942007","cluster_addr":"10.20.193.49:6811/2238942007","heartbeat_back_addr":"10.20.193.49:6817/2238942007","heartbeat_front_addr":"10.20.193.49:6815/2238942007","state":["exists","up"]},{"osd":5,"uuid":"65872639-d6c0-482d-95d1-1d9f250781c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6800","nonce":3226749558},{"type":"v1","addr":"10.20.193.97:6801","nonce":3226749558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6802","nonce":3226749558},{"type":"v1","addr":"10.20.193.97:6803","nonce":3226749558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6806","nonce":3226749558},{"type":"v1","addr":"10.20.193.97:6807","nonce":3226749558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6804","nonce":3226749558},{"type":"v1","addr":"10.20.193.97:6805","nonce":3226749558}]},"public_addr":"10.20.193.97:6801/3226749558","cluster_addr":"10.20.193.97:6803/3226749558","heartbeat_back_addr":"10.20.193.97:6807/3226749558","heartbeat_front_addr":"10.20.193.97:6805/3226749558","state":["exists","up"]},{"osd":6,"uuid":"43091d3e-638d-4462-867b-cade02a315e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6800","nonce":815989681},{"type":"v1","addr":"10.20.193.157:6801","nonce":815989681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6802","nonce":815989681},{"type":"v1","addr":"10.20.193.157:6803","nonce":815989681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6806","nonce":815989681},{"type":"v1","addr":"10.20.193.157:6807","nonce":815989681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6804","nonce":815989681},{"type":"v1","addr":"10.20.193.157:6805","nonce":815989681}]},"public_addr":"10.20.193.157:6801/815989681","cluster_addr":"10.20.193.157:6803/815989681","heartbeat_back_addr":"10.20.193.157:6807/815989681","heartbeat_front_addr":"10.20.193.157:6805/815989681","state":["exists","up"]},{"osd":7,"uuid":"890ae4d6-33c9-4515-a896-a689647330dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6806","nonce":2715110678},{"type":"v1","addr":"10.20.193.162:6808","nonce":2715110678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6812","nonce":2715110678},{"type":"v1","addr":"10.20.193.162:6813","nonce":2715110678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6816","nonce":2715110678},{"type":"v1","addr":"10.20.193.162:6817","nonce":2715110678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6814","nonce":2715110678},{"type":"v1","addr":"10.20.193.162:6815","nonce":2715110678}]},"public_addr":"10.20.193.162:6808/2715110678","cluster_addr":"10.20.193.162:6813/2715110678","heartbeat_back_addr":"10.20.193.162:6817/2715110678","heartbeat_front_addr":"10.20.193.162:6815/2715110678","state":["exists","up"]},{"osd":8,"uuid":"f04abc9b-ed75-4582-b47d-07a9890f52bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6800","nonce":1386770137},{"type":"v1","addr":"10.20.193.49:6801","nonce":1386770137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6802","nonce":1386770137},{"type":"v1","addr":"10.20.193.49:6803","nonce":1386770137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6806","nonce":1386770137},{"type":"v1","addr":"10.20.193.49:6807","nonce":1386770137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6804","nonce":1386770137},{"type":"v1","addr":"10.20.193.49:6805","nonce":1386770137}]},"public_addr":"10.20.193.49:6801/1386770137","cluster_addr":"10.20.193.49:6803/1386770137","heartbeat_back_addr":"10.20.193.49:6807/1386770137","heartbeat_front_addr":"10.20.193.49:6805/1386770137","state":["exists","up"]},{"osd":9,"uuid":"7dfbb00a-6b89-4de3-9f30-6aadd91b4408","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6808","nonce":676086260},{"type":"v1","addr":"10.20.193.97:6809","nonce":676086260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6810","nonce":676086260},{"type":"v1","addr":"10.20.193.97:6811","nonce":676086260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6814","nonce":676086260},{"type":"v1","addr":"10.20.193.97:6815","nonce":676086260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6812","nonce":676086260},{"type":"v1","addr":"10.20.193.97:6813","nonce":676086260}]},"public_addr":"10.20.193.97:6809/676086260","cluster_addr":"10.20.193.97:6811/676086260","heartbeat_back_addr":"10.20.193.97:6815/676086260","heartbeat_front_addr":"10.20.193.97:6813/676086260","state":["exists","up"]},{"osd":10,"uuid":"e497a4fd-a944-489b-9cb3-30f5acaeb53e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6808","nonce":3711386099},{"type":"v1","addr":"10.20.193.157:6809","nonce":3711386099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6810","nonce":3711386099},{"type":"v1","addr":"10.20.193.157:6811","nonce":3711386099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6814","nonce":3711386099},{"type":"v1","addr":"10.20.193.157:6815","nonce":3711386099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6812","nonce":3711386099},{"type":"v1","addr":"10.20.193.157:6813","nonce":3711386099}]},"public_addr":"10.20.193.157:6809/3711386099","cluster_addr":"10.20.193.157:6811/3711386099","heartbeat_back_addr":"10.20.193.157:6815/3711386099","heartbeat_front_addr":"10.20.193.157:6813/3711386099","state":["exists","up"]},{"osd":11,"uuid":"7371d50f-36f9-477d-8d4d-853f481dd6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6802","nonce":3400543064},{"type":"v1","addr":"10.20.193.162:6803","nonce":3400543064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6804","nonce":3400543064},{"type":"v1","addr":"10.20.193.162:6805","nonce":3400543064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6810","nonce":3400543064},{"type":"v1","addr":"10.20.193.162:6811","nonce":3400543064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6807","nonce":3400543064},{"type":"v1","addr":"10.20.193.162:6809","nonce":3400543064}]},"public_addr":"10.20.193.162:6803/3400543064","cluster_addr":"10.20.193.162:6805/3400543064","heartbeat_back_addr":"10.20.193.162:6811/3400543064","heartbeat_front_addr":"10.20.193.162:6809/3400543064","state":["exists","up"]},{"osd":12,"uuid":"3cf4fded-49db-4d95-956b-77acc868a3ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6812","nonce":4012737431},{"type":"v1","addr":"10.20.193.49:6814","nonce":4012737431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6818","nonce":4012737431},{"type":"v1","addr":"10.20.193.49:6819","nonce":4012737431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6822","nonce":4012737431},{"type":"v1","addr":"10.20.193.49:6823","nonce":4012737431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6820","nonce":4012737431},{"type":"v1","addr":"10.20.193.49:6821","nonce":4012737431}]},"public_addr":"10.20.193.49:6814/4012737431","cluster_addr":"10.20.193.49:6819/4012737431","heartbeat_back_addr":"10.20.193.49:6823/4012737431","heartbeat_front_addr":"10.20.193.49:6821/4012737431","state":["exists","up"]},{"osd":13,"uuid":"7dc53473-594f-4cfb-8444-eab205e2e0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6824","nonce":409145483},{"type":"v1","addr":"10.20.193.97:6825","nonce":409145483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6826","nonce":409145483},{"type":"v1","addr":"10.20.193.97:6827","nonce":409145483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6830","nonce":409145483},{"type":"v1","addr":"10.20.193.97:6831","nonce":409145483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6828","nonce":409145483},{"type":"v1","addr":"10.20.193.97:6829","nonce":409145483}]},"public_addr":"10.20.193.97:6825/409145483","cluster_addr":"10.20.193.97:6827/409145483","heartbeat_back_addr":"10.20.193.97:6831/409145483","heartbeat_front_addr":"10.20.193.97:6829/409145483","state":["exists","up"]},{"osd":14,"uuid":"e8ab3e8f-29a8-4c79-bf86-d29543aac56a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6824","nonce":404726964},{"type":"v1","addr":"10.20.193.157:6825","nonce":404726964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6826","nonce":404726964},{"type":"v1","addr":"10.20.193.157:6827","nonce":404726964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6830","nonce":404726964},{"type":"v1","addr":"10.20.193.157:6831","nonce":404726964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6828","nonce":404726964},{"type":"v1","addr":"10.20.193.157:6829","nonce":404726964}]},"public_addr":"10.20.193.157:6825/404726964","cluster_addr":"10.20.193.157:6827/404726964","heartbeat_back_addr":"10.20.193.157:6831/404726964","heartbeat_front_addr":"10.20.193.157:6829/404726964","state":["exists","up"]},{"osd":15,"uuid":"300a4696-aa54-4b47-b9f3-87dec719bcfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6819","nonce":3057705174},{"type":"v1","addr":"10.20.193.162:6821","nonce":3057705174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6823","nonce":3057705174},{"type":"v1","addr":"10.20.193.162:6825","nonce":3057705174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6831","nonce":3057705174},{"type":"v1","addr":"10.20.193.162:6833","nonce":3057705174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6827","nonce":3057705174},{"type":"v1","addr":"10.20.193.162:6829","nonce":3057705174}]},"public_addr":"10.20.193.162:6821/3057705174","cluster_addr":"10.20.193.162:6825/3057705174","heartbeat_back_addr":"10.20.193.162:6833/3057705174","heartbeat_front_addr":"10.20.193.162:6829/3057705174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:18.201964+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:17.998817+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:18.526566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:18.016485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:17.449438+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:18.134204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:19.177012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:17.496419+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:17.321828+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:18.265266+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:19.587499+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:17.978701+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:18.041032+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:18.477125+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:19.577746+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:18.096729+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:10:34.645 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.643+0000 7f01be0e8640 10 librados: watch_flush enter 2026-02-17T11:10:34.645 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.643+0000 7f01be0e8640 10 librados: watch_flush exit 2026-02-17T11:10:34.645 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.643+0000 7f01be0e8640 20 client.4399.objecter shutdown clearing up homeless session... 2026-02-17T11:10:34.645 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.643+0000 7f01be0e8640 10 client.4399.objecter successfully canceled tick 2026-02-17T11:10:34.646 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.643+0000 7f01be0e8640 1 -- 10.20.193.49:0/460438251 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0188079140 msgr2=0x7f018807b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:34.646 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.643+0000 7f01be0e8640 1 --2- 10.20.193.49:0/460438251 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0188079140 0x7f018807b600 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f01b81edd10 tx=0x7f01a8003d70 comp rx=0 tx=0).stop 2026-02-17T11:10:34.646 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.643+0000 7f01be0e8640 10 monclient: shutdown 2026-02-17T11:10:34.646 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.643+0000 7f01be0e8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:34.646 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.643+0000 7f01be0e8640 1 -- 10.20.193.49:0/460438251 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f01b80c7170 msgr2=0x7f01b80c0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:34.646 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.643+0000 7f01be0e8640 1 --2- 10.20.193.49:0/460438251 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f01b80c7170 0x7f01b80c0fb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f01a400c730 tx=0x7f01a400cc00 comp rx=0 tx=0).stop 2026-02-17T11:10:34.646 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.643+0000 7f01be0e8640 1 -- 10.20.193.49:0/460438251 shutdown_connections 2026-02-17T11:10:34.646 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.643+0000 7f01be0e8640 1 --2- 10.20.193.49:0/460438251 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0188079140 0x7f018807b600 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:34.646 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.643+0000 7f01be0e8640 1 --2- 10.20.193.49:0/460438251 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f01b80c89c0 0x7f01b80cb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:34.646 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.643+0000 7f01be0e8640 1 --2- 10.20.193.49:0/460438251 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f01b80c7550 0x7f01b80c3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:34.647 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.643+0000 7f01be0e8640 1 --2- 10.20.193.49:0/460438251 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f01b80c7170 0x7f01b80c0fb0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:34.647 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.643+0000 7f01be0e8640 1 -- 10.20.193.49:0/460438251 >> 10.20.193.49:0/460438251 conn(0x7f01b80c9f40 msgr2=0x7f01b80cc590 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:34.647 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.643+0000 7f01be0e8640 1 -- 10.20.193.49:0/460438251 shutdown_connections 2026-02-17T11:10:34.647 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.643+0000 7f01be0e8640 1 -- 10.20.193.49:0/460438251 wait complete. 2026-02-17T11:10:34.647 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.643+0000 7f01be0e8640 1 librados: shutdown 2026-02-17T11:10:34.654 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-17T11:10:34.655 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:10:34.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.720+0000 7ff653ff7640 10 monclient: get_monmap_and_config 2026-02-17T11:10:34.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.720+0000 7ff653ff7640 10 monclient: build_initial_monmap 2026-02-17T11:10:34.723 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.720+0000 7ff653ff7640 10 monclient: monmap: 2026-02-17T11:10:34.723 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:34.723 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:34.723 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:34.721138+0000 2026-02-17T11:10:34.723 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:34.721138+0000 2026-02-17T11:10:34.723 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:34.723 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:34.723 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:34.723 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:34.723 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:34.723 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:34.724 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:34.724 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:34.724 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:34.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.721+0000 7ff653ff7640 1 Processor -- start 2026-02-17T11:10:34.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.721+0000 7ff653ff7640 1 -- start start 2026-02-17T11:10:34.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.721+0000 7ff653ff7640 10 monclient: init 2026-02-17T11:10:34.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.721+0000 7ff653ff7640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:34.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.721+0000 7ff653ff7640 10 monclient: _add_conns ranks=[5,0,2,3,4,1] 2026-02-17T11:10:34.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.721+0000 7ff653ff7640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7ff64c0c7170 0x7ff64c0c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:34.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.721+0000 7ff653ff7640 10 monclient(hunting): picked mon.noname-c con 0x7ff64c0c7170 addr v2:10.20.193.157:3300/0 2026-02-17T11:10:34.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.721+0000 7ff653ff7640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ff64c0c48c0 addr v1:10.20.193.49:6789/0 2026-02-17T11:10:34.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.721+0000 7ff653ff7640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ff64c0c4d10 addr v1:10.20.193.157:6789/0 2026-02-17T11:10:34.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.721+0000 7ff653ff7640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff64c15a9a0 con 0x7ff64c0c48c0 2026-02-17T11:10:34.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.721+0000 7ff653ff7640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff64c0c5270 con 0x7ff64c0c4d10 2026-02-17T11:10:34.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.721+0000 7ff653ff7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:34.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.721+0000 7ff653ff7640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7ff64c0c8530 con 0x7ff64c0c7170 2026-02-17T11:10:34.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.721+0000 7ff653ff7640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:34.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.721+0000 7ff653ff7640 10 monclient(hunting): authenticate will time out at 1111.384712s 2026-02-17T11:10:34.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.722+0000 7ff65156b640 1 --1- >> v1:10.20.193.49:6789/0 conn(0x7ff64c0c48c0 0x7ff64c0749b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.49:6789/0 says I am v1:10.20.193.49:50396/0 (socket says 10.20.193.49:50396) 2026-02-17T11:10:34.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.722+0000 7ff65156b640 1 -- 10.20.193.49:0/3193502784 learned_addr learned my addr 10.20.193.49:0/3193502784 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:10:34.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.722+0000 7ff651d6c640 1 --2- 10.20.193.49:0/3193502784 >> v2:10.20.193.157:3300/0 conn(0x7ff64c0c7170 0x7ff64c0c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:34.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.722+0000 7ff651d6c640 10 monclient(hunting): get_auth_request con 0x7ff64c0c7170 auth_method 0 2026-02-17T11:10:34.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.722+0000 7ff651d6c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:34.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.722+0000 7ff651d6c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:34.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.722+0000 7ff651d6c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:34.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.723+0000 7ff651d6c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:34.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.723+0000 7ff651d6c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:34.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.723+0000 7ff651d6c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:34.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.723+0000 7ff650d6a640 1 -- 10.20.193.49:0/3193502784 <== mon.0 v1:10.20.193.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 296820200 0 0) 0x7ff64c15a9a0 con 0x7ff64c0c48c0 2026-02-17T11:10:34.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.723+0000 7ff650d6a640 10 monclient(hunting): _negotiate 2026-02-17T11:10:34.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.723+0000 7ff650d6a640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:34.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.723+0000 7ff650d6a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:34.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.723+0000 7ff650d6a640 10 monclient(hunting): my global_id is 4395 2026-02-17T11:10:34.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.723+0000 7ff650d6a640 1 -- 10.20.193.49:0/3193502784 --> v1:10.20.193.49:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff634003620 con 0x7ff64c0c48c0 2026-02-17T11:10:34.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.724+0000 7ff650d6a640 1 -- 10.20.193.49:0/3193502784 <== mon.2 v1:10.20.193.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 489534039 0 0) 0x7ff64c0c5270 con 0x7ff64c0c4d10 2026-02-17T11:10:34.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.724+0000 7ff650d6a640 10 monclient(hunting): _negotiate 2026-02-17T11:10:34.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.724+0000 7ff650d6a640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:34.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.724+0000 7ff650d6a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:34.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.724+0000 7ff650d6a640 10 monclient(hunting): my global_id is 4412 2026-02-17T11:10:34.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.724+0000 7ff650d6a640 1 -- 10.20.193.49:0/3193502784 --> v1:10.20.193.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff64c15a9a0 con 0x7ff64c0c4d10 2026-02-17T11:10:34.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.725+0000 7ff651d6c640 10 monclient(hunting): handle_auth_done global_id 4409 payload 274 2026-02-17T11:10:34.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.725+0000 7ff651d6c640 1 -- 10.20.193.49:0/3193502784 >> v1:10.20.193.157:6789/0 conn(0x7ff64c0c4d10 legacy=0x7ff64c0c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:34.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.725+0000 7ff651d6c640 1 -- 10.20.193.49:0/3193502784 >> v1:10.20.193.49:6789/0 conn(0x7ff64c0c48c0 legacy=0x7ff64c0749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:34.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.725+0000 7ff651d6c640 10 monclient: _finish_hunting 0 2026-02-17T11:10:34.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.725+0000 7ff651d6c640 1 monclient: found mon.noname-c 2026-02-17T11:10:34.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.725+0000 7ff651d6c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:34.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.725+0000 7ff651d6c640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:10:34.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.725+0000 7ff651d6c640 1 -- 10.20.193.49:0/3193502784 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff64c0c5550 con 0x7ff64c0c7170 2026-02-17T11:10:34.735 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.726+0000 7ff651d6c640 1 --2- 10.20.193.49:0/3193502784 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff64c0c7170 0x7ff64c0c7550 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff63c0098a0 tx=0x7ff63c02ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30bb835f0a6e4bbf server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:34.735 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.728+0000 7ff650d6a640 1 -- 10.20.193.49:0/3193502784 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff63c03c070 con 0x7ff64c0c7170 2026-02-17T11:10:34.735 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.728+0000 7ff650d6a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:34.736 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.728+0000 7ff650d6a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:10:34.736 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.728+0000 7ff650d6a640 10 monclient: dump: 2026-02-17T11:10:34.736 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:34.736 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:34.736 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:34.736 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:34.736 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:34.736 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:34.736 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:34.736 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:34.736 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:34.737 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:34.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.728+0000 7ff650d6a640 10 monclient: _finish_auth 0 2026-02-17T11:10:34.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.728+0000 7ff650d6a640 10 monclient: _check_auth_tickets 2026-02-17T11:10:34.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.728+0000 7ff650d6a640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:34.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.728+0000 7ff650d6a640 1 -- 10.20.193.49:0/3193502784 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff63c02fb70 con 0x7ff64c0c7170 2026-02-17T11:10:34.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.728+0000 7ff650d6a640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:34.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.728+0000 7ff653ff7640 5 monclient: authenticate success, global_id 4409 2026-02-17T11:10:34.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.728+0000 7ff650d6a640 1 -- 10.20.193.49:0/3193502784 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff63c037440 con 0x7ff64c0c7170 2026-02-17T11:10:34.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.728+0000 7ff653ff7640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:34.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.728+0000 7ff650d6a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:34.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.728+0000 7ff653ff7640 4 set_mon_vals no callback set 2026-02-17T11:10:34.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.728+0000 7ff650d6a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:10:34.738 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.728+0000 7ff650d6a640 10 monclient: dump: 2026-02-17T11:10:34.738 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:34.738 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:34.738 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:34.738 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:34.738 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:34.738 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:34.738 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:34.738 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:34.738 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:34.738 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:34.738 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.729+0000 7ff653ff7640 10 monclient: shutdown 2026-02-17T11:10:34.739 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.729+0000 7ff653ff7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:34.739 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.729+0000 7ff653ff7640 1 -- 10.20.193.49:0/3193502784 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff64c0c7170 msgr2=0x7ff64c0c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:34.739 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.729+0000 7ff653ff7640 1 --2- 10.20.193.49:0/3193502784 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff64c0c7170 0x7ff64c0c7550 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff63c0098a0 tx=0x7ff63c02ee60 comp rx=0 tx=0).stop 2026-02-17T11:10:34.739 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.729+0000 7ff653ff7640 1 -- 10.20.193.49:0/3193502784 shutdown_connections 2026-02-17T11:10:34.739 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.729+0000 7ff653ff7640 1 --2- 10.20.193.49:0/3193502784 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff64c0c7170 0x7ff64c0c7550 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:34.739 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.729+0000 7ff653ff7640 1 -- 10.20.193.49:0/3193502784 >> 10.20.193.49:0/3193502784 conn(0x7ff64c0c9f40 msgr2=0x7ff64c0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:34.739 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.729+0000 7ff653ff7640 1 -- 10.20.193.49:0/3193502784 shutdown_connections 2026-02-17T11:10:34.739 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.729+0000 7ff653ff7640 1 -- 10.20.193.49:0/3193502784 wait complete. 2026-02-17T11:10:34.739 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.729+0000 7ff653ff7640 10 monclient: build_initial_monmap 2026-02-17T11:10:34.739 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.729+0000 7ff653ff7640 10 monclient: monmap: 2026-02-17T11:10:34.739 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:34.739 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:34.740 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:34.740 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:34.740 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:34.740 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:34.740 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:34.740 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:34.740 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:34.740 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:34.740 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.729+0000 7ff653ff7640 1 librados: starting msgr at 2026-02-17T11:10:34.740 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.729+0000 7ff653ff7640 1 librados: starting objecter 2026-02-17T11:10:34.740 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.730+0000 7ff653ff7640 1 Processor -- start 2026-02-17T11:10:34.740 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.730+0000 7ff653ff7640 1 -- start start 2026-02-17T11:10:34.741 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.730+0000 7ff653ff7640 1 librados: setting wanted keys 2026-02-17T11:10:34.741 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.730+0000 7ff653ff7640 1 librados: calling monclient init 2026-02-17T11:10:34.741 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.730+0000 7ff653ff7640 10 monclient: init 2026-02-17T11:10:34.741 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.730+0000 7ff653ff7640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:34.741 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.730+0000 7ff653ff7640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:10:34.741 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.730+0000 7ff653ff7640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff64c0c48c0 0x7ff64c0c2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:34.741 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.730+0000 7ff653ff7640 10 monclient(hunting): picked mon.noname-c con 0x7ff64c0c48c0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:34.741 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.730+0000 7ff653ff7640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ff64c0c4d10 0x7ff64c14d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:34.741 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.730+0000 7ff653ff7640 10 monclient(hunting): picked mon.noname-a con 0x7ff64c0c4d10 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:34.741 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.730+0000 7ff653ff7640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7ff64c0c7170 0x7ff64c06f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:34.741 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.730+0000 7ff653ff7640 10 monclient(hunting): picked mon.noname-b con 0x7ff64c0c7170 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:34.741 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.730+0000 7ff653ff7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:34.741 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.730+0000 7ff653ff7640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff64c0c81c0 con 0x7ff64c0c4d10 2026-02-17T11:10:34.742 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.730+0000 7ff653ff7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:34.742 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.730+0000 7ff653ff7640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7ff64c0c7ee0 con 0x7ff64c0c7170 2026-02-17T11:10:34.742 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.730+0000 7ff653ff7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:34.742 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.730+0000 7ff653ff7640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7ff64c0750c0 con 0x7ff64c0c48c0 2026-02-17T11:10:34.742 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.730+0000 7ff653ff7640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:34.742 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.730+0000 7ff653ff7640 10 monclient(hunting): authenticate will time out at 1111.393486s 2026-02-17T11:10:34.742 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.730+0000 7ff65156b640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ff64c0c4d10 0x7ff64c14d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:34.742 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.730+0000 7ff651d6c640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff64c0c48c0 0x7ff64c0c2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:34.742 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.730+0000 7ff65256d640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7ff64c0c7170 0x7ff64c06f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:34.742 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.731+0000 7ff651d6c640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff64c0c48c0 0x7ff64c0c2570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:55724/0 (socket says 10.20.193.49:55724) 2026-02-17T11:10:34.742 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.731+0000 7ff651d6c640 1 -- 10.20.193.49:0/3652817660 learned_addr learned my addr 10.20.193.49:0/3652817660 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:34.742 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.731+0000 7ff651d6c640 10 monclient(hunting): get_auth_request con 0x7ff64c0c48c0 auth_method 0 2026-02-17T11:10:34.743 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.731+0000 7ff651d6c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:34.743 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.731+0000 7ff651d6c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:34.743 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.731+0000 7ff651d6c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:34.743 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.731+0000 7ff65256d640 10 monclient(hunting): get_auth_request con 0x7ff64c0c7170 auth_method 0 2026-02-17T11:10:34.743 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.731+0000 7ff65256d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:34.743 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.731+0000 7ff65256d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:34.743 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.731+0000 7ff65256d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:34.743 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.731+0000 7ff65156b640 10 monclient(hunting): get_auth_request con 0x7ff64c0c4d10 auth_method 0 2026-02-17T11:10:34.743 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.731+0000 7ff65156b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:34.743 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.731+0000 7ff65156b640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:34.743 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.731+0000 7ff65156b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:34.743 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.731+0000 7ff651d6c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:34.743 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.731+0000 7ff651d6c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:34.744 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.731+0000 7ff651d6c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:34.744 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.731+0000 7ff65256d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:34.744 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.731+0000 7ff65256d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:34.744 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.731+0000 7ff65256d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:34.744 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.732+0000 7ff65156b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:34.744 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.732+0000 7ff65156b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:34.744 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.732+0000 7ff65156b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:34.744 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.732+0000 7ff651d6c640 10 monclient(hunting): handle_auth_done global_id 4415 payload 824 2026-02-17T11:10:34.744 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.732+0000 7ff651d6c640 1 -- 10.20.193.49:0/3652817660 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7ff64c0c7170 msgr2=0x7ff64c06f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:34.744 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.732+0000 7ff651d6c640 1 --2- 10.20.193.49:0/3652817660 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7ff64c0c7170 0x7ff64c06f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:34.744 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.732+0000 7ff651d6c640 1 -- 10.20.193.49:0/3652817660 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ff64c0c4d10 msgr2=0x7ff64c14d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:34.744 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.732+0000 7ff651d6c640 1 --2- 10.20.193.49:0/3652817660 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ff64c0c4d10 0x7ff64c14d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:34.745 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.732+0000 7ff651d6c640 10 monclient: _finish_hunting 0 2026-02-17T11:10:34.745 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.732+0000 7ff651d6c640 1 monclient: found mon.noname-c 2026-02-17T11:10:34.745 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.732+0000 7ff651d6c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:34.745 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.732+0000 7ff651d6c640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:10:34.745 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.732+0000 7ff651d6c640 1 -- 10.20.193.49:0/3652817660 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff64c14c970 con 0x7ff64c0c48c0 2026-02-17T11:10:34.745 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.733+0000 7ff651d6c640 1 --2- 10.20.193.49:0/3652817660 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff64c0c48c0 0x7ff64c0c2570 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff63c016e30 tx=0x7ff63c0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:34.745 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.733+0000 7ff63a7fc640 10 client.?.objecter ms_handle_connect 0x7ff64c0c48c0 2026-02-17T11:10:34.745 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.733+0000 7ff63a7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:34.747 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.734+0000 7ff63a7fc640 1 -- 10.20.193.49:0/3652817660 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff63c046020 con 0x7ff64c0c48c0 2026-02-17T11:10:34.747 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.734+0000 7ff63a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:34.747 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.734+0000 7ff63a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:10:34.747 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.734+0000 7ff63a7fc640 10 monclient: dump: 2026-02-17T11:10:34.747 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:34.748 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:34.748 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:34.748 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:34.748 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:34.748 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:34.748 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:34.748 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:34.748 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:34.748 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:34.748 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.734+0000 7ff63a7fc640 10 monclient: _finish_auth 0 2026-02-17T11:10:34.748 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.734+0000 7ff63a7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:10:34.748 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.734+0000 7ff63a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:34.749 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.734+0000 7ff653ff7640 5 monclient: authenticate success, global_id 4415 2026-02-17T11:10:34.749 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.734+0000 7ff653ff7640 10 monclient: _renew_subs 2026-02-17T11:10:34.749 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.734+0000 7ff653ff7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:34.749 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.734+0000 7ff653ff7640 1 -- 10.20.193.49:0/3652817660 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff64c06f680 con 0x7ff64c0c48c0 2026-02-17T11:10:34.749 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.734+0000 7ff653ff7640 10 client.4415.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:34.749 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.734+0000 7ff653ff7640 10 monclient: _renew_subs 2026-02-17T11:10:34.749 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.734+0000 7ff653ff7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:34.749 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.734+0000 7ff653ff7640 1 -- 10.20.193.49:0/3652817660 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff64c06e4e0 con 0x7ff64c0c48c0 2026-02-17T11:10:34.749 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.734+0000 7ff653ff7640 1 librados: init done 2026-02-17T11:10:34.749 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.735+0000 7ff63a7fc640 1 -- 10.20.193.49:0/3652817660 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff63c02fb70 con 0x7ff64c0c48c0 2026-02-17T11:10:34.749 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.735+0000 7ff63a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:34.749 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.735+0000 7ff63a7fc640 1 -- 10.20.193.49:0/3652817660 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff63c03c040 con 0x7ff64c0c48c0 2026-02-17T11:10:34.750 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.735+0000 7ff63a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:34.750 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.735+0000 7ff63a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:10:34.750 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.735+0000 7ff63a7fc640 10 monclient: dump: 2026-02-17T11:10:34.750 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:34.750 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:34.750 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:34.750 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:34.750 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:34.750 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:34.750 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:34.750 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:34.750 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:34.751 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:34.751 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.735+0000 7ff63bfff640 4 set_mon_vals no callback set 2026-02-17T11:10:34.751 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.735+0000 7ff653ff7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:34.751 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.735+0000 7ff653ff7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:34.751 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.735+0000 7ff653ff7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:34.751 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.735+0000 7ff653ff7640 1 -- 10.20.193.49:0/3652817660 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff64c0c7550 con 0x7ff64c0c48c0 2026-02-17T11:10:34.752 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.746+0000 7ff63a7fc640 1 -- 10.20.193.49:0/3652817660 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7ff63c042650 con 0x7ff64c0c48c0 2026-02-17T11:10:34.753 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.747+0000 7ff63a7fc640 1 --2- 10.20.193.49:0/3652817660 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ff61c079140 0x7ff61c07b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:34.753 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.747+0000 7ff65156b640 1 --2- 10.20.193.49:0/3652817660 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ff61c079140 0x7ff61c07b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:34.753 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.747+0000 7ff65156b640 10 monclient: get_auth_request con 0x7ff61c079140 auth_method 0 2026-02-17T11:10:34.753 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.748+0000 7ff63a7fc640 10 client.4415.objecter ms_handle_connect 0x7ff61c079140 2026-02-17T11:10:34.753 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.748+0000 7ff65156b640 1 --2- 10.20.193.49:0/3652817660 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ff61c079140 0x7ff61c07b600 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff640007b60 tx=0x7ff640007ab0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:34.753 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.748+0000 7ff63a7fc640 1 -- 10.20.193.49:0/3652817660 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7ff63c082f30 con 0x7ff64c0c48c0 2026-02-17T11:10:34.753 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.748+0000 7ff63a7fc640 10 client.4415.objecter ms_dispatch2 0x7ff64c000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:34.753 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.748+0000 7ff63a7fc640 3 client.4415.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:34.753 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.748+0000 7ff63a7fc640 3 client.4415.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:34.753 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.748+0000 7ff63a7fc640 20 client.4415.objecter dump_active .. 0 homeless 2026-02-17T11:10:34.849 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.848+0000 7ff63a7fc640 1 -- 10.20.193.49:0/3652817660 <== mon.2 v2:10.20.193.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ff63c050070 con 0x7ff64c0c48c0 2026-02-17T11:10:34.849 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.848+0000 7ff63a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:34.849 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.848+0000 7ff63a7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:34.934 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.933+0000 7ff653ff7640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:10:34.934 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.933+0000 7ff653ff7640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:10:34.934 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.933+0000 7ff653ff7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:34.934 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.933+0000 7ff653ff7640 1 -- 10.20.193.49:0/3652817660 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff64c1579d0 con 0x7ff64c0c48c0 2026-02-17T11:10:34.955 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.954+0000 7ff63a7fc640 1 -- 10.20.193.49:0/3652817660 <== mon.2 v2:10.20.193.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+24720 (secure 0 0 0) 0x7ff63c086ef0 con 0x7ff64c0c48c0 2026-02-17T11:10:34.956 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.954+0000 7ff63a7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:10:34.956 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.954+0000 7ff63a7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:34.956 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:10:34.956 INFO:teuthology.orchestra.run.trial049.stdout:{"epoch":33,"fsid":"2799a57b-9ea3-46ae-8e91-1fe004a3651d","created":"2026-02-17T11:08:37.595499+0000","modified":"2026-02-17T11:10:33.710872+0000","last_up_change":"2026-02-17T11:10:25.779416+0000","last_in_change":"2026-02-17T11:08:43.985163+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T11:10:20.646344+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-17T11:10:29.823842+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":33,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":3.9900000095367432,"score_stable":3.9900000095367432,"optimal_score":0.68999999761581421,"raw_score_acting":2.75,"raw_score_stable":2.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"30bc819e-140a-433e-b860-eaa88e282a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6824","nonce":3898931472},{"type":"v1","addr":"10.20.193.49:6825","nonce":3898931472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6826","nonce":3898931472},{"type":"v1","addr":"10.20.193.49:6827","nonce":3898931472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6830","nonce":3898931472},{"type":"v1","addr":"10.20.193.49:6831","nonce":3898931472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6828","nonce":3898931472},{"type":"v1","addr":"10.20.193.49:6829","nonce":3898931472}]},"public_addr":"10.20.193.49:6825/3898931472","cluster_addr":"10.20.193.49:6827/3898931472","heartbeat_back_addr":"10.20.193.49:6831/3898931472","heartbeat_front_addr":"10.20.193.49:6829/3898931472","state":["exists","up"]},{"osd":1,"uuid":"2f7f1f11-f256-4094-82a9-5d21882e6e0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6816","nonce":4259563897},{"type":"v1","addr":"10.20.193.97:6817","nonce":4259563897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6818","nonce":4259563897},{"type":"v1","addr":"10.20.193.97:6819","nonce":4259563897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6822","nonce":4259563897},{"type":"v1","addr":"10.20.193.97:6823","nonce":4259563897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6820","nonce":4259563897},{"type":"v1","addr":"10.20.193.97:6821","nonce":4259563897}]},"public_addr":"10.20.193.97:6817/4259563897","cluster_addr":"10.20.193.97:6819/4259563897","heartbeat_back_addr":"10.20.193.97:6823/4259563897","heartbeat_front_addr":"10.20.193.97:6821/4259563897","state":["exists","up"]},{"osd":2,"uuid":"26bd1274-fe52-42cb-876b-df9920880f95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6816","nonce":1377516118},{"type":"v1","addr":"10.20.193.157:6817","nonce":1377516118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6818","nonce":1377516118},{"type":"v1","addr":"10.20.193.157:6819","nonce":1377516118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6822","nonce":1377516118},{"type":"v1","addr":"10.20.193.157:6823","nonce":1377516118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6820","nonce":1377516118},{"type":"v1","addr":"10.20.193.157:6821","nonce":1377516118}]},"public_addr":"10.20.193.157:6817/1377516118","cluster_addr":"10.20.193.157:6819/1377516118","heartbeat_back_addr":"10.20.193.157:6823/1377516118","heartbeat_front_addr":"10.20.193.157:6821/1377516118","state":["exists","up"]},{"osd":3,"uuid":"c78a5263-3b0d-4b22-a848-bcd6a1e4f6b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6818","nonce":1543573918},{"type":"v1","addr":"10.20.193.162:6820","nonce":1543573918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6822","nonce":1543573918},{"type":"v1","addr":"10.20.193.162:6824","nonce":1543573918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6830","nonce":1543573918},{"type":"v1","addr":"10.20.193.162:6832","nonce":1543573918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6826","nonce":1543573918},{"type":"v1","addr":"10.20.193.162:6828","nonce":1543573918}]},"public_addr":"10.20.193.162:6820/1543573918","cluster_addr":"10.20.193.162:6824/1543573918","heartbeat_back_addr":"10.20.193.162:6832/1543573918","heartbeat_front_addr":"10.20.193.162:6828/1543573918","state":["exists","up"]},{"osd":4,"uuid":"f0fdfadd-2f39-4ad8-ac88-cb588c5e8ee0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6808","nonce":2238942007},{"type":"v1","addr":"10.20.193.49:6809","nonce":2238942007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6810","nonce":2238942007},{"type":"v1","addr":"10.20.193.49:6811","nonce":2238942007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6816","nonce":2238942007},{"type":"v1","addr":"10.20.193.49:6817","nonce":2238942007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6813","nonce":2238942007},{"type":"v1","addr":"10.20.193.49:6815","nonce":2238942007}]},"public_addr":"10.20.193.49:6809/2238942007","cluster_addr":"10.20.193.49:6811/2238942007","heartbeat_back_addr":"10.20.193.49:6817/2238942007","heartbeat_front_addr":"10.20.193.49:6815/2238942007","state":["exists","up"]},{"osd":5,"uuid":"65872639-d6c0-482d-95d1-1d9f250781c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6800","nonce":3226749558},{"type":"v1","addr":"10.20.193.97:6801","nonce":3226749558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6802","nonce":3226749558},{"type":"v1","addr":"10.20.193.97:6803","nonce":3226749558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6806","nonce":3226749558},{"type":"v1","addr":"10.20.193.97:6807","nonce":3226749558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6804","nonce":3226749558},{"type":"v1","addr":"10.20.193.97:6805","nonce":3226749558}]},"public_addr":"10.20.193.97:6801/3226749558","cluster_addr":"10.20.193.97:6803/3226749558","heartbeat_back_addr":"10.20.193.97:6807/3226749558","heartbeat_front_addr":"10.20.193.97:6805/3226749558","state":["exists","up"]},{"osd":6,"uuid":"43091d3e-638d-4462-867b-cade02a315e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6800","nonce":815989681},{"type":"v1","addr":"10.20.193.157:6801","nonce":815989681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6802","nonce":815989681},{"type":"v1","addr":"10.20.193.157:6803","nonce":815989681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6806","nonce":815989681},{"type":"v1","addr":"10.20.193.157:6807","nonce":815989681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6804","nonce":815989681},{"type":"v1","addr":"10.20.193.157:6805","nonce":815989681}]},"public_addr":"10.20.193.157:6801/815989681","cluster_addr":"10.20.193.157:6803/815989681","heartbeat_back_addr":"10.20.193.157:6807/815989681","heartbeat_front_addr":"10.20.193.157:6805/815989681","state":["exists","up"]},{"osd":7,"uuid":"890ae4d6-33c9-4515-a896-a689647330dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6806","nonce":2715110678},{"type":"v1","addr":"10.20.193.162:6808","nonce":2715110678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6812","nonce":2715110678},{"type":"v1","addr":"10.20.193.162:6813","nonce":2715110678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6816","nonce":2715110678},{"type":"v1","addr":"10.20.193.162:6817","nonce":2715110678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6814","nonce":2715110678},{"type":"v1","addr":"10.20.193.162:6815","nonce":2715110678}]},"public_addr":"10.20.193.162:6808/2715110678","cluster_addr":"10.20.193.162:6813/2715110678","heartbeat_back_addr":"10.20.193.162:6817/2715110678","heartbeat_front_addr":"10.20.193.162:6815/2715110678","state":["exists","up"]},{"osd":8,"uuid":"f04abc9b-ed75-4582-b47d-07a9890f52bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6800","nonce":1386770137},{"type":"v1","addr":"10.20.193.49:6801","nonce":1386770137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6802","nonce":1386770137},{"type":"v1","addr":"10.20.193.49:6803","nonce":1386770137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6806","nonce":1386770137},{"type":"v1","addr":"10.20.193.49:6807","nonce":1386770137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6804","nonce":1386770137},{"type":"v1","addr":"10.20.193.49:6805","nonce":1386770137}]},"public_addr":"10.20.193.49:6801/1386770137","cluster_addr":"10.20.193.49:6803/1386770137","heartbeat_back_addr":"10.20.193.49:6807/1386770137","heartbeat_front_addr":"10.20.193.49:6805/1386770137","state":["exists","up"]},{"osd":9,"uuid":"7dfbb00a-6b89-4de3-9f30-6aadd91b4408","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6808","nonce":676086260},{"type":"v1","addr":"10.20.193.97:6809","nonce":676086260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6810","nonce":676086260},{"type":"v1","addr":"10.20.193.97:6811","nonce":676086260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6814","nonce":676086260},{"type":"v1","addr":"10.20.193.97:6815","nonce":676086260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6812","nonce":676086260},{"type":"v1","addr":"10.20.193.97:6813","nonce":676086260}]},"public_addr":"10.20.193.97:6809/676086260","cluster_addr":"10.20.193.97:6811/676086260","heartbeat_back_addr":"10.20.193.97:6815/676086260","heartbeat_front_addr":"10.20.193.97:6813/676086260","state":["exists","up"]},{"osd":10,"uuid":"e497a4fd-a944-489b-9cb3-30f5acaeb53e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6808","nonce":3711386099},{"type":"v1","addr":"10.20.193.157:6809","nonce":3711386099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6810","nonce":3711386099},{"type":"v1","addr":"10.20.193.157:6811","nonce":3711386099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6814","nonce":3711386099},{"type":"v1","addr":"10.20.193.157:6815","nonce":3711386099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6812","nonce":3711386099},{"type":"v1","addr":"10.20.193.157:6813","nonce":3711386099}]},"public_addr":"10.20.193.157:6809/3711386099","cluster_addr":"10.20.193.157:6811/3711386099","heartbeat_back_addr":"10.20.193.157:6815/3711386099","heartbeat_front_addr":"10.20.193.157:6813/3711386099","state":["exists","up"]},{"osd":11,"uuid":"7371d50f-36f9-477d-8d4d-853f481dd6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6802","nonce":3400543064},{"type":"v1","addr":"10.20.193.162:6803","nonce":3400543064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6804","nonce":3400543064},{"type":"v1","addr":"10.20.193.162:6805","nonce":3400543064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6810","nonce":3400543064},{"type":"v1","addr":"10.20.193.162:6811","nonce":3400543064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6807","nonce":3400543064},{"type":"v1","addr":"10.20.193.162:6809","nonce":3400543064}]},"public_addr":"10.20.193.162:6803/3400543064","cluster_addr":"10.20.193.162:6805/3400543064","heartbeat_back_addr":"10.20.193.162:6811/3400543064","heartbeat_front_addr":"10.20.193.162:6809/3400543064","state":["exists","up"]},{"osd":12,"uuid":"3cf4fded-49db-4d95-956b-77acc868a3ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6812","nonce":4012737431},{"type":"v1","addr":"10.20.193.49:6814","nonce":4012737431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6818","nonce":4012737431},{"type":"v1","addr":"10.20.193.49:6819","nonce":4012737431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6822","nonce":4012737431},{"type":"v1","addr":"10.20.193.49:6823","nonce":4012737431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6820","nonce":4012737431},{"type":"v1","addr":"10.20.193.49:6821","nonce":4012737431}]},"public_addr":"10.20.193.49:6814/4012737431","cluster_addr":"10.20.193.49:6819/4012737431","heartbeat_back_addr":"10.20.193.49:6823/4012737431","heartbeat_front_addr":"10.20.193.49:6821/4012737431","state":["exists","up"]},{"osd":13,"uuid":"7dc53473-594f-4cfb-8444-eab205e2e0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6824","nonce":409145483},{"type":"v1","addr":"10.20.193.97:6825","nonce":409145483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6826","nonce":409145483},{"type":"v1","addr":"10.20.193.97:6827","nonce":409145483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6830","nonce":409145483},{"type":"v1","addr":"10.20.193.97:6831","nonce":409145483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6828","nonce":409145483},{"type":"v1","addr":"10.20.193.97:6829","nonce":409145483}]},"public_addr":"10.20.193.97:6825/409145483","cluster_addr":"10.20.193.97:6827/409145483","heartbeat_back_addr":"10.20.193.97:6831/409145483","heartbeat_front_addr":"10.20.193.97:6829/409145483","state":["exists","up"]},{"osd":14,"uuid":"e8ab3e8f-29a8-4c79-bf86-d29543aac56a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6824","nonce":404726964},{"type":"v1","addr":"10.20.193.157:6825","nonce":404726964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6826","nonce":404726964},{"type":"v1","addr":"10.20.193.157:6827","nonce":404726964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6830","nonce":404726964},{"type":"v1","addr":"10.20.193.157:6831","nonce":404726964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6828","nonce":404726964},{"type":"v1","addr":"10.20.193.157:6829","nonce":404726964}]},"public_addr":"10.20.193.157:6825/404726964","cluster_addr":"10.20.193.157:6827/404726964","heartbeat_back_addr":"10.20.193.157:6831/404726964","heartbeat_front_addr":"10.20.193.157:6829/404726964","state":["exists","up"]},{"osd":15,"uuid":"300a4696-aa54-4b47-b9f3-87dec719bcfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6819","nonce":3057705174},{"type":"v1","addr":"10.20.193.162:6821","nonce":3057705174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6823","nonce":3057705174},{"type":"v1","addr":"10.20.193.162:6825","nonce":3057705174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6831","nonce":3057705174},{"type":"v1","addr":"10.20.193.162:6833","nonce":3057705174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6827","nonce":3057705174},{"type":"v1","addr":"10.20.193.162:6829","nonce":3057705174}]},"public_addr":"10.20.193.162:6821/3057705174","cluster_addr":"10.20.193.162:6825/3057705174","heartbeat_back_addr":"10.20.193.162:6833/3057705174","heartbeat_front_addr":"10.20.193.162:6829/3057705174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:18.201964+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:17.998817+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:18.526566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:18.016485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:17.449438+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:18.134204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:19.177012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:17.496419+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:17.321828+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:18.265266+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:19.587499+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:17.978701+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:18.041032+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:18.477125+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:19.577746+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:18.096729+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:10:34.957 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.955+0000 7ff653ff7640 10 librados: watch_flush enter 2026-02-17T11:10:34.957 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.955+0000 7ff653ff7640 10 librados: watch_flush exit 2026-02-17T11:10:34.957 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.955+0000 7ff653ff7640 20 client.4415.objecter shutdown clearing up homeless session... 2026-02-17T11:10:34.957 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.955+0000 7ff653ff7640 10 client.4415.objecter successfully canceled tick 2026-02-17T11:10:34.957 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.955+0000 7ff653ff7640 1 -- 10.20.193.49:0/3652817660 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ff61c079140 msgr2=0x7ff61c07b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:34.957 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.955+0000 7ff653ff7640 1 --2- 10.20.193.49:0/3652817660 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ff61c079140 0x7ff61c07b600 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff640007b60 tx=0x7ff640007ab0 comp rx=0 tx=0).stop 2026-02-17T11:10:34.957 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.955+0000 7ff653ff7640 10 monclient: shutdown 2026-02-17T11:10:34.957 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.955+0000 7ff653ff7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:34.957 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.955+0000 7ff653ff7640 1 -- 10.20.193.49:0/3652817660 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff64c0c48c0 msgr2=0x7ff64c0c2570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:34.957 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.955+0000 7ff653ff7640 1 --2- 10.20.193.49:0/3652817660 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff64c0c48c0 0x7ff64c0c2570 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff63c016e30 tx=0x7ff63c0047c0 comp rx=0 tx=0).stop 2026-02-17T11:10:34.957 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.955+0000 7ff653ff7640 1 -- 10.20.193.49:0/3652817660 shutdown_connections 2026-02-17T11:10:34.957 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.955+0000 7ff653ff7640 1 --2- 10.20.193.49:0/3652817660 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ff61c079140 0x7ff61c07b600 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:34.957 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.955+0000 7ff653ff7640 1 --2- 10.20.193.49:0/3652817660 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7ff64c0c7170 0x7ff64c06f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:34.957 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.955+0000 7ff653ff7640 1 --2- 10.20.193.49:0/3652817660 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ff64c0c4d10 0x7ff64c14d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:34.958 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.955+0000 7ff653ff7640 1 --2- 10.20.193.49:0/3652817660 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff64c0c48c0 0x7ff64c0c2570 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:34.958 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.955+0000 7ff653ff7640 1 -- 10.20.193.49:0/3652817660 >> 10.20.193.49:0/3652817660 conn(0x7ff64c0c9f40 msgr2=0x7ff64c0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:34.958 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.955+0000 7ff653ff7640 1 -- 10.20.193.49:0/3652817660 shutdown_connections 2026-02-17T11:10:34.958 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.955+0000 7ff653ff7640 1 -- 10.20.193.49:0/3652817660 wait complete. 2026-02-17T11:10:34.958 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:34.955+0000 7ff653ff7640 1 librados: shutdown 2026-02-17T11:10:34.966 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:10:34.966 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:10:34.966 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:10:34.967 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:10:34.967 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2026-02-17T11:10:34.967 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2026-02-17T11:10:34.967 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2026-02-17T11:10:34.967 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2026-02-17T11:10:34.968 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 flush_pg_stats 2026-02-17T11:10:34.968 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 flush_pg_stats 2026-02-17T11:10:34.968 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 flush_pg_stats 2026-02-17T11:10:34.968 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 flush_pg_stats 2026-02-17T11:10:34.968 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.12 flush_pg_stats 2026-02-17T11:10:34.969 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.13 flush_pg_stats 2026-02-17T11:10:34.969 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.14 flush_pg_stats 2026-02-17T11:10:34.969 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.15 flush_pg_stats 2026-02-17T11:10:35.050 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.048+0000 7fa5611e6640 10 monclient: get_monmap_and_config 2026-02-17T11:10:35.050 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.048+0000 7fa5611e6640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.050 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.048+0000 7fa5611e6640 10 monclient: monmap: 2026-02-17T11:10:35.050 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.050 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.050 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:35.049125+0000 2026-02-17T11:10:35.050 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:35.049125+0000 2026-02-17T11:10:35.050 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.050 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.050 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:35.050 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:35.050 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:35.050 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:35.050 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:35.050 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:35.050 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.051 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.048+0000 7feef21a0640 10 monclient: get_monmap_and_config 2026-02-17T11:10:35.051 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.048+0000 7feef21a0640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.051 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.048+0000 7feef21a0640 10 monclient: monmap: 2026-02-17T11:10:35.051 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.051 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.051 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:35.049286+0000 2026-02-17T11:10:35.051 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:35.049286+0000 2026-02-17T11:10:35.051 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.051 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.051 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:35.051 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:35.051 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:35.051 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:35.051 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:35.051 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:35.051 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.051 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.049+0000 7fa5611e6640 1 Processor -- start 2026-02-17T11:10:35.051 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.049+0000 7fa5611e6640 1 -- start start 2026-02-17T11:10:35.051 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.049+0000 7fa5611e6640 10 monclient: init 2026-02-17T11:10:35.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.049+0000 7feef21a0640 1 Processor -- start 2026-02-17T11:10:35.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.049+0000 7feef21a0640 1 -- start start 2026-02-17T11:10:35.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.049+0000 7feef21a0640 10 monclient: init 2026-02-17T11:10:35.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.049+0000 7fa5611e6640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.049+0000 7fa5611e6640 10 monclient: _add_conns ranks=[1,2,4,5,0,3] 2026-02-17T11:10:35.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.049+0000 7fa5611e6640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fa55c14e920 addr v1:10.20.193.97:6789/0 2026-02-17T11:10:35.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.049+0000 7fa5611e6640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fa55c15b290 addr v1:10.20.193.157:6789/0 2026-02-17T11:10:35.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.049+0000 7fa5611e6640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7fa55c14ed00 0x7fa55c0c9610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.049+0000 7fa5611e6640 10 monclient(hunting): picked mon.noname-b con 0x7fa55c14ed00 addr v2:10.20.193.97:3300/0 2026-02-17T11:10:35.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.049+0000 7fa5611e6640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa55c159f10 con 0x7fa55c14e920 2026-02-17T11:10:35.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.049+0000 7fa5611e6640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa55c15a1f0 con 0x7fa55c15b290 2026-02-17T11:10:35.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.049+0000 7fa5611e6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.049+0000 7fa5611e6640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7fa55c15a4d0 con 0x7fa55c14ed00 2026-02-17T11:10:35.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.049+0000 7fa5611e6640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.049+0000 7fa5611e6640 10 monclient(hunting): authenticate will time out at 1111.712796s 2026-02-17T11:10:35.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.050+0000 7feef21a0640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.050+0000 7feef21a0640 10 monclient: _add_conns ranks=[0,3,2,4,5,1] 2026-02-17T11:10:35.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.050+0000 7feef21a0640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7feeec0d1b60 addr v1:10.20.193.49:6789/0 2026-02-17T11:10:35.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.050+0000 7feef21a0640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7feeec0d1f40 0x7feeec15c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.050+0000 7feef21a0640 10 monclient(hunting): picked mon.noname-a con 0x7feeec0d1f40 addr v2:10.20.193.49:3300/0 2026-02-17T11:10:35.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.050+0000 7feef21a0640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7feeec15d950 addr v1:10.20.193.157:6789/0 2026-02-17T11:10:35.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.050+0000 7feef21a0640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feeec0c98e0 con 0x7feeec0d1b60 2026-02-17T11:10:35.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.050+0000 7fa55a575640 1 --1- >> v1:10.20.193.157:6789/0 conn(0x7fa55c15b290 0x7fa55c159640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.157:6789/0 says I am v1:10.20.193.49:43266/0 (socket says 10.20.193.49:43266) 2026-02-17T11:10:35.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.050+0000 7fa55a575640 1 -- 10.20.193.49:0/2260849902 learned_addr learned my addr 10.20.193.49:0/2260849902 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:10:35.054 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.050+0000 7feef21a0640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feeec0c9bc0 con 0x7feeec15d950 2026-02-17T11:10:35.054 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.050+0000 7feef21a0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.054 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.050+0000 7feef21a0640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7feeec15cd80 con 0x7feeec0d1f40 2026-02-17T11:10:35.054 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.050+0000 7feef21a0640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.054 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.050+0000 7feef21a0640 10 monclient(hunting): authenticate will time out at 1111.713364s 2026-02-17T11:10:35.054 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.050+0000 7fa55b577640 1 --2- 10.20.193.49:0/2260849902 >> v2:10.20.193.97:3300/0 conn(0x7fa55c14ed00 0x7fa55c0c9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.054 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.050+0000 7faed3e91640 10 monclient: get_monmap_and_config 2026-02-17T11:10:35.054 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.050+0000 7faed3e91640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.054 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.050+0000 7faed3e91640 10 monclient: monmap: 2026-02-17T11:10:35.054 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.054 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.054 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:35.051152+0000 2026-02-17T11:10:35.054 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:35.051152+0000 2026-02-17T11:10:35.054 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.054 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.054 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:35.054 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:35.055 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:35.055 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:35.055 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:35.055 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:35.055 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.050+0000 7fa55b577640 10 monclient(hunting): get_auth_request con 0x7fa55c14ed00 auth_method 0 2026-02-17T11:10:35.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.050+0000 7fa55b577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.050+0000 7fa55b577640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.050+0000 7fa55b577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.050+0000 7feeeaffd640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7feeec0d1f40 0x7feeec15c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.050+0000 7feeebfff640 1 --1- >> v1:10.20.193.157:6789/0 conn(0x7feeec15d950 0x7feeec15dd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.157:6789/0 says I am v1:10.20.193.49:43280/0 (socket says 10.20.193.49:43280) 2026-02-17T11:10:35.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.050+0000 7feeebfff640 1 -- 10.20.193.49:0/8822734 learned_addr learned my addr 10.20.193.49:0/8822734 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:10:35.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.051+0000 7fa55b577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.051+0000 7fa55b577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.051+0000 7fa55b577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.051+0000 7feeeaffd640 10 monclient(hunting): get_auth_request con 0x7feeec0d1f40 auth_method 0 2026-02-17T11:10:35.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.051+0000 7feeeaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.051+0000 7feeeaffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.051+0000 7feeeaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.051+0000 7faed3e91640 1 Processor -- start 2026-02-17T11:10:35.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.051+0000 7faed3e91640 1 -- start start 2026-02-17T11:10:35.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.051+0000 7faed3e91640 10 monclient: init 2026-02-17T11:10:35.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.051+0000 7feeeaffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.051+0000 7feeeaffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.051+0000 7feeeaffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.057 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.052+0000 7fe9d62fc640 10 monclient: get_monmap_and_config 2026-02-17T11:10:35.057 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.052+0000 7fe9d62fc640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.057 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.052+0000 7fe9d62fc640 10 monclient: monmap: 2026-02-17T11:10:35.057 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.057 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.057 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:35.052631+0000 2026-02-17T11:10:35.057 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:35.052631+0000 2026-02-17T11:10:35.057 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.057 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.057 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:35.057 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:35.057 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:35.057 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:35.057 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:35.057 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:35.057 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.058 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.052+0000 7faed3e91640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.058 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.052+0000 7faed3e91640 10 monclient: _add_conns ranks=[0,1,3,4,2,5] 2026-02-17T11:10:35.058 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.052+0000 7faed3e91640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7faecc0d1b60 addr v1:10.20.193.49:6789/0 2026-02-17T11:10:35.058 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.052+0000 7faed3e91640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7faecc0d1f40 addr v1:10.20.193.97:6789/0 2026-02-17T11:10:35.058 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.052+0000 7faed3e91640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7faecc160350 0x7faecc1607c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.058 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.052+0000 7faed3e91640 10 monclient(hunting): picked mon.noname-a con 0x7faecc160350 addr v2:10.20.193.49:3300/0 2026-02-17T11:10:35.058 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.052+0000 7faed3e91640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faecc160ed0 con 0x7faecc0d1b60 2026-02-17T11:10:35.058 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.052+0000 7faed3e91640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faecc0c8e00 con 0x7faecc0d1f40 2026-02-17T11:10:35.058 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.052+0000 7faed3e91640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.058 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.052+0000 7faed3e91640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7faecc0cc2e0 con 0x7faecc160350 2026-02-17T11:10:35.058 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.052+0000 7faed3e91640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.058 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.052+0000 7faed3e91640 10 monclient(hunting): authenticate will time out at 1111.715469s 2026-02-17T11:10:35.059 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.052+0000 7fe9d62fc640 1 Processor -- start 2026-02-17T11:10:35.059 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.052+0000 7fe9d62fc640 1 -- start start 2026-02-17T11:10:35.059 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.052+0000 7fe9d62fc640 10 monclient: init 2026-02-17T11:10:35.059 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.052+0000 7fa55b577640 10 monclient(hunting): handle_auth_done global_id 4405 payload 274 2026-02-17T11:10:35.059 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.052+0000 7fa55b577640 1 -- 10.20.193.49:0/2260849902 >> v1:10.20.193.157:6789/0 conn(0x7fa55c15b290 legacy=0x7fa55c159640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.059 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.052+0000 7fa55b577640 1 -- 10.20.193.49:0/2260849902 >> v1:10.20.193.97:6789/0 conn(0x7fa55c14e920 legacy=0x7fa55c1560c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.059 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.052+0000 7fa55b577640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.059 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.052+0000 7fa55b577640 1 monclient: found mon.noname-b 2026-02-17T11:10:35.059 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.052+0000 7fa55b577640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.059 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.052+0000 7fa55b577640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.059 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.052+0000 7fa55b577640 1 -- 10.20.193.49:0/2260849902 --> v2:10.20.193.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa55c15a7b0 con 0x7fa55c14ed00 2026-02-17T11:10:35.060 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.053+0000 7feeeaffd640 10 monclient(hunting): handle_auth_done global_id 4401 payload 274 2026-02-17T11:10:35.060 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.053+0000 7feeeaffd640 1 -- 10.20.193.49:0/8822734 >> v1:10.20.193.157:6789/0 conn(0x7feeec15d950 legacy=0x7feeec15dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.060 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.053+0000 7feeeaffd640 1 -- 10.20.193.49:0/8822734 >> v1:10.20.193.49:6789/0 conn(0x7feeec0d1b60 legacy=0x7feeec0c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.060 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.053+0000 7feeeaffd640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.060 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.053+0000 7f9945a8f640 10 monclient: get_monmap_and_config 2026-02-17T11:10:35.060 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.053+0000 7f9945a8f640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.060 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.053+0000 7feeeaffd640 1 monclient: found mon.noname-a 2026-02-17T11:10:35.060 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.053+0000 7feeeaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.060 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.053+0000 7feeeaffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:10:35.060 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.053+0000 7feeeaffd640 1 -- 10.20.193.49:0/8822734 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feeec0c9ea0 con 0x7feeec0d1f40 2026-02-17T11:10:35.060 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.053+0000 7f9945a8f640 10 monclient: monmap: 2026-02-17T11:10:35.060 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.060 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.061 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:35.053563+0000 2026-02-17T11:10:35.061 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:35.053563+0000 2026-02-17T11:10:35.061 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.061 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.061 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:35.061 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:35.061 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:35.061 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:35.061 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:35.061 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:35.061 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.061 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.053+0000 7f1052522640 10 monclient: get_monmap_and_config 2026-02-17T11:10:35.061 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.053+0000 7f1052522640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.061 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.053+0000 7f1052522640 10 monclient: monmap: 2026-02-17T11:10:35.061 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.061 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.061 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:35.053912+0000 2026-02-17T11:10:35.061 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:35.053912+0000 2026-02-17T11:10:35.061 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.061 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.061 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:35.061 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:35.061 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:35.062 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:35.062 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:35.062 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:35.062 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.062 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.053+0000 7fe9d62fc640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.062 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.053+0000 7fe9d62fc640 10 monclient: _add_conns ranks=[0,4,5,1,2,3] 2026-02-17T11:10:35.062 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.053+0000 7fe9d62fc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe9d00ce5d0 addr v1:10.20.193.49:6789/0 2026-02-17T11:10:35.062 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.053+0000 7fe9d62fc640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7fe9d015bf30 0x7fe9d00ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.062 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.053+0000 7fe9d62fc640 10 monclient(hunting): picked mon.noname-b con 0x7fe9d015bf30 addr v2:10.20.193.97:3300/0 2026-02-17T11:10:35.062 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.053+0000 7fe9d62fc640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7fe9d00ceef0 0x7fe9d00c9780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.062 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.053+0000 7fe9d62fc640 10 monclient(hunting): picked mon.noname-c con 0x7fe9d00ceef0 addr v2:10.20.193.157:3300/0 2026-02-17T11:10:35.062 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.053+0000 7fe9d62fc640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9d00d20d0 con 0x7fe9d00ce5d0 2026-02-17T11:10:35.062 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.053+0000 7fe9d62fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.062 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.053+0000 7fe9d62fc640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7fe9d00d23b0 con 0x7fe9d015bf30 2026-02-17T11:10:35.062 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.053+0000 7fe9d62fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.063 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.053+0000 7fe9d62fc640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7fe9d00d2690 con 0x7fe9d00ceef0 2026-02-17T11:10:35.063 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.053+0000 7fe9d62fc640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.063 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.053+0000 7fe9d62fc640 10 monclient(hunting): authenticate will time out at 1111.716709s 2026-02-17T11:10:35.063 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.053+0000 7f9945a8f640 1 Processor -- start 2026-02-17T11:10:35.063 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.053+0000 7f9945a8f640 1 -- start start 2026-02-17T11:10:35.063 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.053+0000 7f9945a8f640 10 monclient: init 2026-02-17T11:10:35.063 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.053+0000 7f1052522640 1 Processor -- start 2026-02-17T11:10:35.063 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.053+0000 7f1052522640 1 -- start start 2026-02-17T11:10:35.063 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.053+0000 7f1052522640 10 monclient: init 2026-02-17T11:10:35.063 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.054+0000 7faed1405640 1 --1- >> v1:10.20.193.97:6789/0 conn(0x7faecc0d1f40 0x7faecc0c9bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.97:6789/0 says I am v1:10.20.193.49:51576/0 (socket says 10.20.193.49:51576) 2026-02-17T11:10:35.063 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.054+0000 7faed1405640 1 -- 10.20.193.49:0/4074054069 learned_addr learned my addr 10.20.193.49:0/4074054069 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:10:35.064 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.054+0000 7f9945a8f640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.064 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.054+0000 7f9945a8f640 10 monclient: _add_conns ranks=[4,1,5,2,0,3] 2026-02-17T11:10:35.064 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.054+0000 7f9945a8f640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f99400ce5d0 0x7f99400d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.064 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.054+0000 7f9945a8f640 10 monclient(hunting): picked mon.noname-b con 0x7f99400ce5d0 addr v2:10.20.193.97:3300/0 2026-02-17T11:10:35.064 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.054+0000 7f9945a8f640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f994015bf30 addr v1:10.20.193.97:6789/0 2026-02-17T11:10:35.064 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.054+0000 7f9945a8f640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f99400c9780 0x7f99400c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.064 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.054+0000 7f9945a8f640 10 monclient(hunting): picked mon.noname-c con 0x7f99400c9780 addr v2:10.20.193.157:3300/0 2026-02-17T11:10:35.064 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.054+0000 7fe9d4872640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7fe9d00ceef0 0x7fe9d00c9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.064 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.054+0000 7f9945a8f640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99400d1e00 con 0x7f994015bf30 2026-02-17T11:10:35.064 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.054+0000 7f1052522640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.065 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.054+0000 7f9945a8f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.065 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.054+0000 7f9945a8f640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f99400d20d0 con 0x7f99400ce5d0 2026-02-17T11:10:35.065 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.054+0000 7f1052522640 10 monclient: _add_conns ranks=[0,2,5,4,3,1] 2026-02-17T11:10:35.065 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.054+0000 7f1052522640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f104c0d1b60 addr v1:10.20.193.49:6789/0 2026-02-17T11:10:35.065 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.054+0000 7f9945a8f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.065 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.054+0000 7f9945a8f640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f99400d23b0 con 0x7f99400c9780 2026-02-17T11:10:35.065 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.054+0000 7f1052522640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f104c0d1f40 addr v1:10.20.193.157:6789/0 2026-02-17T11:10:35.065 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.054+0000 7f9945a8f640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.066 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.054+0000 7f1052522640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f104c15e060 0x7f104c15c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.066 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.054+0000 7f9945a8f640 10 monclient(hunting): authenticate will time out at 1111.717701s 2026-02-17T11:10:35.066 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.054+0000 7fe9d4872640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7fe9d00ceef0 0x7fe9d00c9780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:55740/0 (socket says 10.20.193.49:55740) 2026-02-17T11:10:35.066 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.054+0000 7fe9d4872640 1 -- 10.20.193.49:0/3781674581 learned_addr learned my addr 10.20.193.49:0/3781674581 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:35.066 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.054+0000 7fe9d4872640 10 monclient(hunting): get_auth_request con 0x7fe9d00ceef0 auth_method 0 2026-02-17T11:10:35.066 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.054+0000 7fe9d4872640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.066 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.054+0000 7fe9d4872640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.066 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.054+0000 7fe9d4872640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.066 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.054+0000 7f1052522640 10 monclient(hunting): picked mon.noname-c con 0x7f104c15e060 addr v2:10.20.193.157:3300/0 2026-02-17T11:10:35.066 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.054+0000 7f1052522640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f104c0c98e0 con 0x7f104c0d1b60 2026-02-17T11:10:35.066 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.054+0000 7f1052522640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f104c0c9bc0 con 0x7f104c0d1f40 2026-02-17T11:10:35.066 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.054+0000 7f1052522640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.066 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.054+0000 7f1052522640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f104c15cd80 con 0x7f104c15e060 2026-02-17T11:10:35.067 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.054+0000 7f1052522640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.067 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.054+0000 7f1052522640 10 monclient(hunting): authenticate will time out at 1111.717837s 2026-02-17T11:10:35.067 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.055+0000 7fe9d4872640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.067 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.055+0000 7fe9d4872640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.067 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.055+0000 7fe9d4872640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.067 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.055+0000 7fe9cf7fe640 1 --2- 10.20.193.49:0/3781674581 >> v2:10.20.193.97:3300/0 conn(0x7fe9d015bf30 0x7fe9d00ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.067 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.055+0000 7f993ffff640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f99400c9780 0x7f99400c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.067 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.055+0000 7f993effd640 1 --1- >> v1:10.20.193.97:6789/0 conn(0x7f994015bf30 0x7f99400ce9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.97:6789/0 says I am v1:10.20.193.49:51584/0 (socket says 10.20.193.49:51584) 2026-02-17T11:10:35.067 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.055+0000 7f993effd640 1 -- 10.20.193.49:0/2782315169 learned_addr learned my addr 10.20.193.49:0/2782315169 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:10:35.067 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.055+0000 7feeeaffd640 1 --2- 10.20.193.49:0/8822734 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7feeec0d1f40 0x7feeec15c840 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7feedc0098a0 tx=0x7feedc02ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2434442135fc50d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.067 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.055+0000 7fe9cf7fe640 10 monclient(hunting): get_auth_request con 0x7fe9d015bf30 auth_method 0 2026-02-17T11:10:35.068 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.055+0000 7fe9cf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.068 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.055+0000 7fe9cf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.068 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.055+0000 7fe9cf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.068 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.056+0000 7fe9d4872640 10 monclient(hunting): handle_auth_done global_id 4424 payload 274 2026-02-17T11:10:35.068 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.056+0000 7fe9d4872640 1 -- 10.20.193.49:0/3781674581 >> v2:10.20.193.97:3300/0 conn(0x7fe9d015bf30 msgr2=0x7fe9d00ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:35.068 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.056+0000 7fe9d4872640 1 --2- 10.20.193.49:0/3781674581 >> v2:10.20.193.97:3300/0 conn(0x7fe9d015bf30 0x7fe9d00ce9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.068 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.056+0000 7fe9d4872640 1 -- 10.20.193.49:0/3781674581 >> v1:10.20.193.49:6789/0 conn(0x7fe9d00ce5d0 legacy=0x7fe9d00d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:35.068 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.056+0000 7fe9d4872640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.068 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.056+0000 7fe9d4872640 1 monclient: found mon.noname-c 2026-02-17T11:10:35.068 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.056+0000 7fe9d4872640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.068 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.056+0000 7fe9d4872640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:10:35.068 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.056+0000 7fe9d4872640 1 -- 10.20.193.49:0/3781674581 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9d00c8f80 con 0x7fe9d00ceef0 2026-02-17T11:10:35.068 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.056+0000 7f104b7fe640 1 --1- >> v1:10.20.193.157:6789/0 conn(0x7f104c0d1f40 0x7f104c15d950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.157:6789/0 says I am v1:10.20.193.49:43284/0 (socket says 10.20.193.49:43284) 2026-02-17T11:10:35.068 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.056+0000 7f104b7fe640 1 -- 10.20.193.49:0/608520235 learned_addr learned my addr 10.20.193.49:0/608520235 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:10:35.068 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.056+0000 7f6dd568f640 10 monclient: get_monmap_and_config 2026-02-17T11:10:35.068 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.056+0000 7f6dd568f640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.069 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.056+0000 7f6dd568f640 10 monclient: monmap: 2026-02-17T11:10:35.069 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.069 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.069 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:35.057104+0000 2026-02-17T11:10:35.069 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:35.057104+0000 2026-02-17T11:10:35.069 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.069 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.069 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:35.069 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:35.069 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:35.069 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:35.069 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:35.069 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:35.069 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.069 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.056+0000 7faed0c04640 1 -- 10.20.193.49:0/4074054069 <== mon.1 v1:10.20.193.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2826208046 0 0) 0x7faecc0c8e00 con 0x7faecc0d1f40 2026-02-17T11:10:35.069 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.056+0000 7faed0c04640 10 monclient(hunting): _negotiate 2026-02-17T11:10:35.069 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.056+0000 7faed0c04640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.069 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.056+0000 7faed0c04640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.069 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.056+0000 7faed0c04640 10 monclient(hunting): my global_id is 4411 2026-02-17T11:10:35.069 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.056+0000 7faed0c04640 1 -- 10.20.193.49:0/4074054069 --> v1:10.20.193.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faeb4003620 con 0x7faecc0d1f40 2026-02-17T11:10:35.070 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.056+0000 7f741c66c640 10 monclient: get_monmap_and_config 2026-02-17T11:10:35.070 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.056+0000 7f741c66c640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.070 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.056+0000 7f741c66c640 10 monclient: monmap: 2026-02-17T11:10:35.070 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.070 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.070 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:35.057373+0000 2026-02-17T11:10:35.070 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:35.057373+0000 2026-02-17T11:10:35.070 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.070 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.070 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:35.070 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:35.070 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:35.070 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:35.070 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:35.070 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:35.070 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.070 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.056+0000 7f3fae396640 10 monclient: get_monmap_and_config 2026-02-17T11:10:35.070 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.056+0000 7f3fae396640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.070 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.056+0000 7f3fae396640 10 monclient: monmap: 2026-02-17T11:10:35.070 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.070 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.070 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:35.057425+0000 2026-02-17T11:10:35.070 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:35.057425+0000 2026-02-17T11:10:35.071 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.071 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.071 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:35.071 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:35.071 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:35.071 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:35.071 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:35.071 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:35.071 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.071 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.057+0000 7f6dd568f640 1 Processor -- start 2026-02-17T11:10:35.071 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.057+0000 7f993ffff640 10 monclient(hunting): get_auth_request con 0x7f99400c9780 auth_method 0 2026-02-17T11:10:35.071 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.057+0000 7f993ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.071 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.057+0000 7f993ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.071 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.057+0000 7f993ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.071 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.057+0000 7f3fae396640 1 Processor -- start 2026-02-17T11:10:35.072 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.057+0000 7f6dd568f640 1 -- start start 2026-02-17T11:10:35.072 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.057+0000 7f6dd568f640 10 monclient: init 2026-02-17T11:10:35.072 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.057+0000 7f3fae396640 1 -- start start 2026-02-17T11:10:35.072 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.057+0000 7f3fae396640 10 monclient: init 2026-02-17T11:10:35.072 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.057+0000 7f741c66c640 1 Processor -- start 2026-02-17T11:10:35.072 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.057+0000 7f741c66c640 1 -- start start 2026-02-17T11:10:35.072 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.057+0000 7f741c66c640 10 monclient: init 2026-02-17T11:10:35.072 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.057+0000 7fe9d4872640 1 --2- 10.20.193.49:0/3781674581 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe9d00ceef0 0x7fe9d00c9780 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0075130 tx=0x7fe9c402f270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2a93c083ea8440 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.072 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.057+0000 7f741c66c640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.072 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.057+0000 7f6dd568f640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.073 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.057+0000 7f6dd568f640 10 monclient: _add_conns ranks=[1,4,3,5,0,2] 2026-02-17T11:10:35.073 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.057+0000 7f3fae396640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.073 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.057+0000 7f3fae396640 10 monclient: _add_conns ranks=[0,4,5,1,2,3] 2026-02-17T11:10:35.073 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.057+0000 7f3fae396640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f3fa8152700 addr v1:10.20.193.49:6789/0 2026-02-17T11:10:35.073 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.058+0000 7f3fae396640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f3fa815ef80 0x7f3fa80c9730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.073 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.058+0000 7f3fae396640 10 monclient(hunting): picked mon.noname-b con 0x7f3fa815ef80 addr v2:10.20.193.97:3300/0 2026-02-17T11:10:35.073 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.058+0000 7f6dd568f640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f6dd0152700 addr v1:10.20.193.97:6789/0 2026-02-17T11:10:35.073 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.058+0000 7f3fae396640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f3fa8152ae0 0x7f3fa80c9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.073 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.058+0000 7f6dd568f640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f6dd015ef80 0x7f6dd00c9730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.074 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.058+0000 7f3fae396640 10 monclient(hunting): picked mon.noname-c con 0x7f3fa8152ae0 addr v2:10.20.193.157:3300/0 2026-02-17T11:10:35.074 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.058+0000 7f3fae396640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fa815d4f0 con 0x7f3fa8152700 2026-02-17T11:10:35.074 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.058+0000 7f3fae396640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.074 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.058+0000 7f3fae396640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f3fa815d7d0 con 0x7f3fa815ef80 2026-02-17T11:10:35.074 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.058+0000 7f3fae396640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.074 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.058+0000 7f3fae396640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f3fa815dab0 con 0x7f3fa8152ae0 2026-02-17T11:10:35.074 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.058+0000 7f3fae396640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.074 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.058+0000 7f3fae396640 10 monclient(hunting): authenticate will time out at 1111.721063s 2026-02-17T11:10:35.074 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.058+0000 7f6dd568f640 10 monclient(hunting): picked mon.noname-b con 0x7f6dd015ef80 addr v2:10.20.193.97:3300/0 2026-02-17T11:10:35.074 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.058+0000 7f6dd568f640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f6dd0152ae0 0x7f6dd00c9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.074 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.058+0000 7f6dd568f640 10 monclient(hunting): picked mon.noname-a con 0x7f6dd0152ae0 addr v2:10.20.193.49:3300/0 2026-02-17T11:10:35.074 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.057+0000 7f741c66c640 10 monclient: _add_conns ranks=[2,3,5,1,0,4] 2026-02-17T11:10:35.074 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.057+0000 7f741c66c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f74140d1b60 addr v1:10.20.193.157:6789/0 2026-02-17T11:10:35.074 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.058+0000 7f741c66c640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f74140d1f40 0x7f74140c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.074 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.058+0000 7f741c66c640 10 monclient(hunting): picked mon.noname-a con 0x7f74140d1f40 addr v2:10.20.193.49:3300/0 2026-02-17T11:10:35.074 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.058+0000 7f741c66c640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f74140ca100 0x7f7414160350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.074 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.058+0000 7f741c66c640 10 monclient(hunting): picked mon.noname-c con 0x7f74140ca100 addr v2:10.20.193.157:3300/0 2026-02-17T11:10:35.074 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.058+0000 7f741c66c640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7414160ed0 con 0x7f74140d1b60 2026-02-17T11:10:35.075 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.058+0000 7f741c66c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.075 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.058+0000 7f741c66c640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f74140cc2e0 con 0x7f74140d1f40 2026-02-17T11:10:35.075 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.058+0000 7f741c66c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.075 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.058+0000 7f741c66c640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f74140c9730 con 0x7f74140ca100 2026-02-17T11:10:35.075 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.058+0000 7f741c66c640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.075 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.058+0000 7f741c66c640 10 monclient(hunting): authenticate will time out at 1111.721036s 2026-02-17T11:10:35.075 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.058+0000 7f6dd568f640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6dd015d4f0 con 0x7f6dd0152700 2026-02-17T11:10:35.075 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.058+0000 7f6dd568f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.075 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.058+0000 7f6dd568f640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f6dd015d7d0 con 0x7f6dd0152ae0 2026-02-17T11:10:35.075 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.058+0000 7f6dd568f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.075 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.058+0000 7f6dd568f640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f6dd015dab0 con 0x7f6dd015ef80 2026-02-17T11:10:35.075 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.058+0000 7f6dd568f640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.076 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.058+0000 7fecd52a7640 10 monclient: get_monmap_and_config 2026-02-17T11:10:35.076 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.058+0000 7fecd52a7640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.076 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.058+0000 7fecd52a7640 10 monclient: monmap: 2026-02-17T11:10:35.076 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.076 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.076 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:35.058655+0000 2026-02-17T11:10:35.076 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:35.058655+0000 2026-02-17T11:10:35.076 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.076 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.076 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:35.076 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:35.076 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:35.076 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:35.076 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:35.076 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:35.076 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.076 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.058+0000 7f6dd568f640 10 monclient(hunting): authenticate will time out at 1111.721190s 2026-02-17T11:10:35.076 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.058+0000 7fecd52a7640 1 Processor -- start 2026-02-17T11:10:35.077 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.058+0000 7fecd52a7640 1 -- start start 2026-02-17T11:10:35.077 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.058+0000 7fecd52a7640 10 monclient: init 2026-02-17T11:10:35.077 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.059+0000 7fa55b577640 1 --2- 10.20.193.49:0/2260849902 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fa55c14ed00 0x7fa55c0c9610 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa54c009d90 tx=0x7fa54c02f2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=352888dd9bc1a25a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.077 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.059+0000 7fecd52a7640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.077 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.059+0000 7fecd52a7640 10 monclient: _add_conns ranks=[3,0,2,4,1,5] 2026-02-17T11:10:35.077 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.059+0000 7fecd52a7640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fecd0152700 0x7fecd015e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.078 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.059+0000 7fecd52a7640 10 monclient(hunting): picked mon.noname-a con 0x7fecd0152700 addr v2:10.20.193.49:3300/0 2026-02-17T11:10:35.078 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.059+0000 7fecd52a7640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fecd0152ae0 addr v1:10.20.193.49:6789/0 2026-02-17T11:10:35.078 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.059+0000 7fecd52a7640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fecd015edb0 addr v1:10.20.193.157:6789/0 2026-02-17T11:10:35.078 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.059+0000 7fecd52a7640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecd015f1e0 con 0x7fecd0152ae0 2026-02-17T11:10:35.078 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.059+0000 7fecd52a7640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecd015d4f0 con 0x7fecd015edb0 2026-02-17T11:10:35.078 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.059+0000 7fecd52a7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.078 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.059+0000 7fecd52a7640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7fecd015d7d0 con 0x7fecd0152700 2026-02-17T11:10:35.078 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.059+0000 7fecd52a7640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.078 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.059+0000 7faed2407640 1 --2- 10.20.193.49:0/4074054069 >> v2:10.20.193.49:3300/0 conn(0x7faecc160350 0x7faecc1607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.078 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.059+0000 7fecd52a7640 10 monclient(hunting): authenticate will time out at 1111.722314s 2026-02-17T11:10:35.078 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.059+0000 7fc4eb2c4640 10 monclient: get_monmap_and_config 2026-02-17T11:10:35.078 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.059+0000 7fc4eb2c4640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.078 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.059+0000 7fc4eb2c4640 10 monclient: monmap: 2026-02-17T11:10:35.078 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.078 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.078 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:35.060038+0000 2026-02-17T11:10:35.078 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:35.060038+0000 2026-02-17T11:10:35.079 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.079 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.079 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:35.079 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:35.079 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:35.079 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:35.079 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:35.079 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:35.079 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.079 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.059+0000 7f104affd640 1 -- 10.20.193.49:0/608520235 <== mon.2 v1:10.20.193.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1078119994 0 0) 0x7f104c0c9bc0 con 0x7f104c0d1f40 2026-02-17T11:10:35.079 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.059+0000 7f104affd640 10 monclient(hunting): _negotiate 2026-02-17T11:10:35.079 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.059+0000 7f104affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.079 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.059+0000 7f104affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.079 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.059+0000 7f104affd640 10 monclient(hunting): my global_id is 4427 2026-02-17T11:10:35.079 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.059+0000 7f104affd640 1 -- 10.20.193.49:0/608520235 --> v1:10.20.193.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1030003620 con 0x7f104c0d1f40 2026-02-17T11:10:35.079 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.059+0000 7faed2407640 10 monclient(hunting): get_auth_request con 0x7faecc160350 auth_method 0 2026-02-17T11:10:35.079 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.059+0000 7faed2407640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.079 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.059+0000 7faed2407640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.079 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.059+0000 7faed2407640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.080 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.059+0000 7f993e7fc640 1 -- 10.20.193.49:0/2782315169 <== mon.1 v1:10.20.193.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3427804112 0 0) 0x7f99400d1e00 con 0x7f994015bf30 2026-02-17T11:10:35.080 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.059+0000 7f993e7fc640 10 monclient(hunting): _negotiate 2026-02-17T11:10:35.080 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.059+0000 7f993e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.080 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.059+0000 7f993e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.080 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.059+0000 7f993e7fc640 10 monclient(hunting): my global_id is 4417 2026-02-17T11:10:35.080 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.059+0000 7f993e7fc640 1 -- 10.20.193.49:0/2782315169 --> v1:10.20.193.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9924003620 con 0x7f994015bf30 2026-02-17T11:10:35.080 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.059+0000 7faed0c04640 1 -- 10.20.193.49:0/4074054069 <== mon.1 v1:10.20.193.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3411971627 0 0) 0x7faeb4003620 con 0x7faecc0d1f40 2026-02-17T11:10:35.080 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.059+0000 7faed0c04640 1 -- 10.20.193.49:0/4074054069 >> v2:10.20.193.49:3300/0 conn(0x7faecc160350 msgr2=0x7faecc1607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:35.080 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.059+0000 7faed0c04640 1 --2- 10.20.193.49:0/4074054069 >> v2:10.20.193.49:3300/0 conn(0x7faecc160350 0x7faecc1607c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.080 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.059+0000 7faed0c04640 1 -- 10.20.193.49:0/4074054069 >> v1:10.20.193.49:6789/0 conn(0x7faecc0d1b60 legacy=0x7faecc1642e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.080 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.059+0000 7faed0c04640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.081 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.059+0000 7faed0c04640 1 monclient: found mon.noname-b-legacy 2026-02-17T11:10:35.081 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.059+0000 7faed0c04640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.081 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.059+0000 7faed0c04640 10 monclient: _send_mon_message to mon.noname-b-legacy at v1:10.20.193.97:6789/0 2026-02-17T11:10:35.081 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.059+0000 7faed0c04640 1 -- 10.20.193.49:0/4074054069 --> v1:10.20.193.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faecc0c90e0 con 0x7faecc0d1f40 2026-02-17T11:10:35.081 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.059+0000 7faed0c04640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.081 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.059+0000 7faed0c04640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.081 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.059+0000 7faed0c04640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.081 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.059+0000 7faed3e91640 5 monclient: authenticate success, global_id 4411 2026-02-17T11:10:35.081 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.059+0000 7faed3e91640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:10:35.081 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.059+0000 7f84e1553640 10 monclient: get_monmap_and_config 2026-02-17T11:10:35.081 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.059+0000 7f84e1553640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.081 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.059+0000 7f84e1553640 10 monclient: monmap: 2026-02-17T11:10:35.081 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.081 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.081 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:35.060424+0000 2026-02-17T11:10:35.081 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:35.060424+0000 2026-02-17T11:10:35.081 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.081 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.081 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:35.081 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:35.082 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:35.082 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:35.082 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:35.082 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:35.082 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.059+0000 7faed0c04640 1 -- 10.20.193.49:0/4074054069 <== mon.1 v1:10.20.193.97:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2462710995 0 0) 0x7faec0002f00 con 0x7faecc0d1f40 2026-02-17T11:10:35.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.059+0000 7faed0c04640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7faed0c04640 10 monclient: got monmap 1 from mon.noname-b-legacy (according to old e1) 2026-02-17T11:10:35.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7faed0c04640 10 monclient: dump: 2026-02-17T11:10:35.082 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.082 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.082 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.083 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.083 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.083 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.083 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.083 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.083 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.083 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7faed0c04640 1 monclient: mon.b has (v2) addrs [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] but i'm connected to v1:10.20.193.97:6789/0, reconnecting 2026-02-17T11:10:35.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7faed0c04640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7faed0c04640 1 -- 10.20.193.49:0/4074054069 >> v1:10.20.193.97:6789/0 conn(0x7faecc0d1f40 legacy=0x7faecc0c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7faed0c04640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:10:35.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7faed0c04640 1 --2- 10.20.193.49:0/4074054069 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7faeb4003ba0 0x7faeb4003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7faed0c04640 10 monclient(hunting): picked mon.a con 0x7faeb4003ba0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:35.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7faed0c04640 1 --2- 10.20.193.49:0/4074054069 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7faeb4004900 0x7faeb4004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7faed0c04640 10 monclient(hunting): picked mon.b con 0x7faeb4004900 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:35.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7faed0c04640 1 --2- 10.20.193.49:0/4074054069 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7faeb40054c0 0x7faeb400bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7faed0c04640 10 monclient(hunting): picked mon.c con 0x7faeb40054c0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:35.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7faed0c04640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7faed0c04640 1 -- 10.20.193.49:0/4074054069 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7faeb400c370 con 0x7faeb4003ba0 2026-02-17T11:10:35.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7faed0c04640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7faed0c04640 1 -- 10.20.193.49:0/4074054069 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7faeb400c520 con 0x7faeb4004900 2026-02-17T11:10:35.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7faed0c04640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7faed0c04640 1 -- 10.20.193.49:0/4074054069 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7faeb400c720 con 0x7faeb40054c0 2026-02-17T11:10:35.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7faed0c04640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7faed0c04640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:10:35.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7faed3e91640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2026-02-17T11:10:35.084 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7fc4eb2c4640 1 Processor -- start 2026-02-17T11:10:35.084 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7feeea7fc640 1 -- 10.20.193.49:0/8822734 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feedc03c070 con 0x7feeec0d1f40 2026-02-17T11:10:35.084 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7feeea7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.084 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7feeea7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:10:35.084 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7feeea7fc640 10 monclient: dump: 2026-02-17T11:10:35.084 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.084 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.084 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.084 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.084 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.084 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.084 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.084 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.084 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.084 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.084 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7fc4eb2c4640 1 -- start start 2026-02-17T11:10:35.085 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7fc4eb2c4640 10 monclient: init 2026-02-17T11:10:35.085 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7feeea7fc640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.085 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7feeea7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.085 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7feeea7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.085 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7feeea7fc640 1 -- 10.20.193.49:0/8822734 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feedc02fb70 con 0x7feeec0d1f40 2026-02-17T11:10:35.085 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7feeea7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.085 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7feeea7fc640 1 -- 10.20.193.49:0/8822734 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feedc037440 con 0x7feeec0d1f40 2026-02-17T11:10:35.085 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7feef21a0640 5 monclient: authenticate success, global_id 4401 2026-02-17T11:10:35.085 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7feef21a0640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:35.085 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7feef21a0640 4 set_mon_vals no callback set 2026-02-17T11:10:35.085 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7feeea7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.085 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7feeea7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:10:35.085 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7feeea7fc640 10 monclient: dump: 2026-02-17T11:10:35.085 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.085 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.085 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.085 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.085 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.085 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.085 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.086 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.086 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.086 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.086 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7f741abe2640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f74140ca100 0x7f7414160350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.086 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7f84e1553640 1 Processor -- start 2026-02-17T11:10:35.086 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7f84e1553640 1 -- start start 2026-02-17T11:10:35.086 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7f84e1553640 10 monclient: init 2026-02-17T11:10:35.086 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7fc4eb2c4640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.086 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7fc4eb2c4640 10 monclient: _add_conns ranks=[2,4,1,3,5,0] 2026-02-17T11:10:35.086 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7fc4eb2c4640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fc4e40d1b60 addr v1:10.20.193.157:6789/0 2026-02-17T11:10:35.086 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7fc4eb2c4640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7fc4e40d1f40 0x7fc4e415c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.086 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7fc4eb2c4640 10 monclient(hunting): picked mon.noname-b con 0x7fc4e40d1f40 addr v2:10.20.193.97:3300/0 2026-02-17T11:10:35.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7feef21a0640 10 monclient: shutdown 2026-02-17T11:10:35.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7feef21a0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:35.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7feef21a0640 1 -- 10.20.193.49:0/8822734 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7feeec0d1f40 msgr2=0x7feeec15c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7feef21a0640 1 --2- 10.20.193.49:0/8822734 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7feeec0d1f40 0x7feeec15c840 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7feedc0098a0 tx=0x7feedc02ee60 comp rx=0 tx=0).stop 2026-02-17T11:10:35.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7feef21a0640 1 -- 10.20.193.49:0/8822734 shutdown_connections 2026-02-17T11:10:35.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7feef21a0640 1 --2- 10.20.193.49:0/8822734 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7feeec0d1f40 0x7feeec15c840 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7fe9ceffd640 1 -- 10.20.193.49:0/3781674581 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c402fcd0 con 0x7fe9d00ceef0 2026-02-17T11:10:35.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7fe9ceffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7fe9ceffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:10:35.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7fe9ceffd640 10 monclient: dump: 2026-02-17T11:10:35.087 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.087 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.087 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.087 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.087 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.087 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.087 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.087 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.087 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.087 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7fe9ceffd640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7fe9ceffd640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7fe9ceffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7fe9ceffd640 1 -- 10.20.193.49:0/3781674581 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9c40373f0 con 0x7fe9d00ceef0 2026-02-17T11:10:35.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7fe9ceffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7fe9ceffd640 1 -- 10.20.193.49:0/3781674581 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c40377c0 con 0x7fe9d00ceef0 2026-02-17T11:10:35.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7fe9ceffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7fe9ceffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:10:35.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7fe9ceffd640 10 monclient: dump: 2026-02-17T11:10:35.088 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.088 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.088 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.088 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.088 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.088 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.088 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.088 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.088 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.088 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7fe9d62fc640 5 monclient: authenticate success, global_id 4424 2026-02-17T11:10:35.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7fe9d62fc640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:35.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7fe9d62fc640 4 set_mon_vals no callback set 2026-02-17T11:10:35.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7fc4eb2c4640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fc4e415d950 addr v1:10.20.193.97:6789/0 2026-02-17T11:10:35.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7fc4eb2c4640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4e40c98e0 con 0x7fc4e415d950 2026-02-17T11:10:35.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7fc4eb2c4640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4e40c9bc0 con 0x7fc4e40d1b60 2026-02-17T11:10:35.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7fc4eb2c4640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7feef21a0640 1 -- 10.20.193.49:0/8822734 >> 10.20.193.49:0/8822734 conn(0x7feeec06d9b0 msgr2=0x7feeec06ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:35.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7fc4eb2c4640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7fc4e415cd80 con 0x7fc4e40d1f40 2026-02-17T11:10:35.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7fc4eb2c4640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7fc4eb2c4640 10 monclient(hunting): authenticate will time out at 1111.723740s 2026-02-17T11:10:35.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7feef21a0640 1 -- 10.20.193.49:0/8822734 shutdown_connections 2026-02-17T11:10:35.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.060+0000 7feef21a0640 1 -- 10.20.193.49:0/8822734 wait complete. 2026-02-17T11:10:35.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.061+0000 7f84e1553640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.061+0000 7f84e1553640 10 monclient: _add_conns ranks=[4,1,3,5,0,2] 2026-02-17T11:10:35.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.061+0000 7fe9d62fc640 10 monclient: shutdown 2026-02-17T11:10:35.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.061+0000 7fe9d62fc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:35.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.061+0000 7fe9d62fc640 1 -- 10.20.193.49:0/3781674581 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe9d00ceef0 msgr2=0x7fe9d00c9780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.061+0000 7fe9d62fc640 1 --2- 10.20.193.49:0/3781674581 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe9d00ceef0 0x7fe9d00c9780 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0075130 tx=0x7fe9c402f270 comp rx=0 tx=0).stop 2026-02-17T11:10:35.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.061+0000 7f84e1553640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f84dc153be0 0x7f84dc0cb930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.061+0000 7f84e1553640 10 monclient(hunting): picked mon.noname-b con 0x7f84dc153be0 addr v2:10.20.193.97:3300/0 2026-02-17T11:10:35.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.061+0000 7f84e1553640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f84dc15b0c0 addr v1:10.20.193.97:6789/0 2026-02-17T11:10:35.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.061+0000 7f84e1553640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f84dc153fc0 0x7f84dc0c6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.061+0000 7f84e1553640 10 monclient(hunting): picked mon.noname-a con 0x7f84dc153fc0 addr v2:10.20.193.49:3300/0 2026-02-17T11:10:35.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.061+0000 7f84e1553640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84dc0ca5b0 con 0x7f84dc15b0c0 2026-02-17T11:10:35.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.061+0000 7f84e1553640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.061+0000 7f84e1553640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f84dc0cbe70 con 0x7f84dc153fc0 2026-02-17T11:10:35.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.061+0000 7f84e1553640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.061+0000 7f84e1553640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f84dc0ca890 con 0x7f84dc153be0 2026-02-17T11:10:35.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.061+0000 7f84e1553640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.061+0000 7f84e1553640 10 monclient(hunting): authenticate will time out at 1111.724160s 2026-02-17T11:10:35.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.061+0000 7fe9d62fc640 1 -- 10.20.193.49:0/3781674581 shutdown_connections 2026-02-17T11:10:35.091 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.061+0000 7fe9d62fc640 1 --2- 10.20.193.49:0/3781674581 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe9d00ceef0 0x7fe9d00c9780 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.091 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.061+0000 7fe9d62fc640 1 --2- 10.20.193.49:0/3781674581 >> v2:10.20.193.97:3300/0 conn(0x7fe9d015bf30 0x7fe9d00ce9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.091 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.061+0000 7fe9d62fc640 1 -- 10.20.193.49:0/3781674581 >> 10.20.193.49:0/3781674581 conn(0x7fe9d0073030 msgr2=0x7fe9d0073440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:35.091 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.061+0000 7fe9d62fc640 1 -- 10.20.193.49:0/3781674581 shutdown_connections 2026-02-17T11:10:35.091 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.061+0000 7fe9d62fc640 1 -- 10.20.193.49:0/3781674581 wait complete. 2026-02-17T11:10:35.091 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.061+0000 7feef21a0640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.091 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.061+0000 7feef21a0640 10 monclient: monmap: 2026-02-17T11:10:35.091 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.091 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:35.091 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:35.091 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:35.091 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.091 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.091 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:35.091 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:35.091 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:35.091 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.091 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.061+0000 7f3fa7fff640 1 --1- >> v1:10.20.193.49:6789/0 conn(0x7f3fa8152700 0x7f3fa815e870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.49:6789/0 says I am v1:10.20.193.49:50454/0 (socket says 10.20.193.49:50454) 2026-02-17T11:10:35.091 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.061+0000 7f3fa7fff640 1 -- 10.20.193.49:0/3105715253 learned_addr learned my addr 10.20.193.49:0/3105715253 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:10:35.092 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.061+0000 7feef21a0640 1 librados: starting msgr at 2026-02-17T11:10:35.092 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.061+0000 7feef21a0640 1 librados: starting objecter 2026-02-17T11:10:35.092 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.061+0000 7feef21a0640 1 Processor -- start 2026-02-17T11:10:35.092 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.061+0000 7f1050a98640 1 --2- 10.20.193.49:0/608520235 >> v2:10.20.193.157:3300/0 conn(0x7f104c15e060 0x7f104c15c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.092 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.061+0000 7f741abe2640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f74140ca100 0x7f7414160350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:55766/0 (socket says 10.20.193.49:55766) 2026-02-17T11:10:35.092 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.061+0000 7f741abe2640 1 -- 10.20.193.49:0/2733154319 learned_addr learned my addr 10.20.193.49:0/2733154319 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:35.092 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.061+0000 7f741abe2640 10 monclient(hunting): get_auth_request con 0x7f74140ca100 auth_method 0 2026-02-17T11:10:35.092 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.061+0000 7f741abe2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.092 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.061+0000 7f741abe2640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.092 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.061+0000 7f741abe2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.092 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.061+0000 7f435212c640 10 monclient: get_monmap_and_config 2026-02-17T11:10:35.092 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.061+0000 7f435212c640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.092 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.061+0000 7f435212c640 10 monclient: monmap: 2026-02-17T11:10:35.093 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.093 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.093 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:35.062319+0000 2026-02-17T11:10:35.093 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:35.062319+0000 2026-02-17T11:10:35.093 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.093 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.093 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:35.093 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:35.093 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:35.093 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:35.093 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:35.093 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:35.093 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.093 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.061+0000 7feef21a0640 1 -- start start 2026-02-17T11:10:35.093 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.061+0000 7feef21a0640 1 librados: setting wanted keys 2026-02-17T11:10:35.093 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.061+0000 7feef21a0640 1 librados: calling monclient init 2026-02-17T11:10:35.093 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.061+0000 7feef21a0640 10 monclient: init 2026-02-17T11:10:35.093 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.061+0000 7fe9d62fc640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.094 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.061+0000 7fe9d62fc640 10 monclient: monmap: 2026-02-17T11:10:35.094 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.094 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:35.094 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:35.094 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:35.094 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.094 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.094 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:35.094 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:35.094 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:35.094 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.094 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.062+0000 7fe9d62fc640 1 librados: starting msgr at 2026-02-17T11:10:35.094 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.062+0000 7fe9d62fc640 1 librados: starting objecter 2026-02-17T11:10:35.094 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.062+0000 7feef21a0640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.094 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.062+0000 7feef21a0640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:10:35.094 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.062+0000 7feef21a0640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7feeec0d1b60 0x7feeec1e99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.094 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.062+0000 7feef21a0640 10 monclient(hunting): picked mon.noname-b con 0x7feeec0d1b60 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:35.094 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.062+0000 7fe9d62fc640 1 Processor -- start 2026-02-17T11:10:35.095 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.062+0000 7feef21a0640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7feeec0d1f40 0x7feeec1f52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.095 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.062+0000 7feef21a0640 10 monclient(hunting): picked mon.noname-c con 0x7feeec0d1f40 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:35.095 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.062+0000 7feef21a0640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7feeec15d950 0x7feeec1f5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.095 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.062+0000 7feef21a0640 10 monclient(hunting): picked mon.noname-a con 0x7feeec15d950 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:35.095 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.062+0000 7feef21a0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.095 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.062+0000 7feef21a0640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7feeec15d4c0 con 0x7feeec15d950 2026-02-17T11:10:35.095 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.062+0000 7feef21a0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.095 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.062+0000 7feef21a0640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7feeec0ca460 con 0x7feeec0d1b60 2026-02-17T11:10:35.095 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.062+0000 7feef21a0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.095 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.062+0000 7feef21a0640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7feeec06e7b0 con 0x7feeec0d1f40 2026-02-17T11:10:35.095 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.062+0000 7feef21a0640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.095 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.062+0000 7feef21a0640 10 monclient(hunting): authenticate will time out at 1111.725245s 2026-02-17T11:10:35.095 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.062+0000 7fe9d62fc640 1 -- start start 2026-02-17T11:10:35.095 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.062+0000 7fe9d62fc640 1 librados: setting wanted keys 2026-02-17T11:10:35.095 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.062+0000 7fe9d62fc640 1 librados: calling monclient init 2026-02-17T11:10:35.095 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.062+0000 7fe9d62fc640 10 monclient: init 2026-02-17T11:10:35.096 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.062+0000 7f993ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.096 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.062+0000 7f993ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.096 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.062+0000 7f435212c640 1 Processor -- start 2026-02-17T11:10:35.096 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.062+0000 7f993ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.096 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.062+0000 7f435212c640 1 -- start start 2026-02-17T11:10:35.096 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.062+0000 7f435212c640 10 monclient: init 2026-02-17T11:10:35.096 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.062+0000 7f1050a98640 10 monclient(hunting): get_auth_request con 0x7f104c15e060 auth_method 0 2026-02-17T11:10:35.096 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.062+0000 7f1050a98640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.096 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.062+0000 7f1050a98640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.096 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.062+0000 7f1050a98640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.096 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.062+0000 7f741abe2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.062+0000 7f741abe2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.062+0000 7f741abe2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.062+0000 7fe9d62fc640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.062+0000 7fe9d62fc640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:10:35.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.062+0000 7fe9d62fc640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe9d00ce5d0 0x7fe9d01f3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.062+0000 7fe9d62fc640 10 monclient(hunting): picked mon.noname-c con 0x7fe9d00ce5d0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:35.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.062+0000 7fe9d62fc640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe9d00ceef0 0x7fe9d01f60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.062+0000 7fe9d62fc640 10 monclient(hunting): picked mon.noname-a con 0x7fe9d00ceef0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:35.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.062+0000 7fe9d62fc640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe9d015bf30 0x7fe9d015fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.062+0000 7fe9d62fc640 10 monclient(hunting): picked mon.noname-b con 0x7fe9d015bf30 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:35.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.062+0000 7fe9d62fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.062+0000 7fe9d62fc640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe9d00cbc30 con 0x7fe9d00ceef0 2026-02-17T11:10:35.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.062+0000 7fe9d62fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.062+0000 7fe9d62fc640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe9d00c9cc0 con 0x7fe9d015bf30 2026-02-17T11:10:35.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.062+0000 7fe9d62fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.062+0000 7fe9d62fc640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe9d015f680 con 0x7fe9d00ce5d0 2026-02-17T11:10:35.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.062+0000 7fe9d62fc640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.062+0000 7fe9d62fc640 10 monclient(hunting): authenticate will time out at 1111.725880s 2026-02-17T11:10:35.098 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f435212c640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.098 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f435212c640 10 monclient: _add_conns ranks=[5,0,3,4,2,1] 2026-02-17T11:10:35.098 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f435212c640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f434c0d1b60 0x7f434c0d1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.098 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f435212c640 10 monclient(hunting): picked mon.noname-c con 0x7f434c0d1b60 addr v2:10.20.193.157:3300/0 2026-02-17T11:10:35.098 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f435212c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f434c15c840 addr v1:10.20.193.49:6789/0 2026-02-17T11:10:35.098 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f435212c640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f434c15d950 0x7f434c15dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.098 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f435212c640 10 monclient(hunting): picked mon.noname-a con 0x7f434c15d950 addr v2:10.20.193.49:3300/0 2026-02-17T11:10:35.098 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f435212c640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f434c15e2d0 con 0x7f434c15c840 2026-02-17T11:10:35.098 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f435212c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.098 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f435212c640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f434c0ca460 con 0x7f434c15d950 2026-02-17T11:10:35.098 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f435212c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.098 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f435212c640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f434c15d4c0 con 0x7f434c0d1b60 2026-02-17T11:10:35.098 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f435212c640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.098 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f435212c640 10 monclient(hunting): authenticate will time out at 1111.726113s 2026-02-17T11:10:35.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f993e7fc640 1 -- 10.20.193.49:0/2782315169 <== mon.1 v1:10.20.193.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1091830551 0 0) 0x7f9924003620 con 0x7f994015bf30 2026-02-17T11:10:35.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f993e7fc640 1 -- 10.20.193.49:0/2782315169 >> v2:10.20.193.157:3300/0 conn(0x7f99400c9780 msgr2=0x7f99400c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:35.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f993e7fc640 1 --2- 10.20.193.49:0/2782315169 >> v2:10.20.193.157:3300/0 conn(0x7f99400c9780 0x7f99400c9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f993e7fc640 1 -- 10.20.193.49:0/2782315169 >> v2:10.20.193.97:3300/0 conn(0x7f99400ce5d0 msgr2=0x7f99400d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:35.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f993e7fc640 1 --2- 10.20.193.49:0/2782315169 >> v2:10.20.193.97:3300/0 conn(0x7f99400ce5d0 0x7f99400d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f993e7fc640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f993e7fc640 1 monclient: found mon.noname-b-legacy 2026-02-17T11:10:35.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f993e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f993e7fc640 10 monclient: _send_mon_message to mon.noname-b-legacy at v1:10.20.193.97:6789/0 2026-02-17T11:10:35.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f993e7fc640 1 -- 10.20.193.49:0/2782315169 --> v1:10.20.193.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99400d2690 con 0x7f994015bf30 2026-02-17T11:10:35.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f993e7fc640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f993e7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f993e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f993e7fc640 1 -- 10.20.193.49:0/2782315169 <== mon.1 v1:10.20.193.97:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2462710995 0 0) 0x7f9930002f00 con 0x7f994015bf30 2026-02-17T11:10:35.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f993e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f993e7fc640 10 monclient: got monmap 1 from mon.noname-b-legacy (according to old e1) 2026-02-17T11:10:35.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f993e7fc640 10 monclient: dump: 2026-02-17T11:10:35.100 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.100 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.100 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.100 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.100 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.100 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.100 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.100 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.100 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.100 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f993e7fc640 1 monclient: mon.b has (v2) addrs [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] but i'm connected to v1:10.20.193.97:6789/0, reconnecting 2026-02-17T11:10:35.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f993e7fc640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f993e7fc640 1 -- 10.20.193.49:0/2782315169 >> v1:10.20.193.97:6789/0 conn(0x7f994015bf30 legacy=0x7f99400ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f993e7fc640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:10:35.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f993e7fc640 1 --2- 10.20.193.49:0/2782315169 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f9924003bf0 0x7f9924004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f993e7fc640 10 monclient(hunting): picked mon.a con 0x7f9924003bf0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:35.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f993e7fc640 1 --2- 10.20.193.49:0/2782315169 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f9924004900 0x7f9924004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f993e7fc640 10 monclient(hunting): picked mon.b con 0x7f9924004900 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:35.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f993e7fc640 1 --2- 10.20.193.49:0/2782315169 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f99240054c0 0x7f992400bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f993e7fc640 10 monclient(hunting): picked mon.c con 0x7f99240054c0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:35.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f993e7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f993e7fc640 1 -- 10.20.193.49:0/2782315169 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f99400d20d0 con 0x7f9924003bf0 2026-02-17T11:10:35.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f993e7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f993e7fc640 1 -- 10.20.193.49:0/2782315169 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f99400d23b0 con 0x7f9924004900 2026-02-17T11:10:35.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f993e7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f993e7fc640 1 -- 10.20.193.49:0/2782315169 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f992400c3b0 con 0x7f99240054c0 2026-02-17T11:10:35.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f993e7fc640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f993e7fc640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:10:35.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f104affd640 1 -- 10.20.193.49:0/608520235 <== mon.0 v1:10.20.193.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2867132915 0 0) 0x7f104c0c98e0 con 0x7f104c0d1b60 2026-02-17T11:10:35.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f104affd640 10 monclient(hunting): _negotiate 2026-02-17T11:10:35.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f104affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f104affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f104affd640 10 monclient(hunting): my global_id is 4413 2026-02-17T11:10:35.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f104affd640 1 -- 10.20.193.49:0/608520235 --> v1:10.20.193.49:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f104c0c9bc0 con 0x7f104c0d1b60 2026-02-17T11:10:35.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f3fa77fe640 1 --2- 10.20.193.49:0/3105715253 >> v2:10.20.193.97:3300/0 conn(0x7f3fa815ef80 0x7f3fa80c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f1050a98640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f1050a98640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.063+0000 7f1050a98640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.064+0000 7faed1405640 1 --2- 10.20.193.49:0/4074054069 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7faeb4004900 0x7faeb4004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.064+0000 7f741abe2640 10 monclient(hunting): handle_auth_done global_id 4433 payload 274 2026-02-17T11:10:35.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.064+0000 7f741abe2640 1 -- 10.20.193.49:0/2733154319 >> v2:10.20.193.49:3300/0 conn(0x7f74140d1f40 msgr2=0x7f74140c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:35.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.064+0000 7f741abe2640 1 --2- 10.20.193.49:0/2733154319 >> v2:10.20.193.49:3300/0 conn(0x7f74140d1f40 0x7f74140c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.064+0000 7f3fa77fe640 10 monclient(hunting): get_auth_request con 0x7f3fa815ef80 auth_method 0 2026-02-17T11:10:35.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.064+0000 7f3fa77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.064+0000 7f3fa77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.064+0000 7f3fa77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.064+0000 7f741abe2640 1 -- 10.20.193.49:0/2733154319 >> v1:10.20.193.157:6789/0 conn(0x7f74140d1b60 legacy=0x7f74141642e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:35.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.064+0000 7f741abe2640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.064+0000 7f741abe2640 1 monclient: found mon.noname-c 2026-02-17T11:10:35.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.064+0000 7f741abe2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.064+0000 7f741abe2640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:10:35.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.064+0000 7f741abe2640 1 -- 10.20.193.49:0/2733154319 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74140c8e00 con 0x7f74140ca100 2026-02-17T11:10:35.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.064+0000 7fc84b664640 10 monclient: get_monmap_and_config 2026-02-17T11:10:35.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.064+0000 7fc84b664640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.064+0000 7fc84b664640 10 monclient: monmap: 2026-02-17T11:10:35.103 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.103 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.103 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:35.065243+0000 2026-02-17T11:10:35.103 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:35.065243+0000 2026-02-17T11:10:35.103 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.103 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.103 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:35.103 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:35.103 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:35.103 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:35.103 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:35.103 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:35.103 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.065+0000 7fc84b664640 1 Processor -- start 2026-02-17T11:10:35.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.065+0000 7fc84b664640 1 -- start start 2026-02-17T11:10:35.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.065+0000 7fc84b664640 10 monclient: init 2026-02-17T11:10:35.104 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.065+0000 7faed1405640 10 monclient(hunting): get_auth_request con 0x7faeb4004900 auth_method 0 2026-02-17T11:10:35.104 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.065+0000 7faed1405640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.104 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.065+0000 7faed1405640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.104 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.065+0000 7faed1405640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:10:35.104 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.065+0000 7f3fa77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.104 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.065+0000 7f3fa77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.104 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.065+0000 7f3fa77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.104 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.065+0000 7fc84b664640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.104 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.065+0000 7fc84b664640 10 monclient: _add_conns ranks=[4,1,2,0,5,3] 2026-02-17T11:10:35.104 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.065+0000 7fc84b664640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7fc8440d1b60 0x7fc8440d1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.104 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.065+0000 7fc84b664640 10 monclient(hunting): picked mon.noname-b con 0x7fc8440d1b60 addr v2:10.20.193.97:3300/0 2026-02-17T11:10:35.104 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.065+0000 7fc84b664640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fc84415c840 addr v1:10.20.193.97:6789/0 2026-02-17T11:10:35.105 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.065+0000 7f6dcf7fe640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f6dd0152ae0 0x7f6dd00c9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.105 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.065+0000 7fc84b664640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fc84415d950 addr v1:10.20.193.157:6789/0 2026-02-17T11:10:35.105 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.065+0000 7fc84b664640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8440c98e0 con 0x7fc84415c840 2026-02-17T11:10:35.105 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.066+0000 7fc84b664640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8440c9bc0 con 0x7fc84415d950 2026-02-17T11:10:35.105 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.066+0000 7fc84b664640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.105 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.066+0000 7fc84b664640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7fc8440ca460 con 0x7fc8440d1b60 2026-02-17T11:10:35.105 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.066+0000 7fc84b664640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.105 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.066+0000 7fc84b664640 10 monclient(hunting): authenticate will time out at 1111.729023s 2026-02-17T11:10:35.105 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.066+0000 7f3fac90c640 1 --2- 10.20.193.49:0/3105715253 >> v2:10.20.193.157:3300/0 conn(0x7f3fa8152ae0 0x7f3fa80c9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.105 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.066+0000 7f1050a98640 10 monclient(hunting): handle_auth_done global_id 4436 payload 274 2026-02-17T11:10:35.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.066+0000 7f1050a98640 1 -- 10.20.193.49:0/608520235 >> v1:10.20.193.157:6789/0 conn(0x7f104c0d1f40 legacy=0x7f104c15d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.066+0000 7f1050a98640 1 -- 10.20.193.49:0/608520235 >> v1:10.20.193.49:6789/0 conn(0x7f104c0d1b60 legacy=0x7f104c0c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.066+0000 7f1050a98640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.066+0000 7f1050a98640 1 monclient: found mon.noname-c 2026-02-17T11:10:35.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.066+0000 7f1050a98640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.066+0000 7f1050a98640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:10:35.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.066+0000 7f1050a98640 1 -- 10.20.193.49:0/608520235 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f104c0c9ea0 con 0x7f104c15e060 2026-02-17T11:10:35.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.066+0000 7f6dcf7fe640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f6dd0152ae0 0x7f6dd00c9c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:32796/0 (socket says 10.20.193.49:32796) 2026-02-17T11:10:35.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.066+0000 7f6dcf7fe640 1 -- 10.20.193.49:0/2905367551 learned_addr learned my addr 10.20.193.49:0/2905367551 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:35.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.066+0000 7f6dcf7fe640 10 monclient(hunting): get_auth_request con 0x7f6dd0152ae0 auth_method 0 2026-02-17T11:10:35.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.066+0000 7f6dcf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.066+0000 7f6dcf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.066+0000 7f6dcf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.066+0000 7f5e82375640 10 monclient: get_monmap_and_config 2026-02-17T11:10:35.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.066+0000 7f5e82375640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.066+0000 7f5e82375640 10 monclient: monmap: 2026-02-17T11:10:35.106 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.107 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.107 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:35.066729+0000 2026-02-17T11:10:35.107 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:35.066729+0000 2026-02-17T11:10:35.107 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.107 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.107 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:35.107 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:35.107 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:35.107 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:35.107 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:35.107 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:35.107 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.107 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.066+0000 7f5e82375640 1 Processor -- start 2026-02-17T11:10:35.107 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.066+0000 7f6dcf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.107 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.066+0000 7f6dcf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.107 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.066+0000 7f6dcf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.066+0000 7f5e82375640 1 -- start start 2026-02-17T11:10:35.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.066+0000 7f5e82375640 10 monclient: init 2026-02-17T11:10:35.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.067+0000 7f5e82375640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.067+0000 7f5e82375640 10 monclient: _add_conns ranks=[3,0,2,4,5,1] 2026-02-17T11:10:35.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.067+0000 7f5e82375640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f5e7c0d1b60 0x7f5e7c0d1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.067+0000 7f5e82375640 10 monclient(hunting): picked mon.noname-a con 0x7f5e7c0d1b60 addr v2:10.20.193.49:3300/0 2026-02-17T11:10:35.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.067+0000 7f5e82375640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f5e7c15c840 addr v1:10.20.193.49:6789/0 2026-02-17T11:10:35.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.067+0000 7f5e82375640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f5e7c15d950 addr v1:10.20.193.157:6789/0 2026-02-17T11:10:35.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.067+0000 7f5e82375640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e7c0c98e0 con 0x7f5e7c15c840 2026-02-17T11:10:35.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.067+0000 7f5e82375640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e7c0c9bc0 con 0x7f5e7c15d950 2026-02-17T11:10:35.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.067+0000 7f5e82375640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.067+0000 7f5e82375640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f5e7c0ca460 con 0x7f5e7c0d1b60 2026-02-17T11:10:35.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.067+0000 7f5e82375640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.067+0000 7f5e82375640 10 monclient(hunting): authenticate will time out at 1111.730244s 2026-02-17T11:10:35.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.067+0000 7f3fa77fe640 10 monclient(hunting): handle_auth_done global_id 4420 payload 274 2026-02-17T11:10:35.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.067+0000 7f3fa77fe640 1 -- 10.20.193.49:0/3105715253 >> v2:10.20.193.157:3300/0 conn(0x7f3fa8152ae0 msgr2=0x7f3fa80c9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:35.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.067+0000 7f3fa77fe640 1 --2- 10.20.193.49:0/3105715253 >> v2:10.20.193.157:3300/0 conn(0x7f3fa8152ae0 0x7f3fa80c9c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.067+0000 7f3fa77fe640 1 -- 10.20.193.49:0/3105715253 >> v1:10.20.193.49:6789/0 conn(0x7f3fa8152700 legacy=0x7f3fa815e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.067+0000 7f3fa77fe640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.067+0000 7f3fa77fe640 1 monclient: found mon.noname-b 2026-02-17T11:10:35.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.067+0000 7f3fa77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.067+0000 7f3fa77fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.067+0000 7f3fa77fe640 1 -- 10.20.193.49:0/3105715253 --> v2:10.20.193.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fa815dd90 con 0x7f3fa815ef80 2026-02-17T11:10:35.109 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.067+0000 7faed1405640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.109 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.067+0000 7faed1405640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.109 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.067+0000 7faed1405640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:10:35.109 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.067+0000 7faed1c06640 1 --2- 10.20.193.49:0/4074054069 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7faeb4003ba0 0x7faeb4003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.109 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.067+0000 7f1050a98640 1 --2- 10.20.193.49:0/608520235 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f104c15e060 0x7f104c15c840 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1040009d90 tx=0x7f104002f240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4761569e71777522 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.109 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.068+0000 7f741abe2640 1 --2- 10.20.193.49:0/2733154319 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f74140ca100 0x7f7414160350 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f74140c8c30 tx=0x7f741002f230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63389382a1d8193e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.109 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.068+0000 7feccf7fe640 1 --1- >> v1:10.20.193.157:6789/0 conn(0x7fecd015edb0 0x7fecd00c9e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.157:6789/0 says I am v1:10.20.193.49:43308/0 (socket says 10.20.193.49:43308) 2026-02-17T11:10:35.109 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.068+0000 7feccf7fe640 1 -- 10.20.193.49:0/3134872779 learned_addr learned my addr 10.20.193.49:0/3134872779 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:10:35.109 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.068+0000 7f3fa77fe640 1 --2- 10.20.193.49:0/3105715253 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f3fa815ef80 0x7f3fa80c9730 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3fa80cbf60 tx=0x7f3f9802edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba9489b7f16dd10 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.110 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.068+0000 7fa559d74640 1 -- 10.20.193.49:0/2260849902 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa54c03c070 con 0x7fa55c14ed00 2026-02-17T11:10:35.110 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.068+0000 7fa559d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.110 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.068+0000 7fa559d74640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:10:35.110 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.068+0000 7fa559d74640 10 monclient: dump: 2026-02-17T11:10:35.110 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.110 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.110 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.110 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.110 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.110 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.110 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.111 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.111 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.111 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.111 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.068+0000 7fa559d74640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.111 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.068+0000 7fa559d74640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.111 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.068+0000 7fa559d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.111 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.068+0000 7fa559d74640 1 -- 10.20.193.49:0/2260849902 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa54c037440 con 0x7fa55c14ed00 2026-02-17T11:10:35.111 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.068+0000 7fa559d74640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.111 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.068+0000 7fa559d74640 1 -- 10.20.193.49:0/2260849902 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa54c0377f0 con 0x7fa55c14ed00 2026-02-17T11:10:35.111 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.068+0000 7fa5611e6640 5 monclient: authenticate success, global_id 4405 2026-02-17T11:10:35.111 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.068+0000 7fa5611e6640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:35.111 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.068+0000 7fa5611e6640 4 set_mon_vals no callback set 2026-02-17T11:10:35.111 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.068+0000 7fa559d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.111 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.068+0000 7fa559d74640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:35.111 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.068+0000 7fa559d74640 10 monclient: dump: 2026-02-17T11:10:35.111 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.111 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.111 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.111 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.111 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.111 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.111 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.111 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.111 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.111 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.111 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.069+0000 7fa5611e6640 10 monclient: shutdown 2026-02-17T11:10:35.112 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.069+0000 7fa5611e6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:35.112 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.069+0000 7fa5611e6640 1 -- 10.20.193.49:0/2260849902 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fa55c14ed00 msgr2=0x7fa55c0c9610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.112 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.069+0000 7fa5611e6640 1 --2- 10.20.193.49:0/2260849902 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fa55c14ed00 0x7fa55c0c9610 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa54c009d90 tx=0x7fa54c02f2d0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.112 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.069+0000 7fa5611e6640 1 -- 10.20.193.49:0/2260849902 shutdown_connections 2026-02-17T11:10:35.112 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.069+0000 7fa5611e6640 1 --2- 10.20.193.49:0/2260849902 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fa55c14ed00 0x7fa55c0c9610 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.112 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.069+0000 7fa5611e6640 1 -- 10.20.193.49:0/2260849902 >> 10.20.193.49:0/2260849902 conn(0x7fa55c0c9f40 msgr2=0x7fa55c0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:35.112 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.069+0000 7fa5611e6640 1 -- 10.20.193.49:0/2260849902 shutdown_connections 2026-02-17T11:10:35.112 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.069+0000 7fa5611e6640 1 -- 10.20.193.49:0/2260849902 wait complete. 2026-02-17T11:10:35.112 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.069+0000 7faed1c06640 10 monclient(hunting): get_auth_request con 0x7faeb4003ba0 auth_method 0 2026-02-17T11:10:35.112 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.069+0000 7faed1c06640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.112 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.069+0000 7faed1c06640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.112 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.069+0000 7faed1c06640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:10:35.112 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.070+0000 7fa5611e6640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.112 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.070+0000 7fa5611e6640 10 monclient: monmap: 2026-02-17T11:10:35.112 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.112 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:35.112 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:35.112 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:35.113 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.113 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.113 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:35.113 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:35.113 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:35.113 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.113 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.070+0000 7f6dcf7fe640 10 monclient(hunting): handle_auth_done global_id 4419 payload 274 2026-02-17T11:10:35.113 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.070+0000 7f6dcf7fe640 1 -- 10.20.193.49:0/2905367551 >> v2:10.20.193.97:3300/0 conn(0x7f6dd015ef80 msgr2=0x7f6dd00c9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:35.113 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.070+0000 7f6dcf7fe640 1 --2- 10.20.193.49:0/2905367551 >> v2:10.20.193.97:3300/0 conn(0x7f6dd015ef80 0x7f6dd00c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.113 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.070+0000 7faed1405640 10 monclient(hunting): handle_auth_done global_id 4411 payload 293 2026-02-17T11:10:35.113 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.070+0000 7faed1405640 1 -- 10.20.193.49:0/4074054069 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7faeb40054c0 msgr2=0x7faeb400bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:35.113 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.070+0000 7faed1405640 1 --2- 10.20.193.49:0/4074054069 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7faeb40054c0 0x7faeb400bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.113 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.070+0000 7faed1405640 1 -- 10.20.193.49:0/4074054069 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7faeb4003ba0 msgr2=0x7faeb4003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:35.113 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.070+0000 7faed1405640 1 --2- 10.20.193.49:0/4074054069 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7faeb4003ba0 0x7faeb4003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.070+0000 7faed1405640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.070+0000 7faed1405640 1 monclient: found mon.b 2026-02-17T11:10:35.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.070+0000 7faed1405640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.070+0000 7faed1405640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.070+0000 7faed1405640 1 -- 10.20.193.49:0/4074054069 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faeb4003620 con 0x7faeb4004900 2026-02-17T11:10:35.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.070+0000 7faed1405640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.070+0000 7faed1405640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.070+0000 7faed1405640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.070+0000 7f6dcf7fe640 1 -- 10.20.193.49:0/2905367551 >> v1:10.20.193.97:6789/0 conn(0x7f6dd0152700 legacy=0x7f6dd015e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:35.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.070+0000 7faed2407640 1 -- 10.20.193.49:0/4074054069 reap_dead start 2026-02-17T11:10:35.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.070+0000 7f6dcf7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.070+0000 7f6dcf7fe640 1 monclient: found mon.noname-a 2026-02-17T11:10:35.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.070+0000 7f6dcf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.070+0000 7f6dcf7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:10:35.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.070+0000 7f6dcf7fe640 1 -- 10.20.193.49:0/2905367551 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dd015dd90 con 0x7f6dd0152ae0 2026-02-17T11:10:35.115 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.070+0000 7fa5611e6640 1 librados: starting msgr at 2026-02-17T11:10:35.115 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.070+0000 7fa5611e6640 1 librados: starting objecter 2026-02-17T11:10:35.115 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.070+0000 7fa5611e6640 1 Processor -- start 2026-02-17T11:10:35.115 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.070+0000 7fecceffd640 1 --2- 10.20.193.49:0/3134872779 >> v2:10.20.193.49:3300/0 conn(0x7fecd0152700 0x7fecd015e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.115 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.070+0000 7fa5611e6640 1 -- start start 2026-02-17T11:10:35.115 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.070+0000 7fa5611e6640 1 librados: setting wanted keys 2026-02-17T11:10:35.115 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.070+0000 7fa5611e6640 1 librados: calling monclient init 2026-02-17T11:10:35.115 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.071+0000 7fa5611e6640 10 monclient: init 2026-02-17T11:10:35.115 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.071+0000 7ff7a5322640 10 monclient: get_monmap_and_config 2026-02-17T11:10:35.116 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.071+0000 7ff7a5322640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.116 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.071+0000 7ff7a5322640 10 monclient: monmap: 2026-02-17T11:10:35.116 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.116 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.116 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:35.071631+0000 2026-02-17T11:10:35.116 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:35.071631+0000 2026-02-17T11:10:35.116 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.116 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.116 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:35.116 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:35.116 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:35.116 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:35.116 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:35.116 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:35.116 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.116 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.071+0000 7fa5611e6640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.116 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.071+0000 7fe9cf7fe640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe9d00ceef0 0x7fe9d01f60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.117 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.071+0000 7fa5611e6640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:10:35.117 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.071+0000 7fa5611e6640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fa55c14e920 0x7fa55c0743b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.117 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.071+0000 7fa5611e6640 10 monclient(hunting): picked mon.noname-a con 0x7fa55c14e920 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:35.117 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.071+0000 7fa5611e6640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fa55c14ed00 0x7fa55c1f7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.117 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.071+0000 7fa5611e6640 10 monclient(hunting): picked mon.noname-b con 0x7fa55c14ed00 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:35.117 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.071+0000 7fa5611e6640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fa55c15b290 0x7fa55c142760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.117 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.071+0000 7fa5611e6640 10 monclient(hunting): picked mon.noname-c con 0x7fa55c15b290 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:35.117 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.071+0000 7fa5611e6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.117 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.071+0000 7ff7a5322640 1 Processor -- start 2026-02-17T11:10:35.118 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.071+0000 7fa5611e6640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa55c0c88b0 con 0x7fa55c14e920 2026-02-17T11:10:35.118 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.071+0000 7fa5611e6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.118 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.071+0000 7fa5611e6640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa55c15ad70 con 0x7fa55c14ed00 2026-02-17T11:10:35.118 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.071+0000 7fa5611e6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.118 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.071+0000 7fa5611e6640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fa55c0c8a30 con 0x7fa55c15b290 2026-02-17T11:10:35.118 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.071+0000 7fa5611e6640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.118 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.071+0000 7fa5611e6640 10 monclient(hunting): authenticate will time out at 1111.734695s 2026-02-17T11:10:35.118 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.071+0000 7ff7a5322640 1 -- start start 2026-02-17T11:10:35.118 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.071+0000 7ff7a5322640 10 monclient: init 2026-02-17T11:10:35.118 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.071+0000 7fc4e8838640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7fc4e40d1f40 0x7fc4e415c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.118 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.071+0000 7f84daffd640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f84dc153be0 0x7f84dc0cb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.119 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7f6dcf7fe640 1 --2- 10.20.193.49:0/2905367551 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f6dd0152ae0 0x7f6dd00c9c70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6dd008e820 tx=0x7f6dc002f270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfa7f06296919b86 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.119 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7fc4e8838640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7fc4e40d1f40 0x7fc4e415c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:47986/0 (socket says 10.20.193.49:47986) 2026-02-17T11:10:35.119 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7fc4e8838640 1 -- 10.20.193.49:0/1843045386 learned_addr learned my addr 10.20.193.49:0/1843045386 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:35.119 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7fc4e8838640 10 monclient(hunting): get_auth_request con 0x7fc4e40d1f40 auth_method 0 2026-02-17T11:10:35.119 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7fc4e8838640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.119 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7fc4e8838640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.119 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7fc4e8838640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.119 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7ff7a5322640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.119 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7f84daffd640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f84dc153be0 0x7f84dc0cb930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:48000/0 (socket says 10.20.193.49:48000) 2026-02-17T11:10:35.119 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7f84daffd640 1 -- 10.20.193.49:0/39859385 learned_addr learned my addr 10.20.193.49:0/39859385 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:35.119 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7f84daffd640 10 monclient(hunting): get_auth_request con 0x7f84dc153be0 auth_method 0 2026-02-17T11:10:35.119 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7f84daffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.119 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7f84daffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.119 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7f84daffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.120 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7ff7a5322640 10 monclient: _add_conns ranks=[0,5,2,4,3,1] 2026-02-17T11:10:35.120 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7ff7a5322640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ff7a0152700 addr v1:10.20.193.49:6789/0 2026-02-17T11:10:35.120 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7ff7a5322640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7ff7a015ef80 0x7ff7a00c9730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.120 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7ff7a5322640 10 monclient(hunting): picked mon.noname-c con 0x7ff7a015ef80 addr v2:10.20.193.157:3300/0 2026-02-17T11:10:35.120 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7ff7a5322640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ff7a0152ae0 addr v1:10.20.193.157:6789/0 2026-02-17T11:10:35.120 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7ff7a5322640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7a015d4f0 con 0x7ff7a0152700 2026-02-17T11:10:35.120 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7ff7a5322640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7a015d7d0 con 0x7ff7a0152ae0 2026-02-17T11:10:35.120 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7ff7a5322640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.120 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7ff7a5322640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7ff7a015dab0 con 0x7ff7a015ef80 2026-02-17T11:10:35.120 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7ff7a5322640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.120 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7ff7a5322640 10 monclient(hunting): authenticate will time out at 1111.735278s 2026-02-17T11:10:35.120 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7fe9cf7fe640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe9d00ceef0 0x7fe9d01f60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:32852/0 (socket says 10.20.193.49:32852) 2026-02-17T11:10:35.120 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7fe9cf7fe640 1 -- 10.20.193.49:0/4131833758 learned_addr learned my addr 10.20.193.49:0/4131833758 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:35.120 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7fe9cf7fe640 10 monclient(hunting): get_auth_request con 0x7fe9d00ceef0 auth_method 0 2026-02-17T11:10:35.120 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7fe9cf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.120 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7fe9cf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.120 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7fe9cf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.121 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7f74193df640 1 -- 10.20.193.49:0/2733154319 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f741002fc50 con 0x7f74140ca100 2026-02-17T11:10:35.121 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7f74193df640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.121 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7f74193df640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:10:35.121 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7f74193df640 10 monclient: dump: 2026-02-17T11:10:35.121 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.121 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.121 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.121 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.121 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.121 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.121 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.121 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.121 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.121 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.121 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7f74193df640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.121 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7f74193df640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.121 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7f74193df640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.122 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7f74193df640 1 -- 10.20.193.49:0/2733154319 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f741002fdf0 con 0x7f74140ca100 2026-02-17T11:10:35.122 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7f74193df640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.122 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7f74193df640 1 -- 10.20.193.49:0/2733154319 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7410037610 con 0x7f74140ca100 2026-02-17T11:10:35.122 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7f74193df640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.122 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7f74193df640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:10:35.122 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7f74193df640 10 monclient: dump: 2026-02-17T11:10:35.122 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.122 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.122 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.122 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.122 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.122 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.122 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.122 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.122 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.122 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.122 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7f741c66c640 5 monclient: authenticate success, global_id 4433 2026-02-17T11:10:35.122 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7f741c66c640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:35.122 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7f741c66c640 4 set_mon_vals no callback set 2026-02-17T11:10:35.122 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7fe9cf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.122 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7fe9cf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.122 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7fe9cf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.123 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7fc4e8838640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.123 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7fc4e8838640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.123 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7fc4e8838640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.123 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7fecceffd640 10 monclient(hunting): get_auth_request con 0x7fecd0152700 auth_method 0 2026-02-17T11:10:35.123 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7fecceffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.123 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7fecceffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.123 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7fecceffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.123 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7fe9d4872640 1 --2- 10.20.193.49:0/4131833758 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe9d015bf30 0x7fe9d015fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.124 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7f741c66c640 10 monclient: shutdown 2026-02-17T11:10:35.124 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7f741c66c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:35.124 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7f741c66c640 1 -- 10.20.193.49:0/2733154319 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f74140ca100 msgr2=0x7f7414160350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.124 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.072+0000 7f741c66c640 1 --2- 10.20.193.49:0/2733154319 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f74140ca100 0x7f7414160350 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f74140c8c30 tx=0x7f741002f230 comp rx=0 tx=0).stop 2026-02-17T11:10:35.124 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.073+0000 7f741c66c640 1 -- 10.20.193.49:0/2733154319 shutdown_connections 2026-02-17T11:10:35.124 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.073+0000 7f741c66c640 1 --2- 10.20.193.49:0/2733154319 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f74140ca100 0x7f7414160350 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.124 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.073+0000 7f741c66c640 1 --2- 10.20.193.49:0/2733154319 >> v2:10.20.193.49:3300/0 conn(0x7f74140d1f40 0x7f74140c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.124 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.073+0000 7f741c66c640 1 -- 10.20.193.49:0/2733154319 >> 10.20.193.49:0/2733154319 conn(0x7f741406d9b0 msgr2=0x7f741406ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:35.124 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.073+0000 7f741c66c640 1 -- 10.20.193.49:0/2733154319 shutdown_connections 2026-02-17T11:10:35.124 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.073+0000 7f741c66c640 1 -- 10.20.193.49:0/2733154319 wait complete. 2026-02-17T11:10:35.124 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.073+0000 7f84daffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.124 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.073+0000 7f84daffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.124 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.073+0000 7f84db7fe640 1 --2- 10.20.193.49:0/39859385 >> v2:10.20.193.49:3300/0 conn(0x7f84dc153fc0 0x7f84dc0c6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.124 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.073+0000 7f84daffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.124 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.073+0000 7fe9d4872640 10 monclient(hunting): get_auth_request con 0x7fe9d015bf30 auth_method 0 2026-02-17T11:10:35.125 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.073+0000 7fe9d4872640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.125 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.073+0000 7fe9d4872640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.125 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.073+0000 7fe9d4872640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.125 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.073+0000 7f741c66c640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.125 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.073+0000 7f741c66c640 10 monclient: monmap: 2026-02-17T11:10:35.125 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.125 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:35.125 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:35.125 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:35.125 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.125 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.125 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:35.125 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:35.125 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:35.125 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.125 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.073+0000 7f741c66c640 1 librados: starting msgr at 2026-02-17T11:10:35.125 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.073+0000 7f741c66c640 1 librados: starting objecter 2026-02-17T11:10:35.125 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.073+0000 7f741c66c640 1 Processor -- start 2026-02-17T11:10:35.126 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.073+0000 7f741c66c640 1 -- start start 2026-02-17T11:10:35.126 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.073+0000 7f741c66c640 1 librados: setting wanted keys 2026-02-17T11:10:35.126 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.073+0000 7f741c66c640 1 librados: calling monclient init 2026-02-17T11:10:35.126 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.073+0000 7f741c66c640 10 monclient: init 2026-02-17T11:10:35.126 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.073+0000 7fc4e8838640 10 monclient(hunting): handle_auth_done global_id 4423 payload 274 2026-02-17T11:10:35.126 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.073+0000 7fc4e8838640 1 -- 10.20.193.49:0/1843045386 >> v1:10.20.193.157:6789/0 conn(0x7fc4e40d1b60 legacy=0x7fc4e40c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:35.126 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.073+0000 7fc4e8838640 1 -- 10.20.193.49:0/1843045386 >> v1:10.20.193.97:6789/0 conn(0x7fc4e415d950 legacy=0x7fc4e415dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:35.126 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.073+0000 7fc4e8838640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.126 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.073+0000 7fc4e8838640 1 monclient: found mon.noname-b 2026-02-17T11:10:35.126 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.073+0000 7fc4e8838640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.126 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.073+0000 7fc4e8838640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.126 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.073+0000 7fc4e8838640 1 -- 10.20.193.49:0/1843045386 --> v2:10.20.193.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4e40c9ea0 con 0x7fc4e40d1f40 2026-02-17T11:10:35.126 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.074+0000 7f741c66c640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.127 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.074+0000 7f741c66c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:10:35.127 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.074+0000 7f741c66c640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f74140ca100 0x7f7414164510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.127 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.074+0000 7f741c66c640 10 monclient(hunting): picked mon.noname-b con 0x7f74140ca100 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:35.127 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.074+0000 7f741c66c640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f74140d1b60 0x7f74140d0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.127 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.074+0000 7f741c66c640 10 monclient(hunting): picked mon.noname-c con 0x7f74140d1b60 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:35.127 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.074+0000 7f741c66c640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f74140d1f40 0x7f74141f7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.127 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.074+0000 7f741c66c640 10 monclient(hunting): picked mon.noname-a con 0x7f74140d1f40 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:35.127 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.074+0000 7f741c66c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.127 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.074+0000 7f741c66c640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f741406e820 con 0x7f74140d1f40 2026-02-17T11:10:35.127 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.074+0000 7f741c66c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.127 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.074+0000 7f741c66c640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f74140c93c0 con 0x7f74140ca100 2026-02-17T11:10:35.127 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.074+0000 7f741c66c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.127 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.074+0000 7f741c66c640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f74141611b0 con 0x7f74140d1b60 2026-02-17T11:10:35.127 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.074+0000 7f741c66c640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.127 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.074+0000 7f741c66c640 10 monclient(hunting): authenticate will time out at 1111.737319s 2026-02-17T11:10:35.127 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.074+0000 7feeeaffd640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7feeec0d1f40 0x7feeec1f52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.127 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.074+0000 7fe9d4872640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.127 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.074+0000 7fe9d4872640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.127 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.074+0000 7fe9d4872640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.128 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.074+0000 7f104affd640 1 -- 10.20.193.49:0/608520235 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f104003c070 con 0x7f104c15e060 2026-02-17T11:10:35.128 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.074+0000 7f104affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.128 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.074+0000 7f104affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:10:35.128 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.074+0000 7f104affd640 10 monclient: dump: 2026-02-17T11:10:35.128 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.128 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.128 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.128 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.128 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.128 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.128 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.128 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.128 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.128 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.128 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.074+0000 7f104affd640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.128 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.074+0000 7f104affd640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.128 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.074+0000 7f104affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.074+0000 7f104affd640 1 -- 10.20.193.49:0/608520235 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1040037440 con 0x7f104c15e060 2026-02-17T11:10:35.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.074+0000 7f104affd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.074+0000 7f104affd640 1 -- 10.20.193.49:0/608520235 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1040037810 con 0x7f104c15e060 2026-02-17T11:10:35.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.074+0000 7f104affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.074+0000 7f104affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:10:35.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.074+0000 7f104affd640 10 monclient: dump: 2026-02-17T11:10:35.129 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.129 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.129 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.129 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.129 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.129 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.129 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.129 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.129 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.129 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.074+0000 7f1052522640 5 monclient: authenticate success, global_id 4436 2026-02-17T11:10:35.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.074+0000 7f1052522640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:35.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.074+0000 7f1052522640 4 set_mon_vals no callback set 2026-02-17T11:10:35.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.075+0000 7fe9cf7fe640 10 monclient(hunting): handle_auth_done global_id 4422 payload 824 2026-02-17T11:10:35.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.075+0000 7fe9cf7fe640 1 -- 10.20.193.49:0/4131833758 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe9d00ce5d0 msgr2=0x7fe9d01f3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.075+0000 7f1052522640 10 monclient: shutdown 2026-02-17T11:10:35.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.075+0000 7f1052522640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:35.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.075+0000 7f1052522640 1 -- 10.20.193.49:0/608520235 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f104c15e060 msgr2=0x7f104c15c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.075+0000 7f1052522640 1 --2- 10.20.193.49:0/608520235 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f104c15e060 0x7f104c15c840 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1040009d90 tx=0x7f104002f240 comp rx=0 tx=0).stop 2026-02-17T11:10:35.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.075+0000 7f84daffd640 10 monclient(hunting): handle_auth_done global_id 4426 payload 274 2026-02-17T11:10:35.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.075+0000 7f84daffd640 1 -- 10.20.193.49:0/39859385 >> v2:10.20.193.49:3300/0 conn(0x7f84dc153fc0 msgr2=0x7f84dc0c6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:35.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.075+0000 7f84daffd640 1 --2- 10.20.193.49:0/39859385 >> v2:10.20.193.49:3300/0 conn(0x7f84dc153fc0 0x7f84dc0c6ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.074+0000 7feeeaffd640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7feeec0d1f40 0x7feeec1f52e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:55782/0 (socket says 10.20.193.49:55782) 2026-02-17T11:10:35.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.074+0000 7feeeaffd640 1 -- 10.20.193.49:0/2599867942 learned_addr learned my addr 10.20.193.49:0/2599867942 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:35.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.074+0000 7feeeaffd640 10 monclient(hunting): get_auth_request con 0x7feeec0d1f40 auth_method 0 2026-02-17T11:10:35.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.074+0000 7feeeaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.074+0000 7feeeaffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.074+0000 7feeeaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.075+0000 7fe9cffff640 1 --2- 10.20.193.49:0/4131833758 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe9d00ce5d0 0x7fe9d01f3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.075+0000 7f84daffd640 1 -- 10.20.193.49:0/39859385 >> v1:10.20.193.97:6789/0 conn(0x7f84dc15b0c0 legacy=0x7f84dc15d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:35.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.075+0000 7f84daffd640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.075+0000 7f84daffd640 1 monclient: found mon.noname-b 2026-02-17T11:10:35.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.075+0000 7f84daffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.075+0000 7f84daffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.075+0000 7f84daffd640 1 -- 10.20.193.49:0/39859385 --> v2:10.20.193.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84dc0cab70 con 0x7f84dc153be0 2026-02-17T11:10:35.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.075+0000 7fe9cf7fe640 1 --2- 10.20.193.49:0/4131833758 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe9d00ce5d0 0x7fe9d01f3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.075+0000 7fe9cf7fe640 1 -- 10.20.193.49:0/4131833758 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe9d015bf30 msgr2=0x7fe9d015fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.075+0000 7fe9cf7fe640 1 --2- 10.20.193.49:0/4131833758 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe9d015bf30 0x7fe9d015fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.075+0000 7fe9cf7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.075+0000 7fe9cf7fe640 1 monclient: found mon.noname-a 2026-02-17T11:10:35.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.075+0000 7fe9cf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.075+0000 7fe9cf7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:10:35.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.075+0000 7fe9cf7fe640 1 -- 10.20.193.49:0/4131833758 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9d015f050 con 0x7fe9d00ceef0 2026-02-17T11:10:35.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.075+0000 7f1052522640 1 -- 10.20.193.49:0/608520235 shutdown_connections 2026-02-17T11:10:35.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.075+0000 7f1052522640 1 --2- 10.20.193.49:0/608520235 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f104c15e060 0x7f104c15c840 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.075+0000 7f1052522640 1 -- 10.20.193.49:0/608520235 >> 10.20.193.49:0/608520235 conn(0x7f104c06d9b0 msgr2=0x7f104c06ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:35.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.075+0000 7f1052522640 1 -- 10.20.193.49:0/608520235 shutdown_connections 2026-02-17T11:10:35.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.075+0000 7f1052522640 1 -- 10.20.193.49:0/608520235 wait complete. 2026-02-17T11:10:35.133 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.075+0000 7feeeaffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.133 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.075+0000 7feeeaffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.133 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.075+0000 7feeeaffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.133 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.075+0000 7fecceffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.134 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.075+0000 7fecceffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.134 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.075+0000 7fecceffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.135 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.075+0000 7f1052522640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.135 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.075+0000 7f1052522640 10 monclient: monmap: 2026-02-17T11:10:35.135 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.135 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:35.135 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:35.135 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:35.135 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.135 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.135 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:35.135 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:35.135 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:35.135 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.135 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.075+0000 7f1052522640 1 librados: starting msgr at 2026-02-17T11:10:35.135 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.075+0000 7f1052522640 1 librados: starting objecter 2026-02-17T11:10:35.135 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.075+0000 7f1052522640 1 Processor -- start 2026-02-17T11:10:35.135 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.076+0000 7f1052522640 1 -- start start 2026-02-17T11:10:35.135 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.076+0000 7f1052522640 1 librados: setting wanted keys 2026-02-17T11:10:35.135 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.076+0000 7f1052522640 1 librados: calling monclient init 2026-02-17T11:10:35.135 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.076+0000 7f1052522640 10 monclient: init 2026-02-17T11:10:35.135 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.076+0000 7f1052522640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.135 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.076+0000 7f1052522640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:10:35.135 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.076+0000 7f1052522640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f104c0d1b60 0x7f104c200e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.135 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.076+0000 7f1052522640 10 monclient(hunting): picked mon.noname-c con 0x7f104c0d1b60 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:35.135 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.076+0000 7f1052522640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f104c0d1f40 0x7f104c1514d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.136 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.076+0000 7f1052522640 10 monclient(hunting): picked mon.noname-a con 0x7f104c0d1f40 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:35.136 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.076+0000 7f1052522640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f104c15e060 0x7f104c14b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.136 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.076+0000 7f1052522640 10 monclient(hunting): picked mon.noname-b con 0x7f104c15e060 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:35.136 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.076+0000 7f1052522640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.136 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.076+0000 7f1052522640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f104c15d4c0 con 0x7f104c0d1f40 2026-02-17T11:10:35.136 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.076+0000 7f1052522640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.136 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.076+0000 7f1052522640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f104c0ca460 con 0x7f104c15e060 2026-02-17T11:10:35.136 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.076+0000 7f1052522640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.136 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.076+0000 7f1052522640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f104c06e7b0 con 0x7f104c0d1b60 2026-02-17T11:10:35.136 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.076+0000 7f1052522640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.136 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.076+0000 7f1052522640 10 monclient(hunting): authenticate will time out at 1111.739489s 2026-02-17T11:10:35.136 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.076+0000 7feeeaffd640 10 monclient(hunting): handle_auth_done global_id 4442 payload 824 2026-02-17T11:10:35.136 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.076+0000 7feeeaffd640 1 -- 10.20.193.49:0/2599867942 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7feeec0d1b60 msgr2=0x7feeec1e99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.136 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.076+0000 7feeeaffd640 1 --2- 10.20.193.49:0/2599867942 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7feeec0d1b60 0x7feeec1e99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.136 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.076+0000 7feeeaffd640 1 -- 10.20.193.49:0/2599867942 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7feeec15d950 msgr2=0x7feeec1f5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.136 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.076+0000 7feeeaffd640 1 --2- 10.20.193.49:0/2599867942 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7feeec15d950 0x7feeec1f5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.136 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.076+0000 7feeeaffd640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.137 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.076+0000 7feeeaffd640 1 monclient: found mon.noname-c 2026-02-17T11:10:35.137 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.076+0000 7feeeaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.137 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.076+0000 7feeeaffd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:10:35.137 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.076+0000 7feeeaffd640 1 -- 10.20.193.49:0/2599867942 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feeec1576b0 con 0x7feeec0d1f40 2026-02-17T11:10:35.137 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.077+0000 7fecceffd640 10 monclient(hunting): handle_auth_done global_id 4425 payload 274 2026-02-17T11:10:35.137 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.077+0000 7fecceffd640 1 -- 10.20.193.49:0/3134872779 >> v1:10.20.193.157:6789/0 conn(0x7fecd015edb0 legacy=0x7fecd00c9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.137 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.077+0000 7fecceffd640 1 -- 10.20.193.49:0/3134872779 >> v1:10.20.193.49:6789/0 conn(0x7fecd0152ae0 legacy=0x7fecd00c9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:35.137 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.077+0000 7fecceffd640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.137 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.077+0000 7fecceffd640 1 monclient: found mon.noname-a 2026-02-17T11:10:35.137 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.077+0000 7fecceffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.137 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.077+0000 7fecceffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:10:35.137 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.077+0000 7fecceffd640 1 -- 10.20.193.49:0/3134872779 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecd015dab0 con 0x7fecd0152700 2026-02-17T11:10:35.137 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.077+0000 7f434bfff640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f434c15d950 0x7f434c15dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.137 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.077+0000 7fc4e8838640 1 --2- 10.20.193.49:0/1843045386 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc4e40d1f40 0x7fc4e415c840 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc4d8009970 tx=0x7fc4d802eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71a1dfb02e4375ad server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.137 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.077+0000 7f434bfff640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f434c15d950 0x7f434c15dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:32856/0 (socket says 10.20.193.49:32856) 2026-02-17T11:10:35.137 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.077+0000 7f434bfff640 1 -- 10.20.193.49:0/2915363711 learned_addr learned my addr 10.20.193.49:0/2915363711 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:35.137 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.077+0000 7f434bfff640 10 monclient(hunting): get_auth_request con 0x7f434c15d950 auth_method 0 2026-02-17T11:10:35.137 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.077+0000 7f434bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.137 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.077+0000 7f434bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.137 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.077+0000 7f434bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.137 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.078+0000 7fe9cf7fe640 1 --2- 10.20.193.49:0/4131833758 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe9d00ceef0 0x7fe9d01f60c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe9c000e840 tx=0x7fe9c000ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.137 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.078+0000 7fe9ccff9640 10 client.?.objecter ms_handle_connect 0x7fe9d00ceef0 2026-02-17T11:10:35.138 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.078+0000 7fe9ccff9640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:35.138 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.078+0000 7feeeaffd640 1 --2- 10.20.193.49:0/2599867942 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7feeec0d1f40 0x7feeec1f52e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7feedc016e30 tx=0x7feedc0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.138 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.078+0000 7feec7fff640 10 client.?.objecter ms_handle_connect 0x7feeec0d1f40 2026-02-17T11:10:35.138 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.078+0000 7f84daffd640 1 --2- 10.20.193.49:0/39859385 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f84dc153be0 0x7f84dc0cb930 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f84dc0747c0 tx=0x7f84d002ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc4f2eae13c9ea5b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.138 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.078+0000 7feec7fff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:35.138 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.078+0000 7f434bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.138 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.078+0000 7f434bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.138 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.078+0000 7fa55b577640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fa55c15b290 0x7fa55c142760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.138 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.078+0000 7fc848bd8640 1 --1- >> v1:10.20.193.97:6789/0 conn(0x7fc84415c840 0x7fc8440c8d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.97:6789/0 says I am v1:10.20.193.49:51616/0 (socket says 10.20.193.49:51616) 2026-02-17T11:10:35.138 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.078+0000 7fc848bd8640 1 -- 10.20.193.49:0/2584370339 learned_addr learned my addr 10.20.193.49:0/2584370339 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:10:35.138 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.078+0000 7f434bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.138 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.079+0000 7fecceffd640 1 --2- 10.20.193.49:0/3134872779 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fecd0152700 0x7fecd015e870 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fecc40098a0 tx=0x7fecc402ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9ff2209522e85d1 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.139 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.079+0000 7f993effd640 1 --2- 10.20.193.49:0/2782315169 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f9924004900 0x7f9924004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.139 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.079+0000 7f434bfff640 10 monclient(hunting): handle_auth_done global_id 4428 payload 274 2026-02-17T11:10:35.139 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.080+0000 7f434bfff640 1 -- 10.20.193.49:0/2915363711 >> v2:10.20.193.157:3300/0 conn(0x7f434c0d1b60 msgr2=0x7f434c0d1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:35.139 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.080+0000 7f434bfff640 1 --2- 10.20.193.49:0/2915363711 >> v2:10.20.193.157:3300/0 conn(0x7f434c0d1b60 0x7f434c0d1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.139 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.080+0000 7f434bfff640 1 -- 10.20.193.49:0/2915363711 >> v1:10.20.193.49:6789/0 conn(0x7f434c15c840 legacy=0x7f434c0c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:35.139 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.080+0000 7f434bfff640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.139 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.080+0000 7f434bfff640 1 monclient: found mon.noname-a 2026-02-17T11:10:35.139 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.080+0000 7f434bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.139 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.080+0000 7f434bfff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:10:35.139 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.080+0000 7f434bfff640 1 -- 10.20.193.49:0/2915363711 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f434c0c98e0 con 0x7f434c15d950 2026-02-17T11:10:35.139 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.080+0000 7fa55b577640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fa55c15b290 0x7fa55c142760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:55824/0 (socket says 10.20.193.49:55824) 2026-02-17T11:10:35.139 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.080+0000 7fa55b577640 1 -- 10.20.193.49:0/353134677 learned_addr learned my addr 10.20.193.49:0/353134677 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:35.139 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.080+0000 7fa55b577640 10 monclient(hunting): get_auth_request con 0x7fa55c15b290 auth_method 0 2026-02-17T11:10:35.139 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.080+0000 7fa55b577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.139 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.080+0000 7fa55b577640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.139 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.080+0000 7fa55b577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.139 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.080+0000 7f993ffff640 1 --2- 10.20.193.49:0/2782315169 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f99240054c0 0x7f992400bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.139 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.080+0000 7f993ffff640 10 monclient(hunting): get_auth_request con 0x7f99240054c0 auth_method 0 2026-02-17T11:10:35.139 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.080+0000 7f993ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.140 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.080+0000 7f993ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.140 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.080+0000 7f993ffff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:10:35.140 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.081+0000 7fa55b577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.140 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.081+0000 7fa55b577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.140 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.081+0000 7fa55b577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.140 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.081+0000 7f993effd640 10 monclient(hunting): get_auth_request con 0x7f9924004900 auth_method 0 2026-02-17T11:10:35.140 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.081+0000 7f993effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.140 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.081+0000 7f993effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.140 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.081+0000 7f993effd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:10:35.140 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.081+0000 7f993ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.140 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.081+0000 7f993ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.140 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.081+0000 7f993ffff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:10:35.140 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.081+0000 7f993effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.140 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.081+0000 7f993effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.140 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.081+0000 7f993effd640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:10:35.140 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.081+0000 7f434bfff640 1 --2- 10.20.193.49:0/2915363711 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f434c15d950 0x7f434c15dd90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f434c0cf420 tx=0x7f434002f270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd01263338e43473 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.141 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.082+0000 7fc8493d9640 1 --2- 10.20.193.49:0/2584370339 >> v2:10.20.193.97:3300/0 conn(0x7fc8440d1b60 0x7fc8440d1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.141 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.082+0000 7f993f7fe640 1 --2- 10.20.193.49:0/2782315169 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f9924003bf0 0x7f9924004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.141 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.082+0000 7fa55b577640 10 monclient(hunting): handle_auth_done global_id 4445 payload 824 2026-02-17T11:10:35.141 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.082+0000 7fa55b577640 1 -- 10.20.193.49:0/353134677 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fa55c14ed00 msgr2=0x7fa55c1f7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.141 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.082+0000 7fa55b577640 1 --2- 10.20.193.49:0/353134677 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fa55c14ed00 0x7fa55c1f7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.141 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.082+0000 7fa55b577640 1 -- 10.20.193.49:0/353134677 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fa55c14e920 msgr2=0x7fa55c0743b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.141 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.082+0000 7fa55b577640 1 --2- 10.20.193.49:0/353134677 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fa55c14e920 0x7fa55c0743b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.141 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.082+0000 7fa55b577640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.141 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.082+0000 7fa55b577640 1 monclient: found mon.noname-c 2026-02-17T11:10:35.141 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.082+0000 7fa55b577640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.141 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.082+0000 7f993effd640 10 monclient(hunting): handle_auth_done global_id 4417 payload 293 2026-02-17T11:10:35.141 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.082+0000 7f993effd640 1 -- 10.20.193.49:0/2782315169 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f99240054c0 msgr2=0x7f992400bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:35.141 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.082+0000 7f993effd640 1 --2- 10.20.193.49:0/2782315169 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f99240054c0 0x7f992400bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.141 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.082+0000 7f993effd640 1 -- 10.20.193.49:0/2782315169 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f9924003bf0 msgr2=0x7f9924004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:35.141 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.082+0000 7f993effd640 1 --2- 10.20.193.49:0/2782315169 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f9924003bf0 0x7f9924004010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.142 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.082+0000 7f993effd640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.142 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.082+0000 7f993effd640 1 monclient: found mon.b 2026-02-17T11:10:35.142 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.082+0000 7f993effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.142 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.082+0000 7f993effd640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.142 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.082+0000 7f993effd640 1 -- 10.20.193.49:0/2782315169 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9924003620 con 0x7f9924004900 2026-02-17T11:10:35.142 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.082+0000 7f993effd640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.142 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.082+0000 7f993effd640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.142 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.082+0000 7f993effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.142 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.082+0000 7f9945a8f640 5 monclient: authenticate success, global_id 4417 2026-02-17T11:10:35.142 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.082+0000 7f9945a8f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:10:35.142 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.082+0000 7f993ffff640 1 -- 10.20.193.49:0/2782315169 reap_dead start 2026-02-17T11:10:35.142 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.082+0000 7fa55b577640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:10:35.142 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.082+0000 7fa55b577640 1 -- 10.20.193.49:0/353134677 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa55c0748f0 con 0x7fa55c15b290 2026-02-17T11:10:35.142 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.083+0000 7fc8493d9640 10 monclient(hunting): get_auth_request con 0x7fc8440d1b60 auth_method 0 2026-02-17T11:10:35.142 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.083+0000 7fc8493d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.142 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.083+0000 7fc8493d9640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.142 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.083+0000 7fc8493d9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.142 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.084+0000 7fc8493d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.142 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.084+0000 7fc8493d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.142 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.084+0000 7fc8493d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.142 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.085+0000 7fc8493d9640 10 monclient(hunting): handle_auth_done global_id 4435 payload 274 2026-02-17T11:10:35.142 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.085+0000 7fc8493d9640 1 -- 10.20.193.49:0/2584370339 >> v1:10.20.193.157:6789/0 conn(0x7fc84415d950 legacy=0x7fc84415dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:35.142 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.085+0000 7fc8493d9640 1 -- 10.20.193.49:0/2584370339 >> v1:10.20.193.97:6789/0 conn(0x7fc84415c840 legacy=0x7fc8440c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.142 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.085+0000 7fc8493d9640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.142 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.085+0000 7fc8493d9640 1 monclient: found mon.noname-b 2026-02-17T11:10:35.142 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.085+0000 7fc8493d9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.143 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.085+0000 7fc8493d9640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.143 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.085+0000 7fc8493d9640 1 -- 10.20.193.49:0/2584370339 --> v2:10.20.193.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8440c9ea0 con 0x7fc8440d1b60 2026-02-17T11:10:35.143 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.085+0000 7f993effd640 1 --2- 10.20.193.49:0/2782315169 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f9924004900 0x7f9924004d80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f993000c320 tx=0x7f993002f5b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4839b757e982581f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.143 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.085+0000 7fa55b577640 1 --2- 10.20.193.49:0/353134677 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fa55c15b290 0x7fa55c142760 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa54c03a040 tx=0x7fa54c004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.143 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.085+0000 7feccdffb640 1 -- 10.20.193.49:0/3134872779 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc403c070 con 0x7fecd0152700 2026-02-17T11:10:35.143 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.085+0000 7feccdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.143 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.085+0000 7feccdffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:10:35.143 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.085+0000 7feccdffb640 10 monclient: dump: 2026-02-17T11:10:35.143 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.143 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.143 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.143 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.143 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.143 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.143 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.143 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.143 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.143 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.143 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.085+0000 7feccdffb640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.143 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.085+0000 7feccdffb640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.143 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.085+0000 7feccdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.143 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.085+0000 7feccdffb640 1 -- 10.20.193.49:0/3134872779 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecc402fad0 con 0x7fecd0152700 2026-02-17T11:10:35.143 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.085+0000 7feccdffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.143 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.085+0000 7feccdffb640 1 -- 10.20.193.49:0/3134872779 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc4037440 con 0x7fecd0152700 2026-02-17T11:10:35.143 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.085+0000 7feccdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.143 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.085+0000 7feccdffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:10:35.144 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.085+0000 7feccdffb640 10 monclient: dump: 2026-02-17T11:10:35.144 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.144 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.144 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.144 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.144 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.144 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.144 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.144 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.144 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.144 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.144 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.085+0000 7fecd52a7640 5 monclient: authenticate success, global_id 4425 2026-02-17T11:10:35.144 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.085+0000 7fecd52a7640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:35.144 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.085+0000 7fecd52a7640 4 set_mon_vals no callback set 2026-02-17T11:10:35.144 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.085+0000 7fa53b7fe640 10 client.?.objecter ms_handle_connect 0x7fa55c15b290 2026-02-17T11:10:35.144 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.085+0000 7fa53b7fe640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:35.144 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.086+0000 7fecd52a7640 10 monclient: shutdown 2026-02-17T11:10:35.144 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.086+0000 7fecd52a7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:35.144 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.086+0000 7fecd52a7640 1 -- 10.20.193.49:0/3134872779 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fecd0152700 msgr2=0x7fecd015e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.144 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.086+0000 7fecd52a7640 1 --2- 10.20.193.49:0/3134872779 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fecd0152700 0x7fecd015e870 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fecc40098a0 tx=0x7fecc402ee10 comp rx=0 tx=0).stop 2026-02-17T11:10:35.144 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.086+0000 7fecd52a7640 1 -- 10.20.193.49:0/3134872779 shutdown_connections 2026-02-17T11:10:35.144 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.086+0000 7fecd52a7640 1 --2- 10.20.193.49:0/3134872779 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fecd0152700 0x7fecd015e870 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.144 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.086+0000 7fecd52a7640 1 -- 10.20.193.49:0/3134872779 >> 10.20.193.49:0/3134872779 conn(0x7fecd0073030 msgr2=0x7fecd0073440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:35.144 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.086+0000 7fecd52a7640 1 -- 10.20.193.49:0/3134872779 shutdown_connections 2026-02-17T11:10:35.144 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.086+0000 7fecd52a7640 1 -- 10.20.193.49:0/3134872779 wait complete. 2026-02-17T11:10:35.145 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.086+0000 7f6dcdffb640 1 -- 10.20.193.49:0/2905367551 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc002fcd0 con 0x7f6dd0152ae0 2026-02-17T11:10:35.145 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.086+0000 7f6dcdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.145 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.086+0000 7f6dcdffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:10:35.145 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.086+0000 7f6dcdffb640 10 monclient: dump: 2026-02-17T11:10:35.145 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.145 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.145 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.145 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.145 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.145 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.145 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.145 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.145 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.145 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.145 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.086+0000 7f6dcdffb640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.145 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.086+0000 7f6dcdffb640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.145 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.086+0000 7f6dcdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.145 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.086+0000 7f6dcdffb640 1 -- 10.20.193.49:0/2905367551 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dc00373f0 con 0x7f6dd0152ae0 2026-02-17T11:10:35.145 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.086+0000 7f6dd568f640 5 monclient: authenticate success, global_id 4419 2026-02-17T11:10:35.145 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.086+0000 7f6dcdffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.145 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.086+0000 7f6dcdffb640 1 -- 10.20.193.49:0/2905367551 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc00377c0 con 0x7f6dd0152ae0 2026-02-17T11:10:35.145 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.086+0000 7f6dd568f640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:35.145 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.086+0000 7f6dd568f640 4 set_mon_vals no callback set 2026-02-17T11:10:35.145 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.086+0000 7f6dcdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.145 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.086+0000 7f6dcdffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:10:35.145 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.086+0000 7f6dcdffb640 10 monclient: dump: 2026-02-17T11:10:35.145 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.145 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.145 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.145 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.145 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.145 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.145 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.145 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.146 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.146 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.146 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.086+0000 7f5e7bfff640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f5e7c0d1b60 0x7f5e7c0d1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.146 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.086+0000 7f7419be0640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f74140d1b60 0x7f74140d0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.146 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.087+0000 7ff79e7fc640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7ff7a015ef80 0x7ff7a00c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.146 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.087+0000 7fecd52a7640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.146 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.087+0000 7fecd52a7640 10 monclient: monmap: 2026-02-17T11:10:35.146 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.146 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:35.146 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:35.146 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:35.146 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.146 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.146 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:35.146 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:35.146 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:35.146 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.146 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.087+0000 7f5e7bfff640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f5e7c0d1b60 0x7f5e7c0d1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:32874/0 (socket says 10.20.193.49:32874) 2026-02-17T11:10:35.146 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.087+0000 7f5e7bfff640 1 -- 10.20.193.49:0/3532361460 learned_addr learned my addr 10.20.193.49:0/3532361460 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:35.146 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.087+0000 7f5e7bfff640 10 monclient(hunting): get_auth_request con 0x7f5e7c0d1b60 auth_method 0 2026-02-17T11:10:35.146 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.087+0000 7f6dd568f640 10 monclient: shutdown 2026-02-17T11:10:35.146 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.087+0000 7f6dd568f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:35.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.087+0000 7f5e7bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.087+0000 7f5e7bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.087+0000 7f5e7bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.087+0000 7f6dd568f640 1 -- 10.20.193.49:0/2905367551 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f6dd0152ae0 msgr2=0x7f6dd00c9c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.087+0000 7f6dd568f640 1 --2- 10.20.193.49:0/2905367551 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f6dd0152ae0 0x7f6dd00c9c70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6dd008e820 tx=0x7f6dc002f270 comp rx=0 tx=0).stop 2026-02-17T11:10:35.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.087+0000 7f6dd568f640 1 -- 10.20.193.49:0/2905367551 shutdown_connections 2026-02-17T11:10:35.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.087+0000 7f6dd568f640 1 --2- 10.20.193.49:0/2905367551 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f6dd0152ae0 0x7f6dd00c9c70 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.087+0000 7f6dd568f640 1 --2- 10.20.193.49:0/2905367551 >> v2:10.20.193.97:3300/0 conn(0x7f6dd015ef80 0x7f6dd00c9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.087+0000 7f6dd568f640 1 -- 10.20.193.49:0/2905367551 >> 10.20.193.49:0/2905367551 conn(0x7f6dd0073030 msgr2=0x7f6dd0073440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:35.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.087+0000 7f6dd568f640 1 -- 10.20.193.49:0/2905367551 shutdown_connections 2026-02-17T11:10:35.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.087+0000 7f6dd568f640 1 -- 10.20.193.49:0/2905367551 wait complete. 2026-02-17T11:10:35.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.087+0000 7fecd52a7640 1 librados: starting msgr at 2026-02-17T11:10:35.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.087+0000 7fecd52a7640 1 librados: starting objecter 2026-02-17T11:10:35.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.087+0000 7fecd52a7640 1 Processor -- start 2026-02-17T11:10:35.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.087+0000 7fecd52a7640 1 -- start start 2026-02-17T11:10:35.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.087+0000 7fecd52a7640 1 librados: setting wanted keys 2026-02-17T11:10:35.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.087+0000 7fecd52a7640 1 librados: calling monclient init 2026-02-17T11:10:35.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.087+0000 7fecd52a7640 10 monclient: init 2026-02-17T11:10:35.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.087+0000 7f6dd568f640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.087+0000 7f6dd568f640 10 monclient: monmap: 2026-02-17T11:10:35.148 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.148 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:35.148 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:35.148 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:35.148 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.148 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.148 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:35.148 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:35.148 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:35.148 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.087+0000 7fecd52a7640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.087+0000 7fecd52a7640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:10:35.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.087+0000 7fecd52a7640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fecd0152700 0x7fecd014c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.087+0000 7fecd52a7640 10 monclient(hunting): picked mon.noname-b con 0x7fecd0152700 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:35.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.087+0000 7fecd52a7640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fecd0152ae0 0x7fecd014cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.087+0000 7fecd52a7640 10 monclient(hunting): picked mon.noname-a con 0x7fecd0152ae0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:35.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.087+0000 7fecd52a7640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fecd015edb0 0x7fecd01f5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.087+0000 7f6dd568f640 1 librados: starting msgr at 2026-02-17T11:10:35.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.087+0000 7f6dd568f640 1 librados: starting objecter 2026-02-17T11:10:35.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.088+0000 7fecd52a7640 10 monclient(hunting): picked mon.noname-c con 0x7fecd015edb0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:35.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.088+0000 7fecd52a7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.088+0000 7fecd52a7640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fecd015e350 con 0x7fecd0152ae0 2026-02-17T11:10:35.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.088+0000 7fecd52a7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.088+0000 7fecd52a7640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fecd015e070 con 0x7fecd0152700 2026-02-17T11:10:35.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.088+0000 7fecd52a7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.088+0000 7fecd52a7640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fecd0166850 con 0x7fecd015edb0 2026-02-17T11:10:35.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.088+0000 7fecd52a7640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.088+0000 7fecd52a7640 10 monclient(hunting): authenticate will time out at 1111.751027s 2026-02-17T11:10:35.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.088+0000 7f6dd568f640 1 Processor -- start 2026-02-17T11:10:35.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.088+0000 7f6dd568f640 1 -- start start 2026-02-17T11:10:35.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.088+0000 7f6dd568f640 1 librados: setting wanted keys 2026-02-17T11:10:35.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.088+0000 7f6dd568f640 1 librados: calling monclient init 2026-02-17T11:10:35.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.088+0000 7f6dd568f640 10 monclient: init 2026-02-17T11:10:35.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.088+0000 7f7419be0640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f74140d1b60 0x7f74140d0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:55844/0 (socket says 10.20.193.49:55844) 2026-02-17T11:10:35.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.088+0000 7f7419be0640 1 -- 10.20.193.49:0/2659158390 learned_addr learned my addr 10.20.193.49:0/2659158390 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:35.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.088+0000 7f7419be0640 10 monclient(hunting): get_auth_request con 0x7f74140d1b60 auth_method 0 2026-02-17T11:10:35.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.088+0000 7f7419be0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.088+0000 7f7419be0640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.088+0000 7f7419be0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.088+0000 7fc8493d9640 1 --2- 10.20.193.49:0/2584370339 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc8440d1b60 0x7fc8440d1f40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc8340098a0 tx=0x7fc83402ee10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef12387d6e305424 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.088+0000 7ff79e7fc640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7ff7a015ef80 0x7ff7a00c9730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:55838/0 (socket says 10.20.193.49:55838) 2026-02-17T11:10:35.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.088+0000 7ff79e7fc640 1 -- 10.20.193.49:0/519375284 learned_addr learned my addr 10.20.193.49:0/519375284 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:35.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.088+0000 7ff79e7fc640 10 monclient(hunting): get_auth_request con 0x7ff7a015ef80 auth_method 0 2026-02-17T11:10:35.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.088+0000 7ff79e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.088+0000 7ff79e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.088+0000 7ff79e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.088+0000 7f6dd568f640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.088+0000 7f6dd568f640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:10:35.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.088+0000 7f6dd568f640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f6dd0152700 0x7f6dd0159670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.088+0000 7f6dd568f640 10 monclient(hunting): picked mon.noname-a con 0x7f6dd0152700 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:35.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.088+0000 7f6dd568f640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f6dd0152ae0 0x7f6dd01484e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.088+0000 7f6dd568f640 10 monclient(hunting): picked mon.noname-c con 0x7f6dd0152ae0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:35.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.088+0000 7f7419be0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.088+0000 7f7419be0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.088+0000 7f7419be0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.088+0000 7f6dd568f640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f6dd015ef80 0x7f6dd00c6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.088+0000 7f5e7bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.088+0000 7f5e7bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.088+0000 7f5e7bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.151 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.088+0000 7f6dd568f640 10 monclient(hunting): picked mon.noname-b con 0x7f6dd015ef80 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:35.151 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.088+0000 7f6dd568f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.151 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.088+0000 7f6dd568f640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd00ca1b0 con 0x7f6dd0152700 2026-02-17T11:10:35.151 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.088+0000 7f6dd568f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.151 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.088+0000 7f6dd568f640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd015e350 con 0x7f6dd015ef80 2026-02-17T11:10:35.151 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.088+0000 7f6dd568f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.151 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.088+0000 7f6dd568f640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd00ca330 con 0x7f6dd0152ae0 2026-02-17T11:10:35.151 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.088+0000 7f6dd568f640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.151 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.088+0000 7f6dd568f640 10 monclient(hunting): authenticate will time out at 1111.751764s 2026-02-17T11:10:35.151 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.088+0000 7f104b7fe640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f104c0d1f40 0x7f104c1514d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.151 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.089+0000 7ff79e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.151 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.089+0000 7ff79e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.151 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.089+0000 7ff79e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.089+0000 7fe9ccff9640 1 -- 10.20.193.49:0/4131833758 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c0017070 con 0x7fe9d00ceef0 2026-02-17T11:10:35.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.090+0000 7fe9ccff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.090+0000 7fe9ccff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:10:35.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.090+0000 7fe9ccff9640 10 monclient: dump: 2026-02-17T11:10:35.152 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.152 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.152 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.152 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.152 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.152 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.152 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.152 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.152 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.152 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.090+0000 7fe9ccff9640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.090+0000 7fe9ccff9640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.090+0000 7fe9ccff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.090+0000 7fe9ccff9640 1 -- 10.20.193.49:0/4131833758 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9c000c8d0 con 0x7fe9d00ceef0 2026-02-17T11:10:35.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.090+0000 7fe9d62fc640 5 monclient: authenticate success, global_id 4422 2026-02-17T11:10:35.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.090+0000 7fe9d62fc640 10 monclient: _renew_subs 2026-02-17T11:10:35.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.090+0000 7fe9d62fc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:35.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.090+0000 7fe9d62fc640 1 -- 10.20.193.49:0/4131833758 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9d01f3a80 con 0x7fe9d00ceef0 2026-02-17T11:10:35.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.090+0000 7fe9ccff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.090+0000 7fe9ccff9640 1 -- 10.20.193.49:0/4131833758 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c000f040 con 0x7fe9d00ceef0 2026-02-17T11:10:35.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.090+0000 7fe9ccff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.090+0000 7fe9ccff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:10:35.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.090+0000 7fe9ccff9640 10 monclient: dump: 2026-02-17T11:10:35.152 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.152 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.152 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.152 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.152 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.152 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.152 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.152 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.152 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.152 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.090+0000 7fe9ce7fc640 4 set_mon_vals no callback set 2026-02-17T11:10:35.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.090+0000 7fe9d62fc640 10 client.4422.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:35.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.090+0000 7fe9d62fc640 10 monclient: _renew_subs 2026-02-17T11:10:35.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.090+0000 7fe9d62fc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:35.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.090+0000 7fe9d62fc640 1 -- 10.20.193.49:0/4131833758 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9d01f4040 con 0x7fe9d00ceef0 2026-02-17T11:10:35.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.090+0000 7fe9d62fc640 1 librados: init done 2026-02-17T11:10:35.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.090+0000 7fe9aa7fc640 10 client.4422.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:35.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.090+0000 7fe9aa7fc640 15 client.4422.objecter _session_command_op_assign -1 1 2026-02-17T11:10:35.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.090+0000 7fe9aa7fc640 20 client.4422.objecter _get_session osd=-1 returning homeless 2026-02-17T11:10:35.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.090+0000 7fe9aa7fc640 10 client.4422.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:35.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.090+0000 7fe9aa7fc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:35.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.090+0000 7fe9aa7fc640 1 -- 10.20.193.49:0/4131833758 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe994004120 con 0x7fe9d00ceef0 2026-02-17T11:10:35.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.090+0000 7f7419be0640 10 monclient(hunting): handle_auth_done global_id 4448 payload 824 2026-02-17T11:10:35.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.090+0000 7f7419be0640 1 -- 10.20.193.49:0/2659158390 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f74140ca100 msgr2=0x7f7414164510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.090+0000 7f7419be0640 1 --2- 10.20.193.49:0/2659158390 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f74140ca100 0x7f7414164510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.090+0000 7f7419be0640 1 -- 10.20.193.49:0/2659158390 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f74140d1f40 msgr2=0x7f74141f7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.090+0000 7f7419be0640 1 --2- 10.20.193.49:0/2659158390 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f74140d1f40 0x7f74141f7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.090+0000 7f7419be0640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.090+0000 7f7419be0640 1 monclient: found mon.noname-c 2026-02-17T11:10:35.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.090+0000 7f5e7bfff640 10 monclient(hunting): handle_auth_done global_id 4431 payload 274 2026-02-17T11:10:35.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.090+0000 7f5e7bfff640 1 -- 10.20.193.49:0/3532361460 >> v1:10.20.193.157:6789/0 conn(0x7f5e7c15d950 legacy=0x7f5e7c15dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:35.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.090+0000 7f5e7bfff640 1 -- 10.20.193.49:0/3532361460 >> v1:10.20.193.49:6789/0 conn(0x7f5e7c15c840 legacy=0x7f5e7c0c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:35.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.090+0000 7f5e7bfff640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.090+0000 7f5e7bfff640 1 monclient: found mon.noname-a 2026-02-17T11:10:35.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.090+0000 7f5e7bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.090+0000 7f5e7bfff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:10:35.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.090+0000 7f7419be0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.090+0000 7f7419be0640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:10:35.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.090+0000 7f7419be0640 1 -- 10.20.193.49:0/2659158390 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7414164a50 con 0x7f74140d1b60 2026-02-17T11:10:35.154 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.090+0000 7f5e7bfff640 1 -- 10.20.193.49:0/3532361460 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e7c0c9ea0 con 0x7f5e7c0d1b60 2026-02-17T11:10:35.154 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.091+0000 7faed1405640 1 --2- 10.20.193.49:0/4074054069 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7faeb4004900 0x7faeb4004d80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7faec000c2f0 tx=0x7faec002f630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ff1a1cca1a57126 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.154 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.091+0000 7f104b7fe640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f104c0d1f40 0x7f104c1514d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:32900/0 (socket says 10.20.193.49:32900) 2026-02-17T11:10:35.154 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.091+0000 7f104b7fe640 1 -- 10.20.193.49:0/3068591869 learned_addr learned my addr 10.20.193.49:0/3068591869 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:35.154 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.091+0000 7f104b7fe640 10 monclient(hunting): get_auth_request con 0x7f104c0d1f40 auth_method 0 2026-02-17T11:10:35.154 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.091+0000 7f104b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.154 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.091+0000 7f104b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.154 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.091+0000 7f104b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.154 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.091+0000 7ff79e7fc640 10 monclient(hunting): handle_auth_done global_id 4451 payload 274 2026-02-17T11:10:35.154 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.091+0000 7ff79e7fc640 1 -- 10.20.193.49:0/519375284 >> v1:10.20.193.157:6789/0 conn(0x7ff7a0152ae0 legacy=0x7ff7a00c9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:35.154 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.091+0000 7ff79e7fc640 1 -- 10.20.193.49:0/519375284 >> v1:10.20.193.49:6789/0 conn(0x7ff7a0152700 legacy=0x7ff7a015e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:35.154 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.091+0000 7ff79e7fc640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.154 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.091+0000 7ff79e7fc640 1 monclient: found mon.noname-c 2026-02-17T11:10:35.154 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.091+0000 7ff79e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.154 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.091+0000 7ff79e7fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:10:35.154 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.091+0000 7ff79e7fc640 1 -- 10.20.193.49:0/519375284 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7a015dd90 con 0x7ff7a015ef80 2026-02-17T11:10:35.154 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.092+0000 7f104b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.154 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.092+0000 7f104b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.154 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.092+0000 7f104b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.155 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.092+0000 7f5e7bfff640 1 --2- 10.20.193.49:0/3532361460 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5e7c0d1b60 0x7f5e7c0d1f40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5e68009970 tx=0x7f5e6802eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dac0ec9ff4df411 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.155 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.093+0000 7f7419be0640 1 --2- 10.20.193.49:0/2659158390 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f74140d1b60 0x7f74140d0b60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f740800b780 tx=0x7f740800bc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.155 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.093+0000 7f73faffd640 10 client.?.objecter ms_handle_connect 0x7f74140d1b60 2026-02-17T11:10:35.155 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.093+0000 7f73faffd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:35.155 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.093+0000 7ff79e7fc640 1 --2- 10.20.193.49:0/519375284 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff7a015ef80 0x7ff7a00c9730 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff788009970 tx=0x7ff78802eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5adcb7c9b5dae231 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.155 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.094+0000 7f104b7fe640 10 monclient(hunting): handle_auth_done global_id 4434 payload 824 2026-02-17T11:10:35.155 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.094+0000 7f104b7fe640 1 -- 10.20.193.49:0/3068591869 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f104c0d1b60 msgr2=0x7f104c200e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.155 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.094+0000 7f104b7fe640 1 --2- 10.20.193.49:0/3068591869 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f104c0d1b60 0x7f104c200e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.155 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.094+0000 7f104b7fe640 1 -- 10.20.193.49:0/3068591869 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f104c15e060 msgr2=0x7f104c14b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.155 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.094+0000 7f104b7fe640 1 --2- 10.20.193.49:0/3068591869 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f104c15e060 0x7f104c14b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.155 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.094+0000 7f104b7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.155 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.094+0000 7f104b7fe640 1 monclient: found mon.noname-a 2026-02-17T11:10:35.155 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.094+0000 7f104b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.155 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.094+0000 7f104b7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:10:35.155 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.094+0000 7f104b7fe640 1 -- 10.20.193.49:0/3068591869 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f104c203ad0 con 0x7f104c0d1f40 2026-02-17T11:10:35.155 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.094+0000 7f84d9ffb640 1 -- 10.20.193.49:0/39859385 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d003c070 con 0x7f84dc153be0 2026-02-17T11:10:35.155 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.094+0000 7f84d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.156 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.094+0000 7f84d9ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:10:35.156 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.094+0000 7f84d9ffb640 10 monclient: dump: 2026-02-17T11:10:35.156 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.156 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.156 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.156 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.156 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.156 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.156 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.156 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.156 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.156 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.156 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.094+0000 7f84d9ffb640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.156 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.094+0000 7f84d9ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.156 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.094+0000 7f84d9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.156 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.094+0000 7f84d9ffb640 1 -- 10.20.193.49:0/39859385 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84d002fbd0 con 0x7f84dc153be0 2026-02-17T11:10:35.156 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.094+0000 7f84d9ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.156 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.094+0000 7f84d9ffb640 1 -- 10.20.193.49:0/39859385 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d0037440 con 0x7f84dc153be0 2026-02-17T11:10:35.156 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.094+0000 7f84d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.156 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.094+0000 7f84d9ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:35.156 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.094+0000 7f84d9ffb640 10 monclient: dump: 2026-02-17T11:10:35.156 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.156 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.156 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.156 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.156 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.156 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.156 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.156 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.156 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.156 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.156 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.094+0000 7f84e1553640 5 monclient: authenticate success, global_id 4426 2026-02-17T11:10:35.156 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.094+0000 7f84e1553640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:35.156 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.094+0000 7f84e1553640 4 set_mon_vals no callback set 2026-02-17T11:10:35.156 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.095+0000 7f84e1553640 10 monclient: shutdown 2026-02-17T11:10:35.156 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.095+0000 7f84e1553640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:35.156 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.095+0000 7f84e1553640 1 -- 10.20.193.49:0/39859385 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f84dc153be0 msgr2=0x7f84dc0cb930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.156 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.095+0000 7f84e1553640 1 --2- 10.20.193.49:0/39859385 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f84dc153be0 0x7f84dc0cb930 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f84dc0747c0 tx=0x7f84d002ef60 comp rx=0 tx=0).stop 2026-02-17T11:10:35.156 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.095+0000 7f84e1553640 1 -- 10.20.193.49:0/39859385 shutdown_connections 2026-02-17T11:10:35.156 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.095+0000 7f84e1553640 1 --2- 10.20.193.49:0/39859385 >> v2:10.20.193.49:3300/0 conn(0x7f84dc153fc0 0x7f84dc0c6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.157 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.095+0000 7f84e1553640 1 --2- 10.20.193.49:0/39859385 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f84dc153be0 0x7f84dc0cb930 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.157 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.095+0000 7f84e1553640 1 -- 10.20.193.49:0/39859385 >> 10.20.193.49:0/39859385 conn(0x7f84dc0cf670 msgr2=0x7f84dc0cfa80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:35.157 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.095+0000 7feec7fff640 1 -- 10.20.193.49:0/2599867942 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feedc03c050 con 0x7feeec0d1f40 2026-02-17T11:10:35.157 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.095+0000 7feec7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.157 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.095+0000 7feec7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:10:35.157 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.095+0000 7feec7fff640 10 monclient: dump: 2026-02-17T11:10:35.157 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.157 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.157 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.157 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.157 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.157 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.157 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.157 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.157 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.157 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.157 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.095+0000 7feec7fff640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.157 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.095+0000 7feec7fff640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.157 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.095+0000 7feec7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.157 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.095+0000 7feec7fff640 1 -- 10.20.193.49:0/2599867942 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feedc03d040 con 0x7feeec0d1f40 2026-02-17T11:10:35.157 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.095+0000 7feef21a0640 5 monclient: authenticate success, global_id 4442 2026-02-17T11:10:35.157 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.095+0000 7feec7fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.157 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.095+0000 7feec7fff640 1 -- 10.20.193.49:0/2599867942 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feedc041b50 con 0x7feeec0d1f40 2026-02-17T11:10:35.157 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.095+0000 7feef21a0640 10 monclient: _renew_subs 2026-02-17T11:10:35.157 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.095+0000 7feef21a0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:35.157 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.095+0000 7feef21a0640 1 -- 10.20.193.49:0/2599867942 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feeec157990 con 0x7feeec0d1f40 2026-02-17T11:10:35.157 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.095+0000 7feec7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.157 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.095+0000 7feee9ffb640 4 set_mon_vals no callback set 2026-02-17T11:10:35.157 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.095+0000 7feec7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:10:35.158 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.095+0000 7feec7fff640 10 monclient: dump: 2026-02-17T11:10:35.158 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.158 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.158 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.158 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.158 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.158 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.158 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.158 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.158 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.158 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.158 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.095+0000 7f84e1553640 1 -- 10.20.193.49:0/39859385 shutdown_connections 2026-02-17T11:10:35.158 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.095+0000 7feef21a0640 10 client.4442.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:35.158 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.095+0000 7feef21a0640 10 monclient: _renew_subs 2026-02-17T11:10:35.158 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.095+0000 7feef21a0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:35.158 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.095+0000 7feef21a0640 1 -- 10.20.193.49:0/2599867942 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feeec157f50 con 0x7feeec0d1f40 2026-02-17T11:10:35.158 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.095+0000 7f84e1553640 1 -- 10.20.193.49:0/39859385 wait complete. 2026-02-17T11:10:35.158 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.095+0000 7feef21a0640 1 librados: init done 2026-02-17T11:10:35.158 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7f3fa6ffd640 1 -- 10.20.193.49:0/3105715253 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f9803c070 con 0x7f3fa815ef80 2026-02-17T11:10:35.158 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7f3fa6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.158 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7f6dceffd640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f6dd0152700 0x7f6dd0159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7f3fa6ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:10:35.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7f3fa6ffd640 10 monclient: dump: 2026-02-17T11:10:35.159 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.159 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.159 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.159 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.159 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.159 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.159 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.159 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.159 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.159 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7f3fa6ffd640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7f3fa6ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7f3fa6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7f3fa6ffd640 1 -- 10.20.193.49:0/3105715253 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f9802fb00 con 0x7f3fa815ef80 2026-02-17T11:10:35.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7f3fa6ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7f3fa6ffd640 1 -- 10.20.193.49:0/3105715253 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f98037440 con 0x7f3fa815ef80 2026-02-17T11:10:35.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7f3fa6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7f3fa6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:35.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7f993e7fc640 1 -- 10.20.193.49:0/2782315169 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9930007dc0 con 0x7f9924004900 2026-02-17T11:10:35.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7f3fa6ffd640 10 monclient: dump: 2026-02-17T11:10:35.159 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.159 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.159 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.159 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.159 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.160 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.160 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.160 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.160 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.160 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7f993e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7f993e7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:35.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7f993e7fc640 10 monclient: dump: 2026-02-17T11:10:35.160 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.160 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.160 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.160 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.160 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.160 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.160 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.160 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.160 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.160 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7f993e7fc640 1 -- 10.20.193.49:0/2782315169 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9930005bf0 con 0x7f9924004900 2026-02-17T11:10:35.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7f993e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7f993e7fc640 1 -- 10.20.193.49:0/2782315169 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99300072b0 con 0x7f9924004900 2026-02-17T11:10:35.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7f993e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7f993e7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:35.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7f993e7fc640 10 monclient: dump: 2026-02-17T11:10:35.160 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.160 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.160 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.160 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.160 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.160 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.160 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.160 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.160 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.160 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.161 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7f9945a8f640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:35.161 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7f9945a8f640 4 set_mon_vals no callback set 2026-02-17T11:10:35.161 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7feef21a0640 10 client.4442.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:35.161 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7feef21a0640 15 client.4442.objecter _session_command_op_assign -1 1 2026-02-17T11:10:35.161 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7feef21a0640 20 client.4442.objecter _get_session osd=-1 returning homeless 2026-02-17T11:10:35.161 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7feef21a0640 10 client.4442.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:35.161 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7feef21a0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:35.161 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7feef21a0640 1 -- 10.20.193.49:0/2599867942 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7feeec15c840 con 0x7feeec0d1f40 2026-02-17T11:10:35.161 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7f84e1553640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.161 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7f84e1553640 10 monclient: monmap: 2026-02-17T11:10:35.161 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.161 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:35.161 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:35.161 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:35.161 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.161 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.161 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:35.161 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:35.161 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:35.161 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.161 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7f3fae396640 5 monclient: authenticate success, global_id 4420 2026-02-17T11:10:35.162 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7f3fae396640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:35.162 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7f3fae396640 4 set_mon_vals no callback set 2026-02-17T11:10:35.162 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7f3fae396640 10 monclient: shutdown 2026-02-17T11:10:35.162 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7f3fae396640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:35.162 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7f3fae396640 1 -- 10.20.193.49:0/3105715253 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f3fa815ef80 msgr2=0x7f3fa80c9730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.162 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7f3fae396640 1 --2- 10.20.193.49:0/3105715253 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f3fa815ef80 0x7f3fa80c9730 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3fa80cbf60 tx=0x7f3f9802edf0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.162 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7f9945a8f640 10 monclient: shutdown 2026-02-17T11:10:35.162 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7f9945a8f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:35.162 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7f9945a8f640 1 -- 10.20.193.49:0/2782315169 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f9924004900 msgr2=0x7f9924004d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.162 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7f9945a8f640 1 --2- 10.20.193.49:0/2782315169 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f9924004900 0x7f9924004d80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f993000c320 tx=0x7f993002f5b0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.162 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7faed0c04640 1 -- 10.20.193.49:0/4074054069 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec0007e60 con 0x7faeb4004900 2026-02-17T11:10:35.162 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7faed0c04640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.162 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7faed0c04640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:35.162 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7faed0c04640 10 monclient: dump: 2026-02-17T11:10:35.162 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.162 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.162 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.162 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.162 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.162 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.162 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.162 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.162 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.162 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.162 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7faed0c04640 1 -- 10.20.193.49:0/4074054069 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faec0005bd0 con 0x7faeb4004900 2026-02-17T11:10:35.162 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7faed3e91640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:10:35.163 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7f84e1553640 1 librados: starting msgr at 2026-02-17T11:10:35.163 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7f84e1553640 1 librados: starting objecter 2026-02-17T11:10:35.163 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7faed0c04640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.163 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7faed0c04640 1 -- 10.20.193.49:0/4074054069 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec0007070 con 0x7faeb4004900 2026-02-17T11:10:35.163 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7faed0c04640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.163 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7faed0c04640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:35.163 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7faed0c04640 10 monclient: dump: 2026-02-17T11:10:35.163 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.163 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.163 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.163 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.163 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.163 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.163 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.163 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.163 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.163 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.163 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7faed3e91640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:35.163 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7faed3e91640 4 set_mon_vals no callback set 2026-02-17T11:10:35.163 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7f84e1553640 1 Processor -- start 2026-02-17T11:10:35.163 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7f9945a8f640 1 -- 10.20.193.49:0/2782315169 shutdown_connections 2026-02-17T11:10:35.164 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7f9945a8f640 1 --2- 10.20.193.49:0/2782315169 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f9924004900 0x7f9924004d80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.164 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7f9945a8f640 1 -- 10.20.193.49:0/2782315169 >> 10.20.193.49:0/2782315169 conn(0x7f9940073030 msgr2=0x7f9940073440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:35.164 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7f84e1553640 1 -- start start 2026-02-17T11:10:35.164 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7f84e1553640 1 librados: setting wanted keys 2026-02-17T11:10:35.164 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7f9945a8f640 1 -- 10.20.193.49:0/2782315169 shutdown_connections 2026-02-17T11:10:35.164 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7f84e1553640 1 librados: calling monclient init 2026-02-17T11:10:35.164 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.096+0000 7f84e1553640 10 monclient: init 2026-02-17T11:10:35.164 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7f3fae396640 1 -- 10.20.193.49:0/3105715253 shutdown_connections 2026-02-17T11:10:35.164 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7f3fae396640 1 --2- 10.20.193.49:0/3105715253 >> v2:10.20.193.157:3300/0 conn(0x7f3fa8152ae0 0x7f3fa80c9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.164 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7f3fae396640 1 --2- 10.20.193.49:0/3105715253 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f3fa815ef80 0x7f3fa80c9730 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.164 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7f3fae396640 1 -- 10.20.193.49:0/3105715253 >> 10.20.193.49:0/3105715253 conn(0x7f3fa8073030 msgr2=0x7f3fa8073440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:35.164 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7f84e1553640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.164 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7f84e1553640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:10:35.164 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7f84e1553640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f84dc153be0 0x7f84dc071140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.164 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7f84e1553640 10 monclient(hunting): picked mon.noname-c con 0x7f84dc153be0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:35.164 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7f84e1553640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f84dc153fc0 0x7f84dc1f2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.164 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7f84e1553640 10 monclient(hunting): picked mon.noname-b con 0x7f84dc153fc0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:35.164 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7f84e1553640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f84dc15b0c0 0x7f84dc1f0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.165 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7f3fae396640 1 -- 10.20.193.49:0/3105715253 shutdown_connections 2026-02-17T11:10:35.165 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7f3fae396640 1 -- 10.20.193.49:0/3105715253 wait complete. 2026-02-17T11:10:35.165 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7f84e1553640 10 monclient(hunting): picked mon.noname-a con 0x7f84dc15b0c0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:35.165 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7f84e1553640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.165 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7f84e1553640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f84dc0cb410 con 0x7f84dc15b0c0 2026-02-17T11:10:35.165 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7f84e1553640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.165 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7f84e1553640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f84dc0cb130 con 0x7f84dc153fc0 2026-02-17T11:10:35.165 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7f84e1553640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.165 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7f84e1553640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f84dc15d8d0 con 0x7f84dc153be0 2026-02-17T11:10:35.165 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7f84e1553640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.165 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7f84e1553640 10 monclient(hunting): authenticate will time out at 1111.760251s 2026-02-17T11:10:35.165 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7faed3e91640 10 monclient: shutdown 2026-02-17T11:10:35.165 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7faed3e91640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:35.165 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7faed3e91640 1 -- 10.20.193.49:0/4074054069 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7faeb4004900 msgr2=0x7faeb4004d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.165 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7faed3e91640 1 --2- 10.20.193.49:0/4074054069 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7faeb4004900 0x7faeb4004d80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7faec000c2f0 tx=0x7faec002f630 comp rx=0 tx=0).stop 2026-02-17T11:10:35.165 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7f9945a8f640 1 -- 10.20.193.49:0/2782315169 wait complete. 2026-02-17T11:10:35.166 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7fc4d3fff640 1 -- 10.20.193.49:0/1843045386 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d803c070 con 0x7fc4e40d1f40 2026-02-17T11:10:35.166 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7fc4d3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.166 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7fc4d3fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:10:35.166 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7fc4d3fff640 10 monclient: dump: 2026-02-17T11:10:35.166 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.166 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.166 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.166 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.166 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.166 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.166 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.166 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.166 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.166 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.166 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7fc4d3fff640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.166 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7fc4d3fff640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.166 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7fc4d3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.166 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7fc4d3fff640 1 -- 10.20.193.49:0/1843045386 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4d802fb60 con 0x7fc4e40d1f40 2026-02-17T11:10:35.166 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7fc4d3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.166 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7fc4d3fff640 1 -- 10.20.193.49:0/1843045386 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d8037440 con 0x7fc4e40d1f40 2026-02-17T11:10:35.166 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7fc4eb2c4640 5 monclient: authenticate success, global_id 4423 2026-02-17T11:10:35.166 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7fc4eb2c4640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:35.166 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7fc4eb2c4640 4 set_mon_vals no callback set 2026-02-17T11:10:35.166 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7fc4d3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.166 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7fc4d3fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:35.166 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7fc4d3fff640 10 monclient: dump: 2026-02-17T11:10:35.166 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.166 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.166 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.166 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.166 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.166 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.166 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.166 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.166 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.166 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.167 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7f6dceffd640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f6dd0152700 0x7f6dd0159670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:32922/0 (socket says 10.20.193.49:32922) 2026-02-17T11:10:35.167 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7f6dceffd640 1 -- 10.20.193.49:0/2195715102 learned_addr learned my addr 10.20.193.49:0/2195715102 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:35.167 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7f6dceffd640 10 monclient(hunting): get_auth_request con 0x7f6dd0152700 auth_method 0 2026-02-17T11:10:35.167 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7f6dceffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.167 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7f6dceffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.167 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7f6dceffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.167 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7faed3e91640 1 -- 10.20.193.49:0/4074054069 shutdown_connections 2026-02-17T11:10:35.167 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7faed3e91640 1 --2- 10.20.193.49:0/4074054069 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7faeb4004900 0x7faeb4004d80 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.167 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7faed3e91640 1 -- 10.20.193.49:0/4074054069 >> 10.20.193.49:0/4074054069 conn(0x7faecc06d9b0 msgr2=0x7faecc06ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:35.167 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7faed3e91640 1 -- 10.20.193.49:0/4074054069 shutdown_connections 2026-02-17T11:10:35.167 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7f104b7fe640 1 --2- 10.20.193.49:0/3068591869 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f104c0d1f40 0x7f104c1514d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f103c00c760 tx=0x7f103c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.167 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7f1048ff9640 10 client.?.objecter ms_handle_connect 0x7f104c0d1f40 2026-02-17T11:10:35.167 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7f1048ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:35.167 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7f3fae396640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.167 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7f3fae396640 10 monclient: monmap: 2026-02-17T11:10:35.167 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.167 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:35.167 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:35.167 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:35.167 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.167 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.167 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:35.167 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:35.167 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:35.168 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.168 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7f3fae396640 1 librados: starting msgr at 2026-02-17T11:10:35.168 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7f3fae396640 1 librados: starting objecter 2026-02-17T11:10:35.168 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7f3fae396640 1 Processor -- start 2026-02-17T11:10:35.168 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7faed3e91640 1 -- 10.20.193.49:0/4074054069 wait complete. 2026-02-17T11:10:35.168 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7faed3e91640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.168 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7faed3e91640 10 monclient: monmap: 2026-02-17T11:10:35.168 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.168 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:35.168 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:35.168 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:35.168 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.168 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.168 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:35.168 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:35.168 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:35.168 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.168 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7fc833fff640 1 -- 10.20.193.49:0/2584370339 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc83403c070 con 0x7fc8440d1b60 2026-02-17T11:10:35.168 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7fc833fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.168 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7fc833fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:10:35.168 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7fc833fff640 10 monclient: dump: 2026-02-17T11:10:35.168 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.168 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.168 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.168 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.168 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.168 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.168 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.168 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.168 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.168 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.168 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7fc833fff640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.168 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7fc833fff640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.168 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7fc833fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.097+0000 7f9945a8f640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7fc833fff640 1 -- 10.20.193.49:0/2584370339 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc83402fad0 con 0x7fc8440d1b60 2026-02-17T11:10:35.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7fc833fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7fc833fff640 1 -- 10.20.193.49:0/2584370339 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc834037440 con 0x7fc8440d1b60 2026-02-17T11:10:35.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7fc84b664640 5 monclient: authenticate success, global_id 4435 2026-02-17T11:10:35.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7fc84b664640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:35.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7fc84b664640 4 set_mon_vals no callback set 2026-02-17T11:10:35.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7fc833fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7fc833fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:35.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7fc833fff640 10 monclient: dump: 2026-02-17T11:10:35.169 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.169 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.169 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.169 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.169 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.169 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.169 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.169 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.169 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.169 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7f3fae396640 1 -- start start 2026-02-17T11:10:35.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7f3fae396640 1 librados: setting wanted keys 2026-02-17T11:10:35.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7f3fae396640 1 librados: calling monclient init 2026-02-17T11:10:35.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7f3fae396640 10 monclient: init 2026-02-17T11:10:35.170 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7f9945a8f640 10 monclient: monmap: 2026-02-17T11:10:35.170 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.170 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:35.170 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:35.170 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:35.170 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.170 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.170 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:35.170 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:35.170 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:35.170 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.170 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7faed3e91640 1 librados: starting msgr at 2026-02-17T11:10:35.170 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7faed3e91640 1 librados: starting objecter 2026-02-17T11:10:35.170 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7faed3e91640 1 Processor -- start 2026-02-17T11:10:35.170 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7fc4eb2c4640 10 monclient: shutdown 2026-02-17T11:10:35.170 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7fc4eb2c4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:35.170 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7fc4eb2c4640 1 -- 10.20.193.49:0/1843045386 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc4e40d1f40 msgr2=0x7fc4e415c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.170 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7fc4eb2c4640 1 --2- 10.20.193.49:0/1843045386 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc4e40d1f40 0x7fc4e415c840 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc4d8009970 tx=0x7fc4d802eef0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.170 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7faed3e91640 1 -- start start 2026-02-17T11:10:35.170 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7faed3e91640 1 librados: setting wanted keys 2026-02-17T11:10:35.170 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7faed3e91640 1 librados: calling monclient init 2026-02-17T11:10:35.170 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7faed3e91640 10 monclient: init 2026-02-17T11:10:35.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7fecce7fc640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fecd0152ae0 0x7fecd014cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7f3fae396640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7f3fae396640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:10:35.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7f3fae396640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f3fa8152700 0x7f3fa82022b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7f3fae396640 10 monclient(hunting): picked mon.noname-a con 0x7f3fa8152700 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:35.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7f3fae396640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f3fa8152ae0 0x7f3fa80d03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7f3fae396640 10 monclient(hunting): picked mon.noname-c con 0x7f3fa8152ae0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:35.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7f3fae396640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f3fa815ef80 0x7f3fa81f7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7fc84b664640 10 monclient: shutdown 2026-02-17T11:10:35.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7fc84b664640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:35.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7fc84b664640 1 -- 10.20.193.49:0/2584370339 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc8440d1b60 msgr2=0x7fc8440d1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7fc84b664640 1 --2- 10.20.193.49:0/2584370339 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc8440d1b60 0x7fc8440d1f40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc8340098a0 tx=0x7fc83402ee10 comp rx=0 tx=0).stop 2026-02-17T11:10:35.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7fc4eb2c4640 1 -- 10.20.193.49:0/1843045386 shutdown_connections 2026-02-17T11:10:35.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7fc4eb2c4640 1 --2- 10.20.193.49:0/1843045386 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc4e40d1f40 0x7fc4e415c840 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7fc4eb2c4640 1 -- 10.20.193.49:0/1843045386 >> 10.20.193.49:0/1843045386 conn(0x7fc4e406d9b0 msgr2=0x7fc4e406ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:35.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7f3fae396640 10 monclient(hunting): picked mon.noname-b con 0x7f3fa815ef80 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:35.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7f3fae396640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7f3fae396640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa80ca1b0 con 0x7f3fa8152700 2026-02-17T11:10:35.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7f3fae396640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7f3fae396640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa815e350 con 0x7f3fa815ef80 2026-02-17T11:10:35.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7f3fae396640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7f3fae396640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa80ca330 con 0x7f3fa8152ae0 2026-02-17T11:10:35.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7f3fae396640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7f3fae396640 10 monclient(hunting): authenticate will time out at 1111.761490s 2026-02-17T11:10:35.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7f9945a8f640 1 librados: starting msgr at 2026-02-17T11:10:35.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7f9945a8f640 1 librados: starting objecter 2026-02-17T11:10:35.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7f9945a8f640 1 Processor -- start 2026-02-17T11:10:35.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7fc4eb2c4640 1 -- 10.20.193.49:0/1843045386 shutdown_connections 2026-02-17T11:10:35.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7f9945a8f640 1 -- start start 2026-02-17T11:10:35.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7f9945a8f640 1 librados: setting wanted keys 2026-02-17T11:10:35.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7f9945a8f640 1 librados: calling monclient init 2026-02-17T11:10:35.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7f9945a8f640 10 monclient: init 2026-02-17T11:10:35.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7fc4eb2c4640 1 -- 10.20.193.49:0/1843045386 wait complete. 2026-02-17T11:10:35.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7faed3e91640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7faed3e91640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:10:35.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7faed3e91640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7faeb4004900 0x7faecc15d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7faed3e91640 10 monclient(hunting): picked mon.noname-c con 0x7faeb4004900 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:35.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7faed3e91640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7faecc15f6f0 0x7faecc202c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7fc84b664640 1 -- 10.20.193.49:0/2584370339 shutdown_connections 2026-02-17T11:10:35.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7fc84b664640 1 --2- 10.20.193.49:0/2584370339 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc8440d1b60 0x7fc8440d1f40 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7fc84b664640 1 -- 10.20.193.49:0/2584370339 >> 10.20.193.49:0/2584370339 conn(0x7fc84406d9b0 msgr2=0x7fc84406ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:35.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7fc84b664640 1 -- 10.20.193.49:0/2584370339 shutdown_connections 2026-02-17T11:10:35.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7fc84b664640 1 -- 10.20.193.49:0/2584370339 wait complete. 2026-02-17T11:10:35.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7faed3e91640 10 monclient(hunting): picked mon.noname-b con 0x7faecc15f6f0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:35.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7faed3e91640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7faecc15fb70 0x7faecc2031b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7faed3e91640 10 monclient(hunting): picked mon.noname-a con 0x7faecc15fb70 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:35.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7faed3e91640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7faed3e91640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7faecc06e820 con 0x7faecc15fb70 2026-02-17T11:10:35.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7faed3e91640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7faed3e91640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7faecc0c9730 con 0x7faecc15f6f0 2026-02-17T11:10:35.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7faed3e91640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7faed3e91640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7faecc1611b0 con 0x7faeb4004900 2026-02-17T11:10:35.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7faed3e91640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.098+0000 7faed3e91640 10 monclient(hunting): authenticate will time out at 1111.761777s 2026-02-17T11:10:35.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7fc4eb2c4640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7fc4eb2c4640 10 monclient: monmap: 2026-02-17T11:10:35.173 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.173 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:35.173 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:35.173 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:35.173 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.173 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.173 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:35.173 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:35.173 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:35.173 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7fc84b664640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7fc84b664640 10 monclient: monmap: 2026-02-17T11:10:35.173 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.173 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:35.174 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:35.174 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:35.174 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.174 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.174 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:35.174 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:35.174 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:35.174 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7f9945a8f640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7f9945a8f640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:10:35.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7f9945a8f640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f9924004900 0x7f99401474b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7f9945a8f640 10 monclient(hunting): picked mon.noname-c con 0x7f9924004900 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:35.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7f9945a8f640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f994014a4a0 0x7f994014b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7f9945a8f640 10 monclient(hunting): picked mon.noname-b con 0x7f994014a4a0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:35.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7f9945a8f640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f994014b870 0x7f994014f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7fc4eb2c4640 1 librados: starting msgr at 2026-02-17T11:10:35.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7fc4eb2c4640 1 librados: starting objecter 2026-02-17T11:10:35.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7f9945a8f640 10 monclient(hunting): picked mon.noname-a con 0x7f994014b870 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:35.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7f9945a8f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7f9945a8f640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f99400cbc30 con 0x7f994014b870 2026-02-17T11:10:35.175 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7fc4eb2c4640 1 Processor -- start 2026-02-17T11:10:35.175 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7fc84b664640 1 librados: starting msgr at 2026-02-17T11:10:35.175 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7fc84b664640 1 librados: starting objecter 2026-02-17T11:10:35.175 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7f9945a8f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.175 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7f9945a8f640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f99400c9260 con 0x7f994014a4a0 2026-02-17T11:10:35.175 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7f9945a8f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.175 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7f9945a8f640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f99401f38a0 con 0x7f9924004900 2026-02-17T11:10:35.175 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7f9945a8f640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.175 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7fc84b664640 1 Processor -- start 2026-02-17T11:10:35.175 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7fc4eb2c4640 1 -- start start 2026-02-17T11:10:35.175 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7fc4eb2c4640 1 librados: setting wanted keys 2026-02-17T11:10:35.175 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7fc4eb2c4640 1 librados: calling monclient init 2026-02-17T11:10:35.175 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7fc4eb2c4640 10 monclient: init 2026-02-17T11:10:35.175 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7f9945a8f640 10 monclient(hunting): authenticate will time out at 1111.762330s 2026-02-17T11:10:35.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7fc84b664640 1 -- start start 2026-02-17T11:10:35.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7fc84b664640 1 librados: setting wanted keys 2026-02-17T11:10:35.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7fc84b664640 1 librados: calling monclient init 2026-02-17T11:10:35.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7fc84b664640 10 monclient: init 2026-02-17T11:10:35.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7fecce7fc640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fecd0152ae0 0x7fecd014cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:32914/0 (socket says 10.20.193.49:32914) 2026-02-17T11:10:35.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7fecce7fc640 1 -- 10.20.193.49:0/1418801595 learned_addr learned my addr 10.20.193.49:0/1418801595 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:35.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7fecce7fc640 10 monclient(hunting): get_auth_request con 0x7fecd0152ae0 auth_method 0 2026-02-17T11:10:35.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7fecce7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7fecce7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7fecce7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7f6dceffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7f6dceffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7f6dceffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7fc4eb2c4640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7fc4eb2c4640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:10:35.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7fc4eb2c4640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc4e40d1b60 0x7fc4e41e9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7fc4eb2c4640 10 monclient(hunting): picked mon.noname-c con 0x7fc4e40d1b60 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:35.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7fc4eb2c4640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc4e40d1f40 0x7fc4e41f4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7fc4eb2c4640 10 monclient(hunting): picked mon.noname-b con 0x7fc4e40d1f40 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:35.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7fc4eb2c4640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc4e415d950 0x7fc4e41f54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7fc4eb2c4640 10 monclient(hunting): picked mon.noname-a con 0x7fc4e415d950 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:35.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7fc4eb2c4640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7fc4eb2c4640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e415d4c0 con 0x7fc4e415d950 2026-02-17T11:10:35.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7fc4eb2c4640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7fc4eb2c4640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e40ca460 con 0x7fc4e40d1f40 2026-02-17T11:10:35.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7fc4eb2c4640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7fc4eb2c4640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e406e7b0 con 0x7fc4e40d1b60 2026-02-17T11:10:35.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7fc4eb2c4640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7fc4eb2c4640 10 monclient(hunting): authenticate will time out at 1111.762754s 2026-02-17T11:10:35.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7fc84b664640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7fc84b664640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:10:35.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7fc84b664640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc8440d1b60 0x7fc844158ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7fc84b664640 10 monclient(hunting): picked mon.noname-a con 0x7fc8440d1b60 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:35.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7fc84b664640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc84415c840 0x7fc844148e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7fc84b664640 10 monclient(hunting): picked mon.noname-c con 0x7fc84415c840 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:35.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7fc84b664640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc84415d950 0x7fc84415bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7fc84b664640 10 monclient(hunting): picked mon.noname-b con 0x7fc84415d950 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:35.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7fc84b664640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7fc84b664640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc84415cc90 con 0x7fc8440d1b60 2026-02-17T11:10:35.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7fc84b664640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7fc84b664640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc84415d4c0 con 0x7fc84415d950 2026-02-17T11:10:35.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7fc84b664640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7fc84b664640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc84406e7b0 con 0x7fc84415c840 2026-02-17T11:10:35.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7fc84b664640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7fc84b664640 10 monclient(hunting): authenticate will time out at 1111.762949s 2026-02-17T11:10:35.178 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.099+0000 7f434a7fc640 1 -- 10.20.193.49:0/2915363711 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f434002fcd0 con 0x7f434c15d950 2026-02-17T11:10:35.178 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.100+0000 7f434a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.178 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.100+0000 7f434a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:10:35.178 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.100+0000 7f434a7fc640 10 monclient: dump: 2026-02-17T11:10:35.178 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.178 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.178 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.178 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.178 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.178 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.178 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.178 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.178 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.178 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.178 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.100+0000 7f434a7fc640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.178 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.100+0000 7f434a7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.178 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.100+0000 7f434a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.178 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.100+0000 7f434a7fc640 1 -- 10.20.193.49:0/2915363711 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43400373f0 con 0x7f434c15d950 2026-02-17T11:10:35.178 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.100+0000 7f434a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.178 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.100+0000 7f434a7fc640 1 -- 10.20.193.49:0/2915363711 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43400377c0 con 0x7f434c15d950 2026-02-17T11:10:35.178 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.100+0000 7f434a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.178 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.100+0000 7f434a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:10:35.178 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.100+0000 7f434a7fc640 10 monclient: dump: 2026-02-17T11:10:35.178 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.178 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.178 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.178 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.178 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.178 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.178 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.178 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.178 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.178 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.178 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.100+0000 7f435212c640 5 monclient: authenticate success, global_id 4428 2026-02-17T11:10:35.178 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.100+0000 7f435212c640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:35.178 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.100+0000 7f435212c640 4 set_mon_vals no callback set 2026-02-17T11:10:35.178 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.100+0000 7f435212c640 10 monclient: shutdown 2026-02-17T11:10:35.178 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.100+0000 7f435212c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:35.178 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.100+0000 7f435212c640 1 -- 10.20.193.49:0/2915363711 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f434c15d950 msgr2=0x7f434c15dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.179 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.100+0000 7f435212c640 1 --2- 10.20.193.49:0/2915363711 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f434c15d950 0x7f434c15dd90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f434c0cf420 tx=0x7f434002f270 comp rx=0 tx=0).stop 2026-02-17T11:10:35.179 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.100+0000 7f435212c640 1 -- 10.20.193.49:0/2915363711 shutdown_connections 2026-02-17T11:10:35.179 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.100+0000 7f435212c640 1 --2- 10.20.193.49:0/2915363711 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f434c15d950 0x7f434c15dd90 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.179 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.100+0000 7f435212c640 1 --2- 10.20.193.49:0/2915363711 >> v2:10.20.193.157:3300/0 conn(0x7f434c0d1b60 0x7f434c0d1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.179 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.100+0000 7f435212c640 1 -- 10.20.193.49:0/2915363711 >> 10.20.193.49:0/2915363711 conn(0x7f434c06d9b0 msgr2=0x7f434c06ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:35.179 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.100+0000 7fecceffd640 1 --2- 10.20.193.49:0/1418801595 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fecd0152700 0x7fecd014c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.179 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.100+0000 7f435212c640 1 -- 10.20.193.49:0/2915363711 shutdown_connections 2026-02-17T11:10:35.179 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.100+0000 7f435212c640 1 -- 10.20.193.49:0/2915363711 wait complete. 2026-02-17T11:10:35.179 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.100+0000 7fecceffd640 10 monclient(hunting): get_auth_request con 0x7fecd0152700 auth_method 0 2026-02-17T11:10:35.179 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.100+0000 7fecceffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.179 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.100+0000 7fecceffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.179 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.100+0000 7fecceffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.179 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.101+0000 7f435212c640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.179 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.101+0000 7f435212c640 10 monclient: monmap: 2026-02-17T11:10:35.179 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.179 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:35.179 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:35.179 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:35.179 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.179 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.179 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:35.179 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:35.179 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:35.179 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.180 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.101+0000 7fecceffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.180 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.101+0000 7fecceffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.180 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.101+0000 7fecceffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.180 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.101+0000 7f435212c640 1 librados: starting msgr at 2026-02-17T11:10:35.180 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.101+0000 7f435212c640 1 librados: starting objecter 2026-02-17T11:10:35.180 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.101+0000 7feccf7fe640 1 --2- 10.20.193.49:0/1418801595 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fecd015edb0 0x7fecd01f5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.180 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.101+0000 7f435212c640 1 Processor -- start 2026-02-17T11:10:35.180 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.101+0000 7f435212c640 1 -- start start 2026-02-17T11:10:35.180 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.101+0000 7f435212c640 1 librados: setting wanted keys 2026-02-17T11:10:35.180 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.101+0000 7f435212c640 1 librados: calling monclient init 2026-02-17T11:10:35.180 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.101+0000 7f435212c640 10 monclient: init 2026-02-17T11:10:35.180 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.101+0000 7f6dceffd640 10 monclient(hunting): handle_auth_done global_id 4437 payload 824 2026-02-17T11:10:35.180 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.101+0000 7feccf7fe640 10 monclient(hunting): get_auth_request con 0x7fecd015edb0 auth_method 0 2026-02-17T11:10:35.180 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.101+0000 7feccf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.180 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.101+0000 7feccf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.180 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.101+0000 7feccf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.180 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.101+0000 7f435212c640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.181 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.101+0000 7f435212c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:10:35.181 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.101+0000 7f435212c640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f434c0d1b60 0x7f434c151050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.181 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.101+0000 7f435212c640 10 monclient(hunting): picked mon.noname-b con 0x7f434c0d1b60 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:35.181 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.101+0000 7f6dceffd640 1 -- 10.20.193.49:0/2195715102 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f6dd0152ae0 msgr2=0x7f6dd01484e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.181 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.101+0000 7f6dceffd640 1 --2- 10.20.193.49:0/2195715102 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f6dd0152ae0 0x7f6dd01484e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.181 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.101+0000 7f6dceffd640 1 -- 10.20.193.49:0/2195715102 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f6dd015ef80 msgr2=0x7f6dd00c6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.181 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.101+0000 7f6dceffd640 1 --2- 10.20.193.49:0/2195715102 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f6dd015ef80 0x7f6dd00c6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.181 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.101+0000 7f6dceffd640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.181 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.101+0000 7f6dceffd640 1 monclient: found mon.noname-a 2026-02-17T11:10:35.181 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.101+0000 7f6dceffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.181 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.101+0000 7f6dceffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:10:35.181 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.101+0000 7f6dceffd640 1 -- 10.20.193.49:0/2195715102 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dd0157e50 con 0x7f6dd0152700 2026-02-17T11:10:35.181 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.101+0000 7f435212c640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f434c15c840 0x7f434c1f55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.181 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.101+0000 7f435212c640 10 monclient(hunting): picked mon.noname-c con 0x7f434c15c840 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:35.181 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.101+0000 7f435212c640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f434c15d950 0x7f434c1f5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.181 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.101+0000 7f435212c640 10 monclient(hunting): picked mon.noname-a con 0x7f434c15d950 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:35.181 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.101+0000 7f435212c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.181 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.101+0000 7f435212c640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f434c0ca180 con 0x7f434c15d950 2026-02-17T11:10:35.181 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.101+0000 7f435212c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.181 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.101+0000 7f435212c640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f434c0c9ea0 con 0x7f434c0d1b60 2026-02-17T11:10:35.181 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.101+0000 7f435212c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.181 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.101+0000 7f435212c640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f434c15cc90 con 0x7f434c15c840 2026-02-17T11:10:35.181 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.101+0000 7f435212c640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.181 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.101+0000 7f435212c640 10 monclient(hunting): authenticate will time out at 1111.764920s 2026-02-17T11:10:35.182 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.102+0000 7feccf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.182 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.102+0000 7feccf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.182 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.102+0000 7feccf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.182 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.102+0000 7fecceffd640 10 monclient(hunting): handle_auth_done global_id 4438 payload 824 2026-02-17T11:10:35.182 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.102+0000 7fecceffd640 1 -- 10.20.193.49:0/1418801595 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fecd015edb0 msgr2=0x7fecd01f5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.182 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.102+0000 7fecceffd640 1 --2- 10.20.193.49:0/1418801595 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fecd015edb0 0x7fecd01f5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.182 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.102+0000 7fecceffd640 1 -- 10.20.193.49:0/1418801595 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fecd0152ae0 msgr2=0x7fecd014cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.182 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.102+0000 7fecceffd640 1 --2- 10.20.193.49:0/1418801595 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fecd0152ae0 0x7fecd014cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.182 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.102+0000 7fecceffd640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.182 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.102+0000 7fecceffd640 1 monclient: found mon.noname-b 2026-02-17T11:10:35.182 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.102+0000 7fecceffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.182 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.102+0000 7fecceffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.182 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.102+0000 7fecceffd640 1 -- 10.20.193.49:0/1418801595 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecd0147c90 con 0x7fecd0152700 2026-02-17T11:10:35.182 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.104+0000 7f1048ff9640 1 -- 10.20.193.49:0/3068591869 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f103c017070 con 0x7f104c0d1f40 2026-02-17T11:10:35.182 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.104+0000 7f1048ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.182 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.104+0000 7f1048ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:10:35.182 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.104+0000 7f1048ff9640 10 monclient: dump: 2026-02-17T11:10:35.182 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.182 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.182 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.182 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.182 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.182 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.182 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.182 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.182 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.182 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.104+0000 7f1048ff9640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.104+0000 7f1048ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.104+0000 7f1048ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.104+0000 7f1048ff9640 1 -- 10.20.193.49:0/3068591869 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f103c005bb0 con 0x7f104c0d1f40 2026-02-17T11:10:35.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.104+0000 7f1048ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.104+0000 7f1048ff9640 1 -- 10.20.193.49:0/3068591869 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f103c007070 con 0x7f104c0d1f40 2026-02-17T11:10:35.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.104+0000 7f1052522640 5 monclient: authenticate success, global_id 4434 2026-02-17T11:10:35.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.104+0000 7f1052522640 10 monclient: _renew_subs 2026-02-17T11:10:35.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.104+0000 7f104a7fc640 4 set_mon_vals no callback set 2026-02-17T11:10:35.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.104+0000 7f1052522640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:35.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.104+0000 7f1052522640 1 -- 10.20.193.49:0/3068591869 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f104c203db0 con 0x7f104c0d1f40 2026-02-17T11:10:35.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.104+0000 7f73faffd640 1 -- 10.20.193.49:0/2659158390 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7408004480 con 0x7f74140d1b60 2026-02-17T11:10:35.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.104+0000 7f73faffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.104+0000 7f73faffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:10:35.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.104+0000 7f73faffd640 10 monclient: dump: 2026-02-17T11:10:35.183 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.183 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.183 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.183 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.183 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.183 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.183 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.183 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.183 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.183 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.104+0000 7f73faffd640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.104+0000 7f73faffd640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.104+0000 7f73faffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.104+0000 7f73faffd640 1 -- 10.20.193.49:0/2659158390 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7408010070 con 0x7f74140d1b60 2026-02-17T11:10:35.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.104+0000 7f73faffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.104+0000 7f73faffd640 1 -- 10.20.193.49:0/2659158390 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7408002920 con 0x7f74140d1b60 2026-02-17T11:10:35.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.104+0000 7f73faffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.104+0000 7f73faffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:10:35.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.104+0000 7f73faffd640 10 monclient: dump: 2026-02-17T11:10:35.184 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.184 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.184 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.184 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.184 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.184 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.184 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.184 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.184 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.184 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.184 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.104+0000 7f7418bde640 4 set_mon_vals no callback set 2026-02-17T11:10:35.184 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.104+0000 7f1052522640 10 client.4434.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:35.184 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.104+0000 7f1052522640 10 monclient: _renew_subs 2026-02-17T11:10:35.184 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.104+0000 7f1052522640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:35.184 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.104+0000 7f1052522640 1 -- 10.20.193.49:0/3068591869 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f104c204370 con 0x7f104c0d1f40 2026-02-17T11:10:35.184 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.104+0000 7f1052522640 1 librados: init done 2026-02-17T11:10:35.184 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.104+0000 7f741c66c640 5 monclient: authenticate success, global_id 4448 2026-02-17T11:10:35.184 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.104+0000 7f741c66c640 10 monclient: _renew_subs 2026-02-17T11:10:35.184 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.104+0000 7f741c66c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:35.184 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.104+0000 7f741c66c640 1 -- 10.20.193.49:0/2659158390 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74140cf7e0 con 0x7f74140d1b60 2026-02-17T11:10:35.184 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.104+0000 7f1048ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.184 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.104+0000 7f1048ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:10:35.184 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.104+0000 7f1048ff9640 10 monclient: dump: 2026-02-17T11:10:35.184 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.184 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.184 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.184 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.184 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.184 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.184 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.184 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.184 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.185 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.185 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.104+0000 7fa53b7fe640 1 -- 10.20.193.49:0/353134677 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa54c03c050 con 0x7fa55c15b290 2026-02-17T11:10:35.185 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.104+0000 7fa53b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.185 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.105+0000 7fa53b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:10:35.185 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.105+0000 7fa53b7fe640 10 monclient: dump: 2026-02-17T11:10:35.185 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.185 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.185 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.185 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.185 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.185 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.185 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.185 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.185 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.185 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.185 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.105+0000 7fa53b7fe640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.185 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.105+0000 7fa53b7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.185 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.105+0000 7f741c66c640 10 client.4448.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:35.185 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.105+0000 7f741c66c640 10 monclient: _renew_subs 2026-02-17T11:10:35.185 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.105+0000 7f741c66c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:35.185 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.105+0000 7f741c66c640 1 -- 10.20.193.49:0/2659158390 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74140cfda0 con 0x7f74140d1b60 2026-02-17T11:10:35.185 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.105+0000 7fa53b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.185 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.105+0000 7fa53b7fe640 1 -- 10.20.193.49:0/353134677 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa54c048070 con 0x7fa55c15b290 2026-02-17T11:10:35.185 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.105+0000 7fa53b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.185 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.105+0000 7fa53b7fe640 1 -- 10.20.193.49:0/353134677 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa54c037e60 con 0x7fa55c15b290 2026-02-17T11:10:35.185 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.105+0000 7fa53b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.185 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.105+0000 7f741c66c640 1 librados: init done 2026-02-17T11:10:35.186 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.105+0000 7fa53b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:10:35.186 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.105+0000 7fa53b7fe640 10 monclient: dump: 2026-02-17T11:10:35.186 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.186 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.186 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.186 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.186 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.186 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.186 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.186 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.186 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.186 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.186 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.105+0000 7fa559573640 4 set_mon_vals no callback set 2026-02-17T11:10:35.186 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.105+0000 7fa5611e6640 5 monclient: authenticate success, global_id 4445 2026-02-17T11:10:35.186 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.105+0000 7fa5611e6640 10 monclient: _renew_subs 2026-02-17T11:10:35.186 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.105+0000 7fa5611e6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:35.186 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.105+0000 7fa5611e6640 1 -- 10.20.193.49:0/353134677 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa55c073420 con 0x7fa55c15b290 2026-02-17T11:10:35.186 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.105+0000 7fa5611e6640 10 client.4445.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:35.186 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.105+0000 7fa5611e6640 10 monclient: _renew_subs 2026-02-17T11:10:35.186 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.105+0000 7fa5611e6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:35.186 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.105+0000 7fa5611e6640 1 -- 10.20.193.49:0/353134677 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa55c0739e0 con 0x7fa55c15b290 2026-02-17T11:10:35.186 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.105+0000 7fa5611e6640 1 librados: init done 2026-02-17T11:10:35.186 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.105+0000 7f84da7fc640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f84dc153fc0 0x7f84dc1f2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.187 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.105+0000 7f6dceffd640 1 --2- 10.20.193.49:0/2195715102 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f6dd0152700 0x7f6dd0159670 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6dc400b4d0 tx=0x7f6dc400b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.187 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.105+0000 7f6daf7fe640 10 client.?.objecter ms_handle_connect 0x7f6dd0152700 2026-02-17T11:10:35.187 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.105+0000 7f6daf7fe640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:35.187 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.105+0000 7f84da7fc640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f84dc153fc0 0x7f84dc1f2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:48092/0 (socket says 10.20.193.49:48092) 2026-02-17T11:10:35.187 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.105+0000 7f84da7fc640 1 -- 10.20.193.49:0/4105535500 learned_addr learned my addr 10.20.193.49:0/4105535500 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:35.187 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.105+0000 7f84da7fc640 10 monclient(hunting): get_auth_request con 0x7f84dc153fc0 auth_method 0 2026-02-17T11:10:35.187 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.105+0000 7f84da7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.187 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.105+0000 7f84da7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.187 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.105+0000 7f84da7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.187 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.105+0000 7f1052522640 10 client.4434.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:35.187 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.105+0000 7f1052522640 15 client.4434.objecter _session_command_op_assign -1 1 2026-02-17T11:10:35.187 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.105+0000 7f1052522640 20 client.4434.objecter _get_session osd=-1 returning homeless 2026-02-17T11:10:35.187 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.105+0000 7f1052522640 10 client.4434.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:35.187 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.105+0000 7f1052522640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:35.187 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.105+0000 7f1052522640 1 -- 10.20.193.49:0/3068591869 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f104c15c840 con 0x7f104c0d1f40 2026-02-17T11:10:35.187 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.105+0000 7f741c66c640 10 client.4448.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:35.187 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.105+0000 7f741c66c640 15 client.4448.objecter _session_command_op_assign -1 1 2026-02-17T11:10:35.187 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.105+0000 7f741c66c640 20 client.4448.objecter _get_session osd=-1 returning homeless 2026-02-17T11:10:35.187 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.105+0000 7f741c66c640 10 client.4448.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:35.187 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.105+0000 7f741c66c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:35.187 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.105+0000 7f741c66c640 1 -- 10.20.193.49:0/2659158390 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f741406cc70 con 0x7f74140d1b60 2026-02-17T11:10:35.187 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.105+0000 7fa5611e6640 10 client.4445.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:35.187 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.105+0000 7fa5611e6640 15 client.4445.objecter _session_command_op_assign -1 1 2026-02-17T11:10:35.187 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.105+0000 7fa5611e6640 20 client.4445.objecter _get_session osd=-1 returning homeless 2026-02-17T11:10:35.187 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.105+0000 7fa5611e6640 10 client.4445.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:35.187 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.105+0000 7fa5611e6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:35.188 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.105+0000 7fa5611e6640 1 -- 10.20.193.49:0/353134677 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa55c1560c0 con 0x7fa55c15b290 2026-02-17T11:10:35.188 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.105+0000 7f3fac90c640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f3fa815ef80 0x7f3fa81f7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.188 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.106+0000 7f3fac90c640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f3fa815ef80 0x7f3fa81f7570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:48108/0 (socket says 10.20.193.49:48108) 2026-02-17T11:10:35.188 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.106+0000 7f3fac90c640 1 -- 10.20.193.49:0/715203919 learned_addr learned my addr 10.20.193.49:0/715203919 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:35.188 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.106+0000 7f3fac90c640 10 monclient(hunting): get_auth_request con 0x7f3fa815ef80 auth_method 0 2026-02-17T11:10:35.188 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.106+0000 7f3fac90c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.188 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.106+0000 7f3fac90c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.188 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.106+0000 7ff79dffb640 1 -- 10.20.193.49:0/519375284 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff78803c070 con 0x7ff7a015ef80 2026-02-17T11:10:35.188 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.106+0000 7ff79dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.188 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.106+0000 7ff79dffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:10:35.188 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.106+0000 7ff79dffb640 10 monclient: dump: 2026-02-17T11:10:35.188 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.188 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.188 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.188 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.188 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.188 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.188 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.188 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.188 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.188 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.188 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.106+0000 7ff79dffb640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.188 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.106+0000 7ff79dffb640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.188 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.106+0000 7ff79dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.188 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.106+0000 7ff79dffb640 1 -- 10.20.193.49:0/519375284 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff78802fb60 con 0x7ff7a015ef80 2026-02-17T11:10:35.189 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.106+0000 7ff79dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.189 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.106+0000 7ff79dffb640 1 -- 10.20.193.49:0/519375284 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff788037440 con 0x7ff7a015ef80 2026-02-17T11:10:35.189 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.106+0000 7ff79dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.189 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.106+0000 7ff79dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:10:35.189 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.106+0000 7ff79dffb640 10 monclient: dump: 2026-02-17T11:10:35.189 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.189 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.189 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.189 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.189 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.189 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.189 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.189 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.189 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.189 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.189 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.106+0000 7ff7a5322640 5 monclient: authenticate success, global_id 4451 2026-02-17T11:10:35.189 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.106+0000 7faed1405640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7faecc15f6f0 0x7faecc202c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.189 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.106+0000 7f3fac90c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.189 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.106+0000 7ff7a5322640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:35.189 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.106+0000 7ff7a5322640 4 set_mon_vals no callback set 2026-02-17T11:10:35.189 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.106+0000 7f3fac90c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.189 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.106+0000 7f3fac90c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.189 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.106+0000 7f3fac90c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.189 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.106+0000 7ff7a5322640 10 monclient: shutdown 2026-02-17T11:10:35.190 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.106+0000 7ff7a5322640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:35.190 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.106+0000 7ff7a5322640 1 -- 10.20.193.49:0/519375284 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff7a015ef80 msgr2=0x7ff7a00c9730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.190 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.106+0000 7ff7a5322640 1 --2- 10.20.193.49:0/519375284 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff7a015ef80 0x7ff7a00c9730 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff788009970 tx=0x7ff78802eef0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.190 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.106+0000 7faed1405640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7faecc15f6f0 0x7faecc202c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:48114/0 (socket says 10.20.193.49:48114) 2026-02-17T11:10:35.190 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.106+0000 7faed1405640 1 -- 10.20.193.49:0/896420849 learned_addr learned my addr 10.20.193.49:0/896420849 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:35.190 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.106+0000 7faed1405640 10 monclient(hunting): get_auth_request con 0x7faecc15f6f0 auth_method 0 2026-02-17T11:10:35.190 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.106+0000 7faed1405640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.190 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.106+0000 7faed1405640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.190 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.106+0000 7faed1405640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.190 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.106+0000 7ff7a5322640 1 -- 10.20.193.49:0/519375284 shutdown_connections 2026-02-17T11:10:35.190 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.106+0000 7ff7a5322640 1 --2- 10.20.193.49:0/519375284 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff7a015ef80 0x7ff7a00c9730 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.190 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.106+0000 7ff7a5322640 1 -- 10.20.193.49:0/519375284 >> 10.20.193.49:0/519375284 conn(0x7ff7a0073030 msgr2=0x7ff7a0073440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:35.190 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.106+0000 7ff7a5322640 1 -- 10.20.193.49:0/519375284 shutdown_connections 2026-02-17T11:10:35.190 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.106+0000 7ff7a5322640 1 -- 10.20.193.49:0/519375284 wait complete. 2026-02-17T11:10:35.190 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.107+0000 7ff7a5322640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.190 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.107+0000 7ff7a5322640 10 monclient: monmap: 2026-02-17T11:10:35.190 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.190 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:35.190 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:35.190 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:35.190 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.190 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.190 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:35.190 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:35.190 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:35.191 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.191 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.107+0000 7ff7a5322640 1 librados: starting msgr at 2026-02-17T11:10:35.191 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.107+0000 7ff7a5322640 1 librados: starting objecter 2026-02-17T11:10:35.191 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.107+0000 7ff7a5322640 1 Processor -- start 2026-02-17T11:10:35.191 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.107+0000 7ff7a5322640 1 -- start start 2026-02-17T11:10:35.191 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.107+0000 7ff7a5322640 1 librados: setting wanted keys 2026-02-17T11:10:35.191 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.107+0000 7ff7a5322640 1 librados: calling monclient init 2026-02-17T11:10:35.191 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.107+0000 7ff7a5322640 10 monclient: init 2026-02-17T11:10:35.191 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.107+0000 7f5e7affd640 1 -- 10.20.193.49:0/3532361460 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e6803c070 con 0x7f5e7c0d1b60 2026-02-17T11:10:35.191 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.107+0000 7f5e7affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.191 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.107+0000 7f5e7affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:10:35.191 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.107+0000 7f5e7affd640 10 monclient: dump: 2026-02-17T11:10:35.191 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.191 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.191 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.191 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.191 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.191 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.191 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.191 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.191 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.191 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.191 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.107+0000 7f5e7affd640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.191 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.107+0000 7f5e7affd640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.191 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.107+0000 7f5e7affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.191 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.107+0000 7f5e7affd640 1 -- 10.20.193.49:0/3532361460 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e6802fb60 con 0x7f5e7c0d1b60 2026-02-17T11:10:35.191 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.107+0000 7f5e7affd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.191 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.107+0000 7f5e7affd640 1 -- 10.20.193.49:0/3532361460 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e68037440 con 0x7f5e7c0d1b60 2026-02-17T11:10:35.191 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.107+0000 7f5e82375640 5 monclient: authenticate success, global_id 4431 2026-02-17T11:10:35.191 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.107+0000 7f5e82375640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:35.191 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.107+0000 7f5e82375640 4 set_mon_vals no callback set 2026-02-17T11:10:35.191 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.107+0000 7f5e7affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.192 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.107+0000 7f5e7affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:10:35.192 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.107+0000 7f5e7affd640 10 monclient: dump: 2026-02-17T11:10:35.192 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.192 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.192 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.192 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.192 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.192 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.192 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.192 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.192 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.192 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.192 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.108+0000 7ff7a5322640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.192 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.108+0000 7ff7a5322640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:10:35.192 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.108+0000 7ff7a5322640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ff7a0152700 0x7ff7a01f4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.192 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.108+0000 7ff7a5322640 10 monclient(hunting): picked mon.noname-a con 0x7ff7a0152700 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:35.192 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.108+0000 7ff7a5322640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7ff7a0152ae0 0x7ff7a014a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.192 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.108+0000 7ff7a5322640 10 monclient(hunting): picked mon.noname-b con 0x7ff7a0152ae0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:35.192 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.108+0000 7ff7a5322640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff7a015ef80 0x7ff7a00cbe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.192 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.108+0000 7ff7a5322640 10 monclient(hunting): picked mon.noname-c con 0x7ff7a015ef80 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:35.192 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.108+0000 7ff7a5322640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.192 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.108+0000 7ff7a5322640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a00ca380 con 0x7ff7a0152700 2026-02-17T11:10:35.192 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.108+0000 7ff7a5322640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.192 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.108+0000 7ff7a5322640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a015e350 con 0x7ff7a0152ae0 2026-02-17T11:10:35.192 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.108+0000 7ff7a5322640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.192 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.108+0000 7ff7a5322640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a0166850 con 0x7ff7a015ef80 2026-02-17T11:10:35.192 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.108+0000 7ff7a5322640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.192 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.108+0000 7ff7a5322640 10 monclient(hunting): authenticate will time out at 1111.771278s 2026-02-17T11:10:35.192 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.108+0000 7f3fac90c640 10 monclient(hunting): handle_auth_done global_id 4441 payload 824 2026-02-17T11:10:35.193 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.108+0000 7f3fac90c640 1 -- 10.20.193.49:0/715203919 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f3fa8152ae0 msgr2=0x7f3fa80d03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.193 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.108+0000 7f3fac90c640 1 --2- 10.20.193.49:0/715203919 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f3fa8152ae0 0x7f3fa80d03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.193 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.108+0000 7f3fac90c640 1 -- 10.20.193.49:0/715203919 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f3fa8152700 msgr2=0x7f3fa82022b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.193 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.108+0000 7f3fac90c640 1 --2- 10.20.193.49:0/715203919 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f3fa8152700 0x7f3fa82022b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.193 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.108+0000 7f5e82375640 10 monclient: shutdown 2026-02-17T11:10:35.193 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.108+0000 7f5e82375640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:35.193 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.108+0000 7f5e82375640 1 -- 10.20.193.49:0/3532361460 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5e7c0d1b60 msgr2=0x7f5e7c0d1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.193 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.108+0000 7f5e82375640 1 --2- 10.20.193.49:0/3532361460 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5e7c0d1b60 0x7f5e7c0d1f40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5e68009970 tx=0x7f5e6802eef0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.193 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.108+0000 7f3fac90c640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.193 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.108+0000 7f3fac90c640 1 monclient: found mon.noname-b 2026-02-17T11:10:35.193 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.108+0000 7f3fac90c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.193 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.108+0000 7f3fac90c640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.193 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.108+0000 7f3fac90c640 1 -- 10.20.193.49:0/715203919 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fa80ce930 con 0x7f3fa815ef80 2026-02-17T11:10:35.193 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.108+0000 7f5e82375640 1 -- 10.20.193.49:0/3532361460 shutdown_connections 2026-02-17T11:10:35.193 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.108+0000 7f5e82375640 1 --2- 10.20.193.49:0/3532361460 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5e7c0d1b60 0x7f5e7c0d1f40 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.193 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.108+0000 7f5e82375640 1 -- 10.20.193.49:0/3532361460 >> 10.20.193.49:0/3532361460 conn(0x7f5e7c06d9b0 msgr2=0x7f5e7c06ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:35.193 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.108+0000 7f5e82375640 1 -- 10.20.193.49:0/3532361460 shutdown_connections 2026-02-17T11:10:35.193 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.108+0000 7f5e82375640 1 -- 10.20.193.49:0/3532361460 wait complete. 2026-02-17T11:10:35.193 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.108+0000 7faed1405640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.193 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.108+0000 7faed1405640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.193 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.108+0000 7faed1405640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.194 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.108+0000 7f5e82375640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.194 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.108+0000 7f5e82375640 10 monclient: monmap: 2026-02-17T11:10:35.194 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.194 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:35.194 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:35.194 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:35.194 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.194 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.194 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:35.194 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:35.194 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:35.194 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.194 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.109+0000 7f5e82375640 1 librados: starting msgr at 2026-02-17T11:10:35.194 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.109+0000 7f5e82375640 1 librados: starting objecter 2026-02-17T11:10:35.194 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.109+0000 7f5e82375640 1 Processor -- start 2026-02-17T11:10:35.194 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.109+0000 7f5e82375640 1 -- start start 2026-02-17T11:10:35.194 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.109+0000 7f5e82375640 1 librados: setting wanted keys 2026-02-17T11:10:35.194 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.109+0000 7f5e82375640 1 librados: calling monclient init 2026-02-17T11:10:35.194 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.109+0000 7f5e82375640 10 monclient: init 2026-02-17T11:10:35.194 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.109+0000 7f5e82375640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.195 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.109+0000 7f5e82375640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:10:35.195 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.109+0000 7f5e82375640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5e7c0d1b60 0x7f5e7c159130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.195 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.109+0000 7f5e82375640 10 monclient(hunting): picked mon.noname-b con 0x7f5e7c0d1b60 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:35.195 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.109+0000 7f5e82375640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5e7c15c840 0x7f5e7c143cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.195 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.109+0000 7f5e82375640 10 monclient(hunting): picked mon.noname-a con 0x7f5e7c15c840 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:35.195 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.109+0000 7f5e82375640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5e7c15d950 0x7f5e7c1f5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.195 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.109+0000 7f5e82375640 10 monclient(hunting): picked mon.noname-c con 0x7f5e7c15d950 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:35.195 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.109+0000 7f5e82375640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.195 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.109+0000 7f5e82375640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5e7c15cc90 con 0x7f5e7c15c840 2026-02-17T11:10:35.195 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.109+0000 7f5e82375640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.195 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.109+0000 7f5e82375640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f5e7c15d4c0 con 0x7f5e7c0d1b60 2026-02-17T11:10:35.195 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.109+0000 7f5e82375640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.195 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.109+0000 7f5e82375640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f5e7c06e7b0 con 0x7f5e7c15d950 2026-02-17T11:10:35.195 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.109+0000 7f5e82375640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.195 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.109+0000 7f5e82375640 10 monclient(hunting): authenticate will time out at 1111.772804s 2026-02-17T11:10:35.195 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.110+0000 7faed1405640 10 monclient(hunting): handle_auth_done global_id 4444 payload 824 2026-02-17T11:10:35.195 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.110+0000 7faed1405640 1 -- 10.20.193.49:0/896420849 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7faeb4004900 msgr2=0x7faecc15d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.195 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.110+0000 7faed1405640 1 --2- 10.20.193.49:0/896420849 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7faeb4004900 0x7faecc15d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.195 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.110+0000 7faed1405640 1 -- 10.20.193.49:0/896420849 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7faecc15fb70 msgr2=0x7faecc2031b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.195 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.110+0000 7faed1405640 1 --2- 10.20.193.49:0/896420849 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7faecc15fb70 0x7faecc2031b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.195 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.110+0000 7faed1405640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.195 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.110+0000 7faed1405640 1 monclient: found mon.noname-b 2026-02-17T11:10:35.195 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.110+0000 7faed1405640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.195 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.110+0000 7faed1405640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.195 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.110+0000 7faed1405640 1 -- 10.20.193.49:0/896420849 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faecc15c180 con 0x7faecc15f6f0 2026-02-17T11:10:35.195 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.111+0000 7f3fac90c640 1 --2- 10.20.193.49:0/715203919 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f3fa815ef80 0x7f3fa81f7570 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c00cc30 tx=0x7f3f9c00a5c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.195 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.111+0000 7f3fa4ff9640 10 client.?.objecter ms_handle_connect 0x7f3fa815ef80 2026-02-17T11:10:35.195 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.111+0000 7f3fa4ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:35.196 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.111+0000 7faed1405640 1 --2- 10.20.193.49:0/896420849 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7faecc15f6f0 0x7faecc202c70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7faec002fb40 tx=0x7faec00027f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.196 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.111+0000 7faeba7fc640 10 client.?.objecter ms_handle_connect 0x7faecc15f6f0 2026-02-17T11:10:35.196 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.111+0000 7faeba7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:35.196 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.111+0000 7fecceffd640 1 --2- 10.20.193.49:0/1418801595 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fecd0152700 0x7fecd014c680 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fecc4036000 tx=0x7fecc40047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.196 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.111+0000 7fecaf7fe640 10 client.?.objecter ms_handle_connect 0x7fecd0152700 2026-02-17T11:10:35.196 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.111+0000 7fecaf7fe640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:35.196 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.113+0000 7f84db7fe640 1 --2- 10.20.193.49:0/4105535500 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f84dc15b0c0 0x7f84dc1f0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.196 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.113+0000 7f84db7fe640 10 monclient(hunting): get_auth_request con 0x7f84dc15b0c0 auth_method 0 2026-02-17T11:10:35.196 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.113+0000 7f84db7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.196 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.113+0000 7f84db7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.196 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.113+0000 7f84db7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.196 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.115+0000 7f84da7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.196 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.115+0000 7f84da7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.196 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.115+0000 7f84da7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.196 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.115+0000 7fc849bda640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc84415d950 0x7fc84415bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.196 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.115+0000 7f993effd640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f994014a4a0 0x7f994014b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.197 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.117+0000 7f84da7fc640 10 monclient(hunting): handle_auth_done global_id 4447 payload 824 2026-02-17T11:10:35.197 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.117+0000 7f84da7fc640 1 -- 10.20.193.49:0/4105535500 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f84dc153be0 msgr2=0x7f84dc071140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.197 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.117+0000 7f84da7fc640 1 --2- 10.20.193.49:0/4105535500 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f84dc153be0 0x7f84dc071140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.197 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.117+0000 7f84da7fc640 1 -- 10.20.193.49:0/4105535500 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f84dc15b0c0 msgr2=0x7f84dc1f0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.197 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.117+0000 7f84da7fc640 1 --2- 10.20.193.49:0/4105535500 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f84dc15b0c0 0x7f84dc1f0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.197 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.117+0000 7f84da7fc640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.197 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.117+0000 7f84da7fc640 1 monclient: found mon.noname-b 2026-02-17T11:10:35.197 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.117+0000 7f84da7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.197 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.117+0000 7f84da7fc640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.197 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.117+0000 7f84da7fc640 1 -- 10.20.193.49:0/4105535500 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84dc06d940 con 0x7f84dc153fc0 2026-02-17T11:10:35.197 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.117+0000 7fc849bda640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc84415d950 0x7fc84415bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:48136/0 (socket says 10.20.193.49:48136) 2026-02-17T11:10:35.197 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.117+0000 7fc849bda640 1 -- 10.20.193.49:0/2395150845 learned_addr learned my addr 10.20.193.49:0/2395150845 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:35.197 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.117+0000 7fc849bda640 10 monclient(hunting): get_auth_request con 0x7fc84415d950 auth_method 0 2026-02-17T11:10:35.197 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.117+0000 7fc849bda640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.197 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.117+0000 7fc849bda640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.197 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.117+0000 7fc849bda640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.197 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.117+0000 7f993effd640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f994014a4a0 0x7f994014b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:48120/0 (socket says 10.20.193.49:48120) 2026-02-17T11:10:35.197 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.117+0000 7f993effd640 1 -- 10.20.193.49:0/3435546534 learned_addr learned my addr 10.20.193.49:0/3435546534 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:35.197 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.117+0000 7f993effd640 10 monclient(hunting): get_auth_request con 0x7f994014a4a0 auth_method 0 2026-02-17T11:10:35.197 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.117+0000 7f993effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.197 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.117+0000 7f993effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.197 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.117+0000 7f993effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.197 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.118+0000 7fc849bda640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.198 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.118+0000 7fc849bda640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.198 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.118+0000 7fc849bda640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.198 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.118+0000 7feec7fff640 1 -- 10.20.193.49:0/2599867942 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7feedc043410 con 0x7feeec0d1f40 2026-02-17T11:10:35.198 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.118+0000 7f993effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.198 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.118+0000 7f993effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.198 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.118+0000 7f993effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.198 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.119+0000 7f84da7fc640 1 --2- 10.20.193.49:0/4105535500 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f84dc153fc0 0x7f84dc1f2d40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f84c400b4d0 tx=0x7f84c400b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.198 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.119+0000 7f84bb7fe640 10 client.?.objecter ms_handle_connect 0x7f84dc153fc0 2026-02-17T11:10:35.198 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.119+0000 7f84bb7fe640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:35.198 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.119+0000 7feec7fff640 1 --2- 10.20.193.49:0/2599867942 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7feebc079140 0x7feebc07b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.198 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.119+0000 7feeeb7fe640 1 --2- 10.20.193.49:0/2599867942 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7feebc079140 0x7feebc07b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.198 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.119+0000 7feeeb7fe640 10 monclient: get_auth_request con 0x7feebc079140 auth_method 0 2026-02-17T11:10:35.198 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.120+0000 7feeeb7fe640 1 --2- 10.20.193.49:0/2599867942 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7feebc079140 0x7feebc07b600 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7feed8002e60 tx=0x7feed8007a70 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.198 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.120+0000 7feec7fff640 10 client.4442.objecter ms_handle_connect 0x7feebc079140 2026-02-17T11:10:35.198 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.120+0000 7fc849bda640 10 monclient(hunting): handle_auth_done global_id 4450 payload 824 2026-02-17T11:10:35.198 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.120+0000 7fc849bda640 1 -- 10.20.193.49:0/2395150845 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc84415c840 msgr2=0x7fc844148e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.198 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.120+0000 7fc849bda640 1 --2- 10.20.193.49:0/2395150845 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc84415c840 0x7fc844148e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.198 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.120+0000 7fc849bda640 1 -- 10.20.193.49:0/2395150845 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc8440d1b60 msgr2=0x7fc844158ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.198 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.120+0000 7fc849bda640 1 --2- 10.20.193.49:0/2395150845 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc8440d1b60 0x7fc844158ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.198 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.120+0000 7fc849bda640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.199 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.120+0000 7fc849bda640 1 monclient: found mon.noname-b 2026-02-17T11:10:35.199 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.120+0000 7fc849bda640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.199 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.120+0000 7fc849bda640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.199 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.120+0000 7fc849bda640 1 -- 10.20.193.49:0/2395150845 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc844159430 con 0x7fc84415d950 2026-02-17T11:10:35.199 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.120+0000 7feec7fff640 1 -- 10.20.193.49:0/2599867942 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7feedc0bd7c0 con 0x7feeec0d1f40 2026-02-17T11:10:35.199 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.120+0000 7feec7fff640 10 client.4442.objecter ms_dispatch2 0x7feeec000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:35.199 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.120+0000 7feec7fff640 3 client.4442.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:35.199 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.120+0000 7feec7fff640 3 client.4442.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:35.199 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.120+0000 7feec7fff640 10 client.4442.objecter checking command 1 2026-02-17T11:10:35.199 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.120+0000 7feec7fff640 1 --2- 10.20.193.49:0/2599867942 >> [v2:10.20.193.162:6806/2715110678,v1:10.20.193.162:6808/2715110678] conn(0x7feebc081680 0x7feebc083ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.199 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.120+0000 7feec7fff640 20 client.4442.objecter _get_session s=0x7feebc080fb0 osd=7 3 2026-02-17T11:10:35.199 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.120+0000 7feec7fff640 20 client.4442.objecter put_session s=0x7feebc080fb0 osd=7 3 2026-02-17T11:10:35.199 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.120+0000 7feec7fff640 15 client.4442.objecter _session_command_op_remove -1 1 2026-02-17T11:10:35.199 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.120+0000 7feec7fff640 20 client.4442.objecter _get_session s=0x7feebc080fb0 osd=7 3 2026-02-17T11:10:35.199 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.120+0000 7feec7fff640 20 client.4442.objecter get_session s=0x7feebc080fb0 osd=7 3 2026-02-17T11:10:35.199 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.121+0000 7feec7fff640 15 client.4442.objecter _session_command_op_assign 7 1 2026-02-17T11:10:35.199 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.121+0000 7feec7fff640 20 client.4442.objecter put_session s=0x7feebc080fb0 osd=7 4 2026-02-17T11:10:35.199 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.121+0000 7feec7fff640 10 client.4442.objecter _send_command 1 2026-02-17T11:10:35.199 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.121+0000 7feec7fff640 1 -- 10.20.193.49:0/2599867942 --> [v2:10.20.193.162:6806/2715110678,v1:10.20.193.162:6808/2715110678] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feebc084190 con 0x7feebc081680 2026-02-17T11:10:35.199 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.121+0000 7feec7fff640 20 client.4442.objecter dump_active .. 0 homeless 2026-02-17T11:10:35.199 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.121+0000 7feec7fff640 1 -- 10.20.193.49:0/2599867942 <== mon.2 v2:10.20.193.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7feedc084140 con 0x7feeec0d1f40 2026-02-17T11:10:35.199 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.121+0000 7feec7fff640 10 monclient: handle_get_version_reply finishing 1 version 33 2026-02-17T11:10:35.199 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.121+0000 7feeebfff640 1 --2- 10.20.193.49:0/2599867942 >> [v2:10.20.193.162:6806/2715110678,v1:10.20.193.162:6808/2715110678] conn(0x7feebc081680 0x7feebc083ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.121+0000 7f993effd640 10 monclient(hunting): handle_auth_done global_id 4453 payload 824 2026-02-17T11:10:35.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.121+0000 7f993effd640 1 -- 10.20.193.49:0/3435546534 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f9924004900 msgr2=0x7f99401474b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.121+0000 7f993effd640 1 --2- 10.20.193.49:0/3435546534 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f9924004900 0x7f99401474b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.121+0000 7f993effd640 1 -- 10.20.193.49:0/3435546534 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f994014b870 msgr2=0x7f994014f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.121+0000 7f993effd640 1 --2- 10.20.193.49:0/3435546534 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f994014b870 0x7f994014f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.121+0000 7f993effd640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.121+0000 7f993effd640 1 monclient: found mon.noname-b 2026-02-17T11:10:35.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.121+0000 7f993effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.121+0000 7f993effd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.121+0000 7f993effd640 1 -- 10.20.193.49:0/3435546534 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f994014a130 con 0x7f994014a4a0 2026-02-17T11:10:35.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.121+0000 7feeebfff640 10 monclient: get_auth_request con 0x7feebc081680 auth_method 0 2026-02-17T11:10:35.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.122+0000 7f1048ff9640 1 -- 10.20.193.49:0/3068591869 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f103c007210 con 0x7f104c0d1f40 2026-02-17T11:10:35.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.122+0000 7f1048ff9640 1 --2- 10.20.193.49:0/3068591869 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f101c079190 0x7f101c07b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.122+0000 7f104bfff640 1 --2- 10.20.193.49:0/3068591869 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f101c079190 0x7f101c07b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.122+0000 7f104bfff640 10 monclient: get_auth_request con 0x7f101c079190 auth_method 0 2026-02-17T11:10:35.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.122+0000 7fc4e8838640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc4e40d1f40 0x7fc4e41f4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.123+0000 7f104bfff640 1 --2- 10.20.193.49:0/3068591869 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f101c079190 0x7f101c07b650 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1038002e40 tx=0x7f1038007ad0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.123+0000 7f1048ff9640 10 client.4434.objecter ms_handle_connect 0x7f101c079190 2026-02-17T11:10:35.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.123+0000 7feeebfff640 1 --2- 10.20.193.49:0/2599867942 >> [v2:10.20.193.162:6806/2715110678,v1:10.20.193.162:6808/2715110678] conn(0x7feebc081680 0x7feebc083ac0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.123+0000 7feec7fff640 10 client.4442.objecter ms_handle_connect 0x7feebc081680 2026-02-17T11:10:35.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.124+0000 7fc4e8838640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc4e40d1f40 0x7fc4e41f4f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:48134/0 (socket says 10.20.193.49:48134) 2026-02-17T11:10:35.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.124+0000 7fc4e8838640 1 -- 10.20.193.49:0/2523223392 learned_addr learned my addr 10.20.193.49:0/2523223392 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:35.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.124+0000 7fc4e8838640 10 monclient(hunting): get_auth_request con 0x7fc4e40d1f40 auth_method 0 2026-02-17T11:10:35.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.124+0000 7fc4e8838640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.124+0000 7fc4e8838640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.124+0000 7fc4e8838640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.124+0000 7f1048ff9640 1 -- 10.20.193.49:0/3068591869 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7f103c05d9e0 con 0x7f104c0d1f40 2026-02-17T11:10:35.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.124+0000 7f1048ff9640 10 client.4434.objecter ms_dispatch2 0x7f104c000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:35.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.124+0000 7f1048ff9640 3 client.4434.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:35.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.124+0000 7f1048ff9640 3 client.4434.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:35.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.124+0000 7f1048ff9640 10 client.4434.objecter checking command 1 2026-02-17T11:10:35.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.124+0000 7f1048ff9640 1 --2- 10.20.193.49:0/3068591869 >> [v2:10.20.193.97:6824/409145483,v1:10.20.193.97:6825/409145483] conn(0x7f101c081730 0x7f101c083b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.124+0000 7f1048ff9640 20 client.4434.objecter _get_session s=0x7f101c081060 osd=13 3 2026-02-17T11:10:35.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.124+0000 7f1048ff9640 20 client.4434.objecter put_session s=0x7f101c081060 osd=13 3 2026-02-17T11:10:35.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.124+0000 7f1048ff9640 15 client.4434.objecter _session_command_op_remove -1 1 2026-02-17T11:10:35.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.124+0000 7f1048ff9640 20 client.4434.objecter _get_session s=0x7f101c081060 osd=13 3 2026-02-17T11:10:35.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.124+0000 7f1048ff9640 20 client.4434.objecter get_session s=0x7f101c081060 osd=13 3 2026-02-17T11:10:35.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.124+0000 7f1048ff9640 15 client.4434.objecter _session_command_op_assign 13 1 2026-02-17T11:10:35.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.124+0000 7f1048ff9640 20 client.4434.objecter put_session s=0x7f101c081060 osd=13 4 2026-02-17T11:10:35.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.124+0000 7f1048ff9640 10 client.4434.objecter _send_command 1 2026-02-17T11:10:35.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.124+0000 7f1048ff9640 1 -- 10.20.193.49:0/3068591869 --> [v2:10.20.193.97:6824/409145483,v1:10.20.193.97:6825/409145483] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f103c006e50 con 0x7f101c081730 2026-02-17T11:10:35.202 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.124+0000 7f1048ff9640 20 client.4434.objecter dump_active .. 0 homeless 2026-02-17T11:10:35.202 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.124+0000 7f1048ff9640 1 -- 10.20.193.49:0/3068591869 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f103c05dda0 con 0x7f104c0d1f40 2026-02-17T11:10:35.202 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.124+0000 7f1048ff9640 10 monclient: handle_get_version_reply finishing 1 version 33 2026-02-17T11:10:35.202 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.124+0000 7fc849bda640 1 --2- 10.20.193.49:0/2395150845 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc84415d950 0x7fc84415bda0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc84000cc10 tx=0x7fc84000a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.202 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.124+0000 7fc831ffb640 10 client.?.objecter ms_handle_connect 0x7fc84415d950 2026-02-17T11:10:35.202 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.124+0000 7fc831ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:35.202 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.125+0000 7f993effd640 1 --2- 10.20.193.49:0/3435546534 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f994014a4a0 0x7f994014b330 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f993000c420 tx=0x7f9930003180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.202 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.125+0000 7f991bfff640 10 client.?.objecter ms_handle_connect 0x7f994014a4a0 2026-02-17T11:10:35.202 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.125+0000 7f991bfff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:35.202 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.125+0000 7f1050a98640 1 --2- 10.20.193.49:0/3068591869 >> [v2:10.20.193.97:6824/409145483,v1:10.20.193.97:6825/409145483] conn(0x7f101c081730 0x7f101c083b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.202 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.125+0000 7fc4e8838640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.202 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.125+0000 7fc4e8838640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.202 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.125+0000 7fc4e8838640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.202 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.125+0000 7f1050a98640 10 monclient: get_auth_request con 0x7f101c081730 auth_method 0 2026-02-17T11:10:35.202 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.125+0000 7ff79e7fc640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7ff7a0152ae0 0x7ff7a014a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.203 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.126+0000 7fc4e983a640 1 --2- 10.20.193.49:0/2523223392 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc4e415d950 0x7fc4e41f54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.203 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.126+0000 7fc4e983a640 10 monclient(hunting): get_auth_request con 0x7fc4e415d950 auth_method 0 2026-02-17T11:10:35.203 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.126+0000 7fc4e983a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.203 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.126+0000 7fc4e983a640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.203 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.126+0000 7fc4e983a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.203 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.127+0000 7f434b7fe640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f434c0d1b60 0x7f434c151050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.203 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.127+0000 7ff79e7fc640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7ff7a0152ae0 0x7ff7a014a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:48154/0 (socket says 10.20.193.49:48154) 2026-02-17T11:10:35.203 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.127+0000 7ff79e7fc640 1 -- 10.20.193.49:0/586960880 learned_addr learned my addr 10.20.193.49:0/586960880 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:35.203 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.127+0000 7ff79e7fc640 10 monclient(hunting): get_auth_request con 0x7ff7a0152ae0 auth_method 0 2026-02-17T11:10:35.203 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.127+0000 7ff79e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.203 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.127+0000 7ff79e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.203 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.127+0000 7ff79e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.203 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.127+0000 7f1050a98640 1 --2- 10.20.193.49:0/3068591869 >> [v2:10.20.193.97:6824/409145483,v1:10.20.193.97:6825/409145483] conn(0x7f101c081730 0x7f101c083b70 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.13 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.203 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.127+0000 7f1048ff9640 10 client.4434.objecter ms_handle_connect 0x7f101c081730 2026-02-17T11:10:35.203 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.128+0000 7fa53b7fe640 1 -- 10.20.193.49:0/353134677 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7fa54c04d460 con 0x7fa55c15b290 2026-02-17T11:10:35.203 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.128+0000 7faeba7fc640 1 -- 10.20.193.49:0/896420849 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec0007e60 con 0x7faecc15f6f0 2026-02-17T11:10:35.204 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.128+0000 7faeba7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.204 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.128+0000 7faeba7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:10:35.204 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.128+0000 7faeba7fc640 10 monclient: dump: 2026-02-17T11:10:35.204 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.204 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.204 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.204 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.204 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.204 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.204 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.204 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.204 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.204 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.204 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.128+0000 7faeba7fc640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.204 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.128+0000 7faeba7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.204 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.128+0000 7faeba7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.204 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.128+0000 7faeba7fc640 1 -- 10.20.193.49:0/896420849 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faec00048e0 con 0x7faecc15f6f0 2026-02-17T11:10:35.204 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.128+0000 7faeba7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.204 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.128+0000 7faeba7fc640 1 -- 10.20.193.49:0/896420849 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec0004cd0 con 0x7faecc15f6f0 2026-02-17T11:10:35.204 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.128+0000 7faeba7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.204 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.128+0000 7faeba7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:35.204 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.128+0000 7faeba7fc640 10 monclient: dump: 2026-02-17T11:10:35.204 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.204 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.204 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.204 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.204 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.204 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.204 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.204 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.204 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.204 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.204 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.128+0000 7faebbfff640 4 set_mon_vals no callback set 2026-02-17T11:10:35.204 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.128+0000 7f434b7fe640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f434c0d1b60 0x7f434c151050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:48140/0 (socket says 10.20.193.49:48140) 2026-02-17T11:10:35.205 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.128+0000 7f434b7fe640 1 -- 10.20.193.49:0/1356756625 learned_addr learned my addr 10.20.193.49:0/1356756625 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:35.205 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.128+0000 7f434b7fe640 10 monclient(hunting): get_auth_request con 0x7f434c0d1b60 auth_method 0 2026-02-17T11:10:35.205 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.128+0000 7f434b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.205 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.128+0000 7f434b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.205 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.128+0000 7f434b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.205 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.128+0000 7fa53b7fe640 1 --2- 10.20.193.49:0/353134677 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fa528079190 0x7fa52807b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.205 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.129+0000 7faed3e91640 5 monclient: authenticate success, global_id 4444 2026-02-17T11:10:35.205 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.129+0000 7faed3e91640 10 monclient: _renew_subs 2026-02-17T11:10:35.205 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.129+0000 7ff79e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.205 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.129+0000 7ff79e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.205 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.129+0000 7ff79e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.205 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.129+0000 7faed3e91640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.205 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.129+0000 7faed3e91640 1 -- 10.20.193.49:0/896420849 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faecc15c460 con 0x7faecc15f6f0 2026-02-17T11:10:35.205 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.129+0000 7faed3e91640 10 client.4444.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:35.205 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.129+0000 7faed3e91640 10 monclient: _renew_subs 2026-02-17T11:10:35.205 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.129+0000 7faed3e91640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.205 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.129+0000 7faed3e91640 1 -- 10.20.193.49:0/896420849 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faecc15ca20 con 0x7faecc15f6f0 2026-02-17T11:10:35.205 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.129+0000 7faed3e91640 1 librados: init done 2026-02-17T11:10:35.206 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.129+0000 7fa55ad76640 1 --2- 10.20.193.49:0/353134677 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fa528079190 0x7fa52807b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.206 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.129+0000 7fa55ad76640 10 monclient: get_auth_request con 0x7fa528079190 auth_method 0 2026-02-17T11:10:35.206 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.129+0000 7faed3e91640 10 client.4444.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:35.206 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.129+0000 7faed3e91640 15 client.4444.objecter _session_command_op_assign -1 1 2026-02-17T11:10:35.206 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.129+0000 7faed3e91640 20 client.4444.objecter _get_session osd=-1 returning homeless 2026-02-17T11:10:35.206 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.129+0000 7faed3e91640 10 client.4444.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:35.206 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.129+0000 7faed3e91640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.206 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.129+0000 7faed3e91640 1 -- 10.20.193.49:0/896420849 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faecc1539c0 con 0x7faecc15f6f0 2026-02-17T11:10:35.206 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.129+0000 7fa55ad76640 1 --2- 10.20.193.49:0/353134677 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fa528079190 0x7fa52807b650 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa550002770 tx=0x7fa550007ab0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.206 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.129+0000 7fa53b7fe640 10 client.4445.objecter ms_handle_connect 0x7fa528079190 2026-02-17T11:10:35.207 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.130+0000 7fa53b7fe640 1 -- 10.20.193.49:0/353134677 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7fa54c035d20 con 0x7fa55c15b290 2026-02-17T11:10:35.207 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.130+0000 7fa53b7fe640 10 client.4445.objecter ms_dispatch2 0x7fa55c000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:35.207 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.130+0000 7fa53b7fe640 3 client.4445.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:35.207 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.130+0000 7fa53b7fe640 3 client.4445.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:35.207 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.130+0000 7fa53b7fe640 10 client.4445.objecter checking command 1 2026-02-17T11:10:35.207 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.130+0000 7fa53b7fe640 1 --2- 10.20.193.49:0/353134677 >> [v2:10.20.193.157:6800/815989681,v1:10.20.193.157:6801/815989681] conn(0x7fa5280816d0 0x7fa528083b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.207 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.130+0000 7fa53b7fe640 20 client.4445.objecter _get_session s=0x7fa528081000 osd=6 3 2026-02-17T11:10:35.207 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.130+0000 7fa53b7fe640 20 client.4445.objecter put_session s=0x7fa528081000 osd=6 3 2026-02-17T11:10:35.207 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.130+0000 7fa53b7fe640 15 client.4445.objecter _session_command_op_remove -1 1 2026-02-17T11:10:35.207 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.130+0000 7fa53b7fe640 20 client.4445.objecter _get_session s=0x7fa528081000 osd=6 3 2026-02-17T11:10:35.207 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.130+0000 7fa53b7fe640 20 client.4445.objecter get_session s=0x7fa528081000 osd=6 3 2026-02-17T11:10:35.207 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.130+0000 7fa53b7fe640 15 client.4445.objecter _session_command_op_assign 6 1 2026-02-17T11:10:35.207 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.130+0000 7fa53b7fe640 20 client.4445.objecter put_session s=0x7fa528081000 osd=6 4 2026-02-17T11:10:35.207 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.130+0000 7fa53b7fe640 10 client.4445.objecter _send_command 1 2026-02-17T11:10:35.207 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.130+0000 7fa53b7fe640 1 -- 10.20.193.49:0/353134677 --> [v2:10.20.193.157:6800/815989681,v1:10.20.193.157:6801/815989681] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa54c0038c0 con 0x7fa5280816d0 2026-02-17T11:10:35.207 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.130+0000 7fa53b7fe640 20 client.4445.objecter dump_active .. 0 homeless 2026-02-17T11:10:35.207 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.130+0000 7fa53b7fe640 1 -- 10.20.193.49:0/353134677 <== mon.2 v2:10.20.193.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fa54c084bc0 con 0x7fa55c15b290 2026-02-17T11:10:35.207 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.130+0000 7fa53b7fe640 10 monclient: handle_get_version_reply finishing 1 version 33 2026-02-17T11:10:35.207 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.130+0000 7ff79e7fc640 10 monclient(hunting): handle_auth_done global_id 4459 payload 824 2026-02-17T11:10:35.207 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.130+0000 7fc4e983a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.207 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.130+0000 7fc4e983a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.207 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.130+0000 7fa55a575640 1 --2- 10.20.193.49:0/353134677 >> [v2:10.20.193.157:6800/815989681,v1:10.20.193.157:6801/815989681] conn(0x7fa5280816d0 0x7fa528083b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.207 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.130+0000 7fc4e983a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.207 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.130+0000 7ff79e7fc640 1 -- 10.20.193.49:0/586960880 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff7a015ef80 msgr2=0x7ff7a00cbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.130+0000 7ff79e7fc640 1 --2- 10.20.193.49:0/586960880 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff7a015ef80 0x7ff7a00cbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.130+0000 7ff79e7fc640 1 -- 10.20.193.49:0/586960880 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ff7a0152700 msgr2=0x7ff7a01f4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.130+0000 7ff79e7fc640 1 --2- 10.20.193.49:0/586960880 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ff7a0152700 0x7ff7a01f4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.130+0000 7ff79e7fc640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.130+0000 7ff79e7fc640 1 monclient: found mon.noname-b 2026-02-17T11:10:35.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.130+0000 7ff79e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.130+0000 7ff79e7fc640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.130+0000 7ff79e7fc640 1 -- 10.20.193.49:0/586960880 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7a00d2790 con 0x7ff7a0152ae0 2026-02-17T11:10:35.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.131+0000 7fa55a575640 10 monclient: get_auth_request con 0x7fa5280816d0 auth_method 0 2026-02-17T11:10:35.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.131+0000 7f434b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.131+0000 7f434b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.131+0000 7f434b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.133+0000 7fa53b7fe640 10 client.4445.objecter ms_handle_connect 0x7fa5280816d0 2026-02-17T11:10:35.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.133+0000 7fa55a575640 1 --2- 10.20.193.49:0/353134677 >> [v2:10.20.193.157:6800/815989681,v1:10.20.193.157:6801/815989681] conn(0x7fa5280816d0 0x7fa528083b10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.133+0000 7fc4e983a640 10 monclient(hunting): handle_auth_done global_id 4443 payload 824 2026-02-17T11:10:35.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.133+0000 7fc4e983a640 1 -- 10.20.193.49:0/2523223392 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc4e40d1b60 msgr2=0x7fc4e41e9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.133+0000 7fc4e983a640 1 --2- 10.20.193.49:0/2523223392 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc4e40d1b60 0x7fc4e41e9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.133+0000 7fc4e983a640 1 -- 10.20.193.49:0/2523223392 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc4e40d1f40 msgr2=0x7fc4e41f4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.133+0000 7fc4e983a640 1 --2- 10.20.193.49:0/2523223392 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc4e40d1f40 0x7fc4e41f4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.133+0000 7fc4e983a640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.133+0000 7fc4e983a640 1 monclient: found mon.noname-a 2026-02-17T11:10:35.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.133+0000 7fc4e983a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.133+0000 7fc4e983a640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:10:35.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.133+0000 7fc4e983a640 1 -- 10.20.193.49:0/2523223392 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4e4157170 con 0x7fc4e415d950 2026-02-17T11:10:35.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.133+0000 7f434affd640 1 --2- 10.20.193.49:0/1356756625 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f434c15c840 0x7f434c1f55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.134+0000 7f434affd640 10 monclient(hunting): get_auth_request con 0x7f434c15c840 auth_method 0 2026-02-17T11:10:35.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.134+0000 7f434affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.134+0000 7f434affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.134+0000 7f434affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.135+0000 7f434bfff640 1 --2- 10.20.193.49:0/1356756625 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f434c15d950 0x7f434c1f5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.135+0000 7fc4e983a640 1 --2- 10.20.193.49:0/2523223392 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc4e415d950 0x7fc4e41f54d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc4e000be20 tx=0x7fc4e000bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.135+0000 7fc4d1ffb640 10 client.?.objecter ms_handle_connect 0x7fc4e415d950 2026-02-17T11:10:35.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.135+0000 7fc4d1ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:35.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.135+0000 7f434bfff640 10 monclient(hunting): get_auth_request con 0x7f434c15d950 auth_method 0 2026-02-17T11:10:35.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.135+0000 7f434bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.135+0000 7f434bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.135+0000 7f434bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.210 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.135+0000 7f434affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.210 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.135+0000 7f434affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.210 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.135+0000 7f434affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.210 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.136+0000 7f434bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.210 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.136+0000 7f434bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.210 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.136+0000 7f434bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.210 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.137+0000 7f434b7fe640 10 monclient(hunting): handle_auth_done global_id 4462 payload 824 2026-02-17T11:10:35.210 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.137+0000 7f434b7fe640 1 -- 10.20.193.49:0/1356756625 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f434c15c840 msgr2=0x7f434c1f55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.210 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.137+0000 7f434b7fe640 1 --2- 10.20.193.49:0/1356756625 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f434c15c840 0x7f434c1f55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.210 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.137+0000 7f434b7fe640 1 -- 10.20.193.49:0/1356756625 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f434c15d950 msgr2=0x7f434c1f5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.210 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.137+0000 7f434b7fe640 1 --2- 10.20.193.49:0/1356756625 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f434c15d950 0x7f434c1f5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.210 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.137+0000 7f434b7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.210 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.137+0000 7f434b7fe640 1 monclient: found mon.noname-b 2026-02-17T11:10:35.210 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.137+0000 7f434b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.210 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.137+0000 7f434b7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.210 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.137+0000 7f434b7fe640 1 -- 10.20.193.49:0/1356756625 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f434c14ac20 con 0x7f434c0d1b60 2026-02-17T11:10:35.210 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.137+0000 7f434bfff640 1 --2- 10.20.193.49:0/1356756625 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f434c15d950 0x7f434c1f5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:10:35.210 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.138+0000 7f5e7b7fe640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5e7c15c840 0x7f5e7c143cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.210 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.138+0000 7fc831ffb640 1 -- 10.20.193.49:0/2395150845 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc840016020 con 0x7fc84415d950 2026-02-17T11:10:35.210 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.138+0000 7fc831ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.210 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.138+0000 7fc831ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:10:35.210 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.138+0000 7fc831ffb640 10 monclient: dump: 2026-02-17T11:10:35.210 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.210 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.210 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.210 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.210 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.210 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.211 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.211 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.211 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.211 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.211 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.138+0000 7fc831ffb640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.211 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.138+0000 7fc831ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.211 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.138+0000 7fc831ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.211 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.138+0000 7fc831ffb640 1 -- 10.20.193.49:0/2395150845 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc84000ce30 con 0x7fc84415d950 2026-02-17T11:10:35.211 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.138+0000 7fc831ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.211 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.138+0000 7fc831ffb640 1 -- 10.20.193.49:0/2395150845 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc840012640 con 0x7fc84415d950 2026-02-17T11:10:35.211 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.138+0000 7fc831ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.211 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.138+0000 7fc831ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:35.211 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.138+0000 7fc831ffb640 10 monclient: dump: 2026-02-17T11:10:35.211 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.211 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.211 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.211 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.211 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.211 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.211 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.211 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.211 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.211 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.211 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.138+0000 7fc8337fe640 4 set_mon_vals no callback set 2026-02-17T11:10:35.211 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.138+0000 7fc84b664640 5 monclient: authenticate success, global_id 4450 2026-02-17T11:10:35.211 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.138+0000 7fc84b664640 10 monclient: _renew_subs 2026-02-17T11:10:35.211 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.138+0000 7fc84b664640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.211 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.138+0000 7fc84b664640 1 -- 10.20.193.49:0/2395150845 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8441f3e30 con 0x7fc84415d950 2026-02-17T11:10:35.211 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.138+0000 7fc84b664640 10 client.4450.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:35.211 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.138+0000 7fc84b664640 10 monclient: _renew_subs 2026-02-17T11:10:35.211 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.138+0000 7fc84b664640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.211 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.138+0000 7fc84b664640 1 -- 10.20.193.49:0/2395150845 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8441f43f0 con 0x7fc84415d950 2026-02-17T11:10:35.211 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.138+0000 7fc84b664640 1 librados: init done 2026-02-17T11:10:35.211 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.139+0000 7fc84b664640 10 client.4450.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:35.211 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.139+0000 7fc84b664640 15 client.4450.objecter _session_command_op_assign -1 1 2026-02-17T11:10:35.211 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.139+0000 7fc84b664640 20 client.4450.objecter _get_session osd=-1 returning homeless 2026-02-17T11:10:35.211 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.139+0000 7fc84b664640 10 client.4450.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:35.211 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.139+0000 7fc84b664640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.211 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.139+0000 7fc84b664640 1 -- 10.20.193.49:0/2395150845 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc8440d1f40 con 0x7fc84415d950 2026-02-17T11:10:35.212 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.140+0000 7f6daf7fe640 1 -- 10.20.193.49:0/2195715102 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc4004280 con 0x7f6dd0152700 2026-02-17T11:10:35.212 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.140+0000 7f6daf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.212 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.140+0000 7f6daf7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:10:35.212 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.140+0000 7f6daf7fe640 10 monclient: dump: 2026-02-17T11:10:35.212 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.212 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.212 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.212 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.212 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.212 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.212 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.212 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.212 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.212 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.212 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.140+0000 7f6daf7fe640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.212 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.140+0000 7f6daf7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.212 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.140+0000 7f6daf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.212 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.140+0000 7f6daf7fe640 1 -- 10.20.193.49:0/2195715102 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dc4015070 con 0x7f6dd0152700 2026-02-17T11:10:35.212 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.140+0000 7f6dd568f640 5 monclient: authenticate success, global_id 4437 2026-02-17T11:10:35.212 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.140+0000 7f6dd568f640 10 monclient: _renew_subs 2026-02-17T11:10:35.212 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.140+0000 7f6dd568f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:35.212 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.140+0000 7f6dd568f640 1 -- 10.20.193.49:0/2195715102 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dd00c5d30 con 0x7f6dd0152700 2026-02-17T11:10:35.212 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.140+0000 7f6daf7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.212 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.140+0000 7f6daf7fe640 1 -- 10.20.193.49:0/2195715102 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc40026e0 con 0x7f6dd0152700 2026-02-17T11:10:35.212 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.140+0000 7f6daf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.212 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.140+0000 7f6daf7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:10:35.212 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.140+0000 7f6daf7fe640 10 monclient: dump: 2026-02-17T11:10:35.212 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.213 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.213 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.213 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.213 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.213 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.213 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.213 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.213 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.213 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.140+0000 7f6dcd7fa640 4 set_mon_vals no callback set 2026-02-17T11:10:35.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.140+0000 7f6dd568f640 10 client.4437.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:35.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.140+0000 7f6dd568f640 10 monclient: _renew_subs 2026-02-17T11:10:35.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.140+0000 7f6dd568f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:35.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.140+0000 7f6dd568f640 1 -- 10.20.193.49:0/2195715102 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dd00c62f0 con 0x7f6dd0152700 2026-02-17T11:10:35.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.140+0000 7f6dd568f640 1 librados: init done 2026-02-17T11:10:35.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.140+0000 7f5e7b7fe640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5e7c15c840 0x7f5e7c143cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:32998/0 (socket says 10.20.193.49:32998) 2026-02-17T11:10:35.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.140+0000 7f5e7b7fe640 1 -- 10.20.193.49:0/3776431914 learned_addr learned my addr 10.20.193.49:0/3776431914 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:35.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.140+0000 7f5e7b7fe640 10 monclient(hunting): get_auth_request con 0x7f5e7c15c840 auth_method 0 2026-02-17T11:10:35.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.140+0000 7f5e7b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.140+0000 7f5e7b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.140+0000 7f5e7b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.140+0000 7ff79e7fc640 1 --2- 10.20.193.49:0/586960880 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7ff7a0152ae0 0x7ff7a014a6a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff788009970 tx=0x7ff7880047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.140+0000 7ff77f7fe640 10 client.?.objecter ms_handle_connect 0x7ff7a0152ae0 2026-02-17T11:10:35.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.140+0000 7ff77f7fe640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:35.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.140+0000 7f6dd568f640 10 client.4437.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:35.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.140+0000 7f6dd568f640 15 client.4437.objecter _session_command_op_assign -1 1 2026-02-17T11:10:35.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.140+0000 7f6dd568f640 20 client.4437.objecter _get_session osd=-1 returning homeless 2026-02-17T11:10:35.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.140+0000 7f6dd568f640 10 client.4437.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:35.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.140+0000 7f6dd568f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:35.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.140+0000 7f6dd568f640 1 -- 10.20.193.49:0/2195715102 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6dd0073d50 con 0x7f6dd0152700 2026-02-17T11:10:35.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.140+0000 7f5e7b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.140+0000 7f5e7b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.140+0000 7f5e7b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.142+0000 7f5e7b7fe640 10 monclient(hunting): handle_auth_done global_id 4452 payload 824 2026-02-17T11:10:35.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.142+0000 7f5e7b7fe640 1 -- 10.20.193.49:0/3776431914 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5e7c15d950 msgr2=0x7f5e7c1f5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.142+0000 7f5e7b7fe640 1 --2- 10.20.193.49:0/3776431914 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5e7c15d950 0x7f5e7c1f5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.142+0000 7f5e7b7fe640 1 -- 10.20.193.49:0/3776431914 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5e7c0d1b60 msgr2=0x7f5e7c159130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.142+0000 7f5e7b7fe640 1 --2- 10.20.193.49:0/3776431914 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5e7c0d1b60 0x7f5e7c159130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.142+0000 7f5e7b7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.142+0000 7f5e7b7fe640 1 monclient: found mon.noname-a 2026-02-17T11:10:35.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.142+0000 7f5e7b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.142+0000 7f5e7b7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:10:35.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.142+0000 7f5e7b7fe640 1 -- 10.20.193.49:0/3776431914 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e7c1f7f30 con 0x7f5e7c15c840 2026-02-17T11:10:35.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.144+0000 7feec7fff640 1 -- 10.20.193.49:0/2599867942 <== osd.7 v2:10.20.193.162:6806/2715110678 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7feebc084190 con 0x7feebc081680 2026-02-17T11:10:35.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.144+0000 7feec7fff640 10 client.4442.objecter ms_dispatch2 0x7feeec000b90 command_reply(tid 1: 0 ) 2026-02-17T11:10:35.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.144+0000 7feec7fff640 10 client.4442.objecter _finish_command 1 = system:0 2026-02-17T11:10:35.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.144+0000 7feec7fff640 20 client.4442.objecter put_session s=0x7feebc080fb0 osd=7 4 2026-02-17T11:10:35.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.144+0000 7feec7fff640 15 client.4442.objecter _session_command_op_remove 7 1 2026-02-17T11:10:35.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.144+0000 7f5e7b7fe640 1 --2- 10.20.193.49:0/3776431914 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5e7c15c840 0x7f5e7c143cd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c00b5a0 tx=0x7f5e6c00ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.144+0000 7f5e78ff9640 10 client.?.objecter ms_handle_connect 0x7f5e7c15c840 2026-02-17T11:10:35.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.144+0000 7f5e78ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:35.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.148+0000 7faeba7fc640 1 -- 10.20.193.49:0/896420849 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7faec0042070 con 0x7faecc15f6f0 2026-02-17T11:10:35.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.149+0000 7faeba7fc640 1 --2- 10.20.193.49:0/896420849 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fae9c079190 0x7fae9c07b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.149+0000 7faed1c06640 1 --2- 10.20.193.49:0/896420849 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fae9c079190 0x7fae9c07b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.149+0000 7faed1c06640 10 monclient: get_auth_request con 0x7fae9c079190 auth_method 0 2026-02-17T11:10:35.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.149+0000 7faeba7fc640 10 client.4444.objecter ms_handle_connect 0x7fae9c079190 2026-02-17T11:10:35.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.149+0000 7faed1c06640 1 --2- 10.20.193.49:0/896420849 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fae9c079190 0x7fae9c07b650 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7faecc0664a0 tx=0x7faebc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.151+0000 7feef21a0640 10 client.4442.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T11:10:35.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.151+0000 7feef21a0640 15 client.4442.objecter _session_command_op_assign -1 2 2026-02-17T11:10:35.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.151+0000 7feef21a0640 20 client.4442.objecter _get_session s=0x7feebc080fb0 osd=7 3 2026-02-17T11:10:35.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.151+0000 7feef21a0640 20 client.4442.objecter put_session s=0x7feebc080fb0 osd=7 3 2026-02-17T11:10:35.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.151+0000 7feef21a0640 20 client.4442.objecter _get_session s=0x7feebc080fb0 osd=7 3 2026-02-17T11:10:35.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.151+0000 7feef21a0640 15 client.4442.objecter _session_command_op_remove -1 2 2026-02-17T11:10:35.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.151+0000 7feef21a0640 20 client.4442.objecter get_session s=0x7feebc080fb0 osd=7 3 2026-02-17T11:10:35.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.151+0000 7feef21a0640 15 client.4442.objecter _session_command_op_assign 7 2 2026-02-17T11:10:35.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.151+0000 7feef21a0640 20 client.4442.objecter put_session s=0x7feebc080fb0 osd=7 4 2026-02-17T11:10:35.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.151+0000 7feef21a0640 10 client.4442.objecter _send_command 2 2026-02-17T11:10:35.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.151+0000 7feef21a0640 1 -- 10.20.193.49:0/2599867942 --> [v2:10.20.193.162:6806/2715110678,v1:10.20.193.162:6808/2715110678] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7feeec1597e0 con 0x7feebc081680 2026-02-17T11:10:35.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.151+0000 7f73faffd640 1 -- 10.20.193.49:0/2659158390 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f740800c520 con 0x7f74140d1b60 2026-02-17T11:10:35.216 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.151+0000 7fe9ccff9640 1 -- 10.20.193.49:0/4131833758 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7fe9c0012050 con 0x7fe9d00ceef0 2026-02-17T11:10:35.216 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.151+0000 7f73faffd640 1 --2- 10.20.193.49:0/2659158390 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f73e4079140 0x7f73e407b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.216 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.151+0000 7fe9ccff9640 1 --2- 10.20.193.49:0/4131833758 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fe9a0079190 0x7fe9a007b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.216 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.152+0000 7fe9cffff640 1 --2- 10.20.193.49:0/4131833758 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fe9a0079190 0x7fe9a007b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.216 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.152+0000 7fe9cffff640 10 monclient: get_auth_request con 0x7fe9a0079190 auth_method 0 2026-02-17T11:10:35.216 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.152+0000 7f741a3e1640 1 --2- 10.20.193.49:0/2659158390 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f73e4079140 0x7f73e407b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.216 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.152+0000 7f741a3e1640 10 monclient: get_auth_request con 0x7f73e4079140 auth_method 0 2026-02-17T11:10:35.216 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.152+0000 7fe9ccff9640 10 client.4422.objecter ms_handle_connect 0x7fe9a0079190 2026-02-17T11:10:35.216 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.152+0000 7fe9cffff640 1 --2- 10.20.193.49:0/4131833758 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fe9a0079190 0x7fe9a007b650 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc00a8d0 tx=0x7fe9bc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.216 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.152+0000 7f741a3e1640 1 --2- 10.20.193.49:0/2659158390 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f73e4079140 0x7f73e407b600 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7404009750 tx=0x7f7404006ca0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.216 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.153+0000 7f73faffd640 10 client.4448.objecter ms_handle_connect 0x7f73e4079140 2026-02-17T11:10:35.217 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.153+0000 7f73faffd640 1 -- 10.20.193.49:0/2659158390 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7f7408012dd0 con 0x7f74140d1b60 2026-02-17T11:10:35.217 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.153+0000 7f73faffd640 10 client.4448.objecter ms_dispatch2 0x7f7414000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:35.217 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.153+0000 7f73faffd640 3 client.4448.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:35.217 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.153+0000 7f73faffd640 3 client.4448.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:35.217 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.153+0000 7f73faffd640 10 client.4448.objecter checking command 1 2026-02-17T11:10:35.217 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.153+0000 7f73faffd640 1 --2- 10.20.193.49:0/2659158390 >> [v2:10.20.193.162:6818/1543573918,v1:10.20.193.162:6820/1543573918] conn(0x7f73e4081680 0x7f73e4083ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.217 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.153+0000 7f73faffd640 20 client.4448.objecter _get_session s=0x7f73e4080fb0 osd=3 3 2026-02-17T11:10:35.217 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.153+0000 7f73faffd640 20 client.4448.objecter put_session s=0x7f73e4080fb0 osd=3 3 2026-02-17T11:10:35.217 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.153+0000 7f73faffd640 15 client.4448.objecter _session_command_op_remove -1 1 2026-02-17T11:10:35.217 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.153+0000 7f73faffd640 20 client.4448.objecter _get_session s=0x7f73e4080fb0 osd=3 3 2026-02-17T11:10:35.217 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.153+0000 7f73faffd640 20 client.4448.objecter get_session s=0x7f73e4080fb0 osd=3 3 2026-02-17T11:10:35.217 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.153+0000 7f73faffd640 15 client.4448.objecter _session_command_op_assign 3 1 2026-02-17T11:10:35.217 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.153+0000 7f73faffd640 20 client.4448.objecter put_session s=0x7f73e4080fb0 osd=3 4 2026-02-17T11:10:35.217 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.153+0000 7f73faffd640 10 client.4448.objecter _send_command 1 2026-02-17T11:10:35.217 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.153+0000 7f73faffd640 1 -- 10.20.193.49:0/2659158390 --> [v2:10.20.193.162:6818/1543573918,v1:10.20.193.162:6820/1543573918] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7408017e50 con 0x7f73e4081680 2026-02-17T11:10:35.217 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.153+0000 7f73faffd640 20 client.4448.objecter dump_active .. 0 homeless 2026-02-17T11:10:35.217 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.153+0000 7f73faffd640 1 -- 10.20.193.49:0/2659158390 <== mon.2 v2:10.20.193.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f740805dd70 con 0x7f74140d1b60 2026-02-17T11:10:35.217 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.153+0000 7f73faffd640 10 monclient: handle_get_version_reply finishing 1 version 33 2026-02-17T11:10:35.217 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.153+0000 7f1048ff9640 1 -- 10.20.193.49:0/3068591869 <== osd.13 v2:10.20.193.97:6824/409145483 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f103c006e50 con 0x7f101c081730 2026-02-17T11:10:35.217 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.153+0000 7f1048ff9640 10 client.4434.objecter ms_dispatch2 0x7f104c000b90 command_reply(tid 1: 0 ) 2026-02-17T11:10:35.217 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.153+0000 7f1048ff9640 10 client.4434.objecter _finish_command 1 = system:0 2026-02-17T11:10:35.217 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.153+0000 7f1048ff9640 20 client.4434.objecter put_session s=0x7f101c081060 osd=13 4 2026-02-17T11:10:35.217 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.153+0000 7f1048ff9640 15 client.4434.objecter _session_command_op_remove 13 1 2026-02-17T11:10:35.217 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.153+0000 7f741abe2640 1 --2- 10.20.193.49:0/2659158390 >> [v2:10.20.193.162:6818/1543573918,v1:10.20.193.162:6820/1543573918] conn(0x7f73e4081680 0x7f73e4083ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.217 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.154+0000 7f741abe2640 10 monclient: get_auth_request con 0x7f73e4081680 auth_method 0 2026-02-17T11:10:35.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.154+0000 7feec7fff640 1 -- 10.20.193.49:0/2599867942 <== osd.7 v2:10.20.193.162:6806/2715110678 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7feeec1597e0 con 0x7feebc081680 2026-02-17T11:10:35.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.154+0000 7feec7fff640 10 client.4442.objecter ms_dispatch2 0x7feeec000b90 command_reply(tid 2: 0 ) 2026-02-17T11:10:35.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.154+0000 7feec7fff640 10 client.4442.objecter _finish_command 2 = system:0 2026-02-17T11:10:35.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.154+0000 7feec7fff640 20 client.4442.objecter put_session s=0x7feebc080fb0 osd=7 4 2026-02-17T11:10:35.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.154+0000 7feec7fff640 15 client.4442.objecter _session_command_op_remove 7 2 2026-02-17T11:10:35.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.154+0000 7feef21a0640 10 librados: watch_flush enter 2026-02-17T11:10:35.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.154+0000 7feef21a0640 10 librados: watch_flush exit 2026-02-17T11:10:35.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.154+0000 7feef21a0640 10 client.4442.objecter close_session for osd.7 2026-02-17T11:10:35.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.154+0000 7feef21a0640 1 -- 10.20.193.49:0/2599867942 >> [v2:10.20.193.162:6806/2715110678,v1:10.20.193.162:6808/2715110678] conn(0x7feebc081680 msgr2=0x7feebc083ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.154+0000 7feef21a0640 1 --2- 10.20.193.49:0/2599867942 >> [v2:10.20.193.162:6806/2715110678,v1:10.20.193.162:6808/2715110678] conn(0x7feebc081680 0x7feebc083ac0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.154+0000 7feef21a0640 20 client.4442.objecter put_session s=0x7feebc080fb0 osd=7 1 2026-02-17T11:10:35.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.154+0000 7feef21a0640 20 client.4442.objecter shutdown clearing up homeless session... 2026-02-17T11:10:35.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.154+0000 7feef21a0640 10 client.4442.objecter successfully canceled tick 2026-02-17T11:10:35.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.154+0000 7feef21a0640 1 -- 10.20.193.49:0/2599867942 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7feebc079140 msgr2=0x7feebc07b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.154+0000 7feef21a0640 1 --2- 10.20.193.49:0/2599867942 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7feebc079140 0x7feebc07b600 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7feed8002e60 tx=0x7feed8007a70 comp rx=0 tx=0).stop 2026-02-17T11:10:35.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.154+0000 7feef21a0640 10 monclient: shutdown 2026-02-17T11:10:35.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.154+0000 7feef21a0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:35.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.154+0000 7feef21a0640 1 -- 10.20.193.49:0/2599867942 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7feeec0d1f40 msgr2=0x7feeec1f52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.154+0000 7feef21a0640 1 --2- 10.20.193.49:0/2599867942 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7feeec0d1f40 0x7feeec1f52e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7feedc016e30 tx=0x7feedc0047c0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.154+0000 7feeebfff640 1 -- 10.20.193.49:0/2599867942 reap_dead start 2026-02-17T11:10:35.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.154+0000 7feef21a0640 1 -- 10.20.193.49:0/2599867942 shutdown_connections 2026-02-17T11:10:35.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.154+0000 7feef21a0640 1 -- 10.20.193.49:0/2599867942 >> 10.20.193.49:0/2599867942 conn(0x7feeec06d9b0 msgr2=0x7feeec0d0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:35.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.154+0000 7feef21a0640 1 -- 10.20.193.49:0/2599867942 shutdown_connections 2026-02-17T11:10:35.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.154+0000 7feef21a0640 1 -- 10.20.193.49:0/2599867942 wait complete. 2026-02-17T11:10:35.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.154+0000 7faeba7fc640 1 -- 10.20.193.49:0/896420849 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7faec0002440 con 0x7faecc15f6f0 2026-02-17T11:10:35.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.154+0000 7faeba7fc640 10 client.4444.objecter ms_dispatch2 0x7faecc000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:35.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.154+0000 7faeba7fc640 3 client.4444.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:35.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.154+0000 7faeba7fc640 3 client.4444.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:35.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.154+0000 7feef21a0640 1 librados: shutdown 2026-02-17T11:10:35.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.154+0000 7faeba7fc640 10 client.4444.objecter checking command 1 2026-02-17T11:10:35.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.154+0000 7faeba7fc640 1 --2- 10.20.193.49:0/896420849 >> [v2:10.20.193.97:6800/3226749558,v1:10.20.193.97:6801/3226749558] conn(0x7fae9c081730 0x7fae9c083b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.154+0000 7faeba7fc640 20 client.4444.objecter _get_session s=0x7fae9c081060 osd=5 3 2026-02-17T11:10:35.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.154+0000 7faeba7fc640 20 client.4444.objecter put_session s=0x7fae9c081060 osd=5 3 2026-02-17T11:10:35.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.154+0000 7faeba7fc640 15 client.4444.objecter _session_command_op_remove -1 1 2026-02-17T11:10:35.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.154+0000 7faeba7fc640 20 client.4444.objecter _get_session s=0x7fae9c081060 osd=5 3 2026-02-17T11:10:35.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.154+0000 7faeba7fc640 20 client.4444.objecter get_session s=0x7fae9c081060 osd=5 3 2026-02-17T11:10:35.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.154+0000 7faeba7fc640 15 client.4444.objecter _session_command_op_assign 5 1 2026-02-17T11:10:35.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.154+0000 7faeba7fc640 20 client.4444.objecter put_session s=0x7fae9c081060 osd=5 4 2026-02-17T11:10:35.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.154+0000 7faeba7fc640 10 client.4444.objecter _send_command 1 2026-02-17T11:10:35.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.154+0000 7faeba7fc640 1 -- 10.20.193.49:0/896420849 --> [v2:10.20.193.97:6800/3226749558,v1:10.20.193.97:6801/3226749558] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faec0039e50 con 0x7fae9c081730 2026-02-17T11:10:35.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.154+0000 7faeba7fc640 20 client.4444.objecter dump_active .. 0 homeless 2026-02-17T11:10:35.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.155+0000 7faeba7fc640 1 -- 10.20.193.49:0/896420849 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7faec0082e50 con 0x7faecc15f6f0 2026-02-17T11:10:35.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.155+0000 7faeba7fc640 10 monclient: handle_get_version_reply finishing 1 version 33 2026-02-17T11:10:35.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.155+0000 7faed2407640 1 --2- 10.20.193.49:0/896420849 >> [v2:10.20.193.97:6800/3226749558,v1:10.20.193.97:6801/3226749558] conn(0x7fae9c081730 0x7fae9c083b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.155+0000 7f434b7fe640 1 --2- 10.20.193.49:0/1356756625 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f434c0d1b60 0x7f434c151050 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f433800b500 tx=0x7f433800b9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.155+0000 7faed2407640 10 monclient: get_auth_request con 0x7fae9c081730 auth_method 0 2026-02-17T11:10:35.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.155+0000 7f4327fff640 10 client.?.objecter ms_handle_connect 0x7f434c0d1b60 2026-02-17T11:10:35.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.155+0000 7f4327fff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:35.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.155+0000 7f73faffd640 10 client.4448.objecter ms_handle_connect 0x7f73e4081680 2026-02-17T11:10:35.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.155+0000 7f741abe2640 1 --2- 10.20.193.49:0/2659158390 >> [v2:10.20.193.162:6818/1543573918,v1:10.20.193.162:6820/1543573918] conn(0x7f73e4081680 0x7f73e4083ac0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.157+0000 7faed2407640 1 --2- 10.20.193.49:0/896420849 >> [v2:10.20.193.97:6800/3226749558,v1:10.20.193.97:6801/3226749558] conn(0x7fae9c081730 0x7fae9c083b70 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.157+0000 7faeba7fc640 10 client.4444.objecter ms_handle_connect 0x7fae9c081730 2026-02-17T11:10:35.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.158+0000 7fe9ccff9640 1 -- 10.20.193.49:0/4131833758 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7fe9c005dbf0 con 0x7fe9d00ceef0 2026-02-17T11:10:35.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.158+0000 7fe9ccff9640 10 client.4422.objecter ms_dispatch2 0x7fe9d0000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:35.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.158+0000 7fe9ccff9640 3 client.4422.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:35.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.158+0000 7fe9ccff9640 3 client.4422.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:35.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.158+0000 7fe9ccff9640 10 client.4422.objecter checking command 1 2026-02-17T11:10:35.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.158+0000 7fe9ccff9640 1 --2- 10.20.193.49:0/4131833758 >> [v2:10.20.193.162:6802/3400543064,v1:10.20.193.162:6803/3400543064] conn(0x7fe9a00816d0 0x7fe9a0083b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.158+0000 7fe9ccff9640 20 client.4422.objecter _get_session s=0x7fe9a0081000 osd=11 3 2026-02-17T11:10:35.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.158+0000 7fe9ccff9640 20 client.4422.objecter put_session s=0x7fe9a0081000 osd=11 3 2026-02-17T11:10:35.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.158+0000 7fe9ccff9640 15 client.4422.objecter _session_command_op_remove -1 1 2026-02-17T11:10:35.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.158+0000 7fe9ccff9640 20 client.4422.objecter _get_session s=0x7fe9a0081000 osd=11 3 2026-02-17T11:10:35.221 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.158+0000 7fe9ccff9640 20 client.4422.objecter get_session s=0x7fe9a0081000 osd=11 3 2026-02-17T11:10:35.221 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.158+0000 7fe9ccff9640 15 client.4422.objecter _session_command_op_assign 11 1 2026-02-17T11:10:35.221 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.158+0000 7fe9ccff9640 20 client.4422.objecter put_session s=0x7fe9a0081000 osd=11 4 2026-02-17T11:10:35.221 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.158+0000 7fe9ccff9640 10 client.4422.objecter _send_command 1 2026-02-17T11:10:35.221 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.158+0000 7fe9ccff9640 1 -- 10.20.193.49:0/4131833758 --> [v2:10.20.193.162:6802/3400543064,v1:10.20.193.162:6803/3400543064] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe9c001fe70 con 0x7fe9a00816d0 2026-02-17T11:10:35.221 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.158+0000 7fe9ccff9640 20 client.4422.objecter dump_active .. 0 homeless 2026-02-17T11:10:35.221 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.158+0000 7fe9ccff9640 1 -- 10.20.193.49:0/4131833758 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fe9c005dfb0 con 0x7fe9d00ceef0 2026-02-17T11:10:35.221 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.158+0000 7fe9ccff9640 10 monclient: handle_get_version_reply finishing 1 version 33 2026-02-17T11:10:35.221 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.159+0000 7fe9d4872640 1 --2- 10.20.193.49:0/4131833758 >> [v2:10.20.193.162:6802/3400543064,v1:10.20.193.162:6803/3400543064] conn(0x7fe9a00816d0 0x7fe9a0083b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.221 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.159+0000 7fe9d4872640 10 monclient: get_auth_request con 0x7fe9a00816d0 auth_method 0 2026-02-17T11:10:35.221 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.159+0000 7fc4d1ffb640 1 -- 10.20.193.49:0/2523223392 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e0006e60 con 0x7fc4e415d950 2026-02-17T11:10:35.221 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.159+0000 7fc4d1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.221 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.159+0000 7fc4d1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:10:35.221 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.159+0000 7fc4d1ffb640 10 monclient: dump: 2026-02-17T11:10:35.221 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.221 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.221 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.221 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.221 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.222 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.222 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.222 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.222 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.222 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.222 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.159+0000 7fc4d1ffb640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.222 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.159+0000 7fc4d1ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.222 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.159+0000 7fc4d1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.222 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.159+0000 7fc4d1ffb640 1 -- 10.20.193.49:0/2523223392 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4e0010070 con 0x7fc4e415d950 2026-02-17T11:10:35.222 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.159+0000 7fc4d1ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.222 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.159+0000 7fc4d1ffb640 1 -- 10.20.193.49:0/2523223392 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e000ccf0 con 0x7fc4e415d950 2026-02-17T11:10:35.222 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.159+0000 7fc4eb2c4640 5 monclient: authenticate success, global_id 4443 2026-02-17T11:10:35.222 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.160+0000 7fc4eb2c4640 10 monclient: _renew_subs 2026-02-17T11:10:35.222 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.160+0000 7fc4d37fe640 4 set_mon_vals no callback set 2026-02-17T11:10:35.222 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.160+0000 7fc4eb2c4640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:35.222 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.160+0000 7fc4eb2c4640 1 -- 10.20.193.49:0/2523223392 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4e4157450 con 0x7fc4e415d950 2026-02-17T11:10:35.222 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.160+0000 7fc4d1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.222 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.160+0000 7fc4d1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:10:35.222 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.160+0000 7fc4d1ffb640 10 monclient: dump: 2026-02-17T11:10:35.222 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.222 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.222 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.222 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.222 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.222 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.222 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.222 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.222 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.222 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.222 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.160+0000 7fc4eb2c4640 10 client.4443.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:35.222 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.160+0000 7fc4eb2c4640 10 monclient: _renew_subs 2026-02-17T11:10:35.222 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.160+0000 7fc4eb2c4640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:35.222 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.160+0000 7fc4eb2c4640 1 -- 10.20.193.49:0/2523223392 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4e4157a10 con 0x7fc4e415d950 2026-02-17T11:10:35.222 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.160+0000 7fc4eb2c4640 1 librados: init done 2026-02-17T11:10:35.222 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.160+0000 7fc4eb2c4640 10 client.4443.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:35.222 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.160+0000 7fc4eb2c4640 15 client.4443.objecter _session_command_op_assign -1 1 2026-02-17T11:10:35.222 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.160+0000 7fc4eb2c4640 20 client.4443.objecter _get_session osd=-1 returning homeless 2026-02-17T11:10:35.222 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.160+0000 7fc4eb2c4640 10 client.4443.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:35.222 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.160+0000 7fc4eb2c4640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:35.223 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.160+0000 7fc4eb2c4640 1 -- 10.20.193.49:0/2523223392 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc4e40cb140 con 0x7fc4e415d950 2026-02-17T11:10:35.223 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.161+0000 7f1052522640 10 client.4434.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T11:10:35.223 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.161+0000 7f1052522640 15 client.4434.objecter _session_command_op_assign -1 2 2026-02-17T11:10:35.223 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.161+0000 7f1052522640 20 client.4434.objecter _get_session s=0x7f101c081060 osd=13 3 2026-02-17T11:10:35.223 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.161+0000 7f1052522640 20 client.4434.objecter put_session s=0x7f101c081060 osd=13 3 2026-02-17T11:10:35.223 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.161+0000 7f1052522640 20 client.4434.objecter _get_session s=0x7f101c081060 osd=13 3 2026-02-17T11:10:35.223 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.161+0000 7f1052522640 15 client.4434.objecter _session_command_op_remove -1 2 2026-02-17T11:10:35.223 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.161+0000 7f1052522640 20 client.4434.objecter get_session s=0x7f101c081060 osd=13 3 2026-02-17T11:10:35.223 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.161+0000 7f1052522640 15 client.4434.objecter _session_command_op_assign 13 2 2026-02-17T11:10:35.223 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.161+0000 7f1052522640 20 client.4434.objecter put_session s=0x7f101c081060 osd=13 4 2026-02-17T11:10:35.223 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.161+0000 7f1052522640 10 client.4434.objecter _send_command 2 2026-02-17T11:10:35.223 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.161+0000 7f1052522640 1 -- 10.20.193.49:0/3068591869 --> [v2:10.20.193.97:6824/409145483,v1:10.20.193.97:6825/409145483] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f104c151c60 con 0x7f101c081730 2026-02-17T11:10:35.223 INFO:teuthology.orchestra.run.trial049.stdout:107374182406 2026-02-17T11:10:35.223 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2026-02-17T11:10:35.224 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.162+0000 7fe9ccff9640 10 client.4422.objecter ms_handle_connect 0x7fe9a00816d0 2026-02-17T11:10:35.224 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.162+0000 7fe9d4872640 1 --2- 10.20.193.49:0/4131833758 >> [v2:10.20.193.162:6802/3400543064,v1:10.20.193.162:6803/3400543064] conn(0x7fe9a00816d0 0x7fe9a0083b10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.224 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.162+0000 7fecaf7fe640 1 -- 10.20.193.49:0/1418801595 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc4046020 con 0x7fecd0152700 2026-02-17T11:10:35.224 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.162+0000 7fecaf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.224 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.162+0000 7fecaf7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:10:35.224 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.162+0000 7fecaf7fe640 10 monclient: dump: 2026-02-17T11:10:35.224 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.224 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.224 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.224 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.224 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.224 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.224 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.224 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.224 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.224 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.224 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.162+0000 7fecaf7fe640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.224 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.162+0000 7fecaf7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.224 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.162+0000 7fecaf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.224 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.162+0000 7fecaf7fe640 1 -- 10.20.193.49:0/1418801595 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecc4042700 con 0x7fecd0152700 2026-02-17T11:10:35.224 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.162+0000 7fecd52a7640 5 monclient: authenticate success, global_id 4438 2026-02-17T11:10:35.225 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.162+0000 7fecd52a7640 10 monclient: _renew_subs 2026-02-17T11:10:35.225 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.162+0000 7fecd52a7640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.225 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.162+0000 7fecd52a7640 1 -- 10.20.193.49:0/1418801595 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecd0147f70 con 0x7fecd0152700 2026-02-17T11:10:35.225 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.162+0000 7fecaf7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.225 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.162+0000 7fecaf7fe640 1 -- 10.20.193.49:0/1418801595 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc403c040 con 0x7fecd0152700 2026-02-17T11:10:35.225 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.162+0000 7fecaf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.225 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.162+0000 7fecaf7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:35.225 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.162+0000 7fecaf7fe640 10 monclient: dump: 2026-02-17T11:10:35.225 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.225 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.225 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.225 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.225 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.225 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.225 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.225 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.225 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.225 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.225 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.162+0000 7feccd7fa640 4 set_mon_vals no callback set 2026-02-17T11:10:35.225 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.162+0000 7fecd52a7640 10 client.4438.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:35.225 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.162+0000 7fecd52a7640 10 monclient: _renew_subs 2026-02-17T11:10:35.225 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.162+0000 7fecd52a7640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.225 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.162+0000 7fecd52a7640 1 -- 10.20.193.49:0/1418801595 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecd0148530 con 0x7fecd0152700 2026-02-17T11:10:35.225 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.162+0000 7fecd52a7640 1 librados: init done 2026-02-17T11:10:35.225 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.162+0000 7f5e78ff9640 1 -- 10.20.193.49:0/3776431914 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c013020 con 0x7f5e7c15c840 2026-02-17T11:10:35.225 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.162+0000 7f5e78ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.225 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.162+0000 7f5e78ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:10:35.225 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.162+0000 7f5e78ff9640 10 monclient: dump: 2026-02-17T11:10:35.225 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.225 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.226 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.226 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.226 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.226 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.226 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.226 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.226 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.226 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.226 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.163+0000 7f5e78ff9640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.226 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.163+0000 7f5e78ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.226 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.163+0000 7f5e78ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.226 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.163+0000 7f5e78ff9640 1 -- 10.20.193.49:0/3776431914 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e6c0044a0 con 0x7f5e7c15c840 2026-02-17T11:10:35.226 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.163+0000 7f5e78ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.226 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.163+0000 7f5e78ff9640 1 -- 10.20.193.49:0/3776431914 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c0029c0 con 0x7f5e7c15c840 2026-02-17T11:10:35.226 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.163+0000 7f5e82375640 5 monclient: authenticate success, global_id 4452 2026-02-17T11:10:35.226 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.163+0000 7f5e82375640 10 monclient: _renew_subs 2026-02-17T11:10:35.226 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.163+0000 7f5e7a7fc640 4 set_mon_vals no callback set 2026-02-17T11:10:35.226 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.163+0000 7f5e82375640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:35.226 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.163+0000 7f5e82375640 1 -- 10.20.193.49:0/3776431914 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e7c1f3c70 con 0x7f5e7c15c840 2026-02-17T11:10:35.226 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.163+0000 7f5e78ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.226 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.163+0000 7f5e78ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:10:35.226 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.163+0000 7f5e78ff9640 10 monclient: dump: 2026-02-17T11:10:35.226 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.226 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.226 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.226 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.226 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.226 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.226 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.226 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.226 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.226 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.226 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.163+0000 7fc831ffb640 1 -- 10.20.193.49:0/2395150845 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7fc8400127e0 con 0x7fc84415d950 2026-02-17T11:10:35.226 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.163+0000 7f5e82375640 10 client.4452.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:35.226 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.163+0000 7f5e82375640 10 monclient: _renew_subs 2026-02-17T11:10:35.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.163+0000 7f5e82375640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:35.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.163+0000 7f5e82375640 1 -- 10.20.193.49:0/3776431914 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e7c1f4230 con 0x7f5e7c15c840 2026-02-17T11:10:35.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.163+0000 7f5e82375640 1 librados: init done 2026-02-17T11:10:35.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.163+0000 7fecd52a7640 10 client.4438.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:35.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.163+0000 7fecd52a7640 15 client.4438.objecter _session_command_op_assign -1 1 2026-02-17T11:10:35.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.163+0000 7fecd52a7640 20 client.4438.objecter _get_session osd=-1 returning homeless 2026-02-17T11:10:35.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.163+0000 7fecd52a7640 10 client.4438.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:35.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.163+0000 7fecd52a7640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.163+0000 7fecd52a7640 1 -- 10.20.193.49:0/1418801595 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fecd015e870 con 0x7fecd0152700 2026-02-17T11:10:35.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.163+0000 7fc831ffb640 1 --2- 10.20.193.49:0/2395150845 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fc814079190 0x7fc81407b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.163+0000 7f5e82375640 10 client.4452.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:35.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.163+0000 7f5e82375640 15 client.4452.objecter _session_command_op_assign -1 1 2026-02-17T11:10:35.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.163+0000 7f5e82375640 20 client.4452.objecter _get_session osd=-1 returning homeless 2026-02-17T11:10:35.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.163+0000 7f5e82375640 10 client.4452.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:35.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.163+0000 7f5e82375640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:35.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.163+0000 7f5e82375640 1 -- 10.20.193.49:0/3776431914 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5e7c0d1f40 con 0x7f5e7c15c840 2026-02-17T11:10:35.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.163+0000 7fc8493d9640 1 --2- 10.20.193.49:0/2395150845 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fc814079190 0x7fc81407b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.163+0000 7fc8493d9640 10 monclient: get_auth_request con 0x7fc814079190 auth_method 0 2026-02-17T11:10:35.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.164+0000 7fc8493d9640 1 --2- 10.20.193.49:0/2395150845 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fc814079190 0x7fc81407b650 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc834039000 tx=0x7fc834031000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.164+0000 7fc831ffb640 10 client.4450.objecter ms_handle_connect 0x7fc814079190 2026-02-17T11:10:35.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.165+0000 7fa53b7fe640 1 -- 10.20.193.49:0/353134677 <== osd.6 v2:10.20.193.157:6800/815989681 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fa54c0038c0 con 0x7fa5280816d0 2026-02-17T11:10:35.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.165+0000 7fa53b7fe640 10 client.4445.objecter ms_dispatch2 0x7fa55c000b90 command_reply(tid 1: 0 ) 2026-02-17T11:10:35.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.165+0000 7fa53b7fe640 10 client.4445.objecter _finish_command 1 = system:0 2026-02-17T11:10:35.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.165+0000 7fa53b7fe640 20 client.4445.objecter put_session s=0x7fa528081000 osd=6 4 2026-02-17T11:10:35.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.165+0000 7fa53b7fe640 15 client.4445.objecter _session_command_op_remove 6 1 2026-02-17T11:10:35.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.165+0000 7fc831ffb640 1 -- 10.20.193.49:0/2395150845 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7fc84005eca0 con 0x7fc84415d950 2026-02-17T11:10:35.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.165+0000 7fc831ffb640 10 client.4450.objecter ms_dispatch2 0x7fc844000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:35.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.165+0000 7fc831ffb640 3 client.4450.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:35.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.165+0000 7fc831ffb640 3 client.4450.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:35.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.165+0000 7fc831ffb640 10 client.4450.objecter checking command 1 2026-02-17T11:10:35.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.165+0000 7fc831ffb640 1 --2- 10.20.193.49:0/2395150845 >> [v2:10.20.193.157:6808/3711386099,v1:10.20.193.157:6809/3711386099] conn(0x7fc8140816d0 0x7fc814083b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.165+0000 7fc831ffb640 20 client.4450.objecter _get_session s=0x7fc814081000 osd=10 3 2026-02-17T11:10:35.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.165+0000 7fc831ffb640 20 client.4450.objecter put_session s=0x7fc814081000 osd=10 3 2026-02-17T11:10:35.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.165+0000 7fc831ffb640 15 client.4450.objecter _session_command_op_remove -1 1 2026-02-17T11:10:35.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.165+0000 7fc831ffb640 20 client.4450.objecter _get_session s=0x7fc814081000 osd=10 3 2026-02-17T11:10:35.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.165+0000 7fc831ffb640 20 client.4450.objecter get_session s=0x7fc814081000 osd=10 3 2026-02-17T11:10:35.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.165+0000 7fc831ffb640 15 client.4450.objecter _session_command_op_assign 10 1 2026-02-17T11:10:35.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.165+0000 7fc831ffb640 20 client.4450.objecter put_session s=0x7fc814081000 osd=10 4 2026-02-17T11:10:35.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.165+0000 7fc831ffb640 10 client.4450.objecter _send_command 1 2026-02-17T11:10:35.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.165+0000 7fc831ffb640 1 -- 10.20.193.49:0/2395150845 --> [v2:10.20.193.157:6808/3711386099,v1:10.20.193.157:6809/3711386099] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc840014ec0 con 0x7fc8140816d0 2026-02-17T11:10:35.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.165+0000 7fc831ffb640 20 client.4450.objecter dump_active .. 0 homeless 2026-02-17T11:10:35.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.165+0000 7fc831ffb640 1 -- 10.20.193.49:0/2395150845 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fc84005f060 con 0x7fc84415d950 2026-02-17T11:10:35.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.165+0000 7fc831ffb640 10 monclient: handle_get_version_reply finishing 1 version 33 2026-02-17T11:10:35.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.165+0000 7fc848bd8640 1 --2- 10.20.193.49:0/2395150845 >> [v2:10.20.193.157:6808/3711386099,v1:10.20.193.157:6809/3711386099] conn(0x7fc8140816d0 0x7fc814083b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.165+0000 7fc848bd8640 10 monclient: get_auth_request con 0x7fc8140816d0 auth_method 0 2026-02-17T11:10:35.229 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.167+0000 7f3fa4ff9640 1 -- 10.20.193.49:0/715203919 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c00ce50 con 0x7f3fa815ef80 2026-02-17T11:10:35.229 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.167+0000 7f3fa4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.229 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.167+0000 7f3fa4ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:10:35.229 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.167+0000 7f3fa4ff9640 10 monclient: dump: 2026-02-17T11:10:35.229 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.229 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.229 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.229 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.229 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.229 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.229 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.229 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.229 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.229 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.229 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.167+0000 7f3fa4ff9640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.229 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.167+0000 7f3fa4ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.229 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.167+0000 7f3fa4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.229 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.167+0000 7f3fa4ff9640 1 -- 10.20.193.49:0/715203919 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f9c003a90 con 0x7f3fa815ef80 2026-02-17T11:10:35.229 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.167+0000 7f3fae396640 5 monclient: authenticate success, global_id 4441 2026-02-17T11:10:35.229 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.167+0000 7f3fae396640 10 monclient: _renew_subs 2026-02-17T11:10:35.229 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.167+0000 7f3fae396640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.229 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.167+0000 7f3fae396640 1 -- 10.20.193.49:0/715203919 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fa8201800 con 0x7f3fa815ef80 2026-02-17T11:10:35.229 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.167+0000 7f3fa4ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.229 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.167+0000 7f3fa4ff9640 1 -- 10.20.193.49:0/715203919 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c003e60 con 0x7f3fa815ef80 2026-02-17T11:10:35.229 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.167+0000 7f3fa4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.229 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.167+0000 7f3fa4ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:35.229 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.167+0000 7f3fa4ff9640 10 monclient: dump: 2026-02-17T11:10:35.229 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.229 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.229 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.229 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.229 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.229 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.230 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.230 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.230 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.230 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.167+0000 7f3fa67fc640 4 set_mon_vals no callback set 2026-02-17T11:10:35.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.168+0000 7f3fae396640 10 client.4441.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:35.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.168+0000 7f3fae396640 10 monclient: _renew_subs 2026-02-17T11:10:35.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.168+0000 7f3fae396640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.168+0000 7f3fae396640 1 -- 10.20.193.49:0/715203919 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fa80cf8f0 con 0x7f3fa815ef80 2026-02-17T11:10:35.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.168+0000 7f3fae396640 1 librados: init done 2026-02-17T11:10:35.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.168+0000 7fc831ffb640 10 client.4450.objecter ms_handle_connect 0x7fc8140816d0 2026-02-17T11:10:35.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.168+0000 7fc848bd8640 1 --2- 10.20.193.49:0/2395150845 >> [v2:10.20.193.157:6808/3711386099,v1:10.20.193.157:6809/3711386099] conn(0x7fc8140816d0 0x7fc814083b10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.168+0000 7f3fae396640 10 client.4441.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:35.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.168+0000 7f3fae396640 15 client.4441.objecter _session_command_op_assign -1 1 2026-02-17T11:10:35.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.168+0000 7f3fae396640 20 client.4441.objecter _get_session osd=-1 returning homeless 2026-02-17T11:10:35.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.168+0000 7f3fae396640 10 client.4441.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:35.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.168+0000 7f3fae396640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.168+0000 7f3fae396640 1 -- 10.20.193.49:0/715203919 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3fa8073e00 con 0x7f3fa815ef80 2026-02-17T11:10:35.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.170+0000 7f1048ff9640 1 -- 10.20.193.49:0/3068591869 <== osd.13 v2:10.20.193.97:6824/409145483 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f104003d040 con 0x7f101c081730 2026-02-17T11:10:35.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.170+0000 7f1048ff9640 10 client.4434.objecter ms_dispatch2 0x7f104c000b90 command_reply(tid 2: 0 ) 2026-02-17T11:10:35.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.170+0000 7f1048ff9640 10 client.4434.objecter _finish_command 2 = system:0 2026-02-17T11:10:35.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.170+0000 7f1048ff9640 20 client.4434.objecter put_session s=0x7f101c081060 osd=13 4 2026-02-17T11:10:35.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.170+0000 7f1048ff9640 15 client.4434.objecter _session_command_op_remove 13 2 2026-02-17T11:10:35.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.170+0000 7f1052522640 10 librados: watch_flush enter 2026-02-17T11:10:35.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.170+0000 7f1052522640 10 librados: watch_flush exit 2026-02-17T11:10:35.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.170+0000 7f1052522640 10 client.4434.objecter close_session for osd.13 2026-02-17T11:10:35.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.170+0000 7f1052522640 1 -- 10.20.193.49:0/3068591869 >> [v2:10.20.193.97:6824/409145483,v1:10.20.193.97:6825/409145483] conn(0x7f101c081730 msgr2=0x7f101c083b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.170+0000 7f1052522640 1 --2- 10.20.193.49:0/3068591869 >> [v2:10.20.193.97:6824/409145483,v1:10.20.193.97:6825/409145483] conn(0x7f101c081730 0x7f101c083b70 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.170+0000 7f1052522640 20 client.4434.objecter put_session s=0x7f101c081060 osd=13 1 2026-02-17T11:10:35.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.170+0000 7f1052522640 20 client.4434.objecter shutdown clearing up homeless session... 2026-02-17T11:10:35.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.170+0000 7f1052522640 10 client.4434.objecter successfully canceled tick 2026-02-17T11:10:35.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.170+0000 7f1052522640 1 -- 10.20.193.49:0/3068591869 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f101c079190 msgr2=0x7f101c07b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.170+0000 7f1052522640 1 --2- 10.20.193.49:0/3068591869 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f101c079190 0x7f101c07b650 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1038002e40 tx=0x7f1038007ad0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.170+0000 7f1052522640 10 monclient: shutdown 2026-02-17T11:10:35.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.170+0000 7f1052522640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:35.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.170+0000 7f1052522640 1 -- 10.20.193.49:0/3068591869 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f104c0d1f40 msgr2=0x7f104c1514d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.170+0000 7f1052522640 1 --2- 10.20.193.49:0/3068591869 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f104c0d1f40 0x7f104c1514d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f103c00c760 tx=0x7f103c00cc30 comp rx=0 tx=0).stop 2026-02-17T11:10:35.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.170+0000 7f1050a98640 1 -- 10.20.193.49:0/3068591869 reap_dead start 2026-02-17T11:10:35.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.170+0000 7f1052522640 1 -- 10.20.193.49:0/3068591869 shutdown_connections 2026-02-17T11:10:35.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.170+0000 7f1052522640 1 -- 10.20.193.49:0/3068591869 >> 10.20.193.49:0/3068591869 conn(0x7f104c06d9b0 msgr2=0x7f104c0c8730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:35.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.170+0000 7f1052522640 1 -- 10.20.193.49:0/3068591869 shutdown_connections 2026-02-17T11:10:35.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.170+0000 7f1052522640 1 -- 10.20.193.49:0/3068591869 wait complete. 2026-02-17T11:10:35.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.170+0000 7f1052522640 1 librados: shutdown 2026-02-17T11:10:35.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f991bfff640 1 -- 10.20.193.49:0/3435546534 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9930048070 con 0x7f994014a4a0 2026-02-17T11:10:35.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f991bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f991bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:10:35.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f991bfff640 10 monclient: dump: 2026-02-17T11:10:35.232 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.232 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.232 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.232 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.232 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.232 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.232 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.232 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.232 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.232 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f991bfff640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f991bfff640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f991bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f991bfff640 1 -- 10.20.193.49:0/3435546534 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9930007070 con 0x7f994014a4a0 2026-02-17T11:10:35.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f991bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f991bfff640 1 -- 10.20.193.49:0/3435546534 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9930007440 con 0x7f994014a4a0 2026-02-17T11:10:35.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f991bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f991bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:35.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f991bfff640 10 monclient: dump: 2026-02-17T11:10:35.232 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.232 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.232 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.232 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.232 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.232 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.232 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.232 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.232 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.232 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f9945a8f640 5 monclient: authenticate success, global_id 4453 2026-02-17T11:10:35.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f993dffb640 4 set_mon_vals no callback set 2026-02-17T11:10:35.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f9945a8f640 10 monclient: _renew_subs 2026-02-17T11:10:35.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f9945a8f640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f9945a8f640 1 -- 10.20.193.49:0/3435546534 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99401f3af0 con 0x7f994014a4a0 2026-02-17T11:10:35.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f9945a8f640 10 client.4453.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:35.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f9945a8f640 10 monclient: _renew_subs 2026-02-17T11:10:35.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f9945a8f640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f9945a8f640 1 -- 10.20.193.49:0/3435546534 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99401f40b0 con 0x7f994014a4a0 2026-02-17T11:10:35.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f9945a8f640 1 librados: init done 2026-02-17T11:10:35.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f6daf7fe640 1 -- 10.20.193.49:0/2195715102 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f6dc401a460 con 0x7f6dd0152700 2026-02-17T11:10:35.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f4327fff640 1 -- 10.20.193.49:0/1356756625 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4338004480 con 0x7f434c0d1b60 2026-02-17T11:10:35.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f4327fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f4327fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:10:35.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f4327fff640 10 monclient: dump: 2026-02-17T11:10:35.233 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.233 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.233 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.233 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.233 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.233 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.233 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.233 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.233 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.233 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f4327fff640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f4327fff640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f4327fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f4327fff640 1 -- 10.20.193.49:0/1356756625 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4338014070 con 0x7f434c0d1b60 2026-02-17T11:10:35.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f435212c640 5 monclient: authenticate success, global_id 4462 2026-02-17T11:10:35.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f435212c640 10 monclient: _renew_subs 2026-02-17T11:10:35.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f435212c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f435212c640 1 -- 10.20.193.49:0/1356756625 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f434c14af00 con 0x7f434c0d1b60 2026-02-17T11:10:35.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f4327fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f4327fff640 1 -- 10.20.193.49:0/1356756625 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4338002920 con 0x7f434c0d1b60 2026-02-17T11:10:35.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f4327fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f4349ffb640 4 set_mon_vals no callback set 2026-02-17T11:10:35.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f4327fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:35.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f4327fff640 10 monclient: dump: 2026-02-17T11:10:35.234 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.234 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.234 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.234 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.234 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.234 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.234 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.234 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.234 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.234 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f435212c640 10 client.4462.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:35.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f435212c640 10 monclient: _renew_subs 2026-02-17T11:10:35.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f435212c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f435212c640 1 -- 10.20.193.49:0/1356756625 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f434c1f4dc0 con 0x7f434c0d1b60 2026-02-17T11:10:35.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f435212c640 1 librados: init done 2026-02-17T11:10:35.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f9945a8f640 10 client.4453.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:35.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f9945a8f640 15 client.4453.objecter _session_command_op_assign -1 1 2026-02-17T11:10:35.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f9945a8f640 20 client.4453.objecter _get_session osd=-1 returning homeless 2026-02-17T11:10:35.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f9945a8f640 10 client.4453.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:35.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f9945a8f640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f9945a8f640 1 -- 10.20.193.49:0/3435546534 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f99400d18c0 con 0x7f994014a4a0 2026-02-17T11:10:35.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f6daf7fe640 1 --2- 10.20.193.49:0/2195715102 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f6d9c0791c0 0x7f6d9c07b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f84bb7fe640 1 -- 10.20.193.49:0/4105535500 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c4004480 con 0x7f84dc153fc0 2026-02-17T11:10:35.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f84bb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f84bb7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:10:35.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f84bb7fe640 10 monclient: dump: 2026-02-17T11:10:35.235 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.235 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.235 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.235 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.235 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.235 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.235 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.235 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.235 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.235 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f84bb7fe640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f84bb7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f84bb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f84bb7fe640 1 -- 10.20.193.49:0/4105535500 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84c4015070 con 0x7f84dc153fc0 2026-02-17T11:10:35.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.171+0000 7f84bb7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7f84bb7fe640 1 -- 10.20.193.49:0/4105535500 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c4002920 con 0x7f84dc153fc0 2026-02-17T11:10:35.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7f84e1553640 5 monclient: authenticate success, global_id 4447 2026-02-17T11:10:35.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7f84e1553640 10 monclient: _renew_subs 2026-02-17T11:10:35.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7f84d97fa640 4 set_mon_vals no callback set 2026-02-17T11:10:35.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7f84e1553640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7f84e1553640 1 -- 10.20.193.49:0/4105535500 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84dc06dc20 con 0x7f84dc153fc0 2026-02-17T11:10:35.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7f84bb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7f84bb7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:35.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7f84bb7fe640 10 monclient: dump: 2026-02-17T11:10:35.235 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.236 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.236 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.236 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.236 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.236 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.236 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.236 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.236 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.236 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.236 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7f6dce7fc640 1 --2- 10.20.193.49:0/2195715102 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f6d9c0791c0 0x7f6d9c07b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.236 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7f84e1553640 10 client.4447.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:35.236 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7f84e1553640 10 monclient: _renew_subs 2026-02-17T11:10:35.236 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7f84e1553640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.236 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7f84e1553640 1 -- 10.20.193.49:0/4105535500 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84dc06e1e0 con 0x7f84dc153fc0 2026-02-17T11:10:35.236 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7f6dce7fc640 10 monclient: get_auth_request con 0x7f6d9c0791c0 auth_method 0 2026-02-17T11:10:35.236 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7f84e1553640 1 librados: init done 2026-02-17T11:10:35.236 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7f435212c640 10 client.4462.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:35.236 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7f435212c640 15 client.4462.objecter _session_command_op_assign -1 1 2026-02-17T11:10:35.236 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7f435212c640 20 client.4462.objecter _get_session osd=-1 returning homeless 2026-02-17T11:10:35.237 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7f435212c640 10 client.4462.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:35.237 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7f435212c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.237 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7f435212c640 1 -- 10.20.193.49:0/1356756625 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f434c06e7b0 con 0x7f434c0d1b60 2026-02-17T11:10:35.237 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7f6daf7fe640 10 client.4437.objecter ms_handle_connect 0x7f6d9c0791c0 2026-02-17T11:10:35.237 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7f6dce7fc640 1 --2- 10.20.193.49:0/2195715102 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f6d9c0791c0 0x7f6d9c07b680 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6dd014e430 tx=0x7f6db8006d10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.237 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7fa5611e6640 10 client.4445.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T11:10:35.237 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7fa5611e6640 15 client.4445.objecter _session_command_op_assign -1 2 2026-02-17T11:10:35.237 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7fa5611e6640 20 client.4445.objecter _get_session s=0x7fa528081000 osd=6 3 2026-02-17T11:10:35.237 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7fa5611e6640 20 client.4445.objecter put_session s=0x7fa528081000 osd=6 3 2026-02-17T11:10:35.237 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7fa5611e6640 20 client.4445.objecter _get_session s=0x7fa528081000 osd=6 3 2026-02-17T11:10:35.237 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7fa5611e6640 15 client.4445.objecter _session_command_op_remove -1 2 2026-02-17T11:10:35.237 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7fa5611e6640 20 client.4445.objecter get_session s=0x7fa528081000 osd=6 3 2026-02-17T11:10:35.237 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7fa5611e6640 15 client.4445.objecter _session_command_op_assign 6 2 2026-02-17T11:10:35.237 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7fa5611e6640 20 client.4445.objecter put_session s=0x7fa528081000 osd=6 4 2026-02-17T11:10:35.237 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7fa5611e6640 10 client.4445.objecter _send_command 2 2026-02-17T11:10:35.237 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7fa5611e6640 1 -- 10.20.193.49:0/353134677 --> [v2:10.20.193.157:6800/815989681,v1:10.20.193.157:6801/815989681] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa55c1f7ae0 con 0x7fa5280816d0 2026-02-17T11:10:35.237 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7ff77f7fe640 1 -- 10.20.193.49:0/586960880 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff788044070 con 0x7ff7a0152ae0 2026-02-17T11:10:35.237 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7ff77f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.237 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7ff77f7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:10:35.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7ff77f7fe640 10 monclient: dump: 2026-02-17T11:10:35.238 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.238 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.238 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.238 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.238 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.238 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.238 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.238 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.238 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.238 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7ff77f7fe640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7ff77f7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7ff77f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7ff77f7fe640 1 -- 10.20.193.49:0/586960880 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff788040610 con 0x7ff7a0152ae0 2026-02-17T11:10:35.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7ff77f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7ff77f7fe640 1 -- 10.20.193.49:0/586960880 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff78803c040 con 0x7ff7a0152ae0 2026-02-17T11:10:35.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7ff7a5322640 5 monclient: authenticate success, global_id 4459 2026-02-17T11:10:35.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7ff7a5322640 10 monclient: _renew_subs 2026-02-17T11:10:35.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7ff7a5322640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7ff7a5322640 1 -- 10.20.193.49:0/586960880 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7a014abe0 con 0x7ff7a0152ae0 2026-02-17T11:10:35.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7ff79d7fa640 4 set_mon_vals no callback set 2026-02-17T11:10:35.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7ff77f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7ff77f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:35.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7ff77f7fe640 10 monclient: dump: 2026-02-17T11:10:35.238 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.238 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.238 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.238 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.238 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.238 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.238 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.238 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.238 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.238 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7f84e1553640 10 client.4447.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:35.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7f84e1553640 15 client.4447.objecter _session_command_op_assign -1 1 2026-02-17T11:10:35.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7f84e1553640 20 client.4447.objecter _get_session osd=-1 returning homeless 2026-02-17T11:10:35.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7ff7a5322640 10 client.4459.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:35.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7ff7a5322640 10 monclient: _renew_subs 2026-02-17T11:10:35.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7ff7a5322640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7ff7a5322640 1 -- 10.20.193.49:0/586960880 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7a00ce080 con 0x7ff7a0152ae0 2026-02-17T11:10:35.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7ff7a5322640 1 librados: init done 2026-02-17T11:10:35.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7f84e1553640 10 client.4447.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:35.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7f84e1553640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.172+0000 7f84e1553640 1 -- 10.20.193.49:0/4105535500 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f84dc0c9ff0 con 0x7f84dc153fc0 2026-02-17T11:10:35.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.173+0000 7ff7a5322640 10 client.4459.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:35.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.173+0000 7ff7a5322640 15 client.4459.objecter _session_command_op_assign -1 1 2026-02-17T11:10:35.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.173+0000 7ff7a5322640 20 client.4459.objecter _get_session osd=-1 returning homeless 2026-02-17T11:10:35.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.173+0000 7ff7a5322640 10 client.4459.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:35.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.173+0000 7ff7a5322640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.173+0000 7ff7a5322640 1 -- 10.20.193.49:0/586960880 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff7a015e870 con 0x7ff7a0152ae0 2026-02-17T11:10:35.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.178+0000 7fa53b7fe640 1 -- 10.20.193.49:0/353134677 <== osd.6 v2:10.20.193.157:6800/815989681 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa55c1f7ae0 con 0x7fa5280816d0 2026-02-17T11:10:35.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.178+0000 7fa53b7fe640 10 client.4445.objecter ms_dispatch2 0x7fa55c000b90 command_reply(tid 2: 0 ) 2026-02-17T11:10:35.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.178+0000 7fa53b7fe640 10 client.4445.objecter _finish_command 2 = system:0 2026-02-17T11:10:35.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.178+0000 7fa53b7fe640 20 client.4445.objecter put_session s=0x7fa528081000 osd=6 4 2026-02-17T11:10:35.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.178+0000 7fa53b7fe640 15 client.4445.objecter _session_command_op_remove 6 2 2026-02-17T11:10:35.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.178+0000 7fa5611e6640 10 librados: watch_flush enter 2026-02-17T11:10:35.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.178+0000 7fa5611e6640 10 librados: watch_flush exit 2026-02-17T11:10:35.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.178+0000 7fa5611e6640 10 client.4445.objecter close_session for osd.6 2026-02-17T11:10:35.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.178+0000 7fa5611e6640 1 -- 10.20.193.49:0/353134677 >> [v2:10.20.193.157:6800/815989681,v1:10.20.193.157:6801/815989681] conn(0x7fa5280816d0 msgr2=0x7fa528083b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.178+0000 7fa5611e6640 1 --2- 10.20.193.49:0/353134677 >> [v2:10.20.193.157:6800/815989681,v1:10.20.193.157:6801/815989681] conn(0x7fa5280816d0 0x7fa528083b10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.178+0000 7fa5611e6640 20 client.4445.objecter put_session s=0x7fa528081000 osd=6 1 2026-02-17T11:10:35.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.178+0000 7fa5611e6640 20 client.4445.objecter shutdown clearing up homeless session... 2026-02-17T11:10:35.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.178+0000 7fa5611e6640 10 client.4445.objecter successfully canceled tick 2026-02-17T11:10:35.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.178+0000 7fa5611e6640 1 -- 10.20.193.49:0/353134677 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fa528079190 msgr2=0x7fa52807b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.178+0000 7fa5611e6640 1 --2- 10.20.193.49:0/353134677 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fa528079190 0x7fa52807b650 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa550002770 tx=0x7fa550007ab0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.178+0000 7fa5611e6640 10 monclient: shutdown 2026-02-17T11:10:35.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.178+0000 7fa5611e6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:35.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.178+0000 7fa5611e6640 1 -- 10.20.193.49:0/353134677 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fa55c15b290 msgr2=0x7fa55c142760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.178+0000 7fa5611e6640 1 --2- 10.20.193.49:0/353134677 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fa55c15b290 0x7fa55c142760 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa54c03a040 tx=0x7fa54c004b40 comp rx=0 tx=0).stop 2026-02-17T11:10:35.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.178+0000 7fa55b577640 1 -- 10.20.193.49:0/353134677 reap_dead start 2026-02-17T11:10:35.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.178+0000 7fa5611e6640 1 -- 10.20.193.49:0/353134677 shutdown_connections 2026-02-17T11:10:35.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.178+0000 7fa5611e6640 1 -- 10.20.193.49:0/353134677 >> 10.20.193.49:0/353134677 conn(0x7fa55c0c9f40 msgr2=0x7fa55c0c7af0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:35.240 INFO:teuthology.orchestra.run.trial049.stdout:94489280517 2026-02-17T11:10:35.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.178+0000 7fa5611e6640 1 -- 10.20.193.49:0/353134677 shutdown_connections 2026-02-17T11:10:35.241 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.13 2026-02-17T11:10:35.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.178+0000 7fa5611e6640 1 -- 10.20.193.49:0/353134677 wait complete. 2026-02-17T11:10:35.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.178+0000 7fa5611e6640 1 librados: shutdown 2026-02-17T11:10:35.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.180+0000 7faeba7fc640 1 -- 10.20.193.49:0/896420849 <== osd.5 v2:10.20.193.97:6800/3226749558 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7faec0039e50 con 0x7fae9c081730 2026-02-17T11:10:35.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.180+0000 7faeba7fc640 10 client.4444.objecter ms_dispatch2 0x7faecc000b90 command_reply(tid 1: 0 ) 2026-02-17T11:10:35.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.180+0000 7faeba7fc640 10 client.4444.objecter _finish_command 1 = system:0 2026-02-17T11:10:35.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.180+0000 7faeba7fc640 20 client.4444.objecter put_session s=0x7fae9c081060 osd=5 4 2026-02-17T11:10:35.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.180+0000 7faeba7fc640 15 client.4444.objecter _session_command_op_remove 5 1 2026-02-17T11:10:35.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.181+0000 7f6daf7fe640 1 -- 10.20.193.49:0/2195715102 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7f6dc405dfe0 con 0x7f6dd0152700 2026-02-17T11:10:35.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.181+0000 7f6daf7fe640 10 client.4437.objecter ms_dispatch2 0x7f6dd0000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:35.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.181+0000 7f6daf7fe640 3 client.4437.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:35.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.181+0000 7f6daf7fe640 3 client.4437.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:35.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.181+0000 7f6daf7fe640 10 client.4437.objecter checking command 1 2026-02-17T11:10:35.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.181+0000 7f6daf7fe640 1 --2- 10.20.193.49:0/2195715102 >> [v2:10.20.193.157:6816/1377516118,v1:10.20.193.157:6817/1377516118] conn(0x7f6d9c081760 0x7f6d9c083ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.181+0000 7f6daf7fe640 20 client.4437.objecter _get_session s=0x7f6d9c081090 osd=2 3 2026-02-17T11:10:35.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.181+0000 7f6daf7fe640 20 client.4437.objecter put_session s=0x7f6d9c081090 osd=2 3 2026-02-17T11:10:35.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.181+0000 7f6daf7fe640 15 client.4437.objecter _session_command_op_remove -1 1 2026-02-17T11:10:35.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.181+0000 7f6daf7fe640 20 client.4437.objecter _get_session s=0x7f6d9c081090 osd=2 3 2026-02-17T11:10:35.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.181+0000 7f6daf7fe640 20 client.4437.objecter get_session s=0x7f6d9c081090 osd=2 3 2026-02-17T11:10:35.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.181+0000 7f6daf7fe640 15 client.4437.objecter _session_command_op_assign 2 1 2026-02-17T11:10:35.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.181+0000 7f6daf7fe640 20 client.4437.objecter put_session s=0x7f6d9c081090 osd=2 4 2026-02-17T11:10:35.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.181+0000 7f6daf7fe640 10 client.4437.objecter _send_command 1 2026-02-17T11:10:35.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.181+0000 7f6daf7fe640 1 -- 10.20.193.49:0/2195715102 --> [v2:10.20.193.157:6816/1377516118,v1:10.20.193.157:6817/1377516118] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6dc4013e50 con 0x7f6d9c081760 2026-02-17T11:10:35.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.181+0000 7f6daf7fe640 20 client.4437.objecter dump_active .. 0 homeless 2026-02-17T11:10:35.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.181+0000 7f6daf7fe640 1 -- 10.20.193.49:0/2195715102 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f6dc405e3a0 con 0x7f6dd0152700 2026-02-17T11:10:35.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.181+0000 7f6daf7fe640 10 monclient: handle_get_version_reply finishing 1 version 33 2026-02-17T11:10:35.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.182+0000 7f6dcf7fe640 1 --2- 10.20.193.49:0/2195715102 >> [v2:10.20.193.157:6816/1377516118,v1:10.20.193.157:6817/1377516118] conn(0x7f6d9c081760 0x7f6d9c083ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.182+0000 7f6dcf7fe640 10 monclient: get_auth_request con 0x7f6d9c081760 auth_method 0 2026-02-17T11:10:35.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.184+0000 7f6daf7fe640 10 client.4437.objecter ms_handle_connect 0x7f6d9c081760 2026-02-17T11:10:35.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.184+0000 7f6dcf7fe640 1 --2- 10.20.193.49:0/2195715102 >> [v2:10.20.193.157:6816/1377516118,v1:10.20.193.157:6817/1377516118] conn(0x7f6d9c081760 0x7f6d9c083ba0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.242 INFO:teuthology.orchestra.run.trial049.stdout:115964116998 2026-02-17T11:10:35.242 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2026-02-17T11:10:35.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.187+0000 7f73faffd640 1 -- 10.20.193.49:0/2659158390 <== osd.3 v2:10.20.193.162:6818/1543573918 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f7408017e50 con 0x7f73e4081680 2026-02-17T11:10:35.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.187+0000 7f73faffd640 10 client.4448.objecter ms_dispatch2 0x7f7414000b90 command_reply(tid 1: 0 ) 2026-02-17T11:10:35.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.187+0000 7f73faffd640 10 client.4448.objecter _finish_command 1 = system:0 2026-02-17T11:10:35.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.187+0000 7f73faffd640 20 client.4448.objecter put_session s=0x7f73e4080fb0 osd=3 4 2026-02-17T11:10:35.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.187+0000 7f73faffd640 15 client.4448.objecter _session_command_op_remove 3 1 2026-02-17T11:10:35.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.187+0000 7faed3e91640 10 client.4444.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T11:10:35.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.188+0000 7faed3e91640 15 client.4444.objecter _session_command_op_assign -1 2 2026-02-17T11:10:35.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.188+0000 7faed3e91640 20 client.4444.objecter _get_session s=0x7fae9c081060 osd=5 3 2026-02-17T11:10:35.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.188+0000 7faed3e91640 20 client.4444.objecter put_session s=0x7fae9c081060 osd=5 3 2026-02-17T11:10:35.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.188+0000 7faed3e91640 20 client.4444.objecter _get_session s=0x7fae9c081060 osd=5 3 2026-02-17T11:10:35.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.188+0000 7faed3e91640 15 client.4444.objecter _session_command_op_remove -1 2 2026-02-17T11:10:35.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.188+0000 7faed3e91640 20 client.4444.objecter get_session s=0x7fae9c081060 osd=5 3 2026-02-17T11:10:35.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.188+0000 7faed3e91640 15 client.4444.objecter _session_command_op_assign 5 2 2026-02-17T11:10:35.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.188+0000 7faed3e91640 20 client.4444.objecter put_session s=0x7fae9c081060 osd=5 4 2026-02-17T11:10:35.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.188+0000 7faed3e91640 10 client.4444.objecter _send_command 2 2026-02-17T11:10:35.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.188+0000 7faed3e91640 1 -- 10.20.193.49:0/896420849 --> [v2:10.20.193.97:6800/3226749558,v1:10.20.193.97:6801/3226749558] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7faecc155f00 con 0x7fae9c081730 2026-02-17T11:10:35.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.191+0000 7f5e78ff9640 1 -- 10.20.193.49:0/3776431914 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f5e6c002b60 con 0x7f5e7c15c840 2026-02-17T11:10:35.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.191+0000 7faeba7fc640 1 -- 10.20.193.49:0/896420849 <== osd.5 v2:10.20.193.97:6800/3226749558 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7faecc155f00 con 0x7fae9c081730 2026-02-17T11:10:35.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.191+0000 7faeba7fc640 10 client.4444.objecter ms_dispatch2 0x7faecc000b90 command_reply(tid 2: 0 ) 2026-02-17T11:10:35.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.191+0000 7faeba7fc640 10 client.4444.objecter _finish_command 2 = system:0 2026-02-17T11:10:35.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.191+0000 7faeba7fc640 20 client.4444.objecter put_session s=0x7fae9c081060 osd=5 4 2026-02-17T11:10:35.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.191+0000 7faeba7fc640 15 client.4444.objecter _session_command_op_remove 5 2 2026-02-17T11:10:35.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.191+0000 7faed3e91640 10 librados: watch_flush enter 2026-02-17T11:10:35.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.191+0000 7faed3e91640 10 librados: watch_flush exit 2026-02-17T11:10:35.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.191+0000 7faed3e91640 10 client.4444.objecter close_session for osd.5 2026-02-17T11:10:35.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.191+0000 7faed3e91640 1 -- 10.20.193.49:0/896420849 >> [v2:10.20.193.97:6800/3226749558,v1:10.20.193.97:6801/3226749558] conn(0x7fae9c081730 msgr2=0x7fae9c083b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.191+0000 7faed3e91640 1 --2- 10.20.193.49:0/896420849 >> [v2:10.20.193.97:6800/3226749558,v1:10.20.193.97:6801/3226749558] conn(0x7fae9c081730 0x7fae9c083b70 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.191+0000 7faed3e91640 20 client.4444.objecter put_session s=0x7fae9c081060 osd=5 1 2026-02-17T11:10:35.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.191+0000 7faed3e91640 20 client.4444.objecter shutdown clearing up homeless session... 2026-02-17T11:10:35.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.191+0000 7faed3e91640 10 client.4444.objecter successfully canceled tick 2026-02-17T11:10:35.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.191+0000 7faed3e91640 1 -- 10.20.193.49:0/896420849 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fae9c079190 msgr2=0x7fae9c07b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.191+0000 7faed3e91640 1 --2- 10.20.193.49:0/896420849 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fae9c079190 0x7fae9c07b650 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7faecc0664a0 tx=0x7faebc009040 comp rx=0 tx=0).stop 2026-02-17T11:10:35.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.191+0000 7faed3e91640 10 monclient: shutdown 2026-02-17T11:10:35.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.191+0000 7faed3e91640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:35.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.191+0000 7faed3e91640 1 -- 10.20.193.49:0/896420849 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7faecc15f6f0 msgr2=0x7faecc202c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.191+0000 7faed3e91640 1 --2- 10.20.193.49:0/896420849 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7faecc15f6f0 0x7faecc202c70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7faec002fb40 tx=0x7faec00027f0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.191+0000 7faed2407640 1 -- 10.20.193.49:0/896420849 reap_dead start 2026-02-17T11:10:35.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.191+0000 7faed3e91640 1 -- 10.20.193.49:0/896420849 shutdown_connections 2026-02-17T11:10:35.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.191+0000 7faed3e91640 1 -- 10.20.193.49:0/896420849 >> 10.20.193.49:0/896420849 conn(0x7faecc06d9b0 msgr2=0x7faecc154bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:35.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.191+0000 7faed3e91640 1 -- 10.20.193.49:0/896420849 shutdown_connections 2026-02-17T11:10:35.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.191+0000 7faed3e91640 1 -- 10.20.193.49:0/896420849 wait complete. 2026-02-17T11:10:35.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.191+0000 7f5e78ff9640 1 --2- 10.20.193.49:0/3776431914 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5e4c079140 0x7f5e4c07b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.191+0000 7faed3e91640 1 librados: shutdown 2026-02-17T11:10:35.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.192+0000 7f5e7bfff640 1 --2- 10.20.193.49:0/3776431914 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5e4c079140 0x7f5e4c07b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.192+0000 7f5e7bfff640 10 monclient: get_auth_request con 0x7f5e4c079140 auth_method 0 2026-02-17T11:10:35.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.192+0000 7f3fa4ff9640 1 -- 10.20.193.49:0/715203919 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f3f9c004000 con 0x7f3fa815ef80 2026-02-17T11:10:35.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.192+0000 7f5e7bfff640 1 --2- 10.20.193.49:0/3776431914 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5e4c079140 0x7f5e4c07b600 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c08fc80 tx=0x7f5e68031000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.192+0000 7f5e78ff9640 10 client.4452.objecter ms_handle_connect 0x7f5e4c079140 2026-02-17T11:10:35.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.192+0000 7f3fa4ff9640 1 --2- 10.20.193.49:0/715203919 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3f78079360 0x7f3f7807b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.193+0000 7f3fa7fff640 1 --2- 10.20.193.49:0/715203919 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3f78079360 0x7f3f7807b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.193+0000 7f3fa7fff640 10 monclient: get_auth_request con 0x7f3f78079360 auth_method 0 2026-02-17T11:10:35.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.193+0000 7f3fa7fff640 1 --2- 10.20.193.49:0/715203919 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3f78079360 0x7f3f7807b820 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3f94007fd0 tx=0x7f3f94007b40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.193+0000 7f3fa4ff9640 10 client.4441.objecter ms_handle_connect 0x7f3f78079360 2026-02-17T11:10:35.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.193+0000 7f3fa4ff9640 1 -- 10.20.193.49:0/715203919 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7f3f9c05e5e0 con 0x7f3fa815ef80 2026-02-17T11:10:35.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.193+0000 7f3fa4ff9640 10 client.4441.objecter ms_dispatch2 0x7f3fa8000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:35.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.193+0000 7f3fa4ff9640 3 client.4441.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:35.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.193+0000 7f3fa4ff9640 3 client.4441.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:35.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.193+0000 7f3fa4ff9640 10 client.4441.objecter checking command 1 2026-02-17T11:10:35.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.194+0000 7f3fa4ff9640 1 --2- 10.20.193.49:0/715203919 >> [v2:10.20.193.49:6800/1386770137,v1:10.20.193.49:6801/1386770137] conn(0x7f3f78081900 0x7f3f78083d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.194+0000 7f3fa4ff9640 20 client.4441.objecter _get_session s=0x7f3f78081230 osd=8 3 2026-02-17T11:10:35.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.194+0000 7f3fa4ff9640 20 client.4441.objecter put_session s=0x7f3f78081230 osd=8 3 2026-02-17T11:10:35.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.194+0000 7f3fa4ff9640 15 client.4441.objecter _session_command_op_remove -1 1 2026-02-17T11:10:35.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.194+0000 7f3fa4ff9640 20 client.4441.objecter _get_session s=0x7f3f78081230 osd=8 3 2026-02-17T11:10:35.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.194+0000 7f3fa4ff9640 20 client.4441.objecter get_session s=0x7f3f78081230 osd=8 3 2026-02-17T11:10:35.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.194+0000 7f3fa4ff9640 15 client.4441.objecter _session_command_op_assign 8 1 2026-02-17T11:10:35.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.194+0000 7f3fa4ff9640 20 client.4441.objecter put_session s=0x7f3f78081230 osd=8 4 2026-02-17T11:10:35.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.194+0000 7f3fa4ff9640 10 client.4441.objecter _send_command 1 2026-02-17T11:10:35.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.194+0000 7f3fa4ff9640 1 -- 10.20.193.49:0/715203919 --> [v2:10.20.193.49:6800/1386770137,v1:10.20.193.49:6801/1386770137] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3f9c00ce50 con 0x7f3f78081900 2026-02-17T11:10:35.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.194+0000 7f3fa4ff9640 20 client.4441.objecter dump_active .. 0 homeless 2026-02-17T11:10:35.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.194+0000 7f3fa77fe640 1 --2- 10.20.193.49:0/715203919 >> [v2:10.20.193.49:6800/1386770137,v1:10.20.193.49:6801/1386770137] conn(0x7f3f78081900 0x7f3f78083d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.194+0000 7f5e78ff9640 1 -- 10.20.193.49:0/3776431914 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7f5e6c097ee0 con 0x7f5e7c15c840 2026-02-17T11:10:35.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.194+0000 7f5e78ff9640 10 client.4452.objecter ms_dispatch2 0x7f5e7c000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:35.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.194+0000 7f5e78ff9640 3 client.4452.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:35.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.194+0000 7f5e78ff9640 3 client.4452.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:35.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.194+0000 7f741c66c640 10 client.4448.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T11:10:35.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.194+0000 7f741c66c640 15 client.4448.objecter _session_command_op_assign -1 2 2026-02-17T11:10:35.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.194+0000 7f741c66c640 20 client.4448.objecter _get_session s=0x7f73e4080fb0 osd=3 3 2026-02-17T11:10:35.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.194+0000 7f741c66c640 20 client.4448.objecter put_session s=0x7f73e4080fb0 osd=3 3 2026-02-17T11:10:35.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.194+0000 7f741c66c640 20 client.4448.objecter _get_session s=0x7f73e4080fb0 osd=3 3 2026-02-17T11:10:35.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.194+0000 7f741c66c640 15 client.4448.objecter _session_command_op_remove -1 2 2026-02-17T11:10:35.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.194+0000 7f741c66c640 20 client.4448.objecter get_session s=0x7f73e4080fb0 osd=3 3 2026-02-17T11:10:35.247 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.194+0000 7f741c66c640 15 client.4448.objecter _session_command_op_assign 3 2 2026-02-17T11:10:35.247 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.194+0000 7f741c66c640 20 client.4448.objecter put_session s=0x7f73e4080fb0 osd=3 4 2026-02-17T11:10:35.247 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.194+0000 7f741c66c640 10 client.4448.objecter _send_command 2 2026-02-17T11:10:35.247 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.194+0000 7f741c66c640 1 -- 10.20.193.49:0/2659158390 --> [v2:10.20.193.162:6818/1543573918,v1:10.20.193.162:6820/1543573918] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f74140c9ba0 con 0x7f73e4081680 2026-02-17T11:10:35.247 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.194+0000 7f3fa77fe640 10 monclient: get_auth_request con 0x7f3f78081900 auth_method 0 2026-02-17T11:10:35.247 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.194+0000 7f5e78ff9640 10 client.4452.objecter checking command 1 2026-02-17T11:10:35.247 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.194+0000 7f5e78ff9640 1 --2- 10.20.193.49:0/3776431914 >> [v2:10.20.193.97:6808/676086260,v1:10.20.193.97:6809/676086260] conn(0x7f5e4c081680 0x7f5e4c083ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.247 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.194+0000 7f5e78ff9640 20 client.4452.objecter _get_session s=0x7f5e4c080fb0 osd=9 3 2026-02-17T11:10:35.247 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.194+0000 7f5e78ff9640 20 client.4452.objecter put_session s=0x7f5e4c080fb0 osd=9 3 2026-02-17T11:10:35.247 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.194+0000 7f5e78ff9640 15 client.4452.objecter _session_command_op_remove -1 1 2026-02-17T11:10:35.247 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.194+0000 7f5e78ff9640 20 client.4452.objecter _get_session s=0x7f5e4c080fb0 osd=9 3 2026-02-17T11:10:35.247 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.194+0000 7f5e78ff9640 20 client.4452.objecter get_session s=0x7f5e4c080fb0 osd=9 3 2026-02-17T11:10:35.247 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.194+0000 7f5e78ff9640 15 client.4452.objecter _session_command_op_assign 9 1 2026-02-17T11:10:35.247 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.194+0000 7f5e78ff9640 20 client.4452.objecter put_session s=0x7f5e4c080fb0 osd=9 4 2026-02-17T11:10:35.247 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.194+0000 7f5e78ff9640 10 client.4452.objecter _send_command 1 2026-02-17T11:10:35.247 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.194+0000 7f5e78ff9640 1 -- 10.20.193.49:0/3776431914 --> [v2:10.20.193.97:6808/676086260,v1:10.20.193.97:6809/676086260] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5e6c01ce70 con 0x7f5e4c081680 2026-02-17T11:10:35.247 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.194+0000 7f5e78ff9640 20 client.4452.objecter dump_active .. 0 homeless 2026-02-17T11:10:35.247 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.194+0000 7f5e78ff9640 1 -- 10.20.193.49:0/3776431914 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f5e6c05e6c0 con 0x7f5e7c15c840 2026-02-17T11:10:35.247 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.194+0000 7f5e78ff9640 10 monclient: handle_get_version_reply finishing 1 version 33 2026-02-17T11:10:35.247 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.195+0000 7fe9ccff9640 1 -- 10.20.193.49:0/4131833758 <== osd.11 v2:10.20.193.162:6802/3400543064 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fe9c001fe70 con 0x7fe9a00816d0 2026-02-17T11:10:35.247 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.195+0000 7fe9ccff9640 10 client.4422.objecter ms_dispatch2 0x7fe9d0000b90 command_reply(tid 1: 0 ) 2026-02-17T11:10:35.248 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.195+0000 7fe9ccff9640 10 client.4422.objecter _finish_command 1 = system:0 2026-02-17T11:10:35.248 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.195+0000 7fe9ccff9640 20 client.4422.objecter put_session s=0x7fe9a0081000 osd=11 4 2026-02-17T11:10:35.248 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.195+0000 7fe9ccff9640 15 client.4422.objecter _session_command_op_remove 11 1 2026-02-17T11:10:35.248 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.195+0000 7f5e808eb640 1 --2- 10.20.193.49:0/3776431914 >> [v2:10.20.193.97:6808/676086260,v1:10.20.193.97:6809/676086260] conn(0x7f5e4c081680 0x7f5e4c083ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.248 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.195+0000 7f5e808eb640 10 monclient: get_auth_request con 0x7f5e4c081680 auth_method 0 2026-02-17T11:10:35.248 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.197+0000 7f3fa4ff9640 10 client.4441.objecter ms_handle_connect 0x7f3f78081900 2026-02-17T11:10:35.248 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.197+0000 7f3fa77fe640 1 --2- 10.20.193.49:0/715203919 >> [v2:10.20.193.49:6800/1386770137,v1:10.20.193.49:6801/1386770137] conn(0x7f3f78081900 0x7f3f78083d40 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.248 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.197+0000 7f5e808eb640 1 --2- 10.20.193.49:0/3776431914 >> [v2:10.20.193.97:6808/676086260,v1:10.20.193.97:6809/676086260] conn(0x7f5e4c081680 0x7f5e4c083ac0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.248 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.197+0000 7f5e78ff9640 10 client.4452.objecter ms_handle_connect 0x7f5e4c081680 2026-02-17T11:10:35.248 INFO:teuthology.orchestra.run.trial049.stdout:94489280517 2026-02-17T11:10:35.248 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-17T11:10:35.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.199+0000 7fc831ffb640 1 -- 10.20.193.49:0/2395150845 <== osd.10 v2:10.20.193.157:6808/3711386099 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fc840014ec0 con 0x7fc8140816d0 2026-02-17T11:10:35.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.200+0000 7fc831ffb640 10 client.4450.objecter ms_dispatch2 0x7fc844000b90 command_reply(tid 1: 0 ) 2026-02-17T11:10:35.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.200+0000 7fc831ffb640 10 client.4450.objecter _finish_command 1 = system:0 2026-02-17T11:10:35.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.200+0000 7fc831ffb640 20 client.4450.objecter put_session s=0x7fc814081000 osd=10 4 2026-02-17T11:10:35.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.200+0000 7fc831ffb640 15 client.4450.objecter _session_command_op_remove 10 1 2026-02-17T11:10:35.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.202+0000 7fc4d1ffb640 1 -- 10.20.193.49:0/2523223392 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7fc4e0004070 con 0x7fc4e415d950 2026-02-17T11:10:35.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.203+0000 7fc4d1ffb640 1 --2- 10.20.193.49:0/2523223392 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fc4b4079190 0x7fc4b407b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.203+0000 7fc4e9039640 1 --2- 10.20.193.49:0/2523223392 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fc4b4079190 0x7fc4b407b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.203+0000 7fc4e9039640 10 monclient: get_auth_request con 0x7fc4b4079190 auth_method 0 2026-02-17T11:10:35.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.203+0000 7fc4d1ffb640 10 client.4443.objecter ms_handle_connect 0x7fc4b4079190 2026-02-17T11:10:35.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.203+0000 7fc4e9039640 1 --2- 10.20.193.49:0/2523223392 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fc4b4079190 0x7fc4b407b650 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc4d4009750 tx=0x7fc4d4006ca0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.204+0000 7fe9aa7fc640 10 client.4422.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T11:10:35.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.204+0000 7fe9aa7fc640 15 client.4422.objecter _session_command_op_assign -1 2 2026-02-17T11:10:35.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.204+0000 7fe9aa7fc640 20 client.4422.objecter _get_session s=0x7fe9a0081000 osd=11 3 2026-02-17T11:10:35.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.204+0000 7fe9aa7fc640 20 client.4422.objecter put_session s=0x7fe9a0081000 osd=11 3 2026-02-17T11:10:35.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.204+0000 7fe9aa7fc640 20 client.4422.objecter _get_session s=0x7fe9a0081000 osd=11 3 2026-02-17T11:10:35.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.204+0000 7fe9aa7fc640 15 client.4422.objecter _session_command_op_remove -1 2 2026-02-17T11:10:35.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.204+0000 7fe9aa7fc640 20 client.4422.objecter get_session s=0x7fe9a0081000 osd=11 3 2026-02-17T11:10:35.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.204+0000 7fe9aa7fc640 15 client.4422.objecter _session_command_op_assign 11 2 2026-02-17T11:10:35.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.204+0000 7fe9aa7fc640 20 client.4422.objecter put_session s=0x7fe9a0081000 osd=11 4 2026-02-17T11:10:35.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.204+0000 7fe9aa7fc640 10 client.4422.objecter _send_command 2 2026-02-17T11:10:35.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.204+0000 7fe9aa7fc640 1 -- 10.20.193.49:0/4131833758 --> [v2:10.20.193.162:6802/3400543064,v1:10.20.193.162:6803/3400543064] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe994003220 con 0x7fe9a00816d0 2026-02-17T11:10:35.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.205+0000 7fc4d1ffb640 1 -- 10.20.193.49:0/2523223392 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7fc4e005dfb0 con 0x7fc4e415d950 2026-02-17T11:10:35.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.205+0000 7fc4d1ffb640 10 client.4443.objecter ms_dispatch2 0x7fc4e4000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:35.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.205+0000 7fc4d1ffb640 3 client.4443.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:35.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.205+0000 7fc4d1ffb640 3 client.4443.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:35.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.205+0000 7fc4d1ffb640 10 client.4443.objecter checking command 1 2026-02-17T11:10:35.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.205+0000 7fc4d1ffb640 1 --2- 10.20.193.49:0/2523223392 >> [v2:10.20.193.49:6824/3898931472,v1:10.20.193.49:6825/3898931472] conn(0x7fc4b40816d0 0x7fc4b4083b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.205+0000 7fc4d1ffb640 20 client.4443.objecter _get_session s=0x7fc4b4081000 osd=0 3 2026-02-17T11:10:35.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.205+0000 7fc4d1ffb640 20 client.4443.objecter put_session s=0x7fc4b4081000 osd=0 3 2026-02-17T11:10:35.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.205+0000 7fc4d1ffb640 15 client.4443.objecter _session_command_op_remove -1 1 2026-02-17T11:10:35.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.205+0000 7fc4d1ffb640 20 client.4443.objecter _get_session s=0x7fc4b4081000 osd=0 3 2026-02-17T11:10:35.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.205+0000 7fc4d1ffb640 20 client.4443.objecter get_session s=0x7fc4b4081000 osd=0 3 2026-02-17T11:10:35.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.205+0000 7fc4d1ffb640 15 client.4443.objecter _session_command_op_assign 0 1 2026-02-17T11:10:35.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.205+0000 7fc4d1ffb640 20 client.4443.objecter put_session s=0x7fc4b4081000 osd=0 4 2026-02-17T11:10:35.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.205+0000 7fc4d1ffb640 10 client.4443.objecter _send_command 1 2026-02-17T11:10:35.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.205+0000 7fc4d1ffb640 1 -- 10.20.193.49:0/2523223392 --> [v2:10.20.193.49:6824/3898931472,v1:10.20.193.49:6825/3898931472] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc4b40841e0 con 0x7fc4b40816d0 2026-02-17T11:10:35.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.205+0000 7fc4d1ffb640 20 client.4443.objecter dump_active .. 0 homeless 2026-02-17T11:10:35.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.205+0000 7fc4d1ffb640 1 -- 10.20.193.49:0/2523223392 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fc4e005e370 con 0x7fc4e415d950 2026-02-17T11:10:35.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.205+0000 7fc4d1ffb640 10 monclient: handle_get_version_reply finishing 1 version 33 2026-02-17T11:10:35.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.205+0000 7f73faffd640 1 -- 10.20.193.49:0/2659158390 <== osd.3 v2:10.20.193.162:6818/1543573918 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f74140c9ba0 con 0x7f73e4081680 2026-02-17T11:10:35.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.205+0000 7f73faffd640 10 client.4448.objecter ms_dispatch2 0x7f7414000b90 command_reply(tid 2: 0 ) 2026-02-17T11:10:35.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.205+0000 7f73faffd640 10 client.4448.objecter _finish_command 2 = system:0 2026-02-17T11:10:35.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.205+0000 7f73faffd640 20 client.4448.objecter put_session s=0x7f73e4080fb0 osd=3 4 2026-02-17T11:10:35.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.205+0000 7f73faffd640 15 client.4448.objecter _session_command_op_remove 3 2 2026-02-17T11:10:35.251 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.206+0000 7fc4e8838640 1 --2- 10.20.193.49:0/2523223392 >> [v2:10.20.193.49:6824/3898931472,v1:10.20.193.49:6825/3898931472] conn(0x7fc4b40816d0 0x7fc4b4083b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.251 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.206+0000 7f741c66c640 10 librados: watch_flush enter 2026-02-17T11:10:35.251 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.206+0000 7f741c66c640 10 librados: watch_flush exit 2026-02-17T11:10:35.251 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.206+0000 7f741c66c640 10 client.4448.objecter close_session for osd.3 2026-02-17T11:10:35.251 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.206+0000 7f741c66c640 1 -- 10.20.193.49:0/2659158390 >> [v2:10.20.193.162:6818/1543573918,v1:10.20.193.162:6820/1543573918] conn(0x7f73e4081680 msgr2=0x7f73e4083ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.251 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.206+0000 7f741c66c640 1 --2- 10.20.193.49:0/2659158390 >> [v2:10.20.193.162:6818/1543573918,v1:10.20.193.162:6820/1543573918] conn(0x7f73e4081680 0x7f73e4083ac0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.251 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.206+0000 7f741c66c640 20 client.4448.objecter put_session s=0x7f73e4080fb0 osd=3 1 2026-02-17T11:10:35.251 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.206+0000 7f741c66c640 20 client.4448.objecter shutdown clearing up homeless session... 2026-02-17T11:10:35.251 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.206+0000 7f741c66c640 10 client.4448.objecter successfully canceled tick 2026-02-17T11:10:35.251 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.206+0000 7f741c66c640 1 -- 10.20.193.49:0/2659158390 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f73e4079140 msgr2=0x7f73e407b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.251 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.206+0000 7f741c66c640 1 --2- 10.20.193.49:0/2659158390 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f73e4079140 0x7f73e407b600 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7404009750 tx=0x7f7404006ca0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.251 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.206+0000 7f741c66c640 10 monclient: shutdown 2026-02-17T11:10:35.251 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.206+0000 7f741c66c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:35.251 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.206+0000 7f741c66c640 1 -- 10.20.193.49:0/2659158390 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f74140d1b60 msgr2=0x7f74140d0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.251 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.206+0000 7f741c66c640 1 --2- 10.20.193.49:0/2659158390 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f74140d1b60 0x7f74140d0b60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f740800b780 tx=0x7f740800bc50 comp rx=0 tx=0).stop 2026-02-17T11:10:35.251 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.206+0000 7f741abe2640 1 -- 10.20.193.49:0/2659158390 reap_dead start 2026-02-17T11:10:35.251 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.206+0000 7f741c66c640 1 -- 10.20.193.49:0/2659158390 shutdown_connections 2026-02-17T11:10:35.251 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.206+0000 7f741c66c640 1 -- 10.20.193.49:0/2659158390 >> 10.20.193.49:0/2659158390 conn(0x7f741406d9b0 msgr2=0x7f74141514f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:35.251 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.206+0000 7f741c66c640 1 -- 10.20.193.49:0/2659158390 shutdown_connections 2026-02-17T11:10:35.251 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.206+0000 7f741c66c640 1 -- 10.20.193.49:0/2659158390 wait complete. 2026-02-17T11:10:35.252 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.206+0000 7fc4e8838640 10 monclient: get_auth_request con 0x7fc4b40816d0 auth_method 0 2026-02-17T11:10:35.252 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.206+0000 7f741c66c640 1 librados: shutdown 2026-02-17T11:10:35.252 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.208+0000 7fc84b664640 10 client.4450.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T11:10:35.252 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.208+0000 7fc84b664640 15 client.4450.objecter _session_command_op_assign -1 2 2026-02-17T11:10:35.252 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.208+0000 7fc84b664640 20 client.4450.objecter _get_session s=0x7fc814081000 osd=10 3 2026-02-17T11:10:35.252 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.208+0000 7fc84b664640 20 client.4450.objecter put_session s=0x7fc814081000 osd=10 3 2026-02-17T11:10:35.252 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.208+0000 7fc84b664640 20 client.4450.objecter _get_session s=0x7fc814081000 osd=10 3 2026-02-17T11:10:35.252 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.208+0000 7fc84b664640 15 client.4450.objecter _session_command_op_remove -1 2 2026-02-17T11:10:35.252 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.208+0000 7fc84b664640 20 client.4450.objecter get_session s=0x7fc814081000 osd=10 3 2026-02-17T11:10:35.252 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.208+0000 7fc84b664640 15 client.4450.objecter _session_command_op_assign 10 2 2026-02-17T11:10:35.252 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.208+0000 7fc84b664640 20 client.4450.objecter put_session s=0x7fc814081000 osd=10 4 2026-02-17T11:10:35.252 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.208+0000 7fc84b664640 10 client.4450.objecter _send_command 2 2026-02-17T11:10:35.252 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.208+0000 7fc84b664640 1 -- 10.20.193.49:0/2395150845 --> [v2:10.20.193.157:6808/3711386099,v1:10.20.193.157:6809/3711386099] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc844151c60 con 0x7fc8140816d0 2026-02-17T11:10:35.252 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.209+0000 7f6daf7fe640 1 -- 10.20.193.49:0/2195715102 <== osd.2 v2:10.20.193.157:6816/1377516118 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f6dc4013e50 con 0x7f6d9c081760 2026-02-17T11:10:35.252 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.209+0000 7f6daf7fe640 10 client.4437.objecter ms_dispatch2 0x7f6dd0000b90 command_reply(tid 1: 0 ) 2026-02-17T11:10:35.252 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.209+0000 7f6daf7fe640 10 client.4437.objecter _finish_command 1 = system:0 2026-02-17T11:10:35.252 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.209+0000 7f6daf7fe640 20 client.4437.objecter put_session s=0x7f6d9c081090 osd=2 4 2026-02-17T11:10:35.252 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.209+0000 7f6daf7fe640 15 client.4437.objecter _session_command_op_remove 2 1 2026-02-17T11:10:35.252 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.209+0000 7fc4d1ffb640 10 client.4443.objecter ms_handle_connect 0x7fc4b40816d0 2026-02-17T11:10:35.252 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.209+0000 7fc4e8838640 1 --2- 10.20.193.49:0/2523223392 >> [v2:10.20.193.49:6824/3898931472,v1:10.20.193.49:6825/3898931472] conn(0x7fc4b40816d0 0x7fc4b4083b10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.209+0000 7fecaf7fe640 1 -- 10.20.193.49:0/1418801595 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7fecc403f030 con 0x7fecd0152700 2026-02-17T11:10:35.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.210+0000 7fecaf7fe640 1 --2- 10.20.193.49:0/1418801595 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fec9c079190 0x7fec9c07b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.210+0000 7fe9ccff9640 1 -- 10.20.193.49:0/4131833758 <== osd.11 v2:10.20.193.162:6802/3400543064 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fe994003220 con 0x7fe9a00816d0 2026-02-17T11:10:35.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.210+0000 7fe9ccff9640 10 client.4422.objecter ms_dispatch2 0x7fe9d0000b90 command_reply(tid 2: 0 ) 2026-02-17T11:10:35.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.210+0000 7fe9ccff9640 10 client.4422.objecter _finish_command 2 = system:0 2026-02-17T11:10:35.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.210+0000 7fe9ccff9640 20 client.4422.objecter put_session s=0x7fe9a0081000 osd=11 4 2026-02-17T11:10:35.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.210+0000 7fe9ccff9640 15 client.4422.objecter _session_command_op_remove 11 2 2026-02-17T11:10:35.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.210+0000 7fe9aa7fc640 10 librados: watch_flush enter 2026-02-17T11:10:35.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.210+0000 7fe9aa7fc640 10 librados: watch_flush exit 2026-02-17T11:10:35.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.210+0000 7fe9aa7fc640 10 client.4422.objecter close_session for osd.11 2026-02-17T11:10:35.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.210+0000 7fecce7fc640 1 --2- 10.20.193.49:0/1418801595 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fec9c079190 0x7fec9c07b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.210+0000 7fe9aa7fc640 1 -- 10.20.193.49:0/4131833758 >> [v2:10.20.193.162:6802/3400543064,v1:10.20.193.162:6803/3400543064] conn(0x7fe9a00816d0 msgr2=0x7fe9a0083b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.210+0000 7fe9aa7fc640 1 --2- 10.20.193.49:0/4131833758 >> [v2:10.20.193.162:6802/3400543064,v1:10.20.193.162:6803/3400543064] conn(0x7fe9a00816d0 0x7fe9a0083b10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.210+0000 7fe9aa7fc640 20 client.4422.objecter put_session s=0x7fe9a0081000 osd=11 1 2026-02-17T11:10:35.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.210+0000 7fe9aa7fc640 20 client.4422.objecter shutdown clearing up homeless session... 2026-02-17T11:10:35.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.210+0000 7fecce7fc640 10 monclient: get_auth_request con 0x7fec9c079190 auth_method 0 2026-02-17T11:10:35.254 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.210+0000 7fe9aa7fc640 10 client.4422.objecter successfully canceled tick 2026-02-17T11:10:35.254 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.210+0000 7fe9aa7fc640 1 -- 10.20.193.49:0/4131833758 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fe9a0079190 msgr2=0x7fe9a007b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.254 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.210+0000 7fe9aa7fc640 1 --2- 10.20.193.49:0/4131833758 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fe9a0079190 0x7fe9a007b650 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc00a8d0 tx=0x7fe9bc008040 comp rx=0 tx=0).stop 2026-02-17T11:10:35.254 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.210+0000 7fe9aa7fc640 10 monclient: shutdown 2026-02-17T11:10:35.254 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.210+0000 7fe9aa7fc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:35.254 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.210+0000 7fe9aa7fc640 1 -- 10.20.193.49:0/4131833758 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe9d00ceef0 msgr2=0x7fe9d01f60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.254 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.210+0000 7fe9aa7fc640 1 --2- 10.20.193.49:0/4131833758 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe9d00ceef0 0x7fe9d01f60c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe9c000e840 tx=0x7fe9c000ed10 comp rx=0 tx=0).stop 2026-02-17T11:10:35.254 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.210+0000 7fe9d4872640 1 -- 10.20.193.49:0/4131833758 reap_dead start 2026-02-17T11:10:35.254 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.210+0000 7fe9aa7fc640 1 -- 10.20.193.49:0/4131833758 shutdown_connections 2026-02-17T11:10:35.254 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.210+0000 7fe9aa7fc640 1 -- 10.20.193.49:0/4131833758 >> 10.20.193.49:0/4131833758 conn(0x7fe9d0073030 msgr2=0x7fe9d0153570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:35.254 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.210+0000 7fe9aa7fc640 1 -- 10.20.193.49:0/4131833758 shutdown_connections 2026-02-17T11:10:35.254 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.210+0000 7fe9aa7fc640 1 -- 10.20.193.49:0/4131833758 wait complete. 2026-02-17T11:10:35.254 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.210+0000 7fe9aa7fc640 1 librados: shutdown 2026-02-17T11:10:35.254 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.211+0000 7fecaf7fe640 10 client.4438.objecter ms_handle_connect 0x7fec9c079190 2026-02-17T11:10:35.254 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.211+0000 7fecce7fc640 1 --2- 10.20.193.49:0/1418801595 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fec9c079190 0x7fec9c07b650 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fecd01f6f40 tx=0x7fecb8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.254 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.213+0000 7fecaf7fe640 1 -- 10.20.193.49:0/1418801595 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7fecc4083720 con 0x7fecd0152700 2026-02-17T11:10:35.254 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.213+0000 7fecaf7fe640 10 client.4438.objecter ms_dispatch2 0x7fecd0000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:35.254 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.213+0000 7fecaf7fe640 3 client.4438.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:35.255 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.213+0000 7fecaf7fe640 3 client.4438.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:35.255 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.213+0000 7fecaf7fe640 10 client.4438.objecter checking command 1 2026-02-17T11:10:35.255 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.213+0000 7fecaf7fe640 1 --2- 10.20.193.49:0/1418801595 >> [v2:10.20.193.97:6816/4259563897,v1:10.20.193.97:6817/4259563897] conn(0x7fec9c0816d0 0x7fec9c083b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.255 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.213+0000 7fecaf7fe640 20 client.4438.objecter _get_session s=0x7fec9c081000 osd=1 3 2026-02-17T11:10:35.255 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.213+0000 7fecaf7fe640 20 client.4438.objecter put_session s=0x7fec9c081000 osd=1 3 2026-02-17T11:10:35.255 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.213+0000 7fecaf7fe640 15 client.4438.objecter _session_command_op_remove -1 1 2026-02-17T11:10:35.255 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.213+0000 7fecaf7fe640 20 client.4438.objecter _get_session s=0x7fec9c081000 osd=1 3 2026-02-17T11:10:35.255 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.213+0000 7fecaf7fe640 20 client.4438.objecter get_session s=0x7fec9c081000 osd=1 3 2026-02-17T11:10:35.255 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.213+0000 7fecaf7fe640 15 client.4438.objecter _session_command_op_assign 1 1 2026-02-17T11:10:35.255 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.213+0000 7fecaf7fe640 20 client.4438.objecter put_session s=0x7fec9c081000 osd=1 4 2026-02-17T11:10:35.255 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.213+0000 7fecaf7fe640 10 client.4438.objecter _send_command 1 2026-02-17T11:10:35.255 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.213+0000 7fecaf7fe640 1 -- 10.20.193.49:0/1418801595 --> [v2:10.20.193.97:6816/4259563897,v1:10.20.193.97:6817/4259563897] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fecc4043e80 con 0x7fec9c0816d0 2026-02-17T11:10:35.255 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.213+0000 7fecaf7fe640 20 client.4438.objecter dump_active .. 0 homeless 2026-02-17T11:10:35.255 INFO:teuthology.orchestra.run.trial049.stdout:111669149703 2026-02-17T11:10:35.255 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:10:35.255 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.213+0000 7fecaf7fe640 1 -- 10.20.193.49:0/1418801595 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fecc4083ae0 con 0x7fecd0152700 2026-02-17T11:10:35.256 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.213+0000 7fecaf7fe640 10 monclient: handle_get_version_reply finishing 1 version 33 2026-02-17T11:10:35.256 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.214+0000 7feccf7fe640 1 --2- 10.20.193.49:0/1418801595 >> [v2:10.20.193.97:6816/4259563897,v1:10.20.193.97:6817/4259563897] conn(0x7fec9c0816d0 0x7fec9c083b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.256 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.214+0000 7feccf7fe640 10 monclient: get_auth_request con 0x7fec9c0816d0 auth_method 0 2026-02-17T11:10:35.256 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.216+0000 7fc831ffb640 1 -- 10.20.193.49:0/2395150845 <== osd.10 v2:10.20.193.157:6808/3711386099 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc844151c60 con 0x7fc8140816d0 2026-02-17T11:10:35.256 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.216+0000 7fc831ffb640 10 client.4450.objecter ms_dispatch2 0x7fc844000b90 command_reply(tid 2: 0 ) 2026-02-17T11:10:35.256 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.216+0000 7fc831ffb640 10 client.4450.objecter _finish_command 2 = system:0 2026-02-17T11:10:35.256 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.216+0000 7fc831ffb640 20 client.4450.objecter put_session s=0x7fc814081000 osd=10 4 2026-02-17T11:10:35.256 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.216+0000 7fc831ffb640 15 client.4450.objecter _session_command_op_remove 10 2 2026-02-17T11:10:35.256 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.216+0000 7f6dd568f640 10 client.4437.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T11:10:35.256 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.216+0000 7f6dd568f640 15 client.4437.objecter _session_command_op_assign -1 2 2026-02-17T11:10:35.256 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.216+0000 7f6dd568f640 20 client.4437.objecter _get_session s=0x7f6d9c081090 osd=2 3 2026-02-17T11:10:35.256 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.216+0000 7f6dd568f640 20 client.4437.objecter put_session s=0x7f6d9c081090 osd=2 3 2026-02-17T11:10:35.256 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.216+0000 7f6dd568f640 20 client.4437.objecter _get_session s=0x7f6d9c081090 osd=2 3 2026-02-17T11:10:35.256 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.216+0000 7f6dd568f640 15 client.4437.objecter _session_command_op_remove -1 2 2026-02-17T11:10:35.256 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.216+0000 7f6dd568f640 20 client.4437.objecter get_session s=0x7f6d9c081090 osd=2 3 2026-02-17T11:10:35.256 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.216+0000 7f6dd568f640 15 client.4437.objecter _session_command_op_assign 2 2 2026-02-17T11:10:35.256 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.216+0000 7f6dd568f640 20 client.4437.objecter put_session s=0x7f6d9c081090 osd=2 4 2026-02-17T11:10:35.256 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.216+0000 7f6dd568f640 10 client.4437.objecter _send_command 2 2026-02-17T11:10:35.256 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.216+0000 7f6dd568f640 1 -- 10.20.193.49:0/2195715102 --> [v2:10.20.193.157:6816/1377516118,v1:10.20.193.157:6817/1377516118] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6dd006e7b0 con 0x7f6d9c081760 2026-02-17T11:10:35.256 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.216+0000 7fc84b664640 10 librados: watch_flush enter 2026-02-17T11:10:35.256 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.216+0000 7fecaf7fe640 10 client.4438.objecter ms_handle_connect 0x7fec9c0816d0 2026-02-17T11:10:35.256 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.216+0000 7feccf7fe640 1 --2- 10.20.193.49:0/1418801595 >> [v2:10.20.193.97:6816/4259563897,v1:10.20.193.97:6817/4259563897] conn(0x7fec9c0816d0 0x7fec9c083b10 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.257 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.216+0000 7fc84b664640 10 librados: watch_flush exit 2026-02-17T11:10:35.257 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.216+0000 7fc84b664640 10 client.4450.objecter close_session for osd.10 2026-02-17T11:10:35.257 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.216+0000 7fc84b664640 1 -- 10.20.193.49:0/2395150845 >> [v2:10.20.193.157:6808/3711386099,v1:10.20.193.157:6809/3711386099] conn(0x7fc8140816d0 msgr2=0x7fc814083b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.257 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.216+0000 7fc84b664640 1 --2- 10.20.193.49:0/2395150845 >> [v2:10.20.193.157:6808/3711386099,v1:10.20.193.157:6809/3711386099] conn(0x7fc8140816d0 0x7fc814083b10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.257 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.216+0000 7fc84b664640 20 client.4450.objecter put_session s=0x7fc814081000 osd=10 1 2026-02-17T11:10:35.257 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.216+0000 7fc84b664640 20 client.4450.objecter shutdown clearing up homeless session... 2026-02-17T11:10:35.257 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.216+0000 7fc84b664640 10 client.4450.objecter successfully canceled tick 2026-02-17T11:10:35.257 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.216+0000 7fc84b664640 1 -- 10.20.193.49:0/2395150845 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fc814079190 msgr2=0x7fc81407b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.257 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.216+0000 7fc84b664640 1 --2- 10.20.193.49:0/2395150845 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fc814079190 0x7fc81407b650 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc834039000 tx=0x7fc834031000 comp rx=0 tx=0).stop 2026-02-17T11:10:35.257 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.216+0000 7fc84b664640 10 monclient: shutdown 2026-02-17T11:10:35.257 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.216+0000 7fc84b664640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:35.257 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.216+0000 7fc84b664640 1 -- 10.20.193.49:0/2395150845 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc84415d950 msgr2=0x7fc84415bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.257 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.216+0000 7fc84b664640 1 --2- 10.20.193.49:0/2395150845 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc84415d950 0x7fc84415bda0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc84000cc10 tx=0x7fc84000a430 comp rx=0 tx=0).stop 2026-02-17T11:10:35.257 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.216+0000 7fc849bda640 1 -- 10.20.193.49:0/2395150845 reap_dead start 2026-02-17T11:10:35.257 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.216+0000 7fc84b664640 1 -- 10.20.193.49:0/2395150845 shutdown_connections 2026-02-17T11:10:35.257 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.216+0000 7fc84b664640 1 -- 10.20.193.49:0/2395150845 >> 10.20.193.49:0/2395150845 conn(0x7fc84406d9b0 msgr2=0x7fc8440cfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:35.257 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.216+0000 7fc84b664640 1 -- 10.20.193.49:0/2395150845 shutdown_connections 2026-02-17T11:10:35.257 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.216+0000 7fc84b664640 1 -- 10.20.193.49:0/2395150845 wait complete. 2026-02-17T11:10:35.257 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.216+0000 7fc84b664640 1 librados: shutdown 2026-02-17T11:10:35.258 INFO:teuthology.orchestra.run.trial049.stdout:111669149703 2026-02-17T11:10:35.258 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.11 2026-02-17T11:10:35.258 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.219+0000 7f6daf7fe640 1 -- 10.20.193.49:0/2195715102 <== osd.2 v2:10.20.193.157:6816/1377516118 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6dd006e7b0 con 0x7f6d9c081760 2026-02-17T11:10:35.258 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.219+0000 7f6daf7fe640 10 client.4437.objecter ms_dispatch2 0x7f6dd0000b90 command_reply(tid 2: 0 ) 2026-02-17T11:10:35.258 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.219+0000 7f6daf7fe640 10 client.4437.objecter _finish_command 2 = system:0 2026-02-17T11:10:35.258 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.219+0000 7f6daf7fe640 20 client.4437.objecter put_session s=0x7f6d9c081090 osd=2 4 2026-02-17T11:10:35.258 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.219+0000 7f6daf7fe640 15 client.4437.objecter _session_command_op_remove 2 2 2026-02-17T11:10:35.259 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.219+0000 7f6dd568f640 10 librados: watch_flush enter 2026-02-17T11:10:35.259 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.219+0000 7f6dd568f640 10 librados: watch_flush exit 2026-02-17T11:10:35.259 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.219+0000 7f6dd568f640 10 client.4437.objecter close_session for osd.2 2026-02-17T11:10:35.259 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.219+0000 7f6dd568f640 1 -- 10.20.193.49:0/2195715102 >> [v2:10.20.193.157:6816/1377516118,v1:10.20.193.157:6817/1377516118] conn(0x7f6d9c081760 msgr2=0x7f6d9c083ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.259 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.219+0000 7f6dd568f640 1 --2- 10.20.193.49:0/2195715102 >> [v2:10.20.193.157:6816/1377516118,v1:10.20.193.157:6817/1377516118] conn(0x7f6d9c081760 0x7f6d9c083ba0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.259 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.219+0000 7f6dd568f640 20 client.4437.objecter put_session s=0x7f6d9c081090 osd=2 1 2026-02-17T11:10:35.259 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.219+0000 7f6dd568f640 20 client.4437.objecter shutdown clearing up homeless session... 2026-02-17T11:10:35.259 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.219+0000 7f6dd568f640 10 client.4437.objecter successfully canceled tick 2026-02-17T11:10:35.259 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.219+0000 7f6dd568f640 1 -- 10.20.193.49:0/2195715102 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f6d9c0791c0 msgr2=0x7f6d9c07b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.259 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.219+0000 7f6dd568f640 1 --2- 10.20.193.49:0/2195715102 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f6d9c0791c0 0x7f6d9c07b680 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6dd014e430 tx=0x7f6db8006d10 comp rx=0 tx=0).stop 2026-02-17T11:10:35.259 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.219+0000 7f6dd568f640 10 monclient: shutdown 2026-02-17T11:10:35.259 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.219+0000 7f6dd568f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:35.259 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.219+0000 7f6dd568f640 1 -- 10.20.193.49:0/2195715102 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f6dd0152700 msgr2=0x7f6dd0159670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.259 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.219+0000 7f6dd568f640 1 --2- 10.20.193.49:0/2195715102 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f6dd0152700 0x7f6dd0159670 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6dc400b4d0 tx=0x7f6dc400b9a0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.259 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.219+0000 7f6dcf7fe640 1 -- 10.20.193.49:0/2195715102 reap_dead start 2026-02-17T11:10:35.259 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.219+0000 7f6dd568f640 1 -- 10.20.193.49:0/2195715102 shutdown_connections 2026-02-17T11:10:35.259 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.219+0000 7f6dd568f640 1 -- 10.20.193.49:0/2195715102 >> 10.20.193.49:0/2195715102 conn(0x7f6dd0073030 msgr2=0x7f6dd015fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:35.259 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.219+0000 7f6dd568f640 1 -- 10.20.193.49:0/2195715102 shutdown_connections 2026-02-17T11:10:35.259 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.219+0000 7f6dd568f640 1 -- 10.20.193.49:0/2195715102 wait complete. 2026-02-17T11:10:35.259 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.219+0000 7f6dd568f640 1 librados: shutdown 2026-02-17T11:10:35.259 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.220+0000 7ff77f7fe640 1 -- 10.20.193.49:0/586960880 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7ff78803f050 con 0x7ff7a0152ae0 2026-02-17T11:10:35.259 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.221+0000 7ff77f7fe640 1 --2- 10.20.193.49:0/586960880 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ff76c079190 0x7ff76c07b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.259 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.221+0000 7ff79effd640 1 --2- 10.20.193.49:0/586960880 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ff76c079190 0x7ff76c07b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.259 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.221+0000 7ff79effd640 10 monclient: get_auth_request con 0x7ff76c079190 auth_method 0 2026-02-17T11:10:35.259 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.222+0000 7ff79effd640 1 --2- 10.20.193.49:0/586960880 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ff76c079190 0x7ff76c07b650 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff794009750 tx=0x7ff794006ca0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.260 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.222+0000 7ff77f7fe640 10 client.4459.objecter ms_handle_connect 0x7ff76c079190 2026-02-17T11:10:35.260 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.222+0000 7f3fa4ff9640 1 -- 10.20.193.49:0/715203919 <== osd.8 v2:10.20.193.49:6800/1386770137 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f3f9c00ce50 con 0x7f3f78081900 2026-02-17T11:10:35.260 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.222+0000 7f3fa4ff9640 10 client.4441.objecter ms_dispatch2 0x7f3fa8000b90 command_reply(tid 1: 0 ) 2026-02-17T11:10:35.260 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.222+0000 7f3fa4ff9640 10 client.4441.objecter _finish_command 1 = system:0 2026-02-17T11:10:35.260 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.222+0000 7f3fa4ff9640 20 client.4441.objecter put_session s=0x7f3f78081230 osd=8 4 2026-02-17T11:10:35.260 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.222+0000 7f3fa4ff9640 15 client.4441.objecter _session_command_op_remove 8 1 2026-02-17T11:10:35.260 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.222+0000 7f5e78ff9640 1 -- 10.20.193.49:0/3776431914 <== osd.9 v2:10.20.193.97:6808/676086260 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f5e6c01ce70 con 0x7f5e4c081680 2026-02-17T11:10:35.260 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.222+0000 7f5e78ff9640 10 client.4452.objecter ms_dispatch2 0x7f5e7c000b90 command_reply(tid 1: 0 ) 2026-02-17T11:10:35.260 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.222+0000 7f5e78ff9640 10 client.4452.objecter _finish_command 1 = system:0 2026-02-17T11:10:35.260 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.222+0000 7f5e78ff9640 20 client.4452.objecter put_session s=0x7f5e4c080fb0 osd=9 4 2026-02-17T11:10:35.260 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.222+0000 7f5e78ff9640 15 client.4452.objecter _session_command_op_remove 9 1 2026-02-17T11:10:35.260 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.223+0000 7ff77f7fe640 1 -- 10.20.193.49:0/586960880 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7ff7880831e0 con 0x7ff7a0152ae0 2026-02-17T11:10:35.260 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.223+0000 7ff77f7fe640 10 client.4459.objecter ms_dispatch2 0x7ff7a0000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:35.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.223+0000 7ff77f7fe640 3 client.4459.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:35.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.223+0000 7ff77f7fe640 3 client.4459.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:35.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.223+0000 7ff77f7fe640 10 client.4459.objecter checking command 1 2026-02-17T11:10:35.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.223+0000 7ff77f7fe640 1 --2- 10.20.193.49:0/586960880 >> [v2:10.20.193.162:6819/3057705174,v1:10.20.193.162:6821/3057705174] conn(0x7ff76c081730 0x7ff76c083b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.223+0000 7ff77f7fe640 20 client.4459.objecter _get_session s=0x7ff76c081060 osd=15 3 2026-02-17T11:10:35.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.223+0000 7ff77f7fe640 20 client.4459.objecter put_session s=0x7ff76c081060 osd=15 3 2026-02-17T11:10:35.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.223+0000 7ff77f7fe640 15 client.4459.objecter _session_command_op_remove -1 1 2026-02-17T11:10:35.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.223+0000 7ff77f7fe640 20 client.4459.objecter _get_session s=0x7ff76c081060 osd=15 3 2026-02-17T11:10:35.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.223+0000 7ff77f7fe640 20 client.4459.objecter get_session s=0x7ff76c081060 osd=15 3 2026-02-17T11:10:35.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.223+0000 7ff77f7fe640 15 client.4459.objecter _session_command_op_assign 15 1 2026-02-17T11:10:35.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.223+0000 7ff77f7fe640 20 client.4459.objecter put_session s=0x7ff76c081060 osd=15 4 2026-02-17T11:10:35.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.223+0000 7ff77f7fe640 10 client.4459.objecter _send_command 1 2026-02-17T11:10:35.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.223+0000 7ff77f7fe640 1 -- 10.20.193.49:0/586960880 --> [v2:10.20.193.162:6819/3057705174,v1:10.20.193.162:6821/3057705174] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff76c084240 con 0x7ff76c081730 2026-02-17T11:10:35.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.223+0000 7ff77f7fe640 20 client.4459.objecter dump_active .. 0 homeless 2026-02-17T11:10:35.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.223+0000 7ff77f7fe640 1 -- 10.20.193.49:0/586960880 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7ff7880835a0 con 0x7ff7a0152ae0 2026-02-17T11:10:35.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.223+0000 7ff77f7fe640 10 monclient: handle_get_version_reply finishing 1 version 33 2026-02-17T11:10:35.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.223+0000 7ff79f7fe640 1 --2- 10.20.193.49:0/586960880 >> [v2:10.20.193.162:6819/3057705174,v1:10.20.193.162:6821/3057705174] conn(0x7ff76c081730 0x7ff76c083b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.261 INFO:teuthology.orchestra.run.trial049.stdout:115964117000 2026-02-17T11:10:35.261 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.10 2026-02-17T11:10:35.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.224+0000 7ff79f7fe640 10 monclient: get_auth_request con 0x7ff76c081730 auth_method 0 2026-02-17T11:10:35.262 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.226+0000 7ff77f7fe640 10 client.4459.objecter ms_handle_connect 0x7ff76c081730 2026-02-17T11:10:35.262 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.226+0000 7ff79f7fe640 1 --2- 10.20.193.49:0/586960880 >> [v2:10.20.193.162:6819/3057705174,v1:10.20.193.162:6821/3057705174] conn(0x7ff76c081730 0x7ff76c083b70 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.15 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.262 INFO:teuthology.orchestra.run.trial049.stdout:94489280518 2026-02-17T11:10:35.262 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:10:35.262 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.229+0000 7f5e82375640 10 client.4452.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T11:10:35.262 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.229+0000 7f5e82375640 15 client.4452.objecter _session_command_op_assign -1 2 2026-02-17T11:10:35.262 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.229+0000 7f5e82375640 20 client.4452.objecter _get_session s=0x7f5e4c080fb0 osd=9 3 2026-02-17T11:10:35.262 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.229+0000 7f5e82375640 20 client.4452.objecter put_session s=0x7f5e4c080fb0 osd=9 3 2026-02-17T11:10:35.262 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.229+0000 7f5e82375640 20 client.4452.objecter _get_session s=0x7f5e4c080fb0 osd=9 3 2026-02-17T11:10:35.262 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.229+0000 7f5e82375640 15 client.4452.objecter _session_command_op_remove -1 2 2026-02-17T11:10:35.262 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.229+0000 7f5e82375640 20 client.4452.objecter get_session s=0x7f5e4c080fb0 osd=9 3 2026-02-17T11:10:35.262 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.229+0000 7f5e82375640 15 client.4452.objecter _session_command_op_assign 9 2 2026-02-17T11:10:35.262 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.229+0000 7f5e82375640 20 client.4452.objecter put_session s=0x7f5e4c080fb0 osd=9 4 2026-02-17T11:10:35.262 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.229+0000 7f5e82375640 10 client.4452.objecter _send_command 2 2026-02-17T11:10:35.262 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.229+0000 7f5e82375640 1 -- 10.20.193.49:0/3776431914 --> [v2:10.20.193.97:6808/676086260,v1:10.20.193.97:6809/676086260] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5e7c1597e0 con 0x7f5e4c081680 2026-02-17T11:10:35.263 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.229+0000 7f3fae396640 10 client.4441.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T11:10:35.263 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.229+0000 7f3fae396640 15 client.4441.objecter _session_command_op_assign -1 2 2026-02-17T11:10:35.263 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.229+0000 7f3fae396640 20 client.4441.objecter _get_session s=0x7f3f78081230 osd=8 3 2026-02-17T11:10:35.263 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.229+0000 7f3fae396640 20 client.4441.objecter put_session s=0x7f3f78081230 osd=8 3 2026-02-17T11:10:35.263 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.229+0000 7f3fae396640 20 client.4441.objecter _get_session s=0x7f3f78081230 osd=8 3 2026-02-17T11:10:35.263 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.229+0000 7f3fae396640 15 client.4441.objecter _session_command_op_remove -1 2 2026-02-17T11:10:35.263 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.229+0000 7f3fae396640 20 client.4441.objecter get_session s=0x7f3f78081230 osd=8 3 2026-02-17T11:10:35.263 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.229+0000 7f3fae396640 15 client.4441.objecter _session_command_op_assign 8 2 2026-02-17T11:10:35.263 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.229+0000 7f3fae396640 20 client.4441.objecter put_session s=0x7f3f78081230 osd=8 4 2026-02-17T11:10:35.263 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.229+0000 7f3fae396640 10 client.4441.objecter _send_command 2 2026-02-17T11:10:35.263 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.229+0000 7f3fae396640 1 -- 10.20.193.49:0/715203919 --> [v2:10.20.193.49:6800/1386770137,v1:10.20.193.49:6801/1386770137] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3fa806e7b0 con 0x7f3f78081900 2026-02-17T11:10:35.263 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.231+0000 7f84bb7fe640 1 -- 10.20.193.49:0/4105535500 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f84c4010480 con 0x7f84dc153fc0 2026-02-17T11:10:35.263 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.231+0000 7f84bb7fe640 1 --2- 10.20.193.49:0/4105535500 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f84a80791c0 0x7f84a807b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.263 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.231+0000 7f84daffd640 1 --2- 10.20.193.49:0/4105535500 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f84a80791c0 0x7f84a807b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.263 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.231+0000 7f84daffd640 10 monclient: get_auth_request con 0x7f84a80791c0 auth_method 0 2026-02-17T11:10:35.263 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.232+0000 7f84bb7fe640 10 client.4447.objecter ms_handle_connect 0x7f84a80791c0 2026-02-17T11:10:35.263 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.232+0000 7f84daffd640 1 --2- 10.20.193.49:0/4105535500 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f84a80791c0 0x7f84a807b680 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f84dc072f00 tx=0x7f84d0031000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.263 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.232+0000 7f5e78ff9640 1 -- 10.20.193.49:0/3776431914 <== osd.9 v2:10.20.193.97:6808/676086260 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5e7c1597e0 con 0x7f5e4c081680 2026-02-17T11:10:35.263 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.233+0000 7f5e78ff9640 10 client.4452.objecter ms_dispatch2 0x7f5e7c000b90 command_reply(tid 2: 0 ) 2026-02-17T11:10:35.263 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.233+0000 7f5e78ff9640 10 client.4452.objecter _finish_command 2 = system:0 2026-02-17T11:10:35.263 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.233+0000 7f5e78ff9640 20 client.4452.objecter put_session s=0x7f5e4c080fb0 osd=9 4 2026-02-17T11:10:35.263 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.233+0000 7f5e78ff9640 15 client.4452.objecter _session_command_op_remove 9 2 2026-02-17T11:10:35.264 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.233+0000 7f5e82375640 10 librados: watch_flush enter 2026-02-17T11:10:35.264 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.233+0000 7f5e82375640 10 librados: watch_flush exit 2026-02-17T11:10:35.264 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.233+0000 7f5e82375640 10 client.4452.objecter close_session for osd.9 2026-02-17T11:10:35.264 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.233+0000 7f5e82375640 1 -- 10.20.193.49:0/3776431914 >> [v2:10.20.193.97:6808/676086260,v1:10.20.193.97:6809/676086260] conn(0x7f5e4c081680 msgr2=0x7f5e4c083ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.264 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.233+0000 7f5e82375640 1 --2- 10.20.193.49:0/3776431914 >> [v2:10.20.193.97:6808/676086260,v1:10.20.193.97:6809/676086260] conn(0x7f5e4c081680 0x7f5e4c083ac0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.264 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.233+0000 7f5e82375640 20 client.4452.objecter put_session s=0x7f5e4c080fb0 osd=9 1 2026-02-17T11:10:35.264 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.233+0000 7f5e82375640 20 client.4452.objecter shutdown clearing up homeless session... 2026-02-17T11:10:35.264 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.233+0000 7f5e82375640 10 client.4452.objecter successfully canceled tick 2026-02-17T11:10:35.264 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.233+0000 7f5e82375640 1 -- 10.20.193.49:0/3776431914 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5e4c079140 msgr2=0x7f5e4c07b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.264 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.233+0000 7f5e82375640 1 --2- 10.20.193.49:0/3776431914 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5e4c079140 0x7f5e4c07b600 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c08fc80 tx=0x7f5e68031000 comp rx=0 tx=0).stop 2026-02-17T11:10:35.264 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.233+0000 7f5e82375640 10 monclient: shutdown 2026-02-17T11:10:35.264 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.233+0000 7f5e82375640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:35.264 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.233+0000 7f5e82375640 1 -- 10.20.193.49:0/3776431914 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5e7c15c840 msgr2=0x7f5e7c143cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.264 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.233+0000 7f5e82375640 1 --2- 10.20.193.49:0/3776431914 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5e7c15c840 0x7f5e7c143cd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c00b5a0 tx=0x7f5e6c00ba70 comp rx=0 tx=0).stop 2026-02-17T11:10:35.264 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.233+0000 7f5e808eb640 1 -- 10.20.193.49:0/3776431914 reap_dead start 2026-02-17T11:10:35.264 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.233+0000 7f5e82375640 1 -- 10.20.193.49:0/3776431914 shutdown_connections 2026-02-17T11:10:35.264 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.233+0000 7f5e82375640 1 -- 10.20.193.49:0/3776431914 >> 10.20.193.49:0/3776431914 conn(0x7f5e7c06d9b0 msgr2=0x7f5e7c14fd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:35.264 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.233+0000 7f5e82375640 1 -- 10.20.193.49:0/3776431914 shutdown_connections 2026-02-17T11:10:35.264 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.233+0000 7f5e82375640 1 -- 10.20.193.49:0/3776431914 wait complete. 2026-02-17T11:10:35.264 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.233+0000 7f3fa4ff9640 1 -- 10.20.193.49:0/715203919 <== osd.8 v2:10.20.193.49:6800/1386770137 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3fa806e7b0 con 0x7f3f78081900 2026-02-17T11:10:35.264 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.233+0000 7f3fa4ff9640 10 client.4441.objecter ms_dispatch2 0x7f3fa8000b90 command_reply(tid 2: 0 ) 2026-02-17T11:10:35.265 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.233+0000 7f3fa4ff9640 10 client.4441.objecter _finish_command 2 = system:0 2026-02-17T11:10:35.265 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.233+0000 7f3fa4ff9640 20 client.4441.objecter put_session s=0x7f3f78081230 osd=8 4 2026-02-17T11:10:35.265 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.233+0000 7f5e82375640 1 librados: shutdown 2026-02-17T11:10:35.265 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.233+0000 7f3fa4ff9640 15 client.4441.objecter _session_command_op_remove 8 2 2026-02-17T11:10:35.265 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.233+0000 7f3fae396640 10 librados: watch_flush enter 2026-02-17T11:10:35.265 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.233+0000 7f3fae396640 10 librados: watch_flush exit 2026-02-17T11:10:35.265 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.233+0000 7f3fae396640 10 client.4441.objecter close_session for osd.8 2026-02-17T11:10:35.265 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.233+0000 7f3fae396640 1 -- 10.20.193.49:0/715203919 >> [v2:10.20.193.49:6800/1386770137,v1:10.20.193.49:6801/1386770137] conn(0x7f3f78081900 msgr2=0x7f3f78083d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.265 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.233+0000 7f3fae396640 1 --2- 10.20.193.49:0/715203919 >> [v2:10.20.193.49:6800/1386770137,v1:10.20.193.49:6801/1386770137] conn(0x7f3f78081900 0x7f3f78083d40 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.265 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.233+0000 7f3fae396640 20 client.4441.objecter put_session s=0x7f3f78081230 osd=8 1 2026-02-17T11:10:35.265 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.233+0000 7f3fae396640 20 client.4441.objecter shutdown clearing up homeless session... 2026-02-17T11:10:35.265 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.233+0000 7f3fae396640 10 client.4441.objecter successfully canceled tick 2026-02-17T11:10:35.265 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.233+0000 7f3fae396640 1 -- 10.20.193.49:0/715203919 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3f78079360 msgr2=0x7f3f7807b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.265 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.233+0000 7f3fae396640 1 --2- 10.20.193.49:0/715203919 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3f78079360 0x7f3f7807b820 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3f94007fd0 tx=0x7f3f94007b40 comp rx=0 tx=0).stop 2026-02-17T11:10:35.265 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.233+0000 7f3fae396640 10 monclient: shutdown 2026-02-17T11:10:35.265 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.233+0000 7f3fae396640 20 monclient: shutdown canceling and discarding version request 1 2026-02-17T11:10:35.265 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.233+0000 7f3fae396640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:35.266 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.233+0000 7f3fae396640 1 -- 10.20.193.49:0/715203919 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f3fa815ef80 msgr2=0x7f3fa81f7570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.266 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.233+0000 7f3fae396640 1 --2- 10.20.193.49:0/715203919 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f3fa815ef80 0x7f3fa81f7570 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c00cc30 tx=0x7f3f9c00a5c0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.266 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.233+0000 7f3fac90c640 1 -- 10.20.193.49:0/715203919 reap_dead start 2026-02-17T11:10:35.266 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.233+0000 7f3fae396640 1 -- 10.20.193.49:0/715203919 shutdown_connections 2026-02-17T11:10:35.266 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.233+0000 7f3fae396640 1 -- 10.20.193.49:0/715203919 >> 10.20.193.49:0/715203919 conn(0x7f3fa8073030 msgr2=0x7f3fa815fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:35.266 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.233+0000 7f3fae396640 1 -- 10.20.193.49:0/715203919 shutdown_connections 2026-02-17T11:10:35.266 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.233+0000 7f3fae396640 1 -- 10.20.193.49:0/715203919 wait complete. 2026-02-17T11:10:35.266 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.233+0000 7f3fae396640 1 librados: shutdown 2026-02-17T11:10:35.266 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.233+0000 7f84bb7fe640 1 -- 10.20.193.49:0/4105535500 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7f84c405e340 con 0x7f84dc153fc0 2026-02-17T11:10:35.266 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.233+0000 7f84bb7fe640 10 client.4447.objecter ms_dispatch2 0x7f84dc000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:35.266 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.233+0000 7f84bb7fe640 3 client.4447.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:35.266 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.233+0000 7f84bb7fe640 3 client.4447.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:35.266 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.234+0000 7f84bb7fe640 10 client.4447.objecter checking command 1 2026-02-17T11:10:35.266 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.234+0000 7f84bb7fe640 1 --2- 10.20.193.49:0/4105535500 >> [v2:10.20.193.157:6824/404726964,v1:10.20.193.157:6825/404726964] conn(0x7f84a8081700 0x7f84a8083b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.266 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.234+0000 7f84bb7fe640 20 client.4447.objecter _get_session s=0x7f84a8081030 osd=14 3 2026-02-17T11:10:35.266 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.234+0000 7f84bb7fe640 20 client.4447.objecter put_session s=0x7f84a8081030 osd=14 3 2026-02-17T11:10:35.266 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.234+0000 7f84bb7fe640 15 client.4447.objecter _session_command_op_remove -1 1 2026-02-17T11:10:35.266 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.234+0000 7f84bb7fe640 20 client.4447.objecter _get_session s=0x7f84a8081030 osd=14 3 2026-02-17T11:10:35.266 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.234+0000 7f84bb7fe640 20 client.4447.objecter get_session s=0x7f84a8081030 osd=14 3 2026-02-17T11:10:35.266 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.234+0000 7f84bb7fe640 15 client.4447.objecter _session_command_op_assign 14 1 2026-02-17T11:10:35.266 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.234+0000 7f84bb7fe640 20 client.4447.objecter put_session s=0x7f84a8081030 osd=14 4 2026-02-17T11:10:35.266 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.234+0000 7f84bb7fe640 10 client.4447.objecter _send_command 1 2026-02-17T11:10:35.266 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.234+0000 7f84bb7fe640 1 -- 10.20.193.49:0/4105535500 --> [v2:10.20.193.157:6824/404726964,v1:10.20.193.157:6825/404726964] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f84c4010c80 con 0x7f84a8081700 2026-02-17T11:10:35.267 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.234+0000 7f84bb7fe640 20 client.4447.objecter dump_active .. 0 homeless 2026-02-17T11:10:35.267 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.234+0000 7f84db7fe640 1 --2- 10.20.193.49:0/4105535500 >> [v2:10.20.193.157:6824/404726964,v1:10.20.193.157:6825/404726964] conn(0x7f84a8081700 0x7f84a8083b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.267 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.234+0000 7f84db7fe640 10 monclient: get_auth_request con 0x7f84a8081700 auth_method 0 2026-02-17T11:10:35.267 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.236+0000 7f84db7fe640 1 --2- 10.20.193.49:0/4105535500 >> [v2:10.20.193.157:6824/404726964,v1:10.20.193.157:6825/404726964] conn(0x7f84a8081700 0x7f84a8083b40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.14 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.267 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.236+0000 7f84bb7fe640 10 client.4447.objecter ms_handle_connect 0x7f84a8081700 2026-02-17T11:10:35.267 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.241+0000 7fecaf7fe640 1 -- 10.20.193.49:0/1418801595 <== osd.1 v2:10.20.193.97:6816/4259563897 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fecc4043e80 con 0x7fec9c0816d0 2026-02-17T11:10:35.267 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.241+0000 7fecaf7fe640 10 client.4438.objecter ms_dispatch2 0x7fecd0000b90 command_reply(tid 1: 0 ) 2026-02-17T11:10:35.267 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.241+0000 7fecaf7fe640 10 client.4438.objecter _finish_command 1 = system:0 2026-02-17T11:10:35.267 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.241+0000 7fecaf7fe640 20 client.4438.objecter put_session s=0x7fec9c081000 osd=1 4 2026-02-17T11:10:35.267 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.241+0000 7fecaf7fe640 15 client.4438.objecter _session_command_op_remove 1 1 2026-02-17T11:10:35.267 INFO:teuthology.orchestra.run.trial049.stdout:94489280518 2026-02-17T11:10:35.267 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2026-02-17T11:10:35.268 INFO:teuthology.orchestra.run.trial049.stdout:90194313221 2026-02-17T11:10:35.268 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2026-02-17T11:10:35.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.244+0000 7fc4d1ffb640 1 -- 10.20.193.49:0/2523223392 <== osd.0 v2:10.20.193.49:6824/3898931472 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fc4b40841e0 con 0x7fc4b40816d0 2026-02-17T11:10:35.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.244+0000 7fc4d1ffb640 10 client.4443.objecter ms_dispatch2 0x7fc4e4000b90 command_reply(tid 1: 0 ) 2026-02-17T11:10:35.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.244+0000 7fc4d1ffb640 10 client.4443.objecter _finish_command 1 = system:0 2026-02-17T11:10:35.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.244+0000 7fc4d1ffb640 20 client.4443.objecter put_session s=0x7fc4b4081000 osd=0 4 2026-02-17T11:10:35.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.244+0000 7fc4d1ffb640 15 client.4443.objecter _session_command_op_remove 0 1 2026-02-17T11:10:35.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.246+0000 7f991bfff640 1 -- 10.20.193.49:0/3435546534 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f99300075e0 con 0x7f994014a4a0 2026-02-17T11:10:35.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.246+0000 7f84bb7fe640 1 -- 10.20.193.49:0/4105535500 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f84c405e700 con 0x7f84dc153fc0 2026-02-17T11:10:35.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.246+0000 7f84bb7fe640 10 monclient: handle_get_version_reply finishing 1 version 33 2026-02-17T11:10:35.269 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.246+0000 7f991bfff640 1 --2- 10.20.193.49:0/3435546534 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f9910079140 0x7f991007b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.269 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.247+0000 7f993f7fe640 1 --2- 10.20.193.49:0/3435546534 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f9910079140 0x7f991007b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.269 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.247+0000 7f993f7fe640 10 monclient: get_auth_request con 0x7f9910079140 auth_method 0 2026-02-17T11:10:35.269 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.247+0000 7f993f7fe640 1 --2- 10.20.193.49:0/3435546534 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f9910079140 0x7f991007b600 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f992c006fd0 tx=0x7f992c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.269 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.247+0000 7f991bfff640 10 client.4453.objecter ms_handle_connect 0x7f9910079140 2026-02-17T11:10:35.269 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.248+0000 7fecd52a7640 10 client.4438.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T11:10:35.269 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.248+0000 7fecd52a7640 15 client.4438.objecter _session_command_op_assign -1 2 2026-02-17T11:10:35.269 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.248+0000 7fecd52a7640 20 client.4438.objecter _get_session s=0x7fec9c081000 osd=1 3 2026-02-17T11:10:35.269 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.248+0000 7fecd52a7640 20 client.4438.objecter put_session s=0x7fec9c081000 osd=1 3 2026-02-17T11:10:35.269 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.248+0000 7fecd52a7640 20 client.4438.objecter _get_session s=0x7fec9c081000 osd=1 3 2026-02-17T11:10:35.269 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.248+0000 7fecd52a7640 15 client.4438.objecter _session_command_op_remove -1 2 2026-02-17T11:10:35.269 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.248+0000 7fecd52a7640 20 client.4438.objecter get_session s=0x7fec9c081000 osd=1 3 2026-02-17T11:10:35.269 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.248+0000 7fecd52a7640 15 client.4438.objecter _session_command_op_assign 1 2 2026-02-17T11:10:35.269 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.248+0000 7fecd52a7640 20 client.4438.objecter put_session s=0x7fec9c081000 osd=1 4 2026-02-17T11:10:35.269 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.248+0000 7fecd52a7640 10 client.4438.objecter _send_command 2 2026-02-17T11:10:35.269 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.248+0000 7fecd52a7640 1 -- 10.20.193.49:0/1418801595 --> [v2:10.20.193.97:6816/4259563897,v1:10.20.193.97:6817/4259563897] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fecd00ca080 con 0x7fec9c0816d0 2026-02-17T11:10:35.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.249+0000 7f991bfff640 1 -- 10.20.193.49:0/3435546534 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7f99300bca30 con 0x7f994014a4a0 2026-02-17T11:10:35.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.249+0000 7f991bfff640 10 client.4453.objecter ms_dispatch2 0x7f9940000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:35.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.249+0000 7f991bfff640 3 client.4453.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:35.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.249+0000 7f991bfff640 3 client.4453.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:35.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.249+0000 7f991bfff640 10 client.4453.objecter checking command 1 2026-02-17T11:10:35.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.249+0000 7f991bfff640 1 --2- 10.20.193.49:0/3435546534 >> [v2:10.20.193.49:6812/4012737431,v1:10.20.193.49:6814/4012737431] conn(0x7f9910081680 0x7f9910083ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.249+0000 7f991bfff640 20 client.4453.objecter _get_session s=0x7f9910080fb0 osd=12 3 2026-02-17T11:10:35.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.249+0000 7f991bfff640 20 client.4453.objecter put_session s=0x7f9910080fb0 osd=12 3 2026-02-17T11:10:35.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.249+0000 7f991bfff640 15 client.4453.objecter _session_command_op_remove -1 1 2026-02-17T11:10:35.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.249+0000 7f991bfff640 20 client.4453.objecter _get_session s=0x7f9910080fb0 osd=12 3 2026-02-17T11:10:35.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.249+0000 7f991bfff640 20 client.4453.objecter get_session s=0x7f9910080fb0 osd=12 3 2026-02-17T11:10:35.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.249+0000 7f991bfff640 15 client.4453.objecter _session_command_op_assign 12 1 2026-02-17T11:10:35.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.249+0000 7f991bfff640 20 client.4453.objecter put_session s=0x7f9910080fb0 osd=12 4 2026-02-17T11:10:35.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.249+0000 7f991bfff640 10 client.4453.objecter _send_command 1 2026-02-17T11:10:35.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.249+0000 7f991bfff640 1 -- 10.20.193.49:0/3435546534 --> [v2:10.20.193.49:6812/4012737431,v1:10.20.193.49:6814/4012737431] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9930041e50 con 0x7f9910081680 2026-02-17T11:10:35.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.249+0000 7f991bfff640 20 client.4453.objecter dump_active .. 0 homeless 2026-02-17T11:10:35.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.250+0000 7f991bfff640 1 -- 10.20.193.49:0/3435546534 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f99300833b0 con 0x7f994014a4a0 2026-02-17T11:10:35.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.250+0000 7f991bfff640 10 monclient: handle_get_version_reply finishing 1 version 33 2026-02-17T11:10:35.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.250+0000 7ff77f7fe640 1 -- 10.20.193.49:0/586960880 <== osd.15 v2:10.20.193.162:6819/3057705174 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7ff76c084240 con 0x7ff76c081730 2026-02-17T11:10:35.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.250+0000 7ff77f7fe640 10 client.4459.objecter ms_dispatch2 0x7ff7a0000b90 command_reply(tid 1: 0 ) 2026-02-17T11:10:35.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.250+0000 7ff77f7fe640 10 client.4459.objecter _finish_command 1 = system:0 2026-02-17T11:10:35.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.250+0000 7ff77f7fe640 20 client.4459.objecter put_session s=0x7ff76c081060 osd=15 4 2026-02-17T11:10:35.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.250+0000 7ff77f7fe640 15 client.4459.objecter _session_command_op_remove 15 1 2026-02-17T11:10:35.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.250+0000 7f993ffff640 1 --2- 10.20.193.49:0/3435546534 >> [v2:10.20.193.49:6812/4012737431,v1:10.20.193.49:6814/4012737431] conn(0x7f9910081680 0x7f9910083ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.250+0000 7f993ffff640 10 monclient: get_auth_request con 0x7f9910081680 auth_method 0 2026-02-17T11:10:35.271 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.251+0000 7fc4eb2c4640 10 client.4443.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T11:10:35.271 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.251+0000 7fc4eb2c4640 15 client.4443.objecter _session_command_op_assign -1 2 2026-02-17T11:10:35.271 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.251+0000 7fc4eb2c4640 20 client.4443.objecter _get_session s=0x7fc4b4081000 osd=0 3 2026-02-17T11:10:35.271 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.251+0000 7fc4eb2c4640 20 client.4443.objecter put_session s=0x7fc4b4081000 osd=0 3 2026-02-17T11:10:35.271 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.251+0000 7fc4eb2c4640 20 client.4443.objecter _get_session s=0x7fc4b4081000 osd=0 3 2026-02-17T11:10:35.271 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.251+0000 7fc4eb2c4640 15 client.4443.objecter _session_command_op_remove -1 2 2026-02-17T11:10:35.271 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.251+0000 7fc4eb2c4640 20 client.4443.objecter get_session s=0x7fc4b4081000 osd=0 3 2026-02-17T11:10:35.271 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.251+0000 7fc4eb2c4640 15 client.4443.objecter _session_command_op_assign 0 2 2026-02-17T11:10:35.271 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.251+0000 7fc4eb2c4640 20 client.4443.objecter put_session s=0x7fc4b4081000 osd=0 4 2026-02-17T11:10:35.271 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.251+0000 7fc4eb2c4640 10 client.4443.objecter _send_command 2 2026-02-17T11:10:35.271 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.251+0000 7fc4eb2c4640 1 -- 10.20.193.49:0/2523223392 --> [v2:10.20.193.49:6824/3898931472,v1:10.20.193.49:6825/3898931472] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc4e415c840 con 0x7fc4b40816d0 2026-02-17T11:10:35.271 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.251+0000 7fecaf7fe640 1 -- 10.20.193.49:0/1418801595 <== osd.1 v2:10.20.193.97:6816/4259563897 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fecd00ca080 con 0x7fec9c0816d0 2026-02-17T11:10:35.271 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.251+0000 7fecaf7fe640 10 client.4438.objecter ms_dispatch2 0x7fecd0000b90 command_reply(tid 2: 0 ) 2026-02-17T11:10:35.271 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.251+0000 7fecaf7fe640 10 client.4438.objecter _finish_command 2 = system:0 2026-02-17T11:10:35.271 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.251+0000 7fecaf7fe640 20 client.4438.objecter put_session s=0x7fec9c081000 osd=1 4 2026-02-17T11:10:35.271 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.251+0000 7fecaf7fe640 15 client.4438.objecter _session_command_op_remove 1 2 2026-02-17T11:10:35.271 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.251+0000 7fecd52a7640 10 librados: watch_flush enter 2026-02-17T11:10:35.272 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.251+0000 7fecd52a7640 10 librados: watch_flush exit 2026-02-17T11:10:35.272 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.251+0000 7fecd52a7640 10 client.4438.objecter close_session for osd.1 2026-02-17T11:10:35.272 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.251+0000 7fecd52a7640 1 -- 10.20.193.49:0/1418801595 >> [v2:10.20.193.97:6816/4259563897,v1:10.20.193.97:6817/4259563897] conn(0x7fec9c0816d0 msgr2=0x7fec9c083b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.272 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.251+0000 7fecd52a7640 1 --2- 10.20.193.49:0/1418801595 >> [v2:10.20.193.97:6816/4259563897,v1:10.20.193.97:6817/4259563897] conn(0x7fec9c0816d0 0x7fec9c083b10 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.272 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.251+0000 7fecd52a7640 20 client.4438.objecter put_session s=0x7fec9c081000 osd=1 1 2026-02-17T11:10:35.272 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.251+0000 7fecd52a7640 20 client.4438.objecter shutdown clearing up homeless session... 2026-02-17T11:10:35.272 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.251+0000 7fecd52a7640 10 client.4438.objecter successfully canceled tick 2026-02-17T11:10:35.272 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.251+0000 7fecd52a7640 1 -- 10.20.193.49:0/1418801595 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fec9c079190 msgr2=0x7fec9c07b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.272 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.251+0000 7fecd52a7640 1 --2- 10.20.193.49:0/1418801595 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fec9c079190 0x7fec9c07b650 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fecd01f6f40 tx=0x7fecb8008040 comp rx=0 tx=0).stop 2026-02-17T11:10:35.272 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.251+0000 7fecd52a7640 10 monclient: shutdown 2026-02-17T11:10:35.272 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.251+0000 7fecd52a7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:35.272 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.251+0000 7fecd52a7640 1 -- 10.20.193.49:0/1418801595 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fecd0152700 msgr2=0x7fecd014c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.272 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.251+0000 7fecd52a7640 1 --2- 10.20.193.49:0/1418801595 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fecd0152700 0x7fecd014c680 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fecc4036000 tx=0x7fecc40047c0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.272 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.251+0000 7feccf7fe640 1 -- 10.20.193.49:0/1418801595 reap_dead start 2026-02-17T11:10:35.272 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.251+0000 7fecd52a7640 1 -- 10.20.193.49:0/1418801595 shutdown_connections 2026-02-17T11:10:35.272 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.251+0000 7fecd52a7640 1 -- 10.20.193.49:0/1418801595 >> 10.20.193.49:0/1418801595 conn(0x7fecd0073030 msgr2=0x7fecd0073410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:35.272 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.251+0000 7fecd52a7640 1 -- 10.20.193.49:0/1418801595 shutdown_connections 2026-02-17T11:10:35.272 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.251+0000 7fecd52a7640 1 -- 10.20.193.49:0/1418801595 wait complete. 2026-02-17T11:10:35.272 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.251+0000 7fecd52a7640 1 librados: shutdown 2026-02-17T11:10:35.272 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.253+0000 7f991bfff640 10 client.4453.objecter ms_handle_connect 0x7f9910081680 2026-02-17T11:10:35.272 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.253+0000 7f993ffff640 1 --2- 10.20.193.49:0/3435546534 >> [v2:10.20.193.49:6812/4012737431,v1:10.20.193.49:6814/4012737431] conn(0x7f9910081680 0x7f9910083ac0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.12 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.272 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.256+0000 7ff7a5322640 10 client.4459.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T11:10:35.272 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.256+0000 7ff7a5322640 15 client.4459.objecter _session_command_op_assign -1 2 2026-02-17T11:10:35.272 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.256+0000 7ff7a5322640 20 client.4459.objecter _get_session s=0x7ff76c081060 osd=15 3 2026-02-17T11:10:35.272 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.256+0000 7ff7a5322640 20 client.4459.objecter put_session s=0x7ff76c081060 osd=15 3 2026-02-17T11:10:35.272 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.256+0000 7ff7a5322640 20 client.4459.objecter _get_session s=0x7ff76c081060 osd=15 3 2026-02-17T11:10:35.272 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.256+0000 7ff7a5322640 15 client.4459.objecter _session_command_op_remove -1 2 2026-02-17T11:10:35.272 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.256+0000 7ff7a5322640 20 client.4459.objecter get_session s=0x7ff76c081060 osd=15 3 2026-02-17T11:10:35.272 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.256+0000 7ff7a5322640 15 client.4459.objecter _session_command_op_assign 15 2 2026-02-17T11:10:35.272 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.256+0000 7ff7a5322640 20 client.4459.objecter put_session s=0x7ff76c081060 osd=15 4 2026-02-17T11:10:35.273 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.256+0000 7ff7a5322640 10 client.4459.objecter _send_command 2 2026-02-17T11:10:35.273 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.256+0000 7ff7a5322640 1 -- 10.20.193.49:0/586960880 --> [v2:10.20.193.162:6819/3057705174,v1:10.20.193.162:6821/3057705174] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff7a014dc80 con 0x7ff76c081730 2026-02-17T11:10:35.273 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.257+0000 7f4327fff640 1 -- 10.20.193.49:0/1356756625 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f4338019460 con 0x7f434c0d1b60 2026-02-17T11:10:35.273 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.258+0000 7f4327fff640 1 --2- 10.20.193.49:0/1356756625 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f431c079190 0x7f431c07b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.273 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.258+0000 7f434affd640 1 --2- 10.20.193.49:0/1356756625 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f431c079190 0x7f431c07b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.273 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.258+0000 7f434affd640 10 monclient: get_auth_request con 0x7f431c079190 auth_method 0 2026-02-17T11:10:35.273 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.258+0000 7f84bb7fe640 1 -- 10.20.193.49:0/4105535500 <== osd.14 v2:10.20.193.157:6824/404726964 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f84c4010c80 con 0x7f84a8081700 2026-02-17T11:10:35.273 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.258+0000 7f84bb7fe640 10 client.4447.objecter ms_dispatch2 0x7f84dc000b90 command_reply(tid 1: 0 ) 2026-02-17T11:10:35.273 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.258+0000 7f84bb7fe640 10 client.4447.objecter _finish_command 1 = system:0 2026-02-17T11:10:35.273 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.258+0000 7f84bb7fe640 20 client.4447.objecter put_session s=0x7f84a8081030 osd=14 4 2026-02-17T11:10:35.273 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.258+0000 7f84bb7fe640 15 client.4447.objecter _session_command_op_remove 14 1 2026-02-17T11:10:35.273 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.258+0000 7f434affd640 1 --2- 10.20.193.49:0/1356756625 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f431c079190 0x7f431c07b650 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f434c14c2e0 tx=0x7f433c009110 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.273 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.258+0000 7f4327fff640 10 client.4462.objecter ms_handle_connect 0x7f431c079190 2026-02-17T11:10:35.273 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.259+0000 7fc4d1ffb640 1 -- 10.20.193.49:0/2523223392 <== osd.0 v2:10.20.193.49:6824/3898931472 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc4e415c840 con 0x7fc4b40816d0 2026-02-17T11:10:35.273 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.259+0000 7fc4d1ffb640 10 client.4443.objecter ms_dispatch2 0x7fc4e4000b90 command_reply(tid 2: 0 ) 2026-02-17T11:10:35.273 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.259+0000 7fc4d1ffb640 10 client.4443.objecter _finish_command 2 = system:0 2026-02-17T11:10:35.273 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.259+0000 7fc4d1ffb640 20 client.4443.objecter put_session s=0x7fc4b4081000 osd=0 4 2026-02-17T11:10:35.273 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.259+0000 7fc4d1ffb640 15 client.4443.objecter _session_command_op_remove 0 2 2026-02-17T11:10:35.274 INFO:teuthology.orchestra.run.trial049.stdout:94489280518 2026-02-17T11:10:35.274 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:10:35.274 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.259+0000 7fc4eb2c4640 10 librados: watch_flush enter 2026-02-17T11:10:35.274 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.259+0000 7fc4eb2c4640 10 librados: watch_flush exit 2026-02-17T11:10:35.274 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.259+0000 7fc4eb2c4640 10 client.4443.objecter close_session for osd.0 2026-02-17T11:10:35.274 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.259+0000 7fc4eb2c4640 1 -- 10.20.193.49:0/2523223392 >> [v2:10.20.193.49:6824/3898931472,v1:10.20.193.49:6825/3898931472] conn(0x7fc4b40816d0 msgr2=0x7fc4b4083b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.275 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.259+0000 7fc4eb2c4640 1 --2- 10.20.193.49:0/2523223392 >> [v2:10.20.193.49:6824/3898931472,v1:10.20.193.49:6825/3898931472] conn(0x7fc4b40816d0 0x7fc4b4083b10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.275 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.259+0000 7fc4eb2c4640 20 client.4443.objecter put_session s=0x7fc4b4081000 osd=0 1 2026-02-17T11:10:35.275 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.259+0000 7fc4eb2c4640 20 client.4443.objecter shutdown clearing up homeless session... 2026-02-17T11:10:35.275 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.259+0000 7fc4eb2c4640 10 client.4443.objecter successfully canceled tick 2026-02-17T11:10:35.275 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.259+0000 7fc4eb2c4640 1 -- 10.20.193.49:0/2523223392 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fc4b4079190 msgr2=0x7fc4b407b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.275 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.259+0000 7fc4eb2c4640 1 --2- 10.20.193.49:0/2523223392 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fc4b4079190 0x7fc4b407b650 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc4d4009750 tx=0x7fc4d4006ca0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.275 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.259+0000 7fc4eb2c4640 10 monclient: shutdown 2026-02-17T11:10:35.275 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.259+0000 7fc4eb2c4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:35.275 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.259+0000 7fc4eb2c4640 1 -- 10.20.193.49:0/2523223392 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc4e415d950 msgr2=0x7fc4e41f54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.275 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.259+0000 7fc4eb2c4640 1 --2- 10.20.193.49:0/2523223392 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc4e415d950 0x7fc4e41f54d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc4e000be20 tx=0x7fc4e000bf20 comp rx=0 tx=0).stop 2026-02-17T11:10:35.275 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.259+0000 7fc4e983a640 1 -- 10.20.193.49:0/2523223392 reap_dead start 2026-02-17T11:10:35.275 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.259+0000 7fc4eb2c4640 1 -- 10.20.193.49:0/2523223392 shutdown_connections 2026-02-17T11:10:35.275 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.259+0000 7fc4eb2c4640 1 -- 10.20.193.49:0/2523223392 >> 10.20.193.49:0/2523223392 conn(0x7fc4e406d9b0 msgr2=0x7fc4e40d0310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:35.275 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.259+0000 7fc4eb2c4640 1 -- 10.20.193.49:0/2523223392 shutdown_connections 2026-02-17T11:10:35.275 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.259+0000 7fc4eb2c4640 1 -- 10.20.193.49:0/2523223392 wait complete. 2026-02-17T11:10:35.275 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.259+0000 7fc4eb2c4640 1 librados: shutdown 2026-02-17T11:10:35.275 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.260+0000 7f4327fff640 1 -- 10.20.193.49:0/1356756625 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7f433805dea0 con 0x7f434c0d1b60 2026-02-17T11:10:35.275 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.260+0000 7f4327fff640 10 client.4462.objecter ms_dispatch2 0x7f434c000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:35.275 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.260+0000 7f4327fff640 3 client.4462.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:35.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.260+0000 7f4327fff640 3 client.4462.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:35.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.260+0000 7f4327fff640 10 client.4462.objecter checking command 1 2026-02-17T11:10:35.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.260+0000 7f4327fff640 1 --2- 10.20.193.49:0/1356756625 >> [v2:10.20.193.49:6808/2238942007,v1:10.20.193.49:6809/2238942007] conn(0x7f431c0816d0 0x7f431c083b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.260+0000 7f4327fff640 20 client.4462.objecter _get_session s=0x7f431c081000 osd=4 3 2026-02-17T11:10:35.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.260+0000 7f4327fff640 20 client.4462.objecter put_session s=0x7f431c081000 osd=4 3 2026-02-17T11:10:35.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.260+0000 7f4327fff640 15 client.4462.objecter _session_command_op_remove -1 1 2026-02-17T11:10:35.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.260+0000 7f4327fff640 20 client.4462.objecter _get_session s=0x7f431c081000 osd=4 3 2026-02-17T11:10:35.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.260+0000 7f4327fff640 20 client.4462.objecter get_session s=0x7f431c081000 osd=4 3 2026-02-17T11:10:35.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.260+0000 7f4327fff640 15 client.4462.objecter _session_command_op_assign 4 1 2026-02-17T11:10:35.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.260+0000 7f4327fff640 20 client.4462.objecter put_session s=0x7f431c081000 osd=4 4 2026-02-17T11:10:35.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.260+0000 7f4327fff640 10 client.4462.objecter _send_command 1 2026-02-17T11:10:35.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.260+0000 7f4327fff640 1 -- 10.20.193.49:0/1356756625 --> [v2:10.20.193.49:6808/2238942007,v1:10.20.193.49:6809/2238942007] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4338021e80 con 0x7f431c0816d0 2026-02-17T11:10:35.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.260+0000 7f4327fff640 20 client.4462.objecter dump_active .. 0 homeless 2026-02-17T11:10:35.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.260+0000 7f4327fff640 1 -- 10.20.193.49:0/1356756625 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f433805e260 con 0x7f434c0d1b60 2026-02-17T11:10:35.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.260+0000 7f4327fff640 10 monclient: handle_get_version_reply finishing 1 version 33 2026-02-17T11:10:35.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.260+0000 7ff77f7fe640 1 -- 10.20.193.49:0/586960880 <== osd.15 v2:10.20.193.162:6819/3057705174 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff7a014dc80 con 0x7ff76c081730 2026-02-17T11:10:35.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.260+0000 7ff77f7fe640 10 client.4459.objecter ms_dispatch2 0x7ff7a0000b90 command_reply(tid 2: 0 ) 2026-02-17T11:10:35.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.260+0000 7ff77f7fe640 10 client.4459.objecter _finish_command 2 = system:0 2026-02-17T11:10:35.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.260+0000 7ff77f7fe640 20 client.4459.objecter put_session s=0x7ff76c081060 osd=15 4 2026-02-17T11:10:35.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.260+0000 7ff77f7fe640 15 client.4459.objecter _session_command_op_remove 15 2 2026-02-17T11:10:35.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.260+0000 7ff7a5322640 10 librados: watch_flush enter 2026-02-17T11:10:35.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.260+0000 7ff7a5322640 10 librados: watch_flush exit 2026-02-17T11:10:35.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.260+0000 7ff7a5322640 10 client.4459.objecter close_session for osd.15 2026-02-17T11:10:35.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.260+0000 7ff7a5322640 1 -- 10.20.193.49:0/586960880 >> [v2:10.20.193.162:6819/3057705174,v1:10.20.193.162:6821/3057705174] conn(0x7ff76c081730 msgr2=0x7ff76c083b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.260+0000 7ff7a5322640 1 --2- 10.20.193.49:0/586960880 >> [v2:10.20.193.162:6819/3057705174,v1:10.20.193.162:6821/3057705174] conn(0x7ff76c081730 0x7ff76c083b70 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.260+0000 7ff7a5322640 20 client.4459.objecter put_session s=0x7ff76c081060 osd=15 1 2026-02-17T11:10:35.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.260+0000 7ff7a5322640 20 client.4459.objecter shutdown clearing up homeless session... 2026-02-17T11:10:35.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.260+0000 7ff7a5322640 10 client.4459.objecter successfully canceled tick 2026-02-17T11:10:35.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.260+0000 7ff7a5322640 1 -- 10.20.193.49:0/586960880 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ff76c079190 msgr2=0x7ff76c07b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.260+0000 7ff7a5322640 1 --2- 10.20.193.49:0/586960880 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ff76c079190 0x7ff76c07b650 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff794009750 tx=0x7ff794006ca0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.260+0000 7ff7a5322640 10 monclient: shutdown 2026-02-17T11:10:35.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.260+0000 7ff7a5322640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:35.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.260+0000 7ff7a5322640 1 -- 10.20.193.49:0/586960880 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7ff7a0152ae0 msgr2=0x7ff7a014a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.260+0000 7ff7a5322640 1 --2- 10.20.193.49:0/586960880 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7ff7a0152ae0 0x7ff7a014a6a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff788009970 tx=0x7ff7880047c0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.260+0000 7ff79f7fe640 1 -- 10.20.193.49:0/586960880 reap_dead start 2026-02-17T11:10:35.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.260+0000 7ff7a5322640 1 -- 10.20.193.49:0/586960880 shutdown_connections 2026-02-17T11:10:35.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.260+0000 7ff7a5322640 1 -- 10.20.193.49:0/586960880 >> 10.20.193.49:0/586960880 conn(0x7ff7a0073030 msgr2=0x7ff7a014d140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:35.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.260+0000 7f434bfff640 1 --2- 10.20.193.49:0/1356756625 >> [v2:10.20.193.49:6808/2238942007,v1:10.20.193.49:6809/2238942007] conn(0x7f431c0816d0 0x7f431c083b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.260+0000 7ff7a5322640 1 -- 10.20.193.49:0/586960880 shutdown_connections 2026-02-17T11:10:35.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.260+0000 7ff7a5322640 1 -- 10.20.193.49:0/586960880 wait complete. 2026-02-17T11:10:35.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.260+0000 7ff7a5322640 1 librados: shutdown 2026-02-17T11:10:35.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.261+0000 7f434bfff640 10 monclient: get_auth_request con 0x7f431c0816d0 auth_method 0 2026-02-17T11:10:35.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.263+0000 7f434bfff640 1 --2- 10.20.193.49:0/1356756625 >> [v2:10.20.193.49:6808/2238942007,v1:10.20.193.49:6809/2238942007] conn(0x7f431c0816d0 0x7f431c083b10 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.263+0000 7f4327fff640 10 client.4462.objecter ms_handle_connect 0x7f431c0816d0 2026-02-17T11:10:35.278 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.265+0000 7f84e1553640 10 client.4447.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T11:10:35.278 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.265+0000 7f84e1553640 15 client.4447.objecter _session_command_op_assign -1 2 2026-02-17T11:10:35.278 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.265+0000 7f84e1553640 20 client.4447.objecter _get_session s=0x7f84a8081030 osd=14 3 2026-02-17T11:10:35.278 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.265+0000 7f84e1553640 20 client.4447.objecter put_session s=0x7f84a8081030 osd=14 3 2026-02-17T11:10:35.278 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.265+0000 7f84e1553640 20 client.4447.objecter _get_session s=0x7f84a8081030 osd=14 3 2026-02-17T11:10:35.278 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.265+0000 7f84e1553640 15 client.4447.objecter _session_command_op_remove -1 2 2026-02-17T11:10:35.278 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.265+0000 7f84e1553640 20 client.4447.objecter get_session s=0x7f84a8081030 osd=14 3 2026-02-17T11:10:35.278 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.265+0000 7f84e1553640 15 client.4447.objecter _session_command_op_assign 14 2 2026-02-17T11:10:35.278 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.265+0000 7f84e1553640 20 client.4447.objecter put_session s=0x7f84a8081030 osd=14 4 2026-02-17T11:10:35.278 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.265+0000 7f84e1553640 10 client.4447.objecter _send_command 2 2026-02-17T11:10:35.278 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.265+0000 7f84e1553640 1 -- 10.20.193.49:0/4105535500 --> [v2:10.20.193.157:6824/404726964,v1:10.20.193.157:6825/404726964] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f84dc15c1c0 con 0x7f84a8081700 2026-02-17T11:10:35.279 INFO:teuthology.orchestra.run.trial049.stdout:111669149704 2026-02-17T11:10:35.279 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:10:35.279 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.268+0000 7f84bb7fe640 1 -- 10.20.193.49:0/4105535500 <== osd.14 v2:10.20.193.157:6824/404726964 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f84dc15c1c0 con 0x7f84a8081700 2026-02-17T11:10:35.279 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.268+0000 7f84bb7fe640 10 client.4447.objecter ms_dispatch2 0x7f84dc000b90 command_reply(tid 2: 0 ) 2026-02-17T11:10:35.279 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.268+0000 7f84bb7fe640 10 client.4447.objecter _finish_command 2 = system:0 2026-02-17T11:10:35.279 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.268+0000 7f84bb7fe640 20 client.4447.objecter put_session s=0x7f84a8081030 osd=14 4 2026-02-17T11:10:35.279 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.268+0000 7f84bb7fe640 15 client.4447.objecter _session_command_op_remove 14 2 2026-02-17T11:10:35.279 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.269+0000 7f84e1553640 10 librados: watch_flush enter 2026-02-17T11:10:35.279 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.269+0000 7f84e1553640 10 librados: watch_flush exit 2026-02-17T11:10:35.279 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.269+0000 7f84e1553640 10 client.4447.objecter close_session for osd.14 2026-02-17T11:10:35.280 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.269+0000 7f84e1553640 1 -- 10.20.193.49:0/4105535500 >> [v2:10.20.193.157:6824/404726964,v1:10.20.193.157:6825/404726964] conn(0x7f84a8081700 msgr2=0x7f84a8083b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.280 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.269+0000 7f84e1553640 1 --2- 10.20.193.49:0/4105535500 >> [v2:10.20.193.157:6824/404726964,v1:10.20.193.157:6825/404726964] conn(0x7f84a8081700 0x7f84a8083b40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.280 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.269+0000 7f84e1553640 20 client.4447.objecter put_session s=0x7f84a8081030 osd=14 1 2026-02-17T11:10:35.280 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.269+0000 7f84e1553640 20 client.4447.objecter shutdown clearing up homeless session... 2026-02-17T11:10:35.280 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.269+0000 7f84e1553640 10 client.4447.objecter successfully canceled tick 2026-02-17T11:10:35.280 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.269+0000 7f84e1553640 1 -- 10.20.193.49:0/4105535500 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f84a80791c0 msgr2=0x7f84a807b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.280 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.269+0000 7f84e1553640 1 --2- 10.20.193.49:0/4105535500 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f84a80791c0 0x7f84a807b680 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f84dc072f00 tx=0x7f84d0031000 comp rx=0 tx=0).stop 2026-02-17T11:10:35.280 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.269+0000 7f84e1553640 10 monclient: shutdown 2026-02-17T11:10:35.280 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.269+0000 7f84e1553640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:35.280 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.269+0000 7f84e1553640 1 -- 10.20.193.49:0/4105535500 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f84dc153fc0 msgr2=0x7f84dc1f2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.280 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.269+0000 7f84e1553640 1 --2- 10.20.193.49:0/4105535500 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f84dc153fc0 0x7f84dc1f2d40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f84c400b4d0 tx=0x7f84c400b9a0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.280 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.269+0000 7f84db7fe640 1 -- 10.20.193.49:0/4105535500 reap_dead start 2026-02-17T11:10:35.280 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.269+0000 7f84e1553640 1 -- 10.20.193.49:0/4105535500 shutdown_connections 2026-02-17T11:10:35.280 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.269+0000 7f84e1553640 1 -- 10.20.193.49:0/4105535500 >> 10.20.193.49:0/4105535500 conn(0x7f84dc0cf670 msgr2=0x7f84dc0c8880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:35.280 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.269+0000 7f84e1553640 1 -- 10.20.193.49:0/4105535500 shutdown_connections 2026-02-17T11:10:35.280 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.269+0000 7f84e1553640 1 -- 10.20.193.49:0/4105535500 wait complete. 2026-02-17T11:10:35.280 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.269+0000 7f84e1553640 1 librados: shutdown 2026-02-17T11:10:35.280 INFO:teuthology.orchestra.run.trial049.stdout:94489280518 2026-02-17T11:10:35.280 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.15 2026-02-17T11:10:35.281 INFO:teuthology.orchestra.run.trial049.stdout:98784247813 2026-02-17T11:10:35.281 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.14 2026-02-17T11:10:35.289 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.288+0000 7f4327fff640 1 -- 10.20.193.49:0/1356756625 <== osd.4 v2:10.20.193.49:6808/2238942007 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f4338021e80 con 0x7f431c0816d0 2026-02-17T11:10:35.290 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.288+0000 7f4327fff640 10 client.4462.objecter ms_dispatch2 0x7f434c000b90 command_reply(tid 1: 0 ) 2026-02-17T11:10:35.290 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.288+0000 7f4327fff640 10 client.4462.objecter _finish_command 1 = system:0 2026-02-17T11:10:35.290 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.288+0000 7f4327fff640 20 client.4462.objecter put_session s=0x7f431c081000 osd=4 4 2026-02-17T11:10:35.290 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.288+0000 7f4327fff640 15 client.4462.objecter _session_command_op_remove 4 1 2026-02-17T11:10:35.290 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.288+0000 7f991bfff640 1 -- 10.20.193.49:0/3435546534 <== osd.12 v2:10.20.193.49:6812/4012737431 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f9930041e50 con 0x7f9910081680 2026-02-17T11:10:35.290 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.288+0000 7f991bfff640 10 client.4453.objecter ms_dispatch2 0x7f9940000b90 command_reply(tid 1: 0 ) 2026-02-17T11:10:35.290 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.288+0000 7f991bfff640 10 client.4453.objecter _finish_command 1 = system:0 2026-02-17T11:10:35.290 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.288+0000 7f991bfff640 20 client.4453.objecter put_session s=0x7f9910080fb0 osd=12 4 2026-02-17T11:10:35.290 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.288+0000 7f991bfff640 15 client.4453.objecter _session_command_op_remove 12 1 2026-02-17T11:10:35.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.298+0000 7f435212c640 10 client.4462.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T11:10:35.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.298+0000 7f435212c640 15 client.4462.objecter _session_command_op_assign -1 2 2026-02-17T11:10:35.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.298+0000 7f435212c640 20 client.4462.objecter _get_session s=0x7f431c081000 osd=4 3 2026-02-17T11:10:35.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.298+0000 7f435212c640 20 client.4462.objecter put_session s=0x7f431c081000 osd=4 3 2026-02-17T11:10:35.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.298+0000 7f435212c640 20 client.4462.objecter _get_session s=0x7f431c081000 osd=4 3 2026-02-17T11:10:35.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.298+0000 7f435212c640 15 client.4462.objecter _session_command_op_remove -1 2 2026-02-17T11:10:35.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.298+0000 7f435212c640 20 client.4462.objecter get_session s=0x7f431c081000 osd=4 3 2026-02-17T11:10:35.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.298+0000 7f435212c640 15 client.4462.objecter _session_command_op_assign 4 2 2026-02-17T11:10:35.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.298+0000 7f435212c640 20 client.4462.objecter put_session s=0x7f431c081000 osd=4 4 2026-02-17T11:10:35.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.298+0000 7f435212c640 10 client.4462.objecter _send_command 2 2026-02-17T11:10:35.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.298+0000 7f435212c640 1 -- 10.20.193.49:0/1356756625 --> [v2:10.20.193.49:6808/2238942007,v1:10.20.193.49:6809/2238942007] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f434c073ec0 con 0x7f431c0816d0 2026-02-17T11:10:35.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.299+0000 7f9945a8f640 10 client.4453.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T11:10:35.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.299+0000 7f9945a8f640 15 client.4453.objecter _session_command_op_assign -1 2 2026-02-17T11:10:35.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.299+0000 7f9945a8f640 20 client.4453.objecter _get_session s=0x7f9910080fb0 osd=12 3 2026-02-17T11:10:35.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.299+0000 7f9945a8f640 20 client.4453.objecter put_session s=0x7f9910080fb0 osd=12 3 2026-02-17T11:10:35.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.299+0000 7f9945a8f640 20 client.4453.objecter _get_session s=0x7f9910080fb0 osd=12 3 2026-02-17T11:10:35.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.299+0000 7f9945a8f640 15 client.4453.objecter _session_command_op_remove -1 2 2026-02-17T11:10:35.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.299+0000 7f9945a8f640 20 client.4453.objecter get_session s=0x7f9910080fb0 osd=12 3 2026-02-17T11:10:35.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.299+0000 7f9945a8f640 15 client.4453.objecter _session_command_op_assign 12 2 2026-02-17T11:10:35.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.299+0000 7f9945a8f640 20 client.4453.objecter put_session s=0x7f9910080fb0 osd=12 4 2026-02-17T11:10:35.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.299+0000 7f9945a8f640 10 client.4453.objecter _send_command 2 2026-02-17T11:10:35.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.299+0000 7f9945a8f640 1 -- 10.20.193.49:0/3435546534 --> [v2:10.20.193.49:6812/4012737431,v1:10.20.193.49:6814/4012737431] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f99401f4670 con 0x7f9910081680 2026-02-17T11:10:35.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.303+0000 7f4327fff640 1 -- 10.20.193.49:0/1356756625 <== osd.4 v2:10.20.193.49:6808/2238942007 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f434c073ec0 con 0x7f431c0816d0 2026-02-17T11:10:35.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.303+0000 7f4327fff640 10 client.4462.objecter ms_dispatch2 0x7f434c000b90 command_reply(tid 2: 0 ) 2026-02-17T11:10:35.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.303+0000 7f4327fff640 10 client.4462.objecter _finish_command 2 = system:0 2026-02-17T11:10:35.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.303+0000 7f4327fff640 20 client.4462.objecter put_session s=0x7f431c081000 osd=4 4 2026-02-17T11:10:35.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.303+0000 7f4327fff640 15 client.4462.objecter _session_command_op_remove 4 2 2026-02-17T11:10:35.305 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.304+0000 7f435212c640 10 librados: watch_flush enter 2026-02-17T11:10:35.305 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.304+0000 7f435212c640 10 librados: watch_flush exit 2026-02-17T11:10:35.305 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.304+0000 7f435212c640 10 client.4462.objecter close_session for osd.4 2026-02-17T11:10:35.305 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.304+0000 7f435212c640 1 -- 10.20.193.49:0/1356756625 >> [v2:10.20.193.49:6808/2238942007,v1:10.20.193.49:6809/2238942007] conn(0x7f431c0816d0 msgr2=0x7f431c083b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.305 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.304+0000 7f435212c640 1 --2- 10.20.193.49:0/1356756625 >> [v2:10.20.193.49:6808/2238942007,v1:10.20.193.49:6809/2238942007] conn(0x7f431c0816d0 0x7f431c083b10 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.305 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.304+0000 7f435212c640 20 client.4462.objecter put_session s=0x7f431c081000 osd=4 1 2026-02-17T11:10:35.305 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.304+0000 7f435212c640 20 client.4462.objecter shutdown clearing up homeless session... 2026-02-17T11:10:35.305 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.304+0000 7f435212c640 10 client.4462.objecter successfully canceled tick 2026-02-17T11:10:35.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.304+0000 7f435212c640 1 -- 10.20.193.49:0/1356756625 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f431c079190 msgr2=0x7f431c07b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.304+0000 7f435212c640 1 --2- 10.20.193.49:0/1356756625 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f431c079190 0x7f431c07b650 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f434c14c2e0 tx=0x7f433c009110 comp rx=0 tx=0).stop 2026-02-17T11:10:35.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.304+0000 7f435212c640 10 monclient: shutdown 2026-02-17T11:10:35.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.304+0000 7f435212c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:35.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.304+0000 7f435212c640 1 -- 10.20.193.49:0/1356756625 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f434c0d1b60 msgr2=0x7f434c151050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.304+0000 7f435212c640 1 --2- 10.20.193.49:0/1356756625 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f434c0d1b60 0x7f434c151050 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f433800b500 tx=0x7f433800b9d0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.304+0000 7f434bfff640 1 -- 10.20.193.49:0/1356756625 reap_dead start 2026-02-17T11:10:35.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.305+0000 7f435212c640 1 -- 10.20.193.49:0/1356756625 shutdown_connections 2026-02-17T11:10:35.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.305+0000 7f435212c640 1 -- 10.20.193.49:0/1356756625 >> 10.20.193.49:0/1356756625 conn(0x7f434c06d9b0 msgr2=0x7f434c0d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:35.307 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.305+0000 7f435212c640 1 -- 10.20.193.49:0/1356756625 shutdown_connections 2026-02-17T11:10:35.307 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.306+0000 7f435212c640 1 -- 10.20.193.49:0/1356756625 wait complete. 2026-02-17T11:10:35.307 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.306+0000 7f435212c640 1 librados: shutdown 2026-02-17T11:10:35.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.310+0000 7f991bfff640 1 -- 10.20.193.49:0/3435546534 <== osd.12 v2:10.20.193.49:6812/4012737431 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f99401f4670 con 0x7f9910081680 2026-02-17T11:10:35.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.310+0000 7f991bfff640 10 client.4453.objecter ms_dispatch2 0x7f9940000b90 command_reply(tid 2: 0 ) 2026-02-17T11:10:35.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.310+0000 7f991bfff640 10 client.4453.objecter _finish_command 2 = system:0 2026-02-17T11:10:35.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.310+0000 7f991bfff640 20 client.4453.objecter put_session s=0x7f9910080fb0 osd=12 4 2026-02-17T11:10:35.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.310+0000 7f991bfff640 15 client.4453.objecter _session_command_op_remove 12 2 2026-02-17T11:10:35.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.310+0000 7f9945a8f640 10 librados: watch_flush enter 2026-02-17T11:10:35.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.310+0000 7f9945a8f640 10 librados: watch_flush exit 2026-02-17T11:10:35.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.310+0000 7f9945a8f640 10 client.4453.objecter close_session for osd.12 2026-02-17T11:10:35.312 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.310+0000 7f9945a8f640 1 -- 10.20.193.49:0/3435546534 >> [v2:10.20.193.49:6812/4012737431,v1:10.20.193.49:6814/4012737431] conn(0x7f9910081680 msgr2=0x7f9910083ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.312 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.310+0000 7f9945a8f640 1 --2- 10.20.193.49:0/3435546534 >> [v2:10.20.193.49:6812/4012737431,v1:10.20.193.49:6814/4012737431] conn(0x7f9910081680 0x7f9910083ac0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.312 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.310+0000 7f9945a8f640 20 client.4453.objecter put_session s=0x7f9910080fb0 osd=12 1 2026-02-17T11:10:35.312 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.310+0000 7f9945a8f640 20 client.4453.objecter shutdown clearing up homeless session... 2026-02-17T11:10:35.312 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.310+0000 7f9945a8f640 10 client.4453.objecter successfully canceled tick 2026-02-17T11:10:35.314 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.313+0000 7f9945a8f640 1 -- 10.20.193.49:0/3435546534 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f9910079140 msgr2=0x7f991007b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.314 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.313+0000 7f9945a8f640 1 --2- 10.20.193.49:0/3435546534 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f9910079140 0x7f991007b600 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f992c006fd0 tx=0x7f992c008040 comp rx=0 tx=0).stop 2026-02-17T11:10:35.314 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.313+0000 7f9945a8f640 10 monclient: shutdown 2026-02-17T11:10:35.314 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.313+0000 7f9945a8f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:35.314 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.313+0000 7f9945a8f640 1 -- 10.20.193.49:0/3435546534 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f994014a4a0 msgr2=0x7f994014b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.314 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.313+0000 7f9945a8f640 1 --2- 10.20.193.49:0/3435546534 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f994014a4a0 0x7f994014b330 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f993000c420 tx=0x7f9930003180 comp rx=0 tx=0).stop 2026-02-17T11:10:35.314 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.313+0000 7f993ffff640 1 -- 10.20.193.49:0/3435546534 reap_dead start 2026-02-17T11:10:35.314 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.313+0000 7f9945a8f640 1 -- 10.20.193.49:0/3435546534 shutdown_connections 2026-02-17T11:10:35.314 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.313+0000 7f9945a8f640 1 -- 10.20.193.49:0/3435546534 >> 10.20.193.49:0/3435546534 conn(0x7f9940073030 msgr2=0x7f99401533e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:35.314 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.313+0000 7f9945a8f640 1 -- 10.20.193.49:0/3435546534 shutdown_connections 2026-02-17T11:10:35.314 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.313+0000 7f9945a8f640 1 -- 10.20.193.49:0/3435546534 wait complete. 2026-02-17T11:10:35.314 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.313+0000 7f9945a8f640 1 librados: shutdown 2026-02-17T11:10:35.316 INFO:teuthology.orchestra.run.trial049.stdout:90194313222 2026-02-17T11:10:35.316 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-17T11:10:35.324 INFO:teuthology.orchestra.run.trial049.stdout:111669149702 2026-02-17T11:10:35.325 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.12 2026-02-17T11:10:35.343 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.341+0000 7f32b34e8640 10 monclient: get_monmap_and_config 2026-02-17T11:10:35.343 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.341+0000 7f32b34e8640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.343 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.341+0000 7f32b34e8640 10 monclient: monmap: 2026-02-17T11:10:35.343 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.343 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.343 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:35.342298+0000 2026-02-17T11:10:35.343 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:35.342298+0000 2026-02-17T11:10:35.343 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.343 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.343 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:35.343 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:35.343 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:35.343 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:35.343 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:35.343 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:35.343 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.344 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.342+0000 7f32b34e8640 1 Processor -- start 2026-02-17T11:10:35.344 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.342+0000 7f32b34e8640 1 -- start start 2026-02-17T11:10:35.344 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.342+0000 7f32b34e8640 10 monclient: init 2026-02-17T11:10:35.344 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.342+0000 7f32b34e8640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.344 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.342+0000 7f32b34e8640 10 monclient: _add_conns ranks=[0,3,5,4,1,2] 2026-02-17T11:10:35.344 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.342+0000 7f32b34e8640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f32ac0686b0 addr v1:10.20.193.49:6789/0 2026-02-17T11:10:35.344 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.342+0000 7f32b34e8640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f32ac06f700 0x7f32ac068a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.344 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.342+0000 7f32b34e8640 10 monclient(hunting): picked mon.noname-a con 0x7f32ac06f700 addr v2:10.20.193.49:3300/0 2026-02-17T11:10:35.344 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.342+0000 7f32b34e8640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f32ac15be30 0x7f32ac155ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.345 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.342+0000 7f32b34e8640 10 monclient(hunting): picked mon.noname-c con 0x7f32ac15be30 addr v2:10.20.193.157:3300/0 2026-02-17T11:10:35.345 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.342+0000 7f32b34e8640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32ac15cd30 con 0x7f32ac0686b0 2026-02-17T11:10:35.345 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.342+0000 7f32b34e8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.345 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.342+0000 7f32b34e8640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f32ac15c490 con 0x7f32ac06f700 2026-02-17T11:10:35.345 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.342+0000 7f32b34e8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.345 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.342+0000 7f32b34e8640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f32ac15c770 con 0x7f32ac15be30 2026-02-17T11:10:35.345 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.342+0000 7f32b34e8640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.345 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.342+0000 7f32b34e8640 10 monclient(hunting): authenticate will time out at 1112.005923s 2026-02-17T11:10:35.345 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.343+0000 7f20eeee8640 10 monclient: get_monmap_and_config 2026-02-17T11:10:35.345 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.343+0000 7f20eeee8640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.345 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.343+0000 7f20eeee8640 10 monclient: monmap: 2026-02-17T11:10:35.345 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.345 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.345 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:35.343857+0000 2026-02-17T11:10:35.345 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:35.343857+0000 2026-02-17T11:10:35.345 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.345 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.345 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:35.345 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:35.345 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:35.345 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:35.345 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:35.345 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:35.345 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.345 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.343+0000 7f32b1a5e640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f32ac15be30 0x7f32ac155ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.343+0000 7f20eeee8640 1 Processor -- start 2026-02-17T11:10:35.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.343+0000 7f20eeee8640 1 -- start start 2026-02-17T11:10:35.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.343+0000 7f20eeee8640 10 monclient: init 2026-02-17T11:10:35.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.344+0000 7f20eeee8640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.344+0000 7f20eeee8640 10 monclient: _add_conns ranks=[4,1,3,2,0,5] 2026-02-17T11:10:35.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.344+0000 7f20eeee8640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f20e81561c0 0x7f20e80cb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.344+0000 7f20eeee8640 10 monclient(hunting): picked mon.noname-b con 0x7f20e81561c0 addr v2:10.20.193.97:3300/0 2026-02-17T11:10:35.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.344+0000 7f20eeee8640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f20e806e5b0 addr v1:10.20.193.97:6789/0 2026-02-17T11:10:35.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.344+0000 7f20eeee8640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f20e815f4f0 0x7f20e815f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.344+0000 7f20eeee8640 10 monclient(hunting): picked mon.noname-a con 0x7f20e815f4f0 addr v2:10.20.193.49:3300/0 2026-02-17T11:10:35.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.344+0000 7f20eeee8640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20e80cee70 con 0x7f20e806e5b0 2026-02-17T11:10:35.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.344+0000 7f20eeee8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.344+0000 7f20eeee8640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f20e80c8db0 con 0x7f20e815f4f0 2026-02-17T11:10:35.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.344+0000 7f20eeee8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.344+0000 7f20eeee8640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f20e80c9650 con 0x7f20e81561c0 2026-02-17T11:10:35.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.344+0000 7f20eeee8640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.344+0000 7f20eeee8640 10 monclient(hunting): authenticate will time out at 1112.007647s 2026-02-17T11:10:35.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.343+0000 7f32b1a5e640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f32ac15be30 0x7f32ac155ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:55928/0 (socket says 10.20.193.49:55928) 2026-02-17T11:10:35.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.343+0000 7f32b1a5e640 1 -- 10.20.193.49:0/2044610650 learned_addr learned my addr 10.20.193.49:0/2044610650 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:35.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.343+0000 7f32b1a5e640 10 monclient(hunting): get_auth_request con 0x7f32ac15be30 auth_method 0 2026-02-17T11:10:35.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.343+0000 7f32b1a5e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.343+0000 7f32b1a5e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.343+0000 7f32b1a5e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.343+0000 7f32b0a5c640 1 --2- 10.20.193.49:0/2044610650 >> v2:10.20.193.49:3300/0 conn(0x7f32ac06f700 0x7f32ac068a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.344+0000 7f32b1a5e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.344+0000 7f32b1a5e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.344+0000 7f32b1a5e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.344+0000 7f32b0a5c640 10 monclient(hunting): get_auth_request con 0x7f32ac06f700 auth_method 0 2026-02-17T11:10:35.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.344+0000 7f32b0a5c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.344+0000 7f32b0a5c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.344+0000 7f32b0a5c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.345+0000 7f20dffff640 1 --1- >> v1:10.20.193.97:6789/0 conn(0x7f20e806e5b0 0x7f20e80c9ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.97:6789/0 says I am v1:10.20.193.49:51628/0 (socket says 10.20.193.49:51628) 2026-02-17T11:10:35.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.345+0000 7f20dffff640 1 -- 10.20.193.49:0/1982742037 learned_addr learned my addr 10.20.193.49:0/1982742037 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:10:35.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.345+0000 7f32b0a5c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.345+0000 7f32b0a5c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.345+0000 7f32b0a5c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.345+0000 7f20ecc5d640 1 --2- 10.20.193.49:0/1982742037 >> v2:10.20.193.97:3300/0 conn(0x7f20e81561c0 0x7f20e80cb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.345+0000 7f32b1a5e640 10 monclient(hunting): handle_auth_done global_id 4460 payload 274 2026-02-17T11:10:35.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.345+0000 7f32b1a5e640 1 -- 10.20.193.49:0/2044610650 >> v2:10.20.193.49:3300/0 conn(0x7f32ac06f700 msgr2=0x7f32ac068a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:35.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.345+0000 7f32b1a5e640 1 --2- 10.20.193.49:0/2044610650 >> v2:10.20.193.49:3300/0 conn(0x7f32ac06f700 0x7f32ac068a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.345+0000 7f32b1a5e640 1 -- 10.20.193.49:0/2044610650 >> v1:10.20.193.49:6789/0 conn(0x7f32ac0686b0 legacy=0x7f32ac06eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.345+0000 7f32b1a5e640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.345+0000 7f32b1a5e640 1 monclient: found mon.noname-c 2026-02-17T11:10:35.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.345+0000 7f32b1a5e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.345+0000 7f32b1a5e640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:10:35.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.345+0000 7f32b1a5e640 1 -- 10.20.193.49:0/2044610650 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32ac15ca50 con 0x7f32ac15be30 2026-02-17T11:10:35.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.346+0000 7f20ecc5d640 10 monclient(hunting): get_auth_request con 0x7f20e81561c0 auth_method 0 2026-02-17T11:10:35.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.346+0000 7f20ecc5d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.346+0000 7f20ecc5d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.346+0000 7f20ecc5d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.348 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.347+0000 7f32b1a5e640 1 --2- 10.20.193.49:0/2044610650 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f32ac15be30 0x7f32ac155ae0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f32ac0cab90 tx=0x7f32a802f270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf760e4841720c0a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.348 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.347+0000 7f20df7fe640 1 -- 10.20.193.49:0/1982742037 <== mon.1 v1:10.20.193.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2656704877 0 0) 0x7f20e80cee70 con 0x7f20e806e5b0 2026-02-17T11:10:35.348 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.347+0000 7f20df7fe640 10 monclient(hunting): _negotiate 2026-02-17T11:10:35.348 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.347+0000 7f20df7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.348 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.347+0000 7f20df7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.348 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.347+0000 7f20df7fe640 10 monclient(hunting): my global_id is 4465 2026-02-17T11:10:35.348 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.347+0000 7f20df7fe640 1 -- 10.20.193.49:0/1982742037 --> v1:10.20.193.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20d4003620 con 0x7f20e806e5b0 2026-02-17T11:10:35.348 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.347+0000 7f20ecc5d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.348 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.347+0000 7f20ecc5d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.348 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.347+0000 7f20ecc5d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.349 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.348+0000 7f20ecc5d640 10 monclient(hunting): handle_auth_done global_id 4468 payload 274 2026-02-17T11:10:35.349 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.348+0000 7f20ecc5d640 1 -- 10.20.193.49:0/1982742037 >> v2:10.20.193.49:3300/0 conn(0x7f20e815f4f0 msgr2=0x7f20e815f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:35.349 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.348+0000 7f20ecc5d640 1 --2- 10.20.193.49:0/1982742037 >> v2:10.20.193.49:3300/0 conn(0x7f20e815f4f0 0x7f20e815f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.349 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.348+0000 7f20ecc5d640 1 -- 10.20.193.49:0/1982742037 >> v1:10.20.193.97:6789/0 conn(0x7f20e806e5b0 legacy=0x7f20e80c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.349 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.348+0000 7f20ecc5d640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.349 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.348+0000 7f20ecc5d640 1 monclient: found mon.noname-b 2026-02-17T11:10:35.349 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.348+0000 7f20ecc5d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.349 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.348+0000 7f20ecc5d640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.349 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.348+0000 7f20ecc5d640 1 -- 10.20.193.49:0/1982742037 --> v2:10.20.193.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20e80cbce0 con 0x7f20e81561c0 2026-02-17T11:10:35.349 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.348+0000 7f99bf37e640 10 monclient: get_monmap_and_config 2026-02-17T11:10:35.349 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.348+0000 7f99bf37e640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.349 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.348+0000 7f99bf37e640 10 monclient: monmap: 2026-02-17T11:10:35.349 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.349 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.349 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:35.348827+0000 2026-02-17T11:10:35.349 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:35.348827+0000 2026-02-17T11:10:35.349 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.349 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.349 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:35.350 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:35.350 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:35.350 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:35.350 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:35.350 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:35.350 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.350 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.348+0000 7f9037298640 10 monclient: get_monmap_and_config 2026-02-17T11:10:35.350 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.348+0000 7f9037298640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.350 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.348+0000 7f9037298640 10 monclient: monmap: 2026-02-17T11:10:35.350 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.350 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.350 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:35.349104+0000 2026-02-17T11:10:35.350 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:35.349104+0000 2026-02-17T11:10:35.350 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.350 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.350 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:35.350 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:35.350 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:35.350 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:35.350 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:35.350 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:35.350 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.350 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.348+0000 7f99bf37e640 1 Processor -- start 2026-02-17T11:10:35.350 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.348+0000 7f329bfff640 1 -- 10.20.193.49:0/2044610650 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a802fd70 con 0x7f32ac15be30 2026-02-17T11:10:35.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.348+0000 7f329bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.348+0000 7f329bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:10:35.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.349+0000 7f329bfff640 10 monclient: dump: 2026-02-17T11:10:35.351 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.351 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.351 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.351 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.351 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.351 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.351 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.351 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.351 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.351 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.349+0000 7f329bfff640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.349+0000 7f329bfff640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.349+0000 7f329bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.349+0000 7f329bfff640 1 -- 10.20.193.49:0/2044610650 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32a80373f0 con 0x7f32ac15be30 2026-02-17T11:10:35.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.349+0000 7f329bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.349+0000 7f329bfff640 1 -- 10.20.193.49:0/2044610650 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a80377c0 con 0x7f32ac15be30 2026-02-17T11:10:35.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.349+0000 7f329bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.349+0000 7f329bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:10:35.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.349+0000 7f329bfff640 10 monclient: dump: 2026-02-17T11:10:35.351 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.351 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.351 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.351 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.351 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.351 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.351 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.351 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.351 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.351 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.349+0000 7f32b34e8640 5 monclient: authenticate success, global_id 4460 2026-02-17T11:10:35.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.349+0000 7f32b34e8640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:35.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.349+0000 7f32b34e8640 4 set_mon_vals no callback set 2026-02-17T11:10:35.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.349+0000 7f99bf37e640 1 -- start start 2026-02-17T11:10:35.352 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.349+0000 7f99bf37e640 10 monclient: init 2026-02-17T11:10:35.352 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.349+0000 7f9037298640 1 Processor -- start 2026-02-17T11:10:35.352 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.349+0000 7f9037298640 1 -- start start 2026-02-17T11:10:35.352 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.349+0000 7f9037298640 10 monclient: init 2026-02-17T11:10:35.352 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.349+0000 7fe1e1951640 10 monclient: get_monmap_and_config 2026-02-17T11:10:35.352 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.349+0000 7fe1e1951640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.352 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.349+0000 7fe1e1951640 10 monclient: monmap: 2026-02-17T11:10:35.352 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.352 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.352 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:35.349944+0000 2026-02-17T11:10:35.352 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:35.349944+0000 2026-02-17T11:10:35.352 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.352 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.352 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:35.352 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:35.352 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:35.352 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:35.352 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:35.352 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:35.352 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.352 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.349+0000 7f32b34e8640 10 monclient: shutdown 2026-02-17T11:10:35.352 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.349+0000 7f32b34e8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:35.352 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.349+0000 7f32b34e8640 1 -- 10.20.193.49:0/2044610650 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f32ac15be30 msgr2=0x7f32ac155ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.352 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.349+0000 7f32b34e8640 1 --2- 10.20.193.49:0/2044610650 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f32ac15be30 0x7f32ac155ae0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f32ac0cab90 tx=0x7f32a802f270 comp rx=0 tx=0).stop 2026-02-17T11:10:35.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.349+0000 7f99bf37e640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.349+0000 7f99bf37e640 10 monclient: _add_conns ranks=[3,4,5,2,1,0] 2026-02-17T11:10:35.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.349+0000 7f99bf37e640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f99b80d1b60 0x7f99b80d1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.349+0000 7f99bf37e640 10 monclient(hunting): picked mon.noname-a con 0x7f99b80d1b60 addr v2:10.20.193.49:3300/0 2026-02-17T11:10:35.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.349+0000 7f99bf37e640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f99b815c840 0x7f99b80c8d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.349+0000 7f32b34e8640 1 -- 10.20.193.49:0/2044610650 shutdown_connections 2026-02-17T11:10:35.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.349+0000 7f32b34e8640 1 --2- 10.20.193.49:0/2044610650 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f32ac15be30 0x7f32ac155ae0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.349+0000 7f32b34e8640 1 --2- 10.20.193.49:0/2044610650 >> v2:10.20.193.49:3300/0 conn(0x7f32ac06f700 0x7f32ac068a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.349+0000 7f32b34e8640 1 -- 10.20.193.49:0/2044610650 >> 10.20.193.49:0/2044610650 conn(0x7f32ac0cb3a0 msgr2=0x7f32ac0cb7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:35.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.349+0000 7f99bf37e640 10 monclient(hunting): picked mon.noname-b con 0x7f99b815c840 addr v2:10.20.193.97:3300/0 2026-02-17T11:10:35.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.349+0000 7f99bf37e640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f99b80c92a0 0x7f99b815d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.349+0000 7f32b34e8640 1 -- 10.20.193.49:0/2044610650 shutdown_connections 2026-02-17T11:10:35.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.349+0000 7f99bf37e640 10 monclient(hunting): picked mon.noname-c con 0x7f99b80c92a0 addr v2:10.20.193.157:3300/0 2026-02-17T11:10:35.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.349+0000 7f99bf37e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.349+0000 7f99bf37e640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f99b80ca460 con 0x7f99b80d1b60 2026-02-17T11:10:35.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.349+0000 7f99bf37e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.349+0000 7f99bf37e640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f99b815d4c0 con 0x7f99b815c840 2026-02-17T11:10:35.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.349+0000 7f99bf37e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.349+0000 7f99bf37e640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f99b80c98e0 con 0x7f99b80c92a0 2026-02-17T11:10:35.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.349+0000 7f99bf37e640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.349+0000 7f99bf37e640 10 monclient(hunting): authenticate will time out at 1112.012982s 2026-02-17T11:10:35.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.350+0000 7f32b34e8640 1 -- 10.20.193.49:0/2044610650 wait complete. 2026-02-17T11:10:35.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.350+0000 7f9037298640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.350+0000 7f9037298640 10 monclient: _add_conns ranks=[1,4,5,2,0,3] 2026-02-17T11:10:35.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.350+0000 7f9037298640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f9030155d20 addr v1:10.20.193.97:6789/0 2026-02-17T11:10:35.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.350+0000 7f9037298640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f903015c840 0x7f9030156100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.350+0000 7f9037298640 10 monclient(hunting): picked mon.noname-b con 0x7f903015c840 addr v2:10.20.193.97:3300/0 2026-02-17T11:10:35.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.350+0000 7f9037298640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f903015dc50 0x7f90300cafd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.350+0000 7f9037298640 10 monclient(hunting): picked mon.noname-c con 0x7f903015dc50 addr v2:10.20.193.157:3300/0 2026-02-17T11:10:35.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.350+0000 7f9037298640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f903015cd10 con 0x7f9030155d20 2026-02-17T11:10:35.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.350+0000 7f9037298640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.350+0000 7f9037298640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f903006f790 con 0x7f903015c840 2026-02-17T11:10:35.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.350+0000 7f9037298640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.350+0000 7f9037298640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f903006fa70 con 0x7f903015dc50 2026-02-17T11:10:35.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.350+0000 7f9037298640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.350+0000 7f9037298640 10 monclient(hunting): authenticate will time out at 1112.013237s 2026-02-17T11:10:35.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.350+0000 7f99bd0f3640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f99b80d1b60 0x7f99b80d1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.350+0000 7fe1e1951640 1 Processor -- start 2026-02-17T11:10:35.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.350+0000 7fe1e1951640 1 -- start start 2026-02-17T11:10:35.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.350+0000 7fe1e1951640 10 monclient: init 2026-02-17T11:10:35.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.350+0000 7f99bd8f4640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f99b80c92a0 0x7f99b815d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.355 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.350+0000 7f32b34e8640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.355 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.350+0000 7f32b34e8640 10 monclient: monmap: 2026-02-17T11:10:35.355 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.355 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:35.355 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:35.355 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:35.355 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.355 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.355 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:35.355 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:35.355 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:35.355 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.355 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.350+0000 7f903580e640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f903015dc50 0x7f90300cafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.355 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.350+0000 7f99bd8f4640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f99b80c92a0 0x7f99b815d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:55938/0 (socket says 10.20.193.49:55938) 2026-02-17T11:10:35.355 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.350+0000 7f99bd8f4640 1 -- 10.20.193.49:0/1279945657 learned_addr learned my addr 10.20.193.49:0/1279945657 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:35.355 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.350+0000 7f99bd8f4640 10 monclient(hunting): get_auth_request con 0x7f99b80c92a0 auth_method 0 2026-02-17T11:10:35.355 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.350+0000 7f99bd8f4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.355 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.350+0000 7f99bd8f4640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.355 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.350+0000 7f99bd8f4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.355 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.350+0000 7f32b34e8640 1 librados: starting msgr at 2026-02-17T11:10:35.355 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.350+0000 7f32b34e8640 1 librados: starting objecter 2026-02-17T11:10:35.355 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.351+0000 7f20ecc5d640 1 --2- 10.20.193.49:0/1982742037 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f20e81561c0 0x7f20e80cb7a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f20e80c5420 tx=0x7f20d802ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5d59caf7ef074a6 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.351+0000 7f903580e640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f903015dc50 0x7f90300cafd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:55940/0 (socket says 10.20.193.49:55940) 2026-02-17T11:10:35.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.351+0000 7f903580e640 1 -- 10.20.193.49:0/2308465620 learned_addr learned my addr 10.20.193.49:0/2308465620 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:35.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.351+0000 7f903580e640 10 monclient(hunting): get_auth_request con 0x7f903015dc50 auth_method 0 2026-02-17T11:10:35.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.351+0000 7f903580e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.351+0000 7f903580e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.351+0000 7f903580e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.351+0000 7f32b34e8640 1 Processor -- start 2026-02-17T11:10:35.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.351+0000 7f32b34e8640 1 -- start start 2026-02-17T11:10:35.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.351+0000 7f32b34e8640 1 librados: setting wanted keys 2026-02-17T11:10:35.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.351+0000 7f32b34e8640 1 librados: calling monclient init 2026-02-17T11:10:35.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.351+0000 7f32b34e8640 10 monclient: init 2026-02-17T11:10:35.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.351+0000 7fe1e1951640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.351+0000 7fe1e1951640 10 monclient: _add_conns ranks=[2,0,5,1,3,4] 2026-02-17T11:10:35.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.351+0000 7fe1e1951640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fe1dc0d1b60 addr v1:10.20.193.157:6789/0 2026-02-17T11:10:35.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.351+0000 7f99bd8f4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.351+0000 7f99bd8f4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.351+0000 7f99bd8f4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.351+0000 7fe1e1951640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe1dc0d1f40 addr v1:10.20.193.49:6789/0 2026-02-17T11:10:35.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.351+0000 7fe1e1951640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7fe1dc15e060 0x7fe1dc15c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.351+0000 7fe1e1951640 10 monclient(hunting): picked mon.noname-c con 0x7fe1dc15e060 addr v2:10.20.193.157:3300/0 2026-02-17T11:10:35.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.351+0000 7fe1e1951640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1dc0c98e0 con 0x7fe1dc0d1f40 2026-02-17T11:10:35.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.351+0000 7fe1e1951640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1dc0c9bc0 con 0x7fe1dc0d1b60 2026-02-17T11:10:35.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.351+0000 7fe1e1951640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.351+0000 7fe1e1951640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7fe1dc15cd80 con 0x7fe1dc15e060 2026-02-17T11:10:35.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.351+0000 7fe1e1951640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.351+0000 7fe1e1951640 10 monclient(hunting): authenticate will time out at 1112.014502s 2026-02-17T11:10:35.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.351+0000 7f903580e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.351+0000 7f903580e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.351+0000 7f903580e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.351+0000 7f32b34e8640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.351+0000 7f32b34e8640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:10:35.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.351+0000 7f32b34e8640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f32ac0686b0 0x7f32ac1f4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.351+0000 7f32b34e8640 10 monclient(hunting): picked mon.noname-a con 0x7f32ac0686b0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:35.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.351+0000 7f32b34e8640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f32ac06f700 0x7f32ac147be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.351+0000 7f32b34e8640 10 monclient(hunting): picked mon.noname-b con 0x7f32ac06f700 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:35.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.351+0000 7f32b34e8640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f32ac15be30 0x7f32ac0c70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.351+0000 7f32b34e8640 10 monclient(hunting): picked mon.noname-c con 0x7f32ac15be30 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:35.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.351+0000 7f32b34e8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.351+0000 7f32b34e8640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f32ac156020 con 0x7f32ac0686b0 2026-02-17T11:10:35.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.351+0000 7f32b34e8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.351+0000 7f32b34e8640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f32ac06ead0 con 0x7f32ac06f700 2026-02-17T11:10:35.358 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.351+0000 7f32b34e8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.358 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.351+0000 7f32b34e8640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f32ac1561a0 con 0x7f32ac15be30 2026-02-17T11:10:35.358 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.351+0000 7f32b34e8640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.358 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.351+0000 7f32b34e8640 10 monclient(hunting): authenticate will time out at 1112.014736s 2026-02-17T11:10:35.358 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.352+0000 7f99bd0f3640 10 monclient(hunting): get_auth_request con 0x7f99b80d1b60 auth_method 0 2026-02-17T11:10:35.358 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.352+0000 7f99bd0f3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.358 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.352+0000 7f99bd0f3640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.358 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.352+0000 7f99bd0f3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.358 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.352+0000 7f99bd0f3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.358 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.352+0000 7f99bd0f3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.358 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.352+0000 7f99bd0f3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.358 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.352+0000 7f99bd8f4640 10 monclient(hunting): handle_auth_done global_id 4463 payload 274 2026-02-17T11:10:35.358 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.352+0000 7f99bd8f4640 1 -- 10.20.193.49:0/1279945657 >> v2:10.20.193.97:3300/0 conn(0x7f99b815c840 msgr2=0x7f99b80c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:35.358 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.352+0000 7f99bd8f4640 1 --2- 10.20.193.49:0/1279945657 >> v2:10.20.193.97:3300/0 conn(0x7f99b815c840 0x7f99b80c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.358 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.352+0000 7f99bd8f4640 1 -- 10.20.193.49:0/1279945657 >> v2:10.20.193.49:3300/0 conn(0x7f99b80d1b60 msgr2=0x7f99b80d1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:35.358 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.352+0000 7f99bd8f4640 1 --2- 10.20.193.49:0/1279945657 >> v2:10.20.193.49:3300/0 conn(0x7f99b80d1b60 0x7f99b80d1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.358 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.352+0000 7f99bd8f4640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.358 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.352+0000 7f99bd8f4640 1 monclient: found mon.noname-c 2026-02-17T11:10:35.358 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.352+0000 7f99bd8f4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.358 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.352+0000 7f99bd8f4640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:10:35.358 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.352+0000 7f99bd8f4640 1 -- 10.20.193.49:0/1279945657 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99b80c9bc0 con 0x7f99b80c92a0 2026-02-17T11:10:35.359 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.353+0000 7f903580e640 10 monclient(hunting): handle_auth_done global_id 4466 payload 274 2026-02-17T11:10:35.359 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.353+0000 7f903580e640 1 -- 10.20.193.49:0/2308465620 >> v2:10.20.193.97:3300/0 conn(0x7f903015c840 msgr2=0x7f9030156100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:35.359 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.353+0000 7f903580e640 1 --2- 10.20.193.49:0/2308465620 >> v2:10.20.193.97:3300/0 conn(0x7f903015c840 0x7f9030156100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.359 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.353+0000 7f903580e640 1 -- 10.20.193.49:0/2308465620 >> v1:10.20.193.97:6789/0 conn(0x7f9030155d20 legacy=0x7f903015d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:35.359 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.353+0000 7f903580e640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.359 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.353+0000 7f903580e640 1 monclient: found mon.noname-c 2026-02-17T11:10:35.359 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.353+0000 7f903580e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.359 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.353+0000 7f903580e640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:10:35.359 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.353+0000 7f903580e640 1 -- 10.20.193.49:0/2308465620 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f903006fd50 con 0x7f903015dc50 2026-02-17T11:10:35.359 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.354+0000 7f20df7fe640 1 -- 10.20.193.49:0/1982742037 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d803c070 con 0x7f20e81561c0 2026-02-17T11:10:35.359 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.354+0000 7f20df7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.359 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.354+0000 7f20df7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:10:35.359 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.354+0000 7f20df7fe640 10 monclient: dump: 2026-02-17T11:10:35.359 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.359 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.359 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.359 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.359 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.359 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.359 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.359 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.359 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.359 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.359 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.354+0000 7f20df7fe640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.359 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.354+0000 7f20df7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.359 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.354+0000 7f20df7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.359 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.354+0000 7f20df7fe640 1 -- 10.20.193.49:0/1982742037 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20d802fb80 con 0x7f20e81561c0 2026-02-17T11:10:35.359 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.354+0000 7f20df7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.359 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.354+0000 7f20df7fe640 1 -- 10.20.193.49:0/1982742037 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d8037440 con 0x7f20e81561c0 2026-02-17T11:10:35.359 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.354+0000 7f20df7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.359 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.354+0000 7f20df7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:35.359 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.354+0000 7f20df7fe640 10 monclient: dump: 2026-02-17T11:10:35.359 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.359 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.359 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.360 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.360 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.360 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.360 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.360 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.360 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.360 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.360 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.354+0000 7fe1da7fc640 1 --1- >> v1:10.20.193.49:6789/0 conn(0x7fe1dc0d1f40 0x7fe1dc15d950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.49:6789/0 says I am v1:10.20.193.49:50512/0 (socket says 10.20.193.49:50512) 2026-02-17T11:10:35.360 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.354+0000 7f20eeee8640 5 monclient: authenticate success, global_id 4468 2026-02-17T11:10:35.360 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.354+0000 7f20eeee8640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:35.360 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.354+0000 7f20eeee8640 4 set_mon_vals no callback set 2026-02-17T11:10:35.360 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.354+0000 7fe1da7fc640 1 -- 10.20.193.49:0/690046343 learned_addr learned my addr 10.20.193.49:0/690046343 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:10:35.360 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.354+0000 7f99bd8f4640 1 --2- 10.20.193.49:0/1279945657 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f99b80c92a0 0x7f99b815d950 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f99b808fc80 tx=0x7f99b402f270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f6ced4432e7b9b9 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.360 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.354+0000 7f32b0a5c640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f32ac06f700 0x7f32ac147be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.360 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.354+0000 7fe1db7fe640 1 --2- 10.20.193.49:0/690046343 >> v2:10.20.193.157:3300/0 conn(0x7fe1dc15e060 0x7fe1dc15c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.360 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.354+0000 7fe1db7fe640 10 monclient(hunting): get_auth_request con 0x7fe1dc15e060 auth_method 0 2026-02-17T11:10:35.360 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.354+0000 7fe1db7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.360 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.354+0000 7fe1db7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.360 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.354+0000 7fe1db7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.361 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.354+0000 7f20eeee8640 10 monclient: shutdown 2026-02-17T11:10:35.361 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.354+0000 7f20eeee8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:35.361 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.354+0000 7f20eeee8640 1 -- 10.20.193.49:0/1982742037 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f20e81561c0 msgr2=0x7f20e80cb7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.361 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.354+0000 7f20eeee8640 1 --2- 10.20.193.49:0/1982742037 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f20e81561c0 0x7f20e80cb7a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f20e80c5420 tx=0x7f20d802ee70 comp rx=0 tx=0).stop 2026-02-17T11:10:35.361 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.354+0000 7f32b0a5c640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f32ac06f700 0x7f32ac147be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:48218/0 (socket says 10.20.193.49:48218) 2026-02-17T11:10:35.361 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.354+0000 7f32b0a5c640 1 -- 10.20.193.49:0/3484434986 learned_addr learned my addr 10.20.193.49:0/3484434986 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:35.361 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.354+0000 7f32b0a5c640 10 monclient(hunting): get_auth_request con 0x7f32ac06f700 auth_method 0 2026-02-17T11:10:35.361 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.354+0000 7f32b0a5c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.361 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.354+0000 7f32b0a5c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.361 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.354+0000 7f32b0a5c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.361 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.355+0000 7f20eeee8640 1 -- 10.20.193.49:0/1982742037 shutdown_connections 2026-02-17T11:10:35.361 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.355+0000 7f20eeee8640 1 --2- 10.20.193.49:0/1982742037 >> v2:10.20.193.49:3300/0 conn(0x7f20e815f4f0 0x7f20e815f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.361 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.355+0000 7f20eeee8640 1 --2- 10.20.193.49:0/1982742037 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f20e81561c0 0x7f20e80cb7a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.361 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.355+0000 7f20eeee8640 1 -- 10.20.193.49:0/1982742037 >> 10.20.193.49:0/1982742037 conn(0x7f20e806da90 msgr2=0x7f20e806dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:35.361 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.355+0000 7f20eeee8640 1 -- 10.20.193.49:0/1982742037 shutdown_connections 2026-02-17T11:10:35.361 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.355+0000 7f20eeee8640 1 -- 10.20.193.49:0/1982742037 wait complete. 2026-02-17T11:10:35.361 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.355+0000 7fe1db7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.361 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.355+0000 7fe1db7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.361 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.355+0000 7fe1db7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.362 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.356+0000 7f20eeee8640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.362 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.356+0000 7f20eeee8640 10 monclient: monmap: 2026-02-17T11:10:35.362 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.362 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:35.362 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:35.362 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:35.362 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.362 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.362 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:35.362 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:35.362 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:35.362 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.362 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.356+0000 7f20eeee8640 1 librados: starting msgr at 2026-02-17T11:10:35.362 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.356+0000 7f20eeee8640 1 librados: starting objecter 2026-02-17T11:10:35.362 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.356+0000 7f20eeee8640 1 Processor -- start 2026-02-17T11:10:35.362 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.356+0000 7f20eeee8640 1 -- start start 2026-02-17T11:10:35.362 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.356+0000 7f20eeee8640 1 librados: setting wanted keys 2026-02-17T11:10:35.362 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.356+0000 7f20eeee8640 1 librados: calling monclient init 2026-02-17T11:10:35.362 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.356+0000 7f32b0a5c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.362 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.356+0000 7f32b0a5c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.362 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.356+0000 7f32b0a5c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.362 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.356+0000 7f20eeee8640 10 monclient: init 2026-02-17T11:10:35.362 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.356+0000 7f32b125d640 1 --2- 10.20.193.49:0/3484434986 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f32ac0686b0 0x7f32ac1f4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.362 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.357+0000 7f903580e640 1 --2- 10.20.193.49:0/2308465620 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f903015dc50 0x7f90300cafd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f903015cc20 tx=0x7f902c02f230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=933cd61eb129e2e3 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.357+0000 7f20eeee8640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.357+0000 7f20eeee8640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:10:35.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.357+0000 7f20eeee8640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f20e806e5b0 0x7f20e81f7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.357+0000 7f20eeee8640 10 monclient(hunting): picked mon.noname-b con 0x7f20e806e5b0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:35.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.357+0000 7f20eeee8640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f20e81561c0 0x7f20e81f6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.357+0000 7f20eeee8640 10 monclient(hunting): picked mon.noname-c con 0x7f20e81561c0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:35.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.357+0000 7f20eeee8640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f20e815f4f0 0x7f20e81f6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.357+0000 7f20eeee8640 10 monclient(hunting): picked mon.noname-a con 0x7f20e815f4f0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:35.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.357+0000 7f20eeee8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.357+0000 7f20eeee8640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f20e80c92e0 con 0x7f20e815f4f0 2026-02-17T11:10:35.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.357+0000 7f20eeee8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.357+0000 7f20eeee8640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f20e80c9000 con 0x7f20e806e5b0 2026-02-17T11:10:35.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.357+0000 7f20eeee8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.357+0000 7f20eeee8640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f20e81565a0 con 0x7f20e81561c0 2026-02-17T11:10:35.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.357+0000 7f20eeee8640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.357+0000 7f20eeee8640 10 monclient(hunting): authenticate will time out at 1112.020527s 2026-02-17T11:10:35.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.358+0000 7fe1db7fe640 10 monclient(hunting): handle_auth_done global_id 4469 payload 274 2026-02-17T11:10:35.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.358+0000 7fe1db7fe640 1 -- 10.20.193.49:0/690046343 >> v1:10.20.193.157:6789/0 conn(0x7fe1dc0d1b60 legacy=0x7fe1dc0c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:35.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.358+0000 7fe1db7fe640 1 -- 10.20.193.49:0/690046343 >> v1:10.20.193.49:6789/0 conn(0x7fe1dc0d1f40 legacy=0x7fe1dc15d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.358+0000 7fe1db7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.358+0000 7fe1db7fe640 1 monclient: found mon.noname-c 2026-02-17T11:10:35.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.358+0000 7fe1db7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.358+0000 7fe1db7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:10:35.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.358+0000 7fe1db7fe640 1 -- 10.20.193.49:0/690046343 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1dc0c9ea0 con 0x7fe1dc15e060 2026-02-17T11:10:35.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.358+0000 7f32b0a5c640 10 monclient(hunting): handle_auth_done global_id 4471 payload 824 2026-02-17T11:10:35.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.358+0000 7f32b0a5c640 1 -- 10.20.193.49:0/3484434986 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f32ac15be30 msgr2=0x7f32ac0c70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.358+0000 7f32b0a5c640 1 --2- 10.20.193.49:0/3484434986 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f32ac15be30 0x7f32ac0c70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.358+0000 7f32b0a5c640 1 -- 10.20.193.49:0/3484434986 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f32ac0686b0 msgr2=0x7f32ac1f4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.358+0000 7f32b0a5c640 1 --2- 10.20.193.49:0/3484434986 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f32ac0686b0 0x7f32ac1f4900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.364 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.358+0000 7f32b0a5c640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.364 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.358+0000 7f32b0a5c640 1 monclient: found mon.noname-b 2026-02-17T11:10:35.364 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.358+0000 7f32b0a5c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.364 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.358+0000 7f32b0a5c640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.364 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.358+0000 7f32b0a5c640 1 -- 10.20.193.49:0/3484434986 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32ac1f80e0 con 0x7f32ac06f700 2026-02-17T11:10:35.364 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.359+0000 7efc996b0640 10 monclient: get_monmap_and_config 2026-02-17T11:10:35.364 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.359+0000 7efc996b0640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.364 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.359+0000 7efc996b0640 10 monclient: monmap: 2026-02-17T11:10:35.364 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.364 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.364 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:35.359651+0000 2026-02-17T11:10:35.364 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:35.359651+0000 2026-02-17T11:10:35.364 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.364 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.364 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:35.364 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:35.364 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:35.364 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:35.364 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:35.364 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:35.364 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.364 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.359+0000 7f20ed45e640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f20e815f4f0 0x7f20e81f6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.364 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.359+0000 7f3f04ee2640 10 monclient: get_monmap_and_config 2026-02-17T11:10:35.364 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.359+0000 7f3f04ee2640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.364 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.359+0000 7f3f04ee2640 10 monclient: monmap: 2026-02-17T11:10:35.364 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.364 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.364 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:35.360168+0000 2026-02-17T11:10:35.365 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:35.360168+0000 2026-02-17T11:10:35.365 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.365 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.365 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:35.365 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:35.365 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:35.365 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:35.365 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:35.365 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:35.365 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.365 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.359+0000 7efc996b0640 1 Processor -- start 2026-02-17T11:10:35.365 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.359+0000 7efc996b0640 1 -- start start 2026-02-17T11:10:35.365 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.359+0000 7efc996b0640 10 monclient: init 2026-02-17T11:10:35.365 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.359+0000 7f20ecc5d640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f20e806e5b0 0x7f20e81f7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.365 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.360+0000 7f32b0a5c640 1 --2- 10.20.193.49:0/3484434986 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f32ac06f700 0x7f32ac147be0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f32a000ebe0 tx=0x7f32a000c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.365 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.360+0000 7f3299ffb640 10 client.?.objecter ms_handle_connect 0x7f32ac06f700 2026-02-17T11:10:35.365 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.360+0000 7f3299ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:35.365 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.360+0000 7f3f04ee2640 1 Processor -- start 2026-02-17T11:10:35.365 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.360+0000 7f3f04ee2640 1 -- start start 2026-02-17T11:10:35.365 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.360+0000 7f3f04ee2640 10 monclient: init 2026-02-17T11:10:35.366 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.360+0000 7efc996b0640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.366 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.360+0000 7efc996b0640 10 monclient: _add_conns ranks=[4,3,5,2,0,1] 2026-02-17T11:10:35.366 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.360+0000 7efc996b0640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7efc94155fb0 0x7efc940cd610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.366 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.360+0000 7f3f04ee2640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.366 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.360+0000 7f3f04ee2640 10 monclient: _add_conns ranks=[1,4,3,2,0,5] 2026-02-17T11:10:35.366 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.360+0000 7f3f04ee2640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f3f00152700 addr v1:10.20.193.97:6789/0 2026-02-17T11:10:35.366 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.360+0000 7f3f04ee2640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f3f0015ef80 0x7f3f000c9730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.366 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.360+0000 7f3f04ee2640 10 monclient(hunting): picked mon.noname-b con 0x7f3f0015ef80 addr v2:10.20.193.97:3300/0 2026-02-17T11:10:35.366 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.360+0000 7f3f04ee2640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f3f00152ae0 0x7f3f000c9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.366 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.360+0000 7f3f04ee2640 10 monclient(hunting): picked mon.noname-a con 0x7f3f00152ae0 addr v2:10.20.193.49:3300/0 2026-02-17T11:10:35.366 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.360+0000 7f3f04ee2640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f0015d4f0 con 0x7f3f00152700 2026-02-17T11:10:35.366 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.360+0000 7f3f04ee2640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.366 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.360+0000 7f3f04ee2640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f3f0015d7d0 con 0x7f3f00152ae0 2026-02-17T11:10:35.366 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.360+0000 7f3f04ee2640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.366 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.360+0000 7efc996b0640 10 monclient(hunting): picked mon.noname-b con 0x7efc94155fb0 addr v2:10.20.193.97:3300/0 2026-02-17T11:10:35.366 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.360+0000 7f3f04ee2640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f3f0015dab0 con 0x7f3f0015ef80 2026-02-17T11:10:35.366 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.360+0000 7f3f04ee2640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.366 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.360+0000 7f3f04ee2640 10 monclient(hunting): authenticate will time out at 1112.023825s 2026-02-17T11:10:35.366 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.360+0000 7efc996b0640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7efc940cdb50 0x7efc940ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.366 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.360+0000 7efc996b0640 10 monclient(hunting): picked mon.noname-a con 0x7efc940cdb50 addr v2:10.20.193.49:3300/0 2026-02-17T11:10:35.367 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.360+0000 7efc996b0640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7efc9406e5b0 0x7efc940ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.367 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.360+0000 7efc996b0640 10 monclient(hunting): picked mon.noname-c con 0x7efc9406e5b0 addr v2:10.20.193.157:3300/0 2026-02-17T11:10:35.367 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.360+0000 7efc996b0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.367 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.360+0000 7efc996b0640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7efc940cb950 con 0x7efc940cdb50 2026-02-17T11:10:35.367 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.360+0000 7efc996b0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.367 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.360+0000 7efc996b0640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7efc940cbc30 con 0x7efc94155fb0 2026-02-17T11:10:35.367 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.360+0000 7efc996b0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.367 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.360+0000 7efc996b0640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7efc940ccd60 con 0x7efc9406e5b0 2026-02-17T11:10:35.367 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.360+0000 7efc996b0640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.367 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.360+0000 7efc996b0640 10 monclient(hunting): authenticate will time out at 1112.023797s 2026-02-17T11:10:35.367 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.360+0000 7f20ed45e640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f20e815f4f0 0x7f20e81f6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:33034/0 (socket says 10.20.193.49:33034) 2026-02-17T11:10:35.367 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.360+0000 7f20ed45e640 1 -- 10.20.193.49:0/3023193637 learned_addr learned my addr 10.20.193.49:0/3023193637 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:35.367 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.360+0000 7f20ed45e640 10 monclient(hunting): get_auth_request con 0x7f20e815f4f0 auth_method 0 2026-02-17T11:10:35.367 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.360+0000 7f20ed45e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.367 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.360+0000 7f20ed45e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.367 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.360+0000 7f20ed45e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.367 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.360+0000 7f20ecc5d640 10 monclient(hunting): get_auth_request con 0x7f20e806e5b0 auth_method 0 2026-02-17T11:10:35.367 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.360+0000 7f20ecc5d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.367 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.360+0000 7f20ecc5d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.367 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.360+0000 7f20ecc5d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.367 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.361+0000 7f20ed45e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.367 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.361+0000 7f20ed45e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.367 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.361+0000 7f99a7fff640 1 -- 10.20.193.49:0/1279945657 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b402fd20 con 0x7f99b80c92a0 2026-02-17T11:10:35.368 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.361+0000 7f99a7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.368 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.361+0000 7f99a7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:10:35.368 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.361+0000 7f99a7fff640 10 monclient: dump: 2026-02-17T11:10:35.368 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.368 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.368 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.368 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.368 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.368 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.368 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.368 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.368 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.368 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.368 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.361+0000 7f99a7fff640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.368 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.361+0000 7f99a7fff640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.368 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.361+0000 7f99a7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.368 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.361+0000 7f99a7fff640 1 -- 10.20.193.49:0/1279945657 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99b40373f0 con 0x7f99b80c92a0 2026-02-17T11:10:35.368 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.361+0000 7f99a7fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.368 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.361+0000 7f99a7fff640 1 -- 10.20.193.49:0/1279945657 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b4037800 con 0x7f99b80c92a0 2026-02-17T11:10:35.368 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.361+0000 7f99bf37e640 5 monclient: authenticate success, global_id 4463 2026-02-17T11:10:35.368 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.361+0000 7f99bf37e640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:35.368 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.361+0000 7f99bf37e640 4 set_mon_vals no callback set 2026-02-17T11:10:35.368 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.361+0000 7f99a7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.368 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.361+0000 7f99a7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:10:35.368 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.361+0000 7f99a7fff640 10 monclient: dump: 2026-02-17T11:10:35.368 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.368 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.368 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.368 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.368 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.368 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.368 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.368 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.368 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.368 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.368 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.361+0000 7fe1db7fe640 1 --2- 10.20.193.49:0/690046343 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe1dc15e060 0x7fe1dc15c840 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc009d90 tx=0x7fe1cc02f1f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78463a353417f795 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.368 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.361+0000 7f20ed45e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.369 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.361+0000 7f99bf37e640 10 monclient: shutdown 2026-02-17T11:10:35.369 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.361+0000 7f99bf37e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:35.369 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.361+0000 7f99bf37e640 1 -- 10.20.193.49:0/1279945657 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f99b80c92a0 msgr2=0x7f99b815d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.369 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.361+0000 7f99bf37e640 1 --2- 10.20.193.49:0/1279945657 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f99b80c92a0 0x7f99b815d950 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f99b808fc80 tx=0x7f99b402f270 comp rx=0 tx=0).stop 2026-02-17T11:10:35.369 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.362+0000 7f99bf37e640 1 -- 10.20.193.49:0/1279945657 shutdown_connections 2026-02-17T11:10:35.369 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.362+0000 7f99bf37e640 1 --2- 10.20.193.49:0/1279945657 >> v2:10.20.193.97:3300/0 conn(0x7f99b815c840 0x7f99b80c8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.369 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.362+0000 7f99bf37e640 1 --2- 10.20.193.49:0/1279945657 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f99b80c92a0 0x7f99b815d950 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.369 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.362+0000 7f99bf37e640 1 --2- 10.20.193.49:0/1279945657 >> v2:10.20.193.49:3300/0 conn(0x7f99b80d1b60 0x7f99b80d1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.369 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.362+0000 7f99bf37e640 1 -- 10.20.193.49:0/1279945657 >> 10.20.193.49:0/1279945657 conn(0x7f99b806d9b0 msgr2=0x7f99b806ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:35.369 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.362+0000 7f99bf37e640 1 -- 10.20.193.49:0/1279945657 shutdown_connections 2026-02-17T11:10:35.369 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.362+0000 7f20dffff640 1 --2- 10.20.193.49:0/3023193637 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f20e81561c0 0x7f20e81f6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.370 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.362+0000 7f20ecc5d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.370 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.362+0000 7f20ecc5d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.370 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.362+0000 7f20ecc5d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.370 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.362+0000 7f99bf37e640 1 -- 10.20.193.49:0/1279945657 wait complete. 2026-02-17T11:10:35.370 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.362+0000 7fd0937a8640 10 monclient: get_monmap_and_config 2026-02-17T11:10:35.370 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.362+0000 7fd0937a8640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.370 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.362+0000 7fd0937a8640 10 monclient: monmap: 2026-02-17T11:10:35.370 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.370 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.370 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:35.363283+0000 2026-02-17T11:10:35.370 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:35.363283+0000 2026-02-17T11:10:35.370 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.370 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.370 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:35.370 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:35.370 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:35.370 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:35.370 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:35.370 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:35.370 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.370 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.362+0000 7f99bf37e640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.370 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.362+0000 7f99bf37e640 10 monclient: monmap: 2026-02-17T11:10:35.370 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.370 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:35.370 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:35.370 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:35.370 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.370 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.370 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:35.370 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:35.371 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:35.371 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.371 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.362+0000 7f20dffff640 10 monclient(hunting): get_auth_request con 0x7f20e81561c0 auth_method 0 2026-02-17T11:10:35.371 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.362+0000 7f20dffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.371 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.362+0000 7f20dffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.371 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.362+0000 7f20dffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.371 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7f99bf37e640 1 librados: starting msgr at 2026-02-17T11:10:35.371 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7f99bf37e640 1 librados: starting objecter 2026-02-17T11:10:35.371 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7f99bf37e640 1 Processor -- start 2026-02-17T11:10:35.371 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7f3299ffb640 1 -- 10.20.193.49:0/3484434986 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a0017070 con 0x7f32ac06f700 2026-02-17T11:10:35.371 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7f3299ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.371 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7f3299ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:10:35.371 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7f3299ffb640 10 monclient: dump: 2026-02-17T11:10:35.371 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.371 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.371 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.371 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.371 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.371 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.371 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.372 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.372 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.372 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.372 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7f3299ffb640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.372 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7f3299ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.372 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7f3299ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.372 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7f3299ffb640 1 -- 10.20.193.49:0/3484434986 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32a000cc40 con 0x7f32ac06f700 2026-02-17T11:10:35.372 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7f32b34e8640 5 monclient: authenticate success, global_id 4471 2026-02-17T11:10:35.372 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7f32b34e8640 10 monclient: _renew_subs 2026-02-17T11:10:35.372 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7f32b34e8640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.372 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7f32b34e8640 1 -- 10.20.193.49:0/3484434986 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32ac0c6330 con 0x7f32ac06f700 2026-02-17T11:10:35.372 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7f99bf37e640 1 -- start start 2026-02-17T11:10:35.372 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7f99bf37e640 1 librados: setting wanted keys 2026-02-17T11:10:35.372 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7f99bf37e640 1 librados: calling monclient init 2026-02-17T11:10:35.372 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7f99bf37e640 10 monclient: init 2026-02-17T11:10:35.372 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7f32b34e8640 10 client.4471.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:35.372 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7f3299ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.372 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7f3299ffb640 1 -- 10.20.193.49:0/3484434986 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a0013470 con 0x7f32ac06f700 2026-02-17T11:10:35.372 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7f3299ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.372 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7f3299ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:35.372 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7f329b7fe640 4 set_mon_vals no callback set 2026-02-17T11:10:35.372 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7f3299ffb640 10 monclient: dump: 2026-02-17T11:10:35.372 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.372 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.372 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.372 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.372 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.372 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.372 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.373 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.373 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.373 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7f32b34e8640 10 monclient: _renew_subs 2026-02-17T11:10:35.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7f32b34e8640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7f32b34e8640 1 -- 10.20.193.49:0/3484434986 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32ac0c68f0 con 0x7f32ac06f700 2026-02-17T11:10:35.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7f32b34e8640 1 librados: init done 2026-02-17T11:10:35.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7fd0937a8640 1 Processor -- start 2026-02-17T11:10:35.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7fd0937a8640 1 -- start start 2026-02-17T11:10:35.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7fd0937a8640 10 monclient: init 2026-02-17T11:10:35.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7f99bf37e640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7f99bf37e640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:10:35.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7f99bf37e640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f99b80c92a0 0x7f99b8147f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7f99bf37e640 10 monclient(hunting): picked mon.noname-b con 0x7f99b80c92a0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:35.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7f99bf37e640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f99b80d1b60 0x7f99b81f48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7f99bf37e640 10 monclient(hunting): picked mon.noname-c con 0x7f99b80d1b60 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:35.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7f99bf37e640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f99b815c840 0x7f99b81f4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7f99bf37e640 10 monclient(hunting): picked mon.noname-a con 0x7f99b815c840 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:35.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7f99bf37e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7f99bf37e640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f99b815cc90 con 0x7f99b815c840 2026-02-17T11:10:35.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7f99bf37e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7f99bf37e640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f99b80ca180 con 0x7f99b80c92a0 2026-02-17T11:10:35.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7f99bf37e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7f99bf37e640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f99b806e7b0 con 0x7f99b80d1b60 2026-02-17T11:10:35.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7f99bf37e640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7f99bf37e640 10 monclient(hunting): authenticate will time out at 1112.026687s 2026-02-17T11:10:35.374 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7fedfb291640 10 monclient: get_monmap_and_config 2026-02-17T11:10:35.374 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7fedfb291640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.374 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7fedfb291640 10 monclient: monmap: 2026-02-17T11:10:35.374 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.374 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.374 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:35.364229+0000 2026-02-17T11:10:35.374 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:35.364229+0000 2026-02-17T11:10:35.374 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.374 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.374 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:35.374 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:35.374 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:35.374 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:35.374 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:35.374 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:35.374 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.374 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7f32b34e8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:35.374 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7f32b34e8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:35.374 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7f32b34e8640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.374 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7f32b34e8640 1 -- 10.20.193.49:0/3484434986 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32ac06cfa0 con 0x7f32ac06f700 2026-02-17T11:10:35.375 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7fd0937a8640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.375 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7fd0937a8640 10 monclient: _add_conns ranks=[5,1,2,3,4,0] 2026-02-17T11:10:35.375 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7fd0937a8640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7fd08c155d40 0x7fd08c156120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.375 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7fd0937a8640 10 monclient(hunting): picked mon.noname-c con 0x7fd08c155d40 addr v2:10.20.193.157:3300/0 2026-02-17T11:10:35.375 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7fd0937a8640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fd08c0ccc00 addr v1:10.20.193.97:6789/0 2026-02-17T11:10:35.375 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7fd0937a8640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fd08c0caff0 addr v1:10.20.193.157:6789/0 2026-02-17T11:10:35.375 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.363+0000 7fd0937a8640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd08c15c8d0 con 0x7fd08c0ccc00 2026-02-17T11:10:35.375 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7f99b4a91640 10 monclient: get_monmap_and_config 2026-02-17T11:10:35.375 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7f99b4a91640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.375 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7f99b4a91640 10 monclient: monmap: 2026-02-17T11:10:35.375 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.375 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.375 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:35.364555+0000 2026-02-17T11:10:35.375 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:35.364555+0000 2026-02-17T11:10:35.375 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.375 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.375 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:35.375 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:35.375 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:35.375 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:35.375 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:35.375 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:35.375 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.375 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7fd0937a8640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd08c15cbb0 con 0x7fd08c0caff0 2026-02-17T11:10:35.376 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7f901ffff640 1 -- 10.20.193.49:0/2308465620 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f902c02fc50 con 0x7f903015dc50 2026-02-17T11:10:35.376 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7f901ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.376 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7f901ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:10:35.376 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7f901ffff640 10 monclient: dump: 2026-02-17T11:10:35.376 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.376 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.376 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.376 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.376 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.376 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.376 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.376 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.376 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.376 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.376 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7f901ffff640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.376 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7f901ffff640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.376 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7f901ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.376 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7f901ffff640 1 -- 10.20.193.49:0/2308465620 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f902c02fdf0 con 0x7f903015dc50 2026-02-17T11:10:35.376 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7f901ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.376 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7f901ffff640 1 -- 10.20.193.49:0/2308465620 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f902c037610 con 0x7f903015dc50 2026-02-17T11:10:35.376 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7f901ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.376 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7f901ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:10:35.376 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7f901ffff640 10 monclient: dump: 2026-02-17T11:10:35.376 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.376 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.376 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.376 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.376 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.376 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.376 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.376 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.376 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.376 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.376 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7f9037298640 5 monclient: authenticate success, global_id 4466 2026-02-17T11:10:35.376 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7f9037298640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:35.377 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7f9037298640 4 set_mon_vals no callback set 2026-02-17T11:10:35.377 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7fd0937a8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.377 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7fd0937a8640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7fd08c06c890 con 0x7fd08c155d40 2026-02-17T11:10:35.377 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7fedfb291640 1 Processor -- start 2026-02-17T11:10:35.377 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7fd0937a8640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.377 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7f20ed45e640 10 monclient(hunting): handle_auth_done global_id 4461 payload 824 2026-02-17T11:10:35.377 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7f20ed45e640 1 -- 10.20.193.49:0/3023193637 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f20e81561c0 msgr2=0x7f20e81f6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.377 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7f20ed45e640 1 --2- 10.20.193.49:0/3023193637 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f20e81561c0 0x7f20e81f6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.377 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7f20ed45e640 1 -- 10.20.193.49:0/3023193637 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f20e806e5b0 msgr2=0x7f20e81f7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.377 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7f20ed45e640 1 --2- 10.20.193.49:0/3023193637 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f20e806e5b0 0x7f20e81f7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.377 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7f20ed45e640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.377 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7f20ed45e640 1 monclient: found mon.noname-a 2026-02-17T11:10:35.377 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7fedfb291640 1 -- start start 2026-02-17T11:10:35.377 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7fedfb291640 10 monclient: init 2026-02-17T11:10:35.378 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7f20ed45e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.378 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7f20ed45e640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:10:35.378 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7f20ed45e640 1 -- 10.20.193.49:0/3023193637 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20e814a880 con 0x7f20e815f4f0 2026-02-17T11:10:35.378 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7fd0937a8640 10 monclient(hunting): authenticate will time out at 1112.027021s 2026-02-17T11:10:35.378 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7f99b4a91640 1 Processor -- start 2026-02-17T11:10:35.378 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7f99b4a91640 1 -- start start 2026-02-17T11:10:35.378 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7f99b4a91640 10 monclient: init 2026-02-17T11:10:35.378 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7f9037298640 10 monclient: shutdown 2026-02-17T11:10:35.378 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7f9037298640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:35.378 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7f9037298640 1 -- 10.20.193.49:0/2308465620 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f903015dc50 msgr2=0x7f90300cafd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.378 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7f9037298640 1 --2- 10.20.193.49:0/2308465620 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f903015dc50 0x7f90300cafd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f903015cc20 tx=0x7f902c02f230 comp rx=0 tx=0).stop 2026-02-17T11:10:35.378 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7efc92ffd640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7efc94155fb0 0x7efc940cd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.378 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7f9037298640 1 -- 10.20.193.49:0/2308465620 shutdown_connections 2026-02-17T11:10:35.378 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7f9037298640 1 --2- 10.20.193.49:0/2308465620 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f903015dc50 0x7f90300cafd0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.378 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7f9037298640 1 --2- 10.20.193.49:0/2308465620 >> v2:10.20.193.97:3300/0 conn(0x7f903015c840 0x7f9030156100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.379 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7f9037298640 1 -- 10.20.193.49:0/2308465620 >> 10.20.193.49:0/2308465620 conn(0x7f90300cc0c0 msgr2=0x7f90300cc4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:35.379 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7fedfb291640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.379 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7fedfb291640 10 monclient: _add_conns ranks=[5,2,4,0,3,1] 2026-02-17T11:10:35.379 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7fedfb291640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7fedf4155f00 0x7fedf40ccc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.379 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7fedfb291640 10 monclient(hunting): picked mon.noname-c con 0x7fedf4155f00 addr v2:10.20.193.157:3300/0 2026-02-17T11:10:35.379 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7fedfb291640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fedf41562e0 addr v1:10.20.193.157:6789/0 2026-02-17T11:10:35.379 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7efc92ffd640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7efc94155fb0 0x7efc940cd610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:48222/0 (socket says 10.20.193.49:48222) 2026-02-17T11:10:35.379 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7efc92ffd640 1 -- 10.20.193.49:0/2720979807 learned_addr learned my addr 10.20.193.49:0/2720979807 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:35.379 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7efc92ffd640 10 monclient(hunting): get_auth_request con 0x7efc94155fb0 auth_method 0 2026-02-17T11:10:35.379 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7efc92ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.379 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7efc92ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.379 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7efc92ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.379 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7fedfb291640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7fedf415c920 0x7fedf415f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.379 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7fedfb291640 10 monclient(hunting): picked mon.noname-b con 0x7fedf415c920 addr v2:10.20.193.97:3300/0 2026-02-17T11:10:35.379 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7fedfb291640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedf406f730 con 0x7fedf41562e0 2026-02-17T11:10:35.379 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7fedfb291640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.379 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7fedfb291640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7fedf4070ab0 con 0x7fedf415c920 2026-02-17T11:10:35.379 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7fedfb291640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.379 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7fedfb291640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7fedf40692c0 con 0x7fedf4155f00 2026-02-17T11:10:35.379 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7fedfb291640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.379 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.364+0000 7fedfb291640 10 monclient(hunting): authenticate will time out at 1112.027999s 2026-02-17T11:10:35.379 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.365+0000 7f9037298640 1 -- 10.20.193.49:0/2308465620 shutdown_connections 2026-02-17T11:10:35.379 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.365+0000 7f9037298640 1 -- 10.20.193.49:0/2308465620 wait complete. 2026-02-17T11:10:35.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.365+0000 7f99b4a91640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.365+0000 7f99b4a91640 10 monclient: _add_conns ranks=[3,1,5,4,2,0] 2026-02-17T11:10:35.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.365+0000 7f99b4a91640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f99b0152700 0x7f99b015e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.365+0000 7f99b4a91640 10 monclient(hunting): picked mon.noname-a con 0x7f99b0152700 addr v2:10.20.193.49:3300/0 2026-02-17T11:10:35.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.365+0000 7f99b4a91640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f99b0152ae0 addr v1:10.20.193.97:6789/0 2026-02-17T11:10:35.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.365+0000 7f99b4a91640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f99b015edb0 0x7f99b00c9e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.365+0000 7f99b4a91640 10 monclient(hunting): picked mon.noname-c con 0x7f99b015edb0 addr v2:10.20.193.157:3300/0 2026-02-17T11:10:35.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.365+0000 7f99b4a91640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99b015f1e0 con 0x7f99b0152ae0 2026-02-17T11:10:35.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.365+0000 7f99b4a91640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.365+0000 7f99b4a91640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f99b015d4f0 con 0x7f99b0152700 2026-02-17T11:10:35.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.365+0000 7f99b4a91640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.365+0000 7f99b4a91640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f99b015d7d0 con 0x7f99b015edb0 2026-02-17T11:10:35.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.365+0000 7f99b4a91640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.365+0000 7f99b4a91640 10 monclient(hunting): authenticate will time out at 1112.028350s 2026-02-17T11:10:35.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.365+0000 7f9037298640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.365+0000 7f9037298640 10 monclient: monmap: 2026-02-17T11:10:35.380 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.380 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:35.380 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:35.380 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:35.380 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.380 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.380 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:35.380 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:35.380 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:35.380 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.365+0000 7f9037298640 1 librados: starting msgr at 2026-02-17T11:10:35.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.365+0000 7f9037298640 1 librados: starting objecter 2026-02-17T11:10:35.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.365+0000 7f9037298640 1 Processor -- start 2026-02-17T11:10:35.381 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.365+0000 7efc937fe640 1 --2- 10.20.193.49:0/2720979807 >> v2:10.20.193.157:3300/0 conn(0x7efc9406e5b0 0x7efc940ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.381 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.365+0000 7f9037298640 1 -- start start 2026-02-17T11:10:35.381 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.365+0000 7f9037298640 1 librados: setting wanted keys 2026-02-17T11:10:35.381 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.365+0000 7f9037298640 1 librados: calling monclient init 2026-02-17T11:10:35.381 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.365+0000 7f9037298640 10 monclient: init 2026-02-17T11:10:35.381 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.366+0000 7f20ed45e640 1 --2- 10.20.193.49:0/3023193637 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f20e815f4f0 0x7f20e81f6740 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f20e400b970 tx=0x7f20e400be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.381 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.366+0000 7f20dd7fa640 10 client.?.objecter ms_handle_connect 0x7f20e815f4f0 2026-02-17T11:10:35.381 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.366+0000 7f20dd7fa640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:35.381 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.366+0000 7ff62c1fb640 10 monclient: get_monmap_and_config 2026-02-17T11:10:35.381 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.366+0000 7ff62c1fb640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.381 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.366+0000 7ff62c1fb640 10 monclient: monmap: 2026-02-17T11:10:35.381 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.381 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.381 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:35.366930+0000 2026-02-17T11:10:35.381 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:35.366930+0000 2026-02-17T11:10:35.381 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.381 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.381 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:35.381 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:35.381 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:35.381 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:35.381 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:35.381 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:35.381 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.382 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.366+0000 7fe1d9ffb640 1 -- 10.20.193.49:0/690046343 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc03c070 con 0x7fe1dc15e060 2026-02-17T11:10:35.382 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.366+0000 7fe1d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.382 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.366+0000 7fe1d9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:10:35.382 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.366+0000 7fe1d9ffb640 10 monclient: dump: 2026-02-17T11:10:35.382 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.382 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.382 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.382 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.382 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.382 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.382 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.382 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.382 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.382 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.382 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.366+0000 7fe1d9ffb640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.382 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.366+0000 7fe1d9ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.382 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.366+0000 7fe1d9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.382 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.366+0000 7fe1d9ffb640 1 -- 10.20.193.49:0/690046343 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1cc037440 con 0x7fe1dc15e060 2026-02-17T11:10:35.382 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.366+0000 7fe1d9ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.382 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.366+0000 7fe1d9ffb640 1 -- 10.20.193.49:0/690046343 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc037810 con 0x7fe1dc15e060 2026-02-17T11:10:35.382 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.366+0000 7fe1e1951640 5 monclient: authenticate success, global_id 4469 2026-02-17T11:10:35.382 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.366+0000 7fe1e1951640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:35.382 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.366+0000 7fe1e1951640 4 set_mon_vals no callback set 2026-02-17T11:10:35.382 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.366+0000 7fe1d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.382 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.366+0000 7fe1d9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:10:35.382 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.366+0000 7fe1d9ffb640 10 monclient: dump: 2026-02-17T11:10:35.382 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.382 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.382 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.382 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.382 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.383 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.383 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.383 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.383 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.383 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.383 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.366+0000 7f9037298640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.383 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.366+0000 7f9037298640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:10:35.383 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.366+0000 7f9037298640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f9030155d20 0x7f90301fc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.383 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.366+0000 7f9037298640 10 monclient(hunting): picked mon.noname-b con 0x7f9030155d20 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:35.383 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.366+0000 7f9037298640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f903015c840 0x7f90300cb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.383 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.366+0000 7f9037298640 10 monclient(hunting): picked mon.noname-a con 0x7f903015c840 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:35.383 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.366+0000 7f9037298640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f903015dc50 0x7f903014f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.383 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.366+0000 7f9037298640 10 monclient(hunting): picked mon.noname-c con 0x7f903015dc50 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:35.383 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.366+0000 7f9037298640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.383 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.366+0000 7f9037298640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9030069130 con 0x7f903015c840 2026-02-17T11:10:35.383 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.366+0000 7f9037298640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.383 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.366+0000 7f9037298640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f9030070310 con 0x7f9030155d20 2026-02-17T11:10:35.383 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.366+0000 7f9037298640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.383 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.366+0000 7f9037298640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f9030074ab0 con 0x7f903015dc50 2026-02-17T11:10:35.383 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.366+0000 7f9037298640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.383 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.366+0000 7f9037298640 10 monclient(hunting): authenticate will time out at 1112.029299s 2026-02-17T11:10:35.383 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.366+0000 7efc937fe640 10 monclient(hunting): get_auth_request con 0x7efc9406e5b0 auth_method 0 2026-02-17T11:10:35.383 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.366+0000 7efc937fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.384 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.366+0000 7efc937fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.384 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.366+0000 7efc937fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.384 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.366+0000 7efc937fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.384 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.366+0000 7efc937fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.384 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.366+0000 7efc937fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.384 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.366+0000 7fedf9006640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7fedf4155f00 0x7fedf40ccc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.384 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.366+0000 7ff13f2c4640 10 monclient: get_monmap_and_config 2026-02-17T11:10:35.384 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.366+0000 7ff13f2c4640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.384 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.366+0000 7ff13f2c4640 10 monclient: monmap: 2026-02-17T11:10:35.384 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.384 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.384 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:35.367473+0000 2026-02-17T11:10:35.384 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:35.367473+0000 2026-02-17T11:10:35.384 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.384 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.384 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:35.384 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:35.384 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:35.384 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:35.384 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:35.384 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:35.384 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.384 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.366+0000 7ff62c1fb640 1 Processor -- start 2026-02-17T11:10:35.384 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.366+0000 7ff62c1fb640 1 -- start start 2026-02-17T11:10:35.384 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.366+0000 7ff62c1fb640 10 monclient: init 2026-02-17T11:10:35.385 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.367+0000 7fe1e1951640 10 monclient: shutdown 2026-02-17T11:10:35.385 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.367+0000 7fe1e1951640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:35.385 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.367+0000 7fe1e1951640 1 -- 10.20.193.49:0/690046343 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe1dc15e060 msgr2=0x7fe1dc15c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.385 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.367+0000 7fe1e1951640 1 --2- 10.20.193.49:0/690046343 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe1dc15e060 0x7fe1dc15c840 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc009d90 tx=0x7fe1cc02f1f0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.385 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.367+0000 7ff13f2c4640 1 Processor -- start 2026-02-17T11:10:35.385 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.367+0000 7ff13f2c4640 1 -- start start 2026-02-17T11:10:35.385 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.367+0000 7ff13f2c4640 10 monclient: init 2026-02-17T11:10:35.385 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.367+0000 7fe1e1951640 1 -- 10.20.193.49:0/690046343 shutdown_connections 2026-02-17T11:10:35.385 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.367+0000 7fe1e1951640 1 --2- 10.20.193.49:0/690046343 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe1dc15e060 0x7fe1dc15c840 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.385 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.367+0000 7fe1e1951640 1 -- 10.20.193.49:0/690046343 >> 10.20.193.49:0/690046343 conn(0x7fe1dc06d9b0 msgr2=0x7fe1dc06ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:35.385 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.367+0000 7fe1e1951640 1 -- 10.20.193.49:0/690046343 shutdown_connections 2026-02-17T11:10:35.385 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.367+0000 7fe1e1951640 1 -- 10.20.193.49:0/690046343 wait complete. 2026-02-17T11:10:35.385 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.367+0000 7ff62c1fb640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.385 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.367+0000 7ff62c1fb640 10 monclient: _add_conns ranks=[3,2,4,1,5,0] 2026-02-17T11:10:35.385 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.367+0000 7ff62c1fb640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7ff624163950 0x7ff6240cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.385 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.367+0000 7ff62c1fb640 10 monclient(hunting): picked mon.noname-a con 0x7ff624163950 addr v2:10.20.193.49:3300/0 2026-02-17T11:10:35.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.367+0000 7ff62c1fb640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ff624161850 addr v1:10.20.193.157:6789/0 2026-02-17T11:10:35.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.367+0000 7ff62c1fb640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7ff624164440 0x7ff624161cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.367+0000 7ff62c1fb640 10 monclient(hunting): picked mon.noname-b con 0x7ff624164440 addr v2:10.20.193.97:3300/0 2026-02-17T11:10:35.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.367+0000 7ff62c1fb640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff624071ea0 con 0x7ff624161850 2026-02-17T11:10:35.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.367+0000 7ff62c1fb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.367+0000 7ff62c1fb640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7ff62406f540 con 0x7ff624163950 2026-02-17T11:10:35.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.367+0000 7ff62c1fb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.367+0000 7ff62c1fb640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7ff62406f0b0 con 0x7ff624164440 2026-02-17T11:10:35.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.367+0000 7ff62c1fb640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.367+0000 7ff62c1fb640 10 monclient(hunting): authenticate will time out at 1112.030760s 2026-02-17T11:10:35.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.367+0000 7efc937fe640 10 monclient(hunting): handle_auth_done global_id 4475 payload 274 2026-02-17T11:10:35.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.367+0000 7efc937fe640 1 -- 10.20.193.49:0/2720979807 >> v2:10.20.193.97:3300/0 conn(0x7efc94155fb0 msgr2=0x7efc940cd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:35.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.367+0000 7efc937fe640 1 --2- 10.20.193.49:0/2720979807 >> v2:10.20.193.97:3300/0 conn(0x7efc94155fb0 0x7efc940cd610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.367+0000 7ff13f2c4640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.367+0000 7efc937fe640 1 -- 10.20.193.49:0/2720979807 >> v2:10.20.193.49:3300/0 conn(0x7efc940cdb50 msgr2=0x7efc940ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:35.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.367+0000 7efc937fe640 1 --2- 10.20.193.49:0/2720979807 >> v2:10.20.193.49:3300/0 conn(0x7efc940cdb50 0x7efc940ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.367+0000 7efc937fe640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.367+0000 7efc937fe640 1 monclient: found mon.noname-c 2026-02-17T11:10:35.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.367+0000 7efc937fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.367+0000 7efc937fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:10:35.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.367+0000 7efc937fe640 1 -- 10.20.193.49:0/2720979807 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc940cd040 con 0x7efc9406e5b0 2026-02-17T11:10:35.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7fe1e1951640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.387 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7fe1e1951640 10 monclient: monmap: 2026-02-17T11:10:35.387 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.387 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:35.387 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:35.387 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:35.387 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.387 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.387 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:35.387 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:35.387 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:35.387 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.387 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7fedf9006640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7fedf4155f00 0x7fedf40ccc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:56008/0 (socket says 10.20.193.49:56008) 2026-02-17T11:10:35.387 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7fedf9006640 1 -- 10.20.193.49:0/378958725 learned_addr learned my addr 10.20.193.49:0/378958725 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:35.387 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7fedf9006640 10 monclient(hunting): get_auth_request con 0x7fedf4155f00 auth_method 0 2026-02-17T11:10:35.387 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7fedf9006640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.387 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7fedf9006640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.387 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7fedf9006640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.387 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7ff13f2c4640 10 monclient: _add_conns ranks=[1,5,4,3,2,0] 2026-02-17T11:10:35.387 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7ff13f2c4640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7ff138155fb0 addr v1:10.20.193.97:6789/0 2026-02-17T11:10:35.387 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7ff13f2c4640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7ff13806e5b0 0x7ff1380ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.387 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7ff13f2c4640 10 monclient(hunting): picked mon.noname-c con 0x7ff13806e5b0 addr v2:10.20.193.157:3300/0 2026-02-17T11:10:35.387 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7ff13f2c4640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7ff1380ce8d0 0x7ff13815f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.387 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7ff13f2c4640 10 monclient(hunting): picked mon.noname-b con 0x7ff1380ce8d0 addr v2:10.20.193.97:3300/0 2026-02-17T11:10:35.387 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7ff13f2c4640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1380ced00 con 0x7ff138155fb0 2026-02-17T11:10:35.387 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7ff13f2c4640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.387 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7ff13f2c4640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7ff1380cb950 con 0x7ff1380ce8d0 2026-02-17T11:10:35.387 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7ff13f2c4640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.387 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7ff13f2c4640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7ff1380cbc30 con 0x7ff13806e5b0 2026-02-17T11:10:35.387 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7ff13f2c4640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.387 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7ff13f2c4640 10 monclient(hunting): authenticate will time out at 1112.031065s 2026-02-17T11:10:35.388 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7fe1e1951640 1 librados: starting msgr at 2026-02-17T11:10:35.388 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7fe1e1951640 1 librados: starting objecter 2026-02-17T11:10:35.388 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7fe1e1951640 1 Processor -- start 2026-02-17T11:10:35.388 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7f10d9491640 10 monclient: get_monmap_and_config 2026-02-17T11:10:35.388 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7f10d9491640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.388 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7f10d9491640 10 monclient: monmap: 2026-02-17T11:10:35.388 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.388 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.388 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:35.368779+0000 2026-02-17T11:10:35.388 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:35.368779+0000 2026-02-17T11:10:35.388 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.388 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.388 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:35.388 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:35.388 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:35.388 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:35.388 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:35.388 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:35.388 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.388 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7fe1e1951640 1 -- start start 2026-02-17T11:10:35.388 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7fe1e1951640 1 librados: setting wanted keys 2026-02-17T11:10:35.388 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7fe1e1951640 1 librados: calling monclient init 2026-02-17T11:10:35.388 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7fe1e1951640 10 monclient: init 2026-02-17T11:10:35.389 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7f3efed76640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f3f00152ae0 0x7f3f000c9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.389 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7f3efed76640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f3f00152ae0 0x7f3f000c9c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:33044/0 (socket says 10.20.193.49:33044) 2026-02-17T11:10:35.389 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7f3efed76640 1 -- 10.20.193.49:0/1694059901 learned_addr learned my addr 10.20.193.49:0/1694059901 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:35.389 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7f3efed76640 10 monclient(hunting): get_auth_request con 0x7f3f00152ae0 auth_method 0 2026-02-17T11:10:35.389 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7f3efed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.389 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7f3efed76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.389 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7f3efed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.389 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7fe1e1951640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.389 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7fe1e1951640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:10:35.389 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7fe1e1951640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe1dc0d1b60 0x7fe1dc1f4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.389 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7f10d9491640 1 Processor -- start 2026-02-17T11:10:35.389 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7fe1e1951640 10 monclient(hunting): picked mon.noname-c con 0x7fe1dc0d1b60 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:35.389 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7fe1e1951640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe1dc0d1f40 0x7fe1dc0cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.389 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7fe1e1951640 10 monclient(hunting): picked mon.noname-b con 0x7fe1dc0d1f40 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:35.389 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7fe1e1951640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe1dc15e060 0x7fe1dc0ce760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.389 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7fe1e1951640 10 monclient(hunting): picked mon.noname-a con 0x7fe1dc15e060 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:35.389 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7fe1e1951640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.389 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7fe1e1951640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe1dc15d4c0 con 0x7fe1dc15e060 2026-02-17T11:10:35.389 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7fe1e1951640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.389 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7fe1e1951640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe1dc0ca460 con 0x7fe1dc0d1f40 2026-02-17T11:10:35.390 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7fe1e1951640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.390 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7fe1e1951640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe1dc06e7b0 con 0x7fe1dc0d1b60 2026-02-17T11:10:35.390 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7fe1e1951640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.390 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7fe1e1951640 10 monclient(hunting): authenticate will time out at 1112.031828s 2026-02-17T11:10:35.390 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7f10d9491640 1 -- start start 2026-02-17T11:10:35.390 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7f10d9491640 10 monclient: init 2026-02-17T11:10:35.390 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7fedf9006640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.390 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7fedf9006640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.390 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7fedf9006640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.390 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7fbd4b032640 10 monclient: get_monmap_and_config 2026-02-17T11:10:35.390 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7fbd4b032640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.390 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.368+0000 7fbd4b032640 10 monclient: monmap: 2026-02-17T11:10:35.390 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.390 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.390 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:35.369184+0000 2026-02-17T11:10:35.390 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:35.369184+0000 2026-02-17T11:10:35.390 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.390 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.390 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:35.390 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:35.390 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:35.390 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:35.390 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:35.390 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:35.390 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.390 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.369+0000 7fbd4b032640 1 Processor -- start 2026-02-17T11:10:35.391 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.369+0000 7efc937fe640 1 --2- 10.20.193.49:0/2720979807 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7efc9406e5b0 0x7efc940ce8d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7efc94074390 tx=0x7efc8402f1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c25d23a5582d148d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.391 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.369+0000 7fbd4b032640 1 -- start start 2026-02-17T11:10:35.391 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.369+0000 7fbd4b032640 10 monclient: init 2026-02-17T11:10:35.391 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.369+0000 7f3efed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.391 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.369+0000 7f3efed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.391 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.369+0000 7f10d9491640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.391 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.369+0000 7f3efed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.391 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.369+0000 7f10d9491640 10 monclient: _add_conns ranks=[4,0,1,5,2,3] 2026-02-17T11:10:35.391 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.369+0000 7f10d9491640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f10d40c7170 0x7f10d40c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.391 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.369+0000 7f10d9491640 10 monclient(hunting): picked mon.noname-b con 0x7f10d40c7170 addr v2:10.20.193.97:3300/0 2026-02-17T11:10:35.391 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.369+0000 7f10d9491640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f10d40c48c0 addr v1:10.20.193.49:6789/0 2026-02-17T11:10:35.391 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.369+0000 7f10d9491640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f10d40c4d10 addr v1:10.20.193.97:6789/0 2026-02-17T11:10:35.391 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.369+0000 7f10d9491640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10d415a9a0 con 0x7f10d40c48c0 2026-02-17T11:10:35.391 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.369+0000 7f10d9491640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10d40c5270 con 0x7f10d40c4d10 2026-02-17T11:10:35.391 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.369+0000 7f10d9491640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.391 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.369+0000 7f10d9491640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f10d40c8530 con 0x7f10d40c7170 2026-02-17T11:10:35.392 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.369+0000 7f10d9491640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.392 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.369+0000 7f10d9491640 10 monclient(hunting): authenticate will time out at 1112.032449s 2026-02-17T11:10:35.392 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.369+0000 7fd09151d640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7fd08c155d40 0x7fd08c156120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.392 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.369+0000 7fbd4b032640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.392 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.369+0000 7fbd4b032640 10 monclient: _add_conns ranks=[2,1,5,4,0,3] 2026-02-17T11:10:35.392 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.369+0000 7fbd4b032640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fbd44155270 addr v1:10.20.193.157:6789/0 2026-02-17T11:10:35.392 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.370+0000 7fbd4b032640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fbd4406d4f0 addr v1:10.20.193.97:6789/0 2026-02-17T11:10:35.392 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.370+0000 7fbd4b032640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7fbd44155650 0x7fbd44074460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.392 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.370+0000 7fbd4b032640 10 monclient(hunting): picked mon.noname-c con 0x7fbd44155650 addr v2:10.20.193.157:3300/0 2026-02-17T11:10:35.392 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.370+0000 7fbd4b032640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd44158e60 con 0x7fbd4406d4f0 2026-02-17T11:10:35.392 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.370+0000 7fbd4b032640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd44073230 con 0x7fbd44155270 2026-02-17T11:10:35.392 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.370+0000 7fbd4b032640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.392 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.370+0000 7fbd4b032640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7fbd44158670 con 0x7fbd44155650 2026-02-17T11:10:35.392 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.370+0000 7fbd4b032640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.392 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.370+0000 7fbd4b032640 10 monclient(hunting): authenticate will time out at 1112.033064s 2026-02-17T11:10:35.393 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.370+0000 7f3efed76640 10 monclient(hunting): handle_auth_done global_id 4464 payload 274 2026-02-17T11:10:35.393 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.370+0000 7f3efed76640 1 -- 10.20.193.49:0/1694059901 >> v2:10.20.193.97:3300/0 conn(0x7f3f0015ef80 msgr2=0x7f3f000c9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:35.393 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.370+0000 7f3efed76640 1 --2- 10.20.193.49:0/1694059901 >> v2:10.20.193.97:3300/0 conn(0x7f3f0015ef80 0x7f3f000c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.393 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.370+0000 7f3efed76640 1 -- 10.20.193.49:0/1694059901 >> v1:10.20.193.97:6789/0 conn(0x7f3f00152700 legacy=0x7f3f0015e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:35.393 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.370+0000 7f3efed76640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.393 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.370+0000 7f3efed76640 1 monclient: found mon.noname-a 2026-02-17T11:10:35.393 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.370+0000 7f3efed76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.393 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.370+0000 7f3efed76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:10:35.393 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.370+0000 7f3efed76640 1 -- 10.20.193.49:0/1694059901 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f0015dd90 con 0x7f3f00152ae0 2026-02-17T11:10:35.393 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.370+0000 7fedf9006640 10 monclient(hunting): handle_auth_done global_id 4478 payload 274 2026-02-17T11:10:35.393 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.370+0000 7fedf9006640 1 -- 10.20.193.49:0/378958725 >> v2:10.20.193.97:3300/0 conn(0x7fedf415c920 msgr2=0x7fedf415f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:35.393 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.370+0000 7fedf9006640 1 --2- 10.20.193.49:0/378958725 >> v2:10.20.193.97:3300/0 conn(0x7fedf415c920 0x7fedf415f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.393 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.370+0000 7fedf9006640 1 -- 10.20.193.49:0/378958725 >> v1:10.20.193.157:6789/0 conn(0x7fedf41562e0 legacy=0x7fedf415d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:35.393 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.370+0000 7fedf9006640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.393 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.370+0000 7fedf9006640 1 monclient: found mon.noname-c 2026-02-17T11:10:35.393 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.370+0000 7fedf9006640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.393 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.370+0000 7fedf9006640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:10:35.393 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.370+0000 7fedf9006640 1 -- 10.20.193.49:0/378958725 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedf406fa10 con 0x7fedf4155f00 2026-02-17T11:10:35.393 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.371+0000 7f99bc8f2640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f99b80d1b60 0x7f99b81f48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.393 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.371+0000 7f3efed76640 1 --2- 10.20.193.49:0/1694059901 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f3f00152ae0 0x7f3f000c9c70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3f0008e820 tx=0x7f3ef002f280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fbfbd570b51467c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.372+0000 7fd09151d640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7fd08c155d40 0x7fd08c156120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:55998/0 (socket says 10.20.193.49:55998) 2026-02-17T11:10:35.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.372+0000 7fd09151d640 1 -- 10.20.193.49:0/3732901702 learned_addr learned my addr 10.20.193.49:0/3732901702 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:35.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.372+0000 7fd09151d640 10 monclient(hunting): get_auth_request con 0x7fd08c155d40 auth_method 0 2026-02-17T11:10:35.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.372+0000 7fd09151d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.372+0000 7fd09151d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.372+0000 7fd09151d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.372+0000 7f99bd8f4640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f99b815c840 0x7f99b81f4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.372+0000 7f99bc8f2640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f99b80d1b60 0x7f99b81f48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:55988/0 (socket says 10.20.193.49:55988) 2026-02-17T11:10:35.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.372+0000 7f99bc8f2640 1 -- 10.20.193.49:0/1840724848 learned_addr learned my addr 10.20.193.49:0/1840724848 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:35.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.372+0000 7f99bc8f2640 10 monclient(hunting): get_auth_request con 0x7f99b80d1b60 auth_method 0 2026-02-17T11:10:35.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.372+0000 7f99bc8f2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.372+0000 7f99bc8f2640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.372+0000 7f99bc8f2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.372+0000 7f99bd8f4640 10 monclient(hunting): get_auth_request con 0x7f99b815c840 auth_method 0 2026-02-17T11:10:35.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.372+0000 7f99bd8f4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.372+0000 7f99bd8f4640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.372+0000 7f99bd8f4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.372+0000 7fd09151d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.372+0000 7fd09151d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.372+0000 7fd09151d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.372+0000 7fedf9006640 1 --2- 10.20.193.49:0/378958725 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fedf4155f00 0x7fedf40ccc00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fedf4073410 tx=0x7fede402eed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76f104c6371eb721 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.373+0000 7f99bc8f2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.373+0000 7f99bc8f2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.373+0000 7f99bc8f2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.373+0000 7f99bd8f4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.373+0000 7f99bd8f4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.373+0000 7f99bd8f4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.373+0000 7fd09151d640 10 monclient(hunting): handle_auth_done global_id 4481 payload 274 2026-02-17T11:10:35.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.373+0000 7fd09151d640 1 -- 10.20.193.49:0/3732901702 >> v1:10.20.193.157:6789/0 conn(0x7fd08c0caff0 legacy=0x7fd08c0cb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:35.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.373+0000 7fd09151d640 1 -- 10.20.193.49:0/3732901702 >> v1:10.20.193.97:6789/0 conn(0x7fd08c0ccc00 legacy=0x7fd08c15d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:35.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.373+0000 7fd09151d640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.373+0000 7fd09151d640 1 monclient: found mon.noname-c 2026-02-17T11:10:35.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.373+0000 7fd09151d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.373+0000 7fd09151d640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:10:35.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.373+0000 7fd09151d640 1 -- 10.20.193.49:0/3732901702 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd08c06cae0 con 0x7fd08c155d40 2026-02-17T11:10:35.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.374+0000 7f3efd573640 1 -- 10.20.193.49:0/1694059901 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef002fce0 con 0x7f3f00152ae0 2026-02-17T11:10:35.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.374+0000 7f3efd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.374+0000 7f3efd573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:10:35.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.374+0000 7f3efd573640 10 monclient: dump: 2026-02-17T11:10:35.395 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.395 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.396 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.396 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.396 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.396 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.396 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.396 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.396 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.396 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.396 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.374+0000 7f3efd573640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.396 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.374+0000 7f3efd573640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.396 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.374+0000 7f3efd573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.396 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.374+0000 7f3efd573640 1 -- 10.20.193.49:0/1694059901 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ef00373f0 con 0x7f3f00152ae0 2026-02-17T11:10:35.396 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.374+0000 7f903480c640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f903015c840 0x7f90300cb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.396 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.374+0000 7f3f04ee2640 5 monclient: authenticate success, global_id 4464 2026-02-17T11:10:35.396 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.374+0000 7f3f04ee2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:10:35.396 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.374+0000 7f3efd573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.396 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.374+0000 7f3efd573640 1 -- 10.20.193.49:0/1694059901 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef00377c0 con 0x7f3f00152ae0 2026-02-17T11:10:35.396 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.374+0000 7f3efd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.396 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.374+0000 7f3efd573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:10:35.396 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.374+0000 7f3efd573640 10 monclient: dump: 2026-02-17T11:10:35.396 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.396 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.396 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.396 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.396 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.396 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.396 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.396 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.396 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.396 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.396 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.374+0000 7f3f04ee2640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:35.396 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.374+0000 7f3f04ee2640 4 set_mon_vals no callback set 2026-02-17T11:10:35.397 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.374+0000 7f903480c640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f903015c840 0x7f90300cb6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:33070/0 (socket says 10.20.193.49:33070) 2026-02-17T11:10:35.397 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.374+0000 7f903480c640 1 -- 10.20.193.49:0/2812003517 learned_addr learned my addr 10.20.193.49:0/2812003517 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:35.397 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.374+0000 7f903480c640 10 monclient(hunting): get_auth_request con 0x7f903015c840 auth_method 0 2026-02-17T11:10:35.397 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.374+0000 7f903480c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.397 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.374+0000 7f903480c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.397 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.374+0000 7f903480c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.397 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.374+0000 7f3f04ee2640 10 monclient: shutdown 2026-02-17T11:10:35.397 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.374+0000 7f3f04ee2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:35.397 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.374+0000 7f3f04ee2640 1 -- 10.20.193.49:0/1694059901 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f3f00152ae0 msgr2=0x7f3f000c9c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.397 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.374+0000 7f3f04ee2640 1 --2- 10.20.193.49:0/1694059901 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f3f00152ae0 0x7f3f000c9c70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3f0008e820 tx=0x7f3ef002f280 comp rx=0 tx=0).stop 2026-02-17T11:10:35.397 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.375+0000 7f3f04ee2640 1 -- 10.20.193.49:0/1694059901 shutdown_connections 2026-02-17T11:10:35.397 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.375+0000 7f3f04ee2640 1 --2- 10.20.193.49:0/1694059901 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f3f00152ae0 0x7f3f000c9c70 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.397 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.375+0000 7f3f04ee2640 1 --2- 10.20.193.49:0/1694059901 >> v2:10.20.193.97:3300/0 conn(0x7f3f0015ef80 0x7f3f000c9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.397 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.375+0000 7f3f04ee2640 1 -- 10.20.193.49:0/1694059901 >> 10.20.193.49:0/1694059901 conn(0x7f3f00073030 msgr2=0x7f3f00073440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:35.397 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.375+0000 7f3f04ee2640 1 -- 10.20.193.49:0/1694059901 shutdown_connections 2026-02-17T11:10:35.397 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.375+0000 7f3f04ee2640 1 -- 10.20.193.49:0/1694059901 wait complete. 2026-02-17T11:10:35.397 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.375+0000 7f3f04ee2640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.397 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.375+0000 7f3f04ee2640 10 monclient: monmap: 2026-02-17T11:10:35.397 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.397 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:35.397 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:35.397 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:35.397 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.397 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.397 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:35.397 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:35.398 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:35.398 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.398 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.376+0000 7f3f04ee2640 1 librados: starting msgr at 2026-02-17T11:10:35.398 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.376+0000 7f3f04ee2640 1 librados: starting objecter 2026-02-17T11:10:35.398 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.376+0000 7f903480c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.398 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.376+0000 7f903480c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.398 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.376+0000 7f903480c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.398 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.376+0000 7f3f04ee2640 1 Processor -- start 2026-02-17T11:10:35.398 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.376+0000 7f99bc8f2640 10 monclient(hunting): handle_auth_done global_id 4484 payload 824 2026-02-17T11:10:35.398 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.376+0000 7f99bc8f2640 1 -- 10.20.193.49:0/1840724848 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f99b80c92a0 msgr2=0x7f99b8147f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.398 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.376+0000 7f99bc8f2640 1 --2- 10.20.193.49:0/1840724848 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f99b80c92a0 0x7f99b8147f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.398 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.376+0000 7f99bc8f2640 1 -- 10.20.193.49:0/1840724848 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f99b815c840 msgr2=0x7f99b81f4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.398 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.376+0000 7f99bc8f2640 1 --2- 10.20.193.49:0/1840724848 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f99b815c840 0x7f99b81f4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.398 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.376+0000 7f99bc8f2640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.398 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.376+0000 7f99bc8f2640 1 monclient: found mon.noname-c 2026-02-17T11:10:35.398 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.376+0000 7f3f04ee2640 1 -- start start 2026-02-17T11:10:35.398 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.376+0000 7f3f04ee2640 1 librados: setting wanted keys 2026-02-17T11:10:35.398 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.376+0000 7f99bc8f2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.398 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.376+0000 7f99bc8f2640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:10:35.399 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.376+0000 7f99bc8f2640 1 -- 10.20.193.49:0/1840724848 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99b814a290 con 0x7f99b80d1b60 2026-02-17T11:10:35.399 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.376+0000 7f3f04ee2640 1 librados: calling monclient init 2026-02-17T11:10:35.399 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.376+0000 7f3f04ee2640 10 monclient: init 2026-02-17T11:10:35.399 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.376+0000 7f20dd7fa640 1 -- 10.20.193.49:0/3023193637 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e400c790 con 0x7f20e815f4f0 2026-02-17T11:10:35.399 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.376+0000 7f20dd7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.399 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.376+0000 7f20dd7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:10:35.399 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.376+0000 7f20dd7fa640 10 monclient: dump: 2026-02-17T11:10:35.399 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.399 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.399 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.399 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.399 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.399 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.399 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.399 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.399 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.399 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.399 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.376+0000 7f20dd7fa640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.399 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.376+0000 7f20dd7fa640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.399 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.376+0000 7f20dd7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.399 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.376+0000 7f20dd7fa640 1 -- 10.20.193.49:0/3023193637 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20e4010070 con 0x7f20e815f4f0 2026-02-17T11:10:35.399 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.376+0000 7f20dd7fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.399 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.376+0000 7f20dd7fa640 1 -- 10.20.193.49:0/3023193637 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e400cb90 con 0x7f20e815f4f0 2026-02-17T11:10:35.399 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.376+0000 7f20dd7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.399 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.376+0000 7f20dd7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:10:35.399 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.376+0000 7f20dd7fa640 10 monclient: dump: 2026-02-17T11:10:35.399 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.399 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.399 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.399 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.399 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.400 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.400 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.400 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.400 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.400 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.400 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.376+0000 7f20eeee8640 5 monclient: authenticate success, global_id 4461 2026-02-17T11:10:35.400 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.376+0000 7f20eeee8640 10 monclient: _renew_subs 2026-02-17T11:10:35.400 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.376+0000 7f20deffd640 4 set_mon_vals no callback set 2026-02-17T11:10:35.400 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.376+0000 7f20eeee8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:35.400 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.376+0000 7f20eeee8640 1 -- 10.20.193.49:0/3023193637 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20e814ab60 con 0x7f20e815f4f0 2026-02-17T11:10:35.400 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.376+0000 7f20eeee8640 10 client.4461.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:35.400 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.376+0000 7f20eeee8640 10 monclient: _renew_subs 2026-02-17T11:10:35.400 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.376+0000 7f20eeee8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:35.400 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.376+0000 7f20eeee8640 1 -- 10.20.193.49:0/3023193637 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20e81f5a00 con 0x7f20e815f4f0 2026-02-17T11:10:35.400 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.376+0000 7f20eeee8640 1 librados: init done 2026-02-17T11:10:35.400 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.376+0000 7ff629f70640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7ff624163950 0x7ff6240cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.376+0000 7f3f04ee2640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.376+0000 7f3f04ee2640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:10:35.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.376+0000 7f3f04ee2640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f3f00152700 0x7f3f0015b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.376+0000 7f3f04ee2640 10 monclient(hunting): picked mon.noname-a con 0x7f3f00152700 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:35.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.376+0000 7f3f04ee2640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f3f00152ae0 0x7f3f001f3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.376+0000 7f3f04ee2640 10 monclient(hunting): picked mon.noname-c con 0x7f3f00152ae0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:35.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.376+0000 7f3f04ee2640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f3f0015ef80 0x7f3f00148100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.376+0000 7f3f04ee2640 10 monclient(hunting): picked mon.noname-b con 0x7f3f0015ef80 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:35.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.376+0000 7f3f04ee2640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.376+0000 7f3f04ee2640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f3f000ca1b0 con 0x7f3f00152700 2026-02-17T11:10:35.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.376+0000 7f3f04ee2640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.376+0000 7f3f04ee2640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f3f0015e350 con 0x7f3f0015ef80 2026-02-17T11:10:35.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.377+0000 7f3f04ee2640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.377+0000 7f3f04ee2640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f3f000ca330 con 0x7f3f00152ae0 2026-02-17T11:10:35.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.377+0000 7f3f04ee2640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.377+0000 7f3f04ee2640 10 monclient(hunting): authenticate will time out at 1112.040046s 2026-02-17T11:10:35.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.377+0000 7f20eeee8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:35.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.377+0000 7f20eeee8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:35.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.377+0000 7f20eeee8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:35.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.377+0000 7f20eeee8640 1 -- 10.20.193.49:0/3023193637 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20e815cda0 con 0x7f20e815f4f0 2026-02-17T11:10:35.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.378+0000 7f903480c640 10 monclient(hunting): handle_auth_done global_id 4470 payload 824 2026-02-17T11:10:35.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.378+0000 7f903480c640 1 -- 10.20.193.49:0/2812003517 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f903015dc50 msgr2=0x7f903014f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.378+0000 7f903480c640 1 --2- 10.20.193.49:0/2812003517 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f903015dc50 0x7f903014f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.378+0000 7f903480c640 1 -- 10.20.193.49:0/2812003517 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f9030155d20 msgr2=0x7f90301fc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.378+0000 7f903480c640 1 --2- 10.20.193.49:0/2812003517 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f9030155d20 0x7f90301fc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.378+0000 7f903480c640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.378+0000 7f903480c640 1 monclient: found mon.noname-a 2026-02-17T11:10:35.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.378+0000 7f903480c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.378+0000 7f903480c640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:10:35.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.378+0000 7f903480c640 1 -- 10.20.193.49:0/2812003517 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90301f85e0 con 0x7f903015c840 2026-02-17T11:10:35.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.378+0000 7ff13c838640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7ff13806e5b0 0x7ff1380ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.379+0000 7ff13c838640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7ff13806e5b0 0x7ff1380ce390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:56026/0 (socket says 10.20.193.49:56026) 2026-02-17T11:10:35.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.379+0000 7ff13c838640 1 -- 10.20.193.49:0/1130732492 learned_addr learned my addr 10.20.193.49:0/1130732492 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:35.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.379+0000 7ff13c838640 10 monclient(hunting): get_auth_request con 0x7ff13806e5b0 auth_method 0 2026-02-17T11:10:35.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.379+0000 7ff13c838640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.379+0000 7ff13c838640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.379+0000 7ff13c838640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.379+0000 7f99bc8f2640 1 --2- 10.20.193.49:0/1840724848 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f99b80d1b60 0x7f99b81f48b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f99ac00b530 tx=0x7f99ac00ba00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.379+0000 7f99a5ffb640 10 client.?.objecter ms_handle_connect 0x7f99b80d1b60 2026-02-17T11:10:35.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.379+0000 7f99a5ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:35.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.379+0000 7ff13c838640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.379+0000 7ff13c838640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.379+0000 7ff13c838640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.380+0000 7ff13c838640 10 monclient(hunting): handle_auth_done global_id 4487 payload 274 2026-02-17T11:10:35.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.380+0000 7ff13c838640 1 -- 10.20.193.49:0/1130732492 >> v2:10.20.193.97:3300/0 conn(0x7ff1380ce8d0 msgr2=0x7ff13815f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:35.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.380+0000 7ff13c838640 1 --2- 10.20.193.49:0/1130732492 >> v2:10.20.193.97:3300/0 conn(0x7ff1380ce8d0 0x7ff13815f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.380+0000 7ff13c838640 1 -- 10.20.193.49:0/1130732492 >> v1:10.20.193.97:6789/0 conn(0x7ff138155fb0 legacy=0x7ff1380cd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:35.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.380+0000 7ff13c838640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.380+0000 7ff13c838640 1 monclient: found mon.noname-c 2026-02-17T11:10:35.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.380+0000 7ff13c838640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.380+0000 7ff13c838640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:10:35.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.380+0000 7ff13c838640 1 -- 10.20.193.49:0/1130732492 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1380ccd60 con 0x7ff13806e5b0 2026-02-17T11:10:35.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.380+0000 7ff62976f640 1 --1- >> v1:10.20.193.157:6789/0 conn(0x7ff624161850 0x7ff624163d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.157:6789/0 says I am v1:10.20.193.49:43394/0 (socket says 10.20.193.49:43394) 2026-02-17T11:10:35.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.380+0000 7ff62976f640 1 -- 10.20.193.49:0/3001156122 learned_addr learned my addr 10.20.193.49:0/3001156122 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:10:35.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.381+0000 7f903480c640 1 --2- 10.20.193.49:0/2812003517 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f903015c840 0x7f90300cb6e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f902400b500 tx=0x7f902400b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.381+0000 7f901dffb640 10 client.?.objecter ms_handle_connect 0x7f903015c840 2026-02-17T11:10:35.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.381+0000 7f901dffb640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:35.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.381+0000 7ff629f70640 10 monclient(hunting): get_auth_request con 0x7ff624163950 auth_method 0 2026-02-17T11:10:35.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.381+0000 7ff629f70640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.381+0000 7ff629f70640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.381+0000 7ff629f70640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.381+0000 7f99ae575640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f99b0152700 0x7f99b015e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.381+0000 7ff13c838640 1 --2- 10.20.193.49:0/1130732492 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff13806e5b0 0x7ff1380ce390 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff138074110 tx=0x7ff12c02eed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5e8911097792ea5 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.382+0000 7f99ae575640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f99b0152700 0x7f99b015e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:33062/0 (socket says 10.20.193.49:33062) 2026-02-17T11:10:35.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.382+0000 7f99ae575640 1 -- 10.20.193.49:0/234970919 learned_addr learned my addr 10.20.193.49:0/234970919 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:35.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.382+0000 7f99ae575640 10 monclient(hunting): get_auth_request con 0x7f99b0152700 auth_method 0 2026-02-17T11:10:35.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.382+0000 7f99ae575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.382+0000 7f99ae575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.382+0000 7f99ae575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.404 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.382+0000 7ff629f70640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.404 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.382+0000 7ff629f70640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.404 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.382+0000 7ff629f70640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.404 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.382+0000 7f99ae575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.404 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.382+0000 7f99ae575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.404 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.382+0000 7f99ae575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.404 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.382+0000 7f99aed76640 1 --2- 10.20.193.49:0/234970919 >> v2:10.20.193.157:3300/0 conn(0x7f99b015edb0 0x7f99b00c9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.404 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.383+0000 7f99ae575640 10 monclient(hunting): handle_auth_done global_id 4476 payload 274 2026-02-17T11:10:35.404 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.383+0000 7f99ae575640 1 -- 10.20.193.49:0/234970919 >> v2:10.20.193.157:3300/0 conn(0x7f99b015edb0 msgr2=0x7f99b00c9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:35.404 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.383+0000 7f99ae575640 1 --2- 10.20.193.49:0/234970919 >> v2:10.20.193.157:3300/0 conn(0x7f99b015edb0 0x7f99b00c9e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.404 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.383+0000 7f99ae575640 1 -- 10.20.193.49:0/234970919 >> v1:10.20.193.97:6789/0 conn(0x7f99b0152ae0 legacy=0x7f99b00c9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:35.404 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.383+0000 7f99ae575640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.404 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.383+0000 7f99ae575640 1 monclient: found mon.noname-a 2026-02-17T11:10:35.404 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.383+0000 7f99ae575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.404 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.383+0000 7f99ae575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:10:35.404 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.383+0000 7f99ae575640 1 -- 10.20.193.49:0/234970919 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99b015dab0 con 0x7f99b0152700 2026-02-17T11:10:35.404 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.384+0000 7ff629f70640 10 monclient(hunting): handle_auth_done global_id 4473 payload 274 2026-02-17T11:10:35.404 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.384+0000 7ff629f70640 1 -- 10.20.193.49:0/3001156122 >> v2:10.20.193.97:3300/0 conn(0x7ff624164440 msgr2=0x7ff624161cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:35.404 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.384+0000 7ff629f70640 1 --2- 10.20.193.49:0/3001156122 >> v2:10.20.193.97:3300/0 conn(0x7ff624164440 0x7ff624161cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.404 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.385+0000 7ff629f70640 1 -- 10.20.193.49:0/3001156122 >> v1:10.20.193.157:6789/0 conn(0x7ff624161850 legacy=0x7ff624163d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.404 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.385+0000 7ff629f70640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.404 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.385+0000 7ff629f70640 1 monclient: found mon.noname-a 2026-02-17T11:10:35.405 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.385+0000 7ff629f70640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.405 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.385+0000 7ff629f70640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:10:35.405 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.385+0000 7ff629f70640 1 -- 10.20.193.49:0/3001156122 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff624069260 con 0x7ff624163950 2026-02-17T11:10:35.405 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.385+0000 7fede3fff640 1 -- 10.20.193.49:0/378958725 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede403c070 con 0x7fedf4155f00 2026-02-17T11:10:35.405 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.385+0000 7fede3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.405 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.385+0000 7fede3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:10:35.405 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.385+0000 7fede3fff640 10 monclient: dump: 2026-02-17T11:10:35.405 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.405 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.405 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.405 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.405 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.405 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.405 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.405 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.405 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.405 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.405 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.385+0000 7fede3fff640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.405 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.385+0000 7fede3fff640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.405 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.385+0000 7fede3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.405 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.385+0000 7fede3fff640 1 -- 10.20.193.49:0/378958725 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fede402fb40 con 0x7fedf4155f00 2026-02-17T11:10:35.405 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.385+0000 7fede3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.405 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.385+0000 7fede3fff640 1 -- 10.20.193.49:0/378958725 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede4037440 con 0x7fedf4155f00 2026-02-17T11:10:35.405 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.385+0000 7fede3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.405 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.385+0000 7fede3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:10:35.405 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.385+0000 7fede3fff640 10 monclient: dump: 2026-02-17T11:10:35.405 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.405 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.405 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.405 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.405 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.406 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.406 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.406 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.406 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.406 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.385+0000 7fedfb291640 5 monclient: authenticate success, global_id 4478 2026-02-17T11:10:35.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.385+0000 7fedfb291640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:35.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.385+0000 7fedfb291640 4 set_mon_vals no callback set 2026-02-17T11:10:35.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.386+0000 7fedfb291640 10 monclient: shutdown 2026-02-17T11:10:35.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.386+0000 7fedfb291640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:35.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.386+0000 7fedfb291640 1 -- 10.20.193.49:0/378958725 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fedf4155f00 msgr2=0x7fedf40ccc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.386+0000 7fedfb291640 1 --2- 10.20.193.49:0/378958725 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fedf4155f00 0x7fedf40ccc00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fedf4073410 tx=0x7fede402eed0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.386+0000 7fedfb291640 1 -- 10.20.193.49:0/378958725 shutdown_connections 2026-02-17T11:10:35.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.386+0000 7fedfb291640 1 --2- 10.20.193.49:0/378958725 >> v2:10.20.193.97:3300/0 conn(0x7fedf415c920 0x7fedf415f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.386+0000 7fedfb291640 1 --2- 10.20.193.49:0/378958725 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fedf4155f00 0x7fedf40ccc00 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.386+0000 7fedfb291640 1 -- 10.20.193.49:0/378958725 >> 10.20.193.49:0/378958725 conn(0x7fedf40cc0e0 msgr2=0x7fedf40cc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:35.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.386+0000 7f10d27fc640 1 --1- >> v1:10.20.193.49:6789/0 conn(0x7f10d40c48c0 0x7f10d40749b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.49:6789/0 says I am v1:10.20.193.49:50522/0 (socket says 10.20.193.49:50522) 2026-02-17T11:10:35.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.386+0000 7f10d27fc640 1 -- 10.20.193.49:0/2737788666 learned_addr learned my addr 10.20.193.49:0/2737788666 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:10:35.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.386+0000 7fedfb291640 1 -- 10.20.193.49:0/378958725 shutdown_connections 2026-02-17T11:10:35.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.386+0000 7ff629f70640 1 --2- 10.20.193.49:0/3001156122 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ff624163950 0x7ff6240cbac0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff6241614f0 tx=0x7ff61402ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=673438278dd62406 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.386+0000 7fedfb291640 1 -- 10.20.193.49:0/378958725 wait complete. 2026-02-17T11:10:35.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.386+0000 7fedfb291640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.386+0000 7fedfb291640 10 monclient: monmap: 2026-02-17T11:10:35.407 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.407 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:35.407 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:35.407 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:35.407 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.407 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.407 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:35.407 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:35.407 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:35.407 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.387+0000 7fedfb291640 1 librados: starting msgr at 2026-02-17T11:10:35.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.387+0000 7fedfb291640 1 librados: starting objecter 2026-02-17T11:10:35.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.387+0000 7fedfb291640 1 Processor -- start 2026-02-17T11:10:35.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.387+0000 7fedfb291640 1 -- start start 2026-02-17T11:10:35.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.387+0000 7fedfb291640 1 librados: setting wanted keys 2026-02-17T11:10:35.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.387+0000 7fedfb291640 1 librados: calling monclient init 2026-02-17T11:10:35.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.387+0000 7fedfb291640 10 monclient: init 2026-02-17T11:10:35.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.387+0000 7f99ae575640 1 --2- 10.20.193.49:0/234970919 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f99b0152700 0x7f99b015e870 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f99b00cbf90 tx=0x7f99a402eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffc8fc4349334e85 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.387+0000 7efc91ffb640 1 -- 10.20.193.49:0/2720979807 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc8403c070 con 0x7efc9406e5b0 2026-02-17T11:10:35.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.387+0000 7efc91ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.387+0000 7fedfb291640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.387+0000 7efc91ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:10:35.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.387+0000 7efc91ffb640 10 monclient: dump: 2026-02-17T11:10:35.407 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.407 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.407 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.408 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.408 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.408 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.408 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.408 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.408 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.408 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.387+0000 7efc91ffb640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.387+0000 7efc91ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.387+0000 7efc91ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.387+0000 7efc91ffb640 1 -- 10.20.193.49:0/2720979807 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc8402fe40 con 0x7efc9406e5b0 2026-02-17T11:10:35.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.387+0000 7efc91ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.387+0000 7efc91ffb640 1 -- 10.20.193.49:0/2720979807 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc84037660 con 0x7efc9406e5b0 2026-02-17T11:10:35.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.387+0000 7efc996b0640 5 monclient: authenticate success, global_id 4475 2026-02-17T11:10:35.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.387+0000 7efc996b0640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:35.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.387+0000 7efc996b0640 4 set_mon_vals no callback set 2026-02-17T11:10:35.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.387+0000 7efc91ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.387+0000 7efc91ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:10:35.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.387+0000 7efc91ffb640 10 monclient: dump: 2026-02-17T11:10:35.408 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.408 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.408 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.408 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.408 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.408 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.408 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.408 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.408 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.408 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.387+0000 7fedfb291640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:10:35.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.387+0000 7fedfb291640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fedf4155f00 0x7fedf4144a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.387+0000 7fedfb291640 10 monclient(hunting): picked mon.noname-a con 0x7fedf4155f00 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:35.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.387+0000 7fedfb291640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fedf41562e0 0x7fedf40c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.387+0000 7fedfb291640 10 monclient(hunting): picked mon.noname-c con 0x7fedf41562e0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:35.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.387+0000 7fedfb291640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fedf415c920 0x7fedf40c8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.387+0000 7fedfb291640 10 monclient(hunting): picked mon.noname-b con 0x7fedf415c920 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:35.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.387+0000 7fedfb291640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.387+0000 7fedfb291640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fedf40702b0 con 0x7fedf4155f00 2026-02-17T11:10:35.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.387+0000 7fedfb291640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.387+0000 7fedfb291640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fedf406ffd0 con 0x7fedf415c920 2026-02-17T11:10:35.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.388+0000 7fedfb291640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.388+0000 7fedfb291640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fedf4070590 con 0x7fedf41562e0 2026-02-17T11:10:35.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.388+0000 7fedfb291640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.388+0000 7fedfb291640 10 monclient(hunting): authenticate will time out at 1112.051042s 2026-02-17T11:10:35.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.388+0000 7efc996b0640 10 monclient: shutdown 2026-02-17T11:10:35.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.388+0000 7efc996b0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:35.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.388+0000 7efc996b0640 1 -- 10.20.193.49:0/2720979807 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7efc9406e5b0 msgr2=0x7efc940ce8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.388+0000 7efc996b0640 1 --2- 10.20.193.49:0/2720979807 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7efc9406e5b0 0x7efc940ce8d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7efc94074390 tx=0x7efc8402f1c0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.388+0000 7efc996b0640 1 -- 10.20.193.49:0/2720979807 shutdown_connections 2026-02-17T11:10:35.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.388+0000 7efc996b0640 1 --2- 10.20.193.49:0/2720979807 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7efc9406e5b0 0x7efc940ce8d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.388+0000 7efc996b0640 1 --2- 10.20.193.49:0/2720979807 >> v2:10.20.193.49:3300/0 conn(0x7efc940cdb50 0x7efc940ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.388+0000 7efc996b0640 1 --2- 10.20.193.49:0/2720979807 >> v2:10.20.193.97:3300/0 conn(0x7efc94155fb0 0x7efc940cd610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.388+0000 7efc996b0640 1 -- 10.20.193.49:0/2720979807 >> 10.20.193.49:0/2720979807 conn(0x7efc9406da90 msgr2=0x7efc9406dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:35.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.388+0000 7efc996b0640 1 -- 10.20.193.49:0/2720979807 shutdown_connections 2026-02-17T11:10:35.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.388+0000 7efc996b0640 1 -- 10.20.193.49:0/2720979807 wait complete. 2026-02-17T11:10:35.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.388+0000 7fbd495a8640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7fbd44155650 0x7fbd44074460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.388+0000 7fd09151d640 1 --2- 10.20.193.49:0/3732901702 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fd08c155d40 0x7fd08c156120 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd07c009970 tx=0x7fd07c02ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e6c8155318e3f34 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.388+0000 7fe1db7fe640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe1dc15e060 0x7fe1dc0ce760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.388+0000 7f99a5ffb640 1 -- 10.20.193.49:0/1840724848 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ac013020 con 0x7f99b80d1b60 2026-02-17T11:10:35.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.388+0000 7f99a5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.388+0000 7f99a5ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:10:35.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.388+0000 7f99a5ffb640 10 monclient: dump: 2026-02-17T11:10:35.410 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.410 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.410 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.410 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.410 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.410 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.410 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.410 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.410 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.410 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.388+0000 7f99a5ffb640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.388+0000 7f99a5ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.388+0000 7f99a5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.388+0000 7f99a5ffb640 1 -- 10.20.193.49:0/1840724848 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99ac004480 con 0x7f99b80d1b60 2026-02-17T11:10:35.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.388+0000 7f99a5ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.388+0000 7f99a5ffb640 1 -- 10.20.193.49:0/1840724848 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ac002920 con 0x7f99b80d1b60 2026-02-17T11:10:35.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.388+0000 7f99bf37e640 5 monclient: authenticate success, global_id 4484 2026-02-17T11:10:35.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.388+0000 7f99bf37e640 10 monclient: _renew_subs 2026-02-17T11:10:35.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.388+0000 7f99bf37e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:35.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.389+0000 7f99bf37e640 1 -- 10.20.193.49:0/1840724848 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99b814a570 con 0x7f99b80d1b60 2026-02-17T11:10:35.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.388+0000 7f99a77fe640 4 set_mon_vals no callback set 2026-02-17T11:10:35.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.389+0000 7f99a5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.389+0000 7f99a5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:10:35.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.389+0000 7f99a5ffb640 10 monclient: dump: 2026-02-17T11:10:35.411 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.411 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.411 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.411 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.411 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.411 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.411 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.411 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.411 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.411 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.389+0000 7f99bf37e640 10 client.4484.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:35.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.389+0000 7f99bf37e640 10 monclient: _renew_subs 2026-02-17T11:10:35.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.389+0000 7f99bf37e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:35.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.389+0000 7f99bf37e640 1 -- 10.20.193.49:0/1840724848 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99b814ab30 con 0x7f99b80d1b60 2026-02-17T11:10:35.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.389+0000 7f99bf37e640 1 librados: init done 2026-02-17T11:10:35.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.389+0000 7efc996b0640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.389+0000 7efc996b0640 10 monclient: monmap: 2026-02-17T11:10:35.411 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.411 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:35.411 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:35.411 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:35.411 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.411 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.411 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:35.411 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:35.411 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:35.411 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.389+0000 7fbd495a8640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7fbd44155650 0x7fbd44074460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:56032/0 (socket says 10.20.193.49:56032) 2026-02-17T11:10:35.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.389+0000 7fbd495a8640 1 -- 10.20.193.49:0/3448028675 learned_addr learned my addr 10.20.193.49:0/3448028675 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:35.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.389+0000 7fbd495a8640 10 monclient(hunting): get_auth_request con 0x7fbd44155650 auth_method 0 2026-02-17T11:10:35.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.389+0000 7fbd495a8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.389+0000 7fbd495a8640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.389+0000 7fbd495a8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.389+0000 7fedf9006640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fedf4155f00 0x7fedf4144a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.389+0000 7efc996b0640 1 librados: starting msgr at 2026-02-17T11:10:35.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.389+0000 7efc996b0640 1 librados: starting objecter 2026-02-17T11:10:35.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.389+0000 7efc996b0640 1 Processor -- start 2026-02-17T11:10:35.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.389+0000 7f99bf37e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:35.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.389+0000 7fe1db7fe640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe1dc15e060 0x7fe1dc0ce760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:33090/0 (socket says 10.20.193.49:33090) 2026-02-17T11:10:35.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.389+0000 7fe1db7fe640 1 -- 10.20.193.49:0/3862007712 learned_addr learned my addr 10.20.193.49:0/3862007712 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:35.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.389+0000 7fe1db7fe640 10 monclient(hunting): get_auth_request con 0x7fe1dc15e060 auth_method 0 2026-02-17T11:10:35.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.389+0000 7f99bf37e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:35.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.389+0000 7f99bf37e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:35.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.389+0000 7fe1db7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.389+0000 7fe1db7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.389+0000 7fe1db7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.389+0000 7efc996b0640 1 -- start start 2026-02-17T11:10:35.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.389+0000 7efc996b0640 1 librados: setting wanted keys 2026-02-17T11:10:35.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.389+0000 7efc996b0640 1 librados: calling monclient init 2026-02-17T11:10:35.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.389+0000 7efc996b0640 10 monclient: init 2026-02-17T11:10:35.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.389+0000 7f99bf37e640 1 -- 10.20.193.49:0/1840724848 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99b81f4140 con 0x7f99b80d1b60 2026-02-17T11:10:35.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.389+0000 7fedf9006640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fedf4155f00 0x7fedf4144a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:33114/0 (socket says 10.20.193.49:33114) 2026-02-17T11:10:35.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.389+0000 7fedf9006640 1 -- 10.20.193.49:0/1603394338 learned_addr learned my addr 10.20.193.49:0/1603394338 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:35.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.389+0000 7fedf9006640 10 monclient(hunting): get_auth_request con 0x7fedf4155f00 auth_method 0 2026-02-17T11:10:35.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.389+0000 7fedf9006640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.389+0000 7fedf9006640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.389+0000 7fedf9006640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.390+0000 7efc996b0640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.390+0000 7efc996b0640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:10:35.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.390+0000 7efc996b0640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7efc9406e5b0 0x7efc941f9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.390+0000 7efc996b0640 10 monclient(hunting): picked mon.noname-a con 0x7efc9406e5b0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:35.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.390+0000 7efc996b0640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7efc940cdb50 0x7efc9415c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.390+0000 7efc996b0640 10 monclient(hunting): picked mon.noname-c con 0x7efc940cdb50 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:35.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.390+0000 7efc996b0640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7efc94155fb0 0x7efc94159ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.390+0000 7efc996b0640 10 monclient(hunting): picked mon.noname-b con 0x7efc94155fb0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:35.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.390+0000 7efc996b0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.390+0000 7efc996b0640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7efc941603d0 con 0x7efc9406e5b0 2026-02-17T11:10:35.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.390+0000 7efc996b0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.390+0000 7efc996b0640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7efc94156390 con 0x7efc94155fb0 2026-02-17T11:10:35.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.390+0000 7efc996b0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.390+0000 7efc996b0640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7efc9408f9d0 con 0x7efc940cdb50 2026-02-17T11:10:35.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.390+0000 7efc996b0640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.390+0000 7efc996b0640 10 monclient(hunting): authenticate will time out at 1112.053265s 2026-02-17T11:10:35.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.390+0000 7fe1db7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.390+0000 7fe1db7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.390+0000 7fe1db7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.391+0000 7fbd495a8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.391+0000 7fbd495a8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.391+0000 7fbd495a8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.391+0000 7ff127fff640 1 -- 10.20.193.49:0/1130732492 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff12c03c070 con 0x7ff13806e5b0 2026-02-17T11:10:35.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.391+0000 7ff127fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.391+0000 7ff127fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:10:35.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.391+0000 7ff127fff640 10 monclient: dump: 2026-02-17T11:10:35.415 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.415 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.415 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.415 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.415 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.415 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.415 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.415 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.415 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.415 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.391+0000 7ff127fff640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.391+0000 7ff127fff640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.391+0000 7ff127fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.391+0000 7ff127fff640 1 -- 10.20.193.49:0/1130732492 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff12c02fb40 con 0x7ff13806e5b0 2026-02-17T11:10:35.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.391+0000 7ff127fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.391+0000 7ff127fff640 1 -- 10.20.193.49:0/1130732492 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff12c037440 con 0x7ff13806e5b0 2026-02-17T11:10:35.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.391+0000 7ff13f2c4640 5 monclient: authenticate success, global_id 4487 2026-02-17T11:10:35.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.391+0000 7ff127fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.391+0000 7ff127fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:10:35.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.391+0000 7ff127fff640 10 monclient: dump: 2026-02-17T11:10:35.415 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.415 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.415 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.415 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.415 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.415 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.415 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.415 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.415 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.415 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.391+0000 7ff13f2c4640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:35.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.391+0000 7ff13f2c4640 4 set_mon_vals no callback set 2026-02-17T11:10:35.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.391+0000 7ff13f2c4640 10 monclient: shutdown 2026-02-17T11:10:35.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.391+0000 7ff13f2c4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:35.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.391+0000 7ff13f2c4640 1 -- 10.20.193.49:0/1130732492 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff13806e5b0 msgr2=0x7ff1380ce390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.391+0000 7ff13f2c4640 1 --2- 10.20.193.49:0/1130732492 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff13806e5b0 0x7ff1380ce390 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff138074110 tx=0x7ff12c02eed0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.391+0000 7ff13f2c4640 1 -- 10.20.193.49:0/1130732492 shutdown_connections 2026-02-17T11:10:35.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.391+0000 7ff13f2c4640 1 --2- 10.20.193.49:0/1130732492 >> v2:10.20.193.97:3300/0 conn(0x7ff1380ce8d0 0x7ff13815f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.391+0000 7ff13f2c4640 1 --2- 10.20.193.49:0/1130732492 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff13806e5b0 0x7ff1380ce390 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.391+0000 7ff13f2c4640 1 -- 10.20.193.49:0/1130732492 >> 10.20.193.49:0/1130732492 conn(0x7ff13806da90 msgr2=0x7ff13806dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:35.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.391+0000 7ff13f2c4640 1 -- 10.20.193.49:0/1130732492 shutdown_connections 2026-02-17T11:10:35.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.392+0000 7ff13f2c4640 1 -- 10.20.193.49:0/1130732492 wait complete. 2026-02-17T11:10:35.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.392+0000 7ff13f2c4640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.392+0000 7ff13f2c4640 10 monclient: monmap: 2026-02-17T11:10:35.416 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.416 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:35.416 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:35.416 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:35.416 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.416 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.416 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:35.416 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:35.416 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:35.416 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.392+0000 7f3efe575640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f3f00152700 0x7f3f0015b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.392+0000 7ff13f2c4640 1 librados: starting msgr at 2026-02-17T11:10:35.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.392+0000 7ff13f2c4640 1 librados: starting objecter 2026-02-17T11:10:35.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.392+0000 7ff13f2c4640 1 Processor -- start 2026-02-17T11:10:35.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.392+0000 7ff13f2c4640 1 -- start start 2026-02-17T11:10:35.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.392+0000 7ff13f2c4640 1 librados: setting wanted keys 2026-02-17T11:10:35.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.392+0000 7ff13f2c4640 1 librados: calling monclient init 2026-02-17T11:10:35.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.392+0000 7ff13f2c4640 10 monclient: init 2026-02-17T11:10:35.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.393+0000 7ff13f2c4640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.393+0000 7ff13f2c4640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:10:35.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.393+0000 7ff13f2c4640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7ff13806e5b0 0x7ff1381f46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.393+0000 7ff13f2c4640 10 monclient(hunting): picked mon.noname-b con 0x7ff13806e5b0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:35.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.393+0000 7ff13f2c4640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ff1380ce8d0 0x7ff138145b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.393+0000 7ff13f2c4640 10 monclient(hunting): picked mon.noname-a con 0x7ff1380ce8d0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:35.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.393+0000 7ff13f2c4640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff138155fb0 0x7ff13814aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.393+0000 7ff13f2c4640 10 monclient(hunting): picked mon.noname-c con 0x7ff138155fb0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:35.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.393+0000 7ff13f2c4640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.393+0000 7ff13f2c4640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff138156390 con 0x7ff1380ce8d0 2026-02-17T11:10:35.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.393+0000 7ff13f2c4640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.393+0000 7ff13f2c4640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7ff1380cd320 con 0x7ff13806e5b0 2026-02-17T11:10:35.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.393+0000 7ff13f2c4640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.393+0000 7ff13f2c4640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7ff1381603d0 con 0x7ff138155fb0 2026-02-17T11:10:35.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.393+0000 7ff13f2c4640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.393+0000 7ff13f2c4640 10 monclient(hunting): authenticate will time out at 1112.056274s 2026-02-17T11:10:35.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.395+0000 7fbd495a8640 10 monclient(hunting): handle_auth_done global_id 4493 payload 274 2026-02-17T11:10:35.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.396+0000 7fbd495a8640 1 -- 10.20.193.49:0/3448028675 >> v1:10.20.193.157:6789/0 conn(0x7fbd44155270 legacy=0x7fbd44073cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:35.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.396+0000 7fbd495a8640 1 -- 10.20.193.49:0/3448028675 >> v1:10.20.193.97:6789/0 conn(0x7fbd4406d4f0 legacy=0x7fbd44157f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:35.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.396+0000 7fbd495a8640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.396+0000 7fbd495a8640 1 monclient: found mon.noname-c 2026-02-17T11:10:35.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.396+0000 7fbd495a8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.396+0000 7fbd495a8640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:10:35.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.396+0000 7fbd495a8640 1 -- 10.20.193.49:0/3448028675 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd441588a0 con 0x7fbd44155650 2026-02-17T11:10:35.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.396+0000 7fe1daffd640 1 --2- 10.20.193.49:0/3862007712 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe1dc0d1b60 0x7fe1dc1f4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.396+0000 7f3efdd74640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f3f00152ae0 0x7f3f001f3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.397+0000 7f901dffb640 1 -- 10.20.193.49:0/2812003517 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9024004480 con 0x7f903015c840 2026-02-17T11:10:35.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.397+0000 7f901dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.397+0000 7f901dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:10:35.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.397+0000 7f901dffb640 10 monclient: dump: 2026-02-17T11:10:35.418 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.418 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.418 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.418 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.418 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.418 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.418 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.418 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.418 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.418 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.397+0000 7f901dffb640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.397+0000 7f901dffb640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.397+0000 7f901dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.397+0000 7f901dffb640 1 -- 10.20.193.49:0/2812003517 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9024014070 con 0x7f903015c840 2026-02-17T11:10:35.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.397+0000 7f901dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.397+0000 7f901dffb640 1 -- 10.20.193.49:0/2812003517 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9024002920 con 0x7f903015c840 2026-02-17T11:10:35.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.397+0000 7f901dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.397+0000 7f901dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:10:35.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.397+0000 7f901dffb640 10 monclient: dump: 2026-02-17T11:10:35.418 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.419 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.419 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.419 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.419 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.419 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.419 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.419 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.419 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.419 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.397+0000 7f9037298640 5 monclient: authenticate success, global_id 4470 2026-02-17T11:10:35.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.397+0000 7f901f7fe640 4 set_mon_vals no callback set 2026-02-17T11:10:35.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.397+0000 7f9037298640 10 monclient: _renew_subs 2026-02-17T11:10:35.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.397+0000 7f9037298640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:35.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.397+0000 7f9037298640 1 -- 10.20.193.49:0/2812003517 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90301f88c0 con 0x7f903015c840 2026-02-17T11:10:35.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.397+0000 7f9037298640 10 client.4470.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:35.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.397+0000 7f9037298640 10 monclient: _renew_subs 2026-02-17T11:10:35.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.397+0000 7f9037298640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:35.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.397+0000 7f9037298640 1 -- 10.20.193.49:0/2812003517 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90301f8e80 con 0x7f903015c840 2026-02-17T11:10:35.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.397+0000 7f9037298640 1 librados: init done 2026-02-17T11:10:35.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.397+0000 7fedf9006640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.397+0000 7fedf9006640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.397+0000 7fedf9006640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.397+0000 7f3efe575640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f3f00152700 0x7f3f0015b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:33104/0 (socket says 10.20.193.49:33104) 2026-02-17T11:10:35.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.397+0000 7f3efe575640 1 -- 10.20.193.49:0/3724416512 learned_addr learned my addr 10.20.193.49:0/3724416512 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:35.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.397+0000 7f3efe575640 10 monclient(hunting): get_auth_request con 0x7f3f00152700 auth_method 0 2026-02-17T11:10:35.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.397+0000 7f3efe575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.397+0000 7f3efe575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.397+0000 7f3efe575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.420 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.397+0000 7f9037298640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:35.420 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.397+0000 7f9037298640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:35.420 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.397+0000 7f9037298640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:35.420 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.397+0000 7f9037298640 1 -- 10.20.193.49:0/2812003517 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90300727e0 con 0x7f903015c840 2026-02-17T11:10:35.420 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.413+0000 7fc7894b6640 10 monclient: get_monmap_and_config 2026-02-17T11:10:35.420 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.413+0000 7fc7894b6640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.420 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.413+0000 7fc7894b6640 10 monclient: monmap: 2026-02-17T11:10:35.420 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.420 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.420 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:35.413908+0000 2026-02-17T11:10:35.420 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:35.413908+0000 2026-02-17T11:10:35.420 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.420 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.420 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:35.420 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:35.420 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:35.420 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:35.420 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:35.420 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:35.420 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.420 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.413+0000 7fc7894b6640 1 Processor -- start 2026-02-17T11:10:35.420 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.413+0000 7fc7894b6640 1 -- start start 2026-02-17T11:10:35.420 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.413+0000 7fc7894b6640 10 monclient: init 2026-02-17T11:10:35.420 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.413+0000 7f26ef6d1640 10 monclient: get_monmap_and_config 2026-02-17T11:10:35.420 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.413+0000 7f26ef6d1640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.420 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.413+0000 7f26ef6d1640 10 monclient: monmap: 2026-02-17T11:10:35.421 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.421 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.421 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:35.414470+0000 2026-02-17T11:10:35.421 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:35.414470+0000 2026-02-17T11:10:35.421 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.421 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.421 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:35.421 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:35.421 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:35.421 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:35.421 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:35.421 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:35.421 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.414+0000 7fc7894b6640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.414+0000 7fc7894b6640 10 monclient: _add_conns ranks=[0,3,2,1,4,5] 2026-02-17T11:10:35.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.414+0000 7fc7894b6640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc784155d40 addr v1:10.20.193.49:6789/0 2026-02-17T11:10:35.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.414+0000 7fc7894b6640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fc7840ccc00 0x7fc784156120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.414+0000 7fc7894b6640 10 monclient(hunting): picked mon.noname-a con 0x7fc7840ccc00 addr v2:10.20.193.49:3300/0 2026-02-17T11:10:35.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.414+0000 7fc7894b6640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fc7840caff0 addr v1:10.20.193.157:6789/0 2026-02-17T11:10:35.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.414+0000 7fc7894b6640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc78415c8d0 con 0x7fc784155d40 2026-02-17T11:10:35.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.414+0000 7fc7894b6640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc78415cbb0 con 0x7fc7840caff0 2026-02-17T11:10:35.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.414+0000 7fc7894b6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.414+0000 7fc7894b6640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7fc78406c890 con 0x7fc7840ccc00 2026-02-17T11:10:35.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.414+0000 7fc7894b6640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.414+0000 7fc7894b6640 10 monclient(hunting): authenticate will time out at 1112.077415s 2026-02-17T11:10:35.422 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.414+0000 7f26ef6d1640 1 Processor -- start 2026-02-17T11:10:35.422 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.414+0000 7f26ef6d1640 1 -- start start 2026-02-17T11:10:35.422 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.414+0000 7f26ef6d1640 10 monclient: init 2026-02-17T11:10:35.422 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.415+0000 7f26ef6d1640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.422 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.415+0000 7f26ef6d1640 10 monclient: _add_conns ranks=[4,3,1,0,5,2] 2026-02-17T11:10:35.422 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.415+0000 7f26ef6d1640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f26e815a370 0x7f26e80cba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.422 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.415+0000 7f26ef6d1640 10 monclient(hunting): picked mon.noname-b con 0x7f26e815a370 addr v2:10.20.193.97:3300/0 2026-02-17T11:10:35.422 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.415+0000 7f26ef6d1640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f26e81603c0 0x7f26e80d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.422 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.415+0000 7f26ef6d1640 10 monclient(hunting): picked mon.noname-a con 0x7f26e81603c0 addr v2:10.20.193.49:3300/0 2026-02-17T11:10:35.422 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.415+0000 7f26ef6d1640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f26e815a750 addr v1:10.20.193.97:6789/0 2026-02-17T11:10:35.422 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.415+0000 7f26ef6d1640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26e80c8e10 con 0x7f26e815a750 2026-02-17T11:10:35.422 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.415+0000 7f26ef6d1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.422 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.415+0000 7f26ef6d1640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f26e80d1f20 con 0x7f26e81603c0 2026-02-17T11:10:35.422 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.415+0000 7f26ef6d1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.422 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.415+0000 7f26ef6d1640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f26e80d2200 con 0x7f26e815a370 2026-02-17T11:10:35.422 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.415+0000 7f26ef6d1640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.422 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.415+0000 7f26ef6d1640 10 monclient(hunting): authenticate will time out at 1112.078205s 2026-02-17T11:10:35.473 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.472+0000 7f3299ffb640 1 -- 10.20.193.49:0/3484434986 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f32a0013610 con 0x7f32ac06f700 2026-02-17T11:10:35.473 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.472+0000 7f3299ffb640 1 --2- 10.20.193.49:0/3484434986 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f327c0791c0 0x7f327c07b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.472+0000 7f32b125d640 1 --2- 10.20.193.49:0/3484434986 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f327c0791c0 0x7f327c07b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.472+0000 7f32b125d640 10 monclient: get_auth_request con 0x7f327c0791c0 auth_method 0 2026-02-17T11:10:35.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.473+0000 7f3299ffb640 10 client.4471.objecter ms_handle_connect 0x7f327c0791c0 2026-02-17T11:10:35.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.473+0000 7f32b125d640 1 --2- 10.20.193.49:0/3484434986 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f327c0791c0 0x7f327c07b680 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f329c002f50 tx=0x7f329c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.474+0000 7f3299ffb640 1 -- 10.20.193.49:0/3484434986 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7f32a005e6d0 con 0x7f32ac06f700 2026-02-17T11:10:35.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.474+0000 7f3299ffb640 10 client.4471.objecter ms_dispatch2 0x7f32ac000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:35.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.474+0000 7f3299ffb640 3 client.4471.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:35.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.474+0000 7f3299ffb640 3 client.4471.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:35.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.474+0000 7f3299ffb640 20 client.4471.objecter dump_active .. 0 homeless 2026-02-17T11:10:35.482 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.481+0000 7f3299ffb640 1 -- 10.20.193.49:0/3484434986 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f32ac06cfa0 con 0x7f32ac06f700 2026-02-17T11:10:35.482 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.481+0000 7f3299ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:35.482 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.481+0000 7f3299ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:35.485 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.484+0000 7f3efed76640 1 --2- 10.20.193.49:0/3724416512 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f3f0015ef80 0x7f3f00148100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.485 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.484+0000 7fe1da7fc640 1 --2- 10.20.193.49:0/3862007712 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe1dc0d1f40 0x7fe1dc0cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.486 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.484+0000 7f3efed76640 10 monclient(hunting): get_auth_request con 0x7f3f0015ef80 auth_method 0 2026-02-17T11:10:35.486 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.484+0000 7f3efed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.486 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.484+0000 7f3efed76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.486 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.484+0000 7f3efed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.486 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.485+0000 7fe1da7fc640 10 monclient(hunting): get_auth_request con 0x7fe1dc0d1f40 auth_method 0 2026-02-17T11:10:35.486 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.485+0000 7fe1da7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.486 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.485+0000 7fe1da7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.486 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.485+0000 7fe1da7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.487 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.486+0000 7f3efed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.487 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.486+0000 7f3efed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.487 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.486+0000 7f3efed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.488 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.487+0000 7fe1da7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.488 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.487+0000 7fe1da7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.488 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.487+0000 7fe1da7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.490 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.488+0000 7f3efed76640 10 monclient(hunting): handle_auth_done global_id 4480 payload 824 2026-02-17T11:10:35.490 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.488+0000 7f3efed76640 1 -- 10.20.193.49:0/3724416512 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f3f00152ae0 msgr2=0x7f3f001f3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.490 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.488+0000 7f3efed76640 1 --2- 10.20.193.49:0/3724416512 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f3f00152ae0 0x7f3f001f3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.490 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.488+0000 7f3efed76640 1 -- 10.20.193.49:0/3724416512 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f3f00152700 msgr2=0x7f3f0015b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.490 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.488+0000 7f3efed76640 1 --2- 10.20.193.49:0/3724416512 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f3f00152700 0x7f3f0015b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.490 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.488+0000 7f3efed76640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.490 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.488+0000 7f3efed76640 1 monclient: found mon.noname-b 2026-02-17T11:10:35.490 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.488+0000 7f3efed76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.490 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.488+0000 7f3efed76640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.490 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.488+0000 7f3efed76640 1 -- 10.20.193.49:0/3724416512 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f0015a130 con 0x7f3f0015ef80 2026-02-17T11:10:35.491 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.490+0000 7fe1da7fc640 10 monclient(hunting): handle_auth_done global_id 4483 payload 824 2026-02-17T11:10:35.492 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.490+0000 7fe1da7fc640 1 -- 10.20.193.49:0/3862007712 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe1dc0d1b60 msgr2=0x7fe1dc1f4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.492 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.490+0000 7fe1da7fc640 1 --2- 10.20.193.49:0/3862007712 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe1dc0d1b60 0x7fe1dc1f4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.492 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.490+0000 7fe1da7fc640 1 -- 10.20.193.49:0/3862007712 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe1dc15e060 msgr2=0x7fe1dc0ce760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.492 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.490+0000 7fe1da7fc640 1 --2- 10.20.193.49:0/3862007712 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe1dc15e060 0x7fe1dc0ce760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.492 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.490+0000 7fe1da7fc640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.492 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.490+0000 7fe1da7fc640 1 monclient: found mon.noname-b 2026-02-17T11:10:35.492 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.490+0000 7fe1da7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.492 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.490+0000 7fe1da7fc640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.492 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.490+0000 7fe1da7fc640 1 -- 10.20.193.49:0/3862007712 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1dc15ae50 con 0x7fe1dc0d1f40 2026-02-17T11:10:35.493 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.492+0000 7fe1da7fc640 1 --2- 10.20.193.49:0/3862007712 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe1dc0d1f40 0x7fe1dc0cf9b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe1c400c460 tx=0x7fe1c400c930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.494 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.492+0000 7fe1b3fff640 10 client.?.objecter ms_handle_connect 0x7fe1dc0d1f40 2026-02-17T11:10:35.494 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.492+0000 7fe1b3fff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:35.494 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.492+0000 7f3efed76640 1 --2- 10.20.193.49:0/3724416512 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f3f0015ef80 0x7f3f00148100 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3ef0035000 tx=0x7f3ef0004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.494 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.492+0000 7f3ee6ffd640 10 client.?.objecter ms_handle_connect 0x7f3f0015ef80 2026-02-17T11:10:35.494 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.492+0000 7f3ee6ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:35.495 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.493+0000 7fbd495a8640 1 --2- 10.20.193.49:0/3448028675 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fbd44155650 0x7fbd44074460 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbd44072350 tx=0x7fbd3402efb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a06e4bd150b08f2a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.495 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.494+0000 7fedf9807640 1 --2- 10.20.193.49:0/1603394338 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fedf415c920 0x7fedf40c8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.496 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.494+0000 7ff13d039640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7ff13806e5b0 0x7ff1381f46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.496 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.495+0000 7fedf9807640 10 monclient(hunting): get_auth_request con 0x7fedf415c920 auth_method 0 2026-02-17T11:10:35.496 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.495+0000 7fedf9807640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.496 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.495+0000 7fedf9807640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.496 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.495+0000 7fedf9807640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.497 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.495+0000 7ff13d039640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7ff13806e5b0 0x7ff1381f46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:48340/0 (socket says 10.20.193.49:48340) 2026-02-17T11:10:35.497 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.495+0000 7ff13d039640 1 -- 10.20.193.49:0/2386248712 learned_addr learned my addr 10.20.193.49:0/2386248712 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:35.497 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.496+0000 7ff13d039640 10 monclient(hunting): get_auth_request con 0x7ff13806e5b0 auth_method 0 2026-02-17T11:10:35.497 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.496+0000 7ff13d039640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.497 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.496+0000 7ff13d039640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.497 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.496+0000 7ff13d039640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.498 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.496+0000 7fedf9807640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.498 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.496+0000 7fedf9807640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.498 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.496+0000 7fedf9807640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.498 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.496+0000 7fedf9006640 10 monclient(hunting): handle_auth_done global_id 4485 payload 824 2026-02-17T11:10:35.498 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.496+0000 7fedf9006640 1 -- 10.20.193.49:0/1603394338 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fedf41562e0 msgr2=0x7fedf40c85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.498 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.496+0000 7fedf9006640 1 --2- 10.20.193.49:0/1603394338 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fedf41562e0 0x7fedf40c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.498 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.496+0000 7fedf9006640 1 -- 10.20.193.49:0/1603394338 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fedf415c920 msgr2=0x7fedf40c8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.498 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.496+0000 7fedf9006640 1 --2- 10.20.193.49:0/1603394338 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fedf415c920 0x7fedf40c8af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.498 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.496+0000 7fedf9006640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.498 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.496+0000 7fedf9006640 1 monclient: found mon.noname-a 2026-02-17T11:10:35.498 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.496+0000 7fedf9006640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.498 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.496+0000 7fedf9006640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:10:35.498 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.496+0000 7fedf9006640 1 -- 10.20.193.49:0/1603394338 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedf41f4b00 con 0x7fedf4155f00 2026-02-17T11:10:35.498 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.496+0000 7f10d2ffd640 1 --2- 10.20.193.49:0/2737788666 >> v2:10.20.193.97:3300/0 conn(0x7f10d40c7170 0x7f10d40c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.499 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.496+0000 7ff13d039640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.499 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.496+0000 7ff13d039640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.499 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.496+0000 7ff13d039640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.499 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.498+0000 7f10d2ffd640 10 monclient(hunting): get_auth_request con 0x7f10d40c7170 auth_method 0 2026-02-17T11:10:35.499 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.498+0000 7f10d2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.499 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.498+0000 7f10d2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.499 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.498+0000 7f10d2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.500 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.499+0000 7ff13d039640 10 monclient(hunting): handle_auth_done global_id 4489 payload 824 2026-02-17T11:10:35.501 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.499+0000 7ff13d039640 1 -- 10.20.193.49:0/2386248712 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff138155fb0 msgr2=0x7ff13814aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.501 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.499+0000 7ff13d039640 1 --2- 10.20.193.49:0/2386248712 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff138155fb0 0x7ff13814aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.501 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.499+0000 7ff13d039640 1 -- 10.20.193.49:0/2386248712 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ff1380ce8d0 msgr2=0x7ff138145b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.501 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.499+0000 7ff13d039640 1 --2- 10.20.193.49:0/2386248712 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ff1380ce8d0 0x7ff138145b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.501 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.499+0000 7ff13d039640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.501 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.499+0000 7ff13d039640 1 monclient: found mon.noname-b 2026-02-17T11:10:35.501 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.499+0000 7ff13d039640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.501 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.499+0000 7ff13d039640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.501 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.499+0000 7ff13d039640 1 -- 10.20.193.49:0/2386248712 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1380d0a10 con 0x7ff13806e5b0 2026-02-17T11:10:35.502 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.501+0000 7efc937fe640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7efc94155fb0 0x7efc94159ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.502 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.501+0000 7f10d2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.503 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.501+0000 7f10d2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.503 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.501+0000 7f10d2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.503 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.501+0000 7ff13d039640 1 --2- 10.20.193.49:0/2386248712 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7ff13806e5b0 0x7ff1381f46d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff12800b4d0 tx=0x7ff12800b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.503 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.501+0000 7ff125ffb640 10 client.?.objecter ms_handle_connect 0x7ff13806e5b0 2026-02-17T11:10:35.503 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.501+0000 7ff125ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:35.503 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.502+0000 7efc937fe640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7efc94155fb0 0x7efc94159ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:48328/0 (socket says 10.20.193.49:48328) 2026-02-17T11:10:35.503 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.502+0000 7efc937fe640 1 -- 10.20.193.49:0/1047109506 learned_addr learned my addr 10.20.193.49:0/1047109506 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:35.503 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.502+0000 7efc937fe640 10 monclient(hunting): get_auth_request con 0x7efc94155fb0 auth_method 0 2026-02-17T11:10:35.503 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.502+0000 7efc937fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.503 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.502+0000 7efc937fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.503 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.502+0000 7efc937fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.504 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.502+0000 7f10d2ffd640 10 monclient(hunting): handle_auth_done global_id 4492 payload 274 2026-02-17T11:10:35.504 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.502+0000 7f10d2ffd640 1 -- 10.20.193.49:0/2737788666 >> v1:10.20.193.97:6789/0 conn(0x7f10d40c4d10 legacy=0x7f10d40c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:35.504 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.502+0000 7f10d2ffd640 1 -- 10.20.193.49:0/2737788666 >> v1:10.20.193.49:6789/0 conn(0x7f10d40c48c0 legacy=0x7f10d40749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.504 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.502+0000 7f10d2ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.504 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.502+0000 7f10d2ffd640 1 monclient: found mon.noname-b 2026-02-17T11:10:35.504 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.502+0000 7f10d2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.504 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.502+0000 7f10d2ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.504 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.502+0000 7f10d2ffd640 1 -- 10.20.193.49:0/2737788666 --> v2:10.20.193.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10d40c5550 con 0x7f10d40c7170 2026-02-17T11:10:35.505 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.503+0000 7f99a5ffb640 1 -- 10.20.193.49:0/1840724848 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f99ac002ac0 con 0x7f99b80d1b60 2026-02-17T11:10:35.505 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.503+0000 7f99a5ffb640 1 --2- 10.20.193.49:0/1840724848 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f9988079190 0x7f998807b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.505 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.503+0000 7efc937fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.505 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.503+0000 7efc937fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.505 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.503+0000 7efc937fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.505 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.503+0000 7f99bd0f3640 1 --2- 10.20.193.49:0/1840724848 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f9988079190 0x7f998807b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.505 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.504+0000 7f99bd0f3640 10 monclient: get_auth_request con 0x7f9988079190 auth_method 0 2026-02-17T11:10:35.506 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.505+0000 7f99bd0f3640 1 --2- 10.20.193.49:0/1840724848 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f9988079190 0x7f998807b650 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f99a8006b90 tx=0x7f99a8006b20 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.506 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.505+0000 7f99a5ffb640 10 client.4484.objecter ms_handle_connect 0x7f9988079190 2026-02-17T11:10:35.507 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.505+0000 7f99a5ffb640 1 -- 10.20.193.49:0/1840724848 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7f99ac05e110 con 0x7f99b80d1b60 2026-02-17T11:10:35.507 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.505+0000 7f99a5ffb640 10 client.4484.objecter ms_dispatch2 0x7f99b8000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:35.507 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.505+0000 7f99a5ffb640 3 client.4484.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:35.507 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.505+0000 7f99a5ffb640 3 client.4484.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:35.507 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.506+0000 7f99a5ffb640 20 client.4484.objecter dump_active .. 0 homeless 2026-02-17T11:10:35.507 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.506+0000 7efc937fe640 10 monclient(hunting): handle_auth_done global_id 4495 payload 824 2026-02-17T11:10:35.507 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.506+0000 7efc937fe640 1 -- 10.20.193.49:0/1047109506 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7efc940cdb50 msgr2=0x7efc9415c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.507 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.506+0000 7efc937fe640 1 --2- 10.20.193.49:0/1047109506 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7efc940cdb50 0x7efc9415c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.507 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.506+0000 7efc937fe640 1 -- 10.20.193.49:0/1047109506 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7efc9406e5b0 msgr2=0x7efc941f9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.507 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.506+0000 7efc937fe640 1 --2- 10.20.193.49:0/1047109506 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7efc9406e5b0 0x7efc941f9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.508 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.506+0000 7efc937fe640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.508 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.506+0000 7efc937fe640 1 monclient: found mon.noname-b 2026-02-17T11:10:35.508 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.506+0000 7efc937fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.508 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.506+0000 7efc937fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.508 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.506+0000 7efc937fe640 1 -- 10.20.193.49:0/1047109506 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc941f9560 con 0x7efc94155fb0 2026-02-17T11:10:35.508 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.506+0000 7f10d2ffd640 1 --2- 10.20.193.49:0/2737788666 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f10d40c7170 0x7f10d40c7550 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f10c80098a0 tx=0x7f10c802ee10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f44c729ebcc44bb0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.509 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.507+0000 7efc937fe640 1 --2- 10.20.193.49:0/1047109506 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7efc94155fb0 0x7efc94159ff0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efc8403a040 tx=0x7efc84004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.509 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.507+0000 7efc737fe640 10 client.?.objecter ms_handle_connect 0x7efc94155fb0 2026-02-17T11:10:35.509 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.507+0000 7efc737fe640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:35.509 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.508+0000 7f26ed446640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f26e815a370 0x7f26e80cba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.509 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.508+0000 7f26ed446640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f26e815a370 0x7f26e80cba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:48348/0 (socket says 10.20.193.49:48348) 2026-02-17T11:10:35.509 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.508+0000 7f26ed446640 1 -- 10.20.193.49:0/2083608995 learned_addr learned my addr 10.20.193.49:0/2083608995 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:35.509 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.508+0000 7f26ed446640 10 monclient(hunting): get_auth_request con 0x7f26e815a370 auth_method 0 2026-02-17T11:10:35.509 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.508+0000 7f26ed446640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.509 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.508+0000 7f26ed446640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.509 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.508+0000 7f26ed446640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.511 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.510+0000 7f26ed446640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.511 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.510+0000 7f26ed446640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.511 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.510+0000 7f26ed446640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.513 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.512+0000 7f99a5ffb640 1 -- 10.20.193.49:0/1840724848 <== mon.2 v2:10.20.193.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f99ac01d020 con 0x7f99b80d1b60 2026-02-17T11:10:35.513 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.512+0000 7f99a5ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:35.513 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.512+0000 7f99a5ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:35.514 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.512+0000 7f3ee6ffd640 1 -- 10.20.193.49:0/3724416512 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef0046020 con 0x7f3f0015ef80 2026-02-17T11:10:35.514 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.512+0000 7f3ee6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.514 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.512+0000 7f3ee6ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:10:35.514 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.512+0000 7f3ee6ffd640 10 monclient: dump: 2026-02-17T11:10:35.514 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.514 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.514 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.514 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.514 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.514 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.514 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.514 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.514 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.514 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.514 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.512+0000 7f3ee6ffd640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.514 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.512+0000 7f3ee6ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.514 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.512+0000 7f3ee6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.515 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.512+0000 7f3ee6ffd640 1 -- 10.20.193.49:0/3724416512 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ef0037de0 con 0x7f3f0015ef80 2026-02-17T11:10:35.515 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.512+0000 7f3ee6ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.515 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.512+0000 7f3ee6ffd640 1 -- 10.20.193.49:0/3724416512 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef00416b0 con 0x7f3f0015ef80 2026-02-17T11:10:35.515 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.512+0000 7f3f04ee2640 5 monclient: authenticate success, global_id 4480 2026-02-17T11:10:35.515 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.512+0000 7f3efcd72640 4 set_mon_vals no callback set 2026-02-17T11:10:35.515 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.512+0000 7f3f04ee2640 10 monclient: _renew_subs 2026-02-17T11:10:35.515 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.512+0000 7f3f04ee2640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.515 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.512+0000 7f3f04ee2640 1 -- 10.20.193.49:0/3724416512 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f0015a410 con 0x7f3f0015ef80 2026-02-17T11:10:35.515 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.512+0000 7f3ee6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.515 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.512+0000 7f3ee6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:35.515 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.512+0000 7f3ee6ffd640 10 monclient: dump: 2026-02-17T11:10:35.515 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.515 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.515 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.515 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.515 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.515 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.515 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.515 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.516 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.516 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.516 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.512+0000 7f3f04ee2640 10 client.4480.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:35.516 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.512+0000 7f3f04ee2640 10 monclient: _renew_subs 2026-02-17T11:10:35.516 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.512+0000 7f3f04ee2640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.516 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.512+0000 7f3f04ee2640 1 -- 10.20.193.49:0/3724416512 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f0015a9d0 con 0x7f3f0015ef80 2026-02-17T11:10:35.516 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.512+0000 7f3f04ee2640 1 librados: init done 2026-02-17T11:10:35.516 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.512+0000 7ff125ffb640 1 -- 10.20.193.49:0/2386248712 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff128004480 con 0x7ff13806e5b0 2026-02-17T11:10:35.517 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.512+0000 7ff125ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.517 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.512+0000 7ff125ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:10:35.517 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.512+0000 7ff125ffb640 10 monclient: dump: 2026-02-17T11:10:35.517 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.517 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.517 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.517 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.517 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.517 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.517 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.517 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.517 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.517 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.517 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.512+0000 7ff125ffb640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.517 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.512+0000 7ff125ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.517 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.512+0000 7ff125ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.517 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.512+0000 7ff125ffb640 1 -- 10.20.193.49:0/2386248712 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff128015070 con 0x7ff13806e5b0 2026-02-17T11:10:35.517 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.512+0000 7ff125ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.517 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.512+0000 7ff125ffb640 1 -- 10.20.193.49:0/2386248712 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff128002920 con 0x7ff13806e5b0 2026-02-17T11:10:35.518 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.512+0000 7ff13f2c4640 5 monclient: authenticate success, global_id 4489 2026-02-17T11:10:35.518 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.512+0000 7ff13f2c4640 10 monclient: _renew_subs 2026-02-17T11:10:35.518 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.512+0000 7ff1277fe640 4 set_mon_vals no callback set 2026-02-17T11:10:35.518 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.512+0000 7ff13f2c4640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.518 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.512+0000 7ff13f2c4640 1 -- 10.20.193.49:0/2386248712 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1380d0cf0 con 0x7ff13806e5b0 2026-02-17T11:10:35.518 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.512+0000 7ff125ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.518 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.512+0000 7ff125ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:35.518 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.512+0000 7ff125ffb640 10 monclient: dump: 2026-02-17T11:10:35.518 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.518 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.518 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.518 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.518 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.518 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.518 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.518 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.518 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.518 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.518 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.512+0000 7ff13f2c4640 10 client.4489.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:35.518 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.512+0000 7ff13f2c4640 10 monclient: _renew_subs 2026-02-17T11:10:35.518 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.512+0000 7ff13f2c4640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.518 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.512+0000 7ff13f2c4640 1 -- 10.20.193.49:0/2386248712 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1380d12b0 con 0x7ff13806e5b0 2026-02-17T11:10:35.518 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.512+0000 7ff13f2c4640 1 librados: init done 2026-02-17T11:10:35.519 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.513+0000 7f3f04ee2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:35.519 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.513+0000 7f3f04ee2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:35.519 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.513+0000 7f3f04ee2640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.519 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.513+0000 7f3f04ee2640 1 -- 10.20.193.49:0/3724416512 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f0006a240 con 0x7f3f0015ef80 2026-02-17T11:10:35.519 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.513+0000 7ff13f2c4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:35.519 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.513+0000 7ff13f2c4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:35.519 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.513+0000 7ff13f2c4640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.519 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.513+0000 7ff13f2c4640 1 -- 10.20.193.49:0/2386248712 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff13808f9d0 con 0x7ff13806e5b0 2026-02-17T11:10:35.520 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.513+0000 7fd07bfff640 1 -- 10.20.193.49:0/3732901702 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd07c03c070 con 0x7fd08c155d40 2026-02-17T11:10:35.520 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.513+0000 7fd07bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.520 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.513+0000 7fd07bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:10:35.520 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.513+0000 7fd07bfff640 10 monclient: dump: 2026-02-17T11:10:35.520 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.520 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.520 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.520 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.520 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.520 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.520 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.520 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.520 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.520 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.520 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.513+0000 7fd07bfff640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.520 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.513+0000 7fd07bfff640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.521 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.513+0000 7fd07bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.521 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.513+0000 7fd07bfff640 1 -- 10.20.193.49:0/3732901702 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd07c02fac0 con 0x7fd08c155d40 2026-02-17T11:10:35.521 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.513+0000 7fd07bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.521 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.513+0000 7fd07bfff640 1 -- 10.20.193.49:0/3732901702 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd07c037440 con 0x7fd08c155d40 2026-02-17T11:10:35.521 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.513+0000 7fd07bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.521 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.513+0000 7fd07bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:10:35.521 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.513+0000 7fd07bfff640 10 monclient: dump: 2026-02-17T11:10:35.521 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.521 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.521 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.521 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.521 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.521 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.521 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.521 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.521 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.521 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.521 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.513+0000 7fd0937a8640 5 monclient: authenticate success, global_id 4481 2026-02-17T11:10:35.521 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.513+0000 7fd0937a8640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:35.521 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.513+0000 7fd0937a8640 4 set_mon_vals no callback set 2026-02-17T11:10:35.522 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.514+0000 7fe1b3fff640 1 -- 10.20.193.49:0/3862007712 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c4017070 con 0x7fe1dc0d1f40 2026-02-17T11:10:35.522 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.514+0000 7fe1b3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.522 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.514+0000 7fe1b3fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:10:35.522 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.514+0000 7fe1b3fff640 10 monclient: dump: 2026-02-17T11:10:35.522 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.522 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.522 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.522 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.522 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.522 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.523 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.523 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.523 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.523 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.523 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.514+0000 7fe1b3fff640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.523 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.514+0000 7fe1b3fff640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.523 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.514+0000 7fe1b3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.523 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.514+0000 7fe1b3fff640 1 -- 10.20.193.49:0/3862007712 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1c4005de0 con 0x7fe1dc0d1f40 2026-02-17T11:10:35.523 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.514+0000 7fe1b3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.523 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.514+0000 7fe1b3fff640 1 -- 10.20.193.49:0/3862007712 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c40072f0 con 0x7fe1dc0d1f40 2026-02-17T11:10:35.523 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.514+0000 7fe1e1951640 5 monclient: authenticate success, global_id 4483 2026-02-17T11:10:35.523 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.514+0000 7fe1e1951640 10 monclient: _renew_subs 2026-02-17T11:10:35.523 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.514+0000 7fe1e1951640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.523 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.514+0000 7fe1d97fa640 4 set_mon_vals no callback set 2026-02-17T11:10:35.523 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.514+0000 7fe1e1951640 1 -- 10.20.193.49:0/3862007712 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1dc15b130 con 0x7fe1dc0d1f40 2026-02-17T11:10:35.523 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.514+0000 7fe1b3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.523 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.514+0000 7fe1b3fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:35.523 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.514+0000 7fe1b3fff640 10 monclient: dump: 2026-02-17T11:10:35.523 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.523 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.524 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.524 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.524 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.524 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.524 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.524 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.524 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.524 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.524 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.514+0000 7fe1e1951640 10 client.4483.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:35.524 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.514+0000 7fe1e1951640 10 monclient: _renew_subs 2026-02-17T11:10:35.524 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.514+0000 7fe1e1951640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.524 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.514+0000 7fe1e1951640 1 -- 10.20.193.49:0/3862007712 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1dc15b6f0 con 0x7fe1dc0d1f40 2026-02-17T11:10:35.524 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.514+0000 7fd0937a8640 10 monclient: shutdown 2026-02-17T11:10:35.524 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.514+0000 7fd0937a8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:35.524 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.514+0000 7fd0937a8640 1 -- 10.20.193.49:0/3732901702 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fd08c155d40 msgr2=0x7fd08c156120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.525 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.514+0000 7fe1e1951640 1 librados: init done 2026-02-17T11:10:35.525 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.514+0000 7fd0937a8640 1 --2- 10.20.193.49:0/3732901702 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fd08c155d40 0x7fd08c156120 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd07c009970 tx=0x7fd07c02ee90 comp rx=0 tx=0).stop 2026-02-17T11:10:35.525 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.514+0000 7fd0937a8640 1 -- 10.20.193.49:0/3732901702 shutdown_connections 2026-02-17T11:10:35.525 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.514+0000 7fd0937a8640 1 --2- 10.20.193.49:0/3732901702 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fd08c155d40 0x7fd08c156120 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.525 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.514+0000 7fd0937a8640 1 -- 10.20.193.49:0/3732901702 >> 10.20.193.49:0/3732901702 conn(0x7fd08c0cc0e0 msgr2=0x7fd08c0cc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:35.525 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.514+0000 7fd0937a8640 1 -- 10.20.193.49:0/3732901702 shutdown_connections 2026-02-17T11:10:35.525 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.514+0000 7fd0937a8640 1 -- 10.20.193.49:0/3732901702 wait complete. 2026-02-17T11:10:35.525 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.514+0000 7fc7837fe640 1 --1- >> v1:10.20.193.157:6789/0 conn(0x7fc7840caff0 0x7fc7840cb480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.157:6789/0 says I am v1:10.20.193.49:43424/0 (socket says 10.20.193.49:43424) 2026-02-17T11:10:35.525 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.514+0000 7fc7837fe640 1 -- 10.20.193.49:0/4151334464 learned_addr learned my addr 10.20.193.49:0/4151334464 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:10:35.526 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.514+0000 7fe1e1951640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:35.526 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.514+0000 7fe1e1951640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:35.526 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.514+0000 7fe1e1951640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.526 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.514+0000 7fe1e1951640 1 -- 10.20.193.49:0/3862007712 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1dc076720 con 0x7fe1dc0d1f40 2026-02-17T11:10:35.526 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7f26ed446640 10 monclient(hunting): handle_auth_done global_id 4498 payload 274 2026-02-17T11:10:35.526 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7f26ed446640 1 -- 10.20.193.49:0/2083608995 >> v2:10.20.193.49:3300/0 conn(0x7f26e81603c0 msgr2=0x7f26e80d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:35.526 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7f26ed446640 1 --2- 10.20.193.49:0/2083608995 >> v2:10.20.193.49:3300/0 conn(0x7f26e81603c0 0x7f26e80d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.526 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7f26ed446640 1 -- 10.20.193.49:0/2083608995 >> v1:10.20.193.97:6789/0 conn(0x7f26e815a750 legacy=0x7f26e80c95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.526 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7fd0937a8640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.526 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7fd0937a8640 10 monclient: monmap: 2026-02-17T11:10:35.526 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.527 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:35.527 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:35.527 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:35.527 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.527 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.527 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:35.527 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:35.527 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:35.527 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.527 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7f26ed446640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.527 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7f26ed446640 1 monclient: found mon.noname-b 2026-02-17T11:10:35.527 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7f26ed446640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.527 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7f26ed446640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.527 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7f26ed446640 1 -- 10.20.193.49:0/2083608995 --> v2:10.20.193.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26e80d24e0 con 0x7f26e815a370 2026-02-17T11:10:35.528 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7fbd437fe640 1 -- 10.20.193.49:0/3448028675 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd3403c070 con 0x7fbd44155650 2026-02-17T11:10:35.528 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7fbd437fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.528 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7fbd437fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:10:35.528 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7fbd437fe640 10 monclient: dump: 2026-02-17T11:10:35.528 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.528 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.528 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.528 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.528 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.528 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.528 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.528 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.528 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.528 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.528 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7fbd437fe640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.528 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7fbd437fe640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.528 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7fbd437fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.528 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7fbd437fe640 1 -- 10.20.193.49:0/3448028675 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd3402fbe0 con 0x7fbd44155650 2026-02-17T11:10:35.528 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7fbd437fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.528 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7fbd437fe640 1 -- 10.20.193.49:0/3448028675 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd34037440 con 0x7fbd44155650 2026-02-17T11:10:35.528 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7fbd4b032640 5 monclient: authenticate success, global_id 4493 2026-02-17T11:10:35.529 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7fbd4b032640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:35.529 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7fbd4b032640 4 set_mon_vals no callback set 2026-02-17T11:10:35.529 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7fbd437fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.529 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7fbd437fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:10:35.529 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7fbd437fe640 10 monclient: dump: 2026-02-17T11:10:35.529 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.529 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.529 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.529 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.529 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.529 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.529 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.529 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.529 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.529 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.529 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7fd0937a8640 1 librados: starting msgr at 2026-02-17T11:10:35.529 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7fd0937a8640 1 librados: starting objecter 2026-02-17T11:10:35.529 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7fd0937a8640 1 Processor -- start 2026-02-17T11:10:35.529 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7fd0937a8640 1 -- start start 2026-02-17T11:10:35.529 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7fd0937a8640 1 librados: setting wanted keys 2026-02-17T11:10:35.530 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7fd0937a8640 1 librados: calling monclient init 2026-02-17T11:10:35.530 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7fd0937a8640 10 monclient: init 2026-02-17T11:10:35.530 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7fbd4b032640 10 monclient: shutdown 2026-02-17T11:10:35.530 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7fbd4b032640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:35.530 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7fbd4b032640 1 -- 10.20.193.49:0/3448028675 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fbd44155650 msgr2=0x7fbd44074460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.530 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7fbd4b032640 1 --2- 10.20.193.49:0/3448028675 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fbd44155650 0x7fbd44074460 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbd44072350 tx=0x7fbd3402efb0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.530 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7fd0937a8640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.530 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7fbd4b032640 1 -- 10.20.193.49:0/3448028675 shutdown_connections 2026-02-17T11:10:35.530 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7fbd4b032640 1 --2- 10.20.193.49:0/3448028675 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fbd44155650 0x7fbd44074460 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.530 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7fbd4b032640 1 -- 10.20.193.49:0/3448028675 >> 10.20.193.49:0/3448028675 conn(0x7fbd440c9f40 msgr2=0x7fbd440ca350 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:35.531 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7fd0937a8640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:10:35.531 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7fd0937a8640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fd08c0caff0 0x7fd08c0cd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.531 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7fd0937a8640 10 monclient(hunting): picked mon.noname-c con 0x7fd08c0caff0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:35.531 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7fd0937a8640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fd08c0ccc00 0x7fd08c1f5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.531 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7fd0937a8640 10 monclient(hunting): picked mon.noname-a con 0x7fd08c0ccc00 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:35.531 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7fbd4b032640 1 -- 10.20.193.49:0/3448028675 shutdown_connections 2026-02-17T11:10:35.531 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7fd0937a8640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fd08c155d40 0x7fd08c1f56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.531 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7fd0937a8640 10 monclient(hunting): picked mon.noname-b con 0x7fd08c155d40 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:35.531 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7fd0937a8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.531 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7fd0937a8640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd08c06d0a0 con 0x7fd08c0ccc00 2026-02-17T11:10:35.531 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7fd0937a8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.531 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7fd0937a8640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd08c06d410 con 0x7fd08c155d40 2026-02-17T11:10:35.531 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7fbd4b032640 1 -- 10.20.193.49:0/3448028675 wait complete. 2026-02-17T11:10:35.532 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7fd0937a8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.532 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7fd0937a8640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fd08c15d9b0 con 0x7fd08c0caff0 2026-02-17T11:10:35.532 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7fd0937a8640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.532 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.515+0000 7fd0937a8640 10 monclient(hunting): authenticate will time out at 1112.178841s 2026-02-17T11:10:35.532 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.516+0000 7fbd4b032640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.532 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.516+0000 7fbd4b032640 10 monclient: monmap: 2026-02-17T11:10:35.532 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.532 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:35.533 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:35.533 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:35.533 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.533 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.533 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:35.533 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:35.533 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:35.533 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.533 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.516+0000 7fbd4b032640 1 librados: starting msgr at 2026-02-17T11:10:35.533 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.516+0000 7fbd4b032640 1 librados: starting objecter 2026-02-17T11:10:35.533 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.516+0000 7fbd4b032640 1 Processor -- start 2026-02-17T11:10:35.533 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.516+0000 7fbd4b032640 1 -- start start 2026-02-17T11:10:35.533 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.516+0000 7fbd4b032640 1 librados: setting wanted keys 2026-02-17T11:10:35.533 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.516+0000 7fbd4b032640 1 librados: calling monclient init 2026-02-17T11:10:35.533 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.516+0000 7fbd4b032640 10 monclient: init 2026-02-17T11:10:35.533 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.516+0000 7fbd4b032640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.533 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.516+0000 7fbd4b032640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:10:35.533 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.516+0000 7fbd4b032640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fbd4406d4f0 0x7fbd441f3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.533 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.516+0000 7fbd4b032640 10 monclient(hunting): picked mon.noname-b con 0x7fbd4406d4f0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:35.533 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.516+0000 7fbd4b032640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbd44155270 0x7fbd440c27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.533 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.516+0000 7fbd4b032640 10 monclient(hunting): picked mon.noname-a con 0x7fbd44155270 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:35.533 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.516+0000 7fbd4b032640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fbd44155650 0x7fbd441487f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.533 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.516+0000 7fbd4b032640 10 monclient(hunting): picked mon.noname-c con 0x7fbd44155650 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:35.533 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.517+0000 7fbd4b032640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.533 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.517+0000 7fbd4b032640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fbd440734d0 con 0x7fbd44155270 2026-02-17T11:10:35.533 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.517+0000 7fbd4b032640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.533 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.517+0000 7fbd4b032640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fbd44073840 con 0x7fbd4406d4f0 2026-02-17T11:10:35.533 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.517+0000 7fbd4b032640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.534 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.517+0000 7fbd4b032640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fbd440ce2e0 con 0x7fbd44155650 2026-02-17T11:10:35.534 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.517+0000 7fbd4b032640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.534 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.517+0000 7fbd4b032640 10 monclient(hunting): authenticate will time out at 1112.180012s 2026-02-17T11:10:35.534 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.517+0000 7fd09151d640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fd08c0caff0 0x7fd08c0cd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.534 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.518+0000 7fbd495a8640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fbd44155650 0x7fbd441487f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.534 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.518+0000 7fc781ffb640 1 -- 10.20.193.49:0/4151334464 <== mon.2 v1:10.20.193.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1376001759 0 0) 0x7fc78415cbb0 con 0x7fc7840caff0 2026-02-17T11:10:35.534 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.518+0000 7fc781ffb640 10 monclient(hunting): _negotiate 2026-02-17T11:10:35.534 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.518+0000 7fc781ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.534 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.518+0000 7fc781ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.534 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.518+0000 7fc781ffb640 10 monclient(hunting): my global_id is 4496 2026-02-17T11:10:35.534 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.518+0000 7fc781ffb640 1 -- 10.20.193.49:0/4151334464 --> v1:10.20.193.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc770003620 con 0x7fc7840caff0 2026-02-17T11:10:35.535 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.518+0000 7fd09151d640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fd08c0caff0 0x7fd08c0cd6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:56072/0 (socket says 10.20.193.49:56072) 2026-02-17T11:10:35.535 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.518+0000 7fd09151d640 1 -- 10.20.193.49:0/1818882660 learned_addr learned my addr 10.20.193.49:0/1818882660 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:35.535 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.518+0000 7fd09151d640 10 monclient(hunting): get_auth_request con 0x7fd08c0caff0 auth_method 0 2026-02-17T11:10:35.535 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.518+0000 7fd09151d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.535 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.518+0000 7fd09151d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.535 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.518+0000 7fd09151d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.535 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.518+0000 7fbd495a8640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fbd44155650 0x7fbd441487f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:56088/0 (socket says 10.20.193.49:56088) 2026-02-17T11:10:35.535 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.518+0000 7fbd495a8640 1 -- 10.20.193.49:0/1287266055 learned_addr learned my addr 10.20.193.49:0/1287266055 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:35.535 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.518+0000 7fbd495a8640 10 monclient(hunting): get_auth_request con 0x7fbd44155650 auth_method 0 2026-02-17T11:10:35.535 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.518+0000 7fbd495a8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.535 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.518+0000 7fbd495a8640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.535 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.518+0000 7fbd495a8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.535 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.518+0000 7fd09151d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.535 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.518+0000 7fd09151d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.535 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.518+0000 7fd09151d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.536 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.520+0000 7fbd495a8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.536 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.520+0000 7fbd495a8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.536 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.520+0000 7fbd495a8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.536 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.520+0000 7fd09151d640 10 monclient(hunting): handle_auth_done global_id 4499 payload 824 2026-02-17T11:10:35.536 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.520+0000 7fd09151d640 1 -- 10.20.193.49:0/1818882660 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fd08c155d40 msgr2=0x7fd08c1f56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.536 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.520+0000 7fd09151d640 1 --2- 10.20.193.49:0/1818882660 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fd08c155d40 0x7fd08c1f56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.536 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.520+0000 7fd09151d640 1 -- 10.20.193.49:0/1818882660 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fd08c0ccc00 msgr2=0x7fd08c1f5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.536 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.520+0000 7fd09151d640 1 --2- 10.20.193.49:0/1818882660 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fd08c0ccc00 0x7fd08c1f5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.536 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.520+0000 7fd09151d640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.536 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.520+0000 7fd09151d640 1 monclient: found mon.noname-c 2026-02-17T11:10:35.536 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.520+0000 7fd09151d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.536 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.520+0000 7fd09151d640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:10:35.536 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.520+0000 7fd09151d640 1 -- 10.20.193.49:0/1818882660 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd08c156b40 con 0x7fd08c0caff0 2026-02-17T11:10:35.537 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.522+0000 7fbd495a8640 10 monclient(hunting): handle_auth_done global_id 4502 payload 824 2026-02-17T11:10:35.537 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.522+0000 7fbd495a8640 1 -- 10.20.193.49:0/1287266055 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fbd4406d4f0 msgr2=0x7fbd441f3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.537 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.522+0000 7fbd495a8640 1 --2- 10.20.193.49:0/1287266055 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fbd4406d4f0 0x7fbd441f3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.537 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.522+0000 7fbd495a8640 1 -- 10.20.193.49:0/1287266055 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbd44155270 msgr2=0x7fbd440c27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.537 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.522+0000 7fbd495a8640 1 --2- 10.20.193.49:0/1287266055 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbd44155270 0x7fbd440c27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.537 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.522+0000 7fbd495a8640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.537 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.522+0000 7fbd495a8640 1 monclient: found mon.noname-c 2026-02-17T11:10:35.537 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.522+0000 7fbd495a8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.537 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.522+0000 7fbd495a8640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:10:35.537 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.522+0000 7fbd495a8640 1 -- 10.20.193.49:0/1287266055 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd441f44c0 con 0x7fbd44155650 2026-02-17T11:10:35.537 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.524+0000 7fd09151d640 1 --2- 10.20.193.49:0/1818882660 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fd08c0caff0 0x7fd08c0cd6d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd07c009970 tx=0x7fd07c0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.537 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.524+0000 7fd079ffb640 10 client.?.objecter ms_handle_connect 0x7fd08c0caff0 2026-02-17T11:10:35.537 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.524+0000 7fd079ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:35.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.525+0000 7fc781ffb640 1 -- 10.20.193.49:0/4151334464 <== mon.2 v1:10.20.193.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1050704655 0 0) 0x7fc770003620 con 0x7fc7840caff0 2026-02-17T11:10:35.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.525+0000 7fc781ffb640 1 -- 10.20.193.49:0/4151334464 >> v2:10.20.193.49:3300/0 conn(0x7fc7840ccc00 msgr2=0x7fc784156120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:35.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.525+0000 7fc781ffb640 1 --2- 10.20.193.49:0/4151334464 >> v2:10.20.193.49:3300/0 conn(0x7fc7840ccc00 0x7fc784156120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.525+0000 7fc781ffb640 1 -- 10.20.193.49:0/4151334464 >> v1:10.20.193.49:6789/0 conn(0x7fc784155d40 legacy=0x7fc78415d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:35.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.525+0000 7fc781ffb640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.525+0000 7fc781ffb640 1 monclient: found mon.noname-c-legacy 2026-02-17T11:10:35.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.525+0000 7fc781ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.525+0000 7fc781ffb640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:10.20.193.157:6789/0 2026-02-17T11:10:35.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.525+0000 7fc781ffb640 1 -- 10.20.193.49:0/4151334464 --> v1:10.20.193.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc78406cae0 con 0x7fc7840caff0 2026-02-17T11:10:35.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.525+0000 7fc781ffb640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.525+0000 7fc781ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.525+0000 7fc781ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.525+0000 7fc781ffb640 1 -- 10.20.193.49:0/4151334464 <== mon.2 v1:10.20.193.157:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2462710995 0 0) 0x7fc774003280 con 0x7fc7840caff0 2026-02-17T11:10:35.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.525+0000 7fc781ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.525+0000 7fc781ffb640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2026-02-17T11:10:35.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.525+0000 7fc781ffb640 10 monclient: dump: 2026-02-17T11:10:35.538 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.539 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.539 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.539 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.539 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.539 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.539 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.539 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.539 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.539 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.539 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.525+0000 7fc781ffb640 1 monclient: mon.c has (v2) addrs [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] but i'm connected to v1:10.20.193.157:6789/0, reconnecting 2026-02-17T11:10:35.539 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.525+0000 7fc781ffb640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.539 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.525+0000 7fc781ffb640 1 -- 10.20.193.49:0/4151334464 >> v1:10.20.193.157:6789/0 conn(0x7fc7840caff0 legacy=0x7fc7840cb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.539 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.525+0000 7fc781ffb640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:10:35.539 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.525+0000 7fc781ffb640 1 --2- 10.20.193.49:0/4151334464 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc770003ba0 0x7fc770003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.539 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.525+0000 7fc781ffb640 10 monclient(hunting): picked mon.b con 0x7fc770003ba0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:35.539 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.525+0000 7fc781ffb640 1 --2- 10.20.193.49:0/4151334464 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc770004900 0x7fc770004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.539 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.525+0000 7fc781ffb640 10 monclient(hunting): picked mon.a con 0x7fc770004900 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:35.539 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.525+0000 7fc781ffb640 1 --2- 10.20.193.49:0/4151334464 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc770009ab0 0x7fc77000bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.539 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.525+0000 7fc781ffb640 10 monclient(hunting): picked mon.c con 0x7fc770009ab0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:35.539 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.525+0000 7fc781ffb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.539 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.525+0000 7fc781ffb640 1 -- 10.20.193.49:0/4151334464 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc78406c890 con 0x7fc770004900 2026-02-17T11:10:35.539 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.525+0000 7fc781ffb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.539 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.525+0000 7fc781ffb640 1 -- 10.20.193.49:0/4151334464 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc77000c4f0 con 0x7fc770003ba0 2026-02-17T11:10:35.539 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.525+0000 7fc781ffb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.539 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.525+0000 7fc781ffb640 1 -- 10.20.193.49:0/4151334464 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc77000c6f0 con 0x7fc770009ab0 2026-02-17T11:10:35.539 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.525+0000 7fc781ffb640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.539 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.525+0000 7fc781ffb640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:10:35.540 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.525+0000 7fbd495a8640 1 --2- 10.20.193.49:0/1287266055 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fbd44155650 0x7fbd441487f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbd3402f4c0 tx=0x7fbd340047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.540 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.525+0000 7fbd417fa640 10 client.?.objecter ms_handle_connect 0x7fbd44155650 2026-02-17T11:10:35.540 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.525+0000 7fbd417fa640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:35.540 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.528+0000 7fd079ffb640 1 -- 10.20.193.49:0/1818882660 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd07c044070 con 0x7fd08c0caff0 2026-02-17T11:10:35.540 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.528+0000 7fd079ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.540 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.528+0000 7fd079ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:10:35.540 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.528+0000 7fd079ffb640 10 monclient: dump: 2026-02-17T11:10:35.540 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.540 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.540 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.540 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.540 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.540 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.540 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.540 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.540 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.540 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.540 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.528+0000 7fd079ffb640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.540 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.528+0000 7fd079ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.540 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.528+0000 7fd079ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.528+0000 7fd079ffb640 1 -- 10.20.193.49:0/1818882660 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd07c040610 con 0x7fd08c0caff0 2026-02-17T11:10:35.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.528+0000 7fd079ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.528+0000 7fd079ffb640 1 -- 10.20.193.49:0/1818882660 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd07c03c040 con 0x7fd08c0caff0 2026-02-17T11:10:35.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.528+0000 7fd079ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.528+0000 7fd079ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:10:35.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.528+0000 7fd07b7fe640 4 set_mon_vals no callback set 2026-02-17T11:10:35.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.528+0000 7fd079ffb640 10 monclient: dump: 2026-02-17T11:10:35.541 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.541 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.541 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.541 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.541 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.541 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.541 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.541 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.541 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.541 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.528+0000 7fd0937a8640 5 monclient: authenticate success, global_id 4499 2026-02-17T11:10:35.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.528+0000 7fd0937a8640 10 monclient: _renew_subs 2026-02-17T11:10:35.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.528+0000 7fd0937a8640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:35.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.528+0000 7fd0937a8640 1 -- 10.20.193.49:0/1818882660 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd08c156e20 con 0x7fd08c0caff0 2026-02-17T11:10:35.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.528+0000 7fd0937a8640 10 client.4499.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:35.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.528+0000 7fd0937a8640 10 monclient: _renew_subs 2026-02-17T11:10:35.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.528+0000 7fd0937a8640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:35.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.528+0000 7fd0937a8640 1 -- 10.20.193.49:0/1818882660 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd08c1573e0 con 0x7fd08c0caff0 2026-02-17T11:10:35.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.528+0000 7fd0937a8640 1 librados: init done 2026-02-17T11:10:35.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.528+0000 7fc7837fe640 1 --2- 10.20.193.49:0/4151334464 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc770009ab0 0x7fc77000bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.542 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.529+0000 7fd0937a8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:35.542 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.529+0000 7fd0937a8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:35.542 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.529+0000 7fd0937a8640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:35.542 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.529+0000 7fd0937a8640 1 -- 10.20.193.49:0/1818882660 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd08c073080 con 0x7fd08c0caff0 2026-02-17T11:10:35.542 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.529+0000 7fc7837fe640 10 monclient(hunting): get_auth_request con 0x7fc770009ab0 auth_method 0 2026-02-17T11:10:35.542 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.529+0000 7fc7837fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.542 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.529+0000 7fc7837fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.542 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.529+0000 7fc7837fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:10:35.542 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.530+0000 7fbd417fa640 1 -- 10.20.193.49:0/1287266055 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd34044070 con 0x7fbd44155650 2026-02-17T11:10:35.543 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.530+0000 7fbd417fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.543 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.530+0000 7fbd417fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:10:35.543 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.530+0000 7fbd417fa640 10 monclient: dump: 2026-02-17T11:10:35.543 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.543 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.543 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.543 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.543 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.543 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.543 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.543 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.543 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.543 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.543 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.530+0000 7fbd417fa640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.543 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.530+0000 7fbd417fa640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.543 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.530+0000 7fbd417fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.543 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.530+0000 7fbd417fa640 1 -- 10.20.193.49:0/1287266055 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd34040610 con 0x7fbd44155650 2026-02-17T11:10:35.543 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.530+0000 7fbd4b032640 5 monclient: authenticate success, global_id 4502 2026-02-17T11:10:35.543 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.530+0000 7fbd4b032640 10 monclient: _renew_subs 2026-02-17T11:10:35.543 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.530+0000 7fbd4b032640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:35.543 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.530+0000 7fbd4b032640 1 -- 10.20.193.49:0/1287266055 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd440c2ce0 con 0x7fbd44155650 2026-02-17T11:10:35.543 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.530+0000 7fbd417fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.543 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.530+0000 7fbd417fa640 1 -- 10.20.193.49:0/1287266055 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd3403c040 con 0x7fbd44155650 2026-02-17T11:10:35.543 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.530+0000 7fbd417fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.543 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.530+0000 7fbd417fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:10:35.543 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.530+0000 7fbd417fa640 10 monclient: dump: 2026-02-17T11:10:35.543 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.543 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.543 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.543 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.543 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.544 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.544 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.544 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.544 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.544 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.544 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.530+0000 7fbd42ffd640 4 set_mon_vals no callback set 2026-02-17T11:10:35.544 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.530+0000 7fbd4b032640 10 client.4502.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:35.544 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.530+0000 7fbd4b032640 10 monclient: _renew_subs 2026-02-17T11:10:35.544 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.530+0000 7fbd4b032640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:35.544 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.530+0000 7fbd4b032640 1 -- 10.20.193.49:0/1287266055 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd440c2f90 con 0x7fbd44155650 2026-02-17T11:10:35.544 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.530+0000 7fbd4b032640 1 librados: init done 2026-02-17T11:10:35.544 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.530+0000 7fc7837fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.544 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.530+0000 7fc7837fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.544 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.530+0000 7fc7837fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:10:35.544 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.531+0000 7fbd4b032640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:35.544 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.531+0000 7fbd4b032640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:35.544 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.531+0000 7fbd4b032640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:35.544 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.531+0000 7fbd4b032640 1 -- 10.20.193.49:0/1287266055 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd44069130 con 0x7fbd44155650 2026-02-17T11:10:35.566 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.565+0000 7f32b34e8640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-17T11:10:35.566 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.565+0000 7f32b34e8640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-17T11:10:35.566 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.565+0000 7f32b34e8640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.566 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.565+0000 7f32b34e8640 1 -- 10.20.193.49:0/3484434986 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 13} v 0) -- 0x7f32ac154d90 con 0x7f32ac06f700 2026-02-17T11:10:35.597 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.596+0000 7f99bf37e640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-17T11:10:35.597 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.596+0000 7f99bf37e640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-17T11:10:35.597 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.596+0000 7f99bf37e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:35.597 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.596+0000 7f99bf37e640 1 -- 10.20.193.49:0/1840724848 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f99b806c890 con 0x7f99b80d1b60 2026-02-17T11:10:35.612 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.611+0000 7f901dffb640 1 -- 10.20.193.49:0/2812003517 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f9024019460 con 0x7f903015c840 2026-02-17T11:10:35.612 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.611+0000 7f901dffb640 1 --2- 10.20.193.49:0/2812003517 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f9000079190 0x7f900007b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.613 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.612+0000 7f903500d640 1 --2- 10.20.193.49:0/2812003517 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f9000079190 0x7f900007b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.613 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.612+0000 7f903500d640 10 monclient: get_auth_request con 0x7f9000079190 auth_method 0 2026-02-17T11:10:35.613 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.612+0000 7f901dffb640 10 client.4470.objecter ms_handle_connect 0x7f9000079190 2026-02-17T11:10:35.613 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.612+0000 7f903500d640 1 --2- 10.20.193.49:0/2812003517 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f9000079190 0x7f900007b650 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9020009750 tx=0x7f9020006ca0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.619+0000 7f901dffb640 1 -- 10.20.193.49:0/2812003517 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7f902405e030 con 0x7f903015c840 2026-02-17T11:10:35.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.619+0000 7f901dffb640 10 client.4470.objecter ms_dispatch2 0x7f9030000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:35.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.619+0000 7f901dffb640 3 client.4470.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:35.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.619+0000 7f901dffb640 3 client.4470.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:35.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.619+0000 7f901dffb640 20 client.4470.objecter dump_active .. 0 homeless 2026-02-17T11:10:35.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.619+0000 7fedf9006640 1 --2- 10.20.193.49:0/1603394338 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fedf4155f00 0x7fedf4144a00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fede4002410 tx=0x7fede40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.619+0000 7fede1ffb640 10 client.?.objecter ms_handle_connect 0x7fedf4155f00 2026-02-17T11:10:35.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.619+0000 7f901dffb640 1 -- 10.20.193.49:0/2812003517 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f90300727e0 con 0x7f903015c840 2026-02-17T11:10:35.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.619+0000 7f901dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:35.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.619+0000 7f901dffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:35.622 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.619+0000 7fede1ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:35.624 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.620+0000 7f99ad573640 1 -- 10.20.193.49:0/234970919 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a403c070 con 0x7f99b0152700 2026-02-17T11:10:35.624 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.620+0000 7f99ad573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.624 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.620+0000 7f99ad573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:10:35.625 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.620+0000 7f99ad573640 10 monclient: dump: 2026-02-17T11:10:35.625 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.625 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.625 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.625 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.625 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.625 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.625 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.625 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.625 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.625 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.625 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.620+0000 7f99ad573640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.620+0000 7f99ad573640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.620+0000 7f99ad573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.620+0000 7f99ad573640 1 -- 10.20.193.49:0/234970919 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99a402fb40 con 0x7f99b0152700 2026-02-17T11:10:35.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.620+0000 7f99ad573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.620+0000 7f99ad573640 1 -- 10.20.193.49:0/234970919 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a4037440 con 0x7f99b0152700 2026-02-17T11:10:35.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.620+0000 7f99ad573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.620+0000 7f99ad573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:10:35.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.620+0000 7f99ad573640 10 monclient: dump: 2026-02-17T11:10:35.626 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.626 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.626 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.626 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.626 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.627 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.627 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.627 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.627 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.627 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.620+0000 7f99b4a91640 5 monclient: authenticate success, global_id 4476 2026-02-17T11:10:35.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.620+0000 7f99b4a91640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:35.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.620+0000 7f99b4a91640 4 set_mon_vals no callback set 2026-02-17T11:10:35.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.621+0000 7f99b4a91640 10 monclient: shutdown 2026-02-17T11:10:35.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.621+0000 7f99b4a91640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:35.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.621+0000 7f99b4a91640 1 -- 10.20.193.49:0/234970919 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f99b0152700 msgr2=0x7f99b015e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.621+0000 7f99b4a91640 1 --2- 10.20.193.49:0/234970919 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f99b0152700 0x7f99b015e870 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f99b00cbf90 tx=0x7f99a402eed0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.621+0000 7f99b4a91640 1 -- 10.20.193.49:0/234970919 shutdown_connections 2026-02-17T11:10:35.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.621+0000 7f99b4a91640 1 --2- 10.20.193.49:0/234970919 >> v2:10.20.193.157:3300/0 conn(0x7f99b015edb0 0x7f99b00c9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.621+0000 7f99b4a91640 1 --2- 10.20.193.49:0/234970919 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f99b0152700 0x7f99b015e870 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.621+0000 7f99b4a91640 1 -- 10.20.193.49:0/234970919 >> 10.20.193.49:0/234970919 conn(0x7f99b0073030 msgr2=0x7f99b0073440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:35.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.621+0000 7f99b4a91640 1 -- 10.20.193.49:0/234970919 shutdown_connections 2026-02-17T11:10:35.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.621+0000 7f99b4a91640 1 -- 10.20.193.49:0/234970919 wait complete. 2026-02-17T11:10:35.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.621+0000 7f99b4a91640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.621+0000 7f99b4a91640 10 monclient: monmap: 2026-02-17T11:10:35.628 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.628 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:35.628 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:35.628 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:35.628 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.628 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.628 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:35.629 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:35.629 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:35.629 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.622+0000 7f99b4a91640 1 librados: starting msgr at 2026-02-17T11:10:35.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.622+0000 7f99b4a91640 1 librados: starting objecter 2026-02-17T11:10:35.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.622+0000 7f99b4a91640 1 Processor -- start 2026-02-17T11:10:35.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.622+0000 7f99b4a91640 1 -- start start 2026-02-17T11:10:35.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.622+0000 7f99b4a91640 1 librados: setting wanted keys 2026-02-17T11:10:35.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.622+0000 7f99b4a91640 1 librados: calling monclient init 2026-02-17T11:10:35.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.622+0000 7f99b4a91640 10 monclient: init 2026-02-17T11:10:35.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.622+0000 7f99b4a91640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.622+0000 7f99b4a91640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:10:35.630 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.622+0000 7f99b4a91640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f99b0152700 0x7f99b0158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.630 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.622+0000 7f99b4a91640 10 monclient(hunting): picked mon.noname-a con 0x7f99b0152700 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:35.630 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.622+0000 7f99b4a91640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f99b0152ae0 0x7f99b01f4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.630 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.622+0000 7f99b4a91640 10 monclient(hunting): picked mon.noname-b con 0x7f99b0152ae0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:35.630 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.622+0000 7f99b4a91640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f99b015edb0 0x7f99b01f4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.630 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.622+0000 7f99b4a91640 10 monclient(hunting): picked mon.noname-c con 0x7f99b015edb0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:35.630 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.622+0000 7f99b4a91640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.630 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.622+0000 7f99b4a91640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f99b015e350 con 0x7f99b0152700 2026-02-17T11:10:35.630 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.622+0000 7f99b4a91640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.630 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.622+0000 7f99b4a91640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f99b015e070 con 0x7f99b0152ae0 2026-02-17T11:10:35.630 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.622+0000 7f99b4a91640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.630 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.622+0000 7f99b4a91640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f99b00ca380 con 0x7f99b015edb0 2026-02-17T11:10:35.631 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.622+0000 7f99b4a91640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.631 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.622+0000 7f99b4a91640 10 monclient(hunting): authenticate will time out at 1112.285663s 2026-02-17T11:10:35.632 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.625+0000 7fc7827fc640 1 --2- 10.20.193.49:0/4151334464 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc770004900 0x7fc770004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.632 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.626+0000 7fc7827fc640 10 monclient(hunting): get_auth_request con 0x7fc770004900 auth_method 0 2026-02-17T11:10:35.632 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.626+0000 7fc7827fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.632 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.626+0000 7fc7827fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.632 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.626+0000 7fc7827fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:10:35.632 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.626+0000 7fc7827fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.632 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.626+0000 7fc7827fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.632 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.626+0000 7fc7827fc640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:10:35.635 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.627+0000 7ff628f6e640 1 -- 10.20.193.49:0/3001156122 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff61403c070 con 0x7ff624163950 2026-02-17T11:10:35.635 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.627+0000 7ff628f6e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.635 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.627+0000 7ff628f6e640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:10:35.635 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.627+0000 7ff628f6e640 10 monclient: dump: 2026-02-17T11:10:35.635 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.635 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.635 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.635 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.635 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.635 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.636 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.636 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.636 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.636 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.636 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.627+0000 7ff628f6e640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.636 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.627+0000 7ff628f6e640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.636 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.627+0000 7ff628f6e640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.636 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.627+0000 7ff628f6e640 1 -- 10.20.193.49:0/3001156122 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff61402faf0 con 0x7ff624163950 2026-02-17T11:10:35.636 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.627+0000 7ff628f6e640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.636 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.627+0000 7ff628f6e640 1 -- 10.20.193.49:0/3001156122 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff614037440 con 0x7ff624163950 2026-02-17T11:10:35.636 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.627+0000 7ff62c1fb640 5 monclient: authenticate success, global_id 4473 2026-02-17T11:10:35.636 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.627+0000 7ff62c1fb640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:35.636 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.627+0000 7ff62c1fb640 4 set_mon_vals no callback set 2026-02-17T11:10:35.637 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.627+0000 7ff628f6e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.637 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.627+0000 7ff628f6e640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:10:35.637 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.627+0000 7ff628f6e640 10 monclient: dump: 2026-02-17T11:10:35.637 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.637 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.637 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.637 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.637 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.637 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.637 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.637 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.637 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.638 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.638 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.628+0000 7ff62c1fb640 10 monclient: shutdown 2026-02-17T11:10:35.638 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.628+0000 7ff62c1fb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:35.638 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.628+0000 7ff62c1fb640 1 -- 10.20.193.49:0/3001156122 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ff624163950 msgr2=0x7ff6240cbac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.638 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.628+0000 7ff62c1fb640 1 --2- 10.20.193.49:0/3001156122 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ff624163950 0x7ff6240cbac0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff6241614f0 tx=0x7ff61402ede0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.638 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.628+0000 7ff62c1fb640 1 -- 10.20.193.49:0/3001156122 shutdown_connections 2026-02-17T11:10:35.638 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.628+0000 7ff62c1fb640 1 --2- 10.20.193.49:0/3001156122 >> v2:10.20.193.97:3300/0 conn(0x7ff624164440 0x7ff624161cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.638 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.628+0000 7ff62c1fb640 1 --2- 10.20.193.49:0/3001156122 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ff624163950 0x7ff6240cbac0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.638 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.628+0000 7ff62c1fb640 1 -- 10.20.193.49:0/3001156122 >> 10.20.193.49:0/3001156122 conn(0x7ff6240cafa0 msgr2=0x7ff6240cb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:35.639 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.628+0000 7ff62c1fb640 1 -- 10.20.193.49:0/3001156122 shutdown_connections 2026-02-17T11:10:35.639 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.628+0000 7ff62c1fb640 1 -- 10.20.193.49:0/3001156122 wait complete. 2026-02-17T11:10:35.639 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.628+0000 7ff62c1fb640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.639 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.628+0000 7ff62c1fb640 10 monclient: monmap: 2026-02-17T11:10:35.639 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.639 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:35.639 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:35.639 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:35.639 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.639 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.639 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:35.639 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:35.639 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:35.639 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.639 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.628+0000 7ff62c1fb640 1 librados: starting msgr at 2026-02-17T11:10:35.640 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.628+0000 7ff62c1fb640 1 librados: starting objecter 2026-02-17T11:10:35.640 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.629+0000 7ff62c1fb640 1 Processor -- start 2026-02-17T11:10:35.640 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.629+0000 7ff62c1fb640 1 -- start start 2026-02-17T11:10:35.640 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.629+0000 7ff62c1fb640 1 librados: setting wanted keys 2026-02-17T11:10:35.640 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.629+0000 7ff62c1fb640 1 librados: calling monclient init 2026-02-17T11:10:35.640 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.629+0000 7ff62c1fb640 10 monclient: init 2026-02-17T11:10:35.640 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.629+0000 7ff62c1fb640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.640 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.629+0000 7ff62c1fb640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:10:35.640 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.629+0000 7ff62c1fb640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ff624161850 0x7ff6240c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.640 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.629+0000 7ff62c1fb640 10 monclient(hunting): picked mon.noname-a con 0x7ff624161850 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:35.640 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.629+0000 7ff62c1fb640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7ff624163950 0x7ff6241f5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.640 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.629+0000 7ff62c1fb640 10 monclient(hunting): picked mon.noname-b con 0x7ff624163950 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:35.640 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.629+0000 7ff62c1fb640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff624164440 0x7ff6241fb880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.640 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.629+0000 7ff62c1fb640 10 monclient(hunting): picked mon.noname-c con 0x7ff624164440 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:35.641 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.629+0000 7ff62c1fb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.641 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.629+0000 7ff62c1fb640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff62406ea60 con 0x7ff624161850 2026-02-17T11:10:35.641 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.629+0000 7ff62c1fb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.641 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.629+0000 7ff62c1fb640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7ff62406e780 con 0x7ff624163950 2026-02-17T11:10:35.641 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.629+0000 7ff62c1fb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.641 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.629+0000 7ff62c1fb640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7ff62406ed40 con 0x7ff624164440 2026-02-17T11:10:35.641 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.629+0000 7ff62c1fb640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.641 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.629+0000 7ff62c1fb640 10 monclient(hunting): authenticate will time out at 1112.292643s 2026-02-17T11:10:35.642 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.635+0000 7f20dd7fa640 1 -- 10.20.193.49:0/3023193637 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f20e401d030 con 0x7f20e815f4f0 2026-02-17T11:10:35.642 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.636+0000 7f20dd7fa640 1 --2- 10.20.193.49:0/3023193637 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f20b8079190 0x7f20b807b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.642 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.636+0000 7f20ecc5d640 1 --2- 10.20.193.49:0/3023193637 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f20b8079190 0x7f20b807b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.642 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.636+0000 7fc7827fc640 10 monclient(hunting): handle_auth_done global_id 4496 payload 293 2026-02-17T11:10:35.643 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.636+0000 7f20ecc5d640 10 monclient: get_auth_request con 0x7f20b8079190 auth_method 0 2026-02-17T11:10:35.644 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.636+0000 7fc7827fc640 1 -- 10.20.193.49:0/4151334464 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc770009ab0 msgr2=0x7fc77000bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:35.644 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.636+0000 7fc7827fc640 1 --2- 10.20.193.49:0/4151334464 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc770009ab0 0x7fc77000bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.644 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.636+0000 7fc7827fc640 1 -- 10.20.193.49:0/4151334464 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc770003ba0 msgr2=0x7fc770003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:35.644 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.636+0000 7fc7827fc640 1 --2- 10.20.193.49:0/4151334464 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc770003ba0 0x7fc770003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.644 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.636+0000 7fc7827fc640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.644 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.636+0000 7fc7827fc640 1 monclient: found mon.a 2026-02-17T11:10:35.644 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.636+0000 7fc7827fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.644 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.636+0000 7fc7827fc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:35.644 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.636+0000 7fc7827fc640 1 -- 10.20.193.49:0/4151334464 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc770003620 con 0x7fc770004900 2026-02-17T11:10:35.644 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.636+0000 7fc7827fc640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.644 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.636+0000 7fc7827fc640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.644 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.636+0000 7fc7827fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.644 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.636+0000 7fc7837fe640 1 -- 10.20.193.49:0/4151334464 reap_dead start 2026-02-17T11:10:35.644 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.636+0000 7fc7894b6640 5 monclient: authenticate success, global_id 4496 2026-02-17T11:10:35.645 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.636+0000 7fc7894b6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:10:35.645 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.636+0000 7f20dd7fa640 10 client.4461.objecter ms_handle_connect 0x7f20b8079190 2026-02-17T11:10:35.645 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.636+0000 7f20ecc5d640 1 --2- 10.20.193.49:0/3023193637 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f20b8079190 0x7f20b807b650 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f20d8039000 tx=0x7f20d8033000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.646 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.638+0000 7fd079ffb640 1 -- 10.20.193.49:0/1818882660 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7fd07c03f050 con 0x7fd08c0caff0 2026-02-17T11:10:35.646 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.638+0000 7fd079ffb640 1 --2- 10.20.193.49:0/1818882660 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fd05c079190 0x7fd05c07b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.646 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.639+0000 7fd090d1c640 1 --2- 10.20.193.49:0/1818882660 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fd05c079190 0x7fd05c07b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.646 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.639+0000 7fd090d1c640 10 monclient: get_auth_request con 0x7fd05c079190 auth_method 0 2026-02-17T11:10:35.646 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.640+0000 7fd079ffb640 10 client.4499.objecter ms_handle_connect 0x7fd05c079190 2026-02-17T11:10:35.646 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.640+0000 7fd090d1c640 1 --2- 10.20.193.49:0/1818882660 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fd05c079190 0x7fd05c07b650 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd08c160290 tx=0x7fd080006ca0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.646 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.641+0000 7fd079ffb640 1 -- 10.20.193.49:0/1818882660 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7fd07c0830c0 con 0x7fd08c0caff0 2026-02-17T11:10:35.646 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.641+0000 7fd079ffb640 10 client.4499.objecter ms_dispatch2 0x7fd08c000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:35.646 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.641+0000 7fd079ffb640 3 client.4499.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:35.646 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.641+0000 7fd079ffb640 3 client.4499.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:35.646 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.641+0000 7fd079ffb640 20 client.4499.objecter dump_active .. 0 homeless 2026-02-17T11:10:35.647 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.645+0000 7f20dd7fa640 1 -- 10.20.193.49:0/3023193637 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7f20e400cd30 con 0x7f20e815f4f0 2026-02-17T11:10:35.647 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.645+0000 7f20dd7fa640 10 client.4461.objecter ms_dispatch2 0x7f20e8000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:35.647 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.645+0000 7f20dd7fa640 3 client.4461.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:35.647 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.645+0000 7f20dd7fa640 3 client.4461.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:35.647 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.645+0000 7f20dd7fa640 20 client.4461.objecter dump_active .. 0 homeless 2026-02-17T11:10:35.647 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.645+0000 7f20dd7fa640 1 -- 10.20.193.49:0/3023193637 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f20e40620b0 con 0x7f20e815f4f0 2026-02-17T11:10:35.647 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.645+0000 7f20dd7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:35.647 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.645+0000 7f20dd7fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:35.647 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.646+0000 7f99ae575640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f99b0152700 0x7f99b0158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.648 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.646+0000 7fc7827fc640 1 --2- 10.20.193.49:0/4151334464 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc770004900 0x7fc770004d80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc76c009980 tx=0x7fc76c02ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1221fa4a20e68ba4 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.649 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.646+0000 7fede1ffb640 1 -- 10.20.193.49:0/1603394338 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede4046020 con 0x7fedf4155f00 2026-02-17T11:10:35.649 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.646+0000 7fede1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.649 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.646+0000 7fede1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:10:35.649 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.646+0000 7fede1ffb640 10 monclient: dump: 2026-02-17T11:10:35.649 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.649 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.649 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.649 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.649 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.649 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.649 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.650 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.650 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.650 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.650 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.646+0000 7fede1ffb640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.650 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.646+0000 7fede1ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.650 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.646+0000 7fede1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.650 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.646+0000 7fede1ffb640 1 -- 10.20.193.49:0/1603394338 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fede4042640 con 0x7fedf4155f00 2026-02-17T11:10:35.650 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.646+0000 7fede1ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.650 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.646+0000 7fede1ffb640 1 -- 10.20.193.49:0/1603394338 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede403c040 con 0x7fedf4155f00 2026-02-17T11:10:35.650 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.646+0000 7fedfb291640 5 monclient: authenticate success, global_id 4485 2026-02-17T11:10:35.650 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.646+0000 7fede37fe640 4 set_mon_vals no callback set 2026-02-17T11:10:35.650 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.646+0000 7fedfb291640 10 monclient: _renew_subs 2026-02-17T11:10:35.650 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.646+0000 7fedfb291640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:35.650 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.646+0000 7fedfb291640 1 -- 10.20.193.49:0/1603394338 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedf40c7230 con 0x7fedf4155f00 2026-02-17T11:10:35.650 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.646+0000 7fede1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.650 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.646+0000 7fede1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:10:35.650 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.646+0000 7fede1ffb640 10 monclient: dump: 2026-02-17T11:10:35.650 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.651 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.651 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.651 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.651 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.651 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.651 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.651 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.651 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.651 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.651 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.646+0000 7fedfb291640 10 client.4485.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:35.651 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.646+0000 7fedfb291640 10 monclient: _renew_subs 2026-02-17T11:10:35.651 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.646+0000 7fedfb291640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:35.651 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.646+0000 7fedfb291640 1 -- 10.20.193.49:0/1603394338 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedf40c77f0 con 0x7fedf4155f00 2026-02-17T11:10:35.651 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.646+0000 7fedfb291640 1 librados: init done 2026-02-17T11:10:35.651 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.647+0000 7fedfb291640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:35.651 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.647+0000 7fedfb291640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:35.651 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.647+0000 7fedfb291640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:35.651 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.647+0000 7fedfb291640 1 -- 10.20.193.49:0/1603394338 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedf415cdb0 con 0x7fedf4155f00 2026-02-17T11:10:35.652 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.647+0000 7f99ae575640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f99b0152700 0x7f99b0158040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:33198/0 (socket says 10.20.193.49:33198) 2026-02-17T11:10:35.652 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.647+0000 7f99ae575640 1 -- 10.20.193.49:0/862010316 learned_addr learned my addr 10.20.193.49:0/862010316 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:35.652 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.647+0000 7f99ae575640 10 monclient(hunting): get_auth_request con 0x7f99b0152700 auth_method 0 2026-02-17T11:10:35.652 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.647+0000 7f99ae575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.652 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.647+0000 7f99ae575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.652 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.647+0000 7f99ae575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.652 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.648+0000 7f99ae575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.652 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.648+0000 7f99ae575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.652 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.648+0000 7f99ae575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.652 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.648+0000 7fd079ffb640 1 -- 10.20.193.49:0/1818882660 <== mon.2 v2:10.20.193.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fd07c087780 con 0x7fd08c0caff0 2026-02-17T11:10:35.652 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.648+0000 7fd079ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:35.653 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.648+0000 7fd079ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:35.653 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.650+0000 7f99ae575640 10 monclient(hunting): handle_auth_done global_id 4491 payload 824 2026-02-17T11:10:35.653 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.651+0000 7f99ae575640 1 -- 10.20.193.49:0/862010316 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f99b015edb0 msgr2=0x7f99b01f4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.653 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.651+0000 7f99ae575640 1 --2- 10.20.193.49:0/862010316 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f99b015edb0 0x7f99b01f4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.653 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.651+0000 7f99ae575640 1 -- 10.20.193.49:0/862010316 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f99b0152ae0 msgr2=0x7f99b01f4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.653 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.651+0000 7f99ae575640 1 --2- 10.20.193.49:0/862010316 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f99b0152ae0 0x7f99b01f4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.653 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.651+0000 7f99ae575640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.653 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.651+0000 7f99ae575640 1 monclient: found mon.noname-a 2026-02-17T11:10:35.653 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.651+0000 7f99ae575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.653 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.651+0000 7f99ae575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:10:35.653 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.651+0000 7f99ae575640 1 -- 10.20.193.49:0/862010316 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99b0156d30 con 0x7f99b0152700 2026-02-17T11:10:35.654 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.652+0000 7f99ae575640 1 --2- 10.20.193.49:0/862010316 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f99b0152700 0x7f99b0158040 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f99a4009a70 tx=0x7f99a40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.654 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.652+0000 7f9996ffd640 10 client.?.objecter ms_handle_connect 0x7f99b0152700 2026-02-17T11:10:35.654 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.652+0000 7f9996ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:35.655 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.653+0000 7fc781ffb640 1 -- 10.20.193.49:0/4151334464 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc76c03c070 con 0x7fc770004900 2026-02-17T11:10:35.655 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.653+0000 7fc781ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.655 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.653+0000 7fc781ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:10:35.655 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.653+0000 7fc781ffb640 10 monclient: dump: 2026-02-17T11:10:35.655 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.655 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.655 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.655 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.655 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.655 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.655 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.655 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.655 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.655 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.655 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.653+0000 7fc781ffb640 1 -- 10.20.193.49:0/4151334464 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc76c02f770 con 0x7fc770004900 2026-02-17T11:10:35.655 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.653+0000 7fc781ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.655 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.653+0000 7fc781ffb640 1 -- 10.20.193.49:0/4151334464 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc76c009550 con 0x7fc770004900 2026-02-17T11:10:35.656 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.653+0000 7fc781ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.656 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.653+0000 7fc781ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:10:35.656 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.653+0000 7fc781ffb640 10 monclient: dump: 2026-02-17T11:10:35.656 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.656 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.656 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.656 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.656 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.656 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.656 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.656 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.656 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.656 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.656 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.653+0000 7fc7894b6640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:35.656 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.653+0000 7fc7894b6640 4 set_mon_vals no callback set 2026-02-17T11:10:35.658 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.654+0000 7fc7894b6640 10 monclient: shutdown 2026-02-17T11:10:35.658 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.654+0000 7fc7894b6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:35.658 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.654+0000 7fc7894b6640 1 -- 10.20.193.49:0/4151334464 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc770004900 msgr2=0x7fc770004d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.658 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.654+0000 7fc7894b6640 1 --2- 10.20.193.49:0/4151334464 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc770004900 0x7fc770004d80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc76c009980 tx=0x7fc76c02ed10 comp rx=0 tx=0).stop 2026-02-17T11:10:35.658 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.654+0000 7fc7894b6640 1 -- 10.20.193.49:0/4151334464 shutdown_connections 2026-02-17T11:10:35.658 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.654+0000 7fc7894b6640 1 --2- 10.20.193.49:0/4151334464 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc770004900 0x7fc770004d80 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.658 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.654+0000 7fc7894b6640 1 -- 10.20.193.49:0/4151334464 >> 10.20.193.49:0/4151334464 conn(0x7fc7840cc0e0 msgr2=0x7fc7840cc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:35.658 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.654+0000 7fc7894b6640 1 -- 10.20.193.49:0/4151334464 shutdown_connections 2026-02-17T11:10:35.658 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.654+0000 7fc7894b6640 1 -- 10.20.193.49:0/4151334464 wait complete. 2026-02-17T11:10:35.658 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.654+0000 7fc7894b6640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.658 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.654+0000 7fc7894b6640 10 monclient: monmap: 2026-02-17T11:10:35.658 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.658 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:35.658 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:35.658 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:35.658 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.658 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.658 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:35.658 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:35.658 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:35.659 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.659 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.654+0000 7fc7894b6640 1 librados: starting msgr at 2026-02-17T11:10:35.659 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.654+0000 7fc7894b6640 1 librados: starting objecter 2026-02-17T11:10:35.659 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.655+0000 7fc7894b6640 1 Processor -- start 2026-02-17T11:10:35.659 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.655+0000 7fc7894b6640 1 -- start start 2026-02-17T11:10:35.659 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.655+0000 7fc7894b6640 1 librados: setting wanted keys 2026-02-17T11:10:35.659 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.655+0000 7fc7894b6640 1 librados: calling monclient init 2026-02-17T11:10:35.659 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.655+0000 7fc7894b6640 10 monclient: init 2026-02-17T11:10:35.659 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.655+0000 7fc7894b6640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.659 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.655+0000 7fc7894b6640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:10:35.659 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.655+0000 7fc7894b6640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc770004900 0x7fc7840c5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.659 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.655+0000 7fc7894b6640 10 monclient(hunting): picked mon.noname-c con 0x7fc770004900 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:35.659 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.655+0000 7fc7894b6640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc7840c8cc0 0x7fc7841f6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.659 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.655+0000 7fc7894b6640 10 monclient(hunting): picked mon.noname-b con 0x7fc7840c8cc0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:35.659 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.655+0000 7fc7894b6640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc7840c4800 0x7fc7841f4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.659 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.655+0000 7fc7894b6640 10 monclient(hunting): picked mon.noname-a con 0x7fc7840c4800 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:35.659 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.655+0000 7fc7894b6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.659 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.655+0000 7fc7894b6640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc78406d0a0 con 0x7fc7840c4800 2026-02-17T11:10:35.659 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.655+0000 7fc7894b6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.659 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.655+0000 7fc7894b6640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc78406d410 con 0x7fc7840c8cc0 2026-02-17T11:10:35.659 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.655+0000 7fc7894b6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.660 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.655+0000 7fc7894b6640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc784073080 con 0x7fc770004900 2026-02-17T11:10:35.660 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.655+0000 7fc7894b6640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.660 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.655+0000 7fc7894b6640 10 monclient(hunting): authenticate will time out at 1112.318501s 2026-02-17T11:10:35.661 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.660+0000 7fbd417fa640 1 -- 10.20.193.49:0/1287266055 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7fbd3403f050 con 0x7fbd44155650 2026-02-17T11:10:35.661 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.660+0000 7fbd417fa640 1 --2- 10.20.193.49:0/1287266055 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fbd1c079190 0x7fbd1c07b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.662 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.660+0000 7fbd48da7640 1 --2- 10.20.193.49:0/1287266055 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fbd1c079190 0x7fbd1c07b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.662 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.660+0000 7fbd48da7640 10 monclient: get_auth_request con 0x7fbd1c079190 auth_method 0 2026-02-17T11:10:35.662 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.661+0000 7fbd48da7640 1 --2- 10.20.193.49:0/1287266055 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fbd1c079190 0x7fbd1c07b650 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbd441f6a50 tx=0x7fbd38009250 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.662 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.661+0000 7fbd417fa640 10 client.4502.objecter ms_handle_connect 0x7fbd1c079190 2026-02-17T11:10:35.664 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.663+0000 7fbd417fa640 1 -- 10.20.193.49:0/1287266055 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7fbd3402fb40 con 0x7fbd44155650 2026-02-17T11:10:35.664 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.663+0000 7fbd417fa640 10 client.4502.objecter ms_dispatch2 0x7fbd44000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:35.664 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.663+0000 7fbd417fa640 3 client.4502.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:35.664 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.663+0000 7fbd417fa640 3 client.4502.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:35.664 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.663+0000 7fbd417fa640 20 client.4502.objecter dump_active .. 0 homeless 2026-02-17T11:10:35.708 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.707+0000 7f9037298640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-17T11:10:35.709 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.707+0000 7f9037298640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-17T11:10:35.709 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.707+0000 7f9037298640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:35.709 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.707+0000 7f9037298640 1 -- 10.20.193.49:0/2812003517 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f903006a400 con 0x7f903015c840 2026-02-17T11:10:35.723 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.722+0000 7f3ee6ffd640 1 -- 10.20.193.49:0/3724416512 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f3ef0041850 con 0x7f3f0015ef80 2026-02-17T11:10:35.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.722+0000 7f3ee6ffd640 1 --2- 10.20.193.49:0/3724416512 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3ecc079190 0x7f3ecc07b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.723+0000 7f3efe575640 1 --2- 10.20.193.49:0/3724416512 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3ecc079190 0x7f3ecc07b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.723+0000 7f3efe575640 10 monclient: get_auth_request con 0x7f3ecc079190 auth_method 0 2026-02-17T11:10:35.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.723+0000 7f3efe575640 1 --2- 10.20.193.49:0/3724416512 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3ecc079190 0x7f3ecc07b650 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3ef40099b0 tx=0x7f3ef4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.723+0000 7f3ee6ffd640 10 client.4480.objecter ms_handle_connect 0x7f3ecc079190 2026-02-17T11:10:35.732 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.731+0000 7f20eeee8640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 6}] 2026-02-17T11:10:35.733 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.731+0000 7f20eeee8640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2026-02-17T11:10:35.733 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.731+0000 7f20eeee8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:35.733 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.731+0000 7f20eeee8640 1 -- 10.20.193.49:0/3023193637 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f20e81501f0 con 0x7f20e815f4f0 2026-02-17T11:10:35.733 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.732+0000 7fd0937a8640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-17T11:10:35.733 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.732+0000 7fd0937a8640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-17T11:10:35.733 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.732+0000 7fd0937a8640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:35.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.732+0000 7fd0937a8640 1 -- 10.20.193.49:0/1818882660 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fd08c070240 con 0x7fd08c0caff0 2026-02-17T11:10:35.756 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.754+0000 7fc7837fe640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc7840c4800 0x7fc7841f4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.756 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.755+0000 7ff629f70640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ff624161850 0x7ff6240c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.757 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.755+0000 7fc7837fe640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc7840c4800 0x7fc7841f4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:33212/0 (socket says 10.20.193.49:33212) 2026-02-17T11:10:35.757 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.755+0000 7fc7837fe640 1 -- 10.20.193.49:0/2454147964 learned_addr learned my addr 10.20.193.49:0/2454147964 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:35.757 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.755+0000 7fc7837fe640 10 monclient(hunting): get_auth_request con 0x7fc7840c4800 auth_method 0 2026-02-17T11:10:35.757 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.755+0000 7fc7837fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.757 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.755+0000 7fc7837fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.757 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.755+0000 7fc7837fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.758 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.756+0000 7ff629f70640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ff624161850 0x7ff6240c7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:33206/0 (socket says 10.20.193.49:33206) 2026-02-17T11:10:35.758 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.756+0000 7ff629f70640 1 -- 10.20.193.49:0/546728900 learned_addr learned my addr 10.20.193.49:0/546728900 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:35.758 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.756+0000 7ff629f70640 10 monclient(hunting): get_auth_request con 0x7ff624161850 auth_method 0 2026-02-17T11:10:35.758 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.756+0000 7ff629f70640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.758 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.756+0000 7ff629f70640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.758 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.756+0000 7ff629f70640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.761 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.759+0000 7f99a5ffb640 1 -- 10.20.193.49:0/1840724848 <== mon.2 v2:10.20.193.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f99ac0627d0 con 0x7f99b80d1b60 2026-02-17T11:10:35.761 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.759+0000 7f99a5ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-17T11:10:35.761 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.759+0000 7f99a5ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:35.761 INFO:teuthology.orchestra.run.trial049.stdout:107374182405 2026-02-17T11:10:35.764 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.761+0000 7f99bf37e640 10 librados: watch_flush enter 2026-02-17T11:10:35.764 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.761+0000 7f99bf37e640 10 librados: watch_flush exit 2026-02-17T11:10:35.764 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.761+0000 7f99bf37e640 20 client.4484.objecter shutdown clearing up homeless session... 2026-02-17T11:10:35.764 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.761+0000 7f99bf37e640 10 client.4484.objecter successfully canceled tick 2026-02-17T11:10:35.764 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.761+0000 7f99bf37e640 1 -- 10.20.193.49:0/1840724848 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f9988079190 msgr2=0x7f998807b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.764 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.761+0000 7f99bf37e640 1 --2- 10.20.193.49:0/1840724848 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f9988079190 0x7f998807b650 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f99a8006b90 tx=0x7f99a8006b20 comp rx=0 tx=0).stop 2026-02-17T11:10:35.764 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.761+0000 7f99bf37e640 10 monclient: shutdown 2026-02-17T11:10:35.764 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.761+0000 7f99bf37e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:35.764 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.761+0000 7f99bf37e640 1 -- 10.20.193.49:0/1840724848 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f99b80d1b60 msgr2=0x7f99b81f48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.764 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.761+0000 7f99bf37e640 1 --2- 10.20.193.49:0/1840724848 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f99b80d1b60 0x7f99b81f48b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f99ac00b530 tx=0x7f99ac00ba00 comp rx=0 tx=0).stop 2026-02-17T11:10:35.765 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.761+0000 7f99bf37e640 1 -- 10.20.193.49:0/1840724848 shutdown_connections 2026-02-17T11:10:35.765 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.761+0000 7f99bf37e640 1 --2- 10.20.193.49:0/1840724848 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f9988079190 0x7f998807b650 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.765 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.761+0000 7f99bf37e640 1 --2- 10.20.193.49:0/1840724848 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f99b815c840 0x7f99b81f4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.765 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.761+0000 7f99bf37e640 1 --2- 10.20.193.49:0/1840724848 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f99b80d1b60 0x7f99b81f48b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.765 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.761+0000 7f99bf37e640 1 --2- 10.20.193.49:0/1840724848 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f99b80c92a0 0x7f99b8147f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.765 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.761+0000 7f99bf37e640 1 -- 10.20.193.49:0/1840724848 >> 10.20.193.49:0/1840724848 conn(0x7f99b806d9b0 msgr2=0x7f99b80cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:35.765 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.761+0000 7f99bf37e640 1 -- 10.20.193.49:0/1840724848 shutdown_connections 2026-02-17T11:10:35.765 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.761+0000 7f99bf37e640 1 -- 10.20.193.49:0/1840724848 wait complete. 2026-02-17T11:10:35.765 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.762+0000 7f99bf37e640 1 librados: shutdown 2026-02-17T11:10:35.766 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.764+0000 7fc7837fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.766 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.764+0000 7fc7837fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.766 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.764+0000 7fc7837fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.765+0000 7fede1ffb640 1 -- 10.20.193.49:0/1603394338 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7fede403f030 con 0x7fedf4155f00 2026-02-17T11:10:35.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.765+0000 7fede1ffb640 1 --2- 10.20.193.49:0/1603394338 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fedc4079190 0x7fedc407b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.765+0000 7fedf8805640 1 --2- 10.20.193.49:0/1603394338 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fedc4079190 0x7fedc407b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.765+0000 7fedf8805640 10 monclient: get_auth_request con 0x7fedc4079190 auth_method 0 2026-02-17T11:10:35.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.766+0000 7fc782ffd640 1 --2- 10.20.193.49:0/2454147964 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc770004900 0x7fc7840c5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.766+0000 7fede1ffb640 10 client.4485.objecter ms_handle_connect 0x7fedc4079190 2026-02-17T11:10:35.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.766+0000 7fedf8805640 1 --2- 10.20.193.49:0/1603394338 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fedc4079190 0x7fedc407b650 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fede8006fd0 tx=0x7fede8006d40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.766+0000 7fbd417fa640 1 -- 10.20.193.49:0/1287266055 <== mon.2 v2:10.20.193.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fbd441f44c0 con 0x7fbd44155650 2026-02-17T11:10:35.769 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.766+0000 7fbd417fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:35.769 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.766+0000 7fbd417fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:35.769 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.766+0000 7fc782ffd640 10 monclient(hunting): get_auth_request con 0x7fc770004900 auth_method 0 2026-02-17T11:10:35.770 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.766+0000 7fc782ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.770 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.766+0000 7fc782ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.770 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.766+0000 7fc782ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.770 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.767+0000 7fc782ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.770 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.767+0000 7fc782ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.770 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.767+0000 7fc782ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.771 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.767+0000 7ff62a771640 1 --2- 10.20.193.49:0/546728900 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff624164440 0x7ff6241fb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.771 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.768+0000 7ff62a771640 10 monclient(hunting): get_auth_request con 0x7ff624164440 auth_method 0 2026-02-17T11:10:35.771 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.768+0000 7ff62a771640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.771 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.768+0000 7ff62a771640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.771 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.768+0000 7ff62a771640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.771 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.769+0000 7ff629f70640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.769+0000 7ff629f70640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.769+0000 7ff629f70640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.769+0000 7fc782ffd640 10 monclient(hunting): handle_auth_done global_id 4505 payload 824 2026-02-17T11:10:35.773 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.769+0000 7fc782ffd640 1 -- 10.20.193.49:0/2454147964 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc7840c8cc0 msgr2=0x7fc7841f6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.773 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.769+0000 7fc782ffd640 1 --2- 10.20.193.49:0/2454147964 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc7840c8cc0 0x7fc7841f6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.773 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.769+0000 7fc782ffd640 1 -- 10.20.193.49:0/2454147964 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc7840c4800 msgr2=0x7fc7841f4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.773 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.769+0000 7fc782ffd640 1 --2- 10.20.193.49:0/2454147964 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc7840c4800 0x7fc7841f4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.773 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.769+0000 7fc782ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.773 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.769+0000 7fc782ffd640 1 monclient: found mon.noname-c 2026-02-17T11:10:35.773 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.769+0000 7fc782ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.773 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.769+0000 7fc782ffd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:10:35.773 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.769+0000 7fc782ffd640 1 -- 10.20.193.49:0/2454147964 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7840c3480 con 0x7fc770004900 2026-02-17T11:10:35.775 INFO:tasks.ceph.ceph_manager.ceph:need seq 107374182406 got 107374182405 for osd.7 2026-02-17T11:10:35.776 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.770+0000 7ff62a771640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.776 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.770+0000 7ff62a771640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.776 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.770+0000 7ff62a771640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.776 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.772+0000 7ff62a771640 10 monclient(hunting): handle_auth_done global_id 4508 payload 824 2026-02-17T11:10:35.776 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.772+0000 7ff62a771640 1 -- 10.20.193.49:0/546728900 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7ff624163950 msgr2=0x7ff6241f5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.776 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.772+0000 7ff62a771640 1 --2- 10.20.193.49:0/546728900 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7ff624163950 0x7ff6241f5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.777 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.772+0000 7ff62a771640 1 -- 10.20.193.49:0/546728900 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ff624161850 msgr2=0x7ff6240c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.777 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.772+0000 7ff62a771640 1 --2- 10.20.193.49:0/546728900 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ff624161850 0x7ff6240c7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.777 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.772+0000 7ff62a771640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.777 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.772+0000 7ff62a771640 1 monclient: found mon.noname-c 2026-02-17T11:10:35.777 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.772+0000 7ff62a771640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.777 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.772+0000 7ff62a771640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:10:35.777 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.772+0000 7ff62a771640 1 -- 10.20.193.49:0/546728900 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6241f8d30 con 0x7ff624164440 2026-02-17T11:10:35.778 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.772+0000 7fc782ffd640 1 --2- 10.20.193.49:0/2454147964 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc770004900 0x7fc7840c5fd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc77800b500 tx=0x7fc77800b9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.778 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.772+0000 7fc7637fe640 10 client.?.objecter ms_handle_connect 0x7fc770004900 2026-02-17T11:10:35.778 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.772+0000 7fc7637fe640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:35.779 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.774+0000 7ff62a771640 1 --2- 10.20.193.49:0/546728900 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff624164440 0x7ff6241fb880 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff62000be50 tx=0x7ff62000bf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.779 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.774+0000 7ff6127fc640 10 client.?.objecter ms_handle_connect 0x7ff624164440 2026-02-17T11:10:35.779 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.774+0000 7ff6127fc640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:35.780 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.775+0000 7fede1ffb640 1 -- 10.20.193.49:0/1603394338 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7fede4031dd0 con 0x7fedf4155f00 2026-02-17T11:10:35.780 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.775+0000 7fede1ffb640 10 client.4485.objecter ms_dispatch2 0x7fedf4000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:35.780 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.775+0000 7fede1ffb640 3 client.4485.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:35.780 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.775+0000 7fede1ffb640 3 client.4485.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:35.780 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.775+0000 7fede1ffb640 20 client.4485.objecter dump_active .. 0 homeless 2026-02-17T11:10:35.780 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.775+0000 7fede1ffb640 1 -- 10.20.193.49:0/1603394338 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fede4050030 con 0x7fedf4155f00 2026-02-17T11:10:35.780 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.775+0000 7fede1ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:35.780 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.775+0000 7fede1ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:35.782 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.777+0000 7ff6127fc640 1 -- 10.20.193.49:0/546728900 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff620002a60 con 0x7ff624164440 2026-02-17T11:10:35.782 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.777+0000 7ff6127fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.782 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.777+0000 7ff6127fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:10:35.782 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.777+0000 7ff6127fc640 10 monclient: dump: 2026-02-17T11:10:35.782 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.782 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.782 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.783 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.783 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.783 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.783 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.783 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.783 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.783 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.783 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.777+0000 7ff6127fc640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.783 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.777+0000 7ff6127fc640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.783 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.777+0000 7ff6127fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.783 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.777+0000 7ff6127fc640 1 -- 10.20.193.49:0/546728900 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff620010070 con 0x7ff624164440 2026-02-17T11:10:35.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.777+0000 7ff6127fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.777+0000 7ff6127fc640 1 -- 10.20.193.49:0/546728900 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff620002e60 con 0x7ff624164440 2026-02-17T11:10:35.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.777+0000 7ff62c1fb640 5 monclient: authenticate success, global_id 4508 2026-02-17T11:10:35.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.777+0000 7ff62c1fb640 10 monclient: _renew_subs 2026-02-17T11:10:35.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.777+0000 7ff62c1fb640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:35.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.777+0000 7ff613fff640 4 set_mon_vals no callback set 2026-02-17T11:10:35.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.777+0000 7ff62c1fb640 1 -- 10.20.193.49:0/546728900 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6240c6970 con 0x7ff624164440 2026-02-17T11:10:35.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.777+0000 7ff6127fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.777+0000 7ff6127fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:10:35.785 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.777+0000 7ff6127fc640 10 monclient: dump: 2026-02-17T11:10:35.785 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.785 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.785 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.785 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.785 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.785 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.785 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.785 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.785 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.786 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.777+0000 7ff62c1fb640 10 client.4508.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:35.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.777+0000 7ff62c1fb640 10 monclient: _renew_subs 2026-02-17T11:10:35.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.777+0000 7ff62c1fb640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:35.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.777+0000 7ff62c1fb640 1 -- 10.20.193.49:0/546728900 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6240c6f30 con 0x7ff624164440 2026-02-17T11:10:35.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.777+0000 7ff62c1fb640 1 librados: init done 2026-02-17T11:10:35.787 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.778+0000 7fc7637fe640 1 -- 10.20.193.49:0/2454147964 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc778002c40 con 0x7fc770004900 2026-02-17T11:10:35.787 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.778+0000 7fc7637fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.787 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.778+0000 7fc7637fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:10:35.787 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.778+0000 7fc7637fe640 10 monclient: dump: 2026-02-17T11:10:35.787 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.787 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.787 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.787 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.787 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.788 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.788 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.788 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.788 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.788 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.788 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.778+0000 7fc7637fe640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.788 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.778+0000 7fc7637fe640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.788 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.778+0000 7fc7637fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.788 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.778+0000 7fc7637fe640 1 -- 10.20.193.49:0/2454147964 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc778014070 con 0x7fc770004900 2026-02-17T11:10:35.788 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.778+0000 7fc7637fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.788 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.778+0000 7fc7637fe640 1 -- 10.20.193.49:0/2454147964 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc778004070 con 0x7fc770004900 2026-02-17T11:10:35.788 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.778+0000 7fc7894b6640 5 monclient: authenticate success, global_id 4505 2026-02-17T11:10:35.789 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.778+0000 7fc7817fa640 4 set_mon_vals no callback set 2026-02-17T11:10:35.789 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.778+0000 7fc7894b6640 10 monclient: _renew_subs 2026-02-17T11:10:35.789 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.778+0000 7fc7894b6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:35.789 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.778+0000 7fc7894b6640 1 -- 10.20.193.49:0/2454147964 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7840c3760 con 0x7fc770004900 2026-02-17T11:10:35.789 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.778+0000 7fc7637fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.789 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.778+0000 7fc7637fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:10:35.789 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.778+0000 7fc7637fe640 10 monclient: dump: 2026-02-17T11:10:35.789 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.789 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.789 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.789 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.789 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.789 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.790 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.790 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.790 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.790 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.778+0000 7ff62c1fb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:35.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.778+0000 7ff62c1fb640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:35.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.778+0000 7ff62c1fb640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:35.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.778+0000 7ff62c1fb640 1 -- 10.20.193.49:0/546728900 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6240cf330 con 0x7ff624164440 2026-02-17T11:10:35.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.778+0000 7fc7894b6640 10 client.4505.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:35.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.778+0000 7fc7894b6640 10 monclient: _renew_subs 2026-02-17T11:10:35.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.778+0000 7fc7894b6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:35.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.778+0000 7fc7894b6640 1 -- 10.20.193.49:0/2454147964 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7840c3d20 con 0x7fc770004900 2026-02-17T11:10:35.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.778+0000 7fc7894b6640 1 librados: init done 2026-02-17T11:10:35.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.778+0000 7fc7894b6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:35.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.778+0000 7fc7894b6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:35.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.778+0000 7fc7894b6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:35.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.778+0000 7fc7894b6640 1 -- 10.20.193.49:0/2454147964 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc78415c830 con 0x7fc770004900 2026-02-17T11:10:35.792 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.784+0000 7f901dffb640 1 -- 10.20.193.49:0/2812003517 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f903006a400 con 0x7f903015c840 2026-02-17T11:10:35.792 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.784+0000 7f901dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-17T11:10:35.792 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.784+0000 7f901dffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:35.792 INFO:teuthology.orchestra.run.trial049.stdout:111669149702 2026-02-17T11:10:35.793 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.786+0000 7f9037298640 10 librados: watch_flush enter 2026-02-17T11:10:35.794 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.786+0000 7f9037298640 10 librados: watch_flush exit 2026-02-17T11:10:35.794 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.786+0000 7f9037298640 20 client.4470.objecter shutdown clearing up homeless session... 2026-02-17T11:10:35.794 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.786+0000 7f9037298640 10 client.4470.objecter successfully canceled tick 2026-02-17T11:10:35.794 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.786+0000 7f9037298640 1 -- 10.20.193.49:0/2812003517 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f9000079190 msgr2=0x7f900007b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.794 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.786+0000 7f9037298640 1 --2- 10.20.193.49:0/2812003517 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f9000079190 0x7f900007b650 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9020009750 tx=0x7f9020006ca0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.794 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.786+0000 7f9037298640 10 monclient: shutdown 2026-02-17T11:10:35.794 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.786+0000 7f9037298640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:35.794 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.786+0000 7f9037298640 1 -- 10.20.193.49:0/2812003517 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f903015c840 msgr2=0x7f90300cb6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.794 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.786+0000 7f9037298640 1 --2- 10.20.193.49:0/2812003517 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f903015c840 0x7f90300cb6e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f902400b500 tx=0x7f902400b9d0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.794 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.786+0000 7f9037298640 1 -- 10.20.193.49:0/2812003517 shutdown_connections 2026-02-17T11:10:35.794 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.786+0000 7f9037298640 1 --2- 10.20.193.49:0/2812003517 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f9000079190 0x7f900007b650 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.794 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.786+0000 7f9037298640 1 --2- 10.20.193.49:0/2812003517 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f903015dc50 0x7f903014f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.795 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.786+0000 7f9037298640 1 --2- 10.20.193.49:0/2812003517 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f903015c840 0x7f90300cb6e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.795 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.786+0000 7f9037298640 1 --2- 10.20.193.49:0/2812003517 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f9030155d20 0x7f90301fc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.795 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.786+0000 7f9037298640 1 -- 10.20.193.49:0/2812003517 >> 10.20.193.49:0/2812003517 conn(0x7f90300cc0c0 msgr2=0x7f903015d540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:35.795 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.786+0000 7f9037298640 1 -- 10.20.193.49:0/2812003517 shutdown_connections 2026-02-17T11:10:35.795 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.786+0000 7f9037298640 1 -- 10.20.193.49:0/2812003517 wait complete. 2026-02-17T11:10:35.795 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.786+0000 7f9037298640 1 librados: shutdown 2026-02-17T11:10:35.796 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.786+0000 7f9996ffd640 1 -- 10.20.193.49:0/862010316 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a4047070 con 0x7f99b0152700 2026-02-17T11:10:35.796 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.786+0000 7f9996ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.796 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.786+0000 7f9996ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:10:35.796 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.786+0000 7f9996ffd640 10 monclient: dump: 2026-02-17T11:10:35.796 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.796 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.796 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.797 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.797 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.797 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.797 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.797 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.797 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.797 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.797 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.786+0000 7f9996ffd640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.797 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.786+0000 7f9996ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.797 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.786+0000 7f9996ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.797 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.786+0000 7f9996ffd640 1 -- 10.20.193.49:0/862010316 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99a403f6a0 con 0x7f99b0152700 2026-02-17T11:10:35.797 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.786+0000 7f9996ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.797 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.786+0000 7f9996ffd640 1 -- 10.20.193.49:0/862010316 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a403c040 con 0x7f99b0152700 2026-02-17T11:10:35.797 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.786+0000 7f99b4a91640 5 monclient: authenticate success, global_id 4491 2026-02-17T11:10:35.797 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.786+0000 7f9996ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.797 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.786+0000 7f9996ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:10:35.797 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.786+0000 7f9997fff640 4 set_mon_vals no callback set 2026-02-17T11:10:35.798 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.786+0000 7f9996ffd640 10 monclient: dump: 2026-02-17T11:10:35.798 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.798 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.798 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.798 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.798 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.798 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.798 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.798 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.798 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.798 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.798 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.786+0000 7f99b4a91640 10 monclient: _renew_subs 2026-02-17T11:10:35.798 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.786+0000 7f99b4a91640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:35.798 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.786+0000 7f99b4a91640 1 -- 10.20.193.49:0/862010316 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99b01412e0 con 0x7f99b0152700 2026-02-17T11:10:35.798 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.787+0000 7f99b4a91640 10 client.4491.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:35.798 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.787+0000 7f99b4a91640 10 monclient: _renew_subs 2026-02-17T11:10:35.799 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.787+0000 7f99b4a91640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:35.799 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.787+0000 7f99b4a91640 1 -- 10.20.193.49:0/862010316 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99b0157280 con 0x7f99b0152700 2026-02-17T11:10:35.799 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.787+0000 7f99b4a91640 1 librados: init done 2026-02-17T11:10:35.799 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.787+0000 7f99b4a91640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:35.799 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.787+0000 7f99b4a91640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:35.799 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.787+0000 7f99b4a91640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:35.799 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.787+0000 7f99b4a91640 1 -- 10.20.193.49:0/862010316 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99b014d020 con 0x7f99b0152700 2026-02-17T11:10:35.799 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.789+0000 7f20dd7fa640 1 -- 10.20.193.49:0/3023193637 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f20e40619b0 con 0x7f20e815f4f0 2026-02-17T11:10:35.799 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.789+0000 7f20dd7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2026-02-17T11:10:35.799 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.789+0000 7f20dd7fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:35.800 INFO:teuthology.orchestra.run.trial049.stdout:115964116997 2026-02-17T11:10:35.800 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.790+0000 7ff6127fc640 1 -- 10.20.193.49:0/546728900 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7ff620004070 con 0x7ff624164440 2026-02-17T11:10:35.800 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.790+0000 7ff6127fc640 1 --2- 10.20.193.49:0/546728900 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ff5f4079190 0x7ff5f407b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.800 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.790+0000 7ff629f70640 1 --2- 10.20.193.49:0/546728900 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ff5f4079190 0x7ff5f407b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.800 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.790+0000 7ff629f70640 10 monclient: get_auth_request con 0x7ff5f4079190 auth_method 0 2026-02-17T11:10:35.801 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.791+0000 7ff6127fc640 10 client.4508.objecter ms_handle_connect 0x7ff5f4079190 2026-02-17T11:10:35.801 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.791+0000 7ff629f70640 1 --2- 10.20.193.49:0/546728900 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ff5f4079190 0x7ff5f407b650 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff61402ee20 tx=0x7ff614033000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.802 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.791+0000 7f20eeee8640 10 librados: watch_flush enter 2026-02-17T11:10:35.802 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.791+0000 7f20eeee8640 10 librados: watch_flush exit 2026-02-17T11:10:35.802 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.791+0000 7f20eeee8640 20 client.4461.objecter shutdown clearing up homeless session... 2026-02-17T11:10:35.802 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.791+0000 7f20eeee8640 10 client.4461.objecter successfully canceled tick 2026-02-17T11:10:35.802 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.792+0000 7f20eeee8640 1 -- 10.20.193.49:0/3023193637 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f20b8079190 msgr2=0x7f20b807b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.802 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.792+0000 7f20eeee8640 1 --2- 10.20.193.49:0/3023193637 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f20b8079190 0x7f20b807b650 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f20d8039000 tx=0x7f20d8033000 comp rx=0 tx=0).stop 2026-02-17T11:10:35.802 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.792+0000 7f20eeee8640 10 monclient: shutdown 2026-02-17T11:10:35.802 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.792+0000 7f20eeee8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:35.802 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.792+0000 7f20eeee8640 1 -- 10.20.193.49:0/3023193637 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f20e815f4f0 msgr2=0x7f20e81f6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.802 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.792+0000 7f20eeee8640 1 --2- 10.20.193.49:0/3023193637 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f20e815f4f0 0x7f20e81f6740 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f20e400b970 tx=0x7f20e400be40 comp rx=0 tx=0).stop 2026-02-17T11:10:35.802 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.792+0000 7f20eeee8640 1 -- 10.20.193.49:0/3023193637 shutdown_connections 2026-02-17T11:10:35.802 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.792+0000 7f20eeee8640 1 --2- 10.20.193.49:0/3023193637 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f20b8079190 0x7f20b807b650 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.802 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.792+0000 7f20eeee8640 1 --2- 10.20.193.49:0/3023193637 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f20e815f4f0 0x7f20e81f6740 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.802 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.792+0000 7f20eeee8640 1 --2- 10.20.193.49:0/3023193637 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f20e81561c0 0x7f20e81f6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.803 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.792+0000 7f20eeee8640 1 --2- 10.20.193.49:0/3023193637 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f20e806e5b0 0x7f20e81f7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.803 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.792+0000 7f20eeee8640 1 -- 10.20.193.49:0/3023193637 >> 10.20.193.49:0/3023193637 conn(0x7f20e806da90 msgr2=0x7f20e806b600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:35.803 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.792+0000 7f20eeee8640 1 -- 10.20.193.49:0/3023193637 shutdown_connections 2026-02-17T11:10:35.803 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.792+0000 7f20eeee8640 1 -- 10.20.193.49:0/3023193637 wait complete. 2026-02-17T11:10:35.803 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.792+0000 7f20eeee8640 1 librados: shutdown 2026-02-17T11:10:35.803 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.792+0000 7ff6127fc640 1 -- 10.20.193.49:0/546728900 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7ff62005df80 con 0x7ff624164440 2026-02-17T11:10:35.804 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.792+0000 7ff6127fc640 10 client.4508.objecter ms_dispatch2 0x7ff624000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:35.804 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.792+0000 7ff6127fc640 3 client.4508.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:35.804 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.792+0000 7ff6127fc640 3 client.4508.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:35.804 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.792+0000 7ff6127fc640 20 client.4508.objecter dump_active .. 0 homeless 2026-02-17T11:10:35.804 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.793+0000 7fd079ffb640 1 -- 10.20.193.49:0/1818882660 <== mon.2 v2:10.20.193.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fd07c087080 con 0x7fd08c0caff0 2026-02-17T11:10:35.804 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.793+0000 7fd079ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-17T11:10:35.804 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.793+0000 7fd079ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:35.804 INFO:teuthology.orchestra.run.trial049.stdout:111669149702 2026-02-17T11:10:35.805 INFO:tasks.ceph.ceph_manager.ceph:need seq 111669149703 got 111669149702 for osd.3 2026-02-17T11:10:35.806 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.795+0000 7fd0937a8640 10 librados: watch_flush enter 2026-02-17T11:10:35.806 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.795+0000 7fd0937a8640 10 librados: watch_flush exit 2026-02-17T11:10:35.806 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.795+0000 7fd0937a8640 20 client.4499.objecter shutdown clearing up homeless session... 2026-02-17T11:10:35.806 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.795+0000 7fd0937a8640 10 client.4499.objecter successfully canceled tick 2026-02-17T11:10:35.806 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.795+0000 7fd0937a8640 1 -- 10.20.193.49:0/1818882660 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fd05c079190 msgr2=0x7fd05c07b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.806 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.795+0000 7fd0937a8640 1 --2- 10.20.193.49:0/1818882660 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fd05c079190 0x7fd05c07b650 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd08c160290 tx=0x7fd080006ca0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.806 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.795+0000 7fd0937a8640 10 monclient: shutdown 2026-02-17T11:10:35.806 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.795+0000 7fd0937a8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:35.806 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.795+0000 7fd0937a8640 1 -- 10.20.193.49:0/1818882660 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fd08c0caff0 msgr2=0x7fd08c0cd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.806 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.795+0000 7fd0937a8640 1 --2- 10.20.193.49:0/1818882660 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fd08c0caff0 0x7fd08c0cd6d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd07c009970 tx=0x7fd07c0047c0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.807 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.795+0000 7fd0937a8640 1 -- 10.20.193.49:0/1818882660 shutdown_connections 2026-02-17T11:10:35.807 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.795+0000 7fd0937a8640 1 --2- 10.20.193.49:0/1818882660 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fd05c079190 0x7fd05c07b650 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.807 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.795+0000 7fd0937a8640 1 --2- 10.20.193.49:0/1818882660 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fd08c155d40 0x7fd08c1f56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.807 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.795+0000 7fd0937a8640 1 --2- 10.20.193.49:0/1818882660 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fd08c0ccc00 0x7fd08c1f5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.807 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.795+0000 7fd0937a8640 1 --2- 10.20.193.49:0/1818882660 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fd08c0caff0 0x7fd08c0cd6d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.807 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.795+0000 7fd0937a8640 1 -- 10.20.193.49:0/1818882660 >> 10.20.193.49:0/1818882660 conn(0x7fd08c0cc0e0 msgr2=0x7fd08c0cc4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:35.807 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.795+0000 7fd0937a8640 1 -- 10.20.193.49:0/1818882660 shutdown_connections 2026-02-17T11:10:35.807 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.795+0000 7fd0937a8640 1 -- 10.20.193.49:0/1818882660 wait complete. 2026-02-17T11:10:35.807 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.795+0000 7fd0937a8640 1 librados: shutdown 2026-02-17T11:10:35.807 INFO:tasks.ceph.ceph_manager.ceph:need seq 115964116998 got 115964116997 for osd.6 2026-02-17T11:10:35.808 INFO:tasks.ceph.ceph_manager.ceph:need seq 111669149703 got 111669149702 for osd.11 2026-02-17T11:10:35.821 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.820+0000 7f3ee6ffd640 1 -- 10.20.193.49:0/3724416512 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7f3ef0083cd0 con 0x7f3f0015ef80 2026-02-17T11:10:35.821 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.820+0000 7f3ee6ffd640 10 client.4480.objecter ms_dispatch2 0x7f3f00000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:35.821 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.820+0000 7f3ee6ffd640 3 client.4480.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:35.821 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.820+0000 7f3ee6ffd640 3 client.4480.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:35.821 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.820+0000 7f3ee6ffd640 20 client.4480.objecter dump_active .. 0 homeless 2026-02-17T11:10:35.822 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.820+0000 7efc737fe640 1 -- 10.20.193.49:0/1047109506 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc84047030 con 0x7efc94155fb0 2026-02-17T11:10:35.822 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.820+0000 7efc737fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.822 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.820+0000 7efc737fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:10:35.823 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.820+0000 7efc737fe640 10 monclient: dump: 2026-02-17T11:10:35.823 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.823 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.823 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.823 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.823 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.823 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.823 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.823 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.823 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.823 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.823 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.820+0000 7efc737fe640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.823 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.820+0000 7efc737fe640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.823 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.820+0000 7efc737fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.823 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.820+0000 7efc737fe640 1 -- 10.20.193.49:0/1047109506 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc84042470 con 0x7efc94155fb0 2026-02-17T11:10:35.823 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.820+0000 7efc996b0640 5 monclient: authenticate success, global_id 4495 2026-02-17T11:10:35.823 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.820+0000 7efc996b0640 10 monclient: _renew_subs 2026-02-17T11:10:35.823 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.820+0000 7efc996b0640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.824 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.820+0000 7efc996b0640 1 -- 10.20.193.49:0/1047109506 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc9415d900 con 0x7efc94155fb0 2026-02-17T11:10:35.824 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.820+0000 7efc737fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.824 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.820+0000 7efc737fe640 1 -- 10.20.193.49:0/1047109506 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc8403c040 con 0x7efc94155fb0 2026-02-17T11:10:35.824 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.820+0000 7efc737fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.824 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.820+0000 7efc737fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:35.824 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.820+0000 7efc737fe640 10 monclient: dump: 2026-02-17T11:10:35.824 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.824 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.824 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.824 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.824 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.824 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.824 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.824 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.824 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.824 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.824 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.820+0000 7efc917fa640 4 set_mon_vals no callback set 2026-02-17T11:10:35.824 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.820+0000 7efc996b0640 10 client.4495.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:35.824 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.820+0000 7efc996b0640 10 monclient: _renew_subs 2026-02-17T11:10:35.824 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.820+0000 7efc996b0640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.825 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.820+0000 7efc996b0640 1 -- 10.20.193.49:0/1047109506 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc9415dec0 con 0x7efc94155fb0 2026-02-17T11:10:35.825 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.820+0000 7efc996b0640 1 librados: init done 2026-02-17T11:10:35.825 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.821+0000 7efc996b0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:35.825 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.821+0000 7efc996b0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:35.825 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.821+0000 7efc996b0640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.825 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.821+0000 7efc996b0640 1 -- 10.20.193.49:0/1047109506 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc94159970 con 0x7efc94155fb0 2026-02-17T11:10:35.828 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.826+0000 7f26ed446640 1 --2- 10.20.193.49:0/2083608995 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f26e815a370 0x7f26e80cba50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f26e808ef70 tx=0x7f26d802eed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ce4dd00b740270d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.828 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.827+0000 7f3ee6ffd640 1 -- 10.20.193.49:0/3724416512 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f3f0006a240 con 0x7f3f0015ef80 2026-02-17T11:10:35.828 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.827+0000 7f3ee6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:35.828 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.827+0000 7f3ee6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:35.835 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.834+0000 7ff125ffb640 1 -- 10.20.193.49:0/2386248712 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7ff128010480 con 0x7ff13806e5b0 2026-02-17T11:10:35.836 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.835+0000 7ff125ffb640 1 --2- 10.20.193.49:0/2386248712 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ff1080791c0 0x7ff10807b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.836 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.835+0000 7ff13c838640 1 --2- 10.20.193.49:0/2386248712 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ff1080791c0 0x7ff10807b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.836 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.835+0000 7ff13c838640 10 monclient: get_auth_request con 0x7ff1080791c0 auth_method 0 2026-02-17T11:10:35.837 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.836+0000 7ff125ffb640 10 client.4489.objecter ms_handle_connect 0x7ff1080791c0 2026-02-17T11:10:35.837 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.836+0000 7ff13c838640 1 --2- 10.20.193.49:0/2386248712 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ff1080791c0 0x7ff10807b680 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff138074390 tx=0x7ff12c031000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.838 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.836+0000 7ff125ffb640 1 -- 10.20.193.49:0/2386248712 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7ff12805e420 con 0x7ff13806e5b0 2026-02-17T11:10:35.838 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.836+0000 7ff125ffb640 10 client.4489.objecter ms_dispatch2 0x7ff138000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:35.838 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.836+0000 7ff125ffb640 3 client.4489.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:35.838 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.836+0000 7ff125ffb640 3 client.4489.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:35.838 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.836+0000 7ff125ffb640 20 client.4489.objecter dump_active .. 0 homeless 2026-02-17T11:10:35.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.842+0000 7ff125ffb640 1 -- 10.20.193.49:0/2386248712 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ff128062ae0 con 0x7ff13806e5b0 2026-02-17T11:10:35.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.842+0000 7ff125ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:35.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.842+0000 7ff125ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:35.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.851+0000 7fe1b3fff640 1 -- 10.20.193.49:0/3862007712 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7fe1c4007490 con 0x7fe1dc0d1f40 2026-02-17T11:10:35.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.851+0000 7fe1b3fff640 1 --2- 10.20.193.49:0/3862007712 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fe1ac079190 0x7fe1ac07b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.852+0000 7fe1daffd640 1 --2- 10.20.193.49:0/3862007712 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fe1ac079190 0x7fe1ac07b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.852+0000 7fe1daffd640 10 monclient: get_auth_request con 0x7fe1ac079190 auth_method 0 2026-02-17T11:10:35.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.852+0000 7fe1daffd640 1 --2- 10.20.193.49:0/3862007712 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fe1ac079190 0x7fe1ac07b650 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe1d000a830 tx=0x7fe1d0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.852+0000 7fe1b3fff640 10 client.4483.objecter ms_handle_connect 0x7fe1ac079190 2026-02-17T11:10:35.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.852+0000 7fbd4b032640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-17T11:10:35.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.852+0000 7fbd4b032640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-17T11:10:35.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.852+0000 7fbd4b032640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:35.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.852+0000 7fbd4b032640 1 -- 10.20.193.49:0/1287266055 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fbd440c3270 con 0x7fbd44155650 2026-02-17T11:10:35.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.853+0000 7fe1b3fff640 1 -- 10.20.193.49:0/3862007712 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7fe1c40077b0 con 0x7fe1dc0d1f40 2026-02-17T11:10:35.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.853+0000 7fe1b3fff640 10 client.4483.objecter ms_dispatch2 0x7fe1dc000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:35.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.853+0000 7fe1b3fff640 3 client.4483.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:35.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.853+0000 7fe1b3fff640 3 client.4483.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:35.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.853+0000 7fe1b3fff640 20 client.4483.objecter dump_active .. 0 homeless 2026-02-17T11:10:35.861 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.860+0000 7fe1b3fff640 1 -- 10.20.193.49:0/3862007712 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe1dc076720 con 0x7fe1dc0d1f40 2026-02-17T11:10:35.862 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.860+0000 7fe1b3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:35.862 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.860+0000 7fe1b3fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:35.863 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.861+0000 7fedfb291640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-17T11:10:35.863 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.861+0000 7fedfb291640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-17T11:10:35.863 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.861+0000 7fedfb291640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:35.863 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.861+0000 7fedfb291640 1 -- 10.20.193.49:0/1603394338 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fedf40cad00 con 0x7fedf4155f00 2026-02-17T11:10:35.900 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.898+0000 7f9996ffd640 1 -- 10.20.193.49:0/862010316 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f99a403fa90 con 0x7f99b0152700 2026-02-17T11:10:35.901 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.899+0000 7f9996ffd640 1 --2- 10.20.193.49:0/862010316 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f997c0791c0 0x7f997c07b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.901 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.899+0000 7f99add74640 1 --2- 10.20.193.49:0/862010316 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f997c0791c0 0x7f997c07b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.901 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.899+0000 7f99add74640 10 monclient: get_auth_request con 0x7f997c0791c0 auth_method 0 2026-02-17T11:10:35.901 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.900+0000 7f99add74640 1 --2- 10.20.193.49:0/862010316 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f997c0791c0 0x7f997c07b680 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f99b01f17a0 tx=0x7f9998006ca0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.901 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.900+0000 7f9996ffd640 10 client.4491.objecter ms_handle_connect 0x7f997c0791c0 2026-02-17T11:10:35.912 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.910+0000 7f3f04ee2640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 8}] 2026-02-17T11:10:35.912 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.910+0000 7f3f04ee2640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 8}] 2026-02-17T11:10:35.912 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.910+0000 7f3f04ee2640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.912 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.910+0000 7f3f04ee2640 1 -- 10.20.193.49:0/3724416512 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f3f00073d50 con 0x7f3f0015ef80 2026-02-17T11:10:35.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.911+0000 7f9996ffd640 1 -- 10.20.193.49:0/862010316 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7f99a402fac0 con 0x7f99b0152700 2026-02-17T11:10:35.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.911+0000 7f9996ffd640 10 client.4491.objecter ms_dispatch2 0x7f99b0000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:35.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.911+0000 7f9996ffd640 3 client.4491.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:35.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.911+0000 7f9996ffd640 3 client.4491.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:35.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.911+0000 7f9996ffd640 20 client.4491.objecter dump_active .. 0 homeless 2026-02-17T11:10:35.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.911+0000 7f9996ffd640 1 -- 10.20.193.49:0/862010316 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f99b014d020 con 0x7f99b0152700 2026-02-17T11:10:35.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.911+0000 7f9996ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:35.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.911+0000 7f9996ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:35.919 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.918+0000 7fede1ffb640 1 -- 10.20.193.49:0/1603394338 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fede4087dc0 con 0x7fedf4155f00 2026-02-17T11:10:35.919 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.918+0000 7fede1ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-17T11:10:35.919 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.918+0000 7fede1ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:35.920 INFO:teuthology.orchestra.run.trial049.stdout:94489280516 2026-02-17T11:10:35.922 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.920+0000 7fedfb291640 10 librados: watch_flush enter 2026-02-17T11:10:35.922 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.920+0000 7fedfb291640 10 librados: watch_flush exit 2026-02-17T11:10:35.922 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.920+0000 7fedfb291640 20 client.4485.objecter shutdown clearing up homeless session... 2026-02-17T11:10:35.923 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.920+0000 7fedfb291640 10 client.4485.objecter successfully canceled tick 2026-02-17T11:10:35.923 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.920+0000 7fedfb291640 1 -- 10.20.193.49:0/1603394338 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fedc4079190 msgr2=0x7fedc407b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.923 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.920+0000 7fedfb291640 1 --2- 10.20.193.49:0/1603394338 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fedc4079190 0x7fedc407b650 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fede8006fd0 tx=0x7fede8006d40 comp rx=0 tx=0).stop 2026-02-17T11:10:35.923 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.920+0000 7fedfb291640 10 monclient: shutdown 2026-02-17T11:10:35.923 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.920+0000 7fedfb291640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:35.923 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.920+0000 7fedfb291640 1 -- 10.20.193.49:0/1603394338 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fedf4155f00 msgr2=0x7fedf4144a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.923 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.920+0000 7fedfb291640 1 --2- 10.20.193.49:0/1603394338 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fedf4155f00 0x7fedf4144a00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fede4002410 tx=0x7fede40047c0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.923 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.920+0000 7fedfb291640 1 -- 10.20.193.49:0/1603394338 shutdown_connections 2026-02-17T11:10:35.923 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.920+0000 7fedfb291640 1 --2- 10.20.193.49:0/1603394338 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fedc4079190 0x7fedc407b650 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.923 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.920+0000 7fedfb291640 1 --2- 10.20.193.49:0/1603394338 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fedf415c920 0x7fedf40c8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.923 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.920+0000 7fedfb291640 1 --2- 10.20.193.49:0/1603394338 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fedf41562e0 0x7fedf40c85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.923 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.920+0000 7fedfb291640 1 --2- 10.20.193.49:0/1603394338 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fedf4155f00 0x7fedf4144a00 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.924 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.920+0000 7fedfb291640 1 -- 10.20.193.49:0/1603394338 >> 10.20.193.49:0/1603394338 conn(0x7fedf40cc0e0 msgr2=0x7fedf40ce8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:35.924 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.920+0000 7fedfb291640 1 -- 10.20.193.49:0/1603394338 shutdown_connections 2026-02-17T11:10:35.924 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.920+0000 7fedfb291640 1 -- 10.20.193.49:0/1603394338 wait complete. 2026-02-17T11:10:35.924 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.920+0000 7fedfb291640 1 librados: shutdown 2026-02-17T11:10:35.931 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280518 got 94489280516 for osd.1 2026-02-17T11:10:35.932 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.929+0000 7ff13f2c4640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-17T11:10:35.932 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.929+0000 7ff13f2c4640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-17T11:10:35.932 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.929+0000 7ff13f2c4640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.932 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.929+0000 7ff13f2c4640 1 -- 10.20.193.49:0/2386248712 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 15} v 0) -- 0x7ff13815f670 con 0x7ff13806e5b0 2026-02-17T11:10:35.949 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.947+0000 7fe1e1951640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-17T11:10:35.949 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.947+0000 7fe1e1951640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-17T11:10:35.949 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.947+0000 7fe1e1951640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:35.949 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.947+0000 7fe1e1951640 1 -- 10.20.193.49:0/3862007712 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fe1dc15c840 con 0x7fe1dc0d1f40 2026-02-17T11:10:35.961 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.959+0000 7f10d1ffb640 1 -- 10.20.193.49:0/2737788666 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c803c070 con 0x7f10d40c7170 2026-02-17T11:10:35.961 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.959+0000 7f10d1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.961 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.959+0000 7f10d1ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:10:35.961 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.959+0000 7f10d1ffb640 10 monclient: dump: 2026-02-17T11:10:35.961 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.961 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.961 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.962 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.962 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.962 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.962 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.962 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.962 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.962 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.962 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.959+0000 7f10d1ffb640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.962 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.959+0000 7f10d1ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.962 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.959+0000 7f10d1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.963 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.959+0000 7f10d1ffb640 1 -- 10.20.193.49:0/2737788666 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10c802fad0 con 0x7f10d40c7170 2026-02-17T11:10:35.963 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.959+0000 7f10d1ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.963 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.959+0000 7f10d1ffb640 1 -- 10.20.193.49:0/2737788666 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c8037440 con 0x7f10d40c7170 2026-02-17T11:10:35.963 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.959+0000 7f10d1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.963 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.959+0000 7f10d1ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:35.963 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.959+0000 7f10d1ffb640 10 monclient: dump: 2026-02-17T11:10:35.963 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.963 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.963 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.963 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.964 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.964 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.964 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.964 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.964 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.964 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.964 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.959+0000 7f10d9491640 5 monclient: authenticate success, global_id 4492 2026-02-17T11:10:35.964 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.959+0000 7f10d9491640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:35.964 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.959+0000 7f10d9491640 4 set_mon_vals no callback set 2026-02-17T11:10:35.965 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.959+0000 7f3299ffb640 1 -- 10.20.193.49:0/3484434986 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 13}]=0 v0) ==== 75+0+12 (secure 0 0 0) 0x7f32ac154d90 con 0x7f32ac06f700 2026-02-17T11:10:35.965 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.959+0000 7f3299ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-17T11:10:35.965 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.959+0000 7f3299ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:35.965 INFO:teuthology.orchestra.run.trial049.stdout:94489280516 2026-02-17T11:10:35.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.959+0000 7f10d9491640 10 monclient: shutdown 2026-02-17T11:10:35.968 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.959+0000 7f10d9491640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:35.968 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.959+0000 7f10d9491640 1 -- 10.20.193.49:0/2737788666 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f10d40c7170 msgr2=0x7f10d40c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.968 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.959+0000 7f10d9491640 1 --2- 10.20.193.49:0/2737788666 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f10d40c7170 0x7f10d40c7550 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f10c80098a0 tx=0x7f10c802ee10 comp rx=0 tx=0).stop 2026-02-17T11:10:35.968 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.959+0000 7f10d9491640 1 -- 10.20.193.49:0/2737788666 shutdown_connections 2026-02-17T11:10:35.968 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.959+0000 7f10d9491640 1 --2- 10.20.193.49:0/2737788666 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f10d40c7170 0x7f10d40c7550 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.968 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.959+0000 7f10d9491640 1 -- 10.20.193.49:0/2737788666 >> 10.20.193.49:0/2737788666 conn(0x7f10d40c9f40 msgr2=0x7f10d40ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:35.968 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.960+0000 7f10d9491640 1 -- 10.20.193.49:0/2737788666 shutdown_connections 2026-02-17T11:10:35.968 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.960+0000 7f10d9491640 1 -- 10.20.193.49:0/2737788666 wait complete. 2026-02-17T11:10:35.968 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.960+0000 7f10d9491640 10 monclient: build_initial_monmap 2026-02-17T11:10:35.969 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.960+0000 7f10d9491640 10 monclient: monmap: 2026-02-17T11:10:35.969 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:35.969 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:35.969 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:35.969 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:35.969 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:35.969 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.969 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:35.969 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:35.969 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:35.969 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.970 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.961+0000 7f10d9491640 1 librados: starting msgr at 2026-02-17T11:10:35.970 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.961+0000 7f10d9491640 1 librados: starting objecter 2026-02-17T11:10:35.970 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.961+0000 7f10d9491640 1 Processor -- start 2026-02-17T11:10:35.970 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.961+0000 7f10d9491640 1 -- start start 2026-02-17T11:10:35.970 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.961+0000 7f10d9491640 1 librados: setting wanted keys 2026-02-17T11:10:35.970 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.961+0000 7f10d9491640 1 librados: calling monclient init 2026-02-17T11:10:35.970 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.961+0000 7f10d9491640 10 monclient: init 2026-02-17T11:10:35.970 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.961+0000 7f10d9491640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:35.970 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.961+0000 7f10d9491640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:10:35.970 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.961+0000 7f10d9491640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f10d40c48c0 0x7f10d406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.970 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.961+0000 7f10d9491640 10 monclient(hunting): picked mon.noname-a con 0x7f10d40c48c0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:35.971 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.961+0000 7f10d9491640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f10d40c4d10 0x7f10d41f6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.971 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.961+0000 7f10d9491640 10 monclient(hunting): picked mon.noname-c con 0x7f10d40c4d10 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:35.971 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.961+0000 7f10d9491640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f10d40c7170 0x7f10d41f6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.971 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.961+0000 7f10d9491640 10 monclient(hunting): picked mon.noname-b con 0x7f10d40c7170 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:35.971 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.961+0000 7f10d9491640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.971 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.961+0000 7f10d9491640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f10d40c81c0 con 0x7f10d40c48c0 2026-02-17T11:10:35.971 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.961+0000 7f10d9491640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.971 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.961+0000 7f10d9491640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f10d40c7ee0 con 0x7f10d40c7170 2026-02-17T11:10:35.971 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.961+0000 7f10d9491640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:35.971 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.961+0000 7f10d9491640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f10d40750c0 con 0x7f10d40c4d10 2026-02-17T11:10:35.971 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.961+0000 7f10d9491640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:35.971 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.961+0000 7f10d9491640 10 monclient(hunting): authenticate will time out at 1112.624638s 2026-02-17T11:10:35.973 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.961+0000 7f32b34e8640 10 librados: watch_flush enter 2026-02-17T11:10:35.973 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.961+0000 7f32b34e8640 10 librados: watch_flush exit 2026-02-17T11:10:35.973 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.961+0000 7f32b34e8640 20 client.4471.objecter shutdown clearing up homeless session... 2026-02-17T11:10:35.974 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.961+0000 7f32b34e8640 10 client.4471.objecter successfully canceled tick 2026-02-17T11:10:35.974 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.961+0000 7f32b34e8640 1 -- 10.20.193.49:0/3484434986 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f327c0791c0 msgr2=0x7f327c07b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.974 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.961+0000 7f32b34e8640 1 --2- 10.20.193.49:0/3484434986 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f327c0791c0 0x7f327c07b680 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f329c002f50 tx=0x7f329c009040 comp rx=0 tx=0).stop 2026-02-17T11:10:35.974 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.961+0000 7f32b34e8640 10 monclient: shutdown 2026-02-17T11:10:35.974 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.961+0000 7f32b34e8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:35.974 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.961+0000 7f32b34e8640 1 -- 10.20.193.49:0/3484434986 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f32ac06f700 msgr2=0x7f32ac147be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.974 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.961+0000 7f32b34e8640 1 --2- 10.20.193.49:0/3484434986 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f32ac06f700 0x7f32ac147be0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f32a000ebe0 tx=0x7f32a000c520 comp rx=0 tx=0).stop 2026-02-17T11:10:35.974 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.961+0000 7f32b34e8640 1 -- 10.20.193.49:0/3484434986 shutdown_connections 2026-02-17T11:10:35.974 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.961+0000 7f32b34e8640 1 --2- 10.20.193.49:0/3484434986 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f327c0791c0 0x7f327c07b680 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.974 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.961+0000 7f32b34e8640 1 --2- 10.20.193.49:0/3484434986 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f32ac15be30 0x7f32ac0c70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.975 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.961+0000 7f32b34e8640 1 --2- 10.20.193.49:0/3484434986 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f32ac06f700 0x7f32ac147be0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.975 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.961+0000 7f32b34e8640 1 --2- 10.20.193.49:0/3484434986 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f32ac0686b0 0x7f32ac1f4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.975 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.961+0000 7f32b34e8640 1 -- 10.20.193.49:0/3484434986 >> 10.20.193.49:0/3484434986 conn(0x7f32ac0cb3a0 msgr2=0x7f32ac06c890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:35.975 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.961+0000 7f32b34e8640 1 -- 10.20.193.49:0/3484434986 shutdown_connections 2026-02-17T11:10:35.975 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.961+0000 7f32b34e8640 1 -- 10.20.193.49:0/3484434986 wait complete. 2026-02-17T11:10:35.975 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.961+0000 7f32b34e8640 1 librados: shutdown 2026-02-17T11:10:35.977 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.962+0000 7f10d2ffd640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f10d40c48c0 0x7f10d406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.977 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.962+0000 7f10d2ffd640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f10d40c48c0 0x7f10d406eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:33226/0 (socket says 10.20.193.49:33226) 2026-02-17T11:10:35.977 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.962+0000 7f10d2ffd640 1 -- 10.20.193.49:0/1638920163 learned_addr learned my addr 10.20.193.49:0/1638920163 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:35.977 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.962+0000 7f10d2ffd640 10 monclient(hunting): get_auth_request con 0x7f10d40c48c0 auth_method 0 2026-02-17T11:10:35.977 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.962+0000 7f10d2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:35.977 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.962+0000 7f10d2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:35.977 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.962+0000 7f10d2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:35.978 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.962+0000 7f10d2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:35.978 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.962+0000 7f10d2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:35.978 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.962+0000 7f10d2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:35.978 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.964+0000 7f10d2ffd640 10 monclient(hunting): handle_auth_done global_id 4500 payload 824 2026-02-17T11:10:35.978 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.964+0000 7f10d2ffd640 1 -- 10.20.193.49:0/1638920163 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f10d40c4d10 msgr2=0x7f10d41f6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.978 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.964+0000 7f10d2ffd640 1 --2- 10.20.193.49:0/1638920163 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f10d40c4d10 0x7f10d41f6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.978 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.964+0000 7f10d2ffd640 1 -- 10.20.193.49:0/1638920163 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f10d40c7170 msgr2=0x7f10d41f6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.978 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.964+0000 7f10d2ffd640 1 --2- 10.20.193.49:0/1638920163 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f10d40c7170 0x7f10d41f6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.978 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.964+0000 7f10d2ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:10:35.978 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.964+0000 7f10d2ffd640 1 monclient: found mon.noname-a 2026-02-17T11:10:35.978 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.964+0000 7f10d2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:35.979 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.964+0000 7f10d2ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:10:35.979 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.964+0000 7f10d2ffd640 1 -- 10.20.193.49:0/1638920163 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10d41f7cb0 con 0x7f10d40c48c0 2026-02-17T11:10:35.979 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.965+0000 7f10d2ffd640 1 --2- 10.20.193.49:0/1638920163 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f10d40c48c0 0x7f10d406eb30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f10c8009130 tx=0x7f10c80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.979 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.965+0000 7f10b37fe640 10 client.?.objecter ms_handle_connect 0x7f10d40c48c0 2026-02-17T11:10:35.979 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.965+0000 7f10b37fe640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:35.979 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.967+0000 7efc737fe640 1 -- 10.20.193.49:0/1047109506 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7efc84042840 con 0x7efc94155fb0 2026-02-17T11:10:35.981 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.967+0000 7f10b37fe640 1 -- 10.20.193.49:0/1638920163 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c8046020 con 0x7f10d40c48c0 2026-02-17T11:10:35.981 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.967+0000 7f10b37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.981 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.967+0000 7f10b37fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:10:35.981 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.967+0000 7f10b37fe640 10 monclient: dump: 2026-02-17T11:10:35.981 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.981 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.981 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.981 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.982 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.982 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.982 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.982 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.982 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.982 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.982 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.967+0000 7f10b37fe640 10 monclient: _finish_auth 0 2026-02-17T11:10:35.982 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.967+0000 7f10b37fe640 10 monclient: _check_auth_tickets 2026-02-17T11:10:35.982 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.967+0000 7f10b37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:35.983 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.967+0000 7f10b37fe640 1 -- 10.20.193.49:0/1638920163 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10c80426e0 con 0x7f10d40c48c0 2026-02-17T11:10:35.983 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.967+0000 7f10d9491640 5 monclient: authenticate success, global_id 4500 2026-02-17T11:10:35.983 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.967+0000 7f10b37fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:35.983 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.967+0000 7f10b37fe640 1 -- 10.20.193.49:0/1638920163 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c803c040 con 0x7f10d40c48c0 2026-02-17T11:10:35.983 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.967+0000 7f10d9491640 10 monclient: _renew_subs 2026-02-17T11:10:35.983 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.967+0000 7f10d9491640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:35.983 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.967+0000 7f10d9491640 1 -- 10.20.193.49:0/1638920163 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10d406d7b0 con 0x7f10d40c48c0 2026-02-17T11:10:35.983 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.967+0000 7f10d17fa640 4 set_mon_vals no callback set 2026-02-17T11:10:35.983 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.967+0000 7f10b37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.983 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.967+0000 7f10b37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:10:35.984 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.967+0000 7f10b37fe640 10 monclient: dump: 2026-02-17T11:10:35.984 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.984 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.984 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.984 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.984 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.984 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.984 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.984 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:35.984 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:35.984 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:35.985 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.967+0000 7efc737fe640 1 --2- 10.20.193.49:0/1047109506 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7efc600791c0 0x7efc6007b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.985 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.967+0000 7f10d9491640 10 client.4500.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:35.986 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.967+0000 7f10d9491640 10 monclient: _renew_subs 2026-02-17T11:10:35.986 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.967+0000 7f10d9491640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:35.986 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.967+0000 7f10d9491640 1 -- 10.20.193.49:0/1638920163 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10d406dd70 con 0x7f10d40c48c0 2026-02-17T11:10:35.986 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.967+0000 7f10d9491640 1 librados: init done 2026-02-17T11:10:35.986 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.967+0000 7efc92ffd640 1 --2- 10.20.193.49:0/1047109506 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7efc600791c0 0x7efc6007b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.987 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.967+0000 7efc92ffd640 10 monclient: get_auth_request con 0x7efc600791c0 auth_method 0 2026-02-17T11:10:35.987 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.968+0000 7f10d9491640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:35.987 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.968+0000 7f10d9491640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:35.987 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.968+0000 7f10d9491640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:35.987 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.968+0000 7f10d9491640 1 -- 10.20.193.49:0/1638920163 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10d40c7550 con 0x7f10d40c48c0 2026-02-17T11:10:35.988 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.968+0000 7efc92ffd640 1 --2- 10.20.193.49:0/1047109506 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7efc600791c0 0x7efc6007b680 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7efc88006fd0 tx=0x7efc88008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.988 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.968+0000 7efc737fe640 10 client.4495.objecter ms_handle_connect 0x7efc600791c0 2026-02-17T11:10:35.988 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.969+0000 7efc737fe640 1 -- 10.20.193.49:0/1047109506 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7efc840027c0 con 0x7efc94155fb0 2026-02-17T11:10:35.989 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.969+0000 7efc737fe640 10 client.4495.objecter ms_dispatch2 0x7efc94000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:35.989 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.969+0000 7efc737fe640 3 client.4495.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:35.989 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.969+0000 7efc737fe640 3 client.4495.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:35.989 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.969+0000 7efc737fe640 20 client.4495.objecter dump_active .. 0 homeless 2026-02-17T11:10:35.990 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280517 got 94489280516 for osd.13 2026-02-17T11:10:35.990 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.976+0000 7efc737fe640 1 -- 10.20.193.49:0/1047109506 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7efc84087b80 con 0x7efc94155fb0 2026-02-17T11:10:35.990 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.976+0000 7efc737fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:35.990 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.976+0000 7efc737fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:35.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.979+0000 7f10b37fe640 1 -- 10.20.193.49:0/1638920163 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f10c803f030 con 0x7f10d40c48c0 2026-02-17T11:10:35.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.980+0000 7f10b37fe640 1 --2- 10.20.193.49:0/1638920163 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f10a0079190 0x7f10a007b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:35.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.980+0000 7f10d27fc640 1 --2- 10.20.193.49:0/1638920163 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f10a0079190 0x7f10a007b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:35.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.980+0000 7f10d27fc640 10 monclient: get_auth_request con 0x7f10a0079190 auth_method 0 2026-02-17T11:10:35.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.981+0000 7f10d27fc640 1 --2- 10.20.193.49:0/1638920163 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f10a0079190 0x7f10a007b650 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f10bc007fd0 tx=0x7f10bc007b20 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:35.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.981+0000 7f10b37fe640 10 client.4500.objecter ms_handle_connect 0x7f10a0079190 2026-02-17T11:10:35.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.982+0000 7f10b37fe640 1 -- 10.20.193.49:0/1638920163 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7f10c8083630 con 0x7f10d40c48c0 2026-02-17T11:10:35.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.982+0000 7f10b37fe640 10 client.4500.objecter ms_dispatch2 0x7f10d4000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:35.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.982+0000 7f10b37fe640 3 client.4500.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:35.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.982+0000 7f10b37fe640 3 client.4500.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:35.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.982+0000 7f10b37fe640 20 client.4500.objecter dump_active .. 0 homeless 2026-02-17T11:10:35.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.982+0000 7f3ee6ffd640 1 -- 10.20.193.49:0/3724416512 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3f00073d50 con 0x7f3f0015ef80 2026-02-17T11:10:35.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.982+0000 7f3ee6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 8}] 2026-02-17T11:10:35.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.982+0000 7f3ee6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:35.993 INFO:teuthology.orchestra.run.trial049.stdout:90194313220 2026-02-17T11:10:35.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.983+0000 7ff125ffb640 1 -- 10.20.193.49:0/2386248712 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 15}]=0 v0) ==== 75+0+12 (secure 0 0 0) 0x7ff1280623e0 con 0x7ff13806e5b0 2026-02-17T11:10:35.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.984+0000 7ff125ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-17T11:10:35.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.984+0000 7ff125ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:35.994 INFO:teuthology.orchestra.run.trial049.stdout:94489280516 2026-02-17T11:10:35.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.984+0000 7f3f04ee2640 10 librados: watch_flush enter 2026-02-17T11:10:35.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.984+0000 7f3f04ee2640 10 librados: watch_flush exit 2026-02-17T11:10:35.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.984+0000 7f3f04ee2640 20 client.4480.objecter shutdown clearing up homeless session... 2026-02-17T11:10:35.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.984+0000 7f3f04ee2640 10 client.4480.objecter successfully canceled tick 2026-02-17T11:10:35.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.984+0000 7f3f04ee2640 1 -- 10.20.193.49:0/3724416512 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3ecc079190 msgr2=0x7f3ecc07b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.984+0000 7f3f04ee2640 1 --2- 10.20.193.49:0/3724416512 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3ecc079190 0x7f3ecc07b650 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3ef40099b0 tx=0x7f3ef4008040 comp rx=0 tx=0).stop 2026-02-17T11:10:35.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.984+0000 7f3f04ee2640 10 monclient: shutdown 2026-02-17T11:10:35.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.984+0000 7f3f04ee2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:35.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.984+0000 7f3f04ee2640 1 -- 10.20.193.49:0/3724416512 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f3f0015ef80 msgr2=0x7f3f00148100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.984+0000 7f3f04ee2640 1 --2- 10.20.193.49:0/3724416512 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f3f0015ef80 0x7f3f00148100 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3ef0035000 tx=0x7f3ef0004b40 comp rx=0 tx=0).stop 2026-02-17T11:10:35.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.984+0000 7f3f04ee2640 1 -- 10.20.193.49:0/3724416512 shutdown_connections 2026-02-17T11:10:35.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.984+0000 7f3f04ee2640 1 --2- 10.20.193.49:0/3724416512 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3ecc079190 0x7f3ecc07b650 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.984+0000 7f3f04ee2640 1 --2- 10.20.193.49:0/3724416512 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f3f0015ef80 0x7f3f00148100 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.984+0000 7f3f04ee2640 1 --2- 10.20.193.49:0/3724416512 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f3f00152ae0 0x7f3f001f3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.984+0000 7f3f04ee2640 1 --2- 10.20.193.49:0/3724416512 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f3f00152700 0x7f3f0015b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.984+0000 7f3f04ee2640 1 -- 10.20.193.49:0/3724416512 >> 10.20.193.49:0/3724416512 conn(0x7f3f00073030 msgr2=0x7f3f0015fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:35.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.984+0000 7f3f04ee2640 1 -- 10.20.193.49:0/3724416512 shutdown_connections 2026-02-17T11:10:35.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.984+0000 7f3f04ee2640 1 -- 10.20.193.49:0/3724416512 wait complete. 2026-02-17T11:10:35.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.984+0000 7f3f04ee2640 1 librados: shutdown 2026-02-17T11:10:35.997 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.986+0000 7ff13f2c4640 10 librados: watch_flush enter 2026-02-17T11:10:35.997 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.986+0000 7ff13f2c4640 10 librados: watch_flush exit 2026-02-17T11:10:35.997 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.986+0000 7ff13f2c4640 20 client.4489.objecter shutdown clearing up homeless session... 2026-02-17T11:10:35.997 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.986+0000 7ff13f2c4640 10 client.4489.objecter successfully canceled tick 2026-02-17T11:10:35.997 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.986+0000 7ff13f2c4640 1 -- 10.20.193.49:0/2386248712 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ff1080791c0 msgr2=0x7ff10807b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.997 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.986+0000 7ff13f2c4640 1 --2- 10.20.193.49:0/2386248712 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ff1080791c0 0x7ff10807b680 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff138074390 tx=0x7ff12c031000 comp rx=0 tx=0).stop 2026-02-17T11:10:35.997 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.986+0000 7ff13f2c4640 10 monclient: shutdown 2026-02-17T11:10:35.998 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.986+0000 7ff13f2c4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:35.998 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.986+0000 7ff13f2c4640 1 -- 10.20.193.49:0/2386248712 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7ff13806e5b0 msgr2=0x7ff1381f46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:35.998 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.986+0000 7ff13f2c4640 1 --2- 10.20.193.49:0/2386248712 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7ff13806e5b0 0x7ff1381f46d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff12800b4d0 tx=0x7ff12800b9a0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.998 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.986+0000 7ff13f2c4640 1 -- 10.20.193.49:0/2386248712 shutdown_connections 2026-02-17T11:10:35.998 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.986+0000 7ff13f2c4640 1 --2- 10.20.193.49:0/2386248712 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ff1080791c0 0x7ff10807b680 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.998 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.986+0000 7ff13f2c4640 1 --2- 10.20.193.49:0/2386248712 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff138155fb0 0x7ff13814aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.998 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.986+0000 7ff13f2c4640 1 --2- 10.20.193.49:0/2386248712 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ff1380ce8d0 0x7ff138145b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.998 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.986+0000 7ff13f2c4640 1 --2- 10.20.193.49:0/2386248712 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7ff13806e5b0 0x7ff1381f46d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:35.998 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.986+0000 7ff13f2c4640 1 -- 10.20.193.49:0/2386248712 >> 10.20.193.49:0/2386248712 conn(0x7ff13806da90 msgr2=0x7ff13806de70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:35.998 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.986+0000 7ff13f2c4640 1 -- 10.20.193.49:0/2386248712 shutdown_connections 2026-02-17T11:10:35.998 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.986+0000 7ff13f2c4640 1 -- 10.20.193.49:0/2386248712 wait complete. 2026-02-17T11:10:35.998 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.986+0000 7ff13f2c4640 1 librados: shutdown 2026-02-17T11:10:35.999 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.990+0000 7f26d7fff640 1 -- 10.20.193.49:0/2083608995 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d803c070 con 0x7f26e815a370 2026-02-17T11:10:35.999 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.990+0000 7f26d7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:35.999 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.990+0000 7f26d7fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:10:35.999 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.990+0000 7f26d7fff640 10 monclient: dump: 2026-02-17T11:10:35.999 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:35.999 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:35.999 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.999 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:35.999 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:35.999 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:35.999 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:35.999 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:36.000 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:36.000 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:36.000 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.990+0000 7f26d7fff640 10 monclient: _finish_auth 0 2026-02-17T11:10:36.000 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.990+0000 7f26d7fff640 10 monclient: _check_auth_tickets 2026-02-17T11:10:36.000 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.990+0000 7f26d7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:36.000 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.990+0000 7f26d7fff640 1 -- 10.20.193.49:0/2083608995 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26d802fbe0 con 0x7f26e815a370 2026-02-17T11:10:36.000 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.990+0000 7f26d7fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:36.000 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.990+0000 7f26d7fff640 1 -- 10.20.193.49:0/2083608995 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d8037440 con 0x7f26e815a370 2026-02-17T11:10:36.000 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.990+0000 7f26ef6d1640 5 monclient: authenticate success, global_id 4498 2026-02-17T11:10:36.000 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.990+0000 7f26ef6d1640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:36.000 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.990+0000 7f26ef6d1640 4 set_mon_vals no callback set 2026-02-17T11:10:36.000 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.990+0000 7f26d7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:36.000 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.990+0000 7f26d7fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:36.000 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.990+0000 7f26d7fff640 10 monclient: dump: 2026-02-17T11:10:36.000 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:36.000 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:36.000 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:36.001 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:36.001 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:36.001 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:36.001 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:36.001 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:36.001 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:36.001 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:36.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.991+0000 7fe1b3fff640 1 -- 10.20.193.49:0/3862007712 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe1c4021020 con 0x7fe1dc0d1f40 2026-02-17T11:10:36.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.991+0000 7fe1b3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-17T11:10:36.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.991+0000 7fe1b3fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:36.002 INFO:teuthology.orchestra.run.trial049.stdout:94489280515 2026-02-17T11:10:36.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.991+0000 7f26ef6d1640 10 monclient: shutdown 2026-02-17T11:10:36.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.991+0000 7f26ef6d1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:36.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.991+0000 7f26ef6d1640 1 -- 10.20.193.49:0/2083608995 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f26e815a370 msgr2=0x7f26e80cba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:36.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.991+0000 7f26ef6d1640 1 --2- 10.20.193.49:0/2083608995 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f26e815a370 0x7f26e80cba50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f26e808ef70 tx=0x7f26d802eed0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.991+0000 7f26ef6d1640 1 -- 10.20.193.49:0/2083608995 shutdown_connections 2026-02-17T11:10:36.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.991+0000 7f26ef6d1640 1 --2- 10.20.193.49:0/2083608995 >> v2:10.20.193.49:3300/0 conn(0x7f26e81603c0 0x7f26e80d18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.991+0000 7f26ef6d1640 1 --2- 10.20.193.49:0/2083608995 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f26e815a370 0x7f26e80cba50 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.991+0000 7f26ef6d1640 1 -- 10.20.193.49:0/2083608995 >> 10.20.193.49:0/2083608995 conn(0x7f26e8073030 msgr2=0x7f26e8073440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:36.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.991+0000 7f26ef6d1640 1 -- 10.20.193.49:0/2083608995 shutdown_connections 2026-02-17T11:10:36.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.991+0000 7f26ef6d1640 1 -- 10.20.193.49:0/2083608995 wait complete. 2026-02-17T11:10:36.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.992+0000 7f26ef6d1640 10 monclient: build_initial_monmap 2026-02-17T11:10:36.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.992+0000 7f26ef6d1640 10 monclient: monmap: 2026-02-17T11:10:36.003 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:36.003 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:36.003 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:36.003 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:36.003 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:36.004 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:36.004 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:36.004 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:36.004 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:36.004 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:36.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.992+0000 7f26ef6d1640 1 librados: starting msgr at 2026-02-17T11:10:36.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.992+0000 7f26ef6d1640 1 librados: starting objecter 2026-02-17T11:10:36.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.992+0000 7f26ef6d1640 1 Processor -- start 2026-02-17T11:10:36.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.992+0000 7f26ef6d1640 1 -- start start 2026-02-17T11:10:36.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.992+0000 7f26ef6d1640 1 librados: setting wanted keys 2026-02-17T11:10:36.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.992+0000 7f26ef6d1640 1 librados: calling monclient init 2026-02-17T11:10:36.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.992+0000 7f26ef6d1640 10 monclient: init 2026-02-17T11:10:36.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.992+0000 7ff6127fc640 1 -- 10.20.193.49:0/546728900 <== mon.2 v2:10.20.193.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ff620062640 con 0x7ff624164440 2026-02-17T11:10:36.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.992+0000 7ff6127fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:36.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.992+0000 7ff6127fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:36.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.993+0000 7f26ef6d1640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:36.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.993+0000 7f26ef6d1640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:10:36.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.993+0000 7f26ef6d1640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f26e815a370 0x7f26e80d1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:36.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.993+0000 7f26ef6d1640 10 monclient(hunting): picked mon.noname-b con 0x7f26e815a370 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:36.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.993+0000 7f26ef6d1640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f26e815a750 0x7f26e81494f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:36.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.993+0000 7f26ef6d1640 10 monclient(hunting): picked mon.noname-a con 0x7f26e815a750 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:36.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.993+0000 7f26ef6d1640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f26e81603c0 0x7f26e80c64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:36.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.993+0000 7f26ef6d1640 10 monclient(hunting): picked mon.noname-c con 0x7f26e81603c0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:36.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.993+0000 7f26ef6d1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:36.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.993+0000 7f26ef6d1640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f26e80c9d00 con 0x7f26e815a750 2026-02-17T11:10:36.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.993+0000 7f26ef6d1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:36.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.993+0000 7f26ef6d1640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f26e80d27c0 con 0x7f26e815a370 2026-02-17T11:10:36.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.993+0000 7f26ef6d1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:36.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.993+0000 7f26ef6d1640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f26e80c9e80 con 0x7f26e81603c0 2026-02-17T11:10:36.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.993+0000 7f26ef6d1640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:36.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.993+0000 7f26ef6d1640 10 monclient(hunting): authenticate will time out at 1112.656158s 2026-02-17T11:10:36.007 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.993+0000 7fe1e1951640 10 librados: watch_flush enter 2026-02-17T11:10:36.007 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.993+0000 7fe1e1951640 10 librados: watch_flush exit 2026-02-17T11:10:36.007 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.993+0000 7fe1e1951640 20 client.4483.objecter shutdown clearing up homeless session... 2026-02-17T11:10:36.007 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.993+0000 7fe1e1951640 10 client.4483.objecter successfully canceled tick 2026-02-17T11:10:36.007 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.993+0000 7fe1e1951640 1 -- 10.20.193.49:0/3862007712 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fe1ac079190 msgr2=0x7fe1ac07b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:36.007 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.993+0000 7fe1e1951640 1 --2- 10.20.193.49:0/3862007712 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fe1ac079190 0x7fe1ac07b650 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe1d000a830 tx=0x7fe1d0008040 comp rx=0 tx=0).stop 2026-02-17T11:10:36.007 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.993+0000 7fe1e1951640 10 monclient: shutdown 2026-02-17T11:10:36.007 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.993+0000 7fe1e1951640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:36.007 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.993+0000 7fe1e1951640 1 -- 10.20.193.49:0/3862007712 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe1dc0d1f40 msgr2=0x7fe1dc0cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:36.007 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.993+0000 7fe1e1951640 1 --2- 10.20.193.49:0/3862007712 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe1dc0d1f40 0x7fe1dc0cf9b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe1c400c460 tx=0x7fe1c400c930 comp rx=0 tx=0).stop 2026-02-17T11:10:36.007 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.993+0000 7fe1e1951640 1 -- 10.20.193.49:0/3862007712 shutdown_connections 2026-02-17T11:10:36.007 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.993+0000 7fe1e1951640 1 --2- 10.20.193.49:0/3862007712 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fe1ac079190 0x7fe1ac07b650 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.007 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.993+0000 7fe1e1951640 1 --2- 10.20.193.49:0/3862007712 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe1dc15e060 0x7fe1dc0ce760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.007 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.993+0000 7fe1e1951640 1 --2- 10.20.193.49:0/3862007712 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe1dc0d1f40 0x7fe1dc0cf9b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.008 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.993+0000 7fe1e1951640 1 --2- 10.20.193.49:0/3862007712 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe1dc0d1b60 0x7fe1dc1f4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.008 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.993+0000 7fe1e1951640 1 -- 10.20.193.49:0/3862007712 >> 10.20.193.49:0/3862007712 conn(0x7fe1dc06d9b0 msgr2=0x7fe1dc150880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:36.008 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.993+0000 7fe1e1951640 1 -- 10.20.193.49:0/3862007712 shutdown_connections 2026-02-17T11:10:36.008 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.993+0000 7fe1e1951640 1 -- 10.20.193.49:0/3862007712 wait complete. 2026-02-17T11:10:36.008 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.993+0000 7fe1e1951640 1 librados: shutdown 2026-02-17T11:10:36.008 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313220 for osd.8 2026-02-17T11:10:36.009 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.994+0000 7fbd417fa640 1 -- 10.20.193.49:0/1287266055 <== mon.2 v2:10.20.193.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fbd340877d0 con 0x7fbd44155650 2026-02-17T11:10:36.009 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.994+0000 7fbd417fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-17T11:10:36.009 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.994+0000 7fbd417fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:36.009 INFO:teuthology.orchestra.run.trial049.stdout:111669149703 2026-02-17T11:10:36.009 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.995+0000 7f26ed446640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f26e815a370 0x7f26e80d1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:36.009 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.995+0000 7f26ed446640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f26e815a370 0x7f26e80d1860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:48404/0 (socket says 10.20.193.49:48404) 2026-02-17T11:10:36.010 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.995+0000 7f26ed446640 1 -- 10.20.193.49:0/3091068981 learned_addr learned my addr 10.20.193.49:0/3091068981 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:36.010 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.995+0000 7f26ed446640 10 monclient(hunting): get_auth_request con 0x7f26e815a370 auth_method 0 2026-02-17T11:10:36.010 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.995+0000 7f26ed446640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:36.010 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.995+0000 7f26ed446640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:36.010 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.995+0000 7f26ed446640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:36.010 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.995+0000 7f26ed446640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:36.010 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.995+0000 7f26ed446640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:36.010 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.995+0000 7f26ed446640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:36.011 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280518 got 94489280516 for osd.15 2026-02-17T11:10:36.011 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.996+0000 7fbd4b032640 10 librados: watch_flush enter 2026-02-17T11:10:36.011 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.996+0000 7fbd4b032640 10 librados: watch_flush exit 2026-02-17T11:10:36.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.996+0000 7fbd4b032640 20 client.4502.objecter shutdown clearing up homeless session... 2026-02-17T11:10:36.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.996+0000 7fbd4b032640 10 client.4502.objecter successfully canceled tick 2026-02-17T11:10:36.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.996+0000 7fbd4b032640 1 -- 10.20.193.49:0/1287266055 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fbd1c079190 msgr2=0x7fbd1c07b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:36.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.996+0000 7fbd4b032640 1 --2- 10.20.193.49:0/1287266055 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fbd1c079190 0x7fbd1c07b650 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbd441f6a50 tx=0x7fbd38009250 comp rx=0 tx=0).stop 2026-02-17T11:10:36.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.996+0000 7fbd4b032640 10 monclient: shutdown 2026-02-17T11:10:36.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.996+0000 7fbd4b032640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:36.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.996+0000 7fbd4b032640 1 -- 10.20.193.49:0/1287266055 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fbd44155650 msgr2=0x7fbd441487f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:36.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.996+0000 7fbd4b032640 1 --2- 10.20.193.49:0/1287266055 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fbd44155650 0x7fbd441487f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbd3402f4c0 tx=0x7fbd340047c0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.996+0000 7fbd4b032640 1 -- 10.20.193.49:0/1287266055 shutdown_connections 2026-02-17T11:10:36.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.996+0000 7fbd4b032640 1 --2- 10.20.193.49:0/1287266055 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fbd1c079190 0x7fbd1c07b650 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.996+0000 7fbd4b032640 1 --2- 10.20.193.49:0/1287266055 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fbd44155650 0x7fbd441487f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.996+0000 7fbd4b032640 1 --2- 10.20.193.49:0/1287266055 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbd44155270 0x7fbd440c27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.996+0000 7fbd4b032640 1 --2- 10.20.193.49:0/1287266055 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fbd4406d4f0 0x7fbd441f3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.996+0000 7fbd4b032640 1 -- 10.20.193.49:0/1287266055 >> 10.20.193.49:0/1287266055 conn(0x7fbd440c9f40 msgr2=0x7fbd44154000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:36.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.996+0000 7fbd4b032640 1 -- 10.20.193.49:0/1287266055 shutdown_connections 2026-02-17T11:10:36.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.996+0000 7fbd4b032640 1 -- 10.20.193.49:0/1287266055 wait complete. 2026-02-17T11:10:36.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.996+0000 7fbd4b032640 1 librados: shutdown 2026-02-17T11:10:36.013 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.997+0000 7f26ed446640 10 monclient(hunting): handle_auth_done global_id 4504 payload 824 2026-02-17T11:10:36.013 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.997+0000 7f26ed446640 1 -- 10.20.193.49:0/3091068981 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f26e81603c0 msgr2=0x7f26e80c64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:36.013 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.997+0000 7f26ed446640 1 --2- 10.20.193.49:0/3091068981 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f26e81603c0 0x7f26e80c64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.013 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.997+0000 7f26ed446640 1 -- 10.20.193.49:0/3091068981 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f26e815a750 msgr2=0x7f26e81494f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:36.013 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.997+0000 7f26ed446640 1 --2- 10.20.193.49:0/3091068981 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f26e815a750 0x7f26e81494f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.013 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.997+0000 7f26ed446640 10 monclient: _finish_hunting 0 2026-02-17T11:10:36.013 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.997+0000 7f26ed446640 1 monclient: found mon.noname-b 2026-02-17T11:10:36.013 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.997+0000 7f26ed446640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:36.013 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.997+0000 7f26ed446640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:10:36.013 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.997+0000 7f26ed446640 1 -- 10.20.193.49:0/3091068981 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26e81f8270 con 0x7f26e815a370 2026-02-17T11:10:36.013 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.997+0000 7f99b4a91640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-17T11:10:36.014 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.997+0000 7f99b4a91640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-17T11:10:36.014 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.997+0000 7f99b4a91640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:36.014 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.997+0000 7f99b4a91640 1 -- 10.20.193.49:0/862010316 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f99b01598f0 con 0x7f99b0152700 2026-02-17T11:10:36.014 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.998+0000 7f26ed446640 1 --2- 10.20.193.49:0/3091068981 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f26e815a370 0x7f26e80d1860 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f26d8009a70 tx=0x7f26d80047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:36.014 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.998+0000 7f26d5ffb640 10 client.?.objecter ms_handle_connect 0x7f26e815a370 2026-02-17T11:10:36.014 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.998+0000 7f26d5ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:36.015 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.999+0000 7f26d5ffb640 1 -- 10.20.193.49:0/3091068981 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d8047070 con 0x7f26e815a370 2026-02-17T11:10:36.015 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.999+0000 7f26d5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:36.015 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.999+0000 7f26d5ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:10:36.015 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.999+0000 7f26d5ffb640 10 monclient: dump: 2026-02-17T11:10:36.015 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:36.015 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:36.015 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:36.015 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:36.015 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:36.015 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:36.015 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:36.015 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:36.015 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:36.015 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:36.015 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.999+0000 7f26d5ffb640 10 monclient: _finish_auth 0 2026-02-17T11:10:36.015 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.999+0000 7f26d5ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:10:36.015 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.999+0000 7f26d5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:36.015 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.999+0000 7f26d5ffb640 1 -- 10.20.193.49:0/3091068981 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26d8042630 con 0x7f26e815a370 2026-02-17T11:10:36.015 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.999+0000 7f26d5ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:36.015 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.999+0000 7f26d5ffb640 1 -- 10.20.193.49:0/3091068981 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d803c040 con 0x7f26e815a370 2026-02-17T11:10:36.015 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.999+0000 7f26ef6d1640 5 monclient: authenticate success, global_id 4504 2026-02-17T11:10:36.015 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.999+0000 7f26ef6d1640 10 monclient: _renew_subs 2026-02-17T11:10:36.015 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.999+0000 7f26d77fe640 4 set_mon_vals no callback set 2026-02-17T11:10:36.015 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.999+0000 7f26ef6d1640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:36.015 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.999+0000 7f26ef6d1640 1 -- 10.20.193.49:0/3091068981 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26e81f8550 con 0x7f26e815a370 2026-02-17T11:10:36.016 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.999+0000 7f26d5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:36.016 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.999+0000 7f26d5ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:36.016 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.999+0000 7f26d5ffb640 10 monclient: dump: 2026-02-17T11:10:36.016 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:36.016 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:36.016 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:36.016 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:36.016 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:36.016 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:36.016 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:36.016 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:36.016 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:36.016 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:36.016 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.999+0000 7f26ef6d1640 10 client.4504.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:36.016 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.999+0000 7f26ef6d1640 10 monclient: _renew_subs 2026-02-17T11:10:36.016 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.999+0000 7f26ef6d1640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:36.016 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.999+0000 7f26ef6d1640 1 -- 10.20.193.49:0/3091068981 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26e81f8b10 con 0x7f26e815a370 2026-02-17T11:10:36.016 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:35.999+0000 7f26ef6d1640 1 librados: init done 2026-02-17T11:10:36.016 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.000+0000 7f26ef6d1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:36.016 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.000+0000 7f26ef6d1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:36.016 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.000+0000 7f26ef6d1640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:36.016 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.000+0000 7f26ef6d1640 1 -- 10.20.193.49:0/3091068981 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26e80cba50 con 0x7f26e815a370 2026-02-17T11:10:36.017 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280517 got 94489280515 for osd.5 2026-02-17T11:10:36.017 INFO:tasks.ceph.ceph_manager.ceph:need seq 111669149704 got 111669149703 for osd.0 2026-02-17T11:10:36.018 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.005+0000 7fc7637fe640 1 -- 10.20.193.49:0/2454147964 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7fc778004210 con 0x7fc770004900 2026-02-17T11:10:36.018 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.006+0000 7fc7637fe640 1 --2- 10.20.193.49:0/2454147964 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fc750079170 0x7fc75007b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:36.018 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.006+0000 7fc7827fc640 1 --2- 10.20.193.49:0/2454147964 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fc750079170 0x7fc75007b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:36.018 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.006+0000 7fc7827fc640 10 monclient: get_auth_request con 0x7fc750079170 auth_method 0 2026-02-17T11:10:36.018 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.007+0000 7fc7637fe640 10 client.4505.objecter ms_handle_connect 0x7fc750079170 2026-02-17T11:10:36.018 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.007+0000 7fc7827fc640 1 --2- 10.20.193.49:0/2454147964 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fc750079170 0x7fc75007b630 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc76c039000 tx=0x7fc76c031000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:36.018 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.008+0000 7fc7637fe640 1 -- 10.20.193.49:0/2454147964 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7fc77805dfa0 con 0x7fc770004900 2026-02-17T11:10:36.018 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.008+0000 7fc7637fe640 10 client.4505.objecter ms_dispatch2 0x7fc784000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:36.018 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.008+0000 7fc7637fe640 3 client.4505.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:36.018 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.008+0000 7fc7637fe640 3 client.4505.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:36.018 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.008+0000 7fc7637fe640 20 client.4505.objecter dump_active .. 0 homeless 2026-02-17T11:10:36.019 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.011+0000 7f26d5ffb640 1 -- 10.20.193.49:0/3091068981 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f26d803f3c0 con 0x7f26e815a370 2026-02-17T11:10:36.019 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.011+0000 7f26d5ffb640 1 --2- 10.20.193.49:0/3091068981 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f26b8079140 0x7f26b807b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:36.019 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.011+0000 7f26ecc45640 1 --2- 10.20.193.49:0/3091068981 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f26b8079140 0x7f26b807b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:36.019 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.011+0000 7f26ecc45640 10 monclient: get_auth_request con 0x7f26b8079140 auth_method 0 2026-02-17T11:10:36.019 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.012+0000 7f26d5ffb640 10 client.4504.objecter ms_handle_connect 0x7f26b8079140 2026-02-17T11:10:36.019 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.012+0000 7f26ecc45640 1 --2- 10.20.193.49:0/3091068981 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f26b8079140 0x7f26b807b600 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f26e814ca90 tx=0x7f26dc006cf0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:36.019 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.013+0000 7f26d5ffb640 1 -- 10.20.193.49:0/3091068981 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7f26d8082d70 con 0x7f26e815a370 2026-02-17T11:10:36.019 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.013+0000 7f26d5ffb640 10 client.4504.objecter ms_dispatch2 0x7f26e8000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:36.019 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.013+0000 7f26d5ffb640 3 client.4504.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:36.019 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.013+0000 7f26d5ffb640 3 client.4504.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:36.019 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.013+0000 7f26d5ffb640 20 client.4504.objecter dump_active .. 0 homeless 2026-02-17T11:10:36.019 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.014+0000 7fc7637fe640 1 -- 10.20.193.49:0/2454147964 <== mon.2 v2:10.20.193.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc778062660 con 0x7fc770004900 2026-02-17T11:10:36.019 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.014+0000 7fc7637fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:36.019 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.014+0000 7fc7637fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:36.064 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.062+0000 7efc996b0640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-17T11:10:36.064 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.062+0000 7efc996b0640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-17T11:10:36.064 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.062+0000 7efc996b0640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:36.064 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.062+0000 7efc996b0640 1 -- 10.20.193.49:0/1047109506 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7efc9414fdc0 con 0x7efc94155fb0 2026-02-17T11:10:36.079 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.077+0000 7ff62c1fb640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-17T11:10:36.079 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.077+0000 7ff62c1fb640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-17T11:10:36.079 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.077+0000 7ff62c1fb640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:36.079 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.077+0000 7ff62c1fb640 1 -- 10.20.193.49:0/546728900 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7ff624163f80 con 0x7ff624164440 2026-02-17T11:10:36.081 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.080+0000 7ff6127fc640 1 -- 10.20.193.49:0/546728900 <== mon.2 v2:10.20.193.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff620061f40 con 0x7ff624164440 2026-02-17T11:10:36.081 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.080+0000 7ff6127fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-17T11:10:36.081 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.080+0000 7ff6127fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:36.081 INFO:teuthology.orchestra.run.trial049.stdout:94489280516 2026-02-17T11:10:36.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.082+0000 7ff62c1fb640 10 librados: watch_flush enter 2026-02-17T11:10:36.084 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.082+0000 7ff62c1fb640 10 librados: watch_flush exit 2026-02-17T11:10:36.084 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.082+0000 7ff62c1fb640 20 client.4508.objecter shutdown clearing up homeless session... 2026-02-17T11:10:36.084 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.082+0000 7ff62c1fb640 10 client.4508.objecter successfully canceled tick 2026-02-17T11:10:36.084 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.082+0000 7ff62c1fb640 1 -- 10.20.193.49:0/546728900 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ff5f4079190 msgr2=0x7ff5f407b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:36.084 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.082+0000 7ff62c1fb640 1 --2- 10.20.193.49:0/546728900 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ff5f4079190 0x7ff5f407b650 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff61402ee20 tx=0x7ff614033000 comp rx=0 tx=0).stop 2026-02-17T11:10:36.084 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.082+0000 7ff62c1fb640 10 monclient: shutdown 2026-02-17T11:10:36.084 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.082+0000 7ff62c1fb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:36.084 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.082+0000 7ff62c1fb640 1 -- 10.20.193.49:0/546728900 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff624164440 msgr2=0x7ff6241fb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:36.084 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.082+0000 7ff62c1fb640 1 --2- 10.20.193.49:0/546728900 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff624164440 0x7ff6241fb880 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff62000be50 tx=0x7ff62000bf50 comp rx=0 tx=0).stop 2026-02-17T11:10:36.084 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.082+0000 7ff62c1fb640 1 -- 10.20.193.49:0/546728900 shutdown_connections 2026-02-17T11:10:36.084 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.082+0000 7ff62c1fb640 1 --2- 10.20.193.49:0/546728900 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ff5f4079190 0x7ff5f407b650 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.084 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.082+0000 7ff62c1fb640 1 --2- 10.20.193.49:0/546728900 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff624164440 0x7ff6241fb880 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.084 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.082+0000 7ff62c1fb640 1 --2- 10.20.193.49:0/546728900 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7ff624163950 0x7ff6241f5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.085 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.082+0000 7ff62c1fb640 1 --2- 10.20.193.49:0/546728900 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ff624161850 0x7ff6240c7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.085 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.082+0000 7ff62c1fb640 1 -- 10.20.193.49:0/546728900 >> 10.20.193.49:0/546728900 conn(0x7ff6240cafa0 msgr2=0x7ff6240cd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:36.085 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.082+0000 7ff62c1fb640 1 -- 10.20.193.49:0/546728900 shutdown_connections 2026-02-17T11:10:36.085 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.082+0000 7ff62c1fb640 1 -- 10.20.193.49:0/546728900 wait complete. 2026-02-17T11:10:36.085 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.082+0000 7ff62c1fb640 1 librados: shutdown 2026-02-17T11:10:36.091 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.090+0000 7f10b37fe640 1 -- 10.20.193.49:0/1638920163 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f10c8050070 con 0x7f10d40c48c0 2026-02-17T11:10:36.091 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.090+0000 7f10b37fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:36.091 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.090+0000 7f10b37fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:36.093 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280518 got 94489280516 for osd.2 2026-02-17T11:10:36.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.099+0000 7fc7894b6640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-17T11:10:36.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.099+0000 7fc7894b6640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-17T11:10:36.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.099+0000 7fc7894b6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:36.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.099+0000 7fc7894b6640 1 -- 10.20.193.49:0/2454147964 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fc784071660 con 0x7fc770004900 2026-02-17T11:10:36.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.100+0000 7f9996ffd640 1 -- 10.20.193.49:0/862010316 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f99a4051080 con 0x7f99b0152700 2026-02-17T11:10:36.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.100+0000 7f9996ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-17T11:10:36.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.100+0000 7f9996ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:36.102 INFO:teuthology.orchestra.run.trial049.stdout:94489280516 2026-02-17T11:10:36.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.102+0000 7fc7637fe640 1 -- 10.20.193.49:0/2454147964 <== mon.2 v2:10.20.193.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc778061f60 con 0x7fc770004900 2026-02-17T11:10:36.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.102+0000 7fc7637fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-17T11:10:36.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.102+0000 7fc7637fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:36.103 INFO:teuthology.orchestra.run.trial049.stdout:90194313221 2026-02-17T11:10:36.105 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.102+0000 7f99b4a91640 10 librados: watch_flush enter 2026-02-17T11:10:36.105 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.102+0000 7f99b4a91640 10 librados: watch_flush exit 2026-02-17T11:10:36.105 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.102+0000 7f99b4a91640 20 client.4491.objecter shutdown clearing up homeless session... 2026-02-17T11:10:36.105 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.102+0000 7f99b4a91640 10 client.4491.objecter successfully canceled tick 2026-02-17T11:10:36.105 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.102+0000 7f99b4a91640 1 -- 10.20.193.49:0/862010316 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f997c0791c0 msgr2=0x7f997c07b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:36.105 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.102+0000 7f99b4a91640 1 --2- 10.20.193.49:0/862010316 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f997c0791c0 0x7f997c07b680 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f99b01f17a0 tx=0x7f9998006ca0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.102+0000 7f99b4a91640 10 monclient: shutdown 2026-02-17T11:10:36.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.102+0000 7f99b4a91640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:36.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.102+0000 7f99b4a91640 1 -- 10.20.193.49:0/862010316 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f99b0152700 msgr2=0x7f99b0158040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:36.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.102+0000 7f99b4a91640 1 --2- 10.20.193.49:0/862010316 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f99b0152700 0x7f99b0158040 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f99a4009a70 tx=0x7f99a40047c0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.102+0000 7f99b4a91640 1 -- 10.20.193.49:0/862010316 shutdown_connections 2026-02-17T11:10:36.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.102+0000 7f99b4a91640 1 --2- 10.20.193.49:0/862010316 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f997c0791c0 0x7f997c07b680 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.102+0000 7f99b4a91640 1 --2- 10.20.193.49:0/862010316 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f99b015edb0 0x7f99b01f4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.102+0000 7f99b4a91640 1 --2- 10.20.193.49:0/862010316 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f99b0152ae0 0x7f99b01f4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.102+0000 7f99b4a91640 1 --2- 10.20.193.49:0/862010316 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f99b0152700 0x7f99b0158040 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.102+0000 7f99b4a91640 1 -- 10.20.193.49:0/862010316 >> 10.20.193.49:0/862010316 conn(0x7f99b0073030 msgr2=0x7f99b0151680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:36.107 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.102+0000 7f99b4a91640 1 -- 10.20.193.49:0/862010316 shutdown_connections 2026-02-17T11:10:36.107 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.102+0000 7f99b4a91640 1 -- 10.20.193.49:0/862010316 wait complete. 2026-02-17T11:10:36.107 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.102+0000 7f99b4a91640 1 librados: shutdown 2026-02-17T11:10:36.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.104+0000 7fc7894b6640 10 librados: watch_flush enter 2026-02-17T11:10:36.109 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.104+0000 7fc7894b6640 10 librados: watch_flush exit 2026-02-17T11:10:36.109 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.104+0000 7fc7894b6640 20 client.4505.objecter shutdown clearing up homeless session... 2026-02-17T11:10:36.109 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.104+0000 7fc7894b6640 10 client.4505.objecter successfully canceled tick 2026-02-17T11:10:36.109 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.104+0000 7fc7894b6640 1 -- 10.20.193.49:0/2454147964 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fc750079170 msgr2=0x7fc75007b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:36.109 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.104+0000 7fc7894b6640 1 --2- 10.20.193.49:0/2454147964 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fc750079170 0x7fc75007b630 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc76c039000 tx=0x7fc76c031000 comp rx=0 tx=0).stop 2026-02-17T11:10:36.109 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.104+0000 7fc7894b6640 10 monclient: shutdown 2026-02-17T11:10:36.109 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.104+0000 7fc7894b6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:36.109 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.104+0000 7fc7894b6640 1 -- 10.20.193.49:0/2454147964 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc770004900 msgr2=0x7fc7840c5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:36.109 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.104+0000 7fc7894b6640 1 --2- 10.20.193.49:0/2454147964 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc770004900 0x7fc7840c5fd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc77800b500 tx=0x7fc77800b9d0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.109 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.104+0000 7fc7894b6640 1 -- 10.20.193.49:0/2454147964 shutdown_connections 2026-02-17T11:10:36.110 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.104+0000 7fc7894b6640 1 --2- 10.20.193.49:0/2454147964 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fc750079170 0x7fc75007b630 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.110 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.104+0000 7fc7894b6640 1 --2- 10.20.193.49:0/2454147964 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc7840c4800 0x7fc7841f4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.110 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.104+0000 7fc7894b6640 1 --2- 10.20.193.49:0/2454147964 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc7840c8cc0 0x7fc7841f6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.110 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.104+0000 7fc7894b6640 1 --2- 10.20.193.49:0/2454147964 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc770004900 0x7fc7840c5fd0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.110 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.104+0000 7fc7894b6640 1 -- 10.20.193.49:0/2454147964 >> 10.20.193.49:0/2454147964 conn(0x7fc7840cc0e0 msgr2=0x7fc7840cebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:36.110 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.104+0000 7fc7894b6640 1 -- 10.20.193.49:0/2454147964 shutdown_connections 2026-02-17T11:10:36.110 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.104+0000 7fc7894b6640 1 -- 10.20.193.49:0/2454147964 wait complete. 2026-02-17T11:10:36.110 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.104+0000 7fc7894b6640 1 librados: shutdown 2026-02-17T11:10:36.113 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280518 got 94489280516 for osd.9 2026-02-17T11:10:36.114 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313222 got 90194313221 for osd.4 2026-02-17T11:10:36.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.113+0000 7f26d5ffb640 1 -- 10.20.193.49:0/3091068981 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f26d8087430 con 0x7f26e815a370 2026-02-17T11:10:36.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.113+0000 7f26d5ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:36.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.113+0000 7f26d5ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:36.119 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.117+0000 7efc737fe640 1 -- 10.20.193.49:0/1047109506 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7efc84087480 con 0x7efc94155fb0 2026-02-17T11:10:36.119 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.117+0000 7efc737fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-17T11:10:36.119 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.117+0000 7efc737fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:36.119 INFO:teuthology.orchestra.run.trial049.stdout:115964116999 2026-02-17T11:10:36.122 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.119+0000 7efc996b0640 10 librados: watch_flush enter 2026-02-17T11:10:36.122 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.119+0000 7efc996b0640 10 librados: watch_flush exit 2026-02-17T11:10:36.122 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.119+0000 7efc996b0640 20 client.4495.objecter shutdown clearing up homeless session... 2026-02-17T11:10:36.122 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.119+0000 7efc996b0640 10 client.4495.objecter successfully canceled tick 2026-02-17T11:10:36.123 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.119+0000 7efc996b0640 1 -- 10.20.193.49:0/1047109506 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7efc600791c0 msgr2=0x7efc6007b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:36.123 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.119+0000 7efc996b0640 1 --2- 10.20.193.49:0/1047109506 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7efc600791c0 0x7efc6007b680 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7efc88006fd0 tx=0x7efc88008040 comp rx=0 tx=0).stop 2026-02-17T11:10:36.123 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.119+0000 7efc996b0640 10 monclient: shutdown 2026-02-17T11:10:36.123 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.119+0000 7efc996b0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:36.123 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.119+0000 7efc996b0640 1 -- 10.20.193.49:0/1047109506 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7efc94155fb0 msgr2=0x7efc94159ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:36.123 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.119+0000 7efc996b0640 1 --2- 10.20.193.49:0/1047109506 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7efc94155fb0 0x7efc94159ff0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efc8403a040 tx=0x7efc84004b40 comp rx=0 tx=0).stop 2026-02-17T11:10:36.123 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.120+0000 7efc996b0640 1 -- 10.20.193.49:0/1047109506 shutdown_connections 2026-02-17T11:10:36.123 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.120+0000 7efc996b0640 1 --2- 10.20.193.49:0/1047109506 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7efc600791c0 0x7efc6007b680 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.123 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.120+0000 7efc996b0640 1 --2- 10.20.193.49:0/1047109506 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7efc94155fb0 0x7efc94159ff0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.123 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.120+0000 7efc996b0640 1 --2- 10.20.193.49:0/1047109506 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7efc940cdb50 0x7efc9415c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.123 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.120+0000 7efc996b0640 1 --2- 10.20.193.49:0/1047109506 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7efc9406e5b0 0x7efc941f9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.123 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.120+0000 7efc996b0640 1 -- 10.20.193.49:0/1047109506 >> 10.20.193.49:0/1047109506 conn(0x7efc9406da90 msgr2=0x7efc941551d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:36.124 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.120+0000 7efc996b0640 1 -- 10.20.193.49:0/1047109506 shutdown_connections 2026-02-17T11:10:36.124 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.120+0000 7efc996b0640 1 -- 10.20.193.49:0/1047109506 wait complete. 2026-02-17T11:10:36.124 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.120+0000 7efc996b0640 1 librados: shutdown 2026-02-17T11:10:36.130 INFO:tasks.ceph.ceph_manager.ceph:need seq 115964117000 got 115964116999 for osd.10 2026-02-17T11:10:36.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.176+0000 7f10d9491640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-17T11:10:36.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.176+0000 7f10d9491640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-17T11:10:36.178 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.176+0000 7f10d9491640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:36.178 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.176+0000 7f10d9491640 1 -- 10.20.193.49:0/1638920163 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 14} v 0) -- 0x7f10d40c9b20 con 0x7f10d40c48c0 2026-02-17T11:10:36.179 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.177+0000 7f10b37fe640 1 -- 10.20.193.49:0/1638920163 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 14}]=0 v0) ==== 75+0+12 (secure 0 0 0) 0x7f10d41f7cb0 con 0x7f10d40c48c0 2026-02-17T11:10:36.179 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.178+0000 7f10b37fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-17T11:10:36.179 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.178+0000 7f10b37fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:36.180 INFO:teuthology.orchestra.run.trial049.stdout:98784247812 2026-02-17T11:10:36.182 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.179+0000 7f10d9491640 10 librados: watch_flush enter 2026-02-17T11:10:36.182 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.179+0000 7f10d9491640 10 librados: watch_flush exit 2026-02-17T11:10:36.182 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.179+0000 7f10d9491640 20 client.4500.objecter shutdown clearing up homeless session... 2026-02-17T11:10:36.182 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.179+0000 7f10d9491640 10 client.4500.objecter successfully canceled tick 2026-02-17T11:10:36.182 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.179+0000 7f10d9491640 1 -- 10.20.193.49:0/1638920163 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f10a0079190 msgr2=0x7f10a007b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:36.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.179+0000 7f10d9491640 1 --2- 10.20.193.49:0/1638920163 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f10a0079190 0x7f10a007b650 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f10bc007fd0 tx=0x7f10bc007b20 comp rx=0 tx=0).stop 2026-02-17T11:10:36.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.179+0000 7f10d9491640 10 monclient: shutdown 2026-02-17T11:10:36.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.179+0000 7f10d9491640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:36.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.179+0000 7f10d9491640 1 -- 10.20.193.49:0/1638920163 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f10d40c48c0 msgr2=0x7f10d406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:36.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.179+0000 7f10d9491640 1 --2- 10.20.193.49:0/1638920163 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f10d40c48c0 0x7f10d406eb30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f10c8009130 tx=0x7f10c80047c0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.179+0000 7f10d9491640 1 -- 10.20.193.49:0/1638920163 shutdown_connections 2026-02-17T11:10:36.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.179+0000 7f10d9491640 1 --2- 10.20.193.49:0/1638920163 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f10a0079190 0x7f10a007b650 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.179+0000 7f10d9491640 1 --2- 10.20.193.49:0/1638920163 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f10d40c7170 0x7f10d41f6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.179+0000 7f10d9491640 1 --2- 10.20.193.49:0/1638920163 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f10d40c4d10 0x7f10d41f6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.184 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.179+0000 7f10d9491640 1 --2- 10.20.193.49:0/1638920163 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f10d40c48c0 0x7f10d406eb30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.184 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.179+0000 7f10d9491640 1 -- 10.20.193.49:0/1638920163 >> 10.20.193.49:0/1638920163 conn(0x7f10d40c9f40 msgr2=0x7f10d4157940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:36.184 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.179+0000 7f10d9491640 1 -- 10.20.193.49:0/1638920163 shutdown_connections 2026-02-17T11:10:36.184 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.179+0000 7f10d9491640 1 -- 10.20.193.49:0/1638920163 wait complete. 2026-02-17T11:10:36.184 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.179+0000 7f10d9491640 1 librados: shutdown 2026-02-17T11:10:36.190 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247813 got 98784247812 for osd.14 2026-02-17T11:10:36.199 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.197+0000 7f26ef6d1640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-17T11:10:36.199 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.197+0000 7f26ef6d1640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-17T11:10:36.199 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.197+0000 7f26ef6d1640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:36.199 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.197+0000 7f26ef6d1640 1 -- 10.20.193.49:0/3091068981 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 12} v 0) -- 0x7f26e815dd70 con 0x7f26e815a370 2026-02-17T11:10:36.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.199+0000 7f26d5ffb640 1 -- 10.20.193.49:0/3091068981 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 12}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f26d8086d30 con 0x7f26e815a370 2026-02-17T11:10:36.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.199+0000 7f26d5ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-17T11:10:36.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.199+0000 7f26d5ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:36.201 INFO:teuthology.orchestra.run.trial049.stdout:111669149701 2026-02-17T11:10:36.203 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.201+0000 7f26ef6d1640 10 librados: watch_flush enter 2026-02-17T11:10:36.203 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.201+0000 7f26ef6d1640 10 librados: watch_flush exit 2026-02-17T11:10:36.203 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.201+0000 7f26ef6d1640 20 client.4504.objecter shutdown clearing up homeless session... 2026-02-17T11:10:36.203 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.201+0000 7f26ef6d1640 10 client.4504.objecter successfully canceled tick 2026-02-17T11:10:36.204 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.201+0000 7f26ef6d1640 1 -- 10.20.193.49:0/3091068981 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f26b8079140 msgr2=0x7f26b807b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:36.204 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.201+0000 7f26ef6d1640 1 --2- 10.20.193.49:0/3091068981 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f26b8079140 0x7f26b807b600 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f26e814ca90 tx=0x7f26dc006cf0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.204 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.201+0000 7f26ef6d1640 10 monclient: shutdown 2026-02-17T11:10:36.204 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.201+0000 7f26ef6d1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:36.204 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.201+0000 7f26ef6d1640 1 -- 10.20.193.49:0/3091068981 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f26e815a370 msgr2=0x7f26e80d1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:36.204 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.201+0000 7f26ef6d1640 1 --2- 10.20.193.49:0/3091068981 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f26e815a370 0x7f26e80d1860 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f26d8009a70 tx=0x7f26d80047c0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.204 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.201+0000 7f26ef6d1640 1 -- 10.20.193.49:0/3091068981 shutdown_connections 2026-02-17T11:10:36.204 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.201+0000 7f26ef6d1640 1 --2- 10.20.193.49:0/3091068981 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f26b8079140 0x7f26b807b600 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.204 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.201+0000 7f26ef6d1640 1 --2- 10.20.193.49:0/3091068981 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f26e81603c0 0x7f26e80c64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.205 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.201+0000 7f26ef6d1640 1 --2- 10.20.193.49:0/3091068981 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f26e815a750 0x7f26e81494f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.205 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.201+0000 7f26ef6d1640 1 --2- 10.20.193.49:0/3091068981 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f26e815a370 0x7f26e80d1860 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.205 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.201+0000 7f26ef6d1640 1 -- 10.20.193.49:0/3091068981 >> 10.20.193.49:0/3091068981 conn(0x7f26e8073030 msgr2=0x7f26e815df90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:36.205 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.201+0000 7f26ef6d1640 1 -- 10.20.193.49:0/3091068981 shutdown_connections 2026-02-17T11:10:36.205 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.201+0000 7f26ef6d1640 1 -- 10.20.193.49:0/3091068981 wait complete. 2026-02-17T11:10:36.205 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.201+0000 7f26ef6d1640 1 librados: shutdown 2026-02-17T11:10:36.211 INFO:tasks.ceph.ceph_manager.ceph:need seq 111669149702 got 111669149701 for osd.12 2026-02-17T11:10:36.776 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2026-02-17T11:10:36.806 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:10:36.809 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2026-02-17T11:10:36.809 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.11 2026-02-17T11:10:36.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.844+0000 7fe190664640 10 monclient: get_monmap_and_config 2026-02-17T11:10:36.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.844+0000 7fe190664640 10 monclient: build_initial_monmap 2026-02-17T11:10:36.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.844+0000 7fe190664640 10 monclient: monmap: 2026-02-17T11:10:36.847 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:36.847 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:36.847 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:36.845266+0000 2026-02-17T11:10:36.847 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:36.845266+0000 2026-02-17T11:10:36.847 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:36.847 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:36.847 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:36.847 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:36.847 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:36.847 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:36.847 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:36.848 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:36.848 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:36.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.845+0000 7fe190664640 1 Processor -- start 2026-02-17T11:10:36.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.845+0000 7fe190664640 1 -- start start 2026-02-17T11:10:36.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.845+0000 7fe190664640 10 monclient: init 2026-02-17T11:10:36.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.845+0000 7fe190664640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:36.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.845+0000 7fe190664640 10 monclient: _add_conns ranks=[3,4,1,5,0,2] 2026-02-17T11:10:36.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.845+0000 7fe190664640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fe188153db0 0x7fe18815a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:36.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.845+0000 7fe190664640 10 monclient(hunting): picked mon.noname-a con 0x7fe188153db0 addr v2:10.20.193.49:3300/0 2026-02-17T11:10:36.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.845+0000 7fe190664640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7fe1880ccc50 0x7fe1880c7500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:36.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.845+0000 7fe190664640 10 monclient(hunting): picked mon.noname-b con 0x7fe1880ccc50 addr v2:10.20.193.97:3300/0 2026-02-17T11:10:36.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.845+0000 7fe190664640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fe1880c7a40 addr v1:10.20.193.97:6789/0 2026-02-17T11:10:36.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.845+0000 7fe190664640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1880c9390 con 0x7fe1880c7a40 2026-02-17T11:10:36.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.845+0000 7fe190664640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:36.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.845+0000 7fe190664640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7fe18815acd0 con 0x7fe188153db0 2026-02-17T11:10:36.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.845+0000 7fe190664640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:36.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.845+0000 7fe190664640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7fe1880c6ab0 con 0x7fe1880ccc50 2026-02-17T11:10:36.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.845+0000 7fe190664640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:36.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.845+0000 7fe190664640 10 monclient(hunting): authenticate will time out at 1113.508968s 2026-02-17T11:10:36.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.846+0000 7fe18e3d9640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fe188153db0 0x7fe18815a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:36.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.846+0000 7fe18dbd8640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7fe1880ccc50 0x7fe1880c7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:36.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.846+0000 7fe18e3d9640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fe188153db0 0x7fe18815a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:33316/0 (socket says 10.20.193.49:33316) 2026-02-17T11:10:36.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.846+0000 7fe18e3d9640 1 -- 10.20.193.49:0/1325604672 learned_addr learned my addr 10.20.193.49:0/1325604672 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:36.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.846+0000 7fe18e3d9640 10 monclient(hunting): get_auth_request con 0x7fe188153db0 auth_method 0 2026-02-17T11:10:36.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.846+0000 7fe18e3d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:36.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.846+0000 7fe18e3d9640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:36.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.846+0000 7fe18e3d9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:36.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.846+0000 7fe18dbd8640 10 monclient(hunting): get_auth_request con 0x7fe1880ccc50 auth_method 0 2026-02-17T11:10:36.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.846+0000 7fe18dbd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:36.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.846+0000 7fe18dbd8640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:36.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.846+0000 7fe18dbd8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:36.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.847+0000 7fe18e3d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:36.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.847+0000 7fe18e3d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:36.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.847+0000 7fe18e3d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:36.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.847+0000 7fe18dbd8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:36.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.847+0000 7fe18dbd8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:36.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.847+0000 7fe18dbd8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:36.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.848+0000 7fe18e3d9640 10 monclient(hunting): handle_auth_done global_id 4503 payload 274 2026-02-17T11:10:36.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.848+0000 7fe18e3d9640 1 -- 10.20.193.49:0/1325604672 >> v2:10.20.193.97:3300/0 conn(0x7fe1880ccc50 msgr2=0x7fe1880c7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:36.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.848+0000 7fe18e3d9640 1 --2- 10.20.193.49:0/1325604672 >> v2:10.20.193.97:3300/0 conn(0x7fe1880ccc50 0x7fe1880c7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.848+0000 7fe18e3d9640 1 -- 10.20.193.49:0/1325604672 >> v1:10.20.193.97:6789/0 conn(0x7fe1880c7a40 legacy=0x7fe1880cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:36.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.848+0000 7fe18e3d9640 10 monclient: _finish_hunting 0 2026-02-17T11:10:36.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.848+0000 7fe18e3d9640 1 monclient: found mon.noname-a 2026-02-17T11:10:36.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.848+0000 7fe18e3d9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:36.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.848+0000 7fe18e3d9640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:10:36.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.848+0000 7fe18e3d9640 1 -- 10.20.193.49:0/1325604672 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe18815b180 con 0x7fe188153db0 2026-02-17T11:10:36.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.849+0000 7fe18e3d9640 1 --2- 10.20.193.49:0/1325604672 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe188153db0 0x7fe18815a790 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe188074570 tx=0x7fe17802eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba62c656ec0ea686 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:36.861 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.851+0000 7fe18d3d7640 1 -- 10.20.193.49:0/1325604672 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe17803c070 con 0x7fe188153db0 2026-02-17T11:10:36.861 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.851+0000 7fe18d3d7640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:36.862 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.851+0000 7fe18d3d7640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:10:36.862 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.851+0000 7fe18d3d7640 10 monclient: dump: 2026-02-17T11:10:36.862 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:36.862 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:36.862 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:36.862 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:36.862 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:36.862 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:36.862 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:36.863 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:36.863 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:36.863 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:36.863 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.851+0000 7fe18d3d7640 10 monclient: _finish_auth 0 2026-02-17T11:10:36.863 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.851+0000 7fe18d3d7640 10 monclient: _check_auth_tickets 2026-02-17T11:10:36.863 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.851+0000 7fe18d3d7640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:36.863 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.851+0000 7fe18d3d7640 1 -- 10.20.193.49:0/1325604672 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe17802fbe0 con 0x7fe188153db0 2026-02-17T11:10:36.863 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.851+0000 7fe190664640 5 monclient: authenticate success, global_id 4503 2026-02-17T11:10:36.863 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.851+0000 7fe190664640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:10:36.863 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.851+0000 7fe18d3d7640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:36.864 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.851+0000 7fe190664640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:36.864 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.851+0000 7fe18d3d7640 1 -- 10.20.193.49:0/1325604672 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe178037440 con 0x7fe188153db0 2026-02-17T11:10:36.864 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.851+0000 7fe190664640 4 set_mon_vals no callback set 2026-02-17T11:10:36.864 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.851+0000 7fe18d3d7640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:36.864 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.851+0000 7fe18d3d7640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:10:36.864 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.851+0000 7fe18d3d7640 10 monclient: dump: 2026-02-17T11:10:36.864 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:36.864 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:36.864 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:36.864 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:36.864 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:36.865 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:36.865 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:36.865 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:36.865 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:36.865 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:36.865 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.851+0000 7fe190664640 10 monclient: shutdown 2026-02-17T11:10:36.865 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.851+0000 7fe190664640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:36.865 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.851+0000 7fe190664640 1 -- 10.20.193.49:0/1325604672 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe188153db0 msgr2=0x7fe18815a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:36.865 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.851+0000 7fe190664640 1 --2- 10.20.193.49:0/1325604672 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe188153db0 0x7fe18815a790 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe188074570 tx=0x7fe17802eed0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.865 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.851+0000 7fe190664640 1 -- 10.20.193.49:0/1325604672 shutdown_connections 2026-02-17T11:10:36.865 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.851+0000 7fe190664640 1 --2- 10.20.193.49:0/1325604672 >> v2:10.20.193.97:3300/0 conn(0x7fe1880ccc50 0x7fe1880c7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.865 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.851+0000 7fe190664640 1 --2- 10.20.193.49:0/1325604672 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe188153db0 0x7fe18815a790 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.866 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.851+0000 7fe190664640 1 -- 10.20.193.49:0/1325604672 >> 10.20.193.49:0/1325604672 conn(0x7fe1880cc130 msgr2=0x7fe1880cc540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:36.866 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.851+0000 7fe190664640 1 -- 10.20.193.49:0/1325604672 shutdown_connections 2026-02-17T11:10:36.866 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.851+0000 7fe190664640 1 -- 10.20.193.49:0/1325604672 wait complete. 2026-02-17T11:10:36.866 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.851+0000 7fe190664640 10 monclient: build_initial_monmap 2026-02-17T11:10:36.866 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.851+0000 7fe190664640 10 monclient: monmap: 2026-02-17T11:10:36.866 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:36.866 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:36.866 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:36.866 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:36.866 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:36.866 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:36.866 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:36.866 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:36.867 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:36.867 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:36.867 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.852+0000 7fe190664640 1 librados: starting msgr at 2026-02-17T11:10:36.867 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.852+0000 7fe190664640 1 librados: starting objecter 2026-02-17T11:10:36.867 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.852+0000 7fe190664640 1 Processor -- start 2026-02-17T11:10:36.867 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.852+0000 7fe190664640 1 -- start start 2026-02-17T11:10:36.867 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.852+0000 7fe190664640 1 librados: setting wanted keys 2026-02-17T11:10:36.867 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.852+0000 7fe190664640 1 librados: calling monclient init 2026-02-17T11:10:36.867 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.852+0000 7fe190664640 10 monclient: init 2026-02-17T11:10:36.867 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.852+0000 7fe190664640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:36.867 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.852+0000 7fe190664640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:10:36.867 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.852+0000 7fe190664640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe1880c7a40 0x7fe1881f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:36.868 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.852+0000 7fe190664640 10 monclient(hunting): picked mon.noname-a con 0x7fe1880c7a40 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:36.868 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.852+0000 7fe190664640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe1880ccc50 0x7fe18814f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:36.868 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.852+0000 7fe190664640 10 monclient(hunting): picked mon.noname-c con 0x7fe1880ccc50 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:36.868 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.852+0000 7fe190664640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe188153db0 0x7fe1881f4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:36.868 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.852+0000 7fe190664640 10 monclient(hunting): picked mon.noname-b con 0x7fe188153db0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:36.868 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.852+0000 7fe190664640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:36.868 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.852+0000 7fe190664640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe1880c9910 con 0x7fe1880c7a40 2026-02-17T11:10:36.868 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.852+0000 7fe190664640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:36.868 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.852+0000 7fe190664640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe1880c7070 con 0x7fe188153db0 2026-02-17T11:10:36.868 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.852+0000 7fe190664640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:36.868 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.852+0000 7fe190664640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe1880c6d00 con 0x7fe1880ccc50 2026-02-17T11:10:36.869 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.852+0000 7fe190664640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:36.869 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.852+0000 7fe190664640 10 monclient(hunting): authenticate will time out at 1113.515672s 2026-02-17T11:10:36.869 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.852+0000 7fe18e3d9640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe1880c7a40 0x7fe1881f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:36.869 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.853+0000 7fe18ebda640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe188153db0 0x7fe1881f4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:36.869 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.853+0000 7fe18e3d9640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe1880c7a40 0x7fe1881f7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:33332/0 (socket says 10.20.193.49:33332) 2026-02-17T11:10:36.869 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.853+0000 7fe18e3d9640 1 -- 10.20.193.49:0/1623861441 learned_addr learned my addr 10.20.193.49:0/1623861441 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:36.869 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.853+0000 7fe18e3d9640 10 monclient(hunting): get_auth_request con 0x7fe1880c7a40 auth_method 0 2026-02-17T11:10:36.869 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.853+0000 7fe18e3d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:36.869 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.853+0000 7fe18e3d9640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:36.869 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.853+0000 7fe18e3d9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:36.869 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.853+0000 7fe18ebda640 10 monclient(hunting): get_auth_request con 0x7fe188153db0 auth_method 0 2026-02-17T11:10:36.869 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.853+0000 7fe18ebda640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:36.870 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.853+0000 7fe18ebda640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:36.870 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.853+0000 7fe18ebda640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:36.870 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.853+0000 7fe18dbd8640 1 --2- 10.20.193.49:0/1623861441 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe1880ccc50 0x7fe18814f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:36.870 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.853+0000 7fe18e3d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:36.870 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.853+0000 7fe18e3d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:36.870 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.853+0000 7fe18e3d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:36.870 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.853+0000 7fe18dbd8640 10 monclient(hunting): get_auth_request con 0x7fe1880ccc50 auth_method 0 2026-02-17T11:10:36.870 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.853+0000 7fe18dbd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:36.870 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.853+0000 7fe18dbd8640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:36.870 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.853+0000 7fe18dbd8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:36.870 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.853+0000 7fe18ebda640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:36.870 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.853+0000 7fe18ebda640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:36.871 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.853+0000 7fe18ebda640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:36.871 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.853+0000 7fe18dbd8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:36.871 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.853+0000 7fe18dbd8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:36.871 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.853+0000 7fe18dbd8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:36.871 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.854+0000 7fe18ebda640 10 monclient(hunting): handle_auth_done global_id 4510 payload 824 2026-02-17T11:10:36.871 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.854+0000 7fe18ebda640 1 -- 10.20.193.49:0/1623861441 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe1880ccc50 msgr2=0x7fe18814f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:36.871 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.854+0000 7fe18ebda640 1 --2- 10.20.193.49:0/1623861441 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe1880ccc50 0x7fe18814f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.871 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.854+0000 7fe18ebda640 1 -- 10.20.193.49:0/1623861441 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe1880c7a40 msgr2=0x7fe1881f7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:36.871 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.854+0000 7fe18ebda640 1 --2- 10.20.193.49:0/1623861441 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe1880c7a40 0x7fe1881f7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.871 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.854+0000 7fe18ebda640 10 monclient: _finish_hunting 0 2026-02-17T11:10:36.871 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.854+0000 7fe18ebda640 1 monclient: found mon.noname-b 2026-02-17T11:10:36.871 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.854+0000 7fe18ebda640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:36.871 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.854+0000 7fe18ebda640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:10:36.872 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.854+0000 7fe18ebda640 1 -- 10.20.193.49:0/1623861441 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe18814c530 con 0x7fe188153db0 2026-02-17T11:10:36.872 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.855+0000 7fe18ebda640 1 --2- 10.20.193.49:0/1623861441 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe188153db0 0x7fe1881f4f00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe184003a40 tx=0x7fe18400cf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:36.872 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.855+0000 7fe16effd640 10 client.?.objecter ms_handle_connect 0x7fe188153db0 2026-02-17T11:10:36.872 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.855+0000 7fe16effd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:36.872 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.857+0000 7fe16effd640 1 -- 10.20.193.49:0/1623861441 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe184003c70 con 0x7fe188153db0 2026-02-17T11:10:36.872 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.857+0000 7fe16effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:36.872 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.857+0000 7fe16effd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:10:36.872 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.857+0000 7fe16effd640 10 monclient: dump: 2026-02-17T11:10:36.872 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:36.872 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:36.872 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:36.873 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:36.873 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:36.873 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:36.873 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:36.873 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:36.873 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:36.873 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:36.873 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.857+0000 7fe16effd640 10 monclient: _finish_auth 0 2026-02-17T11:10:36.873 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.857+0000 7fe16effd640 10 monclient: _check_auth_tickets 2026-02-17T11:10:36.873 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.857+0000 7fe16effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:36.873 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.857+0000 7fe16effd640 1 -- 10.20.193.49:0/1623861441 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe184003e10 con 0x7fe188153db0 2026-02-17T11:10:36.874 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.857+0000 7fe16effd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:36.874 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.857+0000 7fe16effd640 1 -- 10.20.193.49:0/1623861441 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe18400ac60 con 0x7fe188153db0 2026-02-17T11:10:36.874 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.857+0000 7fe190664640 5 monclient: authenticate success, global_id 4510 2026-02-17T11:10:36.874 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.857+0000 7fe190664640 10 monclient: _renew_subs 2026-02-17T11:10:36.874 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.857+0000 7fe18cbd6640 4 set_mon_vals no callback set 2026-02-17T11:10:36.874 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.857+0000 7fe190664640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:36.874 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.857+0000 7fe190664640 1 -- 10.20.193.49:0/1623861441 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1881e5e50 con 0x7fe188153db0 2026-02-17T11:10:36.874 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.857+0000 7fe16effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:36.874 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.857+0000 7fe16effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:36.874 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.857+0000 7fe16effd640 10 monclient: dump: 2026-02-17T11:10:36.875 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:36.875 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:36.875 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:36.875 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:36.875 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:36.875 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:36.875 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:36.875 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:36.875 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:36.875 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:36.875 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.857+0000 7fe190664640 10 client.4510.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:36.876 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.857+0000 7fe190664640 10 monclient: _renew_subs 2026-02-17T11:10:36.876 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.857+0000 7fe190664640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:36.876 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.857+0000 7fe190664640 1 -- 10.20.193.49:0/1623861441 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1881e6410 con 0x7fe188153db0 2026-02-17T11:10:36.876 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.857+0000 7fe190664640 1 librados: init done 2026-02-17T11:10:36.876 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.858+0000 7fe190664640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:36.876 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.858+0000 7fe190664640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:36.876 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.858+0000 7fe190664640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:36.876 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.858+0000 7fe190664640 1 -- 10.20.193.49:0/1623861441 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1880727e0 con 0x7fe188153db0 2026-02-17T11:10:36.887 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.885+0000 7f5677afa640 10 monclient: get_monmap_and_config 2026-02-17T11:10:36.887 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.885+0000 7f5677afa640 10 monclient: build_initial_monmap 2026-02-17T11:10:36.887 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.885+0000 7f5677afa640 10 monclient: monmap: 2026-02-17T11:10:36.887 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:36.888 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:36.888 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:36.886041+0000 2026-02-17T11:10:36.888 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:36.886041+0000 2026-02-17T11:10:36.888 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:36.888 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:36.888 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:36.888 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:36.888 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:36.888 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:36.888 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:36.888 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:36.888 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:36.888 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.886+0000 7f5677afa640 1 Processor -- start 2026-02-17T11:10:36.889 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.886+0000 7f5677afa640 1 -- start start 2026-02-17T11:10:36.889 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.886+0000 7f5677afa640 10 monclient: init 2026-02-17T11:10:36.889 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.886+0000 7f0de463b640 10 monclient: get_monmap_and_config 2026-02-17T11:10:36.889 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.886+0000 7f0de463b640 10 monclient: build_initial_monmap 2026-02-17T11:10:36.889 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.886+0000 7f0de463b640 10 monclient: monmap: 2026-02-17T11:10:36.889 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:36.889 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:36.889 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:36.886642+0000 2026-02-17T11:10:36.890 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:36.886642+0000 2026-02-17T11:10:36.890 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:36.890 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:36.890 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:36.890 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:36.890 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:36.890 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:36.890 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:36.890 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:36.890 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:36.891 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.886+0000 7f5677afa640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:36.891 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.886+0000 7f5677afa640 10 monclient: _add_conns ranks=[3,2,5,1,0,4] 2026-02-17T11:10:36.892 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.886+0000 7f5677afa640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f56700ce5d0 0x7f56700d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:36.892 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.886+0000 7f5677afa640 10 monclient(hunting): picked mon.noname-a con 0x7f56700ce5d0 addr v2:10.20.193.49:3300/0 2026-02-17T11:10:36.892 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.886+0000 7f5677afa640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f567015bf30 addr v1:10.20.193.157:6789/0 2026-02-17T11:10:36.892 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.886+0000 7f5677afa640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f56700c9780 0x7f56700c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:36.892 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.886+0000 7f5677afa640 10 monclient(hunting): picked mon.noname-c con 0x7f56700c9780 addr v2:10.20.193.157:3300/0 2026-02-17T11:10:36.892 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.886+0000 7f5677afa640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56700d1e00 con 0x7f567015bf30 2026-02-17T11:10:36.892 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.886+0000 7f5677afa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:36.892 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.886+0000 7f5677afa640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f56700d20d0 con 0x7f56700ce5d0 2026-02-17T11:10:36.892 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.886+0000 7f5677afa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:36.892 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.886+0000 7f5677afa640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f56700d23b0 con 0x7f56700c9780 2026-02-17T11:10:36.892 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.886+0000 7f5677afa640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:36.893 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.886+0000 7f5677afa640 10 monclient(hunting): authenticate will time out at 1113.549614s 2026-02-17T11:10:36.893 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.886+0000 7f0de463b640 1 Processor -- start 2026-02-17T11:10:36.893 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.886+0000 7f0de463b640 1 -- start start 2026-02-17T11:10:36.893 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.886+0000 7f0de463b640 10 monclient: init 2026-02-17T11:10:36.894 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.887+0000 7f5676070640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f56700c9780 0x7f56700c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:36.894 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.887+0000 7f567586f640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f56700ce5d0 0x7f56700d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:36.894 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.887+0000 7f567586f640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f56700ce5d0 0x7f56700d18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:33336/0 (socket says 10.20.193.49:33336) 2026-02-17T11:10:36.894 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.887+0000 7f567586f640 1 -- 10.20.193.49:0/1712512760 learned_addr learned my addr 10.20.193.49:0/1712512760 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:36.894 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.887+0000 7f567586f640 10 monclient(hunting): get_auth_request con 0x7f56700ce5d0 auth_method 0 2026-02-17T11:10:36.894 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.887+0000 7f567586f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:36.894 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.887+0000 7f567586f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:36.895 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.887+0000 7f567586f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:36.895 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.887+0000 7f5676070640 10 monclient(hunting): get_auth_request con 0x7f56700c9780 auth_method 0 2026-02-17T11:10:36.895 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.887+0000 7f5676070640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:36.895 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.887+0000 7f5676070640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:36.895 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.887+0000 7f5676070640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:36.896 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.887+0000 7f0de463b640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:36.896 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.887+0000 7f0de463b640 10 monclient: _add_conns ranks=[1,3,4,2,0,5] 2026-02-17T11:10:36.896 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.887+0000 7f0de463b640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f0ddc155d40 addr v1:10.20.193.97:6789/0 2026-02-17T11:10:36.896 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.887+0000 7f0de463b640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f0ddc0ccc00 0x7f0ddc156120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:36.896 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.887+0000 7f0de463b640 10 monclient(hunting): picked mon.noname-a con 0x7f0ddc0ccc00 addr v2:10.20.193.49:3300/0 2026-02-17T11:10:36.896 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.887+0000 7f0de463b640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f0ddc0caff0 0x7f0ddc0cb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:36.896 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.887+0000 7f0de463b640 10 monclient(hunting): picked mon.noname-b con 0x7f0ddc0caff0 addr v2:10.20.193.97:3300/0 2026-02-17T11:10:36.896 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.887+0000 7f0de463b640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ddc15c8d0 con 0x7f0ddc155d40 2026-02-17T11:10:36.896 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.887+0000 7f0de463b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:36.897 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.887+0000 7f0de463b640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f0ddc06c890 con 0x7f0ddc0ccc00 2026-02-17T11:10:36.897 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.887+0000 7f0de463b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:36.897 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.887+0000 7f0de463b640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f0ddc06d410 con 0x7f0ddc0caff0 2026-02-17T11:10:36.897 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.887+0000 7f0de463b640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:36.897 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.887+0000 7f0de463b640 10 monclient(hunting): authenticate will time out at 1113.550500s 2026-02-17T11:10:36.897 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.887+0000 7f567586f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:36.897 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.887+0000 7f567586f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:36.897 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.887+0000 7f567586f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:36.898 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.887+0000 7f7801b72640 10 monclient: get_monmap_and_config 2026-02-17T11:10:36.898 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.887+0000 7f7801b72640 10 monclient: build_initial_monmap 2026-02-17T11:10:36.898 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.887+0000 7f7801b72640 10 monclient: monmap: 2026-02-17T11:10:36.898 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:36.898 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:36.898 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:36.888272+0000 2026-02-17T11:10:36.898 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:36.888272+0000 2026-02-17T11:10:36.898 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:36.898 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:36.899 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:36.899 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:36.899 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:36.899 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:36.899 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:36.899 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:36.899 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:36.899 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.888+0000 7f5676070640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:36.899 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.888+0000 7f5676070640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:36.900 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.888+0000 7f5676070640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:36.901 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.888+0000 7f7801b72640 1 Processor -- start 2026-02-17T11:10:36.901 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.888+0000 7f7801b72640 1 -- start start 2026-02-17T11:10:36.901 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.888+0000 7f7801b72640 10 monclient: init 2026-02-17T11:10:36.901 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.888+0000 7f7801b72640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:36.901 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.888+0000 7f7801b72640 10 monclient: _add_conns ranks=[4,3,2,5,0,1] 2026-02-17T11:10:36.901 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.888+0000 7f7801b72640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f77fc0c7170 0x7f77fc0c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:36.901 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.888+0000 7f7801b72640 10 monclient(hunting): picked mon.noname-b con 0x7f77fc0c7170 addr v2:10.20.193.97:3300/0 2026-02-17T11:10:36.901 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.888+0000 7f7801b72640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f77fc0c48c0 0x7f77fc0749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:36.901 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.888+0000 7f7801b72640 10 monclient(hunting): picked mon.noname-a con 0x7f77fc0c48c0 addr v2:10.20.193.49:3300/0 2026-02-17T11:10:36.901 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.888+0000 7f7801b72640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f77fc074ef0 addr v1:10.20.193.157:6789/0 2026-02-17T11:10:36.901 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.888+0000 7f7801b72640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77fc15a9a0 con 0x7f77fc074ef0 2026-02-17T11:10:36.902 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.888+0000 7f7801b72640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:36.902 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.888+0000 7f7801b72640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f77fc0c8530 con 0x7f77fc0c48c0 2026-02-17T11:10:36.902 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.888+0000 7f7801b72640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:36.902 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.888+0000 7f7801b72640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f77fc0c5270 con 0x7f77fc0c7170 2026-02-17T11:10:36.902 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.888+0000 7f7801b72640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:36.902 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.888+0000 7f7801b72640 10 monclient(hunting): authenticate will time out at 1113.551701s 2026-02-17T11:10:36.903 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.888+0000 7f567586f640 10 monclient(hunting): handle_auth_done global_id 4509 payload 274 2026-02-17T11:10:36.903 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.888+0000 7f567586f640 1 -- 10.20.193.49:0/1712512760 >> v2:10.20.193.157:3300/0 conn(0x7f56700c9780 msgr2=0x7f56700c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:36.903 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.888+0000 7f567586f640 1 --2- 10.20.193.49:0/1712512760 >> v2:10.20.193.157:3300/0 conn(0x7f56700c9780 0x7f56700c9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.903 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.888+0000 7f567586f640 1 -- 10.20.193.49:0/1712512760 >> v1:10.20.193.157:6789/0 conn(0x7f567015bf30 legacy=0x7f56700ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:36.903 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.888+0000 7f567586f640 10 monclient: _finish_hunting 0 2026-02-17T11:10:36.903 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.888+0000 7f567586f640 1 monclient: found mon.noname-a 2026-02-17T11:10:36.903 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.888+0000 7f567586f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:36.903 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.888+0000 7f567586f640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:10:36.903 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.888+0000 7f567586f640 1 -- 10.20.193.49:0/1712512760 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56700d2690 con 0x7f56700ce5d0 2026-02-17T11:10:36.904 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.889+0000 7f0de1baf640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f0ddc0ccc00 0x7f0ddc156120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:36.904 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.889+0000 7f0de1baf640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f0ddc0ccc00 0x7f0ddc156120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:33350/0 (socket says 10.20.193.49:33350) 2026-02-17T11:10:36.904 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.889+0000 7f0de1baf640 1 -- 10.20.193.49:0/189371667 learned_addr learned my addr 10.20.193.49:0/189371667 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:36.904 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.889+0000 7f0de1baf640 10 monclient(hunting): get_auth_request con 0x7f0ddc0ccc00 auth_method 0 2026-02-17T11:10:36.904 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.889+0000 7f0de1baf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:36.904 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.889+0000 7f0de1baf640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:36.904 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.889+0000 7f0de1baf640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:36.905 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.889+0000 7f77faffd640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f77fc0c48c0 0x7f77fc0749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:36.905 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.890+0000 7f0de1baf640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:36.905 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.890+0000 7f0de1baf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:36.905 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.890+0000 7f0de1baf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:36.905 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.890+0000 7f77faffd640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f77fc0c48c0 0x7f77fc0749b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:33358/0 (socket says 10.20.193.49:33358) 2026-02-17T11:10:36.906 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.890+0000 7f77faffd640 1 -- 10.20.193.49:0/416918467 learned_addr learned my addr 10.20.193.49:0/416918467 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:36.906 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.890+0000 7f77faffd640 10 monclient(hunting): get_auth_request con 0x7f77fc0c48c0 auth_method 0 2026-02-17T11:10:36.906 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.890+0000 7f77faffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:36.906 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.890+0000 7f77faffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:36.906 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.890+0000 7f77faffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:36.906 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.890+0000 7f567586f640 1 --2- 10.20.193.49:0/1712512760 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f56700ce5d0 0x7f56700d18c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5670075130 tx=0x7f566002eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f651dc4a17675a30 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:36.907 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.891+0000 7f0de1baf640 10 monclient(hunting): handle_auth_done global_id 4512 payload 274 2026-02-17T11:10:36.907 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.891+0000 7f0de1baf640 1 -- 10.20.193.49:0/189371667 >> v2:10.20.193.97:3300/0 conn(0x7f0ddc0caff0 msgr2=0x7f0ddc0cb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:36.907 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.891+0000 7f0de1baf640 1 --2- 10.20.193.49:0/189371667 >> v2:10.20.193.97:3300/0 conn(0x7f0ddc0caff0 0x7f0ddc0cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.907 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.891+0000 7f0de1baf640 1 -- 10.20.193.49:0/189371667 >> v1:10.20.193.97:6789/0 conn(0x7f0ddc155d40 legacy=0x7f0ddc15d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:36.907 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.891+0000 7f0de1baf640 10 monclient: _finish_hunting 0 2026-02-17T11:10:36.907 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.891+0000 7f0de1baf640 1 monclient: found mon.noname-a 2026-02-17T11:10:36.907 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.891+0000 7f0de1baf640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:36.907 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.891+0000 7f0de1baf640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:10:36.907 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.891+0000 7f0de1baf640 1 -- 10.20.193.49:0/189371667 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ddc15cbb0 con 0x7f0ddc0ccc00 2026-02-17T11:10:36.909 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.891+0000 7f77faffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:36.909 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.891+0000 7f77faffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:36.909 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.891+0000 7f77faffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:36.909 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.892+0000 7f77fa7fc640 1 -- 10.20.193.49:0/416918467 <== mon.2 v1:10.20.193.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2853287813 0 0) 0x7f77fc15a9a0 con 0x7f77fc074ef0 2026-02-17T11:10:36.909 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.892+0000 7f77fa7fc640 10 monclient(hunting): _negotiate 2026-02-17T11:10:36.909 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.892+0000 7f77fa7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:36.909 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.892+0000 7f77fa7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:36.909 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.892+0000 7f77fa7fc640 10 monclient(hunting): my global_id is 4520 2026-02-17T11:10:36.909 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.892+0000 7f77fa7fc640 1 -- 10.20.193.49:0/416918467 --> v1:10.20.193.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77e0003620 con 0x7f77fc074ef0 2026-02-17T11:10:36.909 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.893+0000 7f77faffd640 10 monclient(hunting): handle_auth_done global_id 4515 payload 274 2026-02-17T11:10:36.909 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.893+0000 7f77faffd640 1 -- 10.20.193.49:0/416918467 >> v2:10.20.193.97:3300/0 conn(0x7f77fc0c7170 msgr2=0x7f77fc0c7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:36.909 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.893+0000 7f77faffd640 1 --2- 10.20.193.49:0/416918467 >> v2:10.20.193.97:3300/0 conn(0x7f77fc0c7170 0x7f77fc0c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.909 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.893+0000 7f77faffd640 1 -- 10.20.193.49:0/416918467 >> v1:10.20.193.157:6789/0 conn(0x7f77fc074ef0 legacy=0x7f77fc0c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:36.910 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.893+0000 7f77faffd640 10 monclient: _finish_hunting 0 2026-02-17T11:10:36.910 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.893+0000 7f77faffd640 1 monclient: found mon.noname-a 2026-02-17T11:10:36.910 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.893+0000 7f77faffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:36.910 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.893+0000 7f77faffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:10:36.910 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.893+0000 7f77faffd640 1 -- 10.20.193.49:0/416918467 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77fc0c5550 con 0x7f77fc0c48c0 2026-02-17T11:10:36.910 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.894+0000 7f0de1baf640 1 --2- 10.20.193.49:0/189371667 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0ddc0ccc00 0x7f0ddc156120 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc069bf0 tx=0x7f0dd002ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8d868f24c458a75 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:36.910 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.896+0000 7f77faffd640 1 --2- 10.20.193.49:0/416918467 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f77fc0c48c0 0x7f77fc0749b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f77fc0723c0 tx=0x7f77ec02eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba0217a4d6b68d7 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:36.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.896+0000 7f567486d640 1 -- 10.20.193.49:0/1712512760 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f566003c070 con 0x7f56700ce5d0 2026-02-17T11:10:36.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.896+0000 7f567486d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:36.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.896+0000 7f567486d640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:10:36.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.896+0000 7f567486d640 10 monclient: dump: 2026-02-17T11:10:36.913 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:36.913 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:36.913 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:36.913 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:36.913 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:36.913 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:36.913 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:36.913 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:36.913 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:36.913 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:36.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.896+0000 7f567486d640 10 monclient: _finish_auth 0 2026-02-17T11:10:36.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.896+0000 7f567486d640 10 monclient: _check_auth_tickets 2026-02-17T11:10:36.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.896+0000 7f567486d640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:36.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.896+0000 7f5677afa640 5 monclient: authenticate success, global_id 4509 2026-02-17T11:10:36.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.896+0000 7f567486d640 1 -- 10.20.193.49:0/1712512760 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f566002fbe0 con 0x7f56700ce5d0 2026-02-17T11:10:36.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.896+0000 7f567486d640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:36.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.896+0000 7f5677afa640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:36.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.896+0000 7f567486d640 1 -- 10.20.193.49:0/1712512760 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5660037440 con 0x7f56700ce5d0 2026-02-17T11:10:36.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.896+0000 7f5677afa640 4 set_mon_vals no callback set 2026-02-17T11:10:36.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.896+0000 7f567486d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:36.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.896+0000 7f567486d640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:10:36.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.896+0000 7f567486d640 10 monclient: dump: 2026-02-17T11:10:36.914 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:36.914 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:36.914 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:36.914 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:36.914 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:36.915 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:36.915 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:36.915 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:36.915 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:36.915 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:36.915 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.896+0000 7f5677afa640 10 monclient: shutdown 2026-02-17T11:10:36.915 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.896+0000 7f5677afa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:36.915 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.896+0000 7f5677afa640 1 -- 10.20.193.49:0/1712512760 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f56700ce5d0 msgr2=0x7f56700d18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:36.915 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.896+0000 7f5677afa640 1 --2- 10.20.193.49:0/1712512760 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f56700ce5d0 0x7f56700d18c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5670075130 tx=0x7f566002eed0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.915 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.896+0000 7f5677afa640 1 -- 10.20.193.49:0/1712512760 shutdown_connections 2026-02-17T11:10:36.915 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.896+0000 7f5677afa640 1 --2- 10.20.193.49:0/1712512760 >> v2:10.20.193.157:3300/0 conn(0x7f56700c9780 0x7f56700c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.915 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.896+0000 7f5677afa640 1 --2- 10.20.193.49:0/1712512760 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f56700ce5d0 0x7f56700d18c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.915 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.896+0000 7f5677afa640 1 -- 10.20.193.49:0/1712512760 >> 10.20.193.49:0/1712512760 conn(0x7f5670073030 msgr2=0x7f5670073440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:36.915 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.896+0000 7f5677afa640 1 -- 10.20.193.49:0/1712512760 shutdown_connections 2026-02-17T11:10:36.915 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.896+0000 7f5677afa640 1 -- 10.20.193.49:0/1712512760 wait complete. 2026-02-17T11:10:36.915 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.897+0000 7f5677afa640 10 monclient: build_initial_monmap 2026-02-17T11:10:36.915 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.897+0000 7f5677afa640 10 monclient: monmap: 2026-02-17T11:10:36.915 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:36.916 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:36.916 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:36.916 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:36.916 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:36.916 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:36.916 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:36.916 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:36.916 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:36.916 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:36.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.897+0000 7f5677afa640 1 librados: starting msgr at 2026-02-17T11:10:36.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.897+0000 7f5677afa640 1 librados: starting objecter 2026-02-17T11:10:36.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.897+0000 7f5677afa640 1 Processor -- start 2026-02-17T11:10:36.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.897+0000 7f5677afa640 1 -- start start 2026-02-17T11:10:36.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.897+0000 7f5677afa640 1 librados: setting wanted keys 2026-02-17T11:10:36.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.897+0000 7f5677afa640 1 librados: calling monclient init 2026-02-17T11:10:36.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.897+0000 7f5677afa640 10 monclient: init 2026-02-17T11:10:36.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.898+0000 7f5677afa640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:36.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.898+0000 7f5677afa640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:10:36.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.898+0000 7f5677afa640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f56700c9780 0x7f56700d1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:36.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.898+0000 7f5677afa640 10 monclient(hunting): picked mon.noname-c con 0x7f56700c9780 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:36.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.898+0000 7f5677afa640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f56700ce5d0 0x7f567015d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:36.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.898+0000 7f5677afa640 10 monclient(hunting): picked mon.noname-a con 0x7f56700ce5d0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:36.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.898+0000 7f5677afa640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f567015bf30 0x7f56701f45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:36.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.898+0000 7f5677afa640 10 monclient(hunting): picked mon.noname-b con 0x7f567015bf30 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:36.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.898+0000 7f5677afa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:36.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.898+0000 7f5677afa640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f56700ca0d0 con 0x7f56700ce5d0 2026-02-17T11:10:36.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.898+0000 7f5677afa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:36.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.898+0000 7f5677afa640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f56700c9260 con 0x7f567015bf30 2026-02-17T11:10:36.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.898+0000 7f5677afa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:36.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.898+0000 7f5677afa640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f56700cbc30 con 0x7f56700c9780 2026-02-17T11:10:36.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.898+0000 7f5677afa640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:36.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.898+0000 7f5677afa640 10 monclient(hunting): authenticate will time out at 1113.561087s 2026-02-17T11:10:36.918 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.898+0000 7f0de13ae640 1 -- 10.20.193.49:0/189371667 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dd003c070 con 0x7f0ddc0ccc00 2026-02-17T11:10:36.918 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.898+0000 7f0de13ae640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:36.918 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.898+0000 7f0de13ae640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:10:36.918 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.898+0000 7f0de13ae640 10 monclient: dump: 2026-02-17T11:10:36.918 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:36.918 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:36.918 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:36.918 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:36.918 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:36.918 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:36.918 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:36.918 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:36.918 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:36.919 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:36.919 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.898+0000 7f0de13ae640 10 monclient: _finish_auth 0 2026-02-17T11:10:36.919 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.898+0000 7f0de13ae640 10 monclient: _check_auth_tickets 2026-02-17T11:10:36.919 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.898+0000 7f0de13ae640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:36.919 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.898+0000 7f0de13ae640 1 -- 10.20.193.49:0/189371667 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dd002fa90 con 0x7f0ddc0ccc00 2026-02-17T11:10:36.919 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.898+0000 7f0de13ae640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:36.919 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.898+0000 7f0de13ae640 1 -- 10.20.193.49:0/189371667 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dd002fe60 con 0x7f0ddc0ccc00 2026-02-17T11:10:36.919 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.898+0000 7f0de463b640 5 monclient: authenticate success, global_id 4512 2026-02-17T11:10:36.919 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.898+0000 7f0de463b640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:36.919 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.898+0000 7f0de463b640 4 set_mon_vals no callback set 2026-02-17T11:10:36.919 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.898+0000 7f0de13ae640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:36.919 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.898+0000 7f0de13ae640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:10:36.919 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.898+0000 7f0de13ae640 10 monclient: dump: 2026-02-17T11:10:36.919 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:36.919 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:36.919 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:36.919 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:36.919 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:36.919 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:36.919 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:36.920 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:36.920 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:36.920 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:36.920 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.898+0000 7f567586f640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f56700c9780 0x7f56700d1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:36.921 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.898+0000 7f0de463b640 10 monclient: shutdown 2026-02-17T11:10:36.921 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.898+0000 7f0de463b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:36.921 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.898+0000 7f0de463b640 1 -- 10.20.193.49:0/189371667 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0ddc0ccc00 msgr2=0x7f0ddc156120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:36.921 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.898+0000 7f0de463b640 1 --2- 10.20.193.49:0/189371667 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0ddc0ccc00 0x7f0ddc156120 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc069bf0 tx=0x7f0dd002ee60 comp rx=0 tx=0).stop 2026-02-17T11:10:36.921 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.898+0000 7f0de463b640 1 -- 10.20.193.49:0/189371667 shutdown_connections 2026-02-17T11:10:36.921 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.898+0000 7f0de463b640 1 --2- 10.20.193.49:0/189371667 >> v2:10.20.193.97:3300/0 conn(0x7f0ddc0caff0 0x7f0ddc0cb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.921 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.898+0000 7f0de463b640 1 --2- 10.20.193.49:0/189371667 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0ddc0ccc00 0x7f0ddc156120 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.921 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.898+0000 7f0de463b640 1 -- 10.20.193.49:0/189371667 >> 10.20.193.49:0/189371667 conn(0x7f0ddc0cc0e0 msgr2=0x7f0ddc0cc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:36.921 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.898+0000 7f0de463b640 1 -- 10.20.193.49:0/189371667 shutdown_connections 2026-02-17T11:10:36.921 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.898+0000 7f0de463b640 1 -- 10.20.193.49:0/189371667 wait complete. 2026-02-17T11:10:36.922 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.898+0000 7f567586f640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f56700c9780 0x7f56700d1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:48162/0 (socket says 10.20.193.49:48162) 2026-02-17T11:10:36.922 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.898+0000 7f567586f640 1 -- 10.20.193.49:0/535311151 learned_addr learned my addr 10.20.193.49:0/535311151 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:36.922 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.898+0000 7f567586f640 10 monclient(hunting): get_auth_request con 0x7f56700c9780 auth_method 0 2026-02-17T11:10:36.922 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.898+0000 7f567586f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:36.922 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.898+0000 7f567586f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:36.922 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.898+0000 7f567586f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:36.922 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.899+0000 7f567586f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:36.922 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.899+0000 7f567586f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:36.922 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.899+0000 7f567586f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:36.923 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.899+0000 7f0de463b640 10 monclient: build_initial_monmap 2026-02-17T11:10:36.923 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.899+0000 7f0de463b640 10 monclient: monmap: 2026-02-17T11:10:36.923 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:36.923 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:36.923 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:36.923 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:36.923 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:36.923 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:36.923 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:36.923 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:36.923 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:36.924 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:36.924 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.899+0000 7f0de463b640 1 librados: starting msgr at 2026-02-17T11:10:36.924 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.899+0000 7f0de463b640 1 librados: starting objecter 2026-02-17T11:10:36.924 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.899+0000 7f0de463b640 1 Processor -- start 2026-02-17T11:10:36.924 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.899+0000 7f0de463b640 1 -- start start 2026-02-17T11:10:36.924 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.899+0000 7f0de463b640 1 librados: setting wanted keys 2026-02-17T11:10:36.924 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.899+0000 7f0de463b640 1 librados: calling monclient init 2026-02-17T11:10:36.924 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.899+0000 7f0de463b640 10 monclient: init 2026-02-17T11:10:36.924 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.899+0000 7f0de463b640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:36.924 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.899+0000 7f0de463b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:10:36.924 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.899+0000 7f0de463b640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0ddc0caff0 0x7f0ddc1566c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:36.924 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.899+0000 7f0de463b640 10 monclient(hunting): picked mon.noname-a con 0x7f0ddc0caff0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:36.924 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.899+0000 7f0de463b640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f0ddc0ccc00 0x7f0ddc15b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:36.924 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.899+0000 7f0de463b640 10 monclient(hunting): picked mon.noname-c con 0x7f0ddc0ccc00 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:36.924 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.899+0000 7f0de463b640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f0ddc155d40 0x7f0ddc1f5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:36.924 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.899+0000 7f0de463b640 10 monclient(hunting): picked mon.noname-b con 0x7f0ddc155d40 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:36.924 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.899+0000 7f0de463b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:36.924 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.899+0000 7f0de463b640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0ddc06d0a0 con 0x7f0ddc0caff0 2026-02-17T11:10:36.924 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.899+0000 7f0de463b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:36.924 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.899+0000 7f0de463b640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f0ddc06cdc0 con 0x7f0ddc155d40 2026-02-17T11:10:36.924 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.899+0000 7f0de463b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:36.925 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.899+0000 7f0de463b640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f0ddc15d9b0 con 0x7f0ddc0ccc00 2026-02-17T11:10:36.925 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.899+0000 7f0de463b640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:36.925 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.899+0000 7f0de463b640 10 monclient(hunting): authenticate will time out at 1113.562747s 2026-02-17T11:10:36.925 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.900+0000 7f567506e640 1 --2- 10.20.193.49:0/535311151 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f56700ce5d0 0x7f567015d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:36.925 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.900+0000 7f567586f640 10 monclient(hunting): handle_auth_done global_id 4523 payload 824 2026-02-17T11:10:36.925 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.900+0000 7f567586f640 1 -- 10.20.193.49:0/535311151 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f567015bf30 msgr2=0x7f56701f45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:36.925 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.900+0000 7f567586f640 1 --2- 10.20.193.49:0/535311151 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f567015bf30 0x7f56701f45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.925 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.900+0000 7f567586f640 1 -- 10.20.193.49:0/535311151 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f56700ce5d0 msgr2=0x7f567015d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:36.925 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.900+0000 7f567586f640 1 --2- 10.20.193.49:0/535311151 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f56700ce5d0 0x7f567015d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.925 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.900+0000 7f567586f640 10 monclient: _finish_hunting 0 2026-02-17T11:10:36.925 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.900+0000 7f567586f640 1 monclient: found mon.noname-c 2026-02-17T11:10:36.925 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.900+0000 7f567586f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:36.926 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.900+0000 7f567586f640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:10:36.926 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.900+0000 7f567586f640 1 -- 10.20.193.49:0/535311151 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56700d0770 con 0x7f56700c9780 2026-02-17T11:10:36.926 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.901+0000 7f77fa7fc640 1 -- 10.20.193.49:0/416918467 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ec03c070 con 0x7f77fc0c48c0 2026-02-17T11:10:36.926 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.901+0000 7f77fa7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:36.926 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.901+0000 7f77fa7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:10:36.926 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.901+0000 7f77fa7fc640 10 monclient: dump: 2026-02-17T11:10:36.926 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:36.926 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:36.926 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:36.927 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:36.927 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:36.927 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:36.927 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:36.927 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:36.927 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:36.927 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:36.927 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.901+0000 7f77fa7fc640 10 monclient: _finish_auth 0 2026-02-17T11:10:36.927 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.901+0000 7f77fa7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:10:36.927 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.901+0000 7f77fa7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:36.927 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.901+0000 7f77fa7fc640 1 -- 10.20.193.49:0/416918467 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77ec02fbe0 con 0x7f77fc0c48c0 2026-02-17T11:10:36.927 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.901+0000 7f7801b72640 5 monclient: authenticate success, global_id 4515 2026-02-17T11:10:36.927 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.901+0000 7f7801b72640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:10:36.927 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.901+0000 7f77fa7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:36.927 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.901+0000 7f77fa7fc640 1 -- 10.20.193.49:0/416918467 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ec037440 con 0x7f77fc0c48c0 2026-02-17T11:10:36.927 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.901+0000 7f7801b72640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:36.927 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.901+0000 7f77fa7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:36.927 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.901+0000 7f7801b72640 4 set_mon_vals no callback set 2026-02-17T11:10:36.927 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.901+0000 7f77fa7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:10:36.927 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.901+0000 7f77fa7fc640 10 monclient: dump: 2026-02-17T11:10:36.927 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:36.927 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:36.927 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:36.927 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:36.928 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:36.928 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:36.928 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:36.928 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:36.928 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:36.928 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:36.928 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.901+0000 7f0de1baf640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f0ddc0ccc00 0x7f0ddc15b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:36.928 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.901+0000 7f7801b72640 10 monclient: shutdown 2026-02-17T11:10:36.928 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.901+0000 7f7801b72640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:36.928 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.901+0000 7f7801b72640 1 -- 10.20.193.49:0/416918467 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f77fc0c48c0 msgr2=0x7f77fc0749b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:36.928 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.901+0000 7f7801b72640 1 --2- 10.20.193.49:0/416918467 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f77fc0c48c0 0x7f77fc0749b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f77fc0723c0 tx=0x7f77ec02eed0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.928 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.901+0000 7f0de23b0640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0ddc0caff0 0x7f0ddc1566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:36.929 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.901+0000 7f7801b72640 1 -- 10.20.193.49:0/416918467 shutdown_connections 2026-02-17T11:10:36.929 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.901+0000 7f7801b72640 1 --2- 10.20.193.49:0/416918467 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f77fc0c48c0 0x7f77fc0749b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.929 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.901+0000 7f7801b72640 1 --2- 10.20.193.49:0/416918467 >> v2:10.20.193.97:3300/0 conn(0x7f77fc0c7170 0x7f77fc0c7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.929 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.901+0000 7f7801b72640 1 -- 10.20.193.49:0/416918467 >> 10.20.193.49:0/416918467 conn(0x7f77fc0c9f40 msgr2=0x7f77fc0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:36.929 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.901+0000 7f7801b72640 1 -- 10.20.193.49:0/416918467 shutdown_connections 2026-02-17T11:10:36.929 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.901+0000 7f7801b72640 1 -- 10.20.193.49:0/416918467 wait complete. 2026-02-17T11:10:36.929 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.901+0000 7f0de1baf640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f0ddc0ccc00 0x7f0ddc15b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:48176/0 (socket says 10.20.193.49:48176) 2026-02-17T11:10:36.929 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.901+0000 7f0de1baf640 1 -- 10.20.193.49:0/3656177287 learned_addr learned my addr 10.20.193.49:0/3656177287 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:36.929 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.901+0000 7f0de1baf640 10 monclient(hunting): get_auth_request con 0x7f0ddc0ccc00 auth_method 0 2026-02-17T11:10:36.929 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.901+0000 7f0de1baf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:36.929 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.901+0000 7f0de1baf640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:36.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.901+0000 7f0de1baf640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:36.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.901+0000 7f567586f640 1 --2- 10.20.193.49:0/535311151 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f56700c9780 0x7f56700d1780 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5660009a70 tx=0x7f56600047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:36.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.901+0000 7f565e7fc640 10 client.?.objecter ms_handle_connect 0x7f56700c9780 2026-02-17T11:10:36.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.901+0000 7f565e7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:36.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.902+0000 7f0de23b0640 10 monclient(hunting): get_auth_request con 0x7f0ddc0caff0 auth_method 0 2026-02-17T11:10:36.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.902+0000 7f0de23b0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:36.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.902+0000 7f0de23b0640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:36.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.902+0000 7f0de23b0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:36.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.902+0000 7f7801b72640 10 monclient: build_initial_monmap 2026-02-17T11:10:36.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.902+0000 7f7801b72640 10 monclient: monmap: 2026-02-17T11:10:36.930 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:36.930 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:36.931 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:36.931 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:36.931 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:36.931 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:36.931 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:36.931 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:36.931 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:36.931 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:36.931 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.902+0000 7f0de1baf640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:36.931 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.902+0000 7f0de1baf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:36.931 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.902+0000 7f0de1baf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:36.931 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.902+0000 7f7801b72640 1 librados: starting msgr at 2026-02-17T11:10:36.931 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.902+0000 7f7801b72640 1 librados: starting objecter 2026-02-17T11:10:36.931 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.902+0000 7f7801b72640 1 Processor -- start 2026-02-17T11:10:36.932 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.902+0000 7f0de23b0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:36.932 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.902+0000 7f0de23b0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:36.932 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.902+0000 7f0de23b0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:36.932 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.902+0000 7f7801b72640 1 -- start start 2026-02-17T11:10:36.932 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.902+0000 7f7801b72640 1 librados: setting wanted keys 2026-02-17T11:10:36.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.902+0000 7f7801b72640 1 librados: calling monclient init 2026-02-17T11:10:36.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.902+0000 7f7801b72640 10 monclient: init 2026-02-17T11:10:36.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.903+0000 7f7801b72640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:36.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.903+0000 7f7801b72640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:10:36.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.903+0000 7f7801b72640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f77fc074ef0 0x7f77fc149e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:36.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.903+0000 7f7801b72640 10 monclient(hunting): picked mon.noname-b con 0x7f77fc074ef0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:36.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.903+0000 7f7801b72640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f77fc0c48c0 0x7f77fc15d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:36.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.903+0000 7f7801b72640 10 monclient(hunting): picked mon.noname-c con 0x7f77fc0c48c0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:36.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.903+0000 7f7801b72640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f77fc0c7170 0x7f77fc15d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:36.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.903+0000 7f7801b72640 10 monclient(hunting): picked mon.noname-a con 0x7f77fc0c7170 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:36.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.903+0000 7f7801b72640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:36.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.903+0000 7f7801b72640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f77fc0c81c0 con 0x7f77fc0c7170 2026-02-17T11:10:36.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.903+0000 7f7801b72640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:36.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.903+0000 7f7801b72640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f77fc0c7ee0 con 0x7f77fc074ef0 2026-02-17T11:10:36.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.903+0000 7f7801b72640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:36.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.903+0000 7f7801b72640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f77fc0c90d0 con 0x7f77fc0c48c0 2026-02-17T11:10:36.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.903+0000 7f7801b72640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:36.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.903+0000 7f7801b72640 10 monclient(hunting): authenticate will time out at 1113.566057s 2026-02-17T11:10:36.934 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.903+0000 7f0de1baf640 10 monclient(hunting): handle_auth_done global_id 4526 payload 824 2026-02-17T11:10:36.934 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.903+0000 7f0de1baf640 1 -- 10.20.193.49:0/3656177287 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f0ddc155d40 msgr2=0x7f0ddc1f5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:36.934 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.903+0000 7f0de1baf640 1 --2- 10.20.193.49:0/3656177287 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f0ddc155d40 0x7f0ddc1f5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.934 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.903+0000 7f0de1baf640 1 -- 10.20.193.49:0/3656177287 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0ddc0caff0 msgr2=0x7f0ddc1566c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:36.934 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.903+0000 7f0de1baf640 1 --2- 10.20.193.49:0/3656177287 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0ddc0caff0 0x7f0ddc1566c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.934 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.903+0000 7f0de1baf640 10 monclient: _finish_hunting 0 2026-02-17T11:10:36.934 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.903+0000 7f0de1baf640 1 monclient: found mon.noname-c 2026-02-17T11:10:36.934 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.903+0000 7f0de1baf640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:36.934 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.903+0000 7f0de1baf640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:10:36.934 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.903+0000 7f0de1baf640 1 -- 10.20.193.49:0/3656177287 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ddc156d20 con 0x7f0ddc0ccc00 2026-02-17T11:10:36.934 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:10:36.935 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.905+0000 7f77fbfff640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f77fc0c7170 0x7f77fc15d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:36.935 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.905+0000 7f77fbfff640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f77fc0c7170 0x7f77fc15d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:33396/0 (socket says 10.20.193.49:33396) 2026-02-17T11:10:36.935 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.905+0000 7f77fbfff640 1 -- 10.20.193.49:0/2213070188 learned_addr learned my addr 10.20.193.49:0/2213070188 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:36.935 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.905+0000 7f77fbfff640 10 monclient(hunting): get_auth_request con 0x7f77fc0c7170 auth_method 0 2026-02-17T11:10:36.935 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.905+0000 7f77fbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:36.935 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.905+0000 7f77fbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:36.935 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.905+0000 7f77fbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:36.935 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.905+0000 7f77fbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:36.935 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.905+0000 7f77fbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:36.935 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.905+0000 7f77fbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:36.935 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.906+0000 7f565e7fc640 1 -- 10.20.193.49:0/535311151 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f566003c040 con 0x7f56700c9780 2026-02-17T11:10:36.935 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.906+0000 7f565e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:36.935 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.906+0000 7f565e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:10:36.935 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.906+0000 7f565e7fc640 10 monclient: dump: 2026-02-17T11:10:36.935 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:36.936 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:36.936 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:36.936 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:36.936 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:36.936 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:36.936 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:36.936 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:36.936 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:36.936 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:36.936 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.906+0000 7f565e7fc640 10 monclient: _finish_auth 0 2026-02-17T11:10:36.936 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.906+0000 7f565e7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:10:36.936 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.906+0000 7f565e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:36.936 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.906+0000 7f565e7fc640 1 -- 10.20.193.49:0/535311151 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5660042630 con 0x7f56700c9780 2026-02-17T11:10:36.936 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.906+0000 7f5677afa640 5 monclient: authenticate success, global_id 4523 2026-02-17T11:10:36.936 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.906+0000 7f5677afa640 10 monclient: _renew_subs 2026-02-17T11:10:36.936 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.906+0000 7f5677afa640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:36.936 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.906+0000 7f5677afa640 1 -- 10.20.193.49:0/535311151 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56700cf880 con 0x7f56700c9780 2026-02-17T11:10:36.936 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.906+0000 7f565e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:36.936 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.906+0000 7f565e7fc640 1 -- 10.20.193.49:0/535311151 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5660042a20 con 0x7f56700c9780 2026-02-17T11:10:36.936 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.906+0000 7f565e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:36.936 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.906+0000 7f565e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:10:36.936 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.906+0000 7f565e7fc640 10 monclient: dump: 2026-02-17T11:10:36.936 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:36.936 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:36.936 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:36.936 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:36.936 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:36.937 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:36.937 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:36.937 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:36.937 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:36.937 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:36.937 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.906+0000 7f565ffff640 4 set_mon_vals no callback set 2026-02-17T11:10:36.937 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.906+0000 7f0de1baf640 1 --2- 10.20.193.49:0/3656177287 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f0ddc0ccc00 0x7f0ddc15b380 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0dd0002410 tx=0x7f0dd00047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:36.937 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.906+0000 7f0dc2ffd640 10 client.?.objecter ms_handle_connect 0x7f0ddc0ccc00 2026-02-17T11:10:36.937 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.906+0000 7f0dc2ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:36.937 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.906+0000 7f5677afa640 10 client.4523.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:36.937 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.906+0000 7f5677afa640 10 monclient: _renew_subs 2026-02-17T11:10:36.937 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.906+0000 7f5677afa640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:36.937 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.906+0000 7f5677afa640 1 -- 10.20.193.49:0/535311151 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56700cfe40 con 0x7f56700c9780 2026-02-17T11:10:36.937 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.906+0000 7f5677afa640 1 librados: init done 2026-02-17T11:10:36.937 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.906+0000 7f5677afa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:36.937 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.906+0000 7f5677afa640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:36.937 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.906+0000 7f5677afa640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:36.938 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.906+0000 7f5677afa640 1 -- 10.20.193.49:0/535311151 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56700c9b90 con 0x7f56700c9780 2026-02-17T11:10:36.938 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.907+0000 7f77fbfff640 10 monclient(hunting): handle_auth_done global_id 4521 payload 824 2026-02-17T11:10:36.938 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.907+0000 7f77fbfff640 1 -- 10.20.193.49:0/2213070188 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f77fc0c48c0 msgr2=0x7f77fc15d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:36.938 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.907+0000 7f77fbfff640 1 --2- 10.20.193.49:0/2213070188 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f77fc0c48c0 0x7f77fc15d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.938 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.907+0000 7f77fbfff640 1 -- 10.20.193.49:0/2213070188 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f77fc074ef0 msgr2=0x7f77fc149e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:36.939 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.907+0000 7f77fbfff640 1 --2- 10.20.193.49:0/2213070188 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f77fc074ef0 0x7f77fc149e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:36.939 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.907+0000 7f77fbfff640 10 monclient: _finish_hunting 0 2026-02-17T11:10:36.939 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.907+0000 7f77fbfff640 1 monclient: found mon.noname-a 2026-02-17T11:10:36.939 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.907+0000 7f77fbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:36.939 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.907+0000 7f77fbfff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:10:36.939 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.907+0000 7f77fbfff640 1 -- 10.20.193.49:0/2213070188 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77fc0c2c90 con 0x7f77fc0c7170 2026-02-17T11:10:36.939 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.908+0000 7f77fbfff640 1 --2- 10.20.193.49:0/2213070188 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f77fc0c7170 0x7f77fc15d5f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f77f000cc20 tx=0x7f77f000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:36.939 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.908+0000 7f77d7fff640 10 client.?.objecter ms_handle_connect 0x7f77fc0c7170 2026-02-17T11:10:36.939 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.908+0000 7f77d7fff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:36.939 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.910+0000 7f77d7fff640 1 -- 10.20.193.49:0/2213070188 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f000ce40 con 0x7f77fc0c7170 2026-02-17T11:10:36.939 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.910+0000 7f77d7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:36.939 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.910+0000 7f77d7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:10:36.939 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.910+0000 7f77d7fff640 10 monclient: dump: 2026-02-17T11:10:36.939 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:36.939 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:36.939 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:36.939 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:36.939 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:36.939 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:36.939 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:36.939 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:36.939 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:36.939 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:36.939 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.910+0000 7f77d7fff640 10 monclient: _finish_auth 0 2026-02-17T11:10:36.939 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.910+0000 7f77d7fff640 10 monclient: _check_auth_tickets 2026-02-17T11:10:36.939 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.910+0000 7f77d7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:36.939 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.910+0000 7f77d7fff640 1 -- 10.20.193.49:0/2213070188 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77f0003a70 con 0x7f77fc0c7170 2026-02-17T11:10:36.939 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.910+0000 7f7801b72640 5 monclient: authenticate success, global_id 4521 2026-02-17T11:10:36.939 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.910+0000 7f7801b72640 10 monclient: _renew_subs 2026-02-17T11:10:36.939 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.910+0000 7f7801b72640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:36.940 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.910+0000 7f7801b72640 1 -- 10.20.193.49:0/2213070188 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77fc0c2f70 con 0x7f77fc0c7170 2026-02-17T11:10:36.940 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.910+0000 7f77d7fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:36.940 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.910+0000 7f77d7fff640 1 -- 10.20.193.49:0/2213070188 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f0003e60 con 0x7f77fc0c7170 2026-02-17T11:10:36.940 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.910+0000 7f77d7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:36.940 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.910+0000 7f77d7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:10:36.940 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.910+0000 7f77d7fff640 10 monclient: dump: 2026-02-17T11:10:36.940 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:36.940 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:36.940 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:36.940 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:36.940 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:36.940 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:36.940 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:36.940 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:36.940 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:36.940 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:36.940 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.910+0000 7f77f9ffb640 4 set_mon_vals no callback set 2026-02-17T11:10:36.940 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.910+0000 7f7801b72640 10 client.4521.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:36.940 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.910+0000 7f7801b72640 10 monclient: _renew_subs 2026-02-17T11:10:36.940 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.910+0000 7f7801b72640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:36.940 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.910+0000 7f7801b72640 1 -- 10.20.193.49:0/2213070188 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77fc0c3530 con 0x7f77fc0c7170 2026-02-17T11:10:36.940 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.910+0000 7f7801b72640 1 librados: init done 2026-02-17T11:10:36.940 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.910+0000 7f7801b72640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:36.940 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.910+0000 7f7801b72640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:36.940 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.910+0000 7f7801b72640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:36.940 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.910+0000 7f7801b72640 1 -- 10.20.193.49:0/2213070188 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77fc0c4d10 con 0x7f77fc0c7170 2026-02-17T11:10:36.941 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.918+0000 7f565e7fc640 1 -- 10.20.193.49:0/535311151 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f5660042bc0 con 0x7f56700c9780 2026-02-17T11:10:36.941 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.918+0000 7f565e7fc640 1 --2- 10.20.193.49:0/535311151 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5640079190 0x7f564007b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:36.941 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.918+0000 7f567506e640 1 --2- 10.20.193.49:0/535311151 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5640079190 0x7f564007b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:36.941 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.918+0000 7f567506e640 10 monclient: get_auth_request con 0x7f5640079190 auth_method 0 2026-02-17T11:10:36.941 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.919+0000 7f567506e640 1 --2- 10.20.193.49:0/535311151 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5640079190 0x7f564007b650 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f56700d1730 tx=0x7f5664009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:36.941 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.919+0000 7f565e7fc640 10 client.4523.objecter ms_handle_connect 0x7f5640079190 2026-02-17T11:10:36.941 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.920+0000 7f565e7fc640 1 -- 10.20.193.49:0/535311151 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7f566002faa0 con 0x7f56700c9780 2026-02-17T11:10:36.941 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.920+0000 7f565e7fc640 10 client.4523.objecter ms_dispatch2 0x7f5670000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:36.941 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.920+0000 7f565e7fc640 3 client.4523.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:36.941 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.920+0000 7f565e7fc640 3 client.4523.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:36.941 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.920+0000 7f565e7fc640 20 client.4523.objecter dump_active .. 0 homeless 2026-02-17T11:10:36.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.921+0000 7f0dc2ffd640 1 -- 10.20.193.49:0/3656177287 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dd0044070 con 0x7f0ddc0ccc00 2026-02-17T11:10:36.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.921+0000 7f0dc2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:36.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.921+0000 7f0dc2ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:10:36.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.921+0000 7f0dc2ffd640 10 monclient: dump: 2026-02-17T11:10:36.942 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:36.942 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:36.942 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:36.942 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:36.942 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:36.942 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:36.942 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:36.942 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:36.942 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:36.942 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:36.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.921+0000 7f0dc2ffd640 10 monclient: _finish_auth 0 2026-02-17T11:10:36.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.921+0000 7f0dc2ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:10:36.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.921+0000 7f0dc2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:36.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.921+0000 7f0dc2ffd640 1 -- 10.20.193.49:0/3656177287 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dd0040630 con 0x7f0ddc0ccc00 2026-02-17T11:10:36.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.921+0000 7f0dc2ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:36.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.921+0000 7f0dc2ffd640 1 -- 10.20.193.49:0/3656177287 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dd003c040 con 0x7f0ddc0ccc00 2026-02-17T11:10:36.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.921+0000 7f0dc2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:36.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.921+0000 7f0dc2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:10:36.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.921+0000 7f0de0bad640 4 set_mon_vals no callback set 2026-02-17T11:10:36.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.921+0000 7f0dc2ffd640 10 monclient: dump: 2026-02-17T11:10:36.942 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:36.942 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:36.942 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:36.942 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:36.942 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:36.942 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:36.942 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:36.943 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:36.943 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:36.943 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:36.943 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.921+0000 7f0de463b640 5 monclient: authenticate success, global_id 4526 2026-02-17T11:10:36.943 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.921+0000 7f0de463b640 10 monclient: _renew_subs 2026-02-17T11:10:36.943 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.921+0000 7f0de463b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:36.943 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.921+0000 7f0de463b640 1 -- 10.20.193.49:0/3656177287 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ddc157000 con 0x7f0ddc0ccc00 2026-02-17T11:10:36.943 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.921+0000 7f0de463b640 10 client.4526.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:36.943 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.921+0000 7f0de463b640 10 monclient: _renew_subs 2026-02-17T11:10:36.943 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.921+0000 7f0de463b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:36.943 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.921+0000 7f0de463b640 1 -- 10.20.193.49:0/3656177287 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ddc1575c0 con 0x7f0ddc0ccc00 2026-02-17T11:10:36.943 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.921+0000 7f0de463b640 1 librados: init done 2026-02-17T11:10:36.943 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.922+0000 7f77d7fff640 1 -- 10.20.193.49:0/2213070188 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f77f00050d0 con 0x7f77fc0c7170 2026-02-17T11:10:36.943 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.922+0000 7f0de463b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:36.943 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.922+0000 7f0de463b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:36.943 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.922+0000 7f0de463b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:36.943 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.922+0000 7f0de463b640 1 -- 10.20.193.49:0/3656177287 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ddc06f640 con 0x7f0ddc0ccc00 2026-02-17T11:10:36.944 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.922+0000 7f77d7fff640 1 --2- 10.20.193.49:0/2213070188 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f77cc079190 0x7f77cc07b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:36.944 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.922+0000 7f77fb7fe640 1 --2- 10.20.193.49:0/2213070188 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f77cc079190 0x7f77cc07b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:36.944 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.923+0000 7f77fb7fe640 10 monclient: get_auth_request con 0x7f77cc079190 auth_method 0 2026-02-17T11:10:36.944 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.923+0000 7f77fb7fe640 1 --2- 10.20.193.49:0/2213070188 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f77cc079190 0x7f77cc07b650 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f77e8009770 tx=0x7f77e8006cf0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:36.944 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.923+0000 7f77d7fff640 10 client.4521.objecter ms_handle_connect 0x7f77cc079190 2026-02-17T11:10:36.964 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.963+0000 7fe16effd640 1 -- 10.20.193.49:0/1623861441 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7fe1840050d0 con 0x7fe188153db0 2026-02-17T11:10:36.965 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.964+0000 7fe16effd640 1 --2- 10.20.193.49:0/1623861441 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fe158079140 0x7fe15807b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:36.965 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.964+0000 7fe18e3d9640 1 --2- 10.20.193.49:0/1623861441 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fe158079140 0x7fe15807b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:36.965 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.964+0000 7fe18e3d9640 10 monclient: get_auth_request con 0x7fe158079140 auth_method 0 2026-02-17T11:10:36.965 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.964+0000 7fe16effd640 10 client.4510.objecter ms_handle_connect 0x7fe158079140 2026-02-17T11:10:36.965 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.964+0000 7fe18e3d9640 1 --2- 10.20.193.49:0/1623861441 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fe158079140 0x7fe15807b600 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe1780091b0 tx=0x7fe178039040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:36.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.966+0000 7fe16effd640 1 -- 10.20.193.49:0/1623861441 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7fe18405e7d0 con 0x7fe188153db0 2026-02-17T11:10:36.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.966+0000 7fe16effd640 10 client.4510.objecter ms_dispatch2 0x7fe188000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:36.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.966+0000 7fe16effd640 3 client.4510.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:36.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.966+0000 7fe16effd640 3 client.4510.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:36.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.966+0000 7fe16effd640 20 client.4510.objecter dump_active .. 0 homeless 2026-02-17T11:10:36.975 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.974+0000 7fe16effd640 1 -- 10.20.193.49:0/1623861441 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe184062790 con 0x7fe188153db0 2026-02-17T11:10:36.975 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.974+0000 7fe16effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:36.975 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:36.974+0000 7fe16effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:36.991 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.13 2026-02-17T11:10:37.010 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2026-02-17T11:10:37.011 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.15 2026-02-17T11:10:37.014 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.011+0000 7fed0e9fb640 10 monclient: get_monmap_and_config 2026-02-17T11:10:37.014 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.011+0000 7fed0e9fb640 10 monclient: build_initial_monmap 2026-02-17T11:10:37.014 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.011+0000 7fed0e9fb640 10 monclient: monmap: 2026-02-17T11:10:37.014 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:37.014 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.014 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:37.012443+0000 2026-02-17T11:10:37.014 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:37.012443+0000 2026-02-17T11:10:37.014 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:37.014 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.014 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:37.015 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:37.015 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:37.015 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:37.015 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:37.015 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:37.015 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.015 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.012+0000 7fed0e9fb640 1 Processor -- start 2026-02-17T11:10:37.015 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.012+0000 7fed0e9fb640 1 -- start start 2026-02-17T11:10:37.015 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.012+0000 7fed0e9fb640 10 monclient: init 2026-02-17T11:10:37.016 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.012+0000 7fed0e9fb640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:37.017 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.012+0000 7fed0e9fb640 10 monclient: _add_conns ranks=[0,2,3,5,1,4] 2026-02-17T11:10:37.017 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.012+0000 7fed0e9fb640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fed0814f280 addr v1:10.20.193.49:6789/0 2026-02-17T11:10:37.017 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.012+0000 7fed0e9fb640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fed0814f660 addr v1:10.20.193.157:6789/0 2026-02-17T11:10:37.017 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.012+0000 7fed0e9fb640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fed0815abc0 0x7fed0815afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.017 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.012+0000 7fed0e9fb640 10 monclient(hunting): picked mon.noname-a con 0x7fed0815abc0 addr v2:10.20.193.49:3300/0 2026-02-17T11:10:37.017 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.012+0000 7fed0e9fb640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed080c7110 con 0x7fed0814f280 2026-02-17T11:10:37.017 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.012+0000 7fed0e9fb640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed080c7390 con 0x7fed0814f660 2026-02-17T11:10:37.017 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.012+0000 7fed0e9fb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.017 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.012+0000 7fed0e9fb640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7fed080c7950 con 0x7fed0815abc0 2026-02-17T11:10:37.017 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.012+0000 7fed0e9fb640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:37.017 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.012+0000 7fed0e9fb640 10 monclient(hunting): authenticate will time out at 1113.675986s 2026-02-17T11:10:37.019 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-17T11:10:37.019 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:10:37.026 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.024+0000 7f565e7fc640 1 -- 10.20.193.49:0/535311151 <== mon.2 v2:10.20.193.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f5660088140 con 0x7f56700c9780 2026-02-17T11:10:37.026 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.024+0000 7f565e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:37.026 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.024+0000 7f565e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:37.027 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.025+0000 7f77d7fff640 1 -- 10.20.193.49:0/2213070188 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7f77f005ea20 con 0x7f77fc0c7170 2026-02-17T11:10:37.027 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.025+0000 7f77d7fff640 10 client.4521.objecter ms_dispatch2 0x7f77fc000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:37.028 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.025+0000 7f77d7fff640 3 client.4521.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:37.028 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.025+0000 7f77d7fff640 3 client.4521.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:37.028 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.025+0000 7f77d7fff640 20 client.4521.objecter dump_active .. 0 homeless 2026-02-17T11:10:37.028 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.025+0000 7f77d7fff640 1 -- 10.20.193.49:0/2213070188 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f77f0019300 con 0x7f77fc0c7170 2026-02-17T11:10:37.028 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.025+0000 7f77d7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:37.028 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.025+0000 7f77d7fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:37.030 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.027+0000 7fed0cf71640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fed0815abc0 0x7fed0815afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:37.030 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.027+0000 7fed07fff640 1 --1- >> v1:10.20.193.49:6789/0 conn(0x7fed0814f280 0x7fed080c7e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.49:6789/0 says I am v1:10.20.193.49:47602/0 (socket says 10.20.193.49:47602) 2026-02-17T11:10:37.030 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.027+0000 7fed07fff640 1 -- 10.20.193.49:0/1272165945 learned_addr learned my addr 10.20.193.49:0/1272165945 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:10:37.030 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.027+0000 7fed0cf71640 10 monclient(hunting): get_auth_request con 0x7fed0815abc0 auth_method 0 2026-02-17T11:10:37.031 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.027+0000 7fed0cf71640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:37.031 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.027+0000 7fed0cf71640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:37.031 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.027+0000 7fed0cf71640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:37.031 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.028+0000 7fed0cf71640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:37.031 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.028+0000 7fed0cf71640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:37.031 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.028+0000 7fed0cf71640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:37.032 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.030+0000 7fed0cf71640 10 monclient(hunting): handle_auth_done global_id 4524 payload 274 2026-02-17T11:10:37.032 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.030+0000 7fed0cf71640 1 -- 10.20.193.49:0/1272165945 >> v1:10.20.193.157:6789/0 conn(0x7fed0814f660 legacy=0x7fed080c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:37.032 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.030+0000 7fed0cf71640 1 -- 10.20.193.49:0/1272165945 >> v1:10.20.193.49:6789/0 conn(0x7fed0814f280 legacy=0x7fed080c7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.032 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.030+0000 7fed0cf71640 10 monclient: _finish_hunting 0 2026-02-17T11:10:37.032 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.030+0000 7fed0cf71640 1 monclient: found mon.noname-a 2026-02-17T11:10:37.032 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.030+0000 7fed0cf71640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:37.032 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.030+0000 7fed0cf71640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:10:37.032 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.030+0000 7fed0cf71640 1 -- 10.20.193.49:0/1272165945 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed080c7670 con 0x7fed0815abc0 2026-02-17T11:10:37.034 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.033+0000 7fed0cf71640 1 --2- 10.20.193.49:0/1272165945 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fed0815abc0 0x7fed0815afe0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fecfc009d90 tx=0x7fecfc02f270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cb88a333c11b318 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:37.038 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.035+0000 7fed06ffd640 1 -- 10.20.193.49:0/1272165945 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecfc03c070 con 0x7fed0815abc0 2026-02-17T11:10:37.038 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.035+0000 7fed06ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:37.038 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.035+0000 7fed06ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:10:37.038 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.035+0000 7fed06ffd640 10 monclient: dump: 2026-02-17T11:10:37.038 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:37.039 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.039 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.039 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.039 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:37.039 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.039 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:37.039 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:37.039 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:37.039 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.039 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.035+0000 7fed06ffd640 10 monclient: _finish_auth 0 2026-02-17T11:10:37.039 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.035+0000 7fed06ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:10:37.039 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.035+0000 7fed06ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:37.039 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.035+0000 7fed06ffd640 1 -- 10.20.193.49:0/1272165945 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecfc037440 con 0x7fed0815abc0 2026-02-17T11:10:37.040 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.035+0000 7fed06ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:37.040 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.035+0000 7fed06ffd640 1 -- 10.20.193.49:0/1272165945 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecfc037810 con 0x7fed0815abc0 2026-02-17T11:10:37.040 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.035+0000 7fed0e9fb640 5 monclient: authenticate success, global_id 4524 2026-02-17T11:10:37.040 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.035+0000 7fed0e9fb640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:37.040 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.035+0000 7fed0e9fb640 4 set_mon_vals no callback set 2026-02-17T11:10:37.040 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.035+0000 7fed06ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:37.040 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.035+0000 7fed06ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:10:37.040 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.035+0000 7fed06ffd640 10 monclient: dump: 2026-02-17T11:10:37.040 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:37.040 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.040 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.040 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.041 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:37.041 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.041 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:37.041 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:37.041 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:37.041 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.041 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.036+0000 7fed0e9fb640 10 monclient: shutdown 2026-02-17T11:10:37.041 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.036+0000 7fed0e9fb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:37.041 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.036+0000 7fed0e9fb640 1 -- 10.20.193.49:0/1272165945 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fed0815abc0 msgr2=0x7fed0815afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.041 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.036+0000 7fed0e9fb640 1 --2- 10.20.193.49:0/1272165945 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fed0815abc0 0x7fed0815afe0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fecfc009d90 tx=0x7fecfc02f270 comp rx=0 tx=0).stop 2026-02-17T11:10:37.041 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.036+0000 7fed0e9fb640 1 -- 10.20.193.49:0/1272165945 shutdown_connections 2026-02-17T11:10:37.041 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.036+0000 7fed0e9fb640 1 --2- 10.20.193.49:0/1272165945 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fed0815abc0 0x7fed0815afe0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.042 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.036+0000 7fed0e9fb640 1 -- 10.20.193.49:0/1272165945 >> 10.20.193.49:0/1272165945 conn(0x7fed080c9f20 msgr2=0x7fed080ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:37.042 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.036+0000 7fed0e9fb640 1 -- 10.20.193.49:0/1272165945 shutdown_connections 2026-02-17T11:10:37.042 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.036+0000 7fed0e9fb640 1 -- 10.20.193.49:0/1272165945 wait complete. 2026-02-17T11:10:37.042 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.036+0000 7fed0e9fb640 10 monclient: build_initial_monmap 2026-02-17T11:10:37.042 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.036+0000 7fed0e9fb640 10 monclient: monmap: 2026-02-17T11:10:37.042 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:37.042 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:37.042 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:37.042 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:37.042 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:37.042 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.042 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:37.043 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:37.043 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:37.043 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.043 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.036+0000 7fed0e9fb640 1 librados: starting msgr at 2026-02-17T11:10:37.043 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.036+0000 7fed0e9fb640 1 librados: starting objecter 2026-02-17T11:10:37.043 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.037+0000 7fed0e9fb640 1 Processor -- start 2026-02-17T11:10:37.043 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.037+0000 7fed0e9fb640 1 -- start start 2026-02-17T11:10:37.043 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.037+0000 7fed0e9fb640 1 librados: setting wanted keys 2026-02-17T11:10:37.043 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.037+0000 7fed0e9fb640 1 librados: calling monclient init 2026-02-17T11:10:37.043 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.037+0000 7fed0e9fb640 10 monclient: init 2026-02-17T11:10:37.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.037+0000 7fed0e9fb640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:37.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.037+0000 7fed0e9fb640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:10:37.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.037+0000 7fed0e9fb640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fed0814f280 0x7fed08146860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.037+0000 7fed0e9fb640 10 monclient(hunting): picked mon.noname-b con 0x7fed0814f280 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:37.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.037+0000 7fed0e9fb640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fed0814f660 0x7fed080cc720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.037+0000 7fed0e9fb640 10 monclient(hunting): picked mon.noname-a con 0x7fed0814f660 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:37.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.037+0000 7fed0e9fb640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fed0815abc0 0x7fed0806eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.037+0000 7fed0e9fb640 10 monclient(hunting): picked mon.noname-c con 0x7fed0815abc0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:37.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.037+0000 7fed0e9fb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.037+0000 7fed0e9fb640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fed0815a730 con 0x7fed0814f660 2026-02-17T11:10:37.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.037+0000 7fed0e9fb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.037+0000 7fed0e9fb640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fed080c8530 con 0x7fed0814f280 2026-02-17T11:10:37.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.037+0000 7fed0e9fb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.037+0000 7fed0e9fb640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fed0815a3c0 con 0x7fed0815abc0 2026-02-17T11:10:37.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.037+0000 7fed0e9fb640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:37.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.037+0000 7fed0e9fb640 10 monclient(hunting): authenticate will time out at 1113.700749s 2026-02-17T11:10:37.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.038+0000 7fed077fe640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fed0814f660 0x7fed080cc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:37.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.038+0000 7fed07fff640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fed0814f280 0x7fed08146860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:37.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.038+0000 7fed077fe640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fed0814f660 0x7fed080cc720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:33410/0 (socket says 10.20.193.49:33410) 2026-02-17T11:10:37.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.038+0000 7fed077fe640 1 -- 10.20.193.49:0/2151066935 learned_addr learned my addr 10.20.193.49:0/2151066935 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:37.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.038+0000 7fed077fe640 10 monclient(hunting): get_auth_request con 0x7fed0814f660 auth_method 0 2026-02-17T11:10:37.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.038+0000 7fed077fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:37.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.038+0000 7fed077fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:37.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.038+0000 7fed077fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:37.050 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.038+0000 7fed07fff640 10 monclient(hunting): get_auth_request con 0x7fed0814f280 auth_method 0 2026-02-17T11:10:37.050 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.038+0000 7fed07fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:37.050 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.038+0000 7fed07fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:37.050 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.038+0000 7fed07fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:37.050 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.038+0000 7fed077fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:37.050 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.038+0000 7fed077fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:37.050 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.038+0000 7fed077fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:37.050 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.038+0000 7fed07fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:37.050 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.038+0000 7fed07fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:37.050 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.038+0000 7fed07fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:37.050 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.040+0000 7fed07fff640 10 monclient(hunting): handle_auth_done global_id 4513 payload 824 2026-02-17T11:10:37.050 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.040+0000 7fed07fff640 1 -- 10.20.193.49:0/2151066935 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fed0815abc0 msgr2=0x7fed0806eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.051 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.040+0000 7fed07fff640 1 --2- 10.20.193.49:0/2151066935 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fed0815abc0 0x7fed0806eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.051 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.040+0000 7fed07fff640 1 -- 10.20.193.49:0/2151066935 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fed0814f660 msgr2=0x7fed080cc720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.051 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.040+0000 7fed07fff640 1 --2- 10.20.193.49:0/2151066935 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fed0814f660 0x7fed080cc720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.051 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.040+0000 7fed07fff640 10 monclient: _finish_hunting 0 2026-02-17T11:10:37.051 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.040+0000 7fed07fff640 1 monclient: found mon.noname-b 2026-02-17T11:10:37.051 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.040+0000 7fed07fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:37.051 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.040+0000 7fed07fff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:10:37.051 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.040+0000 7fed07fff640 1 -- 10.20.193.49:0/2151066935 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed081f5c80 con 0x7fed0814f280 2026-02-17T11:10:37.051 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.041+0000 7fed07fff640 1 --2- 10.20.193.49:0/2151066935 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fed0814f280 0x7fed08146860 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fecf400c410 tx=0x7fecf400c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:37.051 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.041+0000 7fed04ff9640 10 client.?.objecter ms_handle_connect 0x7fed0814f280 2026-02-17T11:10:37.051 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.041+0000 7fed04ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:37.051 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.042+0000 7fed04ff9640 1 -- 10.20.193.49:0/2151066935 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf4017070 con 0x7fed0814f280 2026-02-17T11:10:37.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.042+0000 7fed04ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:37.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.042+0000 7fed04ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:10:37.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.042+0000 7fed04ff9640 10 monclient: dump: 2026-02-17T11:10:37.052 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:37.052 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.052 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.052 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.052 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:37.052 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.052 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:37.052 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:37.052 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:37.052 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.042+0000 7fed04ff9640 10 monclient: _finish_auth 0 2026-02-17T11:10:37.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.042+0000 7fed04ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:10:37.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.042+0000 7fed04ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:37.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.042+0000 7fed04ff9640 1 -- 10.20.193.49:0/2151066935 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecf4005de0 con 0x7fed0814f280 2026-02-17T11:10:37.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.042+0000 7fed0e9fb640 5 monclient: authenticate success, global_id 4513 2026-02-17T11:10:37.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.042+0000 7fed0e9fb640 10 monclient: _renew_subs 2026-02-17T11:10:37.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.042+0000 7fed0e9fb640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:37.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.042+0000 7fed0e9fb640 1 -- 10.20.193.49:0/2151066935 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed081f4e80 con 0x7fed0814f280 2026-02-17T11:10:37.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.042+0000 7fed04ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:37.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.042+0000 7fed04ff9640 1 -- 10.20.193.49:0/2151066935 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf40072d0 con 0x7fed0814f280 2026-02-17T11:10:37.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.042+0000 7fed04ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:37.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.042+0000 7fed04ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:37.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.042+0000 7fed04ff9640 10 monclient: dump: 2026-02-17T11:10:37.054 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:37.054 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.054 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.054 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.054 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:37.054 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.054 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:37.054 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:37.054 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:37.054 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.054 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.042+0000 7fed067fc640 4 set_mon_vals no callback set 2026-02-17T11:10:37.054 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.042+0000 7fed0e9fb640 10 client.4513.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:37.054 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.042+0000 7fed0e9fb640 10 monclient: _renew_subs 2026-02-17T11:10:37.054 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.042+0000 7fed0e9fb640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:37.054 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.042+0000 7fed0e9fb640 1 -- 10.20.193.49:0/2151066935 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed081f56c0 con 0x7fed0814f280 2026-02-17T11:10:37.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.042+0000 7fed0e9fb640 1 librados: init done 2026-02-17T11:10:37.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.043+0000 7fed0e9fb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:37.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.043+0000 7fed0e9fb640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:37.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.043+0000 7fed0e9fb640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:37.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.043+0000 7fed0e9fb640 1 -- 10.20.193.49:0/2151066935 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed080c9b70 con 0x7fed0814f280 2026-02-17T11:10:37.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.053+0000 7fed04ff9640 1 -- 10.20.193.49:0/2151066935 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7fecf4007470 con 0x7fed0814f280 2026-02-17T11:10:37.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.054+0000 7fed04ff9640 1 --2- 10.20.193.49:0/2151066935 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fecd8079140 0x7fecd807b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.054+0000 7fed077fe640 1 --2- 10.20.193.49:0/2151066935 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fecd8079140 0x7fecd807b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:37.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.054+0000 7fed077fe640 10 monclient: get_auth_request con 0x7fecd8079140 auth_method 0 2026-02-17T11:10:37.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.054+0000 7fed04ff9640 10 client.4513.objecter ms_handle_connect 0x7fecd8079140 2026-02-17T11:10:37.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.054+0000 7fed077fe640 1 --2- 10.20.193.49:0/2151066935 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fecd8079140 0x7fecd807b600 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fed080cd0d0 tx=0x7fecf8009290 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:37.057 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.055+0000 7fed04ff9640 1 -- 10.20.193.49:0/2151066935 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7fecf4007790 con 0x7fed0814f280 2026-02-17T11:10:37.057 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.055+0000 7fed04ff9640 10 client.4513.objecter ms_dispatch2 0x7fed08000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:37.057 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.055+0000 7fed04ff9640 3 client.4513.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:37.057 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.055+0000 7fed04ff9640 3 client.4513.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:37.057 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.055+0000 7fed04ff9640 20 client.4513.objecter dump_active .. 0 homeless 2026-02-17T11:10:37.061 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.060+0000 7fe190664640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-17T11:10:37.061 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.060+0000 7fe190664640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-17T11:10:37.061 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.060+0000 7fe190664640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:37.062 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.060+0000 7fe190664640 1 -- 10.20.193.49:0/1623861441 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fe188070b70 con 0x7fe188153db0 2026-02-17T11:10:37.062 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.060+0000 7fde90296640 10 monclient: get_monmap_and_config 2026-02-17T11:10:37.062 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.060+0000 7fde90296640 10 monclient: build_initial_monmap 2026-02-17T11:10:37.062 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.060+0000 7fde90296640 10 monclient: monmap: 2026-02-17T11:10:37.062 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:37.062 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.062 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:37.061430+0000 2026-02-17T11:10:37.062 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:37.061430+0000 2026-02-17T11:10:37.062 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:37.062 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.063 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:37.063 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:37.063 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:37.063 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:37.063 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:37.063 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:37.063 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.064 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.061+0000 7fde90296640 1 Processor -- start 2026-02-17T11:10:37.064 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.061+0000 7fde90296640 1 -- start start 2026-02-17T11:10:37.064 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.061+0000 7fde90296640 10 monclient: init 2026-02-17T11:10:37.065 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.061+0000 7fde90296640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:37.065 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.061+0000 7fde90296640 10 monclient: _add_conns ranks=[0,1,3,4,2,5] 2026-02-17T11:10:37.065 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.061+0000 7fde90296640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fde8814f280 addr v1:10.20.193.49:6789/0 2026-02-17T11:10:37.065 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.061+0000 7fde90296640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fde8814f660 addr v1:10.20.193.97:6789/0 2026-02-17T11:10:37.065 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.061+0000 7fde90296640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fde8815abc0 0x7fde8815afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.065 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.061+0000 7fde90296640 10 monclient(hunting): picked mon.noname-a con 0x7fde8815abc0 addr v2:10.20.193.49:3300/0 2026-02-17T11:10:37.065 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.061+0000 7fde90296640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde880c7110 con 0x7fde8814f280 2026-02-17T11:10:37.065 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.061+0000 7fde90296640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde880c7390 con 0x7fde8814f660 2026-02-17T11:10:37.065 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.061+0000 7fde90296640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.065 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.061+0000 7fde90296640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7fde880c7950 con 0x7fde8815abc0 2026-02-17T11:10:37.065 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.061+0000 7fde90296640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:37.065 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.061+0000 7fde90296640 10 monclient(hunting): authenticate will time out at 1113.724958s 2026-02-17T11:10:37.065 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.062+0000 7fde8e80c640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fde8815abc0 0x7fde8815afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:37.065 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.062+0000 7fde8e00b640 1 --1- >> v1:10.20.193.49:6789/0 conn(0x7fde8814f280 0x7fde880c7e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.49:6789/0 says I am v1:10.20.193.49:47616/0 (socket says 10.20.193.49:47616) 2026-02-17T11:10:37.065 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.062+0000 7fde8e00b640 1 -- 10.20.193.49:0/2209712610 learned_addr learned my addr 10.20.193.49:0/2209712610 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:10:37.066 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.062+0000 7fde8e80c640 10 monclient(hunting): get_auth_request con 0x7fde8815abc0 auth_method 0 2026-02-17T11:10:37.066 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.062+0000 7fde8e80c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:37.066 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.062+0000 7fde8e80c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:37.066 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.062+0000 7fde8e80c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:37.066 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.063+0000 7fde8e80c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:37.066 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.063+0000 7fde8e80c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:37.066 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.063+0000 7fde8e80c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:37.067 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.064+0000 7fde8e80c640 10 monclient(hunting): handle_auth_done global_id 4533 payload 274 2026-02-17T11:10:37.067 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.064+0000 7fde8e80c640 1 -- 10.20.193.49:0/2209712610 >> v1:10.20.193.97:6789/0 conn(0x7fde8814f660 legacy=0x7fde880c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:37.067 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.064+0000 7fde8e80c640 1 -- 10.20.193.49:0/2209712610 >> v1:10.20.193.49:6789/0 conn(0x7fde8814f280 legacy=0x7fde880c7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.067 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.064+0000 7fde8e80c640 10 monclient: _finish_hunting 0 2026-02-17T11:10:37.067 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.064+0000 7fde8e80c640 1 monclient: found mon.noname-a 2026-02-17T11:10:37.067 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.064+0000 7fde8e80c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:37.067 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.064+0000 7fde8e80c640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:10:37.067 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.064+0000 7fde8e80c640 1 -- 10.20.193.49:0/2209712610 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde880c7670 con 0x7fde8815abc0 2026-02-17T11:10:37.068 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.067+0000 7fde8e80c640 1 --2- 10.20.193.49:0/2209712610 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fde8815abc0 0x7fde8815afe0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fde84009d90 tx=0x7fde8402f280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7e16fc2035d5de2 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:37.070 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.069+0000 7fde8d009640 1 -- 10.20.193.49:0/2209712610 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde8403c070 con 0x7fde8815abc0 2026-02-17T11:10:37.070 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.069+0000 7fde8d009640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:37.070 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.069+0000 7fde8d009640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:10:37.070 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.069+0000 7fde8d009640 10 monclient: dump: 2026-02-17T11:10:37.071 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:37.071 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.071 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.071 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.071 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:37.071 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.071 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:37.071 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:37.071 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:37.071 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.071 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.069+0000 7fde8d009640 10 monclient: _finish_auth 0 2026-02-17T11:10:37.071 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.069+0000 7fde8d009640 10 monclient: _check_auth_tickets 2026-02-17T11:10:37.071 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.069+0000 7fde8d009640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:37.072 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.069+0000 7fde90296640 5 monclient: authenticate success, global_id 4533 2026-02-17T11:10:37.072 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.069+0000 7fde90296640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:10:37.074 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.070+0000 7fde8d009640 1 -- 10.20.193.49:0/2209712610 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde84037440 con 0x7fde8815abc0 2026-02-17T11:10:37.074 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.070+0000 7fde8d009640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:37.074 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.070+0000 7fde90296640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:37.074 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.070+0000 7fde8d009640 1 -- 10.20.193.49:0/2209712610 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde84037810 con 0x7fde8815abc0 2026-02-17T11:10:37.075 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.070+0000 7fde8d009640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:37.075 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.070+0000 7fde90296640 4 set_mon_vals no callback set 2026-02-17T11:10:37.075 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.070+0000 7fde8d009640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:10:37.075 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.070+0000 7fde8d009640 10 monclient: dump: 2026-02-17T11:10:37.075 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:37.075 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.075 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.075 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.075 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:37.075 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.075 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:37.075 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:37.075 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:37.075 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.076 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.070+0000 7fde90296640 10 monclient: shutdown 2026-02-17T11:10:37.076 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.070+0000 7fde90296640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:37.076 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.070+0000 7fde90296640 1 -- 10.20.193.49:0/2209712610 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fde8815abc0 msgr2=0x7fde8815afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.076 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.070+0000 7fde90296640 1 --2- 10.20.193.49:0/2209712610 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fde8815abc0 0x7fde8815afe0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fde84009d90 tx=0x7fde8402f280 comp rx=0 tx=0).stop 2026-02-17T11:10:37.076 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.070+0000 7fde90296640 1 -- 10.20.193.49:0/2209712610 shutdown_connections 2026-02-17T11:10:37.076 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.070+0000 7fde90296640 1 --2- 10.20.193.49:0/2209712610 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fde8815abc0 0x7fde8815afe0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.076 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.070+0000 7fde90296640 1 -- 10.20.193.49:0/2209712610 >> 10.20.193.49:0/2209712610 conn(0x7fde880c9f20 msgr2=0x7fde880ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:37.076 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.070+0000 7fde90296640 1 -- 10.20.193.49:0/2209712610 shutdown_connections 2026-02-17T11:10:37.076 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.070+0000 7fde90296640 1 -- 10.20.193.49:0/2209712610 wait complete. 2026-02-17T11:10:37.076 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.071+0000 7fde90296640 10 monclient: build_initial_monmap 2026-02-17T11:10:37.076 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.071+0000 7fde90296640 10 monclient: monmap: 2026-02-17T11:10:37.076 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:37.076 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:37.077 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:37.077 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:37.077 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:37.077 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.077 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:37.077 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:37.077 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:37.077 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.077 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.071+0000 7fde90296640 1 librados: starting msgr at 2026-02-17T11:10:37.077 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.071+0000 7fde90296640 1 librados: starting objecter 2026-02-17T11:10:37.077 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.071+0000 7fde90296640 1 Processor -- start 2026-02-17T11:10:37.077 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.071+0000 7fde90296640 1 -- start start 2026-02-17T11:10:37.077 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.071+0000 7fde90296640 1 librados: setting wanted keys 2026-02-17T11:10:37.077 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.071+0000 7fde90296640 1 librados: calling monclient init 2026-02-17T11:10:37.078 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.071+0000 7fde90296640 10 monclient: init 2026-02-17T11:10:37.078 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.071+0000 7fde90296640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:37.078 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.071+0000 7fde90296640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:10:37.078 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.071+0000 7fde90296640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fde8814f280 0x7fde881f4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.078 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.071+0000 7fde90296640 10 monclient(hunting): picked mon.noname-c con 0x7fde8814f280 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:37.078 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.071+0000 7fde90296640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fde8814f660 0x7fde8814d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.078 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.071+0000 7fde90296640 10 monclient(hunting): picked mon.noname-a con 0x7fde8814f660 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:37.078 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.071+0000 7fde90296640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fde8815abc0 0x7fde88148b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.078 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.071+0000 7fde90296640 10 monclient(hunting): picked mon.noname-b con 0x7fde8815abc0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:37.078 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.071+0000 7fde90296640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.078 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.071+0000 7fde90296640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fde8815a730 con 0x7fde8814f660 2026-02-17T11:10:37.078 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.071+0000 7fde90296640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.078 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.071+0000 7fde90296640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fde880c8530 con 0x7fde8815abc0 2026-02-17T11:10:37.078 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.071+0000 7fde90296640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.078 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.071+0000 7fde90296640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fde8815a3c0 con 0x7fde8814f280 2026-02-17T11:10:37.078 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.071+0000 7fde90296640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:37.079 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.071+0000 7fde90296640 10 monclient(hunting): authenticate will time out at 1113.734971s 2026-02-17T11:10:37.079 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.072+0000 7fde8d80a640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fde8814f660 0x7fde8814d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:37.079 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.072+0000 7fde8d80a640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fde8814f660 0x7fde8814d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:33420/0 (socket says 10.20.193.49:33420) 2026-02-17T11:10:37.079 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.072+0000 7fde8d80a640 1 -- 10.20.193.49:0/174857959 learned_addr learned my addr 10.20.193.49:0/174857959 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:37.079 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.072+0000 7fde8d80a640 10 monclient(hunting): get_auth_request con 0x7fde8814f660 auth_method 0 2026-02-17T11:10:37.079 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.072+0000 7fde8d80a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:37.079 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.072+0000 7fde8d80a640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:37.079 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.072+0000 7fde8d80a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:37.079 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.072+0000 7fde8d80a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:37.079 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.072+0000 7fde8d80a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:37.079 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.072+0000 7fde8d80a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:37.081 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.074+0000 7fde8d80a640 10 monclient(hunting): handle_auth_done global_id 4539 payload 824 2026-02-17T11:10:37.081 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.074+0000 7fde8d80a640 1 -- 10.20.193.49:0/174857959 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fde8814f280 msgr2=0x7fde881f4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.081 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.074+0000 7fde8d80a640 1 --2- 10.20.193.49:0/174857959 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fde8814f280 0x7fde881f4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.081 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.074+0000 7fde8d80a640 1 -- 10.20.193.49:0/174857959 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fde8815abc0 msgr2=0x7fde88148b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.081 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.074+0000 7fde8d80a640 1 --2- 10.20.193.49:0/174857959 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fde8815abc0 0x7fde88148b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.081 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.074+0000 7fde8d80a640 10 monclient: _finish_hunting 0 2026-02-17T11:10:37.081 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.074+0000 7fde8d80a640 1 monclient: found mon.noname-a 2026-02-17T11:10:37.081 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.074+0000 7fde8d80a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:37.081 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.074+0000 7fde8d80a640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:10:37.081 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.074+0000 7fde8d80a640 1 -- 10.20.193.49:0/174857959 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde8806e050 con 0x7fde8814f660 2026-02-17T11:10:37.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.075+0000 7fde8d80a640 1 --2- 10.20.193.49:0/174857959 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fde8814f660 0x7fde8814d540 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fde7c00b5a0 tx=0x7fde7c00ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:37.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.075+0000 7fde6effd640 10 client.?.objecter ms_handle_connect 0x7fde8814f660 2026-02-17T11:10:37.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.075+0000 7fde6effd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:37.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.077+0000 7fde6effd640 1 -- 10.20.193.49:0/174857959 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7c012070 con 0x7fde8814f660 2026-02-17T11:10:37.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.077+0000 7fde6effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:37.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.077+0000 7fde6effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:10:37.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.077+0000 7fde6effd640 10 monclient: dump: 2026-02-17T11:10:37.082 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:37.082 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.082 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.082 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.082 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:37.082 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.082 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:37.082 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:37.082 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:37.082 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.077+0000 7fde6effd640 10 monclient: _finish_auth 0 2026-02-17T11:10:37.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.077+0000 7fde6effd640 10 monclient: _check_auth_tickets 2026-02-17T11:10:37.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.077+0000 7fde6effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:37.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.077+0000 7fde6effd640 1 -- 10.20.193.49:0/174857959 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde7c0044a0 con 0x7fde8814f660 2026-02-17T11:10:37.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.077+0000 7fde90296640 5 monclient: authenticate success, global_id 4539 2026-02-17T11:10:37.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.077+0000 7fde6effd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:37.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.077+0000 7fde6effd640 1 -- 10.20.193.49:0/174857959 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7c0029c0 con 0x7fde8814f660 2026-02-17T11:10:37.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.077+0000 7fde6effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:37.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.077+0000 7fde6effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:10:37.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.077+0000 7fde6effd640 10 monclient: dump: 2026-02-17T11:10:37.083 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:37.083 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.083 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.083 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.083 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:37.083 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.083 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:37.083 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:37.084 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:37.084 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.084 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.077+0000 7fde90296640 10 monclient: _renew_subs 2026-02-17T11:10:37.084 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.077+0000 7fde8c808640 4 set_mon_vals no callback set 2026-02-17T11:10:37.084 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.077+0000 7fde90296640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:37.084 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.077+0000 7fde90296640 1 -- 10.20.193.49:0/174857959 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde8806e330 con 0x7fde8814f660 2026-02-17T11:10:37.084 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.077+0000 7fde90296640 10 client.4539.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:37.084 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.077+0000 7fde90296640 10 monclient: _renew_subs 2026-02-17T11:10:37.084 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.077+0000 7fde90296640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:37.084 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.077+0000 7fde90296640 1 -- 10.20.193.49:0/174857959 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde8806e8f0 con 0x7fde8814f660 2026-02-17T11:10:37.084 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.077+0000 7fde90296640 1 librados: init done 2026-02-17T11:10:37.084 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.077+0000 7fde90296640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:37.084 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.077+0000 7fde90296640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:37.084 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.077+0000 7fde90296640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:37.084 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.077+0000 7fde90296640 1 -- 10.20.193.49:0/174857959 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde880c9b70 con 0x7fde8814f660 2026-02-17T11:10:37.086 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.079+0000 7f39cc8e1640 10 monclient: get_monmap_and_config 2026-02-17T11:10:37.086 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.079+0000 7f39cc8e1640 10 monclient: build_initial_monmap 2026-02-17T11:10:37.086 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.079+0000 7f39cc8e1640 10 monclient: monmap: 2026-02-17T11:10:37.086 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:37.086 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.086 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:37.080412+0000 2026-02-17T11:10:37.086 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:37.080412+0000 2026-02-17T11:10:37.086 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:37.086 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.086 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:37.086 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:37.086 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:37.086 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:37.086 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:37.087 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:37.087 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.080+0000 7f39cc8e1640 1 Processor -- start 2026-02-17T11:10:37.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.080+0000 7f39cc8e1640 1 -- start start 2026-02-17T11:10:37.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.080+0000 7f39cc8e1640 10 monclient: init 2026-02-17T11:10:37.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.080+0000 7f39cc8e1640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:37.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.080+0000 7f39cc8e1640 10 monclient: _add_conns ranks=[2,0,5,4,1,3] 2026-02-17T11:10:37.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.080+0000 7f39cc8e1640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f39c40686b0 addr v1:10.20.193.157:6789/0 2026-02-17T11:10:37.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.080+0000 7f39cc8e1640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f39c406f700 addr v1:10.20.193.49:6789/0 2026-02-17T11:10:37.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.080+0000 7f39cc8e1640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f39c41561f0 0x7f39c4068a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.080+0000 7f39cc8e1640 10 monclient(hunting): picked mon.noname-c con 0x7f39c41561f0 addr v2:10.20.193.157:3300/0 2026-02-17T11:10:37.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.080+0000 7f39cc8e1640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39c415cd30 con 0x7f39c406f700 2026-02-17T11:10:37.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.080+0000 7f39cc8e1640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39c415c490 con 0x7f39c40686b0 2026-02-17T11:10:37.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.080+0000 7f39cc8e1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.080+0000 7f39cc8e1640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f39c415c770 con 0x7f39c41561f0 2026-02-17T11:10:37.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.080+0000 7f39cc8e1640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:37.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.080+0000 7f39cc8e1640 10 monclient(hunting): authenticate will time out at 1113.743957s 2026-02-17T11:10:37.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.081+0000 7fb3abc91640 10 monclient: get_monmap_and_config 2026-02-17T11:10:37.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.081+0000 7fb3abc91640 10 monclient: build_initial_monmap 2026-02-17T11:10:37.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.081+0000 7fb3abc91640 10 monclient: monmap: 2026-02-17T11:10:37.089 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:37.089 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.089 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:37.081707+0000 2026-02-17T11:10:37.089 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:37.081707+0000 2026-02-17T11:10:37.089 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:37.089 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.089 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:37.089 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:37.089 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:37.089 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:37.089 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:37.089 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:37.089 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.081+0000 7fb3abc91640 1 Processor -- start 2026-02-17T11:10:37.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.081+0000 7fb3abc91640 1 -- start start 2026-02-17T11:10:37.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.081+0000 7fb3abc91640 10 monclient: init 2026-02-17T11:10:37.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.082+0000 7fb3abc91640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:37.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.082+0000 7fb3abc91640 10 monclient: _add_conns ranks=[0,5,2,4,3,1] 2026-02-17T11:10:37.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.082+0000 7fb3abc91640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb3a40d1b60 addr v1:10.20.193.49:6789/0 2026-02-17T11:10:37.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.082+0000 7fb3abc91640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7fb3a40d1f40 0x7fb3a415c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.082+0000 7fb3abc91640 10 monclient(hunting): picked mon.noname-c con 0x7fb3a40d1f40 addr v2:10.20.193.157:3300/0 2026-02-17T11:10:37.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.082+0000 7fb3abc91640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fb3a415d950 addr v1:10.20.193.157:6789/0 2026-02-17T11:10:37.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.082+0000 7fb3abc91640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3a40c98e0 con 0x7fb3a40d1b60 2026-02-17T11:10:37.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.082+0000 7fb3abc91640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3a40c9bc0 con 0x7fb3a415d950 2026-02-17T11:10:37.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.082+0000 7fb3abc91640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.082+0000 7fb3abc91640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7fb3a415cd80 con 0x7fb3a40d1f40 2026-02-17T11:10:37.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.082+0000 7fb3abc91640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:37.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.082+0000 7fb3abc91640 10 monclient(hunting): authenticate will time out at 1113.745194s 2026-02-17T11:10:37.091 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.090+0000 7fde6effd640 1 -- 10.20.193.49:0/174857959 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7fde7c021480 con 0x7fde8814f660 2026-02-17T11:10:37.091 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.090+0000 7fde6effd640 1 --2- 10.20.193.49:0/174857959 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fde58079170 0x7fde5807b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.092 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.090+0000 7fde8e00b640 1 --2- 10.20.193.49:0/174857959 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fde58079170 0x7fde5807b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:37.092 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.090+0000 7fde8e00b640 10 monclient: get_auth_request con 0x7fde58079170 auth_method 0 2026-02-17T11:10:37.092 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.091+0000 7fde6effd640 10 client.4539.objecter ms_handle_connect 0x7fde58079170 2026-02-17T11:10:37.092 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.091+0000 7fde8e00b640 1 --2- 10.20.193.49:0/174857959 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fde58079170 0x7fde5807b630 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fde78007fd0 tx=0x7fde78007b40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:37.094 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:10:37.095 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.093+0000 7f31a88c4640 10 monclient: get_monmap_and_config 2026-02-17T11:10:37.095 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.093+0000 7f31a88c4640 10 monclient: build_initial_monmap 2026-02-17T11:10:37.095 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.093+0000 7f31a88c4640 10 monclient: monmap: 2026-02-17T11:10:37.095 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:37.095 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.095 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:37.094110+0000 2026-02-17T11:10:37.095 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:37.094110+0000 2026-02-17T11:10:37.095 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:37.095 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.095 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:37.095 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:37.095 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:37.095 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:37.095 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:37.095 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:37.095 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.096 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.093+0000 7fde6effd640 1 -- 10.20.193.49:0/174857959 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7fde7c004650 con 0x7fde8814f660 2026-02-17T11:10:37.096 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.093+0000 7fde6effd640 10 client.4539.objecter ms_dispatch2 0x7fde88000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:37.096 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.093+0000 7fde6effd640 3 client.4539.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:37.096 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.093+0000 7fde6effd640 3 client.4539.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:37.096 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.093+0000 7fde6effd640 20 client.4539.objecter dump_active .. 0 homeless 2026-02-17T11:10:37.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.094+0000 7f31a88c4640 1 Processor -- start 2026-02-17T11:10:37.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.094+0000 7f31a88c4640 1 -- start start 2026-02-17T11:10:37.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.094+0000 7f31a88c4640 10 monclient: init 2026-02-17T11:10:37.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.094+0000 7fb9b0e76640 10 monclient: get_monmap_and_config 2026-02-17T11:10:37.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.094+0000 7fb9b0e76640 10 monclient: build_initial_monmap 2026-02-17T11:10:37.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.094+0000 7fb9b0e76640 10 monclient: monmap: 2026-02-17T11:10:37.097 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:37.097 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.097 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:37.095204+0000 2026-02-17T11:10:37.097 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:37.095204+0000 2026-02-17T11:10:37.098 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:37.098 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.098 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:37.098 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:37.098 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:37.098 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:37.098 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:37.098 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:37.098 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.098 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.095+0000 7f31a88c4640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:37.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.095+0000 7f31a88c4640 10 monclient: _add_conns ranks=[2,1,4,5,0,3] 2026-02-17T11:10:37.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.095+0000 7f31a88c4640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f31a00ce5d0 addr v1:10.20.193.157:6789/0 2026-02-17T11:10:37.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.095+0000 7f31a88c4640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f31a015bf30 addr v1:10.20.193.97:6789/0 2026-02-17T11:10:37.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.095+0000 7f31a88c4640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f31a00c9780 0x7f31a00c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.095+0000 7f31a88c4640 10 monclient(hunting): picked mon.noname-b con 0x7f31a00c9780 addr v2:10.20.193.97:3300/0 2026-02-17T11:10:37.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.095+0000 7f31a88c4640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31a00d20d0 con 0x7f31a015bf30 2026-02-17T11:10:37.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.095+0000 7f31a88c4640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31a00d23b0 con 0x7f31a00ce5d0 2026-02-17T11:10:37.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.095+0000 7f31a88c4640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.095+0000 7f31a88c4640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f31a00d2690 con 0x7f31a00c9780 2026-02-17T11:10:37.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.095+0000 7f31a88c4640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:37.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.095+0000 7f31a88c4640 10 monclient(hunting): authenticate will time out at 1113.758194s 2026-02-17T11:10:37.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.095+0000 7fb9b0e76640 1 Processor -- start 2026-02-17T11:10:37.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.095+0000 7fb9b0e76640 1 -- start start 2026-02-17T11:10:37.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.095+0000 7fb9b0e76640 10 monclient: init 2026-02-17T11:10:37.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.095+0000 7fb9b0e76640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:37.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.095+0000 7fb9b0e76640 10 monclient: _add_conns ranks=[3,0,4,5,2,1] 2026-02-17T11:10:37.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.095+0000 7fb9b0e76640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fb9ac0d1b60 0x7fb9ac0d1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.095+0000 7fb9b0e76640 10 monclient(hunting): picked mon.noname-a con 0x7fb9ac0d1b60 addr v2:10.20.193.49:3300/0 2026-02-17T11:10:37.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.095+0000 7fb9b0e76640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb9ac15c840 addr v1:10.20.193.49:6789/0 2026-02-17T11:10:37.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.095+0000 7fb9b0e76640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7fb9ac15d950 0x7fb9ac15dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.095+0000 7fb9b0e76640 10 monclient(hunting): picked mon.noname-b con 0x7fb9ac15d950 addr v2:10.20.193.97:3300/0 2026-02-17T11:10:37.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.095+0000 7fb9b0e76640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9ac15e2d0 con 0x7fb9ac15c840 2026-02-17T11:10:37.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.095+0000 7fb9b0e76640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.095+0000 7fb9b0e76640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7fb9ac0ca460 con 0x7fb9ac0d1b60 2026-02-17T11:10:37.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.095+0000 7fb9b0e76640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.095+0000 7fb9b0e76640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7fb9ac15d4c0 con 0x7fb9ac15d950 2026-02-17T11:10:37.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.095+0000 7fb9b0e76640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:37.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.095+0000 7fb9b0e76640 10 monclient(hunting): authenticate will time out at 1113.758993s 2026-02-17T11:10:37.114 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2026-02-17T11:10:37.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.112+0000 7f5677afa640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 6}] 2026-02-17T11:10:37.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.112+0000 7f5677afa640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2026-02-17T11:10:37.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.112+0000 7f5677afa640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:37.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.112+0000 7f5677afa640 1 -- 10.20.193.49:0/535311151 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f5670152c10 con 0x7f56700c9780 2026-02-17T11:10:37.115 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-17T11:10:37.118 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.116+0000 7f7801b72640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-17T11:10:37.118 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.116+0000 7f7801b72640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-17T11:10:37.118 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.116+0000 7f7801b72640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:37.118 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.116+0000 7f7801b72640 1 -- 10.20.193.49:0/2213070188 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f77fc0ccb50 con 0x7f77fc0c7170 2026-02-17T11:10:37.132 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.10 2026-02-17T11:10:37.133 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.132+0000 7f0dc2ffd640 1 -- 10.20.193.49:0/3656177287 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f0dd003f050 con 0x7f0ddc0ccc00 2026-02-17T11:10:37.133 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.132+0000 7f0dc2ffd640 1 --2- 10.20.193.49:0/3656177287 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0dac079190 0x7f0dac07b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.135 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.132+0000 7f0de23b0640 1 --2- 10.20.193.49:0/3656177287 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0dac079190 0x7f0dac07b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:37.135 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.132+0000 7f0de23b0640 10 monclient: get_auth_request con 0x7f0dac079190 auth_method 0 2026-02-17T11:10:37.136 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.133+0000 7f0dc2ffd640 10 client.4526.objecter ms_handle_connect 0x7f0dac079190 2026-02-17T11:10:37.136 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.133+0000 7f0de23b0640 1 --2- 10.20.193.49:0/3656177287 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0dac079190 0x7f0dac07b650 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc159980 tx=0x7f0dcc009110 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:37.136 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.133+0000 7f0dc2ffd640 1 -- 10.20.193.49:0/3656177287 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7f0dd0030d10 con 0x7f0ddc0ccc00 2026-02-17T11:10:37.136 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.133+0000 7f0dc2ffd640 10 client.4526.objecter ms_dispatch2 0x7f0ddc000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:37.136 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.133+0000 7f0dc2ffd640 3 client.4526.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:37.136 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.133+0000 7f0dc2ffd640 3 client.4526.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:37.136 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.134+0000 7f0dc2ffd640 20 client.4526.objecter dump_active .. 0 homeless 2026-02-17T11:10:37.141 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.140+0000 7f0dc2ffd640 1 -- 10.20.193.49:0/3656177287 <== mon.2 v2:10.20.193.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f0ddc06f640 con 0x7f0ddc0ccc00 2026-02-17T11:10:37.141 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.140+0000 7f0dc2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:37.142 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.140+0000 7f0dc2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:37.144 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.143+0000 7f565e7fc640 1 -- 10.20.193.49:0/535311151 <== mon.2 v2:10.20.193.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f5660087a40 con 0x7f56700c9780 2026-02-17T11:10:37.144 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.143+0000 7f565e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2026-02-17T11:10:37.144 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.143+0000 7f565e7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:37.144 INFO:teuthology.orchestra.run.trial049.stdout:115964116997 2026-02-17T11:10:37.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.145+0000 7f5677afa640 10 librados: watch_flush enter 2026-02-17T11:10:37.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.145+0000 7f5677afa640 10 librados: watch_flush exit 2026-02-17T11:10:37.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.145+0000 7f5677afa640 20 client.4523.objecter shutdown clearing up homeless session... 2026-02-17T11:10:37.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.145+0000 7f5677afa640 10 client.4523.objecter successfully canceled tick 2026-02-17T11:10:37.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.145+0000 7f5677afa640 1 -- 10.20.193.49:0/535311151 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5640079190 msgr2=0x7f564007b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.145+0000 7f5677afa640 1 --2- 10.20.193.49:0/535311151 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5640079190 0x7f564007b650 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f56700d1730 tx=0x7f5664009040 comp rx=0 tx=0).stop 2026-02-17T11:10:37.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.145+0000 7f5677afa640 10 monclient: shutdown 2026-02-17T11:10:37.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.145+0000 7f5677afa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:37.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.145+0000 7f5677afa640 1 -- 10.20.193.49:0/535311151 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f56700c9780 msgr2=0x7f56700d1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.145+0000 7f5677afa640 1 --2- 10.20.193.49:0/535311151 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f56700c9780 0x7f56700d1780 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5660009a70 tx=0x7f56600047c0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.145+0000 7f5677afa640 1 -- 10.20.193.49:0/535311151 shutdown_connections 2026-02-17T11:10:37.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.145+0000 7f5677afa640 1 --2- 10.20.193.49:0/535311151 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5640079190 0x7f564007b650 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.145+0000 7f5677afa640 1 --2- 10.20.193.49:0/535311151 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f567015bf30 0x7f56701f45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.145+0000 7f5677afa640 1 --2- 10.20.193.49:0/535311151 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f56700ce5d0 0x7f567015d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.145+0000 7f5677afa640 1 --2- 10.20.193.49:0/535311151 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f56700c9780 0x7f56700d1780 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.145+0000 7f5677afa640 1 -- 10.20.193.49:0/535311151 >> 10.20.193.49:0/535311151 conn(0x7f5670073030 msgr2=0x7f5670154990 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:37.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.145+0000 7f5677afa640 1 -- 10.20.193.49:0/535311151 shutdown_connections 2026-02-17T11:10:37.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.145+0000 7f5677afa640 1 -- 10.20.193.49:0/535311151 wait complete. 2026-02-17T11:10:37.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.145+0000 7f5677afa640 1 librados: shutdown 2026-02-17T11:10:37.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.145+0000 7fb3a9205640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7fb3a40d1f40 0x7fb3a415c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:37.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.146+0000 7fb3a9205640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7fb3a40d1f40 0x7fb3a415c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:48218/0 (socket says 10.20.193.49:48218) 2026-02-17T11:10:37.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.146+0000 7fb3a9205640 1 -- 10.20.193.49:0/3705465221 learned_addr learned my addr 10.20.193.49:0/3705465221 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:37.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.146+0000 7fb3a9205640 10 monclient(hunting): get_auth_request con 0x7fb3a40d1f40 auth_method 0 2026-02-17T11:10:37.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.146+0000 7fb3a9205640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:37.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.146+0000 7fb3a9205640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:37.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.146+0000 7fb3a9205640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:37.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.146+0000 7f39cae57640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f39c41561f0 0x7f39c4068a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:37.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.147+0000 7fb3a9205640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:37.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.147+0000 7fb3a9205640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:37.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.147+0000 7fb3a9205640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:37.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.147+0000 7f39cae57640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f39c41561f0 0x7f39c4068a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:48214/0 (socket says 10.20.193.49:48214) 2026-02-17T11:10:37.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.147+0000 7f39cae57640 1 -- 10.20.193.49:0/4121854922 learned_addr learned my addr 10.20.193.49:0/4121854922 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:37.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.147+0000 7f39cae57640 10 monclient(hunting): get_auth_request con 0x7f39c41561f0 auth_method 0 2026-02-17T11:10:37.151 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.147+0000 7f39cae57640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:37.151 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.147+0000 7f39cae57640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:37.151 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.147+0000 7f39cae57640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:37.151 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.148+0000 7fb3a9205640 10 monclient(hunting): handle_auth_done global_id 4529 payload 274 2026-02-17T11:10:37.151 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.148+0000 7fb3a9205640 1 -- 10.20.193.49:0/3705465221 >> v1:10.20.193.157:6789/0 conn(0x7fb3a415d950 legacy=0x7fb3a415dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:37.151 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.148+0000 7fb3a9205640 1 -- 10.20.193.49:0/3705465221 >> v1:10.20.193.49:6789/0 conn(0x7fb3a40d1b60 legacy=0x7fb3a40c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:37.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.148+0000 7fb3a9205640 10 monclient: _finish_hunting 0 2026-02-17T11:10:37.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.148+0000 7fb3a9205640 1 monclient: found mon.noname-c 2026-02-17T11:10:37.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.148+0000 7fb3a9205640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:37.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.148+0000 7fb3a9205640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:10:37.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.148+0000 7fb3a9205640 1 -- 10.20.193.49:0/3705465221 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3a40c9ea0 con 0x7fb3a40d1f40 2026-02-17T11:10:37.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.148+0000 7f39cae57640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:37.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.148+0000 7f39cae57640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:37.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.148+0000 7f39cae57640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:37.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.150+0000 7f39cae57640 10 monclient(hunting): handle_auth_done global_id 4532 payload 274 2026-02-17T11:10:37.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.150+0000 7f39cae57640 1 -- 10.20.193.49:0/4121854922 >> v1:10.20.193.157:6789/0 conn(0x7f39c40686b0 legacy=0x7f39c406eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:37.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.150+0000 7f39cae57640 1 -- 10.20.193.49:0/4121854922 >> v1:10.20.193.49:6789/0 conn(0x7f39c406f700 legacy=0x7f39c4155ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:37.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.150+0000 7f39cae57640 10 monclient: _finish_hunting 0 2026-02-17T11:10:37.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.150+0000 7f39cae57640 1 monclient: found mon.noname-c 2026-02-17T11:10:37.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.150+0000 7f39cae57640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:37.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.150+0000 7f39cae57640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:10:37.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.150+0000 7f39cae57640 1 -- 10.20.193.49:0/4121854922 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39c415ca50 con 0x7f39c41561f0 2026-02-17T11:10:37.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.151+0000 7fb3a9205640 1 --2- 10.20.193.49:0/3705465221 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb3a40d1f40 0x7fb3a415c840 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb398009970 tx=0x7fb39802eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=511c3beee4d5f9e2 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:37.154 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.152+0000 7f39cae57640 1 --2- 10.20.193.49:0/4121854922 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f39c41561f0 0x7f39c4068a90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f39b8009e50 tx=0x7f39b802f2a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a9d51673221db5f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:37.156 INFO:tasks.ceph.ceph_manager.ceph:need seq 115964116998 got 115964116997 for osd.6 2026-02-17T11:10:37.156 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.155+0000 7f31a6639640 1 --1- >> v1:10.20.193.157:6789/0 conn(0x7f31a00ce5d0 0x7f31a00d18c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.157:6789/0 says I am v1:10.20.193.49:52956/0 (socket says 10.20.193.49:52956) 2026-02-17T11:10:37.156 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.155+0000 7f31a6639640 1 -- 10.20.193.49:0/163656211 learned_addr learned my addr 10.20.193.49:0/163656211 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:10:37.158 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.156+0000 7fb3a8a04640 1 -- 10.20.193.49:0/3705465221 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39803c070 con 0x7fb3a40d1f40 2026-02-17T11:10:37.158 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.156+0000 7fb3a8a04640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:37.158 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.156+0000 7fb3a8a04640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:10:37.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.156+0000 7fb3a8a04640 10 monclient: dump: 2026-02-17T11:10:37.159 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:37.159 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.159 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.159 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.159 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:37.159 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.159 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:37.159 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:37.159 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:37.159 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.156+0000 7fb3a8a04640 10 monclient: _finish_auth 0 2026-02-17T11:10:37.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.156+0000 7fb3a8a04640 10 monclient: _check_auth_tickets 2026-02-17T11:10:37.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.156+0000 7fb3a8a04640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:37.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.156+0000 7fb3a8a04640 1 -- 10.20.193.49:0/3705465221 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb39802fb60 con 0x7fb3a40d1f40 2026-02-17T11:10:37.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.156+0000 7fb3a8a04640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:37.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.156+0000 7fb3a8a04640 1 -- 10.20.193.49:0/3705465221 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb398037440 con 0x7fb3a40d1f40 2026-02-17T11:10:37.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.156+0000 7fb3abc91640 5 monclient: authenticate success, global_id 4529 2026-02-17T11:10:37.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.156+0000 7fb3abc91640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:37.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.156+0000 7fb3abc91640 4 set_mon_vals no callback set 2026-02-17T11:10:37.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.156+0000 7fb3a8a04640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:37.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.156+0000 7fb3a8a04640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:10:37.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.156+0000 7fb3a8a04640 10 monclient: dump: 2026-02-17T11:10:37.160 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:37.160 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.160 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.160 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.160 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:37.160 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.160 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:37.161 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:37.161 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:37.161 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.161 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.157+0000 7fed04ff9640 1 -- 10.20.193.49:0/2151066935 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fecf4021020 con 0x7fed0814f280 2026-02-17T11:10:37.161 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.157+0000 7fed04ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:37.161 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.157+0000 7fed04ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:37.162 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.157+0000 7fb3abc91640 10 monclient: shutdown 2026-02-17T11:10:37.162 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.157+0000 7fb3abc91640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:37.162 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.157+0000 7fb3abc91640 1 -- 10.20.193.49:0/3705465221 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb3a40d1f40 msgr2=0x7fb3a415c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.162 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.157+0000 7fb3abc91640 1 --2- 10.20.193.49:0/3705465221 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb3a40d1f40 0x7fb3a415c840 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb398009970 tx=0x7fb39802eef0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.162 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.157+0000 7fb3abc91640 1 -- 10.20.193.49:0/3705465221 shutdown_connections 2026-02-17T11:10:37.163 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.157+0000 7fb3abc91640 1 --2- 10.20.193.49:0/3705465221 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb3a40d1f40 0x7fb3a415c840 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.163 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.157+0000 7fb3abc91640 1 -- 10.20.193.49:0/3705465221 >> 10.20.193.49:0/3705465221 conn(0x7fb3a406d9b0 msgr2=0x7fb3a406ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:37.163 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.157+0000 7fb3abc91640 1 -- 10.20.193.49:0/3705465221 shutdown_connections 2026-02-17T11:10:37.163 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.157+0000 7fb3abc91640 1 -- 10.20.193.49:0/3705465221 wait complete. 2026-02-17T11:10:37.163 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.157+0000 7f31a6e3a640 1 --2- 10.20.193.49:0/163656211 >> v2:10.20.193.97:3300/0 conn(0x7f31a00c9780 0x7f31a00c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:37.164 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.158+0000 7fb3abc91640 10 monclient: build_initial_monmap 2026-02-17T11:10:37.164 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.158+0000 7fb3abc91640 10 monclient: monmap: 2026-02-17T11:10:37.164 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:37.164 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:37.164 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:37.164 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:37.164 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:37.164 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.164 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:37.164 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:37.164 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:37.164 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.164 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.158+0000 7fb3abc91640 1 librados: starting msgr at 2026-02-17T11:10:37.164 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.158+0000 7fb3abc91640 1 librados: starting objecter 2026-02-17T11:10:37.165 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.158+0000 7fb3abc91640 1 Processor -- start 2026-02-17T11:10:37.165 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.158+0000 7fb3abc91640 1 -- start start 2026-02-17T11:10:37.165 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.158+0000 7fb3abc91640 1 librados: setting wanted keys 2026-02-17T11:10:37.165 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.158+0000 7fb3abc91640 1 librados: calling monclient init 2026-02-17T11:10:37.165 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.158+0000 7f39c9654640 1 -- 10.20.193.49:0/4121854922 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b802fd00 con 0x7f39c41561f0 2026-02-17T11:10:37.165 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.158+0000 7f39c9654640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:37.165 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.158+0000 7fb3abc91640 10 monclient: init 2026-02-17T11:10:37.166 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.158+0000 7f39c9654640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:10:37.166 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.158+0000 7f39c9654640 10 monclient: dump: 2026-02-17T11:10:37.166 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:37.166 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.166 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.166 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.166 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:37.167 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.167 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:37.167 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:37.167 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:37.167 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.167 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.158+0000 7f39c9654640 10 monclient: _finish_auth 0 2026-02-17T11:10:37.167 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.158+0000 7f39c9654640 10 monclient: _check_auth_tickets 2026-02-17T11:10:37.167 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.158+0000 7f39c9654640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:37.167 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.158+0000 7f39c9654640 1 -- 10.20.193.49:0/4121854922 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39b80373f0 con 0x7f39c41561f0 2026-02-17T11:10:37.167 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.158+0000 7f39c9654640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:37.167 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.158+0000 7f39c9654640 1 -- 10.20.193.49:0/4121854922 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b80377c0 con 0x7f39c41561f0 2026-02-17T11:10:37.167 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.158+0000 7f39c9654640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:37.167 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.158+0000 7f39c9654640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:10:37.167 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.158+0000 7f39c9654640 10 monclient: dump: 2026-02-17T11:10:37.167 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:37.167 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.167 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.168 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.168 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:37.168 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.168 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:37.168 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:37.168 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:37.168 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.168 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.158+0000 7f39cc8e1640 5 monclient: authenticate success, global_id 4532 2026-02-17T11:10:37.168 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.158+0000 7f39cc8e1640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:37.168 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.158+0000 7f39cc8e1640 4 set_mon_vals no callback set 2026-02-17T11:10:37.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.158+0000 7f31a6e3a640 10 monclient(hunting): get_auth_request con 0x7f31a00c9780 auth_method 0 2026-02-17T11:10:37.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.158+0000 7f31a6e3a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:37.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.158+0000 7f31a6e3a640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:37.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.158+0000 7f31a6e3a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:37.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.158+0000 7f31a5637640 1 -- 10.20.193.49:0/163656211 <== mon.2 v1:10.20.193.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 561502340 0 0) 0x7f31a00d23b0 con 0x7f31a00ce5d0 2026-02-17T11:10:37.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.158+0000 7f31a5637640 10 monclient(hunting): _negotiate 2026-02-17T11:10:37.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.158+0000 7f31a5637640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:37.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.158+0000 7f31a5637640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:37.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.158+0000 7f31a5637640 10 monclient(hunting): my global_id is 4535 2026-02-17T11:10:37.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.158+0000 7f31a5637640 1 -- 10.20.193.49:0/163656211 --> v1:10.20.193.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3190003620 con 0x7f31a00ce5d0 2026-02-17T11:10:37.170 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.158+0000 7fb9aad76640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7fb9ac15d950 0x7fb9ac15dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:37.170 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.159+0000 7fb3abc91640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:37.170 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.159+0000 7fb3abc91640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:10:37.170 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.159+0000 7fb3abc91640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb3a40d1b60 0x7fb3a4147d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.170 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.159+0000 7f39cc8e1640 10 monclient: shutdown 2026-02-17T11:10:37.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.159+0000 7f39cc8e1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:37.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.159+0000 7f39cc8e1640 1 -- 10.20.193.49:0/4121854922 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f39c41561f0 msgr2=0x7f39c4068a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.159+0000 7f39cc8e1640 1 --2- 10.20.193.49:0/4121854922 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f39c41561f0 0x7f39c4068a90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f39b8009e50 tx=0x7f39b802f2a0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.159+0000 7fb3abc91640 10 monclient(hunting): picked mon.noname-b con 0x7fb3a40d1b60 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:37.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.159+0000 7fb3abc91640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb3a40d1f40 0x7fb3a40cd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.159+0000 7fb3abc91640 10 monclient(hunting): picked mon.noname-a con 0x7fb3a40d1f40 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:37.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.159+0000 7fb3abc91640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb3a415d950 0x7fb3a40cda20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.159+0000 7fb3abc91640 10 monclient(hunting): picked mon.noname-c con 0x7fb3a415d950 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:37.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.159+0000 7fb3abc91640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.159+0000 7fb3abc91640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a415d4c0 con 0x7fb3a40d1f40 2026-02-17T11:10:37.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.159+0000 7fb3abc91640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.159+0000 7fb3abc91640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a40ca460 con 0x7fb3a40d1b60 2026-02-17T11:10:37.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.159+0000 7fb3abc91640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.159+0000 7fb3abc91640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a406e7b0 con 0x7fb3a415d950 2026-02-17T11:10:37.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.159+0000 7fb3abc91640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:37.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.159+0000 7fb3abc91640 10 monclient(hunting): authenticate will time out at 1113.822171s 2026-02-17T11:10:37.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.159+0000 7f39cc8e1640 1 -- 10.20.193.49:0/4121854922 shutdown_connections 2026-02-17T11:10:37.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.159+0000 7f39cc8e1640 1 --2- 10.20.193.49:0/4121854922 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f39c41561f0 0x7f39c4068a90 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.159+0000 7f39cc8e1640 1 -- 10.20.193.49:0/4121854922 >> 10.20.193.49:0/4121854922 conn(0x7f39c40cb3a0 msgr2=0x7f39c40cb7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:37.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.159+0000 7f39cc8e1640 1 -- 10.20.193.49:0/4121854922 shutdown_connections 2026-02-17T11:10:37.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.159+0000 7f39cc8e1640 1 -- 10.20.193.49:0/4121854922 wait complete. 2026-02-17T11:10:37.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.159+0000 7f31a6e3a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:37.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.159+0000 7f31a6e3a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:37.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.159+0000 7f31a6e3a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:37.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.159+0000 7fb9aad76640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7fb9ac15d950 0x7fb9ac15dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:55506/0 (socket says 10.20.193.49:55506) 2026-02-17T11:10:37.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.159+0000 7fb9aad76640 1 -- 10.20.193.49:0/3136774077 learned_addr learned my addr 10.20.193.49:0/3136774077 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:37.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.159+0000 7fb9aad76640 10 monclient(hunting): get_auth_request con 0x7fb9ac15d950 auth_method 0 2026-02-17T11:10:37.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.159+0000 7fb9aad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:37.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.159+0000 7fb9aad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:37.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.159+0000 7fb9aad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:37.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.159+0000 7f39cc8e1640 10 monclient: build_initial_monmap 2026-02-17T11:10:37.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.159+0000 7f39cc8e1640 10 monclient: monmap: 2026-02-17T11:10:37.174 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:37.174 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:37.175 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:37.175 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:37.175 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:37.175 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.175 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:37.175 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:37.175 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:37.175 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.175 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.160+0000 7f39cc8e1640 1 librados: starting msgr at 2026-02-17T11:10:37.175 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.160+0000 7f39cc8e1640 1 librados: starting objecter 2026-02-17T11:10:37.175 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.160+0000 7f39cc8e1640 1 Processor -- start 2026-02-17T11:10:37.175 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.160+0000 7f39cc8e1640 1 -- start start 2026-02-17T11:10:37.175 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.160+0000 7f39cc8e1640 1 librados: setting wanted keys 2026-02-17T11:10:37.175 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.160+0000 7f39cc8e1640 1 librados: calling monclient init 2026-02-17T11:10:37.175 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.160+0000 7f39cc8e1640 10 monclient: init 2026-02-17T11:10:37.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.160+0000 7f31a6e3a640 10 monclient(hunting): handle_auth_done global_id 4516 payload 274 2026-02-17T11:10:37.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.160+0000 7f31a6e3a640 1 -- 10.20.193.49:0/163656211 >> v1:10.20.193.157:6789/0 conn(0x7f31a00ce5d0 legacy=0x7f31a00d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.160+0000 7f31a6e3a640 1 -- 10.20.193.49:0/163656211 >> v1:10.20.193.97:6789/0 conn(0x7f31a015bf30 legacy=0x7f31a00ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:37.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.160+0000 7f31a6e3a640 10 monclient: _finish_hunting 0 2026-02-17T11:10:37.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.160+0000 7f31a6e3a640 1 monclient: found mon.noname-b 2026-02-17T11:10:37.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.160+0000 7f31a6e3a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:37.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.160+0000 7f31a6e3a640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:10:37.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.160+0000 7f31a6e3a640 1 -- 10.20.193.49:0/163656211 --> v2:10.20.193.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31a00c8f80 con 0x7f31a00c9780 2026-02-17T11:10:37.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.160+0000 7f39cc8e1640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:37.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.160+0000 7f39cc8e1640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:10:37.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.160+0000 7f5b187f7640 10 monclient: get_monmap_and_config 2026-02-17T11:10:37.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.160+0000 7f5b187f7640 10 monclient: build_initial_monmap 2026-02-17T11:10:37.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.160+0000 7f39cc8e1640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f39c40686b0 0x7f39c414ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.160+0000 7f5b187f7640 10 monclient: monmap: 2026-02-17T11:10:37.177 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:37.177 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.177 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:37.161172+0000 2026-02-17T11:10:37.177 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:37.161172+0000 2026-02-17T11:10:37.178 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:37.178 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.178 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:37.178 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:37.178 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:37.178 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:37.178 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:37.178 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:37.178 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.179 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.160+0000 7f39cc8e1640 10 monclient(hunting): picked mon.noname-a con 0x7f39c40686b0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:37.179 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.160+0000 7f39cc8e1640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f39c406f700 0x7f39c413ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.179 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.160+0000 7f39cc8e1640 10 monclient(hunting): picked mon.noname-b con 0x7f39c406f700 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:37.179 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.160+0000 7f39cc8e1640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f39c41561f0 0x7f39c4143ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.179 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.160+0000 7f39cc8e1640 10 monclient(hunting): picked mon.noname-c con 0x7f39c41561f0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:37.179 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.160+0000 7f39cc8e1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.179 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.160+0000 7f39cc8e1640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f39c415be30 con 0x7f39c40686b0 2026-02-17T11:10:37.179 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.160+0000 7f39cc8e1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.179 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.160+0000 7f39cc8e1640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f39c406ead0 con 0x7f39c406f700 2026-02-17T11:10:37.179 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.160+0000 7f39cc8e1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.179 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.160+0000 7f39cc8e1640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f39c415bfb0 con 0x7f39c41561f0 2026-02-17T11:10:37.179 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.160+0000 7f39cc8e1640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:37.180 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.160+0000 7f39cc8e1640 10 monclient(hunting): authenticate will time out at 1113.823830s 2026-02-17T11:10:37.180 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.161+0000 7f5b187f7640 1 Processor -- start 2026-02-17T11:10:37.180 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.161+0000 7f5b187f7640 1 -- start start 2026-02-17T11:10:37.180 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.161+0000 7f5b187f7640 10 monclient: init 2026-02-17T11:10:37.180 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.161+0000 7fb9aad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:37.180 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.161+0000 7fb9aad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:37.180 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.161+0000 7fb9aad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:37.181 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.161+0000 7fb3aa207640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb3a415d950 0x7fb3a40cda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:37.181 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.161+0000 7fb3aa207640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb3a415d950 0x7fb3a40cda20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:48220/0 (socket says 10.20.193.49:48220) 2026-02-17T11:10:37.181 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.161+0000 7fb3aa207640 1 -- 10.20.193.49:0/228728157 learned_addr learned my addr 10.20.193.49:0/228728157 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:37.181 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.161+0000 7fb3aa207640 10 monclient(hunting): get_auth_request con 0x7fb3a415d950 auth_method 0 2026-02-17T11:10:37.181 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.161+0000 7fb3aa207640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:37.181 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.161+0000 7fb3aa207640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:37.181 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.161+0000 7fb3aa207640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:37.181 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.161+0000 7f5b187f7640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:37.181 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.161+0000 7f5b187f7640 10 monclient: _add_conns ranks=[4,2,3,1,0,5] 2026-02-17T11:10:37.181 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.161+0000 7f39cae57640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f39c41561f0 0x7f39c4143ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:37.181 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.161+0000 7f5b187f7640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f5b100ce5d0 0x7f5b100d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.182 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.161+0000 7f5b187f7640 10 monclient(hunting): picked mon.noname-b con 0x7f5b100ce5d0 addr v2:10.20.193.97:3300/0 2026-02-17T11:10:37.182 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.161+0000 7fe16effd640 1 -- 10.20.193.49:0/1623861441 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe184066a90 con 0x7fe188153db0 2026-02-17T11:10:37.182 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.161+0000 7fe16effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-17T11:10:37.182 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.161+0000 7fe16effd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:37.182 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.161+0000 7f5b187f7640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f5b1015bf30 addr v1:10.20.193.157:6789/0 2026-02-17T11:10:37.182 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.161+0000 7f5b187f7640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f5b100c9780 0x7f5b100c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.182 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.161+0000 7f5b187f7640 10 monclient(hunting): picked mon.noname-a con 0x7f5b100c9780 addr v2:10.20.193.49:3300/0 2026-02-17T11:10:37.182 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.161+0000 7f5b187f7640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b100d1e00 con 0x7f5b1015bf30 2026-02-17T11:10:37.182 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.161+0000 7f5b187f7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.182 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.161+0000 7f5b187f7640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f5b100d20d0 con 0x7f5b100c9780 2026-02-17T11:10:37.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.161+0000 7f5b187f7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.161+0000 7f5b187f7640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f5b100d23b0 con 0x7f5b100ce5d0 2026-02-17T11:10:37.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.161+0000 7f5b187f7640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:37.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.161+0000 7f5b187f7640 10 monclient(hunting): authenticate will time out at 1113.824891s 2026-02-17T11:10:37.183 INFO:teuthology.orchestra.run.trial049.stdout:107374182405 2026-02-17T11:10:37.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.162+0000 7fb3aa207640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:37.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.162+0000 7fb3aa207640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:37.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.162+0000 7fb3aa207640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:37.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.162+0000 7f39cae57640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f39c41561f0 0x7f39c4143ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:48224/0 (socket says 10.20.193.49:48224) 2026-02-17T11:10:37.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.162+0000 7f39cae57640 1 -- 10.20.193.49:0/2243935134 learned_addr learned my addr 10.20.193.49:0/2243935134 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:37.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.162+0000 7f39cae57640 10 monclient(hunting): get_auth_request con 0x7f39c41561f0 auth_method 0 2026-02-17T11:10:37.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.162+0000 7f39cae57640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:37.184 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.162+0000 7f39cae57640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:37.184 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.162+0000 7f39cae57640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:37.184 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.162+0000 7fb9aad76640 10 monclient(hunting): handle_auth_done global_id 4519 payload 274 2026-02-17T11:10:37.184 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.162+0000 7fb9aad76640 1 -- 10.20.193.49:0/3136774077 >> v2:10.20.193.49:3300/0 conn(0x7fb9ac0d1b60 msgr2=0x7fb9ac0d1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:37.184 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.162+0000 7fb9aad76640 1 --2- 10.20.193.49:0/3136774077 >> v2:10.20.193.49:3300/0 conn(0x7fb9ac0d1b60 0x7fb9ac0d1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.184 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.162+0000 7fb9aad76640 1 -- 10.20.193.49:0/3136774077 >> v1:10.20.193.49:6789/0 conn(0x7fb9ac15c840 legacy=0x7fb9ac0c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:37.184 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.162+0000 7fb9aad76640 10 monclient: _finish_hunting 0 2026-02-17T11:10:37.184 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.162+0000 7fb9aad76640 1 monclient: found mon.noname-b 2026-02-17T11:10:37.184 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.162+0000 7fb9aad76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:37.184 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.162+0000 7fb9aad76640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:10:37.184 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.162+0000 7fb9aad76640 1 -- 10.20.193.49:0/3136774077 --> v2:10.20.193.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9ac0c98e0 con 0x7fb9ac15d950 2026-02-17T11:10:37.185 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.162+0000 7f31a6e3a640 1 --2- 10.20.193.49:0/163656211 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f31a00c9780 0x7f31a00c9b90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3194009d90 tx=0x7f319402f1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1656acb2cfa896d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:37.185 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.164+0000 7fe190664640 10 librados: watch_flush enter 2026-02-17T11:10:37.185 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.164+0000 7fe190664640 10 librados: watch_flush exit 2026-02-17T11:10:37.185 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.164+0000 7fe190664640 20 client.4510.objecter shutdown clearing up homeless session... 2026-02-17T11:10:37.185 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.164+0000 7fe190664640 10 client.4510.objecter successfully canceled tick 2026-02-17T11:10:37.185 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.164+0000 7fe190664640 1 -- 10.20.193.49:0/1623861441 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fe158079140 msgr2=0x7fe15807b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.185 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.164+0000 7fe190664640 1 --2- 10.20.193.49:0/1623861441 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fe158079140 0x7fe15807b600 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe1780091b0 tx=0x7fe178039040 comp rx=0 tx=0).stop 2026-02-17T11:10:37.185 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.164+0000 7fe190664640 10 monclient: shutdown 2026-02-17T11:10:37.185 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.164+0000 7fe190664640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:37.186 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.164+0000 7fb3aa207640 10 monclient(hunting): handle_auth_done global_id 4538 payload 824 2026-02-17T11:10:37.186 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.164+0000 7fe190664640 1 -- 10.20.193.49:0/1623861441 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe188153db0 msgr2=0x7fe1881f4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.186 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.164+0000 7fe190664640 1 --2- 10.20.193.49:0/1623861441 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe188153db0 0x7fe1881f4f00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe184003a40 tx=0x7fe18400cf80 comp rx=0 tx=0).stop 2026-02-17T11:10:37.186 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.164+0000 7fb3aa207640 1 -- 10.20.193.49:0/228728157 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb3a40d1b60 msgr2=0x7fb3a4147d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.186 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.164+0000 7fb3aa207640 1 --2- 10.20.193.49:0/228728157 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb3a40d1b60 0x7fb3a4147d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.186 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.164+0000 7fb3aa207640 1 -- 10.20.193.49:0/228728157 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb3a40d1f40 msgr2=0x7fb3a40cd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.186 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.164+0000 7fb3aa207640 1 --2- 10.20.193.49:0/228728157 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb3a40d1f40 0x7fb3a40cd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.186 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.164+0000 7fb3aa207640 10 monclient: _finish_hunting 0 2026-02-17T11:10:37.186 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.164+0000 7fb3aa207640 1 monclient: found mon.noname-c 2026-02-17T11:10:37.186 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.164+0000 7fb3aa207640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:37.187 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.164+0000 7fb3aa207640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:10:37.187 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.164+0000 7fb3aa207640 1 -- 10.20.193.49:0/228728157 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3a41f3f20 con 0x7fb3a415d950 2026-02-17T11:10:37.187 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.164+0000 7fe190664640 1 -- 10.20.193.49:0/1623861441 shutdown_connections 2026-02-17T11:10:37.187 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.164+0000 7fe190664640 1 --2- 10.20.193.49:0/1623861441 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fe158079140 0x7fe15807b600 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.187 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.164+0000 7fb9aad76640 1 --2- 10.20.193.49:0/3136774077 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb9ac15d950 0x7fb9ac15dd90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac0751e0 tx=0x7fb99c02f270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62beffa0c806b36d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:37.187 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.164+0000 7fe190664640 1 --2- 10.20.193.49:0/1623861441 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe188153db0 0x7fe1881f4f00 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.187 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.164+0000 7fe190664640 1 --2- 10.20.193.49:0/1623861441 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe1880ccc50 0x7fe18814f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.187 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.164+0000 7fe190664640 1 --2- 10.20.193.49:0/1623861441 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe1880c7a40 0x7fe1881f7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.187 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.164+0000 7fe190664640 1 -- 10.20.193.49:0/1623861441 >> 10.20.193.49:0/1623861441 conn(0x7fe1880cc130 msgr2=0x7fe18815d940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:37.187 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.164+0000 7fe190664640 1 -- 10.20.193.49:0/1623861441 shutdown_connections 2026-02-17T11:10:37.187 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.164+0000 7fe190664640 1 -- 10.20.193.49:0/1623861441 wait complete. 2026-02-17T11:10:37.188 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.164+0000 7fe190664640 1 librados: shutdown 2026-02-17T11:10:37.188 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.164+0000 7f39cae57640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:37.188 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.164+0000 7f39cae57640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:37.188 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.164+0000 7f39cae57640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:37.188 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.166+0000 7f39c9e55640 1 --2- 10.20.193.49:0/2243935134 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f39c406f700 0x7f39c413ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:37.188 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.167+0000 7f39c9e55640 10 monclient(hunting): get_auth_request con 0x7f39c406f700 auth_method 0 2026-02-17T11:10:37.188 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.167+0000 7f39c9e55640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:37.188 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.167+0000 7f39c9e55640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:37.188 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.167+0000 7f39c9e55640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:37.188 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.167+0000 7f39cae57640 10 monclient(hunting): handle_auth_done global_id 4541 payload 824 2026-02-17T11:10:37.188 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.167+0000 7f39cae57640 1 -- 10.20.193.49:0/2243935134 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f39c406f700 msgr2=0x7f39c413ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.188 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.167+0000 7f39cae57640 1 --2- 10.20.193.49:0/2243935134 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f39c406f700 0x7f39c413ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.188 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.167+0000 7f39cae57640 1 -- 10.20.193.49:0/2243935134 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f39c40686b0 msgr2=0x7f39c414ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.189 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.167+0000 7f39cae57640 1 --2- 10.20.193.49:0/2243935134 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f39c40686b0 0x7f39c414ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.189 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.167+0000 7f39cae57640 10 monclient: _finish_hunting 0 2026-02-17T11:10:37.189 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.167+0000 7f39cae57640 1 monclient: found mon.noname-c 2026-02-17T11:10:37.189 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.167+0000 7f39cae57640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:37.189 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.167+0000 7f39cae57640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:10:37.189 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.167+0000 7f39cae57640 1 -- 10.20.193.49:0/2243935134 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39c40cde20 con 0x7f39c41561f0 2026-02-17T11:10:37.189 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.167+0000 7fb3aa207640 1 --2- 10.20.193.49:0/228728157 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb3a415d950 0x7fb3a40cda20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb3a000cc10 tx=0x7fb3a000a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:37.189 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.167+0000 7fb3927fc640 10 client.?.objecter ms_handle_connect 0x7fb3a415d950 2026-02-17T11:10:37.189 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.167+0000 7fb3927fc640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:37.189 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.169+0000 7fb9a9573640 1 -- 10.20.193.49:0/3136774077 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb99c02fcd0 con 0x7fb9ac15d950 2026-02-17T11:10:37.189 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.169+0000 7fb9a9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:37.189 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.169+0000 7fb9a9573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:10:37.189 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.169+0000 7fb9a9573640 10 monclient: dump: 2026-02-17T11:10:37.189 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:37.190 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.190 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.190 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.190 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:37.190 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.190 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:37.190 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:37.190 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:37.190 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.190 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.169+0000 7fb9a9573640 10 monclient: _finish_auth 0 2026-02-17T11:10:37.190 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.169+0000 7fb9a9573640 10 monclient: _check_auth_tickets 2026-02-17T11:10:37.190 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.169+0000 7fb9a9573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:37.190 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.169+0000 7fb9a9573640 1 -- 10.20.193.49:0/3136774077 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb99c0373f0 con 0x7fb9ac15d950 2026-02-17T11:10:37.190 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.169+0000 7fb9a9573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:37.190 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.169+0000 7fb9a9573640 1 -- 10.20.193.49:0/3136774077 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb99c0377c0 con 0x7fb9ac15d950 2026-02-17T11:10:37.190 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.169+0000 7fb9b0e76640 5 monclient: authenticate success, global_id 4519 2026-02-17T11:10:37.190 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.169+0000 7fb9b0e76640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:37.190 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.169+0000 7fb9b0e76640 4 set_mon_vals no callback set 2026-02-17T11:10:37.190 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.169+0000 7fb9a9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:37.190 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.169+0000 7fb9a9573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:37.190 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.169+0000 7fb9a9573640 10 monclient: dump: 2026-02-17T11:10:37.190 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:37.190 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.190 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.190 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.190 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:37.190 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.191 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:37.191 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:37.191 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:37.191 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.191 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.169+0000 7f31a5637640 1 -- 10.20.193.49:0/163656211 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f319403c070 con 0x7f31a00c9780 2026-02-17T11:10:37.191 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.169+0000 7f31a5637640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:37.191 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.169+0000 7f31a5637640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:10:37.191 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.169+0000 7f31a5637640 10 monclient: dump: 2026-02-17T11:10:37.191 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:37.191 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.191 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.191 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.191 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:37.191 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.191 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:37.191 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:37.191 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:37.191 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.192 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.169+0000 7f31a5637640 10 monclient: _finish_auth 0 2026-02-17T11:10:37.192 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.169+0000 7f31a5637640 10 monclient: _check_auth_tickets 2026-02-17T11:10:37.192 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.169+0000 7f31a5637640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:37.192 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.169+0000 7f31a5637640 1 -- 10.20.193.49:0/163656211 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3194037440 con 0x7f31a00c9780 2026-02-17T11:10:37.192 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.169+0000 7f31a5637640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:37.192 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.169+0000 7f31a5637640 1 -- 10.20.193.49:0/163656211 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3194037810 con 0x7f31a00c9780 2026-02-17T11:10:37.192 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.169+0000 7f31a88c4640 5 monclient: authenticate success, global_id 4516 2026-02-17T11:10:37.192 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.169+0000 7f31a88c4640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:37.192 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.169+0000 7f31a88c4640 4 set_mon_vals no callback set 2026-02-17T11:10:37.192 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.169+0000 7f31a5637640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:37.192 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.169+0000 7f31a5637640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:37.192 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.169+0000 7f31a5637640 10 monclient: dump: 2026-02-17T11:10:37.192 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:37.192 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.192 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.192 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.192 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:37.192 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.192 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:37.192 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:37.192 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:37.192 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.192 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.169+0000 7f39cae57640 1 --2- 10.20.193.49:0/2243935134 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f39c41561f0 0x7f39c4143ff0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f39b8009e50 tx=0x7f39b8004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:37.193 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.169+0000 7f39aeffd640 10 client.?.objecter ms_handle_connect 0x7f39c41561f0 2026-02-17T11:10:37.193 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.169+0000 7f39aeffd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:37.193 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.169+0000 7f5b15d6b640 1 --1- >> v1:10.20.193.157:6789/0 conn(0x7f5b1015bf30 0x7f5b100ce9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.157:6789/0 says I am v1:10.20.193.49:52958/0 (socket says 10.20.193.49:52958) 2026-02-17T11:10:37.193 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.169+0000 7f5b15d6b640 1 -- 10.20.193.49:0/3581126632 learned_addr learned my addr 10.20.193.49:0/3581126632 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:10:37.193 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.169+0000 7fb9b0e76640 10 monclient: shutdown 2026-02-17T11:10:37.193 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.169+0000 7fb9b0e76640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:37.193 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.169+0000 7fb9b0e76640 1 -- 10.20.193.49:0/3136774077 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb9ac15d950 msgr2=0x7fb9ac15dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.193 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.169+0000 7fb9b0e76640 1 --2- 10.20.193.49:0/3136774077 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb9ac15d950 0x7fb9ac15dd90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac0751e0 tx=0x7fb99c02f270 comp rx=0 tx=0).stop 2026-02-17T11:10:37.193 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.169+0000 7fb9b0e76640 1 -- 10.20.193.49:0/3136774077 shutdown_connections 2026-02-17T11:10:37.193 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.169+0000 7fb9b0e76640 1 --2- 10.20.193.49:0/3136774077 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb9ac15d950 0x7fb9ac15dd90 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.193 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.169+0000 7fb9b0e76640 1 --2- 10.20.193.49:0/3136774077 >> v2:10.20.193.49:3300/0 conn(0x7fb9ac0d1b60 0x7fb9ac0d1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.194 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.169+0000 7fb9b0e76640 1 -- 10.20.193.49:0/3136774077 >> 10.20.193.49:0/3136774077 conn(0x7fb9ac06d9b0 msgr2=0x7fb9ac06ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:37.194 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.170+0000 7fb9b0e76640 1 -- 10.20.193.49:0/3136774077 shutdown_connections 2026-02-17T11:10:37.194 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.170+0000 7f31a88c4640 10 monclient: shutdown 2026-02-17T11:10:37.194 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.170+0000 7f31a88c4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:37.194 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.170+0000 7f31a88c4640 1 -- 10.20.193.49:0/163656211 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f31a00c9780 msgr2=0x7f31a00c9b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.194 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.170+0000 7f31a88c4640 1 --2- 10.20.193.49:0/163656211 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f31a00c9780 0x7f31a00c9b90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3194009d90 tx=0x7f319402f1e0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.194 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.170+0000 7fb9b0e76640 1 -- 10.20.193.49:0/3136774077 wait complete. 2026-02-17T11:10:37.194 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.14 2026-02-17T11:10:37.195 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.170+0000 7f31a88c4640 1 -- 10.20.193.49:0/163656211 shutdown_connections 2026-02-17T11:10:37.195 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.170+0000 7f31a88c4640 1 --2- 10.20.193.49:0/163656211 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f31a00c9780 0x7f31a00c9b90 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.195 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.170+0000 7f31a88c4640 1 -- 10.20.193.49:0/163656211 >> 10.20.193.49:0/163656211 conn(0x7f31a0073030 msgr2=0x7f31a0073440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:37.195 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.170+0000 7f31a88c4640 1 -- 10.20.193.49:0/163656211 shutdown_connections 2026-02-17T11:10:37.195 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.170+0000 7f31a88c4640 1 -- 10.20.193.49:0/163656211 wait complete. 2026-02-17T11:10:37.195 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.170+0000 7f39aeffd640 1 -- 10.20.193.49:0/2243935134 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b8046020 con 0x7f39c41561f0 2026-02-17T11:10:37.195 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.170+0000 7f39aeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:37.195 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.170+0000 7f39aeffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:10:37.195 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.170+0000 7f39aeffd640 10 monclient: dump: 2026-02-17T11:10:37.195 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:37.195 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.195 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.195 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.195 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:37.195 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.195 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:37.195 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:37.195 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:37.195 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.195 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.170+0000 7f39aeffd640 10 monclient: _finish_auth 0 2026-02-17T11:10:37.196 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.170+0000 7fb9b0e76640 10 monclient: build_initial_monmap 2026-02-17T11:10:37.196 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.170+0000 7fb9b0e76640 10 monclient: monmap: 2026-02-17T11:10:37.196 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:37.196 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:37.196 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:37.196 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:37.196 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:37.196 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.196 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:37.196 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:37.196 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:37.196 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.196 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.170+0000 7f39aeffd640 10 monclient: _check_auth_tickets 2026-02-17T11:10:37.196 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.170+0000 7f39aeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:37.196 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.170+0000 7f39cc8e1640 5 monclient: authenticate success, global_id 4541 2026-02-17T11:10:37.196 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.170+0000 7f39cc8e1640 10 monclient: _renew_subs 2026-02-17T11:10:37.196 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.170+0000 7f39cc8e1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:37.196 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.170+0000 7f39cc8e1640 1 -- 10.20.193.49:0/2243935134 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39c40ce100 con 0x7f39c41561f0 2026-02-17T11:10:37.196 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.170+0000 7f31a88c4640 10 monclient: build_initial_monmap 2026-02-17T11:10:37.197 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.170+0000 7f39cc8e1640 10 client.4541.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:37.197 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.170+0000 7f39cc8e1640 10 monclient: _renew_subs 2026-02-17T11:10:37.197 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.170+0000 7f39cc8e1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:37.197 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.170+0000 7f31a88c4640 10 monclient: monmap: 2026-02-17T11:10:37.197 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:37.197 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:37.197 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:37.197 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:37.197 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:37.197 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.197 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:37.197 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:37.197 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:37.197 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.197 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.170+0000 7f39cc8e1640 1 -- 10.20.193.49:0/2243935134 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39c41437f0 con 0x7f39c41561f0 2026-02-17T11:10:37.197 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.170+0000 7f39cc8e1640 1 librados: init done 2026-02-17T11:10:37.197 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.170+0000 7fb9b0e76640 1 librados: starting msgr at 2026-02-17T11:10:37.198 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.171+0000 7fb9b0e76640 1 librados: starting objecter 2026-02-17T11:10:37.198 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.171+0000 7f31a88c4640 1 librados: starting msgr at 2026-02-17T11:10:37.198 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.171+0000 7f31a88c4640 1 librados: starting objecter 2026-02-17T11:10:37.198 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.171+0000 7fb9b0e76640 1 Processor -- start 2026-02-17T11:10:37.198 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.171+0000 7f31a88c4640 1 Processor -- start 2026-02-17T11:10:37.198 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.171+0000 7fb9b0e76640 1 -- start start 2026-02-17T11:10:37.198 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.171+0000 7fb9b0e76640 1 librados: setting wanted keys 2026-02-17T11:10:37.198 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.171+0000 7fb9b0e76640 1 librados: calling monclient init 2026-02-17T11:10:37.198 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.171+0000 7fb9b0e76640 10 monclient: init 2026-02-17T11:10:37.198 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.171+0000 7f5b1656c640 1 --2- 10.20.193.49:0/3581126632 >> v2:10.20.193.97:3300/0 conn(0x7f5b100ce5d0 0x7f5b100d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:37.199 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.171+0000 7f31a88c4640 1 -- start start 2026-02-17T11:10:37.199 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.171+0000 7f31a88c4640 1 librados: setting wanted keys 2026-02-17T11:10:37.199 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.171+0000 7f31a88c4640 1 librados: calling monclient init 2026-02-17T11:10:37.199 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.171+0000 7f31a88c4640 10 monclient: init 2026-02-17T11:10:37.199 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.171+0000 7f39cc8e1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:37.199 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.171+0000 7fb9b0e76640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:37.199 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.171+0000 7f39cc8e1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:37.199 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.171+0000 7f39cc8e1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:37.199 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.171+0000 7fb9b0e76640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:10:37.199 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.171+0000 7fb9b0e76640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb9ac0d1b60 0x7fb9ac148590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.199 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.171+0000 7fb9b0e76640 10 monclient(hunting): picked mon.noname-a con 0x7fb9ac0d1b60 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:37.199 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.171+0000 7f39cc8e1640 1 -- 10.20.193.49:0/2243935134 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39c4068a90 con 0x7f39c41561f0 2026-02-17T11:10:37.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.171+0000 7fb9b0e76640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb9ac15c840 0x7fb9ac0d0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.171+0000 7fb9b0e76640 10 monclient(hunting): picked mon.noname-c con 0x7fb9ac15c840 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:37.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.171+0000 7fb9b0e76640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb9ac15d950 0x7fb9ac1570c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.171+0000 7fb9b0e76640 10 monclient(hunting): picked mon.noname-b con 0x7fb9ac15d950 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:37.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.171+0000 7fb9b0e76640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.171+0000 7fb9b0e76640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb9ac0ca180 con 0x7fb9ac0d1b60 2026-02-17T11:10:37.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.171+0000 7fb9b0e76640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.171+0000 7fb9b0e76640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb9ac0c9ea0 con 0x7fb9ac15d950 2026-02-17T11:10:37.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.171+0000 7f31a88c4640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:37.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.171+0000 7fb9b0e76640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.171+0000 7fb9b0e76640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb9ac15cc90 con 0x7fb9ac15c840 2026-02-17T11:10:37.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.171+0000 7fb9b0e76640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:37.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.171+0000 7fb9b0e76640 10 monclient(hunting): authenticate will time out at 1113.834580s 2026-02-17T11:10:37.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.171+0000 7f31a88c4640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:10:37.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.171+0000 7f31a88c4640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f31a00c9780 0x7f31a01f6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.171+0000 7f31a88c4640 10 monclient(hunting): picked mon.noname-c con 0x7f31a00c9780 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:37.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.171+0000 7f5b1656c640 10 monclient(hunting): get_auth_request con 0x7f5b100ce5d0 auth_method 0 2026-02-17T11:10:37.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.171+0000 7f5b1656c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:37.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.171+0000 7f31a88c4640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f31a00ce5d0 0x7f31a01f5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.171+0000 7f31a88c4640 10 monclient(hunting): picked mon.noname-a con 0x7f31a00ce5d0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:37.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.171+0000 7f5b1656c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:37.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.171+0000 7f5b1656c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:37.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.171+0000 7f31a88c4640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f31a015bf30 0x7f31a01f6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.171+0000 7f31a88c4640 10 monclient(hunting): picked mon.noname-b con 0x7f31a015bf30 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:37.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.171+0000 7f31a88c4640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.171+0000 7f31a88c4640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f31a00cbc30 con 0x7f31a00ce5d0 2026-02-17T11:10:37.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.171+0000 7f31a88c4640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.171+0000 7f31a88c4640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f31a00ca0d0 con 0x7f31a015bf30 2026-02-17T11:10:37.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.171+0000 7f31a88c4640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.202 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.171+0000 7f31a88c4640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f31a01f4a80 con 0x7f31a00c9780 2026-02-17T11:10:37.202 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.171+0000 7f31a88c4640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:37.202 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.171+0000 7f31a88c4640 10 monclient(hunting): authenticate will time out at 1113.834648s 2026-02-17T11:10:37.202 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.172+0000 7f5b1656c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:37.202 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.172+0000 7f5b1656c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:37.202 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.172+0000 7f5b1656c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:37.202 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.172+0000 7f39aeffd640 1 -- 10.20.193.49:0/2243935134 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39b80373f0 con 0x7f39c41561f0 2026-02-17T11:10:37.202 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.172+0000 7f39aeffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:37.202 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.172+0000 7f39aeffd640 1 -- 10.20.193.49:0/2243935134 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b8041450 con 0x7f39c41561f0 2026-02-17T11:10:37.202 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.172+0000 7f39aeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:37.202 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.172+0000 7f39aeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:10:37.202 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.172+0000 7f39c8e53640 4 set_mon_vals no callback set 2026-02-17T11:10:37.202 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.172+0000 7f39aeffd640 10 monclient: dump: 2026-02-17T11:10:37.202 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:37.202 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.202 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.202 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.202 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:37.202 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.202 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:37.202 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:37.202 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:37.202 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.203 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.172+0000 7fb3927fc640 1 -- 10.20.193.49:0/228728157 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a0016020 con 0x7fb3a415d950 2026-02-17T11:10:37.203 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.172+0000 7fb3927fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:37.203 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.172+0000 7fb3927fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:10:37.203 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.172+0000 7fb3927fc640 10 monclient: dump: 2026-02-17T11:10:37.203 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:37.203 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.203 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.203 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.203 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:37.203 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.203 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:37.203 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:37.203 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:37.203 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.203 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.172+0000 7fb3927fc640 10 monclient: _finish_auth 0 2026-02-17T11:10:37.203 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.172+0000 7fb3927fc640 10 monclient: _check_auth_tickets 2026-02-17T11:10:37.203 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.172+0000 7fb3927fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:37.203 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.172+0000 7fb3927fc640 1 -- 10.20.193.49:0/228728157 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3a000ce30 con 0x7fb3a415d950 2026-02-17T11:10:37.203 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.172+0000 7fb3abc91640 5 monclient: authenticate success, global_id 4538 2026-02-17T11:10:37.203 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.172+0000 7fb3abc91640 10 monclient: _renew_subs 2026-02-17T11:10:37.204 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.172+0000 7fb3abc91640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:37.204 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.172+0000 7fb3abc91640 1 -- 10.20.193.49:0/228728157 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3a41f4200 con 0x7fb3a415d950 2026-02-17T11:10:37.204 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.172+0000 7fb3927fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:37.204 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.172+0000 7fb3927fc640 1 -- 10.20.193.49:0/228728157 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a0012640 con 0x7fb3a415d950 2026-02-17T11:10:37.204 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.172+0000 7fb3927fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:37.204 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.172+0000 7fb3927fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:10:37.204 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.172+0000 7fb3927fc640 10 monclient: dump: 2026-02-17T11:10:37.204 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:37.204 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.204 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.204 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.204 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:37.204 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.204 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:37.204 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:37.204 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:37.204 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.204 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.172+0000 7fb393fff640 4 set_mon_vals no callback set 2026-02-17T11:10:37.204 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.172+0000 7fb3abc91640 10 client.4538.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:37.204 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.172+0000 7fb3abc91640 10 monclient: _renew_subs 2026-02-17T11:10:37.204 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.172+0000 7fb3abc91640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:37.204 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.172+0000 7fb3abc91640 1 -- 10.20.193.49:0/228728157 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3a41f47c0 con 0x7fb3a415d950 2026-02-17T11:10:37.204 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.172+0000 7fb3abc91640 1 librados: init done 2026-02-17T11:10:37.204 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.172+0000 7f5b1656c640 10 monclient(hunting): handle_auth_done global_id 4525 payload 274 2026-02-17T11:10:37.204 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.172+0000 7f5b1656c640 1 -- 10.20.193.49:0/3581126632 >> v2:10.20.193.49:3300/0 conn(0x7f5b100c9780 msgr2=0x7f5b100c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:37.204 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.172+0000 7f5b1656c640 1 --2- 10.20.193.49:0/3581126632 >> v2:10.20.193.49:3300/0 conn(0x7f5b100c9780 0x7f5b100c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.205 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.172+0000 7f5b1656c640 1 -- 10.20.193.49:0/3581126632 >> v1:10.20.193.157:6789/0 conn(0x7f5b1015bf30 legacy=0x7f5b100ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.205 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.172+0000 7f5b1656c640 10 monclient: _finish_hunting 0 2026-02-17T11:10:37.205 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.172+0000 7f5b1656c640 1 monclient: found mon.noname-b 2026-02-17T11:10:37.205 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.172+0000 7f5b1656c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:37.205 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.172+0000 7f5b1656c640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:10:37.205 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.172+0000 7f5b1656c640 1 -- 10.20.193.49:0/3581126632 --> v2:10.20.193.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b100d2690 con 0x7f5b100ce5d0 2026-02-17T11:10:37.205 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.173+0000 7fb3abc91640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:37.205 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.173+0000 7fb3abc91640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:37.205 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.173+0000 7fb3abc91640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:37.205 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.173+0000 7fb3abc91640 1 -- 10.20.193.49:0/228728157 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3a415c840 con 0x7fb3a415d950 2026-02-17T11:10:37.205 INFO:tasks.ceph.ceph_manager.ceph:need seq 107374182406 got 107374182405 for osd.7 2026-02-17T11:10:37.206 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.174+0000 7f31a6e3a640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f31a015bf30 0x7f31a01f6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:37.206 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.174+0000 7fb9aad76640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb9ac15d950 0x7fb9ac1570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:37.206 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.174+0000 7f31a6e3a640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f31a015bf30 0x7f31a01f6340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:55564/0 (socket says 10.20.193.49:55564) 2026-02-17T11:10:37.206 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.174+0000 7f31a6e3a640 1 -- 10.20.193.49:0/995141424 learned_addr learned my addr 10.20.193.49:0/995141424 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:37.206 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.174+0000 7f31a6e3a640 10 monclient(hunting): get_auth_request con 0x7f31a015bf30 auth_method 0 2026-02-17T11:10:37.206 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.174+0000 7f31a6e3a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:37.206 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.174+0000 7f31a6e3a640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:37.206 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.174+0000 7f31a6e3a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:37.206 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.174+0000 7fb9aad76640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb9ac15d950 0x7fb9ac1570c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:55550/0 (socket says 10.20.193.49:55550) 2026-02-17T11:10:37.206 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.174+0000 7fb9aad76640 1 -- 10.20.193.49:0/2139302021 learned_addr learned my addr 10.20.193.49:0/2139302021 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:37.206 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.174+0000 7fb9aad76640 10 monclient(hunting): get_auth_request con 0x7fb9ac15d950 auth_method 0 2026-02-17T11:10:37.206 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.174+0000 7fb9aad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:37.206 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.174+0000 7fb9aad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:37.206 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.174+0000 7fb9aad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:37.207 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.174+0000 7f31a6e3a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:37.207 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.174+0000 7f31a6e3a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:37.207 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.174+0000 7f31a6e3a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:37.207 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.175+0000 7fb9aad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:37.207 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.175+0000 7fb9aad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:37.207 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.175+0000 7fb9aad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:37.207 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.176+0000 7fb9a9d74640 1 --2- 10.20.193.49:0/2139302021 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb9ac15c840 0x7fb9ac0d0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:37.207 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.177+0000 7f31a6639640 1 --2- 10.20.193.49:0/995141424 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f31a00c9780 0x7f31a01f6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:37.207 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.177+0000 7f31a6639640 10 monclient(hunting): get_auth_request con 0x7f31a00c9780 auth_method 0 2026-02-17T11:10:37.207 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.177+0000 7f31a6639640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:37.207 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.177+0000 7f31a6639640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:37.207 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.177+0000 7f31a6639640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:37.207 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.177+0000 7fb9a9d74640 10 monclient(hunting): get_auth_request con 0x7fb9ac15c840 auth_method 0 2026-02-17T11:10:37.207 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.177+0000 7fb9a9d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:37.207 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.177+0000 7fb9a9d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:37.207 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.177+0000 7fb9a9d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:37.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.178+0000 7f31a6e3a640 10 monclient(hunting): handle_auth_done global_id 4528 payload 824 2026-02-17T11:10:37.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.178+0000 7f31a6e3a640 1 -- 10.20.193.49:0/995141424 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f31a00c9780 msgr2=0x7f31a01f6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.178+0000 7f31a6e3a640 1 --2- 10.20.193.49:0/995141424 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f31a00c9780 0x7f31a01f6d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.178+0000 7f31a6e3a640 1 -- 10.20.193.49:0/995141424 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f31a00ce5d0 msgr2=0x7f31a01f5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.178+0000 7f31a6e3a640 1 --2- 10.20.193.49:0/995141424 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f31a00ce5d0 0x7f31a01f5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.178+0000 7f31a6e3a640 10 monclient: _finish_hunting 0 2026-02-17T11:10:37.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.178+0000 7f31a6e3a640 1 monclient: found mon.noname-b 2026-02-17T11:10:37.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.178+0000 7fb9aad76640 10 monclient(hunting): handle_auth_done global_id 4531 payload 824 2026-02-17T11:10:37.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.178+0000 7fb9aad76640 1 -- 10.20.193.49:0/2139302021 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb9ac15c840 msgr2=0x7fb9ac0d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.178+0000 7f31a6e3a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:37.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.178+0000 7f31a6e3a640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:10:37.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.178+0000 7f31a6e3a640 1 -- 10.20.193.49:0/995141424 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31a01f4d60 con 0x7f31a015bf30 2026-02-17T11:10:37.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.178+0000 7fb9aad76640 1 --2- 10.20.193.49:0/2139302021 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb9ac15c840 0x7fb9ac0d0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.178+0000 7fb9aad76640 1 -- 10.20.193.49:0/2139302021 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb9ac0d1b60 msgr2=0x7fb9ac148590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.178+0000 7fb9aad76640 1 --2- 10.20.193.49:0/2139302021 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb9ac0d1b60 0x7fb9ac148590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.178+0000 7fb9aad76640 10 monclient: _finish_hunting 0 2026-02-17T11:10:37.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.178+0000 7fb9aad76640 1 monclient: found mon.noname-b 2026-02-17T11:10:37.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.178+0000 7fb9aad76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:37.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.178+0000 7fb9aad76640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:10:37.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.178+0000 7fb9aad76640 1 -- 10.20.193.49:0/2139302021 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9ac157bb0 con 0x7fb9ac15d950 2026-02-17T11:10:37.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.179+0000 7f31a6e3a640 1 --2- 10.20.193.49:0/995141424 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f31a015bf30 0x7f31a01f6340 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3194009d90 tx=0x7f3194004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:37.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.179+0000 7f318affd640 10 client.?.objecter ms_handle_connect 0x7f31a015bf30 2026-02-17T11:10:37.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.179+0000 7f318affd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:37.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.180+0000 7fb9aad76640 1 --2- 10.20.193.49:0/2139302021 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb9ac15d950 0x7fb9ac1570c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb99c039040 tx=0x7fb99c004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:37.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.180+0000 7fb992ffd640 10 client.?.objecter ms_handle_connect 0x7fb9ac15d950 2026-02-17T11:10:37.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.180+0000 7fb992ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:37.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.182+0000 7f5fdc5c3640 10 monclient: get_monmap_and_config 2026-02-17T11:10:37.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.182+0000 7f5fdc5c3640 10 monclient: build_initial_monmap 2026-02-17T11:10:37.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.182+0000 7f5fdc5c3640 10 monclient: monmap: 2026-02-17T11:10:37.209 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:37.209 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.209 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:37.183475+0000 2026-02-17T11:10:37.209 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:37.183475+0000 2026-02-17T11:10:37.209 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:37.209 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.209 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:37.209 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:37.209 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:37.209 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:37.210 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:37.210 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:37.210 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.210 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.183+0000 7f318affd640 1 -- 10.20.193.49:0/995141424 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3194047020 con 0x7f31a015bf30 2026-02-17T11:10:37.210 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.183+0000 7f318affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:37.210 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.183+0000 7f318affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:10:37.210 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.183+0000 7f318affd640 10 monclient: dump: 2026-02-17T11:10:37.210 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:37.210 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.210 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.210 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.210 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:37.210 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.210 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:37.210 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:37.210 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:37.210 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.210 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.183+0000 7f318affd640 10 monclient: _finish_auth 0 2026-02-17T11:10:37.210 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.183+0000 7f318affd640 10 monclient: _check_auth_tickets 2026-02-17T11:10:37.210 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.183+0000 7f318affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:37.210 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.183+0000 7f318affd640 1 -- 10.20.193.49:0/995141424 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3194042670 con 0x7f31a015bf30 2026-02-17T11:10:37.210 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.183+0000 7f318affd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:37.211 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.183+0000 7f318affd640 1 -- 10.20.193.49:0/995141424 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f319403c040 con 0x7f31a015bf30 2026-02-17T11:10:37.211 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.183+0000 7f31a88c4640 5 monclient: authenticate success, global_id 4528 2026-02-17T11:10:37.211 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.183+0000 7f31a88c4640 10 monclient: _renew_subs 2026-02-17T11:10:37.211 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.183+0000 7f31a4e36640 4 set_mon_vals no callback set 2026-02-17T11:10:37.211 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.183+0000 7f31a88c4640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:37.211 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.183+0000 7f31a88c4640 1 -- 10.20.193.49:0/995141424 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31a01f5040 con 0x7f31a015bf30 2026-02-17T11:10:37.211 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.183+0000 7f318affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:37.211 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.183+0000 7f318affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:37.211 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.183+0000 7f318affd640 10 monclient: dump: 2026-02-17T11:10:37.211 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:37.211 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.211 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.211 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.211 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:37.211 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.211 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:37.211 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:37.211 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:37.211 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.211 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.183+0000 7f5b1656c640 1 --2- 10.20.193.49:0/3581126632 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5b100ce5d0 0x7f5b100d18c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5b100cf4c0 tx=0x7f5b0002ede0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2045c9f90ac1e94 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:37.211 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.183+0000 7f31a88c4640 10 client.4528.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:37.211 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.183+0000 7f31a88c4640 10 monclient: _renew_subs 2026-02-17T11:10:37.211 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.183+0000 7f31a88c4640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:37.211 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.183+0000 7f31a88c4640 1 -- 10.20.193.49:0/995141424 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31a01f5600 con 0x7f31a015bf30 2026-02-17T11:10:37.211 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.183+0000 7f31a88c4640 1 librados: init done 2026-02-17T11:10:37.212 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.183+0000 7f5fdc5c3640 1 Processor -- start 2026-02-17T11:10:37.212 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.183+0000 7f5fdc5c3640 1 -- start start 2026-02-17T11:10:37.212 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.183+0000 7f5fdc5c3640 10 monclient: init 2026-02-17T11:10:37.212 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.183+0000 7fc4c2953640 10 monclient: get_monmap_and_config 2026-02-17T11:10:37.212 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.183+0000 7fc4c2953640 10 monclient: build_initial_monmap 2026-02-17T11:10:37.212 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.183+0000 7fc4c2953640 10 monclient: monmap: 2026-02-17T11:10:37.212 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:37.212 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.212 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:37.183992+0000 2026-02-17T11:10:37.212 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:37.183992+0000 2026-02-17T11:10:37.212 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:37.212 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.212 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:37.212 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:37.212 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:37.212 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:37.212 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:37.212 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:37.212 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.212 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.183+0000 7fc4c2953640 1 Processor -- start 2026-02-17T11:10:37.212 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.183+0000 7f5fdc5c3640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:37.212 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.183+0000 7f5fdc5c3640 10 monclient: _add_conns ranks=[5,4,0,2,1,3] 2026-02-17T11:10:37.212 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.183+0000 7fc4c2953640 1 -- start start 2026-02-17T11:10:37.212 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.183+0000 7fc4c2953640 10 monclient: init 2026-02-17T11:10:37.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.183+0000 7f5fdc5c3640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f5fd40c7170 0x7f5fd40c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.183+0000 7f5fdc5c3640 10 monclient(hunting): picked mon.noname-c con 0x7f5fd40c7170 addr v2:10.20.193.157:3300/0 2026-02-17T11:10:37.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.183+0000 7f5fdc5c3640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f5fd40c48c0 0x7f5fd40749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.183+0000 7f5fdc5c3640 10 monclient(hunting): picked mon.noname-b con 0x7f5fd40c48c0 addr v2:10.20.193.97:3300/0 2026-02-17T11:10:37.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.183+0000 7f5fdc5c3640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f5fd4074ef0 addr v1:10.20.193.49:6789/0 2026-02-17T11:10:37.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.183+0000 7f31a88c4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:37.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.183+0000 7f31a88c4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:37.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.184+0000 7f31a88c4640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:37.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.184+0000 7f5fdc5c3640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fd415a9a0 con 0x7f5fd4074ef0 2026-02-17T11:10:37.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.184+0000 7f5fdc5c3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.184+0000 7f5fdc5c3640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f5fd40c8530 con 0x7f5fd40c48c0 2026-02-17T11:10:37.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.184+0000 7f5fdc5c3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.184+0000 7f5fdc5c3640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f5fd40c5270 con 0x7f5fd40c7170 2026-02-17T11:10:37.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.184+0000 7f5fdc5c3640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:37.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.184+0000 7f5fdc5c3640 10 monclient(hunting): authenticate will time out at 1113.847013s 2026-02-17T11:10:37.213 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.12 2026-02-17T11:10:37.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.184+0000 7f31a88c4640 1 -- 10.20.193.49:0/995141424 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31a00c9b90 con 0x7f31a015bf30 2026-02-17T11:10:37.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.184+0000 7fc4c2953640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:37.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.184+0000 7fb992ffd640 1 -- 10.20.193.49:0/2139302021 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb99c046020 con 0x7fb9ac15d950 2026-02-17T11:10:37.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.184+0000 7fb992ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:37.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.184+0000 7fc4c2953640 10 monclient: _add_conns ranks=[2,1,5,4,3,0] 2026-02-17T11:10:37.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.184+0000 7fb992ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:10:37.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.184+0000 7fb992ffd640 10 monclient: dump: 2026-02-17T11:10:37.214 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:37.214 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.214 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.214 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.214 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:37.214 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.214 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:37.214 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:37.214 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:37.214 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.184+0000 7fb992ffd640 10 monclient: _finish_auth 0 2026-02-17T11:10:37.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.184+0000 7fb992ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:10:37.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.184+0000 7fb992ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:37.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.184+0000 7fb992ffd640 1 -- 10.20.193.49:0/2139302021 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb99c041450 con 0x7fb9ac15d950 2026-02-17T11:10:37.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.184+0000 7fc4c2953640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fc4bc0d1b60 addr v1:10.20.193.157:6789/0 2026-02-17T11:10:37.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.184+0000 7fb992ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:37.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.184+0000 7fb992ffd640 1 -- 10.20.193.49:0/2139302021 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb99c037e60 con 0x7fb9ac15d950 2026-02-17T11:10:37.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.184+0000 7fb992ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:37.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.184+0000 7fb992ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:37.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.184+0000 7fb992ffd640 10 monclient: dump: 2026-02-17T11:10:37.215 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:37.215 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.215 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.215 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.215 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:37.215 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.215 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:37.215 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:37.215 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:37.215 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.184+0000 7fb9b0e76640 5 monclient: authenticate success, global_id 4531 2026-02-17T11:10:37.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.184+0000 7fc4c2953640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fc4bc0d1f40 addr v1:10.20.193.97:6789/0 2026-02-17T11:10:37.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.184+0000 7fb9b0e76640 10 monclient: _renew_subs 2026-02-17T11:10:37.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.184+0000 7fb9a8d72640 4 set_mon_vals no callback set 2026-02-17T11:10:37.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.184+0000 7fb9b0e76640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:37.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.184+0000 7fb9b0e76640 1 -- 10.20.193.49:0/2139302021 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9ac157e90 con 0x7fb9ac15d950 2026-02-17T11:10:37.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.184+0000 7fc4c2953640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7fc4bc15e060 0x7fc4bc15c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.184+0000 7fc4c2953640 10 monclient(hunting): picked mon.noname-c con 0x7fc4bc15e060 addr v2:10.20.193.157:3300/0 2026-02-17T11:10:37.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.184+0000 7fc4c2953640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4bc0c98e0 con 0x7fc4bc0d1f40 2026-02-17T11:10:37.216 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.184+0000 7fc4c2953640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4bc0c9bc0 con 0x7fc4bc0d1b60 2026-02-17T11:10:37.216 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.184+0000 7fc4c2953640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.216 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.184+0000 7fc4c2953640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7fc4bc15cd80 con 0x7fc4bc15e060 2026-02-17T11:10:37.216 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.184+0000 7fc4c2953640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:37.216 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.184+0000 7fc4c2953640 10 monclient(hunting): authenticate will time out at 1113.847547s 2026-02-17T11:10:37.216 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.184+0000 7fb9b0e76640 10 client.4531.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:37.216 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.184+0000 7fb9b0e76640 10 monclient: _renew_subs 2026-02-17T11:10:37.216 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.184+0000 7fb9b0e76640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:37.216 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.184+0000 7fb9b0e76640 1 -- 10.20.193.49:0/2139302021 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9ac1f47a0 con 0x7fb9ac15d950 2026-02-17T11:10:37.216 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.184+0000 7fb9b0e76640 1 librados: init done 2026-02-17T11:10:37.216 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.185+0000 7fb9b0e76640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:37.216 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.185+0000 7fb9b0e76640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:37.216 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.185+0000 7fb9b0e76640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:37.216 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.185+0000 7fb9b0e76640 1 -- 10.20.193.49:0/2139302021 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9ac1583b0 con 0x7fb9ac15d950 2026-02-17T11:10:37.216 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.196+0000 7f318affd640 1 -- 10.20.193.49:0/995141424 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f3194042a60 con 0x7f31a015bf30 2026-02-17T11:10:37.216 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.197+0000 7f318affd640 1 --2- 10.20.193.49:0/995141424 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3170079140 0x7f317007b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.216 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.197+0000 7fde6effd640 1 -- 10.20.193.49:0/174857959 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fde7c0622c0 con 0x7fde8814f660 2026-02-17T11:10:37.216 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.197+0000 7fde6effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:37.217 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.197+0000 7fde6effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:37.217 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.197+0000 7f31a6639640 1 --2- 10.20.193.49:0/995141424 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3170079140 0x7f317007b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:37.217 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.197+0000 7f31a6639640 10 monclient: get_auth_request con 0x7f3170079140 auth_method 0 2026-02-17T11:10:37.217 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.198+0000 7f31a6639640 1 --2- 10.20.193.49:0/995141424 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3170079140 0x7f317007b600 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3198007fd0 tx=0x7f3198009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:37.217 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.198+0000 7f318affd640 10 client.4528.objecter ms_handle_connect 0x7f3170079140 2026-02-17T11:10:37.217 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.201+0000 7f40e746f640 10 monclient: get_monmap_and_config 2026-02-17T11:10:37.217 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.201+0000 7f40e746f640 10 monclient: build_initial_monmap 2026-02-17T11:10:37.217 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.201+0000 7f40e746f640 10 monclient: monmap: 2026-02-17T11:10:37.217 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:37.217 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.217 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:37.202322+0000 2026-02-17T11:10:37.217 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:37.202322+0000 2026-02-17T11:10:37.217 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:37.217 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.217 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:37.217 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:37.217 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:37.217 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:37.217 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:37.217 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:37.217 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.217 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.202+0000 7f40e746f640 1 Processor -- start 2026-02-17T11:10:37.217 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.202+0000 7f40e746f640 1 -- start start 2026-02-17T11:10:37.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.202+0000 7f40e746f640 10 monclient: init 2026-02-17T11:10:37.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.202+0000 7f5fdab39640 1 --1- >> v1:10.20.193.49:6789/0 conn(0x7f5fd4074ef0 0x7f5fd40c89c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.49:6789/0 says I am v1:10.20.193.49:47658/0 (socket says 10.20.193.49:47658) 2026-02-17T11:10:37.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.202+0000 7f5fdab39640 1 -- 10.20.193.49:0/291886030 learned_addr learned my addr 10.20.193.49:0/291886030 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:10:37.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.202+0000 7f40e746f640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:37.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.202+0000 7f40e746f640 10 monclient: _add_conns ranks=[3,0,2,1,5,4] 2026-02-17T11:10:37.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.202+0000 7f40e746f640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f40e015d370 0x7f40e015d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.202+0000 7f40e746f640 10 monclient(hunting): picked mon.noname-a con 0x7f40e015d370 addr v2:10.20.193.49:3300/0 2026-02-17T11:10:37.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.202+0000 7f40e746f640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f40e00c7e20 addr v1:10.20.193.49:6789/0 2026-02-17T11:10:37.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.202+0000 7f40e746f640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f40e00c74c0 addr v1:10.20.193.157:6789/0 2026-02-17T11:10:37.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.202+0000 7f40e746f640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40e00c8350 con 0x7f40e00c7e20 2026-02-17T11:10:37.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.202+0000 7f40e746f640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40e00c8630 con 0x7f40e00c74c0 2026-02-17T11:10:37.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.202+0000 7f40e746f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.202+0000 7f40e746f640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f40e015b710 con 0x7f40e015d370 2026-02-17T11:10:37.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.202+0000 7f40e746f640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:37.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.202+0000 7f40e746f640 10 monclient(hunting): authenticate will time out at 1113.865782s 2026-02-17T11:10:37.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.206+0000 7f77d7fff640 1 -- 10.20.193.49:0/2213070188 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f77f00630e0 con 0x7f77fc0c7170 2026-02-17T11:10:37.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.206+0000 7f77d7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-17T11:10:37.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.206+0000 7f77d7fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:37.219 INFO:teuthology.orchestra.run.trial049.stdout:111669149702 2026-02-17T11:10:37.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.208+0000 7f7801b72640 10 librados: watch_flush enter 2026-02-17T11:10:37.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.208+0000 7f7801b72640 10 librados: watch_flush exit 2026-02-17T11:10:37.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.208+0000 7f7801b72640 20 client.4521.objecter shutdown clearing up homeless session... 2026-02-17T11:10:37.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.208+0000 7f7801b72640 10 client.4521.objecter successfully canceled tick 2026-02-17T11:10:37.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.208+0000 7f7801b72640 1 -- 10.20.193.49:0/2213070188 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f77cc079190 msgr2=0x7f77cc07b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.208+0000 7f7801b72640 1 --2- 10.20.193.49:0/2213070188 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f77cc079190 0x7f77cc07b650 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f77e8009770 tx=0x7f77e8006cf0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.209+0000 7f7801b72640 10 monclient: shutdown 2026-02-17T11:10:37.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.209+0000 7f7801b72640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:37.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.209+0000 7f7801b72640 1 -- 10.20.193.49:0/2213070188 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f77fc0c7170 msgr2=0x7f77fc15d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.209+0000 7f7801b72640 1 --2- 10.20.193.49:0/2213070188 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f77fc0c7170 0x7f77fc15d5f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f77f000cc20 tx=0x7f77f000a430 comp rx=0 tx=0).stop 2026-02-17T11:10:37.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.209+0000 7f7801b72640 1 -- 10.20.193.49:0/2213070188 shutdown_connections 2026-02-17T11:10:37.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.209+0000 7f7801b72640 1 --2- 10.20.193.49:0/2213070188 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f77cc079190 0x7f77cc07b650 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.209+0000 7f7801b72640 1 --2- 10.20.193.49:0/2213070188 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f77fc0c7170 0x7f77fc15d5f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.209+0000 7f7801b72640 1 --2- 10.20.193.49:0/2213070188 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f77fc0c48c0 0x7f77fc15d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.209+0000 7f7801b72640 1 --2- 10.20.193.49:0/2213070188 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f77fc074ef0 0x7f77fc149e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.209+0000 7f7801b72640 1 -- 10.20.193.49:0/2213070188 >> 10.20.193.49:0/2213070188 conn(0x7f77fc0c9f40 msgr2=0x7f77fc0cb330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:37.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.209+0000 7f7801b72640 1 -- 10.20.193.49:0/2213070188 shutdown_connections 2026-02-17T11:10:37.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.209+0000 7f7801b72640 1 -- 10.20.193.49:0/2213070188 wait complete. 2026-02-17T11:10:37.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.209+0000 7f7801b72640 1 librados: shutdown 2026-02-17T11:10:37.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.214+0000 7f40e51e4640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f40e015d370 0x7f40e015d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:37.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.217+0000 7f40e51e4640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f40e015d370 0x7f40e015d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:33502/0 (socket says 10.20.193.49:33502) 2026-02-17T11:10:37.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.217+0000 7f40e51e4640 1 -- 10.20.193.49:0/3243672239 learned_addr learned my addr 10.20.193.49:0/3243672239 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:37.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.217+0000 7f40e51e4640 10 monclient(hunting): get_auth_request con 0x7f40e015d370 auth_method 0 2026-02-17T11:10:37.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.217+0000 7f40e51e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:37.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.217+0000 7f40e51e4640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:37.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.217+0000 7f40e51e4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:37.220 INFO:tasks.ceph.ceph_manager.ceph:need seq 111669149703 got 111669149702 for osd.11 2026-02-17T11:10:37.221 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.218+0000 7f5fd9336640 1 -- 10.20.193.49:0/291886030 <== mon.0 v1:10.20.193.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1256225651 0 0) 0x7f5fd415a9a0 con 0x7f5fd4074ef0 2026-02-17T11:10:37.221 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.218+0000 7f5fd9336640 10 monclient(hunting): _negotiate 2026-02-17T11:10:37.221 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.218+0000 7f5fd9336640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:37.221 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.218+0000 7f5fd9336640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:37.221 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.218+0000 7f5fd9336640 10 monclient(hunting): my global_id is 4542 2026-02-17T11:10:37.221 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.218+0000 7f5fd9336640 1 -- 10.20.193.49:0/291886030 --> v1:10.20.193.49:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5fbc003620 con 0x7f5fd4074ef0 2026-02-17T11:10:37.221 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.219+0000 7f40e51e4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:37.221 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.219+0000 7f40e51e4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:37.221 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.219+0000 7f40e51e4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:37.221 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.220+0000 7f40e51e4640 10 monclient(hunting): handle_auth_done global_id 4545 payload 274 2026-02-17T11:10:37.222 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.220+0000 7f40e51e4640 1 -- 10.20.193.49:0/3243672239 >> v1:10.20.193.157:6789/0 conn(0x7f40e00c74c0 legacy=0x7f40e00c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:37.222 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.220+0000 7f40e51e4640 1 -- 10.20.193.49:0/3243672239 >> v1:10.20.193.49:6789/0 conn(0x7f40e00c7e20 legacy=0x7f40e015b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:37.222 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.220+0000 7f40e51e4640 10 monclient: _finish_hunting 0 2026-02-17T11:10:37.222 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.220+0000 7f40e51e4640 1 monclient: found mon.noname-a 2026-02-17T11:10:37.222 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.220+0000 7f40e51e4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:37.222 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.220+0000 7f40e51e4640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:10:37.222 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.220+0000 7f40e51e4640 1 -- 10.20.193.49:0/3243672239 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40e00c8910 con 0x7f40e015d370 2026-02-17T11:10:37.223 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.222+0000 7f40e51e4640 1 --2- 10.20.193.49:0/3243672239 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f40e015d370 0x7f40e015d750 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f40d0009970 tx=0x7f40d002eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1a185ed803d0924 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:37.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.226+0000 7f5fd9336640 1 -- 10.20.193.49:0/291886030 <== mon.0 v1:10.20.193.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1140846375 0 0) 0x7f5fbc003620 con 0x7f5fd4074ef0 2026-02-17T11:10:37.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.226+0000 7f5fd9336640 1 -- 10.20.193.49:0/291886030 >> v2:10.20.193.157:3300/0 conn(0x7f5fd40c7170 msgr2=0x7f5fd40c7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:37.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.226+0000 7f5fd9336640 1 --2- 10.20.193.49:0/291886030 >> v2:10.20.193.157:3300/0 conn(0x7f5fd40c7170 0x7f5fd40c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.226+0000 7f5fd9336640 1 -- 10.20.193.49:0/291886030 >> v2:10.20.193.97:3300/0 conn(0x7f5fd40c48c0 msgr2=0x7f5fd40749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:37.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.226+0000 7f5fd9336640 1 --2- 10.20.193.49:0/291886030 >> v2:10.20.193.97:3300/0 conn(0x7f5fd40c48c0 0x7f5fd40749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.226+0000 7f5fd9336640 10 monclient: _finish_hunting 0 2026-02-17T11:10:37.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.226+0000 7f5fd9336640 1 monclient: found mon.noname-a-legacy 2026-02-17T11:10:37.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.226+0000 7f5fd9336640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:37.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.226+0000 7f5fd9336640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.49:6789/0 2026-02-17T11:10:37.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.226+0000 7f5fd9336640 1 -- 10.20.193.49:0/291886030 --> v1:10.20.193.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fd40c5550 con 0x7f5fd4074ef0 2026-02-17T11:10:37.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.226+0000 7f5fd9336640 10 monclient: _finish_auth 0 2026-02-17T11:10:37.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.226+0000 7f5fd9336640 10 monclient: _check_auth_tickets 2026-02-17T11:10:37.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.226+0000 7f5fd9336640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:37.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.226+0000 7f5fd9336640 1 -- 10.20.193.49:0/291886030 <== mon.0 v1:10.20.193.49:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2462710995 0 0) 0x7f5fd0003280 con 0x7f5fd4074ef0 2026-02-17T11:10:37.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.226+0000 7f5fd9336640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:37.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.226+0000 7f5fd9336640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T11:10:37.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.226+0000 7f5fd9336640 10 monclient: dump: 2026-02-17T11:10:37.228 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:37.228 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.228 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.228 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.228 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:37.228 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.228 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:37.228 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:37.228 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:37.228 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.226+0000 7f5fd9336640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] but i'm connected to v1:10.20.193.49:6789/0, reconnecting 2026-02-17T11:10:37.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.226+0000 7f5fd9336640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:37.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.226+0000 7f5fd9336640 1 -- 10.20.193.49:0/291886030 >> v1:10.20.193.49:6789/0 conn(0x7f5fd4074ef0 legacy=0x7f5fd40c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.226+0000 7f5fd9336640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:10:37.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.226+0000 7f5fd9336640 1 --2- 10.20.193.49:0/291886030 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5fbc003bf0 0x7f5fbc004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.226+0000 7f5fd9336640 10 monclient(hunting): picked mon.b con 0x7f5fbc003bf0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:37.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.226+0000 7f5fd9336640 1 --2- 10.20.193.49:0/291886030 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5fbc004900 0x7f5fbc004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.226+0000 7f5fd9336640 10 monclient(hunting): picked mon.c con 0x7f5fbc004900 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:37.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.226+0000 7f5fd9336640 1 --2- 10.20.193.49:0/291886030 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5fbc009ab0 0x7f5fbc00bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.226+0000 7f5fd9336640 10 monclient(hunting): picked mon.a con 0x7f5fbc009ab0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:37.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.226+0000 7f5fd9336640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.226+0000 7f5fd9336640 1 -- 10.20.193.49:0/291886030 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd40c8530 con 0x7f5fbc009ab0 2026-02-17T11:10:37.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.226+0000 7f5fd9336640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.226+0000 7f5fd9336640 1 -- 10.20.193.49:0/291886030 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd40c5270 con 0x7f5fbc003bf0 2026-02-17T11:10:37.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.226+0000 7f5fd9336640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.226+0000 7f5fd9336640 1 -- 10.20.193.49:0/291886030 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f5fbc00c540 con 0x7f5fbc004900 2026-02-17T11:10:37.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.226+0000 7f5fd9336640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:37.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.226+0000 7f5fd9336640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:10:37.229 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.228+0000 7f40cffff640 1 -- 10.20.193.49:0/3243672239 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d003c070 con 0x7f40e015d370 2026-02-17T11:10:37.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.228+0000 7f40cffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:37.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.228+0000 7f40cffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:10:37.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.228+0000 7f40cffff640 10 monclient: dump: 2026-02-17T11:10:37.230 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:37.230 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.230 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.230 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.230 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:37.230 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.230 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:37.230 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:37.230 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:37.230 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.228+0000 7f40cffff640 10 monclient: _finish_auth 0 2026-02-17T11:10:37.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.228+0000 7f40cffff640 10 monclient: _check_auth_tickets 2026-02-17T11:10:37.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.228+0000 7f40cffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:37.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.228+0000 7f40cffff640 1 -- 10.20.193.49:0/3243672239 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40d002fb60 con 0x7f40e015d370 2026-02-17T11:10:37.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.228+0000 7f40cffff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:37.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.228+0000 7f40cffff640 1 -- 10.20.193.49:0/3243672239 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d0037440 con 0x7f40e015d370 2026-02-17T11:10:37.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.228+0000 7f40cffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:37.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.228+0000 7f40cffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:10:37.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.228+0000 7f40cffff640 10 monclient: dump: 2026-02-17T11:10:37.230 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:37.230 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.230 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.230 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.230 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:37.230 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.230 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:37.230 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:37.230 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:37.230 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.228+0000 7f40e746f640 5 monclient: authenticate success, global_id 4545 2026-02-17T11:10:37.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.228+0000 7f40e746f640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:37.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.228+0000 7f40e746f640 4 set_mon_vals no callback set 2026-02-17T11:10:37.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.229+0000 7f40e746f640 10 monclient: shutdown 2026-02-17T11:10:37.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.229+0000 7f40e746f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:37.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.229+0000 7f40e746f640 1 -- 10.20.193.49:0/3243672239 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f40e015d370 msgr2=0x7f40e015d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.229+0000 7f40e746f640 1 --2- 10.20.193.49:0/3243672239 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f40e015d370 0x7f40e015d750 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f40d0009970 tx=0x7f40d002eef0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.229+0000 7f40e746f640 1 -- 10.20.193.49:0/3243672239 shutdown_connections 2026-02-17T11:10:37.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.229+0000 7f40e746f640 1 --2- 10.20.193.49:0/3243672239 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f40e015d370 0x7f40e015d750 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.229+0000 7f40e746f640 1 -- 10.20.193.49:0/3243672239 >> 10.20.193.49:0/3243672239 conn(0x7f40e00c9f20 msgr2=0x7f40e00ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:37.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.229+0000 7f40e746f640 1 -- 10.20.193.49:0/3243672239 shutdown_connections 2026-02-17T11:10:37.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.229+0000 7f40e746f640 1 -- 10.20.193.49:0/3243672239 wait complete. 2026-02-17T11:10:37.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.229+0000 7f5fdab39640 1 --2- 10.20.193.49:0/291886030 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5fbc009ab0 0x7f5fbc00bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:37.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.229+0000 7f40e746f640 10 monclient: build_initial_monmap 2026-02-17T11:10:37.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.229+0000 7f40e746f640 10 monclient: monmap: 2026-02-17T11:10:37.231 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:37.231 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:37.231 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:37.231 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:37.231 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:37.231 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.231 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:37.231 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:37.231 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:37.231 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.229+0000 7f40e746f640 1 librados: starting msgr at 2026-02-17T11:10:37.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.229+0000 7f40e746f640 1 librados: starting objecter 2026-02-17T11:10:37.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.229+0000 7f40e746f640 1 Processor -- start 2026-02-17T11:10:37.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.229+0000 7f5fdab39640 10 monclient(hunting): get_auth_request con 0x7f5fbc009ab0 auth_method 0 2026-02-17T11:10:37.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.229+0000 7f5fdab39640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:37.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.229+0000 7f5fdab39640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:37.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.229+0000 7f5fdab39640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:10:37.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.229+0000 7f40e746f640 1 -- start start 2026-02-17T11:10:37.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.229+0000 7f40e746f640 1 librados: setting wanted keys 2026-02-17T11:10:37.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.229+0000 7f40e746f640 1 librados: calling monclient init 2026-02-17T11:10:37.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.229+0000 7f40e746f640 10 monclient: init 2026-02-17T11:10:37.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.230+0000 7f40e746f640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:37.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.230+0000 7f40e746f640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:10:37.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.230+0000 7f40e746f640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f40e00c74c0 0x7f40e01f5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.230+0000 7f40e746f640 10 monclient(hunting): picked mon.noname-b con 0x7f40e00c74c0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:37.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.230+0000 7f40e746f640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f40e00c7e20 0x7f40e01444f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.230+0000 7f40e746f640 10 monclient(hunting): picked mon.noname-c con 0x7f40e00c7e20 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:37.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.230+0000 7f40e746f640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f40e015d370 0x7f40e00cc890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.230+0000 7f40e746f640 10 monclient(hunting): picked mon.noname-a con 0x7f40e015d370 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:37.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.230+0000 7f40e746f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.230+0000 7f40e746f640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f40e00c8ed0 con 0x7f40e015d370 2026-02-17T11:10:37.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.230+0000 7f40e746f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.230+0000 7f40e746f640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f40e00c9240 con 0x7f40e00c74c0 2026-02-17T11:10:37.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.230+0000 7f40e746f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.230+0000 7f40e746f640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f40e00c96d0 con 0x7f40e00c7e20 2026-02-17T11:10:37.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.230+0000 7f40e746f640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:37.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.230+0000 7f40e746f640 10 monclient(hunting): authenticate will time out at 1113.893404s 2026-02-17T11:10:37.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.230+0000 7f5fdab39640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:37.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.230+0000 7f5fdab39640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:37.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.230+0000 7f5fdab39640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:10:37.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.231+0000 7f5fdab39640 10 monclient(hunting): handle_auth_done global_id 4542 payload 293 2026-02-17T11:10:37.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.231+0000 7f5fdab39640 1 -- 10.20.193.49:0/291886030 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5fbc004900 msgr2=0x7f5fbc004d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:37.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.231+0000 7f5fdab39640 1 --2- 10.20.193.49:0/291886030 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5fbc004900 0x7f5fbc004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.231+0000 7f5fdab39640 1 -- 10.20.193.49:0/291886030 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5fbc003bf0 msgr2=0x7f5fbc004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:37.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.231+0000 7f5fdab39640 1 --2- 10.20.193.49:0/291886030 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5fbc003bf0 0x7f5fbc004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.231+0000 7f5fdab39640 10 monclient: _finish_hunting 0 2026-02-17T11:10:37.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.231+0000 7f5fdab39640 1 monclient: found mon.a 2026-02-17T11:10:37.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.231+0000 7f5fdab39640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:37.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.231+0000 7f5fdab39640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:37.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.231+0000 7f5fdab39640 1 -- 10.20.193.49:0/291886030 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fbc003620 con 0x7f5fbc009ab0 2026-02-17T11:10:37.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.231+0000 7f5fdab39640 10 monclient: _finish_auth 0 2026-02-17T11:10:37.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.231+0000 7f5fdab39640 10 monclient: _check_auth_tickets 2026-02-17T11:10:37.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.231+0000 7f5fdab39640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:37.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.231+0000 7f5fdc5c3640 5 monclient: authenticate success, global_id 4542 2026-02-17T11:10:37.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.231+0000 7f5fdc5c3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:10:37.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.231+0000 7f0de463b640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-17T11:10:37.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.231+0000 7f0de463b640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-17T11:10:37.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.231+0000 7f0de463b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:37.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.231+0000 7f0de463b640 1 -- 10.20.193.49:0/3656177287 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f0ddc073080 con 0x7f0ddc0ccc00 2026-02-17T11:10:37.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.232+0000 7f5fdab39640 1 -- 10.20.193.49:0/291886030 reap_dead start 2026-02-17T11:10:37.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.232+0000 7f40e59e5640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f40e015d370 0x7f40e00cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:37.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.232+0000 7f40e59e5640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f40e015d370 0x7f40e00cc890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:33514/0 (socket says 10.20.193.49:33514) 2026-02-17T11:10:37.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.232+0000 7f40e59e5640 1 -- 10.20.193.49:0/1955498600 learned_addr learned my addr 10.20.193.49:0/1955498600 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:37.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.232+0000 7f40e59e5640 10 monclient(hunting): get_auth_request con 0x7f40e015d370 auth_method 0 2026-02-17T11:10:37.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.232+0000 7f40e59e5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:37.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.232+0000 7f40e59e5640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:37.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.232+0000 7f40e59e5640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:37.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.232+0000 7f5fdab39640 1 --2- 10.20.193.49:0/291886030 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5fbc009ab0 0x7f5fbc00bea0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5fd000a800 tx=0x7f5fd002fbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d67d2a960d063c8 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:37.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.232+0000 7f40e59e5640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:37.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.232+0000 7f40e59e5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:37.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.232+0000 7f40e59e5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:37.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.234+0000 7f40e59e5640 10 monclient(hunting): handle_auth_done global_id 4548 payload 824 2026-02-17T11:10:37.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.234+0000 7f40e59e5640 1 -- 10.20.193.49:0/1955498600 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f40e00c7e20 msgr2=0x7f40e01444f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.234+0000 7f40e59e5640 1 --2- 10.20.193.49:0/1955498600 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f40e00c7e20 0x7f40e01444f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.234+0000 7f40e59e5640 1 -- 10.20.193.49:0/1955498600 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f40e00c74c0 msgr2=0x7f40e01f5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.234+0000 7f40e59e5640 1 --2- 10.20.193.49:0/1955498600 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f40e00c74c0 0x7f40e01f5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.234+0000 7f40e59e5640 10 monclient: _finish_hunting 0 2026-02-17T11:10:37.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.234+0000 7f40e59e5640 1 monclient: found mon.noname-a 2026-02-17T11:10:37.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.234+0000 7f40e59e5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:37.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.234+0000 7f40e59e5640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:10:37.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.234+0000 7f40e59e5640 1 -- 10.20.193.49:0/1955498600 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40e0144f50 con 0x7f40e015d370 2026-02-17T11:10:37.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.237+0000 7f40e59e5640 1 --2- 10.20.193.49:0/1955498600 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f40e015d370 0x7f40e00cc890 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f40dc00b990 tx=0x7f40dc00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:37.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.237+0000 7f40cdffb640 10 client.?.objecter ms_handle_connect 0x7f40e015d370 2026-02-17T11:10:37.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.237+0000 7f40cdffb640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:37.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.237+0000 7f5fd9336640 1 -- 10.20.193.49:0/291886030 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd000a450 con 0x7f5fbc009ab0 2026-02-17T11:10:37.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.237+0000 7f5fd9336640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:37.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.237+0000 7f5fd9336640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:10:37.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.237+0000 7f5fd9336640 10 monclient: dump: 2026-02-17T11:10:37.238 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:37.238 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.238 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.238 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.239 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:37.239 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.239 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:37.239 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:37.239 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:37.239 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.237+0000 7f5fd9336640 1 -- 10.20.193.49:0/291886030 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fd0031660 con 0x7f5fbc009ab0 2026-02-17T11:10:37.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.237+0000 7f5fdc5c3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:10:37.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.237+0000 7f5fd9336640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:37.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.237+0000 7f5fdc5c3640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:37.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.237+0000 7f5fd9336640 1 -- 10.20.193.49:0/291886030 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd0031a50 con 0x7f5fbc009ab0 2026-02-17T11:10:37.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.237+0000 7f5fd9336640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:37.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.237+0000 7f5fdc5c3640 4 set_mon_vals no callback set 2026-02-17T11:10:37.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.237+0000 7f5fd9336640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:10:37.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.237+0000 7f5fd9336640 10 monclient: dump: 2026-02-17T11:10:37.239 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:37.239 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.239 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.239 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.239 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:37.239 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.239 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:37.239 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:37.239 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:37.239 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.238+0000 7f5fdc5c3640 10 monclient: shutdown 2026-02-17T11:10:37.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.238+0000 7f5fdc5c3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:37.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.238+0000 7f5fdc5c3640 1 -- 10.20.193.49:0/291886030 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5fbc009ab0 msgr2=0x7f5fbc00bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.238+0000 7f5fdc5c3640 1 --2- 10.20.193.49:0/291886030 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5fbc009ab0 0x7f5fbc00bea0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5fd000a800 tx=0x7f5fd002fbd0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.238+0000 7f5fdc5c3640 1 -- 10.20.193.49:0/291886030 shutdown_connections 2026-02-17T11:10:37.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.238+0000 7f5fdc5c3640 1 --2- 10.20.193.49:0/291886030 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5fbc009ab0 0x7f5fbc00bea0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.238+0000 7f5fdc5c3640 1 -- 10.20.193.49:0/291886030 >> 10.20.193.49:0/291886030 conn(0x7f5fd40c9f40 msgr2=0x7f5fd40ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:37.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.238+0000 7f5fdc5c3640 1 -- 10.20.193.49:0/291886030 shutdown_connections 2026-02-17T11:10:37.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.238+0000 7f5fdc5c3640 1 -- 10.20.193.49:0/291886030 wait complete. 2026-02-17T11:10:37.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.238+0000 7f40e59e5640 1 -- 10.20.193.49:0/1955498600 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f40e015d370 msgr2=0x7f40e00cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-17T11:10:37.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.238+0000 7f40e59e5640 1 -- 10.20.193.49:0/1955498600 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f40e015d370 msgr2=0x7f40e00cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:10:37.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.238+0000 7f40e59e5640 1 --2- 10.20.193.49:0/1955498600 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f40e015d370 0x7f40e00cc890 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f40dc00b990 tx=0x7f40dc00be60 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:10:37.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.238+0000 7f40e59e5640 1 --2- 10.20.193.49:0/1955498600 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f40e015d370 0x7f40e00cc890 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f40dc00b990 tx=0x7f40dc00be60 comp rx=0 tx=0).stop 2026-02-17T11:10:37.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.238+0000 7f40cdffb640 10 monclient: ms_handle_reset current mon [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:37.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.238+0000 7f40cdffb640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:37.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.238+0000 7f40cdffb640 1 -- 10.20.193.49:0/1955498600 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f40e015d370 msgr2=0x7f40e00cc890 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:10:37.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.238+0000 7f40cdffb640 1 --2- 10.20.193.49:0/1955498600 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f40e015d370 0x7f40e00cc890 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.238+0000 7f40cdffb640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:10:37.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.238+0000 7f40cdffb640 1 --2- 10.20.193.49:0/1955498600 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f40e00c7e20 0x7f40b0006f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.238+0000 7f40cdffb640 10 monclient(hunting): picked mon.noname-c con 0x7f40e00c7e20 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:37.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.238+0000 7f40cdffb640 1 --2- 10.20.193.49:0/1955498600 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f40e00c74c0 0x7f40b00099e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.238+0000 7f40cdffb640 10 monclient(hunting): picked mon.noname-b con 0x7f40e00c74c0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:37.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.238+0000 7f40cdffb640 1 --2- 10.20.193.49:0/1955498600 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f40b000a440 0x7f40b000c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.238+0000 7f40cdffb640 10 monclient(hunting): picked mon.noname-a con 0x7f40b000a440 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:37.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.238+0000 7f40cdffb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.238+0000 7f40cdffb640 1 -- 10.20.193.49:0/1955498600 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f40b000d3d0 con 0x7f40b000a440 2026-02-17T11:10:37.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.238+0000 7f40cdffb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.238+0000 7f40cdffb640 1 -- 10.20.193.49:0/1955498600 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f40b000d550 con 0x7f40e00c74c0 2026-02-17T11:10:37.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.238+0000 7f40cdffb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.238+0000 7f40cdffb640 1 -- 10.20.193.49:0/1955498600 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f40b000d750 con 0x7f40e00c7e20 2026-02-17T11:10:37.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.238+0000 7f40cdffb640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:37.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.238+0000 7f5fdc5c3640 10 monclient: build_initial_monmap 2026-02-17T11:10:37.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.238+0000 7f5fdc5c3640 10 monclient: monmap: 2026-02-17T11:10:37.241 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:37.241 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:37.241 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:37.241 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:37.241 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:37.241 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.241 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:37.241 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:37.241 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:37.241 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.239+0000 7f5fdc5c3640 1 librados: starting msgr at 2026-02-17T11:10:37.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.239+0000 7f5fdc5c3640 1 librados: starting objecter 2026-02-17T11:10:37.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.239+0000 7f5fdc5c3640 1 Processor -- start 2026-02-17T11:10:37.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.239+0000 7f5fdc5c3640 1 -- start start 2026-02-17T11:10:37.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.239+0000 7f5fdc5c3640 1 librados: setting wanted keys 2026-02-17T11:10:37.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.239+0000 7f5fdc5c3640 1 librados: calling monclient init 2026-02-17T11:10:37.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.239+0000 7f5fdc5c3640 10 monclient: init 2026-02-17T11:10:37.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.239+0000 7f5fdc5c3640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:37.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.239+0000 7f5fdc5c3640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:10:37.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.239+0000 7f5fdc5c3640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5fbc009ab0 0x7f5fd41f7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.239+0000 7f5fdc5c3640 10 monclient(hunting): picked mon.noname-c con 0x7f5fbc009ab0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:37.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.239+0000 7f5fdc5c3640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5fd40c17e0 0x7f5fd40c36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.239+0000 7f5fdc5c3640 10 monclient(hunting): picked mon.noname-b con 0x7f5fd40c17e0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:37.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.239+0000 7f5fdc5c3640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5fd40c3c30 0x7f5fd4156590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.239+0000 7f5fdc5c3640 10 monclient(hunting): picked mon.noname-a con 0x7f5fd40c3c30 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:37.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.239+0000 7f5fdc5c3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.239+0000 7f5fdc5c3640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd40c81c0 con 0x7f5fd40c3c30 2026-02-17T11:10:37.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.239+0000 7f5fdc5c3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.239+0000 7f5fdc5c3640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd40c7ee0 con 0x7f5fd40c17e0 2026-02-17T11:10:37.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.239+0000 7f5fdc5c3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.239+0000 7f5fdc5c3640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd40c4d10 con 0x7f5fbc009ab0 2026-02-17T11:10:37.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.239+0000 7f5fdc5c3640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:37.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.239+0000 7f5fdc5c3640 10 monclient(hunting): authenticate will time out at 1113.902647s 2026-02-17T11:10:37.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.241+0000 7f40e59e5640 1 --2- 10.20.193.49:0/1955498600 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f40b000a440 0x7f40b000c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:37.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.241+0000 7f40e59e5640 10 monclient(hunting): get_auth_request con 0x7f40b000a440 auth_method 0 2026-02-17T11:10:37.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.241+0000 7f40e59e5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:37.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.241+0000 7f40e59e5640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:37.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.241+0000 7f40e59e5640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:10:37.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.241+0000 7f40e59e5640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:37.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.241+0000 7f40e59e5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:37.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.241+0000 7f40e59e5640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:10:37.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.241+0000 7f5fdab39640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5fd40c3c30 0x7f5fd4156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:37.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.242+0000 7f40e59e5640 10 monclient(hunting): handle_auth_done global_id 4548 payload 293 2026-02-17T11:10:37.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.242+0000 7f40e59e5640 1 -- 10.20.193.49:0/1955498600 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f40e00c7e20 msgr2=0x7f40b0006f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.242+0000 7f40e59e5640 1 --2- 10.20.193.49:0/1955498600 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f40e00c7e20 0x7f40b0006f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.242+0000 7f40e59e5640 1 -- 10.20.193.49:0/1955498600 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f40e00c74c0 msgr2=0x7f40b00099e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.242+0000 7f40e59e5640 1 --2- 10.20.193.49:0/1955498600 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f40e00c74c0 0x7f40b00099e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.242+0000 7f40e59e5640 10 monclient: _finish_hunting 0 2026-02-17T11:10:37.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.242+0000 7f40e59e5640 1 monclient: found mon.noname-a 2026-02-17T11:10:37.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.242+0000 7f40e59e5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:37.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.242+0000 7f40e59e5640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:10:37.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.242+0000 7f40e59e5640 1 -- 10.20.193.49:0/1955498600 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40b000da10 con 0x7f40b000a440 2026-02-17T11:10:37.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.242+0000 7f5fdab39640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5fd40c3c30 0x7f5fd4156590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:33522/0 (socket says 10.20.193.49:33522) 2026-02-17T11:10:37.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.242+0000 7f5fdab39640 1 -- 10.20.193.49:0/2499466160 learned_addr learned my addr 10.20.193.49:0/2499466160 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:37.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.242+0000 7f5fdab39640 10 monclient(hunting): get_auth_request con 0x7f5fd40c3c30 auth_method 0 2026-02-17T11:10:37.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.242+0000 7f5fdab39640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:37.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.242+0000 7f5fdab39640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:37.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.242+0000 7f5fdab39640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:37.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.243+0000 7f5fdab39640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:37.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.243+0000 7f5fdab39640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:37.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.243+0000 7f5fdab39640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:37.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.243+0000 7f40e59e5640 1 --2- 10.20.193.49:0/1955498600 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f40b000a440 0x7f40b000c8d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f40dc00bfd0 tx=0x7f40dc009710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:37.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.243+0000 7f40cdffb640 10 client.?.objecter ms_handle_connect 0x7f40b000a440 2026-02-17T11:10:37.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.243+0000 7f40cdffb640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:37.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.245+0000 7f5fdab39640 10 monclient(hunting): handle_auth_done global_id 4551 payload 824 2026-02-17T11:10:37.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.245+0000 7f5fdab39640 1 -- 10.20.193.49:0/2499466160 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5fbc009ab0 msgr2=0x7f5fd41f7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.245+0000 7f5fdab39640 1 --2- 10.20.193.49:0/2499466160 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5fbc009ab0 0x7f5fd41f7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.245+0000 7f5fdab39640 1 -- 10.20.193.49:0/2499466160 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5fd40c17e0 msgr2=0x7f5fd40c36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.245+0000 7f5fdab39640 1 --2- 10.20.193.49:0/2499466160 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5fd40c17e0 0x7f5fd40c36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.245+0000 7f5fdab39640 10 monclient: _finish_hunting 0 2026-02-17T11:10:37.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.245+0000 7f5fdab39640 1 monclient: found mon.noname-a 2026-02-17T11:10:37.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.245+0000 7f5fdab39640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:37.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.245+0000 7f5fdab39640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:10:37.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.245+0000 7f5fdab39640 1 -- 10.20.193.49:0/2499466160 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fd41f7570 con 0x7f5fd40c3c30 2026-02-17T11:10:37.248 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.247+0000 7f5fdab39640 1 --2- 10.20.193.49:0/2499466160 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5fd40c3c30 0x7f5fd4156590 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5fd002fc10 tx=0x7f5fd40c5720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:37.248 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.247+0000 7f5fbaffd640 10 client.?.objecter ms_handle_connect 0x7f5fd40c3c30 2026-02-17T11:10:37.248 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.247+0000 7f5fbaffd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:37.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.248+0000 7f40cdffb640 1 -- 10.20.193.49:0/1955498600 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40dc006e60 con 0x7f40b000a440 2026-02-17T11:10:37.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.248+0000 7f40cdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:37.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.248+0000 7f40cdffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:10:37.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.248+0000 7f40cdffb640 10 monclient: dump: 2026-02-17T11:10:37.249 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:37.249 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.249 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.250 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.250 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:37.250 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.250 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:37.250 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:37.250 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:37.250 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.248+0000 7f40cdffb640 10 monclient: _finish_auth 0 2026-02-17T11:10:37.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.248+0000 7f40cdffb640 10 monclient: _check_auth_tickets 2026-02-17T11:10:37.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.248+0000 7f40cdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:37.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.248+0000 7f40cdffb640 1 -- 10.20.193.49:0/1955498600 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40dc010070 con 0x7f40b000a440 2026-02-17T11:10:37.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.248+0000 7f40e746f640 5 monclient: authenticate success, global_id 4548 2026-02-17T11:10:37.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.248+0000 7f40e746f640 10 monclient: _renew_subs 2026-02-17T11:10:37.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.248+0000 7f40e746f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:37.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.248+0000 7f40e746f640 1 -- 10.20.193.49:0/1955498600 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40e01f2480 con 0x7f40b000a440 2026-02-17T11:10:37.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.248+0000 7f40cdffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:37.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.248+0000 7f40cdffb640 1 -- 10.20.193.49:0/1955498600 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40dc002d30 con 0x7f40b000a440 2026-02-17T11:10:37.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.248+0000 7f40cdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:37.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.248+0000 7f40cdffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:10:37.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.248+0000 7f40cf7fe640 4 set_mon_vals no callback set 2026-02-17T11:10:37.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.248+0000 7f40cdffb640 10 monclient: dump: 2026-02-17T11:10:37.250 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:37.250 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.250 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.250 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.250 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:37.250 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.250 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:37.250 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:37.250 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:37.250 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.248+0000 7f40e746f640 10 client.4548.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:37.251 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.248+0000 7f40e746f640 10 monclient: _renew_subs 2026-02-17T11:10:37.251 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.248+0000 7f40e746f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:37.251 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.248+0000 7f40e746f640 1 -- 10.20.193.49:0/1955498600 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40e00cbdb0 con 0x7f40b000a440 2026-02-17T11:10:37.251 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.248+0000 7f40e746f640 1 librados: init done 2026-02-17T11:10:37.251 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.249+0000 7f40e746f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:37.251 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.249+0000 7f40e746f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:37.251 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.249+0000 7f40e746f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:37.251 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.249+0000 7f40e746f640 1 -- 10.20.193.49:0/1955498600 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40e015d750 con 0x7f40b000a440 2026-02-17T11:10:37.251 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.249+0000 7fed0e9fb640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-17T11:10:37.251 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.249+0000 7fed0e9fb640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-17T11:10:37.251 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.249+0000 7fed0e9fb640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:37.251 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.249+0000 7fed0e9fb640 1 -- 10.20.193.49:0/2151066935 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fed08156390 con 0x7fed0814f280 2026-02-17T11:10:37.252 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.250+0000 7f5fbaffd640 1 -- 10.20.193.49:0/2499466160 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd0003780 con 0x7f5fd40c3c30 2026-02-17T11:10:37.252 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.250+0000 7f5fbaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:37.252 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.250+0000 7f5fbaffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:10:37.252 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.250+0000 7f5fbaffd640 10 monclient: dump: 2026-02-17T11:10:37.252 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:37.252 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.252 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.252 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.252 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:37.252 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.252 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:37.252 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:37.252 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:37.252 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.252 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.250+0000 7f5fbaffd640 10 monclient: _finish_auth 0 2026-02-17T11:10:37.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.250+0000 7f5fbaffd640 10 monclient: _check_auth_tickets 2026-02-17T11:10:37.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.250+0000 7f5fbaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:37.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.250+0000 7f5fbaffd640 1 -- 10.20.193.49:0/2499466160 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fd0031c20 con 0x7f5fd40c3c30 2026-02-17T11:10:37.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.250+0000 7f5fbaffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:37.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.250+0000 7f5fbaffd640 1 -- 10.20.193.49:0/2499466160 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd003b450 con 0x7f5fd40c3c30 2026-02-17T11:10:37.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.250+0000 7f5fdc5c3640 5 monclient: authenticate success, global_id 4551 2026-02-17T11:10:37.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.250+0000 7f5fdc5c3640 10 monclient: _renew_subs 2026-02-17T11:10:37.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.250+0000 7f5fd8b35640 4 set_mon_vals no callback set 2026-02-17T11:10:37.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.250+0000 7f5fdc5c3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:37.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.250+0000 7f5fdc5c3640 1 -- 10.20.193.49:0/2499466160 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fd40c4330 con 0x7f5fd40c3c30 2026-02-17T11:10:37.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.250+0000 7f5fbaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:37.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.250+0000 7f5fbaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:10:37.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.250+0000 7f5fbaffd640 10 monclient: dump: 2026-02-17T11:10:37.253 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:37.253 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.253 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.253 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.253 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:37.253 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.253 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:37.253 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:37.253 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:37.253 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.250+0000 7f5fdc5c3640 10 client.4551.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:37.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.250+0000 7f5fdc5c3640 10 monclient: _renew_subs 2026-02-17T11:10:37.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.250+0000 7f5fdc5c3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:37.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.250+0000 7f5fdc5c3640 1 -- 10.20.193.49:0/2499466160 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fd41574d0 con 0x7f5fd40c3c30 2026-02-17T11:10:37.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.250+0000 7f5fdc5c3640 1 librados: init done 2026-02-17T11:10:37.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.250+0000 7f5fdc5c3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:37.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.251+0000 7f5fdc5c3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:37.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.251+0000 7f5fdc5c3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:37.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.251+0000 7f5fdc5c3640 1 -- 10.20.193.49:0/2499466160 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fd40749b0 con 0x7f5fd40c3c30 2026-02-17T11:10:37.282 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.281+0000 7f949129f640 10 monclient: get_monmap_and_config 2026-02-17T11:10:37.282 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.281+0000 7f949129f640 10 monclient: build_initial_monmap 2026-02-17T11:10:37.282 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.281+0000 7f949129f640 10 monclient: monmap: 2026-02-17T11:10:37.282 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:37.282 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.282 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:37.281852+0000 2026-02-17T11:10:37.283 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:37.281852+0000 2026-02-17T11:10:37.283 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:37.283 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.283 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:37.283 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:37.283 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:37.283 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:37.283 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:37.283 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:37.283 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.284 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.281+0000 7f949129f640 1 Processor -- start 2026-02-17T11:10:37.284 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.281+0000 7f949129f640 1 -- start start 2026-02-17T11:10:37.284 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.281+0000 7f949129f640 10 monclient: init 2026-02-17T11:10:37.284 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.282+0000 7f949129f640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:37.284 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.282+0000 7f949129f640 10 monclient: _add_conns ranks=[5,1,0,2,3,4] 2026-02-17T11:10:37.284 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.282+0000 7f949129f640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f948c152820 0x7f948c1593f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.284 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.282+0000 7f949129f640 10 monclient(hunting): picked mon.noname-c con 0x7f948c152820 addr v2:10.20.193.157:3300/0 2026-02-17T11:10:37.284 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.282+0000 7f949129f640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f948c152c00 addr v1:10.20.193.97:6789/0 2026-02-17T11:10:37.284 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.282+0000 7f949129f640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f948c0738f0 addr v1:10.20.193.49:6789/0 2026-02-17T11:10:37.284 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.282+0000 7f949129f640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f948c073e90 con 0x7f948c0738f0 2026-02-17T11:10:37.284 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.282+0000 7f949129f640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f948c074170 con 0x7f948c152c00 2026-02-17T11:10:37.284 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.282+0000 7f949129f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.284 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.282+0000 7f949129f640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f948c159930 con 0x7f948c152820 2026-02-17T11:10:37.284 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.282+0000 7f949129f640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:37.284 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.282+0000 7f949129f640 10 monclient(hunting): authenticate will time out at 1113.945579s 2026-02-17T11:10:37.284 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.283+0000 7f36cfd6e640 10 monclient: get_monmap_and_config 2026-02-17T11:10:37.284 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.283+0000 7f36cfd6e640 10 monclient: build_initial_monmap 2026-02-17T11:10:37.284 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.283+0000 7f36cfd6e640 10 monclient: monmap: 2026-02-17T11:10:37.284 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:37.285 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.285 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:37.283703+0000 2026-02-17T11:10:37.285 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:37.283703+0000 2026-02-17T11:10:37.285 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:37.285 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.285 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:37.285 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:37.285 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:37.285 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:37.285 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:37.285 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:37.285 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.285 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.283+0000 7f36cfd6e640 1 Processor -- start 2026-02-17T11:10:37.285 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.283+0000 7f36cfd6e640 1 -- start start 2026-02-17T11:10:37.285 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.283+0000 7f36cfd6e640 10 monclient: init 2026-02-17T11:10:37.285 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.284+0000 7f36cfd6e640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:37.285 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.284+0000 7f36cfd6e640 10 monclient: _add_conns ranks=[3,5,4,1,0,2] 2026-02-17T11:10:37.285 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.284+0000 7f36cfd6e640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f36c8152700 0x7f36c815e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.286 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.284+0000 7f36cfd6e640 10 monclient(hunting): picked mon.noname-a con 0x7f36c8152700 addr v2:10.20.193.49:3300/0 2026-02-17T11:10:37.286 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.284+0000 7f36cfd6e640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f36c8152ae0 0x7f36c815edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.286 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.284+0000 7f36cfd6e640 10 monclient(hunting): picked mon.noname-c con 0x7f36c8152ae0 addr v2:10.20.193.157:3300/0 2026-02-17T11:10:37.286 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.284+0000 7f36cfd6e640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f36c80c9730 0x7f36c80c9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.286 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.284+0000 7f36cfd6e640 10 monclient(hunting): picked mon.noname-b con 0x7f36c80c9730 addr v2:10.20.193.97:3300/0 2026-02-17T11:10:37.286 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.284+0000 7f36cfd6e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.286 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.284+0000 7f36cfd6e640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f36c815d4f0 con 0x7f36c8152700 2026-02-17T11:10:37.286 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.284+0000 7f36cfd6e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.286 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.284+0000 7f36cfd6e640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f36c815d7d0 con 0x7f36c80c9730 2026-02-17T11:10:37.286 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.284+0000 7f36cfd6e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.286 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.284+0000 7f36cfd6e640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f36c815dab0 con 0x7f36c8152ae0 2026-02-17T11:10:37.286 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.284+0000 7f36cfd6e640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:37.286 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.284+0000 7f36cfd6e640 10 monclient(hunting): authenticate will time out at 1113.947182s 2026-02-17T11:10:37.290 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.289+0000 7fde90296640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-17T11:10:37.290 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.289+0000 7fde90296640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-17T11:10:37.290 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.289+0000 7fde90296640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:37.290 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.289+0000 7fde90296640 1 -- 10.20.193.49:0/174857959 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 13} v 0) -- 0x7fde881f51e0 con 0x7fde8814f660 2026-02-17T11:10:37.294 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.293+0000 7f318affd640 1 -- 10.20.193.49:0/995141424 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7f3194042d80 con 0x7f31a015bf30 2026-02-17T11:10:37.294 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.293+0000 7f318affd640 10 client.4528.objecter ms_dispatch2 0x7f31a0000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:37.294 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.293+0000 7f318affd640 3 client.4528.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:37.294 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.293+0000 7f318affd640 3 client.4528.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:37.294 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.293+0000 7f318affd640 20 client.4528.objecter dump_active .. 0 homeless 2026-02-17T11:10:37.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.299+0000 7f318affd640 1 -- 10.20.193.49:0/995141424 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f3194051030 con 0x7f31a015bf30 2026-02-17T11:10:37.301 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.299+0000 7f318affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:37.301 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.299+0000 7f318affd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:37.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.303+0000 7fc4bb7fe640 1 --1- >> v1:10.20.193.97:6789/0 conn(0x7fc4bc0d1f40 0x7fc4bc15d950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.97:6789/0 says I am v1:10.20.193.49:34872/0 (socket says 10.20.193.49:34872) 2026-02-17T11:10:37.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.303+0000 7fc4bb7fe640 1 -- 10.20.193.49:0/2439487116 learned_addr learned my addr 10.20.193.49:0/2439487116 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:10:37.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.305+0000 7f5b1556a640 1 -- 10.20.193.49:0/3581126632 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b0003c070 con 0x7f5b100ce5d0 2026-02-17T11:10:37.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.305+0000 7f5b1556a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:37.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.305+0000 7f5b1556a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:10:37.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.305+0000 7f5b1556a640 10 monclient: dump: 2026-02-17T11:10:37.306 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:37.306 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.306 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.306 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.307 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:37.307 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.307 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:37.307 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:37.307 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:37.307 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.307 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.305+0000 7f5b1556a640 10 monclient: _finish_auth 0 2026-02-17T11:10:37.307 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.305+0000 7f5b1556a640 10 monclient: _check_auth_tickets 2026-02-17T11:10:37.307 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.305+0000 7f5b1556a640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:37.307 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.305+0000 7f5b1556a640 1 -- 10.20.193.49:0/3581126632 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b0002faf0 con 0x7f5b100ce5d0 2026-02-17T11:10:37.307 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.305+0000 7f5b1556a640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:37.307 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.305+0000 7f5b1556a640 1 -- 10.20.193.49:0/3581126632 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b00037440 con 0x7f5b100ce5d0 2026-02-17T11:10:37.307 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.305+0000 7f5b1556a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:37.307 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.305+0000 7f5b1556a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:37.307 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.305+0000 7f5b1556a640 10 monclient: dump: 2026-02-17T11:10:37.307 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:37.307 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.307 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.307 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.307 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:37.307 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.307 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:37.307 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:37.307 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:37.307 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.307 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.305+0000 7f5b187f7640 5 monclient: authenticate success, global_id 4525 2026-02-17T11:10:37.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.305+0000 7f5b187f7640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:37.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.305+0000 7f5b187f7640 4 set_mon_vals no callback set 2026-02-17T11:10:37.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.305+0000 7f948a7fc640 1 --1- >> v1:10.20.193.97:6789/0 conn(0x7f948c152c00 0x7f948c0c7e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.97:6789/0 says I am v1:10.20.193.49:34888/0 (socket says 10.20.193.49:34888) 2026-02-17T11:10:37.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.305+0000 7f948a7fc640 1 -- 10.20.193.49:0/1234628709 learned_addr learned my addr 10.20.193.49:0/1234628709 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:10:37.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.305+0000 7f5b187f7640 10 monclient: shutdown 2026-02-17T11:10:37.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.305+0000 7f5b187f7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:37.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.305+0000 7f5b187f7640 1 -- 10.20.193.49:0/3581126632 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5b100ce5d0 msgr2=0x7f5b100d18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.305+0000 7f5b187f7640 1 --2- 10.20.193.49:0/3581126632 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5b100ce5d0 0x7f5b100d18c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5b100cf4c0 tx=0x7f5b0002ede0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.305+0000 7f5b187f7640 1 -- 10.20.193.49:0/3581126632 shutdown_connections 2026-02-17T11:10:37.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.305+0000 7f5b187f7640 1 --2- 10.20.193.49:0/3581126632 >> v2:10.20.193.49:3300/0 conn(0x7f5b100c9780 0x7f5b100c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.305+0000 7f5b187f7640 1 --2- 10.20.193.49:0/3581126632 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5b100ce5d0 0x7f5b100d18c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.305+0000 7f5b187f7640 1 -- 10.20.193.49:0/3581126632 >> 10.20.193.49:0/3581126632 conn(0x7f5b10073030 msgr2=0x7f5b10073440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:37.310 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.305+0000 7f5b187f7640 1 -- 10.20.193.49:0/3581126632 shutdown_connections 2026-02-17T11:10:37.310 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.305+0000 7f5b187f7640 1 -- 10.20.193.49:0/3581126632 wait complete. 2026-02-17T11:10:37.310 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.306+0000 7f5b187f7640 10 monclient: build_initial_monmap 2026-02-17T11:10:37.310 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.306+0000 7f5b187f7640 10 monclient: monmap: 2026-02-17T11:10:37.310 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:37.310 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:37.310 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:37.310 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:37.310 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:37.310 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.310 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:37.310 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:37.310 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:37.310 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.310 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.306+0000 7f5b187f7640 1 librados: starting msgr at 2026-02-17T11:10:37.310 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.306+0000 7f5b187f7640 1 librados: starting objecter 2026-02-17T11:10:37.310 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.306+0000 7f5b187f7640 1 Processor -- start 2026-02-17T11:10:37.310 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.306+0000 7f5b187f7640 1 -- start start 2026-02-17T11:10:37.310 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.306+0000 7f5b187f7640 1 librados: setting wanted keys 2026-02-17T11:10:37.310 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.306+0000 7f5b187f7640 1 librados: calling monclient init 2026-02-17T11:10:37.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.306+0000 7f5b187f7640 10 monclient: init 2026-02-17T11:10:37.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.307+0000 7f5b187f7640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:37.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.307+0000 7f5b187f7640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:10:37.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.307+0000 7f5b187f7640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5b100c9780 0x7f5b101537e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.307+0000 7f5b187f7640 10 monclient(hunting): picked mon.noname-a con 0x7f5b100c9780 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:37.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.307+0000 7f5b187f7640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5b100ce5d0 0x7f5b1015eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.307+0000 7f5b187f7640 10 monclient(hunting): picked mon.noname-b con 0x7f5b100ce5d0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:37.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.307+0000 7f5b187f7640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5b1015bf30 0x7f5b1015f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.307+0000 7f5b187f7640 10 monclient(hunting): picked mon.noname-c con 0x7f5b1015bf30 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:37.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.307+0000 7f5b187f7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.307+0000 7f5b187f7640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5b100ca0d0 con 0x7f5b100c9780 2026-02-17T11:10:37.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.307+0000 7f5b187f7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.307+0000 7f5b187f7640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f5b100c9260 con 0x7f5b100ce5d0 2026-02-17T11:10:37.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.307+0000 7f5b187f7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.307+0000 7f5b187f7640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f5b100cbc30 con 0x7f5b1015bf30 2026-02-17T11:10:37.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.307+0000 7f5b187f7640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:37.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.307+0000 7f5b187f7640 10 monclient(hunting): authenticate will time out at 1113.970168s 2026-02-17T11:10:37.362 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.361+0000 7f40cdffb640 1 -- 10.20.193.49:0/1955498600 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f40dc00c9a0 con 0x7f40b000a440 2026-02-17T11:10:37.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.362+0000 7f40cdffb640 1 --2- 10.20.193.49:0/1955498600 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f40e015d370 0x7f40b00837d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.362+0000 7f40e51e4640 1 --2- 10.20.193.49:0/1955498600 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f40e015d370 0x7f40b00837d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:37.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.362+0000 7f40e51e4640 10 monclient: get_auth_request con 0x7f40e015d370 auth_method 0 2026-02-17T11:10:37.364 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.363+0000 7f40e51e4640 1 --2- 10.20.193.49:0/1955498600 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f40e015d370 0x7f40b00837d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f40e015d060 tx=0x7f40d0031070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:37.364 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.363+0000 7f40cdffb640 10 client.4548.objecter ms_handle_connect 0x7f40e015d370 2026-02-17T11:10:37.369 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.367+0000 7f5fbaffd640 1 -- 10.20.193.49:0/2499466160 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f5fd003b610 con 0x7f5fd40c3c30 2026-02-17T11:10:37.369 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.368+0000 7f5fbaffd640 1 --2- 10.20.193.49:0/2499466160 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5fa4079140 0x7f5fa407b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.370 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.368+0000 7f5fda338640 1 --2- 10.20.193.49:0/2499466160 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5fa4079140 0x7f5fa407b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:37.370 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.368+0000 7f5fda338640 10 monclient: get_auth_request con 0x7f5fa4079140 auth_method 0 2026-02-17T11:10:37.370 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.368+0000 7f5fbaffd640 10 client.4551.objecter ms_handle_connect 0x7f5fa4079140 2026-02-17T11:10:37.370 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.368+0000 7f5fda338640 1 --2- 10.20.193.49:0/2499466160 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5fa4079140 0x7f5fa407b600 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5fc400ab10 tx=0x7f5fc4009250 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:37.377 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.375+0000 7f40cdffb640 1 -- 10.20.193.49:0/1955498600 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7f40dc05f0b0 con 0x7f40b000a440 2026-02-17T11:10:37.377 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.375+0000 7f40cdffb640 10 client.4548.objecter ms_dispatch2 0x7f40e0000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:37.377 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.375+0000 7f40cdffb640 3 client.4548.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:37.377 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.375+0000 7f40cdffb640 3 client.4548.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:37.377 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.375+0000 7f40cdffb640 20 client.4548.objecter dump_active .. 0 homeless 2026-02-17T11:10:37.377 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.375+0000 7f40cdffb640 1 -- 10.20.193.49:0/1955498600 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f40dc063070 con 0x7f40b000a440 2026-02-17T11:10:37.378 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.375+0000 7f40cdffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:37.378 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.375+0000 7f40cdffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:37.379 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.378+0000 7fb3927fc640 1 -- 10.20.193.49:0/228728157 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7fb3a00127e0 con 0x7fb3a415d950 2026-02-17T11:10:37.379 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.378+0000 7fb3927fc640 1 --2- 10.20.193.49:0/228728157 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb374079140 0x7fb37407b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.378+0000 7fb3a9a06640 1 --2- 10.20.193.49:0/228728157 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb374079140 0x7fb37407b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:37.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.378+0000 7fb3a9a06640 10 monclient: get_auth_request con 0x7fb374079140 auth_method 0 2026-02-17T11:10:37.381 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.379+0000 7fb3927fc640 1 -- 10.20.193.49:0/228728157 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7fb3a005ebd0 con 0x7fb3a415d950 2026-02-17T11:10:37.381 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.379+0000 7fb3927fc640 10 client.4538.objecter ms_dispatch2 0x7fb3a4000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:37.381 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.379+0000 7fb3927fc640 3 client.4538.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:37.381 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.379+0000 7fb3927fc640 3 client.4538.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:37.381 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.379+0000 7fb3927fc640 20 client.4538.objecter dump_active .. 0 homeless 2026-02-17T11:10:37.381 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.379+0000 7fb3927fc640 10 client.4538.objecter ms_handle_connect 0x7fb374079140 2026-02-17T11:10:37.382 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.379+0000 7fb3a9a06640 1 --2- 10.20.193.49:0/228728157 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb374079140 0x7fb37407b600 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb394009750 tx=0x7fb394006ca0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:37.384 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.382+0000 7f31a88c4640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-17T11:10:37.384 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.382+0000 7f31a88c4640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-17T11:10:37.384 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.382+0000 7f31a88c4640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:37.384 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.382+0000 7f31a88c4640 1 -- 10.20.193.49:0/995141424 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f31a00cbdb0 con 0x7f31a015bf30 2026-02-17T11:10:37.393 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.392+0000 7fb3927fc640 1 -- 10.20.193.49:0/228728157 <== mon.2 v2:10.20.193.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb3a0020020 con 0x7fb3a415d950 2026-02-17T11:10:37.393 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.392+0000 7fb3927fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:37.393 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.392+0000 7fb3927fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:37.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.392+0000 7f39aeffd640 1 -- 10.20.193.49:0/2243935134 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f39b80415f0 con 0x7f39c41561f0 2026-02-17T11:10:37.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.393+0000 7f39aeffd640 1 --2- 10.20.193.49:0/2243935134 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3994079140 0x7f399407b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.393+0000 7f39ca656640 1 --2- 10.20.193.49:0/2243935134 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3994079140 0x7f399407b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:37.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.393+0000 7f39ca656640 10 monclient: get_auth_request con 0x7f3994079140 auth_method 0 2026-02-17T11:10:37.396 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.393+0000 7f39aeffd640 10 client.4541.objecter ms_handle_connect 0x7f3994079140 2026-02-17T11:10:37.396 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.393+0000 7f39ca656640 1 --2- 10.20.193.49:0/2243935134 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3994079140 0x7f399407b600 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f39bc006fd0 tx=0x7f39bc006d40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:37.396 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.394+0000 7f39aeffd640 1 -- 10.20.193.49:0/2243935134 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7f39b80bd720 con 0x7f39c41561f0 2026-02-17T11:10:37.396 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.394+0000 7f39aeffd640 10 client.4541.objecter ms_dispatch2 0x7f39c4000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:37.396 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.394+0000 7f39aeffd640 3 client.4541.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:37.396 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.394+0000 7f39aeffd640 3 client.4541.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:37.396 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.394+0000 7f39aeffd640 20 client.4541.objecter dump_active .. 0 homeless 2026-02-17T11:10:37.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.401+0000 7f39aeffd640 1 -- 10.20.193.49:0/2243935134 <== mon.2 v2:10.20.193.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f39b8050030 con 0x7f39c41561f0 2026-02-17T11:10:37.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.401+0000 7f39aeffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:37.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.401+0000 7f39aeffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:37.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.405+0000 7f36ce2e4640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f36c80c9730 0x7f36c80c9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:37.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.406+0000 7f36ce2e4640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f36c80c9730 0x7f36c80c9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:55632/0 (socket says 10.20.193.49:55632) 2026-02-17T11:10:37.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.406+0000 7f36ce2e4640 1 -- 10.20.193.49:0/3655024785 learned_addr learned my addr 10.20.193.49:0/3655024785 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:37.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.406+0000 7f36ce2e4640 10 monclient(hunting): get_auth_request con 0x7f36c80c9730 auth_method 0 2026-02-17T11:10:37.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.406+0000 7f36ce2e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:37.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.406+0000 7f36ce2e4640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:37.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.406+0000 7f36ce2e4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:37.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.407+0000 7f948affd640 1 --2- 10.20.193.49:0/1234628709 >> v2:10.20.193.157:3300/0 conn(0x7f948c152820 0x7f948c1593f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:37.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.407+0000 7f36ce2e4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:37.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.407+0000 7f36ce2e4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:37.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.407+0000 7f36ce2e4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:37.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.407+0000 7f948affd640 10 monclient(hunting): get_auth_request con 0x7f948c152820 auth_method 0 2026-02-17T11:10:37.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.407+0000 7f948affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:37.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.407+0000 7f948affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:37.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.407+0000 7f948affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:37.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.407+0000 7f36cd2e2640 1 --2- 10.20.193.49:0/3655024785 >> v2:10.20.193.157:3300/0 conn(0x7f36c8152ae0 0x7f36c815edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:37.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.408+0000 7f36cd2e2640 10 monclient(hunting): get_auth_request con 0x7f36c8152ae0 auth_method 0 2026-02-17T11:10:37.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.408+0000 7f36cd2e2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:37.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.408+0000 7f36cd2e2640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:37.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.408+0000 7f36cd2e2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:37.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.409+0000 7f948affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:37.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.409+0000 7f948affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:37.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.409+0000 7f948affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:37.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.409+0000 7f36ce2e4640 10 monclient(hunting): handle_auth_done global_id 4534 payload 274 2026-02-17T11:10:37.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.409+0000 7f36ce2e4640 1 -- 10.20.193.49:0/3655024785 >> v2:10.20.193.157:3300/0 conn(0x7f36c8152ae0 msgr2=0x7f36c815edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:37.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.409+0000 7f36ce2e4640 1 --2- 10.20.193.49:0/3655024785 >> v2:10.20.193.157:3300/0 conn(0x7f36c8152ae0 0x7f36c815edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.409+0000 7f36ce2e4640 1 -- 10.20.193.49:0/3655024785 >> v2:10.20.193.49:3300/0 conn(0x7f36c8152700 msgr2=0x7f36c815e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:37.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.409+0000 7f36ce2e4640 1 --2- 10.20.193.49:0/3655024785 >> v2:10.20.193.49:3300/0 conn(0x7f36c8152700 0x7f36c815e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.409+0000 7f36ce2e4640 10 monclient: _finish_hunting 0 2026-02-17T11:10:37.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.409+0000 7f36ce2e4640 1 monclient: found mon.noname-b 2026-02-17T11:10:37.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.409+0000 7f36ce2e4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:37.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.409+0000 7f36ce2e4640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:10:37.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.409+0000 7f36ce2e4640 1 -- 10.20.193.49:0/3655024785 --> v2:10.20.193.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36c815dd90 con 0x7f36c80c9730 2026-02-17T11:10:37.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.410+0000 7fc4c0ec9640 1 --2- 10.20.193.49:0/2439487116 >> v2:10.20.193.157:3300/0 conn(0x7fc4bc15e060 0x7fc4bc15c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:37.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.410+0000 7f948affd640 10 monclient(hunting): handle_auth_done global_id 4553 payload 274 2026-02-17T11:10:37.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.410+0000 7f948affd640 1 -- 10.20.193.49:0/1234628709 >> v1:10.20.193.97:6789/0 conn(0x7f948c152c00 legacy=0x7f948c0c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.410+0000 7f948affd640 1 -- 10.20.193.49:0/1234628709 >> v1:10.20.193.49:6789/0 conn(0x7f948c0738f0 legacy=0x7f948c0c5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:37.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.410+0000 7f948affd640 10 monclient: _finish_hunting 0 2026-02-17T11:10:37.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.410+0000 7f948affd640 1 monclient: found mon.noname-c 2026-02-17T11:10:37.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.410+0000 7f948affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:37.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.410+0000 7f948affd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:10:37.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.410+0000 7f948affd640 1 -- 10.20.193.49:0/1234628709 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f948c074450 con 0x7f948c152820 2026-02-17T11:10:37.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.411+0000 7fc4c0ec9640 10 monclient(hunting): get_auth_request con 0x7fc4bc15e060 auth_method 0 2026-02-17T11:10:37.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.411+0000 7fc4c0ec9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:37.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.411+0000 7fc4c0ec9640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:37.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.411+0000 7fc4c0ec9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:37.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.412+0000 7fc4c0ec9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:37.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.412+0000 7fc4c0ec9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:37.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.412+0000 7fc4c0ec9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:37.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.413+0000 7fc4c0ec9640 10 monclient(hunting): handle_auth_done global_id 4559 payload 274 2026-02-17T11:10:37.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.413+0000 7fc4c0ec9640 1 -- 10.20.193.49:0/2439487116 >> v1:10.20.193.157:6789/0 conn(0x7fc4bc0d1b60 legacy=0x7fc4bc0c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:37.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.413+0000 7fc4c0ec9640 1 -- 10.20.193.49:0/2439487116 >> v1:10.20.193.97:6789/0 conn(0x7fc4bc0d1f40 legacy=0x7fc4bc15d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.413+0000 7fc4c0ec9640 10 monclient: _finish_hunting 0 2026-02-17T11:10:37.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.413+0000 7fc4c0ec9640 1 monclient: found mon.noname-c 2026-02-17T11:10:37.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.413+0000 7fc4c0ec9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:37.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.413+0000 7fc4c0ec9640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:10:37.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.413+0000 7fc4c0ec9640 1 -- 10.20.193.49:0/2439487116 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4bc0c9ea0 con 0x7fc4bc15e060 2026-02-17T11:10:37.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.413+0000 7f948affd640 1 --2- 10.20.193.49:0/1234628709 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f948c152820 0x7f948c1593f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f94800098a0 tx=0x7f948002eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3a3155be1160ca4 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:37.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.415+0000 7f5b16d6d640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5b1015bf30 0x7f5b1015f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:37.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.415+0000 7fc4c0ec9640 1 --2- 10.20.193.49:0/2439487116 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc4bc15e060 0x7fc4bc15c840 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0009d90 tx=0x7fc4b002f1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6a2be9d12993f81 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:37.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.416+0000 7f5b16d6d640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5b1015bf30 0x7f5b1015f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:48318/0 (socket says 10.20.193.49:48318) 2026-02-17T11:10:37.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.416+0000 7f5b16d6d640 1 -- 10.20.193.49:0/3354965162 learned_addr learned my addr 10.20.193.49:0/3354965162 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:37.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.416+0000 7f5b16d6d640 10 monclient(hunting): get_auth_request con 0x7f5b1015bf30 auth_method 0 2026-02-17T11:10:37.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.416+0000 7f5b16d6d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:37.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.416+0000 7f5b16d6d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:37.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.416+0000 7f5b16d6d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:37.420 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.416+0000 7f5b16d6d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:37.420 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.416+0000 7f5b16d6d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:37.420 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.416+0000 7f5b16d6d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:37.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.418+0000 7f5b16d6d640 10 monclient(hunting): handle_auth_done global_id 4562 payload 824 2026-02-17T11:10:37.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.418+0000 7f5b16d6d640 1 -- 10.20.193.49:0/3354965162 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5b100ce5d0 msgr2=0x7f5b1015eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.418+0000 7f5b16d6d640 1 --2- 10.20.193.49:0/3354965162 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5b100ce5d0 0x7f5b1015eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.418+0000 7f5b16d6d640 1 -- 10.20.193.49:0/3354965162 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5b100c9780 msgr2=0x7f5b101537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.418+0000 7f5b16d6d640 1 --2- 10.20.193.49:0/3354965162 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5b100c9780 0x7f5b101537e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.418+0000 7f5b16d6d640 10 monclient: _finish_hunting 0 2026-02-17T11:10:37.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.418+0000 7f5b16d6d640 1 monclient: found mon.noname-c 2026-02-17T11:10:37.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.418+0000 7f5b16d6d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:37.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.418+0000 7f5b16d6d640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:10:37.422 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.418+0000 7f5b16d6d640 1 -- 10.20.193.49:0/3354965162 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b101f3c00 con 0x7f5b1015bf30 2026-02-17T11:10:37.422 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.419+0000 7fb992ffd640 1 -- 10.20.193.49:0/2139302021 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7fb99c041820 con 0x7fb9ac15d950 2026-02-17T11:10:37.423 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.419+0000 7fb992ffd640 1 --2- 10.20.193.49:0/2139302021 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb978079170 0x7fb97807b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.423 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.419+0000 7fb9aa575640 1 --2- 10.20.193.49:0/2139302021 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb978079170 0x7fb97807b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:37.423 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.419+0000 7fb9aa575640 10 monclient: get_auth_request con 0x7fb978079170 auth_method 0 2026-02-17T11:10:37.423 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.420+0000 7fb9aa575640 1 --2- 10.20.193.49:0/2139302021 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb978079170 0x7fb97807b630 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb9a0009770 tx=0x7fb9a0006cf0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:37.423 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.420+0000 7fb992ffd640 10 client.4531.objecter ms_handle_connect 0x7fb978079170 2026-02-17T11:10:37.423 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.420+0000 7f5b16d6d640 1 --2- 10.20.193.49:0/3354965162 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5b1015bf30 0x7f5b1015f040 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c00b970 tx=0x7f5b0c00be40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:37.424 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.420+0000 7f5af6ffd640 10 client.?.objecter ms_handle_connect 0x7f5b1015bf30 2026-02-17T11:10:37.424 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.420+0000 7f5af6ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:37.424 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.421+0000 7f0dc2ffd640 1 -- 10.20.193.49:0/3656177287 <== mon.2 v2:10.20.193.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f0dd0087190 con 0x7f0ddc0ccc00 2026-02-17T11:10:37.424 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.421+0000 7f0dc2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-17T11:10:37.424 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.421+0000 7f0dc2ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:37.425 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.421+0000 7fb992ffd640 1 -- 10.20.193.49:0/2139302021 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7fb99c083e70 con 0x7fb9ac15d950 2026-02-17T11:10:37.425 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.421+0000 7fb992ffd640 10 client.4531.objecter ms_dispatch2 0x7fb9ac000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:37.425 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.421+0000 7fb992ffd640 3 client.4531.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:37.425 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.421+0000 7fb992ffd640 3 client.4531.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:37.425 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.421+0000 7fb992ffd640 20 client.4531.objecter dump_active .. 0 homeless 2026-02-17T11:10:37.426 INFO:teuthology.orchestra.run.trial049.stdout:111669149702 2026-02-17T11:10:37.427 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.422+0000 7f9489ffb640 1 -- 10.20.193.49:0/1234628709 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f948003c070 con 0x7f948c152820 2026-02-17T11:10:37.427 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.422+0000 7f9489ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:37.427 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.422+0000 7f9489ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:10:37.427 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.422+0000 7f9489ffb640 10 monclient: dump: 2026-02-17T11:10:37.427 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:37.427 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.427 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.427 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.427 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:37.427 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.428 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:37.428 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:37.428 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:37.428 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.428 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.422+0000 7f9489ffb640 10 monclient: _finish_auth 0 2026-02-17T11:10:37.428 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.422+0000 7f9489ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:10:37.428 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.422+0000 7f9489ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:37.428 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.422+0000 7f9489ffb640 1 -- 10.20.193.49:0/1234628709 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f948002fb70 con 0x7f948c152820 2026-02-17T11:10:37.428 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.422+0000 7f9489ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:37.428 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.422+0000 7f9489ffb640 1 -- 10.20.193.49:0/1234628709 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9480037440 con 0x7f948c152820 2026-02-17T11:10:37.428 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.422+0000 7f9489ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:37.428 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.422+0000 7f9489ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:10:37.429 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.422+0000 7f9489ffb640 10 monclient: dump: 2026-02-17T11:10:37.429 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:37.429 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.429 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.429 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.429 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:37.429 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.429 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:37.429 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:37.429 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:37.429 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.429 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.422+0000 7f949129f640 5 monclient: authenticate success, global_id 4553 2026-02-17T11:10:37.429 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.422+0000 7f949129f640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:37.430 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.422+0000 7f949129f640 4 set_mon_vals no callback set 2026-02-17T11:10:37.431 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.422+0000 7fc4baffd640 1 -- 10.20.193.49:0/2439487116 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b003c070 con 0x7fc4bc15e060 2026-02-17T11:10:37.431 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.422+0000 7fc4baffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:37.431 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.422+0000 7fc4baffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:10:37.431 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.422+0000 7fc4baffd640 10 monclient: dump: 2026-02-17T11:10:37.431 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:37.431 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.431 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.431 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.431 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:37.431 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.431 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:37.432 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:37.432 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:37.432 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.432 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.422+0000 7fc4baffd640 10 monclient: _finish_auth 0 2026-02-17T11:10:37.432 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.422+0000 7fc4baffd640 10 monclient: _check_auth_tickets 2026-02-17T11:10:37.432 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.422+0000 7fc4baffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:37.432 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.422+0000 7fc4baffd640 1 -- 10.20.193.49:0/2439487116 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4b0037440 con 0x7fc4bc15e060 2026-02-17T11:10:37.432 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.422+0000 7fc4baffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:37.432 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.422+0000 7fc4baffd640 1 -- 10.20.193.49:0/2439487116 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b0037810 con 0x7fc4bc15e060 2026-02-17T11:10:37.432 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.422+0000 7fc4c2953640 5 monclient: authenticate success, global_id 4559 2026-02-17T11:10:37.432 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.422+0000 7fc4c2953640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:37.432 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.422+0000 7fc4c2953640 4 set_mon_vals no callback set 2026-02-17T11:10:37.432 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.422+0000 7fc4baffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:37.432 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.422+0000 7fc4baffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:10:37.433 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.422+0000 7fc4baffd640 10 monclient: dump: 2026-02-17T11:10:37.433 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:37.433 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.433 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.433 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.433 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:37.433 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.433 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:37.433 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:37.433 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:37.433 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.434 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.423+0000 7f949129f640 10 monclient: shutdown 2026-02-17T11:10:37.434 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.423+0000 7f949129f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:37.434 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.423+0000 7f949129f640 1 -- 10.20.193.49:0/1234628709 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f948c152820 msgr2=0x7f948c1593f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.434 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.423+0000 7f949129f640 1 --2- 10.20.193.49:0/1234628709 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f948c152820 0x7f948c1593f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f94800098a0 tx=0x7f948002eeb0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.434 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.423+0000 7f949129f640 1 -- 10.20.193.49:0/1234628709 shutdown_connections 2026-02-17T11:10:37.434 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.423+0000 7f949129f640 1 --2- 10.20.193.49:0/1234628709 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f948c152820 0x7f948c1593f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.434 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.423+0000 7f949129f640 1 -- 10.20.193.49:0/1234628709 >> 10.20.193.49:0/1234628709 conn(0x7f948c0c9f40 msgr2=0x7f948c0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:37.435 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.423+0000 7f5af6ffd640 1 -- 10.20.193.49:0/3354965162 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c00c790 con 0x7f5b1015bf30 2026-02-17T11:10:37.435 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.423+0000 7f5af6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:37.435 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.423+0000 7f5af6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:10:37.435 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.423+0000 7f5af6ffd640 10 monclient: dump: 2026-02-17T11:10:37.435 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:37.435 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.435 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.435 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.435 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:37.435 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.435 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:37.435 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:37.435 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:37.436 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.436 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.423+0000 7f5af6ffd640 10 monclient: _finish_auth 0 2026-02-17T11:10:37.436 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.423+0000 7f5af6ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:10:37.436 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.423+0000 7f5af6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:37.436 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.423+0000 7f5af6ffd640 1 -- 10.20.193.49:0/3354965162 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b0c010070 con 0x7f5b1015bf30 2026-02-17T11:10:37.436 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.423+0000 7f5af6ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:37.436 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.423+0000 7f5af6ffd640 1 -- 10.20.193.49:0/3354965162 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c00cb90 con 0x7f5b1015bf30 2026-02-17T11:10:37.436 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.423+0000 7f5b187f7640 5 monclient: authenticate success, global_id 4562 2026-02-17T11:10:37.436 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.423+0000 7f5b14d69640 4 set_mon_vals no callback set 2026-02-17T11:10:37.436 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.423+0000 7f5af6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:37.436 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.423+0000 7f5af6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:10:37.436 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.423+0000 7f949129f640 1 -- 10.20.193.49:0/1234628709 shutdown_connections 2026-02-17T11:10:37.437 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.423+0000 7f949129f640 1 -- 10.20.193.49:0/1234628709 wait complete. 2026-02-17T11:10:37.437 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.423+0000 7f5af6ffd640 10 monclient: dump: 2026-02-17T11:10:37.437 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:37.437 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.437 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.437 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.437 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:37.438 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.438 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:37.438 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:37.438 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:37.438 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.438 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.423+0000 7f5b187f7640 10 monclient: _renew_subs 2026-02-17T11:10:37.438 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.423+0000 7f5b187f7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:37.438 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.423+0000 7f5b187f7640 1 -- 10.20.193.49:0/3354965162 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b101f3ea0 con 0x7f5b1015bf30 2026-02-17T11:10:37.438 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.423+0000 7f5b187f7640 10 client.4562.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:37.438 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.423+0000 7f5b187f7640 10 monclient: _renew_subs 2026-02-17T11:10:37.438 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.423+0000 7f5b187f7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:37.438 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.423+0000 7f5b187f7640 1 -- 10.20.193.49:0/3354965162 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b101f4460 con 0x7f5b1015bf30 2026-02-17T11:10:37.438 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.423+0000 7f5b187f7640 1 librados: init done 2026-02-17T11:10:37.439 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.423+0000 7fc4c2953640 10 monclient: shutdown 2026-02-17T11:10:37.439 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.423+0000 7fc4c2953640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:37.439 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.423+0000 7fc4c2953640 1 -- 10.20.193.49:0/2439487116 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc4bc15e060 msgr2=0x7fc4bc15c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.439 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.423+0000 7fc4c2953640 1 --2- 10.20.193.49:0/2439487116 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc4bc15e060 0x7fc4bc15c840 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0009d90 tx=0x7fc4b002f1e0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.439 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.423+0000 7fc4c2953640 1 -- 10.20.193.49:0/2439487116 shutdown_connections 2026-02-17T11:10:37.439 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.423+0000 7fc4c2953640 1 --2- 10.20.193.49:0/2439487116 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc4bc15e060 0x7fc4bc15c840 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.439 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.423+0000 7fc4c2953640 1 -- 10.20.193.49:0/2439487116 >> 10.20.193.49:0/2439487116 conn(0x7fc4bc06d9b0 msgr2=0x7fc4bc06ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:37.439 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.423+0000 7fc4c2953640 1 -- 10.20.193.49:0/2439487116 shutdown_connections 2026-02-17T11:10:37.439 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.423+0000 7fc4c2953640 1 -- 10.20.193.49:0/2439487116 wait complete. 2026-02-17T11:10:37.440 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.423+0000 7f949129f640 10 monclient: build_initial_monmap 2026-02-17T11:10:37.440 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.423+0000 7f949129f640 10 monclient: monmap: 2026-02-17T11:10:37.440 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:37.440 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:37.440 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:37.440 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:37.440 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:37.440 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.440 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:37.440 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:37.440 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:37.440 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.441 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.423+0000 7f0de463b640 10 librados: watch_flush enter 2026-02-17T11:10:37.441 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7f0de463b640 10 librados: watch_flush exit 2026-02-17T11:10:37.441 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7f0de463b640 20 client.4526.objecter shutdown clearing up homeless session... 2026-02-17T11:10:37.441 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7f0de463b640 10 client.4526.objecter successfully canceled tick 2026-02-17T11:10:37.441 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7fc4c2953640 10 monclient: build_initial_monmap 2026-02-17T11:10:37.441 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7fc4c2953640 10 monclient: monmap: 2026-02-17T11:10:37.441 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:37.441 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:37.441 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:37.441 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:37.441 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:37.442 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.442 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:37.442 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:37.442 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:37.442 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.442 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7f0de463b640 1 -- 10.20.193.49:0/3656177287 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0dac079190 msgr2=0x7f0dac07b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.442 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7f0de463b640 1 --2- 10.20.193.49:0/3656177287 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0dac079190 0x7f0dac07b650 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc159980 tx=0x7f0dcc009110 comp rx=0 tx=0).stop 2026-02-17T11:10:37.442 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7f0de463b640 10 monclient: shutdown 2026-02-17T11:10:37.442 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7f0de463b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:37.442 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7f0de463b640 1 -- 10.20.193.49:0/3656177287 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f0ddc0ccc00 msgr2=0x7f0ddc15b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.442 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7f0de463b640 1 --2- 10.20.193.49:0/3656177287 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f0ddc0ccc00 0x7f0ddc15b380 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0dd0002410 tx=0x7f0dd00047c0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.443 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7f949129f640 1 librados: starting msgr at 2026-02-17T11:10:37.443 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7f949129f640 1 librados: starting objecter 2026-02-17T11:10:37.443 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7f5b187f7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:37.443 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7f5b187f7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:37.443 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7f5b187f7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:37.443 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7f949129f640 1 Processor -- start 2026-02-17T11:10:37.444 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7f0de463b640 1 -- 10.20.193.49:0/3656177287 shutdown_connections 2026-02-17T11:10:37.444 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7f0de463b640 1 --2- 10.20.193.49:0/3656177287 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0dac079190 0x7f0dac07b650 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.444 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7f0de463b640 1 --2- 10.20.193.49:0/3656177287 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f0ddc155d40 0x7f0ddc1f5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.444 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7f0de463b640 1 --2- 10.20.193.49:0/3656177287 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f0ddc0ccc00 0x7f0ddc15b380 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.444 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7f0de463b640 1 --2- 10.20.193.49:0/3656177287 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0ddc0caff0 0x7f0ddc1566c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.444 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7f5b187f7640 1 -- 10.20.193.49:0/3354965162 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b100c9b90 con 0x7f5b1015bf30 2026-02-17T11:10:37.444 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7f0de463b640 1 -- 10.20.193.49:0/3656177287 >> 10.20.193.49:0/3656177287 conn(0x7f0ddc0cc0e0 msgr2=0x7f0ddc0cddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:37.445 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7f949129f640 1 -- start start 2026-02-17T11:10:37.445 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7f949129f640 1 librados: setting wanted keys 2026-02-17T11:10:37.445 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7f949129f640 1 librados: calling monclient init 2026-02-17T11:10:37.445 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7f949129f640 10 monclient: init 2026-02-17T11:10:37.445 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7f0de463b640 1 -- 10.20.193.49:0/3656177287 shutdown_connections 2026-02-17T11:10:37.445 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7f0de463b640 1 -- 10.20.193.49:0/3656177287 wait complete. 2026-02-17T11:10:37.445 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7fc4c2953640 1 librados: starting msgr at 2026-02-17T11:10:37.445 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7fc4c2953640 1 librados: starting objecter 2026-02-17T11:10:37.446 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7f0de463b640 1 librados: shutdown 2026-02-17T11:10:37.446 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7fc4c2953640 1 Processor -- start 2026-02-17T11:10:37.446 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7fc4c2953640 1 -- start start 2026-02-17T11:10:37.446 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7fc4c2953640 1 librados: setting wanted keys 2026-02-17T11:10:37.446 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7fc4c2953640 1 librados: calling monclient init 2026-02-17T11:10:37.446 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7fc4c2953640 10 monclient: init 2026-02-17T11:10:37.447 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7f949129f640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:37.447 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7f949129f640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:10:37.447 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7f949129f640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f948c0738f0 0x7f948c1f7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.447 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7f949129f640 10 monclient(hunting): picked mon.noname-c con 0x7f948c0738f0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:37.447 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7f949129f640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f948c152820 0x7f948c06d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.447 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7f949129f640 10 monclient(hunting): picked mon.noname-b con 0x7f948c152820 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:37.447 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7f949129f640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f948c152c00 0x7f948c146280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.447 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7f949129f640 10 monclient(hunting): picked mon.noname-a con 0x7f948c152c00 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:37.447 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7f949129f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.447 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7f949129f640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f948c074a10 con 0x7f948c152c00 2026-02-17T11:10:37.447 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7f949129f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.447 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7f949129f640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f948c0c8550 con 0x7f948c152820 2026-02-17T11:10:37.447 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7f949129f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.447 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7f949129f640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f948c074cf0 con 0x7f948c0738f0 2026-02-17T11:10:37.447 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7f949129f640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:37.447 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7f949129f640 10 monclient(hunting): authenticate will time out at 1114.087667s 2026-02-17T11:10:37.448 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7fc4c2953640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:37.448 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7fc4c2953640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:10:37.448 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7fc4c2953640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc4bc0d1b60 0x7fc4bc14a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.448 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7fc4c2953640 10 monclient(hunting): picked mon.noname-a con 0x7fc4bc0d1b60 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:37.448 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7fc4c2953640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc4bc0d1f40 0x7fc4bc14ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.448 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7fc4c2953640 10 monclient(hunting): picked mon.noname-b con 0x7fc4bc0d1f40 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:37.448 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7fc4c2953640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc4bc15e060 0x7fc4bc144570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.448 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7fc4c2953640 10 monclient(hunting): picked mon.noname-c con 0x7fc4bc15e060 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:37.449 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7fc4c2953640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.449 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7fc4c2953640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc4bc15d4c0 con 0x7fc4bc0d1b60 2026-02-17T11:10:37.449 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7fc4c2953640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.449 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7fc4c2953640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc4bc0ca460 con 0x7fc4bc0d1f40 2026-02-17T11:10:37.449 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7fc4c2953640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.449 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7fc4c2953640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc4bc06e7b0 con 0x7fc4bc15e060 2026-02-17T11:10:37.449 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7fc4c2953640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:37.449 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.424+0000 7fc4c2953640 10 monclient(hunting): authenticate will time out at 1114.087789s 2026-02-17T11:10:37.449 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.427+0000 7fb992ffd640 1 -- 10.20.193.49:0/2139302021 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb9ac1583b0 con 0x7fb9ac15d950 2026-02-17T11:10:37.449 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.427+0000 7fb992ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:37.449 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.427+0000 7fb992ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:37.449 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.428+0000 7f36ce2e4640 1 --2- 10.20.193.49:0/3655024785 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f36c80c9730 0x7f36c80c9b60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f36c80cbf90 tx=0x7f36c402f260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7f4afa8a2a1afdc server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:37.450 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.429+0000 7f318affd640 1 -- 10.20.193.49:0/995141424 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3194088810 con 0x7f31a015bf30 2026-02-17T11:10:37.450 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.429+0000 7f318affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-17T11:10:37.450 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.429+0000 7f318affd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:37.450 INFO:teuthology.orchestra.run.trial049.stdout:94489280515 2026-02-17T11:10:37.451 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.431+0000 7f31a88c4640 10 librados: watch_flush enter 2026-02-17T11:10:37.451 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.431+0000 7f31a88c4640 10 librados: watch_flush exit 2026-02-17T11:10:37.451 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.431+0000 7f31a88c4640 20 client.4528.objecter shutdown clearing up homeless session... 2026-02-17T11:10:37.451 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.432+0000 7f31a88c4640 10 client.4528.objecter successfully canceled tick 2026-02-17T11:10:37.451 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.432+0000 7f31a88c4640 1 -- 10.20.193.49:0/995141424 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3170079140 msgr2=0x7f317007b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.451 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.432+0000 7f31a88c4640 1 --2- 10.20.193.49:0/995141424 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3170079140 0x7f317007b600 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3198007fd0 tx=0x7f3198009040 comp rx=0 tx=0).stop 2026-02-17T11:10:37.451 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.432+0000 7f31a88c4640 10 monclient: shutdown 2026-02-17T11:10:37.451 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.432+0000 7f31a88c4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:37.451 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.432+0000 7f31a88c4640 1 -- 10.20.193.49:0/995141424 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f31a015bf30 msgr2=0x7f31a01f6340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.451 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.432+0000 7f31a88c4640 1 --2- 10.20.193.49:0/995141424 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f31a015bf30 0x7f31a01f6340 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3194009d90 tx=0x7f3194004b40 comp rx=0 tx=0).stop 2026-02-17T11:10:37.451 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.432+0000 7f31a88c4640 1 -- 10.20.193.49:0/995141424 shutdown_connections 2026-02-17T11:10:37.451 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.432+0000 7f31a88c4640 1 --2- 10.20.193.49:0/995141424 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3170079140 0x7f317007b600 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.451 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.432+0000 7f31a88c4640 1 --2- 10.20.193.49:0/995141424 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f31a015bf30 0x7f31a01f6340 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.451 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.432+0000 7f31a88c4640 1 --2- 10.20.193.49:0/995141424 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f31a00ce5d0 0x7f31a01f5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.451 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.432+0000 7f31a88c4640 1 --2- 10.20.193.49:0/995141424 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f31a00c9780 0x7f31a01f6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.451 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.432+0000 7f31a88c4640 1 -- 10.20.193.49:0/995141424 >> 10.20.193.49:0/995141424 conn(0x7f31a0073030 msgr2=0x7f31a0153780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:37.451 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.432+0000 7f31a88c4640 1 -- 10.20.193.49:0/995141424 shutdown_connections 2026-02-17T11:10:37.451 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.432+0000 7fed04ff9640 1 -- 10.20.193.49:0/2151066935 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fed081f4e80 con 0x7fed0814f280 2026-02-17T11:10:37.452 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.432+0000 7fed04ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-17T11:10:37.452 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.432+0000 7fed04ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:37.452 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.432+0000 7f31a88c4640 1 -- 10.20.193.49:0/995141424 wait complete. 2026-02-17T11:10:37.452 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.432+0000 7f31a88c4640 1 librados: shutdown 2026-02-17T11:10:37.452 INFO:teuthology.orchestra.run.trial049.stdout:94489280516 2026-02-17T11:10:37.453 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.433+0000 7f36ccae1640 1 -- 10.20.193.49:0/3655024785 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36c402fd10 con 0x7f36c80c9730 2026-02-17T11:10:37.453 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.433+0000 7f36ccae1640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:37.453 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.433+0000 7f36ccae1640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:10:37.453 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.433+0000 7f36ccae1640 10 monclient: dump: 2026-02-17T11:10:37.453 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:37.453 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.453 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.453 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.453 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:37.453 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.453 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:37.453 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:37.453 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:37.453 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.453 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.433+0000 7f36ccae1640 10 monclient: _finish_auth 0 2026-02-17T11:10:37.453 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.433+0000 7f36ccae1640 10 monclient: _check_auth_tickets 2026-02-17T11:10:37.453 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.433+0000 7f36ccae1640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:37.453 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.433+0000 7f36ccae1640 1 -- 10.20.193.49:0/3655024785 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36c40373f0 con 0x7f36c80c9730 2026-02-17T11:10:37.453 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.433+0000 7f36ccae1640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:37.453 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.433+0000 7f36ccae1640 1 -- 10.20.193.49:0/3655024785 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36c40377c0 con 0x7f36c80c9730 2026-02-17T11:10:37.453 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.433+0000 7f36ccae1640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:37.454 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.433+0000 7f36ccae1640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:37.454 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.433+0000 7f36ccae1640 10 monclient: dump: 2026-02-17T11:10:37.454 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:37.454 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.454 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.454 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.454 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:37.454 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.454 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:37.454 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:37.454 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:37.454 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.454 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.433+0000 7f36cfd6e640 5 monclient: authenticate success, global_id 4534 2026-02-17T11:10:37.454 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.433+0000 7f36cfd6e640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:37.454 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.433+0000 7f36cfd6e640 4 set_mon_vals no callback set 2026-02-17T11:10:37.454 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.433+0000 7f948a7fc640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f948c152820 0x7f948c06d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:37.455 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.433+0000 7f36cfd6e640 10 monclient: shutdown 2026-02-17T11:10:37.455 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.433+0000 7f36cfd6e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:37.455 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.433+0000 7f36cfd6e640 1 -- 10.20.193.49:0/3655024785 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f36c80c9730 msgr2=0x7f36c80c9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.455 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.433+0000 7f36cfd6e640 1 --2- 10.20.193.49:0/3655024785 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f36c80c9730 0x7f36c80c9b60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f36c80cbf90 tx=0x7f36c402f260 comp rx=0 tx=0).stop 2026-02-17T11:10:37.455 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.433+0000 7f948a7fc640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f948c152820 0x7f948c06d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:55658/0 (socket says 10.20.193.49:55658) 2026-02-17T11:10:37.455 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.433+0000 7f948a7fc640 1 -- 10.20.193.49:0/404514965 learned_addr learned my addr 10.20.193.49:0/404514965 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:37.455 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.433+0000 7f948a7fc640 10 monclient(hunting): get_auth_request con 0x7f948c152820 auth_method 0 2026-02-17T11:10:37.455 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.433+0000 7f948a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:37.455 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.433+0000 7f948a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:37.455 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.433+0000 7f948a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:37.455 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.433+0000 7f36cfd6e640 1 -- 10.20.193.49:0/3655024785 shutdown_connections 2026-02-17T11:10:37.455 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.433+0000 7f36cfd6e640 1 --2- 10.20.193.49:0/3655024785 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f36c80c9730 0x7f36c80c9b60 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.455 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.433+0000 7f36cfd6e640 1 --2- 10.20.193.49:0/3655024785 >> v2:10.20.193.157:3300/0 conn(0x7f36c8152ae0 0x7f36c815edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.433+0000 7f36cfd6e640 1 --2- 10.20.193.49:0/3655024785 >> v2:10.20.193.49:3300/0 conn(0x7f36c8152700 0x7f36c815e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.433+0000 7f36cfd6e640 1 -- 10.20.193.49:0/3655024785 >> 10.20.193.49:0/3655024785 conn(0x7f36c8073030 msgr2=0x7f36c8073440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:37.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.433+0000 7f36cfd6e640 1 -- 10.20.193.49:0/3655024785 shutdown_connections 2026-02-17T11:10:37.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.433+0000 7fc4bb7fe640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc4bc0d1f40 0x7fc4bc14ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:37.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.433+0000 7f36cfd6e640 1 -- 10.20.193.49:0/3655024785 wait complete. 2026-02-17T11:10:37.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.434+0000 7fc4bb7fe640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc4bc0d1f40 0x7fc4bc14ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:55672/0 (socket says 10.20.193.49:55672) 2026-02-17T11:10:37.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.434+0000 7fc4bb7fe640 1 -- 10.20.193.49:0/3741304070 learned_addr learned my addr 10.20.193.49:0/3741304070 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:37.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.434+0000 7fc4bb7fe640 10 monclient(hunting): get_auth_request con 0x7fc4bc0d1f40 auth_method 0 2026-02-17T11:10:37.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.434+0000 7fc4bb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:37.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.434+0000 7fc4bb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:37.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.434+0000 7fc4bb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:37.457 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.434+0000 7f36cfd6e640 10 monclient: build_initial_monmap 2026-02-17T11:10:37.457 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.434+0000 7f36cfd6e640 10 monclient: monmap: 2026-02-17T11:10:37.457 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:37.457 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:37.457 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:37.457 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:37.457 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:37.457 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.457 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:37.457 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:37.457 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:37.457 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.434+0000 7fed0e9fb640 10 librados: watch_flush enter 2026-02-17T11:10:37.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.434+0000 7fed0e9fb640 10 librados: watch_flush exit 2026-02-17T11:10:37.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.434+0000 7fed0e9fb640 20 client.4513.objecter shutdown clearing up homeless session... 2026-02-17T11:10:37.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.434+0000 7fed0e9fb640 10 client.4513.objecter successfully canceled tick 2026-02-17T11:10:37.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.434+0000 7fed0e9fb640 1 -- 10.20.193.49:0/2151066935 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fecd8079140 msgr2=0x7fecd807b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.434+0000 7fed0e9fb640 1 --2- 10.20.193.49:0/2151066935 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fecd8079140 0x7fecd807b600 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fed080cd0d0 tx=0x7fecf8009290 comp rx=0 tx=0).stop 2026-02-17T11:10:37.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.434+0000 7fed0e9fb640 10 monclient: shutdown 2026-02-17T11:10:37.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.434+0000 7fed0e9fb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:37.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.434+0000 7fed0e9fb640 1 -- 10.20.193.49:0/2151066935 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fed0814f280 msgr2=0x7fed08146860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.434+0000 7fed0e9fb640 1 --2- 10.20.193.49:0/2151066935 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fed0814f280 0x7fed08146860 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fecf400c410 tx=0x7fecf400c8e0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.434+0000 7fed0e9fb640 1 -- 10.20.193.49:0/2151066935 shutdown_connections 2026-02-17T11:10:37.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.434+0000 7fed0e9fb640 1 --2- 10.20.193.49:0/2151066935 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fecd8079140 0x7fecd807b600 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.434+0000 7fed0e9fb640 1 --2- 10.20.193.49:0/2151066935 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fed0815abc0 0x7fed0806eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.434+0000 7fed0e9fb640 1 --2- 10.20.193.49:0/2151066935 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fed0814f660 0x7fed080cc720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.434+0000 7fed0e9fb640 1 --2- 10.20.193.49:0/2151066935 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fed0814f280 0x7fed08146860 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.434+0000 7fed0e9fb640 1 -- 10.20.193.49:0/2151066935 >> 10.20.193.49:0/2151066935 conn(0x7fed080c9f20 msgr2=0x7fed0815c420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:37.459 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.434+0000 7fed0e9fb640 1 -- 10.20.193.49:0/2151066935 shutdown_connections 2026-02-17T11:10:37.459 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.434+0000 7fed0e9fb640 1 -- 10.20.193.49:0/2151066935 wait complete. 2026-02-17T11:10:37.459 INFO:tasks.ceph.ceph_manager.ceph:need seq 111669149703 got 111669149702 for osd.3 2026-02-17T11:10:37.459 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.434+0000 7f36cfd6e640 1 librados: starting msgr at 2026-02-17T11:10:37.459 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.434+0000 7f36cfd6e640 1 librados: starting objecter 2026-02-17T11:10:37.459 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.434+0000 7fed0e9fb640 1 librados: shutdown 2026-02-17T11:10:37.459 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.434+0000 7f36cfd6e640 1 Processor -- start 2026-02-17T11:10:37.460 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.434+0000 7fc4bb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:37.460 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.434+0000 7fc4bb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:37.460 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.434+0000 7fc4bb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:37.460 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.434+0000 7f36cfd6e640 1 -- start start 2026-02-17T11:10:37.460 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.434+0000 7f36cfd6e640 1 librados: setting wanted keys 2026-02-17T11:10:37.460 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.434+0000 7f36cfd6e640 1 librados: calling monclient init 2026-02-17T11:10:37.460 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.434+0000 7f36cfd6e640 10 monclient: init 2026-02-17T11:10:37.461 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.435+0000 7f36cfd6e640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:37.461 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.435+0000 7f36cfd6e640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:10:37.461 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.435+0000 7f36cfd6e640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f36c80c9730 0x7f36c81f4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.461 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.435+0000 7f36cfd6e640 10 monclient(hunting): picked mon.noname-a con 0x7f36c80c9730 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:37.461 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.435+0000 7f36cfd6e640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f36c8152700 0x7f36c81f4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.461 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.435+0000 7f36cfd6e640 10 monclient(hunting): picked mon.noname-b con 0x7f36c8152700 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:37.461 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.435+0000 7f36cfd6e640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f36c8152ae0 0x7f36c81f6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.461 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.435+0000 7f36cfd6e640 10 monclient(hunting): picked mon.noname-c con 0x7f36c8152ae0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:37.461 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.435+0000 7f36cfd6e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.461 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.435+0000 7f36cfd6e640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f36c80ca0a0 con 0x7f36c80c9730 2026-02-17T11:10:37.461 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.435+0000 7f36cfd6e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.461 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.435+0000 7f36cfd6e640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f36c815e350 con 0x7f36c8152700 2026-02-17T11:10:37.461 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.435+0000 7f36cfd6e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:37.461 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.435+0000 7f36cfd6e640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f36c80ca220 con 0x7f36c8152ae0 2026-02-17T11:10:37.461 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.435+0000 7f36cfd6e640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:37.461 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.435+0000 7f36cfd6e640 10 monclient(hunting): authenticate will time out at 1114.098204s 2026-02-17T11:10:37.461 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.436+0000 7fc4bb7fe640 10 monclient(hunting): handle_auth_done global_id 4537 payload 824 2026-02-17T11:10:37.461 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.436+0000 7fc4bb7fe640 1 -- 10.20.193.49:0/3741304070 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc4bc15e060 msgr2=0x7fc4bc144570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.461 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.436+0000 7fc4bb7fe640 1 --2- 10.20.193.49:0/3741304070 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc4bc15e060 0x7fc4bc144570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.461 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.436+0000 7fc4bb7fe640 1 -- 10.20.193.49:0/3741304070 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc4bc0d1b60 msgr2=0x7fc4bc14a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.461 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.436+0000 7fc4bb7fe640 1 --2- 10.20.193.49:0/3741304070 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc4bc0d1b60 0x7fc4bc14a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.462 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.436+0000 7fc4bb7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:10:37.462 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.436+0000 7fc4bb7fe640 1 monclient: found mon.noname-b 2026-02-17T11:10:37.462 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.436+0000 7fc4bb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:37.462 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.436+0000 7fc4bb7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:10:37.462 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.436+0000 7fc4bb7fe640 1 -- 10.20.193.49:0/3741304070 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4bc149980 con 0x7fc4bc0d1f40 2026-02-17T11:10:37.462 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.437+0000 7f948a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:37.462 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.437+0000 7f948a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:37.462 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.437+0000 7f948a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:37.462 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.438+0000 7f948a7fc640 10 monclient(hunting): handle_auth_done global_id 4540 payload 824 2026-02-17T11:10:37.462 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.438+0000 7f948a7fc640 1 -- 10.20.193.49:0/404514965 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f948c0738f0 msgr2=0x7f948c1f7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.462 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.438+0000 7f948a7fc640 1 --2- 10.20.193.49:0/404514965 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f948c0738f0 0x7f948c1f7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.462 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.438+0000 7f948a7fc640 1 -- 10.20.193.49:0/404514965 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f948c152c00 msgr2=0x7f948c146280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.462 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.438+0000 7f948a7fc640 1 --2- 10.20.193.49:0/404514965 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f948c152c00 0x7f948c146280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.462 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.438+0000 7f948a7fc640 10 monclient: _finish_hunting 0 2026-02-17T11:10:37.462 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.438+0000 7f948a7fc640 1 monclient: found mon.noname-b 2026-02-17T11:10:37.462 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.438+0000 7f948a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:37.462 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.438+0000 7f948a7fc640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:10:37.463 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.438+0000 7f948a7fc640 1 -- 10.20.193.49:0/404514965 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f948c157510 con 0x7f948c152820 2026-02-17T11:10:37.463 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.439+0000 7fc4bb7fe640 1 --2- 10.20.193.49:0/3741304070 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc4bc0d1f40 0x7fc4bc14ac40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac00c4d0 tx=0x7fc4ac00c9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:37.463 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.439+0000 7fc4b8ff9640 10 client.?.objecter ms_handle_connect 0x7fc4bc0d1f40 2026-02-17T11:10:37.463 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.439+0000 7fc4b8ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:37.463 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.440+0000 7f36cd2e2640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f36c8152700 0x7f36c81f4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:37.463 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280517 got 94489280515 for osd.5 2026-02-17T11:10:37.464 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.441+0000 7fc4b8ff9640 1 -- 10.20.193.49:0/3741304070 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac017070 con 0x7fc4bc0d1f40 2026-02-17T11:10:37.464 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.441+0000 7fc4b8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:37.464 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.441+0000 7fc4b8ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:10:37.464 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.441+0000 7fc4b8ff9640 10 monclient: dump: 2026-02-17T11:10:37.464 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:37.464 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.464 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.464 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.464 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:37.464 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.464 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:37.464 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:37.464 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:37.464 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.464 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.441+0000 7fc4b8ff9640 10 monclient: _finish_auth 0 2026-02-17T11:10:37.464 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.441+0000 7fc4b8ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:10:37.464 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.441+0000 7fc4b8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:37.464 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.441+0000 7fc4c2953640 5 monclient: authenticate success, global_id 4537 2026-02-17T11:10:37.464 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.441+0000 7fc4c2953640 10 monclient: _renew_subs 2026-02-17T11:10:37.464 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.441+0000 7fc4c2953640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:37.464 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.441+0000 7fc4c2953640 1 -- 10.20.193.49:0/3741304070 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4bc15a640 con 0x7fc4bc0d1f40 2026-02-17T11:10:37.464 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.441+0000 7fc4c2953640 10 client.4537.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:37.464 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.441+0000 7fc4c2953640 10 monclient: _renew_subs 2026-02-17T11:10:37.464 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.441+0000 7fc4c2953640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:37.465 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.441+0000 7fc4c2953640 1 -- 10.20.193.49:0/3741304070 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4bc15ac00 con 0x7fc4bc0d1f40 2026-02-17T11:10:37.465 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.441+0000 7fc4c2953640 1 librados: init done 2026-02-17T11:10:37.465 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.441+0000 7f36cd2e2640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f36c8152700 0x7f36c81f4e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:55688/0 (socket says 10.20.193.49:55688) 2026-02-17T11:10:37.465 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.441+0000 7f36cd2e2640 1 -- 10.20.193.49:0/2697055802 learned_addr learned my addr 10.20.193.49:0/2697055802 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:37.465 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.441+0000 7f36cd2e2640 10 monclient(hunting): get_auth_request con 0x7f36c8152700 auth_method 0 2026-02-17T11:10:37.465 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.441+0000 7f36cd2e2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:37.465 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.441+0000 7f36cd2e2640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:37.465 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.441+0000 7f36cd2e2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:37.465 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.441+0000 7fc4b8ff9640 1 -- 10.20.193.49:0/3741304070 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4ac005de0 con 0x7fc4bc0d1f40 2026-02-17T11:10:37.465 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.441+0000 7fc4b8ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:37.465 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.441+0000 7fc4b8ff9640 1 -- 10.20.193.49:0/3741304070 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac021060 con 0x7fc4bc0d1f40 2026-02-17T11:10:37.465 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.441+0000 7fc4b8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:37.465 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.441+0000 7fc4b8ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:37.465 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.441+0000 7fc4b8ff9640 10 monclient: dump: 2026-02-17T11:10:37.465 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:37.465 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.465 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.465 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.465 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:37.465 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.466 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:37.466 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:37.466 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:37.466 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.441+0000 7fc4ba7fc640 4 set_mon_vals no callback set 2026-02-17T11:10:37.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.442+0000 7f36cd2e2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:37.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.442+0000 7f36cd2e2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:37.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.442+0000 7f36cd2e2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:37.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.442+0000 7fc4c2953640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:37.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.442+0000 7fc4c2953640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:37.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.442+0000 7fc4c2953640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:37.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.442+0000 7fc4c2953640 1 -- 10.20.193.49:0/3741304070 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4bc15c840 con 0x7fc4bc0d1f40 2026-02-17T11:10:37.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.442+0000 7f948a7fc640 1 --2- 10.20.193.49:0/404514965 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f948c152820 0x7f948c06d2a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f947400c730 tx=0x7f947400cc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:37.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.442+0000 7f946b7fe640 10 client.?.objecter ms_handle_connect 0x7f948c152820 2026-02-17T11:10:37.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.442+0000 7f946b7fe640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:37.467 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280518 got 94489280516 for osd.1 2026-02-17T11:10:37.467 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.443+0000 7f36cd2e2640 10 monclient(hunting): handle_auth_done global_id 4543 payload 824 2026-02-17T11:10:37.467 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.443+0000 7f36cd2e2640 1 -- 10.20.193.49:0/2697055802 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f36c8152ae0 msgr2=0x7f36c81f6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.467 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.443+0000 7f36cd2e2640 1 --2- 10.20.193.49:0/2697055802 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f36c8152ae0 0x7f36c81f6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.467 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.443+0000 7f36cd2e2640 1 -- 10.20.193.49:0/2697055802 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f36c80c9730 msgr2=0x7f36c81f4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.467 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.443+0000 7f36cd2e2640 1 --2- 10.20.193.49:0/2697055802 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f36c80c9730 0x7f36c81f4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.467 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.443+0000 7f36cd2e2640 10 monclient: _finish_hunting 0 2026-02-17T11:10:37.467 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.443+0000 7f36cd2e2640 1 monclient: found mon.noname-b 2026-02-17T11:10:37.467 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.443+0000 7f36cd2e2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:37.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.443+0000 7f36cd2e2640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:10:37.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.443+0000 7f36cd2e2640 1 -- 10.20.193.49:0/2697055802 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36c81f77a0 con 0x7f36c8152700 2026-02-17T11:10:37.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.445+0000 7f36cd2e2640 1 --2- 10.20.193.49:0/2697055802 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f36c8152700 0x7f36c81f4e00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f36bc00e810 tx=0x7f36bc00ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:37.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.445+0000 7f36b67fc640 10 client.?.objecter ms_handle_connect 0x7f36c8152700 2026-02-17T11:10:37.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.445+0000 7f36b67fc640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:37.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.462+0000 7f40e746f640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-17T11:10:37.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.462+0000 7f40e746f640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-17T11:10:37.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.462+0000 7f40e746f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:37.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.462+0000 7f40e746f640 1 -- 10.20.193.49:0/1955498600 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f40e0157530 con 0x7f40b000a440 2026-02-17T11:10:37.482 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.481+0000 7fde6effd640 1 -- 10.20.193.49:0/174857959 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 13}]=0 v0) ==== 75+0+12 (secure 0 0 0) 0x7fde7c061bc0 con 0x7fde8814f660 2026-02-17T11:10:37.482 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.481+0000 7fde6effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-17T11:10:37.482 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.481+0000 7fde6effd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:37.482 INFO:teuthology.orchestra.run.trial049.stdout:94489280516 2026-02-17T11:10:37.484 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.483+0000 7fde90296640 10 librados: watch_flush enter 2026-02-17T11:10:37.484 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.483+0000 7fde90296640 10 librados: watch_flush exit 2026-02-17T11:10:37.484 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.483+0000 7fde90296640 20 client.4539.objecter shutdown clearing up homeless session... 2026-02-17T11:10:37.484 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.483+0000 7fde90296640 10 client.4539.objecter successfully canceled tick 2026-02-17T11:10:37.485 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.483+0000 7fde90296640 1 -- 10.20.193.49:0/174857959 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fde58079170 msgr2=0x7fde5807b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.485 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.483+0000 7fde90296640 1 --2- 10.20.193.49:0/174857959 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fde58079170 0x7fde5807b630 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fde78007fd0 tx=0x7fde78007b40 comp rx=0 tx=0).stop 2026-02-17T11:10:37.485 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.483+0000 7fde90296640 10 monclient: shutdown 2026-02-17T11:10:37.485 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.483+0000 7fde90296640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:37.485 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.483+0000 7fde90296640 1 -- 10.20.193.49:0/174857959 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fde8814f660 msgr2=0x7fde8814d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.485 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.483+0000 7fde90296640 1 --2- 10.20.193.49:0/174857959 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fde8814f660 0x7fde8814d540 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fde7c00b5a0 tx=0x7fde7c00ba70 comp rx=0 tx=0).stop 2026-02-17T11:10:37.485 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.483+0000 7fde90296640 1 -- 10.20.193.49:0/174857959 shutdown_connections 2026-02-17T11:10:37.485 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.483+0000 7fde90296640 1 --2- 10.20.193.49:0/174857959 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fde58079170 0x7fde5807b630 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.485 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.483+0000 7fde90296640 1 --2- 10.20.193.49:0/174857959 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fde8815abc0 0x7fde88148b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.485 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.483+0000 7fde90296640 1 --2- 10.20.193.49:0/174857959 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fde8814f660 0x7fde8814d540 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.485 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.483+0000 7fde90296640 1 --2- 10.20.193.49:0/174857959 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fde8814f280 0x7fde881f4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.485 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.483+0000 7fde90296640 1 -- 10.20.193.49:0/174857959 >> 10.20.193.49:0/174857959 conn(0x7fde880c9f20 msgr2=0x7fde880c5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:37.485 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.483+0000 7fde90296640 1 -- 10.20.193.49:0/174857959 shutdown_connections 2026-02-17T11:10:37.485 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.483+0000 7fde90296640 1 -- 10.20.193.49:0/174857959 wait complete. 2026-02-17T11:10:37.485 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.483+0000 7fde90296640 1 librados: shutdown 2026-02-17T11:10:37.489 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.487+0000 7fb3abc91640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 8}] 2026-02-17T11:10:37.489 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.487+0000 7fb3abc91640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 8}] 2026-02-17T11:10:37.489 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.487+0000 7fb3abc91640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:37.489 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.487+0000 7fb3abc91640 1 -- 10.20.193.49:0/228728157 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fb3a414fb70 con 0x7fb3a415d950 2026-02-17T11:10:37.492 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280517 got 94489280516 for osd.13 2026-02-17T11:10:37.492 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.491+0000 7f5fbaffd640 1 -- 10.20.193.49:0/2499466160 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7f5fd0082400 con 0x7f5fd40c3c30 2026-02-17T11:10:37.493 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.491+0000 7f5fbaffd640 10 client.4551.objecter ms_dispatch2 0x7f5fd4000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:37.493 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.491+0000 7f5fbaffd640 3 client.4551.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:37.493 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.491+0000 7f5fbaffd640 3 client.4551.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:37.493 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.491+0000 7f5fbaffd640 20 client.4551.objecter dump_active .. 0 homeless 2026-02-17T11:10:37.493 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.491+0000 7f5fbaffd640 1 -- 10.20.193.49:0/2499466160 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f5fd41f7570 con 0x7f5fd40c3c30 2026-02-17T11:10:37.493 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.491+0000 7f5fbaffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:37.493 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.491+0000 7f5fbaffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:37.495 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.494+0000 7f39cc8e1640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-17T11:10:37.495 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.494+0000 7f39cc8e1640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-17T11:10:37.496 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.494+0000 7f39cc8e1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:37.496 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.494+0000 7f39cc8e1640 1 -- 10.20.193.49:0/2243935134 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 15} v 0) -- 0x7f39c414c050 con 0x7f39c41561f0 2026-02-17T11:10:37.497 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.496+0000 7f40cdffb640 1 -- 10.20.193.49:0/1955498600 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f40dc067370 con 0x7f40b000a440 2026-02-17T11:10:37.497 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.496+0000 7f40cdffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-17T11:10:37.497 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.496+0000 7f40cdffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:37.497 INFO:teuthology.orchestra.run.trial049.stdout:115964116999 2026-02-17T11:10:37.500 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.498+0000 7f40e746f640 10 librados: watch_flush enter 2026-02-17T11:10:37.500 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.498+0000 7f40e746f640 10 librados: watch_flush exit 2026-02-17T11:10:37.500 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.498+0000 7f40e746f640 20 client.4548.objecter shutdown clearing up homeless session... 2026-02-17T11:10:37.500 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.498+0000 7f40e746f640 10 client.4548.objecter successfully canceled tick 2026-02-17T11:10:37.500 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.498+0000 7f40e746f640 1 -- 10.20.193.49:0/1955498600 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f40e015d370 msgr2=0x7f40b00837d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.500 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.498+0000 7f40e746f640 1 --2- 10.20.193.49:0/1955498600 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f40e015d370 0x7f40b00837d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f40e015d060 tx=0x7f40d0031070 comp rx=0 tx=0).stop 2026-02-17T11:10:37.500 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.498+0000 7f40e746f640 10 monclient: shutdown 2026-02-17T11:10:37.500 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.498+0000 7f40e746f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:37.500 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.498+0000 7f40e746f640 1 -- 10.20.193.49:0/1955498600 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f40b000a440 msgr2=0x7f40b000c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.500 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.498+0000 7f40e746f640 1 --2- 10.20.193.49:0/1955498600 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f40b000a440 0x7f40b000c8d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f40dc00bfd0 tx=0x7f40dc009710 comp rx=0 tx=0).stop 2026-02-17T11:10:37.500 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.498+0000 7f40e746f640 1 -- 10.20.193.49:0/1955498600 shutdown_connections 2026-02-17T11:10:37.500 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.498+0000 7f40e746f640 1 --2- 10.20.193.49:0/1955498600 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f40e015d370 0x7f40b00837d0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.500 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.498+0000 7f40e746f640 1 --2- 10.20.193.49:0/1955498600 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f40b000a440 0x7f40b000c8d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.500 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.498+0000 7f40e746f640 1 --2- 10.20.193.49:0/1955498600 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f40e00c74c0 0x7f40b00099e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.500 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.498+0000 7f40e746f640 1 --2- 10.20.193.49:0/1955498600 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f40e00c7e20 0x7f40b0006f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.501 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.498+0000 7f40e746f640 1 -- 10.20.193.49:0/1955498600 >> 10.20.193.49:0/1955498600 conn(0x7f40e00c9f20 msgr2=0x7f40e00ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:37.501 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.498+0000 7f40e746f640 1 -- 10.20.193.49:0/1955498600 shutdown_connections 2026-02-17T11:10:37.501 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.498+0000 7f40e746f640 1 -- 10.20.193.49:0/1955498600 wait complete. 2026-02-17T11:10:37.501 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.498+0000 7f40e746f640 1 librados: shutdown 2026-02-17T11:10:37.508 INFO:tasks.ceph.ceph_manager.ceph:need seq 115964117000 got 115964116999 for osd.10 2026-02-17T11:10:37.516 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.515+0000 7fb9b0e76640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-17T11:10:37.516 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.515+0000 7fb9b0e76640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-17T11:10:37.516 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.515+0000 7fb9b0e76640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:37.516 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.515+0000 7fb9b0e76640 1 -- 10.20.193.49:0/2139302021 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fb9ac06e7b0 con 0x7fb9ac15d950 2026-02-17T11:10:37.534 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.533+0000 7f5af6ffd640 1 -- 10.20.193.49:0/3354965162 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f5b0c01d030 con 0x7f5b1015bf30 2026-02-17T11:10:37.535 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.533+0000 7f5af6ffd640 1 --2- 10.20.193.49:0/3354965162 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5ae00791c0 0x7f5ae007b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.535 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.533+0000 7f5b1656c640 1 --2- 10.20.193.49:0/3354965162 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5ae00791c0 0x7f5ae007b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:37.535 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.533+0000 7f5b1656c640 10 monclient: get_auth_request con 0x7f5ae00791c0 auth_method 0 2026-02-17T11:10:37.535 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.534+0000 7f5af6ffd640 10 client.4562.objecter ms_handle_connect 0x7f5ae00791c0 2026-02-17T11:10:37.536 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.534+0000 7f5b1656c640 1 --2- 10.20.193.49:0/3354965162 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5ae00791c0 0x7f5ae007b680 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5b00039000 tx=0x7f5b00031000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:37.537 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.535+0000 7f5af6ffd640 1 -- 10.20.193.49:0/3354965162 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7f5b0c01de10 con 0x7f5b1015bf30 2026-02-17T11:10:37.537 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.535+0000 7f5af6ffd640 10 client.4562.objecter ms_dispatch2 0x7f5b10000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:37.537 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.535+0000 7f5af6ffd640 3 client.4562.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:37.537 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.535+0000 7f5af6ffd640 3 client.4562.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:37.537 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.535+0000 7f5af6ffd640 20 client.4562.objecter dump_active .. 0 homeless 2026-02-17T11:10:37.543 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.542+0000 7f5af6ffd640 1 -- 10.20.193.49:0/3354965162 <== mon.2 v2:10.20.193.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f5b0c0620f0 con 0x7f5b1015bf30 2026-02-17T11:10:37.543 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.542+0000 7f5af6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:37.544 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.542+0000 7f5af6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:37.548 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.546+0000 7f946b7fe640 1 -- 10.20.193.49:0/404514965 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9474017070 con 0x7f948c152820 2026-02-17T11:10:37.548 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.546+0000 7f946b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:37.548 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.546+0000 7f946b7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:10:37.548 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.546+0000 7f946b7fe640 10 monclient: dump: 2026-02-17T11:10:37.548 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:37.549 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.549 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.549 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.549 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:37.549 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.549 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:37.549 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:37.549 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:37.549 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.549 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.546+0000 7f946b7fe640 10 monclient: _finish_auth 0 2026-02-17T11:10:37.549 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.546+0000 7f946b7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:10:37.549 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.546+0000 7f946b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:37.550 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.546+0000 7f946b7fe640 1 -- 10.20.193.49:0/404514965 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9474005bb0 con 0x7f948c152820 2026-02-17T11:10:37.550 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.546+0000 7f946b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:37.550 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.546+0000 7f946b7fe640 1 -- 10.20.193.49:0/404514965 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9474007070 con 0x7f948c152820 2026-02-17T11:10:37.550 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.546+0000 7f946b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:37.550 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.546+0000 7f946b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:37.550 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.546+0000 7f946b7fe640 10 monclient: dump: 2026-02-17T11:10:37.550 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:37.550 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.550 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.550 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.550 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:37.550 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.551 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:37.551 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:37.551 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:37.551 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.551 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.546+0000 7f949129f640 5 monclient: authenticate success, global_id 4540 2026-02-17T11:10:37.551 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.546+0000 7f94897fa640 4 set_mon_vals no callback set 2026-02-17T11:10:37.551 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.546+0000 7f949129f640 10 monclient: _renew_subs 2026-02-17T11:10:37.551 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.546+0000 7f949129f640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:37.551 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.546+0000 7f949129f640 1 -- 10.20.193.49:0/404514965 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f948c1467c0 con 0x7f948c152820 2026-02-17T11:10:37.551 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.546+0000 7f949129f640 10 client.4540.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:37.551 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.546+0000 7f949129f640 10 monclient: _renew_subs 2026-02-17T11:10:37.551 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.546+0000 7f949129f640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:37.552 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.546+0000 7f949129f640 1 -- 10.20.193.49:0/404514965 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f948c157a60 con 0x7f948c152820 2026-02-17T11:10:37.552 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.546+0000 7f949129f640 1 librados: init done 2026-02-17T11:10:37.552 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.546+0000 7f949129f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:37.552 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.546+0000 7f949129f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:37.552 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.546+0000 7f949129f640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:37.552 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.546+0000 7f949129f640 1 -- 10.20.193.49:0/404514965 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f948c1593f0 con 0x7f948c152820 2026-02-17T11:10:37.554 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.553+0000 7f39aeffd640 1 -- 10.20.193.49:0/2243935134 <== mon.2 v2:10.20.193.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 15}]=0 v0) ==== 75+0+12 (secure 0 0 0) 0x7f39b80883a0 con 0x7f39c41561f0 2026-02-17T11:10:37.555 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.553+0000 7f39aeffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-17T11:10:37.555 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.553+0000 7f39aeffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:37.555 INFO:teuthology.orchestra.run.trial049.stdout:94489280516 2026-02-17T11:10:37.556 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.553+0000 7fc4b8ff9640 1 -- 10.20.193.49:0/3741304070 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7fc4ac024080 con 0x7fc4bc0d1f40 2026-02-17T11:10:37.556 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.554+0000 7fc4b8ff9640 1 --2- 10.20.193.49:0/3741304070 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fc48c079140 0x7fc48c07b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.556 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.554+0000 7fc4bbfff640 1 --2- 10.20.193.49:0/3741304070 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fc48c079140 0x7fc48c07b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:37.556 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.554+0000 7fc4bbfff640 10 monclient: get_auth_request con 0x7fc48c079140 auth_method 0 2026-02-17T11:10:37.556 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.554+0000 7fc4bbfff640 1 --2- 10.20.193.49:0/3741304070 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fc48c079140 0x7fc48c07b600 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc4a8009750 tx=0x7fc4a8006ca0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:37.557 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.554+0000 7fc4b8ff9640 10 client.4537.objecter ms_handle_connect 0x7fc48c079140 2026-02-17T11:10:37.558 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.555+0000 7f39cc8e1640 10 librados: watch_flush enter 2026-02-17T11:10:37.558 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.555+0000 7f39cc8e1640 10 librados: watch_flush exit 2026-02-17T11:10:37.558 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.555+0000 7f39cc8e1640 20 client.4541.objecter shutdown clearing up homeless session... 2026-02-17T11:10:37.558 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.555+0000 7f39cc8e1640 10 client.4541.objecter successfully canceled tick 2026-02-17T11:10:37.558 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.555+0000 7f39cc8e1640 1 -- 10.20.193.49:0/2243935134 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3994079140 msgr2=0x7f399407b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.559 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.555+0000 7f39cc8e1640 1 --2- 10.20.193.49:0/2243935134 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3994079140 0x7f399407b600 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f39bc006fd0 tx=0x7f39bc006d40 comp rx=0 tx=0).stop 2026-02-17T11:10:37.559 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.555+0000 7f39cc8e1640 10 monclient: shutdown 2026-02-17T11:10:37.559 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.555+0000 7f39cc8e1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:37.559 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.555+0000 7f39cc8e1640 1 -- 10.20.193.49:0/2243935134 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f39c41561f0 msgr2=0x7f39c4143ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.559 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.555+0000 7f39cc8e1640 1 --2- 10.20.193.49:0/2243935134 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f39c41561f0 0x7f39c4143ff0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f39b8009e50 tx=0x7f39b8004b40 comp rx=0 tx=0).stop 2026-02-17T11:10:37.559 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.555+0000 7f39cc8e1640 1 -- 10.20.193.49:0/2243935134 shutdown_connections 2026-02-17T11:10:37.559 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.555+0000 7f39cc8e1640 1 --2- 10.20.193.49:0/2243935134 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3994079140 0x7f399407b600 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.559 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.555+0000 7f39cc8e1640 1 --2- 10.20.193.49:0/2243935134 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f39c41561f0 0x7f39c4143ff0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.559 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.555+0000 7f39cc8e1640 1 --2- 10.20.193.49:0/2243935134 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f39c406f700 0x7f39c413ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.559 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.555+0000 7f39cc8e1640 1 --2- 10.20.193.49:0/2243935134 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f39c40686b0 0x7f39c414ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.559 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.555+0000 7f39cc8e1640 1 -- 10.20.193.49:0/2243935134 >> 10.20.193.49:0/2243935134 conn(0x7f39c40cb3a0 msgr2=0x7f39c4153570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:37.559 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.555+0000 7f39cc8e1640 1 -- 10.20.193.49:0/2243935134 shutdown_connections 2026-02-17T11:10:37.560 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.555+0000 7f39cc8e1640 1 -- 10.20.193.49:0/2243935134 wait complete. 2026-02-17T11:10:37.560 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.555+0000 7f39cc8e1640 1 librados: shutdown 2026-02-17T11:10:37.560 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.556+0000 7fc4b8ff9640 1 -- 10.20.193.49:0/3741304070 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7fc4ac05d670 con 0x7fc4bc0d1f40 2026-02-17T11:10:37.560 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.556+0000 7fc4b8ff9640 10 client.4537.objecter ms_dispatch2 0x7fc4bc000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:37.560 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.556+0000 7fc4b8ff9640 3 client.4537.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:37.560 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.556+0000 7fc4b8ff9640 3 client.4537.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:37.560 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.556+0000 7fc4b8ff9640 20 client.4537.objecter dump_active .. 0 homeless 2026-02-17T11:10:37.566 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280518 got 94489280516 for osd.15 2026-02-17T11:10:37.566 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.563+0000 7fc4b8ff9640 1 -- 10.20.193.49:0/3741304070 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc4ac061630 con 0x7fc4bc0d1f40 2026-02-17T11:10:37.566 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.563+0000 7fc4b8ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:37.566 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.563+0000 7fc4b8ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:37.574 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.571+0000 7f36b67fc640 1 -- 10.20.193.49:0/2697055802 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36bc017070 con 0x7f36c8152700 2026-02-17T11:10:37.574 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.571+0000 7f36b67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:37.574 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.571+0000 7f36b67fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:10:37.574 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.571+0000 7f36b67fc640 10 monclient: dump: 2026-02-17T11:10:37.574 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:37.574 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.574 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.575 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.575 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:37.575 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.575 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:37.575 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:37.575 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:37.575 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.575 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.571+0000 7f36b67fc640 10 monclient: _finish_auth 0 2026-02-17T11:10:37.575 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.571+0000 7f36b67fc640 10 monclient: _check_auth_tickets 2026-02-17T11:10:37.575 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.571+0000 7f36b67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:37.575 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.571+0000 7f36b67fc640 1 -- 10.20.193.49:0/2697055802 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36bc00c8d0 con 0x7f36c8152700 2026-02-17T11:10:37.576 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.571+0000 7f36b67fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:37.576 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.571+0000 7f36b67fc640 1 -- 10.20.193.49:0/2697055802 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36bc00f040 con 0x7f36c8152700 2026-02-17T11:10:37.576 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.571+0000 7f36cfd6e640 5 monclient: authenticate success, global_id 4543 2026-02-17T11:10:37.576 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.571+0000 7f36b67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:37.576 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.571+0000 7f36b7fff640 4 set_mon_vals no callback set 2026-02-17T11:10:37.576 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.571+0000 7f36b67fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:37.576 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.571+0000 7f36b67fc640 10 monclient: dump: 2026-02-17T11:10:37.576 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:37.576 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:37.576 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.576 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:37.576 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:37.577 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:37.577 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:37.577 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:37.577 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:37.577 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:37.577 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.571+0000 7f36cfd6e640 10 monclient: _renew_subs 2026-02-17T11:10:37.577 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.571+0000 7f36cfd6e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:37.577 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.571+0000 7f36cfd6e640 1 -- 10.20.193.49:0/2697055802 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36c81f7a80 con 0x7f36c8152700 2026-02-17T11:10:37.577 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.571+0000 7f36cfd6e640 10 client.4543.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:37.577 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.571+0000 7f36cfd6e640 10 monclient: _renew_subs 2026-02-17T11:10:37.577 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.571+0000 7f36cfd6e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:37.577 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.571+0000 7f36cfd6e640 1 -- 10.20.193.49:0/2697055802 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36c81f3d80 con 0x7f36c8152700 2026-02-17T11:10:37.577 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.571+0000 7f36cfd6e640 1 librados: init done 2026-02-17T11:10:37.578 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.572+0000 7f36cfd6e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:37.578 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.572+0000 7f36cfd6e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:37.578 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.572+0000 7f36cfd6e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:37.578 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.572+0000 7f36cfd6e640 1 -- 10.20.193.49:0/2697055802 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36c80c9b60 con 0x7f36c8152700 2026-02-17T11:10:37.579 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.577+0000 7f5fdc5c3640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-17T11:10:37.579 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.577+0000 7f5fdc5c3640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-17T11:10:37.579 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.577+0000 7f5fdc5c3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:37.579 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.577+0000 7f5fdc5c3640 1 -- 10.20.193.49:0/2499466160 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f5fd414ecc0 con 0x7f5fd40c3c30 2026-02-17T11:10:37.581 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.580+0000 7f5fbaffd640 1 -- 10.20.193.49:0/2499466160 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5fd0036070 con 0x7f5fd40c3c30 2026-02-17T11:10:37.581 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.580+0000 7f5fbaffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-17T11:10:37.581 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.580+0000 7f5fbaffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:37.581 INFO:teuthology.orchestra.run.trial049.stdout:94489280516 2026-02-17T11:10:37.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.581+0000 7f5fdc5c3640 10 librados: watch_flush enter 2026-02-17T11:10:37.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.581+0000 7f5fdc5c3640 10 librados: watch_flush exit 2026-02-17T11:10:37.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.581+0000 7f5fdc5c3640 20 client.4551.objecter shutdown clearing up homeless session... 2026-02-17T11:10:37.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.581+0000 7f5fdc5c3640 10 client.4551.objecter successfully canceled tick 2026-02-17T11:10:37.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.581+0000 7f5fdc5c3640 1 -- 10.20.193.49:0/2499466160 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5fa4079140 msgr2=0x7f5fa407b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.581+0000 7f5fdc5c3640 1 --2- 10.20.193.49:0/2499466160 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5fa4079140 0x7f5fa407b600 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5fc400ab10 tx=0x7f5fc4009250 comp rx=0 tx=0).stop 2026-02-17T11:10:37.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.582+0000 7f5fdc5c3640 10 monclient: shutdown 2026-02-17T11:10:37.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.582+0000 7f5fdc5c3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:37.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.582+0000 7f5fdc5c3640 1 -- 10.20.193.49:0/2499466160 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5fd40c3c30 msgr2=0x7f5fd4156590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.582+0000 7f5fdc5c3640 1 --2- 10.20.193.49:0/2499466160 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5fd40c3c30 0x7f5fd4156590 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5fd002fc10 tx=0x7f5fd40c5720 comp rx=0 tx=0).stop 2026-02-17T11:10:37.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.582+0000 7f5fdc5c3640 1 -- 10.20.193.49:0/2499466160 shutdown_connections 2026-02-17T11:10:37.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.582+0000 7f5fdc5c3640 1 --2- 10.20.193.49:0/2499466160 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5fa4079140 0x7f5fa407b600 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.582+0000 7f5fdc5c3640 1 --2- 10.20.193.49:0/2499466160 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5fd40c3c30 0x7f5fd4156590 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.582+0000 7f5fdc5c3640 1 --2- 10.20.193.49:0/2499466160 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5fd40c17e0 0x7f5fd40c36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.582+0000 7f5fdc5c3640 1 --2- 10.20.193.49:0/2499466160 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5fbc009ab0 0x7f5fd41f7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.582+0000 7f5fdc5c3640 1 -- 10.20.193.49:0/2499466160 >> 10.20.193.49:0/2499466160 conn(0x7f5fd40c9f40 msgr2=0x7f5fd40ccb60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:37.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.582+0000 7f5fdc5c3640 1 -- 10.20.193.49:0/2499466160 shutdown_connections 2026-02-17T11:10:37.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.582+0000 7f5fdc5c3640 1 -- 10.20.193.49:0/2499466160 wait complete. 2026-02-17T11:10:37.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.582+0000 7f5fdc5c3640 1 librados: shutdown 2026-02-17T11:10:37.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.590+0000 7fb3927fc640 1 -- 10.20.193.49:0/228728157 <== mon.2 v2:10.20.193.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb3a00102e0 con 0x7fb3a415d950 2026-02-17T11:10:37.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.590+0000 7fb3927fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 8}] 2026-02-17T11:10:37.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.590+0000 7fb3927fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:37.592 INFO:teuthology.orchestra.run.trial049.stdout:90194313220 2026-02-17T11:10:37.592 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280518 got 94489280516 for osd.9 2026-02-17T11:10:37.594 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.592+0000 7fb3abc91640 10 librados: watch_flush enter 2026-02-17T11:10:37.594 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.592+0000 7fb3abc91640 10 librados: watch_flush exit 2026-02-17T11:10:37.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.592+0000 7fb3abc91640 20 client.4538.objecter shutdown clearing up homeless session... 2026-02-17T11:10:37.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.592+0000 7fb3abc91640 10 client.4538.objecter successfully canceled tick 2026-02-17T11:10:37.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.592+0000 7fb3abc91640 1 -- 10.20.193.49:0/228728157 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb374079140 msgr2=0x7fb37407b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.592+0000 7fb3abc91640 1 --2- 10.20.193.49:0/228728157 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb374079140 0x7fb37407b600 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb394009750 tx=0x7fb394006ca0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.592+0000 7fb3abc91640 10 monclient: shutdown 2026-02-17T11:10:37.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.592+0000 7fb3abc91640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:37.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.592+0000 7fb3abc91640 1 -- 10.20.193.49:0/228728157 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb3a415d950 msgr2=0x7fb3a40cda20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.592+0000 7fb3abc91640 1 --2- 10.20.193.49:0/228728157 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb3a415d950 0x7fb3a40cda20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb3a000cc10 tx=0x7fb3a000a430 comp rx=0 tx=0).stop 2026-02-17T11:10:37.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.592+0000 7fb3abc91640 1 -- 10.20.193.49:0/228728157 shutdown_connections 2026-02-17T11:10:37.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.592+0000 7fb3abc91640 1 --2- 10.20.193.49:0/228728157 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb374079140 0x7fb37407b600 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.592+0000 7fb3abc91640 1 --2- 10.20.193.49:0/228728157 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb3a415d950 0x7fb3a40cda20 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.592+0000 7fb3abc91640 1 --2- 10.20.193.49:0/228728157 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb3a40d1f40 0x7fb3a40cd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.592+0000 7fb3abc91640 1 --2- 10.20.193.49:0/228728157 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb3a40d1b60 0x7fb3a4147d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.592+0000 7fb3abc91640 1 -- 10.20.193.49:0/228728157 >> 10.20.193.49:0/228728157 conn(0x7fb3a406d9b0 msgr2=0x7fb3a40cff40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:37.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.592+0000 7fb3abc91640 1 -- 10.20.193.49:0/228728157 shutdown_connections 2026-02-17T11:10:37.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.592+0000 7fb3abc91640 1 -- 10.20.193.49:0/228728157 wait complete. 2026-02-17T11:10:37.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.592+0000 7fb3abc91640 1 librados: shutdown 2026-02-17T11:10:37.602 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313220 for osd.8 2026-02-17T11:10:37.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.626+0000 7f5b187f7640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-17T11:10:37.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.626+0000 7f5b187f7640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-17T11:10:37.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.626+0000 7f5b187f7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:37.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.626+0000 7f5b187f7640 1 -- 10.20.193.49:0/3354965162 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f5b101598e0 con 0x7f5b1015bf30 2026-02-17T11:10:37.630 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.629+0000 7f5af6ffd640 1 -- 10.20.193.49:0/3354965162 <== mon.2 v2:10.20.193.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5b0c0619f0 con 0x7f5b1015bf30 2026-02-17T11:10:37.630 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.629+0000 7f5af6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-17T11:10:37.630 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.629+0000 7f5af6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:37.631 INFO:teuthology.orchestra.run.trial049.stdout:94489280516 2026-02-17T11:10:37.633 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.630+0000 7f5b187f7640 10 librados: watch_flush enter 2026-02-17T11:10:37.633 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.630+0000 7f5b187f7640 10 librados: watch_flush exit 2026-02-17T11:10:37.633 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.630+0000 7f5b187f7640 20 client.4562.objecter shutdown clearing up homeless session... 2026-02-17T11:10:37.633 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.630+0000 7f5b187f7640 10 client.4562.objecter successfully canceled tick 2026-02-17T11:10:37.633 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.630+0000 7f5b187f7640 1 -- 10.20.193.49:0/3354965162 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5ae00791c0 msgr2=0x7f5ae007b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.633 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.630+0000 7f5b187f7640 1 --2- 10.20.193.49:0/3354965162 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5ae00791c0 0x7f5ae007b680 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5b00039000 tx=0x7f5b00031000 comp rx=0 tx=0).stop 2026-02-17T11:10:37.633 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.630+0000 7f5b187f7640 10 monclient: shutdown 2026-02-17T11:10:37.633 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.630+0000 7f5b187f7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:37.634 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.630+0000 7f5b187f7640 1 -- 10.20.193.49:0/3354965162 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5b1015bf30 msgr2=0x7f5b1015f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.634 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.630+0000 7f5b187f7640 1 --2- 10.20.193.49:0/3354965162 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5b1015bf30 0x7f5b1015f040 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c00b970 tx=0x7f5b0c00be40 comp rx=0 tx=0).stop 2026-02-17T11:10:37.634 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.630+0000 7f5b187f7640 1 -- 10.20.193.49:0/3354965162 shutdown_connections 2026-02-17T11:10:37.634 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.630+0000 7f5b187f7640 1 --2- 10.20.193.49:0/3354965162 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5ae00791c0 0x7f5ae007b680 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.634 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.630+0000 7f5b187f7640 1 --2- 10.20.193.49:0/3354965162 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5b1015bf30 0x7f5b1015f040 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.634 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.630+0000 7f5b187f7640 1 --2- 10.20.193.49:0/3354965162 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5b100ce5d0 0x7f5b1015eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.634 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.630+0000 7f5b187f7640 1 --2- 10.20.193.49:0/3354965162 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5b100c9780 0x7f5b101537e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.634 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.630+0000 7f5b187f7640 1 -- 10.20.193.49:0/3354965162 >> 10.20.193.49:0/3354965162 conn(0x7f5b10073030 msgr2=0x7f5b10154990 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:37.634 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.630+0000 7f5b187f7640 1 -- 10.20.193.49:0/3354965162 shutdown_connections 2026-02-17T11:10:37.634 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.630+0000 7f5b187f7640 1 -- 10.20.193.49:0/3354965162 wait complete. 2026-02-17T11:10:37.634 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.630+0000 7f5b187f7640 1 librados: shutdown 2026-02-17T11:10:37.640 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280518 got 94489280516 for osd.2 2026-02-17T11:10:37.649 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.648+0000 7fc4c2953640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-17T11:10:37.650 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.648+0000 7fc4c2953640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-17T11:10:37.650 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.648+0000 7fc4c2953640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:37.650 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.648+0000 7fc4c2953640 1 -- 10.20.193.49:0/3741304070 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fc4bc1597e0 con 0x7fc4bc0d1f40 2026-02-17T11:10:37.810 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.808+0000 7f946b7fe640 1 -- 10.20.193.49:0/404514965 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f9474007210 con 0x7f948c152820 2026-02-17T11:10:37.811 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.809+0000 7f946b7fe640 1 --2- 10.20.193.49:0/404514965 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f9458079190 0x7f945807b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.811 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.809+0000 7f948affd640 1 --2- 10.20.193.49:0/404514965 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f9458079190 0x7f945807b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:37.811 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.809+0000 7f948affd640 10 monclient: get_auth_request con 0x7f9458079190 auth_method 0 2026-02-17T11:10:37.812 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.810+0000 7f946b7fe640 10 client.4540.objecter ms_handle_connect 0x7f9458079190 2026-02-17T11:10:37.812 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.810+0000 7f948affd640 1 --2- 10.20.193.49:0/404514965 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f9458079190 0x7f945807b650 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9480039000 tx=0x7f9480031000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:37.813 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.811+0000 7f946b7fe640 1 -- 10.20.193.49:0/404514965 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7f947405d6c0 con 0x7f948c152820 2026-02-17T11:10:37.813 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.811+0000 7f946b7fe640 10 client.4540.objecter ms_dispatch2 0x7f948c000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:37.813 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.811+0000 7f946b7fe640 3 client.4540.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:37.813 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.811+0000 7f946b7fe640 3 client.4540.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:37.813 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.811+0000 7f946b7fe640 20 client.4540.objecter dump_active .. 0 homeless 2026-02-17T11:10:37.819 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.817+0000 7f946b7fe640 1 -- 10.20.193.49:0/404514965 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f9474021020 con 0x7f948c152820 2026-02-17T11:10:37.819 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.817+0000 7f946b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:37.819 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.817+0000 7f946b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:37.825 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.824+0000 7fb992ffd640 1 -- 10.20.193.49:0/2139302021 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb99c050070 con 0x7fb9ac15d950 2026-02-17T11:10:37.826 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.824+0000 7fb992ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-17T11:10:37.826 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.824+0000 7fb992ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:37.826 INFO:teuthology.orchestra.run.trial049.stdout:111669149703 2026-02-17T11:10:37.827 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.824+0000 7f36b67fc640 1 -- 10.20.193.49:0/2697055802 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f36bc012050 con 0x7f36c8152700 2026-02-17T11:10:37.827 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.825+0000 7f36b67fc640 1 --2- 10.20.193.49:0/2697055802 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3698079190 0x7f369807b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:37.827 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.825+0000 7f36cdae3640 1 --2- 10.20.193.49:0/2697055802 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3698079190 0x7f369807b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:37.827 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.825+0000 7f36cdae3640 10 monclient: get_auth_request con 0x7f3698079190 auth_method 0 2026-02-17T11:10:37.828 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.826+0000 7f36b67fc640 1 -- 10.20.193.49:0/2697055802 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7f36bc05dd70 con 0x7f36c8152700 2026-02-17T11:10:37.828 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.826+0000 7f36b67fc640 10 client.4543.objecter ms_dispatch2 0x7f36c8000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:37.828 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.826+0000 7f36b67fc640 3 client.4543.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:37.828 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.826+0000 7f36b67fc640 3 client.4543.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:37.828 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.826+0000 7f36cdae3640 1 --2- 10.20.193.49:0/2697055802 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3698079190 0x7f369807b650 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f36b80098a0 tx=0x7f36b8006d90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:37.829 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.826+0000 7f36b67fc640 20 client.4543.objecter dump_active .. 0 homeless 2026-02-17T11:10:37.829 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.826+0000 7f36b67fc640 10 client.4543.objecter ms_handle_connect 0x7f3698079190 2026-02-17T11:10:37.830 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.826+0000 7fb9b0e76640 10 librados: watch_flush enter 2026-02-17T11:10:37.830 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.826+0000 7fb9b0e76640 10 librados: watch_flush exit 2026-02-17T11:10:37.830 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.826+0000 7fb9b0e76640 20 client.4531.objecter shutdown clearing up homeless session... 2026-02-17T11:10:37.830 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.826+0000 7fb9b0e76640 10 client.4531.objecter successfully canceled tick 2026-02-17T11:10:37.830 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.826+0000 7fb9b0e76640 1 -- 10.20.193.49:0/2139302021 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb978079170 msgr2=0x7fb97807b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.830 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.826+0000 7fb9b0e76640 1 --2- 10.20.193.49:0/2139302021 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb978079170 0x7fb97807b630 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb9a0009770 tx=0x7fb9a0006cf0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.830 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.826+0000 7fb9b0e76640 10 monclient: shutdown 2026-02-17T11:10:37.830 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.826+0000 7fb9b0e76640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:37.831 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.826+0000 7fb9b0e76640 1 -- 10.20.193.49:0/2139302021 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb9ac15d950 msgr2=0x7fb9ac1570c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.831 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.826+0000 7fb9b0e76640 1 --2- 10.20.193.49:0/2139302021 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb9ac15d950 0x7fb9ac1570c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb99c039040 tx=0x7fb99c004b40 comp rx=0 tx=0).stop 2026-02-17T11:10:37.831 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.826+0000 7fb9b0e76640 1 -- 10.20.193.49:0/2139302021 shutdown_connections 2026-02-17T11:10:37.831 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.826+0000 7fb9b0e76640 1 --2- 10.20.193.49:0/2139302021 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb978079170 0x7fb97807b630 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.831 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.826+0000 7fb9b0e76640 1 --2- 10.20.193.49:0/2139302021 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb9ac15d950 0x7fb9ac1570c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.831 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.826+0000 7fb9b0e76640 1 --2- 10.20.193.49:0/2139302021 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb9ac15c840 0x7fb9ac0d0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.831 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.826+0000 7fb9b0e76640 1 --2- 10.20.193.49:0/2139302021 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb9ac0d1b60 0x7fb9ac148590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.831 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.826+0000 7fb9b0e76640 1 -- 10.20.193.49:0/2139302021 >> 10.20.193.49:0/2139302021 conn(0x7fb9ac06d9b0 msgr2=0x7fb9ac0d0050 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:37.831 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.826+0000 7fb9b0e76640 1 -- 10.20.193.49:0/2139302021 shutdown_connections 2026-02-17T11:10:37.831 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.826+0000 7fb9b0e76640 1 -- 10.20.193.49:0/2139302021 wait complete. 2026-02-17T11:10:37.831 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.826+0000 7fb9b0e76640 1 librados: shutdown 2026-02-17T11:10:37.834 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.833+0000 7f36b67fc640 1 -- 10.20.193.49:0/2697055802 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f36bc062430 con 0x7f36c8152700 2026-02-17T11:10:37.834 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.833+0000 7f36b67fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:37.834 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.833+0000 7f36b67fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:37.837 INFO:tasks.ceph.ceph_manager.ceph:need seq 111669149704 got 111669149703 for osd.0 2026-02-17T11:10:37.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.837+0000 7fc4b8ff9640 1 -- 10.20.193.49:0/3741304070 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc4ac065930 con 0x7fc4bc0d1f40 2026-02-17T11:10:37.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.837+0000 7fc4b8ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-17T11:10:37.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.837+0000 7fc4b8ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:37.839 INFO:teuthology.orchestra.run.trial049.stdout:90194313221 2026-02-17T11:10:37.842 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.839+0000 7fc4c2953640 10 librados: watch_flush enter 2026-02-17T11:10:37.842 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.839+0000 7fc4c2953640 10 librados: watch_flush exit 2026-02-17T11:10:37.842 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.839+0000 7fc4c2953640 20 client.4537.objecter shutdown clearing up homeless session... 2026-02-17T11:10:37.842 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.839+0000 7fc4c2953640 10 client.4537.objecter successfully canceled tick 2026-02-17T11:10:37.842 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.839+0000 7fc4c2953640 1 -- 10.20.193.49:0/3741304070 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fc48c079140 msgr2=0x7fc48c07b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.842 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.839+0000 7fc4c2953640 1 --2- 10.20.193.49:0/3741304070 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fc48c079140 0x7fc48c07b600 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc4a8009750 tx=0x7fc4a8006ca0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.842 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.839+0000 7fc4c2953640 10 monclient: shutdown 2026-02-17T11:10:37.842 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.839+0000 7fc4c2953640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:37.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.839+0000 7fc4c2953640 1 -- 10.20.193.49:0/3741304070 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc4bc0d1f40 msgr2=0x7fc4bc14ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.839+0000 7fc4c2953640 1 --2- 10.20.193.49:0/3741304070 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc4bc0d1f40 0x7fc4bc14ac40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac00c4d0 tx=0x7fc4ac00c9a0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.840+0000 7fc4c2953640 1 -- 10.20.193.49:0/3741304070 shutdown_connections 2026-02-17T11:10:37.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.840+0000 7fc4c2953640 1 --2- 10.20.193.49:0/3741304070 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fc48c079140 0x7fc48c07b600 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.840+0000 7fc4c2953640 1 --2- 10.20.193.49:0/3741304070 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc4bc15e060 0x7fc4bc144570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.840+0000 7fc4c2953640 1 --2- 10.20.193.49:0/3741304070 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc4bc0d1f40 0x7fc4bc14ac40 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.840+0000 7fc4c2953640 1 --2- 10.20.193.49:0/3741304070 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc4bc0d1b60 0x7fc4bc14a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.840+0000 7fc4c2953640 1 -- 10.20.193.49:0/3741304070 >> 10.20.193.49:0/3741304070 conn(0x7fc4bc06d9b0 msgr2=0x7fc4bc0cf740 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:37.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.840+0000 7fc4c2953640 1 -- 10.20.193.49:0/3741304070 shutdown_connections 2026-02-17T11:10:37.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.840+0000 7fc4c2953640 1 -- 10.20.193.49:0/3741304070 wait complete. 2026-02-17T11:10:37.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.840+0000 7fc4c2953640 1 librados: shutdown 2026-02-17T11:10:37.849 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313222 got 90194313221 for osd.4 2026-02-17T11:10:37.903 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.901+0000 7f949129f640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-17T11:10:37.903 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.901+0000 7f949129f640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-17T11:10:37.903 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.901+0000 7f949129f640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:37.903 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.901+0000 7f949129f640 1 -- 10.20.193.49:0/404514965 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 14} v 0) -- 0x7f948c0c72b0 con 0x7f948c152820 2026-02-17T11:10:37.908 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.907+0000 7f946b7fe640 1 -- 10.20.193.49:0/404514965 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 14}]=0 v0) ==== 75+0+12 (secure 0 0 0) 0x7f948c1467c0 con 0x7f948c152820 2026-02-17T11:10:37.908 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.907+0000 7f946b7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-17T11:10:37.908 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.907+0000 7f946b7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:37.909 INFO:teuthology.orchestra.run.trial049.stdout:98784247814 2026-02-17T11:10:37.911 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.908+0000 7f949129f640 10 librados: watch_flush enter 2026-02-17T11:10:37.911 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.908+0000 7f949129f640 10 librados: watch_flush exit 2026-02-17T11:10:37.911 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.908+0000 7f949129f640 20 client.4540.objecter shutdown clearing up homeless session... 2026-02-17T11:10:37.911 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.908+0000 7f949129f640 10 client.4540.objecter successfully canceled tick 2026-02-17T11:10:37.911 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.908+0000 7f949129f640 1 -- 10.20.193.49:0/404514965 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f9458079190 msgr2=0x7f945807b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.911 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.908+0000 7f949129f640 1 --2- 10.20.193.49:0/404514965 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f9458079190 0x7f945807b650 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9480039000 tx=0x7f9480031000 comp rx=0 tx=0).stop 2026-02-17T11:10:37.912 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.908+0000 7f949129f640 10 monclient: shutdown 2026-02-17T11:10:37.912 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.908+0000 7f949129f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:37.912 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.908+0000 7f949129f640 1 -- 10.20.193.49:0/404514965 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f948c152820 msgr2=0x7f948c06d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.912 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.908+0000 7f949129f640 1 --2- 10.20.193.49:0/404514965 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f948c152820 0x7f948c06d2a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f947400c730 tx=0x7f947400cc00 comp rx=0 tx=0).stop 2026-02-17T11:10:37.912 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.909+0000 7f949129f640 1 -- 10.20.193.49:0/404514965 shutdown_connections 2026-02-17T11:10:37.912 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.909+0000 7f949129f640 1 --2- 10.20.193.49:0/404514965 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f9458079190 0x7f945807b650 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.912 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.909+0000 7f949129f640 1 --2- 10.20.193.49:0/404514965 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f948c152c00 0x7f948c146280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.912 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.909+0000 7f949129f640 1 --2- 10.20.193.49:0/404514965 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f948c152820 0x7f948c06d2a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.909+0000 7f949129f640 1 --2- 10.20.193.49:0/404514965 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f948c0738f0 0x7f948c1f7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.909+0000 7f949129f640 1 -- 10.20.193.49:0/404514965 >> 10.20.193.49:0/404514965 conn(0x7f948c0c9f40 msgr2=0x7f948c0c6170 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:37.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.909+0000 7f949129f640 1 -- 10.20.193.49:0/404514965 shutdown_connections 2026-02-17T11:10:37.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.909+0000 7f949129f640 1 -- 10.20.193.49:0/404514965 wait complete. 2026-02-17T11:10:37.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.909+0000 7f949129f640 1 librados: shutdown 2026-02-17T11:10:37.918 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247813 got 98784247814 for osd.14 2026-02-17T11:10:37.919 DEBUG:teuthology.parallel:result is None 2026-02-17T11:10:37.919 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.918+0000 7f36cfd6e640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-17T11:10:37.920 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.918+0000 7f36cfd6e640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-17T11:10:37.920 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.918+0000 7f36cfd6e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:37.920 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.918+0000 7f36cfd6e640 1 -- 10.20.193.49:0/2697055802 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 12} v 0) -- 0x7f36c814e930 con 0x7f36c8152700 2026-02-17T11:10:37.923 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.921+0000 7f36b67fc640 1 -- 10.20.193.49:0/2697055802 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 12}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f36bc061d30 con 0x7f36c8152700 2026-02-17T11:10:37.923 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.921+0000 7f36b67fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-17T11:10:37.923 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.921+0000 7f36b67fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:37.923 INFO:teuthology.orchestra.run.trial049.stdout:111669149703 2026-02-17T11:10:37.926 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.923+0000 7f36cfd6e640 10 librados: watch_flush enter 2026-02-17T11:10:37.926 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.923+0000 7f36cfd6e640 10 librados: watch_flush exit 2026-02-17T11:10:37.926 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.923+0000 7f36cfd6e640 20 client.4543.objecter shutdown clearing up homeless session... 2026-02-17T11:10:37.926 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.923+0000 7f36cfd6e640 10 client.4543.objecter successfully canceled tick 2026-02-17T11:10:37.926 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.923+0000 7f36cfd6e640 1 -- 10.20.193.49:0/2697055802 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3698079190 msgr2=0x7f369807b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.926 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.923+0000 7f36cfd6e640 1 --2- 10.20.193.49:0/2697055802 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3698079190 0x7f369807b650 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f36b80098a0 tx=0x7f36b8006d90 comp rx=0 tx=0).stop 2026-02-17T11:10:37.926 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.923+0000 7f36cfd6e640 10 monclient: shutdown 2026-02-17T11:10:37.926 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.923+0000 7f36cfd6e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:37.926 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.923+0000 7f36cfd6e640 1 -- 10.20.193.49:0/2697055802 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f36c8152700 msgr2=0x7f36c81f4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:37.927 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.923+0000 7f36cfd6e640 1 --2- 10.20.193.49:0/2697055802 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f36c8152700 0x7f36c81f4e00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f36bc00e810 tx=0x7f36bc00ece0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.927 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.923+0000 7f36cfd6e640 1 -- 10.20.193.49:0/2697055802 shutdown_connections 2026-02-17T11:10:37.927 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.923+0000 7f36cfd6e640 1 --2- 10.20.193.49:0/2697055802 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3698079190 0x7f369807b650 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.927 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.923+0000 7f36cfd6e640 1 --2- 10.20.193.49:0/2697055802 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f36c8152ae0 0x7f36c81f6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.927 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.923+0000 7f36cfd6e640 1 --2- 10.20.193.49:0/2697055802 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f36c8152700 0x7f36c81f4e00 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.927 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.923+0000 7f36cfd6e640 1 --2- 10.20.193.49:0/2697055802 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f36c80c9730 0x7f36c81f4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:37.927 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.923+0000 7f36cfd6e640 1 -- 10.20.193.49:0/2697055802 >> 10.20.193.49:0/2697055802 conn(0x7f36c8073030 msgr2=0x7f36c8147dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:37.927 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.923+0000 7f36cfd6e640 1 -- 10.20.193.49:0/2697055802 shutdown_connections 2026-02-17T11:10:37.927 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.923+0000 7f36cfd6e640 1 -- 10.20.193.49:0/2697055802 wait complete. 2026-02-17T11:10:37.927 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:37.923+0000 7f36cfd6e640 1 librados: shutdown 2026-02-17T11:10:37.933 INFO:tasks.ceph.ceph_manager.ceph:need seq 111669149702 got 111669149703 for osd.12 2026-02-17T11:10:37.933 DEBUG:teuthology.parallel:result is None 2026-02-17T11:10:38.156 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2026-02-17T11:10:38.206 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2026-02-17T11:10:38.221 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.11 2026-02-17T11:10:38.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.225+0000 7f3d883de640 10 monclient: get_monmap_and_config 2026-02-17T11:10:38.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.225+0000 7f3d883de640 10 monclient: build_initial_monmap 2026-02-17T11:10:38.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.225+0000 7f3d883de640 10 monclient: monmap: 2026-02-17T11:10:38.227 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:38.228 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.228 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:38.226013+0000 2026-02-17T11:10:38.228 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:38.226013+0000 2026-02-17T11:10:38.228 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:38.228 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.228 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:38.228 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:38.228 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:38.228 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:38.228 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:38.228 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:38.228 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.229 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.225+0000 7f3d883de640 1 Processor -- start 2026-02-17T11:10:38.229 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.226+0000 7f3d883de640 1 -- start start 2026-02-17T11:10:38.229 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.226+0000 7f3d883de640 10 monclient: init 2026-02-17T11:10:38.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.226+0000 7f3d883de640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:38.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.226+0000 7f3d883de640 10 monclient: _add_conns ranks=[1,0,5,3,4,2] 2026-02-17T11:10:38.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.226+0000 7f3d883de640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f3d8014f280 addr v1:10.20.193.97:6789/0 2026-02-17T11:10:38.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.226+0000 7f3d883de640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f3d8014f660 addr v1:10.20.193.49:6789/0 2026-02-17T11:10:38.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.226+0000 7f3d883de640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f3d8015abc0 0x7f3d8015afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.226+0000 7f3d883de640 10 monclient(hunting): picked mon.noname-c con 0x7f3d8015abc0 addr v2:10.20.193.157:3300/0 2026-02-17T11:10:38.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.226+0000 7f3d883de640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d800c7110 con 0x7f3d8014f660 2026-02-17T11:10:38.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.226+0000 7f3d883de640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d800c7390 con 0x7f3d8014f280 2026-02-17T11:10:38.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.226+0000 7f3d883de640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.226+0000 7f3d883de640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f3d800c7950 con 0x7f3d8015abc0 2026-02-17T11:10:38.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.226+0000 7f3d883de640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:38.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.226+0000 7f3d883de640 10 monclient(hunting): authenticate will time out at 1114.889673s 2026-02-17T11:10:38.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.227+0000 7f3d86954640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f3d8015abc0 0x7f3d8015afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:38.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.227+0000 7f3d85952640 1 --1- >> v1:10.20.193.49:6789/0 conn(0x7f3d8014f660 0x7f3d800c6a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.49:6789/0 says I am v1:10.20.193.49:47686/0 (socket says 10.20.193.49:47686) 2026-02-17T11:10:38.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.227+0000 7f3d85952640 1 -- 10.20.193.49:0/457191151 learned_addr learned my addr 10.20.193.49:0/457191151 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:10:38.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.227+0000 7f3d86954640 10 monclient(hunting): get_auth_request con 0x7f3d8015abc0 auth_method 0 2026-02-17T11:10:38.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.227+0000 7f3d86954640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:38.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.227+0000 7f3d86954640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:38.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.227+0000 7f3d86954640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:38.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.227+0000 7f3d86954640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:38.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.227+0000 7f3d86954640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:38.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.227+0000 7f3d86954640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:38.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.228+0000 7f3d86954640 10 monclient(hunting): handle_auth_done global_id 4565 payload 274 2026-02-17T11:10:38.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.228+0000 7f3d86954640 1 -- 10.20.193.49:0/457191151 >> v1:10.20.193.97:6789/0 conn(0x7f3d8014f280 legacy=0x7f3d800c7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.228+0000 7f3d86954640 1 -- 10.20.193.49:0/457191151 >> v1:10.20.193.49:6789/0 conn(0x7f3d8014f660 legacy=0x7f3d800c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.228+0000 7f3d86954640 10 monclient: _finish_hunting 0 2026-02-17T11:10:38.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.228+0000 7f3d86954640 1 monclient: found mon.noname-c 2026-02-17T11:10:38.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.228+0000 7f3d86954640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:38.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.228+0000 7f3d86954640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:10:38.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.228+0000 7f3d86954640 1 -- 10.20.193.49:0/457191151 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d800c7670 con 0x7f3d8015abc0 2026-02-17T11:10:38.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.229+0000 7f3d86954640 1 --2- 10.20.193.49:0/457191151 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f3d8015abc0 0x7f3d8015afe0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c009d90 tx=0x7f3d7c02f2c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2862691d883d27c0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:38.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.231+0000 7f3d85151640 1 -- 10.20.193.49:0/457191151 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c03c070 con 0x7f3d8015abc0 2026-02-17T11:10:38.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.231+0000 7f3d85151640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:38.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.231+0000 7f3d85151640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:10:38.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.231+0000 7f3d85151640 10 monclient: dump: 2026-02-17T11:10:38.239 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:38.239 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.239 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.239 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.239 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:38.240 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.240 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:38.240 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:38.240 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:38.240 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.231+0000 7f3d85151640 10 monclient: _finish_auth 0 2026-02-17T11:10:38.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.231+0000 7f3d85151640 10 monclient: _check_auth_tickets 2026-02-17T11:10:38.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.231+0000 7f3d85151640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:38.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.231+0000 7f3d85151640 1 -- 10.20.193.49:0/457191151 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d7c037440 con 0x7f3d8015abc0 2026-02-17T11:10:38.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.231+0000 7f3d883de640 5 monclient: authenticate success, global_id 4565 2026-02-17T11:10:38.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.231+0000 7f3d883de640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:10:38.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.231+0000 7f3d85151640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:38.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.231+0000 7f3d85151640 1 -- 10.20.193.49:0/457191151 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c037810 con 0x7f3d8015abc0 2026-02-17T11:10:38.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.231+0000 7f3d85151640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:38.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.231+0000 7f3d85151640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:10:38.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.231+0000 7f3d85151640 10 monclient: dump: 2026-02-17T11:10:38.241 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:38.241 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.241 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.241 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.241 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:38.241 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.241 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:38.241 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:38.242 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:38.242 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.231+0000 7f3d883de640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:38.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.231+0000 7f3d883de640 4 set_mon_vals no callback set 2026-02-17T11:10:38.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.231+0000 7f3d883de640 10 monclient: shutdown 2026-02-17T11:10:38.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.231+0000 7f3d883de640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:38.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.231+0000 7f3d883de640 1 -- 10.20.193.49:0/457191151 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f3d8015abc0 msgr2=0x7f3d8015afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.231+0000 7f3d883de640 1 --2- 10.20.193.49:0/457191151 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f3d8015abc0 0x7f3d8015afe0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c009d90 tx=0x7f3d7c02f2c0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.231+0000 7f3d883de640 1 -- 10.20.193.49:0/457191151 shutdown_connections 2026-02-17T11:10:38.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.231+0000 7f3d883de640 1 --2- 10.20.193.49:0/457191151 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f3d8015abc0 0x7f3d8015afe0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.231+0000 7f3d883de640 1 -- 10.20.193.49:0/457191151 >> 10.20.193.49:0/457191151 conn(0x7f3d800c9f20 msgr2=0x7f3d800ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:38.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.231+0000 7f3d883de640 1 -- 10.20.193.49:0/457191151 shutdown_connections 2026-02-17T11:10:38.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.231+0000 7f3d883de640 1 -- 10.20.193.49:0/457191151 wait complete. 2026-02-17T11:10:38.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.232+0000 7f3d883de640 10 monclient: build_initial_monmap 2026-02-17T11:10:38.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.232+0000 7f3d883de640 10 monclient: monmap: 2026-02-17T11:10:38.243 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:38.243 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:38.243 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:38.243 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:38.243 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:38.243 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.243 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:38.244 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:38.244 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:38.244 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.232+0000 7f3d883de640 1 librados: starting msgr at 2026-02-17T11:10:38.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.232+0000 7f3d883de640 1 librados: starting objecter 2026-02-17T11:10:38.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.232+0000 7f3d883de640 1 Processor -- start 2026-02-17T11:10:38.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.232+0000 7f3d883de640 1 -- start start 2026-02-17T11:10:38.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.232+0000 7f3d883de640 1 librados: setting wanted keys 2026-02-17T11:10:38.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.232+0000 7f3d883de640 1 librados: calling monclient init 2026-02-17T11:10:38.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.232+0000 7f3d883de640 10 monclient: init 2026-02-17T11:10:38.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.233+0000 7f3d883de640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:38.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.233+0000 7f3d883de640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:10:38.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.233+0000 7f3d883de640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f3d8014f280 0x7f3d801f4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.233+0000 7f3d883de640 10 monclient(hunting): picked mon.noname-b con 0x7f3d8014f280 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:38.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.233+0000 7f3d883de640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f3d8014f660 0x7f3d801568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.233+0000 7f3d883de640 10 monclient(hunting): picked mon.noname-a con 0x7f3d8014f660 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:38.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.233+0000 7f3d883de640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f3d8015abc0 0x7f3d8014ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.233+0000 7f3d883de640 10 monclient(hunting): picked mon.noname-c con 0x7f3d8015abc0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:38.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.233+0000 7f3d883de640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.233+0000 7f3d883de640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f3d8015a3c0 con 0x7f3d8014f660 2026-02-17T11:10:38.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.233+0000 7f3d883de640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.233+0000 7f3d883de640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f3d8015a730 con 0x7f3d8014f280 2026-02-17T11:10:38.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.233+0000 7f3d883de640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.233+0000 7f3d883de640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f3d8015b520 con 0x7f3d8015abc0 2026-02-17T11:10:38.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.233+0000 7f3d883de640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:38.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.233+0000 7f3d883de640 10 monclient(hunting): authenticate will time out at 1114.896529s 2026-02-17T11:10:38.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.233+0000 7f3d86153640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f3d8014f280 0x7f3d801f4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:38.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.233+0000 7f3d85952640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f3d8014f660 0x7f3d801568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:38.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.233+0000 7f3d86954640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f3d8015abc0 0x7f3d8014ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:38.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.234+0000 7f3d86153640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f3d8014f280 0x7f3d801f4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:55712/0 (socket says 10.20.193.49:55712) 2026-02-17T11:10:38.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.234+0000 7f3d86153640 1 -- 10.20.193.49:0/810886775 learned_addr learned my addr 10.20.193.49:0/810886775 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:38.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.234+0000 7f3d86153640 10 monclient(hunting): get_auth_request con 0x7f3d8014f280 auth_method 0 2026-02-17T11:10:38.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.234+0000 7f3d86153640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:38.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.234+0000 7f3d86153640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:38.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.234+0000 7f3d86153640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:38.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.234+0000 7f3d85952640 10 monclient(hunting): get_auth_request con 0x7f3d8014f660 auth_method 0 2026-02-17T11:10:38.247 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.234+0000 7f3d85952640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:38.247 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.234+0000 7f3d85952640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:38.247 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.234+0000 7f3d85952640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:38.247 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.234+0000 7f3d86954640 10 monclient(hunting): get_auth_request con 0x7f3d8015abc0 auth_method 0 2026-02-17T11:10:38.247 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.234+0000 7f3d86954640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:38.247 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.234+0000 7f3d86954640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:38.247 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.234+0000 7f3d86954640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:38.247 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.234+0000 7f3d86153640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:38.247 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.234+0000 7f3d86153640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:38.247 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.234+0000 7f3d86153640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:38.247 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.234+0000 7f3d85952640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:38.247 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.234+0000 7f3d85952640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:38.247 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.234+0000 7f3d85952640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:38.247 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.234+0000 7f3d86954640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:38.248 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.234+0000 7f3d86954640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:38.248 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.234+0000 7f3d86954640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:38.248 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.235+0000 7f3d86153640 10 monclient(hunting): handle_auth_done global_id 4549 payload 824 2026-02-17T11:10:38.248 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.235+0000 7f3d86153640 1 -- 10.20.193.49:0/810886775 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f3d8015abc0 msgr2=0x7f3d8014ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.248 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.235+0000 7f3d86153640 1 --2- 10.20.193.49:0/810886775 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f3d8015abc0 0x7f3d8014ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.248 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.235+0000 7f3d86153640 1 -- 10.20.193.49:0/810886775 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f3d8014f660 msgr2=0x7f3d801568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.248 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.235+0000 7f3d86153640 1 --2- 10.20.193.49:0/810886775 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f3d8014f660 0x7f3d801568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.248 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.235+0000 7f3d86153640 10 monclient: _finish_hunting 0 2026-02-17T11:10:38.248 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.235+0000 7f3d86153640 1 monclient: found mon.noname-b 2026-02-17T11:10:38.248 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.235+0000 7f3d86153640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:38.248 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.235+0000 7f3d86153640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:10:38.248 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.235+0000 7f3d86153640 1 -- 10.20.193.49:0/810886775 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d801f7750 con 0x7f3d8014f280 2026-02-17T11:10:38.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.236+0000 7f3d86153640 1 --2- 10.20.193.49:0/810886775 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f3d8014f280 0x7f3d801f4710 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3d7000c480 tx=0x7f3d7000c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:38.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.236+0000 7f3d66ffd640 10 client.?.objecter ms_handle_connect 0x7f3d8014f280 2026-02-17T11:10:38.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.236+0000 7f3d66ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:38.251 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.238+0000 7f3d66ffd640 1 -- 10.20.193.49:0/810886775 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d70017070 con 0x7f3d8014f280 2026-02-17T11:10:38.251 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.238+0000 7f3d66ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:38.251 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.238+0000 7f3d66ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:10:38.251 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.238+0000 7f3d66ffd640 10 monclient: dump: 2026-02-17T11:10:38.251 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:38.251 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.251 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.251 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.252 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:38.252 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.252 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:38.252 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:38.252 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:38.252 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.252 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.238+0000 7f3d66ffd640 10 monclient: _finish_auth 0 2026-02-17T11:10:38.252 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.238+0000 7f3d66ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:10:38.252 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.238+0000 7f3d66ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:38.252 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.238+0000 7f3d66ffd640 1 -- 10.20.193.49:0/810886775 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d700052f0 con 0x7f3d8014f280 2026-02-17T11:10:38.252 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.238+0000 7f3d66ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:38.252 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.238+0000 7f3d66ffd640 1 -- 10.20.193.49:0/810886775 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d700036f0 con 0x7f3d8014f280 2026-02-17T11:10:38.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.238+0000 7f3d883de640 5 monclient: authenticate success, global_id 4549 2026-02-17T11:10:38.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.238+0000 7f3d883de640 10 monclient: _renew_subs 2026-02-17T11:10:38.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.238+0000 7f3d84950640 4 set_mon_vals no callback set 2026-02-17T11:10:38.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.238+0000 7f3d883de640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:38.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.238+0000 7f3d883de640 1 -- 10.20.193.49:0/810886775 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d801f7a30 con 0x7f3d8014f280 2026-02-17T11:10:38.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.238+0000 7f3d66ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:38.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.238+0000 7f3d66ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:38.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.238+0000 7f3d66ffd640 10 monclient: dump: 2026-02-17T11:10:38.253 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:38.253 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.254 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.254 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.254 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:38.254 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.254 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:38.254 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:38.254 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:38.254 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.254 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.238+0000 7f3d883de640 10 client.4549.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:38.254 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.238+0000 7f3d883de640 10 monclient: _renew_subs 2026-02-17T11:10:38.254 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.238+0000 7f3d883de640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:38.254 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.238+0000 7f3d883de640 1 -- 10.20.193.49:0/810886775 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d801f7ff0 con 0x7f3d8014f280 2026-02-17T11:10:38.254 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.238+0000 7f3d883de640 1 librados: init done 2026-02-17T11:10:38.255 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.239+0000 7f3d883de640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:38.255 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.239+0000 7f3d883de640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:38.255 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.239+0000 7f3d883de640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:38.255 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.239+0000 7f3d883de640 1 -- 10.20.193.49:0/810886775 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d80074860 con 0x7f3d8014f280 2026-02-17T11:10:38.255 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.249+0000 7f3d66ffd640 1 -- 10.20.193.49:0/810886775 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f3d70003890 con 0x7f3d8014f280 2026-02-17T11:10:38.256 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.250+0000 7f3d66ffd640 1 --2- 10.20.193.49:0/810886775 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3d50079170 0x7f3d5007b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.256 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.250+0000 7f3d85952640 1 --2- 10.20.193.49:0/810886775 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3d50079170 0x7f3d5007b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:38.256 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.250+0000 7f3d85952640 10 monclient: get_auth_request con 0x7f3d50079170 auth_method 0 2026-02-17T11:10:38.256 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.251+0000 7f3d66ffd640 1 -- 10.20.193.49:0/810886775 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7f3d7005d560 con 0x7f3d8014f280 2026-02-17T11:10:38.256 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.251+0000 7f3d66ffd640 10 client.4549.objecter ms_dispatch2 0x7f3d80000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:38.256 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.251+0000 7f3d66ffd640 3 client.4549.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:38.257 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.251+0000 7f3d66ffd640 3 client.4549.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:38.257 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.251+0000 7f3d66ffd640 20 client.4549.objecter dump_active .. 0 homeless 2026-02-17T11:10:38.257 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.251+0000 7f3d66ffd640 10 client.4549.objecter ms_handle_connect 0x7f3d50079170 2026-02-17T11:10:38.257 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.251+0000 7f3d85952640 1 --2- 10.20.193.49:0/810886775 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3d50079170 0x7f3d5007b630 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3d8014e770 tx=0x7f3d74009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:38.272 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.271+0000 7effb4d11640 10 monclient: get_monmap_and_config 2026-02-17T11:10:38.272 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.271+0000 7effb4d11640 10 monclient: build_initial_monmap 2026-02-17T11:10:38.273 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.271+0000 7effb4d11640 10 monclient: monmap: 2026-02-17T11:10:38.273 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:38.273 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.273 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:38.271851+0000 2026-02-17T11:10:38.273 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:38.271851+0000 2026-02-17T11:10:38.273 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:38.273 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.273 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:38.273 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:38.274 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:38.274 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:38.274 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:38.274 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:38.274 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.271+0000 7effb4d11640 1 Processor -- start 2026-02-17T11:10:38.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.271+0000 7effb4d11640 1 -- start start 2026-02-17T11:10:38.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.271+0000 7effb4d11640 10 monclient: init 2026-02-17T11:10:38.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.272+0000 7effb4d11640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:38.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.272+0000 7effb4d11640 10 monclient: _add_conns ranks=[5,0,3,4,2,1] 2026-02-17T11:10:38.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.272+0000 7effb4d11640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7effb015f690 0x7effb015fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.272+0000 7effb4d11640 10 monclient(hunting): picked mon.noname-c con 0x7effb015f690 addr v2:10.20.193.157:3300/0 2026-02-17T11:10:38.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.272+0000 7effb4d11640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7effb00c9050 addr v1:10.20.193.49:6789/0 2026-02-17T11:10:38.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.272+0000 7effb4d11640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7effb0072de0 0x7effb015d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.272+0000 7effb4d11640 10 monclient(hunting): picked mon.noname-a con 0x7effb0072de0 addr v2:10.20.193.49:3300/0 2026-02-17T11:10:38.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.272+0000 7effb4d11640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effb00732e0 con 0x7effb00c9050 2026-02-17T11:10:38.278 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.272+0000 7effb4d11640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.278 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.272+0000 7effb4d11640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7effb00735c0 con 0x7effb0072de0 2026-02-17T11:10:38.278 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.272+0000 7effb4d11640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.278 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.272+0000 7effb4d11640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7effb00738a0 con 0x7effb015f690 2026-02-17T11:10:38.278 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.272+0000 7effb4d11640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:38.278 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.272+0000 7effb4d11640 10 monclient(hunting): authenticate will time out at 1114.935319s 2026-02-17T11:10:38.278 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.272+0000 7effae575640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7effb015f690 0x7effb015fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:38.278 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.272+0000 7effae575640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7effb015f690 0x7effb015fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:48380/0 (socket says 10.20.193.49:48380) 2026-02-17T11:10:38.278 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.272+0000 7effae575640 1 -- 10.20.193.49:0/1390228812 learned_addr learned my addr 10.20.193.49:0/1390228812 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:38.278 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.272+0000 7effae575640 10 monclient(hunting): get_auth_request con 0x7effb015f690 auth_method 0 2026-02-17T11:10:38.278 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.272+0000 7effae575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:38.278 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.272+0000 7effae575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:38.278 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.272+0000 7effae575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:38.279 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.273+0000 7effae575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:38.279 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.273+0000 7effae575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:38.279 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.273+0000 7effae575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:38.279 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.273+0000 7effae575640 10 monclient(hunting): handle_auth_done global_id 4571 payload 274 2026-02-17T11:10:38.279 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.273+0000 7effae575640 1 -- 10.20.193.49:0/1390228812 >> v2:10.20.193.49:3300/0 conn(0x7effb0072de0 msgr2=0x7effb015d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:38.279 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.273+0000 7effae575640 1 --2- 10.20.193.49:0/1390228812 >> v2:10.20.193.49:3300/0 conn(0x7effb0072de0 0x7effb015d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.279 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.273+0000 7effae575640 1 -- 10.20.193.49:0/1390228812 >> v1:10.20.193.49:6789/0 conn(0x7effb00c9050 legacy=0x7effb00726d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:38.279 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.273+0000 7effae575640 10 monclient: _finish_hunting 0 2026-02-17T11:10:38.279 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.273+0000 7effae575640 1 monclient: found mon.noname-c 2026-02-17T11:10:38.279 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.273+0000 7effae575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:38.279 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.273+0000 7effae575640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:10:38.279 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.273+0000 7effae575640 1 -- 10.20.193.49:0/1390228812 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effb0073b80 con 0x7effb015f690 2026-02-17T11:10:38.280 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.274+0000 7effae575640 1 --2- 10.20.193.49:0/1390228812 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7effb015f690 0x7effb015fa70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7effb0072680 tx=0x7effa402ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0c25c38ad62e80b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:38.284 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.276+0000 7effad573640 1 -- 10.20.193.49:0/1390228812 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa403c070 con 0x7effb015f690 2026-02-17T11:10:38.284 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.276+0000 7effad573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:38.284 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.276+0000 7effad573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:10:38.284 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.276+0000 7effad573640 10 monclient: dump: 2026-02-17T11:10:38.284 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:38.284 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.284 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.284 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.284 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:38.284 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.285 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:38.285 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:38.285 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:38.285 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.285 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.276+0000 7effad573640 10 monclient: _finish_auth 0 2026-02-17T11:10:38.285 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.276+0000 7effad573640 10 monclient: _check_auth_tickets 2026-02-17T11:10:38.285 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.276+0000 7effad573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:38.285 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.276+0000 7effad573640 1 -- 10.20.193.49:0/1390228812 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effa402fa90 con 0x7effb015f690 2026-02-17T11:10:38.285 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.276+0000 7effb4d11640 5 monclient: authenticate success, global_id 4571 2026-02-17T11:10:38.285 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.276+0000 7effb4d11640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:10:38.285 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.276+0000 7effad573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:38.285 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.276+0000 7effad573640 1 -- 10.20.193.49:0/1390228812 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa402fe60 con 0x7effb015f690 2026-02-17T11:10:38.286 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.276+0000 7effb4d11640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:38.286 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.276+0000 7effb4d11640 4 set_mon_vals no callback set 2026-02-17T11:10:38.286 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.276+0000 7effad573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:38.286 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.276+0000 7effad573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:10:38.286 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.276+0000 7effad573640 10 monclient: dump: 2026-02-17T11:10:38.286 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:38.286 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.286 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.286 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.286 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:38.286 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.286 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:38.287 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:38.287 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:38.287 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.287 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.276+0000 7effb4d11640 10 monclient: shutdown 2026-02-17T11:10:38.287 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.276+0000 7effb4d11640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:38.287 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.276+0000 7effb4d11640 1 -- 10.20.193.49:0/1390228812 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7effb015f690 msgr2=0x7effb015fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.287 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.276+0000 7effb4d11640 1 --2- 10.20.193.49:0/1390228812 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7effb015f690 0x7effb015fa70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7effb0072680 tx=0x7effa402ee60 comp rx=0 tx=0).stop 2026-02-17T11:10:38.287 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.277+0000 7effb4d11640 1 -- 10.20.193.49:0/1390228812 shutdown_connections 2026-02-17T11:10:38.287 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.277+0000 7effb4d11640 1 --2- 10.20.193.49:0/1390228812 >> v2:10.20.193.49:3300/0 conn(0x7effb0072de0 0x7effb015d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.287 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.277+0000 7effb4d11640 1 --2- 10.20.193.49:0/1390228812 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7effb015f690 0x7effb015fa70 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.287 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.277+0000 7effb4d11640 1 -- 10.20.193.49:0/1390228812 >> 10.20.193.49:0/1390228812 conn(0x7effb00c9f20 msgr2=0x7effb00ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:38.287 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.277+0000 7effb4d11640 1 -- 10.20.193.49:0/1390228812 shutdown_connections 2026-02-17T11:10:38.288 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.277+0000 7effb4d11640 1 -- 10.20.193.49:0/1390228812 wait complete. 2026-02-17T11:10:38.288 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.277+0000 7effb4d11640 10 monclient: build_initial_monmap 2026-02-17T11:10:38.288 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.277+0000 7effb4d11640 10 monclient: monmap: 2026-02-17T11:10:38.288 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:38.288 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:38.288 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:38.288 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:38.288 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:38.288 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.288 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:38.288 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:38.288 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:38.289 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.289 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.277+0000 7effb4d11640 1 librados: starting msgr at 2026-02-17T11:10:38.289 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.277+0000 7effb4d11640 1 librados: starting objecter 2026-02-17T11:10:38.289 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.277+0000 7effb4d11640 1 Processor -- start 2026-02-17T11:10:38.289 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.277+0000 7effb4d11640 1 -- start start 2026-02-17T11:10:38.289 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.277+0000 7effb4d11640 1 librados: setting wanted keys 2026-02-17T11:10:38.289 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.277+0000 7effb4d11640 1 librados: calling monclient init 2026-02-17T11:10:38.289 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.277+0000 7effb4d11640 10 monclient: init 2026-02-17T11:10:38.289 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.278+0000 7effb4d11640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:38.289 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.278+0000 7effb4d11640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:10:38.289 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.278+0000 7effb4d11640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7effb0072de0 0x7effb00c6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.289 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.278+0000 7effb4d11640 10 monclient(hunting): picked mon.noname-c con 0x7effb0072de0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:38.289 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.278+0000 7effb4d11640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7effb00c9050 0x7effb014b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.290 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.278+0000 7effb4d11640 10 monclient(hunting): picked mon.noname-b con 0x7effb00c9050 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:38.290 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.278+0000 7effb4d11640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7effb015f690 0x7effb00c4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.290 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.278+0000 7effb4d11640 10 monclient(hunting): picked mon.noname-a con 0x7effb015f690 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:38.290 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.278+0000 7effb4d11640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.290 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.278+0000 7effb4d11640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7effb00c9640 con 0x7effb015f690 2026-02-17T11:10:38.290 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.278+0000 7effb4d11640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.290 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.278+0000 7effb4d11640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7effb00c94c0 con 0x7effb00c9050 2026-02-17T11:10:38.290 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.278+0000 7effb4d11640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.290 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.278+0000 7effb4d11640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7effb00c97c0 con 0x7effb0072de0 2026-02-17T11:10:38.290 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.278+0000 7effb4d11640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:38.290 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.278+0000 7effb4d11640 10 monclient(hunting): authenticate will time out at 1114.941319s 2026-02-17T11:10:38.290 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.278+0000 7effae575640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7effb0072de0 0x7effb00c6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:38.290 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.278+0000 7effae575640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7effb0072de0 0x7effb00c6ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:48382/0 (socket says 10.20.193.49:48382) 2026-02-17T11:10:38.291 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.278+0000 7effae575640 1 -- 10.20.193.49:0/3166480743 learned_addr learned my addr 10.20.193.49:0/3166480743 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:38.291 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.278+0000 7effae575640 10 monclient(hunting): get_auth_request con 0x7effb0072de0 auth_method 0 2026-02-17T11:10:38.291 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.278+0000 7effae575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:38.291 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.278+0000 7effae575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:38.291 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.278+0000 7effae575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:38.291 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.278+0000 7effae575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:38.291 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.278+0000 7effae575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:38.291 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.278+0000 7effae575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:38.291 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.280+0000 7effae575640 10 monclient(hunting): handle_auth_done global_id 4574 payload 824 2026-02-17T11:10:38.291 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.280+0000 7effae575640 1 -- 10.20.193.49:0/3166480743 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7effb00c9050 msgr2=0x7effb014b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.291 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.280+0000 7effae575640 1 --2- 10.20.193.49:0/3166480743 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7effb00c9050 0x7effb014b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.291 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.280+0000 7effae575640 1 -- 10.20.193.49:0/3166480743 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7effb015f690 msgr2=0x7effb00c4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.292 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.280+0000 7effae575640 1 --2- 10.20.193.49:0/3166480743 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7effb015f690 0x7effb00c4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.292 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.280+0000 7effae575640 10 monclient: _finish_hunting 0 2026-02-17T11:10:38.292 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.280+0000 7effae575640 1 monclient: found mon.noname-c 2026-02-17T11:10:38.292 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.280+0000 7effae575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:38.292 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.280+0000 7effae575640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:10:38.292 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.280+0000 7effae575640 1 -- 10.20.193.49:0/3166480743 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effb01f37b0 con 0x7effb0072de0 2026-02-17T11:10:38.292 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.281+0000 7effae575640 1 --2- 10.20.193.49:0/3166480743 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7effb0072de0 0x7effb00c6ce0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7effa4002410 tx=0x7effa40047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:38.292 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.281+0000 7eff96ffd640 10 client.?.objecter ms_handle_connect 0x7effb0072de0 2026-02-17T11:10:38.292 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.281+0000 7eff96ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:38.294 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.283+0000 7eff96ffd640 1 -- 10.20.193.49:0/3166480743 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa4044070 con 0x7effb0072de0 2026-02-17T11:10:38.294 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.283+0000 7eff96ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:38.294 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.283+0000 7eff96ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:10:38.294 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.283+0000 7eff96ffd640 10 monclient: dump: 2026-02-17T11:10:38.294 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:38.294 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.294 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.294 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.294 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:38.294 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.295 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:38.295 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:38.295 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:38.295 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.295 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.283+0000 7eff96ffd640 10 monclient: _finish_auth 0 2026-02-17T11:10:38.295 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.283+0000 7eff96ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:10:38.295 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.283+0000 7eff96ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:38.295 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.283+0000 7eff96ffd640 1 -- 10.20.193.49:0/3166480743 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effa4040630 con 0x7effb0072de0 2026-02-17T11:10:38.295 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.283+0000 7eff96ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:38.295 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.283+0000 7eff96ffd640 1 -- 10.20.193.49:0/3166480743 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa403c040 con 0x7effb0072de0 2026-02-17T11:10:38.295 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.283+0000 7effb4d11640 5 monclient: authenticate success, global_id 4574 2026-02-17T11:10:38.295 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.283+0000 7effacd72640 4 set_mon_vals no callback set 2026-02-17T11:10:38.295 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.283+0000 7eff96ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:38.295 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.283+0000 7eff96ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:10:38.296 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.283+0000 7eff96ffd640 10 monclient: dump: 2026-02-17T11:10:38.296 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:38.296 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.296 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.296 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.296 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:38.296 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.296 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:38.296 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:38.296 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:38.296 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.296 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.283+0000 7effb4d11640 10 monclient: _renew_subs 2026-02-17T11:10:38.296 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.283+0000 7effb4d11640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:38.296 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.283+0000 7effb4d11640 1 -- 10.20.193.49:0/3166480743 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effb01f3a90 con 0x7effb0072de0 2026-02-17T11:10:38.296 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.283+0000 7effb4d11640 10 client.4574.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:38.297 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.283+0000 7effb4d11640 10 monclient: _renew_subs 2026-02-17T11:10:38.297 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.283+0000 7effb4d11640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:38.297 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.283+0000 7effb4d11640 1 -- 10.20.193.49:0/3166480743 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effb01f4050 con 0x7effb0072de0 2026-02-17T11:10:38.297 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.283+0000 7effb4d11640 1 librados: init done 2026-02-17T11:10:38.297 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.283+0000 7effb4d11640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:38.297 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.283+0000 7effb4d11640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:38.297 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.283+0000 7effb4d11640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:38.297 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.283+0000 7effb4d11640 1 -- 10.20.193.49:0/3166480743 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effb015fa70 con 0x7effb0072de0 2026-02-17T11:10:38.301 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.291+0000 7f0b137cc640 10 monclient: get_monmap_and_config 2026-02-17T11:10:38.301 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.291+0000 7f0b137cc640 10 monclient: build_initial_monmap 2026-02-17T11:10:38.301 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.291+0000 7f0b137cc640 10 monclient: monmap: 2026-02-17T11:10:38.301 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:38.301 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.302 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:38.292346+0000 2026-02-17T11:10:38.302 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:38.292346+0000 2026-02-17T11:10:38.302 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:38.302 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.302 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:38.302 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:38.302 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:38.302 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:38.302 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:38.302 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:38.302 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.302 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.292+0000 7f0b137cc640 1 Processor -- start 2026-02-17T11:10:38.302 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.292+0000 7f0b137cc640 1 -- start start 2026-02-17T11:10:38.302 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.292+0000 7f0b137cc640 10 monclient: init 2026-02-17T11:10:38.302 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.292+0000 7f0b137cc640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:38.302 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.292+0000 7f0b137cc640 10 monclient: _add_conns ranks=[3,2,1,0,4,5] 2026-02-17T11:10:38.302 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.292+0000 7f0b137cc640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f0b0c0c7170 0x7f0b0c0c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.292+0000 7f0b137cc640 10 monclient(hunting): picked mon.noname-a con 0x7f0b0c0c7170 addr v2:10.20.193.49:3300/0 2026-02-17T11:10:38.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.292+0000 7f0b137cc640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f0b0c0c48c0 addr v1:10.20.193.157:6789/0 2026-02-17T11:10:38.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.292+0000 7f0b137cc640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f0b0c0c4d10 addr v1:10.20.193.97:6789/0 2026-02-17T11:10:38.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.292+0000 7f0b137cc640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b0c15a9a0 con 0x7f0b0c0c4d10 2026-02-17T11:10:38.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.292+0000 7f0b137cc640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b0c0c5270 con 0x7f0b0c0c48c0 2026-02-17T11:10:38.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.292+0000 7f0b137cc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.292+0000 7f0b137cc640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f0b0c0c8530 con 0x7f0b0c0c7170 2026-02-17T11:10:38.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.292+0000 7f0b137cc640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:38.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.292+0000 7f0b137cc640 10 monclient(hunting): authenticate will time out at 1114.955997s 2026-02-17T11:10:38.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.293+0000 7f0b11541640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f0b0c0c7170 0x7f0b0c0c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:38.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.293+0000 7f0b11541640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f0b0c0c7170 0x7f0b0c0c7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:33586/0 (socket says 10.20.193.49:33586) 2026-02-17T11:10:38.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.293+0000 7f0b11541640 1 -- 10.20.193.49:0/991331582 learned_addr learned my addr 10.20.193.49:0/991331582 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:38.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.293+0000 7f0b11541640 10 monclient(hunting): get_auth_request con 0x7f0b0c0c7170 auth_method 0 2026-02-17T11:10:38.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.293+0000 7f0b11541640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:38.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.293+0000 7f0b11541640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:38.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.293+0000 7f0b11541640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:38.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.293+0000 7f0b11541640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:38.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.293+0000 7f0b11541640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:38.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.293+0000 7f0b11541640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:38.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.294+0000 7f0b11541640 10 monclient(hunting): handle_auth_done global_id 4560 payload 274 2026-02-17T11:10:38.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.294+0000 7f0b11541640 1 -- 10.20.193.49:0/991331582 >> v1:10.20.193.157:6789/0 conn(0x7f0b0c0c48c0 legacy=0x7f0b0c0749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:38.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.294+0000 7f0b11541640 1 -- 10.20.193.49:0/991331582 >> v1:10.20.193.97:6789/0 conn(0x7f0b0c0c4d10 legacy=0x7f0b0c0c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:38.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.294+0000 7f0b11541640 10 monclient: _finish_hunting 0 2026-02-17T11:10:38.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.294+0000 7f0b11541640 1 monclient: found mon.noname-a 2026-02-17T11:10:38.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.294+0000 7f0b11541640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:38.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.294+0000 7f0b11541640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:10:38.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.294+0000 7f0b11541640 1 -- 10.20.193.49:0/991331582 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b0c0c5550 con 0x7f0b0c0c7170 2026-02-17T11:10:38.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.295+0000 7f0b11541640 1 --2- 10.20.193.49:0/991331582 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0b0c0c7170 0x7f0b0c0c7550 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0afc009970 tx=0x7f0afc02eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1f95689495ec81e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:38.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.297+0000 7f0afbfff640 1 -- 10.20.193.49:0/991331582 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0afc03c070 con 0x7f0b0c0c7170 2026-02-17T11:10:38.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.297+0000 7f0afbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:38.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.297+0000 7f0afbfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:10:38.305 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.297+0000 7f0afbfff640 10 monclient: dump: 2026-02-17T11:10:38.305 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:38.305 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.305 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.305 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.305 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:38.305 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.305 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:38.305 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:38.305 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:38.305 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.305 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.297+0000 7f0afbfff640 10 monclient: _finish_auth 0 2026-02-17T11:10:38.305 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.297+0000 7f0afbfff640 10 monclient: _check_auth_tickets 2026-02-17T11:10:38.305 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.297+0000 7f0afbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:38.305 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.297+0000 7f0afbfff640 1 -- 10.20.193.49:0/991331582 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0afc02fb60 con 0x7f0b0c0c7170 2026-02-17T11:10:38.305 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.297+0000 7f0afbfff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:38.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.297+0000 7f0b137cc640 5 monclient: authenticate success, global_id 4560 2026-02-17T11:10:38.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.297+0000 7f0b137cc640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:38.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.297+0000 7f0afbfff640 1 -- 10.20.193.49:0/991331582 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0afc037440 con 0x7f0b0c0c7170 2026-02-17T11:10:38.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.297+0000 7f0b137cc640 4 set_mon_vals no callback set 2026-02-17T11:10:38.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.297+0000 7f0afbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:38.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.297+0000 7f0afbfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:10:38.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.297+0000 7f0afbfff640 10 monclient: dump: 2026-02-17T11:10:38.306 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:38.306 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.306 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.306 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.306 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:38.306 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.306 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:38.306 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:38.306 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:38.306 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.297+0000 7f0b137cc640 10 monclient: shutdown 2026-02-17T11:10:38.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.297+0000 7f0b137cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:38.307 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.297+0000 7f0b137cc640 1 -- 10.20.193.49:0/991331582 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0b0c0c7170 msgr2=0x7f0b0c0c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.307 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.297+0000 7f0b137cc640 1 --2- 10.20.193.49:0/991331582 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0b0c0c7170 0x7f0b0c0c7550 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0afc009970 tx=0x7f0afc02eef0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.307 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.297+0000 7f0b137cc640 1 -- 10.20.193.49:0/991331582 shutdown_connections 2026-02-17T11:10:38.307 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.297+0000 7f0b137cc640 1 --2- 10.20.193.49:0/991331582 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0b0c0c7170 0x7f0b0c0c7550 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.307 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.297+0000 7f0b137cc640 1 -- 10.20.193.49:0/991331582 >> 10.20.193.49:0/991331582 conn(0x7f0b0c0c9f40 msgr2=0x7f0b0c0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:38.307 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.297+0000 7f0b137cc640 1 -- 10.20.193.49:0/991331582 shutdown_connections 2026-02-17T11:10:38.307 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.297+0000 7f0b137cc640 1 -- 10.20.193.49:0/991331582 wait complete. 2026-02-17T11:10:38.307 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.298+0000 7f0b137cc640 10 monclient: build_initial_monmap 2026-02-17T11:10:38.307 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.298+0000 7f0b137cc640 10 monclient: monmap: 2026-02-17T11:10:38.307 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:38.307 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:38.307 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:38.307 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:38.307 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:38.307 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.307 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:38.307 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:38.307 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:38.308 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.298+0000 7f0b137cc640 1 librados: starting msgr at 2026-02-17T11:10:38.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.298+0000 7f0b137cc640 1 librados: starting objecter 2026-02-17T11:10:38.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.298+0000 7f0b137cc640 1 Processor -- start 2026-02-17T11:10:38.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.298+0000 7f0b137cc640 1 -- start start 2026-02-17T11:10:38.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.298+0000 7f0b137cc640 1 librados: setting wanted keys 2026-02-17T11:10:38.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.298+0000 7f0b137cc640 1 librados: calling monclient init 2026-02-17T11:10:38.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.298+0000 7f0b137cc640 10 monclient: init 2026-02-17T11:10:38.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.299+0000 7f0b137cc640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:38.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.299+0000 7f0b137cc640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:10:38.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.299+0000 7f0b137cc640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0b0c0c48c0 0x7f0b0c1f2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.299+0000 7f0b137cc640 10 monclient(hunting): picked mon.noname-a con 0x7f0b0c0c48c0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:38.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.299+0000 7f0b137cc640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f0b0c0c4d10 0x7f0b0c1f3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.299+0000 7f0b137cc640 10 monclient(hunting): picked mon.noname-b con 0x7f0b0c0c4d10 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:38.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.299+0000 7f0b137cc640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f0b0c0c7170 0x7f0b0c0cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.299+0000 7f0b137cc640 10 monclient(hunting): picked mon.noname-c con 0x7f0b0c0c7170 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:38.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.299+0000 7f0b137cc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.299+0000 7f0b137cc640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0b0c0c81c0 con 0x7f0b0c0c48c0 2026-02-17T11:10:38.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.299+0000 7f0b137cc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.299+0000 7f0b137cc640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f0b0c0c7ee0 con 0x7f0b0c0c4d10 2026-02-17T11:10:38.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.299+0000 7f0b137cc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.299+0000 7f0b137cc640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f0b0c0750c0 con 0x7f0b0c0c7170 2026-02-17T11:10:38.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.299+0000 7f0b137cc640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:38.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.299+0000 7f0b137cc640 10 monclient(hunting): authenticate will time out at 1114.962274s 2026-02-17T11:10:38.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.299+0000 7f0b11541640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0b0c0c48c0 0x7f0b0c1f2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:38.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.299+0000 7f0b11541640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0b0c0c48c0 0x7f0b0c1f2bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:33600/0 (socket says 10.20.193.49:33600) 2026-02-17T11:10:38.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.299+0000 7f0b11541640 1 -- 10.20.193.49:0/2954081124 learned_addr learned my addr 10.20.193.49:0/2954081124 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:38.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.299+0000 7f0b11541640 10 monclient(hunting): get_auth_request con 0x7f0b0c0c48c0 auth_method 0 2026-02-17T11:10:38.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.299+0000 7f0b11541640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:38.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.299+0000 7f0b11541640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:38.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.299+0000 7f0b11541640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:38.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.299+0000 7f0b11541640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:38.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.299+0000 7f0b11541640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:38.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.299+0000 7f0b11541640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:38.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.301+0000 7f0b11541640 10 monclient(hunting): handle_auth_done global_id 4563 payload 824 2026-02-17T11:10:38.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.301+0000 7f0b11541640 1 -- 10.20.193.49:0/2954081124 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f0b0c0c7170 msgr2=0x7f0b0c0cc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.301+0000 7f0b11541640 1 --2- 10.20.193.49:0/2954081124 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f0b0c0c7170 0x7f0b0c0cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.301+0000 7f0b11541640 1 -- 10.20.193.49:0/2954081124 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f0b0c0c4d10 msgr2=0x7f0b0c1f3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.301+0000 7f0b11541640 1 --2- 10.20.193.49:0/2954081124 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f0b0c0c4d10 0x7f0b0c1f3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.301+0000 7f0b11541640 10 monclient: _finish_hunting 0 2026-02-17T11:10:38.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.301+0000 7f0b11541640 1 monclient: found mon.noname-a 2026-02-17T11:10:38.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.301+0000 7f0b11541640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:38.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.301+0000 7f0b11541640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:10:38.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.301+0000 7f0b11541640 1 -- 10.20.193.49:0/2954081124 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b0c155fd0 con 0x7f0b0c0c48c0 2026-02-17T11:10:38.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.302+0000 7f0b11541640 1 --2- 10.20.193.49:0/2954081124 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0b0c0c48c0 0x7f0b0c1f2bf0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0afc009aa0 tx=0x7f0afc0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:38.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.302+0000 7f0af9ffb640 10 client.?.objecter ms_handle_connect 0x7f0b0c0c48c0 2026-02-17T11:10:38.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.302+0000 7f0af9ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:38.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.303+0000 7f0af9ffb640 1 -- 10.20.193.49:0/2954081124 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0afc044070 con 0x7f0b0c0c48c0 2026-02-17T11:10:38.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.303+0000 7f0af9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:38.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.303+0000 7f0af9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:10:38.312 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.303+0000 7f0af9ffb640 10 monclient: dump: 2026-02-17T11:10:38.312 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:38.312 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.312 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.312 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.312 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:38.312 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.312 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:38.312 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:38.312 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:38.312 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.312 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.303+0000 7f0af9ffb640 10 monclient: _finish_auth 0 2026-02-17T11:10:38.312 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.303+0000 7f0af9ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:10:38.312 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.303+0000 7f0af9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:38.312 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.303+0000 7f0af9ffb640 1 -- 10.20.193.49:0/2954081124 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0afc040610 con 0x7f0b0c0c48c0 2026-02-17T11:10:38.312 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.303+0000 7f0af9ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:38.312 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.303+0000 7f0b137cc640 5 monclient: authenticate success, global_id 4563 2026-02-17T11:10:38.312 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.303+0000 7f0b137cc640 10 monclient: _renew_subs 2026-02-17T11:10:38.312 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.303+0000 7f0af9ffb640 1 -- 10.20.193.49:0/2954081124 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0afc03c040 con 0x7f0b0c0c48c0 2026-02-17T11:10:38.312 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.303+0000 7f0afb7fe640 4 set_mon_vals no callback set 2026-02-17T11:10:38.312 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.303+0000 7f0b137cc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:38.312 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.303+0000 7f0b137cc640 1 -- 10.20.193.49:0/2954081124 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b0c1562b0 con 0x7f0b0c0c48c0 2026-02-17T11:10:38.313 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.303+0000 7f0af9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:38.313 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.303+0000 7f0af9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:10:38.313 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.303+0000 7f0af9ffb640 10 monclient: dump: 2026-02-17T11:10:38.313 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:38.313 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.313 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.313 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.313 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:38.313 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.313 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:38.313 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:38.313 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:38.313 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.313 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.303+0000 7f0b137cc640 10 client.4563.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:38.313 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.303+0000 7f0b137cc640 10 monclient: _renew_subs 2026-02-17T11:10:38.313 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.303+0000 7f0b137cc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:38.313 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.303+0000 7f0b137cc640 1 -- 10.20.193.49:0/2954081124 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b0c156870 con 0x7f0b0c0c48c0 2026-02-17T11:10:38.313 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.303+0000 7f0b137cc640 1 librados: init done 2026-02-17T11:10:38.313 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.304+0000 7f0b137cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:38.313 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.304+0000 7f0b137cc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:38.313 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.304+0000 7f0b137cc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:38.313 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.304+0000 7f0b137cc640 1 -- 10.20.193.49:0/2954081124 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b0c0c7550 con 0x7f0b0c0c48c0 2026-02-17T11:10:38.316 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.315+0000 7f0af9ffb640 1 -- 10.20.193.49:0/2954081124 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f0afc03f050 con 0x7f0b0c0c48c0 2026-02-17T11:10:38.316 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.315+0000 7f0af9ffb640 1 --2- 10.20.193.49:0/2954081124 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0adc0791c0 0x7f0adc07b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.317 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.315+0000 7f0b10d40640 1 --2- 10.20.193.49:0/2954081124 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0adc0791c0 0x7f0adc07b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:38.317 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.315+0000 7f0b10d40640 10 monclient: get_auth_request con 0x7f0adc0791c0 auth_method 0 2026-02-17T11:10:38.317 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.316+0000 7f0af9ffb640 10 client.4563.objecter ms_handle_connect 0x7f0adc0791c0 2026-02-17T11:10:38.317 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.316+0000 7f0b10d40640 1 --2- 10.20.193.49:0/2954081124 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0adc0791c0 0x7f0adc07b680 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c0cd460 tx=0x7f0b00006ca0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:38.319 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.318+0000 7f0af9ffb640 1 -- 10.20.193.49:0/2954081124 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7f0afc083090 con 0x7f0b0c0c48c0 2026-02-17T11:10:38.319 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.318+0000 7f0af9ffb640 10 client.4563.objecter ms_dispatch2 0x7f0b0c000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:38.319 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.318+0000 7f0af9ffb640 3 client.4563.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:38.319 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.318+0000 7f0af9ffb640 3 client.4563.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:38.319 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.318+0000 7f0af9ffb640 20 client.4563.objecter dump_active .. 0 homeless 2026-02-17T11:10:38.352 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.351+0000 7f3d66ffd640 1 -- 10.20.193.49:0/810886775 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f3d80074860 con 0x7f3d8014f280 2026-02-17T11:10:38.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.351+0000 7f3d66ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:38.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.351+0000 7f3d66ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:38.392 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.391+0000 7eff96ffd640 1 -- 10.20.193.49:0/3166480743 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7effa403f050 con 0x7effb0072de0 2026-02-17T11:10:38.393 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.392+0000 7eff96ffd640 1 --2- 10.20.193.49:0/3166480743 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7eff7c0791c0 0x7eff7c07b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.393 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.392+0000 7effadd74640 1 --2- 10.20.193.49:0/3166480743 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7eff7c0791c0 0x7eff7c07b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:38.393 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.392+0000 7effadd74640 10 monclient: get_auth_request con 0x7eff7c0791c0 auth_method 0 2026-02-17T11:10:38.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.392+0000 7eff96ffd640 1 -- 10.20.193.49:0/3166480743 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7effa4083140 con 0x7effb0072de0 2026-02-17T11:10:38.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.393+0000 7eff96ffd640 10 client.4574.objecter ms_dispatch2 0x7effb0000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:38.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.393+0000 7eff96ffd640 3 client.4574.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:38.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.393+0000 7eff96ffd640 3 client.4574.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:38.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.393+0000 7effadd74640 1 --2- 10.20.193.49:0/3166480743 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7eff7c0791c0 0x7eff7c07b680 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7effb00ccff0 tx=0x7eff98006ca0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:38.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.393+0000 7eff96ffd640 20 client.4574.objecter dump_active .. 0 homeless 2026-02-17T11:10:38.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.393+0000 7eff96ffd640 10 client.4574.objecter ms_handle_connect 0x7eff7c0791c0 2026-02-17T11:10:38.400 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.399+0000 7eff96ffd640 1 -- 10.20.193.49:0/3166480743 <== mon.2 v2:10.20.193.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7effa4087800 con 0x7effb0072de0 2026-02-17T11:10:38.400 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.399+0000 7eff96ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:38.400 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.399+0000 7eff96ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:38.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.417+0000 7f0af9ffb640 1 -- 10.20.193.49:0/2954081124 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f0afc087750 con 0x7f0b0c0c48c0 2026-02-17T11:10:38.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.417+0000 7f0af9ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:38.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.417+0000 7f0af9ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:38.438 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.436+0000 7f3d883de640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 6}] 2026-02-17T11:10:38.438 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.437+0000 7f3d883de640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2026-02-17T11:10:38.438 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.437+0000 7f3d883de640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:38.438 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.437+0000 7f3d883de640 1 -- 10.20.193.49:0/810886775 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f3d800c9b70 con 0x7f3d8014f280 2026-02-17T11:10:38.442 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.440+0000 7f3d66ffd640 1 -- 10.20.193.49:0/810886775 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f3d70021020 con 0x7f3d8014f280 2026-02-17T11:10:38.442 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.440+0000 7f3d66ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2026-02-17T11:10:38.442 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.440+0000 7f3d66ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:38.442 INFO:teuthology.orchestra.run.trial049.stdout:115964116998 2026-02-17T11:10:38.445 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.442+0000 7f3d883de640 10 librados: watch_flush enter 2026-02-17T11:10:38.445 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.442+0000 7f3d883de640 10 librados: watch_flush exit 2026-02-17T11:10:38.445 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.442+0000 7f3d883de640 20 client.4549.objecter shutdown clearing up homeless session... 2026-02-17T11:10:38.445 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.442+0000 7f3d883de640 10 client.4549.objecter successfully canceled tick 2026-02-17T11:10:38.445 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.442+0000 7f3d883de640 1 -- 10.20.193.49:0/810886775 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3d50079170 msgr2=0x7f3d5007b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.445 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.442+0000 7f3d883de640 1 --2- 10.20.193.49:0/810886775 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3d50079170 0x7f3d5007b630 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3d8014e770 tx=0x7f3d74009040 comp rx=0 tx=0).stop 2026-02-17T11:10:38.445 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.442+0000 7f3d883de640 10 monclient: shutdown 2026-02-17T11:10:38.445 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.442+0000 7f3d883de640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:38.445 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.442+0000 7f3d883de640 1 -- 10.20.193.49:0/810886775 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f3d8014f280 msgr2=0x7f3d801f4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.445 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.442+0000 7f3d883de640 1 --2- 10.20.193.49:0/810886775 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f3d8014f280 0x7f3d801f4710 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3d7000c480 tx=0x7f3d7000c950 comp rx=0 tx=0).stop 2026-02-17T11:10:38.446 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.443+0000 7f3d883de640 1 -- 10.20.193.49:0/810886775 shutdown_connections 2026-02-17T11:10:38.446 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.443+0000 7f3d883de640 1 --2- 10.20.193.49:0/810886775 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3d50079170 0x7f3d5007b630 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.446 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.443+0000 7f3d883de640 1 --2- 10.20.193.49:0/810886775 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f3d8015abc0 0x7f3d8014ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.446 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.443+0000 7f3d883de640 1 --2- 10.20.193.49:0/810886775 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f3d8014f660 0x7f3d801568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.446 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.443+0000 7f3d883de640 1 --2- 10.20.193.49:0/810886775 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f3d8014f280 0x7f3d801f4710 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.446 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.443+0000 7f3d883de640 1 -- 10.20.193.49:0/810886775 >> 10.20.193.49:0/810886775 conn(0x7f3d800c9f20 msgr2=0x7f3d800c5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:38.446 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.443+0000 7f3d883de640 1 -- 10.20.193.49:0/810886775 shutdown_connections 2026-02-17T11:10:38.446 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.443+0000 7f3d883de640 1 -- 10.20.193.49:0/810886775 wait complete. 2026-02-17T11:10:38.446 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.443+0000 7f3d883de640 1 librados: shutdown 2026-02-17T11:10:38.453 INFO:tasks.ceph.ceph_manager.ceph:need seq 115964116998 got 115964116998 for osd.6 2026-02-17T11:10:38.453 DEBUG:teuthology.parallel:result is None 2026-02-17T11:10:38.459 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:10:38.464 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-17T11:10:38.468 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:10:38.491 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.489+0000 7effb4d11640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-17T11:10:38.491 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.489+0000 7effb4d11640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-17T11:10:38.491 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.489+0000 7effb4d11640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:38.491 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.489+0000 7effb4d11640 1 -- 10.20.193.49:0/3166480743 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7effb00cb990 con 0x7effb0072de0 2026-02-17T11:10:38.493 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.13 2026-02-17T11:10:38.494 INFO:teuthology.orchestra.run.trial049.stdout:107374182406 2026-02-17T11:10:38.494 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.491+0000 7eff96ffd640 1 -- 10.20.193.49:0/3166480743 <== mon.2 v2:10.20.193.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7effa4087100 con 0x7effb0072de0 2026-02-17T11:10:38.495 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.491+0000 7eff96ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-17T11:10:38.495 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.491+0000 7eff96ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:38.498 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.493+0000 7effb4d11640 10 librados: watch_flush enter 2026-02-17T11:10:38.498 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.493+0000 7effb4d11640 10 librados: watch_flush exit 2026-02-17T11:10:38.498 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.493+0000 7effb4d11640 20 client.4574.objecter shutdown clearing up homeless session... 2026-02-17T11:10:38.498 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.493+0000 7effb4d11640 10 client.4574.objecter successfully canceled tick 2026-02-17T11:10:38.498 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.493+0000 7effb4d11640 1 -- 10.20.193.49:0/3166480743 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7eff7c0791c0 msgr2=0x7eff7c07b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.498 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.493+0000 7effb4d11640 1 --2- 10.20.193.49:0/3166480743 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7eff7c0791c0 0x7eff7c07b680 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7effb00ccff0 tx=0x7eff98006ca0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.498 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.493+0000 7effb4d11640 10 monclient: shutdown 2026-02-17T11:10:38.498 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.493+0000 7effb4d11640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:38.498 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.493+0000 7effb4d11640 1 -- 10.20.193.49:0/3166480743 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7effb0072de0 msgr2=0x7effb00c6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.499 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.493+0000 7effb4d11640 1 --2- 10.20.193.49:0/3166480743 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7effb0072de0 0x7effb00c6ce0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7effa4002410 tx=0x7effa40047c0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.499 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.493+0000 7effb4d11640 1 -- 10.20.193.49:0/3166480743 shutdown_connections 2026-02-17T11:10:38.499 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.493+0000 7effb4d11640 1 --2- 10.20.193.49:0/3166480743 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7eff7c0791c0 0x7eff7c07b680 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.499 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.493+0000 7effb4d11640 1 --2- 10.20.193.49:0/3166480743 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7effb015f690 0x7effb00c4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.499 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.493+0000 7effb4d11640 1 --2- 10.20.193.49:0/3166480743 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7effb00c9050 0x7effb014b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.499 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.493+0000 7effb4d11640 1 --2- 10.20.193.49:0/3166480743 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7effb0072de0 0x7effb00c6ce0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.499 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.493+0000 7effb4d11640 1 -- 10.20.193.49:0/3166480743 >> 10.20.193.49:0/3166480743 conn(0x7effb00c9f20 msgr2=0x7effb00726d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:38.499 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.493+0000 7effb4d11640 1 -- 10.20.193.49:0/3166480743 shutdown_connections 2026-02-17T11:10:38.499 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.493+0000 7effb4d11640 1 -- 10.20.193.49:0/3166480743 wait complete. 2026-02-17T11:10:38.499 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.493+0000 7effb4d11640 1 librados: shutdown 2026-02-17T11:10:38.502 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.501+0000 7f0b137cc640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-17T11:10:38.502 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.501+0000 7f0b137cc640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-17T11:10:38.503 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.501+0000 7f0b137cc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:38.503 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.501+0000 7f0b137cc640 1 -- 10.20.193.49:0/2954081124 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f0b0c14efa0 con 0x7f0b0c0c48c0 2026-02-17T11:10:38.504 INFO:tasks.ceph.ceph_manager.ceph:need seq 107374182406 got 107374182406 for osd.7 2026-02-17T11:10:38.505 DEBUG:teuthology.parallel:result is None 2026-02-17T11:10:38.507 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.506+0000 7f0af9ffb640 1 -- 10.20.193.49:0/2954081124 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f0afc087050 con 0x7f0b0c0c48c0 2026-02-17T11:10:38.507 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.506+0000 7f0af9ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-17T11:10:38.507 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.506+0000 7f0af9ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:38.508 INFO:teuthology.orchestra.run.trial049.stdout:111669149704 2026-02-17T11:10:38.509 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.10 2026-02-17T11:10:38.511 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.508+0000 7f0b137cc640 10 librados: watch_flush enter 2026-02-17T11:10:38.511 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.508+0000 7f0b137cc640 10 librados: watch_flush exit 2026-02-17T11:10:38.511 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.508+0000 7f0b137cc640 20 client.4563.objecter shutdown clearing up homeless session... 2026-02-17T11:10:38.511 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.508+0000 7f0b137cc640 10 client.4563.objecter successfully canceled tick 2026-02-17T11:10:38.512 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.508+0000 7f0b137cc640 1 -- 10.20.193.49:0/2954081124 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0adc0791c0 msgr2=0x7f0adc07b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.512 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.508+0000 7f0b137cc640 1 --2- 10.20.193.49:0/2954081124 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0adc0791c0 0x7f0adc07b680 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c0cd460 tx=0x7f0b00006ca0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.512 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.508+0000 7f0b137cc640 10 monclient: shutdown 2026-02-17T11:10:38.512 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.508+0000 7f0b137cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:38.512 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.508+0000 7f0b137cc640 1 -- 10.20.193.49:0/2954081124 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0b0c0c48c0 msgr2=0x7f0b0c1f2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.512 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.508+0000 7f0b137cc640 1 --2- 10.20.193.49:0/2954081124 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0b0c0c48c0 0x7f0b0c1f2bf0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0afc009aa0 tx=0x7f0afc0047c0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.512 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.508+0000 7f0b137cc640 1 -- 10.20.193.49:0/2954081124 shutdown_connections 2026-02-17T11:10:38.512 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.508+0000 7f0b137cc640 1 --2- 10.20.193.49:0/2954081124 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0adc0791c0 0x7f0adc07b680 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.512 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.508+0000 7f0b137cc640 1 --2- 10.20.193.49:0/2954081124 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f0b0c0c7170 0x7f0b0c0cc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.512 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.508+0000 7f0b137cc640 1 --2- 10.20.193.49:0/2954081124 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f0b0c0c4d10 0x7f0b0c1f3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.512 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.508+0000 7f0b137cc640 1 --2- 10.20.193.49:0/2954081124 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0b0c0c48c0 0x7f0b0c1f2bf0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.513 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.508+0000 7f0b137cc640 1 -- 10.20.193.49:0/2954081124 >> 10.20.193.49:0/2954081124 conn(0x7f0b0c0c9f40 msgr2=0x7f0b0c1591b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:38.513 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.508+0000 7f0b137cc640 1 -- 10.20.193.49:0/2954081124 shutdown_connections 2026-02-17T11:10:38.513 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.508+0000 7f0b137cc640 1 -- 10.20.193.49:0/2954081124 wait complete. 2026-02-17T11:10:38.513 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.508+0000 7f0b137cc640 1 librados: shutdown 2026-02-17T11:10:38.519 INFO:tasks.ceph.ceph_manager.ceph:need seq 111669149703 got 111669149704 for osd.11 2026-02-17T11:10:38.519 DEBUG:teuthology.parallel:result is None 2026-02-17T11:10:38.562 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.560+0000 7f9c2263b640 10 monclient: get_monmap_and_config 2026-02-17T11:10:38.562 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.560+0000 7f9c2263b640 10 monclient: build_initial_monmap 2026-02-17T11:10:38.562 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.560+0000 7f9c2263b640 10 monclient: monmap: 2026-02-17T11:10:38.562 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:38.563 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.563 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:38.561322+0000 2026-02-17T11:10:38.563 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:38.561322+0000 2026-02-17T11:10:38.563 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:38.563 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.563 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:38.563 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:38.563 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:38.563 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:38.563 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:38.563 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:38.563 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.564 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.560+0000 7f1262ea0640 10 monclient: get_monmap_and_config 2026-02-17T11:10:38.564 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.560+0000 7f1262ea0640 10 monclient: build_initial_monmap 2026-02-17T11:10:38.564 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.560+0000 7f1262ea0640 10 monclient: monmap: 2026-02-17T11:10:38.564 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:38.564 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.564 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:38.561462+0000 2026-02-17T11:10:38.565 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:38.561462+0000 2026-02-17T11:10:38.565 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:38.565 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.565 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:38.565 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:38.565 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:38.565 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:38.565 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:38.565 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:38.565 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.566 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.561+0000 7f9c2263b640 1 Processor -- start 2026-02-17T11:10:38.566 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.561+0000 7f9c2263b640 1 -- start start 2026-02-17T11:10:38.566 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.561+0000 7f9c2263b640 10 monclient: init 2026-02-17T11:10:38.566 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.561+0000 7f9f2ee64640 10 monclient: get_monmap_and_config 2026-02-17T11:10:38.566 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.561+0000 7f9f2ee64640 10 monclient: build_initial_monmap 2026-02-17T11:10:38.567 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.561+0000 7f9f2ee64640 10 monclient: monmap: 2026-02-17T11:10:38.567 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:38.567 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.567 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:38.561939+0000 2026-02-17T11:10:38.567 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:38.561939+0000 2026-02-17T11:10:38.567 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:38.567 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.567 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:38.567 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:38.567 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:38.567 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:38.567 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:38.568 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:38.568 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.568 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.561+0000 7f1262ea0640 1 Processor -- start 2026-02-17T11:10:38.568 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.561+0000 7f1262ea0640 1 -- start start 2026-02-17T11:10:38.568 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.561+0000 7f1262ea0640 10 monclient: init 2026-02-17T11:10:38.569 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.561+0000 7f9c2263b640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:38.569 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.561+0000 7f9c2263b640 10 monclient: _add_conns ranks=[0,3,5,2,1,4] 2026-02-17T11:10:38.569 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.561+0000 7f9c2263b640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f9c1c0c7170 addr v1:10.20.193.49:6789/0 2026-02-17T11:10:38.569 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.561+0000 7f9f2ee64640 1 Processor -- start 2026-02-17T11:10:38.570 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.561+0000 7f9c2263b640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f9c1c0c7550 0x7f9c1c0749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.570 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.561+0000 7f9c2263b640 10 monclient(hunting): picked mon.noname-a con 0x7f9c1c0c7550 addr v2:10.20.193.49:3300/0 2026-02-17T11:10:38.570 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.561+0000 7f9c2263b640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f9c1c074ef0 0x7f9c1c0c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.570 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.561+0000 7f9c2263b640 10 monclient(hunting): picked mon.noname-c con 0x7f9c1c074ef0 addr v2:10.20.193.157:3300/0 2026-02-17T11:10:38.570 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.561+0000 7f9c2263b640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c1c0c4fd0 con 0x7f9c1c0c7170 2026-02-17T11:10:38.571 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.561+0000 7f9c2263b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.571 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.561+0000 7f9c2263b640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f9c1c0c8530 con 0x7f9c1c0c7550 2026-02-17T11:10:38.571 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.561+0000 7f9c2263b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.571 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.561+0000 7f9c2263b640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f9c1c15a9a0 con 0x7f9c1c074ef0 2026-02-17T11:10:38.571 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.561+0000 7f9f2ee64640 1 -- start start 2026-02-17T11:10:38.571 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.561+0000 7f9f2ee64640 10 monclient: init 2026-02-17T11:10:38.572 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.561+0000 7f9c2263b640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:38.572 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.561+0000 7f9c2263b640 10 monclient(hunting): authenticate will time out at 1115.224880s 2026-02-17T11:10:38.572 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.562+0000 7f9c1b7fe640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f9c1c0c7550 0x7f9c1c0749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:38.572 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.15 2026-02-17T11:10:38.574 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.562+0000 7f1262ea0640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:38.574 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.562+0000 7f1262ea0640 10 monclient: _add_conns ranks=[4,3,0,1,2,5] 2026-02-17T11:10:38.574 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.562+0000 7f1262ea0640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f125c0d1b60 0x7f125c0d1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.574 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.562+0000 7f1262ea0640 10 monclient(hunting): picked mon.noname-b con 0x7f125c0d1b60 addr v2:10.20.193.97:3300/0 2026-02-17T11:10:38.574 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.562+0000 7f1262ea0640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f125c15c840 0x7f125c0c8d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.574 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.562+0000 7f1262ea0640 10 monclient(hunting): picked mon.noname-a con 0x7f125c15c840 addr v2:10.20.193.49:3300/0 2026-02-17T11:10:38.574 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.562+0000 7f1262ea0640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f125c0c92a0 addr v1:10.20.193.49:6789/0 2026-02-17T11:10:38.574 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.562+0000 7f1262ea0640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f125c0c98e0 con 0x7f125c0c92a0 2026-02-17T11:10:38.574 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.562+0000 7f1262ea0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.574 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.562+0000 7f1262ea0640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f125c0ca460 con 0x7f125c15c840 2026-02-17T11:10:38.575 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.562+0000 7f1262ea0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.575 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.562+0000 7f1262ea0640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f125c15d4c0 con 0x7f125c0d1b60 2026-02-17T11:10:38.575 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.562+0000 7f1262ea0640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:38.575 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.562+0000 7f1262ea0640 10 monclient(hunting): authenticate will time out at 1115.225349s 2026-02-17T11:10:38.575 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.562+0000 7f9c20bb1640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f9c1c074ef0 0x7f9c1c0c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:38.575 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.562+0000 7f9c1b7fe640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f9c1c0c7550 0x7f9c1c0749b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:33616/0 (socket says 10.20.193.49:33616) 2026-02-17T11:10:38.575 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.562+0000 7f9c1b7fe640 1 -- 10.20.193.49:0/3777692105 learned_addr learned my addr 10.20.193.49:0/3777692105 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:38.576 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.562+0000 7f9c1b7fe640 10 monclient(hunting): get_auth_request con 0x7f9c1c0c7550 auth_method 0 2026-02-17T11:10:38.576 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.562+0000 7f9c1b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:38.576 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.562+0000 7f9c1b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:38.576 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.562+0000 7f9c1b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:38.577 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.562+0000 7f9f2ee64640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:38.577 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.562+0000 7f9f2ee64640 10 monclient: _add_conns ranks=[3,2,4,0,5,1] 2026-02-17T11:10:38.577 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.562+0000 7f9f2ee64640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f9f28155f90 0x7f9f280c2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.577 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.562+0000 7f9f2ee64640 10 monclient(hunting): picked mon.noname-a con 0x7f9f28155f90 addr v2:10.20.193.49:3300/0 2026-02-17T11:10:38.577 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.562+0000 7f9c20bb1640 10 monclient(hunting): get_auth_request con 0x7f9c1c074ef0 auth_method 0 2026-02-17T11:10:38.577 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.562+0000 7f9c20bb1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:38.577 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.562+0000 7f9c20bb1640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:38.578 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.562+0000 7f9c20bb1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:38.578 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.562+0000 7f9f2ee64640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f9f2815d310 addr v1:10.20.193.157:6789/0 2026-02-17T11:10:38.578 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.562+0000 7f9f2ee64640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f9f2815d730 0x7f9f2806fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.579 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.562+0000 7f9f2ee64640 10 monclient(hunting): picked mon.noname-b con 0x7f9f2815d730 addr v2:10.20.193.97:3300/0 2026-02-17T11:10:38.579 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.562+0000 7f9f2ee64640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f2815ffc0 con 0x7f9f2815d310 2026-02-17T11:10:38.579 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.562+0000 7f9f2ee64640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.579 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.562+0000 7f9f2ee64640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f9f2815c860 con 0x7f9f28155f90 2026-02-17T11:10:38.579 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.562+0000 7f9f2ee64640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.579 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.562+0000 7f9f2ee64640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f9f281602a0 con 0x7f9f2815d730 2026-02-17T11:10:38.579 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.562+0000 7f9f2ee64640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:38.579 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.562+0000 7f9f2ee64640 10 monclient(hunting): authenticate will time out at 1115.225539s 2026-02-17T11:10:38.580 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.562+0000 7f9c20bb1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:38.580 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.562+0000 7f9c20bb1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:38.580 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.562+0000 7f9c20bb1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:38.580 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.562+0000 7f1260c15640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f125c0d1b60 0x7f125c0d1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:38.581 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.562+0000 7f9c1b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:38.581 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.562+0000 7f9c1b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:38.581 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.562+0000 7f9c1b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:38.582 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.563+0000 7f1261416640 1 --1- >> v1:10.20.193.49:6789/0 conn(0x7f125c0c92a0 0x7f125c15d950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.49:6789/0 says I am v1:10.20.193.49:47722/0 (socket says 10.20.193.49:47722) 2026-02-17T11:10:38.582 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.563+0000 7f1261416640 1 -- 10.20.193.49:0/748105602 learned_addr learned my addr 10.20.193.49:0/748105602 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:10:38.582 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.563+0000 7f1260c15640 10 monclient(hunting): get_auth_request con 0x7f125c0d1b60 auth_method 0 2026-02-17T11:10:38.582 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.563+0000 7f1260c15640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:38.582 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.563+0000 7f1260c15640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:38.582 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.563+0000 7f1260c15640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:38.582 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.563+0000 7f1260c15640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:38.582 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.563+0000 7f1260c15640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:38.582 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.563+0000 7f1260c15640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:38.583 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.563+0000 7f9c20bb1640 10 monclient(hunting): handle_auth_done global_id 4577 payload 274 2026-02-17T11:10:38.583 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.563+0000 7f9c20bb1640 1 -- 10.20.193.49:0/3777692105 >> v2:10.20.193.49:3300/0 conn(0x7f9c1c0c7550 msgr2=0x7f9c1c0749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:38.583 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.563+0000 7f9c20bb1640 1 --2- 10.20.193.49:0/3777692105 >> v2:10.20.193.49:3300/0 conn(0x7f9c1c0c7550 0x7f9c1c0749b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.563+0000 7f9c20bb1640 1 -- 10.20.193.49:0/3777692105 >> v1:10.20.193.49:6789/0 conn(0x7f9c1c0c7170 legacy=0x7f9c1c0c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.563+0000 7f9c20bb1640 10 monclient: _finish_hunting 0 2026-02-17T11:10:38.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.563+0000 7f9c20bb1640 1 monclient: found mon.noname-c 2026-02-17T11:10:38.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.563+0000 7f9c20bb1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:38.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.563+0000 7f9c20bb1640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:10:38.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.563+0000 7f9c20bb1640 1 -- 10.20.193.49:0/3777692105 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c1c0c5270 con 0x7f9c1c074ef0 2026-02-17T11:10:38.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.564+0000 7f9f1ffff640 1 --1- >> v1:10.20.193.157:6789/0 conn(0x7f9f2815d310 0x7f9f2806f6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.157:6789/0 says I am v1:10.20.193.49:52982/0 (socket says 10.20.193.49:52982) 2026-02-17T11:10:38.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.564+0000 7f9f1ffff640 1 -- 10.20.193.49:0/3128604315 learned_addr learned my addr 10.20.193.49:0/3128604315 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:10:38.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.564+0000 7f1260c15640 10 monclient(hunting): handle_auth_done global_id 4552 payload 274 2026-02-17T11:10:38.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.564+0000 7f1260c15640 1 -- 10.20.193.49:0/748105602 >> v2:10.20.193.49:3300/0 conn(0x7f125c15c840 msgr2=0x7f125c0c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:38.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.564+0000 7f1260c15640 1 --2- 10.20.193.49:0/748105602 >> v2:10.20.193.49:3300/0 conn(0x7f125c15c840 0x7f125c0c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.564+0000 7f1260c15640 1 -- 10.20.193.49:0/748105602 >> v1:10.20.193.49:6789/0 conn(0x7f125c0c92a0 legacy=0x7f125c15d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:38.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.564+0000 7f1260c15640 10 monclient: _finish_hunting 0 2026-02-17T11:10:38.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.564+0000 7f1260c15640 1 monclient: found mon.noname-b 2026-02-17T11:10:38.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.564+0000 7f1260c15640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:38.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.564+0000 7f1260c15640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:10:38.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.564+0000 7f1260c15640 1 -- 10.20.193.49:0/748105602 --> v2:10.20.193.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f125c0c9bc0 con 0x7f125c0d1b60 2026-02-17T11:10:38.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.564+0000 7f9c20bb1640 1 --2- 10.20.193.49:0/3777692105 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f9c1c074ef0 0x7f9c1c0c89c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c0c84a0 tx=0x7f9c1002f1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78cb5c5a7b0cc5cf server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:38.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.565+0000 7f9f2d3da640 1 --2- 10.20.193.49:0/3128604315 >> v2:10.20.193.97:3300/0 conn(0x7f9f2815d730 0x7f9f2806fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:38.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.565+0000 7f9f2d3da640 10 monclient(hunting): get_auth_request con 0x7f9f2815d730 auth_method 0 2026-02-17T11:10:38.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.565+0000 7f9f2d3da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:38.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.565+0000 7f9f2d3da640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:38.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.565+0000 7f9f2d3da640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:38.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.565+0000 7f1260c15640 1 --2- 10.20.193.49:0/748105602 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f125c0d1b60 0x7f125c0d1f40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f125c0cf420 tx=0x7f124c02ede0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbdca26ab4e746d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:38.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.565+0000 7f9f1f7fe640 1 -- 10.20.193.49:0/3128604315 <== mon.2 v1:10.20.193.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3410154232 0 0) 0x7f9f2815ffc0 con 0x7f9f2815d310 2026-02-17T11:10:38.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.565+0000 7f9f1f7fe640 10 monclient(hunting): _negotiate 2026-02-17T11:10:38.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.565+0000 7f9f1f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:38.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.565+0000 7f9f1f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:38.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.565+0000 7f9f1f7fe640 10 monclient(hunting): my global_id is 4580 2026-02-17T11:10:38.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.565+0000 7f9f1f7fe640 1 -- 10.20.193.49:0/3128604315 --> v1:10.20.193.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f14003620 con 0x7f9f2815d310 2026-02-17T11:10:38.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.566+0000 7f9f2d3da640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:38.589 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.566+0000 7f9f2d3da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:38.589 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.566+0000 7f9f2d3da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:38.589 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.567+0000 7f9f2d3da640 10 monclient(hunting): handle_auth_done global_id 4555 payload 274 2026-02-17T11:10:38.589 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.567+0000 7f9f2d3da640 1 -- 10.20.193.49:0/3128604315 >> v2:10.20.193.49:3300/0 conn(0x7f9f28155f90 msgr2=0x7f9f280c2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:38.589 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.567+0000 7f9f2d3da640 1 --2- 10.20.193.49:0/3128604315 >> v2:10.20.193.49:3300/0 conn(0x7f9f28155f90 0x7f9f280c2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.589 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.567+0000 7f9f2d3da640 1 -- 10.20.193.49:0/3128604315 >> v1:10.20.193.157:6789/0 conn(0x7f9f2815d310 legacy=0x7f9f2806f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.589 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.567+0000 7f9f2d3da640 10 monclient: _finish_hunting 0 2026-02-17T11:10:38.589 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.567+0000 7f9f2d3da640 1 monclient: found mon.noname-b 2026-02-17T11:10:38.589 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.567+0000 7f9f2d3da640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:38.589 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.567+0000 7f9f2d3da640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:10:38.589 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.567+0000 7f9f2d3da640 1 -- 10.20.193.49:0/3128604315 --> v2:10.20.193.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f2815bf30 con 0x7f9f2815d730 2026-02-17T11:10:38.590 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.568+0000 7f12537fe640 1 -- 10.20.193.49:0/748105602 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f124c03c070 con 0x7f125c0d1b60 2026-02-17T11:10:38.590 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.568+0000 7f12537fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:38.590 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.568+0000 7f12537fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:10:38.590 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.568+0000 7f12537fe640 10 monclient: dump: 2026-02-17T11:10:38.590 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:38.590 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.590 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.590 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.590 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:38.590 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.591 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:38.591 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:38.591 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:38.591 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.568+0000 7f12537fe640 10 monclient: _finish_auth 0 2026-02-17T11:10:38.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.568+0000 7f12537fe640 10 monclient: _check_auth_tickets 2026-02-17T11:10:38.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.568+0000 7f12537fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:38.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.568+0000 7f12537fe640 1 -- 10.20.193.49:0/748105602 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f124c02fa50 con 0x7f125c0d1b60 2026-02-17T11:10:38.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.568+0000 7f12537fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:38.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.568+0000 7f12537fe640 1 -- 10.20.193.49:0/748105602 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f124c02fe20 con 0x7f125c0d1b60 2026-02-17T11:10:38.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.568+0000 7f1262ea0640 5 monclient: authenticate success, global_id 4552 2026-02-17T11:10:38.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.568+0000 7f1262ea0640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:38.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.568+0000 7f1262ea0640 4 set_mon_vals no callback set 2026-02-17T11:10:38.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.568+0000 7f12537fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:38.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.568+0000 7f12537fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:38.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.568+0000 7f12537fe640 10 monclient: dump: 2026-02-17T11:10:38.592 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:38.592 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.592 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.592 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.592 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:38.592 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.592 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:38.592 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:38.592 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:38.592 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.592 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.568+0000 7f1262ea0640 10 monclient: shutdown 2026-02-17T11:10:38.592 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.568+0000 7f1262ea0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:38.592 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.568+0000 7f1262ea0640 1 -- 10.20.193.49:0/748105602 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f125c0d1b60 msgr2=0x7f125c0d1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.592 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.568+0000 7f1262ea0640 1 --2- 10.20.193.49:0/748105602 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f125c0d1b60 0x7f125c0d1f40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f125c0cf420 tx=0x7f124c02ede0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.593 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2026-02-17T11:10:38.593 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.568+0000 7f9c1affd640 1 -- 10.20.193.49:0/3777692105 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c1003c070 con 0x7f9c1c074ef0 2026-02-17T11:10:38.594 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.568+0000 7f9c1affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:38.594 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.568+0000 7f9c1affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:10:38.594 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.568+0000 7f9c1affd640 10 monclient: dump: 2026-02-17T11:10:38.594 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:38.594 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.594 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.594 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.594 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:38.594 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.594 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:38.594 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:38.594 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:38.594 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.594 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.568+0000 7f9c1affd640 10 monclient: _finish_auth 0 2026-02-17T11:10:38.594 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.568+0000 7f9c1affd640 10 monclient: _check_auth_tickets 2026-02-17T11:10:38.594 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.568+0000 7f9c1affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:38.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.568+0000 7f9c1affd640 1 -- 10.20.193.49:0/3777692105 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c10037440 con 0x7f9c1c074ef0 2026-02-17T11:10:38.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.568+0000 7f9c1affd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:38.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.568+0000 7f9c1affd640 1 -- 10.20.193.49:0/3777692105 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c10037810 con 0x7f9c1c074ef0 2026-02-17T11:10:38.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.568+0000 7f9c2263b640 5 monclient: authenticate success, global_id 4577 2026-02-17T11:10:38.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.568+0000 7f9c2263b640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:38.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.568+0000 7f9c2263b640 4 set_mon_vals no callback set 2026-02-17T11:10:38.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.568+0000 7f9c1affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:38.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.568+0000 7f9c1affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:10:38.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.568+0000 7f9c1affd640 10 monclient: dump: 2026-02-17T11:10:38.595 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:38.595 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.595 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.595 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.595 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:38.595 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.595 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:38.595 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:38.595 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:38.596 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.568+0000 7f1262ea0640 1 -- 10.20.193.49:0/748105602 shutdown_connections 2026-02-17T11:10:38.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.568+0000 7f1262ea0640 1 --2- 10.20.193.49:0/748105602 >> v2:10.20.193.49:3300/0 conn(0x7f125c15c840 0x7f125c0c8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.568+0000 7f1262ea0640 1 --2- 10.20.193.49:0/748105602 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f125c0d1b60 0x7f125c0d1f40 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.568+0000 7f1262ea0640 1 -- 10.20.193.49:0/748105602 >> 10.20.193.49:0/748105602 conn(0x7f125c06d9b0 msgr2=0x7f125c06ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:38.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.568+0000 7f1262ea0640 1 -- 10.20.193.49:0/748105602 shutdown_connections 2026-02-17T11:10:38.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.568+0000 7f1262ea0640 1 -- 10.20.193.49:0/748105602 wait complete. 2026-02-17T11:10:38.597 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.568+0000 7f9f2d3da640 1 --2- 10.20.193.49:0/3128604315 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f9f2815d730 0x7f9f2806fe00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9f28074550 tx=0x7f9f2402f1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a82a511243c18d1 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:38.597 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.568+0000 7f9c2263b640 10 monclient: shutdown 2026-02-17T11:10:38.597 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.568+0000 7f9c2263b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:38.597 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.568+0000 7f9c2263b640 1 -- 10.20.193.49:0/3777692105 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f9c1c074ef0 msgr2=0x7f9c1c0c89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.597 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.568+0000 7f9c2263b640 1 --2- 10.20.193.49:0/3777692105 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f9c1c074ef0 0x7f9c1c0c89c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c0c84a0 tx=0x7f9c1002f1c0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.598 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.569+0000 7f9c2263b640 1 -- 10.20.193.49:0/3777692105 shutdown_connections 2026-02-17T11:10:38.598 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.569+0000 7f9c2263b640 1 --2- 10.20.193.49:0/3777692105 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f9c1c074ef0 0x7f9c1c0c89c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.598 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.569+0000 7f9c2263b640 1 --2- 10.20.193.49:0/3777692105 >> v2:10.20.193.49:3300/0 conn(0x7f9c1c0c7550 0x7f9c1c0749b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.598 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.569+0000 7f9c2263b640 1 -- 10.20.193.49:0/3777692105 >> 10.20.193.49:0/3777692105 conn(0x7f9c1c0c9f40 msgr2=0x7f9c1c0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:38.598 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.569+0000 7f9c2263b640 1 -- 10.20.193.49:0/3777692105 shutdown_connections 2026-02-17T11:10:38.598 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.569+0000 7f9c2263b640 1 -- 10.20.193.49:0/3777692105 wait complete. 2026-02-17T11:10:38.598 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.569+0000 7f1262ea0640 10 monclient: build_initial_monmap 2026-02-17T11:10:38.598 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.569+0000 7f1262ea0640 10 monclient: monmap: 2026-02-17T11:10:38.598 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:38.598 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:38.598 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:38.598 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:38.598 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:38.598 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.598 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:38.598 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:38.599 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:38.599 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.599 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.569+0000 7f9c2263b640 10 monclient: build_initial_monmap 2026-02-17T11:10:38.599 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.569+0000 7f9c2263b640 10 monclient: monmap: 2026-02-17T11:10:38.599 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:38.599 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:38.599 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:38.599 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:38.599 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:38.599 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.599 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:38.599 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:38.599 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:38.599 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.600 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.569+0000 7f1262ea0640 1 librados: starting msgr at 2026-02-17T11:10:38.600 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.569+0000 7f1262ea0640 1 librados: starting objecter 2026-02-17T11:10:38.600 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.569+0000 7f1262ea0640 1 Processor -- start 2026-02-17T11:10:38.600 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.569+0000 7f9c2263b640 1 librados: starting msgr at 2026-02-17T11:10:38.600 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.569+0000 7f9c2263b640 1 librados: starting objecter 2026-02-17T11:10:38.600 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.569+0000 7f1262ea0640 1 -- start start 2026-02-17T11:10:38.600 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.569+0000 7f1262ea0640 1 librados: setting wanted keys 2026-02-17T11:10:38.600 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.569+0000 7f1262ea0640 1 librados: calling monclient init 2026-02-17T11:10:38.600 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.569+0000 7f1262ea0640 10 monclient: init 2026-02-17T11:10:38.601 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.569+0000 7f9c2263b640 1 Processor -- start 2026-02-17T11:10:38.601 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.569+0000 7f9c2263b640 1 -- start start 2026-02-17T11:10:38.601 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.569+0000 7f9c2263b640 1 librados: setting wanted keys 2026-02-17T11:10:38.601 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.569+0000 7f9c2263b640 1 librados: calling monclient init 2026-02-17T11:10:38.601 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.569+0000 7f9c2263b640 10 monclient: init 2026-02-17T11:10:38.602 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.570+0000 7f1262ea0640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:38.602 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.570+0000 7f1262ea0640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:10:38.602 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.570+0000 7f1262ea0640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f125c0c92a0 0x7f125c1f1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.602 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.570+0000 7f1262ea0640 10 monclient(hunting): picked mon.noname-c con 0x7f125c0c92a0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:38.602 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.570+0000 7f1262ea0640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f125c0d1b60 0x7f125c1f18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.602 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.570+0000 7f1262ea0640 10 monclient(hunting): picked mon.noname-a con 0x7f125c0d1b60 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:38.602 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.570+0000 7f1262ea0640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f125c15c840 0x7f125c151170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.602 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.570+0000 7f1262ea0640 10 monclient(hunting): picked mon.noname-b con 0x7f125c15c840 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:38.602 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.570+0000 7f1262ea0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.602 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.570+0000 7f1262ea0640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f125c15cc90 con 0x7f125c0d1b60 2026-02-17T11:10:38.602 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.570+0000 7f1262ea0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.602 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.570+0000 7f1262ea0640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f125c0ca180 con 0x7f125c15c840 2026-02-17T11:10:38.602 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.570+0000 7f1262ea0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.602 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.570+0000 7f1262ea0640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f125c06e7b0 con 0x7f125c0c92a0 2026-02-17T11:10:38.602 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.570+0000 7f1262ea0640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:38.602 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.570+0000 7f1262ea0640 10 monclient(hunting): authenticate will time out at 1115.233088s 2026-02-17T11:10:38.603 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.570+0000 7f9c2263b640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:38.603 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.570+0000 7f9c2263b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:10:38.603 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.570+0000 7f9c2263b640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f9c1c074ef0 0x7f9c1c14eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.603 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.570+0000 7f9c2263b640 10 monclient(hunting): picked mon.noname-a con 0x7f9c1c074ef0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:38.603 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.570+0000 7f9c2263b640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f9c1c0c7170 0x7f9c1c15d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.603 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.570+0000 7f9c2263b640 10 monclient(hunting): picked mon.noname-c con 0x7f9c1c0c7170 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:38.603 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.570+0000 7f9c2263b640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f9c1c0c7550 0x7f9c1c0c0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.603 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.570+0000 7f9c2263b640 10 monclient(hunting): picked mon.noname-b con 0x7f9c1c0c7550 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:38.603 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.570+0000 7f9c2263b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.603 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.570+0000 7f9c2263b640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9c1c0c7ee0 con 0x7f9c1c074ef0 2026-02-17T11:10:38.603 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.570+0000 7f9c2263b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.604 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.570+0000 7f9c2263b640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f9c1c0c5830 con 0x7f9c1c0c7550 2026-02-17T11:10:38.604 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.570+0000 7f9c2263b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.604 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.570+0000 7f9c2263b640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f9c1c0c81c0 con 0x7f9c1c0c7170 2026-02-17T11:10:38.604 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.570+0000 7f9c2263b640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:38.604 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.570+0000 7f9c2263b640 10 monclient(hunting): authenticate will time out at 1115.233161s 2026-02-17T11:10:38.604 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.570+0000 7f1253fff640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f125c0d1b60 0x7f125c1f18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:38.604 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.570+0000 7f1253fff640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f125c0d1b60 0x7f125c1f18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:33636/0 (socket says 10.20.193.49:33636) 2026-02-17T11:10:38.604 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.570+0000 7f1253fff640 1 -- 10.20.193.49:0/3558579449 learned_addr learned my addr 10.20.193.49:0/3558579449 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:38.604 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.570+0000 7f1253fff640 10 monclient(hunting): get_auth_request con 0x7f125c0d1b60 auth_method 0 2026-02-17T11:10:38.604 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.570+0000 7f1253fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:38.604 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.570+0000 7f1253fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:38.604 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.570+0000 7f1253fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:38.604 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.570+0000 7f1260c15640 1 --2- 10.20.193.49:0/3558579449 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f125c0c92a0 0x7f125c1f1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:38.605 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.570+0000 7f9c1bfff640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f9c1c074ef0 0x7f9c1c14eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:38.605 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.570+0000 7f1260c15640 10 monclient(hunting): get_auth_request con 0x7f125c0c92a0 auth_method 0 2026-02-17T11:10:38.605 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.570+0000 7f1260c15640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:38.605 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.570+0000 7f1260c15640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:38.605 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.570+0000 7f1260c15640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:38.605 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.570+0000 7f9c1b7fe640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f9c1c0c7170 0x7f9c1c15d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:38.605 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.571+0000 7f1253fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:38.606 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.571+0000 7f1253fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:38.606 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.571+0000 7f1253fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:38.606 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.571+0000 7f1260c15640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:38.606 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.571+0000 7f1260c15640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:38.606 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.571+0000 7f1260c15640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:38.606 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.571+0000 7f9f1f7fe640 1 -- 10.20.193.49:0/3128604315 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f2403c070 con 0x7f9f2815d730 2026-02-17T11:10:38.606 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.571+0000 7f9f1f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:38.606 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.571+0000 7f9f1f7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:10:38.606 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.571+0000 7f9f1f7fe640 10 monclient: dump: 2026-02-17T11:10:38.606 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:38.606 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.606 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.606 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.606 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:38.606 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.606 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:38.607 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:38.607 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:38.607 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.607 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.571+0000 7f9f1f7fe640 10 monclient: _finish_auth 0 2026-02-17T11:10:38.607 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.571+0000 7f9f1f7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:10:38.607 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.571+0000 7f9f1f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:38.607 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.571+0000 7f9f1f7fe640 1 -- 10.20.193.49:0/3128604315 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f24037440 con 0x7f9f2815d730 2026-02-17T11:10:38.607 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.571+0000 7f9f2ee64640 5 monclient: authenticate success, global_id 4555 2026-02-17T11:10:38.607 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.571+0000 7f9f2ee64640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:10:38.607 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.571+0000 7f9f1f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:38.607 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.571+0000 7f9f2ee64640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:38.607 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.571+0000 7f9c1b7fe640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f9c1c0c7170 0x7f9c1c15d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:48414/0 (socket says 10.20.193.49:48414) 2026-02-17T11:10:38.607 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.571+0000 7f9c1b7fe640 1 -- 10.20.193.49:0/1853108823 learned_addr learned my addr 10.20.193.49:0/1853108823 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:38.607 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.571+0000 7f9c1b7fe640 10 monclient(hunting): get_auth_request con 0x7f9c1c0c7170 auth_method 0 2026-02-17T11:10:38.607 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.571+0000 7f9c1b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:38.607 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.571+0000 7f9c1b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:38.607 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.571+0000 7f9c1b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:38.607 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.571+0000 7f9c1bfff640 10 monclient(hunting): get_auth_request con 0x7f9c1c074ef0 auth_method 0 2026-02-17T11:10:38.608 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.571+0000 7f9c1bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:38.608 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.571+0000 7f9c1bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:38.608 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.571+0000 7f9c1bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:38.608 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.571+0000 7f9f1f7fe640 1 -- 10.20.193.49:0/3128604315 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f24037810 con 0x7f9f2815d730 2026-02-17T11:10:38.608 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.571+0000 7f9f1f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:38.608 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.571+0000 7f9f2ee64640 4 set_mon_vals no callback set 2026-02-17T11:10:38.608 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.571+0000 7f9f1f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:38.608 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.571+0000 7f9f1f7fe640 10 monclient: dump: 2026-02-17T11:10:38.608 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:38.608 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.608 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.608 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.608 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:38.608 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.608 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:38.608 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:38.608 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:38.609 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.609 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.571+0000 7f9c20bb1640 1 --2- 10.20.193.49:0/1853108823 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f9c1c0c7550 0x7f9c1c0c0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:38.610 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.571+0000 7f1261416640 1 --2- 10.20.193.49:0/3558579449 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f125c15c840 0x7f125c151170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:38.610 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.571+0000 7f9f2ee64640 10 monclient: shutdown 2026-02-17T11:10:38.610 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.571+0000 7f9f2ee64640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:38.610 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.571+0000 7f9f2ee64640 1 -- 10.20.193.49:0/3128604315 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f9f2815d730 msgr2=0x7f9f2806fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.610 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.571+0000 7f9f2ee64640 1 --2- 10.20.193.49:0/3128604315 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f9f2815d730 0x7f9f2806fe00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9f28074550 tx=0x7f9f2402f1c0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.610 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.571+0000 7f8ade322640 10 monclient: get_monmap_and_config 2026-02-17T11:10:38.610 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.571+0000 7f8ade322640 10 monclient: build_initial_monmap 2026-02-17T11:10:38.611 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2026-02-17T11:10:38.611 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.571+0000 7f9f2ee64640 1 -- 10.20.193.49:0/3128604315 shutdown_connections 2026-02-17T11:10:38.611 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.571+0000 7f9f2ee64640 1 --2- 10.20.193.49:0/3128604315 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f9f2815d730 0x7f9f2806fe00 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.611 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.571+0000 7f9f2ee64640 1 --2- 10.20.193.49:0/3128604315 >> v2:10.20.193.49:3300/0 conn(0x7f9f28155f90 0x7f9f280c2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.611 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.571+0000 7f9f2ee64640 1 -- 10.20.193.49:0/3128604315 >> 10.20.193.49:0/3128604315 conn(0x7f9f280cc0c0 msgr2=0x7f9f280cc4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:38.611 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.571+0000 7f9c20bb1640 10 monclient(hunting): get_auth_request con 0x7f9c1c0c7550 auth_method 0 2026-02-17T11:10:38.612 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.571+0000 7f9c20bb1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:38.612 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.571+0000 7f9c20bb1640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:38.612 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.571+0000 7f9c20bb1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:38.612 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.571+0000 7f9f2ee64640 1 -- 10.20.193.49:0/3128604315 shutdown_connections 2026-02-17T11:10:38.612 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.571+0000 7f9f2ee64640 1 -- 10.20.193.49:0/3128604315 wait complete. 2026-02-17T11:10:38.612 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.571+0000 7f1261416640 10 monclient(hunting): get_auth_request con 0x7f125c15c840 auth_method 0 2026-02-17T11:10:38.612 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.571+0000 7f1261416640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:38.612 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.571+0000 7f1261416640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:38.612 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.571+0000 7f1261416640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:38.612 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.571+0000 7f8ade322640 10 monclient: monmap: 2026-02-17T11:10:38.612 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:38.613 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.613 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:38.572056+0000 2026-02-17T11:10:38.613 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:38.572056+0000 2026-02-17T11:10:38.613 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:38.613 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.613 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:38.613 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:38.613 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:38.613 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:38.613 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:38.613 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:38.613 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.613 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f9c20bb1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:38.613 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f9c20bb1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:38.613 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f9c20bb1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:38.613 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f9f2ee64640 10 monclient: build_initial_monmap 2026-02-17T11:10:38.614 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f9f2ee64640 10 monclient: monmap: 2026-02-17T11:10:38.614 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:38.614 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:38.614 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:38.614 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:38.614 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:38.614 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.614 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:38.614 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:38.614 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:38.614 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.614 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f8ade322640 1 Processor -- start 2026-02-17T11:10:38.614 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f8ade322640 1 -- start start 2026-02-17T11:10:38.614 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f8ade322640 10 monclient: init 2026-02-17T11:10:38.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f9f2ee64640 1 librados: starting msgr at 2026-02-17T11:10:38.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f9f2ee64640 1 librados: starting objecter 2026-02-17T11:10:38.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f9f2ee64640 1 Processor -- start 2026-02-17T11:10:38.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f1261416640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:38.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f1261416640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:38.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f1261416640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:38.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f9f2ee64640 1 -- start start 2026-02-17T11:10:38.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f9f2ee64640 1 librados: setting wanted keys 2026-02-17T11:10:38.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f9f2ee64640 1 librados: calling monclient init 2026-02-17T11:10:38.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f9f2ee64640 10 monclient: init 2026-02-17T11:10:38.616 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f1260c15640 10 monclient(hunting): handle_auth_done global_id 4583 payload 824 2026-02-17T11:10:38.616 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f1260c15640 1 -- 10.20.193.49:0/3558579449 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f125c15c840 msgr2=0x7f125c151170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.616 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f1260c15640 1 --2- 10.20.193.49:0/3558579449 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f125c15c840 0x7f125c151170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.616 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f1260c15640 1 -- 10.20.193.49:0/3558579449 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f125c0d1b60 msgr2=0x7f125c1f18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.616 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f1260c15640 1 --2- 10.20.193.49:0/3558579449 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f125c0d1b60 0x7f125c1f18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.616 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f1260c15640 10 monclient: _finish_hunting 0 2026-02-17T11:10:38.616 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f1260c15640 1 monclient: found mon.noname-c 2026-02-17T11:10:38.616 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f1260c15640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:38.616 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f1260c15640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:10:38.616 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f1260c15640 1 -- 10.20.193.49:0/3558579449 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f125c1f5610 con 0x7f125c0c92a0 2026-02-17T11:10:38.616 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f9c1b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:38.616 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f9c1b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:38.616 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f9c1b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:38.617 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f8ade322640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:38.617 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f8ade322640 10 monclient: _add_conns ranks=[2,1,4,3,5,0] 2026-02-17T11:10:38.617 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f8ade322640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f8ad81527c0 addr v1:10.20.193.157:6789/0 2026-02-17T11:10:38.617 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f8ade322640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f8ad80c8cf0 addr v1:10.20.193.97:6789/0 2026-02-17T11:10:38.617 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f8ade322640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f8ad815df20 0x7f8ad80c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.617 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f8ade322640 10 monclient(hunting): picked mon.noname-b con 0x7f8ad815df20 addr v2:10.20.193.97:3300/0 2026-02-17T11:10:38.617 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f9f2ee64640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:38.617 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f8ade322640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ad80c97e0 con 0x7f8ad80c8cf0 2026-02-17T11:10:38.617 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f9f2ee64640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:10:38.617 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f8ade322640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ad80c9ac0 con 0x7f8ad81527c0 2026-02-17T11:10:38.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f8ade322640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f8ade322640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f8ad80ca360 con 0x7f8ad815df20 2026-02-17T11:10:38.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f8ade322640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:38.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f8ade322640 10 monclient(hunting): authenticate will time out at 1115.235748s 2026-02-17T11:10:38.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f9f2ee64640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f9f28155f90 0x7f9f281f7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f9f2ee64640 10 monclient(hunting): picked mon.noname-c con 0x7f9f28155f90 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:38.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f9f2ee64640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f9f2815d310 0x7f9f281f3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f9f2ee64640 10 monclient(hunting): picked mon.noname-b con 0x7f9f2815d310 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:38.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f9f2ee64640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f9f2815d730 0x7f9f280cc710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f9f2ee64640 10 monclient(hunting): picked mon.noname-a con 0x7f9f2815d730 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:38.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f9f2ee64640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f9f2ee64640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9f28073080 con 0x7f9f2815d730 2026-02-17T11:10:38.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f9f2ee64640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f9f2ee64640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f9f2815c4f0 con 0x7f9f2815d310 2026-02-17T11:10:38.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f9f2ee64640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f9f2ee64640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f9f2815ccf0 con 0x7f9f28155f90 2026-02-17T11:10:38.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f9f2ee64640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:38.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f9f2ee64640 10 monclient(hunting): authenticate will time out at 1115.235775s 2026-02-17T11:10:38.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f9c1bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:38.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f9c1bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:38.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.572+0000 7f9c1bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:38.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.573+0000 7f9c20bb1640 10 monclient(hunting): handle_auth_done global_id 4558 payload 824 2026-02-17T11:10:38.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.573+0000 7f9c20bb1640 1 -- 10.20.193.49:0/1853108823 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f9c1c0c7170 msgr2=0x7f9c1c15d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.573+0000 7f9c20bb1640 1 --2- 10.20.193.49:0/1853108823 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f9c1c0c7170 0x7f9c1c15d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.573+0000 7f9c20bb1640 1 -- 10.20.193.49:0/1853108823 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f9c1c074ef0 msgr2=0x7f9c1c14eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.573+0000 7f9c20bb1640 1 --2- 10.20.193.49:0/1853108823 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f9c1c074ef0 0x7f9c1c14eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.573+0000 7f9c20bb1640 10 monclient: _finish_hunting 0 2026-02-17T11:10:38.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.573+0000 7f9c20bb1640 1 monclient: found mon.noname-b 2026-02-17T11:10:38.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.573+0000 7f9c20bb1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:38.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.573+0000 7f9c20bb1640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:10:38.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.573+0000 7f9c20bb1640 1 -- 10.20.193.49:0/1853108823 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c1c14e020 con 0x7f9c1c0c7550 2026-02-17T11:10:38.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.575+0000 7f1260c15640 1 --2- 10.20.193.49:0/3558579449 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f125c0c92a0 0x7f125c1f1380 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f125c08f350 tx=0x7f124c0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:38.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.575+0000 7f12517fa640 10 client.?.objecter ms_handle_connect 0x7f125c0c92a0 2026-02-17T11:10:38.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.575+0000 7f12517fa640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:38.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.576+0000 7f9f2d3da640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f9f2815d730 0x7f9f280cc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:38.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.576+0000 7f9f2d3da640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f9f2815d730 0x7f9f280cc710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:33646/0 (socket says 10.20.193.49:33646) 2026-02-17T11:10:38.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.576+0000 7f9f2d3da640 1 -- 10.20.193.49:0/2506347443 learned_addr learned my addr 10.20.193.49:0/2506347443 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:38.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.576+0000 7f9f2d3da640 10 monclient(hunting): get_auth_request con 0x7f9f2815d730 auth_method 0 2026-02-17T11:10:38.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.576+0000 7f9f2d3da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:38.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.576+0000 7f9f2d3da640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:38.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.576+0000 7f9f2d3da640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:38.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.576+0000 7f9f2d3da640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:38.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.576+0000 7f9f2d3da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:38.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.576+0000 7f9f2d3da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:38.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.577+0000 7f9f1ffff640 1 --2- 10.20.193.49:0/2506347443 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f9f2815d310 0x7f9f281f3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:38.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.577+0000 7f9c20bb1640 1 --2- 10.20.193.49:0/1853108823 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f9c1c0c7550 0x7f9c1c0c0fb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c0c86b0 tx=0x7f9c10004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:38.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.577+0000 7f9c18ff9640 10 client.?.objecter ms_handle_connect 0x7f9c1c0c7550 2026-02-17T11:10:38.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.577+0000 7f9c18ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:38.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.577+0000 7f8adc898640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f8ad815df20 0x7f8ad80c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:38.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.577+0000 7f8ad7fff640 1 --1- >> v1:10.20.193.157:6789/0 conn(0x7f8ad81527c0 0x7f8ad80d2250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.157:6789/0 says I am v1:10.20.193.49:52984/0 (socket says 10.20.193.49:52984) 2026-02-17T11:10:38.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.577+0000 7f8ad7fff640 1 -- 10.20.193.49:0/2333200292 learned_addr learned my addr 10.20.193.49:0/2333200292 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:10:38.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.577+0000 7f9f2cbd9640 1 --2- 10.20.193.49:0/2506347443 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f9f28155f90 0x7f9f281f7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:38.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.577+0000 7f8adc898640 10 monclient(hunting): get_auth_request con 0x7f8ad815df20 auth_method 0 2026-02-17T11:10:38.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.577+0000 7f8adc898640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:38.622 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.577+0000 7f8adc898640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:38.622 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.577+0000 7f8adc898640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:38.622 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.578+0000 7f9f2d3da640 10 monclient(hunting): handle_auth_done global_id 4578 payload 824 2026-02-17T11:10:38.622 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.578+0000 7f9f2d3da640 1 -- 10.20.193.49:0/2506347443 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f9f28155f90 msgr2=0x7f9f281f7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.622 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.578+0000 7f9f2d3da640 1 --2- 10.20.193.49:0/2506347443 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f9f28155f90 0x7f9f281f7680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.622 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.578+0000 7f9f2d3da640 1 -- 10.20.193.49:0/2506347443 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f9f2815d310 msgr2=0x7f9f281f3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.622 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.578+0000 7f9f2d3da640 1 --2- 10.20.193.49:0/2506347443 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f9f2815d310 0x7f9f281f3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.622 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.578+0000 7f9f2d3da640 10 monclient: _finish_hunting 0 2026-02-17T11:10:38.622 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.578+0000 7f9f2d3da640 1 monclient: found mon.noname-a 2026-02-17T11:10:38.622 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.578+0000 7f9f2d3da640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:38.622 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.578+0000 7f9f2d3da640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:10:38.622 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.578+0000 7f9f2d3da640 1 -- 10.20.193.49:0/2506347443 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f281f4630 con 0x7f9f2815d730 2026-02-17T11:10:38.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.578+0000 7f12517fa640 1 -- 10.20.193.49:0/3558579449 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f124c046020 con 0x7f125c0c92a0 2026-02-17T11:10:38.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.578+0000 7f12517fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:38.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.578+0000 7f12517fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:10:38.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.578+0000 7f12517fa640 10 monclient: dump: 2026-02-17T11:10:38.623 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:38.623 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.623 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.623 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.623 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:38.623 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.623 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:38.623 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:38.623 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:38.623 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.578+0000 7f12517fa640 10 monclient: _finish_auth 0 2026-02-17T11:10:38.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.578+0000 7f12517fa640 10 monclient: _check_auth_tickets 2026-02-17T11:10:38.624 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.578+0000 7f12517fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:38.624 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.578+0000 7f12517fa640 1 -- 10.20.193.49:0/3558579449 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f124c0426e0 con 0x7f125c0c92a0 2026-02-17T11:10:38.624 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.578+0000 7f12517fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:38.624 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.578+0000 7f12517fa640 1 -- 10.20.193.49:0/3558579449 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f124c03c040 con 0x7f125c0c92a0 2026-02-17T11:10:38.624 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.578+0000 7f1262ea0640 5 monclient: authenticate success, global_id 4583 2026-02-17T11:10:38.624 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.578+0000 7f1252ffd640 4 set_mon_vals no callback set 2026-02-17T11:10:38.624 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.578+0000 7f1262ea0640 10 monclient: _renew_subs 2026-02-17T11:10:38.624 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.578+0000 7f1262ea0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:38.624 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.578+0000 7f1262ea0640 1 -- 10.20.193.49:0/3558579449 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f125c1f58f0 con 0x7f125c0c92a0 2026-02-17T11:10:38.624 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.578+0000 7f12517fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:38.624 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.578+0000 7f12517fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:10:38.624 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.578+0000 7f12517fa640 10 monclient: dump: 2026-02-17T11:10:38.624 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:38.624 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.624 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.624 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.624 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:38.624 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.624 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:38.624 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:38.624 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:38.624 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.624 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.578+0000 7f1262ea0640 10 client.4583.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:38.624 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.578+0000 7f1262ea0640 10 monclient: _renew_subs 2026-02-17T11:10:38.624 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.578+0000 7f1262ea0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:38.624 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.578+0000 7f1262ea0640 1 -- 10.20.193.49:0/3558579449 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f125c1f5eb0 con 0x7f125c0c92a0 2026-02-17T11:10:38.624 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.578+0000 7f1262ea0640 1 librados: init done 2026-02-17T11:10:38.625 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.578+0000 7f8adc898640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:38.625 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.578+0000 7f8adc898640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:38.625 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.578+0000 7f8adc898640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:38.625 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.578+0000 7f1262ea0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:38.625 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.578+0000 7f1262ea0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:38.625 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.578+0000 7f1262ea0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:38.625 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.578+0000 7f1262ea0640 1 -- 10.20.193.49:0/3558579449 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f125c0d1f40 con 0x7f125c0c92a0 2026-02-17T11:10:38.625 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.579+0000 7f9f2d3da640 1 --2- 10.20.193.49:0/2506347443 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f9f2815d730 0x7f9f280cc710 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9f2403a040 tx=0x7f9f24004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:38.625 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.579+0000 7f9f1d7fa640 10 client.?.objecter ms_handle_connect 0x7f9f2815d730 2026-02-17T11:10:38.625 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.579+0000 7f9f1d7fa640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:38.625 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.579+0000 7f8adc898640 10 monclient(hunting): handle_auth_done global_id 4564 payload 274 2026-02-17T11:10:38.625 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.579+0000 7f8adc898640 1 -- 10.20.193.49:0/2333200292 >> v1:10.20.193.157:6789/0 conn(0x7f8ad81527c0 legacy=0x7f8ad80d2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.625 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.579+0000 7f8adc898640 1 -- 10.20.193.49:0/2333200292 >> v1:10.20.193.97:6789/0 conn(0x7f8ad80c8cf0 legacy=0x7f8ad815d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:38.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.579+0000 7f8adc898640 10 monclient: _finish_hunting 0 2026-02-17T11:10:38.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.579+0000 7f8adc898640 1 monclient: found mon.noname-b 2026-02-17T11:10:38.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.579+0000 7f8adc898640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:38.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.579+0000 7f8adc898640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:10:38.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.579+0000 7f8adc898640 1 -- 10.20.193.49:0/2333200292 --> v2:10.20.193.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ad80c9da0 con 0x7f8ad815df20 2026-02-17T11:10:38.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.580+0000 7f0c0ccf2640 10 monclient: get_monmap_and_config 2026-02-17T11:10:38.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.580+0000 7f0c0ccf2640 10 monclient: build_initial_monmap 2026-02-17T11:10:38.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.580+0000 7f0c0ccf2640 10 monclient: monmap: 2026-02-17T11:10:38.626 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:38.626 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.626 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:38.580812+0000 2026-02-17T11:10:38.626 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:38.580812+0000 2026-02-17T11:10:38.626 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:38.626 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.626 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:38.626 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:38.626 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:38.626 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:38.626 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:38.626 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:38.626 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.580+0000 7f0c0ccf2640 1 Processor -- start 2026-02-17T11:10:38.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.580+0000 7f0c0ccf2640 1 -- start start 2026-02-17T11:10:38.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.580+0000 7f0c0ccf2640 10 monclient: init 2026-02-17T11:10:38.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f9f1d7fa640 1 -- 10.20.193.49:0/2506347443 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f2403c050 con 0x7f9f2815d730 2026-02-17T11:10:38.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f9f1d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:38.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f9f1d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:10:38.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f9f1d7fa640 10 monclient: dump: 2026-02-17T11:10:38.627 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:38.627 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.627 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.627 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.627 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:38.627 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.627 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:38.627 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:38.627 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:38.627 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f9f1d7fa640 10 monclient: _finish_auth 0 2026-02-17T11:10:38.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f9f1d7fa640 10 monclient: _check_auth_tickets 2026-02-17T11:10:38.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f9f1d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:38.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f9f1d7fa640 1 -- 10.20.193.49:0/2506347443 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f24048070 con 0x7f9f2815d730 2026-02-17T11:10:38.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f9f1d7fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:38.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f9f1d7fa640 1 -- 10.20.193.49:0/2506347443 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f24041b30 con 0x7f9f2815d730 2026-02-17T11:10:38.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f9f1d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:38.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f9f1effd640 4 set_mon_vals no callback set 2026-02-17T11:10:38.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f9f1d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:10:38.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f9f1d7fa640 10 monclient: dump: 2026-02-17T11:10:38.628 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:38.628 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.628 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.628 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.628 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:38.628 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.628 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:38.628 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:38.628 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:38.628 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f9f2ee64640 5 monclient: authenticate success, global_id 4578 2026-02-17T11:10:38.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f9f2ee64640 10 monclient: _renew_subs 2026-02-17T11:10:38.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f9f2ee64640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:38.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f9f2ee64640 1 -- 10.20.193.49:0/2506347443 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f281f4070 con 0x7f9f2815d730 2026-02-17T11:10:38.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f9f2ee64640 10 client.4578.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:38.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f9f2ee64640 10 monclient: _renew_subs 2026-02-17T11:10:38.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f9f2ee64640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:38.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f9f2ee64640 1 -- 10.20.193.49:0/2506347443 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f280c4500 con 0x7f9f2815d730 2026-02-17T11:10:38.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f9f2ee64640 1 librados: init done 2026-02-17T11:10:38.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f0c0ccf2640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:38.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f0c0ccf2640 10 monclient: _add_conns ranks=[0,2,4,1,5,3] 2026-02-17T11:10:38.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f0c0ccf2640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f0c08152700 addr v1:10.20.193.49:6789/0 2026-02-17T11:10:38.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f0c0ccf2640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f0c0815ef80 addr v1:10.20.193.157:6789/0 2026-02-17T11:10:38.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f0c0ccf2640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f0c08152ae0 0x7f0c080c9e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f0c0ccf2640 10 monclient(hunting): picked mon.noname-b con 0x7f0c08152ae0 addr v2:10.20.193.97:3300/0 2026-02-17T11:10:38.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f0c0ccf2640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c0815d4f0 con 0x7f0c08152700 2026-02-17T11:10:38.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f0c0ccf2640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c0815d7d0 con 0x7f0c0815ef80 2026-02-17T11:10:38.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f0c0ccf2640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f0c0ccf2640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f0c0815dab0 con 0x7f0c08152ae0 2026-02-17T11:10:38.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f0c0ccf2640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:38.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f0c0ccf2640 10 monclient(hunting): authenticate will time out at 1115.244383s 2026-02-17T11:10:38.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f9c18ff9640 1 -- 10.20.193.49:0/1853108823 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c1003c050 con 0x7f9c1c0c7550 2026-02-17T11:10:38.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f9c18ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:38.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f9c18ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:10:38.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f9c18ff9640 10 monclient: dump: 2026-02-17T11:10:38.629 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:38.629 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.629 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.629 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.629 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:38.629 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.629 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:38.629 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:38.629 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:38.630 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.630 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f9c18ff9640 10 monclient: _finish_auth 0 2026-02-17T11:10:38.630 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f9c18ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:10:38.630 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f9c18ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:38.630 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f9c18ff9640 1 -- 10.20.193.49:0/1853108823 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c10048070 con 0x7f9c1c0c7550 2026-02-17T11:10:38.630 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f9c18ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:38.630 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f9c18ff9640 1 -- 10.20.193.49:0/1853108823 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c10041a70 con 0x7f9c1c0c7550 2026-02-17T11:10:38.630 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f9f2ee64640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:38.630 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f9f2ee64640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:38.630 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f9c18ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:38.630 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f9c18ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:38.630 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f9c18ff9640 10 monclient: dump: 2026-02-17T11:10:38.630 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:38.630 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.630 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.630 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.630 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:38.630 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.630 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:38.630 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:38.630 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:38.630 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.630 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f9f2ee64640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:38.631 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f9c1a7fc640 4 set_mon_vals no callback set 2026-02-17T11:10:38.631 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f9c2263b640 5 monclient: authenticate success, global_id 4558 2026-02-17T11:10:38.631 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f9c2263b640 10 monclient: _renew_subs 2026-02-17T11:10:38.631 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f9c2263b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:38.631 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f8adc898640 1 --2- 10.20.193.49:0/2333200292 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f8ad815df20 0x7f8ad80c9180 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8acc009d90 tx=0x7f8acc02f190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cddb7b21d177617a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:38.631 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f9c2263b640 1 -- 10.20.193.49:0/1853108823 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c1c0c19d0 con 0x7f9c1c0c7550 2026-02-17T11:10:38.631 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f9f2ee64640 1 -- 10.20.193.49:0/2506347443 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f28074ab0 con 0x7f9f2815d730 2026-02-17T11:10:38.631 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f9c2263b640 10 client.4558.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:38.631 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f9c2263b640 10 monclient: _renew_subs 2026-02-17T11:10:38.631 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f9c2263b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:38.631 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f9c2263b640 1 -- 10.20.193.49:0/1853108823 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c1c14e2c0 con 0x7f9c1c0c7550 2026-02-17T11:10:38.631 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.581+0000 7f9c2263b640 1 librados: init done 2026-02-17T11:10:38.632 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.582+0000 7f9c2263b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:38.632 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.582+0000 7f9c2263b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:38.632 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.582+0000 7f9c2263b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:38.632 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.582+0000 7f9c2263b640 1 -- 10.20.193.49:0/1853108823 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c1c0c4c20 con 0x7f9c1c0c7550 2026-02-17T11:10:38.632 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.582+0000 7f0c06d76640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f0c08152ae0 0x7f0c080c9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:38.632 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.590+0000 7f0c05d74640 1 --1- >> v1:10.20.193.157:6789/0 conn(0x7f0c0815ef80 0x7f0c080c9730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.157:6789/0 says I am v1:10.20.193.49:52992/0 (socket says 10.20.193.49:52992) 2026-02-17T11:10:38.632 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.590+0000 7f0c05d74640 1 -- 10.20.193.49:0/3346019430 learned_addr learned my addr 10.20.193.49:0/3346019430 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:10:38.632 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.591+0000 7f12517fa640 1 -- 10.20.193.49:0/3558579449 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f124c03f030 con 0x7f125c0c92a0 2026-02-17T11:10:38.632 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.591+0000 7f12517fa640 1 --2- 10.20.193.49:0/3558579449 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f122c079190 0x7f122c07b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.632 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.591+0000 7f1253fff640 1 --2- 10.20.193.49:0/3558579449 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f122c079190 0x7f122c07b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:38.632 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.591+0000 7f1253fff640 10 monclient: get_auth_request con 0x7f122c079190 auth_method 0 2026-02-17T11:10:38.632 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.592+0000 7f1253fff640 1 --2- 10.20.193.49:0/3558579449 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f122c079190 0x7f122c07b650 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f125c0cbd50 tx=0x7f12440092c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:38.632 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.592+0000 7f12517fa640 10 client.4583.objecter ms_handle_connect 0x7f122c079190 2026-02-17T11:10:38.633 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.593+0000 7f9f1d7fa640 1 -- 10.20.193.49:0/2506347443 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f9f24041cd0 con 0x7f9f2815d730 2026-02-17T11:10:38.633 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.593+0000 7f9f1d7fa640 1 --2- 10.20.193.49:0/2506347443 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f9ef8079170 0x7f9ef807b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.633 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.593+0000 7f9f2cbd9640 1 --2- 10.20.193.49:0/2506347443 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f9ef8079170 0x7f9ef807b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:38.633 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.593+0000 7f9f2cbd9640 10 monclient: get_auth_request con 0x7f9ef8079170 auth_method 0 2026-02-17T11:10:38.633 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.594+0000 7f9f2cbd9640 1 --2- 10.20.193.49:0/2506347443 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f9ef8079170 0x7f9ef807b630 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9f1800a8b0 tx=0x7f9f18008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:38.633 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.594+0000 7f9f1d7fa640 10 client.4578.objecter ms_handle_connect 0x7f9ef8079170 2026-02-17T11:10:38.633 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.595+0000 7f9f1d7fa640 1 -- 10.20.193.49:0/2506347443 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7f9f24084030 con 0x7f9f2815d730 2026-02-17T11:10:38.633 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.595+0000 7f9f1d7fa640 10 client.4578.objecter ms_dispatch2 0x7f9f28000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:38.633 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.595+0000 7f9f1d7fa640 3 client.4578.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:38.633 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.595+0000 7f9f1d7fa640 3 client.4578.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:38.633 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.595+0000 7f9f1d7fa640 20 client.4578.objecter dump_active .. 0 homeless 2026-02-17T11:10:38.641 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:10:38.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.680+0000 7f0c06d76640 10 monclient(hunting): get_auth_request con 0x7f0c08152ae0 auth_method 0 2026-02-17T11:10:38.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.680+0000 7f0c06d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:38.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.680+0000 7f0c06d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:38.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.680+0000 7f0c06d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:38.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.680+0000 7ff9fe585640 10 monclient: get_monmap_and_config 2026-02-17T11:10:38.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.680+0000 7ff9fe585640 10 monclient: build_initial_monmap 2026-02-17T11:10:38.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.680+0000 7ff9fe585640 10 monclient: monmap: 2026-02-17T11:10:38.681 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:38.681 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.681 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:38.681034+0000 2026-02-17T11:10:38.681 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:38.681034+0000 2026-02-17T11:10:38.681 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:38.681 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.681 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:38.681 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:38.681 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:38.681 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:38.681 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:38.682 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:38.682 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.682 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.680+0000 7ff9fe585640 1 Processor -- start 2026-02-17T11:10:38.682 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.681+0000 7ff9fe585640 1 -- start start 2026-02-17T11:10:38.682 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.681+0000 7ff9fe585640 10 monclient: init 2026-02-17T11:10:38.682 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.681+0000 7ff9fe585640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:38.682 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.681+0000 7ff9fe585640 10 monclient: _add_conns ranks=[5,3,1,0,4,2] 2026-02-17T11:10:38.682 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.681+0000 7ff9fe585640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7ff9f80d1b60 0x7ff9f80d1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.683 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.681+0000 7ff9fe585640 10 monclient(hunting): picked mon.noname-c con 0x7ff9f80d1b60 addr v2:10.20.193.157:3300/0 2026-02-17T11:10:38.683 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.681+0000 7ff9fe585640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7ff9f815c840 0x7ff9f80c8d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.683 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.681+0000 7ff9fe585640 10 monclient(hunting): picked mon.noname-a con 0x7ff9f815c840 addr v2:10.20.193.49:3300/0 2026-02-17T11:10:38.683 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.681+0000 7ff9fe585640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7ff9f80c92a0 addr v1:10.20.193.97:6789/0 2026-02-17T11:10:38.683 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.681+0000 7ff9fe585640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9f80c98e0 con 0x7ff9f80c92a0 2026-02-17T11:10:38.683 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.681+0000 7ff9fe585640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.683 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.681+0000 7ff9fe585640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7ff9f80ca460 con 0x7ff9f815c840 2026-02-17T11:10:38.683 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.681+0000 7ff9fe585640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.683 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.681+0000 7ff9fe585640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7ff9f815d4c0 con 0x7ff9f80d1b60 2026-02-17T11:10:38.683 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.681+0000 7ff9fe585640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:38.683 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.681+0000 7ff9fe585640 10 monclient(hunting): authenticate will time out at 1115.344708s 2026-02-17T11:10:38.688 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.687+0000 7f12517fa640 1 -- 10.20.193.49:0/3558579449 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7f124c083610 con 0x7f125c0c92a0 2026-02-17T11:10:38.688 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.687+0000 7f12517fa640 10 client.4583.objecter ms_dispatch2 0x7f125c000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:38.688 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.687+0000 7f12517fa640 3 client.4583.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:38.688 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.687+0000 7f12517fa640 3 client.4583.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:38.688 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.687+0000 7f12517fa640 20 client.4583.objecter dump_active .. 0 homeless 2026-02-17T11:10:38.688 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.687+0000 7f0c06d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:38.688 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.687+0000 7f0c06d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:38.688 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.687+0000 7f0c06d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:38.689 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.688+0000 7f9c18ff9640 1 -- 10.20.193.49:0/1853108823 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f9c10041c10 con 0x7f9c1c0c7550 2026-02-17T11:10:38.689 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.688+0000 7f9c18ff9640 1 --2- 10.20.193.49:0/1853108823 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f9bec079140 0x7f9bec07b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.689 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.688+0000 7f9c1bfff640 1 --2- 10.20.193.49:0/1853108823 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f9bec079140 0x7f9bec07b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:38.689 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.688+0000 7f9c1bfff640 10 monclient: get_auth_request con 0x7f9bec079140 auth_method 0 2026-02-17T11:10:38.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.689+0000 7f9c18ff9640 10 client.4558.objecter ms_handle_connect 0x7f9bec079140 2026-02-17T11:10:38.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.689+0000 7f9c1bfff640 1 --2- 10.20.193.49:0/1853108823 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f9bec079140 0x7f9bec07b600 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c0c51a0 tx=0x7f9c08007f50 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:38.691 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.689+0000 7f9c18ff9640 1 -- 10.20.193.49:0/1853108823 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7f9c10084610 con 0x7f9c1c0c7550 2026-02-17T11:10:38.691 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.689+0000 7f9c18ff9640 10 client.4558.objecter ms_dispatch2 0x7f9c1c000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:38.691 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.689+0000 7f9c18ff9640 3 client.4558.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:38.691 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.689+0000 7f9c18ff9640 3 client.4558.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:38.691 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.689+0000 7f9c18ff9640 20 client.4558.objecter dump_active .. 0 homeless 2026-02-17T11:10:38.695 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.694+0000 7f12517fa640 1 -- 10.20.193.49:0/3558579449 <== mon.2 v2:10.20.193.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f124c050030 con 0x7f125c0c92a0 2026-02-17T11:10:38.695 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.694+0000 7f12517fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:38.695 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.694+0000 7f12517fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:38.697 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.695+0000 7ff9f7fff640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7ff9f80d1b60 0x7ff9f80d1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:38.697 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.696+0000 7f8ad6ffd640 1 -- 10.20.193.49:0/2333200292 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8acc03c070 con 0x7f8ad815df20 2026-02-17T11:10:38.697 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.696+0000 7f8ad6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:38.697 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.696+0000 7f8ad6ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:10:38.697 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.696+0000 7f8ad6ffd640 10 monclient: dump: 2026-02-17T11:10:38.697 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:38.697 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.697 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.697 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.697 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:38.697 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.697 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:38.697 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:38.698 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:38.698 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.698 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.696+0000 7f0c05573640 1 -- 10.20.193.49:0/3346019430 <== mon.2 v1:10.20.193.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 915513700 0 0) 0x7f0c0815d7d0 con 0x7f0c0815ef80 2026-02-17T11:10:38.698 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.696+0000 7f8ad6ffd640 10 monclient: _finish_auth 0 2026-02-17T11:10:38.698 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.696+0000 7f8ad6ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:10:38.698 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.696+0000 7f8ad6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:38.698 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.696+0000 7f8ad6ffd640 1 -- 10.20.193.49:0/2333200292 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8acc02fe10 con 0x7f8ad815df20 2026-02-17T11:10:38.698 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.696+0000 7f8ad6ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:38.698 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.696+0000 7f8ad6ffd640 1 -- 10.20.193.49:0/2333200292 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8acc037660 con 0x7f8ad815df20 2026-02-17T11:10:38.698 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.696+0000 7f8ade322640 5 monclient: authenticate success, global_id 4564 2026-02-17T11:10:38.698 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.696+0000 7f0c05573640 10 monclient(hunting): _negotiate 2026-02-17T11:10:38.698 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.696+0000 7f0c05573640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:38.699 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.696+0000 7f0c05573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:38.699 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.696+0000 7f0c05573640 10 monclient(hunting): my global_id is 4592 2026-02-17T11:10:38.699 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.696+0000 7ff9f7fff640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7ff9f80d1b60 0x7ff9f80d1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:48442/0 (socket says 10.20.193.49:48442) 2026-02-17T11:10:38.699 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.696+0000 7ff9f7fff640 1 -- 10.20.193.49:0/1644475235 learned_addr learned my addr 10.20.193.49:0/1644475235 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:38.699 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.696+0000 7ff9f7fff640 10 monclient(hunting): get_auth_request con 0x7ff9f80d1b60 auth_method 0 2026-02-17T11:10:38.699 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.696+0000 7ff9f7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:38.699 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.696+0000 7f8ade322640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:38.699 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.696+0000 7f8ad6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:38.699 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.696+0000 7f8ade322640 4 set_mon_vals no callback set 2026-02-17T11:10:38.699 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.696+0000 7f8ad6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:38.699 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.696+0000 7f8ad6ffd640 10 monclient: dump: 2026-02-17T11:10:38.699 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:38.699 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.699 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.699 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.699 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:38.700 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.700 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:38.700 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:38.700 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:38.700 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.700 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.696+0000 7ff9f7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:38.700 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.696+0000 7ff9f7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:38.700 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.696+0000 7f0c05573640 1 -- 10.20.193.49:0/3346019430 --> v1:10.20.193.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0bf4003620 con 0x7f0c0815ef80 2026-02-17T11:10:38.700 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.696+0000 7f9c18ff9640 1 -- 10.20.193.49:0/1853108823 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f9c100885d0 con 0x7f9c1c0c7550 2026-02-17T11:10:38.700 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.696+0000 7f9c18ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:38.700 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.696+0000 7f9c18ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:38.701 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.696+0000 7ff9f7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:38.701 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.696+0000 7ff9f7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:38.701 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.696+0000 7ff9f7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:38.701 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.696+0000 7f8ade322640 10 monclient: shutdown 2026-02-17T11:10:38.701 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.696+0000 7f8ade322640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:38.701 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.696+0000 7f8ade322640 1 -- 10.20.193.49:0/2333200292 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f8ad815df20 msgr2=0x7f8ad80c9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.701 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.696+0000 7f8ade322640 1 --2- 10.20.193.49:0/2333200292 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f8ad815df20 0x7f8ad80c9180 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8acc009d90 tx=0x7f8acc02f190 comp rx=0 tx=0).stop 2026-02-17T11:10:38.701 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.696+0000 7f8ade322640 1 -- 10.20.193.49:0/2333200292 shutdown_connections 2026-02-17T11:10:38.702 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.696+0000 7f8ade322640 1 --2- 10.20.193.49:0/2333200292 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f8ad815df20 0x7f8ad80c9180 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.702 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.696+0000 7f8ade322640 1 -- 10.20.193.49:0/2333200292 >> 10.20.193.49:0/2333200292 conn(0x7f8ad8073030 msgr2=0x7f8ad8073440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:38.702 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.696+0000 7f8ade322640 1 -- 10.20.193.49:0/2333200292 shutdown_connections 2026-02-17T11:10:38.702 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.696+0000 7f8ade322640 1 -- 10.20.193.49:0/2333200292 wait complete. 2026-02-17T11:10:38.702 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.697+0000 7f0c05573640 1 -- 10.20.193.49:0/3346019430 <== mon.0 v1:10.20.193.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2203099007 0 0) 0x7f0c0815d4f0 con 0x7f0c08152700 2026-02-17T11:10:38.702 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.697+0000 7f0c05573640 10 monclient(hunting): _negotiate 2026-02-17T11:10:38.702 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.697+0000 7f0c05573640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:38.702 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.697+0000 7f0c05573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:38.702 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.697+0000 7f0c05573640 10 monclient(hunting): my global_id is 4581 2026-02-17T11:10:38.702 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.697+0000 7f0c05573640 1 -- 10.20.193.49:0/3346019430 --> v1:10.20.193.49:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c0815d7d0 con 0x7f0c08152700 2026-02-17T11:10:38.703 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.697+0000 7f9f1d7fa640 1 -- 10.20.193.49:0/2506347443 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f9f24051020 con 0x7f9f2815d730 2026-02-17T11:10:38.703 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.697+0000 7f9f1d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:38.703 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.697+0000 7f9f1d7fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:38.703 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.697+0000 7ff9f7fff640 10 monclient(hunting): handle_auth_done global_id 4595 payload 274 2026-02-17T11:10:38.703 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.697+0000 7ff9f7fff640 1 -- 10.20.193.49:0/1644475235 >> v2:10.20.193.49:3300/0 conn(0x7ff9f815c840 msgr2=0x7ff9f80c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:38.703 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.697+0000 7ff9f7fff640 1 --2- 10.20.193.49:0/1644475235 >> v2:10.20.193.49:3300/0 conn(0x7ff9f815c840 0x7ff9f80c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.703 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.697+0000 7ff9f7fff640 1 -- 10.20.193.49:0/1644475235 >> v1:10.20.193.97:6789/0 conn(0x7ff9f80c92a0 legacy=0x7ff9f815d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:38.703 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.697+0000 7ff9f7fff640 10 monclient: _finish_hunting 0 2026-02-17T11:10:38.703 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.697+0000 7ff9f7fff640 1 monclient: found mon.noname-c 2026-02-17T11:10:38.703 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.697+0000 7ff9f7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:38.703 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.697+0000 7ff9f7fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:10:38.703 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.697+0000 7ff9f7fff640 1 -- 10.20.193.49:0/1644475235 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9f80c9bc0 con 0x7ff9f80d1b60 2026-02-17T11:10:38.704 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.697+0000 7f8ade322640 10 monclient: build_initial_monmap 2026-02-17T11:10:38.704 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.697+0000 7f8ade322640 10 monclient: monmap: 2026-02-17T11:10:38.704 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:38.704 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:38.704 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:38.704 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:38.704 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:38.704 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.704 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:38.704 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:38.704 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:38.704 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.705 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.697+0000 7f0c06d76640 10 monclient(hunting): handle_auth_done global_id 4567 payload 274 2026-02-17T11:10:38.705 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.697+0000 7f0c06d76640 1 -- 10.20.193.49:0/3346019430 >> v1:10.20.193.157:6789/0 conn(0x7f0c0815ef80 legacy=0x7f0c080c9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.705 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.697+0000 7f0c06d76640 1 -- 10.20.193.49:0/3346019430 >> v1:10.20.193.49:6789/0 conn(0x7f0c08152700 legacy=0x7f0c0815e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.705 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.697+0000 7f0c06d76640 10 monclient: _finish_hunting 0 2026-02-17T11:10:38.705 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.697+0000 7f0c06d76640 1 monclient: found mon.noname-b 2026-02-17T11:10:38.705 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.697+0000 7f0c06d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:38.705 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.697+0000 7f0c06d76640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:10:38.705 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.697+0000 7f0c06d76640 1 -- 10.20.193.49:0/3346019430 --> v2:10.20.193.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c0815dd90 con 0x7f0c08152ae0 2026-02-17T11:10:38.706 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.697+0000 7f8ade322640 1 librados: starting msgr at 2026-02-17T11:10:38.706 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.697+0000 7f8ade322640 1 librados: starting objecter 2026-02-17T11:10:38.706 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.697+0000 7f8ade322640 1 Processor -- start 2026-02-17T11:10:38.706 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.697+0000 7f8ade322640 1 -- start start 2026-02-17T11:10:38.706 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.697+0000 7f8ade322640 1 librados: setting wanted keys 2026-02-17T11:10:38.706 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.697+0000 7f8ade322640 1 librados: calling monclient init 2026-02-17T11:10:38.706 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.697+0000 7f8ade322640 10 monclient: init 2026-02-17T11:10:38.706 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.698+0000 7f8ade322640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:38.706 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.698+0000 7f8ade322640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:10:38.706 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.698+0000 7f8ade322640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f8ad80c8cf0 0x7f8ad806dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.706 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.698+0000 7f8ade322640 10 monclient(hunting): picked mon.noname-a con 0x7f8ad80c8cf0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:38.706 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.698+0000 7f8ade322640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f8ad81527c0 0x7f8ad81f44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.706 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.698+0000 7f8ade322640 10 monclient(hunting): picked mon.noname-b con 0x7f8ad81527c0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:38.706 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.698+0000 7f8ade322640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f8ad815df20 0x7f8ad81441b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.706 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.698+0000 7f8ade322640 10 monclient(hunting): picked mon.noname-c con 0x7f8ad815df20 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:38.706 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.698+0000 7f8ade322640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.706 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.698+0000 7f8ade322640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad8152ba0 con 0x7f8ad80c8cf0 2026-02-17T11:10:38.706 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.698+0000 7f8ade322640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.706 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.698+0000 7f8ade322640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad815d2f0 con 0x7f8ad81527c0 2026-02-17T11:10:38.706 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.698+0000 7f8ade322640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.707 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.698+0000 7f8ade322640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad8160100 con 0x7f8ad815df20 2026-02-17T11:10:38.707 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.698+0000 7f8ade322640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:38.707 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.698+0000 7f8ade322640 10 monclient(hunting): authenticate will time out at 1115.361497s 2026-02-17T11:10:38.707 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.699+0000 7f0c06d76640 1 --2- 10.20.193.49:0/3346019430 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f0c08152ae0 0x7f0c080c9e40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0bf8009d90 tx=0x7f0bf802f230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8fdd7b656c2cfaf4 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:38.707 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.699+0000 7f8ad7fff640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f8ad80c8cf0 0x7f8ad806dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:38.707 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.699+0000 7f7297bf5640 10 monclient: get_monmap_and_config 2026-02-17T11:10:38.707 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.699+0000 7f7297bf5640 10 monclient: build_initial_monmap 2026-02-17T11:10:38.707 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.699+0000 7f7297bf5640 10 monclient: monmap: 2026-02-17T11:10:38.707 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:38.707 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.707 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:38.700243+0000 2026-02-17T11:10:38.707 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:38.700243+0000 2026-02-17T11:10:38.707 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:38.708 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.708 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:38.708 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:38.708 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:38.708 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:38.708 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:38.708 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:38.708 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.708 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.699+0000 7eff85ab0640 10 monclient: get_monmap_and_config 2026-02-17T11:10:38.708 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.699+0000 7eff85ab0640 10 monclient: build_initial_monmap 2026-02-17T11:10:38.708 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.699+0000 7eff85ab0640 10 monclient: monmap: 2026-02-17T11:10:38.708 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:38.708 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.708 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:38.700244+0000 2026-02-17T11:10:38.708 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:38.700244+0000 2026-02-17T11:10:38.708 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:38.708 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.708 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:38.708 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:38.709 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:38.709 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:38.709 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:38.709 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:38.709 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.709 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.699+0000 7f8ad77fe640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f8ad81527c0 0x7f8ad81f44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:38.709 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.700+0000 7f7297bf5640 1 Processor -- start 2026-02-17T11:10:38.709 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.700+0000 7eff85ab0640 1 Processor -- start 2026-02-17T11:10:38.709 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.700+0000 7f8ad7fff640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f8ad80c8cf0 0x7f8ad806dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:33674/0 (socket says 10.20.193.49:33674) 2026-02-17T11:10:38.709 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.700+0000 7f8ad7fff640 1 -- 10.20.193.49:0/3921632394 learned_addr learned my addr 10.20.193.49:0/3921632394 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:38.710 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.700+0000 7f8ad7fff640 10 monclient(hunting): get_auth_request con 0x7f8ad80c8cf0 auth_method 0 2026-02-17T11:10:38.710 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.700+0000 7f8ad7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:38.710 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.700+0000 7f8ad7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:38.710 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.700+0000 7f8ad7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:38.710 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.700+0000 7f7297bf5640 1 -- start start 2026-02-17T11:10:38.710 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.700+0000 7f7297bf5640 10 monclient: init 2026-02-17T11:10:38.710 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.700+0000 7ff9f7fff640 1 --2- 10.20.193.49:0/1644475235 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff9f80d1b60 0x7ff9f80d1f40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff9f80cf420 tx=0x7ff9e402eed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2de4ecaf694aeb9b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:38.710 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.700+0000 7eff85ab0640 1 -- start start 2026-02-17T11:10:38.710 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.700+0000 7eff85ab0640 10 monclient: init 2026-02-17T11:10:38.711 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.700+0000 7f8adc898640 1 --2- 10.20.193.49:0/3921632394 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f8ad815df20 0x7f8ad81441b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:38.711 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.700+0000 7f8ad77fe640 10 monclient(hunting): get_auth_request con 0x7f8ad81527c0 auth_method 0 2026-02-17T11:10:38.711 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.700+0000 7f8ad77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:38.711 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.700+0000 7f8ad77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:38.711 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.700+0000 7f8ad77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:38.711 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.700+0000 7f8ad7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:38.711 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.700+0000 7f8ad7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:38.711 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.700+0000 7f8ad7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:38.712 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.700+0000 7f7297bf5640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:38.712 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.700+0000 7f7297bf5640 10 monclient: _add_conns ranks=[2,5,3,4,0,1] 2026-02-17T11:10:38.712 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.700+0000 7f7297bf5640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f72901560e0 addr v1:10.20.193.157:6789/0 2026-02-17T11:10:38.712 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.700+0000 7f7297bf5640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f729015fe10 0x7f72900c9b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.712 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.700+0000 7f7297bf5640 10 monclient(hunting): picked mon.noname-c con 0x7f729015fe10 addr v2:10.20.193.157:3300/0 2026-02-17T11:10:38.712 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.700+0000 7f7297bf5640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f72900ca040 0x7f72900ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.712 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.700+0000 7f7297bf5640 10 monclient(hunting): picked mon.noname-a con 0x7f72900ca040 addr v2:10.20.193.49:3300/0 2026-02-17T11:10:38.712 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.700+0000 7f7297bf5640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72900d2130 con 0x7f72901560e0 2026-02-17T11:10:38.712 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.700+0000 7f7297bf5640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.712 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.700+0000 7f7297bf5640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f72900c9670 con 0x7f72900ca040 2026-02-17T11:10:38.712 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.700+0000 7f7297bf5640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.712 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.700+0000 7f7297bf5640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f72900d2410 con 0x7f729015fe10 2026-02-17T11:10:38.712 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.700+0000 7f7297bf5640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:38.712 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.700+0000 7f7297bf5640 10 monclient(hunting): authenticate will time out at 1115.363779s 2026-02-17T11:10:38.712 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.700+0000 7eff85ab0640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:38.712 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.700+0000 7eff85ab0640 10 monclient: _add_conns ranks=[4,2,5,3,0,1] 2026-02-17T11:10:38.712 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.700+0000 7eff85ab0640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7eff8015d370 0x7eff8015d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.713 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.700+0000 7f8adc898640 10 monclient(hunting): get_auth_request con 0x7f8ad815df20 auth_method 0 2026-02-17T11:10:38.713 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.700+0000 7f8adc898640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:38.713 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.700+0000 7f8adc898640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:38.713 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.700+0000 7eff85ab0640 10 monclient(hunting): picked mon.noname-b con 0x7eff8015d370 addr v2:10.20.193.97:3300/0 2026-02-17T11:10:38.713 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.700+0000 7f8adc898640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:38.713 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.700+0000 7eff85ab0640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7eff800c7e20 addr v1:10.20.193.157:6789/0 2026-02-17T11:10:38.714 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.700+0000 7eff85ab0640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7eff800c74c0 0x7eff800c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.714 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.700+0000 7eff85ab0640 10 monclient(hunting): picked mon.noname-c con 0x7eff800c74c0 addr v2:10.20.193.157:3300/0 2026-02-17T11:10:38.714 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.700+0000 7eff85ab0640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff800c8350 con 0x7eff800c7e20 2026-02-17T11:10:38.714 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.700+0000 7eff85ab0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.714 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.700+0000 7eff85ab0640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7eff8015b710 con 0x7eff8015d370 2026-02-17T11:10:38.714 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.700+0000 7eff85ab0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.714 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.700+0000 7eff85ab0640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7eff800c9240 con 0x7eff800c74c0 2026-02-17T11:10:38.714 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.700+0000 7eff85ab0640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:38.714 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.700+0000 7eff85ab0640 10 monclient(hunting): authenticate will time out at 1115.363947s 2026-02-17T11:10:38.714 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.701+0000 7f0c05573640 1 -- 10.20.193.49:0/3346019430 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf803c070 con 0x7f0c08152ae0 2026-02-17T11:10:38.714 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.701+0000 7f0c05573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:38.714 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.701+0000 7f0c05573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:10:38.715 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.701+0000 7f0c05573640 10 monclient: dump: 2026-02-17T11:10:38.715 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:38.715 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.715 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.715 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.715 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:38.715 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.715 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:38.715 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:38.715 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:38.715 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.715 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.701+0000 7f0c05573640 10 monclient: _finish_auth 0 2026-02-17T11:10:38.715 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.701+0000 7f0c05573640 10 monclient: _check_auth_tickets 2026-02-17T11:10:38.715 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.701+0000 7f0c05573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:38.715 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.701+0000 7f0c05573640 1 -- 10.20.193.49:0/3346019430 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bf8037440 con 0x7f0c08152ae0 2026-02-17T11:10:38.715 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.701+0000 7f0c05573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:38.715 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.701+0000 7f0c05573640 1 -- 10.20.193.49:0/3346019430 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf8037810 con 0x7f0c08152ae0 2026-02-17T11:10:38.715 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.701+0000 7f0c0ccf2640 5 monclient: authenticate success, global_id 4567 2026-02-17T11:10:38.715 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.701+0000 7f0c0ccf2640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:38.715 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.701+0000 7f0c0ccf2640 4 set_mon_vals no callback set 2026-02-17T11:10:38.715 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.701+0000 7f0c05573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:38.715 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.701+0000 7f0c05573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:38.715 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.701+0000 7f0c05573640 10 monclient: dump: 2026-02-17T11:10:38.716 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:38.716 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.716 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.716 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.716 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:38.716 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.716 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:38.716 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:38.716 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:38.716 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.701+0000 7f8adc898640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:38.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.701+0000 7f8adc898640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:38.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.701+0000 7f8adc898640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:38.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.701+0000 7f8ad77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:38.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.701+0000 7f8ad77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:38.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.701+0000 7f8ad77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:38.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.702+0000 7f0c0ccf2640 10 monclient: shutdown 2026-02-17T11:10:38.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.702+0000 7f0c0ccf2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:38.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.702+0000 7f0c0ccf2640 1 -- 10.20.193.49:0/3346019430 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f0c08152ae0 msgr2=0x7f0c080c9e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.702+0000 7f0c0ccf2640 1 --2- 10.20.193.49:0/3346019430 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f0c08152ae0 0x7f0c080c9e40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0bf8009d90 tx=0x7f0bf802f230 comp rx=0 tx=0).stop 2026-02-17T11:10:38.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.702+0000 7f0c0ccf2640 1 -- 10.20.193.49:0/3346019430 shutdown_connections 2026-02-17T11:10:38.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.702+0000 7f0c0ccf2640 1 --2- 10.20.193.49:0/3346019430 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f0c08152ae0 0x7f0c080c9e40 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.702+0000 7f0c0ccf2640 1 -- 10.20.193.49:0/3346019430 >> 10.20.193.49:0/3346019430 conn(0x7f0c08073030 msgr2=0x7f0c08073440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:38.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.702+0000 7f0c0ccf2640 1 -- 10.20.193.49:0/3346019430 shutdown_connections 2026-02-17T11:10:38.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.702+0000 7f0c0ccf2640 1 -- 10.20.193.49:0/3346019430 wait complete. 2026-02-17T11:10:38.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.702+0000 7f8ad7fff640 10 monclient(hunting): handle_auth_done global_id 4584 payload 824 2026-02-17T11:10:38.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.702+0000 7f8ad7fff640 1 -- 10.20.193.49:0/3921632394 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f8ad815df20 msgr2=0x7f8ad81441b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.702+0000 7f8ad7fff640 1 --2- 10.20.193.49:0/3921632394 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f8ad815df20 0x7f8ad81441b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.702+0000 7f8ad7fff640 1 -- 10.20.193.49:0/3921632394 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f8ad81527c0 msgr2=0x7f8ad81f44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.702+0000 7f8ad7fff640 1 --2- 10.20.193.49:0/3921632394 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f8ad81527c0 0x7f8ad81f44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.702+0000 7f8ad7fff640 10 monclient: _finish_hunting 0 2026-02-17T11:10:38.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.702+0000 7f8ad7fff640 1 monclient: found mon.noname-a 2026-02-17T11:10:38.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.702+0000 7f8ad7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:38.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.702+0000 7f8ad7fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:10:38.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.702+0000 7f8ad7fff640 1 -- 10.20.193.49:0/3921632394 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ad8148630 con 0x7f8ad80c8cf0 2026-02-17T11:10:38.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.702+0000 7f0c0ccf2640 10 monclient: build_initial_monmap 2026-02-17T11:10:38.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.702+0000 7f0c0ccf2640 10 monclient: monmap: 2026-02-17T11:10:38.718 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:38.718 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:38.718 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:38.719 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:38.719 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:38.719 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.719 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:38.719 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:38.719 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:38.719 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.719 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.702+0000 7f0c0ccf2640 1 librados: starting msgr at 2026-02-17T11:10:38.719 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.702+0000 7f0c0ccf2640 1 librados: starting objecter 2026-02-17T11:10:38.719 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.702+0000 7f0c0ccf2640 1 Processor -- start 2026-02-17T11:10:38.719 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.702+0000 7f0c0ccf2640 1 -- start start 2026-02-17T11:10:38.719 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.702+0000 7f0c0ccf2640 1 librados: setting wanted keys 2026-02-17T11:10:38.719 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.702+0000 7f0c0ccf2640 1 librados: calling monclient init 2026-02-17T11:10:38.719 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.702+0000 7f0c0ccf2640 10 monclient: init 2026-02-17T11:10:38.719 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.702+0000 7f729616b640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f72900ca040 0x7f72900ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:38.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.703+0000 7f0c0ccf2640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:38.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.703+0000 7f0c0ccf2640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:10:38.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.703+0000 7f0c0ccf2640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f0c08152700 0x7f0c081f7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.703+0000 7f0c0ccf2640 10 monclient(hunting): picked mon.noname-c con 0x7f0c08152700 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:38.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.703+0000 7f0c0ccf2640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f0c08152ae0 0x7f0c080d1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.703+0000 7f0c0ccf2640 10 monclient(hunting): picked mon.noname-b con 0x7f0c08152ae0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:38.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.703+0000 7f0c0ccf2640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0c0815ef80 0x7f0c080cffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.703+0000 7f0c0ccf2640 10 monclient(hunting): picked mon.noname-a con 0x7f0c0815ef80 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:38.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.703+0000 7f0c0ccf2640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.703+0000 7f0c0ccf2640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0c080ca380 con 0x7f0c0815ef80 2026-02-17T11:10:38.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.703+0000 7f0c0ccf2640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.703+0000 7f0c0ccf2640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f0c0815e350 con 0x7f0c08152ae0 2026-02-17T11:10:38.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.703+0000 7f0c0ccf2640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.703+0000 7f0c0ccf2640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f0c08166850 con 0x7f0c08152700 2026-02-17T11:10:38.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.703+0000 7f0c0ccf2640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:38.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.703+0000 7f0c0ccf2640 10 monclient(hunting): authenticate will time out at 1115.366339s 2026-02-17T11:10:38.721 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.703+0000 7ff9f6ffd640 1 -- 10.20.193.49:0/1644475235 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e403c070 con 0x7ff9f80d1b60 2026-02-17T11:10:38.721 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.703+0000 7ff9f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:38.721 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.703+0000 7ff9f6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:10:38.721 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.703+0000 7ff9f6ffd640 10 monclient: dump: 2026-02-17T11:10:38.721 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:38.721 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.721 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.721 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.721 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:38.721 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.721 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:38.721 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:38.721 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:38.721 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.721 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.703+0000 7ff9f6ffd640 10 monclient: _finish_auth 0 2026-02-17T11:10:38.721 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.703+0000 7ff9f6ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:10:38.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.703+0000 7ff9f6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:38.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.703+0000 7ff9f6ffd640 1 -- 10.20.193.49:0/1644475235 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9e402fb40 con 0x7ff9f80d1b60 2026-02-17T11:10:38.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.703+0000 7ff9f6ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:38.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.703+0000 7ff9f6ffd640 1 -- 10.20.193.49:0/1644475235 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e4037440 con 0x7ff9f80d1b60 2026-02-17T11:10:38.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.703+0000 7ff9fe585640 5 monclient: authenticate success, global_id 4595 2026-02-17T11:10:38.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.703+0000 7ff9fe585640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:38.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.703+0000 7ff9fe585640 4 set_mon_vals no callback set 2026-02-17T11:10:38.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.703+0000 7ff9f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:38.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.703+0000 7ff9f6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:10:38.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.703+0000 7ff9f6ffd640 10 monclient: dump: 2026-02-17T11:10:38.722 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:38.722 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.722 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.722 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.722 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:38.722 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.722 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:38.722 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:38.722 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:38.722 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.703+0000 7f8ad7fff640 1 --2- 10.20.193.49:0/3921632394 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f8ad80c8cf0 0x7f8ad806dd00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8ac400c730 tx=0x7f8ac400cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:38.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.703+0000 7f8ad4ff9640 10 client.?.objecter ms_handle_connect 0x7f8ad80c8cf0 2026-02-17T11:10:38.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.703+0000 7f8ad4ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:38.723 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.703+0000 7f729616b640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f72900ca040 0x7f72900ce350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:33690/0 (socket says 10.20.193.49:33690) 2026-02-17T11:10:38.723 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.703+0000 7f729616b640 1 -- 10.20.193.49:0/1269364918 learned_addr learned my addr 10.20.193.49:0/1269364918 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:38.723 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.703+0000 7f729616b640 10 monclient(hunting): get_auth_request con 0x7f72900ca040 auth_method 0 2026-02-17T11:10:38.723 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.703+0000 7f729616b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:38.723 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.703+0000 7f729616b640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:38.723 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.703+0000 7f729616b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:38.723 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.703+0000 7ff9fe585640 10 monclient: shutdown 2026-02-17T11:10:38.723 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.703+0000 7ff9fe585640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:38.723 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.703+0000 7ff9fe585640 1 -- 10.20.193.49:0/1644475235 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff9f80d1b60 msgr2=0x7ff9f80d1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.723 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.703+0000 7ff9fe585640 1 --2- 10.20.193.49:0/1644475235 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff9f80d1b60 0x7ff9f80d1f40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff9f80cf420 tx=0x7ff9e402eed0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.723 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.703+0000 7ff9fe585640 1 -- 10.20.193.49:0/1644475235 shutdown_connections 2026-02-17T11:10:38.723 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.703+0000 7ff9fe585640 1 --2- 10.20.193.49:0/1644475235 >> v2:10.20.193.49:3300/0 conn(0x7ff9f815c840 0x7ff9f80c8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.723 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.703+0000 7ff9fe585640 1 --2- 10.20.193.49:0/1644475235 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff9f80d1b60 0x7ff9f80d1f40 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.704+0000 7ff9fe585640 1 -- 10.20.193.49:0/1644475235 >> 10.20.193.49:0/1644475235 conn(0x7ff9f806d9b0 msgr2=0x7ff9f806ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:38.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.704+0000 7ff9fe585640 1 -- 10.20.193.49:0/1644475235 shutdown_connections 2026-02-17T11:10:38.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.704+0000 7ff9fe585640 1 -- 10.20.193.49:0/1644475235 wait complete. 2026-02-17T11:10:38.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.704+0000 7f729616b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:38.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.704+0000 7f729616b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:38.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.704+0000 7f729616b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:38.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.704+0000 7ff9fe585640 10 monclient: build_initial_monmap 2026-02-17T11:10:38.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.704+0000 7ff9fe585640 10 monclient: monmap: 2026-02-17T11:10:38.724 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:38.724 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:38.724 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:38.724 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:38.724 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:38.724 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.724 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:38.724 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:38.724 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:38.724 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.704+0000 7f0c05d74640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f0c08152ae0 0x7f0c080d1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:38.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.704+0000 7eff7f7fe640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7eff8015d370 0x7eff8015d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:38.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.704+0000 7ff9fe585640 1 librados: starting msgr at 2026-02-17T11:10:38.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.704+0000 7ff9fe585640 1 librados: starting objecter 2026-02-17T11:10:38.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.704+0000 7ff9fe585640 1 Processor -- start 2026-02-17T11:10:38.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.704+0000 7ff9fe585640 1 -- start start 2026-02-17T11:10:38.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.704+0000 7ff9fe585640 1 librados: setting wanted keys 2026-02-17T11:10:38.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.704+0000 7ff9fe585640 1 librados: calling monclient init 2026-02-17T11:10:38.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.704+0000 7ff9fe585640 10 monclient: init 2026-02-17T11:10:38.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.704+0000 7f0c05d74640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f0c08152ae0 0x7f0c080d1f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:55788/0 (socket says 10.20.193.49:55788) 2026-02-17T11:10:38.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.704+0000 7f0c05d74640 1 -- 10.20.193.49:0/877735764 learned_addr learned my addr 10.20.193.49:0/877735764 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:38.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.704+0000 7f0c05d74640 10 monclient(hunting): get_auth_request con 0x7f0c08152ae0 auth_method 0 2026-02-17T11:10:38.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.704+0000 7f0c05d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:38.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.704+0000 7f0c05d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:38.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.704+0000 7f0c05d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:38.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.705+0000 7eff7f7fe640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7eff8015d370 0x7eff8015d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:55784/0 (socket says 10.20.193.49:55784) 2026-02-17T11:10:38.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.705+0000 7eff7f7fe640 1 -- 10.20.193.49:0/1663899187 learned_addr learned my addr 10.20.193.49:0/1663899187 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:38.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.705+0000 7eff7f7fe640 10 monclient(hunting): get_auth_request con 0x7eff8015d370 auth_method 0 2026-02-17T11:10:38.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.705+0000 7eff7f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:38.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.705+0000 7eff7f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:38.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.705+0000 7eff7f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:38.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.705+0000 7ff9fe585640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:38.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.705+0000 7ff9fe585640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:10:38.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.705+0000 7ff9fe585640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7ff9f80c92a0 0x7ff9f81f4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.705+0000 7ff9fe585640 10 monclient(hunting): picked mon.noname-b con 0x7ff9f80c92a0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:38.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.705+0000 7ff9fe585640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ff9f80d1b60 0x7ff9f815dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.705+0000 7ff9fe585640 10 monclient(hunting): picked mon.noname-a con 0x7ff9f80d1b60 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:38.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.705+0000 7ff9fe585640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff9f815c840 0x7ff9f81f1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.705+0000 7ff9fe585640 10 monclient(hunting): picked mon.noname-c con 0x7ff9f815c840 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:38.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.705+0000 7ff9fe585640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.705+0000 7ff9fe585640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f815cc90 con 0x7ff9f80d1b60 2026-02-17T11:10:38.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.705+0000 7ff9fe585640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.705+0000 7ff9fe585640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f80ca180 con 0x7ff9f80c92a0 2026-02-17T11:10:38.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.705+0000 7ff9fe585640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.705+0000 7ff9fe585640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f806e7b0 con 0x7ff9f815c840 2026-02-17T11:10:38.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.705+0000 7eff7ffff640 1 --2- 10.20.193.49:0/1663899187 >> v2:10.20.193.157:3300/0 conn(0x7eff800c74c0 0x7eff800c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:38.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.705+0000 7ff9fe585640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:38.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.705+0000 7ff9fe585640 10 monclient(hunting): authenticate will time out at 1115.368255s 2026-02-17T11:10:38.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.705+0000 7f0c06575640 1 --2- 10.20.193.49:0/877735764 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f0c08152700 0x7f0c081f7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:38.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.705+0000 7eff7ffff640 10 monclient(hunting): get_auth_request con 0x7eff800c74c0 auth_method 0 2026-02-17T11:10:38.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.705+0000 7eff7ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:38.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.705+0000 7eff7ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:38.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.705+0000 7eff7ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:38.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.705+0000 7f0c05d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:38.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.705+0000 7f0c05d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:38.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.705+0000 7f729616b640 10 monclient(hunting): handle_auth_done global_id 4587 payload 274 2026-02-17T11:10:38.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.705+0000 7f729616b640 1 -- 10.20.193.49:0/1269364918 >> v2:10.20.193.157:3300/0 conn(0x7f729015fe10 msgr2=0x7f72900c9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:38.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.705+0000 7f729616b640 1 --2- 10.20.193.49:0/1269364918 >> v2:10.20.193.157:3300/0 conn(0x7f729015fe10 0x7f72900c9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.705+0000 7f0c05d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:38.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.705+0000 7f729616b640 1 -- 10.20.193.49:0/1269364918 >> v1:10.20.193.157:6789/0 conn(0x7f72901560e0 legacy=0x7f72900d1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:38.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.705+0000 7f729616b640 10 monclient: _finish_hunting 0 2026-02-17T11:10:38.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.705+0000 7f729616b640 1 monclient: found mon.noname-a 2026-02-17T11:10:38.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.705+0000 7eff7f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:38.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.705+0000 7eff7f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:38.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.705+0000 7f729616b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:38.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.705+0000 7f729616b640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:10:38.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.705+0000 7f729616b640 1 -- 10.20.193.49:0/1269364918 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72900d26f0 con 0x7f72900ca040 2026-02-17T11:10:38.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.705+0000 7eff7f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:38.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.705+0000 7f0c06575640 10 monclient(hunting): get_auth_request con 0x7f0c08152700 auth_method 0 2026-02-17T11:10:38.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.705+0000 7f0c06575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:38.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.705+0000 7f0c06575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:38.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.705+0000 7f0c06575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:38.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.705+0000 7f0c06d76640 1 --2- 10.20.193.49:0/877735764 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0c0815ef80 0x7f0c080cffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:38.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.705+0000 7eff7ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:38.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.705+0000 7eff7ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:38.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.705+0000 7eff7ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:38.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.706+0000 7f0c06575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:38.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.706+0000 7f0c06575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:38.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.706+0000 7f0c06575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:38.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.707+0000 7f0c05d74640 10 monclient(hunting): handle_auth_done global_id 4573 payload 824 2026-02-17T11:10:38.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.707+0000 7f0c05d74640 1 -- 10.20.193.49:0/877735764 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f0c08152700 msgr2=0x7f0c081f7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.707+0000 7f0c05d74640 1 --2- 10.20.193.49:0/877735764 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f0c08152700 0x7f0c081f7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.707+0000 7f0c05d74640 1 -- 10.20.193.49:0/877735764 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0c0815ef80 msgr2=0x7f0c080cffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.707+0000 7f0c05d74640 1 --2- 10.20.193.49:0/877735764 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0c0815ef80 0x7f0c080cffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.707+0000 7f0c05d74640 10 monclient: _finish_hunting 0 2026-02-17T11:10:38.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.707+0000 7f0c05d74640 1 monclient: found mon.noname-b 2026-02-17T11:10:38.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.707+0000 7f0c05d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:38.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.707+0000 7f0c05d74640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:10:38.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.707+0000 7f0c05d74640 1 -- 10.20.193.49:0/877735764 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c0815b610 con 0x7f0c08152ae0 2026-02-17T11:10:38.731 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.707+0000 7eff7ffff640 10 monclient(hunting): handle_auth_done global_id 4601 payload 274 2026-02-17T11:10:38.731 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.707+0000 7eff7ffff640 1 -- 10.20.193.49:0/1663899187 >> v2:10.20.193.97:3300/0 conn(0x7eff8015d370 msgr2=0x7eff8015d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:38.731 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.707+0000 7eff7ffff640 1 --2- 10.20.193.49:0/1663899187 >> v2:10.20.193.97:3300/0 conn(0x7eff8015d370 0x7eff8015d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.731 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.707+0000 7eff7ffff640 1 -- 10.20.193.49:0/1663899187 >> v1:10.20.193.157:6789/0 conn(0x7eff800c7e20 legacy=0x7eff8015b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:38.731 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.707+0000 7eff7ffff640 10 monclient: _finish_hunting 0 2026-02-17T11:10:38.731 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.707+0000 7eff7ffff640 1 monclient: found mon.noname-c 2026-02-17T11:10:38.731 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.707+0000 7eff7ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:38.731 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.707+0000 7eff7ffff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:10:38.731 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.707+0000 7eff7ffff640 1 -- 10.20.193.49:0/1663899187 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff800c8630 con 0x7eff800c74c0 2026-02-17T11:10:38.731 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.708+0000 7f729616b640 1 --2- 10.20.193.49:0/1269364918 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f72900ca040 0x7f72900ce350 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f72900cf430 tx=0x7f728c02f270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ff3c83bbbf060d6 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:38.731 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.709+0000 7ff9f77fe640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ff9f80d1b60 0x7ff9f815dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:38.731 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.709+0000 7ff9f7fff640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7ff9f80c92a0 0x7ff9f81f4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:38.731 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.709+0000 7f0c05d74640 1 --2- 10.20.193.49:0/877735764 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f0c08152ae0 0x7f0c080d1f00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0bf000c730 tx=0x7f0bf000cc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:38.731 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.709+0000 7f0beeffd640 10 client.?.objecter ms_handle_connect 0x7f0c08152ae0 2026-02-17T11:10:38.731 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.709+0000 7f0beeffd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:38.732 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.710+0000 7ff9f7fff640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7ff9f80c92a0 0x7ff9f81f4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:55796/0 (socket says 10.20.193.49:55796) 2026-02-17T11:10:38.732 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.710+0000 7ff9f7fff640 1 -- 10.20.193.49:0/2636840979 learned_addr learned my addr 10.20.193.49:0/2636840979 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:38.732 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.710+0000 7ff9f7fff640 10 monclient(hunting): get_auth_request con 0x7ff9f80c92a0 auth_method 0 2026-02-17T11:10:38.732 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.710+0000 7ff9f7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:38.732 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.710+0000 7ff9f7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:38.732 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.710+0000 7f8ad4ff9640 1 -- 10.20.193.49:0/3921632394 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac4017070 con 0x7f8ad80c8cf0 2026-02-17T11:10:38.732 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.710+0000 7f8ad4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:38.732 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.710+0000 7f8ad4ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:10:38.732 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.710+0000 7f8ad4ff9640 10 monclient: dump: 2026-02-17T11:10:38.732 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:38.732 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.732 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.732 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.732 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:38.732 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.732 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:38.732 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:38.732 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:38.732 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.732 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.710+0000 7f8ad4ff9640 10 monclient: _finish_auth 0 2026-02-17T11:10:38.732 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.710+0000 7f8ad4ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:10:38.732 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.710+0000 7ff9f7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:38.733 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.710+0000 7f8ad4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:38.733 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.710+0000 7f8ad4ff9640 1 -- 10.20.193.49:0/3921632394 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ac4005bb0 con 0x7f8ad80c8cf0 2026-02-17T11:10:38.733 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.710+0000 7f8ad4ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:38.733 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.710+0000 7f8ad4ff9640 1 -- 10.20.193.49:0/3921632394 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac4007070 con 0x7f8ad80c8cf0 2026-02-17T11:10:38.733 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.710+0000 7f8ad4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:38.733 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.710+0000 7f8ad4ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:10:38.733 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.710+0000 7f8ad4ff9640 10 monclient: dump: 2026-02-17T11:10:38.733 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:38.733 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.733 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.733 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.733 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:38.733 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.733 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:38.733 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:38.733 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:38.733 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.733 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.710+0000 7f8ad67fc640 4 set_mon_vals no callback set 2026-02-17T11:10:38.733 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.710+0000 7f8ade322640 5 monclient: authenticate success, global_id 4584 2026-02-17T11:10:38.733 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.710+0000 7f8ade322640 10 monclient: _renew_subs 2026-02-17T11:10:38.733 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.710+0000 7f8ade322640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:38.733 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.710+0000 7f8ade322640 1 -- 10.20.193.49:0/3921632394 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ad814d0f0 con 0x7f8ad80c8cf0 2026-02-17T11:10:38.733 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.710+0000 7ff9f77fe640 10 monclient(hunting): get_auth_request con 0x7ff9f80d1b60 auth_method 0 2026-02-17T11:10:38.733 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.710+0000 7ff9f77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:38.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.710+0000 7ff9f77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:38.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.710+0000 7ff9f77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:38.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.710+0000 7f8ade322640 10 client.4584.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:38.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.710+0000 7f8ade322640 10 monclient: _renew_subs 2026-02-17T11:10:38.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.710+0000 7f8ade322640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:38.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.710+0000 7f8ade322640 1 -- 10.20.193.49:0/3921632394 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ad81f7a40 con 0x7f8ad80c8cf0 2026-02-17T11:10:38.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.710+0000 7f8ade322640 1 librados: init done 2026-02-17T11:10:38.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.710+0000 7ff9f77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:38.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.710+0000 7ff9f77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:38.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.710+0000 7ff9f77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:38.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.710+0000 7ff9f7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:38.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.710+0000 7ff9f7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:38.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.710+0000 7ff9f7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:38.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.710+0000 7eff7ffff640 1 --2- 10.20.193.49:0/1663899187 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7eff800c74c0 0x7eff800c52b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7eff8015dcf0 tx=0x7eff7402f1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=283d7f981a125683 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:38.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.711+0000 7f8ade322640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:38.735 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.711+0000 7f8ade322640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:38.735 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.711+0000 7f8ade322640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:38.735 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.711+0000 7ff9fcafb640 1 --2- 10.20.193.49:0/2636840979 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff9f815c840 0x7ff9f81f1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:38.735 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.711+0000 7f8ade322640 1 -- 10.20.193.49:0/3921632394 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ad80c9180 con 0x7f8ad80c8cf0 2026-02-17T11:10:38.735 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.711+0000 7f0beeffd640 1 -- 10.20.193.49:0/877735764 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf0017070 con 0x7f0c08152ae0 2026-02-17T11:10:38.735 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.711+0000 7f0beeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:38.735 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.711+0000 7f0beeffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:10:38.735 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.711+0000 7f0beeffd640 10 monclient: dump: 2026-02-17T11:10:38.735 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:38.735 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.735 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.735 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.735 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:38.735 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.735 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:38.735 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:38.735 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:38.735 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.736 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.711+0000 7f0beeffd640 10 monclient: _finish_auth 0 2026-02-17T11:10:38.736 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.711+0000 7f0beeffd640 10 monclient: _check_auth_tickets 2026-02-17T11:10:38.736 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.711+0000 7f0beeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:38.736 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.711+0000 7f0c0ccf2640 5 monclient: authenticate success, global_id 4573 2026-02-17T11:10:38.736 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.711+0000 7f0c0ccf2640 10 monclient: _renew_subs 2026-02-17T11:10:38.736 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.711+0000 7f0c0ccf2640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:38.736 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.711+0000 7f0c0ccf2640 1 -- 10.20.193.49:0/877735764 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c081f7990 con 0x7f0c08152ae0 2026-02-17T11:10:38.736 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.711+0000 7f0c0ccf2640 10 client.4573.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:38.736 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.711+0000 7f0c0ccf2640 10 monclient: _renew_subs 2026-02-17T11:10:38.736 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.711+0000 7f0c0ccf2640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:38.736 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.711+0000 7f0c0ccf2640 1 -- 10.20.193.49:0/877735764 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c081f7f50 con 0x7f0c08152ae0 2026-02-17T11:10:38.736 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.711+0000 7f0c0ccf2640 1 librados: init done 2026-02-17T11:10:38.736 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.711+0000 7ff9fcafb640 10 monclient(hunting): get_auth_request con 0x7ff9f815c840 auth_method 0 2026-02-17T11:10:38.736 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.711+0000 7ff9fcafb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:38.736 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.711+0000 7ff9fcafb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:38.736 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.711+0000 7ff9fcafb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:38.736 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.711+0000 7f0c0ccf2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:38.736 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.711+0000 7f0c0ccf2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:38.736 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.711+0000 7f0c0ccf2640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:38.736 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.711+0000 7f0c0ccf2640 1 -- 10.20.193.49:0/877735764 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c0815e870 con 0x7f0c08152ae0 2026-02-17T11:10:38.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.712+0000 7ff9fcafb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:38.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.712+0000 7ff9fcafb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:38.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.712+0000 7ff9fcafb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:38.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.713+0000 7ff9f7fff640 10 monclient(hunting): handle_auth_done global_id 4579 payload 824 2026-02-17T11:10:38.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.713+0000 7ff9f7fff640 1 -- 10.20.193.49:0/2636840979 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff9f815c840 msgr2=0x7ff9f81f1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.713+0000 7ff9f7fff640 1 --2- 10.20.193.49:0/2636840979 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff9f815c840 0x7ff9f81f1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.713+0000 7ff9f7fff640 1 -- 10.20.193.49:0/2636840979 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ff9f80d1b60 msgr2=0x7ff9f815dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.713+0000 7ff9f7fff640 1 --2- 10.20.193.49:0/2636840979 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ff9f80d1b60 0x7ff9f815dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.713+0000 7ff9f7fff640 10 monclient: _finish_hunting 0 2026-02-17T11:10:38.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.713+0000 7ff9f7fff640 1 monclient: found mon.noname-b 2026-02-17T11:10:38.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.713+0000 7ff9f7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:38.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.713+0000 7ff9f7fff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:10:38.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.713+0000 7ff9f7fff640 1 -- 10.20.193.49:0/2636840979 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9f81f59d0 con 0x7ff9f80c92a0 2026-02-17T11:10:38.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.713+0000 7f0beeffd640 1 -- 10.20.193.49:0/877735764 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bf0005bb0 con 0x7f0c08152ae0 2026-02-17T11:10:38.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.713+0000 7f0beeffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:38.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.713+0000 7f0beeffd640 1 -- 10.20.193.49:0/877735764 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf0021060 con 0x7f0c08152ae0 2026-02-17T11:10:38.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.713+0000 7f0beeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:38.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.713+0000 7f0beeffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:38.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.713+0000 7f0c04d72640 4 set_mon_vals no callback set 2026-02-17T11:10:38.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.713+0000 7f0beeffd640 10 monclient: dump: 2026-02-17T11:10:38.737 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:38.737 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.737 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.737 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.738 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:38.738 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.738 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:38.738 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:38.738 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:38.738 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.738 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.714+0000 7ff9f7fff640 1 --2- 10.20.193.49:0/2636840979 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7ff9f80c92a0 0x7ff9f81f4220 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4002410 tx=0x7ff9e40047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:38.738 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.714+0000 7ff9f4ff9640 10 client.?.objecter ms_handle_connect 0x7ff9f80c92a0 2026-02-17T11:10:38.738 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.714+0000 7ff9f4ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:38.740 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.715+0000 7eff7e7fc640 1 -- 10.20.193.49:0/1663899187 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff7403c070 con 0x7eff800c74c0 2026-02-17T11:10:38.740 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.715+0000 7eff7e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:38.740 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.715+0000 7eff7e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:10:38.740 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.715+0000 7eff7e7fc640 10 monclient: dump: 2026-02-17T11:10:38.740 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:38.740 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.740 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.740 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.740 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:38.740 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.740 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:38.740 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:38.740 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:38.740 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.740 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.715+0000 7eff7e7fc640 10 monclient: _finish_auth 0 2026-02-17T11:10:38.740 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.715+0000 7eff7e7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:10:38.740 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.715+0000 7eff7e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:38.740 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.715+0000 7eff7e7fc640 1 -- 10.20.193.49:0/1663899187 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff7402fe30 con 0x7eff800c74c0 2026-02-17T11:10:38.740 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.715+0000 7eff7e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:38.740 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.715+0000 7eff7e7fc640 1 -- 10.20.193.49:0/1663899187 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff74037640 con 0x7eff800c74c0 2026-02-17T11:10:38.740 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.715+0000 7eff85ab0640 5 monclient: authenticate success, global_id 4601 2026-02-17T11:10:38.740 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.715+0000 7eff85ab0640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:38.740 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.715+0000 7eff85ab0640 4 set_mon_vals no callback set 2026-02-17T11:10:38.740 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.715+0000 7eff7e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:38.740 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.715+0000 7eff7e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:10:38.740 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.715+0000 7eff7e7fc640 10 monclient: dump: 2026-02-17T11:10:38.740 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:38.740 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.740 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.740 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.741 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:38.741 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.741 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:38.741 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:38.741 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:38.741 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.741 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.716+0000 7eff85ab0640 10 monclient: shutdown 2026-02-17T11:10:38.741 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.716+0000 7eff85ab0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:38.741 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.716+0000 7eff85ab0640 1 -- 10.20.193.49:0/1663899187 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7eff800c74c0 msgr2=0x7eff800c52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.741 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.716+0000 7eff85ab0640 1 --2- 10.20.193.49:0/1663899187 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7eff800c74c0 0x7eff800c52b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7eff8015dcf0 tx=0x7eff7402f1c0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.741 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.716+0000 7eff85ab0640 1 -- 10.20.193.49:0/1663899187 shutdown_connections 2026-02-17T11:10:38.741 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.716+0000 7eff85ab0640 1 --2- 10.20.193.49:0/1663899187 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7eff800c74c0 0x7eff800c52b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.741 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.716+0000 7eff85ab0640 1 --2- 10.20.193.49:0/1663899187 >> v2:10.20.193.97:3300/0 conn(0x7eff8015d370 0x7eff8015d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.741 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.716+0000 7eff85ab0640 1 -- 10.20.193.49:0/1663899187 >> 10.20.193.49:0/1663899187 conn(0x7eff800c9f20 msgr2=0x7eff800ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:38.741 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.716+0000 7eff85ab0640 1 -- 10.20.193.49:0/1663899187 shutdown_connections 2026-02-17T11:10:38.741 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.716+0000 7eff85ab0640 1 -- 10.20.193.49:0/1663899187 wait complete. 2026-02-17T11:10:38.741 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.716+0000 7eff85ab0640 10 monclient: build_initial_monmap 2026-02-17T11:10:38.741 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.716+0000 7eff85ab0640 10 monclient: monmap: 2026-02-17T11:10:38.741 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:38.741 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:38.741 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:38.741 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:38.741 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:38.741 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.741 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:38.741 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:38.741 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:38.741 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.741 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.717+0000 7eff85ab0640 1 librados: starting msgr at 2026-02-17T11:10:38.741 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.717+0000 7eff85ab0640 1 librados: starting objecter 2026-02-17T11:10:38.741 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.717+0000 7eff85ab0640 1 Processor -- start 2026-02-17T11:10:38.741 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.717+0000 7eff85ab0640 1 -- start start 2026-02-17T11:10:38.741 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.717+0000 7eff85ab0640 1 librados: setting wanted keys 2026-02-17T11:10:38.741 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.717+0000 7eff85ab0640 1 librados: calling monclient init 2026-02-17T11:10:38.741 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.717+0000 7eff85ab0640 10 monclient: init 2026-02-17T11:10:38.741 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.717+0000 7eff85ab0640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:38.741 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.717+0000 7eff85ab0640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:10:38.741 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.717+0000 7eff85ab0640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7eff800c74c0 0x7eff80074670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.741 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.717+0000 7eff85ab0640 10 monclient(hunting): picked mon.noname-a con 0x7eff800c74c0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:38.741 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.717+0000 7eff85ab0640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7eff800c7e20 0x7eff801f2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.742 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.717+0000 7eff85ab0640 10 monclient(hunting): picked mon.noname-c con 0x7eff800c7e20 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:38.742 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.717+0000 7eff85ab0640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7eff8015d370 0x7eff8014b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.742 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.717+0000 7eff85ab0640 10 monclient(hunting): picked mon.noname-b con 0x7eff8015d370 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:38.742 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.717+0000 7eff85ab0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.742 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.717+0000 7eff85ab0640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7eff800c8ed0 con 0x7eff800c74c0 2026-02-17T11:10:38.742 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.717+0000 7eff85ab0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.742 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.717+0000 7eff85ab0640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7eff800c8bf0 con 0x7eff8015d370 2026-02-17T11:10:38.742 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.717+0000 7eff85ab0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.742 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.717+0000 7eff85ab0640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7eff800c96d0 con 0x7eff800c7e20 2026-02-17T11:10:38.742 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.717+0000 7eff85ab0640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:38.742 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.717+0000 7eff85ab0640 10 monclient(hunting): authenticate will time out at 1115.380762s 2026-02-17T11:10:38.742 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.718+0000 7eff7effd640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7eff800c7e20 0x7eff801f2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:38.742 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.718+0000 7eff7effd640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7eff800c7e20 0x7eff801f2930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:48504/0 (socket says 10.20.193.49:48504) 2026-02-17T11:10:38.742 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.718+0000 7eff7effd640 1 -- 10.20.193.49:0/56635324 learned_addr learned my addr 10.20.193.49:0/56635324 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:38.742 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.718+0000 7eff7effd640 10 monclient(hunting): get_auth_request con 0x7eff800c7e20 auth_method 0 2026-02-17T11:10:38.742 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.718+0000 7eff7effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:38.742 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.718+0000 7eff7effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:38.742 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.718+0000 7eff7effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:38.742 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.718+0000 7eff7effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:38.742 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.718+0000 7eff7effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:38.742 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.718+0000 7eff7effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:38.742 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.719+0000 7eff7effd640 10 monclient(hunting): handle_auth_done global_id 4610 payload 824 2026-02-17T11:10:38.742 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.719+0000 7eff7effd640 1 -- 10.20.193.49:0/56635324 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7eff8015d370 msgr2=0x7eff8014b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.742 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.719+0000 7eff7effd640 1 --2- 10.20.193.49:0/56635324 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7eff8015d370 0x7eff8014b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.742 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.719+0000 7eff7effd640 1 -- 10.20.193.49:0/56635324 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7eff800c74c0 msgr2=0x7eff80074670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.742 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.719+0000 7eff7effd640 1 --2- 10.20.193.49:0/56635324 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7eff800c74c0 0x7eff80074670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.742 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.719+0000 7eff7effd640 10 monclient: _finish_hunting 0 2026-02-17T11:10:38.742 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.719+0000 7eff7effd640 1 monclient: found mon.noname-c 2026-02-17T11:10:38.742 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.719+0000 7eff7effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:38.742 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.719+0000 7eff7effd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:10:38.742 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.719+0000 7eff7effd640 1 -- 10.20.193.49:0/56635324 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff800732f0 con 0x7eff800c7e20 2026-02-17T11:10:38.742 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.720+0000 7eff7effd640 1 --2- 10.20.193.49:0/56635324 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7eff800c7e20 0x7eff801f2930 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7eff7000b570 tx=0x7eff7000ba40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:38.742 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.720+0000 7eff5bfff640 10 client.?.objecter ms_handle_connect 0x7eff800c7e20 2026-02-17T11:10:38.742 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.720+0000 7eff5bfff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:38.742 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.722+0000 7eff5bfff640 1 -- 10.20.193.49:0/56635324 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff70013020 con 0x7eff800c7e20 2026-02-17T11:10:38.742 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.722+0000 7eff5bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:38.742 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.722+0000 7eff5bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:10:38.742 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.722+0000 7eff5bfff640 10 monclient: dump: 2026-02-17T11:10:38.742 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:38.743 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.743 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.743 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.743 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:38.743 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.743 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:38.743 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:38.743 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:38.743 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.743 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.722+0000 7eff5bfff640 10 monclient: _finish_auth 0 2026-02-17T11:10:38.743 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.722+0000 7eff5bfff640 10 monclient: _check_auth_tickets 2026-02-17T11:10:38.743 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.722+0000 7eff5bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:38.743 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.722+0000 7eff5bfff640 1 -- 10.20.193.49:0/56635324 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff700044a0 con 0x7eff800c7e20 2026-02-17T11:10:38.743 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.722+0000 7eff5bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:38.743 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.722+0000 7eff5bfff640 1 -- 10.20.193.49:0/56635324 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff700029c0 con 0x7eff800c7e20 2026-02-17T11:10:38.743 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.722+0000 7eff5bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:38.743 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.722+0000 7eff5bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:10:38.743 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.722+0000 7eff7dffb640 4 set_mon_vals no callback set 2026-02-17T11:10:38.743 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.722+0000 7eff5bfff640 10 monclient: dump: 2026-02-17T11:10:38.743 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:38.743 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.743 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.743 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.743 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:38.743 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.743 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:38.743 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:38.743 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:38.743 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.743 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.722+0000 7eff85ab0640 5 monclient: authenticate success, global_id 4610 2026-02-17T11:10:38.743 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.722+0000 7eff85ab0640 10 monclient: _renew_subs 2026-02-17T11:10:38.743 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.722+0000 7eff85ab0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:38.743 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.722+0000 7eff85ab0640 1 -- 10.20.193.49:0/56635324 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff800735d0 con 0x7eff800c7e20 2026-02-17T11:10:38.743 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.722+0000 7eff85ab0640 10 client.4610.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:38.743 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.722+0000 7eff85ab0640 10 monclient: _renew_subs 2026-02-17T11:10:38.743 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.722+0000 7eff85ab0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:38.743 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.722+0000 7eff85ab0640 1 -- 10.20.193.49:0/56635324 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff80073b90 con 0x7eff800c7e20 2026-02-17T11:10:38.743 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.722+0000 7eff85ab0640 1 librados: init done 2026-02-17T11:10:38.743 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.723+0000 7eff85ab0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:38.743 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.723+0000 7eff85ab0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:38.743 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.723+0000 7eff85ab0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:38.743 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.723+0000 7eff85ab0640 1 -- 10.20.193.49:0/56635324 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff8015d750 con 0x7eff800c7e20 2026-02-17T11:10:38.745 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.744+0000 7f4675cb7640 10 monclient: get_monmap_and_config 2026-02-17T11:10:38.745 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.744+0000 7f4675cb7640 10 monclient: build_initial_monmap 2026-02-17T11:10:38.745 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.744+0000 7f4675cb7640 10 monclient: monmap: 2026-02-17T11:10:38.745 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:38.745 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.745 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:38.744998+0000 2026-02-17T11:10:38.745 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:38.744998+0000 2026-02-17T11:10:38.745 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:38.745 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.745 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:38.745 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:38.745 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:38.746 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:38.746 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:38.746 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:38.746 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.746 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.744+0000 7f4675cb7640 1 Processor -- start 2026-02-17T11:10:38.746 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.744+0000 7f4675cb7640 1 -- start start 2026-02-17T11:10:38.746 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.744+0000 7f4675cb7640 10 monclient: init 2026-02-17T11:10:38.746 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.745+0000 7f4675cb7640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:38.746 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.745+0000 7f4675cb7640 10 monclient: _add_conns ranks=[1,0,2,5,3,4] 2026-02-17T11:10:38.746 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.745+0000 7f4675cb7640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f46701560e0 addr v1:10.20.193.97:6789/0 2026-02-17T11:10:38.746 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.745+0000 7f4675cb7640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f467015fe10 addr v1:10.20.193.49:6789/0 2026-02-17T11:10:38.746 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.745+0000 7f4675cb7640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f46700ce350 addr v1:10.20.193.157:6789/0 2026-02-17T11:10:38.746 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.745+0000 7f4675cb7640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46700d2130 con 0x7f467015fe10 2026-02-17T11:10:38.746 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.745+0000 7f4675cb7640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46700d2410 con 0x7f46701560e0 2026-02-17T11:10:38.746 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.745+0000 7f4675cb7640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46700d26f0 con 0x7f46700ce350 2026-02-17T11:10:38.746 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.745+0000 7f4675cb7640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:38.746 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.745+0000 7f4675cb7640 10 monclient(hunting): authenticate will time out at 1115.408503s 2026-02-17T11:10:38.773 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.772+0000 7eff5bfff640 1 -- 10.20.193.49:0/56635324 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7eff70002b60 con 0x7eff800c7e20 2026-02-17T11:10:38.773 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.772+0000 7eff5bfff640 1 --2- 10.20.193.49:0/56635324 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7eff50079140 0x7eff5007b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.773 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.772+0000 7eff7f7fe640 1 --2- 10.20.193.49:0/56635324 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7eff50079140 0x7eff5007b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:38.773 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.772+0000 7eff7f7fe640 10 monclient: get_auth_request con 0x7eff50079140 auth_method 0 2026-02-17T11:10:38.774 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.773+0000 7eff5bfff640 10 client.4610.objecter ms_handle_connect 0x7eff50079140 2026-02-17T11:10:38.774 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.773+0000 7eff7f7fe640 1 --2- 10.20.193.49:0/56635324 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7eff50079140 0x7eff5007b600 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7eff801f5b30 tx=0x7eff6c0096b0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:38.781 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.779+0000 7f1262ea0640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-17T11:10:38.781 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.779+0000 7f1262ea0640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-17T11:10:38.781 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.779+0000 7f1262ea0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:38.781 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.779+0000 7f1262ea0640 1 -- 10.20.193.49:0/3558579449 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f125c1502a0 con 0x7f125c0c92a0 2026-02-17T11:10:38.783 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.782+0000 7f9f2ee64640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-17T11:10:38.783 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.782+0000 7f9f2ee64640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-17T11:10:38.783 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.782+0000 7f9f2ee64640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:38.783 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.782+0000 7f9f2ee64640 1 -- 10.20.193.49:0/2506347443 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f9f28072da0 con 0x7f9f2815d730 2026-02-17T11:10:38.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.784+0000 7f9c2263b640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-17T11:10:38.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.784+0000 7f9c2263b640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-17T11:10:38.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.784+0000 7f9c2263b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:38.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.784+0000 7f9c2263b640 1 -- 10.20.193.49:0/1853108823 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f9c1c0c4940 con 0x7f9c1c0c7550 2026-02-17T11:10:38.822 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.821+0000 7f8ad4ff9640 1 -- 10.20.193.49:0/3921632394 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f8ac4024080 con 0x7f8ad80c8cf0 2026-02-17T11:10:38.823 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.821+0000 7f8ad4ff9640 1 --2- 10.20.193.49:0/3921632394 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f8aa8079140 0x7f8aa807b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.823 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.822+0000 7f8ad77fe640 1 --2- 10.20.193.49:0/3921632394 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f8aa8079140 0x7f8aa807b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:38.823 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.822+0000 7f8ad77fe640 10 monclient: get_auth_request con 0x7f8aa8079140 auth_method 0 2026-02-17T11:10:38.824 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.822+0000 7f8ad4ff9640 10 client.4584.objecter ms_handle_connect 0x7f8aa8079140 2026-02-17T11:10:38.824 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.822+0000 7f8ad77fe640 1 --2- 10.20.193.49:0/3921632394 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f8aa8079140 0x7f8aa807b600 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8ad8148c40 tx=0x7f8ac8009110 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:38.824 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.823+0000 7f0beeffd640 1 -- 10.20.193.49:0/877735764 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f0bf0024080 con 0x7f0c08152ae0 2026-02-17T11:10:38.825 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.824+0000 7f0beeffd640 1 --2- 10.20.193.49:0/877735764 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0bd4079140 0x7f0bd407b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.825 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.824+0000 7f0c06575640 1 --2- 10.20.193.49:0/877735764 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0bd4079140 0x7f0bd407b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:38.825 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.824+0000 7f0c06575640 10 monclient: get_auth_request con 0x7f0bd4079140 auth_method 0 2026-02-17T11:10:38.826 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.824+0000 7f0beeffd640 10 client.4573.objecter ms_handle_connect 0x7f0bd4079140 2026-02-17T11:10:38.826 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.824+0000 7f0c06575640 1 --2- 10.20.193.49:0/877735764 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0bd4079140 0x7f0bd407b600 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc003fd0 tx=0x7f0bfc002a40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:38.826 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.825+0000 7f0beeffd640 1 -- 10.20.193.49:0/877735764 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7f0bf005d7a0 con 0x7f0c08152ae0 2026-02-17T11:10:38.826 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.825+0000 7f0beeffd640 10 client.4573.objecter ms_dispatch2 0x7f0c08000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:38.826 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.825+0000 7f0beeffd640 3 client.4573.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:38.826 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.825+0000 7f0beeffd640 3 client.4573.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:38.826 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.825+0000 7f0beeffd640 20 client.4573.objecter dump_active .. 0 homeless 2026-02-17T11:10:38.831 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.830+0000 7f8ad4ff9640 1 -- 10.20.193.49:0/3921632394 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7f8ac405d7b0 con 0x7f8ad80c8cf0 2026-02-17T11:10:38.832 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.830+0000 7f8ad4ff9640 10 client.4584.objecter ms_dispatch2 0x7f8ad8000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:38.832 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.830+0000 7f8ad4ff9640 3 client.4584.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:38.832 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.830+0000 7f8ad4ff9640 3 client.4584.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:38.832 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.830+0000 7f8ad4ff9640 20 client.4584.objecter dump_active .. 0 homeless 2026-02-17T11:10:38.832 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.830+0000 7f8ad4ff9640 1 -- 10.20.193.49:0/3921632394 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f8ac4061770 con 0x7f8ad80c8cf0 2026-02-17T11:10:38.832 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.830+0000 7f8ad4ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:38.832 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.830+0000 7f8ad4ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:38.833 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.831+0000 7eff5bfff640 1 -- 10.20.193.49:0/56635324 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7eff7005e300 con 0x7eff800c7e20 2026-02-17T11:10:38.833 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.831+0000 7eff5bfff640 10 client.4610.objecter ms_dispatch2 0x7eff80000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:38.833 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.831+0000 7eff5bfff640 3 client.4610.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:38.833 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.831+0000 7eff5bfff640 3 client.4610.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:38.833 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.831+0000 7eff5bfff640 20 client.4610.objecter dump_active .. 0 homeless 2026-02-17T11:10:38.837 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.831+0000 7ff9f4ff9640 1 -- 10.20.193.49:0/2636840979 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e4044070 con 0x7ff9f80c92a0 2026-02-17T11:10:38.837 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.831+0000 7ff9f4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:38.838 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.831+0000 7ff9f4ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:10:38.838 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.831+0000 7ff9f4ff9640 10 monclient: dump: 2026-02-17T11:10:38.838 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:38.838 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.838 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.838 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.838 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:38.838 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.838 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:38.838 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:38.838 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:38.838 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.838 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.831+0000 7ff9f4ff9640 10 monclient: _finish_auth 0 2026-02-17T11:10:38.838 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.831+0000 7ff9f4ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:10:38.838 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.831+0000 7ff9f4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:38.838 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.831+0000 7ff9f4ff9640 1 -- 10.20.193.49:0/2636840979 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9e4040630 con 0x7ff9f80c92a0 2026-02-17T11:10:38.838 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.831+0000 7ff9f4ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:38.838 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.831+0000 7ff9f4ff9640 1 -- 10.20.193.49:0/2636840979 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e403c040 con 0x7ff9f80c92a0 2026-02-17T11:10:38.838 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.831+0000 7ff9f4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:38.838 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.831+0000 7ff9f4ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:38.838 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.831+0000 7ff9f4ff9640 10 monclient: dump: 2026-02-17T11:10:38.838 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:38.838 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.838 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.838 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.838 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:38.838 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.838 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:38.839 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:38.839 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:38.839 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.831+0000 7ff9fe585640 5 monclient: authenticate success, global_id 4579 2026-02-17T11:10:38.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.831+0000 7ff9f67fc640 4 set_mon_vals no callback set 2026-02-17T11:10:38.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.831+0000 7ff9fe585640 10 monclient: _renew_subs 2026-02-17T11:10:38.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.831+0000 7ff9fe585640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:38.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.831+0000 7ff9fe585640 1 -- 10.20.193.49:0/2636840979 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9f81f5cb0 con 0x7ff9f80c92a0 2026-02-17T11:10:38.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.831+0000 7ff9fe585640 10 client.4579.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:38.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.831+0000 7ff9fe585640 10 monclient: _renew_subs 2026-02-17T11:10:38.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.831+0000 7ff9fe585640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:38.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.831+0000 7ff9fe585640 1 -- 10.20.193.49:0/2636840979 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9f81f6270 con 0x7ff9f80c92a0 2026-02-17T11:10:38.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.831+0000 7ff9fe585640 1 librados: init done 2026-02-17T11:10:38.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.831+0000 7f0beeffd640 1 -- 10.20.193.49:0/877735764 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f0bf0061760 con 0x7f0c08152ae0 2026-02-17T11:10:38.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.831+0000 7f0beeffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:38.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.831+0000 7f0beeffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:38.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.832+0000 7ff9fe585640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:38.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.832+0000 7ff9fe585640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:38.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.832+0000 7ff9fe585640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:38.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.832+0000 7ff9fe585640 1 -- 10.20.193.49:0/2636840979 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9f815ea40 con 0x7ff9f80c92a0 2026-02-17T11:10:38.840 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:10:38.841 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.832+0000 7f7294968640 1 -- 10.20.193.49:0/1269364918 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f728c02fcd0 con 0x7f72900ca040 2026-02-17T11:10:38.841 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.832+0000 7f7294968640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:38.841 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.832+0000 7f7294968640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:10:38.841 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.832+0000 7f7294968640 10 monclient: dump: 2026-02-17T11:10:38.841 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:38.841 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.841 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.841 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.841 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:38.841 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.841 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:38.841 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:38.841 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:38.841 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.841 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.832+0000 7f7294968640 10 monclient: _finish_auth 0 2026-02-17T11:10:38.841 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.832+0000 7f7294968640 10 monclient: _check_auth_tickets 2026-02-17T11:10:38.841 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.832+0000 7f7294968640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:38.841 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.832+0000 7f7294968640 1 -- 10.20.193.49:0/1269364918 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f728c0373f0 con 0x7f72900ca040 2026-02-17T11:10:38.841 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.832+0000 7f7297bf5640 5 monclient: authenticate success, global_id 4587 2026-02-17T11:10:38.841 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.832+0000 7f7297bf5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:10:38.841 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.832+0000 7f7294968640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:38.841 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.832+0000 7f7297bf5640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:38.841 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.832+0000 7f7297bf5640 4 set_mon_vals no callback set 2026-02-17T11:10:38.841 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.832+0000 7f7294968640 1 -- 10.20.193.49:0/1269364918 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f728c0377c0 con 0x7f72900ca040 2026-02-17T11:10:38.841 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.832+0000 7f7294968640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:38.841 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.832+0000 7f7294968640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:10:38.841 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.832+0000 7f7294968640 10 monclient: dump: 2026-02-17T11:10:38.841 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:38.841 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.841 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.841 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.842 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:38.842 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.842 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:38.842 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:38.842 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:38.842 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.842 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.833+0000 7f7297bf5640 10 monclient: shutdown 2026-02-17T11:10:38.842 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.833+0000 7f7297bf5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:38.842 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.833+0000 7f7297bf5640 1 -- 10.20.193.49:0/1269364918 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f72900ca040 msgr2=0x7f72900ce350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.842 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.833+0000 7f7297bf5640 1 --2- 10.20.193.49:0/1269364918 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f72900ca040 0x7f72900ce350 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f72900cf430 tx=0x7f728c02f270 comp rx=0 tx=0).stop 2026-02-17T11:10:38.842 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.833+0000 7f7297bf5640 1 -- 10.20.193.49:0/1269364918 shutdown_connections 2026-02-17T11:10:38.842 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.833+0000 7f7297bf5640 1 --2- 10.20.193.49:0/1269364918 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f72900ca040 0x7f72900ce350 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.842 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.833+0000 7f7297bf5640 1 --2- 10.20.193.49:0/1269364918 >> v2:10.20.193.157:3300/0 conn(0x7f729015fe10 0x7f72900c9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.842 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.833+0000 7f7297bf5640 1 -- 10.20.193.49:0/1269364918 >> 10.20.193.49:0/1269364918 conn(0x7f7290073030 msgr2=0x7f7290073440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:38.842 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.833+0000 7f7297bf5640 1 -- 10.20.193.49:0/1269364918 shutdown_connections 2026-02-17T11:10:38.842 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.833+0000 7f7297bf5640 1 -- 10.20.193.49:0/1269364918 wait complete. 2026-02-17T11:10:38.842 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.834+0000 7f9c18ff9640 1 -- 10.20.193.49:0/1853108823 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9c1008c8d0 con 0x7f9c1c0c7550 2026-02-17T11:10:38.842 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.834+0000 7f9c18ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-17T11:10:38.842 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.834+0000 7f9c18ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:38.842 INFO:teuthology.orchestra.run.trial049.stdout:94489280517 2026-02-17T11:10:38.842 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.834+0000 7f7297bf5640 10 monclient: build_initial_monmap 2026-02-17T11:10:38.842 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.834+0000 7f7297bf5640 10 monclient: monmap: 2026-02-17T11:10:38.843 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:38.843 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:38.843 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:38.843 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:38.843 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:38.843 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.843 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:38.843 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:38.843 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:38.843 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.834+0000 7f7297bf5640 1 librados: starting msgr at 2026-02-17T11:10:38.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.834+0000 7f7297bf5640 1 librados: starting objecter 2026-02-17T11:10:38.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.834+0000 7f466f7fe640 1 --1- >> v1:10.20.193.97:6789/0 conn(0x7f46701560e0 0x7f46700d1890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.97:6789/0 says I am v1:10.20.193.49:34938/0 (socket says 10.20.193.49:34938) 2026-02-17T11:10:38.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.834+0000 7f466f7fe640 1 -- 10.20.193.49:0/987778572 learned_addr learned my addr 10.20.193.49:0/987778572 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:10:38.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.834+0000 7f7297bf5640 1 Processor -- start 2026-02-17T11:10:38.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.834+0000 7f7297bf5640 1 -- start start 2026-02-17T11:10:38.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.834+0000 7f7297bf5640 1 librados: setting wanted keys 2026-02-17T11:10:38.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.834+0000 7f7297bf5640 1 librados: calling monclient init 2026-02-17T11:10:38.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.834+0000 7f7297bf5640 10 monclient: init 2026-02-17T11:10:38.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.834+0000 7f7297bf5640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:38.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.834+0000 7f7297bf5640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:10:38.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.834+0000 7f7297bf5640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f72900ca040 0x7f72901f6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.834+0000 7f7297bf5640 10 monclient(hunting): picked mon.noname-a con 0x7f72900ca040 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:38.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.834+0000 7f7297bf5640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f72901560e0 0x7f72901f3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.834+0000 7f7297bf5640 10 monclient(hunting): picked mon.noname-c con 0x7f72901560e0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:38.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.834+0000 7f7297bf5640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f729015fe10 0x7f729014a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.834+0000 7f7297bf5640 10 monclient(hunting): picked mon.noname-b con 0x7f729015fe10 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:38.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.834+0000 7f7297bf5640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.834+0000 7f7297bf5640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f72900c9300 con 0x7f72900ca040 2026-02-17T11:10:38.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.834+0000 7f7297bf5640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.834+0000 7f7297bf5640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f72900c9020 con 0x7f729015fe10 2026-02-17T11:10:38.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.834+0000 7f7297bf5640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.834+0000 7f7297bf5640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f7290160270 con 0x7f72901560e0 2026-02-17T11:10:38.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.834+0000 7f7297bf5640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:38.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.834+0000 7f7297bf5640 10 monclient(hunting): authenticate will time out at 1115.497966s 2026-02-17T11:10:38.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.836+0000 7f9c2263b640 10 librados: watch_flush enter 2026-02-17T11:10:38.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.836+0000 7f9c2263b640 10 librados: watch_flush exit 2026-02-17T11:10:38.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.836+0000 7f9c2263b640 20 client.4558.objecter shutdown clearing up homeless session... 2026-02-17T11:10:38.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.836+0000 7f9c2263b640 10 client.4558.objecter successfully canceled tick 2026-02-17T11:10:38.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.836+0000 7f9c2263b640 1 -- 10.20.193.49:0/1853108823 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f9bec079140 msgr2=0x7f9bec07b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.836+0000 7f9c2263b640 1 --2- 10.20.193.49:0/1853108823 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f9bec079140 0x7f9bec07b600 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c0c51a0 tx=0x7f9c08007f50 comp rx=0 tx=0).stop 2026-02-17T11:10:38.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.836+0000 7f9c2263b640 10 monclient: shutdown 2026-02-17T11:10:38.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.836+0000 7f9c2263b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:38.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.836+0000 7f9c2263b640 1 -- 10.20.193.49:0/1853108823 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f9c1c0c7550 msgr2=0x7f9c1c0c0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.836+0000 7f9c2263b640 1 --2- 10.20.193.49:0/1853108823 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f9c1c0c7550 0x7f9c1c0c0fb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c0c86b0 tx=0x7f9c10004b40 comp rx=0 tx=0).stop 2026-02-17T11:10:38.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.836+0000 7f9c2263b640 1 -- 10.20.193.49:0/1853108823 shutdown_connections 2026-02-17T11:10:38.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.836+0000 7f9c2263b640 1 --2- 10.20.193.49:0/1853108823 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f9bec079140 0x7f9bec07b600 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.836+0000 7f9c2263b640 1 --2- 10.20.193.49:0/1853108823 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f9c1c0c7550 0x7f9c1c0c0fb0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.836+0000 7f9c2263b640 1 --2- 10.20.193.49:0/1853108823 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f9c1c0c7170 0x7f9c1c15d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.836+0000 7f9c2263b640 1 --2- 10.20.193.49:0/1853108823 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f9c1c074ef0 0x7f9c1c14eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.836+0000 7f9c2263b640 1 -- 10.20.193.49:0/1853108823 >> 10.20.193.49:0/1853108823 conn(0x7f9c1c0c9f40 msgr2=0x7f9c1c0cbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:38.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.836+0000 7f9c2263b640 1 -- 10.20.193.49:0/1853108823 shutdown_connections 2026-02-17T11:10:38.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.836+0000 7f9c2263b640 1 -- 10.20.193.49:0/1853108823 wait complete. 2026-02-17T11:10:38.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.836+0000 7f9c2263b640 1 librados: shutdown 2026-02-17T11:10:38.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.836+0000 7f729596a640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f72900ca040 0x7f72901f6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:38.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.836+0000 7f9f1d7fa640 1 -- 10.20.193.49:0/2506347443 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9f240886f0 con 0x7f9f2815d730 2026-02-17T11:10:38.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.836+0000 7f9f1d7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-17T11:10:38.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.836+0000 7f9f1d7fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:38.845 INFO:teuthology.orchestra.run.trial049.stdout:94489280518 2026-02-17T11:10:38.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.837+0000 7f729596a640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f72900ca040 0x7f72901f6080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:33730/0 (socket says 10.20.193.49:33730) 2026-02-17T11:10:38.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.837+0000 7f729596a640 1 -- 10.20.193.49:0/1513569313 learned_addr learned my addr 10.20.193.49:0/1513569313 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:38.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.837+0000 7f729596a640 10 monclient(hunting): get_auth_request con 0x7f72900ca040 auth_method 0 2026-02-17T11:10:38.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.837+0000 7f729596a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:38.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.837+0000 7f729596a640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:38.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.837+0000 7f729596a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:38.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.837+0000 7eff5bfff640 1 -- 10.20.193.49:0/56635324 <== mon.2 v2:10.20.193.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7eff7001d020 con 0x7eff800c7e20 2026-02-17T11:10:38.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.837+0000 7eff5bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:38.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.837+0000 7eff5bfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:38.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.838+0000 7f729596a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:38.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.838+0000 7f729596a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:38.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.838+0000 7f729596a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:38.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.839+0000 7f9f2ee64640 10 librados: watch_flush enter 2026-02-17T11:10:38.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.839+0000 7f9f2ee64640 10 librados: watch_flush exit 2026-02-17T11:10:38.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.839+0000 7f9f2ee64640 20 client.4578.objecter shutdown clearing up homeless session... 2026-02-17T11:10:38.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.839+0000 7f9f2ee64640 10 client.4578.objecter successfully canceled tick 2026-02-17T11:10:38.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.839+0000 7f9f2ee64640 1 -- 10.20.193.49:0/2506347443 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f9ef8079170 msgr2=0x7f9ef807b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.839+0000 7f9f2ee64640 1 --2- 10.20.193.49:0/2506347443 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f9ef8079170 0x7f9ef807b630 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9f1800a8b0 tx=0x7f9f18008040 comp rx=0 tx=0).stop 2026-02-17T11:10:38.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.839+0000 7f9f2ee64640 10 monclient: shutdown 2026-02-17T11:10:38.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.839+0000 7f9f2ee64640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:38.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.839+0000 7f9f2ee64640 1 -- 10.20.193.49:0/2506347443 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f9f2815d730 msgr2=0x7f9f280cc710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.839+0000 7f9f2ee64640 1 --2- 10.20.193.49:0/2506347443 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f9f2815d730 0x7f9f280cc710 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9f2403a040 tx=0x7f9f24004b40 comp rx=0 tx=0).stop 2026-02-17T11:10:38.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.839+0000 7f9f2ee64640 1 -- 10.20.193.49:0/2506347443 shutdown_connections 2026-02-17T11:10:38.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.839+0000 7f9f2ee64640 1 --2- 10.20.193.49:0/2506347443 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f9ef8079170 0x7f9ef807b630 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.839+0000 7f9f2ee64640 1 --2- 10.20.193.49:0/2506347443 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f9f2815d730 0x7f9f280cc710 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.839+0000 7f9f2ee64640 1 --2- 10.20.193.49:0/2506347443 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f9f2815d310 0x7f9f281f3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.839+0000 7f9f2ee64640 1 --2- 10.20.193.49:0/2506347443 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f9f28155f90 0x7f9f281f7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.839+0000 7f9f2ee64640 1 -- 10.20.193.49:0/2506347443 >> 10.20.193.49:0/2506347443 conn(0x7f9f280cc0c0 msgr2=0x7f9f2815e390 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:38.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.839+0000 7f9f2ee64640 1 -- 10.20.193.49:0/2506347443 shutdown_connections 2026-02-17T11:10:38.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.839+0000 7f9f2ee64640 1 -- 10.20.193.49:0/2506347443 wait complete. 2026-02-17T11:10:38.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.839+0000 7f9f2ee64640 1 librados: shutdown 2026-02-17T11:10:38.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.840+0000 7f729596a640 10 monclient(hunting): handle_auth_done global_id 4596 payload 824 2026-02-17T11:10:38.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.840+0000 7f729596a640 1 -- 10.20.193.49:0/1513569313 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f72901560e0 msgr2=0x7f72901f3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.840+0000 7f729596a640 1 --2- 10.20.193.49:0/1513569313 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f72901560e0 0x7f72901f3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.840+0000 7f729596a640 1 -- 10.20.193.49:0/1513569313 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f729015fe10 msgr2=0x7f729014a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.840+0000 7f729596a640 1 --2- 10.20.193.49:0/1513569313 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f729015fe10 0x7f729014a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.848 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.840+0000 7f729596a640 10 monclient: _finish_hunting 0 2026-02-17T11:10:38.848 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.840+0000 7f729596a640 1 monclient: found mon.noname-a 2026-02-17T11:10:38.848 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.840+0000 7f729596a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:38.848 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.840+0000 7f729596a640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:10:38.848 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.840+0000 7f729596a640 1 -- 10.20.193.49:0/1513569313 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72901f76d0 con 0x7f72900ca040 2026-02-17T11:10:38.848 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.842+0000 7f12517fa640 1 -- 10.20.193.49:0/3558579449 <== mon.2 v2:10.20.193.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f124c0875d0 con 0x7f125c0c92a0 2026-02-17T11:10:38.848 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.842+0000 7f12517fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-17T11:10:38.848 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.842+0000 7f12517fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:38.848 INFO:teuthology.orchestra.run.trial049.stdout:111669149704 2026-02-17T11:10:38.848 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.843+0000 7f466e7fc640 1 -- 10.20.193.49:0/987778572 <== mon.0 v1:10.20.193.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2555252284 0 0) 0x7f46700d2130 con 0x7f467015fe10 2026-02-17T11:10:38.848 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.843+0000 7f466e7fc640 10 monclient(hunting): _negotiate 2026-02-17T11:10:38.848 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.843+0000 7f466e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:38.848 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.843+0000 7f466e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:38.848 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.843+0000 7f466e7fc640 10 monclient(hunting): my global_id is 4593 2026-02-17T11:10:38.848 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.843+0000 7f466e7fc640 1 -- 10.20.193.49:0/987778572 --> v1:10.20.193.49:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4654003620 con 0x7f467015fe10 2026-02-17T11:10:38.848 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.844+0000 7f466e7fc640 1 -- 10.20.193.49:0/987778572 <== mon.2 v1:10.20.193.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2885719673 0 0) 0x7f46700d26f0 con 0x7f46700ce350 2026-02-17T11:10:38.848 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.844+0000 7f466e7fc640 10 monclient(hunting): _negotiate 2026-02-17T11:10:38.848 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.844+0000 7f466e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:38.848 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.844+0000 7f466e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:38.848 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.844+0000 7f466e7fc640 10 monclient(hunting): my global_id is 4613 2026-02-17T11:10:38.848 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.844+0000 7f466e7fc640 1 -- 10.20.193.49:0/987778572 --> v1:10.20.193.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46700d2130 con 0x7f46700ce350 2026-02-17T11:10:38.849 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280517 got 94489280517 for osd.5 2026-02-17T11:10:38.849 DEBUG:teuthology.parallel:result is None 2026-02-17T11:10:38.849 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.845+0000 7f1262ea0640 10 librados: watch_flush enter 2026-02-17T11:10:38.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.845+0000 7f1262ea0640 10 librados: watch_flush exit 2026-02-17T11:10:38.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.845+0000 7f1262ea0640 20 client.4583.objecter shutdown clearing up homeless session... 2026-02-17T11:10:38.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.845+0000 7f1262ea0640 10 client.4583.objecter successfully canceled tick 2026-02-17T11:10:38.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.845+0000 7f1262ea0640 1 -- 10.20.193.49:0/3558579449 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f122c079190 msgr2=0x7f122c07b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.845+0000 7f1262ea0640 1 --2- 10.20.193.49:0/3558579449 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f122c079190 0x7f122c07b650 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f125c0cbd50 tx=0x7f12440092c0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.845+0000 7f1262ea0640 10 monclient: shutdown 2026-02-17T11:10:38.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.845+0000 7f1262ea0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:38.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.845+0000 7f1262ea0640 1 -- 10.20.193.49:0/3558579449 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f125c0c92a0 msgr2=0x7f125c1f1380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.845+0000 7f1262ea0640 1 --2- 10.20.193.49:0/3558579449 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f125c0c92a0 0x7f125c1f1380 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f125c08f350 tx=0x7f124c0047c0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.845+0000 7f1262ea0640 1 -- 10.20.193.49:0/3558579449 shutdown_connections 2026-02-17T11:10:38.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.845+0000 7f1262ea0640 1 --2- 10.20.193.49:0/3558579449 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f122c079190 0x7f122c07b650 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.845+0000 7f1262ea0640 1 --2- 10.20.193.49:0/3558579449 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f125c15c840 0x7f125c151170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.845+0000 7f1262ea0640 1 --2- 10.20.193.49:0/3558579449 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f125c0d1b60 0x7f125c1f18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.845+0000 7f1262ea0640 1 --2- 10.20.193.49:0/3558579449 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f125c0c92a0 0x7f125c1f1380 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.845+0000 7f1262ea0640 1 -- 10.20.193.49:0/3558579449 >> 10.20.193.49:0/3558579449 conn(0x7f125c06d9b0 msgr2=0x7f125c0d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:38.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.845+0000 7f1262ea0640 1 -- 10.20.193.49:0/3558579449 shutdown_connections 2026-02-17T11:10:38.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.845+0000 7f1262ea0640 1 -- 10.20.193.49:0/3558579449 wait complete. 2026-02-17T11:10:38.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.845+0000 7f1262ea0640 1 librados: shutdown 2026-02-17T11:10:38.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.845+0000 7f729596a640 1 --2- 10.20.193.49:0/1513569313 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f72900ca040 0x7f72901f6080 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f728000b5a0 tx=0x7f728000ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:38.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.845+0000 7f727e7fc640 10 client.?.objecter ms_handle_connect 0x7f72900ca040 2026-02-17T11:10:38.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.845+0000 7f727e7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:38.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.846+0000 7f466e7fc640 1 -- 10.20.193.49:0/987778572 <== mon.2 v1:10.20.193.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 249309057 0 0) 0x7f46700d2130 con 0x7f46700ce350 2026-02-17T11:10:38.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.846+0000 7f466e7fc640 1 -- 10.20.193.49:0/987778572 >> v1:10.20.193.97:6789/0 conn(0x7f46701560e0 legacy=0x7f46700d1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.846+0000 7f466e7fc640 1 -- 10.20.193.49:0/987778572 >> v1:10.20.193.49:6789/0 conn(0x7f467015fe10 legacy=0x7f46700c9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.846+0000 7f466e7fc640 10 monclient: _finish_hunting 0 2026-02-17T11:10:38.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.846+0000 7f466e7fc640 1 monclient: found mon.noname-c-legacy 2026-02-17T11:10:38.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.846+0000 7f466e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:38.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.846+0000 7f466e7fc640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:10.20.193.157:6789/0 2026-02-17T11:10:38.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.846+0000 7f466e7fc640 1 -- 10.20.193.49:0/987778572 --> v1:10.20.193.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46700c8d40 con 0x7f46700ce350 2026-02-17T11:10:38.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.846+0000 7f466e7fc640 10 monclient: _finish_auth 0 2026-02-17T11:10:38.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.846+0000 7f466e7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:10:38.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.846+0000 7f466e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:38.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.846+0000 7f466e7fc640 1 -- 10.20.193.49:0/987778572 <== mon.2 v1:10.20.193.157:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2462710995 0 0) 0x7f4664003260 con 0x7f46700ce350 2026-02-17T11:10:38.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.846+0000 7f466e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:38.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.846+0000 7f466e7fc640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2026-02-17T11:10:38.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.846+0000 7f466e7fc640 10 monclient: dump: 2026-02-17T11:10:38.851 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:38.851 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.851 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.851 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.851 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:38.851 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.851 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:38.851 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:38.851 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:38.851 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.846+0000 7f466e7fc640 1 monclient: mon.c has (v2) addrs [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] but i'm connected to v1:10.20.193.157:6789/0, reconnecting 2026-02-17T11:10:38.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.846+0000 7f466e7fc640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:38.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.846+0000 7f466e7fc640 1 -- 10.20.193.49:0/987778572 >> v1:10.20.193.157:6789/0 conn(0x7f46700ce350 legacy=0x7f46700ce780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.846+0000 7f466e7fc640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:10:38.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.846+0000 7f466e7fc640 1 --2- 10.20.193.49:0/987778572 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f4654003d80 0x7f4654004180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.846+0000 7f466e7fc640 10 monclient(hunting): picked mon.c con 0x7f4654003d80 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:38.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.846+0000 7f466e7fc640 1 --2- 10.20.193.49:0/987778572 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f4654004900 0x7f4654004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.846+0000 7f466e7fc640 10 monclient(hunting): picked mon.a con 0x7f4654004900 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:38.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.846+0000 7f466e7fc640 1 --2- 10.20.193.49:0/987778572 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f4654009ab0 0x7f465400bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.846+0000 7f466e7fc640 10 monclient(hunting): picked mon.b con 0x7f4654009ab0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:38.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.846+0000 7f466e7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.846+0000 7f466e7fc640 1 -- 10.20.193.49:0/987778572 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f465400c490 con 0x7f4654004900 2026-02-17T11:10:38.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.846+0000 7f466e7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.846+0000 7f466e7fc640 1 -- 10.20.193.49:0/987778572 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f465400c640 con 0x7f4654009ab0 2026-02-17T11:10:38.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.846+0000 7f466e7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.846+0000 7f466e7fc640 1 -- 10.20.193.49:0/987778572 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f465400c840 con 0x7f4654003d80 2026-02-17T11:10:38.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.846+0000 7f466e7fc640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:38.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.846+0000 7f466e7fc640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:10:38.852 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-17T11:10:38.852 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280518 got 94489280518 for osd.1 2026-02-17T11:10:38.852 DEBUG:teuthology.parallel:result is None 2026-02-17T11:10:38.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.848+0000 7f466f7fe640 1 --2- 10.20.193.49:0/987778572 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f4654003d80 0x7f4654004180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:38.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.848+0000 7f466f7fe640 10 monclient(hunting): get_auth_request con 0x7f4654003d80 auth_method 0 2026-02-17T11:10:38.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.848+0000 7f466f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:38.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.848+0000 7f466f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:38.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.848+0000 7f466f7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:10:38.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.848+0000 7f466f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:38.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.848+0000 7f466f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:38.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.848+0000 7f466f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:10:38.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.849+0000 7f466f7fe640 10 monclient(hunting): handle_auth_done global_id 4613 payload 293 2026-02-17T11:10:38.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.849+0000 7f466f7fe640 1 -- 10.20.193.49:0/987778572 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f4654009ab0 msgr2=0x7f465400bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:38.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.849+0000 7f466f7fe640 1 --2- 10.20.193.49:0/987778572 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f4654009ab0 0x7f465400bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.849+0000 7f466f7fe640 1 -- 10.20.193.49:0/987778572 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f4654004900 msgr2=0x7f4654004d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:38.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.849+0000 7f466f7fe640 1 --2- 10.20.193.49:0/987778572 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f4654004900 0x7f4654004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.849+0000 7f466f7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:10:38.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.849+0000 7f466f7fe640 1 monclient: found mon.c 2026-02-17T11:10:38.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.849+0000 7f466ffff640 1 -- 10.20.193.49:0/987778572 reap_dead start 2026-02-17T11:10:38.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.849+0000 7f466f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:38.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.849+0000 7f466f7fe640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:38.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.849+0000 7f466f7fe640 1 -- 10.20.193.49:0/987778572 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46700d2130 con 0x7f4654003d80 2026-02-17T11:10:38.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.849+0000 7f466f7fe640 10 monclient: _finish_auth 0 2026-02-17T11:10:38.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.849+0000 7f466f7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:10:38.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.849+0000 7f466f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:38.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.849+0000 7f4675cb7640 5 monclient: authenticate success, global_id 4613 2026-02-17T11:10:38.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.849+0000 7f4675cb7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:10:38.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.852+0000 7f466f7fe640 1 --2- 10.20.193.49:0/987778572 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f4654003d80 0x7f4654004180 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f465c003180 tx=0x7f465c02ef00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a40e4d66bdc9825 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:38.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.853+0000 7f727e7fc640 1 -- 10.20.193.49:0/1513569313 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7280012070 con 0x7f72900ca040 2026-02-17T11:10:38.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.853+0000 7f727e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:38.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.853+0000 7f727e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:10:38.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.853+0000 7f727e7fc640 10 monclient: dump: 2026-02-17T11:10:38.854 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:38.854 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.855 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.855 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.855 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:38.855 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.855 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:38.855 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:38.855 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:38.855 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.853+0000 7f727e7fc640 10 monclient: _finish_auth 0 2026-02-17T11:10:38.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.853+0000 7f727e7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:10:38.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.853+0000 7f727e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:38.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.853+0000 7f727e7fc640 1 -- 10.20.193.49:0/1513569313 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72800044a0 con 0x7f72900ca040 2026-02-17T11:10:38.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.853+0000 7f727e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:38.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.853+0000 7f727e7fc640 1 -- 10.20.193.49:0/1513569313 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72800029c0 con 0x7f72900ca040 2026-02-17T11:10:38.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.853+0000 7f727e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:38.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.853+0000 7f727e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:10:38.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.853+0000 7f727e7fc640 10 monclient: dump: 2026-02-17T11:10:38.855 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:38.855 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.855 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.855 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.855 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:38.855 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.855 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:38.855 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:38.855 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:38.855 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.853+0000 7f727ffff640 4 set_mon_vals no callback set 2026-02-17T11:10:38.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.853+0000 7f7297bf5640 5 monclient: authenticate success, global_id 4596 2026-02-17T11:10:38.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.853+0000 7f7297bf5640 10 monclient: _renew_subs 2026-02-17T11:10:38.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.853+0000 7f7297bf5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:38.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.853+0000 7f7297bf5640 1 -- 10.20.193.49:0/1513569313 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7290149350 con 0x7f72900ca040 2026-02-17T11:10:38.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.853+0000 7f7297bf5640 10 client.4596.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:38.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.853+0000 7f7297bf5640 10 monclient: _renew_subs 2026-02-17T11:10:38.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.853+0000 7f7297bf5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:38.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.853+0000 7f7297bf5640 1 -- 10.20.193.49:0/1513569313 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7290149910 con 0x7f72900ca040 2026-02-17T11:10:38.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.853+0000 7f7297bf5640 1 librados: init done 2026-02-17T11:10:38.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.853+0000 7f7297bf5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:38.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.853+0000 7f7297bf5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:38.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.853+0000 7f7297bf5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:38.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.853+0000 7f7297bf5640 1 -- 10.20.193.49:0/1513569313 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72900cd440 con 0x7f72900ca040 2026-02-17T11:10:38.856 INFO:tasks.ceph.ceph_manager.ceph:need seq 111669149703 got 111669149704 for osd.3 2026-02-17T11:10:38.856 DEBUG:teuthology.parallel:result is None 2026-02-17T11:10:38.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.855+0000 7f466e7fc640 1 -- 10.20.193.49:0/987778572 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465c002da0 con 0x7f4654003d80 2026-02-17T11:10:38.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.855+0000 7f466e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:38.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.855+0000 7f466e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:10:38.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.855+0000 7f466e7fc640 10 monclient: dump: 2026-02-17T11:10:38.857 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:38.857 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.857 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.857 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.857 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:38.857 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.857 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:38.857 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:38.857 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:38.857 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.855+0000 7f466e7fc640 1 -- 10.20.193.49:0/987778572 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f465c033070 con 0x7f4654003d80 2026-02-17T11:10:38.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.855+0000 7f466e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:38.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.855+0000 7f466e7fc640 1 -- 10.20.193.49:0/987778572 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465c004de0 con 0x7f4654003d80 2026-02-17T11:10:38.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.855+0000 7f466e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:38.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.855+0000 7f466e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:10:38.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.855+0000 7f466e7fc640 10 monclient: dump: 2026-02-17T11:10:38.857 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:38.857 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.857 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.857 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.857 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:38.857 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.857 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:38.857 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:38.857 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:38.857 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.855+0000 7f4675cb7640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:38.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.855+0000 7f4675cb7640 4 set_mon_vals no callback set 2026-02-17T11:10:38.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.855+0000 7f4675cb7640 10 monclient: shutdown 2026-02-17T11:10:38.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.855+0000 7f4675cb7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:38.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.855+0000 7f4675cb7640 1 -- 10.20.193.49:0/987778572 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f4654003d80 msgr2=0x7f4654004180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.855+0000 7f4675cb7640 1 --2- 10.20.193.49:0/987778572 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f4654003d80 0x7f4654004180 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f465c003180 tx=0x7f465c02ef00 comp rx=0 tx=0).stop 2026-02-17T11:10:38.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.855+0000 7f4675cb7640 1 -- 10.20.193.49:0/987778572 shutdown_connections 2026-02-17T11:10:38.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.855+0000 7f4675cb7640 1 --2- 10.20.193.49:0/987778572 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f4654003d80 0x7f4654004180 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.855+0000 7f4675cb7640 1 -- 10.20.193.49:0/987778572 >> 10.20.193.49:0/987778572 conn(0x7f4670073030 msgr2=0x7f4670073440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:38.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.855+0000 7f4675cb7640 1 -- 10.20.193.49:0/987778572 shutdown_connections 2026-02-17T11:10:38.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.855+0000 7f4675cb7640 1 -- 10.20.193.49:0/987778572 wait complete. 2026-02-17T11:10:38.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.856+0000 7f4675cb7640 10 monclient: build_initial_monmap 2026-02-17T11:10:38.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.856+0000 7f4675cb7640 10 monclient: monmap: 2026-02-17T11:10:38.858 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:38.858 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:38.858 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:38.858 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:38.858 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:38.858 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.858 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:38.858 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:38.858 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:38.858 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.856+0000 7f4675cb7640 1 librados: starting msgr at 2026-02-17T11:10:38.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.856+0000 7f4675cb7640 1 librados: starting objecter 2026-02-17T11:10:38.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.856+0000 7f4675cb7640 1 Processor -- start 2026-02-17T11:10:38.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.856+0000 7f4675cb7640 1 -- start start 2026-02-17T11:10:38.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.856+0000 7f4675cb7640 1 librados: setting wanted keys 2026-02-17T11:10:38.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.856+0000 7f4675cb7640 1 librados: calling monclient init 2026-02-17T11:10:38.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.856+0000 7f4675cb7640 10 monclient: init 2026-02-17T11:10:38.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.856+0000 7f4675cb7640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:38.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.856+0000 7f4675cb7640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:10:38.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.856+0000 7f4675cb7640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f4654003d80 0x7f46701e8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.856+0000 7f4675cb7640 10 monclient(hunting): picked mon.noname-c con 0x7f4654003d80 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:38.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.856+0000 7f4675cb7640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f4670144cc0 0x7f46701f7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.856+0000 7f4675cb7640 10 monclient(hunting): picked mon.noname-b con 0x7f4670144cc0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:38.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.856+0000 7f4675cb7640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f4670145100 0x7f46701f7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.856+0000 7f4675cb7640 10 monclient(hunting): picked mon.noname-a con 0x7f4670145100 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:38.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.856+0000 7f4675cb7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.856+0000 7f4675cb7640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f46700c9300 con 0x7f4670145100 2026-02-17T11:10:38.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.856+0000 7f4675cb7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.856+0000 7f4675cb7640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f46700c9670 con 0x7f4670144cc0 2026-02-17T11:10:38.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.856+0000 7f4675cb7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.856+0000 7f4675cb7640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f4670160270 con 0x7f4654003d80 2026-02-17T11:10:38.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.856+0000 7f4675cb7640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:38.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.856+0000 7f4675cb7640 10 monclient(hunting): authenticate will time out at 1115.519934s 2026-02-17T11:10:38.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.857+0000 7f466f7fe640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f4654003d80 0x7f46701e8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:38.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.857+0000 7f466f7fe640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f4654003d80 0x7f46701e8b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:48520/0 (socket says 10.20.193.49:48520) 2026-02-17T11:10:38.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.857+0000 7f466f7fe640 1 -- 10.20.193.49:0/1568831122 learned_addr learned my addr 10.20.193.49:0/1568831122 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:38.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.857+0000 7f466f7fe640 10 monclient(hunting): get_auth_request con 0x7f4654003d80 auth_method 0 2026-02-17T11:10:38.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.857+0000 7f466f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:38.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.857+0000 7f466f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:38.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.857+0000 7f466f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:38.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.857+0000 7f466f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:38.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.857+0000 7f466f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:38.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.857+0000 7f466f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:38.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.858+0000 7f466f7fe640 10 monclient(hunting): handle_auth_done global_id 4616 payload 824 2026-02-17T11:10:38.860 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.858+0000 7f466f7fe640 1 -- 10.20.193.49:0/1568831122 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f4670144cc0 msgr2=0x7f46701f7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.860 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.858+0000 7f466f7fe640 1 --2- 10.20.193.49:0/1568831122 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f4670144cc0 0x7f46701f7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.860 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.858+0000 7f466f7fe640 1 -- 10.20.193.49:0/1568831122 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f4670145100 msgr2=0x7f46701f7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.860 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.858+0000 7f466f7fe640 1 --2- 10.20.193.49:0/1568831122 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f4670145100 0x7f46701f7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.860 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.858+0000 7f466f7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:10:38.860 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.858+0000 7f466f7fe640 1 monclient: found mon.noname-c 2026-02-17T11:10:38.860 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.858+0000 7f466f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:38.860 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.858+0000 7f466f7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:10:38.860 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.858+0000 7f466f7fe640 1 -- 10.20.193.49:0/1568831122 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46701e77c0 con 0x7f4654003d80 2026-02-17T11:10:38.860 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.859+0000 7f466f7fe640 1 --2- 10.20.193.49:0/1568831122 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f4654003d80 0x7f46701e8b40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f465c02f410 tx=0x7f465c0029a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:38.860 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.859+0000 7f464bfff640 10 client.?.objecter ms_handle_connect 0x7f4654003d80 2026-02-17T11:10:38.861 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.859+0000 7f464bfff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:38.862 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.861+0000 7f464bfff640 1 -- 10.20.193.49:0/1568831122 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465c02fb30 con 0x7f4654003d80 2026-02-17T11:10:38.862 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.861+0000 7f464bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:38.862 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.861+0000 7f464bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:10:38.863 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.861+0000 7f464bfff640 10 monclient: dump: 2026-02-17T11:10:38.863 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:38.863 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.863 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.863 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.863 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:38.863 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.863 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:38.863 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:38.863 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:38.863 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.863 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.861+0000 7f464bfff640 10 monclient: _finish_auth 0 2026-02-17T11:10:38.863 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.861+0000 7f464bfff640 10 monclient: _check_auth_tickets 2026-02-17T11:10:38.863 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.861+0000 7f464bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:38.863 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.861+0000 7f464bfff640 1 -- 10.20.193.49:0/1568831122 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f465c02fcd0 con 0x7f4654003d80 2026-02-17T11:10:38.863 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.861+0000 7f464bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:38.863 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.861+0000 7f464bfff640 1 -- 10.20.193.49:0/1568831122 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465c007270 con 0x7f4654003d80 2026-02-17T11:10:38.863 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.861+0000 7f4675cb7640 5 monclient: authenticate success, global_id 4616 2026-02-17T11:10:38.863 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.861+0000 7f4675cb7640 10 monclient: _renew_subs 2026-02-17T11:10:38.863 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.861+0000 7f4675cb7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:38.863 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.861+0000 7f4675cb7640 1 -- 10.20.193.49:0/1568831122 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46701e7aa0 con 0x7f4654003d80 2026-02-17T11:10:38.863 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.861+0000 7f466dffb640 4 set_mon_vals no callback set 2026-02-17T11:10:38.863 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.861+0000 7f464bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:38.863 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.861+0000 7f464bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:10:38.863 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.861+0000 7f464bfff640 10 monclient: dump: 2026-02-17T11:10:38.863 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:38.863 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.863 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.863 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:38.863 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:38.863 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.863 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:38.863 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:38.863 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:38.863 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.863 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.861+0000 7f4675cb7640 10 client.4616.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:38.863 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.861+0000 7f4675cb7640 10 monclient: _renew_subs 2026-02-17T11:10:38.863 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.861+0000 7f4675cb7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:38.863 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.861+0000 7f4675cb7640 1 -- 10.20.193.49:0/1568831122 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46701e8060 con 0x7f4654003d80 2026-02-17T11:10:38.863 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.861+0000 7f4675cb7640 1 librados: init done 2026-02-17T11:10:38.864 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.862+0000 7f4675cb7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:38.864 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.862+0000 7f4675cb7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:38.864 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.862+0000 7f4675cb7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:38.864 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.862+0000 7f4675cb7640 1 -- 10.20.193.49:0/1568831122 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f467006d580 con 0x7f4654003d80 2026-02-17T11:10:38.867 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.866+0000 7f727e7fc640 1 -- 10.20.193.49:0/1513569313 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f7280021480 con 0x7f72900ca040 2026-02-17T11:10:38.868 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.866+0000 7f727e7fc640 1 --2- 10.20.193.49:0/1513569313 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f7260079190 0x7f726007b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.868 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.867+0000 7f7295169640 1 --2- 10.20.193.49:0/1513569313 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f7260079190 0x7f726007b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:38.868 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.867+0000 7f7295169640 10 monclient: get_auth_request con 0x7f7260079190 auth_method 0 2026-02-17T11:10:38.868 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.867+0000 7f727e7fc640 10 client.4596.objecter ms_handle_connect 0x7f7260079190 2026-02-17T11:10:38.868 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.867+0000 7f7295169640 1 --2- 10.20.193.49:0/1513569313 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f7260079190 0x7f726007b650 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f729014c550 tx=0x7f7284006cf0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:38.870 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.869+0000 7f727e7fc640 1 -- 10.20.193.49:0/1513569313 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7f728005dc80 con 0x7f72900ca040 2026-02-17T11:10:38.870 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.869+0000 7f727e7fc640 10 client.4596.objecter ms_dispatch2 0x7f7290000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:38.870 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.869+0000 7f727e7fc640 3 client.4596.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:38.870 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.869+0000 7f727e7fc640 3 client.4596.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:38.870 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.869+0000 7f727e7fc640 20 client.4596.objecter dump_active .. 0 homeless 2026-02-17T11:10:38.874 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.873+0000 7f464bfff640 1 -- 10.20.193.49:0/1568831122 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f465c007410 con 0x7f4654003d80 2026-02-17T11:10:38.875 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.874+0000 7f464bfff640 1 --2- 10.20.193.49:0/1568831122 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f4640079170 0x7f464007b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.875 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.874+0000 7f466effd640 1 --2- 10.20.193.49:0/1568831122 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f4640079170 0x7f464007b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:38.875 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.874+0000 7f466effd640 10 monclient: get_auth_request con 0x7f4640079170 auth_method 0 2026-02-17T11:10:38.875 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.874+0000 7f466effd640 1 --2- 10.20.193.49:0/1568831122 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f4640079170 0x7f464007b630 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f46700d1a90 tx=0x7f46600079d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:38.876 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.874+0000 7f464bfff640 10 client.4616.objecter ms_handle_connect 0x7f4640079170 2026-02-17T11:10:38.876 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.875+0000 7f464bfff640 1 -- 10.20.193.49:0/1568831122 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7f465c009d60 con 0x7f4654003d80 2026-02-17T11:10:38.876 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.875+0000 7f464bfff640 10 client.4616.objecter ms_dispatch2 0x7f4670000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:38.876 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.875+0000 7f464bfff640 3 client.4616.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:38.876 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.875+0000 7f464bfff640 3 client.4616.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:38.876 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.875+0000 7f464bfff640 20 client.4616.objecter dump_active .. 0 homeless 2026-02-17T11:10:38.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.913+0000 7fe2c5b5e640 10 monclient: get_monmap_and_config 2026-02-17T11:10:38.915 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.913+0000 7fe2c5b5e640 10 monclient: build_initial_monmap 2026-02-17T11:10:38.915 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.913+0000 7fe2c5b5e640 10 monclient: monmap: 2026-02-17T11:10:38.915 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:38.915 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.915 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:38.914198+0000 2026-02-17T11:10:38.915 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:38.914198+0000 2026-02-17T11:10:38.915 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:38.915 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.915 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:38.915 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:38.915 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:38.915 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:38.915 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:38.915 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:38.915 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.914+0000 7fe2c5b5e640 1 Processor -- start 2026-02-17T11:10:38.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.914+0000 7fe2c5b5e640 1 -- start start 2026-02-17T11:10:38.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.914+0000 7fe2c5b5e640 10 monclient: init 2026-02-17T11:10:38.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.914+0000 7fe2c5b5e640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:38.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.914+0000 7fe2c5b5e640 10 monclient: _add_conns ranks=[3,2,0,1,5,4] 2026-02-17T11:10:38.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.914+0000 7fe2c5b5e640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fe2c015d370 0x7fe2c015d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.914+0000 7fe2c5b5e640 10 monclient(hunting): picked mon.noname-a con 0x7fe2c015d370 addr v2:10.20.193.49:3300/0 2026-02-17T11:10:38.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.914+0000 7fe2c5b5e640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fe2c00c7e20 addr v1:10.20.193.157:6789/0 2026-02-17T11:10:38.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.914+0000 7fe2c5b5e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe2c00c74c0 addr v1:10.20.193.49:6789/0 2026-02-17T11:10:38.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.914+0000 7fe2c5b5e640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2c00c8350 con 0x7fe2c00c74c0 2026-02-17T11:10:38.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.914+0000 7fe2c5b5e640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2c00c8630 con 0x7fe2c00c7e20 2026-02-17T11:10:38.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.914+0000 7fe2c5b5e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.914+0000 7fe2c5b5e640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7fe2c015b710 con 0x7fe2c015d370 2026-02-17T11:10:38.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.914+0000 7fe2c5b5e640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:38.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.914+0000 7fe2c5b5e640 10 monclient(hunting): authenticate will time out at 1115.577759s 2026-02-17T11:10:38.919 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.917+0000 7fce42753640 10 monclient: get_monmap_and_config 2026-02-17T11:10:38.919 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.917+0000 7fce42753640 10 monclient: build_initial_monmap 2026-02-17T11:10:38.919 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.917+0000 7fce42753640 10 monclient: monmap: 2026-02-17T11:10:38.919 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:38.919 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:38.919 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:38.918371+0000 2026-02-17T11:10:38.919 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:38.918371+0000 2026-02-17T11:10:38.919 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:38.919 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:38.919 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:38.919 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:38.919 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:38.919 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:38.919 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:38.919 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:38.919 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:38.920 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.918+0000 7fce42753640 1 Processor -- start 2026-02-17T11:10:38.920 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.918+0000 7fce42753640 1 -- start start 2026-02-17T11:10:38.920 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.918+0000 7fce42753640 10 monclient: init 2026-02-17T11:10:38.920 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.918+0000 7fce42753640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:38.920 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.918+0000 7fce42753640 10 monclient: _add_conns ranks=[1,2,3,4,0,5] 2026-02-17T11:10:38.920 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.918+0000 7fce42753640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fce3c0686b0 addr v1:10.20.193.97:6789/0 2026-02-17T11:10:38.920 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.918+0000 7fce42753640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fce3c06f700 addr v1:10.20.193.157:6789/0 2026-02-17T11:10:38.920 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.918+0000 7fce42753640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fce3c1561f0 0x7fce3c068a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.920 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.918+0000 7fce42753640 10 monclient(hunting): picked mon.noname-a con 0x7fce3c1561f0 addr v2:10.20.193.49:3300/0 2026-02-17T11:10:38.920 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.918+0000 7fce42753640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce3c15cd30 con 0x7fce3c0686b0 2026-02-17T11:10:38.920 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.918+0000 7fce42753640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce3c15c490 con 0x7fce3c06f700 2026-02-17T11:10:38.920 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.918+0000 7fce42753640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:38.920 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.918+0000 7fce42753640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7fce3c15c770 con 0x7fce3c1561f0 2026-02-17T11:10:38.921 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.918+0000 7fce42753640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:38.921 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.918+0000 7fce42753640 10 monclient(hunting): authenticate will time out at 1115.581997s 2026-02-17T11:10:38.921 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.920+0000 7f8ade322640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-17T11:10:38.921 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.920+0000 7f8ade322640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-17T11:10:38.921 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.920+0000 7f8ade322640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:38.921 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.920+0000 7f8ade322640 1 -- 10.20.193.49:0/3921632394 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 13} v 0) -- 0x7f8ad814e970 con 0x7f8ad80c8cf0 2026-02-17T11:10:38.922 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.921+0000 7f0c0ccf2640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-17T11:10:38.922 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.921+0000 7f0c0ccf2640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-17T11:10:38.922 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.921+0000 7f0c0ccf2640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:38.922 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.921+0000 7f0c0ccf2640 1 -- 10.20.193.49:0/877735764 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f0c0815ce70 con 0x7f0c08152ae0 2026-02-17T11:10:38.927 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.926+0000 7eff85ab0640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 8}] 2026-02-17T11:10:38.927 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.926+0000 7eff85ab0640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 8}] 2026-02-17T11:10:38.927 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.926+0000 7eff85ab0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:38.927 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.926+0000 7eff85ab0640 1 -- 10.20.193.49:0/56635324 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7eff80070040 con 0x7eff800c7e20 2026-02-17T11:10:38.938 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.937+0000 7f0beeffd640 1 -- 10.20.193.49:0/877735764 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f0bf0065a60 con 0x7f0c08152ae0 2026-02-17T11:10:38.939 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.937+0000 7f0beeffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-17T11:10:38.939 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.937+0000 7f0beeffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:38.939 INFO:teuthology.orchestra.run.trial049.stdout:115964117000 2026-02-17T11:10:38.941 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.939+0000 7f0c0ccf2640 10 librados: watch_flush enter 2026-02-17T11:10:38.941 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.939+0000 7f0c0ccf2640 10 librados: watch_flush exit 2026-02-17T11:10:38.941 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.939+0000 7f0c0ccf2640 20 client.4573.objecter shutdown clearing up homeless session... 2026-02-17T11:10:38.941 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.939+0000 7f0c0ccf2640 10 client.4573.objecter successfully canceled tick 2026-02-17T11:10:38.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.939+0000 7f0c0ccf2640 1 -- 10.20.193.49:0/877735764 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0bd4079140 msgr2=0x7f0bd407b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.939+0000 7f0c0ccf2640 1 --2- 10.20.193.49:0/877735764 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0bd4079140 0x7f0bd407b600 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc003fd0 tx=0x7f0bfc002a40 comp rx=0 tx=0).stop 2026-02-17T11:10:38.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.939+0000 7f0c0ccf2640 10 monclient: shutdown 2026-02-17T11:10:38.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.939+0000 7f0c0ccf2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:38.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.939+0000 7f0c0ccf2640 1 -- 10.20.193.49:0/877735764 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f0c08152ae0 msgr2=0x7f0c080d1f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.939+0000 7f0c0ccf2640 1 --2- 10.20.193.49:0/877735764 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f0c08152ae0 0x7f0c080d1f00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0bf000c730 tx=0x7f0bf000cc00 comp rx=0 tx=0).stop 2026-02-17T11:10:38.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.939+0000 7f0c0ccf2640 1 -- 10.20.193.49:0/877735764 shutdown_connections 2026-02-17T11:10:38.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.939+0000 7f0c0ccf2640 1 --2- 10.20.193.49:0/877735764 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0bd4079140 0x7f0bd407b600 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.939+0000 7f0c0ccf2640 1 --2- 10.20.193.49:0/877735764 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0c0815ef80 0x7f0c080cffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.939+0000 7f0c0ccf2640 1 --2- 10.20.193.49:0/877735764 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f0c08152ae0 0x7f0c080d1f00 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.939+0000 7f0c0ccf2640 1 --2- 10.20.193.49:0/877735764 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f0c08152700 0x7f0c081f7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.939+0000 7f0c0ccf2640 1 -- 10.20.193.49:0/877735764 >> 10.20.193.49:0/877735764 conn(0x7f0c08073030 msgr2=0x7f0c08151140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:38.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.939+0000 7f0c0ccf2640 1 -- 10.20.193.49:0/877735764 shutdown_connections 2026-02-17T11:10:38.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.939+0000 7f0c0ccf2640 1 -- 10.20.193.49:0/877735764 wait complete. 2026-02-17T11:10:38.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.939+0000 7f0c0ccf2640 1 librados: shutdown 2026-02-17T11:10:38.949 INFO:tasks.ceph.ceph_manager.ceph:need seq 115964117000 got 115964117000 for osd.10 2026-02-17T11:10:38.950 DEBUG:teuthology.parallel:result is None 2026-02-17T11:10:38.950 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.949+0000 7ff9f4ff9640 1 -- 10.20.193.49:0/2636840979 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7ff9e403f050 con 0x7ff9f80c92a0 2026-02-17T11:10:38.951 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.949+0000 7ff9f4ff9640 1 --2- 10.20.193.49:0/2636840979 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ff9c80791c0 0x7ff9c807b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:38.951 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.949+0000 7ff9f77fe640 1 --2- 10.20.193.49:0/2636840979 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ff9c80791c0 0x7ff9c807b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:38.951 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.949+0000 7ff9f77fe640 10 monclient: get_auth_request con 0x7ff9c80791c0 auth_method 0 2026-02-17T11:10:38.951 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.950+0000 7ff9f4ff9640 10 client.4579.objecter ms_handle_connect 0x7ff9c80791c0 2026-02-17T11:10:38.951 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.950+0000 7ff9f77fe640 1 --2- 10.20.193.49:0/2636840979 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ff9c80791c0 0x7ff9c807b680 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff9f8159be0 tx=0x7ff9e8009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:38.953 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.951+0000 7ff9f4ff9640 1 -- 10.20.193.49:0/2636840979 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7ff9e4083190 con 0x7ff9f80c92a0 2026-02-17T11:10:38.953 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.951+0000 7ff9f4ff9640 10 client.4579.objecter ms_dispatch2 0x7ff9f8000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:38.953 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.951+0000 7ff9f4ff9640 3 client.4579.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:38.953 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.951+0000 7ff9f4ff9640 3 client.4579.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:38.953 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.951+0000 7ff9f4ff9640 20 client.4579.objecter dump_active .. 0 homeless 2026-02-17T11:10:38.959 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.958+0000 7ff9f4ff9640 1 -- 10.20.193.49:0/2636840979 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ff9f815ea40 con 0x7ff9f80c92a0 2026-02-17T11:10:38.959 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.958+0000 7ff9f4ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:38.959 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.958+0000 7ff9f4ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:38.960 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.958+0000 7fce3bfff640 1 --1- >> v1:10.20.193.97:6789/0 conn(0x7fce3c0686b0 0x7fce3c06eff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.97:6789/0 says I am v1:10.20.193.49:34954/0 (socket says 10.20.193.49:34954) 2026-02-17T11:10:38.960 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.958+0000 7fce3bfff640 1 -- 10.20.193.49:0/3259597381 learned_addr learned my addr 10.20.193.49:0/3259597381 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:10:38.975 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.974+0000 7f727e7fc640 1 -- 10.20.193.49:0/1513569313 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f7280062340 con 0x7f72900ca040 2026-02-17T11:10:38.975 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.974+0000 7f727e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:38.975 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.974+0000 7f727e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:38.979 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.977+0000 7f464bfff640 1 -- 10.20.193.49:0/1568831122 <== mon.2 v2:10.20.193.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f467006d580 con 0x7f4654003d80 2026-02-17T11:10:38.979 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.977+0000 7f464bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:38.979 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.977+0000 7f464bfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:38.980 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.978+0000 7fe2beffd640 1 --1- >> v1:10.20.193.157:6789/0 conn(0x7fe2c00c7e20 0x7fe2c015b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.157:6789/0 says I am v1:10.20.193.49:53006/0 (socket says 10.20.193.49:53006) 2026-02-17T11:10:38.980 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.978+0000 7fe2beffd640 1 -- 10.20.193.49:0/3983798907 learned_addr learned my addr 10.20.193.49:0/3983798907 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:10:38.980 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.979+0000 7fe2bf7fe640 1 --2- 10.20.193.49:0/3983798907 >> v2:10.20.193.49:3300/0 conn(0x7fe2c015d370 0x7fe2c015d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:38.981 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.980+0000 7fe2bf7fe640 10 monclient(hunting): get_auth_request con 0x7fe2c015d370 auth_method 0 2026-02-17T11:10:38.982 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.980+0000 7fe2bf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:38.982 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.980+0000 7fe2bf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:38.982 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.980+0000 7fe2bf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:38.982 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.980+0000 7fce40cc9640 1 --2- 10.20.193.49:0/3259597381 >> v2:10.20.193.49:3300/0 conn(0x7fce3c1561f0 0x7fce3c068a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:38.983 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.981+0000 7eff5bfff640 1 -- 10.20.193.49:0/56635324 <== mon.2 v2:10.20.193.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7eff700629c0 con 0x7eff800c7e20 2026-02-17T11:10:38.983 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.981+0000 7eff5bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 8}] 2026-02-17T11:10:38.983 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.981+0000 7eff5bfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:38.983 INFO:teuthology.orchestra.run.trial049.stdout:90194313221 2026-02-17T11:10:38.984 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.982+0000 7f8ad4ff9640 1 -- 10.20.193.49:0/3921632394 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 13}]=0 v0) ==== 75+0+12 (secure 0 0 0) 0x7f8ac4065a70 con 0x7f8ad80c8cf0 2026-02-17T11:10:38.984 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.982+0000 7f8ad4ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-17T11:10:38.984 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.982+0000 7f8ad4ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:38.984 INFO:teuthology.orchestra.run.trial049.stdout:94489280518 2026-02-17T11:10:38.985 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.983+0000 7fe2bf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:38.985 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.983+0000 7fe2bf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:38.985 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.983+0000 7fe2bf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:38.985 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.983+0000 7fce40cc9640 10 monclient(hunting): get_auth_request con 0x7fce3c1561f0 auth_method 0 2026-02-17T11:10:38.986 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.983+0000 7fce40cc9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:38.986 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.983+0000 7fce40cc9640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:38.986 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.983+0000 7fce40cc9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:38.987 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.983+0000 7eff85ab0640 10 librados: watch_flush enter 2026-02-17T11:10:38.987 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.983+0000 7eff85ab0640 10 librados: watch_flush exit 2026-02-17T11:10:38.987 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.983+0000 7eff85ab0640 20 client.4610.objecter shutdown clearing up homeless session... 2026-02-17T11:10:38.987 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.983+0000 7eff85ab0640 10 client.4610.objecter successfully canceled tick 2026-02-17T11:10:38.987 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.983+0000 7eff85ab0640 1 -- 10.20.193.49:0/56635324 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7eff50079140 msgr2=0x7eff5007b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.988 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.983+0000 7eff85ab0640 1 --2- 10.20.193.49:0/56635324 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7eff50079140 0x7eff5007b600 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7eff801f5b30 tx=0x7eff6c0096b0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.988 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.983+0000 7eff85ab0640 10 monclient: shutdown 2026-02-17T11:10:38.988 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.983+0000 7eff85ab0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:38.988 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.983+0000 7eff85ab0640 1 -- 10.20.193.49:0/56635324 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7eff800c7e20 msgr2=0x7eff801f2930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.988 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.983+0000 7eff85ab0640 1 --2- 10.20.193.49:0/56635324 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7eff800c7e20 0x7eff801f2930 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7eff7000b570 tx=0x7eff7000ba40 comp rx=0 tx=0).stop 2026-02-17T11:10:38.988 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.984+0000 7eff85ab0640 1 -- 10.20.193.49:0/56635324 shutdown_connections 2026-02-17T11:10:38.988 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.984+0000 7eff85ab0640 1 --2- 10.20.193.49:0/56635324 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7eff50079140 0x7eff5007b600 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.988 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.984+0000 7eff85ab0640 1 --2- 10.20.193.49:0/56635324 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7eff8015d370 0x7eff8014b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.988 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.984+0000 7eff85ab0640 1 --2- 10.20.193.49:0/56635324 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7eff800c7e20 0x7eff801f2930 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.988 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.984+0000 7eff85ab0640 1 --2- 10.20.193.49:0/56635324 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7eff800c74c0 0x7eff80074670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.988 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.984+0000 7eff85ab0640 1 -- 10.20.193.49:0/56635324 >> 10.20.193.49:0/56635324 conn(0x7eff800c9f20 msgr2=0x7eff8015dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:38.989 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.984+0000 7eff85ab0640 1 -- 10.20.193.49:0/56635324 shutdown_connections 2026-02-17T11:10:38.989 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.984+0000 7eff85ab0640 1 -- 10.20.193.49:0/56635324 wait complete. 2026-02-17T11:10:38.989 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.984+0000 7eff85ab0640 1 librados: shutdown 2026-02-17T11:10:38.990 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.987+0000 7f8ade322640 10 librados: watch_flush enter 2026-02-17T11:10:38.990 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.987+0000 7f8ade322640 10 librados: watch_flush exit 2026-02-17T11:10:38.990 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.987+0000 7f8ade322640 20 client.4584.objecter shutdown clearing up homeless session... 2026-02-17T11:10:38.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.987+0000 7f8ade322640 10 client.4584.objecter successfully canceled tick 2026-02-17T11:10:38.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.987+0000 7f8ade322640 1 -- 10.20.193.49:0/3921632394 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f8aa8079140 msgr2=0x7f8aa807b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.987+0000 7f8ade322640 1 --2- 10.20.193.49:0/3921632394 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f8aa8079140 0x7f8aa807b600 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8ad8148c40 tx=0x7f8ac8009110 comp rx=0 tx=0).stop 2026-02-17T11:10:38.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.987+0000 7f8ade322640 10 monclient: shutdown 2026-02-17T11:10:38.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.987+0000 7f8ade322640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:38.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.987+0000 7f8ade322640 1 -- 10.20.193.49:0/3921632394 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f8ad80c8cf0 msgr2=0x7f8ad806dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:38.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.987+0000 7f8ade322640 1 --2- 10.20.193.49:0/3921632394 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f8ad80c8cf0 0x7f8ad806dd00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8ac400c730 tx=0x7f8ac400cc00 comp rx=0 tx=0).stop 2026-02-17T11:10:38.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.987+0000 7f8ade322640 1 -- 10.20.193.49:0/3921632394 shutdown_connections 2026-02-17T11:10:38.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.987+0000 7f8ade322640 1 --2- 10.20.193.49:0/3921632394 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f8aa8079140 0x7f8aa807b600 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.987+0000 7f8ade322640 1 --2- 10.20.193.49:0/3921632394 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f8ad815df20 0x7f8ad81441b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.987+0000 7f8ade322640 1 --2- 10.20.193.49:0/3921632394 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f8ad81527c0 0x7f8ad81f44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.987+0000 7f8ade322640 1 --2- 10.20.193.49:0/3921632394 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f8ad80c8cf0 0x7f8ad806dd00 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:38.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.987+0000 7f8ade322640 1 -- 10.20.193.49:0/3921632394 >> 10.20.193.49:0/3921632394 conn(0x7f8ad8073030 msgr2=0x7f8ad80d18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:38.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.987+0000 7f8ade322640 1 -- 10.20.193.49:0/3921632394 shutdown_connections 2026-02-17T11:10:38.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.987+0000 7f8ade322640 1 -- 10.20.193.49:0/3921632394 wait complete. 2026-02-17T11:10:38.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:38.987+0000 7f8ade322640 1 librados: shutdown 2026-02-17T11:10:38.996 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313221 for osd.8 2026-02-17T11:10:38.996 DEBUG:teuthology.parallel:result is None 2026-02-17T11:10:38.997 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280517 got 94489280518 for osd.13 2026-02-17T11:10:38.998 DEBUG:teuthology.parallel:result is None 2026-02-17T11:10:39.016 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.015+0000 7fce40cc9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:39.016 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.015+0000 7fce40cc9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:39.016 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.015+0000 7fce40cc9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:39.017 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.016+0000 7fe2bf7fe640 10 monclient(hunting): handle_auth_done global_id 4599 payload 274 2026-02-17T11:10:39.018 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.016+0000 7fe2bf7fe640 1 -- 10.20.193.49:0/3983798907 >> v1:10.20.193.157:6789/0 conn(0x7fe2c00c7e20 legacy=0x7fe2c015b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:39.018 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.016+0000 7fe2bf7fe640 1 -- 10.20.193.49:0/3983798907 >> v1:10.20.193.49:6789/0 conn(0x7fe2c00c74c0 legacy=0x7fe2c00c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:39.018 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.016+0000 7fe2bf7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:10:39.018 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.016+0000 7fe2bf7fe640 1 monclient: found mon.noname-a 2026-02-17T11:10:39.018 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.016+0000 7fe2bf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:39.018 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.016+0000 7fe2bf7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:10:39.018 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.016+0000 7fe2bf7fe640 1 -- 10.20.193.49:0/3983798907 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2c00c8910 con 0x7fe2c015d370 2026-02-17T11:10:39.019 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.017+0000 7fce40cc9640 10 monclient(hunting): handle_auth_done global_id 4602 payload 274 2026-02-17T11:10:39.019 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.017+0000 7fce40cc9640 1 -- 10.20.193.49:0/3259597381 >> v1:10.20.193.157:6789/0 conn(0x7fce3c06f700 legacy=0x7fce3c155ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:39.019 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.017+0000 7fce40cc9640 1 -- 10.20.193.49:0/3259597381 >> v1:10.20.193.97:6789/0 conn(0x7fce3c0686b0 legacy=0x7fce3c06eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:39.019 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.017+0000 7fce40cc9640 10 monclient: _finish_hunting 0 2026-02-17T11:10:39.019 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.017+0000 7fce40cc9640 1 monclient: found mon.noname-a 2026-02-17T11:10:39.020 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.017+0000 7fce40cc9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:39.020 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.017+0000 7fce40cc9640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:10:39.020 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.017+0000 7fce40cc9640 1 -- 10.20.193.49:0/3259597381 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce3c15ca50 con 0x7fce3c1561f0 2026-02-17T11:10:39.020 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.018+0000 7fe2bf7fe640 1 --2- 10.20.193.49:0/3983798907 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe2c015d370 0x7fe2c015d750 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac0098a0 tx=0x7fe2ac02ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b1a474fe8173ca3 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:39.020 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.018+0000 7fce40cc9640 1 --2- 10.20.193.49:0/3259597381 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fce3c1561f0 0x7fce3c068a90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fce30009d90 tx=0x7fce3002f230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=998373d0244594c8 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:39.026 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.023+0000 7fce3affd640 1 -- 10.20.193.49:0/3259597381 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce3003c070 con 0x7fce3c1561f0 2026-02-17T11:10:39.026 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.023+0000 7fce3affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:39.026 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.023+0000 7fce3affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:10:39.026 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.023+0000 7fce3affd640 10 monclient: dump: 2026-02-17T11:10:39.026 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:39.026 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:39.026 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:39.026 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:39.026 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:39.026 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:39.027 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:39.027 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:39.027 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:39.027 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:39.027 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.023+0000 7fce3affd640 10 monclient: _finish_auth 0 2026-02-17T11:10:39.027 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.023+0000 7fce3affd640 10 monclient: _check_auth_tickets 2026-02-17T11:10:39.027 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.023+0000 7fce3affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:39.027 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.023+0000 7fce3affd640 1 -- 10.20.193.49:0/3259597381 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce30037440 con 0x7fce3c1561f0 2026-02-17T11:10:39.027 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.023+0000 7fce3affd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:39.027 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.023+0000 7fce3affd640 1 -- 10.20.193.49:0/3259597381 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce30037810 con 0x7fce3c1561f0 2026-02-17T11:10:39.027 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.023+0000 7fce42753640 5 monclient: authenticate success, global_id 4602 2026-02-17T11:10:39.028 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.023+0000 7fce42753640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:39.028 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.023+0000 7fce42753640 4 set_mon_vals no callback set 2026-02-17T11:10:39.028 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.023+0000 7fce3affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:39.028 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.023+0000 7fce3affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:10:39.028 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.023+0000 7fce3affd640 10 monclient: dump: 2026-02-17T11:10:39.028 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:39.028 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:39.028 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:39.028 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:39.028 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:39.028 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:39.028 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:39.029 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:39.029 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:39.029 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:39.029 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.024+0000 7fce42753640 10 monclient: shutdown 2026-02-17T11:10:39.029 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.024+0000 7fce42753640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:39.029 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.024+0000 7fce42753640 1 -- 10.20.193.49:0/3259597381 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fce3c1561f0 msgr2=0x7fce3c068a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:39.029 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.024+0000 7fce42753640 1 --2- 10.20.193.49:0/3259597381 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fce3c1561f0 0x7fce3c068a90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fce30009d90 tx=0x7fce3002f230 comp rx=0 tx=0).stop 2026-02-17T11:10:39.029 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.024+0000 7fce42753640 1 -- 10.20.193.49:0/3259597381 shutdown_connections 2026-02-17T11:10:39.029 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.024+0000 7fce42753640 1 --2- 10.20.193.49:0/3259597381 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fce3c1561f0 0x7fce3c068a90 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:39.029 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.024+0000 7fce42753640 1 -- 10.20.193.49:0/3259597381 >> 10.20.193.49:0/3259597381 conn(0x7fce3c0cb3a0 msgr2=0x7fce3c0cb7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:39.029 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.024+0000 7fce42753640 1 -- 10.20.193.49:0/3259597381 shutdown_connections 2026-02-17T11:10:39.029 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.024+0000 7fce42753640 1 -- 10.20.193.49:0/3259597381 wait complete. 2026-02-17T11:10:39.031 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.024+0000 7fe2be7fc640 1 -- 10.20.193.49:0/3983798907 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac03c070 con 0x7fe2c015d370 2026-02-17T11:10:39.031 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.024+0000 7fe2be7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:39.031 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.024+0000 7fe2be7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:10:39.031 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.024+0000 7fe2be7fc640 10 monclient: dump: 2026-02-17T11:10:39.032 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:39.032 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:39.032 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:39.032 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:39.032 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:39.032 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:39.032 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:39.032 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:39.032 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:39.032 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:39.032 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.024+0000 7fe2be7fc640 10 monclient: _finish_auth 0 2026-02-17T11:10:39.032 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.024+0000 7fe2be7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:10:39.033 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.024+0000 7fe2be7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:39.033 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.024+0000 7fe2be7fc640 1 -- 10.20.193.49:0/3983798907 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2ac02fad0 con 0x7fe2c015d370 2026-02-17T11:10:39.033 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.024+0000 7fe2c5b5e640 5 monclient: authenticate success, global_id 4599 2026-02-17T11:10:39.033 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.024+0000 7fe2c5b5e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:10:39.033 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.024+0000 7fe2be7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:39.033 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.024+0000 7fe2c5b5e640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:39.033 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.024+0000 7fe2be7fc640 1 -- 10.20.193.49:0/3983798907 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac037440 con 0x7fe2c015d370 2026-02-17T11:10:39.033 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.024+0000 7fe2be7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:39.033 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.024+0000 7fe2c5b5e640 4 set_mon_vals no callback set 2026-02-17T11:10:39.033 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.024+0000 7fe2be7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:10:39.033 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.024+0000 7fe2be7fc640 10 monclient: dump: 2026-02-17T11:10:39.033 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:39.034 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:39.034 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:39.034 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:39.034 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:39.034 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:39.034 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:39.034 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:39.034 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:39.034 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:39.034 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.024+0000 7fe2c5b5e640 10 monclient: shutdown 2026-02-17T11:10:39.034 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.024+0000 7fe2c5b5e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:39.034 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.024+0000 7fe2c5b5e640 1 -- 10.20.193.49:0/3983798907 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe2c015d370 msgr2=0x7fe2c015d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:39.035 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.024+0000 7fe2c5b5e640 1 --2- 10.20.193.49:0/3983798907 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe2c015d370 0x7fe2c015d750 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac0098a0 tx=0x7fe2ac02ee10 comp rx=0 tx=0).stop 2026-02-17T11:10:39.035 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.024+0000 7fe2c5b5e640 1 -- 10.20.193.49:0/3983798907 shutdown_connections 2026-02-17T11:10:39.035 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.024+0000 7fe2c5b5e640 1 --2- 10.20.193.49:0/3983798907 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe2c015d370 0x7fe2c015d750 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:39.035 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.024+0000 7fe2c5b5e640 1 -- 10.20.193.49:0/3983798907 >> 10.20.193.49:0/3983798907 conn(0x7fe2c00c9f20 msgr2=0x7fe2c00ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:39.035 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.024+0000 7fe2c5b5e640 1 -- 10.20.193.49:0/3983798907 shutdown_connections 2026-02-17T11:10:39.035 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.024+0000 7fe2c5b5e640 1 -- 10.20.193.49:0/3983798907 wait complete. 2026-02-17T11:10:39.036 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.024+0000 7fce42753640 10 monclient: build_initial_monmap 2026-02-17T11:10:39.036 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.024+0000 7fce42753640 10 monclient: monmap: 2026-02-17T11:10:39.036 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:39.036 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:39.036 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:39.036 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:39.036 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:39.036 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:39.036 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:39.036 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:39.036 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:39.036 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:39.037 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.025+0000 7fce42753640 1 librados: starting msgr at 2026-02-17T11:10:39.037 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.025+0000 7fce42753640 1 librados: starting objecter 2026-02-17T11:10:39.037 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.025+0000 7fce42753640 1 Processor -- start 2026-02-17T11:10:39.037 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.025+0000 7fe2c5b5e640 10 monclient: build_initial_monmap 2026-02-17T11:10:39.037 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.025+0000 7fe2c5b5e640 10 monclient: monmap: 2026-02-17T11:10:39.037 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:39.037 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:39.037 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:39.038 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:39.038 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:39.038 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:39.038 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:39.038 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:39.038 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:39.038 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:39.038 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.025+0000 7fce42753640 1 -- start start 2026-02-17T11:10:39.038 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.025+0000 7fce42753640 1 librados: setting wanted keys 2026-02-17T11:10:39.039 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.025+0000 7fce42753640 1 librados: calling monclient init 2026-02-17T11:10:39.039 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.025+0000 7fce42753640 10 monclient: init 2026-02-17T11:10:39.039 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.025+0000 7fe2c5b5e640 1 librados: starting msgr at 2026-02-17T11:10:39.039 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.025+0000 7fe2c5b5e640 1 librados: starting objecter 2026-02-17T11:10:39.040 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.025+0000 7fe2c5b5e640 1 Processor -- start 2026-02-17T11:10:39.040 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.025+0000 7fe2c5b5e640 1 -- start start 2026-02-17T11:10:39.040 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.025+0000 7fe2c5b5e640 1 librados: setting wanted keys 2026-02-17T11:10:39.040 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.025+0000 7fe2c5b5e640 1 librados: calling monclient init 2026-02-17T11:10:39.040 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.025+0000 7fe2c5b5e640 10 monclient: init 2026-02-17T11:10:39.041 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.025+0000 7fce42753640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:39.041 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.025+0000 7fce42753640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:10:39.041 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.025+0000 7fce42753640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fce3c0686b0 0x7fce3c0c99a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:39.041 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.025+0000 7fce42753640 10 monclient(hunting): picked mon.noname-a con 0x7fce3c0686b0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:39.041 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.025+0000 7fce42753640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fce3c06f700 0x7fce3c15aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:39.041 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.025+0000 7fce42753640 10 monclient(hunting): picked mon.noname-b con 0x7fce3c06f700 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:39.041 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.025+0000 7fce42753640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fce3c1561f0 0x7fce3c15b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:39.041 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.025+0000 7fce42753640 10 monclient(hunting): picked mon.noname-c con 0x7fce3c1561f0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:39.041 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.025+0000 7fce42753640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:39.041 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.025+0000 7fce42753640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fce3c15be30 con 0x7fce3c0686b0 2026-02-17T11:10:39.042 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.025+0000 7fce42753640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:39.042 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.025+0000 7fce42753640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fce3c06ead0 con 0x7fce3c06f700 2026-02-17T11:10:39.042 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.025+0000 7fce42753640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:39.042 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.025+0000 7fce42753640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fce3c15bfb0 con 0x7fce3c1561f0 2026-02-17T11:10:39.042 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.025+0000 7fce42753640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:39.042 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.025+0000 7fce42753640 10 monclient(hunting): authenticate will time out at 1115.688730s 2026-02-17T11:10:39.043 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.025+0000 7fe2c5b5e640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:39.043 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.025+0000 7fe2c5b5e640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:10:39.043 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.025+0000 7fe2c5b5e640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe2c00c74c0 0x7fe2c00c3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:39.043 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.025+0000 7fe2c5b5e640 10 monclient(hunting): picked mon.noname-a con 0x7fe2c00c74c0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:39.043 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.025+0000 7fe2c5b5e640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe2c00c7e20 0x7fe2c014ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:39.043 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.025+0000 7fe2c5b5e640 10 monclient(hunting): picked mon.noname-b con 0x7fe2c00c7e20 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:39.043 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.025+0000 7fe2c5b5e640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe2c015d370 0x7fe2c014d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:39.043 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.025+0000 7fe2c5b5e640 10 monclient(hunting): picked mon.noname-c con 0x7fe2c015d370 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:39.043 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.025+0000 7fe2c5b5e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:39.044 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.025+0000 7fe2c5b5e640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c00c8ed0 con 0x7fe2c00c74c0 2026-02-17T11:10:39.044 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.025+0000 7fe2c5b5e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:39.044 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.025+0000 7fe2c5b5e640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c00c9240 con 0x7fe2c00c7e20 2026-02-17T11:10:39.044 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.025+0000 7fe2c5b5e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:39.044 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.025+0000 7fe2c5b5e640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c00c96d0 con 0x7fe2c015d370 2026-02-17T11:10:39.044 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.025+0000 7fe2c5b5e640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:39.044 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.025+0000 7fe2c5b5e640 10 monclient(hunting): authenticate will time out at 1115.688947s 2026-02-17T11:10:39.044 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.026+0000 7fe2bf7fe640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe2c00c74c0 0x7fe2c00c3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:39.044 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.026+0000 7fce3bfff640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fce3c0686b0 0x7fce3c0c99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:39.045 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.026+0000 7fe2bf7fe640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe2c00c74c0 0x7fe2c00c3d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:33790/0 (socket says 10.20.193.49:33790) 2026-02-17T11:10:39.045 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.026+0000 7fe2bf7fe640 1 -- 10.20.193.49:0/3519969738 learned_addr learned my addr 10.20.193.49:0/3519969738 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:39.045 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.026+0000 7fe2bf7fe640 10 monclient(hunting): get_auth_request con 0x7fe2c00c74c0 auth_method 0 2026-02-17T11:10:39.045 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.026+0000 7fe2bf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:39.045 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.026+0000 7fe2bf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:39.045 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.026+0000 7fe2bf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:39.045 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.026+0000 7fce3bfff640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fce3c0686b0 0x7fce3c0c99a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:33774/0 (socket says 10.20.193.49:33774) 2026-02-17T11:10:39.046 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.026+0000 7fce3bfff640 1 -- 10.20.193.49:0/2688110301 learned_addr learned my addr 10.20.193.49:0/2688110301 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:39.046 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.026+0000 7fce3bfff640 10 monclient(hunting): get_auth_request con 0x7fce3c0686b0 auth_method 0 2026-02-17T11:10:39.046 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.026+0000 7fce3bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:39.046 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.026+0000 7fce3bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:39.046 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.026+0000 7fce3bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:39.046 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.027+0000 7fe2bf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:39.046 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.027+0000 7fe2bf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:39.046 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.027+0000 7fe2bf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:39.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.027+0000 7fce3bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:39.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.027+0000 7fce3bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:39.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.027+0000 7fce3bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:39.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.030+0000 7fe2bf7fe640 10 monclient(hunting): handle_auth_done global_id 4605 payload 824 2026-02-17T11:10:39.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.030+0000 7fe2bf7fe640 1 -- 10.20.193.49:0/3519969738 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe2c015d370 msgr2=0x7fe2c014d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:39.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.030+0000 7fe2bf7fe640 1 --2- 10.20.193.49:0/3519969738 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe2c015d370 0x7fe2c014d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:39.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.030+0000 7fe2bf7fe640 1 -- 10.20.193.49:0/3519969738 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe2c00c7e20 msgr2=0x7fe2c014ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:39.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.030+0000 7fe2bf7fe640 1 --2- 10.20.193.49:0/3519969738 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe2c00c7e20 0x7fe2c014ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:39.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.030+0000 7fe2bf7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:10:39.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.030+0000 7fe2bf7fe640 1 monclient: found mon.noname-a 2026-02-17T11:10:39.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.030+0000 7fe2bf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:39.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.030+0000 7fe2bf7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:10:39.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.030+0000 7fe2bf7fe640 1 -- 10.20.193.49:0/3519969738 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2c014bda0 con 0x7fe2c00c74c0 2026-02-17T11:10:39.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.030+0000 7fce3bfff640 10 monclient(hunting): handle_auth_done global_id 4608 payload 824 2026-02-17T11:10:39.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.030+0000 7fce3bfff640 1 -- 10.20.193.49:0/2688110301 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fce3c1561f0 msgr2=0x7fce3c15b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:39.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.030+0000 7fce3bfff640 1 --2- 10.20.193.49:0/2688110301 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fce3c1561f0 0x7fce3c15b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:39.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.030+0000 7fce3bfff640 1 -- 10.20.193.49:0/2688110301 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fce3c06f700 msgr2=0x7fce3c15aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:39.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.030+0000 7fce3bfff640 1 --2- 10.20.193.49:0/2688110301 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fce3c06f700 0x7fce3c15aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:39.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.030+0000 7fce3bfff640 10 monclient: _finish_hunting 0 2026-02-17T11:10:39.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.030+0000 7fce3bfff640 1 monclient: found mon.noname-a 2026-02-17T11:10:39.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.030+0000 7fce3bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:39.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.030+0000 7fce3bfff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:10:39.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.030+0000 7fce3bfff640 1 -- 10.20.193.49:0/2688110301 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce3c159e10 con 0x7fce3c0686b0 2026-02-17T11:10:39.050 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.031+0000 7fe2bf7fe640 1 --2- 10.20.193.49:0/3519969738 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe2c00c74c0 0x7fe2c00c3d90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac009130 tx=0x7fe2ac0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:39.050 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.031+0000 7fe29bfff640 10 client.?.objecter ms_handle_connect 0x7fe2c00c74c0 2026-02-17T11:10:39.050 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.031+0000 7fe29bfff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:39.050 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.031+0000 7fce3bfff640 1 --2- 10.20.193.49:0/2688110301 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fce3c0686b0 0x7fce3c0c99a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fce2800c730 tx=0x7fce2800cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:39.050 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.031+0000 7fce38ff9640 10 client.?.objecter ms_handle_connect 0x7fce3c0686b0 2026-02-17T11:10:39.050 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.031+0000 7fce38ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:39.051 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.035+0000 7fe29bfff640 1 -- 10.20.193.49:0/3519969738 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac046020 con 0x7fe2c00c74c0 2026-02-17T11:10:39.051 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.035+0000 7fe29bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:39.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.035+0000 7fe29bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:10:39.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.035+0000 7fe29bfff640 10 monclient: dump: 2026-02-17T11:10:39.052 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:39.052 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:39.052 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:39.052 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:39.052 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:39.052 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:39.052 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:39.052 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:39.052 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:39.052 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:39.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.035+0000 7fe29bfff640 10 monclient: _finish_auth 0 2026-02-17T11:10:39.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.035+0000 7fe29bfff640 10 monclient: _check_auth_tickets 2026-02-17T11:10:39.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.035+0000 7fe29bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:39.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.035+0000 7fe29bfff640 1 -- 10.20.193.49:0/3519969738 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2ac0426e0 con 0x7fe2c00c74c0 2026-02-17T11:10:39.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.035+0000 7fe29bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:39.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.035+0000 7fe29bfff640 1 -- 10.20.193.49:0/3519969738 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac03c040 con 0x7fe2c00c74c0 2026-02-17T11:10:39.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.035+0000 7fe29bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:39.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.035+0000 7fe29bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:10:39.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.035+0000 7fe2bdffb640 4 set_mon_vals no callback set 2026-02-17T11:10:39.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.035+0000 7fe29bfff640 10 monclient: dump: 2026-02-17T11:10:39.053 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:39.053 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:39.053 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:39.053 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:39.053 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:39.053 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:39.053 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:39.053 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:39.053 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:39.053 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:39.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.035+0000 7fe2c5b5e640 5 monclient: authenticate success, global_id 4605 2026-02-17T11:10:39.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.035+0000 7fe2c5b5e640 10 monclient: _renew_subs 2026-02-17T11:10:39.054 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.035+0000 7fe2c5b5e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:39.054 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.035+0000 7fe2c5b5e640 1 -- 10.20.193.49:0/3519969738 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2c014c080 con 0x7fe2c00c74c0 2026-02-17T11:10:39.054 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.035+0000 7fe2c5b5e640 10 client.4605.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:39.054 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.035+0000 7fe2c5b5e640 10 monclient: _renew_subs 2026-02-17T11:10:39.054 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.035+0000 7fe2c5b5e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:39.054 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.035+0000 7fe2c5b5e640 1 -- 10.20.193.49:0/3519969738 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2c014c640 con 0x7fe2c00c74c0 2026-02-17T11:10:39.054 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.035+0000 7fe2c5b5e640 1 librados: init done 2026-02-17T11:10:39.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.035+0000 7fce38ff9640 1 -- 10.20.193.49:0/2688110301 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce28017070 con 0x7fce3c0686b0 2026-02-17T11:10:39.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.035+0000 7fce38ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:39.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.035+0000 7fce38ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:10:39.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.035+0000 7fce38ff9640 10 monclient: dump: 2026-02-17T11:10:39.055 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:39.055 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:39.055 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:39.055 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:39.055 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:39.055 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:39.055 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:39.055 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:39.055 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:39.055 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:39.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.035+0000 7fce38ff9640 10 monclient: _finish_auth 0 2026-02-17T11:10:39.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.035+0000 7fce38ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:10:39.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.035+0000 7fce38ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:39.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.035+0000 7fce38ff9640 1 -- 10.20.193.49:0/2688110301 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce28005b90 con 0x7fce3c0686b0 2026-02-17T11:10:39.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.035+0000 7fce38ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:39.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.035+0000 7fce38ff9640 1 -- 10.20.193.49:0/2688110301 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce28007070 con 0x7fce3c0686b0 2026-02-17T11:10:39.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.035+0000 7fce38ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:39.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.035+0000 7fce38ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:10:39.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.035+0000 7fce3a7fc640 4 set_mon_vals no callback set 2026-02-17T11:10:39.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.035+0000 7fce38ff9640 10 monclient: dump: 2026-02-17T11:10:39.056 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:39.056 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:39.056 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:39.056 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:39.056 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:39.056 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:39.056 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:39.056 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:39.056 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:39.056 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:39.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.035+0000 7fce42753640 5 monclient: authenticate success, global_id 4608 2026-02-17T11:10:39.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.035+0000 7fce42753640 10 monclient: _renew_subs 2026-02-17T11:10:39.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.035+0000 7fce42753640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:39.057 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.035+0000 7fce42753640 1 -- 10.20.193.49:0/2688110301 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce3c15a0f0 con 0x7fce3c0686b0 2026-02-17T11:10:39.057 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.035+0000 7fce42753640 10 client.4608.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:39.057 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.035+0000 7fce42753640 10 monclient: _renew_subs 2026-02-17T11:10:39.057 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.035+0000 7fce42753640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:39.057 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.035+0000 7fce42753640 1 -- 10.20.193.49:0/2688110301 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce3c15a6b0 con 0x7fce3c0686b0 2026-02-17T11:10:39.057 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.035+0000 7fce42753640 1 librados: init done 2026-02-17T11:10:39.057 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.035+0000 7fe2c5b5e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:39.057 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.035+0000 7fe2c5b5e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:39.057 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.035+0000 7fe2c5b5e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:39.058 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.035+0000 7fce42753640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:39.058 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.035+0000 7fce42753640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:39.058 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.035+0000 7fce42753640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:39.058 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.035+0000 7fe2c5b5e640 1 -- 10.20.193.49:0/3519969738 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2c015d750 con 0x7fe2c00c74c0 2026-02-17T11:10:39.058 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.035+0000 7fce42753640 1 -- 10.20.193.49:0/2688110301 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce3c068a90 con 0x7fce3c0686b0 2026-02-17T11:10:39.058 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.049+0000 7ff9fe585640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-17T11:10:39.059 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.049+0000 7ff9fe585640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-17T11:10:39.059 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.049+0000 7ff9fe585640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:39.059 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.049+0000 7ff9fe585640 1 -- 10.20.193.49:0/2636840979 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 15} v 0) -- 0x7ff9f80d1f40 con 0x7ff9f80c92a0 2026-02-17T11:10:39.059 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.054+0000 7ff9f4ff9640 1 -- 10.20.193.49:0/2636840979 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 15}]=0 v0) ==== 75+0+12 (secure 0 0 0) 0x7ff9e4087150 con 0x7ff9f80c92a0 2026-02-17T11:10:39.059 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.054+0000 7ff9f4ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-17T11:10:39.059 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.054+0000 7ff9f4ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:39.059 INFO:teuthology.orchestra.run.trial049.stdout:94489280518 2026-02-17T11:10:39.060 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.056+0000 7ff9fe585640 10 librados: watch_flush enter 2026-02-17T11:10:39.060 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.056+0000 7ff9fe585640 10 librados: watch_flush exit 2026-02-17T11:10:39.060 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.056+0000 7ff9fe585640 20 client.4579.objecter shutdown clearing up homeless session... 2026-02-17T11:10:39.060 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.056+0000 7ff9fe585640 10 client.4579.objecter successfully canceled tick 2026-02-17T11:10:39.060 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.056+0000 7ff9fe585640 1 -- 10.20.193.49:0/2636840979 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ff9c80791c0 msgr2=0x7ff9c807b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:39.060 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.056+0000 7ff9fe585640 1 --2- 10.20.193.49:0/2636840979 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ff9c80791c0 0x7ff9c807b680 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff9f8159be0 tx=0x7ff9e8009210 comp rx=0 tx=0).stop 2026-02-17T11:10:39.060 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.056+0000 7ff9fe585640 10 monclient: shutdown 2026-02-17T11:10:39.060 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.056+0000 7ff9fe585640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:39.060 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.056+0000 7ff9fe585640 1 -- 10.20.193.49:0/2636840979 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7ff9f80c92a0 msgr2=0x7ff9f81f4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:39.060 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.056+0000 7ff9fe585640 1 --2- 10.20.193.49:0/2636840979 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7ff9f80c92a0 0x7ff9f81f4220 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4002410 tx=0x7ff9e40047c0 comp rx=0 tx=0).stop 2026-02-17T11:10:39.060 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.056+0000 7ff9fe585640 1 -- 10.20.193.49:0/2636840979 shutdown_connections 2026-02-17T11:10:39.060 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.056+0000 7ff9fe585640 1 --2- 10.20.193.49:0/2636840979 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ff9c80791c0 0x7ff9c807b680 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:39.060 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.056+0000 7ff9fe585640 1 --2- 10.20.193.49:0/2636840979 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff9f815c840 0x7ff9f81f1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:39.061 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.056+0000 7ff9fe585640 1 --2- 10.20.193.49:0/2636840979 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ff9f80d1b60 0x7ff9f815dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:39.061 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.056+0000 7ff9fe585640 1 --2- 10.20.193.49:0/2636840979 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7ff9f80c92a0 0x7ff9f81f4220 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:39.061 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.056+0000 7ff9fe585640 1 -- 10.20.193.49:0/2636840979 >> 10.20.193.49:0/2636840979 conn(0x7ff9f806d9b0 msgr2=0x7ff9f80cfba0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:39.061 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.056+0000 7ff9fe585640 1 -- 10.20.193.49:0/2636840979 shutdown_connections 2026-02-17T11:10:39.061 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.056+0000 7ff9fe585640 1 -- 10.20.193.49:0/2636840979 wait complete. 2026-02-17T11:10:39.061 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.056+0000 7ff9fe585640 1 librados: shutdown 2026-02-17T11:10:39.062 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.061+0000 7f7297bf5640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-17T11:10:39.062 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.061+0000 7f7297bf5640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-17T11:10:39.062 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.061+0000 7f7297bf5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:39.062 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.061+0000 7f7297bf5640 1 -- 10.20.193.49:0/1513569313 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f7290150e50 con 0x7f72900ca040 2026-02-17T11:10:39.066 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280518 got 94489280518 for osd.15 2026-02-17T11:10:39.066 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.064+0000 7f4675cb7640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-17T11:10:39.066 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.064+0000 7f4675cb7640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-17T11:10:39.066 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.064+0000 7f4675cb7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:39.066 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.064+0000 7f4675cb7640 1 -- 10.20.193.49:0/1568831122 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f46700cc2c0 con 0x7f4654003d80 2026-02-17T11:10:39.067 DEBUG:teuthology.parallel:result is None 2026-02-17T11:10:39.069 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.067+0000 7f464bfff640 1 -- 10.20.193.49:0/1568831122 <== mon.2 v2:10.20.193.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f465c035330 con 0x7f4654003d80 2026-02-17T11:10:39.069 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.067+0000 7f464bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-17T11:10:39.069 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.067+0000 7f464bfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:39.069 INFO:teuthology.orchestra.run.trial049.stdout:94489280518 2026-02-17T11:10:39.071 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.069+0000 7f4675cb7640 10 librados: watch_flush enter 2026-02-17T11:10:39.071 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.069+0000 7f4675cb7640 10 librados: watch_flush exit 2026-02-17T11:10:39.071 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.069+0000 7f4675cb7640 20 client.4616.objecter shutdown clearing up homeless session... 2026-02-17T11:10:39.071 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.069+0000 7f4675cb7640 10 client.4616.objecter successfully canceled tick 2026-02-17T11:10:39.071 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.069+0000 7f4675cb7640 1 -- 10.20.193.49:0/1568831122 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f4640079170 msgr2=0x7f464007b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:39.071 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.069+0000 7f4675cb7640 1 --2- 10.20.193.49:0/1568831122 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f4640079170 0x7f464007b630 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f46700d1a90 tx=0x7f46600079d0 comp rx=0 tx=0).stop 2026-02-17T11:10:39.071 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.069+0000 7f4675cb7640 10 monclient: shutdown 2026-02-17T11:10:39.071 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.069+0000 7f4675cb7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:39.071 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.069+0000 7f4675cb7640 1 -- 10.20.193.49:0/1568831122 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f4654003d80 msgr2=0x7f46701e8b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:39.071 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.069+0000 7f4675cb7640 1 --2- 10.20.193.49:0/1568831122 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f4654003d80 0x7f46701e8b40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f465c02f410 tx=0x7f465c0029a0 comp rx=0 tx=0).stop 2026-02-17T11:10:39.071 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.069+0000 7f4675cb7640 1 -- 10.20.193.49:0/1568831122 shutdown_connections 2026-02-17T11:10:39.071 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.069+0000 7f4675cb7640 1 --2- 10.20.193.49:0/1568831122 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f4640079170 0x7f464007b630 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:39.072 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.069+0000 7f4675cb7640 1 --2- 10.20.193.49:0/1568831122 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f4670145100 0x7f46701f7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:39.072 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.069+0000 7f4675cb7640 1 --2- 10.20.193.49:0/1568831122 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f4670144cc0 0x7f46701f7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:39.072 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.069+0000 7f4675cb7640 1 --2- 10.20.193.49:0/1568831122 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f4654003d80 0x7f46701e8b40 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:39.072 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.069+0000 7f4675cb7640 1 -- 10.20.193.49:0/1568831122 >> 10.20.193.49:0/1568831122 conn(0x7f4670073030 msgr2=0x7f46700ce760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:39.072 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.069+0000 7f4675cb7640 1 -- 10.20.193.49:0/1568831122 shutdown_connections 2026-02-17T11:10:39.072 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.069+0000 7f4675cb7640 1 -- 10.20.193.49:0/1568831122 wait complete. 2026-02-17T11:10:39.072 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.069+0000 7f4675cb7640 1 librados: shutdown 2026-02-17T11:10:39.079 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280518 got 94489280518 for osd.2 2026-02-17T11:10:39.079 DEBUG:teuthology.parallel:result is None 2026-02-17T11:10:39.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.239+0000 7fe29bfff640 1 -- 10.20.193.49:0/3519969738 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7fe2ac03f030 con 0x7fe2c00c74c0 2026-02-17T11:10:39.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.240+0000 7fe29bfff640 1 --2- 10.20.193.49:0/3519969738 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fe290079190 0x7fe29007b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:39.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.240+0000 7fe2beffd640 1 --2- 10.20.193.49:0/3519969738 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fe290079190 0x7fe29007b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:39.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.240+0000 7fe2beffd640 10 monclient: get_auth_request con 0x7fe290079190 auth_method 0 2026-02-17T11:10:39.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.241+0000 7fe2beffd640 1 --2- 10.20.193.49:0/3519969738 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fe290079190 0x7fe29007b650 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0007fd0 tx=0x7fe2b0007b20 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:39.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.241+0000 7fe29bfff640 10 client.4605.objecter ms_handle_connect 0x7fe290079190 2026-02-17T11:10:39.248 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.247+0000 7fce38ff9640 1 -- 10.20.193.49:0/2688110301 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7fce28007210 con 0x7fce3c0686b0 2026-02-17T11:10:39.248 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.247+0000 7fce38ff9640 1 --2- 10.20.193.49:0/2688110301 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fce0c079140 0x7fce0c07b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:39.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.247+0000 7fce3b7fe640 1 --2- 10.20.193.49:0/2688110301 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fce0c079140 0x7fce0c07b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:39.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.248+0000 7fce3b7fe640 10 monclient: get_auth_request con 0x7fce0c079140 auth_method 0 2026-02-17T11:10:39.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.248+0000 7fce3b7fe640 1 --2- 10.20.193.49:0/2688110301 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fce0c079140 0x7fce0c07b600 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fce2c002770 tx=0x7fce2c007ab0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:39.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.248+0000 7fce38ff9640 10 client.4608.objecter ms_handle_connect 0x7fce0c079140 2026-02-17T11:10:39.260 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.259+0000 7fe29bfff640 1 -- 10.20.193.49:0/3519969738 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7fe2ac083630 con 0x7fe2c00c74c0 2026-02-17T11:10:39.260 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.259+0000 7fe29bfff640 10 client.4605.objecter ms_dispatch2 0x7fe2c0000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:39.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.259+0000 7fe29bfff640 3 client.4605.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:39.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.259+0000 7fe29bfff640 3 client.4605.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:39.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.259+0000 7fe29bfff640 20 client.4605.objecter dump_active .. 0 homeless 2026-02-17T11:10:39.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.259+0000 7fe29bfff640 1 -- 10.20.193.49:0/3519969738 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe2ac050070 con 0x7fe2c00c74c0 2026-02-17T11:10:39.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.259+0000 7fe29bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:39.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.259+0000 7fe29bfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:39.266 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.265+0000 7fce38ff9640 1 -- 10.20.193.49:0/2688110301 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7fce2805d660 con 0x7fce3c0686b0 2026-02-17T11:10:39.266 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.265+0000 7fce38ff9640 10 client.4608.objecter ms_dispatch2 0x7fce3c000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:39.266 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.265+0000 7fce38ff9640 3 client.4608.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:39.266 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.265+0000 7fce38ff9640 3 client.4608.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:39.267 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.265+0000 7fce38ff9640 20 client.4608.objecter dump_active .. 0 homeless 2026-02-17T11:10:39.267 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.265+0000 7fce38ff9640 1 -- 10.20.193.49:0/2688110301 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fce280c79f0 con 0x7fce3c0686b0 2026-02-17T11:10:39.267 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.265+0000 7fce38ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:39.267 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.265+0000 7fce38ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:39.272 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.271+0000 7f727e7fc640 1 -- 10.20.193.49:0/1513569313 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7280061c40 con 0x7f72900ca040 2026-02-17T11:10:39.272 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.271+0000 7f727e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-17T11:10:39.272 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.271+0000 7f727e7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:39.273 INFO:teuthology.orchestra.run.trial049.stdout:94489280518 2026-02-17T11:10:39.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.273+0000 7f7297bf5640 10 librados: watch_flush enter 2026-02-17T11:10:39.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.273+0000 7f7297bf5640 10 librados: watch_flush exit 2026-02-17T11:10:39.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.273+0000 7f7297bf5640 20 client.4596.objecter shutdown clearing up homeless session... 2026-02-17T11:10:39.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.273+0000 7f7297bf5640 10 client.4596.objecter successfully canceled tick 2026-02-17T11:10:39.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.273+0000 7f7297bf5640 1 -- 10.20.193.49:0/1513569313 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f7260079190 msgr2=0x7f726007b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:39.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.273+0000 7f7297bf5640 1 --2- 10.20.193.49:0/1513569313 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f7260079190 0x7f726007b650 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f729014c550 tx=0x7f7284006cf0 comp rx=0 tx=0).stop 2026-02-17T11:10:39.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.273+0000 7f7297bf5640 10 monclient: shutdown 2026-02-17T11:10:39.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.273+0000 7f7297bf5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:39.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.273+0000 7f7297bf5640 1 -- 10.20.193.49:0/1513569313 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f72900ca040 msgr2=0x7f72901f6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:39.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.273+0000 7f7297bf5640 1 --2- 10.20.193.49:0/1513569313 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f72900ca040 0x7f72901f6080 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f728000b5a0 tx=0x7f728000ba70 comp rx=0 tx=0).stop 2026-02-17T11:10:39.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.273+0000 7f7297bf5640 1 -- 10.20.193.49:0/1513569313 shutdown_connections 2026-02-17T11:10:39.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.273+0000 7f7297bf5640 1 --2- 10.20.193.49:0/1513569313 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f7260079190 0x7f726007b650 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:39.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.273+0000 7f7297bf5640 1 --2- 10.20.193.49:0/1513569313 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f729015fe10 0x7f729014a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:39.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.273+0000 7f7297bf5640 1 --2- 10.20.193.49:0/1513569313 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f72901560e0 0x7f72901f3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:39.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.273+0000 7f7297bf5640 1 --2- 10.20.193.49:0/1513569313 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f72900ca040 0x7f72901f6080 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:39.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.273+0000 7f7297bf5640 1 -- 10.20.193.49:0/1513569313 >> 10.20.193.49:0/1513569313 conn(0x7f7290073030 msgr2=0x7f7290151370 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:39.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.273+0000 7f7297bf5640 1 -- 10.20.193.49:0/1513569313 shutdown_connections 2026-02-17T11:10:39.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.274+0000 7f7297bf5640 1 -- 10.20.193.49:0/1513569313 wait complete. 2026-02-17T11:10:39.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.274+0000 7f7297bf5640 1 librados: shutdown 2026-02-17T11:10:39.284 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280518 got 94489280518 for osd.9 2026-02-17T11:10:39.284 DEBUG:teuthology.parallel:result is None 2026-02-17T11:10:39.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.344+0000 7fe2c5b5e640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-17T11:10:39.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.344+0000 7fe2c5b5e640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-17T11:10:39.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.344+0000 7fe2c5b5e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:39.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.344+0000 7fe2c5b5e640 1 -- 10.20.193.49:0/3519969738 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fe2c00701e0 con 0x7fe2c00c74c0 2026-02-17T11:10:39.349 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.347+0000 7fe29bfff640 1 -- 10.20.193.49:0/3519969738 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe2ac087cf0 con 0x7fe2c00c74c0 2026-02-17T11:10:39.349 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.347+0000 7fe29bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-17T11:10:39.349 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.347+0000 7fe29bfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:39.350 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.347+0000 7fce42753640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-17T11:10:39.350 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.347+0000 7fce42753640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-17T11:10:39.350 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.347+0000 7fce42753640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:39.350 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.347+0000 7fce42753640 1 -- 10.20.193.49:0/2688110301 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fce3c06ed10 con 0x7fce3c0686b0 2026-02-17T11:10:39.350 INFO:teuthology.orchestra.run.trial049.stdout:111669149705 2026-02-17T11:10:39.352 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.348+0000 7fe2c5b5e640 10 librados: watch_flush enter 2026-02-17T11:10:39.352 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.348+0000 7fe2c5b5e640 10 librados: watch_flush exit 2026-02-17T11:10:39.352 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.348+0000 7fe2c5b5e640 20 client.4605.objecter shutdown clearing up homeless session... 2026-02-17T11:10:39.352 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.348+0000 7fe2c5b5e640 10 client.4605.objecter successfully canceled tick 2026-02-17T11:10:39.352 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.348+0000 7fe2c5b5e640 1 -- 10.20.193.49:0/3519969738 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fe290079190 msgr2=0x7fe29007b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:39.352 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.348+0000 7fe2c5b5e640 1 --2- 10.20.193.49:0/3519969738 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fe290079190 0x7fe29007b650 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0007fd0 tx=0x7fe2b0007b20 comp rx=0 tx=0).stop 2026-02-17T11:10:39.352 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.348+0000 7fe2c5b5e640 10 monclient: shutdown 2026-02-17T11:10:39.352 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.348+0000 7fe2c5b5e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:39.352 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.348+0000 7fe2c5b5e640 1 -- 10.20.193.49:0/3519969738 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe2c00c74c0 msgr2=0x7fe2c00c3d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:39.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.348+0000 7fe2c5b5e640 1 --2- 10.20.193.49:0/3519969738 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe2c00c74c0 0x7fe2c00c3d90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac009130 tx=0x7fe2ac0047c0 comp rx=0 tx=0).stop 2026-02-17T11:10:39.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.348+0000 7fe2c5b5e640 1 -- 10.20.193.49:0/3519969738 shutdown_connections 2026-02-17T11:10:39.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.348+0000 7fe2c5b5e640 1 --2- 10.20.193.49:0/3519969738 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fe290079190 0x7fe29007b650 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:39.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.348+0000 7fe2c5b5e640 1 --2- 10.20.193.49:0/3519969738 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe2c015d370 0x7fe2c014d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:39.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.348+0000 7fe2c5b5e640 1 --2- 10.20.193.49:0/3519969738 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe2c00c7e20 0x7fe2c014ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:39.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.348+0000 7fe2c5b5e640 1 --2- 10.20.193.49:0/3519969738 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe2c00c74c0 0x7fe2c00c3d90 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:39.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.348+0000 7fe2c5b5e640 1 -- 10.20.193.49:0/3519969738 >> 10.20.193.49:0/3519969738 conn(0x7fe2c00c9f20 msgr2=0x7fe2c00ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:39.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.348+0000 7fe2c5b5e640 1 -- 10.20.193.49:0/3519969738 shutdown_connections 2026-02-17T11:10:39.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.348+0000 7fe2c5b5e640 1 -- 10.20.193.49:0/3519969738 wait complete. 2026-02-17T11:10:39.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.348+0000 7fe2c5b5e640 1 librados: shutdown 2026-02-17T11:10:39.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.350+0000 7fce38ff9640 1 -- 10.20.193.49:0/2688110301 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fce28021020 con 0x7fce3c0686b0 2026-02-17T11:10:39.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.350+0000 7fce38ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-17T11:10:39.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.350+0000 7fce38ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:39.354 INFO:teuthology.orchestra.run.trial049.stdout:90194313222 2026-02-17T11:10:39.355 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.351+0000 7fce42753640 10 librados: watch_flush enter 2026-02-17T11:10:39.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.351+0000 7fce42753640 10 librados: watch_flush exit 2026-02-17T11:10:39.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.351+0000 7fce42753640 20 client.4608.objecter shutdown clearing up homeless session... 2026-02-17T11:10:39.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.351+0000 7fce42753640 10 client.4608.objecter successfully canceled tick 2026-02-17T11:10:39.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.351+0000 7fce42753640 1 -- 10.20.193.49:0/2688110301 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fce0c079140 msgr2=0x7fce0c07b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:39.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.351+0000 7fce42753640 1 --2- 10.20.193.49:0/2688110301 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fce0c079140 0x7fce0c07b600 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fce2c002770 tx=0x7fce2c007ab0 comp rx=0 tx=0).stop 2026-02-17T11:10:39.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.351+0000 7fce42753640 10 monclient: shutdown 2026-02-17T11:10:39.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.351+0000 7fce42753640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:39.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.351+0000 7fce42753640 1 -- 10.20.193.49:0/2688110301 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fce3c0686b0 msgr2=0x7fce3c0c99a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:39.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.351+0000 7fce42753640 1 --2- 10.20.193.49:0/2688110301 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fce3c0686b0 0x7fce3c0c99a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fce2800c730 tx=0x7fce2800cc00 comp rx=0 tx=0).stop 2026-02-17T11:10:39.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.351+0000 7fce42753640 1 -- 10.20.193.49:0/2688110301 shutdown_connections 2026-02-17T11:10:39.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.351+0000 7fce42753640 1 --2- 10.20.193.49:0/2688110301 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fce0c079140 0x7fce0c07b600 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:39.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.351+0000 7fce42753640 1 --2- 10.20.193.49:0/2688110301 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fce3c1561f0 0x7fce3c15b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:39.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.351+0000 7fce42753640 1 --2- 10.20.193.49:0/2688110301 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fce3c06f700 0x7fce3c15aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:39.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.351+0000 7fce42753640 1 --2- 10.20.193.49:0/2688110301 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fce3c0686b0 0x7fce3c0c99a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:39.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.351+0000 7fce42753640 1 -- 10.20.193.49:0/2688110301 >> 10.20.193.49:0/2688110301 conn(0x7fce3c0cb3a0 msgr2=0x7fce3c06ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:39.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.351+0000 7fce42753640 1 -- 10.20.193.49:0/2688110301 shutdown_connections 2026-02-17T11:10:39.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.351+0000 7fce42753640 1 -- 10.20.193.49:0/2688110301 wait complete. 2026-02-17T11:10:39.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.351+0000 7fce42753640 1 librados: shutdown 2026-02-17T11:10:39.359 INFO:tasks.ceph.ceph_manager.ceph:need seq 111669149704 got 111669149705 for osd.0 2026-02-17T11:10:39.359 DEBUG:teuthology.parallel:result is None 2026-02-17T11:10:39.361 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313222 got 90194313222 for osd.4 2026-02-17T11:10:39.361 DEBUG:teuthology.parallel:result is None 2026-02-17T11:10:39.362 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-17T11:10:39.362 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:10:39.469 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.467+0000 7f77a1f0a640 10 monclient: get_monmap_and_config 2026-02-17T11:10:39.469 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.467+0000 7f77a1f0a640 10 monclient: build_initial_monmap 2026-02-17T11:10:39.469 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.467+0000 7f77a1f0a640 10 monclient: monmap: 2026-02-17T11:10:39.469 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:39.469 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:39.470 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:39.468434+0000 2026-02-17T11:10:39.470 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:39.468434+0000 2026-02-17T11:10:39.470 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:39.470 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:39.470 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:39.470 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:39.470 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:39.470 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:39.470 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:39.470 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:39.470 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:39.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.468+0000 7f77a1f0a640 1 Processor -- start 2026-02-17T11:10:39.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.468+0000 7f77a1f0a640 1 -- start start 2026-02-17T11:10:39.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.468+0000 7f77a1f0a640 10 monclient: init 2026-02-17T11:10:39.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.468+0000 7f77a1f0a640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:39.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.468+0000 7f77a1f0a640 10 monclient: _add_conns ranks=[3,5,4,0,2,1] 2026-02-17T11:10:39.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.468+0000 7f77a1f0a640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f779c152820 0x7f779c1593f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:39.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.468+0000 7f77a1f0a640 10 monclient(hunting): picked mon.noname-a con 0x7f779c152820 addr v2:10.20.193.49:3300/0 2026-02-17T11:10:39.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.468+0000 7f77a1f0a640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f779c152c00 0x7f779c0c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:39.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.468+0000 7f77a1f0a640 10 monclient(hunting): picked mon.noname-c con 0x7f779c152c00 addr v2:10.20.193.157:3300/0 2026-02-17T11:10:39.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.468+0000 7f77a1f0a640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f779c0738f0 0x7f779c0c5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:39.475 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.468+0000 7f77a1f0a640 10 monclient(hunting): picked mon.noname-b con 0x7f779c0738f0 addr v2:10.20.193.97:3300/0 2026-02-17T11:10:39.475 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.468+0000 7f77a1f0a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:39.475 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.468+0000 7f77a1f0a640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f779c159930 con 0x7f779c152820 2026-02-17T11:10:39.475 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.468+0000 7f77a1f0a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:39.475 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.468+0000 7f77a1f0a640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f779c073e90 con 0x7f779c0738f0 2026-02-17T11:10:39.475 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.468+0000 7f77a1f0a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:39.475 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.468+0000 7f77a1f0a640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f779c074170 con 0x7f779c152c00 2026-02-17T11:10:39.475 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.468+0000 7f77a1f0a640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:39.475 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.468+0000 7f77a1f0a640 10 monclient(hunting): authenticate will time out at 1116.131926s 2026-02-17T11:10:39.475 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.469+0000 7f779b7fe640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f779c152820 0x7f779c1593f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:39.475 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.469+0000 7f779affd640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f779c152c00 0x7f779c0c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:39.475 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.469+0000 7f779bfff640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f779c0738f0 0x7f779c0c5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:39.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.469+0000 7f779bfff640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f779c0738f0 0x7f779c0c5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:55860/0 (socket says 10.20.193.49:55860) 2026-02-17T11:10:39.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.469+0000 7f779bfff640 1 -- 10.20.193.49:0/2091295916 learned_addr learned my addr 10.20.193.49:0/2091295916 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:39.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.469+0000 7f779b7fe640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f779c152820 0x7f779c1593f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:33794/0 (socket says 10.20.193.49:33794) 2026-02-17T11:10:39.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.469+0000 7f779bfff640 10 monclient(hunting): get_auth_request con 0x7f779c0738f0 auth_method 0 2026-02-17T11:10:39.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.469+0000 7f779bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:39.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.469+0000 7f779bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:39.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.469+0000 7f779bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:39.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.469+0000 7f779b7fe640 10 monclient(hunting): get_auth_request con 0x7f779c152820 auth_method 0 2026-02-17T11:10:39.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.469+0000 7f779b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:39.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.469+0000 7f779b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:39.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.469+0000 7f779b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:39.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.469+0000 7f779affd640 10 monclient(hunting): get_auth_request con 0x7f779c152c00 auth_method 0 2026-02-17T11:10:39.477 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.469+0000 7f779affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:39.477 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.469+0000 7f779affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:39.477 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.469+0000 7f779affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:39.477 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.469+0000 7f779bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:39.477 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.469+0000 7f779bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:39.477 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.469+0000 7f779bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:39.477 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.469+0000 7f779b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:39.477 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.469+0000 7f779b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:39.477 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.469+0000 7f779b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:39.477 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.470+0000 7f779affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:39.477 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.470+0000 7f779affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:39.477 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.470+0000 7f779affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:39.477 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.470+0000 7f779bfff640 10 monclient(hunting): handle_auth_done global_id 4585 payload 274 2026-02-17T11:10:39.478 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.470+0000 7f779bfff640 1 -- 10.20.193.49:0/2091295916 >> v2:10.20.193.157:3300/0 conn(0x7f779c152c00 msgr2=0x7f779c0c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:39.478 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.470+0000 7f779bfff640 1 --2- 10.20.193.49:0/2091295916 >> v2:10.20.193.157:3300/0 conn(0x7f779c152c00 0x7f779c0c7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:39.478 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.470+0000 7f779bfff640 1 -- 10.20.193.49:0/2091295916 >> v2:10.20.193.49:3300/0 conn(0x7f779c152820 msgr2=0x7f779c1593f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:39.478 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.470+0000 7f779bfff640 1 --2- 10.20.193.49:0/2091295916 >> v2:10.20.193.49:3300/0 conn(0x7f779c152820 0x7f779c1593f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:39.478 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.470+0000 7f779bfff640 10 monclient: _finish_hunting 0 2026-02-17T11:10:39.478 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.470+0000 7f779bfff640 1 monclient: found mon.noname-b 2026-02-17T11:10:39.478 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.470+0000 7f779bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:39.478 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.470+0000 7f779bfff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:10:39.478 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.470+0000 7f779bfff640 1 -- 10.20.193.49:0/2091295916 --> v2:10.20.193.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f779c074450 con 0x7f779c0738f0 2026-02-17T11:10:39.478 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.471+0000 7f779bfff640 1 --2- 10.20.193.49:0/2091295916 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f779c0738f0 0x7f779c0c5ce0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f779c069ce0 tx=0x7f779002f2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce1b80e3a6eb102a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:39.484 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.473+0000 7f779a7fc640 1 -- 10.20.193.49:0/2091295916 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f779002fd80 con 0x7f779c0738f0 2026-02-17T11:10:39.485 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.473+0000 7f779a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:39.485 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.473+0000 7f779a7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:10:39.485 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.473+0000 7f779a7fc640 10 monclient: dump: 2026-02-17T11:10:39.485 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:39.485 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:39.485 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:39.485 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:39.485 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:39.485 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:39.485 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:39.485 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:39.486 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:39.486 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:39.486 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.473+0000 7f779a7fc640 10 monclient: _finish_auth 0 2026-02-17T11:10:39.486 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.473+0000 7f779a7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:10:39.486 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.473+0000 7f779a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:39.486 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.473+0000 7f779a7fc640 1 -- 10.20.193.49:0/2091295916 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77900373f0 con 0x7f779c0738f0 2026-02-17T11:10:39.486 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.473+0000 7f77a1f0a640 5 monclient: authenticate success, global_id 4585 2026-02-17T11:10:39.486 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.473+0000 7f77a1f0a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:10:39.486 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.473+0000 7f779a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:39.486 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.473+0000 7f779a7fc640 1 -- 10.20.193.49:0/2091295916 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77900377c0 con 0x7f779c0738f0 2026-02-17T11:10:39.486 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.473+0000 7f779a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:39.487 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.473+0000 7f779a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:39.487 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.473+0000 7f779a7fc640 10 monclient: dump: 2026-02-17T11:10:39.487 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:39.487 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:39.487 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:39.487 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:39.487 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:39.487 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:39.487 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:39.487 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:39.487 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:39.487 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:39.488 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.473+0000 7f77a1f0a640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:39.488 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.473+0000 7f77a1f0a640 4 set_mon_vals no callback set 2026-02-17T11:10:39.488 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.473+0000 7f77a1f0a640 10 monclient: shutdown 2026-02-17T11:10:39.488 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.473+0000 7f77a1f0a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:39.488 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.473+0000 7f77a1f0a640 1 -- 10.20.193.49:0/2091295916 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f779c0738f0 msgr2=0x7f779c0c5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:39.488 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.473+0000 7f77a1f0a640 1 --2- 10.20.193.49:0/2091295916 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f779c0738f0 0x7f779c0c5ce0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f779c069ce0 tx=0x7f779002f2d0 comp rx=0 tx=0).stop 2026-02-17T11:10:39.488 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.473+0000 7f77a1f0a640 1 -- 10.20.193.49:0/2091295916 shutdown_connections 2026-02-17T11:10:39.488 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.473+0000 7f77a1f0a640 1 --2- 10.20.193.49:0/2091295916 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f779c0738f0 0x7f779c0c5ce0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:39.488 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.473+0000 7f77a1f0a640 1 --2- 10.20.193.49:0/2091295916 >> v2:10.20.193.157:3300/0 conn(0x7f779c152c00 0x7f779c0c7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:39.488 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.473+0000 7f77a1f0a640 1 --2- 10.20.193.49:0/2091295916 >> v2:10.20.193.49:3300/0 conn(0x7f779c152820 0x7f779c1593f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:39.488 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.473+0000 7f77a1f0a640 1 -- 10.20.193.49:0/2091295916 >> 10.20.193.49:0/2091295916 conn(0x7f779c0c9f40 msgr2=0x7f779c0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:39.488 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.474+0000 7f77a1f0a640 1 -- 10.20.193.49:0/2091295916 shutdown_connections 2026-02-17T11:10:39.489 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.474+0000 7f77a1f0a640 1 -- 10.20.193.49:0/2091295916 wait complete. 2026-02-17T11:10:39.489 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.474+0000 7f77a1f0a640 10 monclient: build_initial_monmap 2026-02-17T11:10:39.489 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.474+0000 7f77a1f0a640 10 monclient: monmap: 2026-02-17T11:10:39.489 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:39.489 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:39.489 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:39.489 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:39.489 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:39.489 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:39.489 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:39.489 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:39.489 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:39.489 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:39.490 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.474+0000 7f77a1f0a640 1 librados: starting msgr at 2026-02-17T11:10:39.490 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.474+0000 7f77a1f0a640 1 librados: starting objecter 2026-02-17T11:10:39.490 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.474+0000 7f77a1f0a640 1 Processor -- start 2026-02-17T11:10:39.490 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.474+0000 7f77a1f0a640 1 -- start start 2026-02-17T11:10:39.490 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.474+0000 7f77a1f0a640 1 librados: setting wanted keys 2026-02-17T11:10:39.490 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.474+0000 7f77a1f0a640 1 librados: calling monclient init 2026-02-17T11:10:39.490 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.474+0000 7f77a1f0a640 10 monclient: init 2026-02-17T11:10:39.490 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.475+0000 7f77a1f0a640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:39.490 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.475+0000 7f77a1f0a640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:10:39.490 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.475+0000 7f77a1f0a640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f779c0738f0 0x7f779c141980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:39.490 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.475+0000 7f77a1f0a640 10 monclient(hunting): picked mon.noname-a con 0x7f779c0738f0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:39.490 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.475+0000 7f77a1f0a640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f779c152820 0x7f779c06d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:39.491 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.475+0000 7f77a1f0a640 10 monclient(hunting): picked mon.noname-b con 0x7f779c152820 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:39.491 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.475+0000 7f77a1f0a640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f779c152c00 0x7f779c06dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:39.491 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.475+0000 7f77a1f0a640 10 monclient(hunting): picked mon.noname-c con 0x7f779c152c00 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:39.491 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.475+0000 7f77a1f0a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:39.491 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.475+0000 7f77a1f0a640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f779c074cf0 con 0x7f779c0738f0 2026-02-17T11:10:39.491 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.475+0000 7f77a1f0a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:39.491 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.475+0000 7f77a1f0a640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f779c074a10 con 0x7f779c152820 2026-02-17T11:10:39.491 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.475+0000 7f77a1f0a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:39.491 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.475+0000 7f77a1f0a640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f779c0c6220 con 0x7f779c152c00 2026-02-17T11:10:39.491 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.475+0000 7f77a1f0a640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:39.491 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.475+0000 7f77a1f0a640 10 monclient(hunting): authenticate will time out at 1116.138286s 2026-02-17T11:10:39.491 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.475+0000 7f779b7fe640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f779c0738f0 0x7f779c141980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:39.492 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.475+0000 7f779bfff640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f779c152c00 0x7f779c06dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:39.492 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.475+0000 7f779b7fe640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f779c0738f0 0x7f779c141980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:33798/0 (socket says 10.20.193.49:33798) 2026-02-17T11:10:39.492 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.475+0000 7f779b7fe640 1 -- 10.20.193.49:0/1891300052 learned_addr learned my addr 10.20.193.49:0/1891300052 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:39.492 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.475+0000 7f779b7fe640 10 monclient(hunting): get_auth_request con 0x7f779c0738f0 auth_method 0 2026-02-17T11:10:39.492 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.475+0000 7f779b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:39.492 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.475+0000 7f779b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:39.492 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.475+0000 7f779b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:39.492 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.475+0000 7f779affd640 1 --2- 10.20.193.49:0/1891300052 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f779c152820 0x7f779c06d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:39.492 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.475+0000 7f779bfff640 10 monclient(hunting): get_auth_request con 0x7f779c152c00 auth_method 0 2026-02-17T11:10:39.492 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.475+0000 7f779bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:39.492 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.475+0000 7f779bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:39.493 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.475+0000 7f779bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:39.493 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.475+0000 7f779affd640 10 monclient(hunting): get_auth_request con 0x7f779c152820 auth_method 0 2026-02-17T11:10:39.493 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.475+0000 7f779affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:39.493 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.475+0000 7f779affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:39.493 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.475+0000 7f779affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:39.493 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.476+0000 7f779b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:39.493 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.476+0000 7f779b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:39.493 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.476+0000 7f779b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:39.493 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.476+0000 7f779bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:39.493 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.476+0000 7f779bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:39.493 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.476+0000 7f779bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:39.493 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.476+0000 7f779affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:39.493 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.476+0000 7f779affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:39.494 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.476+0000 7f779affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:39.494 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.477+0000 7f779bfff640 10 monclient(hunting): handle_auth_done global_id 4622 payload 824 2026-02-17T11:10:39.494 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.477+0000 7f779bfff640 1 -- 10.20.193.49:0/1891300052 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f779c152820 msgr2=0x7f779c06d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:39.494 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.477+0000 7f779bfff640 1 --2- 10.20.193.49:0/1891300052 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f779c152820 0x7f779c06d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:39.494 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.477+0000 7f779bfff640 1 -- 10.20.193.49:0/1891300052 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f779c0738f0 msgr2=0x7f779c141980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:39.494 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.477+0000 7f779bfff640 1 --2- 10.20.193.49:0/1891300052 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f779c0738f0 0x7f779c141980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:39.494 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.477+0000 7f779bfff640 10 monclient: _finish_hunting 0 2026-02-17T11:10:39.494 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.477+0000 7f779bfff640 1 monclient: found mon.noname-c 2026-02-17T11:10:39.494 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.477+0000 7f779bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:39.494 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.477+0000 7f779bfff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:10:39.494 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.477+0000 7f779bfff640 1 -- 10.20.193.49:0/1891300052 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f779c144d40 con 0x7f779c152c00 2026-02-17T11:10:39.494 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.478+0000 7f779bfff640 1 --2- 10.20.193.49:0/1891300052 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f779c152c00 0x7f779c06dac0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f779c074010 tx=0x7f7790004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:39.495 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.478+0000 7f7777fff640 10 client.?.objecter ms_handle_connect 0x7f779c152c00 2026-02-17T11:10:39.495 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.478+0000 7f7777fff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:39.495 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.479+0000 7f7777fff640 1 -- 10.20.193.49:0/1891300052 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7790046020 con 0x7f779c152c00 2026-02-17T11:10:39.495 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.479+0000 7f7777fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:39.495 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.479+0000 7f7777fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:10:39.495 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.479+0000 7f7777fff640 10 monclient: dump: 2026-02-17T11:10:39.495 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:39.495 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:39.495 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:39.495 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:39.495 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:39.495 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:39.495 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:39.496 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:39.496 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:39.496 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:39.496 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.479+0000 7f7777fff640 10 monclient: _finish_auth 0 2026-02-17T11:10:39.496 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.479+0000 7f7777fff640 10 monclient: _check_auth_tickets 2026-02-17T11:10:39.496 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.479+0000 7f7777fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:39.496 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.479+0000 7f77a1f0a640 5 monclient: authenticate success, global_id 4622 2026-02-17T11:10:39.496 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.479+0000 7f77a1f0a640 10 monclient: _renew_subs 2026-02-17T11:10:39.496 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.479+0000 7f77a1f0a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:39.496 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.479+0000 7f77a1f0a640 1 -- 10.20.193.49:0/1891300052 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f779c145020 con 0x7f779c152c00 2026-02-17T11:10:39.496 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.479+0000 7f77a1f0a640 10 client.4622.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:39.496 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.479+0000 7f77a1f0a640 10 monclient: _renew_subs 2026-02-17T11:10:39.497 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.479+0000 7f77a1f0a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:39.497 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.479+0000 7f77a1f0a640 1 -- 10.20.193.49:0/1891300052 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f779c1455e0 con 0x7f779c152c00 2026-02-17T11:10:39.497 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.479+0000 7f77a1f0a640 1 librados: init done 2026-02-17T11:10:39.497 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.480+0000 7f77a1f0a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:39.497 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.480+0000 7f77a1f0a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:39.497 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.480+0000 7f77a1f0a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:10:39.497 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.480+0000 7f77a1f0a640 1 -- 10.20.193.49:0/1891300052 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f779c0c76a0 con 0x7f779c152c00 2026-02-17T11:10:39.497 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.480+0000 7f7777fff640 1 -- 10.20.193.49:0/1891300052 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77900373f0 con 0x7f779c152c00 2026-02-17T11:10:39.497 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.480+0000 7f7777fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:39.497 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.480+0000 7f7777fff640 1 -- 10.20.193.49:0/1891300052 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7790009510 con 0x7f779c152c00 2026-02-17T11:10:39.497 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.480+0000 7f7777fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:39.497 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.480+0000 7f7777fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:10:39.498 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.480+0000 7f7777fff640 10 monclient: dump: 2026-02-17T11:10:39.498 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:39.498 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:39.498 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:39.498 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:39.498 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:39.498 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:39.498 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:39.498 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:39.498 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:39.498 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:39.498 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.480+0000 7f7799ffb640 4 set_mon_vals no callback set 2026-02-17T11:10:39.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.586+0000 7f7777fff640 1 -- 10.20.193.49:0/1891300052 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f7790041710 con 0x7f779c152c00 2026-02-17T11:10:39.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.586+0000 7f7777fff640 1 --2- 10.20.193.49:0/1891300052 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f776c079140 0x7f776c07b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:39.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.586+0000 7f779b7fe640 1 --2- 10.20.193.49:0/1891300052 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f776c079140 0x7f776c07b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:39.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.586+0000 7f779b7fe640 10 monclient: get_auth_request con 0x7f776c079140 auth_method 0 2026-02-17T11:10:39.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.587+0000 7f779b7fe640 1 --2- 10.20.193.49:0/1891300052 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f776c079140 0x7f776c07b600 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f779c142440 tx=0x7f7788009290 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:39.589 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.587+0000 7f7777fff640 10 client.4622.objecter ms_handle_connect 0x7f776c079140 2026-02-17T11:10:39.589 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.588+0000 7f7777fff640 1 -- 10.20.193.49:0/1891300052 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7f7790083a20 con 0x7f779c152c00 2026-02-17T11:10:39.590 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.588+0000 7f7777fff640 10 client.4622.objecter ms_dispatch2 0x7f779c000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:39.590 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.588+0000 7f7777fff640 3 client.4622.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:39.590 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.588+0000 7f7777fff640 3 client.4622.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:39.590 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.588+0000 7f7777fff640 20 client.4622.objecter dump_active .. 0 homeless 2026-02-17T11:10:39.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.594+0000 7f7777fff640 1 -- 10.20.193.49:0/1891300052 <== mon.2 v2:10.20.193.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f7790050030 con 0x7f779c152c00 2026-02-17T11:10:39.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.595+0000 7f7777fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:39.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.595+0000 7f7777fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:39.677 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.676+0000 7f77a1f0a640 1 -- 10.20.193.49:0/1891300052 --> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f779c156320 con 0x7f776c079140 2026-02-17T11:10:39.679 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.677+0000 7f7777fff640 1 -- 10.20.193.49:0/1891300052 <== mgr.4106 v2:10.20.193.162:6800/2614632098 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+44795 (secure 0 0 0) 0x7f779c156320 con 0x7f776c079140 2026-02-17T11:10:39.680 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:10:39.682 INFO:teuthology.orchestra.run.trial049.stderr:dumped all 2026-02-17T11:10:39.682 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.678+0000 7f77a1f0a640 10 librados: watch_flush enter 2026-02-17T11:10:39.682 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.678+0000 7f77a1f0a640 10 librados: watch_flush exit 2026-02-17T11:10:39.682 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.678+0000 7f77a1f0a640 20 client.4622.objecter shutdown clearing up homeless session... 2026-02-17T11:10:39.682 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.678+0000 7f77a1f0a640 10 client.4622.objecter successfully canceled tick 2026-02-17T11:10:39.683 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.678+0000 7f77a1f0a640 1 -- 10.20.193.49:0/1891300052 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f776c079140 msgr2=0x7f776c07b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:39.683 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.678+0000 7f77a1f0a640 1 --2- 10.20.193.49:0/1891300052 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f776c079140 0x7f776c07b600 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f779c142440 tx=0x7f7788009290 comp rx=0 tx=0).stop 2026-02-17T11:10:39.683 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.678+0000 7f77a1f0a640 10 monclient: shutdown 2026-02-17T11:10:39.683 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.678+0000 7f77a1f0a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:39.683 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.678+0000 7f77a1f0a640 1 -- 10.20.193.49:0/1891300052 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f779c152c00 msgr2=0x7f779c06dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:39.683 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.678+0000 7f77a1f0a640 1 --2- 10.20.193.49:0/1891300052 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f779c152c00 0x7f779c06dac0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f779c074010 tx=0x7f7790004b40 comp rx=0 tx=0).stop 2026-02-17T11:10:39.683 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.678+0000 7f77a1f0a640 1 -- 10.20.193.49:0/1891300052 shutdown_connections 2026-02-17T11:10:39.683 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.678+0000 7f77a1f0a640 1 --2- 10.20.193.49:0/1891300052 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f776c079140 0x7f776c07b600 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:39.683 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.678+0000 7f77a1f0a640 1 --2- 10.20.193.49:0/1891300052 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f779c152c00 0x7f779c06dac0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:39.683 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.678+0000 7f77a1f0a640 1 --2- 10.20.193.49:0/1891300052 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f779c152820 0x7f779c06d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:39.683 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.678+0000 7f77a1f0a640 1 --2- 10.20.193.49:0/1891300052 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f779c0738f0 0x7f779c141980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:39.684 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.678+0000 7f77a1f0a640 1 -- 10.20.193.49:0/1891300052 >> 10.20.193.49:0/1891300052 conn(0x7f779c0c9f40 msgr2=0x7f779c0c7af0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:39.684 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.678+0000 7f77a1f0a640 1 -- 10.20.193.49:0/1891300052 shutdown_connections 2026-02-17T11:10:39.684 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.678+0000 7f77a1f0a640 1 -- 10.20.193.49:0/1891300052 wait complete. 2026-02-17T11:10:39.684 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.678+0000 7f77a1f0a640 1 librados: shutdown 2026-02-17T11:10:39.689 INFO:teuthology.orchestra.run.trial049.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2026-02-17T11:10:38.454448+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459299,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":59,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":12,"kb":1509949440,"kb_used":437856,"kb_used_data":6376,"kb_used_omap":24,"kb_used_meta":431079,"kb_avail":1509511584,"statfs":{"total":1546188226560,"available":1545739862016,"internally_reserved":0,"allocated":6529024,"data_stored":3276512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25501,"internal_metadata":441424995},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[" osd: 0 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 1 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 4 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 5 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 6 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 8 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 9 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 10 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 12 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 13 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 14 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":131107,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":18,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.866087"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T11:10:34.390486+0000","last_change":"2026-02-17T11:10:34.390486+0000","last_active":"2026-02-17T11:10:34.390486+0000","last_peered":"2026-02-17T11:10:34.390486+0000","last_clean":"2026-02-17T11:10:34.390486+0000","last_became_active":"2026-02-17T11:10:31.882486+0000","last_became_peered":"2026-02-17T11:10:31.882486+0000","last_unstale":"2026-02-17T11:10:34.390486+0000","last_undegraded":"2026-02-17T11:10:34.390486+0000","last_fullsized":"2026-02-17T11:10:34.390486+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_clean_scrub_stamp":"2026-02-17T11:10:30.447281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:57:41.179473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.031448708999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,10],"acting":[15,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T11:10:34.082564+0000","last_change":"2026-02-17T11:10:34.082564+0000","last_active":"2026-02-17T11:10:34.082564+0000","last_peered":"2026-02-17T11:10:34.082564+0000","last_clean":"2026-02-17T11:10:34.082564+0000","last_became_active":"2026-02-17T11:10:32.011352+0000","last_became_peered":"2026-02-17T11:10:32.011352+0000","last_unstale":"2026-02-17T11:10:34.082564+0000","last_undegraded":"2026-02-17T11:10:34.082564+0000","last_fullsized":"2026-02-17T11:10:34.082564+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_clean_scrub_stamp":"2026-02-17T11:10:30.447281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:32:07.479731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030517882999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,13],"acting":[8,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T11:10:34.580857+0000","last_change":"2026-02-17T11:10:34.580857+0000","last_active":"2026-02-17T11:10:34.580857+0000","last_peered":"2026-02-17T11:10:34.580857+0000","last_clean":"2026-02-17T11:10:34.580857+0000","last_became_active":"2026-02-17T11:10:31.774687+0000","last_became_peered":"2026-02-17T11:10:31.774687+0000","last_unstale":"2026-02-17T11:10:34.580857+0000","last_undegraded":"2026-02-17T11:10:34.580857+0000","last_fullsized":"2026-02-17T11:10:34.580857+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_clean_scrub_stamp":"2026-02-17T11:10:30.447281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:22:12.754481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.034911202000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4],"acting":[9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T11:10:34.560578+0000","last_change":"2026-02-17T11:10:34.579397+0000","last_active":"2026-02-17T11:10:34.560578+0000","last_peered":"2026-02-17T11:10:34.560578+0000","last_clean":"2026-02-17T11:10:34.560578+0000","last_became_active":"2026-02-17T11:10:31.919932+0000","last_became_peered":"2026-02-17T11:10:31.919932+0000","last_unstale":"2026-02-17T11:10:34.560578+0000","last_undegraded":"2026-02-17T11:10:34.560578+0000","last_fullsized":"2026-02-17T11:10:34.560578+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_clean_scrub_stamp":"2026-02-17T11:10:30.447281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:52:51.393067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.034931859000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"33'2","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T11:10:33.856528+0000","last_change":"2026-02-17T11:10:33.847595+0000","last_active":"2026-02-17T11:10:33.856528+0000","last_peered":"2026-02-17T11:10:33.856528+0000","last_clean":"2026-02-17T11:10:33.856528+0000","last_became_active":"2026-02-17T11:10:31.924469+0000","last_became_peered":"2026-02-17T11:10:31.924469+0000","last_unstale":"2026-02-17T11:10:33.856528+0000","last_undegraded":"2026-02-17T11:10:33.856528+0000","last_fullsized":"2026-02-17T11:10:33.856528+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_clean_scrub_stamp":"2026-02-17T11:10:30.447281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:39:57.389842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057723655999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,12],"acting":[3,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T11:10:33.774326+0000","last_change":"2026-02-17T11:10:33.798221+0000","last_active":"2026-02-17T11:10:33.774326+0000","last_peered":"2026-02-17T11:10:33.774326+0000","last_clean":"2026-02-17T11:10:33.774326+0000","last_became_active":"2026-02-17T11:10:31.972595+0000","last_became_peered":"2026-02-17T11:10:31.972595+0000","last_unstale":"2026-02-17T11:10:33.774326+0000","last_undegraded":"2026-02-17T11:10:33.774326+0000","last_fullsized":"2026-02-17T11:10:33.774326+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_clean_scrub_stamp":"2026-02-17T11:10:30.447281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:29:40.302770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038208368999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T11:10:33.851767+0000","last_change":"2026-02-17T11:10:33.851767+0000","last_active":"2026-02-17T11:10:33.851767+0000","last_peered":"2026-02-17T11:10:33.851767+0000","last_clean":"2026-02-17T11:10:33.851767+0000","last_became_active":"2026-02-17T11:10:31.878425+0000","last_became_peered":"2026-02-17T11:10:31.878425+0000","last_unstale":"2026-02-17T11:10:33.851767+0000","last_undegraded":"2026-02-17T11:10:33.851767+0000","last_fullsized":"2026-02-17T11:10:33.851767+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_clean_scrub_stamp":"2026-02-17T11:10:30.447281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:59:50.900049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057827870000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"31'1","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T11:10:33.791261+0000","last_change":"2026-02-17T11:10:33.802208+0000","last_active":"2026-02-17T11:10:33.791261+0000","last_peered":"2026-02-17T11:10:33.791261+0000","last_clean":"2026-02-17T11:10:33.791261+0000","last_became_active":"2026-02-17T11:10:31.780197+0000","last_became_peered":"2026-02-17T11:10:31.780197+0000","last_unstale":"2026-02-17T11:10:33.791261+0000","last_undegraded":"2026-02-17T11:10:33.791261+0000","last_fullsized":"2026-02-17T11:10:33.791261+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_clean_scrub_stamp":"2026-02-17T11:10:30.447281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:23:13.359463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.029469485,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,15],"acting":[14,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"26'32","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T11:10:33.802908+0000","last_change":"2026-02-17T11:10:28.869213+0000","last_active":"2026-02-17T11:10:33.802908+0000","last_peered":"2026-02-17T11:10:33.802908+0000","last_clean":"2026-02-17T11:10:33.802908+0000","last_became_active":"2026-02-17T11:10:28.524896+0000","last_became_peered":"2026-02-17T11:10:28.524896+0000","last_unstale":"2026-02-17T11:10:33.802908+0000","last_undegraded":"2026-02-17T11:10:33.802908+0000","last_fullsized":"2026-02-17T11:10:33.802908+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:10:20.960810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:10:20.960810+0000","last_clean_scrub_stamp":"2026-02-17T11:10:20.960810+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:21:38.378078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":10,"up_from":27,"seq":115964117001,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":360448,"data_stored":156838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[0,1,2,5,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 10 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":6,"up_from":27,"seq":115964116999,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":761856,"data_stored":554678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,5,7,8,9,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 6 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":12,"up_from":26,"seq":111669149703,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":364544,"data_stored":156857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,7,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 12 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":4,"up_from":21,"seq":90194313222,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":360448,"data_stored":156838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3,5,8,9,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[" osd: 4 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":8,"up_from":21,"seq":90194313221,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":360448,"data_stored":156838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5,7,9,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 8 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":1,"up_from":22,"seq":94489280518,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27320,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":360448,"data_stored":156838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27589065},"hb_peers":[0,2,7,8,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 1 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":14,"up_from":23,"seq":98784247814,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":360448,"data_stored":156838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3,4,5,7,8,9,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 14 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":2,"up_from":22,"seq":94489280518,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27320,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":360448,"data_stored":156838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,5,7,8,9,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":15,"up_from":22,"seq":94489280518,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":344064,"data_stored":147300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,2,4,5,7,8,9,10,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280517,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":745472,"data_stored":545140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[4,6,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 5 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":9,"up_from":22,"seq":94489280518,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":344064,"data_stored":147300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1598,"internal_metadata":27589058},"hb_peers":[2,4,5,7,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 9 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":13,"up_from":22,"seq":94489280518,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":360448,"data_stored":156838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[4,5,6,7,8,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 13 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":0,"up_from":26,"seq":111669149705,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":360448,"data_stored":156838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[1,2,3,4,5,7,8,9,11,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 0 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":7,"up_from":25,"seq":107374182406,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27324,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":360448,"data_stored":156838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27589067},"hb_peers":[0,4,5,6,8,9,10,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149704,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":364544,"data_stored":156857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[2,4,5,6,8,9,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":11,"up_from":26,"seq":111669149704,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27320,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":360448,"data_stored":156838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27589061},"hb_peers":[0,2,3,4,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:10:39.691 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:10:39.759 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.757+0000 7f0b069f5640 10 monclient: get_monmap_and_config 2026-02-17T11:10:39.759 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.757+0000 7f0b069f5640 10 monclient: build_initial_monmap 2026-02-17T11:10:39.759 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.757+0000 7f0b069f5640 10 monclient: monmap: 2026-02-17T11:10:39.759 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:39.759 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:39.759 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:39.758227+0000 2026-02-17T11:10:39.759 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:39.758227+0000 2026-02-17T11:10:39.759 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:39.759 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:39.759 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:39.759 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:39.759 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:39.759 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:39.759 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:39.759 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:39.759 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:39.760 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.758+0000 7f0b069f5640 1 Processor -- start 2026-02-17T11:10:39.760 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.758+0000 7f0b069f5640 1 -- start start 2026-02-17T11:10:39.760 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.758+0000 7f0b069f5640 10 monclient: init 2026-02-17T11:10:39.760 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.758+0000 7f0b069f5640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:39.760 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.758+0000 7f0b069f5640 10 monclient: _add_conns ranks=[2,0,4,1,5,3] 2026-02-17T11:10:39.760 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.758+0000 7f0b069f5640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f0b0014f280 addr v1:10.20.193.157:6789/0 2026-02-17T11:10:39.760 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.758+0000 7f0b069f5640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f0b0014f660 addr v1:10.20.193.49:6789/0 2026-02-17T11:10:39.760 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.758+0000 7f0b069f5640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f0b0015abc0 0x7f0b0015afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:39.760 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.758+0000 7f0b069f5640 10 monclient(hunting): picked mon.noname-b con 0x7f0b0015abc0 addr v2:10.20.193.97:3300/0 2026-02-17T11:10:39.760 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.758+0000 7f0b069f5640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b000c7110 con 0x7f0b0014f660 2026-02-17T11:10:39.760 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.758+0000 7f0b069f5640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b000c7390 con 0x7f0b0014f280 2026-02-17T11:10:39.760 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.758+0000 7f0b069f5640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:39.760 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.758+0000 7f0b069f5640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f0b000c7950 con 0x7f0b0015abc0 2026-02-17T11:10:39.760 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.758+0000 7f0b069f5640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:39.760 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.758+0000 7f0b069f5640 10 monclient(hunting): authenticate will time out at 1116.421778s 2026-02-17T11:10:39.760 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.759+0000 7f0aff7fe640 1 --1- >> v1:10.20.193.49:6789/0 conn(0x7f0b0014f660 0x7f0b000c6a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.49:6789/0 says I am v1:10.20.193.49:47772/0 (socket says 10.20.193.49:47772) 2026-02-17T11:10:39.760 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.759+0000 7f0aff7fe640 1 -- 10.20.193.49:0/220920312 learned_addr learned my addr 10.20.193.49:0/220920312 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:10:39.760 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.759+0000 7f0b04f6b640 1 --2- 10.20.193.49:0/220920312 >> v2:10.20.193.97:3300/0 conn(0x7f0b0015abc0 0x7f0b0015afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:39.760 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.759+0000 7f0b04f6b640 10 monclient(hunting): get_auth_request con 0x7f0b0015abc0 auth_method 0 2026-02-17T11:10:39.760 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.759+0000 7f0b04f6b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:39.760 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.759+0000 7f0b04f6b640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:39.761 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.759+0000 7f0b04f6b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:39.761 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.759+0000 7f0b04f6b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:39.761 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.759+0000 7f0b04f6b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:39.761 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.759+0000 7f0b04f6b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:39.762 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.760+0000 7f0afeffd640 1 -- 10.20.193.49:0/220920312 <== mon.0 v1:10.20.193.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 811878821 0 0) 0x7f0af0002920 con 0x7f0b0014f660 2026-02-17T11:10:39.762 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.760+0000 7f0afeffd640 10 monclient(hunting): _negotiate 2026-02-17T11:10:39.762 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.760+0000 7f0afeffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:39.762 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.760+0000 7f0afeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:39.762 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.760+0000 7f0afeffd640 10 monclient(hunting): my global_id is 4617 2026-02-17T11:10:39.762 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.760+0000 7f0afeffd640 1 -- 10.20.193.49:0/220920312 --> v1:10.20.193.49:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ae40058b0 con 0x7f0b0014f660 2026-02-17T11:10:39.762 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.760+0000 7f0b04f6b640 10 monclient(hunting): handle_auth_done global_id 4591 payload 274 2026-02-17T11:10:39.762 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.760+0000 7f0b04f6b640 1 -- 10.20.193.49:0/220920312 >> v1:10.20.193.157:6789/0 conn(0x7f0b0014f280 legacy=0x7f0b000c7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:39.762 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.760+0000 7f0b04f6b640 1 -- 10.20.193.49:0/220920312 >> v1:10.20.193.49:6789/0 conn(0x7f0b0014f660 legacy=0x7f0b000c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:39.762 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.760+0000 7f0b04f6b640 10 monclient: _finish_hunting 0 2026-02-17T11:10:39.762 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.760+0000 7f0b04f6b640 1 monclient: found mon.noname-b 2026-02-17T11:10:39.762 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.760+0000 7f0b04f6b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:39.762 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.760+0000 7f0b04f6b640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:10:39.762 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.760+0000 7f0b04f6b640 1 -- 10.20.193.49:0/220920312 --> v2:10.20.193.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b000c7670 con 0x7f0b0015abc0 2026-02-17T11:10:39.762 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.761+0000 7f0b04f6b640 1 --2- 10.20.193.49:0/220920312 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f0b0015abc0 0x7f0b0015afe0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0af4009d90 tx=0x7f0af402f2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=787cccb8b0d79c50 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:39.764 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.763+0000 7f0afeffd640 1 -- 10.20.193.49:0/220920312 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af403c070 con 0x7f0b0015abc0 2026-02-17T11:10:39.764 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.763+0000 7f0afeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:39.764 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.763+0000 7f0afeffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:10:39.765 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.763+0000 7f0afeffd640 10 monclient: dump: 2026-02-17T11:10:39.765 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:39.765 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:39.765 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:39.765 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:39.765 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:39.765 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:39.765 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:39.765 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:39.765 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:39.765 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:39.765 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.763+0000 7f0afeffd640 10 monclient: _finish_auth 0 2026-02-17T11:10:39.765 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.763+0000 7f0afeffd640 10 monclient: _check_auth_tickets 2026-02-17T11:10:39.765 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.763+0000 7f0afeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:39.765 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.763+0000 7f0afeffd640 1 -- 10.20.193.49:0/220920312 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0af4037440 con 0x7f0b0015abc0 2026-02-17T11:10:39.765 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.763+0000 7f0afeffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:39.765 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.763+0000 7f0afeffd640 1 -- 10.20.193.49:0/220920312 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af4037810 con 0x7f0b0015abc0 2026-02-17T11:10:39.765 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.763+0000 7f0b069f5640 5 monclient: authenticate success, global_id 4591 2026-02-17T11:10:39.765 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.763+0000 7f0b069f5640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:39.765 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.763+0000 7f0b069f5640 4 set_mon_vals no callback set 2026-02-17T11:10:39.765 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.763+0000 7f0afeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:39.765 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.763+0000 7f0afeffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:39.765 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.763+0000 7f0afeffd640 10 monclient: dump: 2026-02-17T11:10:39.765 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:39.765 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:39.765 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:39.765 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:39.765 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:39.765 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:39.765 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:39.765 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:39.765 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:39.765 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:39.766 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.764+0000 7f0b069f5640 10 monclient: shutdown 2026-02-17T11:10:39.766 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.764+0000 7f0b069f5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:39.766 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.764+0000 7f0b069f5640 1 -- 10.20.193.49:0/220920312 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f0b0015abc0 msgr2=0x7f0b0015afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:39.766 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.764+0000 7f0b069f5640 1 --2- 10.20.193.49:0/220920312 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f0b0015abc0 0x7f0b0015afe0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0af4009d90 tx=0x7f0af402f2c0 comp rx=0 tx=0).stop 2026-02-17T11:10:39.766 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.764+0000 7f0b069f5640 1 -- 10.20.193.49:0/220920312 shutdown_connections 2026-02-17T11:10:39.766 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.764+0000 7f0b069f5640 1 --2- 10.20.193.49:0/220920312 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f0b0015abc0 0x7f0b0015afe0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:39.766 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.764+0000 7f0b069f5640 1 -- 10.20.193.49:0/220920312 >> 10.20.193.49:0/220920312 conn(0x7f0b000c9f20 msgr2=0x7f0b000ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:39.766 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.764+0000 7f0b069f5640 1 -- 10.20.193.49:0/220920312 shutdown_connections 2026-02-17T11:10:39.766 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.764+0000 7f0b069f5640 1 -- 10.20.193.49:0/220920312 wait complete. 2026-02-17T11:10:39.766 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.764+0000 7f0b069f5640 10 monclient: build_initial_monmap 2026-02-17T11:10:39.766 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.764+0000 7f0b069f5640 10 monclient: monmap: 2026-02-17T11:10:39.766 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:39.766 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:39.766 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:39.766 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:39.766 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:39.766 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:39.766 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:39.766 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:39.766 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:39.766 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:39.766 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.764+0000 7f0b069f5640 1 librados: starting msgr at 2026-02-17T11:10:39.766 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.764+0000 7f0b069f5640 1 librados: starting objecter 2026-02-17T11:10:39.766 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.764+0000 7f0b069f5640 1 Processor -- start 2026-02-17T11:10:39.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.764+0000 7f0b069f5640 1 -- start start 2026-02-17T11:10:39.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.764+0000 7f0b069f5640 1 librados: setting wanted keys 2026-02-17T11:10:39.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.764+0000 7f0b069f5640 1 librados: calling monclient init 2026-02-17T11:10:39.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.764+0000 7f0b069f5640 10 monclient: init 2026-02-17T11:10:39.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.765+0000 7f0b069f5640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:39.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.765+0000 7f0b069f5640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:10:39.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.765+0000 7f0b069f5640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f0b0014f280 0x7f0b001f33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:39.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.765+0000 7f0b069f5640 10 monclient(hunting): picked mon.noname-b con 0x7f0b0014f280 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:39.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.765+0000 7f0b069f5640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0b0014f660 0x7f0b00153340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:39.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.765+0000 7f0b069f5640 10 monclient(hunting): picked mon.noname-a con 0x7f0b0014f660 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:39.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.765+0000 7f0b069f5640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f0b0015abc0 0x7f0b00155140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:39.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.765+0000 7f0b069f5640 10 monclient(hunting): picked mon.noname-c con 0x7f0b0015abc0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:39.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.765+0000 7f0b069f5640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:39.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.765+0000 7f0b069f5640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0b0015a3c0 con 0x7f0b0014f660 2026-02-17T11:10:39.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.765+0000 7f0b069f5640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:39.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.765+0000 7f0b069f5640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f0b0015a730 con 0x7f0b0014f280 2026-02-17T11:10:39.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.765+0000 7f0b069f5640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:39.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.765+0000 7f0b069f5640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f0b0015b520 con 0x7f0b0015abc0 2026-02-17T11:10:39.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.765+0000 7f0b069f5640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:39.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.765+0000 7f0b069f5640 10 monclient(hunting): authenticate will time out at 1116.428230s 2026-02-17T11:10:39.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.765+0000 7f0aff7fe640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0b0014f660 0x7f0b00153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:39.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.765+0000 7f0afffff640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f0b0014f280 0x7f0b001f33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:39.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.765+0000 7f0b04f6b640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f0b0015abc0 0x7f0b00155140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:39.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.765+0000 7f0aff7fe640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0b0014f660 0x7f0b00153340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:33810/0 (socket says 10.20.193.49:33810) 2026-02-17T11:10:39.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.765+0000 7f0aff7fe640 1 -- 10.20.193.49:0/36457021 learned_addr learned my addr 10.20.193.49:0/36457021 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:39.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.765+0000 7f0aff7fe640 10 monclient(hunting): get_auth_request con 0x7f0b0014f660 auth_method 0 2026-02-17T11:10:39.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.765+0000 7f0aff7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:39.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.765+0000 7f0aff7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:39.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.765+0000 7f0aff7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:39.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.765+0000 7f0afffff640 10 monclient(hunting): get_auth_request con 0x7f0b0014f280 auth_method 0 2026-02-17T11:10:39.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.765+0000 7f0afffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:39.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.765+0000 7f0afffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:39.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.765+0000 7f0afffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:39.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.765+0000 7f0b04f6b640 10 monclient(hunting): get_auth_request con 0x7f0b0015abc0 auth_method 0 2026-02-17T11:10:39.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.765+0000 7f0b04f6b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:39.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.765+0000 7f0b04f6b640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:39.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.765+0000 7f0b04f6b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:39.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.765+0000 7f0afffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:39.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.765+0000 7f0afffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:39.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.765+0000 7f0afffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:39.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.765+0000 7f0aff7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:39.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.765+0000 7f0aff7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:39.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.765+0000 7f0aff7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:39.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.766+0000 7f0b04f6b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:39.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.766+0000 7f0b04f6b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:39.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.766+0000 7f0b04f6b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:39.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.767+0000 7f0afffff640 10 monclient(hunting): handle_auth_done global_id 4594 payload 824 2026-02-17T11:10:39.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.767+0000 7f0afffff640 1 -- 10.20.193.49:0/36457021 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f0b0015abc0 msgr2=0x7f0b00155140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:39.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.767+0000 7f0afffff640 1 --2- 10.20.193.49:0/36457021 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f0b0015abc0 0x7f0b00155140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:39.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.767+0000 7f0afffff640 1 -- 10.20.193.49:0/36457021 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0b0014f660 msgr2=0x7f0b00153340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:39.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.767+0000 7f0afffff640 1 --2- 10.20.193.49:0/36457021 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0b0014f660 0x7f0b00153340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:39.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.767+0000 7f0afffff640 10 monclient: _finish_hunting 0 2026-02-17T11:10:39.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.767+0000 7f0afffff640 1 monclient: found mon.noname-b 2026-02-17T11:10:39.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.767+0000 7f0afffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:39.769 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.767+0000 7f0afffff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:10:39.769 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.767+0000 7f0afffff640 1 -- 10.20.193.49:0/36457021 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b00156250 con 0x7f0b0014f280 2026-02-17T11:10:39.769 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.767+0000 7f0aff7fe640 1 --2- 10.20.193.49:0/36457021 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0b0014f660 0x7f0b00153340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:10:39.769 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.768+0000 7f0afffff640 1 --2- 10.20.193.49:0/36457021 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f0b0014f280 0x7f0b001f33a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0aec00c450 tx=0x7f0aec00c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:39.769 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.768+0000 7f0afcff9640 10 client.?.objecter ms_handle_connect 0x7f0b0014f280 2026-02-17T11:10:39.769 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.768+0000 7f0afcff9640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:39.771 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.770+0000 7f0afcff9640 1 -- 10.20.193.49:0/36457021 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aec0052d0 con 0x7f0b0014f280 2026-02-17T11:10:39.771 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.770+0000 7f0afcff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:39.771 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.770+0000 7f0afcff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:10:39.771 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.770+0000 7f0afcff9640 10 monclient: dump: 2026-02-17T11:10:39.771 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:39.771 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:39.771 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:39.771 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:39.771 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:39.771 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:39.771 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:39.771 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:39.771 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:39.771 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:39.771 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.770+0000 7f0afcff9640 10 monclient: _finish_auth 0 2026-02-17T11:10:39.771 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.770+0000 7f0afcff9640 10 monclient: _check_auth_tickets 2026-02-17T11:10:39.771 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.770+0000 7f0afcff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:39.771 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.770+0000 7f0afcff9640 1 -- 10.20.193.49:0/36457021 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0aec005470 con 0x7f0b0014f280 2026-02-17T11:10:39.771 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.770+0000 7f0afcff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:39.771 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.770+0000 7f0afcff9640 1 -- 10.20.193.49:0/36457021 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aec0038f0 con 0x7f0b0014f280 2026-02-17T11:10:39.771 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.770+0000 7f0afcff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:39.771 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.770+0000 7f0afcff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:39.771 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.770+0000 7f0afcff9640 10 monclient: dump: 2026-02-17T11:10:39.771 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:39.771 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:39.771 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:39.771 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:39.772 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:39.772 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:39.772 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:39.772 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:39.772 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:39.772 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:39.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.770+0000 7f0afe7fc640 4 set_mon_vals no callback set 2026-02-17T11:10:39.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.770+0000 7f0b069f5640 5 monclient: authenticate success, global_id 4594 2026-02-17T11:10:39.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.770+0000 7f0b069f5640 10 monclient: _renew_subs 2026-02-17T11:10:39.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.770+0000 7f0b069f5640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:39.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.770+0000 7f0b069f5640 1 -- 10.20.193.49:0/36457021 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b00073740 con 0x7f0b0014f280 2026-02-17T11:10:39.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.770+0000 7f0b069f5640 10 client.4594.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:39.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.770+0000 7f0b069f5640 10 monclient: _renew_subs 2026-02-17T11:10:39.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.770+0000 7f0b069f5640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:39.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.770+0000 7f0b069f5640 1 -- 10.20.193.49:0/36457021 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b00073d00 con 0x7f0b0014f280 2026-02-17T11:10:39.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.770+0000 7f0b069f5640 1 librados: init done 2026-02-17T11:10:39.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.770+0000 7f0b069f5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:39.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.770+0000 7f0b069f5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:39.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.770+0000 7f0b069f5640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:39.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.770+0000 7f0b069f5640 1 -- 10.20.193.49:0/36457021 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b000c9b70 con 0x7f0b0014f280 2026-02-17T11:10:39.783 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.782+0000 7f0afcff9640 1 -- 10.20.193.49:0/36457021 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f0aec003a90 con 0x7f0b0014f280 2026-02-17T11:10:39.783 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.782+0000 7f0afcff9640 1 --2- 10.20.193.49:0/36457021 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0ad0079190 0x7f0ad007b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:39.783 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.782+0000 7f0aff7fe640 1 --2- 10.20.193.49:0/36457021 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0ad0079190 0x7f0ad007b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:39.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.782+0000 7f0aff7fe640 10 monclient: get_auth_request con 0x7f0ad0079190 auth_method 0 2026-02-17T11:10:39.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.783+0000 7f0afcff9640 10 client.4594.objecter ms_handle_connect 0x7f0ad0079190 2026-02-17T11:10:39.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.783+0000 7f0aff7fe640 1 --2- 10.20.193.49:0/36457021 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0ad0079190 0x7f0ad007b650 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0b00154af0 tx=0x7f0af0007c90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:39.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.783+0000 7f0afcff9640 1 -- 10.20.193.49:0/36457021 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7f0aec05e150 con 0x7f0b0014f280 2026-02-17T11:10:39.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.783+0000 7f0afcff9640 10 client.4594.objecter ms_dispatch2 0x7f0b00000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:39.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.783+0000 7f0afcff9640 3 client.4594.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:39.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.783+0000 7f0afcff9640 3 client.4594.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:39.785 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.783+0000 7f0afcff9640 20 client.4594.objecter dump_active .. 0 homeless 2026-02-17T11:10:39.885 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.883+0000 7f0afcff9640 1 -- 10.20.193.49:0/36457021 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f0aec062110 con 0x7f0b0014f280 2026-02-17T11:10:39.885 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.883+0000 7f0afcff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:39.885 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.883+0000 7f0afcff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:39.968 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.967+0000 7f0b069f5640 1 -- 10.20.193.49:0/36457021 --> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0b001f38e0 con 0x7f0ad0079190 2026-02-17T11:10:39.969 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.968+0000 7f0afcff9640 1 -- 10.20.193.49:0/36457021 <== mgr.4106 v2:10.20.193.162:6800/2614632098 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+44795 (secure 0 0 0) 0x7f0af0007570 con 0x7f0ad0079190 2026-02-17T11:10:39.969 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:10:39.970 INFO:teuthology.orchestra.run.trial049.stderr:dumped all 2026-02-17T11:10:39.971 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.969+0000 7f0b069f5640 10 librados: watch_flush enter 2026-02-17T11:10:39.971 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.969+0000 7f0b069f5640 10 librados: watch_flush exit 2026-02-17T11:10:39.971 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.969+0000 7f0b069f5640 20 client.4594.objecter shutdown clearing up homeless session... 2026-02-17T11:10:39.971 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.969+0000 7f0b069f5640 10 client.4594.objecter successfully canceled tick 2026-02-17T11:10:39.971 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.969+0000 7f0b069f5640 1 -- 10.20.193.49:0/36457021 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0ad0079190 msgr2=0x7f0ad007b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:39.971 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.969+0000 7f0b069f5640 1 --2- 10.20.193.49:0/36457021 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0ad0079190 0x7f0ad007b650 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0b00154af0 tx=0x7f0af0007c90 comp rx=0 tx=0).stop 2026-02-17T11:10:39.971 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.969+0000 7f0b069f5640 10 monclient: shutdown 2026-02-17T11:10:39.971 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.969+0000 7f0b069f5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:39.971 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.969+0000 7f0b069f5640 1 -- 10.20.193.49:0/36457021 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f0b0014f280 msgr2=0x7f0b001f33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:39.971 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.969+0000 7f0b069f5640 1 --2- 10.20.193.49:0/36457021 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f0b0014f280 0x7f0b001f33a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0aec00c450 tx=0x7f0aec00c920 comp rx=0 tx=0).stop 2026-02-17T11:10:39.971 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.969+0000 7f0b069f5640 1 -- 10.20.193.49:0/36457021 shutdown_connections 2026-02-17T11:10:39.971 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.969+0000 7f0b069f5640 1 --2- 10.20.193.49:0/36457021 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0ad0079190 0x7f0ad007b650 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:39.971 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.969+0000 7f0b069f5640 1 --2- 10.20.193.49:0/36457021 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f0b0015abc0 0x7f0b00155140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:39.971 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.969+0000 7f0b069f5640 1 --2- 10.20.193.49:0/36457021 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0b0014f660 0x7f0b00153340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:39.971 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.969+0000 7f0b069f5640 1 --2- 10.20.193.49:0/36457021 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f0b0014f280 0x7f0b001f33a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:39.971 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.969+0000 7f0b069f5640 1 -- 10.20.193.49:0/36457021 >> 10.20.193.49:0/36457021 conn(0x7f0b000c9f20 msgr2=0x7f0b0014b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:39.971 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.970+0000 7f0b069f5640 1 -- 10.20.193.49:0/36457021 shutdown_connections 2026-02-17T11:10:39.971 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.970+0000 7f0b069f5640 1 -- 10.20.193.49:0/36457021 wait complete. 2026-02-17T11:10:39.971 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:39.970+0000 7f0b069f5640 1 librados: shutdown 2026-02-17T11:10:39.979 INFO:teuthology.orchestra.run.trial049.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2026-02-17T11:10:38.454448+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459299,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":59,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":12,"kb":1509949440,"kb_used":437856,"kb_used_data":6376,"kb_used_omap":24,"kb_used_meta":431079,"kb_avail":1509511584,"statfs":{"total":1546188226560,"available":1545739862016,"internally_reserved":0,"allocated":6529024,"data_stored":3276512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25501,"internal_metadata":441424995},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[" osd: 0 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 1 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 4 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 5 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 6 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 8 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 9 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 10 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 12 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 13 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 14 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":131107,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":18,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.866087"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T11:10:34.390486+0000","last_change":"2026-02-17T11:10:34.390486+0000","last_active":"2026-02-17T11:10:34.390486+0000","last_peered":"2026-02-17T11:10:34.390486+0000","last_clean":"2026-02-17T11:10:34.390486+0000","last_became_active":"2026-02-17T11:10:31.882486+0000","last_became_peered":"2026-02-17T11:10:31.882486+0000","last_unstale":"2026-02-17T11:10:34.390486+0000","last_undegraded":"2026-02-17T11:10:34.390486+0000","last_fullsized":"2026-02-17T11:10:34.390486+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_clean_scrub_stamp":"2026-02-17T11:10:30.447281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:57:41.179473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.031448708999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,10],"acting":[15,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T11:10:34.082564+0000","last_change":"2026-02-17T11:10:34.082564+0000","last_active":"2026-02-17T11:10:34.082564+0000","last_peered":"2026-02-17T11:10:34.082564+0000","last_clean":"2026-02-17T11:10:34.082564+0000","last_became_active":"2026-02-17T11:10:32.011352+0000","last_became_peered":"2026-02-17T11:10:32.011352+0000","last_unstale":"2026-02-17T11:10:34.082564+0000","last_undegraded":"2026-02-17T11:10:34.082564+0000","last_fullsized":"2026-02-17T11:10:34.082564+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_clean_scrub_stamp":"2026-02-17T11:10:30.447281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:32:07.479731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030517882999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,13],"acting":[8,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T11:10:34.580857+0000","last_change":"2026-02-17T11:10:34.580857+0000","last_active":"2026-02-17T11:10:34.580857+0000","last_peered":"2026-02-17T11:10:34.580857+0000","last_clean":"2026-02-17T11:10:34.580857+0000","last_became_active":"2026-02-17T11:10:31.774687+0000","last_became_peered":"2026-02-17T11:10:31.774687+0000","last_unstale":"2026-02-17T11:10:34.580857+0000","last_undegraded":"2026-02-17T11:10:34.580857+0000","last_fullsized":"2026-02-17T11:10:34.580857+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_clean_scrub_stamp":"2026-02-17T11:10:30.447281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:22:12.754481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.034911202000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4],"acting":[9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T11:10:34.560578+0000","last_change":"2026-02-17T11:10:34.579397+0000","last_active":"2026-02-17T11:10:34.560578+0000","last_peered":"2026-02-17T11:10:34.560578+0000","last_clean":"2026-02-17T11:10:34.560578+0000","last_became_active":"2026-02-17T11:10:31.919932+0000","last_became_peered":"2026-02-17T11:10:31.919932+0000","last_unstale":"2026-02-17T11:10:34.560578+0000","last_undegraded":"2026-02-17T11:10:34.560578+0000","last_fullsized":"2026-02-17T11:10:34.560578+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_clean_scrub_stamp":"2026-02-17T11:10:30.447281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:52:51.393067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.034931859000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"33'2","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T11:10:33.856528+0000","last_change":"2026-02-17T11:10:33.847595+0000","last_active":"2026-02-17T11:10:33.856528+0000","last_peered":"2026-02-17T11:10:33.856528+0000","last_clean":"2026-02-17T11:10:33.856528+0000","last_became_active":"2026-02-17T11:10:31.924469+0000","last_became_peered":"2026-02-17T11:10:31.924469+0000","last_unstale":"2026-02-17T11:10:33.856528+0000","last_undegraded":"2026-02-17T11:10:33.856528+0000","last_fullsized":"2026-02-17T11:10:33.856528+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_clean_scrub_stamp":"2026-02-17T11:10:30.447281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:39:57.389842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057723655999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,12],"acting":[3,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T11:10:33.774326+0000","last_change":"2026-02-17T11:10:33.798221+0000","last_active":"2026-02-17T11:10:33.774326+0000","last_peered":"2026-02-17T11:10:33.774326+0000","last_clean":"2026-02-17T11:10:33.774326+0000","last_became_active":"2026-02-17T11:10:31.972595+0000","last_became_peered":"2026-02-17T11:10:31.972595+0000","last_unstale":"2026-02-17T11:10:33.774326+0000","last_undegraded":"2026-02-17T11:10:33.774326+0000","last_fullsized":"2026-02-17T11:10:33.774326+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_clean_scrub_stamp":"2026-02-17T11:10:30.447281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:29:40.302770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038208368999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T11:10:33.851767+0000","last_change":"2026-02-17T11:10:33.851767+0000","last_active":"2026-02-17T11:10:33.851767+0000","last_peered":"2026-02-17T11:10:33.851767+0000","last_clean":"2026-02-17T11:10:33.851767+0000","last_became_active":"2026-02-17T11:10:31.878425+0000","last_became_peered":"2026-02-17T11:10:31.878425+0000","last_unstale":"2026-02-17T11:10:33.851767+0000","last_undegraded":"2026-02-17T11:10:33.851767+0000","last_fullsized":"2026-02-17T11:10:33.851767+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_clean_scrub_stamp":"2026-02-17T11:10:30.447281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:59:50.900049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057827870000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"31'1","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T11:10:33.791261+0000","last_change":"2026-02-17T11:10:33.802208+0000","last_active":"2026-02-17T11:10:33.791261+0000","last_peered":"2026-02-17T11:10:33.791261+0000","last_clean":"2026-02-17T11:10:33.791261+0000","last_became_active":"2026-02-17T11:10:31.780197+0000","last_became_peered":"2026-02-17T11:10:31.780197+0000","last_unstale":"2026-02-17T11:10:33.791261+0000","last_undegraded":"2026-02-17T11:10:33.791261+0000","last_fullsized":"2026-02-17T11:10:33.791261+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_clean_scrub_stamp":"2026-02-17T11:10:30.447281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:23:13.359463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.029469485,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,15],"acting":[14,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"26'32","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T11:10:33.802908+0000","last_change":"2026-02-17T11:10:28.869213+0000","last_active":"2026-02-17T11:10:33.802908+0000","last_peered":"2026-02-17T11:10:33.802908+0000","last_clean":"2026-02-17T11:10:33.802908+0000","last_became_active":"2026-02-17T11:10:28.524896+0000","last_became_peered":"2026-02-17T11:10:28.524896+0000","last_unstale":"2026-02-17T11:10:33.802908+0000","last_undegraded":"2026-02-17T11:10:33.802908+0000","last_fullsized":"2026-02-17T11:10:33.802908+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:10:20.960810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:10:20.960810+0000","last_clean_scrub_stamp":"2026-02-17T11:10:20.960810+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:21:38.378078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":10,"up_from":27,"seq":115964117001,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":360448,"data_stored":156838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[0,1,2,5,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 10 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":6,"up_from":27,"seq":115964116999,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":761856,"data_stored":554678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,5,7,8,9,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 6 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":12,"up_from":26,"seq":111669149703,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":364544,"data_stored":156857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,7,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 12 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":4,"up_from":21,"seq":90194313222,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":360448,"data_stored":156838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3,5,8,9,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[" osd: 4 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":8,"up_from":21,"seq":90194313221,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":360448,"data_stored":156838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5,7,9,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 8 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":1,"up_from":22,"seq":94489280518,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27320,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":360448,"data_stored":156838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27589065},"hb_peers":[0,2,7,8,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 1 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":14,"up_from":23,"seq":98784247814,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":360448,"data_stored":156838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3,4,5,7,8,9,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 14 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":2,"up_from":22,"seq":94489280518,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27320,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":360448,"data_stored":156838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,5,7,8,9,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":15,"up_from":22,"seq":94489280518,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":344064,"data_stored":147300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,2,4,5,7,8,9,10,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280517,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":745472,"data_stored":545140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[4,6,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 5 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":9,"up_from":22,"seq":94489280518,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":344064,"data_stored":147300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1598,"internal_metadata":27589058},"hb_peers":[2,4,5,7,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 9 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":13,"up_from":22,"seq":94489280518,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":360448,"data_stored":156838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[4,5,6,7,8,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 13 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":0,"up_from":26,"seq":111669149705,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":360448,"data_stored":156838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[1,2,3,4,5,7,8,9,11,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 0 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":7,"up_from":25,"seq":107374182406,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27324,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":360448,"data_stored":156838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27589067},"hb_peers":[0,4,5,6,8,9,10,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149704,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":364544,"data_stored":156857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[2,4,5,6,8,9,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":11,"up_from":26,"seq":111669149704,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27320,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":360448,"data_stored":156838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27589061},"hb_peers":[0,2,3,4,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:10:39.979 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-17T11:10:39.980 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-17T11:10:39.980 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-17T11:10:39.980 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:10:40.046 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.045+0000 7fa48d53e640 10 monclient: get_monmap_and_config 2026-02-17T11:10:40.046 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.045+0000 7fa48d53e640 10 monclient: build_initial_monmap 2026-02-17T11:10:40.046 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.045+0000 7fa48d53e640 10 monclient: monmap: 2026-02-17T11:10:40.046 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:40.046 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:40.046 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:40.045738+0000 2026-02-17T11:10:40.046 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:40.045738+0000 2026-02-17T11:10:40.046 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:40.046 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:40.046 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:40.046 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:40.046 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:40.046 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:40.046 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:40.046 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:40.046 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:40.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.045+0000 7fa48d53e640 1 Processor -- start 2026-02-17T11:10:40.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.045+0000 7fa48d53e640 1 -- start start 2026-02-17T11:10:40.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.045+0000 7fa48d53e640 10 monclient: init 2026-02-17T11:10:40.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.046+0000 7fa48d53e640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:40.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.046+0000 7fa48d53e640 10 monclient: _add_conns ranks=[2,3,4,5,0,1] 2026-02-17T11:10:40.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.046+0000 7fa48d53e640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fa48815d370 addr v1:10.20.193.157:6789/0 2026-02-17T11:10:40.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.046+0000 7fa48d53e640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fa4880c7e20 0x7fa48815d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:40.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.046+0000 7fa48d53e640 10 monclient(hunting): picked mon.noname-a con 0x7fa4880c7e20 addr v2:10.20.193.49:3300/0 2026-02-17T11:10:40.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.046+0000 7fa48d53e640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7fa4880c74c0 0x7fa4880c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:40.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.046+0000 7fa48d53e640 10 monclient(hunting): picked mon.noname-b con 0x7fa4880c74c0 addr v2:10.20.193.97:3300/0 2026-02-17T11:10:40.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.046+0000 7fa48d53e640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4880c8350 con 0x7fa48815d370 2026-02-17T11:10:40.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.046+0000 7fa48d53e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:40.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.046+0000 7fa48d53e640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7fa48815b710 con 0x7fa4880c7e20 2026-02-17T11:10:40.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.046+0000 7fa48d53e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:40.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.046+0000 7fa48d53e640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7fa4880c9240 con 0x7fa4880c74c0 2026-02-17T11:10:40.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.046+0000 7fa48d53e640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:40.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.046+0000 7fa48d53e640 10 monclient(hunting): authenticate will time out at 1116.709313s 2026-02-17T11:10:40.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.046+0000 7fa4867fc640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fa4880c7e20 0x7fa48815d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:40.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.046+0000 7fa486ffd640 1 --1- >> v1:10.20.193.157:6789/0 conn(0x7fa48815d370 0x7fa48815b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.157:6789/0 says I am v1:10.20.193.49:53034/0 (socket says 10.20.193.49:53034) 2026-02-17T11:10:40.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.046+0000 7fa486ffd640 1 -- 10.20.193.49:0/2934076698 learned_addr learned my addr 10.20.193.49:0/2934076698 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:10:40.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.046+0000 7fa4877fe640 1 --2- 10.20.193.49:0/2934076698 >> v2:10.20.193.97:3300/0 conn(0x7fa4880c74c0 0x7fa4880c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:40.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.046+0000 7fa4877fe640 10 monclient(hunting): get_auth_request con 0x7fa4880c74c0 auth_method 0 2026-02-17T11:10:40.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.046+0000 7fa4877fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:40.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.046+0000 7fa4877fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:40.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.046+0000 7fa4877fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:40.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.047+0000 7fa4867fc640 10 monclient(hunting): get_auth_request con 0x7fa4880c7e20 auth_method 0 2026-02-17T11:10:40.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.047+0000 7fa4867fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:40.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.047+0000 7fa4867fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:40.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.047+0000 7fa4867fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:40.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.047+0000 7fa4867fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:40.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.047+0000 7fa4867fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:40.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.047+0000 7fa4867fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:40.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.047+0000 7fa4877fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:40.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.047+0000 7fa4877fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:40.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.047+0000 7fa4877fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:40.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.048+0000 7fa4867fc640 10 monclient(hunting): handle_auth_done global_id 4623 payload 274 2026-02-17T11:10:40.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.048+0000 7fa4867fc640 1 -- 10.20.193.49:0/2934076698 >> v2:10.20.193.97:3300/0 conn(0x7fa4880c74c0 msgr2=0x7fa4880c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:40.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.048+0000 7fa4867fc640 1 --2- 10.20.193.49:0/2934076698 >> v2:10.20.193.97:3300/0 conn(0x7fa4880c74c0 0x7fa4880c52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:40.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.048+0000 7fa4867fc640 1 -- 10.20.193.49:0/2934076698 >> v1:10.20.193.157:6789/0 conn(0x7fa48815d370 legacy=0x7fa48815b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:40.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.048+0000 7fa4867fc640 10 monclient: _finish_hunting 0 2026-02-17T11:10:40.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.048+0000 7fa4867fc640 1 monclient: found mon.noname-a 2026-02-17T11:10:40.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.048+0000 7fa4867fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:40.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.048+0000 7fa4867fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:10:40.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.048+0000 7fa4867fc640 1 -- 10.20.193.49:0/2934076698 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4880c8630 con 0x7fa4880c7e20 2026-02-17T11:10:40.050 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.049+0000 7fa4867fc640 1 --2- 10.20.193.49:0/2934076698 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fa4880c7e20 0x7fa48815d750 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa48815dcf0 tx=0x7fa47002ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ae99301adbf965f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:40.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.050+0000 7fa485ffb640 1 -- 10.20.193.49:0/2934076698 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa47003c070 con 0x7fa4880c7e20 2026-02-17T11:10:40.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.050+0000 7fa485ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:40.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.050+0000 7fa485ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:10:40.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.050+0000 7fa485ffb640 10 monclient: dump: 2026-02-17T11:10:40.052 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:40.052 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:40.052 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:40.052 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:40.052 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:40.052 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:40.052 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:40.052 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:40.052 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:40.052 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:40.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.050+0000 7fa485ffb640 10 monclient: _finish_auth 0 2026-02-17T11:10:40.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.050+0000 7fa485ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:10:40.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.050+0000 7fa485ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:40.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.050+0000 7fa485ffb640 1 -- 10.20.193.49:0/2934076698 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa47002faf0 con 0x7fa4880c7e20 2026-02-17T11:10:40.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.050+0000 7fa48d53e640 5 monclient: authenticate success, global_id 4623 2026-02-17T11:10:40.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.050+0000 7fa48d53e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:10:40.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.050+0000 7fa485ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:40.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.050+0000 7fa485ffb640 1 -- 10.20.193.49:0/2934076698 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa470037440 con 0x7fa4880c7e20 2026-02-17T11:10:40.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.050+0000 7fa485ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:40.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.050+0000 7fa485ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:10:40.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.050+0000 7fa485ffb640 10 monclient: dump: 2026-02-17T11:10:40.052 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:40.052 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:40.052 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:40.052 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:40.052 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:40.052 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:40.052 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:40.052 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:40.052 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:40.052 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:40.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.050+0000 7fa48d53e640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:40.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.050+0000 7fa48d53e640 4 set_mon_vals no callback set 2026-02-17T11:10:40.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.051+0000 7fa48d53e640 10 monclient: shutdown 2026-02-17T11:10:40.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.051+0000 7fa48d53e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:40.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.051+0000 7fa48d53e640 1 -- 10.20.193.49:0/2934076698 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fa4880c7e20 msgr2=0x7fa48815d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:40.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.051+0000 7fa48d53e640 1 --2- 10.20.193.49:0/2934076698 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fa4880c7e20 0x7fa48815d750 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa48815dcf0 tx=0x7fa47002ede0 comp rx=0 tx=0).stop 2026-02-17T11:10:40.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.051+0000 7fa48d53e640 1 -- 10.20.193.49:0/2934076698 shutdown_connections 2026-02-17T11:10:40.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.051+0000 7fa48d53e640 1 --2- 10.20.193.49:0/2934076698 >> v2:10.20.193.97:3300/0 conn(0x7fa4880c74c0 0x7fa4880c52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:40.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.051+0000 7fa48d53e640 1 --2- 10.20.193.49:0/2934076698 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fa4880c7e20 0x7fa48815d750 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:40.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.051+0000 7fa48d53e640 1 -- 10.20.193.49:0/2934076698 >> 10.20.193.49:0/2934076698 conn(0x7fa4880c9f20 msgr2=0x7fa4880ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:40.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.051+0000 7fa48d53e640 1 -- 10.20.193.49:0/2934076698 shutdown_connections 2026-02-17T11:10:40.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.051+0000 7fa48d53e640 1 -- 10.20.193.49:0/2934076698 wait complete. 2026-02-17T11:10:40.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.051+0000 7fa48d53e640 10 monclient: build_initial_monmap 2026-02-17T11:10:40.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.051+0000 7fa48d53e640 10 monclient: monmap: 2026-02-17T11:10:40.053 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:40.053 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:40.053 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:40.053 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:40.053 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:40.053 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:40.053 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:40.053 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:40.053 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:40.053 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:40.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.051+0000 7fa48d53e640 1 librados: starting msgr at 2026-02-17T11:10:40.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.051+0000 7fa48d53e640 1 librados: starting objecter 2026-02-17T11:10:40.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.052+0000 7fa48d53e640 1 Processor -- start 2026-02-17T11:10:40.054 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.052+0000 7fa48d53e640 1 -- start start 2026-02-17T11:10:40.054 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.052+0000 7fa48d53e640 1 librados: setting wanted keys 2026-02-17T11:10:40.054 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.052+0000 7fa48d53e640 1 librados: calling monclient init 2026-02-17T11:10:40.054 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.052+0000 7fa48d53e640 10 monclient: init 2026-02-17T11:10:40.054 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.052+0000 7fa48d53e640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:40.054 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.052+0000 7fa48d53e640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:10:40.054 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.052+0000 7fa48d53e640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fa4880c74c0 0x7fa4881f2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:40.054 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.052+0000 7fa48d53e640 10 monclient(hunting): picked mon.noname-c con 0x7fa4880c74c0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:40.054 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.052+0000 7fa48d53e640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fa4880c7e20 0x7fa4881f13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:40.054 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.052+0000 7fa48d53e640 10 monclient(hunting): picked mon.noname-a con 0x7fa4880c7e20 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:40.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.052+0000 7fa48d53e640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fa48815d370 0x7fa488148050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:40.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.052+0000 7fa48d53e640 10 monclient(hunting): picked mon.noname-b con 0x7fa48815d370 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:40.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.052+0000 7fa48d53e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:40.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.052+0000 7fa48d53e640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa4880c8ed0 con 0x7fa4880c7e20 2026-02-17T11:10:40.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.052+0000 7fa48d53e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:40.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.052+0000 7fa48d53e640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa4880c8bf0 con 0x7fa48815d370 2026-02-17T11:10:40.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.052+0000 7fa48d53e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:40.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.052+0000 7fa48d53e640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fa4880c96d0 con 0x7fa4880c74c0 2026-02-17T11:10:40.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.052+0000 7fa48d53e640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:40.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.052+0000 7fa48d53e640 10 monclient(hunting): authenticate will time out at 1116.715490s 2026-02-17T11:10:40.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.052+0000 7fa4867fc640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fa4880c7e20 0x7fa4881f13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:40.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.052+0000 7fa4867fc640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fa4880c7e20 0x7fa4881f13c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:33828/0 (socket says 10.20.193.49:33828) 2026-02-17T11:10:40.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.052+0000 7fa4867fc640 1 -- 10.20.193.49:0/2632854820 learned_addr learned my addr 10.20.193.49:0/2632854820 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:40.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.052+0000 7fa4867fc640 10 monclient(hunting): get_auth_request con 0x7fa4880c7e20 auth_method 0 2026-02-17T11:10:40.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.052+0000 7fa4867fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:40.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.052+0000 7fa4867fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:40.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.052+0000 7fa4867fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:40.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.052+0000 7fa486ffd640 1 --2- 10.20.193.49:0/2632854820 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fa4880c74c0 0x7fa4881f2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:40.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.052+0000 7fa4877fe640 1 --2- 10.20.193.49:0/2632854820 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fa48815d370 0x7fa488148050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:40.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.053+0000 7fa4877fe640 10 monclient(hunting): get_auth_request con 0x7fa48815d370 auth_method 0 2026-02-17T11:10:40.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.053+0000 7fa4877fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:40.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.053+0000 7fa4877fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:40.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.053+0000 7fa4877fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:40.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.053+0000 7fa4867fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:40.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.053+0000 7fa4867fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:40.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.053+0000 7fa4867fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:40.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.053+0000 7fa486ffd640 10 monclient(hunting): get_auth_request con 0x7fa4880c74c0 auth_method 0 2026-02-17T11:10:40.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.053+0000 7fa486ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:40.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.053+0000 7fa486ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:40.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.053+0000 7fa486ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:40.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.053+0000 7fa486ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:40.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.053+0000 7fa486ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:40.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.053+0000 7fa486ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:40.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.053+0000 7fa4877fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:40.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.053+0000 7fa4877fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:40.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.053+0000 7fa4877fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:40.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.054+0000 7fa4867fc640 10 monclient(hunting): handle_auth_done global_id 4626 payload 824 2026-02-17T11:10:40.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.054+0000 7fa4867fc640 1 -- 10.20.193.49:0/2632854820 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fa4880c74c0 msgr2=0x7fa4881f2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:40.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.054+0000 7fa4867fc640 1 --2- 10.20.193.49:0/2632854820 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fa4880c74c0 0x7fa4881f2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:40.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.054+0000 7fa4867fc640 1 -- 10.20.193.49:0/2632854820 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fa48815d370 msgr2=0x7fa488148050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:40.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.054+0000 7fa4867fc640 1 --2- 10.20.193.49:0/2632854820 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fa48815d370 0x7fa488148050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:40.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.054+0000 7fa4867fc640 10 monclient: _finish_hunting 0 2026-02-17T11:10:40.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.054+0000 7fa4867fc640 1 monclient: found mon.noname-a 2026-02-17T11:10:40.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.054+0000 7fa4867fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:40.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.054+0000 7fa4867fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:10:40.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.054+0000 7fa4867fc640 1 -- 10.20.193.49:0/2632854820 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4881f1d00 con 0x7fa4880c7e20 2026-02-17T11:10:40.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.055+0000 7fa4867fc640 1 --2- 10.20.193.49:0/2632854820 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fa4880c7e20 0x7fa4881f13c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa470009130 tx=0x7fa4700047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:40.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.055+0000 7fa4677fe640 10 client.?.objecter ms_handle_connect 0x7fa4880c7e20 2026-02-17T11:10:40.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.055+0000 7fa4677fe640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:40.058 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.056+0000 7fa4677fe640 1 -- 10.20.193.49:0/2632854820 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa47003c040 con 0x7fa4880c7e20 2026-02-17T11:10:40.058 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.056+0000 7fa4677fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:40.058 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.056+0000 7fa4677fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:10:40.058 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.056+0000 7fa4677fe640 10 monclient: dump: 2026-02-17T11:10:40.058 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:40.058 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:40.058 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:40.058 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:40.058 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:40.058 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:40.058 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:40.058 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:40.058 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:40.058 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:40.058 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.056+0000 7fa4677fe640 10 monclient: _finish_auth 0 2026-02-17T11:10:40.058 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.056+0000 7fa4677fe640 10 monclient: _check_auth_tickets 2026-02-17T11:10:40.058 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.056+0000 7fa4677fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:40.058 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.056+0000 7fa4677fe640 1 -- 10.20.193.49:0/2632854820 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa470042610 con 0x7fa4880c7e20 2026-02-17T11:10:40.058 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.056+0000 7fa4677fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:40.058 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.056+0000 7fa4677fe640 1 -- 10.20.193.49:0/2632854820 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4700429e0 con 0x7fa4880c7e20 2026-02-17T11:10:40.058 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.056+0000 7fa4677fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:40.058 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.056+0000 7fa4677fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:10:40.058 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.056+0000 7fa4677fe640 10 monclient: dump: 2026-02-17T11:10:40.058 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:40.058 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:40.058 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:40.058 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:40.058 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:40.058 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:40.058 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:40.058 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:40.058 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:40.058 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:40.058 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.056+0000 7fa4857fa640 4 set_mon_vals no callback set 2026-02-17T11:10:40.058 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.056+0000 7fa48d53e640 5 monclient: authenticate success, global_id 4626 2026-02-17T11:10:40.059 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.056+0000 7fa48d53e640 10 monclient: _renew_subs 2026-02-17T11:10:40.059 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.056+0000 7fa48d53e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:40.059 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.056+0000 7fa48d53e640 1 -- 10.20.193.49:0/2632854820 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4881f1fe0 con 0x7fa4880c7e20 2026-02-17T11:10:40.059 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.057+0000 7fa48d53e640 10 client.4626.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:40.059 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.057+0000 7fa48d53e640 10 monclient: _renew_subs 2026-02-17T11:10:40.059 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.057+0000 7fa48d53e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:40.059 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.057+0000 7fa48d53e640 1 -- 10.20.193.49:0/2632854820 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4881f4d10 con 0x7fa4880c7e20 2026-02-17T11:10:40.059 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.057+0000 7fa48d53e640 1 librados: init done 2026-02-17T11:10:40.059 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.057+0000 7fa48d53e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:40.059 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.057+0000 7fa48d53e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:40.059 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.057+0000 7fa48d53e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:40.059 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.057+0000 7fa48d53e640 1 -- 10.20.193.49:0/2632854820 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa48815d750 con 0x7fa4880c7e20 2026-02-17T11:10:40.070 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.069+0000 7fa4677fe640 1 -- 10.20.193.49:0/2632854820 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7fa47004b450 con 0x7fa4880c7e20 2026-02-17T11:10:40.071 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.069+0000 7fa4677fe640 1 --2- 10.20.193.49:0/2632854820 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fa4540791c0 0x7fa45407b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:40.071 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.069+0000 7fa486ffd640 1 --2- 10.20.193.49:0/2632854820 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fa4540791c0 0x7fa45407b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:40.071 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.069+0000 7fa486ffd640 10 monclient: get_auth_request con 0x7fa4540791c0 auth_method 0 2026-02-17T11:10:40.072 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.070+0000 7fa486ffd640 1 --2- 10.20.193.49:0/2632854820 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fa4540791c0 0x7fa45407b680 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa47c002770 tx=0x7fa47c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:40.072 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.070+0000 7fa4677fe640 10 client.4626.objecter ms_handle_connect 0x7fa4540791c0 2026-02-17T11:10:40.073 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.072+0000 7fa4677fe640 1 -- 10.20.193.49:0/2632854820 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8972+0+0 (secure 0 0 0) 0x7fa47002fa70 con 0x7fa4880c7e20 2026-02-17T11:10:40.073 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.072+0000 7fa4677fe640 10 client.4626.objecter ms_dispatch2 0x7fa488000b90 osd_map(33..33 src has 1..33) 2026-02-17T11:10:40.073 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.072+0000 7fa4677fe640 3 client.4626.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T11:10:40.074 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.072+0000 7fa4677fe640 3 client.4626.objecter handle_osd_map decoding full epoch 33 2026-02-17T11:10:40.074 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.072+0000 7fa4677fe640 20 client.4626.objecter dump_active .. 0 homeless 2026-02-17T11:10:40.175 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.173+0000 7fa4677fe640 1 -- 10.20.193.49:0/2632854820 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fa4700869e0 con 0x7fa4880c7e20 2026-02-17T11:10:40.175 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.173+0000 7fa4677fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:40.175 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.173+0000 7fa4677fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:40.273 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.271+0000 7fa48d53e640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:10:40.273 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.271+0000 7fa48d53e640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:10:40.273 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.271+0000 7fa48d53e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:40.273 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.271+0000 7fa48d53e640 1 -- 10.20.193.49:0/2632854820 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa488070570 con 0x7fa4880c7e20 2026-02-17T11:10:40.284 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.283+0000 7fa4677fe640 1 -- 10.20.193.49:0/2632854820 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fa47008ace0 con 0x7fa4880c7e20 2026-02-17T11:10:40.285 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.283+0000 7fa4677fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:10:40.285 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.283+0000 7fa4677fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:40.285 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:10:40.285 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:10:40.287 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.284+0000 7fa48d53e640 10 librados: watch_flush enter 2026-02-17T11:10:40.287 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.284+0000 7fa48d53e640 10 librados: watch_flush exit 2026-02-17T11:10:40.287 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.284+0000 7fa48d53e640 20 client.4626.objecter shutdown clearing up homeless session... 2026-02-17T11:10:40.287 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.284+0000 7fa48d53e640 10 client.4626.objecter successfully canceled tick 2026-02-17T11:10:40.287 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.284+0000 7fa48d53e640 1 -- 10.20.193.49:0/2632854820 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fa4540791c0 msgr2=0x7fa45407b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:40.287 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.284+0000 7fa48d53e640 1 --2- 10.20.193.49:0/2632854820 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fa4540791c0 0x7fa45407b680 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa47c002770 tx=0x7fa47c009040 comp rx=0 tx=0).stop 2026-02-17T11:10:40.288 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.284+0000 7fa48d53e640 10 monclient: shutdown 2026-02-17T11:10:40.288 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.284+0000 7fa48d53e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:40.288 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.284+0000 7fa48d53e640 1 -- 10.20.193.49:0/2632854820 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fa4880c7e20 msgr2=0x7fa4881f13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:40.288 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.284+0000 7fa48d53e640 1 --2- 10.20.193.49:0/2632854820 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fa4880c7e20 0x7fa4881f13c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa470009130 tx=0x7fa4700047c0 comp rx=0 tx=0).stop 2026-02-17T11:10:40.288 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.284+0000 7fa48d53e640 1 -- 10.20.193.49:0/2632854820 shutdown_connections 2026-02-17T11:10:40.288 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.284+0000 7fa48d53e640 1 --2- 10.20.193.49:0/2632854820 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fa4540791c0 0x7fa45407b680 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:40.288 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.284+0000 7fa48d53e640 1 --2- 10.20.193.49:0/2632854820 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fa48815d370 0x7fa488148050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:40.288 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.284+0000 7fa48d53e640 1 --2- 10.20.193.49:0/2632854820 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fa4880c7e20 0x7fa4881f13c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:40.288 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.284+0000 7fa48d53e640 1 --2- 10.20.193.49:0/2632854820 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fa4880c74c0 0x7fa4881f2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:40.289 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.284+0000 7fa48d53e640 1 -- 10.20.193.49:0/2632854820 >> 10.20.193.49:0/2632854820 conn(0x7fa4880c9f20 msgr2=0x7fa48815af00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:40.289 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.284+0000 7fa48d53e640 1 -- 10.20.193.49:0/2632854820 shutdown_connections 2026-02-17T11:10:40.289 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.284+0000 7fa48d53e640 1 -- 10.20.193.49:0/2632854820 wait complete. 2026-02-17T11:10:40.289 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:40.284+0000 7fa48d53e640 1 librados: shutdown 2026-02-17T11:10:43.295 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:10:43.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.361+0000 7f81942a0640 10 monclient: get_monmap_and_config 2026-02-17T11:10:43.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.361+0000 7f81942a0640 10 monclient: build_initial_monmap 2026-02-17T11:10:43.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.361+0000 7f81942a0640 10 monclient: monmap: 2026-02-17T11:10:43.364 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:43.364 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:43.364 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:43.362565+0000 2026-02-17T11:10:43.364 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:43.362565+0000 2026-02-17T11:10:43.364 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:43.364 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:43.364 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:43.364 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:43.364 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:43.364 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:43.364 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:43.365 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:43.365 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:43.368 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.361+0000 7f81942a0640 1 Processor -- start 2026-02-17T11:10:43.368 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.361+0000 7f81942a0640 1 -- start start 2026-02-17T11:10:43.368 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.361+0000 7f81942a0640 10 monclient: init 2026-02-17T11:10:43.369 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.361+0000 7f81942a0640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:43.369 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.361+0000 7f81942a0640 10 monclient: _add_conns ranks=[0,4,5,1,2,3] 2026-02-17T11:10:43.369 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.361+0000 7f81942a0640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f818c0c7170 addr v1:10.20.193.49:6789/0 2026-02-17T11:10:43.369 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.361+0000 7f81942a0640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f818c0c7550 0x7f818c0749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:43.369 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.361+0000 7f81942a0640 10 monclient(hunting): picked mon.noname-b con 0x7f818c0c7550 addr v2:10.20.193.97:3300/0 2026-02-17T11:10:43.369 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.361+0000 7f81942a0640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f818c074ef0 0x7f818c0c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:43.369 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.361+0000 7f81942a0640 10 monclient(hunting): picked mon.noname-c con 0x7f818c074ef0 addr v2:10.20.193.157:3300/0 2026-02-17T11:10:43.369 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.361+0000 7f81942a0640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f818c0c4fd0 con 0x7f818c0c7170 2026-02-17T11:10:43.369 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.362+0000 7f81942a0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:43.369 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.362+0000 7f81942a0640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f818c0c8530 con 0x7f818c0c7550 2026-02-17T11:10:43.369 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.362+0000 7f81942a0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:43.369 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.362+0000 7f81942a0640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f818c15a9a0 con 0x7f818c074ef0 2026-02-17T11:10:43.370 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.362+0000 7f81942a0640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:43.370 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.362+0000 7f81942a0640 10 monclient(hunting): authenticate will time out at 1120.026028s 2026-02-17T11:10:43.370 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.362+0000 7f8192015640 1 --1- >> v1:10.20.193.49:6789/0 conn(0x7f818c0c7170 0x7f818c0c48c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.49:6789/0 says I am v1:10.20.193.49:47780/0 (socket says 10.20.193.49:47780) 2026-02-17T11:10:43.370 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.362+0000 7f8192015640 1 -- 10.20.193.49:0/1492821050 learned_addr learned my addr 10.20.193.49:0/1492821050 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:10:43.370 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.362+0000 7f8192816640 1 --2- 10.20.193.49:0/1492821050 >> v2:10.20.193.157:3300/0 conn(0x7f818c074ef0 0x7f818c0c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:43.370 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.362+0000 7f8191814640 1 --2- 10.20.193.49:0/1492821050 >> v2:10.20.193.97:3300/0 conn(0x7f818c0c7550 0x7f818c0749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:43.370 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.362+0000 7f8192816640 10 monclient(hunting): get_auth_request con 0x7f818c074ef0 auth_method 0 2026-02-17T11:10:43.370 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.362+0000 7f8192816640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:43.370 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.362+0000 7f8192816640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:43.370 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.362+0000 7f8192816640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:43.370 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.362+0000 7f8191814640 10 monclient(hunting): get_auth_request con 0x7f818c0c7550 auth_method 0 2026-02-17T11:10:43.370 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.362+0000 7f8191814640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:43.371 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.362+0000 7f8191814640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:43.371 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.362+0000 7f8191814640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:43.371 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.363+0000 7f8192816640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:43.371 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.363+0000 7f8192816640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:43.371 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.363+0000 7f8192816640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:43.371 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.363+0000 7f8191814640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:43.371 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.363+0000 7f8191814640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:43.371 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.363+0000 7f8191814640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:43.371 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.363+0000 7f8191013640 1 -- 10.20.193.49:0/1492821050 <== mon.0 v1:10.20.193.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3683118203 0 0) 0x7f818c0c4fd0 con 0x7f818c0c7170 2026-02-17T11:10:43.371 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.363+0000 7f8191013640 10 monclient(hunting): _negotiate 2026-02-17T11:10:43.371 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.363+0000 7f8191013640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:43.371 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.363+0000 7f8191013640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:43.371 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.363+0000 7f8191013640 10 monclient(hunting): my global_id is 4629 2026-02-17T11:10:43.372 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.363+0000 7f8191013640 1 -- 10.20.193.49:0/1492821050 --> v1:10.20.193.49:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8174003620 con 0x7f818c0c7170 2026-02-17T11:10:43.372 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.363+0000 7f8192816640 10 monclient(hunting): handle_auth_done global_id 4637 payload 274 2026-02-17T11:10:43.372 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.363+0000 7f8192816640 1 -- 10.20.193.49:0/1492821050 >> v2:10.20.193.97:3300/0 conn(0x7f818c0c7550 msgr2=0x7f818c0749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:43.372 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.363+0000 7f8192816640 1 --2- 10.20.193.49:0/1492821050 >> v2:10.20.193.97:3300/0 conn(0x7f818c0c7550 0x7f818c0749b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:43.372 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.363+0000 7f8192816640 1 -- 10.20.193.49:0/1492821050 >> v1:10.20.193.49:6789/0 conn(0x7f818c0c7170 legacy=0x7f818c0c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:43.372 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.363+0000 7f8192816640 10 monclient: _finish_hunting 0 2026-02-17T11:10:43.372 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.363+0000 7f8192816640 1 monclient: found mon.noname-c 2026-02-17T11:10:43.372 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.363+0000 7f8192816640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:43.372 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.363+0000 7f8192816640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:10:43.372 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.363+0000 7f8192816640 1 -- 10.20.193.49:0/1492821050 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f818c0c5270 con 0x7f818c074ef0 2026-02-17T11:10:43.372 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.364+0000 7f8192816640 1 --2- 10.20.193.49:0/1492821050 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f818c074ef0 0x7f818c0c89c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f818c0c84a0 tx=0x7f818802f1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72279b67c3fae167 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:43.379 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.366+0000 7f8191013640 1 -- 10.20.193.49:0/1492821050 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f818803c070 con 0x7f818c074ef0 2026-02-17T11:10:43.379 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.366+0000 7f8191013640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:43.379 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.366+0000 7f8191013640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:10:43.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.366+0000 7f8191013640 10 monclient: dump: 2026-02-17T11:10:43.380 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:43.380 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:43.380 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:43.380 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:43.380 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:43.380 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:43.380 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:43.380 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:43.380 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:43.380 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:43.381 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.366+0000 7f8191013640 10 monclient: _finish_auth 0 2026-02-17T11:10:43.381 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.366+0000 7f8191013640 10 monclient: _check_auth_tickets 2026-02-17T11:10:43.381 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.366+0000 7f8191013640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:43.381 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.366+0000 7f8191013640 1 -- 10.20.193.49:0/1492821050 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8188037440 con 0x7f818c074ef0 2026-02-17T11:10:43.381 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.366+0000 7f8191013640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:43.381 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.366+0000 7f8191013640 1 -- 10.20.193.49:0/1492821050 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8188037810 con 0x7f818c074ef0 2026-02-17T11:10:43.381 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.366+0000 7f8191013640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:43.381 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.366+0000 7f8191013640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:10:43.381 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.366+0000 7f8191013640 10 monclient: dump: 2026-02-17T11:10:43.381 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:43.381 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:43.381 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:43.382 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:43.382 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:43.382 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:43.382 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:43.382 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:43.382 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:43.382 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:43.382 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.366+0000 7f81942a0640 5 monclient: authenticate success, global_id 4637 2026-02-17T11:10:43.382 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.366+0000 7f81942a0640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:43.382 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.366+0000 7f81942a0640 4 set_mon_vals no callback set 2026-02-17T11:10:43.382 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.366+0000 7f81942a0640 10 monclient: shutdown 2026-02-17T11:10:43.382 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.366+0000 7f81942a0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:43.382 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.366+0000 7f81942a0640 1 -- 10.20.193.49:0/1492821050 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f818c074ef0 msgr2=0x7f818c0c89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:43.383 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.366+0000 7f81942a0640 1 --2- 10.20.193.49:0/1492821050 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f818c074ef0 0x7f818c0c89c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f818c0c84a0 tx=0x7f818802f1c0 comp rx=0 tx=0).stop 2026-02-17T11:10:43.383 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.366+0000 7f81942a0640 1 -- 10.20.193.49:0/1492821050 shutdown_connections 2026-02-17T11:10:43.383 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.366+0000 7f81942a0640 1 --2- 10.20.193.49:0/1492821050 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f818c074ef0 0x7f818c0c89c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:43.383 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.366+0000 7f81942a0640 1 --2- 10.20.193.49:0/1492821050 >> v2:10.20.193.97:3300/0 conn(0x7f818c0c7550 0x7f818c0749b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:43.383 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.367+0000 7f81942a0640 1 -- 10.20.193.49:0/1492821050 >> 10.20.193.49:0/1492821050 conn(0x7f818c0c9f40 msgr2=0x7f818c0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:43.383 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.367+0000 7f81942a0640 1 -- 10.20.193.49:0/1492821050 shutdown_connections 2026-02-17T11:10:43.383 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.367+0000 7f81942a0640 1 -- 10.20.193.49:0/1492821050 wait complete. 2026-02-17T11:10:43.383 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.367+0000 7f81942a0640 10 monclient: build_initial_monmap 2026-02-17T11:10:43.383 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.367+0000 7f81942a0640 10 monclient: monmap: 2026-02-17T11:10:43.383 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:43.383 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:43.383 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:43.384 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:43.384 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:43.384 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:43.384 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:43.384 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:43.384 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:43.384 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:43.384 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.367+0000 7f81942a0640 1 librados: starting msgr at 2026-02-17T11:10:43.384 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.367+0000 7f81942a0640 1 librados: starting objecter 2026-02-17T11:10:43.384 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.367+0000 7f81942a0640 1 Processor -- start 2026-02-17T11:10:43.384 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.367+0000 7f81942a0640 1 -- start start 2026-02-17T11:10:43.384 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.367+0000 7f81942a0640 1 librados: setting wanted keys 2026-02-17T11:10:43.385 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.367+0000 7f81942a0640 1 librados: calling monclient init 2026-02-17T11:10:43.385 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.367+0000 7f81942a0640 10 monclient: init 2026-02-17T11:10:43.385 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.368+0000 7f81942a0640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:43.385 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.368+0000 7f81942a0640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:10:43.385 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.368+0000 7f81942a0640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f818c074ef0 0x7f818c158ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:43.385 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.368+0000 7f81942a0640 10 monclient(hunting): picked mon.noname-a con 0x7f818c074ef0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:43.385 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.368+0000 7f81942a0640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f818c0c7170 0x7f818c0c2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:43.385 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.368+0000 7f81942a0640 10 monclient(hunting): picked mon.noname-b con 0x7f818c0c7170 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:43.385 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.368+0000 7f81942a0640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f818c0c7550 0x7f818c0c2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:43.385 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.368+0000 7f81942a0640 10 monclient(hunting): picked mon.noname-c con 0x7f818c0c7550 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:43.385 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.368+0000 7f81942a0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:43.385 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.368+0000 7f81942a0640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f818c0c7ee0 con 0x7f818c074ef0 2026-02-17T11:10:43.385 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.368+0000 7f81942a0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:43.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.368+0000 7f81942a0640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f818c0c5830 con 0x7f818c0c7170 2026-02-17T11:10:43.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.368+0000 7f81942a0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:43.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.368+0000 7f81942a0640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f818c0c81c0 con 0x7f818c0c7550 2026-02-17T11:10:43.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.368+0000 7f81942a0640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:43.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.368+0000 7f81942a0640 10 monclient(hunting): authenticate will time out at 1120.032424s 2026-02-17T11:10:43.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.368+0000 7f8192015640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f818c074ef0 0x7f818c158ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:43.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.368+0000 7f8192816640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f818c0c7550 0x7f818c0c2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:43.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.368+0000 7f8192015640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f818c074ef0 0x7f818c158ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:33834/0 (socket says 10.20.193.49:33834) 2026-02-17T11:10:43.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.368+0000 7f8192015640 1 -- 10.20.193.49:0/4147104188 learned_addr learned my addr 10.20.193.49:0/4147104188 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:43.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.368+0000 7f8192015640 10 monclient(hunting): get_auth_request con 0x7f818c074ef0 auth_method 0 2026-02-17T11:10:43.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.368+0000 7f8192015640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:43.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.368+0000 7f8192015640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:43.387 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.368+0000 7f8192015640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:43.387 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.368+0000 7f8191814640 1 --2- 10.20.193.49:0/4147104188 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f818c0c7170 0x7f818c0c2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:43.387 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.368+0000 7f8192816640 10 monclient(hunting): get_auth_request con 0x7f818c0c7550 auth_method 0 2026-02-17T11:10:43.387 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.368+0000 7f8192816640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:43.387 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.368+0000 7f8192816640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:43.387 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.368+0000 7f8192816640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:43.387 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.369+0000 7f8191814640 10 monclient(hunting): get_auth_request con 0x7f818c0c7170 auth_method 0 2026-02-17T11:10:43.387 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.369+0000 7f8191814640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:43.387 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.369+0000 7f8191814640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:43.387 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.369+0000 7f8191814640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:43.388 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.369+0000 7f8192015640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:43.388 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.369+0000 7f8192015640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:43.388 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.369+0000 7f8192015640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:43.388 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.369+0000 7f8192816640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:43.388 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.369+0000 7f8192816640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:43.388 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.369+0000 7f8192816640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:43.388 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.369+0000 7f8191814640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:43.388 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.369+0000 7f8191814640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:43.388 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.369+0000 7f8191814640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:43.388 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.370+0000 7f8192015640 10 monclient(hunting): handle_auth_done global_id 4632 payload 824 2026-02-17T11:10:43.388 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.370+0000 7f8192015640 1 -- 10.20.193.49:0/4147104188 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f818c0c7550 msgr2=0x7f818c0c2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:43.388 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.370+0000 7f8192015640 1 --2- 10.20.193.49:0/4147104188 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f818c0c7550 0x7f818c0c2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:43.388 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.370+0000 7f8192015640 1 -- 10.20.193.49:0/4147104188 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f818c0c7170 msgr2=0x7f818c0c2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:43.389 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.370+0000 7f8192015640 1 --2- 10.20.193.49:0/4147104188 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f818c0c7170 0x7f818c0c2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:43.389 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.370+0000 7f8192015640 10 monclient: _finish_hunting 0 2026-02-17T11:10:43.389 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.370+0000 7f8192015640 1 monclient: found mon.noname-a 2026-02-17T11:10:43.389 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.370+0000 7f8192015640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:43.389 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.370+0000 7f8192015640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:10:43.389 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.370+0000 7f8192015640 1 -- 10.20.193.49:0/4147104188 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f818c0c20a0 con 0x7f818c074ef0 2026-02-17T11:10:43.389 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.371+0000 7f8192015640 1 --2- 10.20.193.49:0/4147104188 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f818c074ef0 0x7f818c158ef0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f817c00c700 tx=0x7f817c00cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:43.389 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.371+0000 7f8172ffd640 10 client.?.objecter ms_handle_connect 0x7f818c074ef0 2026-02-17T11:10:43.389 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.371+0000 7f8172ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:43.389 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.373+0000 7f8172ffd640 1 -- 10.20.193.49:0/4147104188 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f817c017070 con 0x7f818c074ef0 2026-02-17T11:10:43.389 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.373+0000 7f8172ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:43.389 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.373+0000 7f8172ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:10:43.390 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.373+0000 7f8172ffd640 10 monclient: dump: 2026-02-17T11:10:43.390 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:43.390 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:43.390 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:43.390 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:43.390 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:43.390 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:43.390 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:43.390 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:43.390 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:43.390 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:43.390 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.373+0000 7f8172ffd640 10 monclient: _finish_auth 0 2026-02-17T11:10:43.390 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.373+0000 7f8172ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:10:43.391 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.373+0000 7f8172ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:43.391 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.373+0000 7f8172ffd640 1 -- 10.20.193.49:0/4147104188 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f817c005bd0 con 0x7f818c074ef0 2026-02-17T11:10:43.391 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.373+0000 7f81942a0640 5 monclient: authenticate success, global_id 4632 2026-02-17T11:10:43.391 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.373+0000 7f81942a0640 10 monclient: _renew_subs 2026-02-17T11:10:43.391 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.373+0000 7f81942a0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:43.391 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.373+0000 7f81942a0640 1 -- 10.20.193.49:0/4147104188 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f818c1f7570 con 0x7f818c074ef0 2026-02-17T11:10:43.391 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.373+0000 7f8172ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:43.391 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.373+0000 7f8172ffd640 1 -- 10.20.193.49:0/4147104188 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f817c007070 con 0x7f818c074ef0 2026-02-17T11:10:43.391 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.373+0000 7f8172ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:43.391 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.373+0000 7f8172ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:10:43.391 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.373+0000 7f8172ffd640 10 monclient: dump: 2026-02-17T11:10:43.391 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:43.391 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:43.392 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:43.392 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:43.392 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:43.392 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:43.392 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:43.392 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:43.392 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:43.392 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:43.392 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.373+0000 7f8190812640 4 set_mon_vals no callback set 2026-02-17T11:10:43.392 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.373+0000 7f81942a0640 10 client.4632.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:43.392 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.373+0000 7f81942a0640 10 monclient: _renew_subs 2026-02-17T11:10:43.392 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.373+0000 7f81942a0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:43.393 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.373+0000 7f81942a0640 1 -- 10.20.193.49:0/4147104188 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f818c1f6cd0 con 0x7f818c074ef0 2026-02-17T11:10:43.393 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.373+0000 7f81942a0640 1 librados: init done 2026-02-17T11:10:43.393 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.373+0000 7f81942a0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:43.393 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.373+0000 7f81942a0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:43.393 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.373+0000 7f81942a0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:43.393 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.373+0000 7f81942a0640 1 -- 10.20.193.49:0/4147104188 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f818c0749b0 con 0x7f818c074ef0 2026-02-17T11:10:43.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.385+0000 7f8172ffd640 1 -- 10.20.193.49:0/4147104188 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f817c007210 con 0x7f818c074ef0 2026-02-17T11:10:43.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.385+0000 7f8172ffd640 1 --2- 10.20.193.49:0/4147104188 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f815c0791c0 0x7f815c07b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:43.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.385+0000 7f8191814640 1 --2- 10.20.193.49:0/4147104188 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f815c0791c0 0x7f815c07b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:43.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.385+0000 7f8191814640 10 monclient: get_auth_request con 0x7f815c0791c0 auth_method 0 2026-02-17T11:10:43.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.386+0000 7f8172ffd640 10 client.4632.objecter ms_handle_connect 0x7f815c0791c0 2026-02-17T11:10:43.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.386+0000 7f8191814640 1 --2- 10.20.193.49:0/4147104188 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f815c0791c0 0x7f815c07b680 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f818c06f850 tx=0x7f8180009290 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:43.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.387+0000 7f8172ffd640 1 -- 10.20.193.49:0/4147104188 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f817c05d640 con 0x7f818c074ef0 2026-02-17T11:10:43.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.387+0000 7f8172ffd640 10 client.4632.objecter ms_dispatch2 0x7f818c000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:10:43.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.387+0000 7f8172ffd640 3 client.4632.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:10:43.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.387+0000 7f8172ffd640 3 client.4632.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:10:43.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.387+0000 7f8172ffd640 20 client.4632.objecter dump_active .. 0 homeless 2026-02-17T11:10:43.489 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.486+0000 7f8172ffd640 1 -- 10.20.193.49:0/4147104188 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f817c021020 con 0x7f818c074ef0 2026-02-17T11:10:43.489 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.486+0000 7f8172ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:43.489 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.486+0000 7f8172ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:43.589 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.586+0000 7f81942a0640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:10:43.589 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.586+0000 7f81942a0640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:10:43.589 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.586+0000 7f81942a0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:43.589 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.586+0000 7f81942a0640 1 -- 10.20.193.49:0/4147104188 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f818c0c2270 con 0x7f818c074ef0 2026-02-17T11:10:43.592 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.589+0000 7f8172ffd640 1 -- 10.20.193.49:0/4147104188 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f817c061600 con 0x7f818c074ef0 2026-02-17T11:10:43.592 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.589+0000 7f8172ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:10:43.592 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.589+0000 7f8172ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:43.592 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:10:43.592 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:10:43.594 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.590+0000 7f81942a0640 10 librados: watch_flush enter 2026-02-17T11:10:43.594 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.590+0000 7f81942a0640 10 librados: watch_flush exit 2026-02-17T11:10:43.594 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.590+0000 7f81942a0640 20 client.4632.objecter shutdown clearing up homeless session... 2026-02-17T11:10:43.594 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.590+0000 7f81942a0640 10 client.4632.objecter successfully canceled tick 2026-02-17T11:10:43.594 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.590+0000 7f81942a0640 1 -- 10.20.193.49:0/4147104188 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f815c0791c0 msgr2=0x7f815c07b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:43.594 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.590+0000 7f81942a0640 1 --2- 10.20.193.49:0/4147104188 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f815c0791c0 0x7f815c07b680 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f818c06f850 tx=0x7f8180009290 comp rx=0 tx=0).stop 2026-02-17T11:10:43.594 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.590+0000 7f81942a0640 10 monclient: shutdown 2026-02-17T11:10:43.594 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.590+0000 7f81942a0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:43.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.590+0000 7f81942a0640 1 -- 10.20.193.49:0/4147104188 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f818c074ef0 msgr2=0x7f818c158ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:43.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.590+0000 7f81942a0640 1 --2- 10.20.193.49:0/4147104188 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f818c074ef0 0x7f818c158ef0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f817c00c700 tx=0x7f817c00cbd0 comp rx=0 tx=0).stop 2026-02-17T11:10:43.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.590+0000 7f81942a0640 1 -- 10.20.193.49:0/4147104188 shutdown_connections 2026-02-17T11:10:43.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.590+0000 7f81942a0640 1 --2- 10.20.193.49:0/4147104188 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f815c0791c0 0x7f815c07b680 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:43.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.590+0000 7f81942a0640 1 --2- 10.20.193.49:0/4147104188 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f818c0c7550 0x7f818c0c2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:43.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.590+0000 7f81942a0640 1 --2- 10.20.193.49:0/4147104188 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f818c0c7170 0x7f818c0c2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:43.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.590+0000 7f81942a0640 1 --2- 10.20.193.49:0/4147104188 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f818c074ef0 0x7f818c158ef0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:43.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.590+0000 7f81942a0640 1 -- 10.20.193.49:0/4147104188 >> 10.20.193.49:0/4147104188 conn(0x7f818c0c9f40 msgr2=0x7f818c074090 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:43.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.590+0000 7f81942a0640 1 -- 10.20.193.49:0/4147104188 shutdown_connections 2026-02-17T11:10:43.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.590+0000 7f81942a0640 1 -- 10.20.193.49:0/4147104188 wait complete. 2026-02-17T11:10:43.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:43.590+0000 7f81942a0640 1 librados: shutdown 2026-02-17T11:10:46.602 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:10:46.671 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.668+0000 7fc5290bf640 10 monclient: get_monmap_and_config 2026-02-17T11:10:46.671 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.668+0000 7fc5290bf640 10 monclient: build_initial_monmap 2026-02-17T11:10:46.671 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.668+0000 7fc5290bf640 10 monclient: monmap: 2026-02-17T11:10:46.671 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:46.671 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:46.671 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:46.670089+0000 2026-02-17T11:10:46.671 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:46.670089+0000 2026-02-17T11:10:46.672 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:46.672 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:46.672 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:46.672 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:46.672 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:46.672 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:46.672 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:46.672 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:46.672 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:46.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.669+0000 7fc5290bf640 1 Processor -- start 2026-02-17T11:10:46.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.669+0000 7fc5290bf640 1 -- start start 2026-02-17T11:10:46.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.669+0000 7fc5290bf640 10 monclient: init 2026-02-17T11:10:46.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.669+0000 7fc5290bf640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:46.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.669+0000 7fc5290bf640 10 monclient: _add_conns ranks=[2,4,0,3,5,1] 2026-02-17T11:10:46.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.669+0000 7fc5290bf640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fc5240c7170 addr v1:10.20.193.157:6789/0 2026-02-17T11:10:46.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.669+0000 7fc5290bf640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7fc5240c7550 0x7fc5240749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:46.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.669+0000 7fc5290bf640 10 monclient(hunting): picked mon.noname-b con 0x7fc5240c7550 addr v2:10.20.193.97:3300/0 2026-02-17T11:10:46.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.669+0000 7fc5290bf640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc524074ef0 addr v1:10.20.193.49:6789/0 2026-02-17T11:10:46.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.669+0000 7fc5290bf640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5240c4fd0 con 0x7fc524074ef0 2026-02-17T11:10:46.677 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.669+0000 7fc5290bf640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc52415a9a0 con 0x7fc5240c7170 2026-02-17T11:10:46.677 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.669+0000 7fc5290bf640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:46.677 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.669+0000 7fc5290bf640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7fc5240c8530 con 0x7fc5240c7550 2026-02-17T11:10:46.677 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.669+0000 7fc5290bf640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:46.677 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.669+0000 7fc5290bf640 10 monclient(hunting): authenticate will time out at 1123.333688s 2026-02-17T11:10:46.677 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.670+0000 7fc523577640 1 --1- >> v1:10.20.193.49:6789/0 conn(0x7fc524074ef0 0x7fc5240c89c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.49:6789/0 says I am v1:10.20.193.49:54562/0 (socket says 10.20.193.49:54562) 2026-02-17T11:10:46.677 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.670+0000 7fc523577640 1 -- 10.20.193.49:0/191618968 learned_addr learned my addr 10.20.193.49:0/191618968 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:10:46.677 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.670+0000 7fc522d76640 1 --1- 10.20.193.49:0/191618968 >> v1:10.20.193.157:6789/0 conn(0x7fc5240c7170 0x7fc5240c48c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.157:6789/0 says I am v1:10.20.193.49:43382/0 (socket says 10.20.193.49:43382) 2026-02-17T11:10:46.677 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.670+0000 7fc522575640 1 --2- 10.20.193.49:0/191618968 >> v2:10.20.193.97:3300/0 conn(0x7fc5240c7550 0x7fc5240749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:46.677 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.670+0000 7fc522575640 10 monclient(hunting): get_auth_request con 0x7fc5240c7550 auth_method 0 2026-02-17T11:10:46.677 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.670+0000 7fc522575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:46.677 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.670+0000 7fc522575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:46.677 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.670+0000 7fc522575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:46.677 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.670+0000 7fc522575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:46.677 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.670+0000 7fc522575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:46.677 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.670+0000 7fc522575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:46.677 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.671+0000 7fc521d74640 1 -- 10.20.193.49:0/191618968 <== mon.0 v1:10.20.193.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2897140816 0 0) 0x7fc5240c4fd0 con 0x7fc524074ef0 2026-02-17T11:10:46.677 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.671+0000 7fc521d74640 10 monclient(hunting): _negotiate 2026-02-17T11:10:46.677 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.671+0000 7fc521d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:46.677 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.671+0000 7fc521d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:46.677 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.671+0000 7fc521d74640 10 monclient(hunting): my global_id is 4635 2026-02-17T11:10:46.678 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.671+0000 7fc521d74640 1 -- 10.20.193.49:0/191618968 --> v1:10.20.193.49:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc510003620 con 0x7fc524074ef0 2026-02-17T11:10:46.678 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.671+0000 7fc521d74640 1 -- 10.20.193.49:0/191618968 <== mon.2 v1:10.20.193.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1878501687 0 0) 0x7fc52415a9a0 con 0x7fc5240c7170 2026-02-17T11:10:46.678 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.671+0000 7fc521d74640 10 monclient(hunting): _negotiate 2026-02-17T11:10:46.678 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.671+0000 7fc521d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:46.678 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.671+0000 7fc521d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:46.678 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.671+0000 7fc521d74640 10 monclient(hunting): my global_id is 4643 2026-02-17T11:10:46.678 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.671+0000 7fc521d74640 1 -- 10.20.193.49:0/191618968 --> v1:10.20.193.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5240c4fd0 con 0x7fc5240c7170 2026-02-17T11:10:46.678 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.671+0000 7fc522575640 10 monclient(hunting): handle_auth_done global_id 4609 payload 274 2026-02-17T11:10:46.678 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.671+0000 7fc522575640 1 -- 10.20.193.49:0/191618968 >> v1:10.20.193.157:6789/0 conn(0x7fc5240c7170 legacy=0x7fc5240c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:46.678 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.671+0000 7fc522575640 1 -- 10.20.193.49:0/191618968 >> v1:10.20.193.49:6789/0 conn(0x7fc524074ef0 legacy=0x7fc5240c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:46.678 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.671+0000 7fc522575640 10 monclient: _finish_hunting 0 2026-02-17T11:10:46.678 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.671+0000 7fc522575640 1 monclient: found mon.noname-b 2026-02-17T11:10:46.678 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.671+0000 7fc522575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:46.678 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.671+0000 7fc522575640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:10:46.678 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.671+0000 7fc522575640 1 -- 10.20.193.49:0/191618968 --> v2:10.20.193.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5240c5270 con 0x7fc5240c7550 2026-02-17T11:10:46.678 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.672+0000 7fc522575640 1 --2- 10.20.193.49:0/191618968 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc5240c7550 0x7fc5240749b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc50c0098a0 tx=0x7fc50c02ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c37124abe47bb509 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:46.679 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.674+0000 7fc521d74640 1 -- 10.20.193.49:0/191618968 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc50c03c070 con 0x7fc5240c7550 2026-02-17T11:10:46.679 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.674+0000 7fc521d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:46.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.674+0000 7fc521d74640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:10:46.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.674+0000 7fc521d74640 10 monclient: dump: 2026-02-17T11:10:46.680 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:46.680 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:46.680 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:46.680 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:46.680 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:46.680 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:46.680 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:46.680 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:46.680 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:46.680 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:46.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.674+0000 7fc521d74640 10 monclient: _finish_auth 0 2026-02-17T11:10:46.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.674+0000 7fc521d74640 10 monclient: _check_auth_tickets 2026-02-17T11:10:46.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.674+0000 7fc521d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:46.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.674+0000 7fc5290bf640 5 monclient: authenticate success, global_id 4609 2026-02-17T11:10:46.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.674+0000 7fc521d74640 1 -- 10.20.193.49:0/191618968 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc50c02fb70 con 0x7fc5240c7550 2026-02-17T11:10:46.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.674+0000 7fc521d74640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:46.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.674+0000 7fc521d74640 1 -- 10.20.193.49:0/191618968 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc50c037440 con 0x7fc5240c7550 2026-02-17T11:10:46.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.674+0000 7fc5290bf640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:46.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.674+0000 7fc5290bf640 4 set_mon_vals no callback set 2026-02-17T11:10:46.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.674+0000 7fc521d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:46.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.674+0000 7fc521d74640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:46.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.674+0000 7fc521d74640 10 monclient: dump: 2026-02-17T11:10:46.680 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:46.680 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:46.680 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:46.680 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:46.680 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:46.680 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:46.680 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:46.680 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:46.680 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:46.680 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:46.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.674+0000 7fc5290bf640 10 monclient: shutdown 2026-02-17T11:10:46.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.674+0000 7fc5290bf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:46.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.674+0000 7fc5290bf640 1 -- 10.20.193.49:0/191618968 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc5240c7550 msgr2=0x7fc5240749b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:46.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.674+0000 7fc5290bf640 1 --2- 10.20.193.49:0/191618968 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc5240c7550 0x7fc5240749b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc50c0098a0 tx=0x7fc50c02ee60 comp rx=0 tx=0).stop 2026-02-17T11:10:46.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.674+0000 7fc5290bf640 1 -- 10.20.193.49:0/191618968 shutdown_connections 2026-02-17T11:10:46.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.674+0000 7fc5290bf640 1 --2- 10.20.193.49:0/191618968 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc5240c7550 0x7fc5240749b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:46.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.674+0000 7fc5290bf640 1 -- 10.20.193.49:0/191618968 >> 10.20.193.49:0/191618968 conn(0x7fc5240c9f40 msgr2=0x7fc5240ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:46.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.674+0000 7fc5290bf640 1 -- 10.20.193.49:0/191618968 shutdown_connections 2026-02-17T11:10:46.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.674+0000 7fc5290bf640 1 -- 10.20.193.49:0/191618968 wait complete. 2026-02-17T11:10:46.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.675+0000 7fc5290bf640 10 monclient: build_initial_monmap 2026-02-17T11:10:46.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.675+0000 7fc5290bf640 10 monclient: monmap: 2026-02-17T11:10:46.681 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:46.681 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:46.681 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:46.681 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:46.681 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:46.681 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:46.681 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:46.681 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:46.681 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:46.681 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:46.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.675+0000 7fc5290bf640 1 librados: starting msgr at 2026-02-17T11:10:46.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.675+0000 7fc5290bf640 1 librados: starting objecter 2026-02-17T11:10:46.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.675+0000 7fc5290bf640 1 Processor -- start 2026-02-17T11:10:46.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.675+0000 7fc5290bf640 1 -- start start 2026-02-17T11:10:46.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.675+0000 7fc5290bf640 1 librados: setting wanted keys 2026-02-17T11:10:46.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.675+0000 7fc5290bf640 1 librados: calling monclient init 2026-02-17T11:10:46.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.675+0000 7fc5290bf640 10 monclient: init 2026-02-17T11:10:46.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.675+0000 7fc5290bf640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:46.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.675+0000 7fc5290bf640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:10:46.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.675+0000 7fc5290bf640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc524074ef0 0x7fc524158e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:46.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.675+0000 7fc5290bf640 10 monclient(hunting): picked mon.noname-a con 0x7fc524074ef0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:46.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.675+0000 7fc5290bf640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc5240c7170 0x7fc5241554f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:46.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.675+0000 7fc5290bf640 10 monclient(hunting): picked mon.noname-b con 0x7fc5240c7170 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:46.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.675+0000 7fc5290bf640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc5240c7550 0x7fc5241543c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:46.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.675+0000 7fc5290bf640 10 monclient(hunting): picked mon.noname-c con 0x7fc5240c7550 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:46.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.675+0000 7fc5290bf640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:46.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.675+0000 7fc5290bf640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc5240c7ee0 con 0x7fc524074ef0 2026-02-17T11:10:46.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.675+0000 7fc5290bf640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:46.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.675+0000 7fc5290bf640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc5240c5830 con 0x7fc5240c7170 2026-02-17T11:10:46.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.675+0000 7fc5290bf640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:46.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.675+0000 7fc5290bf640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc5240c81c0 con 0x7fc5240c7550 2026-02-17T11:10:46.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.675+0000 7fc5290bf640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:46.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.675+0000 7fc5290bf640 10 monclient(hunting): authenticate will time out at 1123.339729s 2026-02-17T11:10:46.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.675+0000 7fc522d76640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc524074ef0 0x7fc524158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:46.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.676+0000 7fc522575640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc5240c7170 0x7fc5241554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:46.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.676+0000 7fc522d76640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc524074ef0 0x7fc524158e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:59672/0 (socket says 10.20.193.49:59672) 2026-02-17T11:10:46.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.676+0000 7fc522d76640 1 -- 10.20.193.49:0/1021869905 learned_addr learned my addr 10.20.193.49:0/1021869905 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:46.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.676+0000 7fc522d76640 10 monclient(hunting): get_auth_request con 0x7fc524074ef0 auth_method 0 2026-02-17T11:10:46.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.676+0000 7fc522d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:46.682 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.676+0000 7fc522d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:46.682 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.676+0000 7fc522d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:46.682 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.676+0000 7fc523577640 1 --2- 10.20.193.49:0/1021869905 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc5240c7550 0x7fc5241543c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:46.682 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.676+0000 7fc522575640 10 monclient(hunting): get_auth_request con 0x7fc5240c7170 auth_method 0 2026-02-17T11:10:46.682 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.676+0000 7fc522575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:46.682 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.676+0000 7fc522575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:46.682 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.676+0000 7fc522575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:46.682 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.676+0000 7fc523577640 10 monclient(hunting): get_auth_request con 0x7fc5240c7550 auth_method 0 2026-02-17T11:10:46.682 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.676+0000 7fc523577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:46.682 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.676+0000 7fc523577640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:46.682 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.676+0000 7fc523577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:46.682 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.676+0000 7fc522d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:46.682 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.676+0000 7fc522d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:46.682 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.676+0000 7fc522d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:46.682 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.676+0000 7fc522575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:46.682 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.676+0000 7fc522575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:46.682 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.676+0000 7fc522575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:46.682 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.676+0000 7fc523577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:46.682 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.676+0000 7fc523577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:46.682 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.676+0000 7fc523577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:46.682 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.677+0000 7fc522d76640 10 monclient(hunting): handle_auth_done global_id 4638 payload 824 2026-02-17T11:10:46.682 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.677+0000 7fc522d76640 1 -- 10.20.193.49:0/1021869905 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc5240c7550 msgr2=0x7fc5241543c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:46.682 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.677+0000 7fc522d76640 1 --2- 10.20.193.49:0/1021869905 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc5240c7550 0x7fc5241543c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:46.682 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.677+0000 7fc522d76640 1 -- 10.20.193.49:0/1021869905 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc5240c7170 msgr2=0x7fc5241554f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:46.682 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.677+0000 7fc522d76640 1 --2- 10.20.193.49:0/1021869905 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc5240c7170 0x7fc5241554f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:46.682 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.677+0000 7fc522d76640 10 monclient: _finish_hunting 0 2026-02-17T11:10:46.682 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.677+0000 7fc522d76640 1 monclient: found mon.noname-a 2026-02-17T11:10:46.682 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.677+0000 7fc522d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:46.682 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.677+0000 7fc522d76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:10:46.682 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.677+0000 7fc522d76640 1 -- 10.20.193.49:0/1021869905 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc52414af50 con 0x7fc524074ef0 2026-02-17T11:10:46.683 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.678+0000 7fc522d76640 1 --2- 10.20.193.49:0/1021869905 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc524074ef0 0x7fc524158e80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc51800c730 tx=0x7fc51800cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:46.683 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.678+0000 7fc5037fe640 10 client.?.objecter ms_handle_connect 0x7fc524074ef0 2026-02-17T11:10:46.683 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.678+0000 7fc5037fe640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:46.683 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.680+0000 7fc5037fe640 1 -- 10.20.193.49:0/1021869905 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc518004ae0 con 0x7fc524074ef0 2026-02-17T11:10:46.683 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.680+0000 7fc5037fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:46.683 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.680+0000 7fc5037fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:10:46.683 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.680+0000 7fc5037fe640 10 monclient: dump: 2026-02-17T11:10:46.683 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:46.683 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:46.683 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:46.683 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:46.683 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:46.683 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:46.683 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:46.683 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:46.683 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:46.683 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:46.683 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.680+0000 7fc5037fe640 10 monclient: _finish_auth 0 2026-02-17T11:10:46.683 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.680+0000 7fc5037fe640 10 monclient: _check_auth_tickets 2026-02-17T11:10:46.683 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.680+0000 7fc5037fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:46.683 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.680+0000 7fc5037fe640 1 -- 10.20.193.49:0/1021869905 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc518004c80 con 0x7fc524074ef0 2026-02-17T11:10:46.683 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.680+0000 7fc5037fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:46.683 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.680+0000 7fc5037fe640 1 -- 10.20.193.49:0/1021869905 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5180072b0 con 0x7fc524074ef0 2026-02-17T11:10:46.683 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.680+0000 7fc5290bf640 5 monclient: authenticate success, global_id 4638 2026-02-17T11:10:46.683 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.680+0000 7fc5290bf640 10 monclient: _renew_subs 2026-02-17T11:10:46.683 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.680+0000 7fc521573640 4 set_mon_vals no callback set 2026-02-17T11:10:46.683 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.680+0000 7fc5290bf640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:46.683 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.680+0000 7fc5290bf640 1 -- 10.20.193.49:0/1021869905 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc52414b230 con 0x7fc524074ef0 2026-02-17T11:10:46.683 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.680+0000 7fc5037fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:46.683 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.680+0000 7fc5037fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:10:46.683 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.680+0000 7fc5037fe640 10 monclient: dump: 2026-02-17T11:10:46.683 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:46.683 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:46.684 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:46.684 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:46.684 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:46.684 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:46.684 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:46.684 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:46.684 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:46.684 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:46.684 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.680+0000 7fc5290bf640 10 client.4638.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:46.684 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.680+0000 7fc5290bf640 10 monclient: _renew_subs 2026-02-17T11:10:46.684 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.680+0000 7fc5290bf640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:46.684 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.680+0000 7fc5290bf640 1 -- 10.20.193.49:0/1021869905 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc52414b7f0 con 0x7fc524074ef0 2026-02-17T11:10:46.684 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.680+0000 7fc5290bf640 1 librados: init done 2026-02-17T11:10:46.684 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.681+0000 7fc5290bf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:46.684 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.681+0000 7fc5290bf640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:46.684 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.681+0000 7fc5290bf640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:46.684 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.681+0000 7fc5290bf640 1 -- 10.20.193.49:0/1021869905 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc52414c2b0 con 0x7fc524074ef0 2026-02-17T11:10:46.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.692+0000 7fc5037fe640 1 -- 10.20.193.49:0/1021869905 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7fc518007450 con 0x7fc524074ef0 2026-02-17T11:10:46.695 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.692+0000 7fc5037fe640 1 --2- 10.20.193.49:0/1021869905 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fc4f00791c0 0x7fc4f007b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:46.695 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.692+0000 7fc522575640 1 --2- 10.20.193.49:0/1021869905 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fc4f00791c0 0x7fc4f007b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:46.695 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.692+0000 7fc522575640 10 monclient: get_auth_request con 0x7fc4f00791c0 auth_method 0 2026-02-17T11:10:46.696 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.693+0000 7fc522575640 1 --2- 10.20.193.49:0/1021869905 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fc4f00791c0 0x7fc4f007b680 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc50c039000 tx=0x7fc50c033000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:46.696 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.693+0000 7fc5037fe640 10 client.4638.objecter ms_handle_connect 0x7fc4f00791c0 2026-02-17T11:10:46.696 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.694+0000 7fc5037fe640 1 -- 10.20.193.49:0/1021869905 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7fc51805dd80 con 0x7fc524074ef0 2026-02-17T11:10:46.696 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.694+0000 7fc5037fe640 10 client.4638.objecter ms_dispatch2 0x7fc524000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:10:46.697 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.694+0000 7fc5037fe640 3 client.4638.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:10:46.697 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.694+0000 7fc5037fe640 3 client.4638.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:10:46.697 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.694+0000 7fc5037fe640 20 client.4638.objecter dump_active .. 0 homeless 2026-02-17T11:10:46.796 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.793+0000 7fc5037fe640 1 -- 10.20.193.49:0/1021869905 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc52414c2b0 con 0x7fc524074ef0 2026-02-17T11:10:46.796 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.793+0000 7fc5037fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:46.796 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.793+0000 7fc5037fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:46.896 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.894+0000 7fc5290bf640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:10:46.896 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.894+0000 7fc5290bf640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:10:46.896 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.894+0000 7fc5290bf640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:46.896 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.894+0000 7fc5290bf640 1 -- 10.20.193.49:0/1021869905 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc52415a9a0 con 0x7fc524074ef0 2026-02-17T11:10:46.899 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.897+0000 7fc5037fe640 1 -- 10.20.193.49:0/1021869905 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fc518021070 con 0x7fc524074ef0 2026-02-17T11:10:46.899 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.897+0000 7fc5037fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:10:46.899 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.897+0000 7fc5037fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:46.900 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:10:46.900 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:10:46.902 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.898+0000 7fc5290bf640 10 librados: watch_flush enter 2026-02-17T11:10:46.902 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.898+0000 7fc5290bf640 10 librados: watch_flush exit 2026-02-17T11:10:46.902 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.898+0000 7fc5290bf640 20 client.4638.objecter shutdown clearing up homeless session... 2026-02-17T11:10:46.902 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.898+0000 7fc5290bf640 10 client.4638.objecter successfully canceled tick 2026-02-17T11:10:46.902 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.898+0000 7fc5290bf640 1 -- 10.20.193.49:0/1021869905 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fc4f00791c0 msgr2=0x7fc4f007b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:46.902 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.898+0000 7fc5290bf640 1 --2- 10.20.193.49:0/1021869905 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fc4f00791c0 0x7fc4f007b680 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc50c039000 tx=0x7fc50c033000 comp rx=0 tx=0).stop 2026-02-17T11:10:46.902 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.898+0000 7fc5290bf640 10 monclient: shutdown 2026-02-17T11:10:46.903 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.898+0000 7fc5290bf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:46.903 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.898+0000 7fc5290bf640 1 -- 10.20.193.49:0/1021869905 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc524074ef0 msgr2=0x7fc524158e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:46.903 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.898+0000 7fc5290bf640 1 --2- 10.20.193.49:0/1021869905 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc524074ef0 0x7fc524158e80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc51800c730 tx=0x7fc51800cc00 comp rx=0 tx=0).stop 2026-02-17T11:10:46.903 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.898+0000 7fc5290bf640 1 -- 10.20.193.49:0/1021869905 shutdown_connections 2026-02-17T11:10:46.903 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.898+0000 7fc5290bf640 1 --2- 10.20.193.49:0/1021869905 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fc4f00791c0 0x7fc4f007b680 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:46.903 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.898+0000 7fc5290bf640 1 --2- 10.20.193.49:0/1021869905 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc5240c7550 0x7fc5241543c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:46.903 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.898+0000 7fc5290bf640 1 --2- 10.20.193.49:0/1021869905 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc5240c7170 0x7fc5241554f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:46.903 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.898+0000 7fc5290bf640 1 --2- 10.20.193.49:0/1021869905 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc524074ef0 0x7fc524158e80 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:46.903 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.898+0000 7fc5290bf640 1 -- 10.20.193.49:0/1021869905 >> 10.20.193.49:0/1021869905 conn(0x7fc5240c9f40 msgr2=0x7fc5241534f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:46.903 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.898+0000 7fc5290bf640 1 -- 10.20.193.49:0/1021869905 shutdown_connections 2026-02-17T11:10:46.903 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.898+0000 7fc5290bf640 1 -- 10.20.193.49:0/1021869905 wait complete. 2026-02-17T11:10:46.903 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:46.898+0000 7fc5290bf640 1 librados: shutdown 2026-02-17T11:10:49.910 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:10:49.977 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.974+0000 7f43cf33e640 10 monclient: get_monmap_and_config 2026-02-17T11:10:49.977 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.974+0000 7f43cf33e640 10 monclient: build_initial_monmap 2026-02-17T11:10:49.977 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.974+0000 7f43cf33e640 10 monclient: monmap: 2026-02-17T11:10:49.977 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:49.978 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:49.978 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:49.976488+0000 2026-02-17T11:10:49.978 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:49.976488+0000 2026-02-17T11:10:49.978 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:49.978 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:49.978 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:49.978 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:49.978 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:49.978 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:49.978 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:49.978 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:49.978 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:49.981 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.975+0000 7f43cf33e640 1 Processor -- start 2026-02-17T11:10:49.981 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.975+0000 7f43cf33e640 1 -- start start 2026-02-17T11:10:49.981 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.975+0000 7f43cf33e640 10 monclient: init 2026-02-17T11:10:49.982 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.975+0000 7f43cf33e640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:49.982 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.975+0000 7f43cf33e640 10 monclient: _add_conns ranks=[4,1,5,3,2,0] 2026-02-17T11:10:49.982 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.975+0000 7f43cf33e640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f43c815d370 0x7f43c815d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:49.982 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.976+0000 7f43cf33e640 10 monclient(hunting): picked mon.noname-b con 0x7f43c815d370 addr v2:10.20.193.97:3300/0 2026-02-17T11:10:49.982 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.976+0000 7f43cf33e640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f43c80c7e20 addr v1:10.20.193.97:6789/0 2026-02-17T11:10:49.982 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.976+0000 7f43cf33e640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f43c80c74c0 0x7f43c80c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:49.982 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.976+0000 7f43cf33e640 10 monclient(hunting): picked mon.noname-c con 0x7f43c80c74c0 addr v2:10.20.193.157:3300/0 2026-02-17T11:10:49.982 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.976+0000 7f43cf33e640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43c80c8350 con 0x7f43c80c7e20 2026-02-17T11:10:49.982 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.976+0000 7f43cf33e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:49.982 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.976+0000 7f43cf33e640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f43c815b710 con 0x7f43c815d370 2026-02-17T11:10:49.982 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.976+0000 7f43cf33e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:49.982 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.976+0000 7f43cf33e640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f43c80c9240 con 0x7f43c80c74c0 2026-02-17T11:10:49.983 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.976+0000 7f43cf33e640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:49.983 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.976+0000 7f43cf33e640 10 monclient(hunting): authenticate will time out at 1126.640041s 2026-02-17T11:10:49.983 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.976+0000 7f43cd0b3640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f43c815d370 0x7f43c815d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:49.983 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.976+0000 7f43cd8b4640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f43c80c74c0 0x7f43c80c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:49.983 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.976+0000 7f43cc8b2640 1 --1- >> v1:10.20.193.97:6789/0 conn(0x7f43c80c7e20 0x7f43c815b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.97:6789/0 says I am v1:10.20.193.49:43032/0 (socket says 10.20.193.49:43032) 2026-02-17T11:10:49.983 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.976+0000 7f43cc8b2640 1 -- 10.20.193.49:0/2292929258 learned_addr learned my addr 10.20.193.49:0/2292929258 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:10:49.983 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.976+0000 7f43cd8b4640 10 monclient(hunting): get_auth_request con 0x7f43c80c74c0 auth_method 0 2026-02-17T11:10:49.983 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.976+0000 7f43cd8b4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:49.983 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.976+0000 7f43cd8b4640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:49.983 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.976+0000 7f43cd8b4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:49.983 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.976+0000 7f43cd0b3640 10 monclient(hunting): get_auth_request con 0x7f43c815d370 auth_method 0 2026-02-17T11:10:49.983 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.976+0000 7f43cd0b3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:49.984 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.976+0000 7f43cd0b3640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:49.984 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.976+0000 7f43cd0b3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:49.984 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.977+0000 7f43cd8b4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:49.984 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.977+0000 7f43cd8b4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:49.984 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.977+0000 7f43cd8b4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:49.984 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.977+0000 7f43cd0b3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:49.984 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.977+0000 7f43cd0b3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:49.984 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.977+0000 7f43cd0b3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:49.984 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.978+0000 7f43cd8b4640 10 monclient(hunting): handle_auth_done global_id 4649 payload 274 2026-02-17T11:10:49.984 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.978+0000 7f43cd8b4640 1 -- 10.20.193.49:0/2292929258 >> v2:10.20.193.97:3300/0 conn(0x7f43c815d370 msgr2=0x7f43c815d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:49.985 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.978+0000 7f43cd8b4640 1 --2- 10.20.193.49:0/2292929258 >> v2:10.20.193.97:3300/0 conn(0x7f43c815d370 0x7f43c815d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:49.985 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.978+0000 7f43cd8b4640 1 -- 10.20.193.49:0/2292929258 >> v1:10.20.193.97:6789/0 conn(0x7f43c80c7e20 legacy=0x7f43c815b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:49.985 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.978+0000 7f43cd8b4640 10 monclient: _finish_hunting 0 2026-02-17T11:10:49.985 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.978+0000 7f43cd8b4640 1 monclient: found mon.noname-c 2026-02-17T11:10:49.985 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.978+0000 7f43cd8b4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:49.985 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.978+0000 7f43cd8b4640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:10:49.985 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.978+0000 7f43cd8b4640 1 -- 10.20.193.49:0/2292929258 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43c80c8630 con 0x7f43c80c74c0 2026-02-17T11:10:49.985 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.978+0000 7f43cd8b4640 1 --2- 10.20.193.49:0/2292929258 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f43c80c74c0 0x7f43c80c52b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f43c815dcf0 tx=0x7f43c402f1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59ae1ac28406a64f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:49.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.980+0000 7f43b7fff640 1 -- 10.20.193.49:0/2292929258 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c403c070 con 0x7f43c80c74c0 2026-02-17T11:10:49.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.980+0000 7f43b7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:49.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.980+0000 7f43b7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:10:49.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.980+0000 7f43b7fff640 10 monclient: dump: 2026-02-17T11:10:49.992 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:49.993 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:49.993 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:49.993 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:49.993 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:49.993 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:49.993 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:49.993 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:49.993 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:49.993 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:49.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.980+0000 7f43b7fff640 10 monclient: _finish_auth 0 2026-02-17T11:10:49.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.980+0000 7f43b7fff640 10 monclient: _check_auth_tickets 2026-02-17T11:10:49.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.980+0000 7f43b7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:49.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.980+0000 7f43b7fff640 1 -- 10.20.193.49:0/2292929258 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43c4037440 con 0x7f43c80c74c0 2026-02-17T11:10:49.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.980+0000 7f43cf33e640 5 monclient: authenticate success, global_id 4649 2026-02-17T11:10:49.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.980+0000 7f43cf33e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:10:49.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.980+0000 7f43b7fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:49.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.980+0000 7f43b7fff640 1 -- 10.20.193.49:0/2292929258 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c4037810 con 0x7f43c80c74c0 2026-02-17T11:10:49.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.980+0000 7f43b7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:49.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.980+0000 7f43b7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:10:49.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.980+0000 7f43b7fff640 10 monclient: dump: 2026-02-17T11:10:49.994 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:49.994 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:49.994 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:49.995 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:49.995 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:49.995 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:49.995 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:49.995 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:49.995 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:49.995 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:49.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.980+0000 7f43cf33e640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:49.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.980+0000 7f43cf33e640 4 set_mon_vals no callback set 2026-02-17T11:10:49.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.981+0000 7f43cf33e640 10 monclient: shutdown 2026-02-17T11:10:49.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.981+0000 7f43cf33e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:49.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.981+0000 7f43cf33e640 1 -- 10.20.193.49:0/2292929258 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f43c80c74c0 msgr2=0x7f43c80c52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:49.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.981+0000 7f43cf33e640 1 --2- 10.20.193.49:0/2292929258 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f43c80c74c0 0x7f43c80c52b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f43c815dcf0 tx=0x7f43c402f1c0 comp rx=0 tx=0).stop 2026-02-17T11:10:49.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.981+0000 7f43cf33e640 1 -- 10.20.193.49:0/2292929258 shutdown_connections 2026-02-17T11:10:49.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.981+0000 7f43cf33e640 1 --2- 10.20.193.49:0/2292929258 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f43c80c74c0 0x7f43c80c52b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:49.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.981+0000 7f43cf33e640 1 --2- 10.20.193.49:0/2292929258 >> v2:10.20.193.97:3300/0 conn(0x7f43c815d370 0x7f43c815d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:49.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.981+0000 7f43cf33e640 1 -- 10.20.193.49:0/2292929258 >> 10.20.193.49:0/2292929258 conn(0x7f43c80c9f20 msgr2=0x7f43c80ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:49.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.981+0000 7f43cf33e640 1 -- 10.20.193.49:0/2292929258 shutdown_connections 2026-02-17T11:10:49.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.981+0000 7f43cf33e640 1 -- 10.20.193.49:0/2292929258 wait complete. 2026-02-17T11:10:49.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.981+0000 7f43cf33e640 10 monclient: build_initial_monmap 2026-02-17T11:10:49.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.981+0000 7f43cf33e640 10 monclient: monmap: 2026-02-17T11:10:49.996 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:49.996 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:49.997 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:49.997 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:49.997 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:49.997 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:49.997 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:49.997 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:49.997 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:49.997 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:49.997 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.981+0000 7f43cf33e640 1 librados: starting msgr at 2026-02-17T11:10:49.997 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.981+0000 7f43cf33e640 1 librados: starting objecter 2026-02-17T11:10:49.997 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.982+0000 7f43cf33e640 1 Processor -- start 2026-02-17T11:10:49.997 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.982+0000 7f43cf33e640 1 -- start start 2026-02-17T11:10:49.998 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.982+0000 7f43cf33e640 1 librados: setting wanted keys 2026-02-17T11:10:49.998 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.982+0000 7f43cf33e640 1 librados: calling monclient init 2026-02-17T11:10:49.998 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.982+0000 7f43cf33e640 10 monclient: init 2026-02-17T11:10:49.998 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.982+0000 7f43cf33e640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:49.998 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.982+0000 7f43cf33e640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:10:49.998 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.982+0000 7f43cf33e640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f43c80c74c0 0x7f43c8074220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:49.998 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.982+0000 7f43cf33e640 10 monclient(hunting): picked mon.noname-a con 0x7f43c80c74c0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:49.998 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.982+0000 7f43cf33e640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f43c80c7e20 0x7f43c8073440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:49.998 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.982+0000 7f43cf33e640 10 monclient(hunting): picked mon.noname-b con 0x7f43c80c7e20 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:49.998 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.982+0000 7f43cf33e640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f43c815d370 0x7f43c81f4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:49.998 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.982+0000 7f43cf33e640 10 monclient(hunting): picked mon.noname-c con 0x7f43c815d370 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:49.998 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.982+0000 7f43cf33e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:49.999 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.982+0000 7f43cf33e640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f43c80c8ed0 con 0x7f43c80c74c0 2026-02-17T11:10:49.999 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.982+0000 7f43cf33e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:49.999 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.982+0000 7f43cf33e640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f43c80c8bf0 con 0x7f43c80c7e20 2026-02-17T11:10:49.999 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.982+0000 7f43cf33e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:49.999 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.982+0000 7f43cf33e640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f43c80c96d0 con 0x7f43c815d370 2026-02-17T11:10:49.999 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.982+0000 7f43cf33e640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:49.999 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.982+0000 7f43cf33e640 10 monclient(hunting): authenticate will time out at 1126.646454s 2026-02-17T11:10:49.999 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.982+0000 7f43cd8b4640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f43c815d370 0x7f43c81f4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:49.999 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.982+0000 7f43cc8b2640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f43c80c7e20 0x7f43c8073440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:49.999 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.982+0000 7f43cd0b3640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f43c80c74c0 0x7f43c8074220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:49.999 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.982+0000 7f43cc8b2640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f43c80c7e20 0x7f43c8073440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:57580/0 (socket says 10.20.193.49:57580) 2026-02-17T11:10:49.999 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.982+0000 7f43cc8b2640 1 -- 10.20.193.49:0/537510486 learned_addr learned my addr 10.20.193.49:0/537510486 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:50.000 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.983+0000 7f43cc8b2640 10 monclient(hunting): get_auth_request con 0x7f43c80c7e20 auth_method 0 2026-02-17T11:10:50.000 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.983+0000 7f43cc8b2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:50.000 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.983+0000 7f43cc8b2640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:50.000 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.983+0000 7f43cc8b2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:50.000 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.983+0000 7f43cd0b3640 10 monclient(hunting): get_auth_request con 0x7f43c80c74c0 auth_method 0 2026-02-17T11:10:50.000 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.983+0000 7f43cd0b3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:50.000 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.983+0000 7f43cd0b3640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:50.000 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.983+0000 7f43cd0b3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:50.000 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.983+0000 7f43cc8b2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:50.000 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.983+0000 7f43cc8b2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:50.000 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.983+0000 7f43cc8b2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:50.000 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.983+0000 7f43cd0b3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:50.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.983+0000 7f43cd0b3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:50.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.983+0000 7f43cd0b3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:50.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.983+0000 7f43cd8b4640 10 monclient(hunting): get_auth_request con 0x7f43c815d370 auth_method 0 2026-02-17T11:10:50.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.983+0000 7f43cd8b4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:50.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.983+0000 7f43cd8b4640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:50.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.983+0000 7f43cd8b4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:50.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.984+0000 7f43cd8b4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:50.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.984+0000 7f43cd8b4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:50.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.984+0000 7f43cd8b4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:50.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.984+0000 7f43cc8b2640 10 monclient(hunting): handle_auth_done global_id 4621 payload 824 2026-02-17T11:10:50.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.984+0000 7f43cc8b2640 1 -- 10.20.193.49:0/537510486 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f43c815d370 msgr2=0x7f43c81f4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:50.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.984+0000 7f43cc8b2640 1 --2- 10.20.193.49:0/537510486 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f43c815d370 0x7f43c81f4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:50.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.984+0000 7f43cc8b2640 1 -- 10.20.193.49:0/537510486 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f43c80c74c0 msgr2=0x7f43c8074220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:50.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.984+0000 7f43cc8b2640 1 --2- 10.20.193.49:0/537510486 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f43c80c74c0 0x7f43c8074220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:50.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.984+0000 7f43cc8b2640 10 monclient: _finish_hunting 0 2026-02-17T11:10:50.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.984+0000 7f43cc8b2640 1 monclient: found mon.noname-b 2026-02-17T11:10:50.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.984+0000 7f43cc8b2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:50.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.984+0000 7f43cc8b2640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:10:50.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.984+0000 7f43cc8b2640 1 -- 10.20.193.49:0/537510486 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43c81f5a90 con 0x7f43c80c7e20 2026-02-17T11:10:50.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.985+0000 7f43cc8b2640 1 --2- 10.20.193.49:0/537510486 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f43c80c7e20 0x7f43c8073440 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f43bc00c730 tx=0x7f43bc00cc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:50.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.985+0000 7f43b5ffb640 10 client.?.objecter ms_handle_connect 0x7f43c80c7e20 2026-02-17T11:10:50.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.985+0000 7f43b5ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:50.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.987+0000 7f43b5ffb640 1 -- 10.20.193.49:0/537510486 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43bc017070 con 0x7f43c80c7e20 2026-02-17T11:10:50.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.987+0000 7f43b5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:50.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.987+0000 7f43b5ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:10:50.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.987+0000 7f43b5ffb640 10 monclient: dump: 2026-02-17T11:10:50.003 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:50.003 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:50.003 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:50.003 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:50.003 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:50.003 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:50.003 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:50.003 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:50.003 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:50.003 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:50.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.987+0000 7f43b5ffb640 10 monclient: _finish_auth 0 2026-02-17T11:10:50.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.987+0000 7f43b5ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:10:50.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.987+0000 7f43b5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:50.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.987+0000 7f43b5ffb640 1 -- 10.20.193.49:0/537510486 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43bc005b90 con 0x7f43c80c7e20 2026-02-17T11:10:50.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.987+0000 7f43cf33e640 5 monclient: authenticate success, global_id 4621 2026-02-17T11:10:50.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.987+0000 7f43b5ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:50.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.987+0000 7f43b5ffb640 1 -- 10.20.193.49:0/537510486 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43bc007070 con 0x7f43c80c7e20 2026-02-17T11:10:50.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.987+0000 7f43cf33e640 10 monclient: _renew_subs 2026-02-17T11:10:50.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.987+0000 7f43cf33e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:50.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.987+0000 7f43cf33e640 1 -- 10.20.193.49:0/537510486 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43c8154810 con 0x7f43c80c7e20 2026-02-17T11:10:50.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.987+0000 7f43b77fe640 4 set_mon_vals no callback set 2026-02-17T11:10:50.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.987+0000 7f43b5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:50.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.987+0000 7f43b5ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:50.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.987+0000 7f43b5ffb640 10 monclient: dump: 2026-02-17T11:10:50.005 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:50.005 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:50.005 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:50.005 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:50.005 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:50.005 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:50.005 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:50.005 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:50.005 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:50.005 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:50.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.987+0000 7f43cf33e640 10 client.4621.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:50.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.987+0000 7f43cf33e640 10 monclient: _renew_subs 2026-02-17T11:10:50.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.987+0000 7f43cf33e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:50.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.987+0000 7f43cf33e640 1 -- 10.20.193.49:0/537510486 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43c8154e40 con 0x7f43c80c7e20 2026-02-17T11:10:50.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.987+0000 7f43cf33e640 1 librados: init done 2026-02-17T11:10:50.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.988+0000 7f43cf33e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:50.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.988+0000 7f43cf33e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:50.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.988+0000 7f43cf33e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:50.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.988+0000 7f43cf33e640 1 -- 10.20.193.49:0/537510486 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43c815d750 con 0x7f43c80c7e20 2026-02-17T11:10:50.007 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.998+0000 7f43b5ffb640 1 -- 10.20.193.49:0/537510486 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f43bc007210 con 0x7f43c80c7e20 2026-02-17T11:10:50.008 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.999+0000 7f43b5ffb640 1 --2- 10.20.193.49:0/537510486 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f4398079140 0x7f439807b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:50.008 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.999+0000 7f43cd0b3640 1 --2- 10.20.193.49:0/537510486 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f4398079140 0x7f439807b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:50.008 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:49.999+0000 7f43cd0b3640 10 monclient: get_auth_request con 0x7f4398079140 auth_method 0 2026-02-17T11:10:50.008 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:50.000+0000 7f43cd0b3640 1 --2- 10.20.193.49:0/537510486 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f4398079140 0x7f439807b600 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f43b8009c40 tx=0x7f43b8009290 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:50.008 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:50.000+0000 7f43b5ffb640 10 client.4621.objecter ms_handle_connect 0x7f4398079140 2026-02-17T11:10:50.008 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:50.001+0000 7f43b5ffb640 1 -- 10.20.193.49:0/537510486 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f43bc05d6c0 con 0x7f43c80c7e20 2026-02-17T11:10:50.008 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:50.001+0000 7f43b5ffb640 10 client.4621.objecter ms_dispatch2 0x7f43c8000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:10:50.008 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:50.001+0000 7f43b5ffb640 3 client.4621.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:10:50.008 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:50.001+0000 7f43b5ffb640 3 client.4621.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:10:50.008 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:50.001+0000 7f43b5ffb640 20 client.4621.objecter dump_active .. 0 homeless 2026-02-17T11:10:50.104 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:50.102+0000 7f43b5ffb640 1 -- 10.20.193.49:0/537510486 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f43bc021020 con 0x7f43c80c7e20 2026-02-17T11:10:50.104 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:50.102+0000 7f43b5ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:50.104 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:50.102+0000 7f43b5ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:50.202 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:50.199+0000 7f43cf33e640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:10:50.202 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:50.199+0000 7f43cf33e640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:10:50.202 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:50.199+0000 7f43cf33e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:50.202 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:50.199+0000 7f43cf33e640 1 -- 10.20.193.49:0/537510486 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f43c8152ef0 con 0x7f43c80c7e20 2026-02-17T11:10:50.206 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:50.205+0000 7f43b5ffb640 1 -- 10.20.193.49:0/537510486 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f43bc061680 con 0x7f43c80c7e20 2026-02-17T11:10:50.207 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:50.205+0000 7f43b5ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:10:50.207 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:50.205+0000 7f43b5ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:50.207 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:10:50.207 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:10:50.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:50.205+0000 7f43cf33e640 10 librados: watch_flush enter 2026-02-17T11:10:50.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:50.205+0000 7f43cf33e640 10 librados: watch_flush exit 2026-02-17T11:10:50.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:50.205+0000 7f43cf33e640 20 client.4621.objecter shutdown clearing up homeless session... 2026-02-17T11:10:50.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:50.205+0000 7f43cf33e640 10 client.4621.objecter successfully canceled tick 2026-02-17T11:10:50.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:50.205+0000 7f43cf33e640 1 -- 10.20.193.49:0/537510486 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f4398079140 msgr2=0x7f439807b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:50.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:50.205+0000 7f43cf33e640 1 --2- 10.20.193.49:0/537510486 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f4398079140 0x7f439807b600 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f43b8009c40 tx=0x7f43b8009290 comp rx=0 tx=0).stop 2026-02-17T11:10:50.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:50.205+0000 7f43cf33e640 10 monclient: shutdown 2026-02-17T11:10:50.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:50.205+0000 7f43cf33e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:50.210 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:50.205+0000 7f43cf33e640 1 -- 10.20.193.49:0/537510486 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f43c80c7e20 msgr2=0x7f43c8073440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:50.210 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:50.205+0000 7f43cf33e640 1 --2- 10.20.193.49:0/537510486 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f43c80c7e20 0x7f43c8073440 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f43bc00c730 tx=0x7f43bc00cc00 comp rx=0 tx=0).stop 2026-02-17T11:10:50.210 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:50.205+0000 7f43cf33e640 1 -- 10.20.193.49:0/537510486 shutdown_connections 2026-02-17T11:10:50.210 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:50.205+0000 7f43cf33e640 1 --2- 10.20.193.49:0/537510486 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f4398079140 0x7f439807b600 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:50.210 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:50.205+0000 7f43cf33e640 1 --2- 10.20.193.49:0/537510486 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f43c815d370 0x7f43c81f4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:50.210 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:50.205+0000 7f43cf33e640 1 --2- 10.20.193.49:0/537510486 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f43c80c7e20 0x7f43c8073440 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:50.210 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:50.205+0000 7f43cf33e640 1 --2- 10.20.193.49:0/537510486 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f43c80c74c0 0x7f43c8074220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:50.210 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:50.205+0000 7f43cf33e640 1 -- 10.20.193.49:0/537510486 >> 10.20.193.49:0/537510486 conn(0x7f43c80c9f20 msgr2=0x7f43c815dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:50.210 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:50.205+0000 7f43cf33e640 1 -- 10.20.193.49:0/537510486 shutdown_connections 2026-02-17T11:10:50.210 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:50.205+0000 7f43cf33e640 1 -- 10.20.193.49:0/537510486 wait complete. 2026-02-17T11:10:50.210 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:50.205+0000 7f43cf33e640 1 librados: shutdown 2026-02-17T11:10:51.670 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:02:37.152 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:10:51.698 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:02:37.179 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:10:51.699 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:02:37.174 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:10:51.699 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:02:37.175 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:10:51.709 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:02:37.190 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:10:51.710 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:02:37.186 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:10:51.725 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:02:37.167 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:10:51.726 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:02:37.168 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:10:51.737 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:02:37.179 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:10:53.217 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:10:53.283 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.281+0000 7fac049fb640 10 monclient: get_monmap_and_config 2026-02-17T11:10:53.283 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.281+0000 7fac049fb640 10 monclient: build_initial_monmap 2026-02-17T11:10:53.284 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.281+0000 7fac049fb640 10 monclient: monmap: 2026-02-17T11:10:53.284 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:53.284 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:53.284 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:53.282578+0000 2026-02-17T11:10:53.284 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:53.282578+0000 2026-02-17T11:10:53.284 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:53.284 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:53.284 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:53.284 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:53.284 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:53.284 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:53.284 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:53.285 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:53.285 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:53.299 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.281+0000 7fac049fb640 1 Processor -- start 2026-02-17T11:10:53.299 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.281+0000 7fac049fb640 1 -- start start 2026-02-17T11:10:53.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.281+0000 7fac049fb640 10 monclient: init 2026-02-17T11:10:53.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.282+0000 7fac049fb640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:53.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.282+0000 7fac049fb640 10 monclient: _add_conns ranks=[3,4,5,0,1,2] 2026-02-17T11:10:53.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.282+0000 7fac049fb640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fabfc0c7170 0x7fabfc0c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:53.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.282+0000 7fac049fb640 10 monclient(hunting): picked mon.noname-a con 0x7fabfc0c7170 addr v2:10.20.193.49:3300/0 2026-02-17T11:10:53.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.282+0000 7fac049fb640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7fabfc0c48c0 0x7fabfc0749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:53.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.282+0000 7fac049fb640 10 monclient(hunting): picked mon.noname-b con 0x7fabfc0c48c0 addr v2:10.20.193.97:3300/0 2026-02-17T11:10:53.301 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.282+0000 7fac049fb640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7fabfc074ef0 0x7fabfc0c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:53.301 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.282+0000 7fac049fb640 10 monclient(hunting): picked mon.noname-c con 0x7fabfc074ef0 addr v2:10.20.193.157:3300/0 2026-02-17T11:10:53.301 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.282+0000 7fac049fb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:53.301 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.282+0000 7fac049fb640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7fabfc0c8530 con 0x7fabfc0c7170 2026-02-17T11:10:53.301 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.282+0000 7fac049fb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:53.301 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.282+0000 7fac049fb640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7fabfc15a9a0 con 0x7fabfc0c48c0 2026-02-17T11:10:53.301 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.282+0000 7fac049fb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:53.301 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.282+0000 7fac049fb640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7fabfc0c5270 con 0x7fabfc074ef0 2026-02-17T11:10:53.302 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.282+0000 7fac049fb640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:53.302 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.282+0000 7fac049fb640 10 monclient(hunting): authenticate will time out at 1129.946112s 2026-02-17T11:10:53.302 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.282+0000 7fac02770640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fabfc0c7170 0x7fabfc0c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:53.302 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.282+0000 7fac01f6f640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7fabfc0c48c0 0x7fabfc0749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:53.302 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.282+0000 7fac02f71640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7fabfc074ef0 0x7fabfc0c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:53.302 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.282+0000 7fac01f6f640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7fabfc0c48c0 0x7fabfc0749b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:57594/0 (socket says 10.20.193.49:57594) 2026-02-17T11:10:53.302 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.282+0000 7fac01f6f640 1 -- 10.20.193.49:0/2524985693 learned_addr learned my addr 10.20.193.49:0/2524985693 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:53.302 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.282+0000 7fac01f6f640 10 monclient(hunting): get_auth_request con 0x7fabfc0c48c0 auth_method 0 2026-02-17T11:10:53.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.282+0000 7fac01f6f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:53.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.282+0000 7fac01f6f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:53.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.282+0000 7fac01f6f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:53.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.282+0000 7fac02770640 10 monclient(hunting): get_auth_request con 0x7fabfc0c7170 auth_method 0 2026-02-17T11:10:53.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.282+0000 7fac02770640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:53.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.282+0000 7fac02770640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:53.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.282+0000 7fac02770640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:53.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.282+0000 7fac02f71640 10 monclient(hunting): get_auth_request con 0x7fabfc074ef0 auth_method 0 2026-02-17T11:10:53.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.282+0000 7fac02f71640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:53.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.282+0000 7fac02f71640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:53.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.282+0000 7fac02f71640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:53.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.283+0000 7fac02770640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:53.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.283+0000 7fac02770640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:53.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.283+0000 7fac02770640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:53.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.283+0000 7fac01f6f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:53.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.283+0000 7fac01f6f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:53.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.283+0000 7fac01f6f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:53.305 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.283+0000 7fac02f71640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:53.305 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.283+0000 7fac02f71640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:53.305 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.283+0000 7fac02f71640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:53.305 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.284+0000 7fac02770640 10 monclient(hunting): handle_auth_done global_id 4644 payload 274 2026-02-17T11:10:53.305 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.284+0000 7fac02770640 1 -- 10.20.193.49:0/2524985693 >> v2:10.20.193.157:3300/0 conn(0x7fabfc074ef0 msgr2=0x7fabfc0c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:53.305 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.284+0000 7fac02770640 1 --2- 10.20.193.49:0/2524985693 >> v2:10.20.193.157:3300/0 conn(0x7fabfc074ef0 0x7fabfc0c89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:53.305 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.284+0000 7fac02770640 1 -- 10.20.193.49:0/2524985693 >> v2:10.20.193.97:3300/0 conn(0x7fabfc0c48c0 msgr2=0x7fabfc0749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:10:53.305 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.284+0000 7fac02770640 1 --2- 10.20.193.49:0/2524985693 >> v2:10.20.193.97:3300/0 conn(0x7fabfc0c48c0 0x7fabfc0749b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:53.305 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.284+0000 7fac02770640 10 monclient: _finish_hunting 0 2026-02-17T11:10:53.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.284+0000 7fac02770640 1 monclient: found mon.noname-a 2026-02-17T11:10:53.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.284+0000 7fac02770640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:53.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.284+0000 7fac02770640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:10:53.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.284+0000 7fac02770640 1 -- 10.20.193.49:0/2524985693 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabfc0c5550 con 0x7fabfc0c7170 2026-02-17T11:10:53.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.285+0000 7fac02770640 1 --2- 10.20.193.49:0/2524985693 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fabfc0c7170 0x7fabfc0c7550 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fabfc0c7a90 tx=0x7fabf402edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77c367529c5cd870 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:53.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.286+0000 7fac0176e640 1 -- 10.20.193.49:0/2524985693 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf403c070 con 0x7fabfc0c7170 2026-02-17T11:10:53.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.286+0000 7fac0176e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:53.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.286+0000 7fac0176e640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:10:53.307 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.286+0000 7fac0176e640 10 monclient: dump: 2026-02-17T11:10:53.307 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:53.307 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:53.307 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:53.307 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:53.307 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:53.307 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:53.307 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:53.308 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:53.308 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:53.308 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:53.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.286+0000 7fac0176e640 10 monclient: _finish_auth 0 2026-02-17T11:10:53.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.286+0000 7fac0176e640 10 monclient: _check_auth_tickets 2026-02-17T11:10:53.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.286+0000 7fac0176e640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:53.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.286+0000 7fac049fb640 5 monclient: authenticate success, global_id 4644 2026-02-17T11:10:53.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.286+0000 7fac0176e640 1 -- 10.20.193.49:0/2524985693 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabf402fa80 con 0x7fabfc0c7170 2026-02-17T11:10:53.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.286+0000 7fac0176e640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:53.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.286+0000 7fac0176e640 1 -- 10.20.193.49:0/2524985693 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf402fe50 con 0x7fabfc0c7170 2026-02-17T11:10:53.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.286+0000 7fac0176e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:53.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.286+0000 7fac0176e640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:10:53.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.286+0000 7fac0176e640 10 monclient: dump: 2026-02-17T11:10:53.309 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:53.309 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:53.309 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:53.310 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:53.310 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:53.310 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:53.310 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:53.310 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:53.310 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:53.310 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:53.310 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.286+0000 7fac049fb640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:53.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.286+0000 7fac049fb640 4 set_mon_vals no callback set 2026-02-17T11:10:53.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.287+0000 7fac049fb640 10 monclient: shutdown 2026-02-17T11:10:53.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.287+0000 7fac049fb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:53.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.287+0000 7fac049fb640 1 -- 10.20.193.49:0/2524985693 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fabfc0c7170 msgr2=0x7fabfc0c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:53.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.287+0000 7fac049fb640 1 --2- 10.20.193.49:0/2524985693 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fabfc0c7170 0x7fabfc0c7550 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fabfc0c7a90 tx=0x7fabf402edc0 comp rx=0 tx=0).stop 2026-02-17T11:10:53.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.287+0000 7fac049fb640 1 -- 10.20.193.49:0/2524985693 shutdown_connections 2026-02-17T11:10:53.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.287+0000 7fac049fb640 1 --2- 10.20.193.49:0/2524985693 >> v2:10.20.193.97:3300/0 conn(0x7fabfc0c48c0 0x7fabfc0749b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:53.312 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.287+0000 7fac049fb640 1 --2- 10.20.193.49:0/2524985693 >> v2:10.20.193.157:3300/0 conn(0x7fabfc074ef0 0x7fabfc0c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:53.312 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.287+0000 7fac049fb640 1 --2- 10.20.193.49:0/2524985693 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fabfc0c7170 0x7fabfc0c7550 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:53.312 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.287+0000 7fac049fb640 1 -- 10.20.193.49:0/2524985693 >> 10.20.193.49:0/2524985693 conn(0x7fabfc0c9f40 msgr2=0x7fabfc0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:53.312 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.287+0000 7fac049fb640 1 -- 10.20.193.49:0/2524985693 shutdown_connections 2026-02-17T11:10:53.312 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.287+0000 7fac049fb640 1 -- 10.20.193.49:0/2524985693 wait complete. 2026-02-17T11:10:53.312 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.287+0000 7fac049fb640 10 monclient: build_initial_monmap 2026-02-17T11:10:53.312 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.287+0000 7fac049fb640 10 monclient: monmap: 2026-02-17T11:10:53.312 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:53.313 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:53.313 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:53.313 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:53.313 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:53.313 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:53.313 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:53.313 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:53.313 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:53.314 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:53.314 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.288+0000 7fac049fb640 1 librados: starting msgr at 2026-02-17T11:10:53.314 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.288+0000 7fac049fb640 1 librados: starting objecter 2026-02-17T11:10:53.314 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.288+0000 7fac049fb640 1 Processor -- start 2026-02-17T11:10:53.314 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.288+0000 7fac049fb640 1 -- start start 2026-02-17T11:10:53.314 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.288+0000 7fac049fb640 1 librados: setting wanted keys 2026-02-17T11:10:53.314 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.288+0000 7fac049fb640 1 librados: calling monclient init 2026-02-17T11:10:53.314 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.288+0000 7fac049fb640 10 monclient: init 2026-02-17T11:10:53.314 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.288+0000 7fac049fb640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:53.314 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.288+0000 7fac049fb640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:10:53.314 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.288+0000 7fac049fb640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fabfc074ef0 0x7fabfc154630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:53.314 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.288+0000 7fac049fb640 10 monclient(hunting): picked mon.noname-a con 0x7fabfc074ef0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:53.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.288+0000 7fac049fb640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fabfc0c48c0 0x7fabfc159300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:53.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.288+0000 7fac049fb640 10 monclient(hunting): picked mon.noname-b con 0x7fabfc0c48c0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:53.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.288+0000 7fac049fb640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fabfc0c7170 0x7fabfc159840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:53.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.288+0000 7fac049fb640 10 monclient(hunting): picked mon.noname-c con 0x7fabfc0c7170 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:53.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.288+0000 7fac049fb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:53.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.288+0000 7fac049fb640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fabfc0c81c0 con 0x7fabfc074ef0 2026-02-17T11:10:53.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.288+0000 7fac049fb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:53.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.288+0000 7fac049fb640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fabfc0c7ee0 con 0x7fabfc0c48c0 2026-02-17T11:10:53.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.288+0000 7fac049fb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:53.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.288+0000 7fac049fb640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fabfc0c4d10 con 0x7fabfc0c7170 2026-02-17T11:10:53.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.288+0000 7fac049fb640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:53.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.288+0000 7fac049fb640 10 monclient(hunting): authenticate will time out at 1129.952544s 2026-02-17T11:10:53.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.288+0000 7fac02770640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fabfc074ef0 0x7fabfc154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:53.316 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.288+0000 7fac02f71640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fabfc0c7170 0x7fabfc159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:53.316 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.288+0000 7fac01f6f640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fabfc0c48c0 0x7fabfc159300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:53.316 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.288+0000 7fac02770640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fabfc074ef0 0x7fabfc154630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:59692/0 (socket says 10.20.193.49:59692) 2026-02-17T11:10:53.316 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.288+0000 7fac02770640 1 -- 10.20.193.49:0/3930535649 learned_addr learned my addr 10.20.193.49:0/3930535649 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:53.316 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.288+0000 7fac02770640 10 monclient(hunting): get_auth_request con 0x7fabfc074ef0 auth_method 0 2026-02-17T11:10:53.316 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.288+0000 7fac02770640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:53.316 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.288+0000 7fac02770640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:53.316 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.288+0000 7fac02770640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:53.316 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.289+0000 7fac01f6f640 10 monclient(hunting): get_auth_request con 0x7fabfc0c48c0 auth_method 0 2026-02-17T11:10:53.316 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.289+0000 7fac01f6f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:53.316 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.289+0000 7fac01f6f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:53.316 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.289+0000 7fac01f6f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:53.317 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.289+0000 7fac02f71640 10 monclient(hunting): get_auth_request con 0x7fabfc0c7170 auth_method 0 2026-02-17T11:10:53.317 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.289+0000 7fac02f71640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:53.317 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.289+0000 7fac02f71640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:53.317 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.289+0000 7fac02f71640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:53.317 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.289+0000 7fac02770640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:53.317 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.289+0000 7fac02770640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:53.317 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.289+0000 7fac02770640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:53.317 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.289+0000 7fac02f71640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:53.317 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.289+0000 7fac02f71640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:53.317 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.289+0000 7fac02f71640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:53.317 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.289+0000 7fac01f6f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:53.317 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.289+0000 7fac01f6f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:53.317 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.289+0000 7fac01f6f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:53.318 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.290+0000 7fac02770640 10 monclient(hunting): handle_auth_done global_id 4647 payload 824 2026-02-17T11:10:53.318 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.290+0000 7fac02770640 1 -- 10.20.193.49:0/3930535649 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fabfc0c7170 msgr2=0x7fabfc159840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:53.318 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.290+0000 7fac02770640 1 --2- 10.20.193.49:0/3930535649 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fabfc0c7170 0x7fabfc159840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:53.318 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.290+0000 7fac02770640 1 -- 10.20.193.49:0/3930535649 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fabfc0c48c0 msgr2=0x7fabfc159300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:53.318 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.290+0000 7fac02770640 1 --2- 10.20.193.49:0/3930535649 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fabfc0c48c0 0x7fabfc159300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:53.318 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.290+0000 7fac02770640 10 monclient: _finish_hunting 0 2026-02-17T11:10:53.318 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.290+0000 7fac02770640 1 monclient: found mon.noname-a 2026-02-17T11:10:53.318 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.290+0000 7fac02770640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:53.318 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.290+0000 7fac02770640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:10:53.318 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.290+0000 7fac02770640 1 -- 10.20.193.49:0/3930535649 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabfc1563b0 con 0x7fabfc074ef0 2026-02-17T11:10:53.318 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.291+0000 7fac02770640 1 --2- 10.20.193.49:0/3930535649 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fabfc074ef0 0x7fabfc154630 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fabf403a040 tx=0x7fabf40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:53.318 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.291+0000 7fabe6ffd640 10 client.?.objecter ms_handle_connect 0x7fabfc074ef0 2026-02-17T11:10:53.319 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.291+0000 7fabe6ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:53.319 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.293+0000 7fabe6ffd640 1 -- 10.20.193.49:0/3930535649 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf403c040 con 0x7fabfc074ef0 2026-02-17T11:10:53.319 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.293+0000 7fabe6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:53.319 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.293+0000 7fabe6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:10:53.319 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.293+0000 7fabe6ffd640 10 monclient: dump: 2026-02-17T11:10:53.319 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:53.319 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:53.319 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:53.319 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:53.319 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:53.319 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:53.319 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:53.319 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:53.320 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:53.320 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:53.320 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.293+0000 7fabe6ffd640 10 monclient: _finish_auth 0 2026-02-17T11:10:53.320 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.293+0000 7fabe6ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:10:53.320 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.293+0000 7fabe6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:53.320 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.293+0000 7fabe6ffd640 1 -- 10.20.193.49:0/3930535649 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabf4042430 con 0x7fabfc074ef0 2026-02-17T11:10:53.320 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.293+0000 7fabe6ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:53.320 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.293+0000 7fabe6ffd640 1 -- 10.20.193.49:0/3930535649 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf4042840 con 0x7fabfc074ef0 2026-02-17T11:10:53.320 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.293+0000 7fac049fb640 5 monclient: authenticate success, global_id 4647 2026-02-17T11:10:53.320 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.293+0000 7fac049fb640 10 monclient: _renew_subs 2026-02-17T11:10:53.320 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.293+0000 7fac00f6d640 4 set_mon_vals no callback set 2026-02-17T11:10:53.320 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.293+0000 7fac049fb640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:53.321 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.293+0000 7fac049fb640 1 -- 10.20.193.49:0/3930535649 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabfc156690 con 0x7fabfc074ef0 2026-02-17T11:10:53.321 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.293+0000 7fabe6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:53.321 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.293+0000 7fabe6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:10:53.321 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.293+0000 7fabe6ffd640 10 monclient: dump: 2026-02-17T11:10:53.321 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:53.321 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:53.321 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:53.321 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:53.321 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:53.321 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:53.321 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:53.321 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:53.321 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:53.322 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:53.322 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.293+0000 7fac049fb640 10 client.4647.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:53.322 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.293+0000 7fac049fb640 10 monclient: _renew_subs 2026-02-17T11:10:53.322 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.293+0000 7fac049fb640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:53.322 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.293+0000 7fac049fb640 1 -- 10.20.193.49:0/3930535649 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabfc158b00 con 0x7fabfc074ef0 2026-02-17T11:10:53.322 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.293+0000 7fac049fb640 1 librados: init done 2026-02-17T11:10:53.322 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.293+0000 7fac049fb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:53.322 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.293+0000 7fac049fb640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:53.322 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.293+0000 7fac049fb640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:53.322 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.293+0000 7fac049fb640 1 -- 10.20.193.49:0/3930535649 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabfc158630 con 0x7fabfc074ef0 2026-02-17T11:10:53.323 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.306+0000 7fabe6ffd640 1 -- 10.20.193.49:0/3930535649 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7fabf40429e0 con 0x7fabfc074ef0 2026-02-17T11:10:53.324 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.306+0000 7fabe6ffd640 1 --2- 10.20.193.49:0/3930535649 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fabcc079170 0x7fabcc07b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:53.324 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.306+0000 7fac01f6f640 1 --2- 10.20.193.49:0/3930535649 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fabcc079170 0x7fabcc07b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:53.324 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.307+0000 7fac01f6f640 10 monclient: get_auth_request con 0x7fabcc079170 auth_method 0 2026-02-17T11:10:53.324 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.307+0000 7fabe6ffd640 10 client.4647.objecter ms_handle_connect 0x7fabcc079170 2026-02-17T11:10:53.324 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.307+0000 7fac01f6f640 1 --2- 10.20.193.49:0/3930535649 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fabcc079170 0x7fabcc07b630 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fabfc1f0f60 tx=0x7fabe8009340 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:53.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.411+0000 7fabe6ffd640 1 -- 10.20.193.49:0/3930535649 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7fabf4042d00 con 0x7fabfc074ef0 2026-02-17T11:10:53.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.411+0000 7fabe6ffd640 10 client.4647.objecter ms_dispatch2 0x7fabfc000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:10:53.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.411+0000 7fabe6ffd640 3 client.4647.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:10:53.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.411+0000 7fabe6ffd640 3 client.4647.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:10:53.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.411+0000 7fabe6ffd640 20 client.4647.objecter dump_active .. 0 homeless 2026-02-17T11:10:53.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.411+0000 7fabe6ffd640 1 -- 10.20.193.49:0/3930535649 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fabf40878e0 con 0x7fabfc074ef0 2026-02-17T11:10:53.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.411+0000 7fabe6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:53.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.411+0000 7fabe6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:53.514 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.512+0000 7fac049fb640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:10:53.514 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.512+0000 7fac049fb640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:10:53.514 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.512+0000 7fac049fb640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:53.514 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.512+0000 7fac049fb640 1 -- 10.20.193.49:0/3930535649 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fabfc0749b0 con 0x7fabfc074ef0 2026-02-17T11:10:53.516 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.514+0000 7fabe6ffd640 1 -- 10.20.193.49:0/3930535649 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fabf408bbe0 con 0x7fabfc074ef0 2026-02-17T11:10:53.516 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.514+0000 7fabe6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:10:53.516 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.514+0000 7fabe6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:53.516 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:10:53.516 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:10:53.517 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.515+0000 7fac049fb640 10 librados: watch_flush enter 2026-02-17T11:10:53.517 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.515+0000 7fac049fb640 10 librados: watch_flush exit 2026-02-17T11:10:53.518 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.515+0000 7fac049fb640 20 client.4647.objecter shutdown clearing up homeless session... 2026-02-17T11:10:53.518 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.515+0000 7fac049fb640 10 client.4647.objecter successfully canceled tick 2026-02-17T11:10:53.518 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.515+0000 7fac049fb640 1 -- 10.20.193.49:0/3930535649 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fabcc079170 msgr2=0x7fabcc07b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:53.518 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.515+0000 7fac049fb640 1 --2- 10.20.193.49:0/3930535649 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fabcc079170 0x7fabcc07b630 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fabfc1f0f60 tx=0x7fabe8009340 comp rx=0 tx=0).stop 2026-02-17T11:10:53.518 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.515+0000 7fac049fb640 10 monclient: shutdown 2026-02-17T11:10:53.518 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.515+0000 7fac049fb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:53.518 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.515+0000 7fac049fb640 1 -- 10.20.193.49:0/3930535649 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fabfc074ef0 msgr2=0x7fabfc154630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:53.518 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.515+0000 7fac049fb640 1 --2- 10.20.193.49:0/3930535649 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fabfc074ef0 0x7fabfc154630 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fabf403a040 tx=0x7fabf40047c0 comp rx=0 tx=0).stop 2026-02-17T11:10:53.518 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.515+0000 7fac049fb640 1 -- 10.20.193.49:0/3930535649 shutdown_connections 2026-02-17T11:10:53.518 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.515+0000 7fac049fb640 1 --2- 10.20.193.49:0/3930535649 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fabcc079170 0x7fabcc07b630 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:53.518 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.515+0000 7fac049fb640 1 --2- 10.20.193.49:0/3930535649 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fabfc0c7170 0x7fabfc159840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:53.518 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.515+0000 7fac049fb640 1 --2- 10.20.193.49:0/3930535649 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fabfc0c48c0 0x7fabfc159300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:53.518 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.515+0000 7fac049fb640 1 --2- 10.20.193.49:0/3930535649 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fabfc074ef0 0x7fabfc154630 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:53.518 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.515+0000 7fac049fb640 1 -- 10.20.193.49:0/3930535649 >> 10.20.193.49:0/3930535649 conn(0x7fabfc0c9f40 msgr2=0x7fabfc14d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:53.518 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.515+0000 7fac049fb640 1 -- 10.20.193.49:0/3930535649 shutdown_connections 2026-02-17T11:10:53.518 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.515+0000 7fac049fb640 1 -- 10.20.193.49:0/3930535649 wait complete. 2026-02-17T11:10:53.518 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:53.515+0000 7fac049fb640 1 librados: shutdown 2026-02-17T11:10:56.527 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:10:56.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.594+0000 7fbb34a32640 10 monclient: get_monmap_and_config 2026-02-17T11:10:56.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.594+0000 7fbb34a32640 10 monclient: build_initial_monmap 2026-02-17T11:10:56.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.594+0000 7fbb34a32640 10 monclient: monmap: 2026-02-17T11:10:56.596 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:56.596 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:56.596 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:56.594592+0000 2026-02-17T11:10:56.596 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:56.594592+0000 2026-02-17T11:10:56.596 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:56.596 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:56.596 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:56.596 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:56.596 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:56.596 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:56.596 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:56.597 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:56.597 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:56.599 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.594+0000 7fbb34a32640 1 Processor -- start 2026-02-17T11:10:56.600 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.594+0000 7fbb34a32640 1 -- start start 2026-02-17T11:10:56.600 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.594+0000 7fbb34a32640 10 monclient: init 2026-02-17T11:10:56.600 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.594+0000 7fbb34a32640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:56.600 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.594+0000 7fbb34a32640 10 monclient: _add_conns ranks=[3,1,0,5,4,2] 2026-02-17T11:10:56.600 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.595+0000 7fbb34a32640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fbb3015d370 0x7fbb3015d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:56.600 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.595+0000 7fbb34a32640 10 monclient(hunting): picked mon.noname-a con 0x7fbb3015d370 addr v2:10.20.193.49:3300/0 2026-02-17T11:10:56.600 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.595+0000 7fbb34a32640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fbb300c7e20 addr v1:10.20.193.97:6789/0 2026-02-17T11:10:56.600 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.595+0000 7fbb34a32640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fbb300c74c0 addr v1:10.20.193.49:6789/0 2026-02-17T11:10:56.600 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.595+0000 7fbb34a32640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb300c8350 con 0x7fbb300c74c0 2026-02-17T11:10:56.600 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.595+0000 7fbb34a32640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb300c8630 con 0x7fbb300c7e20 2026-02-17T11:10:56.601 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.595+0000 7fbb34a32640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:56.601 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.595+0000 7fbb34a32640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7fbb3015b710 con 0x7fbb3015d370 2026-02-17T11:10:56.601 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.595+0000 7fbb34a32640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:56.601 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.595+0000 7fbb34a32640 10 monclient(hunting): authenticate will time out at 1133.258059s 2026-02-17T11:10:56.601 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.595+0000 7fbb2e575640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fbb3015d370 0x7fbb3015d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:56.601 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.595+0000 7fbb2dd74640 1 --1- >> v1:10.20.193.97:6789/0 conn(0x7fbb300c7e20 0x7fbb3015b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.97:6789/0 says I am v1:10.20.193.49:40774/0 (socket says 10.20.193.49:40774) 2026-02-17T11:10:56.601 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.595+0000 7fbb2dd74640 1 -- 10.20.193.49:0/1391708557 learned_addr learned my addr 10.20.193.49:0/1391708557 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:10:56.601 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.595+0000 7fbb2e575640 10 monclient(hunting): get_auth_request con 0x7fbb3015d370 auth_method 0 2026-02-17T11:10:56.601 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.595+0000 7fbb2e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:56.601 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.595+0000 7fbb2e575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:56.601 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.595+0000 7fbb2e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:56.601 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.596+0000 7fbb2e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:56.602 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.596+0000 7fbb2e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:56.602 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.596+0000 7fbb2e575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:56.602 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.597+0000 7fbb2d573640 1 -- 10.20.193.49:0/1391708557 <== mon.1 v1:10.20.193.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3705211034 0 0) 0x7fbb300c8630 con 0x7fbb300c7e20 2026-02-17T11:10:56.602 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.597+0000 7fbb2d573640 10 monclient(hunting): _negotiate 2026-02-17T11:10:56.602 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.597+0000 7fbb2d573640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:56.602 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.597+0000 7fbb2d573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:56.602 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.597+0000 7fbb2d573640 10 monclient(hunting): my global_id is 4630 2026-02-17T11:10:56.602 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.597+0000 7fbb2d573640 1 -- 10.20.193.49:0/1391708557 --> v1:10.20.193.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb1c003620 con 0x7fbb300c7e20 2026-02-17T11:10:56.602 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.597+0000 7fbb2e575640 10 monclient(hunting): handle_auth_done global_id 4650 payload 274 2026-02-17T11:10:56.602 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.597+0000 7fbb2e575640 1 -- 10.20.193.49:0/1391708557 >> v1:10.20.193.97:6789/0 conn(0x7fbb300c7e20 legacy=0x7fbb3015b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:56.602 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.597+0000 7fbb2e575640 1 -- 10.20.193.49:0/1391708557 >> v1:10.20.193.49:6789/0 conn(0x7fbb300c74c0 legacy=0x7fbb300c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:56.602 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.597+0000 7fbb2e575640 10 monclient: _finish_hunting 0 2026-02-17T11:10:56.602 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.597+0000 7fbb2e575640 1 monclient: found mon.noname-a 2026-02-17T11:10:56.603 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.597+0000 7fbb2e575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:56.603 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.597+0000 7fbb2e575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:10:56.603 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.597+0000 7fbb2e575640 1 -- 10.20.193.49:0/1391708557 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb300c8910 con 0x7fbb3015d370 2026-02-17T11:10:56.609 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.599+0000 7fbb2e575640 1 --2- 10.20.193.49:0/1391708557 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbb3015d370 0x7fbb3015d750 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbb240098a0 tx=0x7fbb2402ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c4cc442769f2167 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:56.610 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.601+0000 7fbb2d573640 1 -- 10.20.193.49:0/1391708557 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb2403c070 con 0x7fbb3015d370 2026-02-17T11:10:56.610 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.601+0000 7fbb2d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:56.610 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.601+0000 7fbb2d573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:10:56.610 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.601+0000 7fbb2d573640 10 monclient: dump: 2026-02-17T11:10:56.610 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:56.610 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:56.610 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:56.610 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:56.610 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:56.611 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:56.611 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:56.611 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:56.611 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:56.611 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:56.611 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.601+0000 7fbb2d573640 10 monclient: _finish_auth 0 2026-02-17T11:10:56.611 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.601+0000 7fbb2d573640 10 monclient: _check_auth_tickets 2026-02-17T11:10:56.611 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.601+0000 7fbb2d573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:56.611 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.601+0000 7fbb2d573640 1 -- 10.20.193.49:0/1391708557 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb2402fb70 con 0x7fbb3015d370 2026-02-17T11:10:56.611 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.601+0000 7fbb34a32640 5 monclient: authenticate success, global_id 4650 2026-02-17T11:10:56.611 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.601+0000 7fbb2d573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:56.612 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.601+0000 7fbb2d573640 1 -- 10.20.193.49:0/1391708557 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb24037440 con 0x7fbb3015d370 2026-02-17T11:10:56.612 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.601+0000 7fbb2d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:56.612 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.601+0000 7fbb2d573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:10:56.612 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.601+0000 7fbb2d573640 10 monclient: dump: 2026-02-17T11:10:56.612 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:56.612 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:56.612 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:56.612 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:56.612 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:56.612 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:56.612 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:56.612 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:56.613 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:56.613 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:56.613 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.601+0000 7fbb34a32640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:56.613 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.601+0000 7fbb34a32640 4 set_mon_vals no callback set 2026-02-17T11:10:56.613 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.601+0000 7fbb34a32640 10 monclient: shutdown 2026-02-17T11:10:56.613 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.601+0000 7fbb34a32640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:56.613 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.601+0000 7fbb34a32640 1 -- 10.20.193.49:0/1391708557 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbb3015d370 msgr2=0x7fbb3015d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:56.613 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.601+0000 7fbb34a32640 1 --2- 10.20.193.49:0/1391708557 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbb3015d370 0x7fbb3015d750 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbb240098a0 tx=0x7fbb2402ee60 comp rx=0 tx=0).stop 2026-02-17T11:10:56.613 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.601+0000 7fbb34a32640 1 -- 10.20.193.49:0/1391708557 shutdown_connections 2026-02-17T11:10:56.613 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.601+0000 7fbb34a32640 1 --2- 10.20.193.49:0/1391708557 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbb3015d370 0x7fbb3015d750 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:56.613 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.601+0000 7fbb34a32640 1 -- 10.20.193.49:0/1391708557 >> 10.20.193.49:0/1391708557 conn(0x7fbb300c9f20 msgr2=0x7fbb300ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:56.613 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.601+0000 7fbb34a32640 1 -- 10.20.193.49:0/1391708557 shutdown_connections 2026-02-17T11:10:56.614 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.601+0000 7fbb34a32640 1 -- 10.20.193.49:0/1391708557 wait complete. 2026-02-17T11:10:56.614 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.602+0000 7fbb34a32640 10 monclient: build_initial_monmap 2026-02-17T11:10:56.614 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.602+0000 7fbb34a32640 10 monclient: monmap: 2026-02-17T11:10:56.614 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:56.614 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:56.614 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:56.614 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:56.614 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:56.614 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:56.614 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:56.614 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:56.614 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:56.614 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:56.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.602+0000 7fbb34a32640 1 librados: starting msgr at 2026-02-17T11:10:56.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.602+0000 7fbb34a32640 1 librados: starting objecter 2026-02-17T11:10:56.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.602+0000 7fbb34a32640 1 Processor -- start 2026-02-17T11:10:56.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.602+0000 7fbb34a32640 1 -- start start 2026-02-17T11:10:56.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.602+0000 7fbb34a32640 1 librados: setting wanted keys 2026-02-17T11:10:56.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.602+0000 7fbb34a32640 1 librados: calling monclient init 2026-02-17T11:10:56.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.602+0000 7fbb34a32640 10 monclient: init 2026-02-17T11:10:56.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.602+0000 7fbb34a32640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:56.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.602+0000 7fbb34a32640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:10:56.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.602+0000 7fbb34a32640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fbb300c74c0 0x7fbb3006db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:56.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.602+0000 7fbb34a32640 10 monclient(hunting): picked mon.noname-b con 0x7fbb300c74c0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:56.616 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.602+0000 7fbb34a32640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbb300c7e20 0x7fbb301f6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:56.616 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.602+0000 7fbb34a32640 10 monclient(hunting): picked mon.noname-a con 0x7fbb300c7e20 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:56.616 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.602+0000 7fbb34a32640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fbb3015d370 0x7fbb300c3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:56.616 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.602+0000 7fbb34a32640 10 monclient(hunting): picked mon.noname-c con 0x7fbb3015d370 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:56.616 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.602+0000 7fbb34a32640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:56.616 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.602+0000 7fbb34a32640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fbb300c8ed0 con 0x7fbb300c7e20 2026-02-17T11:10:56.616 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.602+0000 7fbb34a32640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:56.616 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.602+0000 7fbb34a32640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fbb300c9240 con 0x7fbb300c74c0 2026-02-17T11:10:56.616 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.602+0000 7fbb34a32640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:56.616 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.602+0000 7fbb34a32640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fbb300c96d0 con 0x7fbb3015d370 2026-02-17T11:10:56.616 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.602+0000 7fbb34a32640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:56.616 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.602+0000 7fbb34a32640 10 monclient(hunting): authenticate will time out at 1133.265869s 2026-02-17T11:10:56.616 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.603+0000 7fbb2dd74640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbb300c7e20 0x7fbb301f6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:56.617 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.603+0000 7fbb2e575640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fbb300c74c0 0x7fbb3006db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:56.617 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.603+0000 7fbb2dd74640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbb300c7e20 0x7fbb301f6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:40976/0 (socket says 10.20.193.49:40976) 2026-02-17T11:10:56.617 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.603+0000 7fbb2dd74640 1 -- 10.20.193.49:0/2367298187 learned_addr learned my addr 10.20.193.49:0/2367298187 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:56.617 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.603+0000 7fbb2dd74640 10 monclient(hunting): get_auth_request con 0x7fbb300c7e20 auth_method 0 2026-02-17T11:10:56.617 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.603+0000 7fbb2dd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:56.617 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.603+0000 7fbb2dd74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:56.617 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.603+0000 7fbb2dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:56.617 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.603+0000 7fbb2ed76640 1 --2- 10.20.193.49:0/2367298187 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fbb3015d370 0x7fbb300c3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:56.617 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.603+0000 7fbb2e575640 10 monclient(hunting): get_auth_request con 0x7fbb300c74c0 auth_method 0 2026-02-17T11:10:56.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.603+0000 7fbb2e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:56.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.603+0000 7fbb2e575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:56.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.603+0000 7fbb2e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:56.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.603+0000 7fbb2dd74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:56.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.603+0000 7fbb2dd74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:56.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.603+0000 7fbb2dd74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:56.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.603+0000 7fbb2ed76640 10 monclient(hunting): get_auth_request con 0x7fbb3015d370 auth_method 0 2026-02-17T11:10:56.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.603+0000 7fbb2ed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:56.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.603+0000 7fbb2ed76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:56.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.603+0000 7fbb2ed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:56.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.603+0000 7fbb2e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:56.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.603+0000 7fbb2e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:56.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.603+0000 7fbb2e575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:56.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.603+0000 7fbb2ed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:56.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.603+0000 7fbb2ed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:56.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.603+0000 7fbb2ed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:56.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.604+0000 7fbb2dd74640 10 monclient(hunting): handle_auth_done global_id 4656 payload 824 2026-02-17T11:10:56.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.604+0000 7fbb2dd74640 1 -- 10.20.193.49:0/2367298187 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fbb3015d370 msgr2=0x7fbb300c3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:56.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.604+0000 7fbb2dd74640 1 --2- 10.20.193.49:0/2367298187 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fbb3015d370 0x7fbb300c3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:56.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.604+0000 7fbb2dd74640 1 -- 10.20.193.49:0/2367298187 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fbb300c74c0 msgr2=0x7fbb3006db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:56.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.604+0000 7fbb2dd74640 1 --2- 10.20.193.49:0/2367298187 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fbb300c74c0 0x7fbb3006db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:56.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.604+0000 7fbb2dd74640 10 monclient: _finish_hunting 0 2026-02-17T11:10:56.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.604+0000 7fbb2dd74640 1 monclient: found mon.noname-a 2026-02-17T11:10:56.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.604+0000 7fbb2dd74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:56.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.604+0000 7fbb2dd74640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:10:56.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.604+0000 7fbb2dd74640 1 -- 10.20.193.49:0/2367298187 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb3014c030 con 0x7fbb300c7e20 2026-02-17T11:10:56.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.605+0000 7fbb2dd74640 1 --2- 10.20.193.49:0/2367298187 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbb300c7e20 0x7fbb301f6ac0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbb1800c700 tx=0x7fbb1800cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:56.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.605+0000 7fbb16ffd640 10 client.?.objecter ms_handle_connect 0x7fbb300c7e20 2026-02-17T11:10:56.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.605+0000 7fbb16ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:56.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.607+0000 7fbb16ffd640 1 -- 10.20.193.49:0/2367298187 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb18017070 con 0x7fbb300c7e20 2026-02-17T11:10:56.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.607+0000 7fbb16ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:56.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.607+0000 7fbb16ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:10:56.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.607+0000 7fbb16ffd640 10 monclient: dump: 2026-02-17T11:10:56.620 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:56.620 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:56.620 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:56.620 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:56.621 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:56.621 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:56.621 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:56.621 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:56.621 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:56.621 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:56.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.607+0000 7fbb16ffd640 10 monclient: _finish_auth 0 2026-02-17T11:10:56.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.607+0000 7fbb16ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:10:56.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.607+0000 7fbb16ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:56.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.607+0000 7fbb16ffd640 1 -- 10.20.193.49:0/2367298187 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb18005bf0 con 0x7fbb300c7e20 2026-02-17T11:10:56.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.607+0000 7fbb16ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:56.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.607+0000 7fbb16ffd640 1 -- 10.20.193.49:0/2367298187 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb18007070 con 0x7fbb300c7e20 2026-02-17T11:10:56.622 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.607+0000 7fbb16ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:56.622 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.607+0000 7fbb16ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:10:56.622 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.607+0000 7fbb16ffd640 10 monclient: dump: 2026-02-17T11:10:56.622 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:56.622 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:56.622 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:56.622 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:56.622 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:56.622 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:56.622 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:56.622 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:56.622 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:56.623 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:56.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.607+0000 7fbb2cd72640 4 set_mon_vals no callback set 2026-02-17T11:10:56.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.607+0000 7fbb34a32640 5 monclient: authenticate success, global_id 4656 2026-02-17T11:10:56.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.607+0000 7fbb34a32640 10 monclient: _renew_subs 2026-02-17T11:10:56.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.607+0000 7fbb34a32640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:56.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.607+0000 7fbb34a32640 1 -- 10.20.193.49:0/2367298187 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb3014c310 con 0x7fbb300c7e20 2026-02-17T11:10:56.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.607+0000 7fbb34a32640 10 client.4656.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:56.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.607+0000 7fbb34a32640 10 monclient: _renew_subs 2026-02-17T11:10:56.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.607+0000 7fbb34a32640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:56.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.607+0000 7fbb34a32640 1 -- 10.20.193.49:0/2367298187 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb3014c8d0 con 0x7fbb300c7e20 2026-02-17T11:10:56.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.607+0000 7fbb34a32640 1 librados: init done 2026-02-17T11:10:56.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.607+0000 7fbb34a32640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:56.624 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.607+0000 7fbb34a32640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:56.624 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.607+0000 7fbb34a32640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:56.624 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.607+0000 7fbb34a32640 1 -- 10.20.193.49:0/2367298187 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb3015d750 con 0x7fbb300c7e20 2026-02-17T11:10:56.625 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.619+0000 7fbb16ffd640 1 -- 10.20.193.49:0/2367298187 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7fbb18007210 con 0x7fbb300c7e20 2026-02-17T11:10:56.625 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.619+0000 7fbb16ffd640 1 --2- 10.20.193.49:0/2367298187 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fbafc079190 0x7fbafc07b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:56.625 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.619+0000 7fbb2e575640 1 --2- 10.20.193.49:0/2367298187 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fbafc079190 0x7fbafc07b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:56.625 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.619+0000 7fbb2e575640 10 monclient: get_auth_request con 0x7fbafc079190 auth_method 0 2026-02-17T11:10:56.625 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.620+0000 7fbb2e575640 1 --2- 10.20.193.49:0/2367298187 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fbafc079190 0x7fbafc07b650 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbb24039000 tx=0x7fbb24033000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:56.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.620+0000 7fbb16ffd640 10 client.4656.objecter ms_handle_connect 0x7fbafc079190 2026-02-17T11:10:56.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.620+0000 7fbb16ffd640 1 -- 10.20.193.49:0/2367298187 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7fbb1805d700 con 0x7fbb300c7e20 2026-02-17T11:10:56.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.620+0000 7fbb16ffd640 10 client.4656.objecter ms_dispatch2 0x7fbb30000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:10:56.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.620+0000 7fbb16ffd640 3 client.4656.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:10:56.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.620+0000 7fbb16ffd640 3 client.4656.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:10:56.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.620+0000 7fbb16ffd640 20 client.4656.objecter dump_active .. 0 homeless 2026-02-17T11:10:56.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.721+0000 7fbb16ffd640 1 -- 10.20.193.49:0/2367298187 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fbb18021020 con 0x7fbb300c7e20 2026-02-17T11:10:56.723 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.721+0000 7fbb16ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:56.723 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.721+0000 7fbb16ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:10:56.821 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.820+0000 7fbb34a32640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:10:56.822 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.820+0000 7fbb34a32640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:10:56.822 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.820+0000 7fbb34a32640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:10:56.822 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.820+0000 7fbb34a32640 1 -- 10.20.193.49:0/2367298187 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fbb3006e0b0 con 0x7fbb300c7e20 2026-02-17T11:10:56.824 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.822+0000 7fbb16ffd640 1 -- 10.20.193.49:0/2367298187 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fbb180616c0 con 0x7fbb300c7e20 2026-02-17T11:10:56.824 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.822+0000 7fbb16ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:10:56.824 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.822+0000 7fbb16ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:10:56.824 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:10:56.824 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:10:56.826 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.823+0000 7fbb34a32640 10 librados: watch_flush enter 2026-02-17T11:10:56.826 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.823+0000 7fbb34a32640 10 librados: watch_flush exit 2026-02-17T11:10:56.826 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.823+0000 7fbb34a32640 20 client.4656.objecter shutdown clearing up homeless session... 2026-02-17T11:10:56.826 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.823+0000 7fbb34a32640 10 client.4656.objecter successfully canceled tick 2026-02-17T11:10:56.826 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.823+0000 7fbb34a32640 1 -- 10.20.193.49:0/2367298187 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fbafc079190 msgr2=0x7fbafc07b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:56.826 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.823+0000 7fbb34a32640 1 --2- 10.20.193.49:0/2367298187 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fbafc079190 0x7fbafc07b650 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbb24039000 tx=0x7fbb24033000 comp rx=0 tx=0).stop 2026-02-17T11:10:56.826 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.823+0000 7fbb34a32640 10 monclient: shutdown 2026-02-17T11:10:56.827 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.823+0000 7fbb34a32640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:56.827 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.823+0000 7fbb34a32640 1 -- 10.20.193.49:0/2367298187 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbb300c7e20 msgr2=0x7fbb301f6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:56.827 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.823+0000 7fbb34a32640 1 --2- 10.20.193.49:0/2367298187 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbb300c7e20 0x7fbb301f6ac0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbb1800c700 tx=0x7fbb1800cbd0 comp rx=0 tx=0).stop 2026-02-17T11:10:56.827 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.823+0000 7fbb34a32640 1 -- 10.20.193.49:0/2367298187 shutdown_connections 2026-02-17T11:10:56.827 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.823+0000 7fbb34a32640 1 --2- 10.20.193.49:0/2367298187 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fbafc079190 0x7fbafc07b650 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:56.827 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.823+0000 7fbb34a32640 1 --2- 10.20.193.49:0/2367298187 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fbb3015d370 0x7fbb300c3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:56.827 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.823+0000 7fbb34a32640 1 --2- 10.20.193.49:0/2367298187 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbb300c7e20 0x7fbb301f6ac0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:56.827 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.823+0000 7fbb34a32640 1 --2- 10.20.193.49:0/2367298187 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fbb300c74c0 0x7fbb3006db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:56.827 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.823+0000 7fbb34a32640 1 -- 10.20.193.49:0/2367298187 >> 10.20.193.49:0/2367298187 conn(0x7fbb300c9f20 msgr2=0x7fbb3015c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:56.827 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.823+0000 7fbb34a32640 1 -- 10.20.193.49:0/2367298187 shutdown_connections 2026-02-17T11:10:56.827 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.823+0000 7fbb34a32640 1 -- 10.20.193.49:0/2367298187 wait complete. 2026-02-17T11:10:56.827 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:56.824+0000 7fbb34a32640 1 librados: shutdown 2026-02-17T11:10:59.835 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:10:59.904 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.903+0000 7f688bc3f640 10 monclient: get_monmap_and_config 2026-02-17T11:10:59.904 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.903+0000 7f688bc3f640 10 monclient: build_initial_monmap 2026-02-17T11:10:59.904 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.903+0000 7f688bc3f640 10 monclient: monmap: 2026-02-17T11:10:59.904 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:59.904 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:59.904 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:10:59.903599+0000 2026-02-17T11:10:59.904 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:10:59.903599+0000 2026-02-17T11:10:59.904 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:59.904 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:59.904 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:10:59.904 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:10:59.904 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:10:59.904 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:10:59.904 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:10:59.904 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:10:59.904 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:59.905 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.903+0000 7f688bc3f640 1 Processor -- start 2026-02-17T11:10:59.905 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.903+0000 7f688bc3f640 1 -- start start 2026-02-17T11:10:59.905 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.903+0000 7f688bc3f640 10 monclient: init 2026-02-17T11:10:59.905 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.904+0000 7f688bc3f640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:59.905 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.904+0000 7f688bc3f640 10 monclient: _add_conns ranks=[4,2,0,3,5,1] 2026-02-17T11:10:59.905 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.904+0000 7f688bc3f640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f68840d1b10 0x7f68840d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:59.905 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.904+0000 7f688bc3f640 10 monclient(hunting): picked mon.noname-b con 0x7f68840d1b10 addr v2:10.20.193.97:3300/0 2026-02-17T11:10:59.905 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.904+0000 7f688bc3f640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f688415cc30 addr v1:10.20.193.157:6789/0 2026-02-17T11:10:59.905 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.904+0000 7f688bc3f640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f68840cdec0 addr v1:10.20.193.49:6789/0 2026-02-17T11:10:59.905 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.904+0000 7f688bc3f640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68840ce580 con 0x7f68840cdec0 2026-02-17T11:10:59.905 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.904+0000 7f688bc3f640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68840ce860 con 0x7f688415cc30 2026-02-17T11:10:59.905 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.904+0000 7f688bc3f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:59.905 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.904+0000 7f688bc3f640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f68840c90d0 con 0x7f68840d1b10 2026-02-17T11:10:59.905 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.904+0000 7f688bc3f640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:59.905 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.904+0000 7f688bc3f640 10 monclient(hunting): authenticate will time out at 1136.567238s 2026-02-17T11:10:59.905 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.904+0000 7f688a1b5640 1 --1- >> v1:10.20.193.49:6789/0 conn(0x7f68840cdec0 0x7f68840c9560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.49:6789/0 says I am v1:10.20.193.49:59986/0 (socket says 10.20.193.49:59986) 2026-02-17T11:10:59.905 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.904+0000 7f688a1b5640 1 -- 10.20.193.49:0/787420479 learned_addr learned my addr 10.20.193.49:0/787420479 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:10:59.905 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.904+0000 7f68899b4640 1 --2- 10.20.193.49:0/787420479 >> v2:10.20.193.97:3300/0 conn(0x7f68840d1b10 0x7f68840d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:59.906 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.904+0000 7f68899b4640 10 monclient(hunting): get_auth_request con 0x7f68840d1b10 auth_method 0 2026-02-17T11:10:59.906 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.904+0000 7f68899b4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:59.906 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.904+0000 7f68899b4640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:59.906 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.904+0000 7f68899b4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:59.906 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.905+0000 7f68899b4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:59.906 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.905+0000 7f68899b4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:59.906 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.905+0000 7f68899b4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:59.907 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.905+0000 7f68889b2640 1 -- 10.20.193.49:0/787420479 <== mon.0 v1:10.20.193.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3110478304 0 0) 0x7f68840ce580 con 0x7f68840cdec0 2026-02-17T11:10:59.907 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.905+0000 7f68889b2640 10 monclient(hunting): _negotiate 2026-02-17T11:10:59.907 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.905+0000 7f68889b2640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:59.907 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.905+0000 7f68889b2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:59.907 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.905+0000 7f68889b2640 10 monclient(hunting): my global_id is 4659 2026-02-17T11:10:59.907 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.905+0000 7f68889b2640 1 -- 10.20.193.49:0/787420479 --> v1:10.20.193.49:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f686c003620 con 0x7f68840cdec0 2026-02-17T11:10:59.907 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.906+0000 7f68889b2640 1 -- 10.20.193.49:0/787420479 <== mon.2 v1:10.20.193.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1907227208 0 0) 0x7f68840ce860 con 0x7f688415cc30 2026-02-17T11:10:59.907 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.906+0000 7f68889b2640 10 monclient(hunting): _negotiate 2026-02-17T11:10:59.907 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.906+0000 7f68889b2640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:59.907 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.906+0000 7f68889b2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:59.907 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.906+0000 7f68889b2640 10 monclient(hunting): my global_id is 4664 2026-02-17T11:10:59.907 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.906+0000 7f68889b2640 1 -- 10.20.193.49:0/787420479 --> v1:10.20.193.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68840ce580 con 0x7f688415cc30 2026-02-17T11:10:59.907 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.906+0000 7f68899b4640 10 monclient(hunting): handle_auth_done global_id 4636 payload 274 2026-02-17T11:10:59.907 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.906+0000 7f68899b4640 1 -- 10.20.193.49:0/787420479 >> v1:10.20.193.157:6789/0 conn(0x7f688415cc30 legacy=0x7f68840cb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:59.907 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.906+0000 7f68899b4640 1 -- 10.20.193.49:0/787420479 >> v1:10.20.193.49:6789/0 conn(0x7f68840cdec0 legacy=0x7f68840c9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:59.907 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.906+0000 7f68899b4640 10 monclient: _finish_hunting 0 2026-02-17T11:10:59.907 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.906+0000 7f68899b4640 1 monclient: found mon.noname-b 2026-02-17T11:10:59.907 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.906+0000 7f68899b4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:59.908 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.906+0000 7f68899b4640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:10:59.908 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.906+0000 7f68899b4640 1 -- 10.20.193.49:0/787420479 --> v2:10.20.193.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68840ceb40 con 0x7f68840d1b10 2026-02-17T11:10:59.908 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.907+0000 7f68899b4640 1 --2- 10.20.193.49:0/787420479 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f68840d1b10 0x7f68840d1ef0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f68740098a0 tx=0x7f687402ef00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da0135c4a2e0ca0e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:59.910 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.909+0000 7f68889b2640 1 -- 10.20.193.49:0/787420479 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f687403c070 con 0x7f68840d1b10 2026-02-17T11:10:59.910 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.909+0000 7f68889b2640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:59.910 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.909+0000 7f68889b2640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:10:59.910 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.909+0000 7f68889b2640 10 monclient: dump: 2026-02-17T11:10:59.910 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:59.910 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:59.910 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:59.910 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:59.910 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:59.911 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:59.911 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:59.911 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:59.911 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:59.911 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:59.911 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.909+0000 7f68889b2640 10 monclient: _finish_auth 0 2026-02-17T11:10:59.911 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.909+0000 7f68889b2640 10 monclient: _check_auth_tickets 2026-02-17T11:10:59.911 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.909+0000 7f68889b2640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:59.911 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.909+0000 7f68889b2640 1 -- 10.20.193.49:0/787420479 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f687402fc10 con 0x7f68840d1b10 2026-02-17T11:10:59.911 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.909+0000 7f68889b2640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:59.911 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.909+0000 7f68889b2640 1 -- 10.20.193.49:0/787420479 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6874037440 con 0x7f68840d1b10 2026-02-17T11:10:59.911 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.909+0000 7f688bc3f640 5 monclient: authenticate success, global_id 4636 2026-02-17T11:10:59.911 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.909+0000 7f688bc3f640 10 monclient: get_monmap_and_config success 2026-02-17T11:10:59.911 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.909+0000 7f688bc3f640 4 set_mon_vals no callback set 2026-02-17T11:10:59.911 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.909+0000 7f68889b2640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:59.911 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.909+0000 7f68889b2640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:59.911 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.909+0000 7f68889b2640 10 monclient: dump: 2026-02-17T11:10:59.911 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:59.911 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:59.911 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:59.911 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:59.911 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:59.911 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:59.911 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:59.911 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:59.911 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:59.911 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:59.912 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.909+0000 7f688bc3f640 10 monclient: shutdown 2026-02-17T11:10:59.912 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.909+0000 7f688bc3f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:10:59.912 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.909+0000 7f688bc3f640 1 -- 10.20.193.49:0/787420479 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f68840d1b10 msgr2=0x7f68840d1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:59.912 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.909+0000 7f688bc3f640 1 --2- 10.20.193.49:0/787420479 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f68840d1b10 0x7f68840d1ef0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f68740098a0 tx=0x7f687402ef00 comp rx=0 tx=0).stop 2026-02-17T11:10:59.912 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.909+0000 7f688bc3f640 1 -- 10.20.193.49:0/787420479 shutdown_connections 2026-02-17T11:10:59.912 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.909+0000 7f688bc3f640 1 --2- 10.20.193.49:0/787420479 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f68840d1b10 0x7f68840d1ef0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:59.912 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.909+0000 7f688bc3f640 1 -- 10.20.193.49:0/787420479 >> 10.20.193.49:0/787420479 conn(0x7f6884073030 msgr2=0x7f6884073440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:10:59.912 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.909+0000 7f688bc3f640 1 -- 10.20.193.49:0/787420479 shutdown_connections 2026-02-17T11:10:59.912 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.909+0000 7f688bc3f640 1 -- 10.20.193.49:0/787420479 wait complete. 2026-02-17T11:10:59.912 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.910+0000 7f688bc3f640 10 monclient: build_initial_monmap 2026-02-17T11:10:59.912 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.910+0000 7f688bc3f640 10 monclient: monmap: 2026-02-17T11:10:59.912 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:10:59.912 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:10:59.912 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:10:59.912 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:10:59.912 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:10:59.912 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:59.912 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:10:59.912 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:10:59.912 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:10:59.912 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:59.912 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.910+0000 7f688bc3f640 1 librados: starting msgr at 2026-02-17T11:10:59.912 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.910+0000 7f688bc3f640 1 librados: starting objecter 2026-02-17T11:10:59.912 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.910+0000 7f688bc3f640 1 Processor -- start 2026-02-17T11:10:59.912 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.910+0000 7f688bc3f640 1 -- start start 2026-02-17T11:10:59.912 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.910+0000 7f688bc3f640 1 librados: setting wanted keys 2026-02-17T11:10:59.912 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.910+0000 7f688bc3f640 1 librados: calling monclient init 2026-02-17T11:10:59.912 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.910+0000 7f688bc3f640 10 monclient: init 2026-02-17T11:10:59.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.911+0000 7f688bc3f640 10 monclient: _reopen_session rank -1 2026-02-17T11:10:59.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.911+0000 7f688bc3f640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:10:59.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.911+0000 7f688bc3f640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f68840cdec0 0x7f68841f4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:59.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.911+0000 7f688bc3f640 10 monclient(hunting): picked mon.noname-c con 0x7f68840cdec0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:10:59.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.911+0000 7f688bc3f640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f68840d1b10 0x7f688415b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:59.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.911+0000 7f688bc3f640 10 monclient(hunting): picked mon.noname-a con 0x7f68840d1b10 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:10:59.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.911+0000 7f688bc3f640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f688415cc30 0x7f688415f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:10:59.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.911+0000 7f688bc3f640 10 monclient(hunting): picked mon.noname-b con 0x7f688415cc30 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:10:59.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.911+0000 7f688bc3f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:59.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.911+0000 7f688bc3f640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f68840c8d60 con 0x7f68840d1b10 2026-02-17T11:10:59.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.911+0000 7f688bc3f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:59.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.911+0000 7f688bc3f640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f68840cf100 con 0x7f688415cc30 2026-02-17T11:10:59.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.911+0000 7f688bc3f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:10:59.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.911+0000 7f688bc3f640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f68840c9c70 con 0x7f68840cdec0 2026-02-17T11:10:59.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.911+0000 7f688bc3f640 10 monclient(hunting): _renew_subs 2026-02-17T11:10:59.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.911+0000 7f688bc3f640 10 monclient(hunting): authenticate will time out at 1136.574173s 2026-02-17T11:10:59.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.911+0000 7f68891b3640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f68840d1b10 0x7f688415b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:59.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.911+0000 7f688a1b5640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f688415cc30 0x7f688415f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:59.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.911+0000 7f68899b4640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f68840cdec0 0x7f68841f4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:10:59.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.911+0000 7f68891b3640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f68840d1b10 0x7f688415b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:40992/0 (socket says 10.20.193.49:40992) 2026-02-17T11:10:59.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.911+0000 7f68891b3640 1 -- 10.20.193.49:0/2489551784 learned_addr learned my addr 10.20.193.49:0/2489551784 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:10:59.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.911+0000 7f688a1b5640 10 monclient(hunting): get_auth_request con 0x7f688415cc30 auth_method 0 2026-02-17T11:10:59.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.911+0000 7f688a1b5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:59.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.911+0000 7f688a1b5640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:59.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.911+0000 7f688a1b5640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:59.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.911+0000 7f68891b3640 10 monclient(hunting): get_auth_request con 0x7f68840d1b10 auth_method 0 2026-02-17T11:10:59.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.911+0000 7f68891b3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:59.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.911+0000 7f68891b3640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:59.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.911+0000 7f68891b3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:59.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.911+0000 7f68899b4640 10 monclient(hunting): get_auth_request con 0x7f68840cdec0 auth_method 0 2026-02-17T11:10:59.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.911+0000 7f68899b4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:10:59.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.911+0000 7f68899b4640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:10:59.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.911+0000 7f68899b4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:10:59.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.911+0000 7f688a1b5640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:59.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.911+0000 7f688a1b5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:59.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.911+0000 7f688a1b5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:59.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.911+0000 7f68891b3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:59.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.911+0000 7f68891b3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:59.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.911+0000 7f68891b3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:59.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.912+0000 7f68899b4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:10:59.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.912+0000 7f68899b4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:10:59.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.912+0000 7f68899b4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:10:59.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.913+0000 7f688a1b5640 10 monclient(hunting): handle_auth_done global_id 4639 payload 824 2026-02-17T11:10:59.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.913+0000 7f688a1b5640 1 -- 10.20.193.49:0/2489551784 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f68840cdec0 msgr2=0x7f68841f4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:59.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.913+0000 7f688a1b5640 1 --2- 10.20.193.49:0/2489551784 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f68840cdec0 0x7f68841f4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:59.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.913+0000 7f688a1b5640 1 -- 10.20.193.49:0/2489551784 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f68840d1b10 msgr2=0x7f688415b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:10:59.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.913+0000 7f688a1b5640 1 --2- 10.20.193.49:0/2489551784 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f68840d1b10 0x7f688415b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:10:59.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.913+0000 7f688a1b5640 10 monclient: _finish_hunting 0 2026-02-17T11:10:59.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.913+0000 7f688a1b5640 1 monclient: found mon.noname-b 2026-02-17T11:10:59.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.913+0000 7f688a1b5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:10:59.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.913+0000 7f688a1b5640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:10:59.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.913+0000 7f688a1b5640 1 -- 10.20.193.49:0/2489551784 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68841f4c90 con 0x7f688415cc30 2026-02-17T11:10:59.915 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.914+0000 7f688a1b5640 1 --2- 10.20.193.49:0/2489551784 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f688415cc30 0x7f688415f530 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f688000ca80 tx=0x7f688000cf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:10:59.915 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.914+0000 7f68727fc640 10 client.?.objecter ms_handle_connect 0x7f688415cc30 2026-02-17T11:10:59.915 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.914+0000 7f68727fc640 10 client.?.objecter resend_mon_ops 2026-02-17T11:10:59.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.914+0000 7f68727fc640 1 -- 10.20.193.49:0/2489551784 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f688000ac40 con 0x7f688415cc30 2026-02-17T11:10:59.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.914+0000 7f68727fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:59.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.914+0000 7f68727fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:10:59.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.914+0000 7f68727fc640 10 monclient: dump: 2026-02-17T11:10:59.916 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:59.916 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:59.916 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:59.916 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:59.916 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:59.916 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:59.916 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:59.916 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:59.916 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:59.916 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:59.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.914+0000 7f68727fc640 10 monclient: _finish_auth 0 2026-02-17T11:10:59.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.914+0000 7f68727fc640 10 monclient: _check_auth_tickets 2026-02-17T11:10:59.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.914+0000 7f68727fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:10:59.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.914+0000 7f688bc3f640 5 monclient: authenticate success, global_id 4639 2026-02-17T11:10:59.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.914+0000 7f688bc3f640 10 monclient: _renew_subs 2026-02-17T11:10:59.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.914+0000 7f688bc3f640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:59.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.914+0000 7f688bc3f640 1 -- 10.20.193.49:0/2489551784 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f688415e120 con 0x7f688415cc30 2026-02-17T11:10:59.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.915+0000 7f688bc3f640 10 client.4639.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:10:59.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.915+0000 7f688bc3f640 10 monclient: _renew_subs 2026-02-17T11:10:59.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.915+0000 7f688bc3f640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:59.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.915+0000 7f688bc3f640 1 -- 10.20.193.49:0/2489551784 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f688415e770 con 0x7f688415cc30 2026-02-17T11:10:59.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.915+0000 7f688bc3f640 1 librados: init done 2026-02-17T11:10:59.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.915+0000 7f688bc3f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:59.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.915+0000 7f688bc3f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:10:59.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.915+0000 7f688bc3f640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:10:59.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.915+0000 7f688bc3f640 1 -- 10.20.193.49:0/2489551784 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6884076de0 con 0x7f688415cc30 2026-02-17T11:10:59.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.915+0000 7f68727fc640 1 -- 10.20.193.49:0/2489551784 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f688000ade0 con 0x7f688415cc30 2026-02-17T11:10:59.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.915+0000 7f68727fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:10:59.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.915+0000 7f68727fc640 1 -- 10.20.193.49:0/2489551784 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6880003350 con 0x7f688415cc30 2026-02-17T11:10:59.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.915+0000 7f68727fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:10:59.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.915+0000 7f68727fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:10:59.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.915+0000 7f68727fc640 10 monclient: dump: 2026-02-17T11:10:59.917 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:10:59.917 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:10:59.917 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:59.917 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:10:59.917 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:10:59.917 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:10:59.917 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:10:59.917 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:10:59.917 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:10:59.917 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:10:59.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:10:59.915+0000 7f6873fff640 4 set_mon_vals no callback set 2026-02-17T11:11:00.021 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:00.019+0000 7f68727fc640 1 -- 10.20.193.49:0/2489551784 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f6880025650 con 0x7f688415cc30 2026-02-17T11:11:00.021 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:00.020+0000 7f68727fc640 1 --2- 10.20.193.49:0/2489551784 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f6854079140 0x7f685407b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:00.022 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:00.020+0000 7f68899b4640 1 --2- 10.20.193.49:0/2489551784 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f6854079140 0x7f685407b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:00.022 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:00.020+0000 7f68899b4640 10 monclient: get_auth_request con 0x7f6854079140 auth_method 0 2026-02-17T11:11:00.023 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:00.021+0000 7f68727fc640 1 -- 10.20.193.49:0/2489551784 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f688005eac0 con 0x7f688415cc30 2026-02-17T11:11:00.023 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:00.021+0000 7f68727fc640 10 client.4639.objecter ms_dispatch2 0x7f6884000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:11:00.023 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:00.021+0000 7f68727fc640 3 client.4639.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:11:00.023 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:00.021+0000 7f68727fc640 3 client.4639.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:11:00.023 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:00.021+0000 7f68727fc640 20 client.4639.objecter dump_active .. 0 homeless 2026-02-17T11:11:00.023 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:00.021+0000 7f68899b4640 1 --2- 10.20.193.49:0/2489551784 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f6854079140 0x7f685407b600 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6874039000 tx=0x7f6874033000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:11:00.023 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:00.021+0000 7f68727fc640 10 client.4639.objecter ms_handle_connect 0x7f6854079140 2026-02-17T11:11:00.028 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:00.027+0000 7f68727fc640 1 -- 10.20.193.49:0/2489551784 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f6884076de0 con 0x7f688415cc30 2026-02-17T11:11:00.028 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:00.027+0000 7f68727fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:11:00.028 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:00.027+0000 7f68727fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:11:00.127 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:00.125+0000 7f688bc3f640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:11:00.128 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:00.125+0000 7f688bc3f640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:11:00.128 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:00.125+0000 7f688bc3f640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:11:00.128 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:00.125+0000 7f688bc3f640 1 -- 10.20.193.49:0/2489551784 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f68840ca050 con 0x7f688415cc30 2026-02-17T11:11:00.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:00.128+0000 7f68727fc640 1 -- 10.20.193.49:0/2489551784 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f68840ca050 con 0x7f688415cc30 2026-02-17T11:11:00.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:00.128+0000 7f68727fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:11:00.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:00.128+0000 7f68727fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:11:00.130 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:11:00.131 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:11:00.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:00.130+0000 7f688bc3f640 10 librados: watch_flush enter 2026-02-17T11:11:00.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:00.130+0000 7f688bc3f640 10 librados: watch_flush exit 2026-02-17T11:11:00.133 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:00.130+0000 7f688bc3f640 20 client.4639.objecter shutdown clearing up homeless session... 2026-02-17T11:11:00.133 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:00.130+0000 7f688bc3f640 10 client.4639.objecter successfully canceled tick 2026-02-17T11:11:00.133 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:00.130+0000 7f688bc3f640 1 -- 10.20.193.49:0/2489551784 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f6854079140 msgr2=0x7f685407b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:00.133 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:00.130+0000 7f688bc3f640 1 --2- 10.20.193.49:0/2489551784 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f6854079140 0x7f685407b600 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6874039000 tx=0x7f6874033000 comp rx=0 tx=0).stop 2026-02-17T11:11:00.133 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:00.130+0000 7f688bc3f640 10 monclient: shutdown 2026-02-17T11:11:00.133 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:00.130+0000 7f688bc3f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:11:00.133 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:00.130+0000 7f688bc3f640 1 -- 10.20.193.49:0/2489551784 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f688415cc30 msgr2=0x7f688415f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:00.133 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:00.130+0000 7f688bc3f640 1 --2- 10.20.193.49:0/2489551784 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f688415cc30 0x7f688415f530 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f688000ca80 tx=0x7f688000cf50 comp rx=0 tx=0).stop 2026-02-17T11:11:00.133 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:00.130+0000 7f688bc3f640 1 -- 10.20.193.49:0/2489551784 shutdown_connections 2026-02-17T11:11:00.133 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:00.130+0000 7f688bc3f640 1 --2- 10.20.193.49:0/2489551784 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f6854079140 0x7f685407b600 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:00.134 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:00.130+0000 7f688bc3f640 1 --2- 10.20.193.49:0/2489551784 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f688415cc30 0x7f688415f530 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:00.134 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:00.130+0000 7f688bc3f640 1 --2- 10.20.193.49:0/2489551784 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f68840d1b10 0x7f688415b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:00.134 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:00.130+0000 7f688bc3f640 1 --2- 10.20.193.49:0/2489551784 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f68840cdec0 0x7f68841f4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:00.134 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:00.130+0000 7f688bc3f640 1 -- 10.20.193.49:0/2489551784 >> 10.20.193.49:0/2489551784 conn(0x7f6884073030 msgr2=0x7f68840ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:11:00.134 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:00.130+0000 7f688bc3f640 1 -- 10.20.193.49:0/2489551784 shutdown_connections 2026-02-17T11:11:00.134 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:00.130+0000 7f688bc3f640 1 -- 10.20.193.49:0/2489551784 wait complete. 2026-02-17T11:11:00.134 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:00.130+0000 7f688bc3f640 1 librados: shutdown 2026-02-17T11:11:03.141 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:11:03.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.208+0000 7fb9f1ac7640 10 monclient: get_monmap_and_config 2026-02-17T11:11:03.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.208+0000 7fb9f1ac7640 10 monclient: build_initial_monmap 2026-02-17T11:11:03.210 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.208+0000 7fb9f1ac7640 10 monclient: monmap: 2026-02-17T11:11:03.210 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:11:03.210 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:03.210 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:11:03.208592+0000 2026-02-17T11:11:03.210 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:11:03.208592+0000 2026-02-17T11:11:03.210 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:11:03.210 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:03.210 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:11:03.210 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:11:03.210 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:11:03.211 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:11:03.211 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:11:03.211 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:11:03.211 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:03.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.208+0000 7fb9f1ac7640 1 Processor -- start 2026-02-17T11:11:03.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.208+0000 7fb9f1ac7640 1 -- start start 2026-02-17T11:11:03.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.208+0000 7fb9f1ac7640 10 monclient: init 2026-02-17T11:11:03.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.209+0000 7fb9f1ac7640 10 monclient: _reopen_session rank -1 2026-02-17T11:11:03.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.209+0000 7fb9f1ac7640 10 monclient: _add_conns ranks=[0,4,2,5,1,3] 2026-02-17T11:11:03.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.209+0000 7fb9f1ac7640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb9ec0c7170 addr v1:10.20.193.49:6789/0 2026-02-17T11:11:03.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.209+0000 7fb9f1ac7640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7fb9ec0c7550 0x7fb9ec0749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:03.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.209+0000 7fb9f1ac7640 10 monclient(hunting): picked mon.noname-b con 0x7fb9ec0c7550 addr v2:10.20.193.97:3300/0 2026-02-17T11:11:03.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.209+0000 7fb9f1ac7640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fb9ec074ef0 addr v1:10.20.193.157:6789/0 2026-02-17T11:11:03.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.209+0000 7fb9f1ac7640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9ec0c4fd0 con 0x7fb9ec0c7170 2026-02-17T11:11:03.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.209+0000 7fb9f1ac7640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9ec15a9a0 con 0x7fb9ec074ef0 2026-02-17T11:11:03.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.209+0000 7fb9f1ac7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:03.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.209+0000 7fb9f1ac7640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7fb9ec0c8530 con 0x7fb9ec0c7550 2026-02-17T11:11:03.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.209+0000 7fb9f1ac7640 10 monclient(hunting): _renew_subs 2026-02-17T11:11:03.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.209+0000 7fb9f1ac7640 10 monclient(hunting): authenticate will time out at 1139.872083s 2026-02-17T11:11:03.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.209+0000 7fb9eb7fe640 1 --1- >> v1:10.20.193.49:6789/0 conn(0x7fb9ec0c7170 0x7fb9ec0c48c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.49:6789/0 says I am v1:10.20.193.49:59998/0 (socket says 10.20.193.49:59998) 2026-02-17T11:11:03.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.209+0000 7fb9eb7fe640 1 -- 10.20.193.49:0/1325010956 learned_addr learned my addr 10.20.193.49:0/1325010956 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:11:03.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.209+0000 7fb9eaffd640 1 --2- 10.20.193.49:0/1325010956 >> v2:10.20.193.97:3300/0 conn(0x7fb9ec0c7550 0x7fb9ec0749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:03.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.209+0000 7fb9eaffd640 10 monclient(hunting): get_auth_request con 0x7fb9ec0c7550 auth_method 0 2026-02-17T11:11:03.216 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.209+0000 7fb9eaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:03.216 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.209+0000 7fb9eaffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:03.216 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.209+0000 7fb9eaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:03.216 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.210+0000 7fb9eaffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:03.216 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.210+0000 7fb9eaffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:03.216 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.210+0000 7fb9eaffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:03.216 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.210+0000 7fb9ea7fc640 1 -- 10.20.193.49:0/1325010956 <== mon.0 v1:10.20.193.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 103663580 0 0) 0x7fb9ec0c4fd0 con 0x7fb9ec0c7170 2026-02-17T11:11:03.216 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.210+0000 7fb9ea7fc640 10 monclient(hunting): _negotiate 2026-02-17T11:11:03.216 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.210+0000 7fb9ea7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:03.216 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.210+0000 7fb9ea7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:03.217 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.210+0000 7fb9ea7fc640 10 monclient(hunting): my global_id is 4665 2026-02-17T11:11:03.217 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.210+0000 7fb9ea7fc640 1 -- 10.20.193.49:0/1325010956 --> v1:10.20.193.49:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb9d0003620 con 0x7fb9ec0c7170 2026-02-17T11:11:03.217 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.211+0000 7fb9eaffd640 10 monclient(hunting): handle_auth_done global_id 4642 payload 274 2026-02-17T11:11:03.217 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.211+0000 7fb9eaffd640 1 -- 10.20.193.49:0/1325010956 >> v1:10.20.193.157:6789/0 conn(0x7fb9ec074ef0 legacy=0x7fb9ec0c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:03.217 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.211+0000 7fb9eaffd640 1 -- 10.20.193.49:0/1325010956 >> v1:10.20.193.49:6789/0 conn(0x7fb9ec0c7170 legacy=0x7fb9ec0c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:03.217 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.211+0000 7fb9eaffd640 10 monclient: _finish_hunting 0 2026-02-17T11:11:03.217 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.211+0000 7fb9eaffd640 1 monclient: found mon.noname-b 2026-02-17T11:11:03.217 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.211+0000 7fb9eaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:11:03.217 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.211+0000 7fb9eaffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:11:03.217 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.211+0000 7fb9eaffd640 1 -- 10.20.193.49:0/1325010956 --> v2:10.20.193.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9ec0c5270 con 0x7fb9ec0c7550 2026-02-17T11:11:03.217 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.212+0000 7fb9eaffd640 1 --2- 10.20.193.49:0/1325010956 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb9ec0c7550 0x7fb9ec0749b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc0098a0 tx=0x7fb9dc02ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27d77397c46e9c75 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:11:03.224 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.214+0000 7fb9ea7fc640 1 -- 10.20.193.49:0/1325010956 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc03c070 con 0x7fb9ec0c7550 2026-02-17T11:11:03.224 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.214+0000 7fb9ea7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:03.225 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.214+0000 7fb9ea7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:11:03.225 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.214+0000 7fb9ea7fc640 10 monclient: dump: 2026-02-17T11:11:03.225 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:03.225 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:03.225 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:03.225 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:03.225 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:03.225 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:03.225 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:03.225 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:03.225 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:03.226 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:03.226 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.214+0000 7fb9ea7fc640 10 monclient: _finish_auth 0 2026-02-17T11:11:03.226 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.214+0000 7fb9ea7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:11:03.226 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.214+0000 7fb9ea7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:11:03.226 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.214+0000 7fb9ea7fc640 1 -- 10.20.193.49:0/1325010956 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9dc02fb70 con 0x7fb9ec0c7550 2026-02-17T11:11:03.226 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.214+0000 7fb9ea7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:11:03.226 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.214+0000 7fb9ea7fc640 1 -- 10.20.193.49:0/1325010956 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc037440 con 0x7fb9ec0c7550 2026-02-17T11:11:03.226 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.214+0000 7fb9f1ac7640 5 monclient: authenticate success, global_id 4642 2026-02-17T11:11:03.226 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.214+0000 7fb9f1ac7640 10 monclient: get_monmap_and_config success 2026-02-17T11:11:03.226 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.214+0000 7fb9f1ac7640 4 set_mon_vals no callback set 2026-02-17T11:11:03.226 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.214+0000 7fb9ea7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:03.226 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.214+0000 7fb9ea7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:11:03.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.214+0000 7fb9ea7fc640 10 monclient: dump: 2026-02-17T11:11:03.227 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:03.227 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:03.227 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:03.227 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:03.227 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:03.227 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:03.227 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:03.227 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:03.227 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:03.227 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:03.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.214+0000 7fb9f1ac7640 10 monclient: shutdown 2026-02-17T11:11:03.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.214+0000 7fb9f1ac7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:11:03.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.214+0000 7fb9f1ac7640 1 -- 10.20.193.49:0/1325010956 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb9ec0c7550 msgr2=0x7fb9ec0749b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:03.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.214+0000 7fb9f1ac7640 1 --2- 10.20.193.49:0/1325010956 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb9ec0c7550 0x7fb9ec0749b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc0098a0 tx=0x7fb9dc02ee60 comp rx=0 tx=0).stop 2026-02-17T11:11:03.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.214+0000 7fb9f1ac7640 1 -- 10.20.193.49:0/1325010956 shutdown_connections 2026-02-17T11:11:03.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.214+0000 7fb9f1ac7640 1 --2- 10.20.193.49:0/1325010956 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb9ec0c7550 0x7fb9ec0749b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:03.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.214+0000 7fb9f1ac7640 1 -- 10.20.193.49:0/1325010956 >> 10.20.193.49:0/1325010956 conn(0x7fb9ec0c9f40 msgr2=0x7fb9ec0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:11:03.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.214+0000 7fb9f1ac7640 1 -- 10.20.193.49:0/1325010956 shutdown_connections 2026-02-17T11:11:03.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.214+0000 7fb9f1ac7640 1 -- 10.20.193.49:0/1325010956 wait complete. 2026-02-17T11:11:03.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.214+0000 7fb9f1ac7640 10 monclient: build_initial_monmap 2026-02-17T11:11:03.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.214+0000 7fb9f1ac7640 10 monclient: monmap: 2026-02-17T11:11:03.228 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:11:03.229 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:11:03.229 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:11:03.229 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:11:03.229 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:11:03.229 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:03.229 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:11:03.229 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:11:03.229 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:11:03.229 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:03.229 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.214+0000 7fb9f1ac7640 1 librados: starting msgr at 2026-02-17T11:11:03.229 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.214+0000 7fb9f1ac7640 1 librados: starting objecter 2026-02-17T11:11:03.229 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.214+0000 7fb9f1ac7640 1 Processor -- start 2026-02-17T11:11:03.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.215+0000 7fb9f1ac7640 1 -- start start 2026-02-17T11:11:03.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.215+0000 7fb9f1ac7640 1 librados: setting wanted keys 2026-02-17T11:11:03.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.215+0000 7fb9f1ac7640 1 librados: calling monclient init 2026-02-17T11:11:03.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.215+0000 7fb9f1ac7640 10 monclient: init 2026-02-17T11:11:03.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.215+0000 7fb9f1ac7640 10 monclient: _reopen_session rank -1 2026-02-17T11:11:03.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.215+0000 7fb9f1ac7640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:11:03.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.215+0000 7fb9f1ac7640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb9ec074ef0 0x7fb9ec15bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:03.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.215+0000 7fb9f1ac7640 10 monclient(hunting): picked mon.noname-c con 0x7fb9ec074ef0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:11:03.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.215+0000 7fb9f1ac7640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb9ec0c7170 0x7fb9ec1593e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:03.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.215+0000 7fb9f1ac7640 10 monclient(hunting): picked mon.noname-a con 0x7fb9ec0c7170 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:11:03.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.215+0000 7fb9f1ac7640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb9ec0c7550 0x7fb9ec15da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:03.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.215+0000 7fb9f1ac7640 10 monclient(hunting): picked mon.noname-b con 0x7fb9ec0c7550 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:11:03.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.215+0000 7fb9f1ac7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:03.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.215+0000 7fb9f1ac7640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb9ec0c7ee0 con 0x7fb9ec0c7170 2026-02-17T11:11:03.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.215+0000 7fb9f1ac7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:03.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.215+0000 7fb9f1ac7640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb9ec0c5830 con 0x7fb9ec0c7550 2026-02-17T11:11:03.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.215+0000 7fb9f1ac7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:03.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.215+0000 7fb9f1ac7640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb9ec0c81c0 con 0x7fb9ec074ef0 2026-02-17T11:11:03.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.215+0000 7fb9f1ac7640 10 monclient(hunting): _renew_subs 2026-02-17T11:11:03.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.215+0000 7fb9f1ac7640 10 monclient(hunting): authenticate will time out at 1139.878425s 2026-02-17T11:11:03.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.215+0000 7fb9eb7fe640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb9ec074ef0 0x7fb9ec15bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:03.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.215+0000 7fb9ebfff640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb9ec0c7550 0x7fb9ec15da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:03.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.215+0000 7fb9eaffd640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb9ec0c7170 0x7fb9ec1593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:03.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.215+0000 7fb9eb7fe640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb9ec074ef0 0x7fb9ec15bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:58766/0 (socket says 10.20.193.49:58766) 2026-02-17T11:11:03.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.215+0000 7fb9eb7fe640 1 -- 10.20.193.49:0/1068286809 learned_addr learned my addr 10.20.193.49:0/1068286809 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:11:03.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.215+0000 7fb9eb7fe640 10 monclient(hunting): get_auth_request con 0x7fb9ec074ef0 auth_method 0 2026-02-17T11:11:03.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.215+0000 7fb9eb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:03.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.215+0000 7fb9eb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:03.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.215+0000 7fb9eb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:03.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.215+0000 7fb9ebfff640 10 monclient(hunting): get_auth_request con 0x7fb9ec0c7550 auth_method 0 2026-02-17T11:11:03.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.215+0000 7fb9ebfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:03.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.215+0000 7fb9ebfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:03.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.215+0000 7fb9ebfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:03.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.216+0000 7fb9eaffd640 10 monclient(hunting): get_auth_request con 0x7fb9ec0c7170 auth_method 0 2026-02-17T11:11:03.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.216+0000 7fb9eaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:03.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.216+0000 7fb9eaffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:03.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.216+0000 7fb9eaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:03.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.216+0000 7fb9ebfff640 1 -- 10.20.193.49:0/1068286809 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb9ec0c7550 msgr2=0x7fb9ec15da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-17T11:11:03.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.216+0000 7fb9ebfff640 1 -- 10.20.193.49:0/1068286809 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb9ec0c7550 msgr2=0x7fb9ec15da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:11:03.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.216+0000 7fb9ebfff640 1 --2- 10.20.193.49:0/1068286809 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb9ec0c7550 0x7fb9ec15da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:11:03.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.216+0000 7fb9ebfff640 1 --2- 10.20.193.49:0/1068286809 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb9ec0c7550 0x7fb9ec15da50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:11:03.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.216+0000 7fb9eb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:03.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.216+0000 7fb9eb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:03.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.216+0000 7fb9eb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:03.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.216+0000 7fb9eaffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:03.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.216+0000 7fb9eaffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:03.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.216+0000 7fb9eaffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:03.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.217+0000 7fb9eb7fe640 10 monclient(hunting): handle_auth_done global_id 4673 payload 824 2026-02-17T11:11:03.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.217+0000 7fb9eb7fe640 1 -- 10.20.193.49:0/1068286809 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb9ec0c7550 msgr2=0x7fb9ec15da50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:11:03.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.217+0000 7fb9eb7fe640 1 --2- 10.20.193.49:0/1068286809 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb9ec0c7550 0x7fb9ec15da50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:03.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.217+0000 7fb9eb7fe640 1 -- 10.20.193.49:0/1068286809 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb9ec0c7170 msgr2=0x7fb9ec1593e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:03.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.217+0000 7fb9eb7fe640 1 --2- 10.20.193.49:0/1068286809 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb9ec0c7170 0x7fb9ec1593e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:03.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.217+0000 7fb9eb7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:11:03.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.217+0000 7fb9eb7fe640 1 monclient: found mon.noname-c 2026-02-17T11:11:03.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.217+0000 7fb9eb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:11:03.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.217+0000 7fb9eb7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:11:03.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.217+0000 7fb9eb7fe640 1 -- 10.20.193.49:0/1068286809 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9ec1f3ff0 con 0x7fb9ec074ef0 2026-02-17T11:11:03.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.218+0000 7fb9eb7fe640 1 --2- 10.20.193.49:0/1068286809 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb9ec074ef0 0x7fb9ec15bc80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb9d800c730 tx=0x7fb9d800cc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:11:03.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.218+0000 7fb9c7fff640 10 client.?.objecter ms_handle_connect 0x7fb9ec074ef0 2026-02-17T11:11:03.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.218+0000 7fb9c7fff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:11:03.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.220+0000 7fb9c7fff640 1 -- 10.20.193.49:0/1068286809 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8017070 con 0x7fb9ec074ef0 2026-02-17T11:11:03.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.220+0000 7fb9c7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:03.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.220+0000 7fb9c7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:11:03.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.220+0000 7fb9c7fff640 10 monclient: dump: 2026-02-17T11:11:03.235 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:03.235 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:03.235 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:03.235 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:03.235 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:03.235 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:03.235 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:03.235 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:03.235 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:03.235 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:03.236 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.220+0000 7fb9c7fff640 10 monclient: _finish_auth 0 2026-02-17T11:11:03.236 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.220+0000 7fb9c7fff640 10 monclient: _check_auth_tickets 2026-02-17T11:11:03.236 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.220+0000 7fb9c7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:11:03.236 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.220+0000 7fb9f1ac7640 5 monclient: authenticate success, global_id 4673 2026-02-17T11:11:03.236 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.220+0000 7fb9f1ac7640 10 monclient: _renew_subs 2026-02-17T11:11:03.236 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.220+0000 7fb9c7fff640 1 -- 10.20.193.49:0/1068286809 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9d8005bb0 con 0x7fb9ec074ef0 2026-02-17T11:11:03.236 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.220+0000 7fb9f1ac7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:11:03.236 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.220+0000 7fb9f1ac7640 1 -- 10.20.193.49:0/1068286809 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9ec1f42d0 con 0x7fb9ec074ef0 2026-02-17T11:11:03.236 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.220+0000 7fb9c7fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:11:03.236 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.220+0000 7fb9e9ffb640 4 set_mon_vals no callback set 2026-02-17T11:11:03.236 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.220+0000 7fb9f1ac7640 10 client.4673.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:11:03.236 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.220+0000 7fb9f1ac7640 10 monclient: _renew_subs 2026-02-17T11:11:03.236 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.220+0000 7fb9f1ac7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:11:03.237 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.220+0000 7fb9f1ac7640 1 -- 10.20.193.49:0/1068286809 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9ec15b1a0 con 0x7fb9ec074ef0 2026-02-17T11:11:03.237 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.220+0000 7fb9c7fff640 1 -- 10.20.193.49:0/1068286809 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8007070 con 0x7fb9ec074ef0 2026-02-17T11:11:03.237 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.220+0000 7fb9f1ac7640 1 librados: init done 2026-02-17T11:11:03.237 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.220+0000 7fb9c7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:03.237 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.220+0000 7fb9c7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:11:03.237 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.220+0000 7fb9c7fff640 10 monclient: dump: 2026-02-17T11:11:03.237 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:03.237 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:03.237 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:03.237 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:03.237 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:03.237 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:03.238 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:03.238 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:03.238 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:03.238 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:03.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.221+0000 7fb9f1ac7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:11:03.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.221+0000 7fb9f1ac7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:11:03.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.221+0000 7fb9f1ac7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:11:03.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.221+0000 7fb9f1ac7640 1 -- 10.20.193.49:0/1068286809 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9ec14c770 con 0x7fb9ec074ef0 2026-02-17T11:11:03.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.232+0000 7fb9c7fff640 1 -- 10.20.193.49:0/1068286809 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7fb9d8007210 con 0x7fb9ec074ef0 2026-02-17T11:11:03.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.233+0000 7fb9c7fff640 1 --2- 10.20.193.49:0/1068286809 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb9bc079190 0x7fb9bc07b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:03.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.233+0000 7fb9eaffd640 1 --2- 10.20.193.49:0/1068286809 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb9bc079190 0x7fb9bc07b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:03.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.233+0000 7fb9eaffd640 10 monclient: get_auth_request con 0x7fb9bc079190 auth_method 0 2026-02-17T11:11:03.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.234+0000 7fb9eaffd640 1 --2- 10.20.193.49:0/1068286809 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb9bc079190 0x7fb9bc07b650 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc039000 tx=0x7fb9dc033000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:11:03.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.234+0000 7fb9c7fff640 10 client.4673.objecter ms_handle_connect 0x7fb9bc079190 2026-02-17T11:11:03.257 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.255+0000 7fb9c7fff640 1 -- 10.20.193.49:0/1068286809 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7fb9d805d750 con 0x7fb9ec074ef0 2026-02-17T11:11:03.257 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.255+0000 7fb9c7fff640 10 client.4673.objecter ms_dispatch2 0x7fb9ec000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:11:03.257 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.255+0000 7fb9c7fff640 3 client.4673.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:11:03.257 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.255+0000 7fb9c7fff640 3 client.4673.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:11:03.257 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.255+0000 7fb9c7fff640 20 client.4673.objecter dump_active .. 0 homeless 2026-02-17T11:11:03.338 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.336+0000 7fb9c7fff640 1 -- 10.20.193.49:0/1068286809 <== mon.2 v2:10.20.193.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb9d8021020 con 0x7fb9ec074ef0 2026-02-17T11:11:03.338 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.337+0000 7fb9c7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:11:03.338 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.337+0000 7fb9c7fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:11:03.438 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.436+0000 7fb9f1ac7640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:11:03.438 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.436+0000 7fb9f1ac7640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:11:03.438 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.436+0000 7fb9f1ac7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:11:03.438 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.436+0000 7fb9f1ac7640 1 -- 10.20.193.49:0/1068286809 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb9ec0ca6a0 con 0x7fb9ec074ef0 2026-02-17T11:11:03.442 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.440+0000 7fb9c7fff640 1 -- 10.20.193.49:0/1068286809 <== mon.2 v2:10.20.193.157:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fb9d8061710 con 0x7fb9ec074ef0 2026-02-17T11:11:03.442 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.440+0000 7fb9c7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:11:03.442 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.440+0000 7fb9c7fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:11:03.442 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:11:03.442 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:11:03.444 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.441+0000 7fb9f1ac7640 10 librados: watch_flush enter 2026-02-17T11:11:03.444 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.441+0000 7fb9f1ac7640 10 librados: watch_flush exit 2026-02-17T11:11:03.444 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.441+0000 7fb9f1ac7640 20 client.4673.objecter shutdown clearing up homeless session... 2026-02-17T11:11:03.444 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.441+0000 7fb9f1ac7640 10 client.4673.objecter successfully canceled tick 2026-02-17T11:11:03.444 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.441+0000 7fb9f1ac7640 1 -- 10.20.193.49:0/1068286809 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb9bc079190 msgr2=0x7fb9bc07b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:03.444 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.441+0000 7fb9f1ac7640 1 --2- 10.20.193.49:0/1068286809 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb9bc079190 0x7fb9bc07b650 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc039000 tx=0x7fb9dc033000 comp rx=0 tx=0).stop 2026-02-17T11:11:03.445 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.441+0000 7fb9f1ac7640 10 monclient: shutdown 2026-02-17T11:11:03.445 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.441+0000 7fb9f1ac7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:11:03.445 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.441+0000 7fb9f1ac7640 1 -- 10.20.193.49:0/1068286809 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb9ec074ef0 msgr2=0x7fb9ec15bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:03.445 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.441+0000 7fb9f1ac7640 1 --2- 10.20.193.49:0/1068286809 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb9ec074ef0 0x7fb9ec15bc80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb9d800c730 tx=0x7fb9d800cc00 comp rx=0 tx=0).stop 2026-02-17T11:11:03.445 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.441+0000 7fb9f1ac7640 1 -- 10.20.193.49:0/1068286809 shutdown_connections 2026-02-17T11:11:03.445 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.441+0000 7fb9f1ac7640 1 --2- 10.20.193.49:0/1068286809 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb9bc079190 0x7fb9bc07b650 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:03.445 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.441+0000 7fb9f1ac7640 1 --2- 10.20.193.49:0/1068286809 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb9ec0c7550 0x7fb9ec15da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:03.445 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.441+0000 7fb9f1ac7640 1 --2- 10.20.193.49:0/1068286809 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb9ec0c7170 0x7fb9ec1593e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:03.445 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.441+0000 7fb9f1ac7640 1 --2- 10.20.193.49:0/1068286809 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb9ec074ef0 0x7fb9ec15bc80 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:03.445 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.441+0000 7fb9f1ac7640 1 -- 10.20.193.49:0/1068286809 >> 10.20.193.49:0/1068286809 conn(0x7fb9ec0c9f40 msgr2=0x7fb9ec158330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:11:03.445 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.442+0000 7fb9f1ac7640 1 -- 10.20.193.49:0/1068286809 shutdown_connections 2026-02-17T11:11:03.446 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.442+0000 7fb9f1ac7640 1 -- 10.20.193.49:0/1068286809 wait complete. 2026-02-17T11:11:03.446 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:03.442+0000 7fb9f1ac7640 1 librados: shutdown 2026-02-17T11:11:06.452 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:11:06.521 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.519+0000 7f957373b640 10 monclient: get_monmap_and_config 2026-02-17T11:11:06.521 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.519+0000 7f957373b640 10 monclient: build_initial_monmap 2026-02-17T11:11:06.521 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.519+0000 7f957373b640 10 monclient: monmap: 2026-02-17T11:11:06.521 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:11:06.521 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:06.521 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:11:06.520079+0000 2026-02-17T11:11:06.521 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:11:06.520079+0000 2026-02-17T11:11:06.521 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:11:06.521 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:06.522 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:11:06.522 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:11:06.522 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:11:06.522 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:11:06.522 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:11:06.522 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:11:06.522 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:06.525 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.520+0000 7f957373b640 1 Processor -- start 2026-02-17T11:11:06.525 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.520+0000 7f957373b640 1 -- start start 2026-02-17T11:11:06.525 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.520+0000 7f957373b640 10 monclient: init 2026-02-17T11:11:06.525 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.520+0000 7f957373b640 10 monclient: _reopen_session rank -1 2026-02-17T11:11:06.525 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.520+0000 7f957373b640 10 monclient: _add_conns ranks=[0,1,5,3,4,2] 2026-02-17T11:11:06.525 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.520+0000 7f957373b640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f956c152820 addr v1:10.20.193.49:6789/0 2026-02-17T11:11:06.525 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.520+0000 7f957373b640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f956c152c00 addr v1:10.20.193.97:6789/0 2026-02-17T11:11:06.526 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.520+0000 7f957373b640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f956c0c63f0 0x7f956c1593f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:06.526 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.520+0000 7f957373b640 10 monclient(hunting): picked mon.noname-c con 0x7f956c0c63f0 addr v2:10.20.193.157:3300/0 2026-02-17T11:11:06.526 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.520+0000 7f957373b640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f956c073e90 con 0x7f956c152820 2026-02-17T11:11:06.526 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.520+0000 7f957373b640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f956c074170 con 0x7f956c152c00 2026-02-17T11:11:06.526 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.520+0000 7f957373b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:06.526 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.520+0000 7f957373b640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f956c159930 con 0x7f956c0c63f0 2026-02-17T11:11:06.526 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.520+0000 7f957373b640 10 monclient(hunting): _renew_subs 2026-02-17T11:11:06.526 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.520+0000 7f957373b640 10 monclient(hunting): authenticate will time out at 1143.183654s 2026-02-17T11:11:06.526 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.521+0000 7f95714b0640 1 --1- >> v1:10.20.193.49:6789/0 conn(0x7f956c152820 0x7f956c0c7e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.49:6789/0 says I am v1:10.20.193.49:52176/0 (socket says 10.20.193.49:52176) 2026-02-17T11:11:06.526 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.521+0000 7f95714b0640 1 -- 10.20.193.49:0/1048335631 learned_addr learned my addr 10.20.193.49:0/1048335631 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:11:06.526 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.521+0000 7f9571cb1640 1 --2- 10.20.193.49:0/1048335631 >> v2:10.20.193.157:3300/0 conn(0x7f956c0c63f0 0x7f956c1593f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:06.527 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.521+0000 7f9571cb1640 10 monclient(hunting): get_auth_request con 0x7f956c0c63f0 auth_method 0 2026-02-17T11:11:06.527 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.521+0000 7f9571cb1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:06.527 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.521+0000 7f9571cb1640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:06.527 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.521+0000 7f9571cb1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:06.527 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.521+0000 7f9571cb1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:06.527 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.521+0000 7f9571cb1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:06.527 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.521+0000 7f9571cb1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:06.527 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.522+0000 7f955bfff640 1 -- 10.20.193.49:0/1048335631 <== mon.0 v1:10.20.193.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1510787280 0 0) 0x7f956c073e90 con 0x7f956c152820 2026-02-17T11:11:06.527 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.522+0000 7f955bfff640 10 monclient(hunting): _negotiate 2026-02-17T11:11:06.527 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.522+0000 7f955bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:06.527 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.522+0000 7f955bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:06.527 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.522+0000 7f955bfff640 10 monclient(hunting): my global_id is 4671 2026-02-17T11:11:06.528 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.522+0000 7f955bfff640 1 -- 10.20.193.49:0/1048335631 --> v1:10.20.193.49:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9554003620 con 0x7f956c152820 2026-02-17T11:11:06.528 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.522+0000 7f955bfff640 1 -- 10.20.193.49:0/1048335631 <== mon.1 v1:10.20.193.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2903766041 0 0) 0x7f956c074170 con 0x7f956c152c00 2026-02-17T11:11:06.528 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.522+0000 7f955bfff640 10 monclient(hunting): _negotiate 2026-02-17T11:11:06.528 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.522+0000 7f955bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:06.528 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.522+0000 7f955bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:06.528 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.522+0000 7f955bfff640 10 monclient(hunting): my global_id is 4648 2026-02-17T11:11:06.528 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.522+0000 7f955bfff640 1 -- 10.20.193.49:0/1048335631 --> v1:10.20.193.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f956c073e90 con 0x7f956c152c00 2026-02-17T11:11:06.528 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.522+0000 7f9571cb1640 10 monclient(hunting): handle_auth_done global_id 4676 payload 274 2026-02-17T11:11:06.528 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.522+0000 7f9571cb1640 1 -- 10.20.193.49:0/1048335631 >> v1:10.20.193.97:6789/0 conn(0x7f956c152c00 legacy=0x7f956c0c5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:06.528 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.522+0000 7f9571cb1640 1 -- 10.20.193.49:0/1048335631 >> v1:10.20.193.49:6789/0 conn(0x7f956c152820 legacy=0x7f956c0c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:06.528 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.522+0000 7f9571cb1640 10 monclient: _finish_hunting 0 2026-02-17T11:11:06.528 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.522+0000 7f9571cb1640 1 monclient: found mon.noname-c 2026-02-17T11:11:06.529 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.522+0000 7f9571cb1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:11:06.529 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.522+0000 7f9571cb1640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:11:06.529 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.522+0000 7f9571cb1640 1 -- 10.20.193.49:0/1048335631 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f956c074450 con 0x7f956c0c63f0 2026-02-17T11:11:06.529 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.523+0000 7f9571cb1640 1 --2- 10.20.193.49:0/1048335631 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f956c0c63f0 0x7f956c1593f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9568009d90 tx=0x7f956802f2c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37c5e1c261ba863b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:11:06.535 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.525+0000 7f955bfff640 1 -- 10.20.193.49:0/1048335631 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f956803c070 con 0x7f956c0c63f0 2026-02-17T11:11:06.535 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.525+0000 7f955bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:06.535 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.525+0000 7f955bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:11:06.535 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.525+0000 7f955bfff640 10 monclient: dump: 2026-02-17T11:11:06.535 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:06.535 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:06.536 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:06.536 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:06.536 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:06.536 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:06.536 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:06.536 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:06.536 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:06.536 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:06.536 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.525+0000 7f955bfff640 10 monclient: _finish_auth 0 2026-02-17T11:11:06.536 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.525+0000 7f955bfff640 10 monclient: _check_auth_tickets 2026-02-17T11:11:06.536 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.525+0000 7f955bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:11:06.536 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.525+0000 7f955bfff640 1 -- 10.20.193.49:0/1048335631 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9568037440 con 0x7f956c0c63f0 2026-02-17T11:11:06.537 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.525+0000 7f957373b640 5 monclient: authenticate success, global_id 4676 2026-02-17T11:11:06.537 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.525+0000 7f957373b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:11:06.537 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.525+0000 7f955bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:11:06.537 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.525+0000 7f955bfff640 1 -- 10.20.193.49:0/1048335631 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9568037810 con 0x7f956c0c63f0 2026-02-17T11:11:06.537 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.525+0000 7f955bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:06.537 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.525+0000 7f955bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:11:06.537 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.525+0000 7f955bfff640 10 monclient: dump: 2026-02-17T11:11:06.537 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:06.537 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:06.537 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:06.537 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:06.537 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:06.538 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:06.538 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:06.538 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:06.538 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:06.538 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:06.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.525+0000 7f957373b640 10 monclient: get_monmap_and_config success 2026-02-17T11:11:06.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.525+0000 7f957373b640 4 set_mon_vals no callback set 2026-02-17T11:11:06.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.525+0000 7f957373b640 10 monclient: shutdown 2026-02-17T11:11:06.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.525+0000 7f957373b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:11:06.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.525+0000 7f957373b640 1 -- 10.20.193.49:0/1048335631 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f956c0c63f0 msgr2=0x7f956c1593f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:06.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.525+0000 7f957373b640 1 --2- 10.20.193.49:0/1048335631 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f956c0c63f0 0x7f956c1593f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9568009d90 tx=0x7f956802f2c0 comp rx=0 tx=0).stop 2026-02-17T11:11:06.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.525+0000 7f957373b640 1 -- 10.20.193.49:0/1048335631 shutdown_connections 2026-02-17T11:11:06.539 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.525+0000 7f957373b640 1 --2- 10.20.193.49:0/1048335631 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f956c0c63f0 0x7f956c1593f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:06.539 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.525+0000 7f957373b640 1 -- 10.20.193.49:0/1048335631 >> 10.20.193.49:0/1048335631 conn(0x7f956c0c9f40 msgr2=0x7f956c0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:11:06.539 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.525+0000 7f957373b640 1 -- 10.20.193.49:0/1048335631 shutdown_connections 2026-02-17T11:11:06.539 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.525+0000 7f957373b640 1 -- 10.20.193.49:0/1048335631 wait complete. 2026-02-17T11:11:06.539 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.526+0000 7f957373b640 10 monclient: build_initial_monmap 2026-02-17T11:11:06.539 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.526+0000 7f957373b640 10 monclient: monmap: 2026-02-17T11:11:06.539 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:11:06.539 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:11:06.539 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:11:06.539 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:11:06.539 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:11:06.539 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:06.540 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:11:06.540 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:11:06.540 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:11:06.540 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:06.540 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.526+0000 7f957373b640 1 librados: starting msgr at 2026-02-17T11:11:06.540 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.526+0000 7f957373b640 1 librados: starting objecter 2026-02-17T11:11:06.540 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.526+0000 7f957373b640 1 Processor -- start 2026-02-17T11:11:06.540 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.526+0000 7f957373b640 1 -- start start 2026-02-17T11:11:06.540 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.526+0000 7f957373b640 1 librados: setting wanted keys 2026-02-17T11:11:06.540 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.526+0000 7f957373b640 1 librados: calling monclient init 2026-02-17T11:11:06.540 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.526+0000 7f957373b640 10 monclient: init 2026-02-17T11:11:06.540 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.526+0000 7f957373b640 10 monclient: _reopen_session rank -1 2026-02-17T11:11:06.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.526+0000 7f957373b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:11:06.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.526+0000 7f957373b640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f956c0c63f0 0x7f956c0bebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:06.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.526+0000 7f957373b640 10 monclient(hunting): picked mon.noname-c con 0x7f956c0c63f0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:11:06.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.526+0000 7f957373b640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f956c152820 0x7f956c0bf120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:06.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.526+0000 7f957373b640 10 monclient(hunting): picked mon.noname-b con 0x7f956c152820 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:11:06.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.527+0000 7f957373b640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f956c152c00 0x7f956c1468a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:06.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.527+0000 7f957373b640 10 monclient(hunting): picked mon.noname-a con 0x7f956c152c00 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:11:06.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.527+0000 7f957373b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:06.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.527+0000 7f957373b640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f956c074cf0 con 0x7f956c152c00 2026-02-17T11:11:06.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.527+0000 7f957373b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:06.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.527+0000 7f957373b640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f956c074a10 con 0x7f956c152820 2026-02-17T11:11:06.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.527+0000 7f957373b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:06.542 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.527+0000 7f957373b640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f956c0738f0 con 0x7f956c0c63f0 2026-02-17T11:11:06.542 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.527+0000 7f957373b640 10 monclient(hunting): _renew_subs 2026-02-17T11:11:06.542 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.527+0000 7f957373b640 10 monclient(hunting): authenticate will time out at 1143.190013s 2026-02-17T11:11:06.542 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.527+0000 7f9571cb1640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f956c152c00 0x7f956c1468a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:06.542 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.527+0000 7f95714b0640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f956c0c63f0 0x7f956c0bebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:06.542 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.527+0000 7f9570caf640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f956c152820 0x7f956c0bf120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:06.542 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.527+0000 7f9571cb1640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f956c152c00 0x7f956c1468a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:58234/0 (socket says 10.20.193.49:58234) 2026-02-17T11:11:06.542 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.527+0000 7f9571cb1640 1 -- 10.20.193.49:0/3166857932 learned_addr learned my addr 10.20.193.49:0/3166857932 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:11:06.542 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.527+0000 7f9571cb1640 10 monclient(hunting): get_auth_request con 0x7f956c152c00 auth_method 0 2026-02-17T11:11:06.542 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.527+0000 7f9571cb1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:06.542 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.527+0000 7f9571cb1640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:06.542 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.527+0000 7f9571cb1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:06.543 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.527+0000 7f95714b0640 10 monclient(hunting): get_auth_request con 0x7f956c0c63f0 auth_method 0 2026-02-17T11:11:06.543 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.527+0000 7f95714b0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:06.543 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.527+0000 7f95714b0640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:06.543 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.527+0000 7f95714b0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:06.543 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.527+0000 7f9570caf640 10 monclient(hunting): get_auth_request con 0x7f956c152820 auth_method 0 2026-02-17T11:11:06.543 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.527+0000 7f9570caf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:06.543 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.527+0000 7f9570caf640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:06.543 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.527+0000 7f9570caf640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:06.543 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.527+0000 7f9571cb1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:06.543 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.527+0000 7f9571cb1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:06.543 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.527+0000 7f9571cb1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:06.543 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.527+0000 7f95714b0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:06.544 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.527+0000 7f95714b0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:06.544 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.527+0000 7f95714b0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:06.544 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.527+0000 7f9570caf640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:06.544 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.527+0000 7f9570caf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:06.544 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.527+0000 7f9570caf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:06.544 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.528+0000 7f9571cb1640 10 monclient(hunting): handle_auth_done global_id 4674 payload 824 2026-02-17T11:11:06.544 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.528+0000 7f9571cb1640 1 -- 10.20.193.49:0/3166857932 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f956c0c63f0 msgr2=0x7f956c0bebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:06.544 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.528+0000 7f9571cb1640 1 --2- 10.20.193.49:0/3166857932 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f956c0c63f0 0x7f956c0bebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:06.544 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.528+0000 7f9571cb1640 1 -- 10.20.193.49:0/3166857932 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f956c152820 msgr2=0x7f956c0bf120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:06.544 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.528+0000 7f9571cb1640 1 --2- 10.20.193.49:0/3166857932 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f956c152820 0x7f956c0bf120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:06.544 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.528+0000 7f9571cb1640 10 monclient: _finish_hunting 0 2026-02-17T11:11:06.544 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.528+0000 7f9571cb1640 1 monclient: found mon.noname-a 2026-02-17T11:11:06.545 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.528+0000 7f9571cb1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:11:06.545 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.528+0000 7f9571cb1640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:11:06.545 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.528+0000 7f9571cb1640 1 -- 10.20.193.49:0/3166857932 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f956c1f6a80 con 0x7f956c152c00 2026-02-17T11:11:06.545 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.530+0000 7f9571cb1640 1 --2- 10.20.193.49:0/3166857932 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f956c152c00 0x7f956c1468a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9568009ec0 tx=0x7f9568004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:11:06.545 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.530+0000 7f9559ffb640 10 client.?.objecter ms_handle_connect 0x7f956c152c00 2026-02-17T11:11:06.545 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.530+0000 7f9559ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T11:11:06.545 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.531+0000 7f9559ffb640 1 -- 10.20.193.49:0/3166857932 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f956803c050 con 0x7f956c152c00 2026-02-17T11:11:06.545 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.531+0000 7f9559ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:06.545 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.531+0000 7f9559ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:11:06.545 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.531+0000 7f9559ffb640 10 monclient: dump: 2026-02-17T11:11:06.545 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:06.545 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:06.546 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:06.546 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:06.546 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:06.546 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:06.546 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:06.546 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:06.546 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:06.546 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:06.546 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.531+0000 7f9559ffb640 10 monclient: _finish_auth 0 2026-02-17T11:11:06.546 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.531+0000 7f9559ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:11:06.546 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.531+0000 7f9559ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:11:06.546 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.531+0000 7f9559ffb640 1 -- 10.20.193.49:0/3166857932 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f956803d040 con 0x7f956c152c00 2026-02-17T11:11:06.547 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.531+0000 7f957373b640 5 monclient: authenticate success, global_id 4674 2026-02-17T11:11:06.547 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.531+0000 7f957373b640 10 monclient: _renew_subs 2026-02-17T11:11:06.547 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.531+0000 7f957373b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:11:06.547 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.531+0000 7f957373b640 1 -- 10.20.193.49:0/3166857932 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f956c1f6d60 con 0x7f956c152c00 2026-02-17T11:11:06.547 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.531+0000 7f9559ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:11:06.547 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.531+0000 7f9559ffb640 1 -- 10.20.193.49:0/3166857932 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9568041610 con 0x7f956c152c00 2026-02-17T11:11:06.547 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.531+0000 7f9559ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:06.547 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.531+0000 7f9559ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:11:06.547 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.531+0000 7f9559ffb640 10 monclient: dump: 2026-02-17T11:11:06.547 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:06.547 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:06.547 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:06.547 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:06.548 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:06.548 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:06.548 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:06.548 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:06.548 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:06.548 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:06.548 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.531+0000 7f955b7fe640 4 set_mon_vals no callback set 2026-02-17T11:11:06.548 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.531+0000 7f957373b640 10 client.4674.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:11:06.548 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.531+0000 7f957373b640 10 monclient: _renew_subs 2026-02-17T11:11:06.548 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.531+0000 7f957373b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:11:06.548 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.531+0000 7f957373b640 1 -- 10.20.193.49:0/3166857932 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f956c1f7320 con 0x7f956c152c00 2026-02-17T11:11:06.548 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.531+0000 7f957373b640 1 librados: init done 2026-02-17T11:11:06.549 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.532+0000 7f957373b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:11:06.549 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.532+0000 7f957373b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:11:06.549 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.532+0000 7f957373b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:11:06.549 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.532+0000 7f957373b640 1 -- 10.20.193.49:0/3166857932 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f956c1593f0 con 0x7f956c152c00 2026-02-17T11:11:06.550 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.543+0000 7f9559ffb640 1 -- 10.20.193.49:0/3166857932 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f95680417b0 con 0x7f956c152c00 2026-02-17T11:11:06.550 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.544+0000 7f9559ffb640 1 --2- 10.20.193.49:0/3166857932 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f953c079190 0x7f953c07b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:06.550 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.544+0000 7f95714b0640 1 --2- 10.20.193.49:0/3166857932 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f953c079190 0x7f953c07b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:06.550 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.544+0000 7f95714b0640 10 monclient: get_auth_request con 0x7f953c079190 auth_method 0 2026-02-17T11:11:06.550 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.545+0000 7f95714b0640 1 --2- 10.20.193.49:0/3166857932 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f953c079190 0x7f953c07b650 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f955c005980 tx=0x7f955c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:11:06.550 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.545+0000 7f9559ffb640 10 client.4674.objecter ms_handle_connect 0x7f953c079190 2026-02-17T11:11:06.648 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.647+0000 7f9559ffb640 1 -- 10.20.193.49:0/3166857932 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f9568084210 con 0x7f956c152c00 2026-02-17T11:11:06.649 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.647+0000 7f9559ffb640 10 client.4674.objecter ms_dispatch2 0x7f956c000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:11:06.649 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.647+0000 7f9559ffb640 3 client.4674.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:11:06.649 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.647+0000 7f9559ffb640 3 client.4674.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:11:06.649 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.647+0000 7f9559ffb640 20 client.4674.objecter dump_active .. 0 homeless 2026-02-17T11:11:06.649 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.647+0000 7f9559ffb640 1 -- 10.20.193.49:0/3166857932 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f95680881d0 con 0x7f956c152c00 2026-02-17T11:11:06.649 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.647+0000 7f9559ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:11:06.649 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.647+0000 7f9559ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:11:06.749 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.748+0000 7f957373b640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:11:06.749 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.748+0000 7f957373b640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:11:06.750 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.748+0000 7f957373b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:11:06.750 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.748+0000 7f957373b640 1 -- 10.20.193.49:0/3166857932 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f956c0c7060 con 0x7f956c152c00 2026-02-17T11:11:06.752 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.751+0000 7f9559ffb640 1 -- 10.20.193.49:0/3166857932 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f956808c4d0 con 0x7f956c152c00 2026-02-17T11:11:06.752 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.751+0000 7f9559ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:11:06.752 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.751+0000 7f9559ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:11:06.753 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:11:06.753 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:11:06.755 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.752+0000 7f957373b640 10 librados: watch_flush enter 2026-02-17T11:11:06.755 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.752+0000 7f957373b640 10 librados: watch_flush exit 2026-02-17T11:11:06.755 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.752+0000 7f957373b640 20 client.4674.objecter shutdown clearing up homeless session... 2026-02-17T11:11:06.755 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.752+0000 7f957373b640 10 client.4674.objecter successfully canceled tick 2026-02-17T11:11:06.755 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.752+0000 7f957373b640 1 -- 10.20.193.49:0/3166857932 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f953c079190 msgr2=0x7f953c07b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:06.755 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.752+0000 7f957373b640 1 --2- 10.20.193.49:0/3166857932 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f953c079190 0x7f953c07b650 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f955c005980 tx=0x7f955c009040 comp rx=0 tx=0).stop 2026-02-17T11:11:06.755 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.752+0000 7f957373b640 10 monclient: shutdown 2026-02-17T11:11:06.755 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.752+0000 7f957373b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:11:06.755 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.752+0000 7f957373b640 1 -- 10.20.193.49:0/3166857932 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f956c152c00 msgr2=0x7f956c1468a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:06.755 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.752+0000 7f957373b640 1 --2- 10.20.193.49:0/3166857932 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f956c152c00 0x7f956c1468a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9568009ec0 tx=0x7f9568004b40 comp rx=0 tx=0).stop 2026-02-17T11:11:06.756 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.752+0000 7f957373b640 1 -- 10.20.193.49:0/3166857932 shutdown_connections 2026-02-17T11:11:06.756 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.752+0000 7f957373b640 1 --2- 10.20.193.49:0/3166857932 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f953c079190 0x7f953c07b650 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:06.756 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.752+0000 7f957373b640 1 --2- 10.20.193.49:0/3166857932 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f956c152c00 0x7f956c1468a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:06.756 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.752+0000 7f957373b640 1 --2- 10.20.193.49:0/3166857932 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f956c152820 0x7f956c0bf120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:06.756 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.752+0000 7f957373b640 1 --2- 10.20.193.49:0/3166857932 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f956c0c63f0 0x7f956c0bebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:06.756 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.752+0000 7f957373b640 1 -- 10.20.193.49:0/3166857932 >> 10.20.193.49:0/3166857932 conn(0x7f956c0c9f40 msgr2=0x7f956c150fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:11:06.756 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.752+0000 7f957373b640 1 -- 10.20.193.49:0/3166857932 shutdown_connections 2026-02-17T11:11:06.756 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.752+0000 7f957373b640 1 -- 10.20.193.49:0/3166857932 wait complete. 2026-02-17T11:11:06.756 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:06.752+0000 7f957373b640 1 librados: shutdown 2026-02-17T11:11:09.763 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:11:09.832 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.830+0000 7f01de63a640 10 monclient: get_monmap_and_config 2026-02-17T11:11:09.832 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.830+0000 7f01de63a640 10 monclient: build_initial_monmap 2026-02-17T11:11:09.832 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.830+0000 7f01de63a640 10 monclient: monmap: 2026-02-17T11:11:09.832 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:11:09.832 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:09.832 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:11:09.831302+0000 2026-02-17T11:11:09.832 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:11:09.831302+0000 2026-02-17T11:11:09.833 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:11:09.833 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:09.833 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:11:09.833 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:11:09.833 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:11:09.833 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:11:09.833 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:11:09.833 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:11:09.833 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:09.836 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.831+0000 7f01de63a640 1 Processor -- start 2026-02-17T11:11:09.836 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.831+0000 7f01de63a640 1 -- start start 2026-02-17T11:11:09.836 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.831+0000 7f01de63a640 10 monclient: init 2026-02-17T11:11:09.836 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.831+0000 7f01de63a640 10 monclient: _reopen_session rank -1 2026-02-17T11:11:09.836 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.831+0000 7f01de63a640 10 monclient: _add_conns ranks=[3,5,0,2,4,1] 2026-02-17T11:11:09.837 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.831+0000 7f01de63a640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f01d80c7170 0x7f01d80c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:09.837 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.831+0000 7f01de63a640 10 monclient(hunting): picked mon.noname-a con 0x7f01d80c7170 addr v2:10.20.193.49:3300/0 2026-02-17T11:11:09.837 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.831+0000 7f01de63a640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f01d80c48c0 0x7f01d80749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:09.837 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.831+0000 7f01de63a640 10 monclient(hunting): picked mon.noname-c con 0x7f01d80c48c0 addr v2:10.20.193.157:3300/0 2026-02-17T11:11:09.837 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.831+0000 7f01de63a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f01d8074ef0 addr v1:10.20.193.49:6789/0 2026-02-17T11:11:09.837 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.831+0000 7f01de63a640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01d815a9a0 con 0x7f01d8074ef0 2026-02-17T11:11:09.837 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.831+0000 7f01de63a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:09.837 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.831+0000 7f01de63a640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f01d80c8530 con 0x7f01d80c7170 2026-02-17T11:11:09.837 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.831+0000 7f01de63a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:09.837 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.831+0000 7f01de63a640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f01d80c5270 con 0x7f01d80c48c0 2026-02-17T11:11:09.837 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.831+0000 7f01de63a640 10 monclient(hunting): _renew_subs 2026-02-17T11:11:09.837 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.831+0000 7f01de63a640 10 monclient(hunting): authenticate will time out at 1146.494777s 2026-02-17T11:11:09.838 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.832+0000 7f01d7fff640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f01d80c7170 0x7f01d80c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:09.838 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.832+0000 7f01d77fe640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f01d80c48c0 0x7f01d80749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:09.838 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.832+0000 7f01d7fff640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f01d80c7170 0x7f01d80c7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:58244/0 (socket says 10.20.193.49:58244) 2026-02-17T11:11:09.838 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.832+0000 7f01d7fff640 1 -- 10.20.193.49:0/514321415 learned_addr learned my addr 10.20.193.49:0/514321415 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:11:09.838 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.832+0000 7f01d7fff640 10 monclient(hunting): get_auth_request con 0x7f01d80c7170 auth_method 0 2026-02-17T11:11:09.838 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.832+0000 7f01d7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:09.838 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.832+0000 7f01d7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:09.838 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.832+0000 7f01d7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:09.838 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.832+0000 7f01d77fe640 10 monclient(hunting): get_auth_request con 0x7f01d80c48c0 auth_method 0 2026-02-17T11:11:09.838 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.832+0000 7f01d77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:09.838 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.832+0000 7f01d77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:09.838 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.832+0000 7f01d77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:09.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.832+0000 7f01d7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:09.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.832+0000 7f01d7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:09.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.832+0000 7f01d7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:09.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.832+0000 7f01d77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:09.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.832+0000 7f01d77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:09.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.832+0000 7f01d77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:09.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.833+0000 7f01d7fff640 10 monclient(hunting): handle_auth_done global_id 4677 payload 274 2026-02-17T11:11:09.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.833+0000 7f01d7fff640 1 -- 10.20.193.49:0/514321415 >> v2:10.20.193.157:3300/0 conn(0x7f01d80c48c0 msgr2=0x7f01d80749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:11:09.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.833+0000 7f01d7fff640 1 --2- 10.20.193.49:0/514321415 >> v2:10.20.193.157:3300/0 conn(0x7f01d80c48c0 0x7f01d80749b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:09.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.833+0000 7f01d7fff640 1 -- 10.20.193.49:0/514321415 >> v1:10.20.193.49:6789/0 conn(0x7f01d8074ef0 legacy=0x7f01d80c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:11:09.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.833+0000 7f01d7fff640 10 monclient: _finish_hunting 0 2026-02-17T11:11:09.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.833+0000 7f01d7fff640 1 monclient: found mon.noname-a 2026-02-17T11:11:09.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.833+0000 7f01d7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:11:09.840 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.833+0000 7f01d7fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:11:09.840 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.833+0000 7f01d7fff640 1 -- 10.20.193.49:0/514321415 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01d80c5550 con 0x7f01d80c7170 2026-02-17T11:11:09.840 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.834+0000 7f01d7fff640 1 --2- 10.20.193.49:0/514321415 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f01d80c7170 0x7f01d80c7550 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f01d80c7a90 tx=0x7f01c402eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f770075fda2c11b2 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:11:09.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.836+0000 7f01d6ffd640 1 -- 10.20.193.49:0/514321415 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c403c070 con 0x7f01d80c7170 2026-02-17T11:11:09.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.836+0000 7f01d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:09.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.836+0000 7f01d6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:11:09.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.836+0000 7f01d6ffd640 10 monclient: dump: 2026-02-17T11:11:09.846 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:09.847 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:09.847 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:09.847 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:09.847 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:09.847 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:09.847 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:09.847 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:09.847 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:09.847 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:09.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.836+0000 7f01d6ffd640 10 monclient: _finish_auth 0 2026-02-17T11:11:09.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.836+0000 7f01d6ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:11:09.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.836+0000 7f01d6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:11:09.848 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.836+0000 7f01de63a640 5 monclient: authenticate success, global_id 4677 2026-02-17T11:11:09.848 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.836+0000 7f01de63a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:11:09.848 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.836+0000 7f01d6ffd640 1 -- 10.20.193.49:0/514321415 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01c402fb40 con 0x7f01d80c7170 2026-02-17T11:11:09.848 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.836+0000 7f01d6ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:11:09.848 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.836+0000 7f01d6ffd640 1 -- 10.20.193.49:0/514321415 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c4037440 con 0x7f01d80c7170 2026-02-17T11:11:09.848 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.836+0000 7f01d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:09.848 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.836+0000 7f01d6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:11:09.848 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.836+0000 7f01d6ffd640 10 monclient: dump: 2026-02-17T11:11:09.848 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:09.848 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:09.848 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:09.848 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:09.849 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:09.849 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:09.849 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:09.849 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:09.849 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:09.849 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:09.849 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.836+0000 7f01de63a640 10 monclient: get_monmap_and_config success 2026-02-17T11:11:09.849 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.836+0000 7f01de63a640 4 set_mon_vals no callback set 2026-02-17T11:11:09.849 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.837+0000 7f01de63a640 10 monclient: shutdown 2026-02-17T11:11:09.849 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.837+0000 7f01de63a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:11:09.849 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.837+0000 7f01de63a640 1 -- 10.20.193.49:0/514321415 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f01d80c7170 msgr2=0x7f01d80c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:09.849 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.837+0000 7f01de63a640 1 --2- 10.20.193.49:0/514321415 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f01d80c7170 0x7f01d80c7550 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f01d80c7a90 tx=0x7f01c402eed0 comp rx=0 tx=0).stop 2026-02-17T11:11:09.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.837+0000 7f01de63a640 1 -- 10.20.193.49:0/514321415 shutdown_connections 2026-02-17T11:11:09.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.837+0000 7f01de63a640 1 --2- 10.20.193.49:0/514321415 >> v2:10.20.193.157:3300/0 conn(0x7f01d80c48c0 0x7f01d80749b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:09.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.837+0000 7f01de63a640 1 --2- 10.20.193.49:0/514321415 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f01d80c7170 0x7f01d80c7550 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:09.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.837+0000 7f01de63a640 1 -- 10.20.193.49:0/514321415 >> 10.20.193.49:0/514321415 conn(0x7f01d80c9f40 msgr2=0x7f01d80ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:11:09.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.837+0000 7f01de63a640 1 -- 10.20.193.49:0/514321415 shutdown_connections 2026-02-17T11:11:09.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.837+0000 7f01de63a640 1 -- 10.20.193.49:0/514321415 wait complete. 2026-02-17T11:11:09.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.837+0000 7f01de63a640 10 monclient: build_initial_monmap 2026-02-17T11:11:09.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.837+0000 7f01de63a640 10 monclient: monmap: 2026-02-17T11:11:09.850 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:11:09.850 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:11:09.850 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:11:09.850 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:11:09.851 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:11:09.851 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:09.851 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:11:09.851 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:11:09.851 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:11:09.851 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:09.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.838+0000 7f01de63a640 1 librados: starting msgr at 2026-02-17T11:11:09.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.838+0000 7f01de63a640 1 librados: starting objecter 2026-02-17T11:11:09.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.838+0000 7f01de63a640 1 Processor -- start 2026-02-17T11:11:09.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.838+0000 7f01de63a640 1 -- start start 2026-02-17T11:11:09.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.838+0000 7f01de63a640 1 librados: setting wanted keys 2026-02-17T11:11:09.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.838+0000 7f01de63a640 1 librados: calling monclient init 2026-02-17T11:11:09.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.838+0000 7f01de63a640 10 monclient: init 2026-02-17T11:11:09.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.838+0000 7f01de63a640 10 monclient: _reopen_session rank -1 2026-02-17T11:11:09.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.838+0000 7f01de63a640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:11:09.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.838+0000 7f01de63a640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f01d8074ef0 0x7f01d80c2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:09.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.838+0000 7f01de63a640 10 monclient(hunting): picked mon.noname-b con 0x7f01d8074ef0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:11:09.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.838+0000 7f01de63a640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f01d80c48c0 0x7f01d80c1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:09.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.838+0000 7f01de63a640 10 monclient(hunting): picked mon.noname-c con 0x7f01d80c48c0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:11:09.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.838+0000 7f01de63a640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f01d80c7170 0x7f01d80c19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:09.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.838+0000 7f01de63a640 10 monclient(hunting): picked mon.noname-a con 0x7f01d80c7170 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:11:09.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.838+0000 7f01de63a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:09.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.838+0000 7f01de63a640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f01d80c81c0 con 0x7f01d80c7170 2026-02-17T11:11:09.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.838+0000 7f01de63a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:09.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.838+0000 7f01de63a640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f01d80c7ee0 con 0x7f01d8074ef0 2026-02-17T11:11:09.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.838+0000 7f01de63a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:09.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.838+0000 7f01de63a640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f01d80c90d0 con 0x7f01d80c48c0 2026-02-17T11:11:09.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.838+0000 7f01de63a640 10 monclient(hunting): _renew_subs 2026-02-17T11:11:09.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.838+0000 7f01de63a640 10 monclient(hunting): authenticate will time out at 1146.501874s 2026-02-17T11:11:09.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.839+0000 7f01dcbb0640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f01d80c7170 0x7f01d80c19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:09.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.839+0000 7f01d77fe640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f01d80c48c0 0x7f01d80c1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:09.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.839+0000 7f01dcbb0640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f01d80c7170 0x7f01d80c19b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:58246/0 (socket says 10.20.193.49:58246) 2026-02-17T11:11:09.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.839+0000 7f01dcbb0640 1 -- 10.20.193.49:0/2108119752 learned_addr learned my addr 10.20.193.49:0/2108119752 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:11:09.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.839+0000 7f01dcbb0640 10 monclient(hunting): get_auth_request con 0x7f01d80c7170 auth_method 0 2026-02-17T11:11:09.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.839+0000 7f01dcbb0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:09.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.839+0000 7f01dcbb0640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:09.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.839+0000 7f01dcbb0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:09.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.839+0000 7f01d7fff640 1 --2- 10.20.193.49:0/2108119752 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f01d8074ef0 0x7f01d80c2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:09.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.839+0000 7f01d77fe640 10 monclient(hunting): get_auth_request con 0x7f01d80c48c0 auth_method 0 2026-02-17T11:11:09.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.839+0000 7f01d77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:09.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.839+0000 7f01d77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:09.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.839+0000 7f01d77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:09.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.839+0000 7f01dcbb0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:09.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.839+0000 7f01dcbb0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:09.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.839+0000 7f01dcbb0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:09.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.839+0000 7f01d7fff640 10 monclient(hunting): get_auth_request con 0x7f01d8074ef0 auth_method 0 2026-02-17T11:11:09.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.839+0000 7f01d7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:09.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.839+0000 7f01d7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:09.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.839+0000 7f01d7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:09.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.839+0000 7f01d77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:09.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.839+0000 7f01d77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:09.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.839+0000 7f01d77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:09.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.840+0000 7f01d7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:09.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.840+0000 7f01d7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:09.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.840+0000 7f01d7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:09.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.840+0000 7f01dcbb0640 10 monclient(hunting): handle_auth_done global_id 4680 payload 824 2026-02-17T11:11:09.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.840+0000 7f01dcbb0640 1 -- 10.20.193.49:0/2108119752 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f01d80c48c0 msgr2=0x7f01d80c1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:09.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.840+0000 7f01dcbb0640 1 --2- 10.20.193.49:0/2108119752 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f01d80c48c0 0x7f01d80c1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:09.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.840+0000 7f01dcbb0640 1 -- 10.20.193.49:0/2108119752 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f01d8074ef0 msgr2=0x7f01d80c2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:09.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.840+0000 7f01dcbb0640 1 --2- 10.20.193.49:0/2108119752 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f01d8074ef0 0x7f01d80c2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:09.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.840+0000 7f01dcbb0640 10 monclient: _finish_hunting 0 2026-02-17T11:11:09.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.840+0000 7f01dcbb0640 1 monclient: found mon.noname-a 2026-02-17T11:11:09.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.840+0000 7f01dcbb0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:11:09.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.840+0000 7f01dcbb0640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:11:09.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.840+0000 7f01dcbb0640 1 -- 10.20.193.49:0/2108119752 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01d815e020 con 0x7f01d80c7170 2026-02-17T11:11:09.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.841+0000 7f01dcbb0640 1 --2- 10.20.193.49:0/2108119752 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f01d80c7170 0x7f01d80c19b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f01cc00b990 tx=0x7f01cc00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:11:09.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.841+0000 7f01d4ff9640 10 client.?.objecter ms_handle_connect 0x7f01d80c7170 2026-02-17T11:11:09.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.841+0000 7f01d4ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T11:11:09.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.843+0000 7f01d4ff9640 1 -- 10.20.193.49:0/2108119752 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01cc006e60 con 0x7f01d80c7170 2026-02-17T11:11:09.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.843+0000 7f01d4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:09.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.843+0000 7f01d4ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:11:09.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.843+0000 7f01d4ff9640 10 monclient: dump: 2026-02-17T11:11:09.856 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:09.856 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:09.856 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:09.857 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:09.857 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:09.857 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:09.857 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:09.857 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:09.857 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:09.857 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:09.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.843+0000 7f01d4ff9640 10 monclient: _finish_auth 0 2026-02-17T11:11:09.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.843+0000 7f01d4ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:11:09.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.843+0000 7f01d4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:11:09.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.843+0000 7f01d4ff9640 1 -- 10.20.193.49:0/2108119752 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01cc010070 con 0x7f01d80c7170 2026-02-17T11:11:09.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.843+0000 7f01d4ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:11:09.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.843+0000 7f01d4ff9640 1 -- 10.20.193.49:0/2108119752 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01cc00c9d0 con 0x7f01d80c7170 2026-02-17T11:11:09.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.843+0000 7f01de63a640 5 monclient: authenticate success, global_id 4680 2026-02-17T11:11:09.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.843+0000 7f01de63a640 10 monclient: _renew_subs 2026-02-17T11:11:09.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.843+0000 7f01d67fc640 4 set_mon_vals no callback set 2026-02-17T11:11:09.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.843+0000 7f01de63a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:11:09.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.843+0000 7f01de63a640 1 -- 10.20.193.49:0/2108119752 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01d815d780 con 0x7f01d80c7170 2026-02-17T11:11:09.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.843+0000 7f01d4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:09.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.843+0000 7f01d4ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:11:09.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.843+0000 7f01d4ff9640 10 monclient: dump: 2026-02-17T11:11:09.858 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:09.858 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:09.858 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:09.858 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:09.859 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:09.859 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:09.859 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:09.859 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:09.859 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:09.859 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:09.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.843+0000 7f01de63a640 10 client.4680.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:11:09.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.843+0000 7f01de63a640 10 monclient: _renew_subs 2026-02-17T11:11:09.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.843+0000 7f01de63a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:11:09.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.843+0000 7f01de63a640 1 -- 10.20.193.49:0/2108119752 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01d815dd40 con 0x7f01d80c7170 2026-02-17T11:11:09.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.843+0000 7f01de63a640 1 librados: init done 2026-02-17T11:11:09.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.844+0000 7f01de63a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:11:09.860 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.844+0000 7f01de63a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:11:09.860 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.844+0000 7f01de63a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:11:09.860 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.844+0000 7f01de63a640 1 -- 10.20.193.49:0/2108119752 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01d80c4d10 con 0x7f01d80c7170 2026-02-17T11:11:09.875 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.874+0000 7f01d4ff9640 1 -- 10.20.193.49:0/2108119752 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f01cc00cb70 con 0x7f01d80c7170 2026-02-17T11:11:09.876 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.874+0000 7f01d4ff9640 1 --2- 10.20.193.49:0/2108119752 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f01a8079190 0x7f01a807b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:09.876 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.875+0000 7f01d7fff640 1 --2- 10.20.193.49:0/2108119752 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f01a8079190 0x7f01a807b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:09.876 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.875+0000 7f01d7fff640 10 monclient: get_auth_request con 0x7f01a8079190 auth_method 0 2026-02-17T11:11:09.877 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.876+0000 7f01d7fff640 1 --2- 10.20.193.49:0/2108119752 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f01a8079190 0x7f01a807b650 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f01d80c6e90 tx=0x7f01c4033000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:11:09.877 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.876+0000 7f01d4ff9640 10 client.4680.objecter ms_handle_connect 0x7f01a8079190 2026-02-17T11:11:09.960 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.959+0000 7f01d4ff9640 1 -- 10.20.193.49:0/2108119752 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f01cc05dc00 con 0x7f01d80c7170 2026-02-17T11:11:09.960 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.959+0000 7f01d4ff9640 10 client.4680.objecter ms_dispatch2 0x7f01d8000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:11:09.960 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.959+0000 7f01d4ff9640 3 client.4680.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:11:09.961 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.959+0000 7f01d4ff9640 3 client.4680.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:11:09.961 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.959+0000 7f01d4ff9640 20 client.4680.objecter dump_active .. 0 homeless 2026-02-17T11:11:09.961 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.959+0000 7f01d4ff9640 1 -- 10.20.193.49:0/2108119752 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f01cc061bc0 con 0x7f01d80c7170 2026-02-17T11:11:09.961 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.959+0000 7f01d4ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:11:09.961 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:09.959+0000 7f01d4ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:11:10.058 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:10.057+0000 7f01de63a640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:11:10.059 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:10.057+0000 7f01de63a640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:11:10.059 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:10.057+0000 7f01de63a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:11:10.059 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:10.057+0000 7f01de63a640 1 -- 10.20.193.49:0/2108119752 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f01d80c9c40 con 0x7f01d80c7170 2026-02-17T11:11:10.060 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:10.059+0000 7f01d4ff9640 1 -- 10.20.193.49:0/2108119752 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f01cc06a030 con 0x7f01d80c7170 2026-02-17T11:11:10.061 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:10.059+0000 7f01d4ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:11:10.061 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:10.059+0000 7f01d4ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:11:10.061 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:11:10.061 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:11:10.063 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:10.060+0000 7f01de63a640 10 librados: watch_flush enter 2026-02-17T11:11:10.063 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:10.060+0000 7f01de63a640 10 librados: watch_flush exit 2026-02-17T11:11:10.063 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:10.060+0000 7f01de63a640 20 client.4680.objecter shutdown clearing up homeless session... 2026-02-17T11:11:10.063 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:10.060+0000 7f01de63a640 10 client.4680.objecter successfully canceled tick 2026-02-17T11:11:10.063 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:10.060+0000 7f01de63a640 1 -- 10.20.193.49:0/2108119752 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f01a8079190 msgr2=0x7f01a807b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:10.063 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:10.060+0000 7f01de63a640 1 --2- 10.20.193.49:0/2108119752 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f01a8079190 0x7f01a807b650 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f01d80c6e90 tx=0x7f01c4033000 comp rx=0 tx=0).stop 2026-02-17T11:11:10.063 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:10.060+0000 7f01de63a640 10 monclient: shutdown 2026-02-17T11:11:10.063 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:10.060+0000 7f01de63a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:11:10.063 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:10.060+0000 7f01de63a640 1 -- 10.20.193.49:0/2108119752 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f01d80c7170 msgr2=0x7f01d80c19b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:10.063 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:10.060+0000 7f01de63a640 1 --2- 10.20.193.49:0/2108119752 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f01d80c7170 0x7f01d80c19b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f01cc00b990 tx=0x7f01cc00be60 comp rx=0 tx=0).stop 2026-02-17T11:11:10.063 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:10.060+0000 7f01de63a640 1 -- 10.20.193.49:0/2108119752 shutdown_connections 2026-02-17T11:11:10.064 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:10.060+0000 7f01de63a640 1 --2- 10.20.193.49:0/2108119752 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f01a8079190 0x7f01a807b650 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:10.064 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:10.060+0000 7f01de63a640 1 --2- 10.20.193.49:0/2108119752 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f01d80c7170 0x7f01d80c19b0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:10.064 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:10.060+0000 7f01de63a640 1 --2- 10.20.193.49:0/2108119752 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f01d80c48c0 0x7f01d80c1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:10.064 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:10.060+0000 7f01de63a640 1 --2- 10.20.193.49:0/2108119752 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f01d8074ef0 0x7f01d80c2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:10.064 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:10.060+0000 7f01de63a640 1 -- 10.20.193.49:0/2108119752 >> 10.20.193.49:0/2108119752 conn(0x7f01d80c9f40 msgr2=0x7f01d8157fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:11:10.064 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:10.060+0000 7f01de63a640 1 -- 10.20.193.49:0/2108119752 shutdown_connections 2026-02-17T11:11:10.064 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:10.060+0000 7f01de63a640 1 -- 10.20.193.49:0/2108119752 wait complete. 2026-02-17T11:11:10.064 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:10.060+0000 7f01de63a640 1 librados: shutdown 2026-02-17T11:11:11.751 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:02:57.233 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:11:11.778 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:02:57.260 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:11:11.786 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:02:57.268 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:11:11.806 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:02:57.282 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:11:11.807 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:02:57.249 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:11:11.807 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:02:57.283 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:11:11.807 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:02:57.250 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:11:11.814 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:02:57.290 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:11:11.815 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:02:57.257 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:11:13.072 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:11:13.139 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.136+0000 7ff8c6dbc640 10 monclient: get_monmap_and_config 2026-02-17T11:11:13.139 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.136+0000 7ff8c6dbc640 10 monclient: build_initial_monmap 2026-02-17T11:11:13.139 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.136+0000 7ff8c6dbc640 10 monclient: monmap: 2026-02-17T11:11:13.139 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:11:13.139 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:13.139 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:11:13.138337+0000 2026-02-17T11:11:13.139 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:11:13.138337+0000 2026-02-17T11:11:13.140 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:11:13.140 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:13.140 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:11:13.140 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:11:13.140 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:11:13.140 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:11:13.140 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:11:13.140 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:11:13.140 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:13.143 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.137+0000 7ff8c6dbc640 1 Processor -- start 2026-02-17T11:11:13.143 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.137+0000 7ff8c6dbc640 1 -- start start 2026-02-17T11:11:13.143 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.137+0000 7ff8c6dbc640 10 monclient: init 2026-02-17T11:11:13.144 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.137+0000 7ff8c6dbc640 10 monclient: _reopen_session rank -1 2026-02-17T11:11:13.144 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.137+0000 7ff8c6dbc640 10 monclient: _add_conns ranks=[4,1,5,0,3,2] 2026-02-17T11:11:13.144 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.137+0000 7ff8c6dbc640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7ff8c015d370 0x7ff8c015d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:13.144 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.137+0000 7ff8c6dbc640 10 monclient(hunting): picked mon.noname-b con 0x7ff8c015d370 addr v2:10.20.193.97:3300/0 2026-02-17T11:11:13.144 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.137+0000 7ff8c6dbc640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7ff8c00c7e20 addr v1:10.20.193.97:6789/0 2026-02-17T11:11:13.144 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.137+0000 7ff8c6dbc640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7ff8c00c74c0 0x7ff8c00c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:13.144 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.137+0000 7ff8c6dbc640 10 monclient(hunting): picked mon.noname-c con 0x7ff8c00c74c0 addr v2:10.20.193.157:3300/0 2026-02-17T11:11:13.144 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.137+0000 7ff8c6dbc640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8c00c8350 con 0x7ff8c00c7e20 2026-02-17T11:11:13.144 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.137+0000 7ff8c6dbc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:13.144 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.137+0000 7ff8c6dbc640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7ff8c015b710 con 0x7ff8c015d370 2026-02-17T11:11:13.144 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.137+0000 7ff8c6dbc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:13.144 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.137+0000 7ff8c6dbc640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7ff8c00c9240 con 0x7ff8c00c74c0 2026-02-17T11:11:13.145 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.137+0000 7ff8c6dbc640 10 monclient(hunting): _renew_subs 2026-02-17T11:11:13.145 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.137+0000 7ff8c6dbc640 10 monclient(hunting): authenticate will time out at 1149.801889s 2026-02-17T11:11:13.145 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.138+0000 7ff8c4b31640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7ff8c015d370 0x7ff8c015d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:13.145 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.138+0000 7ff8c5332640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7ff8c00c74c0 0x7ff8c00c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:13.145 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.138+0000 7ff8c4b31640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7ff8c015d370 0x7ff8c015d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:56668/0 (socket says 10.20.193.49:56668) 2026-02-17T11:11:13.145 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.138+0000 7ff8c4b31640 1 -- 10.20.193.49:0/3791460451 learned_addr learned my addr 10.20.193.49:0/3791460451 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:11:13.145 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.138+0000 7ff8c4b31640 10 monclient(hunting): get_auth_request con 0x7ff8c015d370 auth_method 0 2026-02-17T11:11:13.145 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.138+0000 7ff8c4b31640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:13.145 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.138+0000 7ff8c4b31640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:13.145 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.138+0000 7ff8c4b31640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:13.145 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.138+0000 7ff8c5332640 10 monclient(hunting): get_auth_request con 0x7ff8c00c74c0 auth_method 0 2026-02-17T11:11:13.145 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.138+0000 7ff8c5332640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:13.146 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.138+0000 7ff8c5332640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:13.146 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.138+0000 7ff8c5332640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:13.146 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.138+0000 7ff8c4b31640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:13.146 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.138+0000 7ff8c4b31640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:13.146 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.138+0000 7ff8c4b31640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:13.146 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.138+0000 7ff8c5332640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:13.146 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.138+0000 7ff8c5332640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:13.146 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.138+0000 7ff8c5332640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:13.146 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.139+0000 7ff8c5332640 10 monclient(hunting): handle_auth_done global_id 4688 payload 274 2026-02-17T11:11:13.146 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.139+0000 7ff8c5332640 1 -- 10.20.193.49:0/3791460451 >> v2:10.20.193.97:3300/0 conn(0x7ff8c015d370 msgr2=0x7ff8c015d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:11:13.146 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.139+0000 7ff8c5332640 1 --2- 10.20.193.49:0/3791460451 >> v2:10.20.193.97:3300/0 conn(0x7ff8c015d370 0x7ff8c015d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:13.146 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.139+0000 7ff8c5332640 1 -- 10.20.193.49:0/3791460451 >> v1:10.20.193.97:6789/0 conn(0x7ff8c00c7e20 legacy=0x7ff8c015b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:11:13.146 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.139+0000 7ff8c5332640 10 monclient: _finish_hunting 0 2026-02-17T11:11:13.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.139+0000 7ff8c5332640 1 monclient: found mon.noname-c 2026-02-17T11:11:13.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.139+0000 7ff8c5332640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:11:13.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.139+0000 7ff8c5332640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:11:13.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.139+0000 7ff8c5332640 1 -- 10.20.193.49:0/3791460451 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8c00c8630 con 0x7ff8c00c74c0 2026-02-17T11:11:13.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.141+0000 7ff8c5332640 1 --2- 10.20.193.49:0/3791460451 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff8c00c74c0 0x7ff8c00c52b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff8c015dcf0 tx=0x7ff8bc02f1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59ff68e1b6815a3e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:11:13.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.141+0000 7ff8b77fe640 1 -- 10.20.193.49:0/3791460451 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc03c070 con 0x7ff8c00c74c0 2026-02-17T11:11:13.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.141+0000 7ff8b77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:13.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.141+0000 7ff8b77fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:11:13.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.141+0000 7ff8b77fe640 10 monclient: dump: 2026-02-17T11:11:13.153 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:13.153 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:13.153 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:13.154 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:13.154 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:13.154 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:13.154 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:13.154 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:13.154 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:13.154 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:13.154 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.142+0000 7ff8b77fe640 10 monclient: _finish_auth 0 2026-02-17T11:11:13.154 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.142+0000 7ff8b77fe640 10 monclient: _check_auth_tickets 2026-02-17T11:11:13.154 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.142+0000 7ff8b77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:11:13.154 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.142+0000 7ff8c6dbc640 5 monclient: authenticate success, global_id 4688 2026-02-17T11:11:13.154 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.142+0000 7ff8c6dbc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:11:13.155 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.142+0000 7ff8b77fe640 1 -- 10.20.193.49:0/3791460451 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8bc02fe30 con 0x7ff8c00c74c0 2026-02-17T11:11:13.155 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.142+0000 7ff8b77fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:11:13.155 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.142+0000 7ff8b77fe640 1 -- 10.20.193.49:0/3791460451 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc037640 con 0x7ff8c00c74c0 2026-02-17T11:11:13.155 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.142+0000 7ff8b77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:13.155 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.142+0000 7ff8b77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:11:13.155 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.142+0000 7ff8b77fe640 10 monclient: dump: 2026-02-17T11:11:13.155 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:13.155 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:13.155 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:13.155 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:13.155 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:13.155 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:13.156 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:13.156 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:13.156 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:13.156 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:13.156 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.142+0000 7ff8c6dbc640 10 monclient: get_monmap_and_config success 2026-02-17T11:11:13.156 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.142+0000 7ff8c6dbc640 4 set_mon_vals no callback set 2026-02-17T11:11:13.156 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.143+0000 7ff8c6dbc640 10 monclient: shutdown 2026-02-17T11:11:13.156 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.143+0000 7ff8c6dbc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:11:13.156 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.143+0000 7ff8c6dbc640 1 -- 10.20.193.49:0/3791460451 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff8c00c74c0 msgr2=0x7ff8c00c52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:13.156 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.143+0000 7ff8c6dbc640 1 --2- 10.20.193.49:0/3791460451 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff8c00c74c0 0x7ff8c00c52b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff8c015dcf0 tx=0x7ff8bc02f1c0 comp rx=0 tx=0).stop 2026-02-17T11:11:13.156 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.143+0000 7ff8c6dbc640 1 -- 10.20.193.49:0/3791460451 shutdown_connections 2026-02-17T11:11:13.156 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.143+0000 7ff8c6dbc640 1 --2- 10.20.193.49:0/3791460451 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff8c00c74c0 0x7ff8c00c52b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:13.156 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.143+0000 7ff8c6dbc640 1 --2- 10.20.193.49:0/3791460451 >> v2:10.20.193.97:3300/0 conn(0x7ff8c015d370 0x7ff8c015d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:13.157 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.143+0000 7ff8c6dbc640 1 -- 10.20.193.49:0/3791460451 >> 10.20.193.49:0/3791460451 conn(0x7ff8c00c9f20 msgr2=0x7ff8c00ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:11:13.157 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.143+0000 7ff8c6dbc640 1 -- 10.20.193.49:0/3791460451 shutdown_connections 2026-02-17T11:11:13.157 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.143+0000 7ff8c6dbc640 1 -- 10.20.193.49:0/3791460451 wait complete. 2026-02-17T11:11:13.157 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.143+0000 7ff8c6dbc640 10 monclient: build_initial_monmap 2026-02-17T11:11:13.157 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.143+0000 7ff8c6dbc640 10 monclient: monmap: 2026-02-17T11:11:13.157 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:11:13.157 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:11:13.157 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:11:13.157 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:11:13.157 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:11:13.157 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:13.157 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:11:13.158 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:11:13.158 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:11:13.158 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:13.158 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.143+0000 7ff8c6dbc640 1 librados: starting msgr at 2026-02-17T11:11:13.158 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.143+0000 7ff8c6dbc640 1 librados: starting objecter 2026-02-17T11:11:13.158 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.143+0000 7ff8c6dbc640 1 Processor -- start 2026-02-17T11:11:13.158 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.143+0000 7ff8c6dbc640 1 -- start start 2026-02-17T11:11:13.158 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.143+0000 7ff8c6dbc640 1 librados: setting wanted keys 2026-02-17T11:11:13.158 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.143+0000 7ff8c6dbc640 1 librados: calling monclient init 2026-02-17T11:11:13.158 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.143+0000 7ff8c6dbc640 10 monclient: init 2026-02-17T11:11:13.158 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.144+0000 7ff8c6dbc640 10 monclient: _reopen_session rank -1 2026-02-17T11:11:13.158 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.144+0000 7ff8c6dbc640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:11:13.158 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.144+0000 7ff8c6dbc640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ff8c00c74c0 0x7ff8c01f3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:13.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.144+0000 7ff8c6dbc640 10 monclient(hunting): picked mon.noname-a con 0x7ff8c00c74c0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:11:13.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.144+0000 7ff8c6dbc640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff8c00c7e20 0x7ff8c01f77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:13.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.144+0000 7ff8c6dbc640 10 monclient(hunting): picked mon.noname-c con 0x7ff8c00c7e20 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:11:13.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.144+0000 7ff8c6dbc640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7ff8c015d370 0x7ff8c00726d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:13.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.144+0000 7ff8c6dbc640 10 monclient(hunting): picked mon.noname-b con 0x7ff8c015d370 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:11:13.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.144+0000 7ff8c6dbc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:13.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.144+0000 7ff8c6dbc640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c00c8ed0 con 0x7ff8c00c74c0 2026-02-17T11:11:13.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.144+0000 7ff8c6dbc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:13.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.144+0000 7ff8c6dbc640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c00c8bf0 con 0x7ff8c015d370 2026-02-17T11:11:13.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.144+0000 7ff8c6dbc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:13.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.144+0000 7ff8c6dbc640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c00c96d0 con 0x7ff8c00c7e20 2026-02-17T11:11:13.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.144+0000 7ff8c6dbc640 10 monclient(hunting): _renew_subs 2026-02-17T11:11:13.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.144+0000 7ff8c6dbc640 10 monclient(hunting): authenticate will time out at 1149.808183s 2026-02-17T11:11:13.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.144+0000 7ff8b7fff640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff8c00c7e20 0x7ff8c01f77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:13.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.144+0000 7ff8c4b31640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ff8c00c74c0 0x7ff8c01f3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:13.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.144+0000 7ff8c5332640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7ff8c015d370 0x7ff8c00726d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:13.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.144+0000 7ff8b7fff640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff8c00c7e20 0x7ff8c01f77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:45982/0 (socket says 10.20.193.49:45982) 2026-02-17T11:11:13.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.144+0000 7ff8b7fff640 1 -- 10.20.193.49:0/2674172540 learned_addr learned my addr 10.20.193.49:0/2674172540 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:11:13.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.144+0000 7ff8b7fff640 10 monclient(hunting): get_auth_request con 0x7ff8c00c7e20 auth_method 0 2026-02-17T11:11:13.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.144+0000 7ff8b7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:13.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.144+0000 7ff8b7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:13.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.144+0000 7ff8b7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:13.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.144+0000 7ff8c4b31640 10 monclient(hunting): get_auth_request con 0x7ff8c00c74c0 auth_method 0 2026-02-17T11:11:13.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.144+0000 7ff8c4b31640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:13.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.144+0000 7ff8c4b31640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:13.161 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.144+0000 7ff8c4b31640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:13.161 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.144+0000 7ff8c5332640 10 monclient(hunting): get_auth_request con 0x7ff8c015d370 auth_method 0 2026-02-17T11:11:13.161 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.144+0000 7ff8c5332640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:13.161 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.144+0000 7ff8c5332640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:13.161 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.144+0000 7ff8c5332640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:13.161 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.144+0000 7ff8b7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:13.161 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.144+0000 7ff8b7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:13.161 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.144+0000 7ff8b7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:13.161 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.145+0000 7ff8c4b31640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:13.161 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.145+0000 7ff8c4b31640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:13.161 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.145+0000 7ff8c4b31640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:13.161 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.145+0000 7ff8c5332640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:13.161 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.145+0000 7ff8c5332640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:13.162 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.145+0000 7ff8c5332640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:13.162 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.146+0000 7ff8b7fff640 10 monclient(hunting): handle_auth_done global_id 4691 payload 824 2026-02-17T11:11:13.162 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.146+0000 7ff8b7fff640 1 -- 10.20.193.49:0/2674172540 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7ff8c015d370 msgr2=0x7ff8c00726d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:13.162 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.146+0000 7ff8b7fff640 1 --2- 10.20.193.49:0/2674172540 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7ff8c015d370 0x7ff8c00726d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:13.162 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.146+0000 7ff8b7fff640 1 -- 10.20.193.49:0/2674172540 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ff8c00c74c0 msgr2=0x7ff8c01f3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:13.162 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.146+0000 7ff8b7fff640 1 --2- 10.20.193.49:0/2674172540 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ff8c00c74c0 0x7ff8c01f3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:13.162 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.146+0000 7ff8b7fff640 10 monclient: _finish_hunting 0 2026-02-17T11:11:13.162 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.146+0000 7ff8b7fff640 1 monclient: found mon.noname-c 2026-02-17T11:11:13.162 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.146+0000 7ff8b7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:11:13.162 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.146+0000 7ff8b7fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:11:13.162 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.146+0000 7ff8b7fff640 1 -- 10.20.193.49:0/2674172540 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8c015a7e0 con 0x7ff8c00c7e20 2026-02-17T11:11:13.162 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.147+0000 7ff8b7fff640 1 --2- 10.20.193.49:0/2674172540 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff8c00c7e20 0x7ff8c01f77c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff8a800b570 tx=0x7ff8a800ba40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:11:13.163 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.147+0000 7ff8b57fa640 10 client.?.objecter ms_handle_connect 0x7ff8c00c7e20 2026-02-17T11:11:13.163 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.147+0000 7ff8b57fa640 10 client.?.objecter resend_mon_ops 2026-02-17T11:11:13.163 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.149+0000 7ff8b57fa640 1 -- 10.20.193.49:0/2674172540 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a8013020 con 0x7ff8c00c7e20 2026-02-17T11:11:13.163 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.149+0000 7ff8b57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:13.163 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.149+0000 7ff8b57fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:11:13.163 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.149+0000 7ff8b57fa640 10 monclient: dump: 2026-02-17T11:11:13.163 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:13.163 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:13.163 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:13.163 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:13.163 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:13.163 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:13.163 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:13.164 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:13.164 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:13.164 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:13.164 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.149+0000 7ff8b57fa640 10 monclient: _finish_auth 0 2026-02-17T11:11:13.164 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.149+0000 7ff8b57fa640 10 monclient: _check_auth_tickets 2026-02-17T11:11:13.164 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.149+0000 7ff8b57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:11:13.164 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.149+0000 7ff8b57fa640 1 -- 10.20.193.49:0/2674172540 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8a80044a0 con 0x7ff8c00c7e20 2026-02-17T11:11:13.164 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.149+0000 7ff8b57fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:11:13.164 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.149+0000 7ff8b57fa640 1 -- 10.20.193.49:0/2674172540 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a80029c0 con 0x7ff8c00c7e20 2026-02-17T11:11:13.164 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.149+0000 7ff8b57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:13.164 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.149+0000 7ff8b57fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:11:13.164 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.149+0000 7ff8b57fa640 10 monclient: dump: 2026-02-17T11:11:13.165 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:13.165 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:13.165 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:13.165 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:13.165 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:13.165 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:13.165 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:13.165 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:13.165 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:13.165 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:13.165 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.149+0000 7ff8b6ffd640 4 set_mon_vals no callback set 2026-02-17T11:11:13.165 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.149+0000 7ff8c6dbc640 5 monclient: authenticate success, global_id 4691 2026-02-17T11:11:13.165 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.149+0000 7ff8c6dbc640 10 monclient: _renew_subs 2026-02-17T11:11:13.166 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.149+0000 7ff8c6dbc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:11:13.166 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.149+0000 7ff8c6dbc640 1 -- 10.20.193.49:0/2674172540 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8c01f3f30 con 0x7ff8c00c7e20 2026-02-17T11:11:13.166 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.149+0000 7ff8c6dbc640 10 client.4691.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:11:13.166 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.149+0000 7ff8c6dbc640 10 monclient: _renew_subs 2026-02-17T11:11:13.166 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.149+0000 7ff8c6dbc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:11:13.166 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.149+0000 7ff8c6dbc640 1 -- 10.20.193.49:0/2674172540 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8c01f44f0 con 0x7ff8c00c7e20 2026-02-17T11:11:13.166 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.149+0000 7ff8c6dbc640 1 librados: init done 2026-02-17T11:11:13.166 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.149+0000 7ff8c6dbc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:11:13.166 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.149+0000 7ff8c6dbc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:11:13.166 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.149+0000 7ff8c6dbc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:11:13.166 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.149+0000 7ff8c6dbc640 1 -- 10.20.193.49:0/2674172540 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8c00ca8a0 con 0x7ff8c00c7e20 2026-02-17T11:11:13.199 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.197+0000 7ff8b57fa640 1 -- 10.20.193.49:0/2674172540 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7ff8a8002b60 con 0x7ff8c00c7e20 2026-02-17T11:11:13.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.198+0000 7ff8b57fa640 1 --2- 10.20.193.49:0/2674172540 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ff890079190 0x7ff89007b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:13.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.198+0000 7ff8c4b31640 1 --2- 10.20.193.49:0/2674172540 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ff890079190 0x7ff89007b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:13.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.198+0000 7ff8c4b31640 10 monclient: get_auth_request con 0x7ff890079190 auth_method 0 2026-02-17T11:11:13.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.198+0000 7ff8c4b31640 1 -- 10.20.193.49:0/2674172540 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ff890079190 msgr2=0x7ff89007b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T11:11:13.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.198+0000 7ff8c4b31640 1 -- 10.20.193.49:0/2674172540 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ff890079190 msgr2=0x7ff89007b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:11:13.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.198+0000 7ff8c4b31640 1 --2- 10.20.193.49:0/2674172540 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ff890079190 0x7ff89007b650 secure :-1 s=COMPRESSION_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0x7ff8c0074d30 tx=0x7ff8b0009340 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:11:13.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.198+0000 7ff8c4b31640 1 --2- 10.20.193.49:0/2674172540 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ff890079190 0x7ff89007b650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:11:13.262 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.260+0000 7ff8b57fa640 1 -- 10.20.193.49:0/2674172540 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7ff8a805e200 con 0x7ff8c00c7e20 2026-02-17T11:11:13.263 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.260+0000 7ff8b57fa640 10 client.4691.objecter ms_dispatch2 0x7ff8c0000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:11:13.263 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.260+0000 7ff8b57fa640 3 client.4691.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:11:13.263 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.260+0000 7ff8b57fa640 3 client.4691.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:11:13.263 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.260+0000 7ff8b57fa640 20 client.4691.objecter dump_active .. 0 homeless 2026-02-17T11:11:13.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.266+0000 7ff8b57fa640 1 -- 10.20.193.49:0/2674172540 <== mon.2 v2:10.20.193.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ff8c00ca8a0 con 0x7ff8c00c7e20 2026-02-17T11:11:13.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.266+0000 7ff8b57fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:11:13.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.266+0000 7ff8b57fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:11:13.367 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.365+0000 7ff8c6dbc640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:11:13.367 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.365+0000 7ff8c6dbc640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:11:13.368 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.365+0000 7ff8c6dbc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:11:13.368 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.365+0000 7ff8c6dbc640 1 -- 10.20.193.49:0/2674172540 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff8c015d750 con 0x7ff8c00c7e20 2026-02-17T11:11:13.371 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.368+0000 7ff8b57fa640 1 -- 10.20.193.49:0/2674172540 <== mon.2 v2:10.20.193.157:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7ff8a801d020 con 0x7ff8c00c7e20 2026-02-17T11:11:13.371 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.368+0000 7ff8b57fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:11:13.371 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.368+0000 7ff8b57fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:11:13.371 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:11:13.371 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:11:13.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.369+0000 7ff8c6dbc640 10 librados: watch_flush enter 2026-02-17T11:11:13.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.369+0000 7ff8c6dbc640 10 librados: watch_flush exit 2026-02-17T11:11:13.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.369+0000 7ff8c6dbc640 20 client.4691.objecter shutdown clearing up homeless session... 2026-02-17T11:11:13.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.369+0000 7ff8c6dbc640 10 client.4691.objecter successfully canceled tick 2026-02-17T11:11:13.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.369+0000 7ff8c6dbc640 1 -- 10.20.193.49:0/2674172540 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ff890079190 msgr2=0x7ff89007b650 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:11:13.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.369+0000 7ff8c6dbc640 1 --2- 10.20.193.49:0/2674172540 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ff890079190 0x7ff89007b650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:13.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.369+0000 7ff8c6dbc640 10 monclient: shutdown 2026-02-17T11:11:13.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.369+0000 7ff8c6dbc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:11:13.374 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.369+0000 7ff8c6dbc640 1 -- 10.20.193.49:0/2674172540 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff8c00c7e20 msgr2=0x7ff8c01f77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:13.374 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.369+0000 7ff8c6dbc640 1 --2- 10.20.193.49:0/2674172540 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff8c00c7e20 0x7ff8c01f77c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff8a800b570 tx=0x7ff8a800ba40 comp rx=0 tx=0).stop 2026-02-17T11:11:13.374 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.369+0000 7ff8c6dbc640 1 -- 10.20.193.49:0/2674172540 shutdown_connections 2026-02-17T11:11:13.374 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.369+0000 7ff8c6dbc640 1 --2- 10.20.193.49:0/2674172540 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ff890079190 0x7ff89007b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:13.374 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.369+0000 7ff8c6dbc640 1 --2- 10.20.193.49:0/2674172540 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7ff8c015d370 0x7ff8c00726d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:13.374 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.369+0000 7ff8c6dbc640 1 --2- 10.20.193.49:0/2674172540 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff8c00c7e20 0x7ff8c01f77c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:13.374 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.369+0000 7ff8c6dbc640 1 --2- 10.20.193.49:0/2674172540 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ff8c00c74c0 0x7ff8c01f3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:13.374 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.369+0000 7ff8c6dbc640 1 -- 10.20.193.49:0/2674172540 >> 10.20.193.49:0/2674172540 conn(0x7ff8c00c9f20 msgr2=0x7ff8c015c910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:11:13.374 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.369+0000 7ff8c6dbc640 1 -- 10.20.193.49:0/2674172540 shutdown_connections 2026-02-17T11:11:13.374 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.369+0000 7ff8c6dbc640 1 -- 10.20.193.49:0/2674172540 wait complete. 2026-02-17T11:11:13.374 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:13.370+0000 7ff8c6dbc640 1 librados: shutdown 2026-02-17T11:11:16.381 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:11:16.450 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.447+0000 7f01910e8640 10 monclient: get_monmap_and_config 2026-02-17T11:11:16.451 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.447+0000 7f01910e8640 10 monclient: build_initial_monmap 2026-02-17T11:11:16.451 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.447+0000 7f01910e8640 10 monclient: monmap: 2026-02-17T11:11:16.451 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:11:16.451 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:16.451 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:11:16.449305+0000 2026-02-17T11:11:16.451 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:11:16.449305+0000 2026-02-17T11:11:16.451 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:11:16.451 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:16.451 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:11:16.451 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:11:16.452 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:11:16.452 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:11:16.452 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:11:16.452 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:11:16.452 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:16.452 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.448+0000 7f01910e8640 1 Processor -- start 2026-02-17T11:11:16.452 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.448+0000 7f01910e8640 1 -- start start 2026-02-17T11:11:16.452 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.448+0000 7f01910e8640 10 monclient: init 2026-02-17T11:11:16.455 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.448+0000 7f01910e8640 10 monclient: _reopen_session rank -1 2026-02-17T11:11:16.455 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.448+0000 7f01910e8640 10 monclient: _add_conns ranks=[1,4,0,2,3,5] 2026-02-17T11:11:16.455 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.448+0000 7f01910e8640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f018c0c7170 addr v1:10.20.193.97:6789/0 2026-02-17T11:11:16.455 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.448+0000 7f01910e8640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f018c0c7550 0x7f018c0749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:16.455 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.448+0000 7f01910e8640 10 monclient(hunting): picked mon.noname-b con 0x7f018c0c7550 addr v2:10.20.193.97:3300/0 2026-02-17T11:11:16.455 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.448+0000 7f01910e8640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f018c074ef0 addr v1:10.20.193.49:6789/0 2026-02-17T11:11:16.455 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.448+0000 7f01910e8640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f018c0c4fd0 con 0x7f018c074ef0 2026-02-17T11:11:16.455 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.448+0000 7f01910e8640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f018c15a9a0 con 0x7f018c0c7170 2026-02-17T11:11:16.455 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.448+0000 7f01910e8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:16.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.448+0000 7f01910e8640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f018c0c8530 con 0x7f018c0c7550 2026-02-17T11:11:16.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.448+0000 7f01910e8640 10 monclient(hunting): _renew_subs 2026-02-17T11:11:16.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.448+0000 7f01910e8640 10 monclient(hunting): authenticate will time out at 1153.112766s 2026-02-17T11:11:16.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.449+0000 7f018b577640 1 --1- >> v1:10.20.193.49:6789/0 conn(0x7f018c074ef0 0x7f018c0c89c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.49:6789/0 says I am v1:10.20.193.49:34556/0 (socket says 10.20.193.49:34556) 2026-02-17T11:11:16.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.449+0000 7f018b577640 1 -- 10.20.193.49:0/3779791563 learned_addr learned my addr 10.20.193.49:0/3779791563 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:11:16.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.449+0000 7f018a575640 1 --2- 10.20.193.49:0/3779791563 >> v2:10.20.193.97:3300/0 conn(0x7f018c0c7550 0x7f018c0749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:16.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.449+0000 7f018a575640 10 monclient(hunting): get_auth_request con 0x7f018c0c7550 auth_method 0 2026-02-17T11:11:16.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.449+0000 7f018a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:16.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.449+0000 7f018a575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:16.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.449+0000 7f018a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:16.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.449+0000 7f018a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:16.457 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.449+0000 7f018a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:16.457 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.449+0000 7f018a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:16.457 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.450+0000 7f0189d74640 1 -- 10.20.193.49:0/3779791563 <== mon.0 v1:10.20.193.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3180802431 0 0) 0x7f018c0c4fd0 con 0x7f018c074ef0 2026-02-17T11:11:16.457 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.450+0000 7f0189d74640 10 monclient(hunting): _negotiate 2026-02-17T11:11:16.457 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.450+0000 7f0189d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:16.457 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.450+0000 7f0189d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:16.457 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.450+0000 7f0189d74640 10 monclient(hunting): my global_id is 4686 2026-02-17T11:11:16.457 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.450+0000 7f0189d74640 1 -- 10.20.193.49:0/3779791563 --> v1:10.20.193.49:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0178003620 con 0x7f018c074ef0 2026-02-17T11:11:16.457 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.450+0000 7f018a575640 10 monclient(hunting): handle_auth_done global_id 4663 payload 274 2026-02-17T11:11:16.457 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.450+0000 7f018a575640 1 -- 10.20.193.49:0/3779791563 >> v1:10.20.193.97:6789/0 conn(0x7f018c0c7170 legacy=0x7f018c0c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:11:16.457 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.450+0000 7f018a575640 1 -- 10.20.193.49:0/3779791563 >> v1:10.20.193.49:6789/0 conn(0x7f018c074ef0 legacy=0x7f018c0c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:16.457 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.450+0000 7f018a575640 10 monclient: _finish_hunting 0 2026-02-17T11:11:16.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.450+0000 7f018a575640 1 monclient: found mon.noname-b 2026-02-17T11:11:16.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.450+0000 7f018a575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:11:16.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.450+0000 7f018a575640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:11:16.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.450+0000 7f018a575640 1 -- 10.20.193.49:0/3779791563 --> v2:10.20.193.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f018c0c5270 con 0x7f018c0c7550 2026-02-17T11:11:16.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.452+0000 7f018a575640 1 --2- 10.20.193.49:0/3779791563 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f018c0c7550 0x7f018c0749b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f01740098a0 tx=0x7f017402ee10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56fd5d79cc13d318 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:11:16.464 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.454+0000 7f0189d74640 1 -- 10.20.193.49:0/3779791563 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f017403c070 con 0x7f018c0c7550 2026-02-17T11:11:16.464 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.454+0000 7f0189d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:16.464 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.454+0000 7f0189d74640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:11:16.465 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.454+0000 7f0189d74640 10 monclient: dump: 2026-02-17T11:11:16.465 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:16.465 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:16.465 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:16.465 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:16.465 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:16.465 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:16.465 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:16.465 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:16.465 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:16.465 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:16.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.454+0000 7f0189d74640 10 monclient: _finish_auth 0 2026-02-17T11:11:16.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.454+0000 7f0189d74640 10 monclient: _check_auth_tickets 2026-02-17T11:11:16.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.454+0000 7f0189d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:11:16.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.454+0000 7f0189d74640 1 -- 10.20.193.49:0/3779791563 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f017402fad0 con 0x7f018c0c7550 2026-02-17T11:11:16.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.454+0000 7f0189d74640 10 monclient: handle_config config(0 keys) 2026-02-17T11:11:16.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.454+0000 7f0189d74640 1 -- 10.20.193.49:0/3779791563 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0174037440 con 0x7f018c0c7550 2026-02-17T11:11:16.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.454+0000 7f01910e8640 5 monclient: authenticate success, global_id 4663 2026-02-17T11:11:16.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.454+0000 7f01910e8640 10 monclient: get_monmap_and_config success 2026-02-17T11:11:16.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.454+0000 7f01910e8640 4 set_mon_vals no callback set 2026-02-17T11:11:16.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.454+0000 7f0189d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:16.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.454+0000 7f0189d74640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:11:16.467 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.454+0000 7f0189d74640 10 monclient: dump: 2026-02-17T11:11:16.467 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:16.467 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:16.467 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:16.467 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:16.467 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:16.467 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:16.467 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:16.467 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:16.467 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:16.467 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:16.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.454+0000 7f01910e8640 10 monclient: shutdown 2026-02-17T11:11:16.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.454+0000 7f01910e8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:11:16.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.454+0000 7f01910e8640 1 -- 10.20.193.49:0/3779791563 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f018c0c7550 msgr2=0x7f018c0749b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:16.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.454+0000 7f01910e8640 1 --2- 10.20.193.49:0/3779791563 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f018c0c7550 0x7f018c0749b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f01740098a0 tx=0x7f017402ee10 comp rx=0 tx=0).stop 2026-02-17T11:11:16.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.454+0000 7f01910e8640 1 -- 10.20.193.49:0/3779791563 shutdown_connections 2026-02-17T11:11:16.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.454+0000 7f01910e8640 1 --2- 10.20.193.49:0/3779791563 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f018c0c7550 0x7f018c0749b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:16.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.454+0000 7f01910e8640 1 -- 10.20.193.49:0/3779791563 >> 10.20.193.49:0/3779791563 conn(0x7f018c0c9f40 msgr2=0x7f018c0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:11:16.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.454+0000 7f01910e8640 1 -- 10.20.193.49:0/3779791563 shutdown_connections 2026-02-17T11:11:16.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.454+0000 7f01910e8640 1 -- 10.20.193.49:0/3779791563 wait complete. 2026-02-17T11:11:16.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.454+0000 7f01910e8640 10 monclient: build_initial_monmap 2026-02-17T11:11:16.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.454+0000 7f01910e8640 10 monclient: monmap: 2026-02-17T11:11:16.468 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:11:16.469 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:11:16.469 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:11:16.469 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:11:16.469 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:11:16.469 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:16.469 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:11:16.469 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:11:16.469 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:11:16.469 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:16.469 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.455+0000 7f01910e8640 1 librados: starting msgr at 2026-02-17T11:11:16.469 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.455+0000 7f01910e8640 1 librados: starting objecter 2026-02-17T11:11:16.469 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.455+0000 7f01910e8640 1 Processor -- start 2026-02-17T11:11:16.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.455+0000 7f01910e8640 1 -- start start 2026-02-17T11:11:16.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.455+0000 7f01910e8640 1 librados: setting wanted keys 2026-02-17T11:11:16.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.455+0000 7f01910e8640 1 librados: calling monclient init 2026-02-17T11:11:16.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.455+0000 7f01910e8640 10 monclient: init 2026-02-17T11:11:16.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.455+0000 7f01910e8640 10 monclient: _reopen_session rank -1 2026-02-17T11:11:16.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.455+0000 7f01910e8640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:11:16.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.455+0000 7f01910e8640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f018c074ef0 0x7f018c157e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:16.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.455+0000 7f01910e8640 10 monclient(hunting): picked mon.noname-c con 0x7f018c074ef0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:11:16.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.455+0000 7f01910e8640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f018c0c7170 0x7f018c1f4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:16.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.455+0000 7f01910e8640 10 monclient(hunting): picked mon.noname-b con 0x7f018c0c7170 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:11:16.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.455+0000 7f01910e8640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f018c0c7550 0x7f018c1f3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:16.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.455+0000 7f01910e8640 10 monclient(hunting): picked mon.noname-a con 0x7f018c0c7550 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:11:16.471 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.455+0000 7f01910e8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:16.471 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.455+0000 7f01910e8640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f018c0c7ee0 con 0x7f018c0c7550 2026-02-17T11:11:16.471 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.455+0000 7f01910e8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:16.471 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.455+0000 7f01910e8640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f018c0c5830 con 0x7f018c0c7170 2026-02-17T11:11:16.471 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.455+0000 7f01910e8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:16.471 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.455+0000 7f01910e8640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f018c0c81c0 con 0x7f018c074ef0 2026-02-17T11:11:16.471 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.455+0000 7f01910e8640 10 monclient(hunting): _renew_subs 2026-02-17T11:11:16.471 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.455+0000 7f01910e8640 10 monclient(hunting): authenticate will time out at 1153.119658s 2026-02-17T11:11:16.471 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.455+0000 7f018b577640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f018c0c7550 0x7f018c1f3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:16.471 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.456+0000 7f018a575640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f018c0c7170 0x7f018c1f4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:16.471 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.456+0000 7f018b577640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f018c0c7550 0x7f018c1f3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:43920/0 (socket says 10.20.193.49:43920) 2026-02-17T11:11:16.472 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.456+0000 7f018b577640 1 -- 10.20.193.49:0/3652865559 learned_addr learned my addr 10.20.193.49:0/3652865559 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:11:16.472 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.456+0000 7f018b577640 10 monclient(hunting): get_auth_request con 0x7f018c0c7550 auth_method 0 2026-02-17T11:11:16.472 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.456+0000 7f018b577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:16.472 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.456+0000 7f018b577640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:16.472 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.456+0000 7f018b577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:16.472 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.456+0000 7f018ad76640 1 --2- 10.20.193.49:0/3652865559 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f018c074ef0 0x7f018c157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:16.472 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.456+0000 7f018a575640 10 monclient(hunting): get_auth_request con 0x7f018c0c7170 auth_method 0 2026-02-17T11:11:16.472 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.456+0000 7f018a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:16.472 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.456+0000 7f018a575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:16.472 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.456+0000 7f018a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:16.472 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.456+0000 7f018b577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:16.472 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.456+0000 7f018b577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:16.473 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.456+0000 7f018b577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:16.473 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.456+0000 7f018ad76640 10 monclient(hunting): get_auth_request con 0x7f018c074ef0 auth_method 0 2026-02-17T11:11:16.473 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.456+0000 7f018ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:16.473 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.456+0000 7f018ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:16.473 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.456+0000 7f018ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:16.473 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.456+0000 7f018a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:16.473 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.456+0000 7f018a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:16.473 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.456+0000 7f018a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:16.473 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.456+0000 7f018ad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:16.473 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.456+0000 7f018ad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:16.473 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.456+0000 7f018ad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:16.473 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.457+0000 7f018b577640 10 monclient(hunting): handle_auth_done global_id 4689 payload 824 2026-02-17T11:11:16.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.457+0000 7f018b577640 1 -- 10.20.193.49:0/3652865559 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f018c074ef0 msgr2=0x7f018c157e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:16.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.457+0000 7f018b577640 1 --2- 10.20.193.49:0/3652865559 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f018c074ef0 0x7f018c157e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:16.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.457+0000 7f018b577640 1 -- 10.20.193.49:0/3652865559 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f018c0c7170 msgr2=0x7f018c1f4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:16.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.457+0000 7f018b577640 1 --2- 10.20.193.49:0/3652865559 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f018c0c7170 0x7f018c1f4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:16.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.457+0000 7f018b577640 10 monclient: _finish_hunting 0 2026-02-17T11:11:16.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.457+0000 7f018b577640 1 monclient: found mon.noname-a 2026-02-17T11:11:16.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.457+0000 7f018b577640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:11:16.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.457+0000 7f018b577640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:11:16.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.457+0000 7f018b577640 1 -- 10.20.193.49:0/3652865559 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f018c1f4d90 con 0x7f018c0c7550 2026-02-17T11:11:16.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.458+0000 7f018b577640 1 --2- 10.20.193.49:0/3652865559 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f018c0c7550 0x7f018c1f3680 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f017c00cb30 tx=0x7f017c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:11:16.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.458+0000 7f016b7fe640 10 client.?.objecter ms_handle_connect 0x7f018c0c7550 2026-02-17T11:11:16.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.458+0000 7f016b7fe640 10 client.?.objecter resend_mon_ops 2026-02-17T11:11:16.475 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.460+0000 7f016b7fe640 1 -- 10.20.193.49:0/3652865559 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f017c00acb0 con 0x7f018c0c7550 2026-02-17T11:11:16.475 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.460+0000 7f016b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:16.475 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.460+0000 7f016b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:11:16.475 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.460+0000 7f016b7fe640 10 monclient: dump: 2026-02-17T11:11:16.475 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:16.475 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:16.475 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:16.475 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:16.475 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:16.475 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:16.475 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:16.475 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:16.476 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:16.476 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:16.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.460+0000 7f016b7fe640 10 monclient: _finish_auth 0 2026-02-17T11:11:16.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.460+0000 7f016b7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:11:16.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.460+0000 7f016b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:11:16.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.460+0000 7f016b7fe640 1 -- 10.20.193.49:0/3652865559 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f017c00ae50 con 0x7f018c0c7550 2026-02-17T11:11:16.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.460+0000 7f01910e8640 5 monclient: authenticate success, global_id 4689 2026-02-17T11:11:16.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.460+0000 7f01910e8640 10 monclient: _renew_subs 2026-02-17T11:11:16.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.460+0000 7f01910e8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:11:16.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.460+0000 7f01910e8640 1 -- 10.20.193.49:0/3652865559 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f018c158460 con 0x7f018c0c7550 2026-02-17T11:11:16.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.460+0000 7f016b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:11:16.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.460+0000 7f016b7fe640 1 -- 10.20.193.49:0/3652865559 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f017c012600 con 0x7f018c0c7550 2026-02-17T11:11:16.477 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.460+0000 7f016b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:16.477 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.460+0000 7f016b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:11:16.477 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.460+0000 7f016b7fe640 10 monclient: dump: 2026-02-17T11:11:16.477 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:16.477 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:16.477 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:16.477 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:16.477 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:16.477 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:16.477 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:16.477 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:16.477 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:16.478 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:16.478 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.460+0000 7f0189573640 4 set_mon_vals no callback set 2026-02-17T11:11:16.478 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.460+0000 7f01910e8640 10 client.4689.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:11:16.478 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.460+0000 7f01910e8640 10 monclient: _renew_subs 2026-02-17T11:11:16.478 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.460+0000 7f01910e8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:11:16.478 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.460+0000 7f01910e8640 1 -- 10.20.193.49:0/3652865559 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f018c158a20 con 0x7f018c0c7550 2026-02-17T11:11:16.478 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.460+0000 7f01910e8640 1 librados: init done 2026-02-17T11:11:16.478 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.461+0000 7f01910e8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:11:16.478 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.461+0000 7f01910e8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:11:16.478 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.461+0000 7f01910e8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:11:16.478 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.461+0000 7f01910e8640 1 -- 10.20.193.49:0/3652865559 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f018c0749b0 con 0x7f018c0c7550 2026-02-17T11:11:16.483 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.480+0000 7f016b7fe640 1 -- 10.20.193.49:0/3652865559 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f017c0127a0 con 0x7f018c0c7550 2026-02-17T11:11:16.484 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.481+0000 7f016b7fe640 1 --2- 10.20.193.49:0/3652865559 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0158079190 0x7f015807b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:16.484 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.481+0000 7f018ad76640 1 --2- 10.20.193.49:0/3652865559 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0158079190 0x7f015807b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:16.484 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.481+0000 7f018ad76640 10 monclient: get_auth_request con 0x7f0158079190 auth_method 0 2026-02-17T11:11:16.484 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.481+0000 7f018ad76640 1 --2- 10.20.193.49:0/3652865559 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0158079190 0x7f015807b650 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f01800046e0 tx=0x7f01800091c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:11:16.484 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.481+0000 7f016b7fe640 10 client.4689.objecter ms_handle_connect 0x7f0158079190 2026-02-17T11:11:16.485 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.483+0000 7f016b7fe640 1 -- 10.20.193.49:0/3652865559 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f017c05eb70 con 0x7f018c0c7550 2026-02-17T11:11:16.485 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.483+0000 7f016b7fe640 10 client.4689.objecter ms_dispatch2 0x7f018c000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:11:16.485 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.483+0000 7f016b7fe640 3 client.4689.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:11:16.486 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.483+0000 7f016b7fe640 3 client.4689.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:11:16.486 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.483+0000 7f016b7fe640 20 client.4689.objecter dump_active .. 0 homeless 2026-02-17T11:11:16.589 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.586+0000 7f016b7fe640 1 -- 10.20.193.49:0/3652865559 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f017c062b30 con 0x7f018c0c7550 2026-02-17T11:11:16.589 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.586+0000 7f016b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:11:16.589 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.587+0000 7f016b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:11:16.687 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.685+0000 7f01910e8640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:11:16.687 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.685+0000 7f01910e8640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:11:16.688 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.685+0000 7f01910e8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:11:16.688 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.685+0000 7f01910e8640 1 -- 10.20.193.49:0/3652865559 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f018c0ca6a0 con 0x7f018c0c7550 2026-02-17T11:11:16.689 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.687+0000 7f016b7fe640 1 -- 10.20.193.49:0/3652865559 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f017c066e30 con 0x7f018c0c7550 2026-02-17T11:11:16.689 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.687+0000 7f016b7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:11:16.689 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.687+0000 7f016b7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:11:16.690 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:11:16.690 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:11:16.691 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.688+0000 7f01910e8640 10 librados: watch_flush enter 2026-02-17T11:11:16.691 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.688+0000 7f01910e8640 10 librados: watch_flush exit 2026-02-17T11:11:16.692 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.688+0000 7f01910e8640 20 client.4689.objecter shutdown clearing up homeless session... 2026-02-17T11:11:16.692 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.688+0000 7f01910e8640 10 client.4689.objecter successfully canceled tick 2026-02-17T11:11:16.692 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.688+0000 7f01910e8640 1 -- 10.20.193.49:0/3652865559 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0158079190 msgr2=0x7f015807b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:16.692 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.688+0000 7f01910e8640 1 --2- 10.20.193.49:0/3652865559 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0158079190 0x7f015807b650 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f01800046e0 tx=0x7f01800091c0 comp rx=0 tx=0).stop 2026-02-17T11:11:16.692 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.688+0000 7f01910e8640 10 monclient: shutdown 2026-02-17T11:11:16.692 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.688+0000 7f01910e8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:11:16.692 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.688+0000 7f01910e8640 1 -- 10.20.193.49:0/3652865559 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f018c0c7550 msgr2=0x7f018c1f3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:16.692 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.688+0000 7f01910e8640 1 --2- 10.20.193.49:0/3652865559 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f018c0c7550 0x7f018c1f3680 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f017c00cb30 tx=0x7f017c00a060 comp rx=0 tx=0).stop 2026-02-17T11:11:16.692 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.688+0000 7f01910e8640 1 -- 10.20.193.49:0/3652865559 shutdown_connections 2026-02-17T11:11:16.692 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.688+0000 7f01910e8640 1 --2- 10.20.193.49:0/3652865559 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0158079190 0x7f015807b650 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:16.692 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.688+0000 7f01910e8640 1 --2- 10.20.193.49:0/3652865559 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f018c0c7550 0x7f018c1f3680 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:16.693 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.688+0000 7f01910e8640 1 --2- 10.20.193.49:0/3652865559 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f018c0c7170 0x7f018c1f4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:16.693 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.688+0000 7f01910e8640 1 --2- 10.20.193.49:0/3652865559 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f018c074ef0 0x7f018c157e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:16.693 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.688+0000 7f01910e8640 1 -- 10.20.193.49:0/3652865559 >> 10.20.193.49:0/3652865559 conn(0x7f018c0c9f40 msgr2=0x7f018c06fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:11:16.693 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.688+0000 7f01910e8640 1 -- 10.20.193.49:0/3652865559 shutdown_connections 2026-02-17T11:11:16.693 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.688+0000 7f01910e8640 1 -- 10.20.193.49:0/3652865559 wait complete. 2026-02-17T11:11:16.693 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:16.688+0000 7f01910e8640 1 librados: shutdown 2026-02-17T11:11:19.700 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:11:19.770 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.767+0000 7fd72ab5e640 10 monclient: get_monmap_and_config 2026-02-17T11:11:19.770 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.767+0000 7fd72ab5e640 10 monclient: build_initial_monmap 2026-02-17T11:11:19.770 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.767+0000 7fd72ab5e640 10 monclient: monmap: 2026-02-17T11:11:19.771 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:11:19.771 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:19.771 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:11:19.769005+0000 2026-02-17T11:11:19.771 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:11:19.769005+0000 2026-02-17T11:11:19.771 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:11:19.771 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:19.771 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:11:19.771 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:11:19.771 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:11:19.771 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:11:19.771 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:11:19.772 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:11:19.772 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:19.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.767+0000 7fd72ab5e640 1 Processor -- start 2026-02-17T11:11:19.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.768+0000 7fd72ab5e640 1 -- start start 2026-02-17T11:11:19.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.768+0000 7fd72ab5e640 10 monclient: init 2026-02-17T11:11:19.780 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.768+0000 7fd72ab5e640 10 monclient: _reopen_session rank -1 2026-02-17T11:11:19.780 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.768+0000 7fd72ab5e640 10 monclient: _add_conns ranks=[3,5,4,0,2,1] 2026-02-17T11:11:19.780 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.768+0000 7fd72ab5e640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fd724152820 0x7fd7241593f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:19.780 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.768+0000 7fd72ab5e640 10 monclient(hunting): picked mon.noname-a con 0x7fd724152820 addr v2:10.20.193.49:3300/0 2026-02-17T11:11:19.780 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.768+0000 7fd72ab5e640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7fd724152c00 0x7fd7240c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:19.780 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.768+0000 7fd72ab5e640 10 monclient(hunting): picked mon.noname-c con 0x7fd724152c00 addr v2:10.20.193.157:3300/0 2026-02-17T11:11:19.780 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.768+0000 7fd72ab5e640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7fd7240738f0 0x7fd7240c5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:19.780 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.768+0000 7fd72ab5e640 10 monclient(hunting): picked mon.noname-b con 0x7fd7240738f0 addr v2:10.20.193.97:3300/0 2026-02-17T11:11:19.780 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.768+0000 7fd72ab5e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:19.781 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.768+0000 7fd72ab5e640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7fd724159930 con 0x7fd724152820 2026-02-17T11:11:19.781 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.768+0000 7fd72ab5e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:19.781 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.768+0000 7fd72ab5e640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7fd724073e90 con 0x7fd7240738f0 2026-02-17T11:11:19.781 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.768+0000 7fd72ab5e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:19.781 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.768+0000 7fd72ab5e640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7fd724074170 con 0x7fd724152c00 2026-02-17T11:11:19.781 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.768+0000 7fd72ab5e640 10 monclient(hunting): _renew_subs 2026-02-17T11:11:19.781 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.768+0000 7fd72ab5e640 10 monclient(hunting): authenticate will time out at 1156.432743s 2026-02-17T11:11:19.781 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.769+0000 7fd7288d3640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fd724152820 0x7fd7241593f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:19.781 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.769+0000 7fd71bfff640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7fd724152c00 0x7fd7240c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:19.781 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.769+0000 7fd7290d4640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7fd7240738f0 0x7fd7240c5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:19.781 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.769+0000 7fd7288d3640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fd724152820 0x7fd7241593f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:43934/0 (socket says 10.20.193.49:43934) 2026-02-17T11:11:19.781 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.769+0000 7fd7288d3640 1 -- 10.20.193.49:0/3942193727 learned_addr learned my addr 10.20.193.49:0/3942193727 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:11:19.782 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.769+0000 7fd7288d3640 10 monclient(hunting): get_auth_request con 0x7fd724152820 auth_method 0 2026-02-17T11:11:19.782 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.769+0000 7fd7288d3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:19.782 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.769+0000 7fd7288d3640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:19.782 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.769+0000 7fd7288d3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:19.782 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.769+0000 7fd7290d4640 10 monclient(hunting): get_auth_request con 0x7fd7240738f0 auth_method 0 2026-02-17T11:11:19.782 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.769+0000 7fd7290d4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:19.782 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.769+0000 7fd7290d4640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:19.782 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.769+0000 7fd7290d4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:19.782 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.769+0000 7fd71bfff640 1 -- 10.20.193.49:0/3942193727 >> v2:10.20.193.157:3300/0 conn(0x7fd724152c00 msgr2=0x7fd7240c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T11:11:19.782 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.769+0000 7fd71bfff640 1 -- 10.20.193.49:0/3942193727 >> v2:10.20.193.157:3300/0 conn(0x7fd724152c00 msgr2=0x7fd7240c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:11:19.782 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.769+0000 7fd71bfff640 1 --2- 10.20.193.49:0/3942193727 >> v2:10.20.193.157:3300/0 conn(0x7fd724152c00 0x7fd7240c7e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:11:19.782 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.769+0000 7fd71bfff640 1 --2- 10.20.193.49:0/3942193727 >> v2:10.20.193.157:3300/0 conn(0x7fd724152c00 0x7fd7240c7e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:11:19.782 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.769+0000 7fd7288d3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:19.783 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.769+0000 7fd7288d3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:19.783 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.769+0000 7fd7288d3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:19.783 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.769+0000 7fd7290d4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:19.783 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.769+0000 7fd7290d4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:19.783 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.769+0000 7fd7290d4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:19.783 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.770+0000 7fd7288d3640 10 monclient(hunting): handle_auth_done global_id 4692 payload 274 2026-02-17T11:11:19.783 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.770+0000 7fd7288d3640 1 -- 10.20.193.49:0/3942193727 >> v2:10.20.193.157:3300/0 conn(0x7fd724152c00 msgr2=0x7fd7240c7e40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T11:11:19.783 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.770+0000 7fd7288d3640 1 --2- 10.20.193.49:0/3942193727 >> v2:10.20.193.157:3300/0 conn(0x7fd724152c00 0x7fd7240c7e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:19.783 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.770+0000 7fd7288d3640 1 -- 10.20.193.49:0/3942193727 >> v2:10.20.193.97:3300/0 conn(0x7fd7240738f0 msgr2=0x7fd7240c5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:11:19.783 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.770+0000 7fd7288d3640 1 --2- 10.20.193.49:0/3942193727 >> v2:10.20.193.97:3300/0 conn(0x7fd7240738f0 0x7fd7240c5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:19.783 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.770+0000 7fd7288d3640 10 monclient: _finish_hunting 0 2026-02-17T11:11:19.783 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.770+0000 7fd7288d3640 1 monclient: found mon.noname-a 2026-02-17T11:11:19.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.770+0000 7fd7288d3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:11:19.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.770+0000 7fd7288d3640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:11:19.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.770+0000 7fd7288d3640 1 -- 10.20.193.49:0/3942193727 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd724074450 con 0x7fd724152820 2026-02-17T11:11:19.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.771+0000 7fd7288d3640 1 --2- 10.20.193.49:0/3942193727 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fd724152820 0x7fd7241593f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd724069ce0 tx=0x7fd71402ef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f76c2dd5e0bd91ca server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:11:19.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.773+0000 7fd71b7fe640 1 -- 10.20.193.49:0/3942193727 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd71403c070 con 0x7fd724152820 2026-02-17T11:11:19.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.773+0000 7fd71b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:19.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.773+0000 7fd71b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:11:19.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.773+0000 7fd71b7fe640 10 monclient: dump: 2026-02-17T11:11:19.784 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:19.784 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:19.784 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:19.784 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:19.785 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:19.785 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:19.785 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:19.785 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:19.785 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:19.785 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:19.785 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.773+0000 7fd71b7fe640 10 monclient: _finish_auth 0 2026-02-17T11:11:19.785 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.773+0000 7fd71b7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:11:19.785 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.773+0000 7fd71b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:11:19.785 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.773+0000 7fd71b7fe640 1 -- 10.20.193.49:0/3942193727 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd71402fbd0 con 0x7fd724152820 2026-02-17T11:11:19.785 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.773+0000 7fd72ab5e640 5 monclient: authenticate success, global_id 4692 2026-02-17T11:11:19.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.773+0000 7fd72ab5e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:11:19.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.773+0000 7fd71b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:11:19.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.773+0000 7fd71b7fe640 1 -- 10.20.193.49:0/3942193727 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd714037440 con 0x7fd724152820 2026-02-17T11:11:19.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.773+0000 7fd72ab5e640 10 monclient: get_monmap_and_config success 2026-02-17T11:11:19.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.773+0000 7fd72ab5e640 4 set_mon_vals no callback set 2026-02-17T11:11:19.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.773+0000 7fd71b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:19.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.773+0000 7fd71b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:11:19.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.773+0000 7fd71b7fe640 10 monclient: dump: 2026-02-17T11:11:19.786 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:19.786 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:19.786 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:19.786 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:19.786 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:19.787 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:19.787 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:19.787 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:19.787 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:19.787 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:19.787 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.773+0000 7fd72ab5e640 10 monclient: shutdown 2026-02-17T11:11:19.787 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.773+0000 7fd72ab5e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:11:19.787 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.773+0000 7fd72ab5e640 1 -- 10.20.193.49:0/3942193727 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fd724152820 msgr2=0x7fd7241593f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:19.787 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.773+0000 7fd72ab5e640 1 --2- 10.20.193.49:0/3942193727 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fd724152820 0x7fd7241593f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd724069ce0 tx=0x7fd71402ef50 comp rx=0 tx=0).stop 2026-02-17T11:11:19.787 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.773+0000 7fd72ab5e640 1 -- 10.20.193.49:0/3942193727 shutdown_connections 2026-02-17T11:11:19.787 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.773+0000 7fd72ab5e640 1 --2- 10.20.193.49:0/3942193727 >> v2:10.20.193.97:3300/0 conn(0x7fd7240738f0 0x7fd7240c5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:19.787 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.773+0000 7fd72ab5e640 1 --2- 10.20.193.49:0/3942193727 >> v2:10.20.193.157:3300/0 conn(0x7fd724152c00 0x7fd7240c7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:19.788 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.773+0000 7fd72ab5e640 1 --2- 10.20.193.49:0/3942193727 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fd724152820 0x7fd7241593f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:19.788 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.773+0000 7fd72ab5e640 1 -- 10.20.193.49:0/3942193727 >> 10.20.193.49:0/3942193727 conn(0x7fd7240c9f40 msgr2=0x7fd7240ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:11:19.788 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.773+0000 7fd72ab5e640 1 -- 10.20.193.49:0/3942193727 shutdown_connections 2026-02-17T11:11:19.788 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.773+0000 7fd72ab5e640 1 -- 10.20.193.49:0/3942193727 wait complete. 2026-02-17T11:11:19.788 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.774+0000 7fd72ab5e640 10 monclient: build_initial_monmap 2026-02-17T11:11:19.788 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.774+0000 7fd72ab5e640 10 monclient: monmap: 2026-02-17T11:11:19.788 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:11:19.788 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:11:19.788 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:11:19.788 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:11:19.788 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:11:19.788 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:19.789 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:11:19.789 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:11:19.789 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:11:19.789 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:19.789 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.774+0000 7fd72ab5e640 1 librados: starting msgr at 2026-02-17T11:11:19.789 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.774+0000 7fd72ab5e640 1 librados: starting objecter 2026-02-17T11:11:19.789 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.774+0000 7fd72ab5e640 1 Processor -- start 2026-02-17T11:11:19.789 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.774+0000 7fd72ab5e640 1 -- start start 2026-02-17T11:11:19.789 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.774+0000 7fd72ab5e640 1 librados: setting wanted keys 2026-02-17T11:11:19.789 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.774+0000 7fd72ab5e640 1 librados: calling monclient init 2026-02-17T11:11:19.789 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.774+0000 7fd72ab5e640 10 monclient: init 2026-02-17T11:11:19.789 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.775+0000 7fd72ab5e640 10 monclient: _reopen_session rank -1 2026-02-17T11:11:19.789 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.775+0000 7fd72ab5e640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:11:19.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.775+0000 7fd72ab5e640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fd7240738f0 0x7fd72406d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:19.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.775+0000 7fd72ab5e640 10 monclient(hunting): picked mon.noname-a con 0x7fd7240738f0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:11:19.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.775+0000 7fd72ab5e640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fd724152820 0x7fd7241f7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:19.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.775+0000 7fd72ab5e640 10 monclient(hunting): picked mon.noname-c con 0x7fd724152820 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:11:19.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.775+0000 7fd72ab5e640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fd724152c00 0x7fd7240bfb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:19.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.775+0000 7fd72ab5e640 10 monclient(hunting): picked mon.noname-b con 0x7fd724152c00 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:11:19.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.775+0000 7fd72ab5e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:19.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.775+0000 7fd72ab5e640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd724074cf0 con 0x7fd7240738f0 2026-02-17T11:11:19.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.775+0000 7fd72ab5e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:19.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.775+0000 7fd72ab5e640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd724074a10 con 0x7fd724152c00 2026-02-17T11:11:19.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.775+0000 7fd72ab5e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:19.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.775+0000 7fd72ab5e640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fd7240c8380 con 0x7fd724152820 2026-02-17T11:11:19.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.775+0000 7fd72ab5e640 10 monclient(hunting): _renew_subs 2026-02-17T11:11:19.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.775+0000 7fd72ab5e640 10 monclient(hunting): authenticate will time out at 1156.439194s 2026-02-17T11:11:19.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.775+0000 7fd7288d3640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fd7240738f0 0x7fd72406d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:19.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.775+0000 7fd7288d3640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fd7240738f0 0x7fd72406d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:43948/0 (socket says 10.20.193.49:43948) 2026-02-17T11:11:19.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.775+0000 7fd7288d3640 1 -- 10.20.193.49:0/2100792840 learned_addr learned my addr 10.20.193.49:0/2100792840 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:11:19.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.775+0000 7fd7288d3640 10 monclient(hunting): get_auth_request con 0x7fd7240738f0 auth_method 0 2026-02-17T11:11:19.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.775+0000 7fd7288d3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:19.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.775+0000 7fd7288d3640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:19.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.775+0000 7fd7288d3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:19.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.775+0000 7fd7290d4640 1 --2- 10.20.193.49:0/2100792840 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fd724152c00 0x7fd7240bfb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:19.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.775+0000 7fd71bfff640 1 --2- 10.20.193.49:0/2100792840 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fd724152820 0x7fd7241f7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:19.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.775+0000 7fd7290d4640 10 monclient(hunting): get_auth_request con 0x7fd724152c00 auth_method 0 2026-02-17T11:11:19.792 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.775+0000 7fd7290d4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:19.792 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.775+0000 7fd7290d4640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:19.792 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.775+0000 7fd7290d4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:19.792 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.775+0000 7fd7288d3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:19.792 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.775+0000 7fd7288d3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:19.792 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.775+0000 7fd7288d3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:19.792 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.775+0000 7fd71bfff640 10 monclient(hunting): get_auth_request con 0x7fd724152820 auth_method 0 2026-02-17T11:11:19.792 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.775+0000 7fd71bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:19.792 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.775+0000 7fd71bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:19.792 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.775+0000 7fd71bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:19.792 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.775+0000 7fd7290d4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:19.792 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.775+0000 7fd7290d4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:19.793 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.775+0000 7fd7290d4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:19.793 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.776+0000 7fd71bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:19.793 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.776+0000 7fd71bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:19.793 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.776+0000 7fd71bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:19.793 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.777+0000 7fd7288d3640 10 monclient(hunting): handle_auth_done global_id 4695 payload 824 2026-02-17T11:11:19.793 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.777+0000 7fd7288d3640 1 -- 10.20.193.49:0/2100792840 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fd724152820 msgr2=0x7fd7241f7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:19.793 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.777+0000 7fd7288d3640 1 --2- 10.20.193.49:0/2100792840 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fd724152820 0x7fd7241f7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:19.793 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.777+0000 7fd7288d3640 1 -- 10.20.193.49:0/2100792840 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fd724152c00 msgr2=0x7fd7240bfb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:19.793 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.777+0000 7fd7288d3640 1 --2- 10.20.193.49:0/2100792840 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fd724152c00 0x7fd7240bfb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:19.793 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.777+0000 7fd7288d3640 10 monclient: _finish_hunting 0 2026-02-17T11:11:19.793 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.777+0000 7fd7288d3640 1 monclient: found mon.noname-a 2026-02-17T11:11:19.793 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.777+0000 7fd7288d3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:11:19.793 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.777+0000 7fd7288d3640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:11:19.794 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.777+0000 7fd7288d3640 1 -- 10.20.193.49:0/2100792840 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd724157b70 con 0x7fd7240738f0 2026-02-17T11:11:19.796 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.778+0000 7fd7288d3640 1 --2- 10.20.193.49:0/2100792840 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fd7240738f0 0x7fd72406d2a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd714009a40 tx=0x7fd7140047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:11:19.796 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.778+0000 7fd7197fa640 10 client.?.objecter ms_handle_connect 0x7fd7240738f0 2026-02-17T11:11:19.796 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.778+0000 7fd7197fa640 10 client.?.objecter resend_mon_ops 2026-02-17T11:11:19.797 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.779+0000 7fd7197fa640 1 -- 10.20.193.49:0/2100792840 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd71403c040 con 0x7fd7240738f0 2026-02-17T11:11:19.797 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.779+0000 7fd7197fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:19.797 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.779+0000 7fd7197fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:11:19.797 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.779+0000 7fd7197fa640 10 monclient: dump: 2026-02-17T11:11:19.797 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:19.797 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:19.797 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:19.797 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:19.797 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:19.797 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:19.797 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:19.798 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:19.798 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:19.798 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:19.798 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.779+0000 7fd7197fa640 10 monclient: _finish_auth 0 2026-02-17T11:11:19.798 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.779+0000 7fd7197fa640 10 monclient: _check_auth_tickets 2026-02-17T11:11:19.798 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.779+0000 7fd7197fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:11:19.798 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.779+0000 7fd7197fa640 1 -- 10.20.193.49:0/2100792840 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd714042410 con 0x7fd7240738f0 2026-02-17T11:11:19.798 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.779+0000 7fd7197fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:11:19.798 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.779+0000 7fd7197fa640 1 -- 10.20.193.49:0/2100792840 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7140427e0 con 0x7fd7240738f0 2026-02-17T11:11:19.798 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.779+0000 7fd7197fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:19.798 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.779+0000 7fd7197fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:11:19.798 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.779+0000 7fd7197fa640 10 monclient: dump: 2026-02-17T11:11:19.799 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:19.799 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:19.799 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:19.799 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:19.799 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:19.799 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:19.799 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:19.799 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:19.799 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:19.799 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:19.799 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.779+0000 7fd71affd640 4 set_mon_vals no callback set 2026-02-17T11:11:19.799 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.779+0000 7fd72ab5e640 5 monclient: authenticate success, global_id 4695 2026-02-17T11:11:19.799 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.779+0000 7fd72ab5e640 10 monclient: _renew_subs 2026-02-17T11:11:19.800 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.779+0000 7fd72ab5e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:11:19.800 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.779+0000 7fd72ab5e640 1 -- 10.20.193.49:0/2100792840 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd724157e50 con 0x7fd7240738f0 2026-02-17T11:11:19.800 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.779+0000 7fd72ab5e640 10 client.4695.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:11:19.800 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.779+0000 7fd72ab5e640 10 monclient: _renew_subs 2026-02-17T11:11:19.800 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.779+0000 7fd72ab5e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:11:19.800 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.779+0000 7fd72ab5e640 1 -- 10.20.193.49:0/2100792840 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd724158410 con 0x7fd7240738f0 2026-02-17T11:11:19.800 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.779+0000 7fd72ab5e640 1 librados: init done 2026-02-17T11:11:19.800 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.780+0000 7fd72ab5e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:11:19.800 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.780+0000 7fd72ab5e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:11:19.800 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.780+0000 7fd72ab5e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:11:19.800 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.780+0000 7fd72ab5e640 1 -- 10.20.193.49:0/2100792840 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd72414fab0 con 0x7fd7240738f0 2026-02-17T11:11:19.800 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.792+0000 7fd7197fa640 1 -- 10.20.193.49:0/2100792840 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7fd714042980 con 0x7fd7240738f0 2026-02-17T11:11:19.801 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.792+0000 7fd7197fa640 1 --2- 10.20.193.49:0/2100792840 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fd6f4079190 0x7fd6f407b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:19.801 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.792+0000 7fd71bfff640 1 --2- 10.20.193.49:0/2100792840 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fd6f4079190 0x7fd6f407b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:19.801 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.792+0000 7fd71bfff640 10 monclient: get_auth_request con 0x7fd6f4079190 auth_method 0 2026-02-17T11:11:19.801 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.793+0000 7fd71bfff640 1 --2- 10.20.193.49:0/2100792840 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fd6f4079190 0x7fd6f407b650 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd72414ffc0 tx=0x7fd70c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:11:19.801 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.793+0000 7fd7197fa640 10 client.4695.objecter ms_handle_connect 0x7fd6f4079190 2026-02-17T11:11:19.801 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.793+0000 7fd7197fa640 1 -- 10.20.193.49:0/2100792840 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7fd714083920 con 0x7fd7240738f0 2026-02-17T11:11:19.801 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.793+0000 7fd7197fa640 10 client.4695.objecter ms_dispatch2 0x7fd724000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:11:19.801 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.793+0000 7fd7197fa640 3 client.4695.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:11:19.801 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.793+0000 7fd7197fa640 3 client.4695.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:11:19.801 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.793+0000 7fd7197fa640 20 client.4695.objecter dump_active .. 0 homeless 2026-02-17T11:11:19.898 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.896+0000 7fd7197fa640 1 -- 10.20.193.49:0/2100792840 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fd7140878e0 con 0x7fd7240738f0 2026-02-17T11:11:19.899 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.896+0000 7fd7197fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:11:19.899 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.896+0000 7fd7197fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:11:20.000 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.998+0000 7fd72ab5e640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:11:20.000 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.998+0000 7fd72ab5e640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:11:20.000 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.998+0000 7fd72ab5e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:11:20.000 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:19.998+0000 7fd72ab5e640 1 -- 10.20.193.49:0/2100792840 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd724150df0 con 0x7fd7240738f0 2026-02-17T11:11:20.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:20.001+0000 7fd7197fa640 1 -- 10.20.193.49:0/2100792840 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fd71408bbe0 con 0x7fd7240738f0 2026-02-17T11:11:20.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:20.001+0000 7fd7197fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:11:20.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:20.001+0000 7fd7197fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:11:20.003 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:11:20.003 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:11:20.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:20.002+0000 7fd72ab5e640 10 librados: watch_flush enter 2026-02-17T11:11:20.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:20.002+0000 7fd72ab5e640 10 librados: watch_flush exit 2026-02-17T11:11:20.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:20.002+0000 7fd72ab5e640 20 client.4695.objecter shutdown clearing up homeless session... 2026-02-17T11:11:20.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:20.002+0000 7fd72ab5e640 10 client.4695.objecter successfully canceled tick 2026-02-17T11:11:20.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:20.002+0000 7fd72ab5e640 1 -- 10.20.193.49:0/2100792840 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fd6f4079190 msgr2=0x7fd6f407b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:20.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:20.002+0000 7fd72ab5e640 1 --2- 10.20.193.49:0/2100792840 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fd6f4079190 0x7fd6f407b650 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd72414ffc0 tx=0x7fd70c008040 comp rx=0 tx=0).stop 2026-02-17T11:11:20.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:20.002+0000 7fd72ab5e640 10 monclient: shutdown 2026-02-17T11:11:20.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:20.002+0000 7fd72ab5e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:11:20.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:20.002+0000 7fd72ab5e640 1 -- 10.20.193.49:0/2100792840 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fd7240738f0 msgr2=0x7fd72406d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:20.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:20.002+0000 7fd72ab5e640 1 --2- 10.20.193.49:0/2100792840 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fd7240738f0 0x7fd72406d2a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd714009a40 tx=0x7fd7140047c0 comp rx=0 tx=0).stop 2026-02-17T11:11:20.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:20.002+0000 7fd72ab5e640 1 -- 10.20.193.49:0/2100792840 shutdown_connections 2026-02-17T11:11:20.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:20.002+0000 7fd72ab5e640 1 --2- 10.20.193.49:0/2100792840 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fd6f4079190 0x7fd6f407b650 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:20.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:20.002+0000 7fd72ab5e640 1 --2- 10.20.193.49:0/2100792840 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fd724152c00 0x7fd7240bfb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:20.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:20.002+0000 7fd72ab5e640 1 --2- 10.20.193.49:0/2100792840 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fd724152820 0x7fd7241f7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:20.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:20.002+0000 7fd72ab5e640 1 --2- 10.20.193.49:0/2100792840 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fd7240738f0 0x7fd72406d2a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:20.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:20.002+0000 7fd72ab5e640 1 -- 10.20.193.49:0/2100792840 >> 10.20.193.49:0/2100792840 conn(0x7fd7240c9f40 msgr2=0x7fd7240c72c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:11:20.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:20.002+0000 7fd72ab5e640 1 -- 10.20.193.49:0/2100792840 shutdown_connections 2026-02-17T11:11:20.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:20.002+0000 7fd72ab5e640 1 -- 10.20.193.49:0/2100792840 wait complete. 2026-02-17T11:11:20.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:20.002+0000 7fd72ab5e640 1 librados: shutdown 2026-02-17T11:11:23.014 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:11:23.080 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.077+0000 7f666d775640 10 monclient: get_monmap_and_config 2026-02-17T11:11:23.080 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.077+0000 7f666d775640 10 monclient: build_initial_monmap 2026-02-17T11:11:23.080 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.077+0000 7f666d775640 10 monclient: monmap: 2026-02-17T11:11:23.080 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:11:23.080 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:23.080 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:11:23.079392+0000 2026-02-17T11:11:23.080 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:11:23.079392+0000 2026-02-17T11:11:23.080 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:11:23.080 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:23.080 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:11:23.080 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:11:23.080 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:11:23.080 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:11:23.080 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:11:23.080 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:11:23.080 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:23.081 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.078+0000 7f666d775640 1 Processor -- start 2026-02-17T11:11:23.081 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.078+0000 7f666d775640 1 -- start start 2026-02-17T11:11:23.081 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.078+0000 7f666d775640 10 monclient: init 2026-02-17T11:11:23.081 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.078+0000 7f666d775640 10 monclient: _reopen_session rank -1 2026-02-17T11:11:23.081 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.078+0000 7f666d775640 10 monclient: _add_conns ranks=[3,5,0,4,1,2] 2026-02-17T11:11:23.081 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.078+0000 7f666d775640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f666815d370 0x7f666815d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:23.081 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.078+0000 7f666d775640 10 monclient(hunting): picked mon.noname-a con 0x7f666815d370 addr v2:10.20.193.49:3300/0 2026-02-17T11:11:23.081 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.078+0000 7f666d775640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f66680c7e20 0x7f66680c74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:23.081 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.078+0000 7f666d775640 10 monclient(hunting): picked mon.noname-c con 0x7f66680c7e20 addr v2:10.20.193.157:3300/0 2026-02-17T11:11:23.081 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.078+0000 7f666d775640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f666815b000 addr v1:10.20.193.49:6789/0 2026-02-17T11:11:23.081 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.078+0000 7f666d775640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66680c8350 con 0x7f666815b000 2026-02-17T11:11:23.081 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.078+0000 7f666d775640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:23.081 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.078+0000 7f666d775640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f66680c9240 con 0x7f666815d370 2026-02-17T11:11:23.081 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.078+0000 7f666d775640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:23.081 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.078+0000 7f666d775640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f66680c8630 con 0x7f66680c7e20 2026-02-17T11:11:23.081 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.078+0000 7f666d775640 10 monclient(hunting): _renew_subs 2026-02-17T11:11:23.081 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.078+0000 7f666d775640 10 monclient(hunting): authenticate will time out at 1159.742854s 2026-02-17T11:11:23.081 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.079+0000 7f66667fc640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f66680c7e20 0x7f66680c74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:23.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.079+0000 7f6666ffd640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f666815d370 0x7f666815d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:23.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.079+0000 7f66667fc640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f66680c7e20 0x7f66680c74c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:53516/0 (socket says 10.20.193.49:53516) 2026-02-17T11:11:23.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.079+0000 7f66667fc640 1 -- 10.20.193.49:0/466637981 learned_addr learned my addr 10.20.193.49:0/466637981 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:11:23.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.079+0000 7f66667fc640 10 monclient(hunting): get_auth_request con 0x7f66680c7e20 auth_method 0 2026-02-17T11:11:23.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.079+0000 7f66667fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:23.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.079+0000 7f66667fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:23.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.079+0000 7f66667fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:23.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.079+0000 7f66667fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:23.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.079+0000 7f66667fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:23.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.079+0000 7f66667fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:23.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.079+0000 7f6666ffd640 10 monclient(hunting): get_auth_request con 0x7f666815d370 auth_method 0 2026-02-17T11:11:23.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.079+0000 7f6666ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:23.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.079+0000 7f6666ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:23.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.079+0000 7f6666ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:23.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.080+0000 7f6666ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:23.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.080+0000 7f6666ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:23.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.080+0000 7f6666ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:23.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.080+0000 7f66667fc640 10 monclient(hunting): handle_auth_done global_id 4700 payload 274 2026-02-17T11:11:23.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.080+0000 7f66667fc640 1 -- 10.20.193.49:0/466637981 >> v2:10.20.193.49:3300/0 conn(0x7f666815d370 msgr2=0x7f666815d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:11:23.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.080+0000 7f66667fc640 1 --2- 10.20.193.49:0/466637981 >> v2:10.20.193.49:3300/0 conn(0x7f666815d370 0x7f666815d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:23.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.080+0000 7f66667fc640 1 -- 10.20.193.49:0/466637981 >> v1:10.20.193.49:6789/0 conn(0x7f666815b000 legacy=0x7f66680c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:23.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.080+0000 7f66667fc640 10 monclient: _finish_hunting 0 2026-02-17T11:11:23.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.080+0000 7f66667fc640 1 monclient: found mon.noname-c 2026-02-17T11:11:23.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.080+0000 7f66667fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:11:23.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.080+0000 7f66667fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:11:23.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.080+0000 7f66667fc640 1 -- 10.20.193.49:0/466637981 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66680c8910 con 0x7f66680c7e20 2026-02-17T11:11:23.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.081+0000 7f66667fc640 1 --2- 10.20.193.49:0/466637981 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f66680c7e20 0x7f66680c74c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f666815d060 tx=0x7f665002eed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2358aa4f96c89109 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:11:23.085 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.083+0000 7f6665ffb640 1 -- 10.20.193.49:0/466637981 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f665003c070 con 0x7f66680c7e20 2026-02-17T11:11:23.085 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.083+0000 7f6665ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:23.085 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.083+0000 7f6665ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:11:23.085 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.083+0000 7f6665ffb640 10 monclient: dump: 2026-02-17T11:11:23.085 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:23.085 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:23.085 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:23.085 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:23.085 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:23.085 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:23.086 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:23.086 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:23.086 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:23.086 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:23.086 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.083+0000 7f6665ffb640 10 monclient: _finish_auth 0 2026-02-17T11:11:23.086 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.083+0000 7f6665ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:11:23.086 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.083+0000 7f6665ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:11:23.086 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.083+0000 7f6665ffb640 1 -- 10.20.193.49:0/466637981 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f665002fbe0 con 0x7f66680c7e20 2026-02-17T11:11:23.086 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.083+0000 7f6665ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:11:23.086 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.083+0000 7f6665ffb640 1 -- 10.20.193.49:0/466637981 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6650037440 con 0x7f66680c7e20 2026-02-17T11:11:23.086 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.083+0000 7f6665ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:23.086 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.083+0000 7f6665ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:11:23.086 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.083+0000 7f6665ffb640 10 monclient: dump: 2026-02-17T11:11:23.086 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:23.086 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:23.086 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:23.086 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:23.086 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:23.086 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:23.086 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:23.086 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:23.086 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:23.086 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:23.086 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.083+0000 7f666d775640 5 monclient: authenticate success, global_id 4700 2026-02-17T11:11:23.086 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.083+0000 7f666d775640 10 monclient: get_monmap_and_config success 2026-02-17T11:11:23.086 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.083+0000 7f666d775640 4 set_mon_vals no callback set 2026-02-17T11:11:23.086 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.083+0000 7f666d775640 10 monclient: shutdown 2026-02-17T11:11:23.086 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.083+0000 7f666d775640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:11:23.086 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.083+0000 7f666d775640 1 -- 10.20.193.49:0/466637981 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f66680c7e20 msgr2=0x7f66680c74c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:23.086 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.083+0000 7f666d775640 1 --2- 10.20.193.49:0/466637981 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f66680c7e20 0x7f66680c74c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f666815d060 tx=0x7f665002eed0 comp rx=0 tx=0).stop 2026-02-17T11:11:23.086 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.083+0000 7f666d775640 1 -- 10.20.193.49:0/466637981 shutdown_connections 2026-02-17T11:11:23.086 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.083+0000 7f666d775640 1 --2- 10.20.193.49:0/466637981 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f66680c7e20 0x7f66680c74c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:23.086 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.083+0000 7f666d775640 1 --2- 10.20.193.49:0/466637981 >> v2:10.20.193.49:3300/0 conn(0x7f666815d370 0x7f666815d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:23.086 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.083+0000 7f666d775640 1 -- 10.20.193.49:0/466637981 >> 10.20.193.49:0/466637981 conn(0x7f66680c9f20 msgr2=0x7f66680ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:11:23.086 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.083+0000 7f666d775640 1 -- 10.20.193.49:0/466637981 shutdown_connections 2026-02-17T11:11:23.086 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.083+0000 7f666d775640 1 -- 10.20.193.49:0/466637981 wait complete. 2026-02-17T11:11:23.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.084+0000 7f666d775640 10 monclient: build_initial_monmap 2026-02-17T11:11:23.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.084+0000 7f666d775640 10 monclient: monmap: 2026-02-17T11:11:23.088 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:11:23.088 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:11:23.088 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:11:23.088 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:11:23.088 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:11:23.088 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:23.088 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:11:23.088 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:11:23.088 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:11:23.088 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:23.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.084+0000 7f666d775640 1 librados: starting msgr at 2026-02-17T11:11:23.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.084+0000 7f666d775640 1 librados: starting objecter 2026-02-17T11:11:23.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.084+0000 7f666d775640 1 Processor -- start 2026-02-17T11:11:23.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.084+0000 7f666d775640 1 -- start start 2026-02-17T11:11:23.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.084+0000 7f666d775640 1 librados: setting wanted keys 2026-02-17T11:11:23.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.084+0000 7f666d775640 1 librados: calling monclient init 2026-02-17T11:11:23.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.084+0000 7f666d775640 10 monclient: init 2026-02-17T11:11:23.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.084+0000 7f666d775640 10 monclient: _reopen_session rank -1 2026-02-17T11:11:23.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.084+0000 7f666d775640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:11:23.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.084+0000 7f666d775640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f66680c7e20 0x7f6668143850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:23.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.084+0000 7f666d775640 10 monclient(hunting): picked mon.noname-a con 0x7f66680c7e20 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:11:23.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.084+0000 7f666d775640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f666815b000 0x7f666806d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:23.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.084+0000 7f666d775640 10 monclient(hunting): picked mon.noname-c con 0x7f666815b000 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:11:23.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.084+0000 7f666d775640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f666815d370 0x7f666814b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:23.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.084+0000 7f666d775640 10 monclient(hunting): picked mon.noname-b con 0x7f666815d370 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:11:23.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.084+0000 7f666d775640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:23.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.084+0000 7f666d775640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f66680c96d0 con 0x7f66680c7e20 2026-02-17T11:11:23.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.084+0000 7f666d775640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:23.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.084+0000 7f666d775640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f66680c8ed0 con 0x7f666815d370 2026-02-17T11:11:23.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.084+0000 7f666d775640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:23.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.084+0000 7f666d775640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f66681f7710 con 0x7f666815b000 2026-02-17T11:11:23.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.084+0000 7f666d775640 10 monclient(hunting): _renew_subs 2026-02-17T11:11:23.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.084+0000 7f666d775640 10 monclient(hunting): authenticate will time out at 1159.748711s 2026-02-17T11:11:23.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.084+0000 7f6666ffd640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f66680c7e20 0x7f6668143850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:23.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.085+0000 7f66667fc640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f666815b000 0x7f666806d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:23.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.085+0000 7f6666ffd640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f66680c7e20 0x7f6668143850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:43964/0 (socket says 10.20.193.49:43964) 2026-02-17T11:11:23.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.085+0000 7f6666ffd640 1 -- 10.20.193.49:0/486060323 learned_addr learned my addr 10.20.193.49:0/486060323 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:11:23.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.085+0000 7f6666ffd640 10 monclient(hunting): get_auth_request con 0x7f66680c7e20 auth_method 0 2026-02-17T11:11:23.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.085+0000 7f6666ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:23.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.085+0000 7f6666ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:23.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.085+0000 7f6666ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:23.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.085+0000 7f66677fe640 1 --2- 10.20.193.49:0/486060323 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f666815d370 0x7f666814b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:23.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.085+0000 7f66667fc640 10 monclient(hunting): get_auth_request con 0x7f666815b000 auth_method 0 2026-02-17T11:11:23.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.085+0000 7f66667fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:23.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.085+0000 7f66667fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:23.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.085+0000 7f66667fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:23.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.085+0000 7f66677fe640 10 monclient(hunting): get_auth_request con 0x7f666815d370 auth_method 0 2026-02-17T11:11:23.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.085+0000 7f66677fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:23.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.085+0000 7f66677fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:23.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.085+0000 7f66677fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:23.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.085+0000 7f6666ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:23.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.085+0000 7f6666ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:23.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.085+0000 7f6666ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:23.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.085+0000 7f66667fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:23.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.085+0000 7f66667fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:23.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.085+0000 7f66667fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:23.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.085+0000 7f66677fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:23.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.085+0000 7f66677fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:23.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.085+0000 7f66677fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:23.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.086+0000 7f66667fc640 10 monclient(hunting): handle_auth_done global_id 4703 payload 824 2026-02-17T11:11:23.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.086+0000 7f66667fc640 1 -- 10.20.193.49:0/486060323 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f666815d370 msgr2=0x7f666814b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:23.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.086+0000 7f66667fc640 1 --2- 10.20.193.49:0/486060323 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f666815d370 0x7f666814b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:23.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.086+0000 7f66667fc640 1 -- 10.20.193.49:0/486060323 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f66680c7e20 msgr2=0x7f6668143850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:23.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.086+0000 7f66667fc640 1 --2- 10.20.193.49:0/486060323 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f66680c7e20 0x7f6668143850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:23.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.086+0000 7f66667fc640 10 monclient: _finish_hunting 0 2026-02-17T11:11:23.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.086+0000 7f66667fc640 1 monclient: found mon.noname-c 2026-02-17T11:11:23.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.086+0000 7f66667fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:11:23.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.086+0000 7f66667fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:11:23.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.086+0000 7f66667fc640 1 -- 10.20.193.49:0/486060323 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6668149490 con 0x7f666815b000 2026-02-17T11:11:23.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.087+0000 7f66667fc640 1 --2- 10.20.193.49:0/486060323 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f666815b000 0x7f666806d5f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f66680c93c0 tx=0x7f66500047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:11:23.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.087+0000 7f66477fe640 10 client.?.objecter ms_handle_connect 0x7f666815b000 2026-02-17T11:11:23.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.087+0000 7f66477fe640 10 client.?.objecter resend_mon_ops 2026-02-17T11:11:23.091 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.089+0000 7f66477fe640 1 -- 10.20.193.49:0/486060323 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f665003c040 con 0x7f666815b000 2026-02-17T11:11:23.091 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.089+0000 7f66477fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:23.092 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.089+0000 7f66477fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:11:23.092 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.089+0000 7f66477fe640 10 monclient: dump: 2026-02-17T11:11:23.092 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:23.092 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:23.092 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:23.092 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:23.092 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:23.092 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:23.092 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:23.092 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:23.092 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:23.092 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:23.092 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.089+0000 7f66477fe640 10 monclient: _finish_auth 0 2026-02-17T11:11:23.092 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.089+0000 7f66477fe640 10 monclient: _check_auth_tickets 2026-02-17T11:11:23.092 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.089+0000 7f66477fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:11:23.092 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.089+0000 7f66477fe640 1 -- 10.20.193.49:0/486060323 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6650042650 con 0x7f666815b000 2026-02-17T11:11:23.092 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.089+0000 7f666d775640 5 monclient: authenticate success, global_id 4703 2026-02-17T11:11:23.092 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.089+0000 7f666d775640 10 monclient: _renew_subs 2026-02-17T11:11:23.092 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.089+0000 7f666d775640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:11:23.092 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.089+0000 7f666d775640 1 -- 10.20.193.49:0/486060323 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66681f6de0 con 0x7f666815b000 2026-02-17T11:11:23.092 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.089+0000 7f66477fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:11:23.092 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.089+0000 7f66477fe640 1 -- 10.20.193.49:0/486060323 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6650042a40 con 0x7f666815b000 2026-02-17T11:11:23.092 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.089+0000 7f66477fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:23.092 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.089+0000 7f66477fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:11:23.092 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.089+0000 7f66657fa640 4 set_mon_vals no callback set 2026-02-17T11:11:23.092 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.089+0000 7f66477fe640 10 monclient: dump: 2026-02-17T11:11:23.092 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:23.092 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:23.092 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:23.092 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:23.092 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:23.092 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:23.092 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:23.092 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:23.092 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:23.092 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:23.092 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.089+0000 7f666d775640 10 client.4703.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:11:23.092 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.089+0000 7f666d775640 10 monclient: _renew_subs 2026-02-17T11:11:23.093 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.089+0000 7f666d775640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:11:23.093 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.089+0000 7f666d775640 1 -- 10.20.193.49:0/486060323 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66681f73a0 con 0x7f666815b000 2026-02-17T11:11:23.093 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.089+0000 7f666d775640 1 librados: init done 2026-02-17T11:11:23.093 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.090+0000 7f666d775640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:11:23.093 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.090+0000 7f666d775640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:11:23.093 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.090+0000 7f666d775640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:11:23.093 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.090+0000 7f666d775640 1 -- 10.20.193.49:0/486060323 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f666815c610 con 0x7f666815b000 2026-02-17T11:11:23.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.101+0000 7f66477fe640 1 -- 10.20.193.49:0/486060323 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f6650042be0 con 0x7f666815b000 2026-02-17T11:11:23.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.101+0000 7f66477fe640 1 --2- 10.20.193.49:0/486060323 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f6634079170 0x7f663407b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:23.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.101+0000 7f6666ffd640 1 --2- 10.20.193.49:0/486060323 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f6634079170 0x7f663407b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:23.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.101+0000 7f6666ffd640 10 monclient: get_auth_request con 0x7f6634079170 auth_method 0 2026-02-17T11:11:23.104 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.102+0000 7f6666ffd640 1 --2- 10.20.193.49:0/486060323 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f6634079170 0x7f663407b630 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f665c009c60 tx=0x7f665c009290 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:11:23.104 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.102+0000 7f66477fe640 10 client.4703.objecter ms_handle_connect 0x7f6634079170 2026-02-17T11:11:23.105 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.103+0000 7f66477fe640 1 -- 10.20.193.49:0/486060323 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f6650083850 con 0x7f666815b000 2026-02-17T11:11:23.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.103+0000 7f66477fe640 10 client.4703.objecter ms_dispatch2 0x7f6668000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:11:23.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.103+0000 7f66477fe640 3 client.4703.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:11:23.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.103+0000 7f66477fe640 3 client.4703.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:11:23.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.103+0000 7f66477fe640 20 client.4703.objecter dump_active .. 0 homeless 2026-02-17T11:11:23.211 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.209+0000 7f66477fe640 1 -- 10.20.193.49:0/486060323 <== mon.2 v2:10.20.193.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f6650087810 con 0x7f666815b000 2026-02-17T11:11:23.211 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.209+0000 7f66477fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:11:23.211 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.209+0000 7f66477fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:11:23.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.306+0000 7f666d775640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:11:23.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.306+0000 7f666d775640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:11:23.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.306+0000 7f666d775640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:11:23.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.306+0000 7f666d775640 1 -- 10.20.193.49:0/486060323 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f66681f7890 con 0x7f666815b000 2026-02-17T11:11:23.312 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.310+0000 7f66477fe640 1 -- 10.20.193.49:0/486060323 <== mon.2 v2:10.20.193.157:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f665008bb10 con 0x7f666815b000 2026-02-17T11:11:23.312 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.310+0000 7f66477fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:11:23.312 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.310+0000 7f66477fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:11:23.312 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:11:23.312 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:11:23.314 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.310+0000 7f666d775640 10 librados: watch_flush enter 2026-02-17T11:11:23.314 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.310+0000 7f666d775640 10 librados: watch_flush exit 2026-02-17T11:11:23.314 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.310+0000 7f666d775640 20 client.4703.objecter shutdown clearing up homeless session... 2026-02-17T11:11:23.314 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.310+0000 7f666d775640 10 client.4703.objecter successfully canceled tick 2026-02-17T11:11:23.314 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.310+0000 7f666d775640 1 -- 10.20.193.49:0/486060323 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f6634079170 msgr2=0x7f663407b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:23.314 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.310+0000 7f666d775640 1 --2- 10.20.193.49:0/486060323 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f6634079170 0x7f663407b630 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f665c009c60 tx=0x7f665c009290 comp rx=0 tx=0).stop 2026-02-17T11:11:23.314 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.310+0000 7f666d775640 10 monclient: shutdown 2026-02-17T11:11:23.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.310+0000 7f666d775640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:11:23.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.310+0000 7f666d775640 1 -- 10.20.193.49:0/486060323 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f666815b000 msgr2=0x7f666806d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:23.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.310+0000 7f666d775640 1 --2- 10.20.193.49:0/486060323 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f666815b000 0x7f666806d5f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f66680c93c0 tx=0x7f66500047c0 comp rx=0 tx=0).stop 2026-02-17T11:11:23.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.310+0000 7f666d775640 1 -- 10.20.193.49:0/486060323 shutdown_connections 2026-02-17T11:11:23.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.310+0000 7f666d775640 1 --2- 10.20.193.49:0/486060323 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f6634079170 0x7f663407b630 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:23.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.310+0000 7f666d775640 1 --2- 10.20.193.49:0/486060323 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f666815d370 0x7f666814b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:23.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.310+0000 7f666d775640 1 --2- 10.20.193.49:0/486060323 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f666815b000 0x7f666806d5f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:23.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.310+0000 7f666d775640 1 --2- 10.20.193.49:0/486060323 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f66680c7e20 0x7f6668143850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:23.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.310+0000 7f666d775640 1 -- 10.20.193.49:0/486060323 >> 10.20.193.49:0/486060323 conn(0x7f66680c9f20 msgr2=0x7f66680ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:11:23.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.311+0000 7f666d775640 1 -- 10.20.193.49:0/486060323 shutdown_connections 2026-02-17T11:11:23.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.311+0000 7f666d775640 1 -- 10.20.193.49:0/486060323 wait complete. 2026-02-17T11:11:23.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:23.311+0000 7f666d775640 1 librados: shutdown 2026-02-17T11:11:26.322 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:11:26.389 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.388+0000 7f2018bf5640 10 monclient: get_monmap_and_config 2026-02-17T11:11:26.390 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.388+0000 7f2018bf5640 10 monclient: build_initial_monmap 2026-02-17T11:11:26.390 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.388+0000 7f2018bf5640 10 monclient: monmap: 2026-02-17T11:11:26.390 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:11:26.390 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:26.390 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:11:26.389003+0000 2026-02-17T11:11:26.390 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:11:26.389003+0000 2026-02-17T11:11:26.390 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:11:26.390 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:26.390 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:11:26.391 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:11:26.391 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:11:26.391 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:11:26.391 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:11:26.391 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:11:26.391 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:26.393 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.388+0000 7f2018bf5640 1 Processor -- start 2026-02-17T11:11:26.393 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.388+0000 7f2018bf5640 1 -- start start 2026-02-17T11:11:26.393 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.388+0000 7f2018bf5640 10 monclient: init 2026-02-17T11:11:26.393 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.389+0000 7f2018bf5640 10 monclient: _reopen_session rank -1 2026-02-17T11:11:26.393 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.389+0000 7f2018bf5640 10 monclient: _add_conns ranks=[1,0,4,5,2,3] 2026-02-17T11:11:26.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.389+0000 7f2018bf5640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f20140c7170 addr v1:10.20.193.97:6789/0 2026-02-17T11:11:26.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.389+0000 7f2018bf5640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f20140c7550 addr v1:10.20.193.49:6789/0 2026-02-17T11:11:26.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.389+0000 7f2018bf5640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f20140c89c0 0x7f20140c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:26.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.389+0000 7f2018bf5640 10 monclient(hunting): picked mon.noname-b con 0x7f20140c89c0 addr v2:10.20.193.97:3300/0 2026-02-17T11:11:26.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.389+0000 7f2018bf5640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20140c4fd0 con 0x7f20140c7550 2026-02-17T11:11:26.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.389+0000 7f2018bf5640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f201415a9a0 con 0x7f20140c7170 2026-02-17T11:11:26.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.389+0000 7f2018bf5640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:26.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.389+0000 7f2018bf5640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f20140c8530 con 0x7f20140c89c0 2026-02-17T11:11:26.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.389+0000 7f2018bf5640 10 monclient(hunting): _renew_subs 2026-02-17T11:11:26.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.389+0000 7f2018bf5640 10 monclient(hunting): authenticate will time out at 1163.052490s 2026-02-17T11:11:26.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.389+0000 7f2011d74640 1 --1- >> v1:10.20.193.49:6789/0 conn(0x7f20140c7550 0x7f20140749b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.49:6789/0 says I am v1:10.20.193.49:44076/0 (socket says 10.20.193.49:44076) 2026-02-17T11:11:26.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.389+0000 7f2011d74640 1 -- 10.20.193.49:0/2055271612 learned_addr learned my addr 10.20.193.49:0/2055271612 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:11:26.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.390+0000 7f2012d76640 1 --2- 10.20.193.49:0/2055271612 >> v2:10.20.193.97:3300/0 conn(0x7f20140c89c0 0x7f20140c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:26.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.390+0000 7f2012d76640 10 monclient(hunting): get_auth_request con 0x7f20140c89c0 auth_method 0 2026-02-17T11:11:26.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.390+0000 7f2012d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:26.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.390+0000 7f2012d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:26.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.390+0000 7f2012d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:26.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.391+0000 7f2012d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:26.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.391+0000 7f2012d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:26.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.391+0000 7f2012d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:26.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.391+0000 7f2011573640 1 -- 10.20.193.49:0/2055271612 <== mon.0 v1:10.20.193.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 944426143 0 0) 0x7f20140c4fd0 con 0x7f20140c7550 2026-02-17T11:11:26.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.391+0000 7f2011573640 10 monclient(hunting): _negotiate 2026-02-17T11:11:26.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.391+0000 7f2011573640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:26.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.391+0000 7f2011573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:26.396 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.391+0000 7f2011573640 10 monclient(hunting): my global_id is 4707 2026-02-17T11:11:26.396 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.391+0000 7f2011573640 1 -- 10.20.193.49:0/2055271612 --> v1:10.20.193.49:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2000003620 con 0x7f20140c7550 2026-02-17T11:11:26.404 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.393+0000 7f2011573640 1 -- 10.20.193.49:0/2055271612 <== mon.0 v1:10.20.193.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3386666202 0 0) 0x7f2000003620 con 0x7f20140c7550 2026-02-17T11:11:26.404 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.393+0000 7f2011573640 1 -- 10.20.193.49:0/2055271612 >> v2:10.20.193.97:3300/0 conn(0x7f20140c89c0 msgr2=0x7f20140c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:11:26.404 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.393+0000 7f2011573640 1 --2- 10.20.193.49:0/2055271612 >> v2:10.20.193.97:3300/0 conn(0x7f20140c89c0 0x7f20140c8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:26.404 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.393+0000 7f2011573640 1 -- 10.20.193.49:0/2055271612 >> v1:10.20.193.97:6789/0 conn(0x7f20140c7170 legacy=0x7f20140c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:26.404 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.393+0000 7f2011573640 10 monclient: _finish_hunting 0 2026-02-17T11:11:26.404 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.393+0000 7f2011573640 1 monclient: found mon.noname-a-legacy 2026-02-17T11:11:26.405 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.393+0000 7f2011573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:11:26.405 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.393+0000 7f2011573640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.49:6789/0 2026-02-17T11:11:26.405 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.393+0000 7f2011573640 1 -- 10.20.193.49:0/2055271612 --> v1:10.20.193.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20140c5270 con 0x7f20140c7550 2026-02-17T11:11:26.405 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.393+0000 7f2011573640 10 monclient: _finish_auth 0 2026-02-17T11:11:26.405 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.393+0000 7f2011573640 10 monclient: _check_auth_tickets 2026-02-17T11:11:26.405 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.393+0000 7f2011573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:11:26.405 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.393+0000 7f2011573640 1 -- 10.20.193.49:0/2055271612 <== mon.0 v1:10.20.193.49:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2462710995 0 0) 0x7f1ffc002f00 con 0x7f20140c7550 2026-02-17T11:11:26.405 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.393+0000 7f2011573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:26.405 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.393+0000 7f2011573640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T11:11:26.405 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.393+0000 7f2011573640 10 monclient: dump: 2026-02-17T11:11:26.405 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:26.405 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:26.406 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:26.406 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:26.406 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:26.406 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:26.406 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:26.406 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:26.406 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:26.406 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:26.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.393+0000 7f2011573640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] but i'm connected to v1:10.20.193.49:6789/0, reconnecting 2026-02-17T11:11:26.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.393+0000 7f2011573640 10 monclient: _reopen_session rank -1 2026-02-17T11:11:26.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.393+0000 7f2011573640 1 -- 10.20.193.49:0/2055271612 >> v1:10.20.193.49:6789/0 conn(0x7f20140c7550 legacy=0x7f20140749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:26.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.393+0000 7f2011573640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:11:26.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.393+0000 7f2011573640 1 --2- 10.20.193.49:0/2055271612 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f2000003bf0 0x7f2000004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:26.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.393+0000 7f2011573640 10 monclient(hunting): picked mon.c con 0x7f2000003bf0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:11:26.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.393+0000 7f2011573640 1 --2- 10.20.193.49:0/2055271612 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f2000004900 0x7f2000004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:26.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.393+0000 7f2011573640 10 monclient(hunting): picked mon.a con 0x7f2000004900 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:11:26.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.393+0000 7f2011573640 1 --2- 10.20.193.49:0/2055271612 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f20000054c0 0x7f200000bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:26.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.393+0000 7f2011573640 10 monclient(hunting): picked mon.b con 0x7f20000054c0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:11:26.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.393+0000 7f2011573640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:26.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.393+0000 7f2011573640 1 -- 10.20.193.49:0/2055271612 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f20140c8530 con 0x7f2000004900 2026-02-17T11:11:26.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.393+0000 7f2011573640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:26.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.393+0000 7f2011573640 1 -- 10.20.193.49:0/2055271612 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f200000c330 con 0x7f20000054c0 2026-02-17T11:11:26.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.393+0000 7f2011573640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:26.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.393+0000 7f2011573640 1 -- 10.20.193.49:0/2055271612 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f200000c530 con 0x7f2000003bf0 2026-02-17T11:11:26.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.393+0000 7f2011573640 10 monclient(hunting): _renew_subs 2026-02-17T11:11:26.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.393+0000 7f2011573640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:11:26.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.393+0000 7f2012575640 1 --2- 10.20.193.49:0/2055271612 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f2000003bf0 0x7f2000004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:26.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.393+0000 7f2012575640 10 monclient(hunting): get_auth_request con 0x7f2000003bf0 auth_method 0 2026-02-17T11:11:26.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.393+0000 7f2012575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:26.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.393+0000 7f2012575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:26.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.394+0000 7f2012575640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:11:26.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.394+0000 7f2011d74640 1 --2- 10.20.193.49:0/2055271612 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f2000004900 0x7f2000004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:26.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.394+0000 7f2012575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:26.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.394+0000 7f2012575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:26.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.394+0000 7f2012575640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:11:26.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.394+0000 7f2011d74640 10 monclient(hunting): get_auth_request con 0x7f2000004900 auth_method 0 2026-02-17T11:11:26.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.394+0000 7f2011d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:26.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.394+0000 7f2011d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:26.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.394+0000 7f2011d74640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:11:26.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.394+0000 7f2011d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:26.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.394+0000 7f2011d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:26.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.395+0000 7f2011d74640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:11:26.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.395+0000 7f2012d76640 1 --2- 10.20.193.49:0/2055271612 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f20000054c0 0x7f200000bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:26.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.395+0000 7f2012d76640 10 monclient(hunting): get_auth_request con 0x7f20000054c0 auth_method 0 2026-02-17T11:11:26.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.395+0000 7f2012d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:26.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.395+0000 7f2012d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:26.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.395+0000 7f2012d76640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:11:26.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.395+0000 7f2012575640 10 monclient(hunting): handle_auth_done global_id 4707 payload 293 2026-02-17T11:11:26.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.395+0000 7f2012575640 1 -- 10.20.193.49:0/2055271612 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f20000054c0 msgr2=0x7f200000bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:11:26.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.395+0000 7f2012575640 1 --2- 10.20.193.49:0/2055271612 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f20000054c0 0x7f200000bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:26.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.395+0000 7f2012575640 1 -- 10.20.193.49:0/2055271612 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f2000004900 msgr2=0x7f2000004d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:11:26.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.395+0000 7f2012575640 1 --2- 10.20.193.49:0/2055271612 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f2000004900 0x7f2000004d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:26.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.395+0000 7f2012575640 10 monclient: _finish_hunting 0 2026-02-17T11:11:26.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.395+0000 7f2012575640 1 monclient: found mon.c 2026-02-17T11:11:26.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.395+0000 7f2012575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:11:26.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.395+0000 7f2012575640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:11:26.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.395+0000 7f2012575640 1 -- 10.20.193.49:0/2055271612 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2000003620 con 0x7f2000003bf0 2026-02-17T11:11:26.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.395+0000 7f2012d76640 1 -- 10.20.193.49:0/2055271612 reap_dead start 2026-02-17T11:11:26.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.395+0000 7f2012575640 10 monclient: _finish_auth 0 2026-02-17T11:11:26.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.395+0000 7f2012575640 10 monclient: _check_auth_tickets 2026-02-17T11:11:26.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.395+0000 7f2012575640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:11:26.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.395+0000 7f2018bf5640 5 monclient: authenticate success, global_id 4707 2026-02-17T11:11:26.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.395+0000 7f2018bf5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:11:26.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.396+0000 7f2012575640 1 --2- 10.20.193.49:0/2055271612 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f2000003bf0 0x7f2000004010 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f20080030a0 tx=0x7f200802edd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=341138e85d1a256a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:11:26.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.398+0000 7f2011573640 1 -- 10.20.193.49:0/2055271612 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2008002cc0 con 0x7f2000003bf0 2026-02-17T11:11:26.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.398+0000 7f2011573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:26.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.398+0000 7f2011573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:11:26.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.398+0000 7f2011573640 10 monclient: dump: 2026-02-17T11:11:26.411 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:26.411 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:26.411 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:26.411 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:26.412 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:26.412 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:26.412 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:26.412 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:26.412 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:26.412 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:26.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.398+0000 7f2018bf5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:11:26.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.398+0000 7f2011573640 1 -- 10.20.193.49:0/2055271612 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20080052d0 con 0x7f2000003bf0 2026-02-17T11:11:26.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.398+0000 7f2011573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:11:26.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.398+0000 7f2011573640 1 -- 10.20.193.49:0/2055271612 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20080036f0 con 0x7f2000003bf0 2026-02-17T11:11:26.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.398+0000 7f2011573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:26.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.398+0000 7f2011573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:11:26.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.398+0000 7f2011573640 10 monclient: dump: 2026-02-17T11:11:26.413 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:26.413 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:26.413 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:26.413 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:26.413 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:26.413 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:26.413 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:26.413 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:26.413 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:26.413 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:26.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.398+0000 7f2018bf5640 10 monclient: get_monmap_and_config success 2026-02-17T11:11:26.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.398+0000 7f2018bf5640 4 set_mon_vals no callback set 2026-02-17T11:11:26.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.398+0000 7f2018bf5640 10 monclient: shutdown 2026-02-17T11:11:26.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.398+0000 7f2018bf5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:11:26.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.398+0000 7f2018bf5640 1 -- 10.20.193.49:0/2055271612 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f2000003bf0 msgr2=0x7f2000004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:26.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.398+0000 7f2018bf5640 1 --2- 10.20.193.49:0/2055271612 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f2000003bf0 0x7f2000004010 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f20080030a0 tx=0x7f200802edd0 comp rx=0 tx=0).stop 2026-02-17T11:11:26.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.398+0000 7f2018bf5640 1 -- 10.20.193.49:0/2055271612 shutdown_connections 2026-02-17T11:11:26.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.398+0000 7f2018bf5640 1 --2- 10.20.193.49:0/2055271612 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f2000003bf0 0x7f2000004010 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:26.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.398+0000 7f2018bf5640 1 -- 10.20.193.49:0/2055271612 >> 10.20.193.49:0/2055271612 conn(0x7f20140c9f40 msgr2=0x7f20140ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:11:26.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.399+0000 7f2018bf5640 1 -- 10.20.193.49:0/2055271612 shutdown_connections 2026-02-17T11:11:26.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.399+0000 7f2018bf5640 1 -- 10.20.193.49:0/2055271612 wait complete. 2026-02-17T11:11:26.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.399+0000 7f2018bf5640 10 monclient: build_initial_monmap 2026-02-17T11:11:26.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.399+0000 7f2018bf5640 10 monclient: monmap: 2026-02-17T11:11:26.414 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:11:26.415 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:11:26.415 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:11:26.415 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:11:26.415 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:11:26.415 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:26.415 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:11:26.415 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:11:26.415 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:11:26.415 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:26.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.399+0000 7f2018bf5640 1 librados: starting msgr at 2026-02-17T11:11:26.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.399+0000 7f2018bf5640 1 librados: starting objecter 2026-02-17T11:11:26.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.399+0000 7f2018bf5640 1 Processor -- start 2026-02-17T11:11:26.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.399+0000 7f2018bf5640 1 -- start start 2026-02-17T11:11:26.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.399+0000 7f2018bf5640 1 librados: setting wanted keys 2026-02-17T11:11:26.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.399+0000 7f2018bf5640 1 librados: calling monclient init 2026-02-17T11:11:26.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.399+0000 7f2018bf5640 10 monclient: init 2026-02-17T11:11:26.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.400+0000 7f2018bf5640 10 monclient: _reopen_session rank -1 2026-02-17T11:11:26.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.400+0000 7f2018bf5640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:11:26.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.400+0000 7f2018bf5640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f2000003bf0 0x7f201415d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:26.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.400+0000 7f2018bf5640 10 monclient(hunting): picked mon.noname-a con 0x7f2000003bf0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:11:26.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.400+0000 7f2018bf5640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f2014156b40 0x7f201414dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:26.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.400+0000 7f2018bf5640 10 monclient(hunting): picked mon.noname-c con 0x7f2014156b40 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:11:26.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.400+0000 7f2018bf5640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f2014156fc0 0x7f201414e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:26.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.400+0000 7f2018bf5640 10 monclient(hunting): picked mon.noname-b con 0x7f2014156fc0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:11:26.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.400+0000 7f2018bf5640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:26.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.400+0000 7f2018bf5640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f20140c7ee0 con 0x7f2000003bf0 2026-02-17T11:11:26.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.400+0000 7f2018bf5640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:26.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.400+0000 7f2018bf5640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f20140c5830 con 0x7f2014156fc0 2026-02-17T11:11:26.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.400+0000 7f2018bf5640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:26.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.400+0000 7f2018bf5640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f20140c81c0 con 0x7f2014156b40 2026-02-17T11:11:26.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.400+0000 7f2018bf5640 10 monclient(hunting): _renew_subs 2026-02-17T11:11:26.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.400+0000 7f2018bf5640 10 monclient(hunting): authenticate will time out at 1163.063308s 2026-02-17T11:11:26.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.400+0000 7f2012575640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f2000003bf0 0x7f201415d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:26.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.400+0000 7f2011d74640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f2014156b40 0x7f201414dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:26.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.400+0000 7f2012d76640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f2014156fc0 0x7f201414e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:26.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.400+0000 7f2012575640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f2000003bf0 0x7f201415d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:51192/0 (socket says 10.20.193.49:51192) 2026-02-17T11:11:26.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.400+0000 7f2012575640 1 -- 10.20.193.49:0/4287356896 learned_addr learned my addr 10.20.193.49:0/4287356896 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:11:26.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.400+0000 7f2012575640 10 monclient(hunting): get_auth_request con 0x7f2000003bf0 auth_method 0 2026-02-17T11:11:26.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.400+0000 7f2012575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:26.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.400+0000 7f2012575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:26.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.400+0000 7f2012575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:26.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.400+0000 7f2011d74640 10 monclient(hunting): get_auth_request con 0x7f2014156b40 auth_method 0 2026-02-17T11:11:26.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.400+0000 7f2011d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:26.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.400+0000 7f2011d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:26.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.400+0000 7f2011d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:26.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.400+0000 7f2012d76640 10 monclient(hunting): get_auth_request con 0x7f2014156fc0 auth_method 0 2026-02-17T11:11:26.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.400+0000 7f2012d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:26.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.400+0000 7f2012d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:26.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.400+0000 7f2012d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:26.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.401+0000 7f2011d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:26.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.401+0000 7f2011d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:26.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.401+0000 7f2011d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:26.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.401+0000 7f2012575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:26.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.401+0000 7f2012575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:26.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.401+0000 7f2012575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:26.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.401+0000 7f2012d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:26.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.401+0000 7f2012d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:26.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.401+0000 7f2012d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:26.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.402+0000 7f2011d74640 10 monclient(hunting): handle_auth_done global_id 4706 payload 824 2026-02-17T11:11:26.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.402+0000 7f2011d74640 1 -- 10.20.193.49:0/4287356896 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f2014156fc0 msgr2=0x7f201414e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:26.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.402+0000 7f2011d74640 1 --2- 10.20.193.49:0/4287356896 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f2014156fc0 0x7f201414e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:26.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.402+0000 7f2011d74640 1 -- 10.20.193.49:0/4287356896 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f2000003bf0 msgr2=0x7f201415d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:26.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.402+0000 7f2011d74640 1 --2- 10.20.193.49:0/4287356896 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f2000003bf0 0x7f201415d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:26.420 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.402+0000 7f2011d74640 10 monclient: _finish_hunting 0 2026-02-17T11:11:26.420 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.402+0000 7f2011d74640 1 monclient: found mon.noname-c 2026-02-17T11:11:26.420 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.402+0000 7f2011d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:11:26.420 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.402+0000 7f2011d74640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:11:26.420 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.402+0000 7f2011d74640 1 -- 10.20.193.49:0/4287356896 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f201415c0d0 con 0x7f2014156b40 2026-02-17T11:11:26.423 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.403+0000 7f2011d74640 1 --2- 10.20.193.49:0/4287356896 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f2014156b40 0x7f201414dcf0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc002410 tx=0x7f1ffc007500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:11:26.423 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.403+0000 7f1ffaffd640 10 client.?.objecter ms_handle_connect 0x7f2014156b40 2026-02-17T11:11:26.423 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.403+0000 7f1ffaffd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:11:26.423 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.405+0000 7f1ffaffd640 1 -- 10.20.193.49:0/4287356896 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc00f780 con 0x7f2014156b40 2026-02-17T11:11:26.423 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.405+0000 7f1ffaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:26.424 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.405+0000 7f1ffaffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:11:26.424 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.405+0000 7f1ffaffd640 10 monclient: dump: 2026-02-17T11:11:26.424 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:26.424 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:26.424 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:26.424 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:26.424 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:26.424 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:26.424 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:26.424 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:26.424 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:26.424 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:26.424 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.405+0000 7f1ffaffd640 10 monclient: _finish_auth 0 2026-02-17T11:11:26.424 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.405+0000 7f1ffaffd640 10 monclient: _check_auth_tickets 2026-02-17T11:11:26.425 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.405+0000 7f1ffaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:11:26.425 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.405+0000 7f1ffaffd640 1 -- 10.20.193.49:0/4287356896 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ffc018070 con 0x7f2014156b40 2026-02-17T11:11:26.425 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.405+0000 7f1ffaffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:11:26.425 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.405+0000 7f1ffaffd640 1 -- 10.20.193.49:0/4287356896 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc00fb40 con 0x7f2014156b40 2026-02-17T11:11:26.425 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.405+0000 7f1ffaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:26.425 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.405+0000 7f1ffaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:11:26.425 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.405+0000 7f2010d72640 4 set_mon_vals no callback set 2026-02-17T11:11:26.425 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.405+0000 7f1ffaffd640 10 monclient: dump: 2026-02-17T11:11:26.425 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:26.425 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:26.425 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:26.425 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:26.425 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:26.425 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:26.426 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:26.426 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:26.426 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:26.426 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:26.426 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.405+0000 7f2018bf5640 5 monclient: authenticate success, global_id 4706 2026-02-17T11:11:26.426 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.405+0000 7f2018bf5640 10 monclient: _renew_subs 2026-02-17T11:11:26.426 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.405+0000 7f2018bf5640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:11:26.426 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.405+0000 7f2018bf5640 1 -- 10.20.193.49:0/4287356896 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f201415c3b0 con 0x7f2014156b40 2026-02-17T11:11:26.426 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.405+0000 7f2018bf5640 10 client.4706.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:11:26.426 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.405+0000 7f2018bf5640 10 monclient: _renew_subs 2026-02-17T11:11:26.426 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.405+0000 7f2018bf5640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:11:26.426 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.405+0000 7f2018bf5640 1 -- 10.20.193.49:0/4287356896 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f201415c970 con 0x7f2014156b40 2026-02-17T11:11:26.426 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.405+0000 7f2018bf5640 1 librados: init done 2026-02-17T11:11:26.427 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.405+0000 7f2018bf5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:11:26.427 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.406+0000 7f2018bf5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:11:26.427 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.406+0000 7f2018bf5640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:11:26.427 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.406+0000 7f2018bf5640 1 -- 10.20.193.49:0/4287356896 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20140c8e70 con 0x7f2014156b40 2026-02-17T11:11:26.427 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.417+0000 7f1ffaffd640 1 -- 10.20.193.49:0/4287356896 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f1ffc00fce0 con 0x7f2014156b40 2026-02-17T11:11:26.427 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.418+0000 7f1ffaffd640 1 --2- 10.20.193.49:0/4287356896 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f1fe0079170 0x7f1fe007b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:26.427 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.418+0000 7f2012575640 1 --2- 10.20.193.49:0/4287356896 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f1fe0079170 0x7f1fe007b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:26.427 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.418+0000 7f2012575640 10 monclient: get_auth_request con 0x7f1fe0079170 auth_method 0 2026-02-17T11:11:26.427 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.419+0000 7f2012575640 1 --2- 10.20.193.49:0/4287356896 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f1fe0079170 0x7f1fe007b630 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2008002e30 tx=0x7f2008033000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:11:26.427 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.419+0000 7f1ffaffd640 10 client.4706.objecter ms_handle_connect 0x7f1fe0079170 2026-02-17T11:11:26.427 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.420+0000 7f1ffaffd640 1 -- 10.20.193.49:0/4287356896 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f1ffc05e4e0 con 0x7f2014156b40 2026-02-17T11:11:26.427 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.420+0000 7f1ffaffd640 10 client.4706.objecter ms_dispatch2 0x7f2014000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:11:26.427 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.420+0000 7f1ffaffd640 3 client.4706.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:11:26.427 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.420+0000 7f1ffaffd640 3 client.4706.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:11:26.428 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.420+0000 7f1ffaffd640 20 client.4706.objecter dump_active .. 0 homeless 2026-02-17T11:11:26.525 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.524+0000 7f1ffaffd640 1 -- 10.20.193.49:0/4287356896 <== mon.2 v2:10.20.193.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f1ffc0624a0 con 0x7f2014156b40 2026-02-17T11:11:26.526 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.524+0000 7f1ffaffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:11:26.526 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.524+0000 7f1ffaffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:11:26.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.625+0000 7f2018bf5640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:11:26.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.625+0000 7f2018bf5640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:11:26.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.625+0000 7f2018bf5640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:11:26.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.625+0000 7f2018bf5640 1 -- 10.20.193.49:0/4287356896 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f20141574f0 con 0x7f2014156b40 2026-02-17T11:11:26.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.628+0000 7f1ffaffd640 1 -- 10.20.193.49:0/4287356896 <== mon.2 v2:10.20.193.157:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f1ffc0667a0 con 0x7f2014156b40 2026-02-17T11:11:26.630 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.628+0000 7f1ffaffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:11:26.630 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.628+0000 7f1ffaffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:11:26.630 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:11:26.630 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:11:26.632 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.629+0000 7f2018bf5640 10 librados: watch_flush enter 2026-02-17T11:11:26.632 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.629+0000 7f2018bf5640 10 librados: watch_flush exit 2026-02-17T11:11:26.632 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.629+0000 7f2018bf5640 20 client.4706.objecter shutdown clearing up homeless session... 2026-02-17T11:11:26.632 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.629+0000 7f2018bf5640 10 client.4706.objecter successfully canceled tick 2026-02-17T11:11:26.632 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.629+0000 7f2018bf5640 1 -- 10.20.193.49:0/4287356896 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f1fe0079170 msgr2=0x7f1fe007b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:26.632 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.629+0000 7f2018bf5640 1 --2- 10.20.193.49:0/4287356896 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f1fe0079170 0x7f1fe007b630 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2008002e30 tx=0x7f2008033000 comp rx=0 tx=0).stop 2026-02-17T11:11:26.632 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.629+0000 7f2018bf5640 10 monclient: shutdown 2026-02-17T11:11:26.632 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.629+0000 7f2018bf5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:11:26.632 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.629+0000 7f2018bf5640 1 -- 10.20.193.49:0/4287356896 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f2014156b40 msgr2=0x7f201414dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:26.633 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.629+0000 7f2018bf5640 1 --2- 10.20.193.49:0/4287356896 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f2014156b40 0x7f201414dcf0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc002410 tx=0x7f1ffc007500 comp rx=0 tx=0).stop 2026-02-17T11:11:26.633 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.629+0000 7f2018bf5640 1 -- 10.20.193.49:0/4287356896 shutdown_connections 2026-02-17T11:11:26.633 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.629+0000 7f2018bf5640 1 --2- 10.20.193.49:0/4287356896 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f1fe0079170 0x7f1fe007b630 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:26.633 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.629+0000 7f2018bf5640 1 --2- 10.20.193.49:0/4287356896 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f2014156fc0 0x7f201414e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:26.633 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.629+0000 7f2018bf5640 1 --2- 10.20.193.49:0/4287356896 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f2014156b40 0x7f201414dcf0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:26.633 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.629+0000 7f2018bf5640 1 --2- 10.20.193.49:0/4287356896 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f2000003bf0 0x7f201415d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:26.633 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.629+0000 7f2018bf5640 1 -- 10.20.193.49:0/4287356896 >> 10.20.193.49:0/4287356896 conn(0x7f20140c9f40 msgr2=0x7f2014157db0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:11:26.633 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.629+0000 7f2018bf5640 1 -- 10.20.193.49:0/4287356896 shutdown_connections 2026-02-17T11:11:26.633 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.629+0000 7f2018bf5640 1 -- 10.20.193.49:0/4287356896 wait complete. 2026-02-17T11:11:26.633 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:26.629+0000 7f2018bf5640 1 librados: shutdown 2026-02-17T11:11:29.640 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:11:29.709 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.708+0000 7f65d3043640 10 monclient: get_monmap_and_config 2026-02-17T11:11:29.709 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.708+0000 7f65d3043640 10 monclient: build_initial_monmap 2026-02-17T11:11:29.709 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.708+0000 7f65d3043640 10 monclient: monmap: 2026-02-17T11:11:29.710 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:11:29.710 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:29.710 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:11:29.708621+0000 2026-02-17T11:11:29.710 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:11:29.708621+0000 2026-02-17T11:11:29.710 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:11:29.710 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:29.710 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:11:29.710 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:11:29.710 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:11:29.710 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:11:29.710 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:11:29.710 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:11:29.711 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:29.714 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.708+0000 7f65d3043640 1 Processor -- start 2026-02-17T11:11:29.714 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.708+0000 7f65d3043640 1 -- start start 2026-02-17T11:11:29.714 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.708+0000 7f65d3043640 10 monclient: init 2026-02-17T11:11:29.714 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.709+0000 7f65d3043640 10 monclient: _reopen_session rank -1 2026-02-17T11:11:29.714 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.709+0000 7f65d3043640 10 monclient: _add_conns ranks=[4,5,3,1,0,2] 2026-02-17T11:11:29.714 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.709+0000 7f65d3043640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f65cc0c7170 0x7f65cc0c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:29.715 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.709+0000 7f65d3043640 10 monclient(hunting): picked mon.noname-b con 0x7f65cc0c7170 addr v2:10.20.193.97:3300/0 2026-02-17T11:11:29.715 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.709+0000 7f65d3043640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f65cc0c48c0 0x7f65cc0749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:29.715 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.709+0000 7f65d3043640 10 monclient(hunting): picked mon.noname-c con 0x7f65cc0c48c0 addr v2:10.20.193.157:3300/0 2026-02-17T11:11:29.715 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.709+0000 7f65d3043640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f65cc074ef0 0x7f65cc0c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:29.715 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.709+0000 7f65d3043640 10 monclient(hunting): picked mon.noname-a con 0x7f65cc074ef0 addr v2:10.20.193.49:3300/0 2026-02-17T11:11:29.715 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.709+0000 7f65d3043640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:29.715 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.709+0000 7f65d3043640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f65cc0c8530 con 0x7f65cc074ef0 2026-02-17T11:11:29.715 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.709+0000 7f65d3043640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:29.715 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.709+0000 7f65d3043640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f65cc15a9a0 con 0x7f65cc0c7170 2026-02-17T11:11:29.715 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.709+0000 7f65d3043640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:29.715 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.709+0000 7f65d3043640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f65cc0c5270 con 0x7f65cc0c48c0 2026-02-17T11:11:29.715 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.709+0000 7f65d3043640 10 monclient(hunting): _renew_subs 2026-02-17T11:11:29.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.709+0000 7f65d3043640 10 monclient(hunting): authenticate will time out at 1166.372100s 2026-02-17T11:11:29.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.709+0000 7f65d15b9640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f65cc074ef0 0x7f65cc0c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:29.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.709+0000 7f65d0db8640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f65cc0c7170 0x7f65cc0c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:29.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.709+0000 7f65c3fff640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f65cc0c48c0 0x7f65cc0749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:29.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.709+0000 7f65d15b9640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f65cc074ef0 0x7f65cc0c89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:51204/0 (socket says 10.20.193.49:51204) 2026-02-17T11:11:29.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.709+0000 7f65d15b9640 1 -- 10.20.193.49:0/4254235300 learned_addr learned my addr 10.20.193.49:0/4254235300 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:11:29.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.709+0000 7f65d15b9640 10 monclient(hunting): get_auth_request con 0x7f65cc074ef0 auth_method 0 2026-02-17T11:11:29.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.709+0000 7f65d15b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:29.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.709+0000 7f65d15b9640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:29.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.709+0000 7f65d15b9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:29.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.709+0000 7f65d0db8640 10 monclient(hunting): get_auth_request con 0x7f65cc0c7170 auth_method 0 2026-02-17T11:11:29.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.709+0000 7f65d0db8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:29.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.709+0000 7f65d0db8640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:29.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.709+0000 7f65d0db8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:29.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.709+0000 7f65c3fff640 10 monclient(hunting): get_auth_request con 0x7f65cc0c48c0 auth_method 0 2026-02-17T11:11:29.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.709+0000 7f65c3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:29.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.709+0000 7f65c3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:29.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.709+0000 7f65c3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:29.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.710+0000 7f65d15b9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:29.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.710+0000 7f65d15b9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:29.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.710+0000 7f65d15b9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:29.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.710+0000 7f65d0db8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:29.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.710+0000 7f65d0db8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:29.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.710+0000 7f65d0db8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:29.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.710+0000 7f65c3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:29.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.710+0000 7f65c3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:29.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.710+0000 7f65c3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:29.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.711+0000 7f65d0db8640 10 monclient(hunting): handle_auth_done global_id 4687 payload 274 2026-02-17T11:11:29.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.711+0000 7f65d0db8640 1 -- 10.20.193.49:0/4254235300 >> v2:10.20.193.157:3300/0 conn(0x7f65cc0c48c0 msgr2=0x7f65cc0749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:11:29.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.711+0000 7f65d0db8640 1 --2- 10.20.193.49:0/4254235300 >> v2:10.20.193.157:3300/0 conn(0x7f65cc0c48c0 0x7f65cc0749b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:29.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.711+0000 7f65d0db8640 1 -- 10.20.193.49:0/4254235300 >> v2:10.20.193.49:3300/0 conn(0x7f65cc074ef0 msgr2=0x7f65cc0c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:11:29.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.711+0000 7f65d0db8640 1 --2- 10.20.193.49:0/4254235300 >> v2:10.20.193.49:3300/0 conn(0x7f65cc074ef0 0x7f65cc0c89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:29.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.711+0000 7f65d0db8640 10 monclient: _finish_hunting 0 2026-02-17T11:11:29.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.711+0000 7f65d0db8640 1 monclient: found mon.noname-b 2026-02-17T11:11:29.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.711+0000 7f65d0db8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:11:29.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.711+0000 7f65d0db8640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:11:29.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.711+0000 7f65d0db8640 1 -- 10.20.193.49:0/4254235300 --> v2:10.20.193.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65cc0c5550 con 0x7f65cc0c7170 2026-02-17T11:11:29.719 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.712+0000 7f65d0db8640 1 --2- 10.20.193.49:0/4254235300 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f65cc0c7170 0x7f65cc0c7550 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f65cc0723c0 tx=0x7f65bc02edc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ab5394074aeeb31 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:11:29.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.714+0000 7f65c37fe640 1 -- 10.20.193.49:0/4254235300 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65bc03c070 con 0x7f65cc0c7170 2026-02-17T11:11:29.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.714+0000 7f65c37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:29.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.714+0000 7f65c37fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:11:29.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.714+0000 7f65c37fe640 10 monclient: dump: 2026-02-17T11:11:29.725 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:29.725 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:29.726 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:29.726 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:29.726 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:29.726 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:29.726 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:29.726 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:29.726 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:29.726 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:29.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.714+0000 7f65c37fe640 10 monclient: _finish_auth 0 2026-02-17T11:11:29.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.714+0000 7f65c37fe640 10 monclient: _check_auth_tickets 2026-02-17T11:11:29.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.714+0000 7f65c37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:11:29.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.714+0000 7f65c37fe640 1 -- 10.20.193.49:0/4254235300 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65bc02fa80 con 0x7f65cc0c7170 2026-02-17T11:11:29.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.714+0000 7f65d3043640 5 monclient: authenticate success, global_id 4687 2026-02-17T11:11:29.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.714+0000 7f65c37fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:11:29.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.714+0000 7f65c37fe640 1 -- 10.20.193.49:0/4254235300 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65bc02fe50 con 0x7f65cc0c7170 2026-02-17T11:11:29.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.714+0000 7f65d3043640 10 monclient: get_monmap_and_config success 2026-02-17T11:11:29.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.714+0000 7f65d3043640 4 set_mon_vals no callback set 2026-02-17T11:11:29.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.714+0000 7f65c37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:29.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.714+0000 7f65c37fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:11:29.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.714+0000 7f65c37fe640 10 monclient: dump: 2026-02-17T11:11:29.727 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:29.727 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:29.727 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:29.727 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:29.728 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:29.728 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:29.728 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:29.728 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:29.728 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:29.728 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:29.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.714+0000 7f65d3043640 10 monclient: shutdown 2026-02-17T11:11:29.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.714+0000 7f65d3043640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:11:29.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.714+0000 7f65d3043640 1 -- 10.20.193.49:0/4254235300 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f65cc0c7170 msgr2=0x7f65cc0c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:29.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.714+0000 7f65d3043640 1 --2- 10.20.193.49:0/4254235300 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f65cc0c7170 0x7f65cc0c7550 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f65cc0723c0 tx=0x7f65bc02edc0 comp rx=0 tx=0).stop 2026-02-17T11:11:29.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.714+0000 7f65d3043640 1 -- 10.20.193.49:0/4254235300 shutdown_connections 2026-02-17T11:11:29.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.714+0000 7f65d3043640 1 --2- 10.20.193.49:0/4254235300 >> v2:10.20.193.49:3300/0 conn(0x7f65cc074ef0 0x7f65cc0c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:29.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.714+0000 7f65d3043640 1 --2- 10.20.193.49:0/4254235300 >> v2:10.20.193.157:3300/0 conn(0x7f65cc0c48c0 0x7f65cc0749b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:29.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.714+0000 7f65d3043640 1 --2- 10.20.193.49:0/4254235300 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f65cc0c7170 0x7f65cc0c7550 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:29.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.714+0000 7f65d3043640 1 -- 10.20.193.49:0/4254235300 >> 10.20.193.49:0/4254235300 conn(0x7f65cc0c9f40 msgr2=0x7f65cc0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:11:29.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.714+0000 7f65d3043640 1 -- 10.20.193.49:0/4254235300 shutdown_connections 2026-02-17T11:11:29.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.714+0000 7f65d3043640 1 -- 10.20.193.49:0/4254235300 wait complete. 2026-02-17T11:11:29.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.715+0000 7f65d3043640 10 monclient: build_initial_monmap 2026-02-17T11:11:29.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.715+0000 7f65d3043640 10 monclient: monmap: 2026-02-17T11:11:29.729 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:11:29.729 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:11:29.729 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:11:29.729 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:11:29.730 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:11:29.730 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:29.730 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:11:29.730 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:11:29.730 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:11:29.730 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:29.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.715+0000 7f65d3043640 1 librados: starting msgr at 2026-02-17T11:11:29.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.715+0000 7f65d3043640 1 librados: starting objecter 2026-02-17T11:11:29.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.715+0000 7f65d3043640 1 Processor -- start 2026-02-17T11:11:29.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.715+0000 7f65d3043640 1 -- start start 2026-02-17T11:11:29.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.715+0000 7f65d3043640 1 librados: setting wanted keys 2026-02-17T11:11:29.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.715+0000 7f65d3043640 1 librados: calling monclient init 2026-02-17T11:11:29.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.715+0000 7f65d3043640 10 monclient: init 2026-02-17T11:11:29.731 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.715+0000 7f65d3043640 10 monclient: _reopen_session rank -1 2026-02-17T11:11:29.731 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.715+0000 7f65d3043640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:11:29.731 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.715+0000 7f65d3043640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f65cc074ef0 0x7f65cc15da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:29.731 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.715+0000 7f65d3043640 10 monclient(hunting): picked mon.noname-a con 0x7f65cc074ef0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:11:29.731 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.715+0000 7f65d3043640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f65cc0c48c0 0x7f65cc1f4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:29.731 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.715+0000 7f65d3043640 10 monclient(hunting): picked mon.noname-b con 0x7f65cc0c48c0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:11:29.731 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.715+0000 7f65d3043640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f65cc0c7170 0x7f65cc1f37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:29.731 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.715+0000 7f65d3043640 10 monclient(hunting): picked mon.noname-c con 0x7f65cc0c7170 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:11:29.731 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.715+0000 7f65d3043640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:29.731 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.715+0000 7f65d3043640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f65cc0c81c0 con 0x7f65cc074ef0 2026-02-17T11:11:29.731 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.715+0000 7f65d3043640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:29.731 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.715+0000 7f65d3043640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f65cc0c7ee0 con 0x7f65cc0c48c0 2026-02-17T11:11:29.732 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.715+0000 7f65d3043640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:29.732 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.715+0000 7f65d3043640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f65cc0c4d10 con 0x7f65cc0c7170 2026-02-17T11:11:29.732 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.715+0000 7f65d3043640 10 monclient(hunting): _renew_subs 2026-02-17T11:11:29.732 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.715+0000 7f65d3043640 10 monclient(hunting): authenticate will time out at 1166.378830s 2026-02-17T11:11:29.732 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.716+0000 7f65d0db8640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f65cc074ef0 0x7f65cc15da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:29.732 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.716+0000 7f65d15b9640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f65cc0c7170 0x7f65cc1f37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:29.732 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.716+0000 7f65c3fff640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f65cc0c48c0 0x7f65cc1f4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:29.732 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.716+0000 7f65d0db8640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f65cc074ef0 0x7f65cc15da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:51218/0 (socket says 10.20.193.49:51218) 2026-02-17T11:11:29.732 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.716+0000 7f65d0db8640 1 -- 10.20.193.49:0/3135967551 learned_addr learned my addr 10.20.193.49:0/3135967551 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:11:29.732 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.716+0000 7f65d0db8640 10 monclient(hunting): get_auth_request con 0x7f65cc074ef0 auth_method 0 2026-02-17T11:11:29.732 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.716+0000 7f65d0db8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:29.732 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.716+0000 7f65d0db8640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:29.733 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.716+0000 7f65d0db8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:29.733 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.716+0000 7f65c3fff640 10 monclient(hunting): get_auth_request con 0x7f65cc0c48c0 auth_method 0 2026-02-17T11:11:29.733 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.716+0000 7f65c3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:29.733 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.716+0000 7f65c3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:29.733 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.716+0000 7f65c3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:29.733 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.716+0000 7f65d15b9640 10 monclient(hunting): get_auth_request con 0x7f65cc0c7170 auth_method 0 2026-02-17T11:11:29.733 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.716+0000 7f65d15b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:29.733 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.716+0000 7f65d15b9640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:29.733 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.716+0000 7f65d15b9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:29.733 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.716+0000 7f65d0db8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:29.733 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.716+0000 7f65d0db8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:29.733 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.716+0000 7f65d0db8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:29.733 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.716+0000 7f65c3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:29.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.716+0000 7f65c3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:29.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.716+0000 7f65c3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:29.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.716+0000 7f65d15b9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:29.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.716+0000 7f65d15b9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:29.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.716+0000 7f65d15b9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:29.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.717+0000 7f65d0db8640 10 monclient(hunting): handle_auth_done global_id 4716 payload 824 2026-02-17T11:11:29.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.717+0000 7f65d0db8640 1 -- 10.20.193.49:0/3135967551 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f65cc0c7170 msgr2=0x7f65cc1f37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:29.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.717+0000 7f65d0db8640 1 --2- 10.20.193.49:0/3135967551 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f65cc0c7170 0x7f65cc1f37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:29.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.717+0000 7f65d0db8640 1 -- 10.20.193.49:0/3135967551 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f65cc0c48c0 msgr2=0x7f65cc1f4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:29.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.717+0000 7f65d0db8640 1 --2- 10.20.193.49:0/3135967551 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f65cc0c48c0 0x7f65cc1f4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:29.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.717+0000 7f65d0db8640 10 monclient: _finish_hunting 0 2026-02-17T11:11:29.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.717+0000 7f65d0db8640 1 monclient: found mon.noname-a 2026-02-17T11:11:29.735 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.717+0000 7f65d0db8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:11:29.735 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.717+0000 7f65d0db8640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:11:29.735 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.717+0000 7f65d0db8640 1 -- 10.20.193.49:0/3135967551 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65cc1f2740 con 0x7f65cc074ef0 2026-02-17T11:11:29.735 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.719+0000 7f65d0db8640 1 --2- 10.20.193.49:0/3135967551 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f65cc074ef0 0x7f65cc15da60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f65bc009970 tx=0x7f65bc0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:11:29.735 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.719+0000 7f65c17fa640 10 client.?.objecter ms_handle_connect 0x7f65cc074ef0 2026-02-17T11:11:29.735 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.719+0000 7f65c17fa640 10 client.?.objecter resend_mon_ops 2026-02-17T11:11:29.735 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.720+0000 7f65c17fa640 1 -- 10.20.193.49:0/3135967551 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65bc03c040 con 0x7f65cc074ef0 2026-02-17T11:11:29.735 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.720+0000 7f65c17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:29.735 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.720+0000 7f65c17fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:11:29.735 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.720+0000 7f65c17fa640 10 monclient: dump: 2026-02-17T11:11:29.735 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:29.735 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:29.735 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:29.736 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:29.736 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:29.736 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:29.736 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:29.736 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:29.736 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:29.736 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:29.736 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.720+0000 7f65c17fa640 10 monclient: _finish_auth 0 2026-02-17T11:11:29.736 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.720+0000 7f65c17fa640 10 monclient: _check_auth_tickets 2026-02-17T11:11:29.736 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.720+0000 7f65c17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:11:29.736 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.720+0000 7f65c17fa640 1 -- 10.20.193.49:0/3135967551 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65bc042430 con 0x7f65cc074ef0 2026-02-17T11:11:29.736 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.720+0000 7f65c17fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:11:29.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.720+0000 7f65c17fa640 1 -- 10.20.193.49:0/3135967551 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65bc042800 con 0x7f65cc074ef0 2026-02-17T11:11:29.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.720+0000 7f65c17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:29.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.720+0000 7f65c17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:11:29.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.720+0000 7f65c2ffd640 4 set_mon_vals no callback set 2026-02-17T11:11:29.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.720+0000 7f65c17fa640 10 monclient: dump: 2026-02-17T11:11:29.737 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:29.737 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:29.737 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:29.737 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:29.737 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:29.737 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:29.737 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:29.737 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:29.738 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:29.738 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:29.738 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.720+0000 7f65d3043640 5 monclient: authenticate success, global_id 4716 2026-02-17T11:11:29.738 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.720+0000 7f65d3043640 10 monclient: _renew_subs 2026-02-17T11:11:29.738 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.720+0000 7f65d3043640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:11:29.738 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.720+0000 7f65d3043640 1 -- 10.20.193.49:0/3135967551 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65cc1f29e0 con 0x7f65cc074ef0 2026-02-17T11:11:29.738 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.721+0000 7f65d3043640 10 client.4716.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:11:29.738 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.721+0000 7f65d3043640 10 monclient: _renew_subs 2026-02-17T11:11:29.738 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.721+0000 7f65d3043640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:11:29.738 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.721+0000 7f65d3043640 1 -- 10.20.193.49:0/3135967551 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65cc1f2fa0 con 0x7f65cc074ef0 2026-02-17T11:11:29.738 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.721+0000 7f65d3043640 1 librados: init done 2026-02-17T11:11:29.738 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.721+0000 7f65d3043640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:11:29.739 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.721+0000 7f65d3043640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:11:29.739 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.721+0000 7f65d3043640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:11:29.739 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.721+0000 7f65d3043640 1 -- 10.20.193.49:0/3135967551 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65cc0749b0 con 0x7f65cc074ef0 2026-02-17T11:11:29.828 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.827+0000 7f65c17fa640 1 -- 10.20.193.49:0/3135967551 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f65bc0429a0 con 0x7f65cc074ef0 2026-02-17T11:11:29.828 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.827+0000 7f65c17fa640 1 --2- 10.20.193.49:0/3135967551 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f659c079190 0x7f659c07b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:29.829 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.827+0000 7f65c3fff640 1 --2- 10.20.193.49:0/3135967551 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f659c079190 0x7f659c07b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:29.829 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.827+0000 7f65c3fff640 10 monclient: get_auth_request con 0x7f659c079190 auth_method 0 2026-02-17T11:11:29.830 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.828+0000 7f65c17fa640 10 client.4716.objecter ms_handle_connect 0x7f659c079190 2026-02-17T11:11:29.830 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.828+0000 7f65c3fff640 1 --2- 10.20.193.49:0/3135967551 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f659c079190 0x7f659c07b650 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f65cc1f58a0 tx=0x7f65b4009290 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:11:29.836 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.835+0000 7f65c17fa640 1 -- 10.20.193.49:0/3135967551 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f65bc083920 con 0x7f65cc074ef0 2026-02-17T11:11:29.837 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.835+0000 7f65c17fa640 10 client.4716.objecter ms_dispatch2 0x7f65cc000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:11:29.837 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.835+0000 7f65c17fa640 3 client.4716.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:11:29.837 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.835+0000 7f65c17fa640 3 client.4716.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:11:29.837 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.835+0000 7f65c17fa640 20 client.4716.objecter dump_active .. 0 homeless 2026-02-17T11:11:29.837 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.835+0000 7f65c17fa640 1 -- 10.20.193.49:0/3135967551 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f65bc0878e0 con 0x7f65cc074ef0 2026-02-17T11:11:29.837 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.835+0000 7f65c17fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:11:29.837 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.835+0000 7f65c17fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:11:29.937 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.936+0000 7f65d3043640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:11:29.937 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.936+0000 7f65d3043640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:11:29.938 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.936+0000 7f65d3043640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:11:29.938 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.936+0000 7f65d3043640 1 -- 10.20.193.49:0/3135967551 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f65cc070d70 con 0x7f65cc074ef0 2026-02-17T11:11:29.940 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.938+0000 7f65c17fa640 1 -- 10.20.193.49:0/3135967551 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f65bc08bbe0 con 0x7f65cc074ef0 2026-02-17T11:11:29.940 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.938+0000 7f65c17fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:11:29.940 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.938+0000 7f65c17fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:11:29.940 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:11:29.940 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:11:29.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.939+0000 7f65d3043640 10 librados: watch_flush enter 2026-02-17T11:11:29.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.939+0000 7f65d3043640 10 librados: watch_flush exit 2026-02-17T11:11:29.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.939+0000 7f65d3043640 20 client.4716.objecter shutdown clearing up homeless session... 2026-02-17T11:11:29.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.939+0000 7f65d3043640 10 client.4716.objecter successfully canceled tick 2026-02-17T11:11:29.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.939+0000 7f65d3043640 1 -- 10.20.193.49:0/3135967551 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f659c079190 msgr2=0x7f659c07b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:29.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.939+0000 7f65d3043640 1 --2- 10.20.193.49:0/3135967551 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f659c079190 0x7f659c07b650 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f65cc1f58a0 tx=0x7f65b4009290 comp rx=0 tx=0).stop 2026-02-17T11:11:29.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.939+0000 7f65d3043640 10 monclient: shutdown 2026-02-17T11:11:29.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.939+0000 7f65d3043640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:11:29.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.939+0000 7f65d3043640 1 -- 10.20.193.49:0/3135967551 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f65cc074ef0 msgr2=0x7f65cc15da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:29.943 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.939+0000 7f65d3043640 1 --2- 10.20.193.49:0/3135967551 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f65cc074ef0 0x7f65cc15da60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f65bc009970 tx=0x7f65bc0047c0 comp rx=0 tx=0).stop 2026-02-17T11:11:29.943 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.939+0000 7f65d3043640 1 -- 10.20.193.49:0/3135967551 shutdown_connections 2026-02-17T11:11:29.943 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.939+0000 7f65d3043640 1 --2- 10.20.193.49:0/3135967551 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f659c079190 0x7f659c07b650 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:29.943 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.939+0000 7f65d3043640 1 --2- 10.20.193.49:0/3135967551 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f65cc0c7170 0x7f65cc1f37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:29.943 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.939+0000 7f65d3043640 1 --2- 10.20.193.49:0/3135967551 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f65cc0c48c0 0x7f65cc1f4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:29.943 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.939+0000 7f65d3043640 1 --2- 10.20.193.49:0/3135967551 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f65cc074ef0 0x7f65cc15da60 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:29.943 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.939+0000 7f65d3043640 1 -- 10.20.193.49:0/3135967551 >> 10.20.193.49:0/3135967551 conn(0x7f65cc0c9f40 msgr2=0x7f65cc0ccbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:11:29.943 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.939+0000 7f65d3043640 1 -- 10.20.193.49:0/3135967551 shutdown_connections 2026-02-17T11:11:29.943 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.939+0000 7f65d3043640 1 -- 10.20.193.49:0/3135967551 wait complete. 2026-02-17T11:11:29.943 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:29.939+0000 7f65d3043640 1 librados: shutdown 2026-02-17T11:11:31.804 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:03:17.285 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:11:31.807 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:03:17.288 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:11:31.815 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:03:17.296 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:11:31.833 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:03:17.275 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:11:31.834 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:03:17.309 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:11:31.834 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:03:17.277 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:11:31.836 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:03:17.312 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:11:31.842 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:03:17.284 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:11:31.844 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:03:17.319 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:11:32.950 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:11:33.018 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.016+0000 7f84f9d6a640 10 monclient: get_monmap_and_config 2026-02-17T11:11:33.018 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.016+0000 7f84f9d6a640 10 monclient: build_initial_monmap 2026-02-17T11:11:33.018 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.016+0000 7f84f9d6a640 10 monclient: monmap: 2026-02-17T11:11:33.019 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:11:33.019 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:33.019 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:11:33.017370+0000 2026-02-17T11:11:33.019 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:11:33.017370+0000 2026-02-17T11:11:33.019 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:11:33.019 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:33.019 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:11:33.019 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:11:33.019 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:11:33.019 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:11:33.020 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:11:33.020 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:11:33.020 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:33.023 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.017+0000 7f84f9d6a640 1 Processor -- start 2026-02-17T11:11:33.023 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.017+0000 7f84f9d6a640 1 -- start start 2026-02-17T11:11:33.023 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.017+0000 7f84f9d6a640 10 monclient: init 2026-02-17T11:11:33.023 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.017+0000 7f84f9d6a640 10 monclient: _reopen_session rank -1 2026-02-17T11:11:33.023 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.017+0000 7f84f9d6a640 10 monclient: _add_conns ranks=[0,2,3,4,1,5] 2026-02-17T11:11:33.023 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.017+0000 7f84f9d6a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f84f40c7170 addr v1:10.20.193.49:6789/0 2026-02-17T11:11:33.023 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.017+0000 7f84f9d6a640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f84f40c7550 addr v1:10.20.193.157:6789/0 2026-02-17T11:11:33.023 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.017+0000 7f84f9d6a640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f84f40c89c0 0x7f84f40c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:33.023 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.017+0000 7f84f9d6a640 10 monclient(hunting): picked mon.noname-a con 0x7f84f40c89c0 addr v2:10.20.193.49:3300/0 2026-02-17T11:11:33.024 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.017+0000 7f84f9d6a640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84f40c4fd0 con 0x7f84f40c7170 2026-02-17T11:11:33.024 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.017+0000 7f84f9d6a640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84f415a9a0 con 0x7f84f40c7550 2026-02-17T11:11:33.024 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.017+0000 7f84f9d6a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:33.024 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.017+0000 7f84f9d6a640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f84f40c8530 con 0x7f84f40c89c0 2026-02-17T11:11:33.024 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.017+0000 7f84f9d6a640 10 monclient(hunting): _renew_subs 2026-02-17T11:11:33.024 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.017+0000 7f84f9d6a640 10 monclient(hunting): authenticate will time out at 1169.680951s 2026-02-17T11:11:33.024 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.018+0000 7f84f3fff640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f84f40c89c0 0x7f84f40c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:33.024 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.018+0000 7f84f2ffd640 1 --1- >> v1:10.20.193.157:6789/0 conn(0x7f84f40c7550 0x7f84f40749b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.157:6789/0 says I am v1:10.20.193.49:34288/0 (socket says 10.20.193.49:34288) 2026-02-17T11:11:33.024 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.018+0000 7f84f2ffd640 1 -- 10.20.193.49:0/26186277 learned_addr learned my addr 10.20.193.49:0/26186277 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:11:33.024 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.018+0000 7f84f3fff640 10 monclient(hunting): get_auth_request con 0x7f84f40c89c0 auth_method 0 2026-02-17T11:11:33.024 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.018+0000 7f84f3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:33.025 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.018+0000 7f84f3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:33.025 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.018+0000 7f84f3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:33.025 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.019+0000 7f84f3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:33.025 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.019+0000 7f84f3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:33.025 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.019+0000 7f84f3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:33.025 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.019+0000 7f84f27fc640 1 -- 10.20.193.49:0/26186277 <== mon.2 v1:10.20.193.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 959822220 0 0) 0x7f84f415a9a0 con 0x7f84f40c7550 2026-02-17T11:11:33.025 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.019+0000 7f84f27fc640 10 monclient(hunting): _negotiate 2026-02-17T11:11:33.025 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.019+0000 7f84f27fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:33.025 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.019+0000 7f84f27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:33.025 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.019+0000 7f84f27fc640 10 monclient(hunting): my global_id is 4715 2026-02-17T11:11:33.025 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.019+0000 7f84f27fc640 1 -- 10.20.193.49:0/26186277 --> v1:10.20.193.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f84d8003620 con 0x7f84f40c7550 2026-02-17T11:11:33.025 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.021+0000 7f84f3fff640 10 monclient(hunting): handle_auth_done global_id 4719 payload 274 2026-02-17T11:11:33.025 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.021+0000 7f84f3fff640 1 -- 10.20.193.49:0/26186277 >> v1:10.20.193.157:6789/0 conn(0x7f84f40c7550 legacy=0x7f84f40749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:33.026 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.021+0000 7f84f3fff640 1 -- 10.20.193.49:0/26186277 >> v1:10.20.193.49:6789/0 conn(0x7f84f40c7170 legacy=0x7f84f40c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:33.026 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.021+0000 7f84f3fff640 10 monclient: _finish_hunting 0 2026-02-17T11:11:33.026 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.021+0000 7f84f3fff640 1 monclient: found mon.noname-a 2026-02-17T11:11:33.026 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.021+0000 7f84f3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:11:33.026 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.021+0000 7f84f3fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:11:33.026 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.021+0000 7f84f3fff640 1 -- 10.20.193.49:0/26186277 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84f40c5270 con 0x7f84f40c89c0 2026-02-17T11:11:33.031 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.023+0000 7f84f3fff640 1 --2- 10.20.193.49:0/26186277 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f84f40c89c0 0x7f84f40c8e70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f84e8009d90 tx=0x7f84e802f230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73271a32cbb76a1b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:11:33.031 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.025+0000 7f84f27fc640 1 -- 10.20.193.49:0/26186277 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e803c070 con 0x7f84f40c89c0 2026-02-17T11:11:33.031 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.025+0000 7f84f27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:33.031 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.025+0000 7f84f27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:11:33.031 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.025+0000 7f84f27fc640 10 monclient: dump: 2026-02-17T11:11:33.031 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:33.031 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:33.032 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:33.032 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:33.032 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:33.032 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:33.032 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:33.032 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:33.032 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:33.032 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:33.032 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.025+0000 7f84f27fc640 10 monclient: _finish_auth 0 2026-02-17T11:11:33.032 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.025+0000 7f84f27fc640 10 monclient: _check_auth_tickets 2026-02-17T11:11:33.033 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.025+0000 7f84f27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:11:33.033 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.025+0000 7f84f27fc640 1 -- 10.20.193.49:0/26186277 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84e8037440 con 0x7f84f40c89c0 2026-02-17T11:11:33.033 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.025+0000 7f84f27fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:11:33.033 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.025+0000 7f84f9d6a640 5 monclient: authenticate success, global_id 4719 2026-02-17T11:11:33.033 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.025+0000 7f84f27fc640 1 -- 10.20.193.49:0/26186277 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e8037810 con 0x7f84f40c89c0 2026-02-17T11:11:33.033 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.025+0000 7f84f9d6a640 10 monclient: get_monmap_and_config success 2026-02-17T11:11:33.033 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.025+0000 7f84f9d6a640 4 set_mon_vals no callback set 2026-02-17T11:11:33.033 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.025+0000 7f84f27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:33.033 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.025+0000 7f84f27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:11:33.033 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.025+0000 7f84f27fc640 10 monclient: dump: 2026-02-17T11:11:33.033 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:33.033 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:33.034 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:33.034 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:33.034 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:33.034 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:33.034 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:33.034 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:33.034 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:33.034 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:33.034 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.025+0000 7f84f9d6a640 10 monclient: shutdown 2026-02-17T11:11:33.034 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.025+0000 7f84f9d6a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:11:33.034 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.025+0000 7f84f9d6a640 1 -- 10.20.193.49:0/26186277 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f84f40c89c0 msgr2=0x7f84f40c8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:33.034 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.025+0000 7f84f9d6a640 1 --2- 10.20.193.49:0/26186277 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f84f40c89c0 0x7f84f40c8e70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f84e8009d90 tx=0x7f84e802f230 comp rx=0 tx=0).stop 2026-02-17T11:11:33.035 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.025+0000 7f84f9d6a640 1 -- 10.20.193.49:0/26186277 shutdown_connections 2026-02-17T11:11:33.035 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.025+0000 7f84f9d6a640 1 --2- 10.20.193.49:0/26186277 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f84f40c89c0 0x7f84f40c8e70 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:33.035 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.025+0000 7f84f9d6a640 1 -- 10.20.193.49:0/26186277 >> 10.20.193.49:0/26186277 conn(0x7f84f40c9f40 msgr2=0x7f84f40ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:11:33.035 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.025+0000 7f84f9d6a640 1 -- 10.20.193.49:0/26186277 shutdown_connections 2026-02-17T11:11:33.035 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.025+0000 7f84f9d6a640 1 -- 10.20.193.49:0/26186277 wait complete. 2026-02-17T11:11:33.035 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.026+0000 7f84f9d6a640 10 monclient: build_initial_monmap 2026-02-17T11:11:33.035 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.026+0000 7f84f9d6a640 10 monclient: monmap: 2026-02-17T11:11:33.035 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:11:33.036 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:11:33.036 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:11:33.036 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:11:33.036 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:11:33.036 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:33.036 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:11:33.036 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:11:33.036 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:11:33.036 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:33.036 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.026+0000 7f84f9d6a640 1 librados: starting msgr at 2026-02-17T11:11:33.036 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.026+0000 7f84f9d6a640 1 librados: starting objecter 2026-02-17T11:11:33.036 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.026+0000 7f84f9d6a640 1 Processor -- start 2026-02-17T11:11:33.037 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.026+0000 7f84f9d6a640 1 -- start start 2026-02-17T11:11:33.037 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.026+0000 7f84f9d6a640 1 librados: setting wanted keys 2026-02-17T11:11:33.037 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.026+0000 7f84f9d6a640 1 librados: calling monclient init 2026-02-17T11:11:33.037 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.026+0000 7f84f9d6a640 10 monclient: init 2026-02-17T11:11:33.037 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.026+0000 7f84f9d6a640 10 monclient: _reopen_session rank -1 2026-02-17T11:11:33.037 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.026+0000 7f84f9d6a640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:11:33.037 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.026+0000 7f84f9d6a640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f84f40c7170 0x7f84f41f3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:33.037 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.026+0000 7f84f9d6a640 10 monclient(hunting): picked mon.noname-c con 0x7f84f40c7170 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:11:33.037 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.026+0000 7f84f9d6a640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f84f40c7550 0x7f84f41f26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:33.037 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.026+0000 7f84f9d6a640 10 monclient(hunting): picked mon.noname-b con 0x7f84f40c7550 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:11:33.037 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.026+0000 7f84f9d6a640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f84f40c89c0 0x7f84f41f2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:33.037 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.026+0000 7f84f9d6a640 10 monclient(hunting): picked mon.noname-a con 0x7f84f40c89c0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:11:33.037 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.026+0000 7f84f9d6a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:33.038 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.026+0000 7f84f9d6a640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f84f40c5830 con 0x7f84f40c89c0 2026-02-17T11:11:33.038 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.026+0000 7f84f9d6a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:33.038 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.026+0000 7f84f9d6a640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f84f40c93b0 con 0x7f84f40c7550 2026-02-17T11:11:33.038 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.026+0000 7f84f9d6a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:33.038 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.026+0000 7f84f9d6a640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f84f40c7ee0 con 0x7f84f40c7170 2026-02-17T11:11:33.038 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.026+0000 7f84f9d6a640 10 monclient(hunting): _renew_subs 2026-02-17T11:11:33.038 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.026+0000 7f84f9d6a640 10 monclient(hunting): authenticate will time out at 1169.689786s 2026-02-17T11:11:33.038 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.027+0000 7f84f37fe640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f84f40c7170 0x7f84f41f3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:33.038 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.027+0000 7f84f3fff640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f84f40c89c0 0x7f84f41f2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:33.038 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.027+0000 7f84f2ffd640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f84f40c7550 0x7f84f41f26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:33.038 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.027+0000 7f84f3fff640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f84f40c89c0 0x7f84f41f2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:51222/0 (socket says 10.20.193.49:51222) 2026-02-17T11:11:33.038 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.027+0000 7f84f3fff640 1 -- 10.20.193.49:0/3106988369 learned_addr learned my addr 10.20.193.49:0/3106988369 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:11:33.039 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.027+0000 7f84f3fff640 10 monclient(hunting): get_auth_request con 0x7f84f40c89c0 auth_method 0 2026-02-17T11:11:33.039 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.027+0000 7f84f3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:33.039 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.027+0000 7f84f3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:33.039 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.027+0000 7f84f3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:33.039 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.027+0000 7f84f37fe640 10 monclient(hunting): get_auth_request con 0x7f84f40c7170 auth_method 0 2026-02-17T11:11:33.039 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.027+0000 7f84f37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:33.039 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.027+0000 7f84f37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:33.039 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.027+0000 7f84f37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:33.039 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.027+0000 7f84f2ffd640 10 monclient(hunting): get_auth_request con 0x7f84f40c7550 auth_method 0 2026-02-17T11:11:33.039 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.027+0000 7f84f2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:33.039 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.027+0000 7f84f2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:33.039 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.027+0000 7f84f2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:33.040 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.027+0000 7f84f3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:33.040 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.027+0000 7f84f3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:33.040 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.027+0000 7f84f3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:33.040 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.027+0000 7f84f37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:33.040 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.027+0000 7f84f37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:33.040 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.027+0000 7f84f37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:33.040 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.027+0000 7f84f2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:33.040 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.027+0000 7f84f2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:33.040 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.027+0000 7f84f2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:33.040 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.028+0000 7f84f3fff640 10 monclient(hunting): handle_auth_done global_id 4725 payload 824 2026-02-17T11:11:33.040 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.028+0000 7f84f3fff640 1 -- 10.20.193.49:0/3106988369 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f84f40c7170 msgr2=0x7f84f41f3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:33.040 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.028+0000 7f84f3fff640 1 --2- 10.20.193.49:0/3106988369 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f84f40c7170 0x7f84f41f3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:33.040 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.028+0000 7f84f3fff640 1 -- 10.20.193.49:0/3106988369 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f84f40c7550 msgr2=0x7f84f41f26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:33.041 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.028+0000 7f84f3fff640 1 --2- 10.20.193.49:0/3106988369 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f84f40c7550 0x7f84f41f26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:33.041 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.028+0000 7f84f3fff640 10 monclient: _finish_hunting 0 2026-02-17T11:11:33.041 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.028+0000 7f84f3fff640 1 monclient: found mon.noname-a 2026-02-17T11:11:33.041 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.028+0000 7f84f3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:11:33.041 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.028+0000 7f84f3fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:11:33.041 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.028+0000 7f84f3fff640 1 -- 10.20.193.49:0/3106988369 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84f41f1650 con 0x7f84f40c89c0 2026-02-17T11:11:33.041 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.029+0000 7f84f3fff640 1 --2- 10.20.193.49:0/3106988369 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f84f40c89c0 0x7f84f41f2c30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f84e803a040 tx=0x7f84e8004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:11:33.041 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.029+0000 7f84cffff640 10 client.?.objecter ms_handle_connect 0x7f84f40c89c0 2026-02-17T11:11:33.041 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.029+0000 7f84cffff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:11:33.043 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.031+0000 7f84cffff640 1 -- 10.20.193.49:0/3106988369 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e803c050 con 0x7f84f40c89c0 2026-02-17T11:11:33.043 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.031+0000 7f84cffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:33.043 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.031+0000 7f84cffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:11:33.043 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.031+0000 7f84cffff640 10 monclient: dump: 2026-02-17T11:11:33.043 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:33.043 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:33.043 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:33.043 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:33.043 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:33.044 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:33.044 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:33.044 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:33.044 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:33.044 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:33.044 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.031+0000 7f84cffff640 10 monclient: _finish_auth 0 2026-02-17T11:11:33.044 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.031+0000 7f84cffff640 10 monclient: _check_auth_tickets 2026-02-17T11:11:33.044 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.031+0000 7f84cffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:11:33.044 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.031+0000 7f84cffff640 1 -- 10.20.193.49:0/3106988369 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84e8048070 con 0x7f84f40c89c0 2026-02-17T11:11:33.044 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.031+0000 7f84f9d6a640 5 monclient: authenticate success, global_id 4725 2026-02-17T11:11:33.044 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.031+0000 7f84cffff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:11:33.044 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.031+0000 7f84cffff640 1 -- 10.20.193.49:0/3106988369 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e8041a30 con 0x7f84f40c89c0 2026-02-17T11:11:33.045 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.031+0000 7f84cffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:33.045 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.031+0000 7f84cffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:11:33.045 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.031+0000 7f84cffff640 10 monclient: dump: 2026-02-17T11:11:33.045 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:33.045 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:33.045 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:33.045 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:33.045 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:33.045 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:33.045 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:33.045 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:33.046 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:33.046 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:33.046 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.031+0000 7f84f9d6a640 10 monclient: _renew_subs 2026-02-17T11:11:33.046 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.031+0000 7f84f9d6a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:11:33.046 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.031+0000 7f84f9d6a640 1 -- 10.20.193.49:0/3106988369 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84f41f1930 con 0x7f84f40c89c0 2026-02-17T11:11:33.046 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.031+0000 7f84f1ffb640 4 set_mon_vals no callback set 2026-02-17T11:11:33.046 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.031+0000 7f84f9d6a640 10 client.4725.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:11:33.046 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.031+0000 7f84f9d6a640 10 monclient: _renew_subs 2026-02-17T11:11:33.046 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.031+0000 7f84f9d6a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:11:33.046 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.031+0000 7f84f9d6a640 1 -- 10.20.193.49:0/3106988369 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84f41f1ef0 con 0x7f84f40c89c0 2026-02-17T11:11:33.046 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.031+0000 7f84f9d6a640 1 librados: init done 2026-02-17T11:11:33.046 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.031+0000 7f84f9d6a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:11:33.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.031+0000 7f84f9d6a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:11:33.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.031+0000 7f84f9d6a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:11:33.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.031+0000 7f84f9d6a640 1 -- 10.20.193.49:0/3106988369 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84f40c81c0 con 0x7f84f40c89c0 2026-02-17T11:11:33.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.044+0000 7f84cffff640 1 -- 10.20.193.49:0/3106988369 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f84e8041bd0 con 0x7f84f40c89c0 2026-02-17T11:11:33.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.044+0000 7f84cffff640 1 --2- 10.20.193.49:0/3106988369 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f84c40791c0 0x7f84c407b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:33.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.045+0000 7f84f37fe640 1 --2- 10.20.193.49:0/3106988369 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f84c40791c0 0x7f84c407b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:33.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.045+0000 7f84f37fe640 10 monclient: get_auth_request con 0x7f84c40791c0 auth_method 0 2026-02-17T11:11:33.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.045+0000 7f84f37fe640 1 --2- 10.20.193.49:0/3106988369 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f84c40791c0 0x7f84c407b680 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f84e0002770 tx=0x7f84e0007ef0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:11:33.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.045+0000 7f84cffff640 10 client.4725.objecter ms_handle_connect 0x7f84c40791c0 2026-02-17T11:11:33.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.147+0000 7f84cffff640 1 -- 10.20.193.49:0/3106988369 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f84e8084680 con 0x7f84f40c89c0 2026-02-17T11:11:33.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.147+0000 7f84cffff640 10 client.4725.objecter ms_dispatch2 0x7f84f4000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:11:33.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.147+0000 7f84cffff640 3 client.4725.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:11:33.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.147+0000 7f84cffff640 3 client.4725.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:11:33.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.148+0000 7f84cffff640 20 client.4725.objecter dump_active .. 0 homeless 2026-02-17T11:11:33.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.148+0000 7f84cffff640 1 -- 10.20.193.49:0/3106988369 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f84e8088640 con 0x7f84f40c89c0 2026-02-17T11:11:33.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.148+0000 7f84cffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:11:33.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.148+0000 7f84cffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:11:33.257 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.256+0000 7f84f9d6a640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:11:33.257 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.256+0000 7f84f9d6a640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:11:33.258 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.256+0000 7f84f9d6a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:11:33.258 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.256+0000 7f84f9d6a640 1 -- 10.20.193.49:0/3106988369 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f84f415e180 con 0x7f84f40c89c0 2026-02-17T11:11:33.260 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.259+0000 7f84cffff640 1 -- 10.20.193.49:0/3106988369 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f84e808c940 con 0x7f84f40c89c0 2026-02-17T11:11:33.260 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.259+0000 7f84cffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:11:33.260 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.259+0000 7f84cffff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:11:33.260 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:11:33.260 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:11:33.262 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.260+0000 7f84f9d6a640 10 librados: watch_flush enter 2026-02-17T11:11:33.262 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.260+0000 7f84f9d6a640 10 librados: watch_flush exit 2026-02-17T11:11:33.262 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.260+0000 7f84f9d6a640 20 client.4725.objecter shutdown clearing up homeless session... 2026-02-17T11:11:33.262 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.260+0000 7f84f9d6a640 10 client.4725.objecter successfully canceled tick 2026-02-17T11:11:33.262 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.260+0000 7f84f9d6a640 1 -- 10.20.193.49:0/3106988369 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f84c40791c0 msgr2=0x7f84c407b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:33.262 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.260+0000 7f84f9d6a640 1 --2- 10.20.193.49:0/3106988369 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f84c40791c0 0x7f84c407b680 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f84e0002770 tx=0x7f84e0007ef0 comp rx=0 tx=0).stop 2026-02-17T11:11:33.262 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.260+0000 7f84f9d6a640 10 monclient: shutdown 2026-02-17T11:11:33.262 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.260+0000 7f84f9d6a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:11:33.262 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.260+0000 7f84f9d6a640 1 -- 10.20.193.49:0/3106988369 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f84f40c89c0 msgr2=0x7f84f41f2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:33.262 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.260+0000 7f84f9d6a640 1 --2- 10.20.193.49:0/3106988369 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f84f40c89c0 0x7f84f41f2c30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f84e803a040 tx=0x7f84e8004b40 comp rx=0 tx=0).stop 2026-02-17T11:11:33.262 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.260+0000 7f84f9d6a640 1 -- 10.20.193.49:0/3106988369 shutdown_connections 2026-02-17T11:11:33.262 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.260+0000 7f84f9d6a640 1 --2- 10.20.193.49:0/3106988369 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f84c40791c0 0x7f84c407b680 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:33.263 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.260+0000 7f84f9d6a640 1 --2- 10.20.193.49:0/3106988369 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f84f40c89c0 0x7f84f41f2c30 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:33.263 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.260+0000 7f84f9d6a640 1 --2- 10.20.193.49:0/3106988369 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f84f40c7550 0x7f84f41f26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:33.263 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.260+0000 7f84f9d6a640 1 --2- 10.20.193.49:0/3106988369 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f84f40c7170 0x7f84f41f3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:33.263 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.260+0000 7f84f9d6a640 1 -- 10.20.193.49:0/3106988369 >> 10.20.193.49:0/3106988369 conn(0x7f84f40c9f40 msgr2=0x7f84f40cb2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:11:33.263 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.260+0000 7f84f9d6a640 1 -- 10.20.193.49:0/3106988369 shutdown_connections 2026-02-17T11:11:33.263 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.260+0000 7f84f9d6a640 1 -- 10.20.193.49:0/3106988369 wait complete. 2026-02-17T11:11:33.263 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:33.261+0000 7f84f9d6a640 1 librados: shutdown 2026-02-17T11:11:36.271 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:11:36.341 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.339+0000 7f2b9bc66640 10 monclient: get_monmap_and_config 2026-02-17T11:11:36.341 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.339+0000 7f2b9bc66640 10 monclient: build_initial_monmap 2026-02-17T11:11:36.341 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.339+0000 7f2b9bc66640 10 monclient: monmap: 2026-02-17T11:11:36.342 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:11:36.342 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:36.342 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:11:36.340453+0000 2026-02-17T11:11:36.342 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:11:36.340453+0000 2026-02-17T11:11:36.342 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:11:36.342 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:36.342 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:11:36.342 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:11:36.342 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:11:36.342 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:11:36.342 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:11:36.343 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:11:36.343 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:36.345 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.340+0000 7f2b9bc66640 1 Processor -- start 2026-02-17T11:11:36.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.340+0000 7f2b9bc66640 1 -- start start 2026-02-17T11:11:36.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.340+0000 7f2b9bc66640 10 monclient: init 2026-02-17T11:11:36.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.340+0000 7f2b9bc66640 10 monclient: _reopen_session rank -1 2026-02-17T11:11:36.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.340+0000 7f2b9bc66640 10 monclient: _add_conns ranks=[2,1,4,5,3,0] 2026-02-17T11:11:36.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.341+0000 7f2b9bc66640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f2b940c7170 addr v1:10.20.193.157:6789/0 2026-02-17T11:11:36.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.341+0000 7f2b9bc66640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f2b940c7550 addr v1:10.20.193.97:6789/0 2026-02-17T11:11:36.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.341+0000 7f2b9bc66640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f2b940c89c0 0x7f2b940c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:36.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.341+0000 7f2b9bc66640 10 monclient(hunting): picked mon.noname-b con 0x7f2b940c89c0 addr v2:10.20.193.97:3300/0 2026-02-17T11:11:36.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.341+0000 7f2b9bc66640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b940c4fd0 con 0x7f2b940c7550 2026-02-17T11:11:36.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.341+0000 7f2b9bc66640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b9415a9a0 con 0x7f2b940c7170 2026-02-17T11:11:36.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.341+0000 7f2b9bc66640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:36.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.341+0000 7f2b9bc66640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f2b940c8530 con 0x7f2b940c89c0 2026-02-17T11:11:36.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.341+0000 7f2b9bc66640 10 monclient(hunting): _renew_subs 2026-02-17T11:11:36.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.341+0000 7f2b9bc66640 10 monclient(hunting): authenticate will time out at 1173.004051s 2026-02-17T11:11:36.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.341+0000 7f2b999db640 1 --1- >> v1:10.20.193.157:6789/0 conn(0x7f2b940c7170 0x7f2b940c48c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.157:6789/0 says I am v1:10.20.193.49:46562/0 (socket says 10.20.193.49:46562) 2026-02-17T11:11:36.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.341+0000 7f2b999db640 1 -- 10.20.193.49:0/3143233094 learned_addr learned my addr 10.20.193.49:0/3143233094 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:11:36.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.341+0000 7f2b9a1dc640 1 --2- 10.20.193.49:0/3143233094 >> v2:10.20.193.97:3300/0 conn(0x7f2b940c89c0 0x7f2b940c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:36.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.342+0000 7f2b9a1dc640 10 monclient(hunting): get_auth_request con 0x7f2b940c89c0 auth_method 0 2026-02-17T11:11:36.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.342+0000 7f2b9a1dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:36.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.342+0000 7f2b9a1dc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:36.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.342+0000 7f2b9a1dc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:36.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.342+0000 7f2b989d9640 1 -- 10.20.193.49:0/3143233094 <== mon.2 v1:10.20.193.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3631692469 0 0) 0x7f2b9415a9a0 con 0x7f2b940c7170 2026-02-17T11:11:36.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.342+0000 7f2b989d9640 10 monclient(hunting): _negotiate 2026-02-17T11:11:36.348 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.342+0000 7f2b989d9640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:36.348 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.342+0000 7f2b989d9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:36.348 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.342+0000 7f2b989d9640 10 monclient(hunting): my global_id is 4721 2026-02-17T11:11:36.348 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.342+0000 7f2b989d9640 1 -- 10.20.193.49:0/3143233094 --> v1:10.20.193.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b7c003620 con 0x7f2b940c7170 2026-02-17T11:11:36.348 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.342+0000 7f2b9a1dc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:36.348 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.342+0000 7f2b9a1dc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:36.348 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.343+0000 7f2b9a1dc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:36.348 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.344+0000 7f2b9a1dc640 10 monclient(hunting): handle_auth_done global_id 4696 payload 274 2026-02-17T11:11:36.348 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.344+0000 7f2b9a1dc640 1 -- 10.20.193.49:0/3143233094 >> v1:10.20.193.157:6789/0 conn(0x7f2b940c7170 legacy=0x7f2b940c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:36.348 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.344+0000 7f2b9a1dc640 1 -- 10.20.193.49:0/3143233094 >> v1:10.20.193.97:6789/0 conn(0x7f2b940c7550 legacy=0x7f2b940749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:36.348 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.344+0000 7f2b9a1dc640 10 monclient: _finish_hunting 0 2026-02-17T11:11:36.348 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.344+0000 7f2b9a1dc640 1 monclient: found mon.noname-b 2026-02-17T11:11:36.349 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.344+0000 7f2b9a1dc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:11:36.349 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.344+0000 7f2b9a1dc640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:11:36.349 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.344+0000 7f2b9a1dc640 1 -- 10.20.193.49:0/3143233094 --> v2:10.20.193.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b940c5270 con 0x7f2b940c89c0 2026-02-17T11:11:36.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.345+0000 7f2b9a1dc640 1 --2- 10.20.193.49:0/3143233094 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f2b940c89c0 0x7f2b940c8e70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2b90009d90 tx=0x7f2b9002f230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4ab2e383224ba49 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:11:36.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.347+0000 7f2b989d9640 1 -- 10.20.193.49:0/3143233094 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b9003c070 con 0x7f2b940c89c0 2026-02-17T11:11:36.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.347+0000 7f2b989d9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:36.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.347+0000 7f2b989d9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:11:36.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.347+0000 7f2b989d9640 10 monclient: dump: 2026-02-17T11:11:36.354 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:36.354 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:36.354 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:36.354 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:36.355 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:36.355 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:36.355 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:36.355 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:36.355 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:36.355 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:36.355 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.347+0000 7f2b989d9640 10 monclient: _finish_auth 0 2026-02-17T11:11:36.355 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.347+0000 7f2b989d9640 10 monclient: _check_auth_tickets 2026-02-17T11:11:36.355 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.347+0000 7f2b989d9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:11:36.355 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.347+0000 7f2b989d9640 1 -- 10.20.193.49:0/3143233094 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b90037440 con 0x7f2b940c89c0 2026-02-17T11:11:36.355 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.347+0000 7f2b989d9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:11:36.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.347+0000 7f2b989d9640 1 -- 10.20.193.49:0/3143233094 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b90037810 con 0x7f2b940c89c0 2026-02-17T11:11:36.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.347+0000 7f2b9bc66640 5 monclient: authenticate success, global_id 4696 2026-02-17T11:11:36.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.347+0000 7f2b9bc66640 10 monclient: get_monmap_and_config success 2026-02-17T11:11:36.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.347+0000 7f2b9bc66640 4 set_mon_vals no callback set 2026-02-17T11:11:36.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.347+0000 7f2b989d9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:36.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.347+0000 7f2b989d9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:11:36.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.347+0000 7f2b989d9640 10 monclient: dump: 2026-02-17T11:11:36.356 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:36.356 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:36.356 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:36.356 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:36.356 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:36.357 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:36.357 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:36.357 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:36.357 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:36.357 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:36.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.348+0000 7f2b9bc66640 10 monclient: shutdown 2026-02-17T11:11:36.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.348+0000 7f2b9bc66640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:11:36.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.348+0000 7f2b9bc66640 1 -- 10.20.193.49:0/3143233094 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f2b940c89c0 msgr2=0x7f2b940c8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:36.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.348+0000 7f2b9bc66640 1 --2- 10.20.193.49:0/3143233094 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f2b940c89c0 0x7f2b940c8e70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2b90009d90 tx=0x7f2b9002f230 comp rx=0 tx=0).stop 2026-02-17T11:11:36.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.348+0000 7f2b9bc66640 1 -- 10.20.193.49:0/3143233094 shutdown_connections 2026-02-17T11:11:36.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.348+0000 7f2b9bc66640 1 --2- 10.20.193.49:0/3143233094 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f2b940c89c0 0x7f2b940c8e70 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:36.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.348+0000 7f2b9bc66640 1 -- 10.20.193.49:0/3143233094 >> 10.20.193.49:0/3143233094 conn(0x7f2b940c9f40 msgr2=0x7f2b940ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:11:36.358 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.348+0000 7f2b9bc66640 1 -- 10.20.193.49:0/3143233094 shutdown_connections 2026-02-17T11:11:36.358 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.348+0000 7f2b9bc66640 1 -- 10.20.193.49:0/3143233094 wait complete. 2026-02-17T11:11:36.358 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.348+0000 7f2b9bc66640 10 monclient: build_initial_monmap 2026-02-17T11:11:36.358 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.348+0000 7f2b9bc66640 10 monclient: monmap: 2026-02-17T11:11:36.358 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:11:36.358 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:11:36.358 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:11:36.358 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:11:36.358 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:11:36.358 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:36.358 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:11:36.358 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:11:36.359 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:11:36.359 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:36.359 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.349+0000 7f2b9bc66640 1 librados: starting msgr at 2026-02-17T11:11:36.359 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.349+0000 7f2b9bc66640 1 librados: starting objecter 2026-02-17T11:11:36.359 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.349+0000 7f2b9bc66640 1 Processor -- start 2026-02-17T11:11:36.359 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.349+0000 7f2b9bc66640 1 -- start start 2026-02-17T11:11:36.359 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.349+0000 7f2b9bc66640 1 librados: setting wanted keys 2026-02-17T11:11:36.359 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.349+0000 7f2b9bc66640 1 librados: calling monclient init 2026-02-17T11:11:36.359 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.349+0000 7f2b9bc66640 10 monclient: init 2026-02-17T11:11:36.359 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.349+0000 7f2b9bc66640 10 monclient: _reopen_session rank -1 2026-02-17T11:11:36.359 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.349+0000 7f2b9bc66640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:11:36.359 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.349+0000 7f2b9bc66640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f2b940c7170 0x7f2b941f6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:36.360 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.349+0000 7f2b9bc66640 10 monclient(hunting): picked mon.noname-c con 0x7f2b940c7170 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:11:36.360 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.349+0000 7f2b9bc66640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f2b940c7550 0x7f2b9406ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:36.360 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.349+0000 7f2b9bc66640 10 monclient(hunting): picked mon.noname-a con 0x7f2b940c7550 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:11:36.360 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.349+0000 7f2b9bc66640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f2b940c89c0 0x7f2b9406f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:36.360 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.349+0000 7f2b9bc66640 10 monclient(hunting): picked mon.noname-b con 0x7f2b940c89c0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:11:36.360 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.349+0000 7f2b9bc66640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:36.360 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.349+0000 7f2b9bc66640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2b940c5830 con 0x7f2b940c7550 2026-02-17T11:11:36.360 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.349+0000 7f2b9bc66640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:36.360 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.349+0000 7f2b9bc66640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2b940c93b0 con 0x7f2b940c89c0 2026-02-17T11:11:36.360 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.349+0000 7f2b9bc66640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:36.360 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.349+0000 7f2b9bc66640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f2b940c7ee0 con 0x7f2b940c7170 2026-02-17T11:11:36.360 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.349+0000 7f2b9bc66640 10 monclient(hunting): _renew_subs 2026-02-17T11:11:36.360 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.349+0000 7f2b9bc66640 10 monclient(hunting): authenticate will time out at 1173.012537s 2026-02-17T11:11:36.361 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.349+0000 7f2b9a1dc640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f2b940c89c0 0x7f2b9406f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:36.361 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.349+0000 7f2b999db640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f2b940c7170 0x7f2b941f6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:36.361 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.349+0000 7f2b9a1dc640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f2b940c89c0 0x7f2b9406f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:35620/0 (socket says 10.20.193.49:35620) 2026-02-17T11:11:36.361 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.349+0000 7f2b9a1dc640 1 -- 10.20.193.49:0/1414541681 learned_addr learned my addr 10.20.193.49:0/1414541681 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:11:36.361 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.349+0000 7f2b9a1dc640 10 monclient(hunting): get_auth_request con 0x7f2b940c89c0 auth_method 0 2026-02-17T11:11:36.361 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.349+0000 7f2b9a1dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:36.361 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.349+0000 7f2b9a1dc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:36.361 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.349+0000 7f2b9a1dc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:36.361 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.350+0000 7f2b999db640 10 monclient(hunting): get_auth_request con 0x7f2b940c7170 auth_method 0 2026-02-17T11:11:36.361 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.350+0000 7f2b999db640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:36.361 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.350+0000 7f2b999db640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:36.362 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.350+0000 7f2b999db640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:36.362 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.350+0000 7f2b9a1dc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:36.362 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.350+0000 7f2b9a1dc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:36.362 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.350+0000 7f2b9a1dc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:36.362 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.350+0000 7f2b999db640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:36.362 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.350+0000 7f2b999db640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:36.362 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.350+0000 7f2b999db640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:36.362 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.351+0000 7f2b9a1dc640 10 monclient(hunting): handle_auth_done global_id 4702 payload 824 2026-02-17T11:11:36.362 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.351+0000 7f2b9a1dc640 1 -- 10.20.193.49:0/1414541681 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f2b940c7170 msgr2=0x7f2b941f6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:36.362 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.351+0000 7f2b9a1dc640 1 --2- 10.20.193.49:0/1414541681 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f2b940c7170 0x7f2b941f6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:36.362 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.351+0000 7f2b9a1dc640 1 -- 10.20.193.49:0/1414541681 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f2b940c7550 msgr2=0x7f2b9406ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:36.362 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.351+0000 7f2b9a1dc640 1 --2- 10.20.193.49:0/1414541681 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f2b940c7550 0x7f2b9406ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:36.362 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.351+0000 7f2b9a1dc640 10 monclient: _finish_hunting 0 2026-02-17T11:11:36.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.351+0000 7f2b9a1dc640 1 monclient: found mon.noname-b 2026-02-17T11:11:36.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.351+0000 7f2b9a1dc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:11:36.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.351+0000 7f2b9a1dc640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:11:36.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.351+0000 7f2b9a1dc640 1 -- 10.20.193.49:0/1414541681 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b941f3860 con 0x7f2b940c89c0 2026-02-17T11:11:36.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.352+0000 7f2b9a1dc640 1 --2- 10.20.193.49:0/1414541681 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f2b940c89c0 0x7f2b9406f270 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2b90009d90 tx=0x7f2b90004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:11:36.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.352+0000 7f2b827fc640 10 client.?.objecter ms_handle_connect 0x7f2b940c89c0 2026-02-17T11:11:36.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.352+0000 7f2b827fc640 10 client.?.objecter resend_mon_ops 2026-02-17T11:11:36.365 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.354+0000 7f2b827fc640 1 -- 10.20.193.49:0/1414541681 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b9003c050 con 0x7f2b940c89c0 2026-02-17T11:11:36.365 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.354+0000 7f2b827fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:36.365 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.354+0000 7f2b827fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:11:36.365 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.354+0000 7f2b827fc640 10 monclient: dump: 2026-02-17T11:11:36.365 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:36.365 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:36.365 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:36.365 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:36.365 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:36.366 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:36.366 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:36.366 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:36.366 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:36.366 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:36.366 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.354+0000 7f2b827fc640 10 monclient: _finish_auth 0 2026-02-17T11:11:36.366 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.354+0000 7f2b827fc640 10 monclient: _check_auth_tickets 2026-02-17T11:11:36.366 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.354+0000 7f2b827fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:11:36.366 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.354+0000 7f2b827fc640 1 -- 10.20.193.49:0/1414541681 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b90048070 con 0x7f2b940c89c0 2026-02-17T11:11:36.366 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.354+0000 7f2b827fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:11:36.366 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.354+0000 7f2b827fc640 1 -- 10.20.193.49:0/1414541681 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b90041a30 con 0x7f2b940c89c0 2026-02-17T11:11:36.366 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.354+0000 7f2b827fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:36.367 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.354+0000 7f2b827fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:11:36.367 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.354+0000 7f2b83fff640 4 set_mon_vals no callback set 2026-02-17T11:11:36.367 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.354+0000 7f2b827fc640 10 monclient: dump: 2026-02-17T11:11:36.367 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:36.367 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:36.367 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:36.367 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:36.367 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:36.367 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:36.367 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:36.367 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:36.367 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:36.368 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:36.368 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.354+0000 7f2b9bc66640 5 monclient: authenticate success, global_id 4702 2026-02-17T11:11:36.368 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.354+0000 7f2b9bc66640 10 monclient: _renew_subs 2026-02-17T11:11:36.368 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.354+0000 7f2b9bc66640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:11:36.368 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.354+0000 7f2b9bc66640 1 -- 10.20.193.49:0/1414541681 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b941f3b40 con 0x7f2b940c89c0 2026-02-17T11:11:36.368 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.354+0000 7f2b9bc66640 10 client.4702.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:11:36.368 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.354+0000 7f2b9bc66640 10 monclient: _renew_subs 2026-02-17T11:11:36.368 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.354+0000 7f2b9bc66640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:11:36.368 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.354+0000 7f2b9bc66640 1 -- 10.20.193.49:0/1414541681 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b9406e530 con 0x7f2b940c89c0 2026-02-17T11:11:36.368 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.354+0000 7f2b9bc66640 1 librados: init done 2026-02-17T11:11:36.368 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.354+0000 7f2b9bc66640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:11:36.368 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.354+0000 7f2b9bc66640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:11:36.369 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.354+0000 7f2b9bc66640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:11:36.369 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.354+0000 7f2b9bc66640 1 -- 10.20.193.49:0/1414541681 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b940c81c0 con 0x7f2b940c89c0 2026-02-17T11:11:36.370 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.365+0000 7f2b827fc640 1 -- 10.20.193.49:0/1414541681 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f2b90041bd0 con 0x7f2b940c89c0 2026-02-17T11:11:36.370 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.366+0000 7f2b827fc640 1 --2- 10.20.193.49:0/1414541681 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f2b64079190 0x7f2b6407b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:36.370 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.366+0000 7f2b999db640 1 --2- 10.20.193.49:0/1414541681 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f2b64079190 0x7f2b6407b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:36.370 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.366+0000 7f2b999db640 10 monclient: get_auth_request con 0x7f2b64079190 auth_method 0 2026-02-17T11:11:36.370 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.367+0000 7f2b999db640 1 --2- 10.20.193.49:0/1414541681 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f2b64079190 0x7f2b6407b650 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2b84005980 tx=0x7f2b84007dd0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:11:36.371 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.367+0000 7f2b827fc640 10 client.4702.objecter ms_handle_connect 0x7f2b64079190 2026-02-17T11:11:36.371 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.367+0000 7f2b827fc640 1 -- 10.20.193.49:0/1414541681 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f2b90084640 con 0x7f2b940c89c0 2026-02-17T11:11:36.371 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.367+0000 7f2b827fc640 10 client.4702.objecter ms_dispatch2 0x7f2b94000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:11:36.371 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.367+0000 7f2b827fc640 3 client.4702.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:11:36.371 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.367+0000 7f2b827fc640 3 client.4702.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:11:36.371 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.367+0000 7f2b827fc640 20 client.4702.objecter dump_active .. 0 homeless 2026-02-17T11:11:36.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.469+0000 7f2b827fc640 1 -- 10.20.193.49:0/1414541681 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f2b90088d00 con 0x7f2b940c89c0 2026-02-17T11:11:36.471 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.469+0000 7f2b827fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:11:36.471 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.469+0000 7f2b827fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:11:36.572 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.570+0000 7f2b9bc66640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:11:36.572 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.570+0000 7f2b9bc66640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:11:36.572 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.570+0000 7f2b9bc66640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:11:36.572 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.570+0000 7f2b9bc66640 1 -- 10.20.193.49:0/1414541681 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2b940c4b40 con 0x7f2b940c89c0 2026-02-17T11:11:36.589 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.587+0000 7f2b827fc640 1 -- 10.20.193.49:0/1414541681 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f2b90088600 con 0x7f2b940c89c0 2026-02-17T11:11:36.589 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.587+0000 7f2b827fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:11:36.589 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.587+0000 7f2b827fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:11:36.589 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:11:36.589 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:11:36.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.588+0000 7f2b9bc66640 10 librados: watch_flush enter 2026-02-17T11:11:36.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.588+0000 7f2b9bc66640 10 librados: watch_flush exit 2026-02-17T11:11:36.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.588+0000 7f2b9bc66640 20 client.4702.objecter shutdown clearing up homeless session... 2026-02-17T11:11:36.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.588+0000 7f2b9bc66640 10 client.4702.objecter successfully canceled tick 2026-02-17T11:11:36.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.589+0000 7f2b9bc66640 1 -- 10.20.193.49:0/1414541681 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f2b64079190 msgr2=0x7f2b6407b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:36.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.589+0000 7f2b9bc66640 1 --2- 10.20.193.49:0/1414541681 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f2b64079190 0x7f2b6407b650 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2b84005980 tx=0x7f2b84007dd0 comp rx=0 tx=0).stop 2026-02-17T11:11:36.592 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.589+0000 7f2b9bc66640 10 monclient: shutdown 2026-02-17T11:11:36.592 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.589+0000 7f2b9bc66640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:11:36.592 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.589+0000 7f2b9bc66640 1 -- 10.20.193.49:0/1414541681 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f2b940c89c0 msgr2=0x7f2b9406f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:36.592 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.589+0000 7f2b9bc66640 1 --2- 10.20.193.49:0/1414541681 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f2b940c89c0 0x7f2b9406f270 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2b90009d90 tx=0x7f2b90004b40 comp rx=0 tx=0).stop 2026-02-17T11:11:36.592 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.589+0000 7f2b9bc66640 1 -- 10.20.193.49:0/1414541681 shutdown_connections 2026-02-17T11:11:36.592 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.589+0000 7f2b9bc66640 1 --2- 10.20.193.49:0/1414541681 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f2b64079190 0x7f2b6407b650 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:36.592 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.589+0000 7f2b9bc66640 1 --2- 10.20.193.49:0/1414541681 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f2b940c89c0 0x7f2b9406f270 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:36.592 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.589+0000 7f2b9bc66640 1 --2- 10.20.193.49:0/1414541681 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f2b940c7550 0x7f2b9406ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:36.592 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.589+0000 7f2b9bc66640 1 --2- 10.20.193.49:0/1414541681 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f2b940c7170 0x7f2b941f6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:36.592 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.589+0000 7f2b9bc66640 1 -- 10.20.193.49:0/1414541681 >> 10.20.193.49:0/1414541681 conn(0x7f2b940c9f40 msgr2=0x7f2b940cb640 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:11:36.592 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.589+0000 7f2b9bc66640 1 -- 10.20.193.49:0/1414541681 shutdown_connections 2026-02-17T11:11:36.592 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.589+0000 7f2b9bc66640 1 -- 10.20.193.49:0/1414541681 wait complete. 2026-02-17T11:11:36.593 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:36.589+0000 7f2b9bc66640 1 librados: shutdown 2026-02-17T11:11:39.600 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:11:39.667 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.664+0000 7f7b49585640 10 monclient: get_monmap_and_config 2026-02-17T11:11:39.667 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.664+0000 7f7b49585640 10 monclient: build_initial_monmap 2026-02-17T11:11:39.667 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.664+0000 7f7b49585640 10 monclient: monmap: 2026-02-17T11:11:39.667 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:11:39.667 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:39.667 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:11:39.666303+0000 2026-02-17T11:11:39.667 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:11:39.666303+0000 2026-02-17T11:11:39.667 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:11:39.667 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:39.667 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:11:39.667 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:11:39.667 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:11:39.667 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:11:39.667 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:11:39.667 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:11:39.667 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:39.667 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.665+0000 7f7b49585640 1 Processor -- start 2026-02-17T11:11:39.667 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.665+0000 7f7b49585640 1 -- start start 2026-02-17T11:11:39.667 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.665+0000 7f7b49585640 10 monclient: init 2026-02-17T11:11:39.668 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.665+0000 7f7b49585640 10 monclient: _reopen_session rank -1 2026-02-17T11:11:39.668 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.665+0000 7f7b49585640 10 monclient: _add_conns ranks=[3,1,4,2,5,0] 2026-02-17T11:11:39.668 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.665+0000 7f7b49585640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f7b440c7170 0x7f7b440c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:39.668 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.665+0000 7f7b49585640 10 monclient(hunting): picked mon.noname-a con 0x7f7b440c7170 addr v2:10.20.193.49:3300/0 2026-02-17T11:11:39.668 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.665+0000 7f7b49585640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f7b440c48c0 addr v1:10.20.193.97:6789/0 2026-02-17T11:11:39.668 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.665+0000 7f7b49585640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f7b440c4d10 0x7f7b440c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:39.668 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.665+0000 7f7b49585640 10 monclient(hunting): picked mon.noname-b con 0x7f7b440c4d10 addr v2:10.20.193.97:3300/0 2026-02-17T11:11:39.668 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.665+0000 7f7b49585640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b4415a9a0 con 0x7f7b440c48c0 2026-02-17T11:11:39.668 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.665+0000 7f7b49585640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:39.668 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.665+0000 7f7b49585640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f7b440c8530 con 0x7f7b440c7170 2026-02-17T11:11:39.668 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.665+0000 7f7b49585640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:39.668 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.665+0000 7f7b49585640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f7b440c5270 con 0x7f7b440c4d10 2026-02-17T11:11:39.668 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.665+0000 7f7b49585640 10 monclient(hunting): _renew_subs 2026-02-17T11:11:39.668 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.665+0000 7f7b49585640 10 monclient(hunting): authenticate will time out at 1176.329789s 2026-02-17T11:11:39.668 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.666+0000 7f7b42ffd640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f7b440c7170 0x7f7b440c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:39.668 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.666+0000 7f7b437fe640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f7b440c4d10 0x7f7b440c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:39.669 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.666+0000 7f7b42ffd640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f7b440c7170 0x7f7b440c7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:56518/0 (socket says 10.20.193.49:56518) 2026-02-17T11:11:39.669 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.666+0000 7f7b42ffd640 1 -- 10.20.193.49:0/1354464603 learned_addr learned my addr 10.20.193.49:0/1354464603 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:11:39.669 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.666+0000 7f7b42ffd640 10 monclient(hunting): get_auth_request con 0x7f7b440c7170 auth_method 0 2026-02-17T11:11:39.669 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.666+0000 7f7b42ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:39.669 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.666+0000 7f7b42ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:39.669 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.666+0000 7f7b42ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:39.669 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.666+0000 7f7b437fe640 10 monclient(hunting): get_auth_request con 0x7f7b440c4d10 auth_method 0 2026-02-17T11:11:39.669 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.666+0000 7f7b437fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:39.669 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.666+0000 7f7b437fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:39.669 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.666+0000 7f7b437fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:39.669 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.666+0000 7f7b42ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:39.669 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.666+0000 7f7b42ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:39.669 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.666+0000 7f7b42ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:39.669 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.667+0000 7f7b437fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:39.669 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.667+0000 7f7b437fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:39.669 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.667+0000 7f7b437fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:39.669 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.667+0000 7f7b42ffd640 10 monclient(hunting): handle_auth_done global_id 4728 payload 274 2026-02-17T11:11:39.669 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.667+0000 7f7b42ffd640 1 -- 10.20.193.49:0/1354464603 >> v2:10.20.193.97:3300/0 conn(0x7f7b440c4d10 msgr2=0x7f7b440c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:11:39.669 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.667+0000 7f7b42ffd640 1 --2- 10.20.193.49:0/1354464603 >> v2:10.20.193.97:3300/0 conn(0x7f7b440c4d10 0x7f7b440c89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:39.669 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.667+0000 7f7b42ffd640 1 -- 10.20.193.49:0/1354464603 >> v1:10.20.193.97:6789/0 conn(0x7f7b440c48c0 legacy=0x7f7b440749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:39.670 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.667+0000 7f7b42ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:11:39.670 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.667+0000 7f7b42ffd640 1 monclient: found mon.noname-a 2026-02-17T11:11:39.670 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.667+0000 7f7b42ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:11:39.670 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.667+0000 7f7b42ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:11:39.670 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.667+0000 7f7b42ffd640 1 -- 10.20.193.49:0/1354464603 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b440c5550 con 0x7f7b440c7170 2026-02-17T11:11:39.670 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.668+0000 7f7b42ffd640 1 --2- 10.20.193.49:0/1354464603 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f7b440c7170 0x7f7b440c7550 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7b440c6e90 tx=0x7f7b3802eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e52fe511c224d5a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:11:39.673 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.670+0000 7f7b41ffb640 1 -- 10.20.193.49:0/1354464603 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b3803c070 con 0x7f7b440c7170 2026-02-17T11:11:39.673 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.670+0000 7f7b41ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:39.673 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.670+0000 7f7b41ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:11:39.673 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.670+0000 7f7b41ffb640 10 monclient: dump: 2026-02-17T11:11:39.673 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:39.673 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:39.673 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:39.673 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:39.673 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:39.673 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:39.673 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:39.673 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:39.673 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:39.673 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:39.673 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.670+0000 7f7b41ffb640 10 monclient: _finish_auth 0 2026-02-17T11:11:39.673 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.670+0000 7f7b41ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:11:39.673 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.670+0000 7f7b41ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:11:39.673 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.670+0000 7f7b41ffb640 1 -- 10.20.193.49:0/1354464603 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b3802fbe0 con 0x7f7b440c7170 2026-02-17T11:11:39.673 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.670+0000 7f7b49585640 5 monclient: authenticate success, global_id 4728 2026-02-17T11:11:39.673 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.670+0000 7f7b49585640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:11:39.673 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.670+0000 7f7b41ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:11:39.673 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.670+0000 7f7b49585640 10 monclient: get_monmap_and_config success 2026-02-17T11:11:39.673 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.670+0000 7f7b41ffb640 1 -- 10.20.193.49:0/1354464603 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b38037440 con 0x7f7b440c7170 2026-02-17T11:11:39.673 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.670+0000 7f7b49585640 4 set_mon_vals no callback set 2026-02-17T11:11:39.673 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.670+0000 7f7b41ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:39.673 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.670+0000 7f7b41ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:11:39.673 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.670+0000 7f7b41ffb640 10 monclient: dump: 2026-02-17T11:11:39.673 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:39.673 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:39.673 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:39.673 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:39.674 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:39.674 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:39.674 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:39.674 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:39.674 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:39.674 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:39.674 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.670+0000 7f7b49585640 10 monclient: shutdown 2026-02-17T11:11:39.674 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.670+0000 7f7b49585640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:11:39.674 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.670+0000 7f7b49585640 1 -- 10.20.193.49:0/1354464603 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f7b440c7170 msgr2=0x7f7b440c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:39.674 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.670+0000 7f7b49585640 1 --2- 10.20.193.49:0/1354464603 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f7b440c7170 0x7f7b440c7550 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7b440c6e90 tx=0x7f7b3802eed0 comp rx=0 tx=0).stop 2026-02-17T11:11:39.674 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.670+0000 7f7b49585640 1 -- 10.20.193.49:0/1354464603 shutdown_connections 2026-02-17T11:11:39.674 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.670+0000 7f7b49585640 1 --2- 10.20.193.49:0/1354464603 >> v2:10.20.193.97:3300/0 conn(0x7f7b440c4d10 0x7f7b440c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:39.674 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.670+0000 7f7b49585640 1 --2- 10.20.193.49:0/1354464603 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f7b440c7170 0x7f7b440c7550 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:39.674 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.670+0000 7f7b49585640 1 -- 10.20.193.49:0/1354464603 >> 10.20.193.49:0/1354464603 conn(0x7f7b440c9f40 msgr2=0x7f7b440ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:11:39.674 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.670+0000 7f7b49585640 1 -- 10.20.193.49:0/1354464603 shutdown_connections 2026-02-17T11:11:39.674 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.671+0000 7f7b49585640 1 -- 10.20.193.49:0/1354464603 wait complete. 2026-02-17T11:11:39.675 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.671+0000 7f7b49585640 10 monclient: build_initial_monmap 2026-02-17T11:11:39.675 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.671+0000 7f7b49585640 10 monclient: monmap: 2026-02-17T11:11:39.675 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:11:39.675 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:11:39.675 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:11:39.675 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:11:39.675 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:11:39.675 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:39.675 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:11:39.675 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:11:39.675 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:11:39.675 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:39.675 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.671+0000 7f7b49585640 1 librados: starting msgr at 2026-02-17T11:11:39.675 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.671+0000 7f7b49585640 1 librados: starting objecter 2026-02-17T11:11:39.675 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.671+0000 7f7b49585640 1 Processor -- start 2026-02-17T11:11:39.675 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.671+0000 7f7b49585640 1 -- start start 2026-02-17T11:11:39.675 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.671+0000 7f7b49585640 1 librados: setting wanted keys 2026-02-17T11:11:39.675 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.671+0000 7f7b49585640 1 librados: calling monclient init 2026-02-17T11:11:39.675 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.671+0000 7f7b49585640 10 monclient: init 2026-02-17T11:11:39.675 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.672+0000 7f7b49585640 10 monclient: _reopen_session rank -1 2026-02-17T11:11:39.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.672+0000 7f7b49585640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:11:39.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.672+0000 7f7b49585640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f7b440c48c0 0x7f7b440c39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:39.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.672+0000 7f7b49585640 10 monclient(hunting): picked mon.noname-b con 0x7f7b440c48c0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:11:39.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.672+0000 7f7b49585640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f7b440c4d10 0x7f7b4415d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:39.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.672+0000 7f7b49585640 10 monclient(hunting): picked mon.noname-a con 0x7f7b440c4d10 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:11:39.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.672+0000 7f7b49585640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f7b440c7170 0x7f7b4415aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:39.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.672+0000 7f7b49585640 10 monclient(hunting): picked mon.noname-c con 0x7f7b440c7170 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:11:39.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.672+0000 7f7b49585640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:39.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.672+0000 7f7b49585640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7b440c81c0 con 0x7f7b440c4d10 2026-02-17T11:11:39.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.672+0000 7f7b49585640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:39.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.672+0000 7f7b49585640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7b440c7ee0 con 0x7f7b440c48c0 2026-02-17T11:11:39.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.672+0000 7f7b49585640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:39.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.672+0000 7f7b49585640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f7b440750c0 con 0x7f7b440c7170 2026-02-17T11:11:39.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.672+0000 7f7b49585640 10 monclient(hunting): _renew_subs 2026-02-17T11:11:39.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.672+0000 7f7b49585640 10 monclient(hunting): authenticate will time out at 1176.336326s 2026-02-17T11:11:39.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.672+0000 7f7b427fc640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f7b440c4d10 0x7f7b4415d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:39.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.672+0000 7f7b42ffd640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f7b440c48c0 0x7f7b440c39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:39.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.672+0000 7f7b427fc640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f7b440c4d10 0x7f7b4415d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:56530/0 (socket says 10.20.193.49:56530) 2026-02-17T11:11:39.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.672+0000 7f7b427fc640 1 -- 10.20.193.49:0/1830602936 learned_addr learned my addr 10.20.193.49:0/1830602936 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:11:39.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.672+0000 7f7b427fc640 10 monclient(hunting): get_auth_request con 0x7f7b440c4d10 auth_method 0 2026-02-17T11:11:39.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.672+0000 7f7b427fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:39.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.672+0000 7f7b427fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:39.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.672+0000 7f7b427fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:39.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.672+0000 7f7b42ffd640 10 monclient(hunting): get_auth_request con 0x7f7b440c48c0 auth_method 0 2026-02-17T11:11:39.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.672+0000 7f7b42ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:39.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.672+0000 7f7b42ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:39.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.672+0000 7f7b42ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:39.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.672+0000 7f7b437fe640 1 --2- 10.20.193.49:0/1830602936 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f7b440c7170 0x7f7b4415aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:39.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.672+0000 7f7b427fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:39.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.672+0000 7f7b427fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:39.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.672+0000 7f7b427fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:39.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.673+0000 7f7b437fe640 10 monclient(hunting): get_auth_request con 0x7f7b440c7170 auth_method 0 2026-02-17T11:11:39.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.673+0000 7f7b437fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:39.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.673+0000 7f7b437fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:39.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.673+0000 7f7b437fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:39.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.673+0000 7f7b42ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:39.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.673+0000 7f7b42ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:39.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.673+0000 7f7b42ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:39.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.673+0000 7f7b437fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:39.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.673+0000 7f7b437fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:39.677 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.673+0000 7f7b437fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:39.677 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.674+0000 7f7b42ffd640 10 monclient(hunting): handle_auth_done global_id 4711 payload 824 2026-02-17T11:11:39.677 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.674+0000 7f7b42ffd640 1 -- 10.20.193.49:0/1830602936 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f7b440c7170 msgr2=0x7f7b4415aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:39.677 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.674+0000 7f7b42ffd640 1 --2- 10.20.193.49:0/1830602936 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f7b440c7170 0x7f7b4415aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:39.677 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.674+0000 7f7b42ffd640 1 -- 10.20.193.49:0/1830602936 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f7b440c4d10 msgr2=0x7f7b4415d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:39.677 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.674+0000 7f7b42ffd640 1 --2- 10.20.193.49:0/1830602936 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f7b440c4d10 0x7f7b4415d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:39.677 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.674+0000 7f7b42ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:11:39.677 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.674+0000 7f7b42ffd640 1 monclient: found mon.noname-b 2026-02-17T11:11:39.677 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.674+0000 7f7b42ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:11:39.677 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.674+0000 7f7b42ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:11:39.677 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.674+0000 7f7b42ffd640 1 -- 10.20.193.49:0/1830602936 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b4415db50 con 0x7f7b440c48c0 2026-02-17T11:11:39.677 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.675+0000 7f7b42ffd640 1 --2- 10.20.193.49:0/1830602936 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f7b440c48c0 0x7f7b440c39c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7b44154390 tx=0x7f7b380047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:11:39.677 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.675+0000 7f7b237fe640 10 client.?.objecter ms_handle_connect 0x7f7b440c48c0 2026-02-17T11:11:39.677 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.675+0000 7f7b237fe640 10 client.?.objecter resend_mon_ops 2026-02-17T11:11:39.679 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.676+0000 7f7b237fe640 1 -- 10.20.193.49:0/1830602936 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b3803c040 con 0x7f7b440c48c0 2026-02-17T11:11:39.679 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.676+0000 7f7b237fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:39.679 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.676+0000 7f7b237fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:11:39.679 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.676+0000 7f7b237fe640 10 monclient: dump: 2026-02-17T11:11:39.679 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:39.679 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:39.679 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:39.679 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:39.679 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:39.679 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:39.679 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:39.679 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:39.679 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:39.679 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:39.679 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.676+0000 7f7b237fe640 10 monclient: _finish_auth 0 2026-02-17T11:11:39.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.676+0000 7f7b237fe640 10 monclient: _check_auth_tickets 2026-02-17T11:11:39.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.676+0000 7f7b237fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:11:39.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.676+0000 7f7b237fe640 1 -- 10.20.193.49:0/1830602936 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b38042650 con 0x7f7b440c48c0 2026-02-17T11:11:39.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.676+0000 7f7b49585640 5 monclient: authenticate success, global_id 4711 2026-02-17T11:11:39.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.676+0000 7f7b237fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:11:39.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.676+0000 7f7b237fe640 1 -- 10.20.193.49:0/1830602936 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b38042a40 con 0x7f7b440c48c0 2026-02-17T11:11:39.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.676+0000 7f7b237fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:39.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.676+0000 7f7b237fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:11:39.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.676+0000 7f7b237fe640 10 monclient: dump: 2026-02-17T11:11:39.680 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:39.680 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:39.680 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:39.680 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:39.680 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:39.680 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:39.680 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:39.680 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:39.680 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:39.680 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:39.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.676+0000 7f7b417fa640 4 set_mon_vals no callback set 2026-02-17T11:11:39.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.677+0000 7f7b49585640 10 monclient: _renew_subs 2026-02-17T11:11:39.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.677+0000 7f7b49585640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:11:39.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.677+0000 7f7b49585640 1 -- 10.20.193.49:0/1830602936 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b4415de30 con 0x7f7b440c48c0 2026-02-17T11:11:39.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.677+0000 7f7b49585640 10 client.4711.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:11:39.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.677+0000 7f7b49585640 10 monclient: _renew_subs 2026-02-17T11:11:39.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.677+0000 7f7b49585640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:11:39.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.677+0000 7f7b49585640 1 -- 10.20.193.49:0/1830602936 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b440c0e00 con 0x7f7b440c48c0 2026-02-17T11:11:39.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.677+0000 7f7b49585640 1 librados: init done 2026-02-17T11:11:39.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.677+0000 7f7b49585640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:11:39.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.677+0000 7f7b49585640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:11:39.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.677+0000 7f7b49585640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:11:39.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.677+0000 7f7b49585640 1 -- 10.20.193.49:0/1830602936 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b440c7550 con 0x7f7b440c48c0 2026-02-17T11:11:39.785 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.782+0000 7f7b237fe640 1 -- 10.20.193.49:0/1830602936 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f7b38042be0 con 0x7f7b440c48c0 2026-02-17T11:11:39.785 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.782+0000 7f7b237fe640 1 --2- 10.20.193.49:0/1830602936 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f7b10079190 0x7f7b1007b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:39.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.783+0000 7f7b427fc640 1 --2- 10.20.193.49:0/1830602936 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f7b10079190 0x7f7b1007b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:39.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.783+0000 7f7b427fc640 10 monclient: get_auth_request con 0x7f7b10079190 auth_method 0 2026-02-17T11:11:39.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.783+0000 7f7b427fc640 1 --2- 10.20.193.49:0/1830602936 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f7b10079190 0x7f7b1007b650 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7b4415e3f0 tx=0x7f7b2c0028f0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:11:39.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.783+0000 7f7b237fe640 10 client.4711.objecter ms_handle_connect 0x7f7b10079190 2026-02-17T11:11:39.787 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.784+0000 7f7b237fe640 1 -- 10.20.193.49:0/1830602936 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f7b3802faa0 con 0x7f7b440c48c0 2026-02-17T11:11:39.787 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.784+0000 7f7b237fe640 10 client.4711.objecter ms_dispatch2 0x7f7b44000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:11:39.787 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.784+0000 7f7b237fe640 3 client.4711.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:11:39.787 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.784+0000 7f7b237fe640 3 client.4711.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:11:39.788 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.784+0000 7f7b237fe640 20 client.4711.objecter dump_active .. 0 homeless 2026-02-17T11:11:39.793 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.790+0000 7f7b237fe640 1 -- 10.20.193.49:0/1830602936 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f7b380878e0 con 0x7f7b440c48c0 2026-02-17T11:11:39.793 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.790+0000 7f7b237fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:11:39.793 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.790+0000 7f7b237fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:11:39.896 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.894+0000 7f7b49585640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:11:39.896 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.894+0000 7f7b49585640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:11:39.896 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.894+0000 7f7b49585640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:11:39.896 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.894+0000 7f7b49585640 1 -- 10.20.193.49:0/1830602936 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7b440cae20 con 0x7f7b440c48c0 2026-02-17T11:11:39.900 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.898+0000 7f7b237fe640 1 -- 10.20.193.49:0/1830602936 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f7b3808bbe0 con 0x7f7b440c48c0 2026-02-17T11:11:39.901 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.898+0000 7f7b237fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:11:39.901 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.898+0000 7f7b237fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:11:39.901 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:11:39.901 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:11:39.903 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.899+0000 7f7b49585640 10 librados: watch_flush enter 2026-02-17T11:11:39.903 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.899+0000 7f7b49585640 10 librados: watch_flush exit 2026-02-17T11:11:39.903 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.899+0000 7f7b49585640 20 client.4711.objecter shutdown clearing up homeless session... 2026-02-17T11:11:39.903 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.899+0000 7f7b49585640 10 client.4711.objecter successfully canceled tick 2026-02-17T11:11:39.903 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.899+0000 7f7b49585640 1 -- 10.20.193.49:0/1830602936 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f7b10079190 msgr2=0x7f7b1007b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:39.903 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.899+0000 7f7b49585640 1 --2- 10.20.193.49:0/1830602936 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f7b10079190 0x7f7b1007b650 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7b4415e3f0 tx=0x7f7b2c0028f0 comp rx=0 tx=0).stop 2026-02-17T11:11:39.903 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.899+0000 7f7b49585640 10 monclient: shutdown 2026-02-17T11:11:39.903 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.899+0000 7f7b49585640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:11:39.903 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.899+0000 7f7b49585640 1 -- 10.20.193.49:0/1830602936 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f7b440c48c0 msgr2=0x7f7b440c39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:39.903 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.899+0000 7f7b49585640 1 --2- 10.20.193.49:0/1830602936 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f7b440c48c0 0x7f7b440c39c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7b44154390 tx=0x7f7b380047c0 comp rx=0 tx=0).stop 2026-02-17T11:11:39.903 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.899+0000 7f7b49585640 1 -- 10.20.193.49:0/1830602936 shutdown_connections 2026-02-17T11:11:39.903 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.899+0000 7f7b49585640 1 --2- 10.20.193.49:0/1830602936 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f7b10079190 0x7f7b1007b650 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:39.904 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.899+0000 7f7b49585640 1 --2- 10.20.193.49:0/1830602936 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f7b440c7170 0x7f7b4415aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:39.904 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.899+0000 7f7b49585640 1 --2- 10.20.193.49:0/1830602936 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f7b440c4d10 0x7f7b4415d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:39.904 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.899+0000 7f7b49585640 1 --2- 10.20.193.49:0/1830602936 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f7b440c48c0 0x7f7b440c39c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:39.904 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.899+0000 7f7b49585640 1 -- 10.20.193.49:0/1830602936 >> 10.20.193.49:0/1830602936 conn(0x7f7b440c9f40 msgr2=0x7f7b440ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:11:39.904 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.899+0000 7f7b49585640 1 -- 10.20.193.49:0/1830602936 shutdown_connections 2026-02-17T11:11:39.904 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.899+0000 7f7b49585640 1 -- 10.20.193.49:0/1830602936 wait complete. 2026-02-17T11:11:39.904 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:39.899+0000 7f7b49585640 1 librados: shutdown 2026-02-17T11:11:42.912 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:11:42.981 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.978+0000 7f88b46ea640 10 monclient: get_monmap_and_config 2026-02-17T11:11:42.981 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.978+0000 7f88b46ea640 10 monclient: build_initial_monmap 2026-02-17T11:11:42.981 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.978+0000 7f88b46ea640 10 monclient: monmap: 2026-02-17T11:11:42.981 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:11:42.981 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:42.981 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:11:42.979968+0000 2026-02-17T11:11:42.981 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:11:42.979968+0000 2026-02-17T11:11:42.982 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:11:42.982 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:42.982 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:11:42.982 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:11:42.982 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:11:42.982 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:11:42.982 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:11:42.982 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:11:42.982 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:42.986 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.978+0000 7f88b46ea640 1 Processor -- start 2026-02-17T11:11:42.986 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.978+0000 7f88b46ea640 1 -- start start 2026-02-17T11:11:42.986 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.978+0000 7f88b46ea640 10 monclient: init 2026-02-17T11:11:42.986 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.979+0000 7f88b46ea640 10 monclient: _reopen_session rank -1 2026-02-17T11:11:42.986 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.979+0000 7f88b46ea640 10 monclient: _add_conns ranks=[5,0,1,4,2,3] 2026-02-17T11:11:42.986 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.979+0000 7f88b46ea640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f88ac152820 0x7f88ac1593f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:42.986 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.979+0000 7f88b46ea640 10 monclient(hunting): picked mon.noname-c con 0x7f88ac152820 addr v2:10.20.193.157:3300/0 2026-02-17T11:11:42.986 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.979+0000 7f88b46ea640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f88ac152c00 addr v1:10.20.193.49:6789/0 2026-02-17T11:11:42.987 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.979+0000 7f88b46ea640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f88ac0738f0 addr v1:10.20.193.97:6789/0 2026-02-17T11:11:42.987 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.979+0000 7f88b46ea640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88ac073e90 con 0x7f88ac152c00 2026-02-17T11:11:42.987 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.979+0000 7f88b46ea640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88ac074170 con 0x7f88ac0738f0 2026-02-17T11:11:42.987 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.979+0000 7f88b46ea640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:42.987 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.979+0000 7f88b46ea640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f88ac159930 con 0x7f88ac152820 2026-02-17T11:11:42.987 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.979+0000 7f88b46ea640 10 monclient(hunting): _renew_subs 2026-02-17T11:11:42.987 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.979+0000 7f88b46ea640 10 monclient(hunting): authenticate will time out at 1179.643555s 2026-02-17T11:11:42.987 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.979+0000 7f88b1c5e640 1 --1- >> v1:10.20.193.49:6789/0 conn(0x7f88ac152c00 0x7f88ac0c7e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.49:6789/0 says I am v1:10.20.193.49:42548/0 (socket says 10.20.193.49:42548) 2026-02-17T11:11:42.987 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.979+0000 7f88b1c5e640 1 -- 10.20.193.49:0/2629560290 learned_addr learned my addr 10.20.193.49:0/2629560290 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:11:42.988 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.980+0000 7f88b245f640 1 --2- 10.20.193.49:0/2629560290 >> v2:10.20.193.157:3300/0 conn(0x7f88ac152820 0x7f88ac1593f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:42.988 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.980+0000 7f88b245f640 10 monclient(hunting): get_auth_request con 0x7f88ac152820 auth_method 0 2026-02-17T11:11:42.988 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.980+0000 7f88b245f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:42.988 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.980+0000 7f88b245f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:42.988 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.980+0000 7f88b245f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:42.988 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.980+0000 7f88b245f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:42.988 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.980+0000 7f88b245f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:42.988 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.980+0000 7f88b245f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:42.988 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.981+0000 7f88b145d640 1 -- 10.20.193.49:0/2629560290 <== mon.0 v1:10.20.193.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 352666705 0 0) 0x7f88ac073e90 con 0x7f88ac152c00 2026-02-17T11:11:42.988 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.981+0000 7f88b145d640 10 monclient(hunting): _negotiate 2026-02-17T11:11:42.988 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.981+0000 7f88b145d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:42.989 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.981+0000 7f88b145d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:42.989 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.981+0000 7f88b145d640 10 monclient(hunting): my global_id is 4734 2026-02-17T11:11:42.989 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.981+0000 7f88b145d640 1 -- 10.20.193.49:0/2629560290 --> v1:10.20.193.49:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8894003620 con 0x7f88ac152c00 2026-02-17T11:11:42.989 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.981+0000 7f88b145d640 1 -- 10.20.193.49:0/2629560290 <== mon.1 v1:10.20.193.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4012094185 0 0) 0x7f88ac074170 con 0x7f88ac0738f0 2026-02-17T11:11:42.989 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.981+0000 7f88b145d640 10 monclient(hunting): _negotiate 2026-02-17T11:11:42.989 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.981+0000 7f88b145d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:42.989 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.981+0000 7f88b145d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:42.989 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.981+0000 7f88b145d640 10 monclient(hunting): my global_id is 4714 2026-02-17T11:11:42.989 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.981+0000 7f88b145d640 1 -- 10.20.193.49:0/2629560290 --> v1:10.20.193.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f88ac073e90 con 0x7f88ac0738f0 2026-02-17T11:11:42.989 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.981+0000 7f88b245f640 10 monclient(hunting): handle_auth_done global_id 4730 payload 274 2026-02-17T11:11:42.989 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.981+0000 7f88b245f640 1 -- 10.20.193.49:0/2629560290 >> v1:10.20.193.97:6789/0 conn(0x7f88ac0738f0 legacy=0x7f88ac0c5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:42.989 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.981+0000 7f88b245f640 1 -- 10.20.193.49:0/2629560290 >> v1:10.20.193.49:6789/0 conn(0x7f88ac152c00 legacy=0x7f88ac0c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:42.990 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.981+0000 7f88b245f640 10 monclient: _finish_hunting 0 2026-02-17T11:11:42.990 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.981+0000 7f88b245f640 1 monclient: found mon.noname-c 2026-02-17T11:11:42.990 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.981+0000 7f88b245f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:11:42.990 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.981+0000 7f88b245f640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:11:42.990 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.981+0000 7f88b245f640 1 -- 10.20.193.49:0/2629560290 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88ac074450 con 0x7f88ac152820 2026-02-17T11:11:42.990 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.983+0000 7f88b245f640 1 --2- 10.20.193.49:0/2629560290 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f88ac152820 0x7f88ac1593f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f889c0098a0 tx=0x7f889c02ef00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a3784555cc553f1 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:11:42.997 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.985+0000 7f88b145d640 1 -- 10.20.193.49:0/2629560290 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f889c03c070 con 0x7f88ac152820 2026-02-17T11:11:42.997 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.985+0000 7f88b145d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:42.997 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.985+0000 7f88b145d640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:11:42.997 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.985+0000 7f88b145d640 10 monclient: dump: 2026-02-17T11:11:42.997 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:42.998 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:42.998 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:42.998 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:42.998 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:42.998 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:42.998 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:42.998 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:42.998 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:42.998 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:42.998 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.985+0000 7f88b145d640 10 monclient: _finish_auth 0 2026-02-17T11:11:42.998 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.985+0000 7f88b145d640 10 monclient: _check_auth_tickets 2026-02-17T11:11:42.999 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.985+0000 7f88b145d640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:11:42.999 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.985+0000 7f88b145d640 1 -- 10.20.193.49:0/2629560290 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f889c02fc10 con 0x7f88ac152820 2026-02-17T11:11:42.999 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.985+0000 7f88b46ea640 5 monclient: authenticate success, global_id 4730 2026-02-17T11:11:42.999 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.985+0000 7f88b46ea640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:11:42.999 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.985+0000 7f88b145d640 10 monclient: handle_config config(0 keys) 2026-02-17T11:11:42.999 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.985+0000 7f88b145d640 1 -- 10.20.193.49:0/2629560290 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f889c037440 con 0x7f88ac152820 2026-02-17T11:11:42.999 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.985+0000 7f88b46ea640 10 monclient: get_monmap_and_config success 2026-02-17T11:11:42.999 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.985+0000 7f88b46ea640 4 set_mon_vals no callback set 2026-02-17T11:11:42.999 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.985+0000 7f88b145d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:42.999 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.985+0000 7f88b145d640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:11:42.999 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.985+0000 7f88b145d640 10 monclient: dump: 2026-02-17T11:11:42.999 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:43.000 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:43.000 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:43.000 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:43.000 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:43.000 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:43.000 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:43.000 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:43.000 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:43.000 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:43.000 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.985+0000 7f88b46ea640 10 monclient: shutdown 2026-02-17T11:11:43.000 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.985+0000 7f88b46ea640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:11:43.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.985+0000 7f88b46ea640 1 -- 10.20.193.49:0/2629560290 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f88ac152820 msgr2=0x7f88ac1593f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:43.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.985+0000 7f88b46ea640 1 --2- 10.20.193.49:0/2629560290 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f88ac152820 0x7f88ac1593f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f889c0098a0 tx=0x7f889c02ef00 comp rx=0 tx=0).stop 2026-02-17T11:11:43.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.985+0000 7f88b46ea640 1 -- 10.20.193.49:0/2629560290 shutdown_connections 2026-02-17T11:11:43.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.985+0000 7f88b46ea640 1 --2- 10.20.193.49:0/2629560290 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f88ac152820 0x7f88ac1593f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:43.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.985+0000 7f88b46ea640 1 -- 10.20.193.49:0/2629560290 >> 10.20.193.49:0/2629560290 conn(0x7f88ac0c9f40 msgr2=0x7f88ac0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:11:43.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.985+0000 7f88b46ea640 1 -- 10.20.193.49:0/2629560290 shutdown_connections 2026-02-17T11:11:43.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.985+0000 7f88b46ea640 1 -- 10.20.193.49:0/2629560290 wait complete. 2026-02-17T11:11:43.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.986+0000 7f88b46ea640 10 monclient: build_initial_monmap 2026-02-17T11:11:43.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.986+0000 7f88b46ea640 10 monclient: monmap: 2026-02-17T11:11:43.001 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:11:43.001 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:11:43.002 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:11:43.002 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:11:43.002 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:11:43.002 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:43.002 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:11:43.002 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:11:43.002 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:11:43.002 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:43.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.986+0000 7f88b46ea640 1 librados: starting msgr at 2026-02-17T11:11:43.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.986+0000 7f88b46ea640 1 librados: starting objecter 2026-02-17T11:11:43.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.986+0000 7f88b46ea640 1 Processor -- start 2026-02-17T11:11:43.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.986+0000 7f88b46ea640 1 -- start start 2026-02-17T11:11:43.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.986+0000 7f88b46ea640 1 librados: setting wanted keys 2026-02-17T11:11:43.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.986+0000 7f88b46ea640 1 librados: calling monclient init 2026-02-17T11:11:43.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.986+0000 7f88b46ea640 10 monclient: init 2026-02-17T11:11:43.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.986+0000 7f88b46ea640 10 monclient: _reopen_session rank -1 2026-02-17T11:11:43.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.986+0000 7f88b46ea640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:11:43.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.986+0000 7f88b46ea640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f88ac0738f0 0x7f88ac06ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:43.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.986+0000 7f88b46ea640 10 monclient(hunting): picked mon.noname-b con 0x7f88ac0738f0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:11:43.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.986+0000 7f88b46ea640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f88ac152820 0x7f88ac167740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:43.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.986+0000 7f88b46ea640 10 monclient(hunting): picked mon.noname-a con 0x7f88ac152820 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:11:43.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.986+0000 7f88b46ea640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f88ac152c00 0x7f88ac167c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:43.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.986+0000 7f88b46ea640 10 monclient(hunting): picked mon.noname-c con 0x7f88ac152c00 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:11:43.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.986+0000 7f88b46ea640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:43.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.986+0000 7f88b46ea640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f88ac074cf0 con 0x7f88ac152820 2026-02-17T11:11:43.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.986+0000 7f88b46ea640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:43.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.986+0000 7f88b46ea640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f88ac074a10 con 0x7f88ac0738f0 2026-02-17T11:11:43.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.986+0000 7f88b46ea640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:43.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.986+0000 7f88b46ea640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f88ac0c63f0 con 0x7f88ac152c00 2026-02-17T11:11:43.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.986+0000 7f88b46ea640 10 monclient(hunting): _renew_subs 2026-02-17T11:11:43.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.986+0000 7f88b46ea640 10 monclient(hunting): authenticate will time out at 1179.650864s 2026-02-17T11:11:43.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.987+0000 7f88b245f640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f88ac0738f0 0x7f88ac06ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:43.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.987+0000 7f88b2c60640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f88ac152c00 0x7f88ac167c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:43.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.987+0000 7f88b1c5e640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f88ac152820 0x7f88ac167740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:43.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.987+0000 7f88b2c60640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f88ac152c00 0x7f88ac167c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:38190/0 (socket says 10.20.193.49:38190) 2026-02-17T11:11:43.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.987+0000 7f88b245f640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f88ac0738f0 0x7f88ac06ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:35648/0 (socket says 10.20.193.49:35648) 2026-02-17T11:11:43.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.987+0000 7f88b2c60640 1 -- 10.20.193.49:0/1338060727 learned_addr learned my addr 10.20.193.49:0/1338060727 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:11:43.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.987+0000 7f88b2c60640 10 monclient(hunting): get_auth_request con 0x7f88ac152c00 auth_method 0 2026-02-17T11:11:43.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.987+0000 7f88b2c60640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:43.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.987+0000 7f88b2c60640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:43.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.987+0000 7f88b2c60640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:43.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.987+0000 7f88b245f640 10 monclient(hunting): get_auth_request con 0x7f88ac0738f0 auth_method 0 2026-02-17T11:11:43.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.987+0000 7f88b245f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:43.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.987+0000 7f88b245f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:43.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.987+0000 7f88b245f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:43.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.987+0000 7f88b1c5e640 10 monclient(hunting): get_auth_request con 0x7f88ac152820 auth_method 0 2026-02-17T11:11:43.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.987+0000 7f88b1c5e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:43.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.987+0000 7f88b1c5e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:43.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.987+0000 7f88b1c5e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:43.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.987+0000 7f88b2c60640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:43.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.987+0000 7f88b2c60640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:43.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.987+0000 7f88b2c60640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:43.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.987+0000 7f88b1c5e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:43.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.987+0000 7f88b1c5e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:43.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.987+0000 7f88b1c5e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:43.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.987+0000 7f88b245f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:43.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.987+0000 7f88b245f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:43.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.987+0000 7f88b245f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:43.007 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.988+0000 7f88b1c5e640 10 monclient(hunting): handle_auth_done global_id 4737 payload 824 2026-02-17T11:11:43.007 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.988+0000 7f88b1c5e640 1 -- 10.20.193.49:0/1338060727 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f88ac152c00 msgr2=0x7f88ac167c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:43.007 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.988+0000 7f88b1c5e640 1 --2- 10.20.193.49:0/1338060727 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f88ac152c00 0x7f88ac167c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:43.007 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.988+0000 7f88b1c5e640 1 -- 10.20.193.49:0/1338060727 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f88ac0738f0 msgr2=0x7f88ac06ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:43.007 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.988+0000 7f88b1c5e640 1 --2- 10.20.193.49:0/1338060727 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f88ac0738f0 0x7f88ac06ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:43.007 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.988+0000 7f88b1c5e640 10 monclient: _finish_hunting 0 2026-02-17T11:11:43.007 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.988+0000 7f88b1c5e640 1 monclient: found mon.noname-a 2026-02-17T11:11:43.007 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.988+0000 7f88b1c5e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:11:43.007 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.988+0000 7f88b1c5e640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:11:43.007 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.988+0000 7f88b1c5e640 1 -- 10.20.193.49:0/1338060727 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88ac1663c0 con 0x7f88ac152820 2026-02-17T11:11:43.007 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.989+0000 7f88b1c5e640 1 --2- 10.20.193.49:0/1338060727 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f88ac152820 0x7f88ac167740 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f88a000c420 tx=0x7f88a000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:11:43.008 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.990+0000 7f8892ffd640 10 client.?.objecter ms_handle_connect 0x7f88ac152820 2026-02-17T11:11:43.008 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.990+0000 7f8892ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:11:43.008 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.991+0000 7f8892ffd640 1 -- 10.20.193.49:0/1338060727 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a0017070 con 0x7f88ac152820 2026-02-17T11:11:43.008 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.991+0000 7f8892ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:43.008 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.991+0000 7f8892ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:11:43.008 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.991+0000 7f8892ffd640 10 monclient: dump: 2026-02-17T11:11:43.008 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:43.008 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:43.008 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:43.008 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:43.008 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:43.008 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:43.009 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:43.009 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:43.009 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:43.009 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:43.009 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.991+0000 7f8892ffd640 10 monclient: _finish_auth 0 2026-02-17T11:11:43.009 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.991+0000 7f8892ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:11:43.009 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.991+0000 7f8892ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:11:43.009 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.991+0000 7f8892ffd640 1 -- 10.20.193.49:0/1338060727 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88a0005e00 con 0x7f88ac152820 2026-02-17T11:11:43.009 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.991+0000 7f8892ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:11:43.009 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.991+0000 7f8892ffd640 1 -- 10.20.193.49:0/1338060727 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a00072b0 con 0x7f88ac152820 2026-02-17T11:11:43.009 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.991+0000 7f8892ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:43.010 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.991+0000 7f8892ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:11:43.010 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.991+0000 7f8892ffd640 10 monclient: dump: 2026-02-17T11:11:43.010 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:43.010 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:43.010 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:43.010 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:43.010 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:43.010 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:43.010 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:43.010 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:43.010 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:43.010 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:43.011 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.991+0000 7f88b0c5c640 4 set_mon_vals no callback set 2026-02-17T11:11:43.011 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.991+0000 7f88b46ea640 5 monclient: authenticate success, global_id 4737 2026-02-17T11:11:43.011 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.991+0000 7f88b46ea640 10 monclient: _renew_subs 2026-02-17T11:11:43.011 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.991+0000 7f88b46ea640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:11:43.011 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.991+0000 7f88b46ea640 1 -- 10.20.193.49:0/1338060727 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88ac1666a0 con 0x7f88ac152820 2026-02-17T11:11:43.011 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.991+0000 7f88b46ea640 10 client.4737.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:11:43.011 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.991+0000 7f88b46ea640 10 monclient: _renew_subs 2026-02-17T11:11:43.011 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.991+0000 7f88b46ea640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:11:43.011 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.991+0000 7f88b46ea640 1 -- 10.20.193.49:0/1338060727 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88ac166c60 con 0x7f88ac152820 2026-02-17T11:11:43.011 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.991+0000 7f88b46ea640 1 librados: init done 2026-02-17T11:11:43.011 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.992+0000 7f88b46ea640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:11:43.011 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.992+0000 7f88b46ea640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:11:43.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.992+0000 7f88b46ea640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:11:43.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:42.992+0000 7f88b46ea640 1 -- 10.20.193.49:0/1338060727 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88ac1593f0 con 0x7f88ac152820 2026-02-17T11:11:43.013 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:43.004+0000 7f8892ffd640 1 -- 10.20.193.49:0/1338060727 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f88a0007510 con 0x7f88ac152820 2026-02-17T11:11:43.013 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:43.005+0000 7f8892ffd640 1 --2- 10.20.193.49:0/1338060727 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f887c079140 0x7f887c07b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:43.013 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:43.005+0000 7f88b245f640 1 --2- 10.20.193.49:0/1338060727 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f887c079140 0x7f887c07b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:43.013 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:43.005+0000 7f88b245f640 10 monclient: get_auth_request con 0x7f887c079140 auth_method 0 2026-02-17T11:11:43.013 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:43.005+0000 7f88b245f640 1 --2- 10.20.193.49:0/1338060727 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f887c079140 0x7f887c07b600 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f889c039000 tx=0x7f889c033000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:11:43.013 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:43.005+0000 7f8892ffd640 10 client.4737.objecter ms_handle_connect 0x7f887c079140 2026-02-17T11:11:43.109 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:43.107+0000 7f8892ffd640 1 -- 10.20.193.49:0/1338060727 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f88a0007830 con 0x7f88ac152820 2026-02-17T11:11:43.110 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:43.107+0000 7f8892ffd640 10 client.4737.objecter ms_dispatch2 0x7f88ac000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:11:43.110 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:43.107+0000 7f8892ffd640 3 client.4737.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:11:43.110 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:43.107+0000 7f8892ffd640 3 client.4737.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:11:43.110 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:43.107+0000 7f8892ffd640 20 client.4737.objecter dump_active .. 0 homeless 2026-02-17T11:11:43.110 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:43.107+0000 7f8892ffd640 1 -- 10.20.193.49:0/1338060727 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f88a0021080 con 0x7f88ac152820 2026-02-17T11:11:43.110 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:43.107+0000 7f8892ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:11:43.110 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:43.107+0000 7f8892ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:11:43.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:43.217+0000 7f88b46ea640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:11:43.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:43.217+0000 7f88b46ea640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:11:43.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:43.217+0000 7f88b46ea640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:11:43.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:43.217+0000 7f88b46ea640 1 -- 10.20.193.49:0/1338060727 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f88ac0ccb40 con 0x7f88ac152820 2026-02-17T11:11:43.223 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:43.220+0000 7f8892ffd640 1 -- 10.20.193.49:0/1338060727 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f88a0061520 con 0x7f88ac152820 2026-02-17T11:11:43.223 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:43.220+0000 7f8892ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:11:43.223 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:43.220+0000 7f8892ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:11:43.224 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:11:43.224 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:11:43.226 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:43.221+0000 7f88b46ea640 10 librados: watch_flush enter 2026-02-17T11:11:43.226 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:43.221+0000 7f88b46ea640 10 librados: watch_flush exit 2026-02-17T11:11:43.226 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:43.221+0000 7f88b46ea640 20 client.4737.objecter shutdown clearing up homeless session... 2026-02-17T11:11:43.226 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:43.221+0000 7f88b46ea640 10 client.4737.objecter successfully canceled tick 2026-02-17T11:11:43.226 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:43.221+0000 7f88b46ea640 1 -- 10.20.193.49:0/1338060727 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f887c079140 msgr2=0x7f887c07b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:43.226 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:43.221+0000 7f88b46ea640 1 --2- 10.20.193.49:0/1338060727 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f887c079140 0x7f887c07b600 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f889c039000 tx=0x7f889c033000 comp rx=0 tx=0).stop 2026-02-17T11:11:43.226 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:43.221+0000 7f88b46ea640 10 monclient: shutdown 2026-02-17T11:11:43.226 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:43.221+0000 7f88b46ea640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:11:43.226 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:43.221+0000 7f88b46ea640 1 -- 10.20.193.49:0/1338060727 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f88ac152820 msgr2=0x7f88ac167740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:43.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:43.221+0000 7f88b46ea640 1 --2- 10.20.193.49:0/1338060727 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f88ac152820 0x7f88ac167740 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f88a000c420 tx=0x7f88a000c8f0 comp rx=0 tx=0).stop 2026-02-17T11:11:43.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:43.221+0000 7f88b46ea640 1 -- 10.20.193.49:0/1338060727 shutdown_connections 2026-02-17T11:11:43.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:43.221+0000 7f88b46ea640 1 --2- 10.20.193.49:0/1338060727 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f887c079140 0x7f887c07b600 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:43.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:43.221+0000 7f88b46ea640 1 --2- 10.20.193.49:0/1338060727 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f88ac152c00 0x7f88ac167c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:43.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:43.221+0000 7f88b46ea640 1 --2- 10.20.193.49:0/1338060727 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f88ac152820 0x7f88ac167740 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:43.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:43.221+0000 7f88b46ea640 1 --2- 10.20.193.49:0/1338060727 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f88ac0738f0 0x7f88ac06ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:43.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:43.221+0000 7f88b46ea640 1 -- 10.20.193.49:0/1338060727 >> 10.20.193.49:0/1338060727 conn(0x7f88ac0c9f40 msgr2=0x7f88ac0c7230 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:11:43.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:43.221+0000 7f88b46ea640 1 -- 10.20.193.49:0/1338060727 shutdown_connections 2026-02-17T11:11:43.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:43.221+0000 7f88b46ea640 1 -- 10.20.193.49:0/1338060727 wait complete. 2026-02-17T11:11:43.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:43.221+0000 7f88b46ea640 1 librados: shutdown 2026-02-17T11:11:46.234 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:11:46.302 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.299+0000 7f4911f2c640 10 monclient: get_monmap_and_config 2026-02-17T11:11:46.302 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.299+0000 7f4911f2c640 10 monclient: build_initial_monmap 2026-02-17T11:11:46.302 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.299+0000 7f4911f2c640 10 monclient: monmap: 2026-02-17T11:11:46.302 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:11:46.302 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:46.302 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:11:46.301321+0000 2026-02-17T11:11:46.302 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:11:46.301321+0000 2026-02-17T11:11:46.302 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:11:46.302 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:46.302 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:11:46.302 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:11:46.302 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:11:46.302 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:11:46.302 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:11:46.302 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:11:46.302 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:46.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.300+0000 7f4911f2c640 1 Processor -- start 2026-02-17T11:11:46.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.300+0000 7f4911f2c640 1 -- start start 2026-02-17T11:11:46.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.300+0000 7f4911f2c640 10 monclient: init 2026-02-17T11:11:46.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.300+0000 7f4911f2c640 10 monclient: _reopen_session rank -1 2026-02-17T11:11:46.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.300+0000 7f4911f2c640 10 monclient: _add_conns ranks=[3,1,2,0,5,4] 2026-02-17T11:11:46.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.300+0000 7f4911f2c640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f490c0c7170 0x7f490c0c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:46.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.300+0000 7f4911f2c640 10 monclient(hunting): picked mon.noname-a con 0x7f490c0c7170 addr v2:10.20.193.49:3300/0 2026-02-17T11:11:46.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.300+0000 7f4911f2c640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f490c0c48c0 addr v1:10.20.193.97:6789/0 2026-02-17T11:11:46.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.300+0000 7f4911f2c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f490c0c4d10 addr v1:10.20.193.157:6789/0 2026-02-17T11:11:46.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.300+0000 7f4911f2c640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f490c15a9a0 con 0x7f490c0c48c0 2026-02-17T11:11:46.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.300+0000 7f4911f2c640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f490c0c5270 con 0x7f490c0c4d10 2026-02-17T11:11:46.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.300+0000 7f4911f2c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:46.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.300+0000 7f4911f2c640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f490c0c8530 con 0x7f490c0c7170 2026-02-17T11:11:46.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.300+0000 7f4911f2c640 10 monclient(hunting): _renew_subs 2026-02-17T11:11:46.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.300+0000 7f4911f2c640 10 monclient(hunting): authenticate will time out at 1182.964786s 2026-02-17T11:11:46.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.301+0000 7f490b7fe640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f490c0c7170 0x7f490c0c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:46.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.301+0000 7f490affd640 1 --1- >> v1:10.20.193.97:6789/0 conn(0x7f490c0c48c0 0x7f490c0749b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.97:6789/0 says I am v1:10.20.193.49:58228/0 (socket says 10.20.193.49:58228) 2026-02-17T11:11:46.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.301+0000 7f490affd640 1 -- 10.20.193.49:0/2219764624 learned_addr learned my addr 10.20.193.49:0/2219764624 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:11:46.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.301+0000 7f490b7fe640 10 monclient(hunting): get_auth_request con 0x7f490c0c7170 auth_method 0 2026-02-17T11:11:46.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.301+0000 7f490b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:46.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.301+0000 7f490b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:46.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.301+0000 7f490b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:46.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.301+0000 7f490b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:46.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.301+0000 7f490b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:46.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.301+0000 7f490b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:46.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.302+0000 7f490b7fe640 10 monclient(hunting): handle_auth_done global_id 4740 payload 274 2026-02-17T11:11:46.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.302+0000 7f490b7fe640 1 -- 10.20.193.49:0/2219764624 >> v1:10.20.193.157:6789/0 conn(0x7f490c0c4d10 legacy=0x7f490c0c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:46.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.302+0000 7f490b7fe640 1 -- 10.20.193.49:0/2219764624 >> v1:10.20.193.97:6789/0 conn(0x7f490c0c48c0 legacy=0x7f490c0749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:46.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.302+0000 7f490b7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:11:46.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.302+0000 7f490b7fe640 1 monclient: found mon.noname-a 2026-02-17T11:11:46.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.302+0000 7f490b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:11:46.305 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.302+0000 7f490b7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:11:46.305 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.302+0000 7f490b7fe640 1 -- 10.20.193.49:0/2219764624 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f490c0c5550 con 0x7f490c0c7170 2026-02-17T11:11:46.305 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.303+0000 7f490b7fe640 1 --2- 10.20.193.49:0/2219764624 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f490c0c7170 0x7f490c0c7550 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f48f80098a0 tx=0x7f48f802ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a475c6fbcef7bfd server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:11:46.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.304+0000 7f490a7fc640 1 -- 10.20.193.49:0/2219764624 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f803c070 con 0x7f490c0c7170 2026-02-17T11:11:46.312 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.304+0000 7f490a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:46.312 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.304+0000 7f490a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:11:46.312 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.304+0000 7f490a7fc640 10 monclient: dump: 2026-02-17T11:11:46.312 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:46.312 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:46.312 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:46.312 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:46.312 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:46.312 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:46.313 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:46.313 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:46.313 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:46.313 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:46.313 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.304+0000 7f490a7fc640 10 monclient: _finish_auth 0 2026-02-17T11:11:46.313 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.304+0000 7f490a7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:11:46.313 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.304+0000 7f490a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:11:46.313 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.304+0000 7f4911f2c640 5 monclient: authenticate success, global_id 4740 2026-02-17T11:11:46.313 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.304+0000 7f4911f2c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:11:46.313 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.304+0000 7f490a7fc640 1 -- 10.20.193.49:0/2219764624 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48f802fb70 con 0x7f490c0c7170 2026-02-17T11:11:46.313 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.304+0000 7f490a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:11:46.314 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.304+0000 7f490a7fc640 1 -- 10.20.193.49:0/2219764624 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f8037440 con 0x7f490c0c7170 2026-02-17T11:11:46.314 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.304+0000 7f490a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:46.314 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.304+0000 7f490a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:11:46.314 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.304+0000 7f490a7fc640 10 monclient: dump: 2026-02-17T11:11:46.314 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:46.314 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:46.314 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:46.314 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:46.314 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:46.314 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:46.314 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:46.314 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:46.315 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:46.315 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:46.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.304+0000 7f4911f2c640 10 monclient: get_monmap_and_config success 2026-02-17T11:11:46.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.304+0000 7f4911f2c640 4 set_mon_vals no callback set 2026-02-17T11:11:46.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.305+0000 7f4911f2c640 10 monclient: shutdown 2026-02-17T11:11:46.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.305+0000 7f4911f2c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:11:46.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.305+0000 7f4911f2c640 1 -- 10.20.193.49:0/2219764624 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f490c0c7170 msgr2=0x7f490c0c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:46.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.305+0000 7f4911f2c640 1 --2- 10.20.193.49:0/2219764624 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f490c0c7170 0x7f490c0c7550 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f48f80098a0 tx=0x7f48f802ee60 comp rx=0 tx=0).stop 2026-02-17T11:11:46.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.305+0000 7f4911f2c640 1 -- 10.20.193.49:0/2219764624 shutdown_connections 2026-02-17T11:11:46.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.305+0000 7f4911f2c640 1 --2- 10.20.193.49:0/2219764624 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f490c0c7170 0x7f490c0c7550 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:46.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.305+0000 7f4911f2c640 1 -- 10.20.193.49:0/2219764624 >> 10.20.193.49:0/2219764624 conn(0x7f490c0c9f40 msgr2=0x7f490c0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:11:46.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.305+0000 7f4911f2c640 1 -- 10.20.193.49:0/2219764624 shutdown_connections 2026-02-17T11:11:46.316 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.305+0000 7f4911f2c640 1 -- 10.20.193.49:0/2219764624 wait complete. 2026-02-17T11:11:46.316 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.305+0000 7f4911f2c640 10 monclient: build_initial_monmap 2026-02-17T11:11:46.316 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.305+0000 7f4911f2c640 10 monclient: monmap: 2026-02-17T11:11:46.316 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:11:46.316 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:11:46.316 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:11:46.316 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:11:46.316 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:11:46.316 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:46.316 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:11:46.316 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:11:46.316 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:11:46.317 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:46.317 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.305+0000 7f4911f2c640 1 librados: starting msgr at 2026-02-17T11:11:46.317 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.305+0000 7f4911f2c640 1 librados: starting objecter 2026-02-17T11:11:46.317 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.305+0000 7f4911f2c640 1 Processor -- start 2026-02-17T11:11:46.317 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.306+0000 7f4911f2c640 1 -- start start 2026-02-17T11:11:46.317 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.306+0000 7f4911f2c640 1 librados: setting wanted keys 2026-02-17T11:11:46.317 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.306+0000 7f4911f2c640 1 librados: calling monclient init 2026-02-17T11:11:46.317 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.306+0000 7f4911f2c640 10 monclient: init 2026-02-17T11:11:46.317 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.306+0000 7f4911f2c640 10 monclient: _reopen_session rank -1 2026-02-17T11:11:46.317 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.306+0000 7f4911f2c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:11:46.317 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.306+0000 7f4911f2c640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f490c0c48c0 0x7f490c06d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:46.317 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.306+0000 7f4911f2c640 10 monclient(hunting): picked mon.noname-c con 0x7f490c0c48c0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:11:46.318 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.306+0000 7f4911f2c640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f490c0c4d10 0x7f490c1f4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:46.318 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.306+0000 7f4911f2c640 10 monclient(hunting): picked mon.noname-a con 0x7f490c0c4d10 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:11:46.318 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.306+0000 7f4911f2c640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f490c0c7170 0x7f490c06f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:46.318 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.306+0000 7f4911f2c640 10 monclient(hunting): picked mon.noname-b con 0x7f490c0c7170 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:11:46.318 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.306+0000 7f4911f2c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:46.318 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.306+0000 7f4911f2c640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f490c0c81c0 con 0x7f490c0c4d10 2026-02-17T11:11:46.318 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.306+0000 7f4911f2c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:46.318 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.306+0000 7f4911f2c640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f490c0c7ee0 con 0x7f490c0c7170 2026-02-17T11:11:46.318 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.306+0000 7f4911f2c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:46.318 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.306+0000 7f4911f2c640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f490c0750c0 con 0x7f490c0c48c0 2026-02-17T11:11:46.318 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.306+0000 7f4911f2c640 10 monclient(hunting): _renew_subs 2026-02-17T11:11:46.318 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.306+0000 7f4911f2c640 10 monclient(hunting): authenticate will time out at 1182.970461s 2026-02-17T11:11:46.319 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.306+0000 7f490affd640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f490c0c4d10 0x7f490c1f4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:46.319 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.306+0000 7f490bfff640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f490c0c7170 0x7f490c06f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:46.319 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.306+0000 7f490b7fe640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f490c0c48c0 0x7f490c06d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:46.319 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.306+0000 7f490affd640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f490c0c4d10 0x7f490c1f4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:48418/0 (socket says 10.20.193.49:48418) 2026-02-17T11:11:46.319 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.306+0000 7f490affd640 1 -- 10.20.193.49:0/4241282824 learned_addr learned my addr 10.20.193.49:0/4241282824 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:11:46.319 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.306+0000 7f490affd640 10 monclient(hunting): get_auth_request con 0x7f490c0c4d10 auth_method 0 2026-02-17T11:11:46.319 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.306+0000 7f490affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:46.319 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.306+0000 7f490affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:46.319 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.306+0000 7f490affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:46.319 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.306+0000 7f490b7fe640 10 monclient(hunting): get_auth_request con 0x7f490c0c48c0 auth_method 0 2026-02-17T11:11:46.319 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.306+0000 7f490b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:46.319 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.306+0000 7f490b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:46.320 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.306+0000 7f490b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:46.320 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.306+0000 7f490bfff640 10 monclient(hunting): get_auth_request con 0x7f490c0c7170 auth_method 0 2026-02-17T11:11:46.320 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.306+0000 7f490bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:46.320 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.306+0000 7f490bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:46.320 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.306+0000 7f490bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:46.320 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.307+0000 7f490affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:46.320 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.307+0000 7f490affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:46.320 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.307+0000 7f490affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:46.320 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.307+0000 7f490b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:46.320 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.307+0000 7f490b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:46.320 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.307+0000 7f490b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:46.320 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.307+0000 7f490bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:46.321 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.307+0000 7f490bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:46.321 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.307+0000 7f490bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:46.321 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.308+0000 7f490affd640 10 monclient(hunting): handle_auth_done global_id 4743 payload 824 2026-02-17T11:11:46.321 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.308+0000 7f490affd640 1 -- 10.20.193.49:0/4241282824 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f490c0c48c0 msgr2=0x7f490c06d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:46.321 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.308+0000 7f490affd640 1 --2- 10.20.193.49:0/4241282824 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f490c0c48c0 0x7f490c06d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:46.321 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.308+0000 7f490affd640 1 -- 10.20.193.49:0/4241282824 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f490c0c7170 msgr2=0x7f490c06f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:46.321 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.308+0000 7f490affd640 1 --2- 10.20.193.49:0/4241282824 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f490c0c7170 0x7f490c06f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:46.321 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.308+0000 7f490affd640 10 monclient: _finish_hunting 0 2026-02-17T11:11:46.321 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.308+0000 7f490affd640 1 monclient: found mon.noname-a 2026-02-17T11:11:46.321 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.308+0000 7f490affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:11:46.321 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.308+0000 7f490affd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:11:46.321 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.308+0000 7f490affd640 1 -- 10.20.193.49:0/4241282824 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f490c06e580 con 0x7f490c0c4d10 2026-02-17T11:11:46.321 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.309+0000 7f490affd640 1 --2- 10.20.193.49:0/4241282824 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f490c0c4d10 0x7f490c1f4120 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f48fc00c4d0 tx=0x7f48fc00c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:11:46.322 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.309+0000 7f48e7fff640 10 client.?.objecter ms_handle_connect 0x7f490c0c4d10 2026-02-17T11:11:46.322 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.309+0000 7f48e7fff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:11:46.323 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.311+0000 7f48e7fff640 1 -- 10.20.193.49:0/4241282824 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48fc017070 con 0x7f490c0c4d10 2026-02-17T11:11:46.323 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.311+0000 7f48e7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:46.324 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.311+0000 7f48e7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:11:46.324 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.311+0000 7f48e7fff640 10 monclient: dump: 2026-02-17T11:11:46.324 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:46.324 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:46.324 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:46.324 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:46.324 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:46.324 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:46.324 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:46.324 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:46.324 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:46.324 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:46.325 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.311+0000 7f48e7fff640 10 monclient: _finish_auth 0 2026-02-17T11:11:46.325 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.311+0000 7f48e7fff640 10 monclient: _check_auth_tickets 2026-02-17T11:11:46.325 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.311+0000 7f48e7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:11:46.325 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.311+0000 7f48e7fff640 1 -- 10.20.193.49:0/4241282824 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48fc005de0 con 0x7f490c0c4d10 2026-02-17T11:11:46.325 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.311+0000 7f48e7fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:11:46.325 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.311+0000 7f48e7fff640 1 -- 10.20.193.49:0/4241282824 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48fc007290 con 0x7f490c0c4d10 2026-02-17T11:11:46.325 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.311+0000 7f48e7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:46.325 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.311+0000 7f48e7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:11:46.325 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.311+0000 7f48e7fff640 10 monclient: dump: 2026-02-17T11:11:46.325 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:46.325 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:46.325 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:46.326 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:46.326 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:46.326 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:46.326 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:46.326 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:46.326 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:46.326 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:46.326 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.311+0000 7f4909ffb640 4 set_mon_vals no callback set 2026-02-17T11:11:46.326 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.311+0000 7f4911f2c640 5 monclient: authenticate success, global_id 4743 2026-02-17T11:11:46.326 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.311+0000 7f4911f2c640 10 monclient: _renew_subs 2026-02-17T11:11:46.326 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.311+0000 7f4911f2c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:11:46.326 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.311+0000 7f4911f2c640 1 -- 10.20.193.49:0/4241282824 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f490c06dce0 con 0x7f490c0c4d10 2026-02-17T11:11:46.327 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.311+0000 7f4911f2c640 10 client.4743.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:11:46.327 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.311+0000 7f4911f2c640 10 monclient: _renew_subs 2026-02-17T11:11:46.327 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.311+0000 7f4911f2c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:11:46.327 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.311+0000 7f4911f2c640 1 -- 10.20.193.49:0/4241282824 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f490c06e2a0 con 0x7f490c0c4d10 2026-02-17T11:11:46.327 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.311+0000 7f4911f2c640 1 librados: init done 2026-02-17T11:11:46.327 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.311+0000 7f4911f2c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:11:46.327 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.311+0000 7f4911f2c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:11:46.327 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.311+0000 7f4911f2c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:11:46.327 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.311+0000 7f4911f2c640 1 -- 10.20.193.49:0/4241282824 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f490c0c7b10 con 0x7f490c0c4d10 2026-02-17T11:11:46.328 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.323+0000 7f48e7fff640 1 -- 10.20.193.49:0/4241282824 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f48fc007430 con 0x7f490c0c4d10 2026-02-17T11:11:46.329 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.323+0000 7f48e7fff640 1 --2- 10.20.193.49:0/4241282824 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f48dc079140 0x7f48dc07b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:46.329 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.323+0000 7f490b7fe640 1 --2- 10.20.193.49:0/4241282824 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f48dc079140 0x7f48dc07b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:46.329 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.323+0000 7f490b7fe640 10 monclient: get_auth_request con 0x7f48dc079140 auth_method 0 2026-02-17T11:11:46.329 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.324+0000 7f490b7fe640 1 --2- 10.20.193.49:0/4241282824 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f48dc079140 0x7f48dc07b600 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f48f8039000 tx=0x7f48f8033000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:11:46.329 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.324+0000 7f48e7fff640 10 client.4743.objecter ms_handle_connect 0x7f48dc079140 2026-02-17T11:11:46.329 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.326+0000 7f48e7fff640 1 -- 10.20.193.49:0/4241282824 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f48fc007750 con 0x7f490c0c4d10 2026-02-17T11:11:46.329 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.326+0000 7f48e7fff640 10 client.4743.objecter ms_dispatch2 0x7f490c000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:11:46.329 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.326+0000 7f48e7fff640 3 client.4743.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:11:46.329 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.326+0000 7f48e7fff640 3 client.4743.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:11:46.329 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.326+0000 7f48e7fff640 20 client.4743.objecter dump_active .. 0 homeless 2026-02-17T11:11:46.428 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.426+0000 7f48e7fff640 1 -- 10.20.193.49:0/4241282824 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f490c0c7b10 con 0x7f490c0c4d10 2026-02-17T11:11:46.428 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.426+0000 7f48e7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:11:46.428 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.426+0000 7f48e7fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:11:46.529 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.526+0000 7f4911f2c640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:11:46.529 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.526+0000 7f4911f2c640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:11:46.529 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.526+0000 7f4911f2c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:11:46.529 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.526+0000 7f4911f2c640 1 -- 10.20.193.49:0/4241282824 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f490c0c7550 con 0x7f490c0c4d10 2026-02-17T11:11:46.531 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.529+0000 7f48e7fff640 1 -- 10.20.193.49:0/4241282824 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f48fc021020 con 0x7f490c0c4d10 2026-02-17T11:11:46.531 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.529+0000 7f48e7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:11:46.531 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.529+0000 7f48e7fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:11:46.532 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:11:46.532 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:11:46.533 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.530+0000 7f4911f2c640 10 librados: watch_flush enter 2026-02-17T11:11:46.534 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.530+0000 7f4911f2c640 10 librados: watch_flush exit 2026-02-17T11:11:46.534 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.530+0000 7f4911f2c640 20 client.4743.objecter shutdown clearing up homeless session... 2026-02-17T11:11:46.534 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.530+0000 7f4911f2c640 10 client.4743.objecter successfully canceled tick 2026-02-17T11:11:46.534 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.530+0000 7f4911f2c640 1 -- 10.20.193.49:0/4241282824 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f48dc079140 msgr2=0x7f48dc07b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:46.534 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.530+0000 7f4911f2c640 1 --2- 10.20.193.49:0/4241282824 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f48dc079140 0x7f48dc07b600 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f48f8039000 tx=0x7f48f8033000 comp rx=0 tx=0).stop 2026-02-17T11:11:46.534 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.530+0000 7f4911f2c640 10 monclient: shutdown 2026-02-17T11:11:46.534 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.530+0000 7f4911f2c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:11:46.534 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.530+0000 7f4911f2c640 1 -- 10.20.193.49:0/4241282824 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f490c0c4d10 msgr2=0x7f490c1f4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:46.534 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.530+0000 7f4911f2c640 1 --2- 10.20.193.49:0/4241282824 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f490c0c4d10 0x7f490c1f4120 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f48fc00c4d0 tx=0x7f48fc00c9a0 comp rx=0 tx=0).stop 2026-02-17T11:11:46.534 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.530+0000 7f4911f2c640 1 -- 10.20.193.49:0/4241282824 shutdown_connections 2026-02-17T11:11:46.535 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.530+0000 7f4911f2c640 1 --2- 10.20.193.49:0/4241282824 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f48dc079140 0x7f48dc07b600 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:46.535 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.530+0000 7f4911f2c640 1 --2- 10.20.193.49:0/4241282824 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f490c0c7170 0x7f490c06f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:46.535 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.530+0000 7f4911f2c640 1 --2- 10.20.193.49:0/4241282824 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f490c0c4d10 0x7f490c1f4120 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:46.535 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.530+0000 7f4911f2c640 1 --2- 10.20.193.49:0/4241282824 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f490c0c48c0 0x7f490c06d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:46.535 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.530+0000 7f4911f2c640 1 -- 10.20.193.49:0/4241282824 >> 10.20.193.49:0/4241282824 conn(0x7f490c0c9f40 msgr2=0x7f490c0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:11:46.535 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.530+0000 7f4911f2c640 1 -- 10.20.193.49:0/4241282824 shutdown_connections 2026-02-17T11:11:46.535 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.530+0000 7f4911f2c640 1 -- 10.20.193.49:0/4241282824 wait complete. 2026-02-17T11:11:46.535 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:46.530+0000 7f4911f2c640 1 librados: shutdown 2026-02-17T11:11:49.542 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:11:49.611 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.608+0000 7f37b749f640 10 monclient: get_monmap_and_config 2026-02-17T11:11:49.611 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.608+0000 7f37b749f640 10 monclient: build_initial_monmap 2026-02-17T11:11:49.611 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.608+0000 7f37b749f640 10 monclient: monmap: 2026-02-17T11:11:49.611 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:11:49.612 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:49.612 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:11:49.609902+0000 2026-02-17T11:11:49.612 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:11:49.609902+0000 2026-02-17T11:11:49.612 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:11:49.612 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:49.612 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:11:49.612 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:11:49.612 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:11:49.612 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:11:49.612 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:11:49.612 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:11:49.613 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:49.613 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.608+0000 7f37b749f640 1 Processor -- start 2026-02-17T11:11:49.613 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.608+0000 7f37b749f640 1 -- start start 2026-02-17T11:11:49.613 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.608+0000 7f37b749f640 10 monclient: init 2026-02-17T11:11:49.614 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.609+0000 7f37b749f640 10 monclient: _reopen_session rank -1 2026-02-17T11:11:49.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.609+0000 7f37b749f640 10 monclient: _add_conns ranks=[3,1,0,5,2,4] 2026-02-17T11:11:49.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.609+0000 7f37b749f640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f37b015f690 0x7f37b015fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:49.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.609+0000 7f37b749f640 10 monclient(hunting): picked mon.noname-a con 0x7f37b015f690 addr v2:10.20.193.49:3300/0 2026-02-17T11:11:49.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.609+0000 7f37b749f640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f37b00c9050 addr v1:10.20.193.97:6789/0 2026-02-17T11:11:49.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.609+0000 7f37b749f640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f37b0072de0 addr v1:10.20.193.49:6789/0 2026-02-17T11:11:49.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.609+0000 7f37b749f640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37b00732e0 con 0x7f37b0072de0 2026-02-17T11:11:49.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.609+0000 7f37b749f640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37b00735c0 con 0x7f37b00c9050 2026-02-17T11:11:49.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.609+0000 7f37b749f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:49.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.609+0000 7f37b749f640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f37b00738a0 con 0x7f37b015f690 2026-02-17T11:11:49.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.609+0000 7f37b749f640 10 monclient(hunting): _renew_subs 2026-02-17T11:11:49.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.609+0000 7f37b749f640 10 monclient(hunting): authenticate will time out at 1186.273392s 2026-02-17T11:11:49.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.609+0000 7f37b5214640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f37b015f690 0x7f37b015fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:49.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.609+0000 7f37b4a13640 1 --1- >> v1:10.20.193.97:6789/0 conn(0x7f37b00c9050 0x7f37b00726d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.97:6789/0 says I am v1:10.20.193.49:58242/0 (socket says 10.20.193.49:58242) 2026-02-17T11:11:49.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.609+0000 7f37b4a13640 1 -- 10.20.193.49:0/288515128 learned_addr learned my addr 10.20.193.49:0/288515128 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:11:49.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.610+0000 7f37b5214640 10 monclient(hunting): get_auth_request con 0x7f37b015f690 auth_method 0 2026-02-17T11:11:49.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.610+0000 7f37b5214640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:49.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.610+0000 7f37b5214640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:49.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.610+0000 7f37b5214640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:49.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.610+0000 7f37b5214640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:49.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.610+0000 7f37b5214640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:49.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.610+0000 7f37b5214640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:49.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.611+0000 7f379ffff640 1 -- 10.20.193.49:0/288515128 <== mon.1 v1:10.20.193.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1057225043 0 0) 0x7f37b00735c0 con 0x7f37b00c9050 2026-02-17T11:11:49.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.611+0000 7f379ffff640 10 monclient(hunting): _negotiate 2026-02-17T11:11:49.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.611+0000 7f379ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:49.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.611+0000 7f379ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:49.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.611+0000 7f379ffff640 10 monclient(hunting): my global_id is 4726 2026-02-17T11:11:49.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.611+0000 7f379ffff640 1 -- 10.20.193.49:0/288515128 --> v1:10.20.193.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3798003620 con 0x7f37b00c9050 2026-02-17T11:11:49.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.612+0000 7f37b5214640 10 monclient(hunting): handle_auth_done global_id 4746 payload 274 2026-02-17T11:11:49.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.612+0000 7f37b5214640 1 -- 10.20.193.49:0/288515128 >> v1:10.20.193.97:6789/0 conn(0x7f37b00c9050 legacy=0x7f37b00726d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:49.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.612+0000 7f37b5214640 1 -- 10.20.193.49:0/288515128 >> v1:10.20.193.49:6789/0 conn(0x7f37b0072de0 legacy=0x7f37b015d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:49.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.612+0000 7f37b5214640 10 monclient: _finish_hunting 0 2026-02-17T11:11:49.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.612+0000 7f37b5214640 1 monclient: found mon.noname-a 2026-02-17T11:11:49.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.612+0000 7f37b5214640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:11:49.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.612+0000 7f37b5214640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:11:49.616 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.612+0000 7f37b5214640 1 -- 10.20.193.49:0/288515128 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37b0073b80 con 0x7f37b015f690 2026-02-17T11:11:49.616 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.614+0000 7f37b5214640 1 --2- 10.20.193.49:0/288515128 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f37b015f690 0x7f37b015fa70 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f37a00098a0 tx=0x7f37a002edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fa8f13c5a497c2e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:11:49.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.615+0000 7f379ffff640 1 -- 10.20.193.49:0/288515128 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37a003c070 con 0x7f37b015f690 2026-02-17T11:11:49.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.615+0000 7f379ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:49.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.615+0000 7f379ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:11:49.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.615+0000 7f379ffff640 10 monclient: dump: 2026-02-17T11:11:49.618 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:49.618 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:49.618 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:49.618 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:49.618 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:49.618 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:49.618 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:49.618 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:49.618 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:49.618 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:49.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.615+0000 7f379ffff640 10 monclient: _finish_auth 0 2026-02-17T11:11:49.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.615+0000 7f379ffff640 10 monclient: _check_auth_tickets 2026-02-17T11:11:49.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.615+0000 7f379ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:11:49.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.615+0000 7f379ffff640 1 -- 10.20.193.49:0/288515128 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37a002fae0 con 0x7f37b015f690 2026-02-17T11:11:49.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.615+0000 7f37b749f640 5 monclient: authenticate success, global_id 4746 2026-02-17T11:11:49.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.615+0000 7f37b749f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:11:49.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.615+0000 7f379ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:11:49.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.615+0000 7f379ffff640 1 -- 10.20.193.49:0/288515128 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37a0037440 con 0x7f37b015f690 2026-02-17T11:11:49.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.615+0000 7f37b749f640 10 monclient: get_monmap_and_config success 2026-02-17T11:11:49.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.615+0000 7f37b749f640 4 set_mon_vals no callback set 2026-02-17T11:11:49.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.615+0000 7f379ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:49.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.615+0000 7f379ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:11:49.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.615+0000 7f379ffff640 10 monclient: dump: 2026-02-17T11:11:49.618 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:49.618 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:49.618 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:49.618 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:49.618 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:49.618 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:49.618 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:49.618 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:49.618 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:49.618 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:49.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.616+0000 7f37b749f640 10 monclient: shutdown 2026-02-17T11:11:49.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.616+0000 7f37b749f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:11:49.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.616+0000 7f37b749f640 1 -- 10.20.193.49:0/288515128 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f37b015f690 msgr2=0x7f37b015fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:49.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.616+0000 7f37b749f640 1 --2- 10.20.193.49:0/288515128 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f37b015f690 0x7f37b015fa70 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f37a00098a0 tx=0x7f37a002edd0 comp rx=0 tx=0).stop 2026-02-17T11:11:49.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.616+0000 7f37b749f640 1 -- 10.20.193.49:0/288515128 shutdown_connections 2026-02-17T11:11:49.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.616+0000 7f37b749f640 1 --2- 10.20.193.49:0/288515128 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f37b015f690 0x7f37b015fa70 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:49.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.616+0000 7f37b749f640 1 -- 10.20.193.49:0/288515128 >> 10.20.193.49:0/288515128 conn(0x7f37b00c9f20 msgr2=0x7f37b00ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:11:49.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.616+0000 7f37b749f640 1 -- 10.20.193.49:0/288515128 shutdown_connections 2026-02-17T11:11:49.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.616+0000 7f37b749f640 1 -- 10.20.193.49:0/288515128 wait complete. 2026-02-17T11:11:49.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.616+0000 7f37b749f640 10 monclient: build_initial_monmap 2026-02-17T11:11:49.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.616+0000 7f37b749f640 10 monclient: monmap: 2026-02-17T11:11:49.620 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:11:49.620 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:11:49.620 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:11:49.620 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:11:49.620 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:11:49.620 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:49.620 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:11:49.620 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:11:49.620 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:11:49.620 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:49.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.616+0000 7f37b749f640 1 librados: starting msgr at 2026-02-17T11:11:49.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.616+0000 7f37b749f640 1 librados: starting objecter 2026-02-17T11:11:49.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.616+0000 7f37b749f640 1 Processor -- start 2026-02-17T11:11:49.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.616+0000 7f37b749f640 1 -- start start 2026-02-17T11:11:49.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.616+0000 7f37b749f640 1 librados: setting wanted keys 2026-02-17T11:11:49.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.616+0000 7f37b749f640 1 librados: calling monclient init 2026-02-17T11:11:49.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.616+0000 7f37b749f640 10 monclient: init 2026-02-17T11:11:49.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.617+0000 7f37b749f640 10 monclient: _reopen_session rank -1 2026-02-17T11:11:49.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.617+0000 7f37b749f640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:11:49.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.617+0000 7f37b749f640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f37b0072de0 0x7f37b01f4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:49.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.617+0000 7f37b749f640 10 monclient(hunting): picked mon.noname-a con 0x7f37b0072de0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:11:49.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.617+0000 7f37b749f640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f37b00c9050 0x7f37b0158060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:49.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.617+0000 7f37b749f640 10 monclient(hunting): picked mon.noname-c con 0x7f37b00c9050 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:11:49.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.617+0000 7f37b749f640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f37b015f690 0x7f37b0152770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:49.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.617+0000 7f37b749f640 10 monclient(hunting): picked mon.noname-b con 0x7f37b015f690 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:11:49.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.617+0000 7f37b749f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:49.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.617+0000 7f37b749f640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f37b015dcb0 con 0x7f37b0072de0 2026-02-17T11:11:49.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.617+0000 7f37b749f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:49.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.617+0000 7f37b749f640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f37b015db30 con 0x7f37b015f690 2026-02-17T11:11:49.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.617+0000 7f37b749f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:49.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.617+0000 7f37b749f640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f37b0156ce0 con 0x7f37b00c9050 2026-02-17T11:11:49.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.617+0000 7f37b749f640 10 monclient(hunting): _renew_subs 2026-02-17T11:11:49.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.617+0000 7f37b749f640 10 monclient(hunting): authenticate will time out at 1186.281366s 2026-02-17T11:11:49.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.617+0000 7f37b5a15640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f37b015f690 0x7f37b0152770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:49.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.617+0000 7f37b5214640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f37b0072de0 0x7f37b01f4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:49.622 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.617+0000 7f37b5a15640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f37b015f690 0x7f37b0152770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:35906/0 (socket says 10.20.193.49:35906) 2026-02-17T11:11:49.622 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.617+0000 7f37b5a15640 1 -- 10.20.193.49:0/3210436377 learned_addr learned my addr 10.20.193.49:0/3210436377 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:11:49.622 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.617+0000 7f37b5a15640 10 monclient(hunting): get_auth_request con 0x7f37b015f690 auth_method 0 2026-02-17T11:11:49.622 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.617+0000 7f37b5a15640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:49.622 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.617+0000 7f37b5a15640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:49.622 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.617+0000 7f37b5a15640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:49.622 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.617+0000 7f37b5214640 10 monclient(hunting): get_auth_request con 0x7f37b0072de0 auth_method 0 2026-02-17T11:11:49.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.617+0000 7f37b5214640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:49.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.617+0000 7f37b5214640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:49.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.617+0000 7f37b5214640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:49.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.617+0000 7f37b4a13640 1 --2- 10.20.193.49:0/3210436377 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f37b00c9050 0x7f37b0158060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:49.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.618+0000 7f37b4a13640 10 monclient(hunting): get_auth_request con 0x7f37b00c9050 auth_method 0 2026-02-17T11:11:49.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.618+0000 7f37b4a13640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:49.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.618+0000 7f37b4a13640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:49.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.618+0000 7f37b4a13640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:49.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.618+0000 7f37b5a15640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:49.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.618+0000 7f37b5a15640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:49.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.618+0000 7f37b5a15640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:49.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.618+0000 7f37b5214640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:49.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.618+0000 7f37b5214640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:49.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.618+0000 7f37b5214640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:49.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.618+0000 7f37b4a13640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:49.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.618+0000 7f37b4a13640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:49.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.618+0000 7f37b4a13640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:49.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.619+0000 7f37b5a15640 10 monclient(hunting): handle_auth_done global_id 4729 payload 824 2026-02-17T11:11:49.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.619+0000 7f37b5a15640 1 -- 10.20.193.49:0/3210436377 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f37b00c9050 msgr2=0x7f37b0158060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:49.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.619+0000 7f37b5a15640 1 --2- 10.20.193.49:0/3210436377 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f37b00c9050 0x7f37b0158060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:49.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.619+0000 7f37b5a15640 1 -- 10.20.193.49:0/3210436377 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f37b0072de0 msgr2=0x7f37b01f4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:49.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.619+0000 7f37b5a15640 1 --2- 10.20.193.49:0/3210436377 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f37b0072de0 0x7f37b01f4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:49.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.619+0000 7f37b5a15640 10 monclient: _finish_hunting 0 2026-02-17T11:11:49.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.619+0000 7f37b5a15640 1 monclient: found mon.noname-b 2026-02-17T11:11:49.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.619+0000 7f37b5a15640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:11:49.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.619+0000 7f37b5a15640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:11:49.624 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.619+0000 7f37b5a15640 1 -- 10.20.193.49:0/3210436377 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37b0156fc0 con 0x7f37b015f690 2026-02-17T11:11:49.624 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.620+0000 7f37b5a15640 1 --2- 10.20.193.49:0/3210436377 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f37b015f690 0x7f37b0152770 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f37ac00cbf0 tx=0x7f37ac00a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:11:49.624 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.620+0000 7f379dffb640 10 client.?.objecter ms_handle_connect 0x7f37b015f690 2026-02-17T11:11:49.624 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.620+0000 7f379dffb640 10 client.?.objecter resend_mon_ops 2026-02-17T11:11:49.625 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.622+0000 7f379dffb640 1 -- 10.20.193.49:0/3210436377 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ac00ce10 con 0x7f37b015f690 2026-02-17T11:11:49.625 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.622+0000 7f379dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:49.625 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.622+0000 7f379dffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:11:49.625 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.622+0000 7f379dffb640 10 monclient: dump: 2026-02-17T11:11:49.625 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:49.625 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:49.625 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:49.625 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:49.625 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:49.625 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:49.625 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:49.625 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:49.625 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:49.625 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:49.625 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.622+0000 7f379dffb640 10 monclient: _finish_auth 0 2026-02-17T11:11:49.625 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.622+0000 7f379dffb640 10 monclient: _check_auth_tickets 2026-02-17T11:11:49.625 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.622+0000 7f379dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:11:49.625 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.622+0000 7f379dffb640 1 -- 10.20.193.49:0/3210436377 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37ac003a20 con 0x7f37b015f690 2026-02-17T11:11:49.625 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.622+0000 7f37b749f640 5 monclient: authenticate success, global_id 4729 2026-02-17T11:11:49.625 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.622+0000 7f37b749f640 10 monclient: _renew_subs 2026-02-17T11:11:49.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.622+0000 7f37b749f640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:11:49.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.622+0000 7f37b749f640 1 -- 10.20.193.49:0/3210436377 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37b01572a0 con 0x7f37b015f690 2026-02-17T11:11:49.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.622+0000 7f379dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:11:49.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.622+0000 7f379dffb640 1 -- 10.20.193.49:0/3210436377 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ac003df0 con 0x7f37b015f690 2026-02-17T11:11:49.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.622+0000 7f379dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:49.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.622+0000 7f379dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:11:49.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.622+0000 7f379dffb640 10 monclient: dump: 2026-02-17T11:11:49.626 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:49.626 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:49.626 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:49.626 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:49.626 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:49.626 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:49.626 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:49.626 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:49.626 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:49.626 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:49.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.622+0000 7f379f7fe640 4 set_mon_vals no callback set 2026-02-17T11:11:49.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.622+0000 7f37b749f640 10 client.4729.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:11:49.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.622+0000 7f37b749f640 10 monclient: _renew_subs 2026-02-17T11:11:49.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.622+0000 7f37b749f640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:11:49.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.622+0000 7f37b749f640 1 -- 10.20.193.49:0/3210436377 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37b0157860 con 0x7f37b015f690 2026-02-17T11:11:49.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.622+0000 7f37b749f640 1 librados: init done 2026-02-17T11:11:49.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.623+0000 7f37b749f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:11:49.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.623+0000 7f37b749f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:11:49.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.623+0000 7f37b749f640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:11:49.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.623+0000 7f37b749f640 1 -- 10.20.193.49:0/3210436377 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37b00c94c0 con 0x7f37b015f690 2026-02-17T11:11:49.636 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.634+0000 7f379dffb640 1 -- 10.20.193.49:0/3210436377 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f37ac0050d0 con 0x7f37b015f690 2026-02-17T11:11:49.636 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.634+0000 7f379dffb640 1 --2- 10.20.193.49:0/3210436377 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3780079190 0x7f378007b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:49.637 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.634+0000 7f37b5214640 1 --2- 10.20.193.49:0/3210436377 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3780079190 0x7f378007b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:49.637 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.634+0000 7f37b5214640 10 monclient: get_auth_request con 0x7f3780079190 auth_method 0 2026-02-17T11:11:49.637 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.635+0000 7f379dffb640 1 -- 10.20.193.49:0/3210436377 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f37ac05e8e0 con 0x7f37b015f690 2026-02-17T11:11:49.637 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.635+0000 7f379dffb640 10 client.4729.objecter ms_dispatch2 0x7f37b0000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:11:49.637 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.635+0000 7f379dffb640 3 client.4729.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:11:49.637 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.635+0000 7f379dffb640 3 client.4729.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:11:49.637 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.635+0000 7f379dffb640 20 client.4729.objecter dump_active .. 0 homeless 2026-02-17T11:11:49.638 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.635+0000 7f379dffb640 10 client.4729.objecter ms_handle_connect 0x7f3780079190 2026-02-17T11:11:49.638 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.635+0000 7f37b5214640 1 --2- 10.20.193.49:0/3210436377 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3780079190 0x7f378007b650 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f37a0039000 tx=0x7f37a0033000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:11:49.738 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.736+0000 7f379dffb640 1 -- 10.20.193.49:0/3210436377 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f37ac0628a0 con 0x7f37b015f690 2026-02-17T11:11:49.738 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.736+0000 7f379dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:11:49.738 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.736+0000 7f379dffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:11:49.838 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.836+0000 7f37b749f640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:11:49.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.836+0000 7f37b749f640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:11:49.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.836+0000 7f37b749f640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:11:49.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.836+0000 7f37b749f640 1 -- 10.20.193.49:0/3210436377 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f37b00c8940 con 0x7f37b015f690 2026-02-17T11:11:49.841 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.840+0000 7f379dffb640 1 -- 10.20.193.49:0/3210436377 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f37ac066ba0 con 0x7f37b015f690 2026-02-17T11:11:49.841 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.840+0000 7f379dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:11:49.841 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.840+0000 7f379dffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:11:49.841 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:11:49.841 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:11:49.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.840+0000 7f37b749f640 10 librados: watch_flush enter 2026-02-17T11:11:49.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.840+0000 7f37b749f640 10 librados: watch_flush exit 2026-02-17T11:11:49.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.840+0000 7f37b749f640 20 client.4729.objecter shutdown clearing up homeless session... 2026-02-17T11:11:49.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.840+0000 7f37b749f640 10 client.4729.objecter successfully canceled tick 2026-02-17T11:11:49.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.840+0000 7f37b749f640 1 -- 10.20.193.49:0/3210436377 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3780079190 msgr2=0x7f378007b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:49.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.840+0000 7f37b749f640 1 --2- 10.20.193.49:0/3210436377 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3780079190 0x7f378007b650 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f37a0039000 tx=0x7f37a0033000 comp rx=0 tx=0).stop 2026-02-17T11:11:49.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.840+0000 7f37b749f640 10 monclient: shutdown 2026-02-17T11:11:49.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.840+0000 7f37b749f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:11:49.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.840+0000 7f37b749f640 1 -- 10.20.193.49:0/3210436377 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f37b015f690 msgr2=0x7f37b0152770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:49.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.840+0000 7f37b749f640 1 --2- 10.20.193.49:0/3210436377 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f37b015f690 0x7f37b0152770 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f37ac00cbf0 tx=0x7f37ac00a430 comp rx=0 tx=0).stop 2026-02-17T11:11:49.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.840+0000 7f37b749f640 1 -- 10.20.193.49:0/3210436377 shutdown_connections 2026-02-17T11:11:49.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.840+0000 7f37b749f640 1 --2- 10.20.193.49:0/3210436377 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3780079190 0x7f378007b650 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:49.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.840+0000 7f37b749f640 1 --2- 10.20.193.49:0/3210436377 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f37b015f690 0x7f37b0152770 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:49.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.840+0000 7f37b749f640 1 --2- 10.20.193.49:0/3210436377 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f37b00c9050 0x7f37b0158060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:49.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.840+0000 7f37b749f640 1 --2- 10.20.193.49:0/3210436377 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f37b0072de0 0x7f37b01f4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:49.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.840+0000 7f37b749f640 1 -- 10.20.193.49:0/3210436377 >> 10.20.193.49:0/3210436377 conn(0x7f37b00c9f20 msgr2=0x7f37b00726d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:11:49.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.840+0000 7f37b749f640 1 -- 10.20.193.49:0/3210436377 shutdown_connections 2026-02-17T11:11:49.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.840+0000 7f37b749f640 1 -- 10.20.193.49:0/3210436377 wait complete. 2026-02-17T11:11:49.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:49.840+0000 7f37b749f640 1 librados: shutdown 2026-02-17T11:11:51.856 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:03:37.337 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:11:51.857 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:03:37.338 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:11:51.864 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:03:37.346 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:11:51.883 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:03:37.358 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:11:51.884 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:03:37.325 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:11:51.884 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:03:37.359 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:11:51.885 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:03:37.326 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:11:51.892 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:03:37.367 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:11:51.892 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:03:37.334 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:11:52.851 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:11:52.919 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.917+0000 7f1544a64640 10 monclient: get_monmap_and_config 2026-02-17T11:11:52.919 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.917+0000 7f1544a64640 10 monclient: build_initial_monmap 2026-02-17T11:11:52.919 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.917+0000 7f1544a64640 10 monclient: monmap: 2026-02-17T11:11:52.919 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:11:52.919 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:52.919 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:11:52.918623+0000 2026-02-17T11:11:52.919 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:11:52.918623+0000 2026-02-17T11:11:52.919 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:11:52.919 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:52.919 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:11:52.919 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:11:52.919 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:11:52.919 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:11:52.919 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:11:52.919 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:11:52.919 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:52.919 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.917+0000 7f1544a64640 1 Processor -- start 2026-02-17T11:11:52.920 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.917+0000 7f1544a64640 1 -- start start 2026-02-17T11:11:52.920 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.917+0000 7f1544a64640 10 monclient: init 2026-02-17T11:11:52.920 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.918+0000 7f1544a64640 10 monclient: _reopen_session rank -1 2026-02-17T11:11:52.920 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.918+0000 7f1544a64640 10 monclient: _add_conns ranks=[3,2,0,1,5,4] 2026-02-17T11:11:52.920 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.918+0000 7f1544a64640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f154015d370 0x7f154015d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:52.920 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.918+0000 7f1544a64640 10 monclient(hunting): picked mon.noname-a con 0x7f154015d370 addr v2:10.20.193.49:3300/0 2026-02-17T11:11:52.920 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.918+0000 7f1544a64640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f15400c7e20 addr v1:10.20.193.157:6789/0 2026-02-17T11:11:52.920 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.918+0000 7f1544a64640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f15400c74c0 addr v1:10.20.193.49:6789/0 2026-02-17T11:11:52.920 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.918+0000 7f1544a64640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15400c8350 con 0x7f15400c74c0 2026-02-17T11:11:52.920 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.918+0000 7f1544a64640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15400c8630 con 0x7f15400c7e20 2026-02-17T11:11:52.920 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.918+0000 7f1544a64640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:52.920 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.918+0000 7f1544a64640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f154015b710 con 0x7f154015d370 2026-02-17T11:11:52.920 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.918+0000 7f1544a64640 10 monclient(hunting): _renew_subs 2026-02-17T11:11:52.920 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.918+0000 7f1544a64640 10 monclient(hunting): authenticate will time out at 1189.582208s 2026-02-17T11:11:52.920 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.918+0000 7f153e575640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f154015d370 0x7f154015d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:52.920 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.918+0000 7f153ed76640 1 --1- >> v1:10.20.193.49:6789/0 conn(0x7f15400c74c0 0x7f15400c52b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.49:6789/0 says I am v1:10.20.193.49:35134/0 (socket says 10.20.193.49:35134) 2026-02-17T11:11:52.920 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.918+0000 7f153ed76640 1 -- 10.20.193.49:0/2112679149 learned_addr learned my addr 10.20.193.49:0/2112679149 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:11:52.921 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.918+0000 7f153e575640 10 monclient(hunting): get_auth_request con 0x7f154015d370 auth_method 0 2026-02-17T11:11:52.921 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.918+0000 7f153e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:52.921 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.918+0000 7f153e575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:52.921 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.918+0000 7f153e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:52.921 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.919+0000 7f153e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:52.921 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.919+0000 7f153e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:52.921 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.919+0000 7f153e575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:52.922 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.920+0000 7f153d573640 1 -- 10.20.193.49:0/2112679149 <== mon.2 v1:10.20.193.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3005654326 0 0) 0x7f15400c8630 con 0x7f15400c7e20 2026-02-17T11:11:52.922 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.920+0000 7f153d573640 10 monclient(hunting): _negotiate 2026-02-17T11:11:52.922 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.920+0000 7f153d573640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:52.922 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.920+0000 7f153d573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:52.922 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.920+0000 7f153d573640 10 monclient(hunting): my global_id is 4745 2026-02-17T11:11:52.922 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.920+0000 7f153d573640 1 -- 10.20.193.49:0/2112679149 --> v1:10.20.193.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f152c003620 con 0x7f15400c7e20 2026-02-17T11:11:52.922 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.920+0000 7f153e575640 10 monclient(hunting): handle_auth_done global_id 4755 payload 274 2026-02-17T11:11:52.922 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.920+0000 7f153e575640 1 -- 10.20.193.49:0/2112679149 >> v1:10.20.193.157:6789/0 conn(0x7f15400c7e20 legacy=0x7f154015b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:52.922 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.920+0000 7f153e575640 1 -- 10.20.193.49:0/2112679149 >> v1:10.20.193.49:6789/0 conn(0x7f15400c74c0 legacy=0x7f15400c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:52.922 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.920+0000 7f153e575640 10 monclient: _finish_hunting 0 2026-02-17T11:11:52.922 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.920+0000 7f153e575640 1 monclient: found mon.noname-a 2026-02-17T11:11:52.922 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.920+0000 7f153e575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:11:52.922 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.920+0000 7f153e575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:11:52.922 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.920+0000 7f153e575640 1 -- 10.20.193.49:0/2112679149 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15400c8910 con 0x7f154015d370 2026-02-17T11:11:52.924 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.922+0000 7f153e575640 1 --2- 10.20.193.49:0/2112679149 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f154015d370 0x7f154015d750 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f15340098a0 tx=0x7f153402ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7104034ab8d9cf34 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:11:52.926 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.924+0000 7f153d573640 1 -- 10.20.193.49:0/2112679149 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f153403c070 con 0x7f154015d370 2026-02-17T11:11:52.926 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.924+0000 7f153d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:52.926 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.924+0000 7f153d573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:11:52.926 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.924+0000 7f153d573640 10 monclient: dump: 2026-02-17T11:11:52.926 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:52.926 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:52.927 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:52.927 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:52.927 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:52.927 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:52.927 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:52.927 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:52.927 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:52.927 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:52.927 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.924+0000 7f153d573640 10 monclient: _finish_auth 0 2026-02-17T11:11:52.927 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.924+0000 7f153d573640 10 monclient: _check_auth_tickets 2026-02-17T11:11:52.927 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.924+0000 7f153d573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:11:52.927 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.924+0000 7f153d573640 1 -- 10.20.193.49:0/2112679149 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f153402fb70 con 0x7f154015d370 2026-02-17T11:11:52.927 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.924+0000 7f1544a64640 5 monclient: authenticate success, global_id 4755 2026-02-17T11:11:52.927 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.924+0000 7f1544a64640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:11:52.927 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.924+0000 7f153d573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:11:52.927 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.924+0000 7f153d573640 1 -- 10.20.193.49:0/2112679149 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1534037440 con 0x7f154015d370 2026-02-17T11:11:52.927 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.924+0000 7f153d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:52.927 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.924+0000 7f153d573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:11:52.927 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.924+0000 7f153d573640 10 monclient: dump: 2026-02-17T11:11:52.927 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:52.927 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:52.927 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:52.927 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:52.927 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:52.927 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:52.927 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:52.927 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:52.927 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:52.927 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:52.927 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.924+0000 7f1544a64640 10 monclient: get_monmap_and_config success 2026-02-17T11:11:52.927 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.924+0000 7f1544a64640 4 set_mon_vals no callback set 2026-02-17T11:11:52.928 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.924+0000 7f1544a64640 10 monclient: shutdown 2026-02-17T11:11:52.928 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.924+0000 7f1544a64640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:11:52.928 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.924+0000 7f1544a64640 1 -- 10.20.193.49:0/2112679149 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f154015d370 msgr2=0x7f154015d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:52.928 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.924+0000 7f1544a64640 1 --2- 10.20.193.49:0/2112679149 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f154015d370 0x7f154015d750 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f15340098a0 tx=0x7f153402ee60 comp rx=0 tx=0).stop 2026-02-17T11:11:52.928 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.924+0000 7f1544a64640 1 -- 10.20.193.49:0/2112679149 shutdown_connections 2026-02-17T11:11:52.928 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.924+0000 7f1544a64640 1 --2- 10.20.193.49:0/2112679149 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f154015d370 0x7f154015d750 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:52.928 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.924+0000 7f1544a64640 1 -- 10.20.193.49:0/2112679149 >> 10.20.193.49:0/2112679149 conn(0x7f15400c9f20 msgr2=0x7f15400ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:11:52.928 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.924+0000 7f1544a64640 1 -- 10.20.193.49:0/2112679149 shutdown_connections 2026-02-17T11:11:52.928 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.924+0000 7f1544a64640 1 -- 10.20.193.49:0/2112679149 wait complete. 2026-02-17T11:11:52.928 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.925+0000 7f1544a64640 10 monclient: build_initial_monmap 2026-02-17T11:11:52.928 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.925+0000 7f1544a64640 10 monclient: monmap: 2026-02-17T11:11:52.928 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:11:52.928 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:11:52.928 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:11:52.928 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:11:52.928 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:11:52.928 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:52.928 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:11:52.928 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:11:52.928 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:11:52.928 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:52.929 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.925+0000 7f1544a64640 1 librados: starting msgr at 2026-02-17T11:11:52.929 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.925+0000 7f1544a64640 1 librados: starting objecter 2026-02-17T11:11:52.929 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.925+0000 7f1544a64640 1 Processor -- start 2026-02-17T11:11:52.929 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.925+0000 7f1544a64640 1 -- start start 2026-02-17T11:11:52.929 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.925+0000 7f1544a64640 1 librados: setting wanted keys 2026-02-17T11:11:52.929 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.925+0000 7f1544a64640 1 librados: calling monclient init 2026-02-17T11:11:52.929 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.925+0000 7f1544a64640 10 monclient: init 2026-02-17T11:11:52.929 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.925+0000 7f1544a64640 10 monclient: _reopen_session rank -1 2026-02-17T11:11:52.929 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.926+0000 7f1544a64640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:11:52.929 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.926+0000 7f1544a64640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f15400c74c0 0x7f154006edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:52.929 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.926+0000 7f1544a64640 10 monclient(hunting): picked mon.noname-c con 0x7f15400c74c0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:11:52.929 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.926+0000 7f1544a64640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f15400c7e20 0x7f15401f6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:52.929 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.926+0000 7f1544a64640 10 monclient(hunting): picked mon.noname-b con 0x7f15400c7e20 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:11:52.929 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.926+0000 7f1544a64640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f154015d370 0x7f15400c3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:52.929 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.926+0000 7f1544a64640 10 monclient(hunting): picked mon.noname-a con 0x7f154015d370 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:11:52.929 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.926+0000 7f1544a64640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:52.929 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.926+0000 7f1544a64640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f15400c8ed0 con 0x7f154015d370 2026-02-17T11:11:52.929 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.926+0000 7f1544a64640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:52.929 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.926+0000 7f1544a64640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f15400c9240 con 0x7f15400c7e20 2026-02-17T11:11:52.929 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.926+0000 7f1544a64640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:52.929 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.926+0000 7f1544a64640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f15400c96d0 con 0x7f15400c74c0 2026-02-17T11:11:52.929 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.926+0000 7f1544a64640 10 monclient(hunting): _renew_subs 2026-02-17T11:11:52.929 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.926+0000 7f1544a64640 10 monclient(hunting): authenticate will time out at 1189.590085s 2026-02-17T11:11:52.929 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.926+0000 7f153ed76640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f154015d370 0x7f15400c3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:52.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.926+0000 7f153e575640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f15400c74c0 0x7f154006edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:52.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.926+0000 7f153ed76640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f154015d370 0x7f15400c3a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:48456/0 (socket says 10.20.193.49:48456) 2026-02-17T11:11:52.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.926+0000 7f153ed76640 1 -- 10.20.193.49:0/3261641962 learned_addr learned my addr 10.20.193.49:0/3261641962 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:11:52.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.926+0000 7f153ed76640 10 monclient(hunting): get_auth_request con 0x7f154015d370 auth_method 0 2026-02-17T11:11:52.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.926+0000 7f153ed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:52.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.926+0000 7f153ed76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:52.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.926+0000 7f153ed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:52.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.926+0000 7f153dd74640 1 --2- 10.20.193.49:0/3261641962 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f15400c7e20 0x7f15401f6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:52.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.926+0000 7f153ed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:52.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.926+0000 7f153ed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:52.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.926+0000 7f153ed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:52.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.926+0000 7f153dd74640 10 monclient(hunting): get_auth_request con 0x7f15400c7e20 auth_method 0 2026-02-17T11:11:52.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.926+0000 7f153dd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:52.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.926+0000 7f153dd74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:52.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.926+0000 7f153dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:52.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.926+0000 7f153e575640 10 monclient(hunting): get_auth_request con 0x7f15400c74c0 auth_method 0 2026-02-17T11:11:52.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.926+0000 7f153e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:52.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.926+0000 7f153e575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:52.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.926+0000 7f153e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:52.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.927+0000 7f153dd74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:52.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.927+0000 7f153dd74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:52.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.927+0000 7f153dd74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:52.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.927+0000 7f153e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:52.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.927+0000 7f153e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:52.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.927+0000 7f153e575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:52.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.927+0000 7f153ed76640 10 monclient(hunting): handle_auth_done global_id 4761 payload 824 2026-02-17T11:11:52.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.928+0000 7f153ed76640 1 -- 10.20.193.49:0/3261641962 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f15400c74c0 msgr2=0x7f154006edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:52.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.928+0000 7f153ed76640 1 --2- 10.20.193.49:0/3261641962 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f15400c74c0 0x7f154006edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:52.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.928+0000 7f153ed76640 1 -- 10.20.193.49:0/3261641962 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f15400c7e20 msgr2=0x7f15401f6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:52.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.928+0000 7f153ed76640 1 --2- 10.20.193.49:0/3261641962 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f15400c7e20 0x7f15401f6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:52.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.928+0000 7f153ed76640 10 monclient: _finish_hunting 0 2026-02-17T11:11:52.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.928+0000 7f153ed76640 1 monclient: found mon.noname-a 2026-02-17T11:11:52.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.928+0000 7f153ed76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:11:52.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.928+0000 7f153ed76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:11:52.931 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.928+0000 7f153ed76640 1 -- 10.20.193.49:0/3261641962 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f154006da70 con 0x7f154015d370 2026-02-17T11:11:52.931 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.928+0000 7f153ed76640 1 --2- 10.20.193.49:0/3261641962 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f154015d370 0x7f15400c3a90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f153000cb50 tx=0x7f153000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:11:52.931 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.928+0000 7f1526ffd640 10 client.?.objecter ms_handle_connect 0x7f154015d370 2026-02-17T11:11:52.931 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.929+0000 7f1526ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:11:52.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.930+0000 7f1526ffd640 1 -- 10.20.193.49:0/3261641962 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1530017070 con 0x7f154015d370 2026-02-17T11:11:52.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.930+0000 7f1526ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:52.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.930+0000 7f1526ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:11:52.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.930+0000 7f1526ffd640 10 monclient: dump: 2026-02-17T11:11:52.933 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:52.933 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:52.933 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:52.933 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:52.933 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:52.933 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:52.933 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:52.933 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:52.933 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:52.933 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:52.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.930+0000 7f1526ffd640 10 monclient: _finish_auth 0 2026-02-17T11:11:52.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.930+0000 7f1526ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:11:52.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.930+0000 7f1526ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:11:52.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.930+0000 7f1526ffd640 1 -- 10.20.193.49:0/3261641962 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f153000ad50 con 0x7f154015d370 2026-02-17T11:11:52.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.930+0000 7f1526ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:11:52.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.930+0000 7f1526ffd640 1 -- 10.20.193.49:0/3261641962 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1530012600 con 0x7f154015d370 2026-02-17T11:11:52.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.930+0000 7f1544a64640 5 monclient: authenticate success, global_id 4761 2026-02-17T11:11:52.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.930+0000 7f1526ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:52.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.930+0000 7f153cd72640 4 set_mon_vals no callback set 2026-02-17T11:11:52.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.930+0000 7f1526ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:11:52.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.930+0000 7f1526ffd640 10 monclient: dump: 2026-02-17T11:11:52.933 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:52.933 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:52.933 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:52.933 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:52.933 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:52.933 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:52.933 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:52.933 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:52.933 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:52.933 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:52.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.930+0000 7f1544a64640 10 monclient: _renew_subs 2026-02-17T11:11:52.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.930+0000 7f1544a64640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:11:52.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.930+0000 7f1544a64640 1 -- 10.20.193.49:0/3261641962 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f154006dd50 con 0x7f154015d370 2026-02-17T11:11:52.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.930+0000 7f1544a64640 10 client.4761.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:11:52.934 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.930+0000 7f1544a64640 10 monclient: _renew_subs 2026-02-17T11:11:52.934 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.930+0000 7f1544a64640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:11:52.934 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.930+0000 7f1544a64640 1 -- 10.20.193.49:0/3261641962 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f154006e310 con 0x7f154015d370 2026-02-17T11:11:52.934 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.930+0000 7f1544a64640 1 librados: init done 2026-02-17T11:11:52.934 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.931+0000 7f1544a64640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:11:52.934 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.931+0000 7f1544a64640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:11:52.934 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.931+0000 7f1544a64640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:11:52.934 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.931+0000 7f1544a64640 1 -- 10.20.193.49:0/3261641962 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f154006e920 con 0x7f154015d370 2026-02-17T11:11:52.945 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.942+0000 7f1526ffd640 1 -- 10.20.193.49:0/3261641962 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f15300127a0 con 0x7f154015d370 2026-02-17T11:11:52.945 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.943+0000 7f1526ffd640 1 --2- 10.20.193.49:0/3261641962 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f150c079190 0x7f150c07b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:52.945 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.943+0000 7f153e575640 1 --2- 10.20.193.49:0/3261641962 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f150c079190 0x7f150c07b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:52.946 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.943+0000 7f153e575640 10 monclient: get_auth_request con 0x7f150c079190 auth_method 0 2026-02-17T11:11:52.947 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.944+0000 7f153e575640 1 --2- 10.20.193.49:0/3261641962 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f150c079190 0x7f150c07b650 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1534039000 tx=0x7f1534033000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:11:52.947 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.944+0000 7f1526ffd640 10 client.4761.objecter ms_handle_connect 0x7f150c079190 2026-02-17T11:11:52.947 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.944+0000 7f1526ffd640 1 -- 10.20.193.49:0/3261641962 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f1530014dc0 con 0x7f154015d370 2026-02-17T11:11:52.947 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.944+0000 7f1526ffd640 10 client.4761.objecter ms_dispatch2 0x7f1540000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:11:52.947 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.944+0000 7f1526ffd640 3 client.4761.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:11:52.947 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.944+0000 7f1526ffd640 3 client.4761.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:11:52.947 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:52.945+0000 7f1526ffd640 20 client.4761.objecter dump_active .. 0 homeless 2026-02-17T11:11:53.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:53.045+0000 7f1526ffd640 1 -- 10.20.193.49:0/3261641962 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f1530022020 con 0x7f154015d370 2026-02-17T11:11:53.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:53.045+0000 7f1526ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:11:53.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:53.045+0000 7f1526ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:11:53.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:53.144+0000 7f1544a64640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:11:53.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:53.144+0000 7f1544a64640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:11:53.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:53.144+0000 7f1544a64640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:11:53.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:53.144+0000 7f1544a64640 1 -- 10.20.193.49:0/3261641962 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f154015d750 con 0x7f154015d370 2026-02-17T11:11:53.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:53.147+0000 7f1526ffd640 1 -- 10.20.193.49:0/3261641962 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f1530061f00 con 0x7f154015d370 2026-02-17T11:11:53.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:53.147+0000 7f1526ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:11:53.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:53.147+0000 7f1526ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:11:53.150 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:11:53.150 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:11:53.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:53.148+0000 7f1544a64640 10 librados: watch_flush enter 2026-02-17T11:11:53.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:53.149+0000 7f1544a64640 10 librados: watch_flush exit 2026-02-17T11:11:53.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:53.149+0000 7f1544a64640 20 client.4761.objecter shutdown clearing up homeless session... 2026-02-17T11:11:53.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:53.149+0000 7f1544a64640 10 client.4761.objecter successfully canceled tick 2026-02-17T11:11:53.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:53.149+0000 7f1544a64640 1 -- 10.20.193.49:0/3261641962 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f150c079190 msgr2=0x7f150c07b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:53.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:53.149+0000 7f1544a64640 1 --2- 10.20.193.49:0/3261641962 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f150c079190 0x7f150c07b650 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1534039000 tx=0x7f1534033000 comp rx=0 tx=0).stop 2026-02-17T11:11:53.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:53.149+0000 7f1544a64640 10 monclient: shutdown 2026-02-17T11:11:53.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:53.149+0000 7f1544a64640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:11:53.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:53.149+0000 7f1544a64640 1 -- 10.20.193.49:0/3261641962 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f154015d370 msgr2=0x7f15400c3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:53.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:53.149+0000 7f1544a64640 1 --2- 10.20.193.49:0/3261641962 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f154015d370 0x7f15400c3a90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f153000cb50 tx=0x7f153000a430 comp rx=0 tx=0).stop 2026-02-17T11:11:53.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:53.149+0000 7f1544a64640 1 -- 10.20.193.49:0/3261641962 shutdown_connections 2026-02-17T11:11:53.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:53.149+0000 7f1544a64640 1 --2- 10.20.193.49:0/3261641962 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f150c079190 0x7f150c07b650 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:53.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:53.149+0000 7f1544a64640 1 --2- 10.20.193.49:0/3261641962 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f154015d370 0x7f15400c3a90 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:53.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:53.149+0000 7f1544a64640 1 --2- 10.20.193.49:0/3261641962 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f15400c7e20 0x7f15401f6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:53.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:53.149+0000 7f1544a64640 1 --2- 10.20.193.49:0/3261641962 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f15400c74c0 0x7f154006edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:53.154 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:53.149+0000 7f1544a64640 1 -- 10.20.193.49:0/3261641962 >> 10.20.193.49:0/3261641962 conn(0x7f15400c9f20 msgr2=0x7f15400ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:11:53.154 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:53.149+0000 7f1544a64640 1 -- 10.20.193.49:0/3261641962 shutdown_connections 2026-02-17T11:11:53.154 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:53.149+0000 7f1544a64640 1 -- 10.20.193.49:0/3261641962 wait complete. 2026-02-17T11:11:53.154 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:53.149+0000 7f1544a64640 1 librados: shutdown 2026-02-17T11:11:56.161 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:11:56.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.230+0000 7f41dd2e1640 10 monclient: get_monmap_and_config 2026-02-17T11:11:56.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.230+0000 7f41dd2e1640 10 monclient: build_initial_monmap 2026-02-17T11:11:56.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.230+0000 7f41dd2e1640 10 monclient: monmap: 2026-02-17T11:11:56.232 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:11:56.232 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:56.232 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:11:56.231370+0000 2026-02-17T11:11:56.232 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:11:56.231370+0000 2026-02-17T11:11:56.232 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:11:56.232 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:56.232 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:11:56.232 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:11:56.232 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:11:56.232 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:11:56.232 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:11:56.232 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:11:56.232 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:56.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.231+0000 7f41dd2e1640 1 Processor -- start 2026-02-17T11:11:56.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.231+0000 7f41dd2e1640 1 -- start start 2026-02-17T11:11:56.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.231+0000 7f41dd2e1640 10 monclient: init 2026-02-17T11:11:56.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.231+0000 7f41dd2e1640 10 monclient: _reopen_session rank -1 2026-02-17T11:11:56.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.231+0000 7f41dd2e1640 10 monclient: _add_conns ranks=[2,3,1,0,4,5] 2026-02-17T11:11:56.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.231+0000 7f41dd2e1640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f41d80c7170 addr v1:10.20.193.157:6789/0 2026-02-17T11:11:56.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.231+0000 7f41dd2e1640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f41d80c7550 0x7f41d80749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:56.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.231+0000 7f41dd2e1640 10 monclient(hunting): picked mon.noname-a con 0x7f41d80c7550 addr v2:10.20.193.49:3300/0 2026-02-17T11:11:56.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.231+0000 7f41dd2e1640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f41d8074ef0 addr v1:10.20.193.97:6789/0 2026-02-17T11:11:56.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.231+0000 7f41dd2e1640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41d80c4fd0 con 0x7f41d8074ef0 2026-02-17T11:11:56.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.231+0000 7f41dd2e1640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41d815a9a0 con 0x7f41d80c7170 2026-02-17T11:11:56.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.231+0000 7f41dd2e1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:56.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.231+0000 7f41dd2e1640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f41d80c8530 con 0x7f41d80c7550 2026-02-17T11:11:56.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.231+0000 7f41dd2e1640 10 monclient(hunting): _renew_subs 2026-02-17T11:11:56.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.231+0000 7f41dd2e1640 10 monclient(hunting): authenticate will time out at 1192.894868s 2026-02-17T11:11:56.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.232+0000 7f41d67fc640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f41d80c7550 0x7f41d80749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:56.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.232+0000 7f41d6ffd640 1 --1- >> v1:10.20.193.157:6789/0 conn(0x7f41d80c7170 0x7f41d80c48c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.157:6789/0 says I am v1:10.20.193.49:47508/0 (socket says 10.20.193.49:47508) 2026-02-17T11:11:56.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.232+0000 7f41d77fe640 1 --1- >> v1:10.20.193.97:6789/0 conn(0x7f41d8074ef0 0x7f41d80c89c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.97:6789/0 says I am v1:10.20.193.49:45820/0 (socket says 10.20.193.49:45820) 2026-02-17T11:11:56.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.232+0000 7f41d6ffd640 1 -- 10.20.193.49:0/3729978882 learned_addr learned my addr 10.20.193.49:0/3729978882 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:11:56.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.232+0000 7f41d67fc640 10 monclient(hunting): get_auth_request con 0x7f41d80c7550 auth_method 0 2026-02-17T11:11:56.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.232+0000 7f41d67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:56.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.232+0000 7f41d67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:56.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.232+0000 7f41d67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:56.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.232+0000 7f41d67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:56.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.232+0000 7f41d67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:56.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.232+0000 7f41d67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:56.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.233+0000 7f41d5ffb640 1 -- 10.20.193.49:0/3729978882 <== mon.2 v1:10.20.193.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3821972236 0 0) 0x7f41d815a9a0 con 0x7f41d80c7170 2026-02-17T11:11:56.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.233+0000 7f41d5ffb640 10 monclient(hunting): _negotiate 2026-02-17T11:11:56.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.233+0000 7f41d5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:56.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.233+0000 7f41d5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:56.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.233+0000 7f41d5ffb640 10 monclient(hunting): my global_id is 4751 2026-02-17T11:11:56.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.233+0000 7f41d5ffb640 1 -- 10.20.193.49:0/3729978882 --> v1:10.20.193.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41c4003620 con 0x7f41d80c7170 2026-02-17T11:11:56.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.233+0000 7f41d5ffb640 1 -- 10.20.193.49:0/3729978882 <== mon.1 v1:10.20.193.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3686708633 0 0) 0x7f41d80c4fd0 con 0x7f41d8074ef0 2026-02-17T11:11:56.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.233+0000 7f41d5ffb640 10 monclient(hunting): _negotiate 2026-02-17T11:11:56.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.233+0000 7f41d5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:56.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.233+0000 7f41d5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:56.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.233+0000 7f41d5ffb640 10 monclient(hunting): my global_id is 4735 2026-02-17T11:11:56.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.233+0000 7f41d5ffb640 1 -- 10.20.193.49:0/3729978882 --> v1:10.20.193.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41d815a9a0 con 0x7f41d8074ef0 2026-02-17T11:11:56.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.233+0000 7f41d67fc640 10 monclient(hunting): handle_auth_done global_id 4764 payload 274 2026-02-17T11:11:56.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.233+0000 7f41d67fc640 1 -- 10.20.193.49:0/3729978882 >> v1:10.20.193.157:6789/0 conn(0x7f41d80c7170 legacy=0x7f41d80c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:56.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.233+0000 7f41d67fc640 1 -- 10.20.193.49:0/3729978882 >> v1:10.20.193.97:6789/0 conn(0x7f41d8074ef0 legacy=0x7f41d80c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:56.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.233+0000 7f41d67fc640 10 monclient: _finish_hunting 0 2026-02-17T11:11:56.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.233+0000 7f41d67fc640 1 monclient: found mon.noname-a 2026-02-17T11:11:56.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.234+0000 7f41d67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:11:56.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.234+0000 7f41d67fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:11:56.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.234+0000 7f41d67fc640 1 -- 10.20.193.49:0/3729978882 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41d80c5270 con 0x7f41d80c7550 2026-02-17T11:11:56.236 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.234+0000 7f41d67fc640 1 --2- 10.20.193.49:0/3729978882 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f41d80c7550 0x7f41d80749b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f41c00098a0 tx=0x7f41c002ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50b8fdd37f5df309 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:11:56.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.236+0000 7f41d5ffb640 1 -- 10.20.193.49:0/3729978882 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c003c070 con 0x7f41d80c7550 2026-02-17T11:11:56.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.236+0000 7f41d5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:56.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.236+0000 7f41d5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:11:56.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.236+0000 7f41d5ffb640 10 monclient: dump: 2026-02-17T11:11:56.238 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:56.238 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:56.238 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:56.238 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:56.238 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:56.238 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:56.238 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:56.238 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:56.238 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:56.238 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:56.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.236+0000 7f41d5ffb640 10 monclient: _finish_auth 0 2026-02-17T11:11:56.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.236+0000 7f41d5ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:11:56.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.236+0000 7f41d5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:11:56.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.236+0000 7f41d5ffb640 1 -- 10.20.193.49:0/3729978882 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41c002fb70 con 0x7f41d80c7550 2026-02-17T11:11:56.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.236+0000 7f41d5ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:11:56.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.236+0000 7f41d5ffb640 1 -- 10.20.193.49:0/3729978882 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c0037440 con 0x7f41d80c7550 2026-02-17T11:11:56.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.236+0000 7f41dd2e1640 5 monclient: authenticate success, global_id 4764 2026-02-17T11:11:56.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.236+0000 7f41dd2e1640 10 monclient: get_monmap_and_config success 2026-02-17T11:11:56.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.236+0000 7f41dd2e1640 4 set_mon_vals no callback set 2026-02-17T11:11:56.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.236+0000 7f41d5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:56.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.236+0000 7f41d5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:11:56.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.236+0000 7f41d5ffb640 10 monclient: dump: 2026-02-17T11:11:56.239 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:56.239 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:56.239 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:56.239 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:56.239 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:56.239 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:56.239 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:56.239 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:56.239 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:56.239 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:56.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.237+0000 7f41dd2e1640 10 monclient: shutdown 2026-02-17T11:11:56.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.237+0000 7f41dd2e1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:11:56.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.237+0000 7f41dd2e1640 1 -- 10.20.193.49:0/3729978882 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f41d80c7550 msgr2=0x7f41d80749b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:56.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.237+0000 7f41dd2e1640 1 --2- 10.20.193.49:0/3729978882 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f41d80c7550 0x7f41d80749b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f41c00098a0 tx=0x7f41c002ee60 comp rx=0 tx=0).stop 2026-02-17T11:11:56.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.237+0000 7f41dd2e1640 1 -- 10.20.193.49:0/3729978882 shutdown_connections 2026-02-17T11:11:56.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.237+0000 7f41dd2e1640 1 --2- 10.20.193.49:0/3729978882 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f41d80c7550 0x7f41d80749b0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:56.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.237+0000 7f41dd2e1640 1 -- 10.20.193.49:0/3729978882 >> 10.20.193.49:0/3729978882 conn(0x7f41d80c9f40 msgr2=0x7f41d80ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:11:56.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.237+0000 7f41dd2e1640 1 -- 10.20.193.49:0/3729978882 shutdown_connections 2026-02-17T11:11:56.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.237+0000 7f41dd2e1640 1 -- 10.20.193.49:0/3729978882 wait complete. 2026-02-17T11:11:56.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.237+0000 7f41dd2e1640 10 monclient: build_initial_monmap 2026-02-17T11:11:56.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.237+0000 7f41dd2e1640 10 monclient: monmap: 2026-02-17T11:11:56.240 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:11:56.240 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:11:56.241 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:11:56.241 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:11:56.241 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:11:56.241 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:56.241 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:11:56.241 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:11:56.241 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:11:56.241 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:56.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.237+0000 7f41dd2e1640 1 librados: starting msgr at 2026-02-17T11:11:56.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.237+0000 7f41dd2e1640 1 librados: starting objecter 2026-02-17T11:11:56.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.237+0000 7f41dd2e1640 1 Processor -- start 2026-02-17T11:11:56.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.238+0000 7f41dd2e1640 1 -- start start 2026-02-17T11:11:56.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.238+0000 7f41dd2e1640 1 librados: setting wanted keys 2026-02-17T11:11:56.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.238+0000 7f41dd2e1640 1 librados: calling monclient init 2026-02-17T11:11:56.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.238+0000 7f41dd2e1640 10 monclient: init 2026-02-17T11:11:56.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.238+0000 7f41dd2e1640 10 monclient: _reopen_session rank -1 2026-02-17T11:11:56.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.238+0000 7f41dd2e1640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:11:56.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.238+0000 7f41dd2e1640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f41d8074ef0 0x7f41d8148ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:56.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.238+0000 7f41dd2e1640 10 monclient(hunting): picked mon.noname-b con 0x7f41d8074ef0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:11:56.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.238+0000 7f41dd2e1640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f41d80c7170 0x7f41d80c0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:56.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.238+0000 7f41dd2e1640 10 monclient(hunting): picked mon.noname-c con 0x7f41d80c7170 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:11:56.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.238+0000 7f41dd2e1640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f41d80c7550 0x7f41d81f65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:56.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.238+0000 7f41dd2e1640 10 monclient(hunting): picked mon.noname-a con 0x7f41d80c7550 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:11:56.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.238+0000 7f41dd2e1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:56.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.238+0000 7f41dd2e1640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f41d80c7ee0 con 0x7f41d80c7550 2026-02-17T11:11:56.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.238+0000 7f41dd2e1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:56.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.238+0000 7f41dd2e1640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f41d80c5830 con 0x7f41d8074ef0 2026-02-17T11:11:56.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.238+0000 7f41dd2e1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:56.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.238+0000 7f41dd2e1640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f41d80c81c0 con 0x7f41d80c7170 2026-02-17T11:11:56.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.238+0000 7f41dd2e1640 10 monclient(hunting): _renew_subs 2026-02-17T11:11:56.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.238+0000 7f41dd2e1640 10 monclient(hunting): authenticate will time out at 1192.901537s 2026-02-17T11:11:56.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.238+0000 7f41d77fe640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f41d80c7550 0x7f41d81f65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:56.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.238+0000 7f41d6ffd640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f41d8074ef0 0x7f41d8148ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:56.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.238+0000 7f41d67fc640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f41d80c7170 0x7f41d80c0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:56.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.239+0000 7f41d77fe640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f41d80c7550 0x7f41d81f65c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:33260/0 (socket says 10.20.193.49:33260) 2026-02-17T11:11:56.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.239+0000 7f41d77fe640 1 -- 10.20.193.49:0/3489752351 learned_addr learned my addr 10.20.193.49:0/3489752351 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:11:56.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.239+0000 7f41d77fe640 10 monclient(hunting): get_auth_request con 0x7f41d80c7550 auth_method 0 2026-02-17T11:11:56.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.239+0000 7f41d77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:56.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.239+0000 7f41d77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:56.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.239+0000 7f41d77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:56.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.239+0000 7f41d6ffd640 10 monclient(hunting): get_auth_request con 0x7f41d8074ef0 auth_method 0 2026-02-17T11:11:56.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.239+0000 7f41d6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:56.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.239+0000 7f41d6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:56.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.239+0000 7f41d6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:56.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.239+0000 7f41d67fc640 10 monclient(hunting): get_auth_request con 0x7f41d80c7170 auth_method 0 2026-02-17T11:11:56.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.239+0000 7f41d67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:56.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.239+0000 7f41d67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:56.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.239+0000 7f41d67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:56.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.239+0000 7f41d77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:56.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.239+0000 7f41d77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:56.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.239+0000 7f41d77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:56.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.239+0000 7f41d6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:56.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.239+0000 7f41d6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:56.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.239+0000 7f41d6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:56.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.239+0000 7f41d67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:56.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.239+0000 7f41d67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:56.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.239+0000 7f41d67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:56.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.240+0000 7f41d77fe640 10 monclient(hunting): handle_auth_done global_id 4767 payload 824 2026-02-17T11:11:56.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.240+0000 7f41d77fe640 1 -- 10.20.193.49:0/3489752351 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f41d80c7170 msgr2=0x7f41d80c0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:56.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.240+0000 7f41d77fe640 1 --2- 10.20.193.49:0/3489752351 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f41d80c7170 0x7f41d80c0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:56.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.240+0000 7f41d77fe640 1 -- 10.20.193.49:0/3489752351 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f41d8074ef0 msgr2=0x7f41d8148ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:56.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.240+0000 7f41d77fe640 1 --2- 10.20.193.49:0/3489752351 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f41d8074ef0 0x7f41d8148ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:56.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.240+0000 7f41d77fe640 10 monclient: _finish_hunting 0 2026-02-17T11:11:56.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.240+0000 7f41d77fe640 1 monclient: found mon.noname-a 2026-02-17T11:11:56.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.240+0000 7f41d77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:11:56.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.240+0000 7f41d77fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:11:56.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.240+0000 7f41d77fe640 1 -- 10.20.193.49:0/3489752351 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41d80c2720 con 0x7f41d80c7550 2026-02-17T11:11:56.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.241+0000 7f41d77fe640 1 --2- 10.20.193.49:0/3489752351 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f41d80c7550 0x7f41d81f65c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f41c800cc50 tx=0x7f41c800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:11:56.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.241+0000 7f41b77fe640 10 client.?.objecter ms_handle_connect 0x7f41d80c7550 2026-02-17T11:11:56.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.241+0000 7f41b77fe640 10 client.?.objecter resend_mon_ops 2026-02-17T11:11:56.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.243+0000 7f41b77fe640 1 -- 10.20.193.49:0/3489752351 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c8012400 con 0x7f41d80c7550 2026-02-17T11:11:56.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.243+0000 7f41b77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:56.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.243+0000 7f41b77fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:11:56.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.243+0000 7f41b77fe640 10 monclient: dump: 2026-02-17T11:11:56.244 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:56.244 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:56.244 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:56.244 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:56.245 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:56.245 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:56.245 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:56.245 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:56.245 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:56.245 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:56.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.243+0000 7f41b77fe640 10 monclient: _finish_auth 0 2026-02-17T11:11:56.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.243+0000 7f41b77fe640 10 monclient: _check_auth_tickets 2026-02-17T11:11:56.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.243+0000 7f41b77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:11:56.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.243+0000 7f41b77fe640 1 -- 10.20.193.49:0/3489752351 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41c80125a0 con 0x7f41d80c7550 2026-02-17T11:11:56.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.243+0000 7f41b77fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:11:56.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.243+0000 7f41b77fe640 1 -- 10.20.193.49:0/3489752351 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c8012990 con 0x7f41d80c7550 2026-02-17T11:11:56.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.243+0000 7f41b77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:56.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.243+0000 7f41b77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:11:56.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.243+0000 7f41b77fe640 10 monclient: dump: 2026-02-17T11:11:56.245 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:56.245 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:56.245 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:56.245 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:56.245 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:56.245 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:56.245 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:56.245 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:56.245 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:56.245 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:56.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.243+0000 7f41d57fa640 4 set_mon_vals no callback set 2026-02-17T11:11:56.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.243+0000 7f41dd2e1640 5 monclient: authenticate success, global_id 4767 2026-02-17T11:11:56.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.243+0000 7f41dd2e1640 10 monclient: _renew_subs 2026-02-17T11:11:56.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.243+0000 7f41dd2e1640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:11:56.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.243+0000 7f41dd2e1640 1 -- 10.20.193.49:0/3489752351 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41d80becd0 con 0x7f41d80c7550 2026-02-17T11:11:56.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.243+0000 7f41dd2e1640 10 client.4767.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:11:56.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.243+0000 7f41dd2e1640 10 monclient: _renew_subs 2026-02-17T11:11:56.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.243+0000 7f41dd2e1640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:11:56.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.243+0000 7f41dd2e1640 1 -- 10.20.193.49:0/3489752351 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41d80bf270 con 0x7f41d80c7550 2026-02-17T11:11:56.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.243+0000 7f41dd2e1640 1 librados: init done 2026-02-17T11:11:56.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.243+0000 7f41dd2e1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:11:56.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.243+0000 7f41dd2e1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:11:56.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.243+0000 7f41dd2e1640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:11:56.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.243+0000 7f41dd2e1640 1 -- 10.20.193.49:0/3489752351 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41d80749b0 con 0x7f41d80c7550 2026-02-17T11:11:56.256 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.255+0000 7f41b77fe640 1 -- 10.20.193.49:0/3489752351 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f41c8012b30 con 0x7f41d80c7550 2026-02-17T11:11:56.256 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.255+0000 7f41b77fe640 1 --2- 10.20.193.49:0/3489752351 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f41a4079170 0x7f41a407b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:56.257 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.255+0000 7f41d6ffd640 1 --2- 10.20.193.49:0/3489752351 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f41a4079170 0x7f41a407b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:56.257 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.255+0000 7f41d6ffd640 10 monclient: get_auth_request con 0x7f41a4079170 auth_method 0 2026-02-17T11:11:56.257 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.256+0000 7f41b77fe640 1 -- 10.20.193.49:0/3489752351 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f41c805ec60 con 0x7f41d80c7550 2026-02-17T11:11:56.257 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.256+0000 7f41b77fe640 10 client.4767.objecter ms_dispatch2 0x7f41d8000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:11:56.257 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.256+0000 7f41b77fe640 3 client.4767.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:11:56.257 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.256+0000 7f41b77fe640 3 client.4767.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:11:56.257 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.256+0000 7f41b77fe640 20 client.4767.objecter dump_active .. 0 homeless 2026-02-17T11:11:56.257 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.256+0000 7f41b77fe640 10 client.4767.objecter ms_handle_connect 0x7f41a4079170 2026-02-17T11:11:56.257 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.256+0000 7f41d6ffd640 1 --2- 10.20.193.49:0/3489752351 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f41a4079170 0x7f41a407b630 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f41cc007b60 tx=0x7f41cc007ab0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:11:56.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.354+0000 7f41b77fe640 1 -- 10.20.193.49:0/3489752351 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f41c8062c20 con 0x7f41d80c7550 2026-02-17T11:11:56.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.354+0000 7f41b77fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:11:56.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.354+0000 7f41b77fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:11:56.454 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.453+0000 7f41dd2e1640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:11:56.455 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.453+0000 7f41dd2e1640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:11:56.455 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.453+0000 7f41dd2e1640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:11:56.455 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.453+0000 7f41dd2e1640 1 -- 10.20.193.49:0/3489752351 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f41d814e360 con 0x7f41d80c7550 2026-02-17T11:11:56.457 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.456+0000 7f41b77fe640 1 -- 10.20.193.49:0/3489752351 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f41c8066f20 con 0x7f41d80c7550 2026-02-17T11:11:56.457 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.456+0000 7f41b77fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:11:56.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.456+0000 7f41b77fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:11:56.458 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:11:56.458 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:11:56.459 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.457+0000 7f41dd2e1640 10 librados: watch_flush enter 2026-02-17T11:11:56.460 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.457+0000 7f41dd2e1640 10 librados: watch_flush exit 2026-02-17T11:11:56.460 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.457+0000 7f41dd2e1640 20 client.4767.objecter shutdown clearing up homeless session... 2026-02-17T11:11:56.460 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.457+0000 7f41dd2e1640 10 client.4767.objecter successfully canceled tick 2026-02-17T11:11:56.460 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.457+0000 7f41dd2e1640 1 -- 10.20.193.49:0/3489752351 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f41a4079170 msgr2=0x7f41a407b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:56.460 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.457+0000 7f41dd2e1640 1 --2- 10.20.193.49:0/3489752351 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f41a4079170 0x7f41a407b630 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f41cc007b60 tx=0x7f41cc007ab0 comp rx=0 tx=0).stop 2026-02-17T11:11:56.460 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.457+0000 7f41dd2e1640 10 monclient: shutdown 2026-02-17T11:11:56.460 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.457+0000 7f41dd2e1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:11:56.460 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.457+0000 7f41dd2e1640 1 -- 10.20.193.49:0/3489752351 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f41d80c7550 msgr2=0x7f41d81f65c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:56.460 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.457+0000 7f41dd2e1640 1 --2- 10.20.193.49:0/3489752351 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f41d80c7550 0x7f41d81f65c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f41c800cc50 tx=0x7f41c800a430 comp rx=0 tx=0).stop 2026-02-17T11:11:56.460 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.457+0000 7f41dd2e1640 1 -- 10.20.193.49:0/3489752351 shutdown_connections 2026-02-17T11:11:56.461 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.457+0000 7f41dd2e1640 1 --2- 10.20.193.49:0/3489752351 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f41a4079170 0x7f41a407b630 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:56.461 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.457+0000 7f41dd2e1640 1 --2- 10.20.193.49:0/3489752351 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f41d80c7550 0x7f41d81f65c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:56.461 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.457+0000 7f41dd2e1640 1 --2- 10.20.193.49:0/3489752351 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f41d80c7170 0x7f41d80c0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:56.461 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.457+0000 7f41dd2e1640 1 --2- 10.20.193.49:0/3489752351 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f41d8074ef0 0x7f41d8148ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:56.461 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.457+0000 7f41dd2e1640 1 -- 10.20.193.49:0/3489752351 >> 10.20.193.49:0/3489752351 conn(0x7f41d80c9f40 msgr2=0x7f41d806fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:11:56.461 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.457+0000 7f41dd2e1640 1 -- 10.20.193.49:0/3489752351 shutdown_connections 2026-02-17T11:11:56.461 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.457+0000 7f41dd2e1640 1 -- 10.20.193.49:0/3489752351 wait complete. 2026-02-17T11:11:56.461 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:56.457+0000 7f41dd2e1640 1 librados: shutdown 2026-02-17T11:11:59.467 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:11:59.536 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.534+0000 7f69d56f2640 10 monclient: get_monmap_and_config 2026-02-17T11:11:59.536 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.534+0000 7f69d56f2640 10 monclient: build_initial_monmap 2026-02-17T11:11:59.536 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.534+0000 7f69d56f2640 10 monclient: monmap: 2026-02-17T11:11:59.536 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:11:59.537 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:59.537 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:11:59.535413+0000 2026-02-17T11:11:59.537 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:11:59.535413+0000 2026-02-17T11:11:59.537 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:11:59.537 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:59.537 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:11:59.537 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:11:59.537 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:11:59.537 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:11:59.537 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:11:59.537 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:11:59.538 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:59.546 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.535+0000 7f69d56f2640 1 Processor -- start 2026-02-17T11:11:59.547 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.535+0000 7f69d56f2640 1 -- start start 2026-02-17T11:11:59.547 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.535+0000 7f69d56f2640 10 monclient: init 2026-02-17T11:11:59.547 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.535+0000 7f69d56f2640 10 monclient: _reopen_session rank -1 2026-02-17T11:11:59.547 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.535+0000 7f69d56f2640 10 monclient: _add_conns ranks=[5,2,4,1,3,0] 2026-02-17T11:11:59.547 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.535+0000 7f69d56f2640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f69d014f280 0x7f69d00c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:59.548 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.535+0000 7f69d56f2640 10 monclient(hunting): picked mon.noname-c con 0x7f69d014f280 addr v2:10.20.193.157:3300/0 2026-02-17T11:11:59.548 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.535+0000 7f69d56f2640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f69d014f660 addr v1:10.20.193.157:6789/0 2026-02-17T11:11:59.548 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.535+0000 7f69d56f2640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f69d015abc0 0x7f69d015afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:59.548 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.535+0000 7f69d56f2640 10 monclient(hunting): picked mon.noname-b con 0x7f69d015abc0 addr v2:10.20.193.97:3300/0 2026-02-17T11:11:59.548 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.535+0000 7f69d56f2640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69d00c7110 con 0x7f69d014f660 2026-02-17T11:11:59.548 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.535+0000 7f69d56f2640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:59.549 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.535+0000 7f69d56f2640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f69d00c7950 con 0x7f69d015abc0 2026-02-17T11:11:59.549 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.535+0000 7f69d56f2640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:59.549 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.535+0000 7f69d56f2640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f69d015a730 con 0x7f69d014f280 2026-02-17T11:11:59.549 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.535+0000 7f69d56f2640 10 monclient(hunting): _renew_subs 2026-02-17T11:11:59.549 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.535+0000 7f69d56f2640 10 monclient(hunting): authenticate will time out at 1196.198979s 2026-02-17T11:11:59.549 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.536+0000 7f69cf7fe640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f69d015abc0 0x7f69d015afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:59.549 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.536+0000 7f69cf7fe640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f69d015abc0 0x7f69d015afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:55792/0 (socket says 10.20.193.49:55792) 2026-02-17T11:11:59.549 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.536+0000 7f69cf7fe640 1 -- 10.20.193.49:0/1688476862 learned_addr learned my addr 10.20.193.49:0/1688476862 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:11:59.550 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.536+0000 7f69cf7fe640 10 monclient(hunting): get_auth_request con 0x7f69d015abc0 auth_method 0 2026-02-17T11:11:59.550 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.536+0000 7f69cf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:59.550 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.536+0000 7f69cf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:59.550 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.536+0000 7f69cf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:59.550 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.536+0000 7f69ceffd640 1 --2- 10.20.193.49:0/1688476862 >> v2:10.20.193.157:3300/0 conn(0x7f69d014f280 0x7f69d00c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:59.550 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.536+0000 7f69cf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:59.550 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.536+0000 7f69cf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:59.551 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.536+0000 7f69cf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:59.551 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.536+0000 7f69ceffd640 10 monclient(hunting): get_auth_request con 0x7f69d014f280 auth_method 0 2026-02-17T11:11:59.551 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.536+0000 7f69ceffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:59.551 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.536+0000 7f69ceffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:59.551 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.536+0000 7f69ceffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:59.551 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.537+0000 7f69ceffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:59.551 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.537+0000 7f69ceffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:59.551 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.537+0000 7f69ceffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:59.551 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.538+0000 7f69cf7fe640 10 monclient(hunting): handle_auth_done global_id 4741 payload 274 2026-02-17T11:11:59.551 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.538+0000 7f69cf7fe640 1 -- 10.20.193.49:0/1688476862 >> v2:10.20.193.157:3300/0 conn(0x7f69d014f280 msgr2=0x7f69d00c7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:11:59.551 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.538+0000 7f69cf7fe640 1 --2- 10.20.193.49:0/1688476862 >> v2:10.20.193.157:3300/0 conn(0x7f69d014f280 0x7f69d00c7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:59.552 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.538+0000 7f69cf7fe640 1 -- 10.20.193.49:0/1688476862 >> v1:10.20.193.157:6789/0 conn(0x7f69d014f660 legacy=0x7f69d00c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:59.552 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.538+0000 7f69cf7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:11:59.552 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.538+0000 7f69cf7fe640 1 monclient: found mon.noname-b 2026-02-17T11:11:59.552 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.538+0000 7f69cf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:11:59.552 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.538+0000 7f69cf7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:11:59.552 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.538+0000 7f69cf7fe640 1 -- 10.20.193.49:0/1688476862 --> v2:10.20.193.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69d00c7390 con 0x7f69d015abc0 2026-02-17T11:11:59.552 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.539+0000 7f69cf7fe640 1 --2- 10.20.193.49:0/1688476862 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f69d015abc0 0x7f69d015afe0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f69d0069960 tx=0x7f69c002f310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34d0b2d48fd72866 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:11:59.552 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.540+0000 7f69cdffb640 1 -- 10.20.193.49:0/1688476862 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69c002fe10 con 0x7f69d015abc0 2026-02-17T11:11:59.552 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.540+0000 7f69cdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:59.552 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.540+0000 7f69cdffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:11:59.552 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.540+0000 7f69cdffb640 10 monclient: dump: 2026-02-17T11:11:59.552 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:59.553 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:59.553 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:59.553 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:59.553 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:59.553 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:59.553 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:59.553 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:59.553 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:59.553 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:59.553 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.540+0000 7f69cdffb640 10 monclient: _finish_auth 0 2026-02-17T11:11:59.553 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.540+0000 7f69cdffb640 10 monclient: _check_auth_tickets 2026-02-17T11:11:59.553 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.540+0000 7f69cdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:11:59.554 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.540+0000 7f69d56f2640 5 monclient: authenticate success, global_id 4741 2026-02-17T11:11:59.554 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.540+0000 7f69d56f2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:11:59.554 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.540+0000 7f69cdffb640 1 -- 10.20.193.49:0/1688476862 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69c00373f0 con 0x7f69d015abc0 2026-02-17T11:11:59.554 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.540+0000 7f69cdffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:11:59.554 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.540+0000 7f69cdffb640 1 -- 10.20.193.49:0/1688476862 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69c00377c0 con 0x7f69d015abc0 2026-02-17T11:11:59.554 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.540+0000 7f69d56f2640 10 monclient: get_monmap_and_config success 2026-02-17T11:11:59.554 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.540+0000 7f69d56f2640 4 set_mon_vals no callback set 2026-02-17T11:11:59.554 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.540+0000 7f69cdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:59.554 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.540+0000 7f69cdffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:11:59.554 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.540+0000 7f69cdffb640 10 monclient: dump: 2026-02-17T11:11:59.554 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:59.554 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:59.555 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:59.555 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:59.555 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:59.555 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:59.555 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:59.555 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:59.555 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:59.555 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:59.555 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.541+0000 7f69d56f2640 10 monclient: shutdown 2026-02-17T11:11:59.555 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.541+0000 7f69d56f2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:11:59.555 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.541+0000 7f69d56f2640 1 -- 10.20.193.49:0/1688476862 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f69d015abc0 msgr2=0x7f69d015afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:59.555 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.541+0000 7f69d56f2640 1 --2- 10.20.193.49:0/1688476862 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f69d015abc0 0x7f69d015afe0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f69d0069960 tx=0x7f69c002f310 comp rx=0 tx=0).stop 2026-02-17T11:11:59.556 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.541+0000 7f69d56f2640 1 -- 10.20.193.49:0/1688476862 shutdown_connections 2026-02-17T11:11:59.556 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.541+0000 7f69d56f2640 1 --2- 10.20.193.49:0/1688476862 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f69d015abc0 0x7f69d015afe0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:59.556 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.541+0000 7f69d56f2640 1 --2- 10.20.193.49:0/1688476862 >> v2:10.20.193.157:3300/0 conn(0x7f69d014f280 0x7f69d00c7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:59.556 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.541+0000 7f69d56f2640 1 -- 10.20.193.49:0/1688476862 >> 10.20.193.49:0/1688476862 conn(0x7f69d00c9f20 msgr2=0x7f69d00ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:11:59.556 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.541+0000 7f69d56f2640 1 -- 10.20.193.49:0/1688476862 shutdown_connections 2026-02-17T11:11:59.556 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.541+0000 7f69d56f2640 1 -- 10.20.193.49:0/1688476862 wait complete. 2026-02-17T11:11:59.556 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.541+0000 7f69d56f2640 10 monclient: build_initial_monmap 2026-02-17T11:11:59.556 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.541+0000 7f69d56f2640 10 monclient: monmap: 2026-02-17T11:11:59.556 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:11:59.556 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:11:59.556 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:11:59.556 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:11:59.557 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:11:59.557 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:59.557 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:11:59.557 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:11:59.557 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:11:59.557 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:59.557 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.541+0000 7f69d56f2640 1 librados: starting msgr at 2026-02-17T11:11:59.557 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.541+0000 7f69d56f2640 1 librados: starting objecter 2026-02-17T11:11:59.557 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.541+0000 7f69d56f2640 1 Processor -- start 2026-02-17T11:11:59.557 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.541+0000 7f69d56f2640 1 -- start start 2026-02-17T11:11:59.557 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.541+0000 7f69d56f2640 1 librados: setting wanted keys 2026-02-17T11:11:59.557 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.541+0000 7f69d56f2640 1 librados: calling monclient init 2026-02-17T11:11:59.558 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.541+0000 7f69d56f2640 10 monclient: init 2026-02-17T11:11:59.558 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.542+0000 7f69d56f2640 10 monclient: _reopen_session rank -1 2026-02-17T11:11:59.558 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.542+0000 7f69d56f2640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:11:59.558 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.542+0000 7f69d56f2640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f69d014f280 0x7f69d01f3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:59.558 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.542+0000 7f69d56f2640 10 monclient(hunting): picked mon.noname-b con 0x7f69d014f280 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:11:59.558 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.542+0000 7f69d56f2640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f69d014f660 0x7f69d00742b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:59.558 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.542+0000 7f69d56f2640 10 monclient(hunting): picked mon.noname-a con 0x7f69d014f660 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:11:59.558 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.542+0000 7f69d56f2640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f69d015abc0 0x7f69d006b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:59.558 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.542+0000 7f69d56f2640 10 monclient(hunting): picked mon.noname-c con 0x7f69d015abc0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:11:59.558 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.542+0000 7f69d56f2640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:59.558 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.542+0000 7f69d56f2640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f69d015a3c0 con 0x7f69d014f660 2026-02-17T11:11:59.558 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.542+0000 7f69d56f2640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:59.558 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.542+0000 7f69d56f2640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f69d015a0e0 con 0x7f69d014f280 2026-02-17T11:11:59.559 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.542+0000 7f69d56f2640 10 monclient(hunting): start opening mon connection 2026-02-17T11:11:59.559 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.542+0000 7f69d56f2640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f69d015b520 con 0x7f69d015abc0 2026-02-17T11:11:59.559 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.542+0000 7f69d56f2640 10 monclient(hunting): _renew_subs 2026-02-17T11:11:59.559 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.542+0000 7f69d56f2640 10 monclient(hunting): authenticate will time out at 1196.205340s 2026-02-17T11:11:59.559 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.542+0000 7f69ceffd640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f69d014f280 0x7f69d01f3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:59.559 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.542+0000 7f69ce7fc640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f69d014f660 0x7f69d00742b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:59.559 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.542+0000 7f69ceffd640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f69d014f280 0x7f69d01f3960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:55806/0 (socket says 10.20.193.49:55806) 2026-02-17T11:11:59.559 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.542+0000 7f69ceffd640 1 -- 10.20.193.49:0/3762164039 learned_addr learned my addr 10.20.193.49:0/3762164039 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:11:59.559 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.542+0000 7f69ceffd640 10 monclient(hunting): get_auth_request con 0x7f69d014f280 auth_method 0 2026-02-17T11:11:59.559 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.542+0000 7f69ceffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:59.559 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.542+0000 7f69ceffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:59.560 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.542+0000 7f69ceffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:59.560 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.542+0000 7f69cf7fe640 1 --2- 10.20.193.49:0/3762164039 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f69d015abc0 0x7f69d006b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:59.560 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.542+0000 7f69cf7fe640 10 monclient(hunting): get_auth_request con 0x7f69d015abc0 auth_method 0 2026-02-17T11:11:59.560 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.542+0000 7f69cf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:59.560 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.542+0000 7f69cf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:59.560 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.542+0000 7f69cf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:59.560 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.542+0000 7f69ceffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:59.561 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.542+0000 7f69ceffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:59.561 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.542+0000 7f69ceffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:59.561 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.542+0000 7f69ce7fc640 10 monclient(hunting): get_auth_request con 0x7f69d014f660 auth_method 0 2026-02-17T11:11:59.561 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.542+0000 7f69ce7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:11:59.561 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.542+0000 7f69ce7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:11:59.561 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.542+0000 7f69ce7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:11:59.561 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.543+0000 7f69cf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:59.561 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.543+0000 7f69cf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:59.561 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.543+0000 7f69cf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:59.562 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.543+0000 7f69ce7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:11:59.562 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.543+0000 7f69ce7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:11:59.562 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.543+0000 7f69ce7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:11:59.562 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.544+0000 7f69ceffd640 10 monclient(hunting): handle_auth_done global_id 4744 payload 824 2026-02-17T11:11:59.562 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.544+0000 7f69ceffd640 1 -- 10.20.193.49:0/3762164039 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f69d015abc0 msgr2=0x7f69d006b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:59.562 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.544+0000 7f69ceffd640 1 --2- 10.20.193.49:0/3762164039 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f69d015abc0 0x7f69d006b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:59.562 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.544+0000 7f69ceffd640 1 -- 10.20.193.49:0/3762164039 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f69d014f660 msgr2=0x7f69d00742b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:59.562 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.544+0000 7f69ceffd640 1 --2- 10.20.193.49:0/3762164039 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f69d014f660 0x7f69d00742b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:59.562 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.544+0000 7f69ceffd640 10 monclient: _finish_hunting 0 2026-02-17T11:11:59.562 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.544+0000 7f69ceffd640 1 monclient: found mon.noname-b 2026-02-17T11:11:59.562 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.544+0000 7f69ceffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:11:59.562 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.544+0000 7f69ceffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:11:59.563 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.544+0000 7f69ceffd640 1 -- 10.20.193.49:0/3762164039 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69d01f4860 con 0x7f69d014f280 2026-02-17T11:11:59.563 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.545+0000 7f69ceffd640 1 --2- 10.20.193.49:0/3762164039 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f69d014f280 0x7f69d01f3960 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f69c400e890 tx=0x7f69c400ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:11:59.563 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.545+0000 7f69af7fe640 10 client.?.objecter ms_handle_connect 0x7f69d014f280 2026-02-17T11:11:59.563 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.545+0000 7f69af7fe640 10 client.?.objecter resend_mon_ops 2026-02-17T11:11:59.566 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.546+0000 7f69af7fe640 1 -- 10.20.193.49:0/3762164039 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69c4017070 con 0x7f69d014f280 2026-02-17T11:11:59.566 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.546+0000 7f69af7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:59.566 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.546+0000 7f69af7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:11:59.566 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.546+0000 7f69af7fe640 10 monclient: dump: 2026-02-17T11:11:59.566 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:59.566 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:59.567 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:59.567 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:59.567 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:59.567 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:59.567 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:59.567 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:59.567 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:59.567 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:59.567 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.546+0000 7f69af7fe640 10 monclient: _finish_auth 0 2026-02-17T11:11:59.567 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.546+0000 7f69af7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:11:59.567 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.546+0000 7f69af7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:11:59.567 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.546+0000 7f69d56f2640 5 monclient: authenticate success, global_id 4744 2026-02-17T11:11:59.568 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.546+0000 7f69d56f2640 10 monclient: _renew_subs 2026-02-17T11:11:59.568 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.546+0000 7f69d56f2640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:11:59.568 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.546+0000 7f69d56f2640 1 -- 10.20.193.49:0/3762164039 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69d0073810 con 0x7f69d014f280 2026-02-17T11:11:59.568 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.546+0000 7f69d56f2640 10 client.4744.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:11:59.568 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.546+0000 7f69d56f2640 10 monclient: _renew_subs 2026-02-17T11:11:59.568 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.546+0000 7f69d56f2640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:11:59.568 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.546+0000 7f69d56f2640 1 -- 10.20.193.49:0/3762164039 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69d01f42a0 con 0x7f69d014f280 2026-02-17T11:11:59.568 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.546+0000 7f69d56f2640 1 librados: init done 2026-02-17T11:11:59.568 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.546+0000 7f69af7fe640 1 -- 10.20.193.49:0/3762164039 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69c4005a90 con 0x7f69d014f280 2026-02-17T11:11:59.568 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.546+0000 7f69af7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:11:59.568 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.546+0000 7f69af7fe640 1 -- 10.20.193.49:0/3762164039 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69c4021060 con 0x7f69d014f280 2026-02-17T11:11:59.568 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.546+0000 7f69af7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:11:59.569 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.546+0000 7f69af7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:11:59.569 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.546+0000 7f69af7fe640 10 monclient: dump: 2026-02-17T11:11:59.569 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:11:59.569 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:11:59.569 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:59.569 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:11:59.569 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:11:59.569 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:11:59.569 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:11:59.569 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:11:59.569 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:11:59.569 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:11:59.569 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.546+0000 7f69cd7fa640 4 set_mon_vals no callback set 2026-02-17T11:11:59.570 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.546+0000 7f69d56f2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:11:59.570 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.546+0000 7f69d56f2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:11:59.570 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.546+0000 7f69d56f2640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:11:59.570 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.546+0000 7f69d56f2640 1 -- 10.20.193.49:0/3762164039 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69d00c9b70 con 0x7f69d014f280 2026-02-17T11:11:59.570 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.557+0000 7f69af7fe640 1 -- 10.20.193.49:0/3762164039 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f69c4024060 con 0x7f69d014f280 2026-02-17T11:11:59.570 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.558+0000 7f69af7fe640 1 --2- 10.20.193.49:0/3762164039 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f699c079140 0x7f699c07b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:11:59.570 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.558+0000 7f69ce7fc640 1 --2- 10.20.193.49:0/3762164039 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f699c079140 0x7f699c07b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:11:59.570 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.558+0000 7f69ce7fc640 10 monclient: get_auth_request con 0x7f699c079140 auth_method 0 2026-02-17T11:11:59.570 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.559+0000 7f69af7fe640 1 -- 10.20.193.49:0/3762164039 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f69c405deb0 con 0x7f69d014f280 2026-02-17T11:11:59.570 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.559+0000 7f69af7fe640 10 client.4744.objecter ms_dispatch2 0x7f69d0000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:11:59.570 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.559+0000 7f69af7fe640 3 client.4744.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:11:59.570 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.559+0000 7f69af7fe640 3 client.4744.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:11:59.571 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.559+0000 7f69af7fe640 20 client.4744.objecter dump_active .. 0 homeless 2026-02-17T11:11:59.571 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.559+0000 7f69af7fe640 10 client.4744.objecter ms_handle_connect 0x7f699c079140 2026-02-17T11:11:59.571 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.559+0000 7f69ce7fc640 1 --2- 10.20.193.49:0/3762164039 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f699c079140 0x7f699c07b600 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f69d014be40 tx=0x7f69b8007f30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:11:59.659 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.658+0000 7f69af7fe640 1 -- 10.20.193.49:0/3762164039 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f69c4061e70 con 0x7f69d014f280 2026-02-17T11:11:59.659 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.658+0000 7f69af7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:11:59.660 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.658+0000 7f69af7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:11:59.758 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.756+0000 7f69d56f2640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:11:59.758 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.756+0000 7f69d56f2640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:11:59.758 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.756+0000 7f69d56f2640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:11:59.758 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.756+0000 7f69d56f2640 1 -- 10.20.193.49:0/3762164039 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f69d015b180 con 0x7f69d014f280 2026-02-17T11:11:59.761 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.760+0000 7f69af7fe640 1 -- 10.20.193.49:0/3762164039 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f69c4066170 con 0x7f69d014f280 2026-02-17T11:11:59.761 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.760+0000 7f69af7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:11:59.761 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.760+0000 7f69af7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:11:59.761 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:11:59.761 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:11:59.762 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.761+0000 7f69d56f2640 10 librados: watch_flush enter 2026-02-17T11:11:59.762 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.761+0000 7f69d56f2640 10 librados: watch_flush exit 2026-02-17T11:11:59.762 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.761+0000 7f69d56f2640 20 client.4744.objecter shutdown clearing up homeless session... 2026-02-17T11:11:59.762 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.761+0000 7f69d56f2640 10 client.4744.objecter successfully canceled tick 2026-02-17T11:11:59.762 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.761+0000 7f69d56f2640 1 -- 10.20.193.49:0/3762164039 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f699c079140 msgr2=0x7f699c07b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:59.762 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.761+0000 7f69d56f2640 1 --2- 10.20.193.49:0/3762164039 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f699c079140 0x7f699c07b600 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f69d014be40 tx=0x7f69b8007f30 comp rx=0 tx=0).stop 2026-02-17T11:11:59.762 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.761+0000 7f69d56f2640 10 monclient: shutdown 2026-02-17T11:11:59.762 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.761+0000 7f69d56f2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:11:59.762 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.761+0000 7f69d56f2640 1 -- 10.20.193.49:0/3762164039 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f69d014f280 msgr2=0x7f69d01f3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:11:59.763 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.761+0000 7f69d56f2640 1 --2- 10.20.193.49:0/3762164039 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f69d014f280 0x7f69d01f3960 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f69c400e890 tx=0x7f69c400ed60 comp rx=0 tx=0).stop 2026-02-17T11:11:59.763 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.761+0000 7f69d56f2640 1 -- 10.20.193.49:0/3762164039 shutdown_connections 2026-02-17T11:11:59.763 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.761+0000 7f69d56f2640 1 --2- 10.20.193.49:0/3762164039 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f699c079140 0x7f699c07b600 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:59.763 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.761+0000 7f69d56f2640 1 --2- 10.20.193.49:0/3762164039 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f69d015abc0 0x7f69d006b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:59.763 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.761+0000 7f69d56f2640 1 --2- 10.20.193.49:0/3762164039 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f69d014f660 0x7f69d00742b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:59.763 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.761+0000 7f69d56f2640 1 --2- 10.20.193.49:0/3762164039 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f69d014f280 0x7f69d01f3960 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:11:59.763 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.761+0000 7f69d56f2640 1 -- 10.20.193.49:0/3762164039 >> 10.20.193.49:0/3762164039 conn(0x7f69d00c9f20 msgr2=0x7f69d0146b50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:11:59.763 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.761+0000 7f69d56f2640 1 -- 10.20.193.49:0/3762164039 shutdown_connections 2026-02-17T11:11:59.763 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.761+0000 7f69d56f2640 1 -- 10.20.193.49:0/3762164039 wait complete. 2026-02-17T11:11:59.763 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:11:59.761+0000 7f69d56f2640 1 librados: shutdown 2026-02-17T11:12:02.771 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:12:02.840 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.838+0000 7f3d59424640 10 monclient: get_monmap_and_config 2026-02-17T11:12:02.840 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.838+0000 7f3d59424640 10 monclient: build_initial_monmap 2026-02-17T11:12:02.840 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.838+0000 7f3d59424640 10 monclient: monmap: 2026-02-17T11:12:02.840 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:12:02.840 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:02.840 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:12:02.838964+0000 2026-02-17T11:12:02.840 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:12:02.838964+0000 2026-02-17T11:12:02.840 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:12:02.841 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:02.841 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:12:02.841 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:12:02.841 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:12:02.841 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:12:02.841 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:12:02.841 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:12:02.841 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:02.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.838+0000 7f3d59424640 1 Processor -- start 2026-02-17T11:12:02.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.838+0000 7f3d59424640 1 -- start start 2026-02-17T11:12:02.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.838+0000 7f3d59424640 10 monclient: init 2026-02-17T11:12:02.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.839+0000 7f3d59424640 10 monclient: _reopen_session rank -1 2026-02-17T11:12:02.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.839+0000 7f3d59424640 10 monclient: _add_conns ranks=[3,0,2,4,1,5] 2026-02-17T11:12:02.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.839+0000 7f3d59424640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f3d54152680 0x7f3d54076230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:02.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.839+0000 7f3d59424640 10 monclient(hunting): picked mon.noname-a con 0x7f3d54152680 addr v2:10.20.193.49:3300/0 2026-02-17T11:12:02.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.839+0000 7f3d59424640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f3d54152a60 addr v1:10.20.193.49:6789/0 2026-02-17T11:12:02.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.839+0000 7f3d59424640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f3d54073720 addr v1:10.20.193.157:6789/0 2026-02-17T11:12:02.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.839+0000 7f3d59424640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d540c8640 con 0x7f3d54152a60 2026-02-17T11:12:02.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.839+0000 7f3d59424640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d540c88b0 con 0x7f3d54073720 2026-02-17T11:12:02.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.839+0000 7f3d59424640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:02.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.839+0000 7f3d59424640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f3d540ca060 con 0x7f3d54152680 2026-02-17T11:12:02.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.839+0000 7f3d59424640 10 monclient(hunting): _renew_subs 2026-02-17T11:12:02.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.839+0000 7f3d59424640 10 monclient(hunting): authenticate will time out at 1199.502553s 2026-02-17T11:12:02.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.839+0000 7f3d52ffd640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f3d54152680 0x7f3d54076230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:02.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.840+0000 7f3d537fe640 1 --1- >> v1:10.20.193.157:6789/0 conn(0x7f3d54073720 0x7f3d5415f3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.157:6789/0 says I am v1:10.20.193.49:47522/0 (socket says 10.20.193.49:47522) 2026-02-17T11:12:02.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.840+0000 7f3d537fe640 1 -- 10.20.193.49:0/4145949441 learned_addr learned my addr 10.20.193.49:0/4145949441 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:12:02.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.840+0000 7f3d52ffd640 10 monclient(hunting): get_auth_request con 0x7f3d54152680 auth_method 0 2026-02-17T11:12:02.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.840+0000 7f3d52ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:02.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.840+0000 7f3d52ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:02.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.840+0000 7f3d52ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:02.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.840+0000 7f3d52ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:02.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.840+0000 7f3d52ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:02.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.840+0000 7f3d52ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:02.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.841+0000 7f3d51ffb640 1 -- 10.20.193.49:0/4145949441 <== mon.2 v1:10.20.193.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 965028879 0 0) 0x7f3d540c88b0 con 0x7f3d54073720 2026-02-17T11:12:02.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.841+0000 7f3d51ffb640 10 monclient(hunting): _negotiate 2026-02-17T11:12:02.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.841+0000 7f3d51ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:02.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.841+0000 7f3d51ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:02.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.841+0000 7f3d51ffb640 10 monclient(hunting): my global_id is 4766 2026-02-17T11:12:02.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.841+0000 7f3d51ffb640 1 -- 10.20.193.49:0/4145949441 --> v1:10.20.193.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d40003620 con 0x7f3d54073720 2026-02-17T11:12:02.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.842+0000 7f3d52ffd640 10 monclient(hunting): handle_auth_done global_id 4773 payload 274 2026-02-17T11:12:02.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.842+0000 7f3d52ffd640 1 -- 10.20.193.49:0/4145949441 >> v1:10.20.193.157:6789/0 conn(0x7f3d54073720 legacy=0x7f3d5415f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:02.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.842+0000 7f3d52ffd640 1 -- 10.20.193.49:0/4145949441 >> v1:10.20.193.49:6789/0 conn(0x7f3d54152a60 legacy=0x7f3d540c9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:02.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.842+0000 7f3d52ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:12:02.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.842+0000 7f3d52ffd640 1 monclient: found mon.noname-a 2026-02-17T11:12:02.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.842+0000 7f3d52ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:12:02.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.842+0000 7f3d52ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:12:02.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.842+0000 7f3d52ffd640 1 -- 10.20.193.49:0/4145949441 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d540c8b90 con 0x7f3d54152680 2026-02-17T11:12:02.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.844+0000 7f3d52ffd640 1 --2- 10.20.193.49:0/4145949441 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f3d54152680 0x7f3d54076230 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3d480098a0 tx=0x7f3d4802ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52f09b0b18e4cdda server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:12:02.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.846+0000 7f3d51ffb640 1 -- 10.20.193.49:0/4145949441 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4803c070 con 0x7f3d54152680 2026-02-17T11:12:02.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.846+0000 7f3d51ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:02.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.846+0000 7f3d51ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:12:02.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.846+0000 7f3d51ffb640 10 monclient: dump: 2026-02-17T11:12:02.852 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:02.852 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:02.852 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:02.852 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:02.852 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:02.852 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:02.852 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:02.852 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:02.853 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:02.853 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:02.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.846+0000 7f3d51ffb640 10 monclient: _finish_auth 0 2026-02-17T11:12:02.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.846+0000 7f3d51ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:12:02.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.846+0000 7f3d51ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:12:02.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.846+0000 7f3d51ffb640 1 -- 10.20.193.49:0/4145949441 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d4802fc10 con 0x7f3d54152680 2026-02-17T11:12:02.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.846+0000 7f3d51ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:12:02.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.846+0000 7f3d51ffb640 1 -- 10.20.193.49:0/4145949441 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d48037440 con 0x7f3d54152680 2026-02-17T11:12:02.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.846+0000 7f3d51ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:02.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.846+0000 7f3d51ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:12:02.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.846+0000 7f3d51ffb640 10 monclient: dump: 2026-02-17T11:12:02.853 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:02.854 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:02.854 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:02.854 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:02.854 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:02.854 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:02.854 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:02.854 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:02.854 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:02.854 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:02.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.846+0000 7f3d59424640 5 monclient: authenticate success, global_id 4773 2026-02-17T11:12:02.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.846+0000 7f3d59424640 10 monclient: get_monmap_and_config success 2026-02-17T11:12:02.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.846+0000 7f3d59424640 4 set_mon_vals no callback set 2026-02-17T11:12:02.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.846+0000 7f3d59424640 10 monclient: shutdown 2026-02-17T11:12:02.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.846+0000 7f3d59424640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:12:02.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.846+0000 7f3d59424640 1 -- 10.20.193.49:0/4145949441 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f3d54152680 msgr2=0x7f3d54076230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:02.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.846+0000 7f3d59424640 1 --2- 10.20.193.49:0/4145949441 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f3d54152680 0x7f3d54076230 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3d480098a0 tx=0x7f3d4802ef00 comp rx=0 tx=0).stop 2026-02-17T11:12:02.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.846+0000 7f3d59424640 1 -- 10.20.193.49:0/4145949441 shutdown_connections 2026-02-17T11:12:02.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.846+0000 7f3d59424640 1 --2- 10.20.193.49:0/4145949441 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f3d54152680 0x7f3d54076230 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:02.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.846+0000 7f3d59424640 1 -- 10.20.193.49:0/4145949441 >> 10.20.193.49:0/4145949441 conn(0x7f3d540ca740 msgr2=0x7f3d540cab50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:12:02.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.846+0000 7f3d59424640 1 -- 10.20.193.49:0/4145949441 shutdown_connections 2026-02-17T11:12:02.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.846+0000 7f3d59424640 1 -- 10.20.193.49:0/4145949441 wait complete. 2026-02-17T11:12:02.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.847+0000 7f3d59424640 10 monclient: build_initial_monmap 2026-02-17T11:12:02.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.847+0000 7f3d59424640 10 monclient: monmap: 2026-02-17T11:12:02.855 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:12:02.856 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:12:02.856 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:12:02.856 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:12:02.856 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:12:02.856 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:02.856 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:12:02.856 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:12:02.856 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:12:02.856 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:02.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.847+0000 7f3d59424640 1 librados: starting msgr at 2026-02-17T11:12:02.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.847+0000 7f3d59424640 1 librados: starting objecter 2026-02-17T11:12:02.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.847+0000 7f3d59424640 1 Processor -- start 2026-02-17T11:12:02.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.847+0000 7f3d59424640 1 -- start start 2026-02-17T11:12:02.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.847+0000 7f3d59424640 1 librados: setting wanted keys 2026-02-17T11:12:02.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.847+0000 7f3d59424640 1 librados: calling monclient init 2026-02-17T11:12:02.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.847+0000 7f3d59424640 10 monclient: init 2026-02-17T11:12:02.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.847+0000 7f3d59424640 10 monclient: _reopen_session rank -1 2026-02-17T11:12:02.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.847+0000 7f3d59424640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:12:02.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.847+0000 7f3d59424640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f3d54073720 0x7f3d541f45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:02.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.847+0000 7f3d59424640 10 monclient(hunting): picked mon.noname-a con 0x7f3d54073720 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:12:02.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.847+0000 7f3d59424640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f3d54152680 0x7f3d541f7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:02.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.847+0000 7f3d59424640 10 monclient(hunting): picked mon.noname-b con 0x7f3d54152680 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:12:02.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.847+0000 7f3d59424640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f3d54152a60 0x7f3d541591e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:02.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.847+0000 7f3d59424640 10 monclient(hunting): picked mon.noname-c con 0x7f3d54152a60 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:12:02.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.847+0000 7f3d59424640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:02.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.847+0000 7f3d59424640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f3d540c9430 con 0x7f3d54073720 2026-02-17T11:12:02.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.847+0000 7f3d59424640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:02.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.847+0000 7f3d59424640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f3d540c9150 con 0x7f3d54152680 2026-02-17T11:12:02.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.847+0000 7f3d59424640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:02.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.847+0000 7f3d59424640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f3d5415d2c0 con 0x7f3d54152a60 2026-02-17T11:12:02.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.847+0000 7f3d59424640 10 monclient(hunting): _renew_subs 2026-02-17T11:12:02.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.847+0000 7f3d59424640 10 monclient(hunting): authenticate will time out at 1199.510899s 2026-02-17T11:12:02.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.848+0000 7f3d52ffd640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f3d54073720 0x7f3d541f45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:02.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.848+0000 7f3d537fe640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f3d54152a60 0x7f3d541591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:02.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.848+0000 7f3d52ffd640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f3d54073720 0x7f3d541f45b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:33294/0 (socket says 10.20.193.49:33294) 2026-02-17T11:12:02.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.848+0000 7f3d52ffd640 1 -- 10.20.193.49:0/1845685655 learned_addr learned my addr 10.20.193.49:0/1845685655 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:12:02.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.848+0000 7f3d52ffd640 10 monclient(hunting): get_auth_request con 0x7f3d54073720 auth_method 0 2026-02-17T11:12:02.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.848+0000 7f3d52ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:02.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.848+0000 7f3d52ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:02.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.848+0000 7f3d52ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:02.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.848+0000 7f3d527fc640 1 --2- 10.20.193.49:0/1845685655 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f3d54152680 0x7f3d541f7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:02.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.848+0000 7f3d52ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:02.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.848+0000 7f3d52ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:02.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.848+0000 7f3d52ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:02.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.848+0000 7f3d537fe640 10 monclient(hunting): get_auth_request con 0x7f3d54152a60 auth_method 0 2026-02-17T11:12:02.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.848+0000 7f3d537fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:02.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.848+0000 7f3d537fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:02.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.848+0000 7f3d537fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:02.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.848+0000 7f3d527fc640 10 monclient(hunting): get_auth_request con 0x7f3d54152680 auth_method 0 2026-02-17T11:12:02.860 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.848+0000 7f3d527fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:02.860 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.848+0000 7f3d527fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:02.860 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.848+0000 7f3d527fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:02.860 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.848+0000 7f3d537fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:02.860 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.848+0000 7f3d537fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:02.860 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.848+0000 7f3d537fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:02.860 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.848+0000 7f3d527fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:02.860 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.848+0000 7f3d527fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:02.860 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.848+0000 7f3d527fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:02.860 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.850+0000 7f3d52ffd640 10 monclient(hunting): handle_auth_done global_id 4779 payload 824 2026-02-17T11:12:02.861 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.850+0000 7f3d52ffd640 1 -- 10.20.193.49:0/1845685655 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f3d54152a60 msgr2=0x7f3d541591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:02.861 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.850+0000 7f3d52ffd640 1 --2- 10.20.193.49:0/1845685655 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f3d54152a60 0x7f3d541591e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:02.861 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.850+0000 7f3d52ffd640 1 -- 10.20.193.49:0/1845685655 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f3d54152680 msgr2=0x7f3d541f7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:02.861 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.850+0000 7f3d52ffd640 1 --2- 10.20.193.49:0/1845685655 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f3d54152680 0x7f3d541f7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:02.861 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.850+0000 7f3d52ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:12:02.861 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.850+0000 7f3d52ffd640 1 monclient: found mon.noname-a 2026-02-17T11:12:02.861 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.850+0000 7f3d52ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:12:02.861 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.850+0000 7f3d52ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:12:02.861 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.850+0000 7f3d52ffd640 1 -- 10.20.193.49:0/1845685655 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d541f7570 con 0x7f3d54073720 2026-02-17T11:12:02.863 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.851+0000 7f3d52ffd640 1 --2- 10.20.193.49:0/1845685655 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f3d54073720 0x7f3d541f45b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3d48009130 tx=0x7f3d480047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:12:02.863 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.851+0000 7f3d337fe640 10 client.?.objecter ms_handle_connect 0x7f3d54073720 2026-02-17T11:12:02.863 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.851+0000 7f3d337fe640 10 client.?.objecter resend_mon_ops 2026-02-17T11:12:02.864 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.853+0000 7f3d337fe640 1 -- 10.20.193.49:0/1845685655 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4803c040 con 0x7f3d54073720 2026-02-17T11:12:02.864 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.853+0000 7f3d337fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:02.864 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.853+0000 7f3d337fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:12:02.864 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.853+0000 7f3d337fe640 10 monclient: dump: 2026-02-17T11:12:02.864 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:02.864 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:02.864 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:02.864 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:02.864 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:02.864 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:02.864 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:02.865 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:02.865 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:02.865 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:02.865 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.853+0000 7f3d337fe640 10 monclient: _finish_auth 0 2026-02-17T11:12:02.865 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.853+0000 7f3d337fe640 10 monclient: _check_auth_tickets 2026-02-17T11:12:02.865 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.853+0000 7f3d337fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:12:02.865 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.853+0000 7f3d337fe640 1 -- 10.20.193.49:0/1845685655 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d48042630 con 0x7f3d54073720 2026-02-17T11:12:02.865 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.853+0000 7f3d337fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:12:02.865 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.853+0000 7f3d337fe640 1 -- 10.20.193.49:0/1845685655 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d48042a20 con 0x7f3d54073720 2026-02-17T11:12:02.865 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.853+0000 7f3d337fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:02.865 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.853+0000 7f3d337fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:12:02.865 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.853+0000 7f3d337fe640 10 monclient: dump: 2026-02-17T11:12:02.866 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:02.866 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:02.866 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:02.866 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:02.866 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:02.866 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:02.866 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:02.866 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:02.866 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:02.866 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:02.866 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.853+0000 7f3d517fa640 4 set_mon_vals no callback set 2026-02-17T11:12:02.866 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.853+0000 7f3d59424640 5 monclient: authenticate success, global_id 4779 2026-02-17T11:12:02.867 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.853+0000 7f3d59424640 10 monclient: _renew_subs 2026-02-17T11:12:02.867 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.853+0000 7f3d59424640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:12:02.867 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.853+0000 7f3d59424640 1 -- 10.20.193.49:0/1845685655 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d541f7840 con 0x7f3d54073720 2026-02-17T11:12:02.867 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.853+0000 7f3d59424640 10 client.4779.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:12:02.867 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.853+0000 7f3d59424640 10 monclient: _renew_subs 2026-02-17T11:12:02.867 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.853+0000 7f3d59424640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:12:02.867 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.853+0000 7f3d59424640 1 -- 10.20.193.49:0/1845685655 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d541f7e00 con 0x7f3d54073720 2026-02-17T11:12:02.867 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.853+0000 7f3d59424640 1 librados: init done 2026-02-17T11:12:02.867 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.853+0000 7f3d59424640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:12:02.867 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.853+0000 7f3d59424640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:12:02.867 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.853+0000 7f3d59424640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:12:02.867 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.853+0000 7f3d59424640 1 -- 10.20.193.49:0/1845685655 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d54073e10 con 0x7f3d54073720 2026-02-17T11:12:02.869 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.865+0000 7f3d337fe640 1 -- 10.20.193.49:0/1845685655 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f3d4804b450 con 0x7f3d54073720 2026-02-17T11:12:02.869 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.865+0000 7f3d337fe640 1 --2- 10.20.193.49:0/1845685655 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3d20079190 0x7f3d2007b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:02.869 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.866+0000 7f3d527fc640 1 --2- 10.20.193.49:0/1845685655 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3d20079190 0x7f3d2007b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:02.869 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.866+0000 7f3d527fc640 10 monclient: get_auth_request con 0x7f3d20079190 auth_method 0 2026-02-17T11:12:02.869 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.866+0000 7f3d337fe640 10 client.4779.objecter ms_handle_connect 0x7f3d20079190 2026-02-17T11:12:02.869 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.866+0000 7f3d527fc640 1 --2- 10.20.193.49:0/1845685655 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3d20079190 0x7f3d2007b650 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3d5414e610 tx=0x7f3d3c007ef0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:12:02.870 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.867+0000 7f3d337fe640 1 -- 10.20.193.49:0/1845685655 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f3d4802fb50 con 0x7f3d54073720 2026-02-17T11:12:02.870 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.867+0000 7f3d337fe640 10 client.4779.objecter ms_dispatch2 0x7f3d54000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:12:02.870 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.867+0000 7f3d337fe640 3 client.4779.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:12:02.870 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.867+0000 7f3d337fe640 3 client.4779.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:12:02.870 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.867+0000 7f3d337fe640 20 client.4779.objecter dump_active .. 0 homeless 2026-02-17T11:12:02.971 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.970+0000 7f3d337fe640 1 -- 10.20.193.49:0/1845685655 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f3d48086a40 con 0x7f3d54073720 2026-02-17T11:12:02.972 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.970+0000 7f3d337fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:12:02.972 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:02.970+0000 7f3d337fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:12:03.071 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:03.069+0000 7f3d59424640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:12:03.071 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:03.069+0000 7f3d59424640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:12:03.071 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:03.069+0000 7f3d59424640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:12:03.071 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:03.069+0000 7f3d59424640 1 -- 10.20.193.49:0/1845685655 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f3d54070590 con 0x7f3d54073720 2026-02-17T11:12:03.073 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:03.071+0000 7f3d337fe640 1 -- 10.20.193.49:0/1845685655 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f3d4808ad40 con 0x7f3d54073720 2026-02-17T11:12:03.073 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:03.071+0000 7f3d337fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:12:03.073 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:03.071+0000 7f3d337fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:12:03.073 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:12:03.073 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:12:03.075 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:03.072+0000 7f3d59424640 10 librados: watch_flush enter 2026-02-17T11:12:03.075 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:03.072+0000 7f3d59424640 10 librados: watch_flush exit 2026-02-17T11:12:03.075 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:03.072+0000 7f3d59424640 20 client.4779.objecter shutdown clearing up homeless session... 2026-02-17T11:12:03.075 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:03.072+0000 7f3d59424640 10 client.4779.objecter successfully canceled tick 2026-02-17T11:12:03.075 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:03.072+0000 7f3d59424640 1 -- 10.20.193.49:0/1845685655 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3d20079190 msgr2=0x7f3d2007b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:03.076 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:03.072+0000 7f3d59424640 1 --2- 10.20.193.49:0/1845685655 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3d20079190 0x7f3d2007b650 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3d5414e610 tx=0x7f3d3c007ef0 comp rx=0 tx=0).stop 2026-02-17T11:12:03.076 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:03.072+0000 7f3d59424640 10 monclient: shutdown 2026-02-17T11:12:03.076 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:03.072+0000 7f3d59424640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:12:03.076 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:03.072+0000 7f3d59424640 1 -- 10.20.193.49:0/1845685655 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f3d54073720 msgr2=0x7f3d541f45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:03.076 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:03.072+0000 7f3d59424640 1 --2- 10.20.193.49:0/1845685655 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f3d54073720 0x7f3d541f45b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3d48009130 tx=0x7f3d480047c0 comp rx=0 tx=0).stop 2026-02-17T11:12:03.076 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:03.072+0000 7f3d59424640 1 -- 10.20.193.49:0/1845685655 shutdown_connections 2026-02-17T11:12:03.076 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:03.072+0000 7f3d59424640 1 --2- 10.20.193.49:0/1845685655 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3d20079190 0x7f3d2007b650 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:03.076 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:03.072+0000 7f3d59424640 1 --2- 10.20.193.49:0/1845685655 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f3d54152a60 0x7f3d541591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:03.076 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:03.072+0000 7f3d59424640 1 --2- 10.20.193.49:0/1845685655 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f3d54152680 0x7f3d541f7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:03.076 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:03.072+0000 7f3d59424640 1 --2- 10.20.193.49:0/1845685655 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f3d54073720 0x7f3d541f45b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:03.076 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:03.072+0000 7f3d59424640 1 -- 10.20.193.49:0/1845685655 >> 10.20.193.49:0/1845685655 conn(0x7f3d540ca740 msgr2=0x7f3d540cab20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:12:03.076 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:03.072+0000 7f3d59424640 1 -- 10.20.193.49:0/1845685655 shutdown_connections 2026-02-17T11:12:03.077 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:03.072+0000 7f3d59424640 1 -- 10.20.193.49:0/1845685655 wait complete. 2026-02-17T11:12:03.077 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:03.072+0000 7f3d59424640 1 librados: shutdown 2026-02-17T11:12:06.084 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:12:06.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.151+0000 7f8269f96640 10 monclient: get_monmap_and_config 2026-02-17T11:12:06.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.151+0000 7f8269f96640 10 monclient: build_initial_monmap 2026-02-17T11:12:06.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.151+0000 7f8269f96640 10 monclient: monmap: 2026-02-17T11:12:06.153 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:12:06.153 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:06.154 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:12:06.151912+0000 2026-02-17T11:12:06.154 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:12:06.151912+0000 2026-02-17T11:12:06.154 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:12:06.154 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:06.154 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:12:06.154 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:12:06.154 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:12:06.154 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:12:06.154 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:12:06.154 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:12:06.154 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:06.155 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.151+0000 7f8269f96640 1 Processor -- start 2026-02-17T11:12:06.155 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.151+0000 7f8269f96640 1 -- start start 2026-02-17T11:12:06.155 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.151+0000 7f8269f96640 10 monclient: init 2026-02-17T11:12:06.157 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.152+0000 7f8269f96640 10 monclient: _reopen_session rank -1 2026-02-17T11:12:06.157 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.152+0000 7f8269f96640 10 monclient: _add_conns ranks=[0,2,5,1,4,3] 2026-02-17T11:12:06.157 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.152+0000 7f8269f96640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f82640c7170 addr v1:10.20.193.49:6789/0 2026-02-17T11:12:06.158 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.152+0000 7f8269f96640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f82640c7550 addr v1:10.20.193.157:6789/0 2026-02-17T11:12:06.158 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.152+0000 7f8269f96640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f82640c89c0 0x7f82640c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:06.158 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.152+0000 7f8269f96640 10 monclient(hunting): picked mon.noname-c con 0x7f82640c89c0 addr v2:10.20.193.157:3300/0 2026-02-17T11:12:06.158 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.152+0000 7f8269f96640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82640c4fd0 con 0x7f82640c7170 2026-02-17T11:12:06.158 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.152+0000 7f8269f96640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f826415a9a0 con 0x7f82640c7550 2026-02-17T11:12:06.158 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.152+0000 7f8269f96640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:06.158 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.152+0000 7f8269f96640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f82640c8530 con 0x7f82640c89c0 2026-02-17T11:12:06.158 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.152+0000 7f8269f96640 10 monclient(hunting): _renew_subs 2026-02-17T11:12:06.158 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.152+0000 7f8269f96640 10 monclient(hunting): authenticate will time out at 1202.815494s 2026-02-17T11:12:06.158 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.152+0000 7f82637fe640 1 --1- >> v1:10.20.193.49:6789/0 conn(0x7f82640c7170 0x7f82640c48c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.49:6789/0 says I am v1:10.20.193.49:40406/0 (socket says 10.20.193.49:40406) 2026-02-17T11:12:06.158 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.152+0000 7f82637fe640 1 -- 10.20.193.49:0/231323957 learned_addr learned my addr 10.20.193.49:0/231323957 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:12:06.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.153+0000 7f8263fff640 1 --2- 10.20.193.49:0/231323957 >> v2:10.20.193.157:3300/0 conn(0x7f82640c89c0 0x7f82640c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:06.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.153+0000 7f8263fff640 10 monclient(hunting): get_auth_request con 0x7f82640c89c0 auth_method 0 2026-02-17T11:12:06.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.153+0000 7f8263fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:06.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.153+0000 7f8263fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:06.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.153+0000 7f8263fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:06.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.153+0000 7f8263fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:06.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.153+0000 7f8263fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:06.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.154+0000 7f8263fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:06.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.154+0000 7f82627fc640 1 -- 10.20.193.49:0/231323957 <== mon.0 v1:10.20.193.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 464178701 0 0) 0x7f82640c4fd0 con 0x7f82640c7170 2026-02-17T11:12:06.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.154+0000 7f82627fc640 10 monclient(hunting): _negotiate 2026-02-17T11:12:06.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.154+0000 7f82627fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:06.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.154+0000 7f82627fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:06.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.154+0000 7f82627fc640 10 monclient(hunting): my global_id is 4782 2026-02-17T11:12:06.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.154+0000 7f82627fc640 1 -- 10.20.193.49:0/231323957 --> v1:10.20.193.49:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8248003620 con 0x7f82640c7170 2026-02-17T11:12:06.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.155+0000 7f8263fff640 10 monclient(hunting): handle_auth_done global_id 4772 payload 274 2026-02-17T11:12:06.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.155+0000 7f8263fff640 1 -- 10.20.193.49:0/231323957 >> v1:10.20.193.157:6789/0 conn(0x7f82640c7550 legacy=0x7f82640749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:06.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.155+0000 7f8263fff640 1 -- 10.20.193.49:0/231323957 >> v1:10.20.193.49:6789/0 conn(0x7f82640c7170 legacy=0x7f82640c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:06.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.155+0000 7f8263fff640 10 monclient: _finish_hunting 0 2026-02-17T11:12:06.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.155+0000 7f8263fff640 1 monclient: found mon.noname-c 2026-02-17T11:12:06.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.155+0000 7f8263fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:12:06.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.155+0000 7f8263fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:12:06.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.155+0000 7f8263fff640 1 -- 10.20.193.49:0/231323957 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82640c5270 con 0x7f82640c89c0 2026-02-17T11:12:06.165 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.157+0000 7f8263fff640 1 --2- 10.20.193.49:0/231323957 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f82640c89c0 0x7f82640c8e70 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8258009d90 tx=0x7f825802f230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e2f28f4bb984af8 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:12:06.165 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.158+0000 7f82627fc640 1 -- 10.20.193.49:0/231323957 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f825803c070 con 0x7f82640c89c0 2026-02-17T11:12:06.166 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.158+0000 7f82627fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:06.166 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.158+0000 7f82627fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:12:06.166 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.158+0000 7f82627fc640 10 monclient: dump: 2026-02-17T11:12:06.166 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:06.166 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:06.166 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:06.166 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:06.166 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:06.166 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:06.166 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:06.166 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:06.167 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:06.167 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:06.167 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.158+0000 7f82627fc640 10 monclient: _finish_auth 0 2026-02-17T11:12:06.167 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.158+0000 7f82627fc640 10 monclient: _check_auth_tickets 2026-02-17T11:12:06.167 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.158+0000 7f82627fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:12:06.167 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.158+0000 7f82627fc640 1 -- 10.20.193.49:0/231323957 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8258037440 con 0x7f82640c89c0 2026-02-17T11:12:06.167 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.158+0000 7f82627fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:12:06.167 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.158+0000 7f8269f96640 5 monclient: authenticate success, global_id 4772 2026-02-17T11:12:06.167 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.158+0000 7f82627fc640 1 -- 10.20.193.49:0/231323957 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8258037810 con 0x7f82640c89c0 2026-02-17T11:12:06.167 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.158+0000 7f8269f96640 10 monclient: get_monmap_and_config success 2026-02-17T11:12:06.167 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.158+0000 7f8269f96640 4 set_mon_vals no callback set 2026-02-17T11:12:06.167 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.158+0000 7f82627fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:06.168 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.158+0000 7f82627fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:12:06.168 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.158+0000 7f82627fc640 10 monclient: dump: 2026-02-17T11:12:06.168 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:06.168 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:06.168 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:06.168 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:06.168 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:06.168 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:06.168 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:06.168 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:06.168 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:06.168 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:06.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.159+0000 7f8269f96640 10 monclient: shutdown 2026-02-17T11:12:06.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.159+0000 7f8269f96640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:12:06.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.159+0000 7f8269f96640 1 -- 10.20.193.49:0/231323957 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f82640c89c0 msgr2=0x7f82640c8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:06.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.159+0000 7f8269f96640 1 --2- 10.20.193.49:0/231323957 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f82640c89c0 0x7f82640c8e70 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8258009d90 tx=0x7f825802f230 comp rx=0 tx=0).stop 2026-02-17T11:12:06.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.159+0000 7f8269f96640 1 -- 10.20.193.49:0/231323957 shutdown_connections 2026-02-17T11:12:06.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.159+0000 7f8269f96640 1 --2- 10.20.193.49:0/231323957 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f82640c89c0 0x7f82640c8e70 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:06.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.159+0000 7f8269f96640 1 -- 10.20.193.49:0/231323957 >> 10.20.193.49:0/231323957 conn(0x7f82640c9f40 msgr2=0x7f82640ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:12:06.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.159+0000 7f8269f96640 1 -- 10.20.193.49:0/231323957 shutdown_connections 2026-02-17T11:12:06.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.159+0000 7f8269f96640 1 -- 10.20.193.49:0/231323957 wait complete. 2026-02-17T11:12:06.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.160+0000 7f8269f96640 10 monclient: build_initial_monmap 2026-02-17T11:12:06.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.160+0000 7f8269f96640 10 monclient: monmap: 2026-02-17T11:12:06.169 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:12:06.170 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:12:06.170 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:12:06.170 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:12:06.170 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:12:06.170 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:06.170 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:12:06.170 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:12:06.170 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:12:06.170 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:06.170 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.160+0000 7f8269f96640 1 librados: starting msgr at 2026-02-17T11:12:06.170 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.160+0000 7f8269f96640 1 librados: starting objecter 2026-02-17T11:12:06.170 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.160+0000 7f8269f96640 1 Processor -- start 2026-02-17T11:12:06.170 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.160+0000 7f8269f96640 1 -- start start 2026-02-17T11:12:06.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.160+0000 7f8269f96640 1 librados: setting wanted keys 2026-02-17T11:12:06.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.160+0000 7f8269f96640 1 librados: calling monclient init 2026-02-17T11:12:06.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.160+0000 7f8269f96640 10 monclient: init 2026-02-17T11:12:06.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.160+0000 7f8269f96640 10 monclient: _reopen_session rank -1 2026-02-17T11:12:06.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.160+0000 7f8269f96640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:12:06.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.160+0000 7f8269f96640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f82640c7170 0x7f82640c3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:06.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.160+0000 7f8269f96640 10 monclient(hunting): picked mon.noname-c con 0x7f82640c7170 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:12:06.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.160+0000 7f8269f96640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f82640c7550 0x7f826414d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:06.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.160+0000 7f8269f96640 10 monclient(hunting): picked mon.noname-a con 0x7f82640c7550 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:12:06.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.160+0000 7f8269f96640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f82640c89c0 0x7f82641f4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:06.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.160+0000 7f8269f96640 10 monclient(hunting): picked mon.noname-b con 0x7f82640c89c0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:12:06.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.160+0000 7f8269f96640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:06.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.160+0000 7f8269f96640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f82640c5830 con 0x7f82640c7550 2026-02-17T11:12:06.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.160+0000 7f8269f96640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:06.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.160+0000 7f8269f96640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f82640c93b0 con 0x7f82640c89c0 2026-02-17T11:12:06.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.160+0000 7f8269f96640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:06.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.160+0000 7f8269f96640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f82640c7ee0 con 0x7f82640c7170 2026-02-17T11:12:06.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.160+0000 7f8269f96640 10 monclient(hunting): _renew_subs 2026-02-17T11:12:06.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.160+0000 7f8269f96640 10 monclient(hunting): authenticate will time out at 1202.823829s 2026-02-17T11:12:06.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.161+0000 7f8262ffd640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f82640c7550 0x7f826414d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:06.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.161+0000 7f82637fe640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f82640c7170 0x7f82640c3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:06.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.161+0000 7f8263fff640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f82640c89c0 0x7f82641f4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:06.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.161+0000 7f8262ffd640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f82640c7550 0x7f826414d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:49088/0 (socket says 10.20.193.49:49088) 2026-02-17T11:12:06.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.161+0000 7f8262ffd640 1 -- 10.20.193.49:0/1065181091 learned_addr learned my addr 10.20.193.49:0/1065181091 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:12:06.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.161+0000 7f8262ffd640 10 monclient(hunting): get_auth_request con 0x7f82640c7550 auth_method 0 2026-02-17T11:12:06.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.161+0000 7f8262ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:06.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.161+0000 7f8262ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:06.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.161+0000 7f8262ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:06.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.161+0000 7f82637fe640 10 monclient(hunting): get_auth_request con 0x7f82640c7170 auth_method 0 2026-02-17T11:12:06.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.161+0000 7f82637fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:06.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.161+0000 7f82637fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:06.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.161+0000 7f82637fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:06.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.161+0000 7f8263fff640 10 monclient(hunting): get_auth_request con 0x7f82640c89c0 auth_method 0 2026-02-17T11:12:06.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.161+0000 7f8263fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:06.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.161+0000 7f8263fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:06.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.161+0000 7f8263fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:06.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.161+0000 7f82637fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:06.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.161+0000 7f82637fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:06.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.161+0000 7f82637fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:06.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.161+0000 7f8262ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:06.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.161+0000 7f8262ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:06.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.161+0000 7f8262ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:06.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.161+0000 7f8263fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:06.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.161+0000 7f8263fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:06.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.161+0000 7f8263fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:06.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.162+0000 7f82637fe640 10 monclient(hunting): handle_auth_done global_id 4778 payload 824 2026-02-17T11:12:06.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.162+0000 7f82637fe640 1 -- 10.20.193.49:0/1065181091 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f82640c89c0 msgr2=0x7f82641f4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:06.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.162+0000 7f82637fe640 1 --2- 10.20.193.49:0/1065181091 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f82640c89c0 0x7f82641f4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:06.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.162+0000 7f82637fe640 1 -- 10.20.193.49:0/1065181091 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f82640c7550 msgr2=0x7f826414d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:06.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.162+0000 7f82637fe640 1 --2- 10.20.193.49:0/1065181091 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f82640c7550 0x7f826414d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:06.175 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.162+0000 7f82637fe640 10 monclient: _finish_hunting 0 2026-02-17T11:12:06.175 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.162+0000 7f82637fe640 1 monclient: found mon.noname-c 2026-02-17T11:12:06.175 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.162+0000 7f82637fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:12:06.175 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.162+0000 7f82637fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:12:06.175 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.162+0000 7f82637fe640 1 -- 10.20.193.49:0/1065181091 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82640c1200 con 0x7f82640c7170 2026-02-17T11:12:06.175 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.164+0000 7f82637fe640 1 --2- 10.20.193.49:0/1065181091 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f82640c7170 0x7f82640c3f90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f825000c430 tx=0x7f825000c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:12:06.175 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.164+0000 7f823ffff640 10 client.?.objecter ms_handle_connect 0x7f82640c7170 2026-02-17T11:12:06.175 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.164+0000 7f823ffff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:12:06.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.165+0000 7f823ffff640 1 -- 10.20.193.49:0/1065181091 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8250017070 con 0x7f82640c7170 2026-02-17T11:12:06.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.165+0000 7f823ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:06.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.165+0000 7f823ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:12:06.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.165+0000 7f823ffff640 10 monclient: dump: 2026-02-17T11:12:06.177 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:06.178 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:06.178 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:06.178 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:06.178 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:06.178 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:06.178 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:06.178 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:06.178 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:06.178 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:06.178 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.165+0000 7f823ffff640 10 monclient: _finish_auth 0 2026-02-17T11:12:06.178 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.165+0000 7f823ffff640 10 monclient: _check_auth_tickets 2026-02-17T11:12:06.178 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.165+0000 7f823ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:12:06.179 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.165+0000 7f8269f96640 5 monclient: authenticate success, global_id 4778 2026-02-17T11:12:06.179 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.165+0000 7f8269f96640 10 monclient: _renew_subs 2026-02-17T11:12:06.179 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.165+0000 7f8269f96640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:12:06.179 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.165+0000 7f8269f96640 1 -- 10.20.193.49:0/1065181091 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82640c14e0 con 0x7f82640c7170 2026-02-17T11:12:06.179 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.165+0000 7f8269f96640 10 client.4778.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:12:06.179 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.165+0000 7f8269f96640 10 monclient: _renew_subs 2026-02-17T11:12:06.179 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.165+0000 7f8269f96640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:12:06.179 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.165+0000 7f8269f96640 1 -- 10.20.193.49:0/1065181091 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82640c1aa0 con 0x7f82640c7170 2026-02-17T11:12:06.179 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.165+0000 7f8269f96640 1 librados: init done 2026-02-17T11:12:06.179 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.165+0000 7f823ffff640 1 -- 10.20.193.49:0/1065181091 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8250005de0 con 0x7f82640c7170 2026-02-17T11:12:06.179 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.165+0000 7f823ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:12:06.179 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.165+0000 7f823ffff640 1 -- 10.20.193.49:0/1065181091 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8250021060 con 0x7f82640c7170 2026-02-17T11:12:06.180 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.165+0000 7f823ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:06.180 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.165+0000 7f823ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:12:06.180 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.165+0000 7f823ffff640 10 monclient: dump: 2026-02-17T11:12:06.180 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:06.180 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:06.180 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:06.180 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:06.180 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:06.180 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:06.180 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:06.180 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:06.180 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:06.180 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:06.181 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.165+0000 7f8261ffb640 4 set_mon_vals no callback set 2026-02-17T11:12:06.181 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.165+0000 7f8269f96640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:12:06.181 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.166+0000 7f8269f96640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:12:06.181 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.166+0000 7f8269f96640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:12:06.181 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.166+0000 7f8269f96640 1 -- 10.20.193.49:0/1065181091 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82640c81c0 con 0x7f82640c7170 2026-02-17T11:12:06.182 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.177+0000 7f823ffff640 1 -- 10.20.193.49:0/1065181091 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f8250024080 con 0x7f82640c7170 2026-02-17T11:12:06.182 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.178+0000 7f823ffff640 1 --2- 10.20.193.49:0/1065181091 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f8234079170 0x7f823407b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:06.182 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.178+0000 7f8262ffd640 1 --2- 10.20.193.49:0/1065181091 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f8234079170 0x7f823407b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:06.182 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.178+0000 7f8262ffd640 10 monclient: get_auth_request con 0x7f8234079170 auth_method 0 2026-02-17T11:12:06.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.179+0000 7f8262ffd640 1 --2- 10.20.193.49:0/1065181091 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f8234079170 0x7f823407b630 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f82640c9160 tx=0x7f8254002a30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:12:06.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.179+0000 7f823ffff640 10 client.4778.objecter ms_handle_connect 0x7f8234079170 2026-02-17T11:12:06.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.180+0000 7f823ffff640 1 -- 10.20.193.49:0/1065181091 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f825005d610 con 0x7f82640c7170 2026-02-17T11:12:06.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.180+0000 7f823ffff640 10 client.4778.objecter ms_dispatch2 0x7f8264000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:12:06.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.180+0000 7f823ffff640 3 client.4778.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:12:06.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.180+0000 7f823ffff640 3 client.4778.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:12:06.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.180+0000 7f823ffff640 20 client.4778.objecter dump_active .. 0 homeless 2026-02-17T11:12:06.283 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.282+0000 7f823ffff640 1 -- 10.20.193.49:0/1065181091 <== mon.2 v2:10.20.193.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f82500615d0 con 0x7f82640c7170 2026-02-17T11:12:06.283 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.282+0000 7f823ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:12:06.283 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.282+0000 7f823ffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:12:06.383 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.381+0000 7f8269f96640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:12:06.383 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.381+0000 7f8269f96640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:12:06.383 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.381+0000 7f8269f96640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:12:06.383 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.381+0000 7f8269f96640 1 -- 10.20.193.49:0/1065181091 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f82640c9190 con 0x7f82640c7170 2026-02-17T11:12:06.385 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.384+0000 7f823ffff640 1 -- 10.20.193.49:0/1065181091 <== mon.2 v2:10.20.193.157:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f82500658d0 con 0x7f82640c7170 2026-02-17T11:12:06.385 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.384+0000 7f823ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:12:06.385 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.384+0000 7f823ffff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:12:06.385 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:12:06.385 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:12:06.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.385+0000 7f8269f96640 10 librados: watch_flush enter 2026-02-17T11:12:06.387 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.385+0000 7f8269f96640 10 librados: watch_flush exit 2026-02-17T11:12:06.387 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.385+0000 7f8269f96640 20 client.4778.objecter shutdown clearing up homeless session... 2026-02-17T11:12:06.387 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.385+0000 7f8269f96640 10 client.4778.objecter successfully canceled tick 2026-02-17T11:12:06.387 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.385+0000 7f8269f96640 1 -- 10.20.193.49:0/1065181091 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f8234079170 msgr2=0x7f823407b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:06.387 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.385+0000 7f8269f96640 1 --2- 10.20.193.49:0/1065181091 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f8234079170 0x7f823407b630 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f82640c9160 tx=0x7f8254002a30 comp rx=0 tx=0).stop 2026-02-17T11:12:06.387 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.385+0000 7f8269f96640 10 monclient: shutdown 2026-02-17T11:12:06.387 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.385+0000 7f8269f96640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:12:06.387 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.385+0000 7f8269f96640 1 -- 10.20.193.49:0/1065181091 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f82640c7170 msgr2=0x7f82640c3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:06.387 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.385+0000 7f8269f96640 1 --2- 10.20.193.49:0/1065181091 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f82640c7170 0x7f82640c3f90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f825000c430 tx=0x7f825000c900 comp rx=0 tx=0).stop 2026-02-17T11:12:06.387 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.385+0000 7f8269f96640 1 -- 10.20.193.49:0/1065181091 shutdown_connections 2026-02-17T11:12:06.387 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.385+0000 7f8269f96640 1 --2- 10.20.193.49:0/1065181091 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f8234079170 0x7f823407b630 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:06.387 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.385+0000 7f8269f96640 1 --2- 10.20.193.49:0/1065181091 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f82640c89c0 0x7f82641f4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:06.387 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.385+0000 7f8269f96640 1 --2- 10.20.193.49:0/1065181091 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f82640c7550 0x7f826414d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:06.387 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.385+0000 7f8269f96640 1 --2- 10.20.193.49:0/1065181091 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f82640c7170 0x7f82640c3f90 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:06.387 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.385+0000 7f8269f96640 1 -- 10.20.193.49:0/1065181091 >> 10.20.193.49:0/1065181091 conn(0x7f82640c9f40 msgr2=0x7f82640725d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:12:06.387 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.385+0000 7f8269f96640 1 -- 10.20.193.49:0/1065181091 shutdown_connections 2026-02-17T11:12:06.387 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.385+0000 7f8269f96640 1 -- 10.20.193.49:0/1065181091 wait complete. 2026-02-17T11:12:06.387 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:06.385+0000 7f8269f96640 1 librados: shutdown 2026-02-17T11:12:09.396 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:12:09.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.463+0000 7fc09164d640 10 monclient: get_monmap_and_config 2026-02-17T11:12:09.469 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.463+0000 7fc09164d640 10 monclient: build_initial_monmap 2026-02-17T11:12:09.469 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.463+0000 7fc09164d640 10 monclient: monmap: 2026-02-17T11:12:09.469 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:12:09.469 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:09.469 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:12:09.465056+0000 2026-02-17T11:12:09.469 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:12:09.465056+0000 2026-02-17T11:12:09.469 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:12:09.469 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:09.470 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:12:09.470 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:12:09.470 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:12:09.470 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:12:09.470 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:12:09.470 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:12:09.470 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:09.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.464+0000 7fc09164d640 1 Processor -- start 2026-02-17T11:12:09.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.464+0000 7fc09164d640 1 -- start start 2026-02-17T11:12:09.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.464+0000 7fc09164d640 10 monclient: init 2026-02-17T11:12:09.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.464+0000 7fc09164d640 10 monclient: _reopen_session rank -1 2026-02-17T11:12:09.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.464+0000 7fc09164d640 10 monclient: _add_conns ranks=[3,2,0,5,1,4] 2026-02-17T11:12:09.471 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.464+0000 7fc09164d640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fc08c0c7170 0x7fc08c0c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:09.471 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.464+0000 7fc09164d640 10 monclient(hunting): picked mon.noname-a con 0x7fc08c0c7170 addr v2:10.20.193.49:3300/0 2026-02-17T11:12:09.471 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.464+0000 7fc09164d640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fc08c0c48c0 addr v1:10.20.193.157:6789/0 2026-02-17T11:12:09.471 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.464+0000 7fc09164d640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc08c0c4d10 addr v1:10.20.193.49:6789/0 2026-02-17T11:12:09.471 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.464+0000 7fc09164d640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc08c15a9a0 con 0x7fc08c0c4d10 2026-02-17T11:12:09.471 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.464+0000 7fc09164d640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc08c0c5270 con 0x7fc08c0c48c0 2026-02-17T11:12:09.471 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.464+0000 7fc09164d640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:09.471 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.464+0000 7fc09164d640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7fc08c0c8530 con 0x7fc08c0c7170 2026-02-17T11:12:09.471 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.464+0000 7fc09164d640 10 monclient(hunting): _renew_subs 2026-02-17T11:12:09.471 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.464+0000 7fc09164d640 10 monclient(hunting): authenticate will time out at 1206.128625s 2026-02-17T11:12:09.471 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.465+0000 7fc08affd640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fc08c0c7170 0x7fc08c0c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:09.471 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.465+0000 7fc08a7fc640 1 --1- >> v1:10.20.193.157:6789/0 conn(0x7fc08c0c48c0 0x7fc08c0749b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.157:6789/0 says I am v1:10.20.193.49:54116/0 (socket says 10.20.193.49:54116) 2026-02-17T11:12:09.472 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.465+0000 7fc08a7fc640 1 -- 10.20.193.49:0/3175771531 learned_addr learned my addr 10.20.193.49:0/3175771531 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:12:09.472 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.465+0000 7fc08affd640 10 monclient(hunting): get_auth_request con 0x7fc08c0c7170 auth_method 0 2026-02-17T11:12:09.472 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.465+0000 7fc08affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:09.472 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.465+0000 7fc08affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:09.472 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.465+0000 7fc08affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:09.472 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.466+0000 7fc08affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:09.472 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.466+0000 7fc08affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:09.472 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.466+0000 7fc08affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:09.478 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.466+0000 7fc089ffb640 1 -- 10.20.193.49:0/3175771531 <== mon.2 v1:10.20.193.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3501315601 0 0) 0x7fc08c0c5270 con 0x7fc08c0c48c0 2026-02-17T11:12:09.479 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.466+0000 7fc089ffb640 10 monclient(hunting): _negotiate 2026-02-17T11:12:09.479 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.466+0000 7fc089ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:09.479 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.466+0000 7fc089ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:09.479 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.466+0000 7fc089ffb640 10 monclient(hunting): my global_id is 4781 2026-02-17T11:12:09.479 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.466+0000 7fc089ffb640 1 -- 10.20.193.49:0/3175771531 --> v1:10.20.193.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc078003620 con 0x7fc08c0c48c0 2026-02-17T11:12:09.479 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.467+0000 7fc08affd640 10 monclient(hunting): handle_auth_done global_id 4788 payload 274 2026-02-17T11:12:09.479 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.467+0000 7fc08affd640 1 -- 10.20.193.49:0/3175771531 >> v1:10.20.193.157:6789/0 conn(0x7fc08c0c48c0 legacy=0x7fc08c0749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:09.479 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.467+0000 7fc08affd640 1 -- 10.20.193.49:0/3175771531 >> v1:10.20.193.49:6789/0 conn(0x7fc08c0c4d10 legacy=0x7fc08c0c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:09.480 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.467+0000 7fc08affd640 10 monclient: _finish_hunting 0 2026-02-17T11:12:09.480 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.467+0000 7fc08affd640 1 monclient: found mon.noname-a 2026-02-17T11:12:09.480 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.467+0000 7fc08affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:12:09.480 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.467+0000 7fc08affd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:12:09.480 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.467+0000 7fc08affd640 1 -- 10.20.193.49:0/3175771531 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc08c0c5550 con 0x7fc08c0c7170 2026-02-17T11:12:09.480 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.469+0000 7fc08affd640 1 --2- 10.20.193.49:0/3175771531 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc08c0c7170 0x7fc08c0c7550 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc0800098a0 tx=0x7fc08002ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53d0a99d011dbaf4 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:12:09.480 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.471+0000 7fc089ffb640 1 -- 10.20.193.49:0/3175771531 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc08003c070 con 0x7fc08c0c7170 2026-02-17T11:12:09.480 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.471+0000 7fc089ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:09.480 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.471+0000 7fc089ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:12:09.480 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.471+0000 7fc089ffb640 10 monclient: dump: 2026-02-17T11:12:09.480 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:09.481 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:09.481 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:09.481 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:09.481 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:09.481 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:09.481 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:09.481 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:09.481 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:09.481 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:09.481 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.471+0000 7fc089ffb640 10 monclient: _finish_auth 0 2026-02-17T11:12:09.481 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.471+0000 7fc089ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:12:09.481 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.471+0000 7fc089ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:12:09.482 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.471+0000 7fc089ffb640 1 -- 10.20.193.49:0/3175771531 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc08002fb70 con 0x7fc08c0c7170 2026-02-17T11:12:09.482 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.471+0000 7fc09164d640 5 monclient: authenticate success, global_id 4788 2026-02-17T11:12:09.482 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.471+0000 7fc09164d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:12:09.482 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.471+0000 7fc089ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:12:09.482 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.471+0000 7fc089ffb640 1 -- 10.20.193.49:0/3175771531 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc080037440 con 0x7fc08c0c7170 2026-02-17T11:12:09.482 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.471+0000 7fc089ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:09.482 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.471+0000 7fc089ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:12:09.482 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.471+0000 7fc089ffb640 10 monclient: dump: 2026-02-17T11:12:09.482 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:09.482 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:09.482 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:09.482 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:09.483 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:09.483 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:09.483 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:09.483 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:09.483 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:09.483 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:09.483 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.471+0000 7fc09164d640 10 monclient: get_monmap_and_config success 2026-02-17T11:12:09.483 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.471+0000 7fc09164d640 4 set_mon_vals no callback set 2026-02-17T11:12:09.483 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.471+0000 7fc09164d640 10 monclient: shutdown 2026-02-17T11:12:09.483 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.471+0000 7fc09164d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:12:09.483 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.471+0000 7fc09164d640 1 -- 10.20.193.49:0/3175771531 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc08c0c7170 msgr2=0x7fc08c0c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:09.483 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.471+0000 7fc09164d640 1 --2- 10.20.193.49:0/3175771531 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc08c0c7170 0x7fc08c0c7550 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc0800098a0 tx=0x7fc08002ee60 comp rx=0 tx=0).stop 2026-02-17T11:12:09.484 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.471+0000 7fc09164d640 1 -- 10.20.193.49:0/3175771531 shutdown_connections 2026-02-17T11:12:09.484 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.471+0000 7fc09164d640 1 --2- 10.20.193.49:0/3175771531 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc08c0c7170 0x7fc08c0c7550 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:09.484 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.471+0000 7fc09164d640 1 -- 10.20.193.49:0/3175771531 >> 10.20.193.49:0/3175771531 conn(0x7fc08c0c9f40 msgr2=0x7fc08c0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:12:09.484 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.471+0000 7fc09164d640 1 -- 10.20.193.49:0/3175771531 shutdown_connections 2026-02-17T11:12:09.484 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.471+0000 7fc09164d640 1 -- 10.20.193.49:0/3175771531 wait complete. 2026-02-17T11:12:09.484 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.471+0000 7fc09164d640 10 monclient: build_initial_monmap 2026-02-17T11:12:09.484 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.471+0000 7fc09164d640 10 monclient: monmap: 2026-02-17T11:12:09.484 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:12:09.484 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:12:09.484 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:12:09.484 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:12:09.484 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:12:09.484 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:09.485 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:12:09.485 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:12:09.485 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:12:09.485 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:09.485 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.472+0000 7fc09164d640 1 librados: starting msgr at 2026-02-17T11:12:09.485 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.472+0000 7fc09164d640 1 librados: starting objecter 2026-02-17T11:12:09.485 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.472+0000 7fc09164d640 1 Processor -- start 2026-02-17T11:12:09.485 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.472+0000 7fc09164d640 1 -- start start 2026-02-17T11:12:09.485 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.472+0000 7fc09164d640 1 librados: setting wanted keys 2026-02-17T11:12:09.485 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.472+0000 7fc09164d640 1 librados: calling monclient init 2026-02-17T11:12:09.485 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.472+0000 7fc09164d640 10 monclient: init 2026-02-17T11:12:09.485 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.472+0000 7fc09164d640 10 monclient: _reopen_session rank -1 2026-02-17T11:12:09.486 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.472+0000 7fc09164d640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:12:09.486 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.472+0000 7fc09164d640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc08c0c48c0 0x7fc08c15aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:09.486 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.472+0000 7fc09164d640 10 monclient(hunting): picked mon.noname-a con 0x7fc08c0c48c0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:12:09.486 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.472+0000 7fc09164d640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc08c0c4d10 0x7fc08c1f35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:09.486 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.472+0000 7fc09164d640 10 monclient(hunting): picked mon.noname-b con 0x7fc08c0c4d10 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:12:09.486 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.472+0000 7fc09164d640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc08c0c7170 0x7fc08c158270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:09.486 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.472+0000 7fc09164d640 10 monclient(hunting): picked mon.noname-c con 0x7fc08c0c7170 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:12:09.486 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.472+0000 7fc09164d640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:09.486 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.472+0000 7fc09164d640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc08c0c81c0 con 0x7fc08c0c48c0 2026-02-17T11:12:09.486 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.472+0000 7fc09164d640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:09.486 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.472+0000 7fc09164d640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc08c0c7ee0 con 0x7fc08c0c4d10 2026-02-17T11:12:09.486 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.472+0000 7fc09164d640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:09.487 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.472+0000 7fc09164d640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc08c0750c0 con 0x7fc08c0c7170 2026-02-17T11:12:09.487 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.472+0000 7fc09164d640 10 monclient(hunting): _renew_subs 2026-02-17T11:12:09.487 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.472+0000 7fc09164d640 10 monclient(hunting): authenticate will time out at 1206.136601s 2026-02-17T11:12:09.487 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.472+0000 7fc08affd640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc08c0c48c0 0x7fc08c15aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:09.487 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.473+0000 7fc08affd640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc08c0c48c0 0x7fc08c15aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:49098/0 (socket says 10.20.193.49:49098) 2026-02-17T11:12:09.487 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.473+0000 7fc08affd640 1 -- 10.20.193.49:0/1309603603 learned_addr learned my addr 10.20.193.49:0/1309603603 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:12:09.487 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.473+0000 7fc08affd640 10 monclient(hunting): get_auth_request con 0x7fc08c0c48c0 auth_method 0 2026-02-17T11:12:09.487 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.473+0000 7fc08affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:09.487 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.473+0000 7fc08affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:09.487 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.473+0000 7fc08affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:09.487 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.473+0000 7fc08b7fe640 1 --2- 10.20.193.49:0/1309603603 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc08c0c7170 0x7fc08c158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:09.487 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.473+0000 7fc08a7fc640 1 --2- 10.20.193.49:0/1309603603 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc08c0c4d10 0x7fc08c1f35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:09.488 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.473+0000 7fc08affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:09.488 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.473+0000 7fc08affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:09.488 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.473+0000 7fc08affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:09.488 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.473+0000 7fc08b7fe640 10 monclient(hunting): get_auth_request con 0x7fc08c0c7170 auth_method 0 2026-02-17T11:12:09.488 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.473+0000 7fc08b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:09.488 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.473+0000 7fc08b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:09.488 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.473+0000 7fc08b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:09.488 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.473+0000 7fc08a7fc640 10 monclient(hunting): get_auth_request con 0x7fc08c0c4d10 auth_method 0 2026-02-17T11:12:09.488 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.473+0000 7fc08a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:09.488 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.473+0000 7fc08a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:09.488 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.473+0000 7fc08a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:09.488 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.473+0000 7fc08b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:09.488 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.473+0000 7fc08b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:09.489 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.473+0000 7fc08b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:09.489 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.473+0000 7fc08a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:09.489 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.473+0000 7fc08a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:09.489 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.473+0000 7fc08a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:09.489 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.474+0000 7fc08affd640 10 monclient(hunting): handle_auth_done global_id 4794 payload 824 2026-02-17T11:12:09.489 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.474+0000 7fc08affd640 1 -- 10.20.193.49:0/1309603603 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc08c0c7170 msgr2=0x7fc08c158270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:09.489 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.474+0000 7fc08affd640 1 --2- 10.20.193.49:0/1309603603 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc08c0c7170 0x7fc08c158270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:09.489 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.474+0000 7fc08affd640 1 -- 10.20.193.49:0/1309603603 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc08c0c4d10 msgr2=0x7fc08c1f35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:09.489 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.474+0000 7fc08affd640 1 --2- 10.20.193.49:0/1309603603 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc08c0c4d10 0x7fc08c1f35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:09.489 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.474+0000 7fc08affd640 10 monclient: _finish_hunting 0 2026-02-17T11:12:09.489 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.474+0000 7fc08affd640 1 monclient: found mon.noname-a 2026-02-17T11:12:09.489 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.474+0000 7fc08affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:12:09.489 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.474+0000 7fc08affd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:12:09.490 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.474+0000 7fc08affd640 1 -- 10.20.193.49:0/1309603603 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc08c1f3f10 con 0x7fc08c0c48c0 2026-02-17T11:12:09.490 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.475+0000 7fc08affd640 1 --2- 10.20.193.49:0/1309603603 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc08c0c48c0 0x7fc08c15aec0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc080009130 tx=0x7fc0800047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:12:09.490 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.475+0000 7fc06b7fe640 10 client.?.objecter ms_handle_connect 0x7fc08c0c48c0 2026-02-17T11:12:09.490 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.475+0000 7fc06b7fe640 10 client.?.objecter resend_mon_ops 2026-02-17T11:12:09.492 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.477+0000 7fc06b7fe640 1 -- 10.20.193.49:0/1309603603 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc08003c040 con 0x7fc08c0c48c0 2026-02-17T11:12:09.492 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.477+0000 7fc06b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:09.492 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.477+0000 7fc06b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:12:09.492 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.477+0000 7fc06b7fe640 10 monclient: dump: 2026-02-17T11:12:09.492 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:09.492 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:09.493 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:09.493 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:09.493 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:09.493 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:09.493 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:09.493 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:09.493 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:09.493 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:09.493 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.477+0000 7fc06b7fe640 10 monclient: _finish_auth 0 2026-02-17T11:12:09.493 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.477+0000 7fc06b7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:12:09.493 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.477+0000 7fc06b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:12:09.493 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.477+0000 7fc06b7fe640 1 -- 10.20.193.49:0/1309603603 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc080042630 con 0x7fc08c0c48c0 2026-02-17T11:12:09.494 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.477+0000 7fc06b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:12:09.494 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.477+0000 7fc06b7fe640 1 -- 10.20.193.49:0/1309603603 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc080042a20 con 0x7fc08c0c48c0 2026-02-17T11:12:09.494 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.477+0000 7fc09164d640 5 monclient: authenticate success, global_id 4794 2026-02-17T11:12:09.494 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.477+0000 7fc09164d640 10 monclient: _renew_subs 2026-02-17T11:12:09.494 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.477+0000 7fc0897fa640 4 set_mon_vals no callback set 2026-02-17T11:12:09.494 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.477+0000 7fc09164d640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:12:09.494 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.477+0000 7fc09164d640 1 -- 10.20.193.49:0/1309603603 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc08c1f41f0 con 0x7fc08c0c48c0 2026-02-17T11:12:09.494 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.477+0000 7fc06b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:09.494 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.477+0000 7fc06b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:12:09.494 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.477+0000 7fc06b7fe640 10 monclient: dump: 2026-02-17T11:12:09.494 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:09.494 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:09.495 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:09.495 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:09.495 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:09.495 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:09.495 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:09.495 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:09.495 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:09.495 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:09.495 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.477+0000 7fc09164d640 10 client.4794.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:12:09.495 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.477+0000 7fc09164d640 10 monclient: _renew_subs 2026-02-17T11:12:09.495 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.477+0000 7fc09164d640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:12:09.495 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.477+0000 7fc09164d640 1 -- 10.20.193.49:0/1309603603 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc08c06da70 con 0x7fc08c0c48c0 2026-02-17T11:12:09.495 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.477+0000 7fc09164d640 1 librados: init done 2026-02-17T11:12:09.496 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.477+0000 7fc09164d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:12:09.496 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.477+0000 7fc09164d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:12:09.496 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.477+0000 7fc09164d640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:12:09.496 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.477+0000 7fc09164d640 1 -- 10.20.193.49:0/1309603603 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc08c0c7550 con 0x7fc08c0c48c0 2026-02-17T11:12:09.496 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.489+0000 7fc06b7fe640 1 -- 10.20.193.49:0/1309603603 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7fc08004b450 con 0x7fc08c0c48c0 2026-02-17T11:12:09.496 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.490+0000 7fc06b7fe640 1 --2- 10.20.193.49:0/1309603603 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fc0580791c0 0x7fc05807b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:09.497 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.490+0000 7fc08a7fc640 1 --2- 10.20.193.49:0/1309603603 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fc0580791c0 0x7fc05807b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:09.497 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.490+0000 7fc08a7fc640 10 monclient: get_auth_request con 0x7fc0580791c0 auth_method 0 2026-02-17T11:12:09.497 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.491+0000 7fc08a7fc640 1 --2- 10.20.193.49:0/1309603603 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fc0580791c0 0x7fc05807b680 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc08c0cb730 tx=0x7fc074007dd0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:12:09.497 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.491+0000 7fc06b7fe640 10 client.4794.objecter ms_handle_connect 0x7fc0580791c0 2026-02-17T11:12:09.497 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.492+0000 7fc06b7fe640 1 -- 10.20.193.49:0/1309603603 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7fc08002fab0 con 0x7fc08c0c48c0 2026-02-17T11:12:09.497 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.492+0000 7fc06b7fe640 10 client.4794.objecter ms_dispatch2 0x7fc08c000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:12:09.498 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.492+0000 7fc06b7fe640 3 client.4794.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:12:09.498 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.492+0000 7fc06b7fe640 3 client.4794.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:12:09.498 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.492+0000 7fc06b7fe640 20 client.4794.objecter dump_active .. 0 homeless 2026-02-17T11:12:09.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.592+0000 7fc06b7fe640 1 -- 10.20.193.49:0/1309603603 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc080086a50 con 0x7fc08c0c48c0 2026-02-17T11:12:09.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.592+0000 7fc06b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:12:09.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.592+0000 7fc06b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:12:09.693 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.690+0000 7fc09164d640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:12:09.693 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.690+0000 7fc09164d640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:12:09.693 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.690+0000 7fc09164d640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:12:09.693 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.690+0000 7fc09164d640 1 -- 10.20.193.49:0/1309603603 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc08c1f44d0 con 0x7fc08c0c48c0 2026-02-17T11:12:09.696 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.693+0000 7fc06b7fe640 1 -- 10.20.193.49:0/1309603603 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fc08008ad50 con 0x7fc08c0c48c0 2026-02-17T11:12:09.696 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.693+0000 7fc06b7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:12:09.696 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.693+0000 7fc06b7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:12:09.696 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:12:09.697 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:12:09.698 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.694+0000 7fc09164d640 10 librados: watch_flush enter 2026-02-17T11:12:09.698 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.694+0000 7fc09164d640 10 librados: watch_flush exit 2026-02-17T11:12:09.698 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.694+0000 7fc09164d640 20 client.4794.objecter shutdown clearing up homeless session... 2026-02-17T11:12:09.699 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.694+0000 7fc09164d640 10 client.4794.objecter successfully canceled tick 2026-02-17T11:12:09.699 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.695+0000 7fc09164d640 1 -- 10.20.193.49:0/1309603603 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fc0580791c0 msgr2=0x7fc05807b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:09.699 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.695+0000 7fc09164d640 1 --2- 10.20.193.49:0/1309603603 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fc0580791c0 0x7fc05807b680 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc08c0cb730 tx=0x7fc074007dd0 comp rx=0 tx=0).stop 2026-02-17T11:12:09.699 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.695+0000 7fc09164d640 10 monclient: shutdown 2026-02-17T11:12:09.699 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.695+0000 7fc09164d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:12:09.699 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.695+0000 7fc09164d640 1 -- 10.20.193.49:0/1309603603 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc08c0c48c0 msgr2=0x7fc08c15aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:09.699 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.695+0000 7fc09164d640 1 --2- 10.20.193.49:0/1309603603 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc08c0c48c0 0x7fc08c15aec0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc080009130 tx=0x7fc0800047c0 comp rx=0 tx=0).stop 2026-02-17T11:12:09.699 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.695+0000 7fc09164d640 1 -- 10.20.193.49:0/1309603603 shutdown_connections 2026-02-17T11:12:09.699 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.695+0000 7fc09164d640 1 --2- 10.20.193.49:0/1309603603 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fc0580791c0 0x7fc05807b680 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:09.699 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.695+0000 7fc09164d640 1 --2- 10.20.193.49:0/1309603603 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc08c0c7170 0x7fc08c158270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:09.699 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.695+0000 7fc09164d640 1 --2- 10.20.193.49:0/1309603603 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc08c0c4d10 0x7fc08c1f35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:09.699 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.695+0000 7fc09164d640 1 --2- 10.20.193.49:0/1309603603 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc08c0c48c0 0x7fc08c15aec0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:09.700 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.695+0000 7fc09164d640 1 -- 10.20.193.49:0/1309603603 >> 10.20.193.49:0/1309603603 conn(0x7fc08c0c9f40 msgr2=0x7fc08c0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:12:09.700 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.695+0000 7fc09164d640 1 -- 10.20.193.49:0/1309603603 shutdown_connections 2026-02-17T11:12:09.700 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.695+0000 7fc09164d640 1 -- 10.20.193.49:0/1309603603 wait complete. 2026-02-17T11:12:09.700 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:09.695+0000 7fc09164d640 1 librados: shutdown 2026-02-17T11:12:11.886 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:03:57.367 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:12:11.887 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:03:57.369 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:12:11.896 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:03:57.377 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:12:11.914 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:03:57.389 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:12:11.914 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:03:57.390 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:12:11.915 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:03:57.357 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:12:11.916 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:03:57.358 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:12:11.924 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:03:57.399 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:12:11.925 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:03:57.367 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:12:12.708 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:12:12.779 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.776+0000 7fb2a0c0c640 10 monclient: get_monmap_and_config 2026-02-17T11:12:12.779 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.776+0000 7fb2a0c0c640 10 monclient: build_initial_monmap 2026-02-17T11:12:12.779 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.776+0000 7fb2a0c0c640 10 monclient: monmap: 2026-02-17T11:12:12.779 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:12:12.779 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:12.779 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:12:12.777929+0000 2026-02-17T11:12:12.780 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:12:12.777929+0000 2026-02-17T11:12:12.780 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:12:12.780 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:12.780 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:12:12.780 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:12:12.780 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:12:12.780 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:12:12.780 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:12:12.780 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:12:12.780 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:12.780 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.776+0000 7fb2a0c0c640 1 Processor -- start 2026-02-17T11:12:12.780 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.776+0000 7fb2a0c0c640 1 -- start start 2026-02-17T11:12:12.781 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.776+0000 7fb2a0c0c640 10 monclient: init 2026-02-17T11:12:12.783 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.777+0000 7fb2a0c0c640 10 monclient: _reopen_session rank -1 2026-02-17T11:12:12.783 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.777+0000 7fb2a0c0c640 10 monclient: _add_conns ranks=[3,2,4,0,5,1] 2026-02-17T11:12:12.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.777+0000 7fb2a0c0c640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fb29c15f570 0x7fb29c15f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:12.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.777+0000 7fb2a0c0c640 10 monclient(hunting): picked mon.noname-a con 0x7fb29c15f570 addr v2:10.20.193.49:3300/0 2026-02-17T11:12:12.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.777+0000 7fb2a0c0c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fb29c0be810 addr v1:10.20.193.157:6789/0 2026-02-17T11:12:12.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.777+0000 7fb2a0c0c640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7fb29c155770 0x7fb29c155c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:12.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.777+0000 7fb2a0c0c640 10 monclient(hunting): picked mon.noname-b con 0x7fb29c155770 addr v2:10.20.193.97:3300/0 2026-02-17T11:12:12.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.777+0000 7fb2a0c0c640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb29c0bee70 con 0x7fb29c0be810 2026-02-17T11:12:12.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.777+0000 7fb2a0c0c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:12.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.777+0000 7fb2a0c0c640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7fb29c0bec50 con 0x7fb29c15f570 2026-02-17T11:12:12.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.777+0000 7fb2a0c0c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:12.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.777+0000 7fb2a0c0c640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7fb29c0bfd60 con 0x7fb29c155770 2026-02-17T11:12:12.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.777+0000 7fb2a0c0c640 10 monclient(hunting): _renew_subs 2026-02-17T11:12:12.785 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.777+0000 7fb2a0c0c640 10 monclient(hunting): authenticate will time out at 1209.441401s 2026-02-17T11:12:12.785 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.777+0000 7fb29a575640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fb29c15f570 0x7fb29c15f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:12.785 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.777+0000 7fb29ad76640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7fb29c155770 0x7fb29c155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:12.785 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.777+0000 7fb299d74640 1 --1- >> v1:10.20.193.157:6789/0 conn(0x7fb29c0be810 0x7fb29c15d200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.157:6789/0 says I am v1:10.20.193.49:54128/0 (socket says 10.20.193.49:54128) 2026-02-17T11:12:12.785 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.777+0000 7fb299d74640 1 -- 10.20.193.49:0/2092827216 learned_addr learned my addr 10.20.193.49:0/2092827216 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:12:12.785 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.778+0000 7fb29ad76640 10 monclient(hunting): get_auth_request con 0x7fb29c155770 auth_method 0 2026-02-17T11:12:12.785 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.778+0000 7fb29ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:12.785 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.778+0000 7fb29ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:12.785 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.778+0000 7fb29ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:12.785 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.778+0000 7fb29a575640 10 monclient(hunting): get_auth_request con 0x7fb29c15f570 auth_method 0 2026-02-17T11:12:12.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.778+0000 7fb29a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:12.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.778+0000 7fb29a575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:12.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.778+0000 7fb29a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:12.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.778+0000 7fb29a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:12.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.778+0000 7fb29a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:12.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.778+0000 7fb29a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:12.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.778+0000 7fb29ad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:12.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.778+0000 7fb29ad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:12.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.778+0000 7fb29ad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:12.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.779+0000 7fb299573640 1 -- 10.20.193.49:0/2092827216 <== mon.2 v1:10.20.193.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1191915580 0 0) 0x7fb29c0bee70 con 0x7fb29c0be810 2026-02-17T11:12:12.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.779+0000 7fb299573640 10 monclient(hunting): _negotiate 2026-02-17T11:12:12.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.779+0000 7fb299573640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:12.787 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.779+0000 7fb299573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:12.787 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.779+0000 7fb299573640 10 monclient(hunting): my global_id is 4787 2026-02-17T11:12:12.787 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.779+0000 7fb299573640 1 -- 10.20.193.49:0/2092827216 --> v1:10.20.193.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb288003620 con 0x7fb29c0be810 2026-02-17T11:12:12.787 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.779+0000 7fb29a575640 10 monclient(hunting): handle_auth_done global_id 4797 payload 274 2026-02-17T11:12:12.787 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.779+0000 7fb29a575640 1 -- 10.20.193.49:0/2092827216 >> v2:10.20.193.97:3300/0 conn(0x7fb29c155770 msgr2=0x7fb29c155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:12:12.787 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.779+0000 7fb29a575640 1 --2- 10.20.193.49:0/2092827216 >> v2:10.20.193.97:3300/0 conn(0x7fb29c155770 0x7fb29c155c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:12.787 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.779+0000 7fb29a575640 1 -- 10.20.193.49:0/2092827216 >> v1:10.20.193.157:6789/0 conn(0x7fb29c0be810 legacy=0x7fb29c15d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:12.787 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.779+0000 7fb29a575640 10 monclient: _finish_hunting 0 2026-02-17T11:12:12.787 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.779+0000 7fb29a575640 1 monclient: found mon.noname-a 2026-02-17T11:12:12.787 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.779+0000 7fb29a575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:12:12.787 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.779+0000 7fb29a575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:12:12.787 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.779+0000 7fb29a575640 1 -- 10.20.193.49:0/2092827216 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb29c0bf150 con 0x7fb29c15f570 2026-02-17T11:12:12.788 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.780+0000 7fb29a575640 1 --2- 10.20.193.49:0/2092827216 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb29c15f570 0x7fb29c15f950 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb29c070ff0 tx=0x7fb29002ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6840c2854680c35 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:12:12.794 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.782+0000 7fb299573640 1 -- 10.20.193.49:0/2092827216 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb29003c070 con 0x7fb29c15f570 2026-02-17T11:12:12.794 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.782+0000 7fb299573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:12.794 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.782+0000 7fb299573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:12:12.794 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.782+0000 7fb299573640 10 monclient: dump: 2026-02-17T11:12:12.794 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:12.795 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:12.795 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:12.795 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:12.795 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:12.795 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:12.795 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:12.795 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:12.795 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:12.795 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:12.795 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.782+0000 7fb299573640 10 monclient: _finish_auth 0 2026-02-17T11:12:12.795 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.782+0000 7fb299573640 10 monclient: _check_auth_tickets 2026-02-17T11:12:12.795 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.782+0000 7fb299573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:12:12.796 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.782+0000 7fb299573640 1 -- 10.20.193.49:0/2092827216 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb29002faf0 con 0x7fb29c15f570 2026-02-17T11:12:12.796 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.782+0000 7fb299573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:12:12.796 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.782+0000 7fb299573640 1 -- 10.20.193.49:0/2092827216 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb290037440 con 0x7fb29c15f570 2026-02-17T11:12:12.796 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.782+0000 7fb2a0c0c640 5 monclient: authenticate success, global_id 4797 2026-02-17T11:12:12.796 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.782+0000 7fb299573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:12.796 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.782+0000 7fb299573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:12:12.796 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.782+0000 7fb299573640 10 monclient: dump: 2026-02-17T11:12:12.796 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:12.796 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:12.796 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:12.797 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:12.797 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:12.797 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:12.797 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:12.797 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:12.797 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:12.797 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:12.797 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.782+0000 7fb2a0c0c640 10 monclient: get_monmap_and_config success 2026-02-17T11:12:12.797 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.782+0000 7fb2a0c0c640 4 set_mon_vals no callback set 2026-02-17T11:12:12.797 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.782+0000 7fb2a0c0c640 10 monclient: shutdown 2026-02-17T11:12:12.797 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.782+0000 7fb2a0c0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:12:12.798 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.782+0000 7fb2a0c0c640 1 -- 10.20.193.49:0/2092827216 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb29c15f570 msgr2=0x7fb29c15f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:12.798 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.782+0000 7fb2a0c0c640 1 --2- 10.20.193.49:0/2092827216 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb29c15f570 0x7fb29c15f950 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb29c070ff0 tx=0x7fb29002ede0 comp rx=0 tx=0).stop 2026-02-17T11:12:12.798 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.782+0000 7fb2a0c0c640 1 -- 10.20.193.49:0/2092827216 shutdown_connections 2026-02-17T11:12:12.798 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.782+0000 7fb2a0c0c640 1 --2- 10.20.193.49:0/2092827216 >> v2:10.20.193.97:3300/0 conn(0x7fb29c155770 0x7fb29c155c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:12.798 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.782+0000 7fb2a0c0c640 1 --2- 10.20.193.49:0/2092827216 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb29c15f570 0x7fb29c15f950 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:12.798 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.782+0000 7fb2a0c0c640 1 -- 10.20.193.49:0/2092827216 >> 10.20.193.49:0/2092827216 conn(0x7fb29c0c9f40 msgr2=0x7fb29c0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:12:12.798 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.782+0000 7fb2a0c0c640 1 -- 10.20.193.49:0/2092827216 shutdown_connections 2026-02-17T11:12:12.798 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.782+0000 7fb2a0c0c640 1 -- 10.20.193.49:0/2092827216 wait complete. 2026-02-17T11:12:12.798 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.782+0000 7fb2a0c0c640 10 monclient: build_initial_monmap 2026-02-17T11:12:12.798 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.782+0000 7fb2a0c0c640 10 monclient: monmap: 2026-02-17T11:12:12.798 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:12:12.798 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:12:12.799 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:12:12.799 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:12:12.799 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:12:12.799 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:12.799 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:12:12.799 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:12:12.799 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:12:12.799 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:12.799 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.783+0000 7fb2a0c0c640 1 librados: starting msgr at 2026-02-17T11:12:12.799 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.783+0000 7fb2a0c0c640 1 librados: starting objecter 2026-02-17T11:12:12.799 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.783+0000 7fb2a0c0c640 1 Processor -- start 2026-02-17T11:12:12.799 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.783+0000 7fb2a0c0c640 1 -- start start 2026-02-17T11:12:12.800 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.783+0000 7fb2a0c0c640 1 librados: setting wanted keys 2026-02-17T11:12:12.800 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.783+0000 7fb2a0c0c640 1 librados: calling monclient init 2026-02-17T11:12:12.800 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.783+0000 7fb2a0c0c640 10 monclient: init 2026-02-17T11:12:12.800 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.783+0000 7fb2a0c0c640 10 monclient: _reopen_session rank -1 2026-02-17T11:12:12.800 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.783+0000 7fb2a0c0c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:12:12.800 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.783+0000 7fb2a0c0c640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb29c0be810 0x7fb29c15e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:12.800 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.783+0000 7fb2a0c0c640 10 monclient(hunting): picked mon.noname-c con 0x7fb29c0be810 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:12:12.800 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.783+0000 7fb2a0c0c640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb29c155770 0x7fb29c158880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:12.800 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.783+0000 7fb2a0c0c640 10 monclient(hunting): picked mon.noname-a con 0x7fb29c155770 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:12:12.800 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.783+0000 7fb2a0c0c640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb29c15f570 0x7fb29c158dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:12.800 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.783+0000 7fb2a0c0c640 10 monclient(hunting): picked mon.noname-b con 0x7fb29c15f570 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:12:12.800 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.783+0000 7fb2a0c0c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:12.801 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.783+0000 7fb2a0c0c640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb29c0bf9f0 con 0x7fb29c155770 2026-02-17T11:12:12.801 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.783+0000 7fb2a0c0c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:12.801 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.783+0000 7fb2a0c0c640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb29c0bf710 con 0x7fb29c15f570 2026-02-17T11:12:12.801 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.783+0000 7fb2a0c0c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:12.801 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.783+0000 7fb2a0c0c640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb29c15d910 con 0x7fb29c0be810 2026-02-17T11:12:12.801 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.783+0000 7fb2a0c0c640 10 monclient(hunting): _renew_subs 2026-02-17T11:12:12.801 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.783+0000 7fb2a0c0c640 10 monclient(hunting): authenticate will time out at 1209.447653s 2026-02-17T11:12:12.801 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.784+0000 7fb29a575640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb29c0be810 0x7fb29c15e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:12.801 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.784+0000 7fb299d74640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb29c155770 0x7fb29c158880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:12.801 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.784+0000 7fb29a575640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb29c0be810 0x7fb29c15e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:36076/0 (socket says 10.20.193.49:36076) 2026-02-17T11:12:12.801 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.784+0000 7fb29a575640 1 -- 10.20.193.49:0/3291138638 learned_addr learned my addr 10.20.193.49:0/3291138638 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:12:12.801 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.784+0000 7fb29a575640 10 monclient(hunting): get_auth_request con 0x7fb29c0be810 auth_method 0 2026-02-17T11:12:12.802 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.784+0000 7fb29a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:12.802 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.784+0000 7fb29a575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:12.802 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.784+0000 7fb29a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:12.802 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.784+0000 7fb29ad76640 1 --2- 10.20.193.49:0/3291138638 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb29c15f570 0x7fb29c158dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:12.802 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.784+0000 7fb299d74640 10 monclient(hunting): get_auth_request con 0x7fb29c155770 auth_method 0 2026-02-17T11:12:12.802 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.784+0000 7fb299d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:12.802 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.784+0000 7fb299d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:12.802 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.784+0000 7fb299d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:12.802 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.784+0000 7fb29ad76640 10 monclient(hunting): get_auth_request con 0x7fb29c15f570 auth_method 0 2026-02-17T11:12:12.802 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.784+0000 7fb29ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:12.802 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.784+0000 7fb29ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:12.802 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.784+0000 7fb29ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:12.803 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.784+0000 7fb29a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:12.803 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.784+0000 7fb29a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:12.803 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.784+0000 7fb29a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:12.803 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.784+0000 7fb299d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:12.803 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.784+0000 7fb299d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:12.803 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.784+0000 7fb299d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:12.803 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.784+0000 7fb29ad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:12.803 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.784+0000 7fb29ad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:12.803 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.784+0000 7fb29ad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:12.803 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.785+0000 7fb29a575640 10 monclient(hunting): handle_auth_done global_id 4790 payload 824 2026-02-17T11:12:12.803 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.785+0000 7fb29a575640 1 -- 10.20.193.49:0/3291138638 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb29c15f570 msgr2=0x7fb29c158dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:12.803 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.785+0000 7fb29a575640 1 --2- 10.20.193.49:0/3291138638 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb29c15f570 0x7fb29c158dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:12.803 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.785+0000 7fb29a575640 1 -- 10.20.193.49:0/3291138638 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb29c155770 msgr2=0x7fb29c158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:12.804 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.785+0000 7fb29a575640 1 --2- 10.20.193.49:0/3291138638 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb29c155770 0x7fb29c158880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:12.804 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.785+0000 7fb29a575640 10 monclient: _finish_hunting 0 2026-02-17T11:12:12.804 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.785+0000 7fb29a575640 1 monclient: found mon.noname-c 2026-02-17T11:12:12.804 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.785+0000 7fb29a575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:12:12.804 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.785+0000 7fb29a575640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:12:12.804 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.785+0000 7fb29a575640 1 -- 10.20.193.49:0/3291138638 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb29c1f37d0 con 0x7fb29c0be810 2026-02-17T11:12:12.804 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.787+0000 7fb29a575640 1 --2- 10.20.193.49:0/3291138638 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb29c0be810 0x7fb29c15e780 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb290009130 tx=0x7fb2900047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:12:12.804 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.787+0000 7fb282ffd640 10 client.?.objecter ms_handle_connect 0x7fb29c0be810 2026-02-17T11:12:12.804 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.787+0000 7fb282ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:12:12.804 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.788+0000 7fb282ffd640 1 -- 10.20.193.49:0/3291138638 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb290046020 con 0x7fb29c0be810 2026-02-17T11:12:12.804 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.788+0000 7fb282ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:12.804 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.788+0000 7fb282ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:12:12.805 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.788+0000 7fb282ffd640 10 monclient: dump: 2026-02-17T11:12:12.805 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:12.805 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:12.805 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:12.805 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:12.805 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:12.805 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:12.805 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:12.805 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:12.805 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:12.805 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:12.805 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.788+0000 7fb282ffd640 10 monclient: _finish_auth 0 2026-02-17T11:12:12.805 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.788+0000 7fb282ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:12:12.806 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.788+0000 7fb282ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:12:12.806 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.788+0000 7fb2a0c0c640 5 monclient: authenticate success, global_id 4790 2026-02-17T11:12:12.806 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.788+0000 7fb282ffd640 1 -- 10.20.193.49:0/3291138638 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb290042630 con 0x7fb29c0be810 2026-02-17T11:12:12.806 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.788+0000 7fb2a0c0c640 10 monclient: _renew_subs 2026-02-17T11:12:12.806 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.788+0000 7fb2a0c0c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:12:12.806 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.788+0000 7fb2a0c0c640 1 -- 10.20.193.49:0/3291138638 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb29c1f3ab0 con 0x7fb29c0be810 2026-02-17T11:12:12.806 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.788+0000 7fb282ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:12:12.806 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.788+0000 7fb282ffd640 1 -- 10.20.193.49:0/3291138638 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb29003c040 con 0x7fb29c0be810 2026-02-17T11:12:12.806 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.788+0000 7fb282ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:12.807 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.788+0000 7fb282ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:12:12.807 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.788+0000 7fb298d72640 4 set_mon_vals no callback set 2026-02-17T11:12:12.807 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.788+0000 7fb282ffd640 10 monclient: dump: 2026-02-17T11:12:12.807 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:12.807 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:12.807 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:12.807 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:12.807 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:12.807 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:12.807 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:12.807 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:12.807 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:12.807 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:12.808 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.788+0000 7fb2a0c0c640 10 client.4790.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:12:12.808 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.788+0000 7fb2a0c0c640 10 monclient: _renew_subs 2026-02-17T11:12:12.808 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.788+0000 7fb2a0c0c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:12:12.808 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.788+0000 7fb2a0c0c640 1 -- 10.20.193.49:0/3291138638 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb29c1f4070 con 0x7fb29c0be810 2026-02-17T11:12:12.808 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.788+0000 7fb2a0c0c640 1 librados: init done 2026-02-17T11:12:12.808 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.789+0000 7fb2a0c0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:12:12.808 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.789+0000 7fb2a0c0c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:12:12.808 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.789+0000 7fb2a0c0c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:12:12.808 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.789+0000 7fb2a0c0c640 1 -- 10.20.193.49:0/3291138638 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb29c0c01f0 con 0x7fb29c0be810 2026-02-17T11:12:12.810 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.800+0000 7fb282ffd640 1 -- 10.20.193.49:0/3291138638 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7fb290053070 con 0x7fb29c0be810 2026-02-17T11:12:12.810 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.801+0000 7fb282ffd640 1 --2- 10.20.193.49:0/3291138638 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb268079190 0x7fb26807b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:12.810 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.801+0000 7fb299d74640 1 --2- 10.20.193.49:0/3291138638 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb268079190 0x7fb26807b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:12.810 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.801+0000 7fb299d74640 10 monclient: get_auth_request con 0x7fb268079190 auth_method 0 2026-02-17T11:12:12.810 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.802+0000 7fb282ffd640 10 client.4790.objecter ms_handle_connect 0x7fb268079190 2026-02-17T11:12:12.810 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.802+0000 7fb299d74640 1 --2- 10.20.193.49:0/3291138638 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb268079190 0x7fb26807b650 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb284007b60 tx=0x7fb284007ab0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:12:12.810 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.802+0000 7fb282ffd640 1 -- 10.20.193.49:0/3291138638 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7fb29002f9b0 con 0x7fb29c0be810 2026-02-17T11:12:12.810 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.802+0000 7fb282ffd640 10 client.4790.objecter ms_dispatch2 0x7fb29c000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:12:12.810 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.802+0000 7fb282ffd640 3 client.4790.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:12:12.811 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.802+0000 7fb282ffd640 3 client.4790.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:12:12.811 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.802+0000 7fb282ffd640 20 client.4790.objecter dump_active .. 0 homeless 2026-02-17T11:12:12.908 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.906+0000 7fb282ffd640 1 -- 10.20.193.49:0/3291138638 <== mon.2 v2:10.20.193.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb290050020 con 0x7fb29c0be810 2026-02-17T11:12:12.908 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.906+0000 7fb282ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:12:12.908 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:12.906+0000 7fb282ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:12:13.007 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:13.004+0000 7fb2a0c0c640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:12:13.007 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:13.004+0000 7fb2a0c0c640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:12:13.007 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:13.004+0000 7fb2a0c0c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:12:13.008 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:13.004+0000 7fb2a0c0c640 1 -- 10.20.193.49:0/3291138638 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb29c1585a0 con 0x7fb29c0be810 2026-02-17T11:12:13.009 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:13.008+0000 7fb282ffd640 1 -- 10.20.193.49:0/3291138638 <== mon.2 v2:10.20.193.157:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fb29c1585a0 con 0x7fb29c0be810 2026-02-17T11:12:13.010 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:13.008+0000 7fb282ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:12:13.010 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:13.008+0000 7fb282ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:12:13.010 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:12:13.010 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:12:13.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:13.008+0000 7fb2a0c0c640 10 librados: watch_flush enter 2026-02-17T11:12:13.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:13.008+0000 7fb2a0c0c640 10 librados: watch_flush exit 2026-02-17T11:12:13.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:13.008+0000 7fb2a0c0c640 20 client.4790.objecter shutdown clearing up homeless session... 2026-02-17T11:12:13.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:13.008+0000 7fb2a0c0c640 10 client.4790.objecter successfully canceled tick 2026-02-17T11:12:13.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:13.008+0000 7fb2a0c0c640 1 -- 10.20.193.49:0/3291138638 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb268079190 msgr2=0x7fb26807b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:13.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:13.008+0000 7fb2a0c0c640 1 --2- 10.20.193.49:0/3291138638 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb268079190 0x7fb26807b650 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb284007b60 tx=0x7fb284007ab0 comp rx=0 tx=0).stop 2026-02-17T11:12:13.013 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:13.008+0000 7fb2a0c0c640 10 monclient: shutdown 2026-02-17T11:12:13.013 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:13.008+0000 7fb2a0c0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:12:13.013 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:13.008+0000 7fb2a0c0c640 1 -- 10.20.193.49:0/3291138638 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb29c0be810 msgr2=0x7fb29c15e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:13.013 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:13.008+0000 7fb2a0c0c640 1 --2- 10.20.193.49:0/3291138638 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb29c0be810 0x7fb29c15e780 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb290009130 tx=0x7fb2900047c0 comp rx=0 tx=0).stop 2026-02-17T11:12:13.013 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:13.008+0000 7fb2a0c0c640 1 -- 10.20.193.49:0/3291138638 shutdown_connections 2026-02-17T11:12:13.013 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:13.008+0000 7fb2a0c0c640 1 --2- 10.20.193.49:0/3291138638 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb268079190 0x7fb26807b650 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:13.013 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:13.008+0000 7fb2a0c0c640 1 --2- 10.20.193.49:0/3291138638 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb29c15f570 0x7fb29c158dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:13.013 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:13.008+0000 7fb2a0c0c640 1 --2- 10.20.193.49:0/3291138638 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb29c155770 0x7fb29c158880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:13.013 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:13.008+0000 7fb2a0c0c640 1 --2- 10.20.193.49:0/3291138638 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb29c0be810 0x7fb29c15e780 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:13.013 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:13.008+0000 7fb2a0c0c640 1 -- 10.20.193.49:0/3291138638 >> 10.20.193.49:0/3291138638 conn(0x7fb29c0c9f40 msgr2=0x7fb29c152550 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:12:13.013 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:13.008+0000 7fb2a0c0c640 1 -- 10.20.193.49:0/3291138638 shutdown_connections 2026-02-17T11:12:13.013 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:13.008+0000 7fb2a0c0c640 1 -- 10.20.193.49:0/3291138638 wait complete. 2026-02-17T11:12:13.014 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:13.008+0000 7fb2a0c0c640 1 librados: shutdown 2026-02-17T11:12:16.020 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:12:16.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.087+0000 7fb3c04b0640 10 monclient: get_monmap_and_config 2026-02-17T11:12:16.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.087+0000 7fb3c04b0640 10 monclient: build_initial_monmap 2026-02-17T11:12:16.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.087+0000 7fb3c04b0640 10 monclient: monmap: 2026-02-17T11:12:16.090 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:12:16.090 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:16.090 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:12:16.088950+0000 2026-02-17T11:12:16.090 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:12:16.088950+0000 2026-02-17T11:12:16.090 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:12:16.090 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:16.090 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:12:16.090 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:12:16.090 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:12:16.090 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:12:16.090 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:12:16.090 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:12:16.090 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:16.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.087+0000 7fb3c04b0640 1 Processor -- start 2026-02-17T11:12:16.091 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.087+0000 7fb3c04b0640 1 -- start start 2026-02-17T11:12:16.091 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.087+0000 7fb3c04b0640 10 monclient: init 2026-02-17T11:12:16.091 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.088+0000 7fb3c04b0640 10 monclient: _reopen_session rank -1 2026-02-17T11:12:16.091 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.088+0000 7fb3c04b0640 10 monclient: _add_conns ranks=[3,5,0,4,1,2] 2026-02-17T11:12:16.091 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.088+0000 7fb3c04b0640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fb3b80c7170 0x7fb3b80c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:16.091 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.088+0000 7fb3c04b0640 10 monclient(hunting): picked mon.noname-a con 0x7fb3b80c7170 addr v2:10.20.193.49:3300/0 2026-02-17T11:12:16.091 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.088+0000 7fb3c04b0640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7fb3b80c48c0 0x7fb3b80749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:16.091 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.088+0000 7fb3c04b0640 10 monclient(hunting): picked mon.noname-c con 0x7fb3b80c48c0 addr v2:10.20.193.157:3300/0 2026-02-17T11:12:16.091 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.088+0000 7fb3c04b0640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb3b8074ef0 addr v1:10.20.193.49:6789/0 2026-02-17T11:12:16.091 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.088+0000 7fb3c04b0640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3b815a9a0 con 0x7fb3b8074ef0 2026-02-17T11:12:16.091 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.088+0000 7fb3c04b0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:16.091 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.088+0000 7fb3c04b0640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7fb3b80c8530 con 0x7fb3b80c7170 2026-02-17T11:12:16.091 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.088+0000 7fb3c04b0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:16.091 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.088+0000 7fb3c04b0640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7fb3b80c5270 con 0x7fb3b80c48c0 2026-02-17T11:12:16.091 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.088+0000 7fb3c04b0640 10 monclient(hunting): _renew_subs 2026-02-17T11:12:16.091 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.088+0000 7fb3c04b0640 10 monclient(hunting): authenticate will time out at 1212.752514s 2026-02-17T11:12:16.092 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.088+0000 7fb3be225640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fb3b80c7170 0x7fb3b80c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:16.092 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.089+0000 7fb3bda24640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7fb3b80c48c0 0x7fb3b80749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:16.092 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.089+0000 7fb3bea26640 1 --1- >> v1:10.20.193.49:6789/0 conn(0x7fb3b8074ef0 0x7fb3b80c89c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.49:6789/0 says I am v1:10.20.193.49:58690/0 (socket says 10.20.193.49:58690) 2026-02-17T11:12:16.092 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.089+0000 7fb3bea26640 1 -- 10.20.193.49:0/158566339 learned_addr learned my addr 10.20.193.49:0/158566339 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:12:16.092 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.089+0000 7fb3bda24640 10 monclient(hunting): get_auth_request con 0x7fb3b80c48c0 auth_method 0 2026-02-17T11:12:16.092 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.089+0000 7fb3bda24640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:16.092 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.089+0000 7fb3bda24640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:16.092 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.089+0000 7fb3bda24640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:16.092 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.089+0000 7fb3be225640 10 monclient(hunting): get_auth_request con 0x7fb3b80c7170 auth_method 0 2026-02-17T11:12:16.092 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.089+0000 7fb3be225640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:16.092 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.089+0000 7fb3be225640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:16.092 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.089+0000 7fb3be225640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:16.092 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.089+0000 7fb3bda24640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:16.092 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.089+0000 7fb3bda24640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:16.092 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.089+0000 7fb3bda24640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:16.092 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.089+0000 7fb3be225640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:16.092 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.089+0000 7fb3be225640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:16.092 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.089+0000 7fb3be225640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:16.093 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.090+0000 7fb3bda24640 10 monclient(hunting): handle_auth_done global_id 4793 payload 274 2026-02-17T11:12:16.093 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.090+0000 7fb3bda24640 1 -- 10.20.193.49:0/158566339 >> v2:10.20.193.49:3300/0 conn(0x7fb3b80c7170 msgr2=0x7fb3b80c7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:12:16.093 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.090+0000 7fb3bda24640 1 --2- 10.20.193.49:0/158566339 >> v2:10.20.193.49:3300/0 conn(0x7fb3b80c7170 0x7fb3b80c7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:16.093 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.090+0000 7fb3bda24640 1 -- 10.20.193.49:0/158566339 >> v1:10.20.193.49:6789/0 conn(0x7fb3b8074ef0 legacy=0x7fb3b80c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:16.093 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.090+0000 7fb3bda24640 10 monclient: _finish_hunting 0 2026-02-17T11:12:16.093 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.090+0000 7fb3bda24640 1 monclient: found mon.noname-c 2026-02-17T11:12:16.093 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.090+0000 7fb3bda24640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:12:16.093 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.090+0000 7fb3bda24640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:12:16.093 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.090+0000 7fb3bda24640 1 -- 10.20.193.49:0/158566339 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3b80c5550 con 0x7fb3b80c48c0 2026-02-17T11:12:16.094 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.091+0000 7fb3bda24640 1 --2- 10.20.193.49:0/158566339 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb3b80c48c0 0x7fb3b80749b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb3b80c7a90 tx=0x7fb3ac02ede0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9fbebc58c7bf9bc server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:12:16.095 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.093+0000 7fb3bd223640 1 -- 10.20.193.49:0/158566339 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac03c070 con 0x7fb3b80c48c0 2026-02-17T11:12:16.095 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.093+0000 7fb3bd223640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:16.095 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.093+0000 7fb3bd223640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:12:16.095 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.093+0000 7fb3bd223640 10 monclient: dump: 2026-02-17T11:12:16.095 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:16.095 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:16.095 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:16.095 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:16.095 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:16.095 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:16.095 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:16.095 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:16.095 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:16.095 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:16.095 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.093+0000 7fb3bd223640 10 monclient: _finish_auth 0 2026-02-17T11:12:16.095 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.093+0000 7fb3bd223640 10 monclient: _check_auth_tickets 2026-02-17T11:12:16.095 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.093+0000 7fb3bd223640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:12:16.096 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.093+0000 7fb3c04b0640 5 monclient: authenticate success, global_id 4793 2026-02-17T11:12:16.096 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.093+0000 7fb3c04b0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:12:16.096 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.094+0000 7fb3bd223640 1 -- 10.20.193.49:0/158566339 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3ac02faf0 con 0x7fb3b80c48c0 2026-02-17T11:12:16.096 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.094+0000 7fb3bd223640 10 monclient: handle_config config(0 keys) 2026-02-17T11:12:16.096 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.094+0000 7fb3bd223640 1 -- 10.20.193.49:0/158566339 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac037440 con 0x7fb3b80c48c0 2026-02-17T11:12:16.096 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.094+0000 7fb3c04b0640 10 monclient: get_monmap_and_config success 2026-02-17T11:12:16.096 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.094+0000 7fb3c04b0640 4 set_mon_vals no callback set 2026-02-17T11:12:16.096 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.094+0000 7fb3bd223640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:16.096 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.094+0000 7fb3bd223640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:12:16.096 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.094+0000 7fb3bd223640 10 monclient: dump: 2026-02-17T11:12:16.097 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:16.097 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:16.097 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:16.097 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:16.097 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:16.097 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:16.097 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:16.097 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:16.097 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:16.097 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:16.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.094+0000 7fb3c04b0640 10 monclient: shutdown 2026-02-17T11:12:16.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.094+0000 7fb3c04b0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:12:16.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.094+0000 7fb3c04b0640 1 -- 10.20.193.49:0/158566339 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb3b80c48c0 msgr2=0x7fb3b80749b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:16.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.094+0000 7fb3c04b0640 1 --2- 10.20.193.49:0/158566339 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb3b80c48c0 0x7fb3b80749b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb3b80c7a90 tx=0x7fb3ac02ede0 comp rx=0 tx=0).stop 2026-02-17T11:12:16.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.094+0000 7fb3c04b0640 1 -- 10.20.193.49:0/158566339 shutdown_connections 2026-02-17T11:12:16.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.094+0000 7fb3c04b0640 1 --2- 10.20.193.49:0/158566339 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb3b80c48c0 0x7fb3b80749b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:16.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.094+0000 7fb3c04b0640 1 --2- 10.20.193.49:0/158566339 >> v2:10.20.193.49:3300/0 conn(0x7fb3b80c7170 0x7fb3b80c7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:16.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.094+0000 7fb3c04b0640 1 -- 10.20.193.49:0/158566339 >> 10.20.193.49:0/158566339 conn(0x7fb3b80c9f40 msgr2=0x7fb3b80ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:12:16.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.094+0000 7fb3c04b0640 1 -- 10.20.193.49:0/158566339 shutdown_connections 2026-02-17T11:12:16.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.094+0000 7fb3c04b0640 1 -- 10.20.193.49:0/158566339 wait complete. 2026-02-17T11:12:16.098 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.094+0000 7fb3c04b0640 10 monclient: build_initial_monmap 2026-02-17T11:12:16.098 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.094+0000 7fb3c04b0640 10 monclient: monmap: 2026-02-17T11:12:16.098 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:12:16.098 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:12:16.098 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:12:16.099 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:12:16.099 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:12:16.099 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:16.099 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:12:16.099 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:12:16.099 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:12:16.099 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:16.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.095+0000 7fb3c04b0640 1 librados: starting msgr at 2026-02-17T11:12:16.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.095+0000 7fb3c04b0640 1 librados: starting objecter 2026-02-17T11:12:16.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.095+0000 7fb3c04b0640 1 Processor -- start 2026-02-17T11:12:16.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.095+0000 7fb3c04b0640 1 -- start start 2026-02-17T11:12:16.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.095+0000 7fb3c04b0640 1 librados: setting wanted keys 2026-02-17T11:12:16.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.095+0000 7fb3c04b0640 1 librados: calling monclient init 2026-02-17T11:12:16.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.095+0000 7fb3c04b0640 10 monclient: init 2026-02-17T11:12:16.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.095+0000 7fb3c04b0640 10 monclient: _reopen_session rank -1 2026-02-17T11:12:16.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.095+0000 7fb3c04b0640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:12:16.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.095+0000 7fb3c04b0640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb3b8074ef0 0x7fb3b815c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:16.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.095+0000 7fb3c04b0640 10 monclient(hunting): picked mon.noname-a con 0x7fb3b8074ef0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:12:16.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.095+0000 7fb3c04b0640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb3b80c48c0 0x7fb3b806ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:16.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.095+0000 7fb3c04b0640 10 monclient(hunting): picked mon.noname-c con 0x7fb3b80c48c0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:12:16.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.095+0000 7fb3c04b0640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb3b80c7170 0x7fb3b81f4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:16.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.095+0000 7fb3c04b0640 10 monclient(hunting): picked mon.noname-b con 0x7fb3b80c7170 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:12:16.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.095+0000 7fb3c04b0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:16.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.095+0000 7fb3c04b0640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b80c81c0 con 0x7fb3b8074ef0 2026-02-17T11:12:16.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.095+0000 7fb3c04b0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:16.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.095+0000 7fb3c04b0640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b80c7ee0 con 0x7fb3b80c7170 2026-02-17T11:12:16.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.095+0000 7fb3c04b0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:16.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.095+0000 7fb3c04b0640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b80c90d0 con 0x7fb3b80c48c0 2026-02-17T11:12:16.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.095+0000 7fb3c04b0640 10 monclient(hunting): _renew_subs 2026-02-17T11:12:16.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.095+0000 7fb3c04b0640 10 monclient(hunting): authenticate will time out at 1212.759564s 2026-02-17T11:12:16.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.095+0000 7fb3be225640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb3b8074ef0 0x7fb3b815c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:16.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.095+0000 7fb3bda24640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb3b80c48c0 0x7fb3b806ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:16.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.096+0000 7fb3bda24640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb3b80c48c0 0x7fb3b806ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:38690/0 (socket says 10.20.193.49:38690) 2026-02-17T11:12:16.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.096+0000 7fb3be225640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb3b8074ef0 0x7fb3b815c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:45162/0 (socket says 10.20.193.49:45162) 2026-02-17T11:12:16.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.096+0000 7fb3bda24640 1 -- 10.20.193.49:0/2487153754 learned_addr learned my addr 10.20.193.49:0/2487153754 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:12:16.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.096+0000 7fb3bda24640 10 monclient(hunting): get_auth_request con 0x7fb3b80c48c0 auth_method 0 2026-02-17T11:12:16.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.096+0000 7fb3bda24640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:16.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.096+0000 7fb3bda24640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:16.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.096+0000 7fb3bda24640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:16.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.096+0000 7fb3be225640 10 monclient(hunting): get_auth_request con 0x7fb3b8074ef0 auth_method 0 2026-02-17T11:12:16.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.096+0000 7fb3be225640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:16.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.096+0000 7fb3be225640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:16.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.096+0000 7fb3be225640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:16.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.096+0000 7fb3bea26640 1 --2- 10.20.193.49:0/2487153754 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb3b80c7170 0x7fb3b81f4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:16.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.096+0000 7fb3bda24640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:16.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.096+0000 7fb3bda24640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:16.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.096+0000 7fb3bda24640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:16.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.096+0000 7fb3be225640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:16.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.096+0000 7fb3be225640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:16.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.096+0000 7fb3be225640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:16.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.096+0000 7fb3bea26640 10 monclient(hunting): get_auth_request con 0x7fb3b80c7170 auth_method 0 2026-02-17T11:12:16.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.096+0000 7fb3bea26640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:16.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.096+0000 7fb3bea26640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:16.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.096+0000 7fb3bea26640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:16.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.096+0000 7fb3bea26640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:16.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.096+0000 7fb3bea26640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:16.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.096+0000 7fb3bea26640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:16.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.097+0000 7fb3bda24640 10 monclient(hunting): handle_auth_done global_id 4796 payload 824 2026-02-17T11:12:16.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.097+0000 7fb3bda24640 1 -- 10.20.193.49:0/2487153754 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb3b80c7170 msgr2=0x7fb3b81f4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:16.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.097+0000 7fb3bda24640 1 --2- 10.20.193.49:0/2487153754 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb3b80c7170 0x7fb3b81f4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:16.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.097+0000 7fb3bda24640 1 -- 10.20.193.49:0/2487153754 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb3b8074ef0 msgr2=0x7fb3b815c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:16.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.097+0000 7fb3bda24640 1 --2- 10.20.193.49:0/2487153754 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb3b8074ef0 0x7fb3b815c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:16.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.097+0000 7fb3bda24640 10 monclient: _finish_hunting 0 2026-02-17T11:12:16.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.097+0000 7fb3bda24640 1 monclient: found mon.noname-c 2026-02-17T11:12:16.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.097+0000 7fb3bda24640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:12:16.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.097+0000 7fb3bda24640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:12:16.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.097+0000 7fb3bda24640 1 -- 10.20.193.49:0/2487153754 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3b815dd70 con 0x7fb3b80c48c0 2026-02-17T11:12:16.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.098+0000 7fb3bda24640 1 --2- 10.20.193.49:0/2487153754 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb3b80c48c0 0x7fb3b806ee50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac009130 tx=0x7fb3ac0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:12:16.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.098+0000 7fb39effd640 10 client.?.objecter ms_handle_connect 0x7fb3b80c48c0 2026-02-17T11:12:16.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.098+0000 7fb39effd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:12:16.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.099+0000 7fb39effd640 1 -- 10.20.193.49:0/2487153754 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac03c040 con 0x7fb3b80c48c0 2026-02-17T11:12:16.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.099+0000 7fb39effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:16.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.099+0000 7fb39effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:12:16.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.099+0000 7fb39effd640 10 monclient: dump: 2026-02-17T11:12:16.102 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:16.102 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:16.102 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:16.102 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:16.102 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:16.102 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:16.102 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:16.102 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:16.102 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:16.102 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:16.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.099+0000 7fb39effd640 10 monclient: _finish_auth 0 2026-02-17T11:12:16.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.099+0000 7fb39effd640 10 monclient: _check_auth_tickets 2026-02-17T11:12:16.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.099+0000 7fb39effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:12:16.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.099+0000 7fb3c04b0640 5 monclient: authenticate success, global_id 4796 2026-02-17T11:12:16.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.099+0000 7fb3c04b0640 10 monclient: _renew_subs 2026-02-17T11:12:16.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.099+0000 7fb3c04b0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:12:16.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.099+0000 7fb3c04b0640 1 -- 10.20.193.49:0/2487153754 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3b815c9f0 con 0x7fb3b80c48c0 2026-02-17T11:12:16.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.099+0000 7fb3c04b0640 10 client.4796.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:12:16.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.099+0000 7fb3c04b0640 10 monclient: _renew_subs 2026-02-17T11:12:16.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.099+0000 7fb3c04b0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:12:16.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.099+0000 7fb3c04b0640 1 -- 10.20.193.49:0/2487153754 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3b815cfb0 con 0x7fb3b80c48c0 2026-02-17T11:12:16.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.099+0000 7fb3c04b0640 1 librados: init done 2026-02-17T11:12:16.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.100+0000 7fb3c04b0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:12:16.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.100+0000 7fb3c04b0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:12:16.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.100+0000 7fb3c04b0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:12:16.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.100+0000 7fb3c04b0640 1 -- 10.20.193.49:0/2487153754 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3b80c4d10 con 0x7fb3b80c48c0 2026-02-17T11:12:16.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.100+0000 7fb39effd640 1 -- 10.20.193.49:0/2487153754 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3ac02fa70 con 0x7fb3b80c48c0 2026-02-17T11:12:16.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.100+0000 7fb39effd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:12:16.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.100+0000 7fb39effd640 1 -- 10.20.193.49:0/2487153754 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac042830 con 0x7fb3b80c48c0 2026-02-17T11:12:16.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.100+0000 7fb39effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:16.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.100+0000 7fb39effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:12:16.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.100+0000 7fb39effd640 10 monclient: dump: 2026-02-17T11:12:16.103 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:16.103 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:16.103 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:16.103 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:16.103 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:16.104 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:16.104 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:16.104 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:16.104 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:16.104 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:16.104 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.100+0000 7fb3bca22640 4 set_mon_vals no callback set 2026-02-17T11:12:16.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.207+0000 7fb39effd640 1 -- 10.20.193.49:0/2487153754 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7fb3ac04b450 con 0x7fb3b80c48c0 2026-02-17T11:12:16.210 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.207+0000 7fb39effd640 1 --2- 10.20.193.49:0/2487153754 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb388079140 0x7fb38807b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:16.210 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.207+0000 7fb3be225640 1 --2- 10.20.193.49:0/2487153754 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb388079140 0x7fb38807b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:16.210 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.207+0000 7fb3be225640 10 monclient: get_auth_request con 0x7fb388079140 auth_method 0 2026-02-17T11:12:16.211 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.208+0000 7fb3be225640 1 --2- 10.20.193.49:0/2487153754 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb388079140 0x7fb38807b600 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8009ba0 tx=0x7fb3a8009290 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:12:16.211 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.208+0000 7fb39effd640 10 client.4796.objecter ms_handle_connect 0x7fb388079140 2026-02-17T11:12:16.211 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.208+0000 7fb39effd640 1 -- 10.20.193.49:0/2487153754 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7fb3ac082cc0 con 0x7fb3b80c48c0 2026-02-17T11:12:16.211 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.208+0000 7fb39effd640 10 client.4796.objecter ms_dispatch2 0x7fb3b8000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:12:16.211 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.208+0000 7fb39effd640 3 client.4796.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:12:16.211 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.208+0000 7fb39effd640 3 client.4796.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:12:16.211 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.208+0000 7fb39effd640 20 client.4796.objecter dump_active .. 0 homeless 2026-02-17T11:12:16.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.216+0000 7fb39effd640 1 -- 10.20.193.49:0/2487153754 <== mon.2 v2:10.20.193.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb3ac086c80 con 0x7fb3b80c48c0 2026-02-17T11:12:16.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.216+0000 7fb39effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:12:16.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.216+0000 7fb39effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:12:16.318 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.315+0000 7fb3c04b0640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:12:16.326 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.315+0000 7fb3c04b0640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:12:16.326 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.315+0000 7fb3c04b0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:12:16.326 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.315+0000 7fb3c04b0640 1 -- 10.20.193.49:0/2487153754 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb3b814deb0 con 0x7fb3b80c48c0 2026-02-17T11:12:16.327 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.318+0000 7fb39effd640 1 -- 10.20.193.49:0/2487153754 <== mon.2 v2:10.20.193.157:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fb3ac08af80 con 0x7fb3b80c48c0 2026-02-17T11:12:16.327 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.318+0000 7fb39effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:12:16.327 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.318+0000 7fb39effd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:12:16.327 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:12:16.327 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:12:16.330 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.319+0000 7fb3c04b0640 10 librados: watch_flush enter 2026-02-17T11:12:16.330 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.319+0000 7fb3c04b0640 10 librados: watch_flush exit 2026-02-17T11:12:16.330 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.319+0000 7fb3c04b0640 20 client.4796.objecter shutdown clearing up homeless session... 2026-02-17T11:12:16.330 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.319+0000 7fb3c04b0640 10 client.4796.objecter successfully canceled tick 2026-02-17T11:12:16.330 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.319+0000 7fb3c04b0640 1 -- 10.20.193.49:0/2487153754 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb388079140 msgr2=0x7fb38807b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:16.330 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.319+0000 7fb3c04b0640 1 --2- 10.20.193.49:0/2487153754 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb388079140 0x7fb38807b600 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8009ba0 tx=0x7fb3a8009290 comp rx=0 tx=0).stop 2026-02-17T11:12:16.331 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.319+0000 7fb3c04b0640 10 monclient: shutdown 2026-02-17T11:12:16.331 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.319+0000 7fb3c04b0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:12:16.331 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.319+0000 7fb3c04b0640 1 -- 10.20.193.49:0/2487153754 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb3b80c48c0 msgr2=0x7fb3b806ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:16.331 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.319+0000 7fb3c04b0640 1 --2- 10.20.193.49:0/2487153754 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb3b80c48c0 0x7fb3b806ee50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac009130 tx=0x7fb3ac0047c0 comp rx=0 tx=0).stop 2026-02-17T11:12:16.331 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.319+0000 7fb3c04b0640 1 -- 10.20.193.49:0/2487153754 shutdown_connections 2026-02-17T11:12:16.331 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.319+0000 7fb3c04b0640 1 --2- 10.20.193.49:0/2487153754 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb388079140 0x7fb38807b600 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:16.331 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.319+0000 7fb3c04b0640 1 --2- 10.20.193.49:0/2487153754 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb3b80c7170 0x7fb3b81f4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:16.331 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.319+0000 7fb3c04b0640 1 --2- 10.20.193.49:0/2487153754 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb3b80c48c0 0x7fb3b806ee50 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:16.332 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.319+0000 7fb3c04b0640 1 --2- 10.20.193.49:0/2487153754 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb3b8074ef0 0x7fb3b815c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:16.332 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.319+0000 7fb3c04b0640 1 -- 10.20.193.49:0/2487153754 >> 10.20.193.49:0/2487153754 conn(0x7fb3b80c9f40 msgr2=0x7fb3b80cb330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:12:16.332 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.319+0000 7fb3c04b0640 1 -- 10.20.193.49:0/2487153754 shutdown_connections 2026-02-17T11:12:16.332 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.319+0000 7fb3c04b0640 1 -- 10.20.193.49:0/2487153754 wait complete. 2026-02-17T11:12:16.332 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:16.319+0000 7fb3c04b0640 1 librados: shutdown 2026-02-17T11:12:19.333 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:12:19.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.401+0000 7f1e6a43f640 10 monclient: get_monmap_and_config 2026-02-17T11:12:19.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.401+0000 7f1e6a43f640 10 monclient: build_initial_monmap 2026-02-17T11:12:19.404 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.401+0000 7f1e6a43f640 10 monclient: monmap: 2026-02-17T11:12:19.404 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:12:19.404 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:19.404 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:12:19.402557+0000 2026-02-17T11:12:19.404 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:12:19.402557+0000 2026-02-17T11:12:19.404 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:12:19.404 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:19.404 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:12:19.404 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:12:19.404 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:12:19.405 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:12:19.405 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:12:19.405 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:12:19.405 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:19.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.401+0000 7f1e6a43f640 1 Processor -- start 2026-02-17T11:12:19.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.401+0000 7f1e6a43f640 1 -- start start 2026-02-17T11:12:19.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.401+0000 7f1e6a43f640 10 monclient: init 2026-02-17T11:12:19.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.402+0000 7f1e6a43f640 10 monclient: _reopen_session rank -1 2026-02-17T11:12:19.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.402+0000 7f1e6a43f640 10 monclient: _add_conns ranks=[4,3,1,5,0,2] 2026-02-17T11:12:19.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.402+0000 7f1e6a43f640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f1e640686b0 0x7f1e64068a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:19.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.402+0000 7f1e6a43f640 10 monclient(hunting): picked mon.noname-b con 0x7f1e640686b0 addr v2:10.20.193.97:3300/0 2026-02-17T11:12:19.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.402+0000 7f1e6a43f640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f1e6415be30 0x7f1e6406eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:19.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.402+0000 7f1e6a43f640 10 monclient(hunting): picked mon.noname-a con 0x7f1e6415be30 addr v2:10.20.193.49:3300/0 2026-02-17T11:12:19.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.402+0000 7f1e6a43f640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f1e6406f530 addr v1:10.20.193.97:6789/0 2026-02-17T11:12:19.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.402+0000 7f1e6a43f640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e6406f9a0 con 0x7f1e6406f530 2026-02-17T11:12:19.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.402+0000 7f1e6a43f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:19.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.402+0000 7f1e6a43f640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f1e6415cd30 con 0x7f1e6415be30 2026-02-17T11:12:19.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.402+0000 7f1e6a43f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:19.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.402+0000 7f1e6a43f640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f1e6415c490 con 0x7f1e640686b0 2026-02-17T11:12:19.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.402+0000 7f1e6a43f640 10 monclient(hunting): _renew_subs 2026-02-17T11:12:19.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.402+0000 7f1e6a43f640 10 monclient(hunting): authenticate will time out at 1216.066267s 2026-02-17T11:12:19.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.402+0000 7f1e637fe640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f1e6415be30 0x7f1e6406eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:19.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.402+0000 7f1e63fff640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f1e640686b0 0x7f1e64068a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:19.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.402+0000 7f1e637fe640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f1e6415be30 0x7f1e6406eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:45172/0 (socket says 10.20.193.49:45172) 2026-02-17T11:12:19.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.402+0000 7f1e637fe640 1 -- 10.20.193.49:0/4064175641 learned_addr learned my addr 10.20.193.49:0/4064175641 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:12:19.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.402+0000 7f1e637fe640 10 monclient(hunting): get_auth_request con 0x7f1e6415be30 auth_method 0 2026-02-17T11:12:19.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.402+0000 7f1e637fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:19.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.402+0000 7f1e637fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:19.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.402+0000 7f1e637fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:19.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.403+0000 7f1e63fff640 10 monclient(hunting): get_auth_request con 0x7f1e640686b0 auth_method 0 2026-02-17T11:12:19.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.403+0000 7f1e63fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:19.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.403+0000 7f1e63fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:19.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.403+0000 7f1e63fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:19.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.403+0000 7f1e637fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:19.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.403+0000 7f1e637fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:19.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.403+0000 7f1e637fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:19.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.403+0000 7f1e63fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:19.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.403+0000 7f1e63fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:19.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.403+0000 7f1e63fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:19.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.404+0000 7f1e637fe640 10 monclient(hunting): handle_auth_done global_id 4812 payload 274 2026-02-17T11:12:19.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.404+0000 7f1e637fe640 1 -- 10.20.193.49:0/4064175641 >> v2:10.20.193.97:3300/0 conn(0x7f1e640686b0 msgr2=0x7f1e64068a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:12:19.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.404+0000 7f1e637fe640 1 --2- 10.20.193.49:0/4064175641 >> v2:10.20.193.97:3300/0 conn(0x7f1e640686b0 0x7f1e64068a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:19.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.404+0000 7f1e637fe640 1 -- 10.20.193.49:0/4064175641 >> v1:10.20.193.97:6789/0 conn(0x7f1e6406f530 legacy=0x7f1e64155ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:19.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.404+0000 7f1e637fe640 10 monclient: _finish_hunting 0 2026-02-17T11:12:19.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.404+0000 7f1e637fe640 1 monclient: found mon.noname-a 2026-02-17T11:12:19.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.404+0000 7f1e637fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:12:19.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.404+0000 7f1e637fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:12:19.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.404+0000 7f1e637fe640 1 -- 10.20.193.49:0/4064175641 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e6415c770 con 0x7f1e6415be30 2026-02-17T11:12:19.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.404+0000 7f1e637fe640 1 --2- 10.20.193.49:0/4064175641 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1e6415be30 0x7f1e6406eff0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1e6406d9c0 tx=0x7f1e5402eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=217f5fdcdce030e5 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:12:19.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.406+0000 7f1e62ffd640 1 -- 10.20.193.49:0/4064175641 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e5403c070 con 0x7f1e6415be30 2026-02-17T11:12:19.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.406+0000 7f1e62ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:19.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.406+0000 7f1e62ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:12:19.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.406+0000 7f1e62ffd640 10 monclient: dump: 2026-02-17T11:12:19.418 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:19.418 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:19.418 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:19.418 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:19.418 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:19.419 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:19.419 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:19.419 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:19.419 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:19.419 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:19.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.406+0000 7f1e62ffd640 10 monclient: _finish_auth 0 2026-02-17T11:12:19.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.406+0000 7f1e62ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:12:19.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.406+0000 7f1e62ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:12:19.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.406+0000 7f1e62ffd640 1 -- 10.20.193.49:0/4064175641 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e5402fbe0 con 0x7f1e6415be30 2026-02-17T11:12:19.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.406+0000 7f1e62ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:12:19.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.406+0000 7f1e62ffd640 1 -- 10.20.193.49:0/4064175641 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e54037440 con 0x7f1e6415be30 2026-02-17T11:12:19.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.406+0000 7f1e6a43f640 5 monclient: authenticate success, global_id 4812 2026-02-17T11:12:19.420 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.406+0000 7f1e6a43f640 10 monclient: get_monmap_and_config success 2026-02-17T11:12:19.420 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.406+0000 7f1e6a43f640 4 set_mon_vals no callback set 2026-02-17T11:12:19.420 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.406+0000 7f1e62ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:19.420 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.406+0000 7f1e62ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:12:19.420 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.406+0000 7f1e62ffd640 10 monclient: dump: 2026-02-17T11:12:19.420 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:19.420 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:19.420 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:19.420 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:19.420 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:19.420 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:19.420 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:19.421 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:19.421 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:19.421 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:19.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.407+0000 7f1e6a43f640 10 monclient: shutdown 2026-02-17T11:12:19.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.407+0000 7f1e6a43f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:12:19.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.407+0000 7f1e6a43f640 1 -- 10.20.193.49:0/4064175641 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1e6415be30 msgr2=0x7f1e6406eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:19.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.407+0000 7f1e6a43f640 1 --2- 10.20.193.49:0/4064175641 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1e6415be30 0x7f1e6406eff0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1e6406d9c0 tx=0x7f1e5402eed0 comp rx=0 tx=0).stop 2026-02-17T11:12:19.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.407+0000 7f1e6a43f640 1 -- 10.20.193.49:0/4064175641 shutdown_connections 2026-02-17T11:12:19.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.407+0000 7f1e6a43f640 1 --2- 10.20.193.49:0/4064175641 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1e6415be30 0x7f1e6406eff0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:19.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.407+0000 7f1e6a43f640 1 --2- 10.20.193.49:0/4064175641 >> v2:10.20.193.97:3300/0 conn(0x7f1e640686b0 0x7f1e64068a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:19.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.407+0000 7f1e6a43f640 1 -- 10.20.193.49:0/4064175641 >> 10.20.193.49:0/4064175641 conn(0x7f1e640cb3a0 msgr2=0x7f1e640cb7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:12:19.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.407+0000 7f1e6a43f640 1 -- 10.20.193.49:0/4064175641 shutdown_connections 2026-02-17T11:12:19.422 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.407+0000 7f1e6a43f640 1 -- 10.20.193.49:0/4064175641 wait complete. 2026-02-17T11:12:19.422 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.407+0000 7f1e6a43f640 10 monclient: build_initial_monmap 2026-02-17T11:12:19.422 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.407+0000 7f1e6a43f640 10 monclient: monmap: 2026-02-17T11:12:19.422 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:12:19.422 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:12:19.422 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:12:19.422 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:12:19.422 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:12:19.422 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:19.422 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:12:19.422 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:12:19.422 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:12:19.423 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:19.423 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.407+0000 7f1e6a43f640 1 librados: starting msgr at 2026-02-17T11:12:19.423 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.407+0000 7f1e6a43f640 1 librados: starting objecter 2026-02-17T11:12:19.423 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.407+0000 7f1e6a43f640 1 Processor -- start 2026-02-17T11:12:19.423 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.407+0000 7f1e6a43f640 1 -- start start 2026-02-17T11:12:19.423 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.407+0000 7f1e6a43f640 1 librados: setting wanted keys 2026-02-17T11:12:19.423 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.407+0000 7f1e6a43f640 1 librados: calling monclient init 2026-02-17T11:12:19.423 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.407+0000 7f1e6a43f640 10 monclient: init 2026-02-17T11:12:19.423 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.408+0000 7f1e6a43f640 10 monclient: _reopen_session rank -1 2026-02-17T11:12:19.423 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.408+0000 7f1e6a43f640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:12:19.423 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.408+0000 7f1e6a43f640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1e640686b0 0x7f1e640717c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:19.423 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.408+0000 7f1e6a43f640 10 monclient(hunting): picked mon.noname-a con 0x7f1e640686b0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:12:19.423 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.408+0000 7f1e6a43f640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f1e6406f530 0x7f1e641f3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:19.424 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.408+0000 7f1e6a43f640 10 monclient(hunting): picked mon.noname-c con 0x7f1e6406f530 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:12:19.424 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.408+0000 7f1e6a43f640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f1e6415be30 0x7f1e641f4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:19.424 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.408+0000 7f1e6a43f640 10 monclient(hunting): picked mon.noname-b con 0x7f1e6415be30 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:12:19.424 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.408+0000 7f1e6a43f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:19.424 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.408+0000 7f1e6a43f640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1e6406ead0 con 0x7f1e640686b0 2026-02-17T11:12:19.424 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.408+0000 7f1e6a43f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:19.424 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.408+0000 7f1e6a43f640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1e6406e7f0 con 0x7f1e6415be30 2026-02-17T11:12:19.424 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.408+0000 7f1e6a43f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:19.424 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.408+0000 7f1e6a43f640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f1e641561f0 con 0x7f1e6406f530 2026-02-17T11:12:19.424 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.408+0000 7f1e6a43f640 10 monclient(hunting): _renew_subs 2026-02-17T11:12:19.424 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.408+0000 7f1e6a43f640 10 monclient(hunting): authenticate will time out at 1216.072350s 2026-02-17T11:12:19.424 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.408+0000 7f1e63fff640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1e640686b0 0x7f1e640717c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:19.425 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.408+0000 7f1e689b5640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f1e6415be30 0x7f1e641f4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:19.425 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.408+0000 7f1e63fff640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1e640686b0 0x7f1e640717c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:45182/0 (socket says 10.20.193.49:45182) 2026-02-17T11:12:19.425 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.408+0000 7f1e63fff640 1 -- 10.20.193.49:0/2927776459 learned_addr learned my addr 10.20.193.49:0/2927776459 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:12:19.425 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.408+0000 7f1e63fff640 10 monclient(hunting): get_auth_request con 0x7f1e640686b0 auth_method 0 2026-02-17T11:12:19.425 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.408+0000 7f1e63fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:19.425 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.408+0000 7f1e63fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:19.425 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.408+0000 7f1e63fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:19.425 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.408+0000 7f1e689b5640 10 monclient(hunting): get_auth_request con 0x7f1e6415be30 auth_method 0 2026-02-17T11:12:19.425 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.408+0000 7f1e689b5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:19.425 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.408+0000 7f1e689b5640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:19.425 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.408+0000 7f1e689b5640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:19.425 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.408+0000 7f1e637fe640 1 --2- 10.20.193.49:0/2927776459 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f1e6406f530 0x7f1e641f3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:19.426 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.409+0000 7f1e63fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:19.426 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.409+0000 7f1e63fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:19.426 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.409+0000 7f1e63fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:19.426 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.409+0000 7f1e689b5640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:19.426 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.409+0000 7f1e689b5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:19.426 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.409+0000 7f1e689b5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:19.426 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.409+0000 7f1e637fe640 10 monclient(hunting): get_auth_request con 0x7f1e6406f530 auth_method 0 2026-02-17T11:12:19.426 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.409+0000 7f1e637fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:19.426 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.409+0000 7f1e637fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:19.426 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.409+0000 7f1e637fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:19.426 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.409+0000 7f1e637fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:19.426 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.409+0000 7f1e637fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:19.427 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.409+0000 7f1e637fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:19.427 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.410+0000 7f1e63fff640 10 monclient(hunting): handle_auth_done global_id 4815 payload 824 2026-02-17T11:12:19.427 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.410+0000 7f1e63fff640 1 -- 10.20.193.49:0/2927776459 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f1e6406f530 msgr2=0x7f1e641f3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:19.427 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.410+0000 7f1e63fff640 1 --2- 10.20.193.49:0/2927776459 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f1e6406f530 0x7f1e641f3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:19.427 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.410+0000 7f1e63fff640 1 -- 10.20.193.49:0/2927776459 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f1e6415be30 msgr2=0x7f1e641f4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:19.427 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.410+0000 7f1e63fff640 1 --2- 10.20.193.49:0/2927776459 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f1e6415be30 0x7f1e641f4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:19.427 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.410+0000 7f1e63fff640 10 monclient: _finish_hunting 0 2026-02-17T11:12:19.427 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.410+0000 7f1e63fff640 1 monclient: found mon.noname-a 2026-02-17T11:12:19.427 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.410+0000 7f1e63fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:12:19.427 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.410+0000 7f1e63fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:12:19.427 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.410+0000 7f1e63fff640 1 -- 10.20.193.49:0/2927776459 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e641f4b70 con 0x7f1e640686b0 2026-02-17T11:12:19.427 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.411+0000 7f1e63fff640 1 --2- 10.20.193.49:0/2927776459 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1e640686b0 0x7f1e640717c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1e5000ebe0 tx=0x7f1e5000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:12:19.427 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.411+0000 7f1e60ff9640 10 client.?.objecter ms_handle_connect 0x7f1e640686b0 2026-02-17T11:12:19.428 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.411+0000 7f1e60ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T11:12:19.428 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.412+0000 7f1e60ff9640 1 -- 10.20.193.49:0/2927776459 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e50017070 con 0x7f1e640686b0 2026-02-17T11:12:19.428 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.412+0000 7f1e60ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:19.428 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.412+0000 7f1e60ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:12:19.428 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.412+0000 7f1e60ff9640 10 monclient: dump: 2026-02-17T11:12:19.428 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:19.428 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:19.428 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:19.428 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:19.428 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:19.428 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:19.428 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:19.428 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:19.429 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:19.429 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:19.429 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.412+0000 7f1e60ff9640 10 monclient: _finish_auth 0 2026-02-17T11:12:19.429 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.412+0000 7f1e60ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:12:19.429 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.412+0000 7f1e60ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:12:19.429 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.412+0000 7f1e60ff9640 1 -- 10.20.193.49:0/2927776459 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e5000cc40 con 0x7f1e640686b0 2026-02-17T11:12:19.429 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.412+0000 7f1e6a43f640 5 monclient: authenticate success, global_id 4815 2026-02-17T11:12:19.429 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.412+0000 7f1e6a43f640 10 monclient: _renew_subs 2026-02-17T11:12:19.429 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.412+0000 7f1e6a43f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:12:19.429 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.412+0000 7f1e6a43f640 1 -- 10.20.193.49:0/2927776459 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e641f4890 con 0x7f1e640686b0 2026-02-17T11:12:19.429 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.412+0000 7f1e60ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:12:19.429 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.412+0000 7f1e60ff9640 1 -- 10.20.193.49:0/2927776459 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e50013470 con 0x7f1e640686b0 2026-02-17T11:12:19.430 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.412+0000 7f1e60ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:19.430 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.412+0000 7f1e60ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:12:19.430 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.412+0000 7f1e627fc640 4 set_mon_vals no callback set 2026-02-17T11:12:19.430 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.412+0000 7f1e60ff9640 10 monclient: dump: 2026-02-17T11:12:19.430 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:19.430 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:19.430 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:19.430 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:19.430 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:19.430 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:19.430 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:19.430 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:19.431 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:19.431 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:19.431 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.412+0000 7f1e6a43f640 10 client.4815.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:12:19.431 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.412+0000 7f1e6a43f640 10 monclient: _renew_subs 2026-02-17T11:12:19.431 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.412+0000 7f1e6a43f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:12:19.431 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.412+0000 7f1e6a43f640 1 -- 10.20.193.49:0/2927776459 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e641f5440 con 0x7f1e640686b0 2026-02-17T11:12:19.431 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.413+0000 7f1e6a43f640 1 librados: init done 2026-02-17T11:12:19.431 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.413+0000 7f1e6a43f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:12:19.431 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.413+0000 7f1e6a43f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:12:19.431 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.413+0000 7f1e6a43f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:12:19.431 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.413+0000 7f1e6a43f640 1 -- 10.20.193.49:0/2927776459 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e640cb830 con 0x7f1e640686b0 2026-02-17T11:12:19.432 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.425+0000 7f1e60ff9640 1 -- 10.20.193.49:0/2927776459 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f1e50013610 con 0x7f1e640686b0 2026-02-17T11:12:19.432 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.425+0000 7f1e60ff9640 1 --2- 10.20.193.49:0/2927776459 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f1e34079190 0x7f1e3407b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:19.433 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.426+0000 7f1e637fe640 1 --2- 10.20.193.49:0/2927776459 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f1e34079190 0x7f1e3407b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:19.433 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.426+0000 7f1e637fe640 10 monclient: get_auth_request con 0x7f1e34079190 auth_method 0 2026-02-17T11:12:19.433 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.426+0000 7f1e637fe640 1 --2- 10.20.193.49:0/2927776459 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f1e34079190 0x7f1e3407b650 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1e64073870 tx=0x7f1e54033000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:12:19.433 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.426+0000 7f1e60ff9640 10 client.4815.objecter ms_handle_connect 0x7f1e34079190 2026-02-17T11:12:19.530 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.526+0000 7f1e60ff9640 1 -- 10.20.193.49:0/2927776459 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f1e5005e6e0 con 0x7f1e640686b0 2026-02-17T11:12:19.530 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.526+0000 7f1e60ff9640 10 client.4815.objecter ms_dispatch2 0x7f1e64000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:12:19.530 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.527+0000 7f1e60ff9640 3 client.4815.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:12:19.530 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.527+0000 7f1e60ff9640 3 client.4815.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:12:19.530 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.527+0000 7f1e60ff9640 20 client.4815.objecter dump_active .. 0 homeless 2026-02-17T11:12:19.530 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.527+0000 7f1e60ff9640 1 -- 10.20.193.49:0/2927776459 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f1e640cb830 con 0x7f1e640686b0 2026-02-17T11:12:19.530 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.527+0000 7f1e60ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:12:19.530 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.527+0000 7f1e60ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:12:19.631 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.628+0000 7f1e6a43f640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:12:19.631 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.628+0000 7f1e6a43f640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:12:19.631 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.628+0000 7f1e6a43f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:12:19.631 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.628+0000 7f1e6a43f640 1 -- 10.20.193.49:0/2927776459 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f1e64068a90 con 0x7f1e640686b0 2026-02-17T11:12:19.634 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.631+0000 7f1e60ff9640 1 -- 10.20.193.49:0/2927776459 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f1e500626a0 con 0x7f1e640686b0 2026-02-17T11:12:19.634 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.631+0000 7f1e60ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:12:19.634 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.631+0000 7f1e60ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:12:19.634 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:12:19.634 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:12:19.636 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.632+0000 7f1e6a43f640 10 librados: watch_flush enter 2026-02-17T11:12:19.636 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.632+0000 7f1e6a43f640 10 librados: watch_flush exit 2026-02-17T11:12:19.636 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.632+0000 7f1e6a43f640 20 client.4815.objecter shutdown clearing up homeless session... 2026-02-17T11:12:19.636 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.632+0000 7f1e6a43f640 10 client.4815.objecter successfully canceled tick 2026-02-17T11:12:19.636 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.632+0000 7f1e6a43f640 1 -- 10.20.193.49:0/2927776459 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f1e34079190 msgr2=0x7f1e3407b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:19.637 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.632+0000 7f1e6a43f640 1 --2- 10.20.193.49:0/2927776459 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f1e34079190 0x7f1e3407b650 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1e64073870 tx=0x7f1e54033000 comp rx=0 tx=0).stop 2026-02-17T11:12:19.637 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.632+0000 7f1e6a43f640 10 monclient: shutdown 2026-02-17T11:12:19.637 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.632+0000 7f1e6a43f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:12:19.637 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.632+0000 7f1e6a43f640 1 -- 10.20.193.49:0/2927776459 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1e640686b0 msgr2=0x7f1e640717c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:19.637 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.632+0000 7f1e6a43f640 1 --2- 10.20.193.49:0/2927776459 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1e640686b0 0x7f1e640717c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1e5000ebe0 tx=0x7f1e5000c520 comp rx=0 tx=0).stop 2026-02-17T11:12:19.637 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.632+0000 7f1e6a43f640 1 -- 10.20.193.49:0/2927776459 shutdown_connections 2026-02-17T11:12:19.637 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.632+0000 7f1e6a43f640 1 --2- 10.20.193.49:0/2927776459 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f1e34079190 0x7f1e3407b650 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:19.637 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.632+0000 7f1e6a43f640 1 --2- 10.20.193.49:0/2927776459 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f1e6415be30 0x7f1e641f4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:19.637 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.632+0000 7f1e6a43f640 1 --2- 10.20.193.49:0/2927776459 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f1e6406f530 0x7f1e641f3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:19.637 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.632+0000 7f1e6a43f640 1 --2- 10.20.193.49:0/2927776459 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1e640686b0 0x7f1e640717c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:19.637 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.632+0000 7f1e6a43f640 1 -- 10.20.193.49:0/2927776459 >> 10.20.193.49:0/2927776459 conn(0x7f1e640cb3a0 msgr2=0x7f1e641558b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:12:19.638 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.632+0000 7f1e6a43f640 1 -- 10.20.193.49:0/2927776459 shutdown_connections 2026-02-17T11:12:19.638 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.632+0000 7f1e6a43f640 1 -- 10.20.193.49:0/2927776459 wait complete. 2026-02-17T11:12:19.638 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:19.632+0000 7f1e6a43f640 1 librados: shutdown 2026-02-17T11:12:22.644 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:12:22.713 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.710+0000 7f8daff6a640 10 monclient: get_monmap_and_config 2026-02-17T11:12:22.713 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.710+0000 7f8daff6a640 10 monclient: build_initial_monmap 2026-02-17T11:12:22.713 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.711+0000 7f8daff6a640 10 monclient: monmap: 2026-02-17T11:12:22.714 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:12:22.714 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:22.714 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:12:22.712509+0000 2026-02-17T11:12:22.714 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:12:22.712509+0000 2026-02-17T11:12:22.714 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:12:22.714 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:22.714 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:12:22.714 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:12:22.714 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:12:22.714 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:12:22.714 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:12:22.714 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:12:22.715 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:22.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.711+0000 7f8daff6a640 1 Processor -- start 2026-02-17T11:12:22.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.711+0000 7f8daff6a640 1 -- start start 2026-02-17T11:12:22.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.711+0000 7f8daff6a640 10 monclient: init 2026-02-17T11:12:22.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.712+0000 7f8daff6a640 10 monclient: _reopen_session rank -1 2026-02-17T11:12:22.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.712+0000 7f8daff6a640 10 monclient: _add_conns ranks=[2,0,5,4,1,3] 2026-02-17T11:12:22.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.712+0000 7f8daff6a640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f8da815d370 addr v1:10.20.193.157:6789/0 2026-02-17T11:12:22.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.712+0000 7f8daff6a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f8da80c7e20 addr v1:10.20.193.49:6789/0 2026-02-17T11:12:22.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.712+0000 7f8daff6a640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f8da80c59c0 0x7f8da815d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:22.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.712+0000 7f8daff6a640 10 monclient(hunting): picked mon.noname-c con 0x7f8da80c59c0 addr v2:10.20.193.157:3300/0 2026-02-17T11:12:22.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.712+0000 7f8daff6a640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8da80c8350 con 0x7f8da80c7e20 2026-02-17T11:12:22.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.712+0000 7f8daff6a640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8da80c8630 con 0x7f8da815d370 2026-02-17T11:12:22.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.712+0000 7f8daff6a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:22.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.712+0000 7f8daff6a640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f8da815b710 con 0x7f8da80c59c0 2026-02-17T11:12:22.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.712+0000 7f8daff6a640 10 monclient(hunting): _renew_subs 2026-02-17T11:12:22.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.712+0000 7f8daff6a640 10 monclient(hunting): authenticate will time out at 1219.376090s 2026-02-17T11:12:22.719 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.712+0000 7f8dad4de640 1 --1- >> v1:10.20.193.49:6789/0 conn(0x7f8da80c7e20 0x7f8da80c52b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.49:6789/0 says I am v1:10.20.193.49:58692/0 (socket says 10.20.193.49:58692) 2026-02-17T11:12:22.719 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.712+0000 7f8dad4de640 1 -- 10.20.193.49:0/1476342602 learned_addr learned my addr 10.20.193.49:0/1476342602 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:12:22.719 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.712+0000 7f8dae4e0640 1 --2- 10.20.193.49:0/1476342602 >> v2:10.20.193.157:3300/0 conn(0x7f8da80c59c0 0x7f8da815d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:22.719 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.713+0000 7f8dae4e0640 10 monclient(hunting): get_auth_request con 0x7f8da80c59c0 auth_method 0 2026-02-17T11:12:22.719 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.713+0000 7f8dae4e0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:22.719 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.713+0000 7f8dae4e0640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:22.719 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.713+0000 7f8dae4e0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:22.719 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.713+0000 7f8dae4e0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:22.719 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.713+0000 7f8dae4e0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:22.719 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.713+0000 7f8dae4e0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:22.719 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.713+0000 7f8daccdd640 1 -- 10.20.193.49:0/1476342602 <== mon.0 v1:10.20.193.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1034337 0 0) 0x7f8da80c8350 con 0x7f8da80c7e20 2026-02-17T11:12:22.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.713+0000 7f8daccdd640 10 monclient(hunting): _negotiate 2026-02-17T11:12:22.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.713+0000 7f8daccdd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:22.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.713+0000 7f8daccdd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:22.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.713+0000 7f8daccdd640 10 monclient(hunting): my global_id is 4818 2026-02-17T11:12:22.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.713+0000 7f8daccdd640 1 -- 10.20.193.49:0/1476342602 --> v1:10.20.193.49:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d90003620 con 0x7f8da80c7e20 2026-02-17T11:12:22.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.714+0000 7f8dae4e0640 10 monclient(hunting): handle_auth_done global_id 4802 payload 274 2026-02-17T11:12:22.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.714+0000 7f8dae4e0640 1 -- 10.20.193.49:0/1476342602 >> v1:10.20.193.157:6789/0 conn(0x7f8da815d370 legacy=0x7f8da815b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:22.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.714+0000 7f8dae4e0640 1 -- 10.20.193.49:0/1476342602 >> v1:10.20.193.49:6789/0 conn(0x7f8da80c7e20 legacy=0x7f8da80c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:22.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.714+0000 7f8dae4e0640 10 monclient: _finish_hunting 0 2026-02-17T11:12:22.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.714+0000 7f8dae4e0640 1 monclient: found mon.noname-c 2026-02-17T11:12:22.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.714+0000 7f8dae4e0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:12:22.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.714+0000 7f8dae4e0640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:12:22.721 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.714+0000 7f8dae4e0640 1 -- 10.20.193.49:0/1476342602 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8da80c8910 con 0x7f8da80c59c0 2026-02-17T11:12:22.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.716+0000 7f8dae4e0640 1 --2- 10.20.193.49:0/1476342602 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f8da80c59c0 0x7f8da815d750 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8da4009d90 tx=0x7f8da402f230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36fd14c066c73cd9 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:12:22.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.718+0000 7f8daccdd640 1 -- 10.20.193.49:0/1476342602 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da403c070 con 0x7f8da80c59c0 2026-02-17T11:12:22.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.718+0000 7f8daccdd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:22.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.718+0000 7f8daccdd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:12:22.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.718+0000 7f8daccdd640 10 monclient: dump: 2026-02-17T11:12:22.728 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:22.728 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:22.728 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:22.728 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:22.728 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:22.729 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:22.729 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:22.729 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:22.729 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:22.729 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:22.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.718+0000 7f8daccdd640 10 monclient: _finish_auth 0 2026-02-17T11:12:22.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.718+0000 7f8daccdd640 10 monclient: _check_auth_tickets 2026-02-17T11:12:22.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.718+0000 7f8daccdd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:12:22.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.718+0000 7f8daccdd640 1 -- 10.20.193.49:0/1476342602 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8da4037440 con 0x7f8da80c59c0 2026-02-17T11:12:22.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.718+0000 7f8daff6a640 5 monclient: authenticate success, global_id 4802 2026-02-17T11:12:22.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.718+0000 7f8daff6a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:12:22.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.718+0000 7f8daccdd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:12:22.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.718+0000 7f8daccdd640 1 -- 10.20.193.49:0/1476342602 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da4037810 con 0x7f8da80c59c0 2026-02-17T11:12:22.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.718+0000 7f8daff6a640 10 monclient: get_monmap_and_config success 2026-02-17T11:12:22.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.718+0000 7f8daff6a640 4 set_mon_vals no callback set 2026-02-17T11:12:22.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.718+0000 7f8daccdd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:22.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.718+0000 7f8daccdd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:12:22.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.718+0000 7f8daccdd640 10 monclient: dump: 2026-02-17T11:12:22.730 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:22.730 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:22.730 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:22.730 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:22.730 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:22.731 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:22.731 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:22.731 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:22.731 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:22.731 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:22.731 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.718+0000 7f8daff6a640 10 monclient: shutdown 2026-02-17T11:12:22.731 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.718+0000 7f8daff6a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:12:22.731 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.718+0000 7f8daff6a640 1 -- 10.20.193.49:0/1476342602 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f8da80c59c0 msgr2=0x7f8da815d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:22.731 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.718+0000 7f8daff6a640 1 --2- 10.20.193.49:0/1476342602 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f8da80c59c0 0x7f8da815d750 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8da4009d90 tx=0x7f8da402f230 comp rx=0 tx=0).stop 2026-02-17T11:12:22.732 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.718+0000 7f8daff6a640 1 -- 10.20.193.49:0/1476342602 shutdown_connections 2026-02-17T11:12:22.732 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.718+0000 7f8daff6a640 1 --2- 10.20.193.49:0/1476342602 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f8da80c59c0 0x7f8da815d750 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:22.732 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.718+0000 7f8daff6a640 1 -- 10.20.193.49:0/1476342602 >> 10.20.193.49:0/1476342602 conn(0x7f8da80c9f20 msgr2=0x7f8da80ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:12:22.732 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.718+0000 7f8daff6a640 1 -- 10.20.193.49:0/1476342602 shutdown_connections 2026-02-17T11:12:22.732 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.718+0000 7f8daff6a640 1 -- 10.20.193.49:0/1476342602 wait complete. 2026-02-17T11:12:22.732 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.719+0000 7f8daff6a640 10 monclient: build_initial_monmap 2026-02-17T11:12:22.732 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.719+0000 7f8daff6a640 10 monclient: monmap: 2026-02-17T11:12:22.732 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:12:22.732 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:12:22.732 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:12:22.733 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:12:22.733 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:12:22.733 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:22.733 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:12:22.733 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:12:22.733 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:12:22.733 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:22.733 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.719+0000 7f8daff6a640 1 librados: starting msgr at 2026-02-17T11:12:22.733 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.719+0000 7f8daff6a640 1 librados: starting objecter 2026-02-17T11:12:22.733 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.719+0000 7f8daff6a640 1 Processor -- start 2026-02-17T11:12:22.733 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.719+0000 7f8daff6a640 1 -- start start 2026-02-17T11:12:22.733 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.719+0000 7f8daff6a640 1 librados: setting wanted keys 2026-02-17T11:12:22.733 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.719+0000 7f8daff6a640 1 librados: calling monclient init 2026-02-17T11:12:22.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.719+0000 7f8daff6a640 10 monclient: init 2026-02-17T11:12:22.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.719+0000 7f8daff6a640 10 monclient: _reopen_session rank -1 2026-02-17T11:12:22.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.719+0000 7f8daff6a640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:12:22.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.719+0000 7f8daff6a640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f8da80c59c0 0x7f8da81f44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:22.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.719+0000 7f8daff6a640 10 monclient(hunting): picked mon.noname-c con 0x7f8da80c59c0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:12:22.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.719+0000 7f8daff6a640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f8da80c7e20 0x7f8da8073d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:22.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.719+0000 7f8daff6a640 10 monclient(hunting): picked mon.noname-a con 0x7f8da80c7e20 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:12:22.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.719+0000 7f8daff6a640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f8da815d370 0x7f8da81f32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:22.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.719+0000 7f8daff6a640 10 monclient(hunting): picked mon.noname-b con 0x7f8da815d370 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:12:22.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.719+0000 7f8daff6a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:22.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.719+0000 7f8daff6a640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8da80c8ed0 con 0x7f8da80c7e20 2026-02-17T11:12:22.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.719+0000 7f8daff6a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:22.735 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.719+0000 7f8daff6a640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f8da80c9240 con 0x7f8da815d370 2026-02-17T11:12:22.735 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.719+0000 7f8daff6a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:22.735 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.719+0000 7f8daff6a640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f8da80c96d0 con 0x7f8da80c59c0 2026-02-17T11:12:22.735 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.719+0000 7f8daff6a640 10 monclient(hunting): _renew_subs 2026-02-17T11:12:22.735 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.719+0000 7f8daff6a640 10 monclient(hunting): authenticate will time out at 1219.383853s 2026-02-17T11:12:22.735 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.720+0000 7f8dad4de640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f8da80c7e20 0x7f8da8073d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:22.735 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.720+0000 7f8dadcdf640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f8da80c59c0 0x7f8da81f44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:22.735 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.720+0000 7f8dad4de640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f8da80c7e20 0x7f8da8073d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:45190/0 (socket says 10.20.193.49:45190) 2026-02-17T11:12:22.735 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.720+0000 7f8dad4de640 1 -- 10.20.193.49:0/2550454109 learned_addr learned my addr 10.20.193.49:0/2550454109 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:12:22.735 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.720+0000 7f8dad4de640 10 monclient(hunting): get_auth_request con 0x7f8da80c7e20 auth_method 0 2026-02-17T11:12:22.735 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.720+0000 7f8dad4de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:22.735 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.720+0000 7f8dad4de640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:22.736 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.720+0000 7f8dae4e0640 1 --2- 10.20.193.49:0/2550454109 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f8da815d370 0x7f8da81f32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:22.736 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.720+0000 7f8dad4de640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:22.736 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.720+0000 7f8dadcdf640 10 monclient(hunting): get_auth_request con 0x7f8da80c59c0 auth_method 0 2026-02-17T11:12:22.736 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.720+0000 7f8dadcdf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:22.736 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.720+0000 7f8dadcdf640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:22.736 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.720+0000 7f8dadcdf640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:22.736 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.720+0000 7f8dae4e0640 10 monclient(hunting): get_auth_request con 0x7f8da815d370 auth_method 0 2026-02-17T11:12:22.736 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.720+0000 7f8dae4e0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:22.736 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.720+0000 7f8dae4e0640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:22.736 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.720+0000 7f8dae4e0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:22.736 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.720+0000 7f8dad4de640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:22.736 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.720+0000 7f8dad4de640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:22.736 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.720+0000 7f8dad4de640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:22.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.720+0000 7f8dadcdf640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:22.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.720+0000 7f8dadcdf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:22.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.720+0000 7f8dadcdf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:22.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.720+0000 7f8dae4e0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:22.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.720+0000 7f8dae4e0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:22.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.720+0000 7f8dae4e0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:22.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.722+0000 7f8dadcdf640 10 monclient(hunting): handle_auth_done global_id 4808 payload 824 2026-02-17T11:12:22.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.722+0000 7f8dadcdf640 1 -- 10.20.193.49:0/2550454109 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f8da815d370 msgr2=0x7f8da81f32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:22.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.722+0000 7f8dadcdf640 1 --2- 10.20.193.49:0/2550454109 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f8da815d370 0x7f8da81f32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:22.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.722+0000 7f8dadcdf640 1 -- 10.20.193.49:0/2550454109 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f8da80c7e20 msgr2=0x7f8da8073d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:22.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.722+0000 7f8dadcdf640 1 --2- 10.20.193.49:0/2550454109 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f8da80c7e20 0x7f8da8073d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:22.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.722+0000 7f8dadcdf640 10 monclient: _finish_hunting 0 2026-02-17T11:12:22.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.722+0000 7f8dadcdf640 1 monclient: found mon.noname-c 2026-02-17T11:12:22.738 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.722+0000 7f8dadcdf640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:12:22.738 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.722+0000 7f8dadcdf640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:12:22.738 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.722+0000 7f8dadcdf640 1 -- 10.20.193.49:0/2550454109 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8da8072a10 con 0x7f8da80c59c0 2026-02-17T11:12:22.738 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.723+0000 7f8dadcdf640 1 --2- 10.20.193.49:0/2550454109 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f8da80c59c0 0x7f8da81f44a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8d9800c510 tx=0x7f8d9800c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:12:22.738 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.723+0000 7f8d967fc640 10 client.?.objecter ms_handle_connect 0x7f8da80c59c0 2026-02-17T11:12:22.738 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.723+0000 7f8d967fc640 10 client.?.objecter resend_mon_ops 2026-02-17T11:12:22.738 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.724+0000 7f8d967fc640 1 -- 10.20.193.49:0/2550454109 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d980052d0 con 0x7f8da80c59c0 2026-02-17T11:12:22.738 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.724+0000 7f8d967fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:22.738 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.724+0000 7f8d967fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:12:22.738 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.724+0000 7f8d967fc640 10 monclient: dump: 2026-02-17T11:12:22.738 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:22.738 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:22.739 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:22.739 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:22.739 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:22.739 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:22.739 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:22.739 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:22.739 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:22.739 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:22.739 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.724+0000 7f8d967fc640 10 monclient: _finish_auth 0 2026-02-17T11:12:22.739 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.724+0000 7f8d967fc640 10 monclient: _check_auth_tickets 2026-02-17T11:12:22.739 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.724+0000 7f8d967fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:12:22.739 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.724+0000 7f8daff6a640 5 monclient: authenticate success, global_id 4808 2026-02-17T11:12:22.739 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.724+0000 7f8daff6a640 10 monclient: _renew_subs 2026-02-17T11:12:22.740 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.724+0000 7f8daff6a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:12:22.740 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.724+0000 7f8daff6a640 1 -- 10.20.193.49:0/2550454109 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8da8072cf0 con 0x7f8da80c59c0 2026-02-17T11:12:22.740 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.724+0000 7f8daff6a640 10 client.4808.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:12:22.740 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.724+0000 7f8daff6a640 10 monclient: _renew_subs 2026-02-17T11:12:22.740 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.724+0000 7f8daff6a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:12:22.740 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.724+0000 7f8daff6a640 1 -- 10.20.193.49:0/2550454109 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8da80732b0 con 0x7f8da80c59c0 2026-02-17T11:12:22.740 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.724+0000 7f8daff6a640 1 librados: init done 2026-02-17T11:12:22.740 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.724+0000 7f8daff6a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:12:22.740 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.724+0000 7f8daff6a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:12:22.740 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.724+0000 7f8daff6a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:12:22.740 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.724+0000 7f8daff6a640 1 -- 10.20.193.49:0/2550454109 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8da815d750 con 0x7f8da80c59c0 2026-02-17T11:12:22.740 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.724+0000 7f8d967fc640 1 -- 10.20.193.49:0/2550454109 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d98005470 con 0x7f8da80c59c0 2026-02-17T11:12:22.741 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.724+0000 7f8d967fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:12:22.741 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.724+0000 7f8d967fc640 1 -- 10.20.193.49:0/2550454109 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d980038f0 con 0x7f8da80c59c0 2026-02-17T11:12:22.741 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.724+0000 7f8d967fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:22.741 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.724+0000 7f8d967fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:12:22.741 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.724+0000 7f8d967fc640 10 monclient: dump: 2026-02-17T11:12:22.741 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:22.741 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:22.741 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:22.741 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:22.741 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:22.741 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:22.741 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:22.742 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:22.742 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:22.742 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:22.742 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.724+0000 7f8d97fff640 4 set_mon_vals no callback set 2026-02-17T11:12:22.836 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.833+0000 7f8d967fc640 1 -- 10.20.193.49:0/2550454109 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f8d98003a90 con 0x7f8da80c59c0 2026-02-17T11:12:22.837 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.834+0000 7f8d967fc640 1 --2- 10.20.193.49:0/2550454109 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f8d78079140 0x7f8d7807b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:22.837 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.834+0000 7f8dad4de640 1 --2- 10.20.193.49:0/2550454109 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f8d78079140 0x7f8d7807b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:22.837 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.834+0000 7f8dad4de640 10 monclient: get_auth_request con 0x7f8d78079140 auth_method 0 2026-02-17T11:12:22.837 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.835+0000 7f8dad4de640 1 --2- 10.20.193.49:0/2550454109 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f8d78079140 0x7f8d7807b600 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8da815b340 tx=0x7f8d9c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:12:22.837 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.835+0000 7f8d967fc640 10 client.4808.objecter ms_handle_connect 0x7f8d78079140 2026-02-17T11:12:22.838 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.835+0000 7f8d967fc640 1 -- 10.20.193.49:0/2550454109 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f8d9805e220 con 0x7f8da80c59c0 2026-02-17T11:12:22.838 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.835+0000 7f8d967fc640 10 client.4808.objecter ms_dispatch2 0x7f8da8000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:12:22.838 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.836+0000 7f8d967fc640 3 client.4808.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:12:22.838 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.836+0000 7f8d967fc640 3 client.4808.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:12:22.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.836+0000 7f8d967fc640 20 client.4808.objecter dump_active .. 0 homeless 2026-02-17T11:12:22.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.843+0000 7f8d967fc640 1 -- 10.20.193.49:0/2550454109 <== mon.2 v2:10.20.193.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f8d980621e0 con 0x7f8da80c59c0 2026-02-17T11:12:22.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.843+0000 7f8d967fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:12:22.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.843+0000 7f8d967fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:12:22.943 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.940+0000 7f8daff6a640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:12:22.943 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.940+0000 7f8daff6a640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:12:22.943 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.940+0000 7f8daff6a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:12:22.943 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.940+0000 7f8daff6a640 1 -- 10.20.193.49:0/2550454109 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f8da81503a0 con 0x7f8da80c59c0 2026-02-17T11:12:22.946 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.944+0000 7f8d967fc640 1 -- 10.20.193.49:0/2550454109 <== mon.2 v2:10.20.193.157:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f8d980664e0 con 0x7f8da80c59c0 2026-02-17T11:12:22.946 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.944+0000 7f8d967fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:12:22.946 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.944+0000 7f8d967fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:12:22.946 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:12:22.946 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:12:22.948 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.944+0000 7f8daff6a640 10 librados: watch_flush enter 2026-02-17T11:12:22.948 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.944+0000 7f8daff6a640 10 librados: watch_flush exit 2026-02-17T11:12:22.948 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.944+0000 7f8daff6a640 20 client.4808.objecter shutdown clearing up homeless session... 2026-02-17T11:12:22.949 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.944+0000 7f8daff6a640 10 client.4808.objecter successfully canceled tick 2026-02-17T11:12:22.949 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.944+0000 7f8daff6a640 1 -- 10.20.193.49:0/2550454109 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f8d78079140 msgr2=0x7f8d7807b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:22.949 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.944+0000 7f8daff6a640 1 --2- 10.20.193.49:0/2550454109 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f8d78079140 0x7f8d7807b600 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8da815b340 tx=0x7f8d9c009040 comp rx=0 tx=0).stop 2026-02-17T11:12:22.949 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.944+0000 7f8daff6a640 10 monclient: shutdown 2026-02-17T11:12:22.949 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.944+0000 7f8daff6a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:12:22.949 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.944+0000 7f8daff6a640 1 -- 10.20.193.49:0/2550454109 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f8da80c59c0 msgr2=0x7f8da81f44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:22.949 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.944+0000 7f8daff6a640 1 --2- 10.20.193.49:0/2550454109 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f8da80c59c0 0x7f8da81f44a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8d9800c510 tx=0x7f8d9800c9e0 comp rx=0 tx=0).stop 2026-02-17T11:12:22.949 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.944+0000 7f8daff6a640 1 -- 10.20.193.49:0/2550454109 shutdown_connections 2026-02-17T11:12:22.949 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.944+0000 7f8daff6a640 1 --2- 10.20.193.49:0/2550454109 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f8d78079140 0x7f8d7807b600 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:22.949 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.944+0000 7f8daff6a640 1 --2- 10.20.193.49:0/2550454109 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f8da815d370 0x7f8da81f32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:22.950 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.944+0000 7f8daff6a640 1 --2- 10.20.193.49:0/2550454109 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f8da80c7e20 0x7f8da8073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:22.950 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.944+0000 7f8daff6a640 1 --2- 10.20.193.49:0/2550454109 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f8da80c59c0 0x7f8da81f44a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:22.950 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.944+0000 7f8daff6a640 1 -- 10.20.193.49:0/2550454109 >> 10.20.193.49:0/2550454109 conn(0x7f8da80c9f20 msgr2=0x7f8da8151640 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:12:22.950 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.945+0000 7f8daff6a640 1 -- 10.20.193.49:0/2550454109 shutdown_connections 2026-02-17T11:12:22.950 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.945+0000 7f8daff6a640 1 -- 10.20.193.49:0/2550454109 wait complete. 2026-02-17T11:12:22.950 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:22.945+0000 7f8daff6a640 1 librados: shutdown 2026-02-17T11:12:25.956 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:12:26.023 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.022+0000 7fe60a1de640 10 monclient: get_monmap_and_config 2026-02-17T11:12:26.024 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.022+0000 7fe60a1de640 10 monclient: build_initial_monmap 2026-02-17T11:12:26.024 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.022+0000 7fe60a1de640 10 monclient: monmap: 2026-02-17T11:12:26.024 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:12:26.024 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:26.024 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:12:26.022900+0000 2026-02-17T11:12:26.024 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:12:26.022900+0000 2026-02-17T11:12:26.024 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:12:26.025 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:26.025 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:12:26.025 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:12:26.025 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:12:26.025 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:12:26.025 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:12:26.025 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:12:26.025 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:26.027 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.022+0000 7fe60a1de640 1 Processor -- start 2026-02-17T11:12:26.028 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.022+0000 7fe60a1de640 1 -- start start 2026-02-17T11:12:26.028 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.022+0000 7fe60a1de640 10 monclient: init 2026-02-17T11:12:26.028 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.023+0000 7fe60a1de640 10 monclient: _reopen_session rank -1 2026-02-17T11:12:26.028 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.023+0000 7fe60a1de640 10 monclient: _add_conns ranks=[4,0,1,2,5,3] 2026-02-17T11:12:26.028 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.023+0000 7fe60a1de640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7fe6040c7170 0x7fe6040c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:26.028 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.023+0000 7fe60a1de640 10 monclient(hunting): picked mon.noname-b con 0x7fe6040c7170 addr v2:10.20.193.97:3300/0 2026-02-17T11:12:26.028 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.023+0000 7fe60a1de640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe6040c48c0 addr v1:10.20.193.49:6789/0 2026-02-17T11:12:26.028 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.023+0000 7fe60a1de640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fe6040c4d10 addr v1:10.20.193.97:6789/0 2026-02-17T11:12:26.028 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.023+0000 7fe60a1de640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe60415a9a0 con 0x7fe6040c48c0 2026-02-17T11:12:26.029 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.023+0000 7fe60a1de640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6040c5270 con 0x7fe6040c4d10 2026-02-17T11:12:26.029 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.023+0000 7fe60a1de640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:26.029 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.023+0000 7fe60a1de640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7fe6040c8530 con 0x7fe6040c7170 2026-02-17T11:12:26.029 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.023+0000 7fe60a1de640 10 monclient(hunting): _renew_subs 2026-02-17T11:12:26.029 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.023+0000 7fe60a1de640 10 monclient(hunting): authenticate will time out at 1222.686476s 2026-02-17T11:12:26.029 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.023+0000 7fe602ffd640 1 --1- >> v1:10.20.193.49:6789/0 conn(0x7fe6040c48c0 0x7fe6040749b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.49:6789/0 says I am v1:10.20.193.49:58706/0 (socket says 10.20.193.49:58706) 2026-02-17T11:12:26.029 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.023+0000 7fe602ffd640 1 -- 10.20.193.49:0/1527723204 learned_addr learned my addr 10.20.193.49:0/1527723204 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:12:26.029 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.024+0000 7fe6037fe640 1 --2- 10.20.193.49:0/1527723204 >> v2:10.20.193.97:3300/0 conn(0x7fe6040c7170 0x7fe6040c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:26.029 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.024+0000 7fe6037fe640 10 monclient(hunting): get_auth_request con 0x7fe6040c7170 auth_method 0 2026-02-17T11:12:26.029 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.024+0000 7fe6037fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:26.030 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.024+0000 7fe6037fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:26.030 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.024+0000 7fe6037fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:26.030 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.025+0000 7fe6037fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:26.030 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.025+0000 7fe6037fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:26.030 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.025+0000 7fe6037fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:26.030 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.025+0000 7fe6027fc640 1 -- 10.20.193.49:0/1527723204 <== mon.0 v1:10.20.193.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1962842808 0 0) 0x7fe60415a9a0 con 0x7fe6040c48c0 2026-02-17T11:12:26.030 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.025+0000 7fe6027fc640 10 monclient(hunting): _negotiate 2026-02-17T11:12:26.030 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.025+0000 7fe6027fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:26.030 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.025+0000 7fe6027fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:26.030 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.025+0000 7fe6027fc640 10 monclient(hunting): my global_id is 4824 2026-02-17T11:12:26.030 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.025+0000 7fe6027fc640 1 -- 10.20.193.49:0/1527723204 --> v1:10.20.193.49:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe5e8003620 con 0x7fe6040c48c0 2026-02-17T11:12:26.042 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.026+0000 7fe6027fc640 1 -- 10.20.193.49:0/1527723204 <== mon.0 v1:10.20.193.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 77070163 0 0) 0x7fe5e8003620 con 0x7fe6040c48c0 2026-02-17T11:12:26.042 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.026+0000 7fe6027fc640 1 -- 10.20.193.49:0/1527723204 >> v2:10.20.193.97:3300/0 conn(0x7fe6040c7170 msgr2=0x7fe6040c7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:12:26.042 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.026+0000 7fe6027fc640 1 --2- 10.20.193.49:0/1527723204 >> v2:10.20.193.97:3300/0 conn(0x7fe6040c7170 0x7fe6040c7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:26.042 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.026+0000 7fe6027fc640 1 -- 10.20.193.49:0/1527723204 >> v1:10.20.193.97:6789/0 conn(0x7fe6040c4d10 legacy=0x7fe6040c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:26.042 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.026+0000 7fe6027fc640 10 monclient: _finish_hunting 0 2026-02-17T11:12:26.043 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.026+0000 7fe6027fc640 1 monclient: found mon.noname-a-legacy 2026-02-17T11:12:26.043 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.027+0000 7fe6027fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:12:26.043 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.027+0000 7fe6027fc640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.49:6789/0 2026-02-17T11:12:26.043 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.027+0000 7fe6027fc640 1 -- 10.20.193.49:0/1527723204 --> v1:10.20.193.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6040c5550 con 0x7fe6040c48c0 2026-02-17T11:12:26.043 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.027+0000 7fe6027fc640 10 monclient: _finish_auth 0 2026-02-17T11:12:26.043 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.027+0000 7fe6027fc640 10 monclient: _check_auth_tickets 2026-02-17T11:12:26.043 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.027+0000 7fe6027fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:12:26.043 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.027+0000 7fe60a1de640 5 monclient: authenticate success, global_id 4824 2026-02-17T11:12:26.043 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.027+0000 7fe6027fc640 1 -- 10.20.193.49:0/1527723204 <== mon.0 v1:10.20.193.49:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2462710995 0 0) 0x7fe5f4002f00 con 0x7fe6040c48c0 2026-02-17T11:12:26.043 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.027+0000 7fe60a1de640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:12:26.043 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.027+0000 7fe6027fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:26.043 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.027+0000 7fe6027fc640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T11:12:26.044 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.027+0000 7fe6027fc640 10 monclient: dump: 2026-02-17T11:12:26.044 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:26.044 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:26.044 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:26.044 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:26.044 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:26.044 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:26.044 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:26.044 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:26.044 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:26.044 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:26.044 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.027+0000 7fe6027fc640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] but i'm connected to v1:10.20.193.49:6789/0, reconnecting 2026-02-17T11:12:26.045 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.027+0000 7fe6027fc640 10 monclient: _reopen_session rank -1 2026-02-17T11:12:26.045 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.027+0000 7fe6027fc640 1 -- 10.20.193.49:0/1527723204 >> v1:10.20.193.49:6789/0 conn(0x7fe6040c48c0 legacy=0x7fe6040749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:26.045 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.027+0000 7fe6027fc640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:12:26.045 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.027+0000 7fe6027fc640 1 --2- 10.20.193.49:0/1527723204 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe5e8003bf0 0x7fe5e8004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:26.045 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.027+0000 7fe6027fc640 10 monclient(hunting): picked mon.a con 0x7fe5e8003bf0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:12:26.045 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.027+0000 7fe6027fc640 1 --2- 10.20.193.49:0/1527723204 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe5e8004900 0x7fe5e8004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:26.045 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.027+0000 7fe6027fc640 10 monclient(hunting): picked mon.c con 0x7fe5e8004900 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:12:26.045 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.027+0000 7fe6027fc640 1 --2- 10.20.193.49:0/1527723204 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe5e80054c0 0x7fe5e800bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:26.045 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.027+0000 7fe6027fc640 10 monclient(hunting): picked mon.b con 0x7fe5e80054c0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:12:26.045 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.027+0000 7fe6027fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:26.045 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.027+0000 7fe6027fc640 1 -- 10.20.193.49:0/1527723204 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe6040c8530 con 0x7fe5e8003bf0 2026-02-17T11:12:26.046 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.027+0000 7fe6027fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:26.046 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.027+0000 7fe6027fc640 1 -- 10.20.193.49:0/1527723204 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e800c330 con 0x7fe5e80054c0 2026-02-17T11:12:26.046 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.027+0000 7fe6027fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:26.046 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.027+0000 7fe6027fc640 1 -- 10.20.193.49:0/1527723204 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e800c530 con 0x7fe5e8004900 2026-02-17T11:12:26.046 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.027+0000 7fe6027fc640 10 monclient(hunting): _renew_subs 2026-02-17T11:12:26.046 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.027+0000 7fe6027fc640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:12:26.046 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.027+0000 7fe60a1de640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2026-02-17T11:12:26.046 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.027+0000 7fe602ffd640 1 --2- 10.20.193.49:0/1527723204 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe5e8004900 0x7fe5e8004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:26.046 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.028+0000 7fe602ffd640 10 monclient(hunting): get_auth_request con 0x7fe5e8004900 auth_method 0 2026-02-17T11:12:26.046 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.028+0000 7fe602ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:26.046 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.028+0000 7fe602ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:26.046 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.028+0000 7fe602ffd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:12:26.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.028+0000 7fe602ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:26.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.028+0000 7fe602ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:26.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.028+0000 7fe602ffd640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:12:26.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.028+0000 7fe6037fe640 1 --2- 10.20.193.49:0/1527723204 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe5e8003bf0 0x7fe5e8004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:26.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.028+0000 7fe6037fe640 10 monclient(hunting): get_auth_request con 0x7fe5e8003bf0 auth_method 0 2026-02-17T11:12:26.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.028+0000 7fe6037fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:26.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.028+0000 7fe6037fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:26.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.028+0000 7fe6037fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:12:26.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.029+0000 7fe6037fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:26.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.029+0000 7fe6037fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:26.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.029+0000 7fe6037fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:12:26.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.029+0000 7fe603fff640 1 --2- 10.20.193.49:0/1527723204 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe5e80054c0 0x7fe5e800bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:26.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.029+0000 7fe603fff640 10 monclient(hunting): get_auth_request con 0x7fe5e80054c0 auth_method 0 2026-02-17T11:12:26.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.029+0000 7fe603fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:26.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.029+0000 7fe603fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:26.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.029+0000 7fe603fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:12:26.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.029+0000 7fe602ffd640 10 monclient(hunting): handle_auth_done global_id 4824 payload 293 2026-02-17T11:12:26.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.029+0000 7fe602ffd640 1 -- 10.20.193.49:0/1527723204 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe5e80054c0 msgr2=0x7fe5e800bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:12:26.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.029+0000 7fe602ffd640 1 --2- 10.20.193.49:0/1527723204 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe5e80054c0 0x7fe5e800bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:26.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.029+0000 7fe602ffd640 1 -- 10.20.193.49:0/1527723204 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe5e8003bf0 msgr2=0x7fe5e8004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:12:26.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.029+0000 7fe602ffd640 1 --2- 10.20.193.49:0/1527723204 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe5e8003bf0 0x7fe5e8004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:26.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.029+0000 7fe602ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:12:26.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.029+0000 7fe602ffd640 1 monclient: found mon.c 2026-02-17T11:12:26.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.029+0000 7fe602ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:12:26.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.029+0000 7fe603fff640 1 -- 10.20.193.49:0/1527723204 reap_dead start 2026-02-17T11:12:26.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.029+0000 7fe602ffd640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:12:26.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.029+0000 7fe602ffd640 1 -- 10.20.193.49:0/1527723204 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5e8003620 con 0x7fe5e8004900 2026-02-17T11:12:26.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.029+0000 7fe602ffd640 10 monclient: _finish_auth 0 2026-02-17T11:12:26.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.029+0000 7fe602ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:12:26.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.029+0000 7fe602ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:12:26.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.031+0000 7fe602ffd640 1 --2- 10.20.193.49:0/1527723204 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe5e8004900 0x7fe5e8004d80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe5f400c240 tx=0x7fe5f402f570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de4afd5521536fb9 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:12:26.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.033+0000 7fe6027fc640 1 -- 10.20.193.49:0/1527723204 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f4007d60 con 0x7fe5e8004900 2026-02-17T11:12:26.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.033+0000 7fe6027fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:26.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.033+0000 7fe6027fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:12:26.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.033+0000 7fe6027fc640 10 monclient: dump: 2026-02-17T11:12:26.049 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:26.049 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:26.050 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:26.050 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:26.050 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:26.050 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:26.050 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:26.050 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:26.050 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:26.050 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:26.050 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.033+0000 7fe60a1de640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:12:26.050 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.033+0000 7fe6027fc640 1 -- 10.20.193.49:0/1527723204 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5f4005bf0 con 0x7fe5e8004900 2026-02-17T11:12:26.050 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.033+0000 7fe6027fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:12:26.050 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.033+0000 7fe60a1de640 10 monclient: get_monmap_and_config success 2026-02-17T11:12:26.051 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.033+0000 7fe6027fc640 1 -- 10.20.193.49:0/1527723204 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f4007070 con 0x7fe5e8004900 2026-02-17T11:12:26.051 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.033+0000 7fe60a1de640 4 set_mon_vals no callback set 2026-02-17T11:12:26.051 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.033+0000 7fe6027fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:26.051 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.033+0000 7fe6027fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:12:26.051 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.033+0000 7fe6027fc640 10 monclient: dump: 2026-02-17T11:12:26.051 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:26.051 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:26.051 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:26.051 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:26.051 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:26.051 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:26.051 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:26.052 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:26.052 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:26.052 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:26.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.033+0000 7fe60a1de640 10 monclient: shutdown 2026-02-17T11:12:26.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.033+0000 7fe60a1de640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:12:26.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.033+0000 7fe60a1de640 1 -- 10.20.193.49:0/1527723204 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe5e8004900 msgr2=0x7fe5e8004d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:26.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.033+0000 7fe60a1de640 1 --2- 10.20.193.49:0/1527723204 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe5e8004900 0x7fe5e8004d80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe5f400c240 tx=0x7fe5f402f570 comp rx=0 tx=0).stop 2026-02-17T11:12:26.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.033+0000 7fe60a1de640 1 -- 10.20.193.49:0/1527723204 shutdown_connections 2026-02-17T11:12:26.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.033+0000 7fe60a1de640 1 --2- 10.20.193.49:0/1527723204 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe5e8004900 0x7fe5e8004d80 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:26.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.033+0000 7fe60a1de640 1 -- 10.20.193.49:0/1527723204 >> 10.20.193.49:0/1527723204 conn(0x7fe6040c9f40 msgr2=0x7fe6040ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:12:26.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.033+0000 7fe60a1de640 1 -- 10.20.193.49:0/1527723204 shutdown_connections 2026-02-17T11:12:26.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.033+0000 7fe60a1de640 1 -- 10.20.193.49:0/1527723204 wait complete. 2026-02-17T11:12:26.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.033+0000 7fe60a1de640 10 monclient: build_initial_monmap 2026-02-17T11:12:26.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.033+0000 7fe60a1de640 10 monclient: monmap: 2026-02-17T11:12:26.053 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:12:26.053 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:12:26.053 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:12:26.053 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:12:26.053 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:12:26.053 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:26.053 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:12:26.053 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:12:26.053 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:12:26.053 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:26.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.034+0000 7fe60a1de640 1 librados: starting msgr at 2026-02-17T11:12:26.054 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.034+0000 7fe60a1de640 1 librados: starting objecter 2026-02-17T11:12:26.054 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.034+0000 7fe60a1de640 1 Processor -- start 2026-02-17T11:12:26.054 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.034+0000 7fe60a1de640 1 -- start start 2026-02-17T11:12:26.054 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.034+0000 7fe60a1de640 1 librados: setting wanted keys 2026-02-17T11:12:26.054 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.034+0000 7fe60a1de640 1 librados: calling monclient init 2026-02-17T11:12:26.054 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.034+0000 7fe60a1de640 10 monclient: init 2026-02-17T11:12:26.054 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.034+0000 7fe60a1de640 10 monclient: _reopen_session rank -1 2026-02-17T11:12:26.054 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.034+0000 7fe60a1de640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:12:26.054 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.034+0000 7fe60a1de640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe5e8004900 0x7fe604156fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:26.054 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.034+0000 7fe60a1de640 10 monclient(hunting): picked mon.noname-a con 0x7fe5e8004900 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:12:26.054 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.034+0000 7fe60a1de640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe6041f30e0 0x7fe60414e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:26.054 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.034+0000 7fe60a1de640 10 monclient(hunting): picked mon.noname-c con 0x7fe6041f30e0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:12:26.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.034+0000 7fe60a1de640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe60414ee40 0x7fe60414ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:26.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.034+0000 7fe60a1de640 10 monclient(hunting): picked mon.noname-b con 0x7fe60414ee40 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:12:26.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.034+0000 7fe60a1de640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:26.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.034+0000 7fe60a1de640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe6040c81c0 con 0x7fe5e8004900 2026-02-17T11:12:26.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.034+0000 7fe60a1de640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:26.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.034+0000 7fe60a1de640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe6040c7ee0 con 0x7fe60414ee40 2026-02-17T11:12:26.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.034+0000 7fe60a1de640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:26.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.034+0000 7fe60a1de640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe6040c7550 con 0x7fe6041f30e0 2026-02-17T11:12:26.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.034+0000 7fe60a1de640 10 monclient(hunting): _renew_subs 2026-02-17T11:12:26.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.034+0000 7fe60a1de640 10 monclient(hunting): authenticate will time out at 1222.697576s 2026-02-17T11:12:26.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.034+0000 7fe6037fe640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe5e8004900 0x7fe604156fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:26.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.034+0000 7fe602ffd640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe6041f30e0 0x7fe60414e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:26.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.034+0000 7fe603fff640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe60414ee40 0x7fe60414ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:26.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.035+0000 7fe602ffd640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe6041f30e0 0x7fe60414e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:38728/0 (socket says 10.20.193.49:38728) 2026-02-17T11:12:26.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.035+0000 7fe602ffd640 1 -- 10.20.193.49:0/1060881029 learned_addr learned my addr 10.20.193.49:0/1060881029 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:12:26.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.035+0000 7fe602ffd640 10 monclient(hunting): get_auth_request con 0x7fe6041f30e0 auth_method 0 2026-02-17T11:12:26.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.035+0000 7fe602ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:26.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.035+0000 7fe602ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:26.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.035+0000 7fe602ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:26.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.035+0000 7fe6037fe640 10 monclient(hunting): get_auth_request con 0x7fe5e8004900 auth_method 0 2026-02-17T11:12:26.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.035+0000 7fe6037fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:26.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.035+0000 7fe6037fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:26.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.035+0000 7fe6037fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:26.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.035+0000 7fe603fff640 10 monclient(hunting): get_auth_request con 0x7fe60414ee40 auth_method 0 2026-02-17T11:12:26.057 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.035+0000 7fe603fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:26.057 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.035+0000 7fe603fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:26.057 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.035+0000 7fe603fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:26.057 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.035+0000 7fe602ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:26.057 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.035+0000 7fe602ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:26.057 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.035+0000 7fe602ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:26.057 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.035+0000 7fe6037fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:26.057 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.035+0000 7fe6037fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:26.057 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.035+0000 7fe6037fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:26.057 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.035+0000 7fe603fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:26.057 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.035+0000 7fe603fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:26.057 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.035+0000 7fe603fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:26.057 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.036+0000 7fe602ffd640 10 monclient(hunting): handle_auth_done global_id 4811 payload 824 2026-02-17T11:12:26.058 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.036+0000 7fe602ffd640 1 -- 10.20.193.49:0/1060881029 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe60414ee40 msgr2=0x7fe60414ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:26.058 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.036+0000 7fe602ffd640 1 --2- 10.20.193.49:0/1060881029 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe60414ee40 0x7fe60414ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:26.058 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.036+0000 7fe602ffd640 1 -- 10.20.193.49:0/1060881029 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe5e8004900 msgr2=0x7fe604156fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:26.058 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.036+0000 7fe602ffd640 1 --2- 10.20.193.49:0/1060881029 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe5e8004900 0x7fe604156fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:26.058 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.036+0000 7fe602ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:12:26.058 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.036+0000 7fe602ffd640 1 monclient: found mon.noname-c 2026-02-17T11:12:26.058 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.036+0000 7fe602ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:12:26.058 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.036+0000 7fe602ffd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:12:26.058 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.036+0000 7fe602ffd640 1 -- 10.20.193.49:0/1060881029 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6041f36a0 con 0x7fe6041f30e0 2026-02-17T11:12:26.058 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.037+0000 7fe602ffd640 1 --2- 10.20.193.49:0/1060881029 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe6041f30e0 0x7fe60414e900 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe5f402fa80 tx=0x7fe6040c5720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:12:26.058 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.037+0000 7fe5dffff640 10 client.?.objecter ms_handle_connect 0x7fe6041f30e0 2026-02-17T11:12:26.058 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.037+0000 7fe5dffff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:12:26.059 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.039+0000 7fe5dffff640 1 -- 10.20.193.49:0/1060881029 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f40033b0 con 0x7fe6041f30e0 2026-02-17T11:12:26.059 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.039+0000 7fe5dffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:26.059 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.039+0000 7fe5dffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:12:26.059 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.039+0000 7fe5dffff640 10 monclient: dump: 2026-02-17T11:12:26.059 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:26.059 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:26.059 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:26.059 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:26.059 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:26.059 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:26.059 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:26.059 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:26.059 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:26.060 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:26.060 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.039+0000 7fe5dffff640 10 monclient: _finish_auth 0 2026-02-17T11:12:26.060 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.039+0000 7fe5dffff640 10 monclient: _check_auth_tickets 2026-02-17T11:12:26.060 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.039+0000 7fe5dffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:12:26.060 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.039+0000 7fe5dffff640 1 -- 10.20.193.49:0/1060881029 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5f4004ae0 con 0x7fe6041f30e0 2026-02-17T11:12:26.060 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.039+0000 7fe5dffff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:12:26.060 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.039+0000 7fe5dffff640 1 -- 10.20.193.49:0/1060881029 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f4007d60 con 0x7fe6041f30e0 2026-02-17T11:12:26.060 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.039+0000 7fe5dffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:26.060 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.039+0000 7fe5dffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:12:26.060 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.039+0000 7fe5dffff640 10 monclient: dump: 2026-02-17T11:12:26.060 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:26.060 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:26.061 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:26.061 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:26.061 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:26.061 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:26.061 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:26.061 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:26.061 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:26.061 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:26.061 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.039+0000 7fe601ffb640 4 set_mon_vals no callback set 2026-02-17T11:12:26.061 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.039+0000 7fe60a1de640 5 monclient: authenticate success, global_id 4811 2026-02-17T11:12:26.061 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.039+0000 7fe60a1de640 10 monclient: _renew_subs 2026-02-17T11:12:26.061 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.039+0000 7fe60a1de640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:12:26.062 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.039+0000 7fe60a1de640 1 -- 10.20.193.49:0/1060881029 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6041f3980 con 0x7fe6041f30e0 2026-02-17T11:12:26.062 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.039+0000 7fe60a1de640 10 client.4811.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:12:26.062 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.039+0000 7fe60a1de640 10 monclient: _renew_subs 2026-02-17T11:12:26.062 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.039+0000 7fe60a1de640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:12:26.062 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.039+0000 7fe60a1de640 1 -- 10.20.193.49:0/1060881029 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6041567e0 con 0x7fe6041f30e0 2026-02-17T11:12:26.062 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.039+0000 7fe60a1de640 1 librados: init done 2026-02-17T11:12:26.062 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.040+0000 7fe60a1de640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:12:26.062 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.040+0000 7fe60a1de640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:12:26.062 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.040+0000 7fe60a1de640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:12:26.062 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.040+0000 7fe60a1de640 1 -- 10.20.193.49:0/1060881029 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6040749b0 con 0x7fe6041f30e0 2026-02-17T11:12:26.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.147+0000 7fe5dffff640 1 -- 10.20.193.49:0/1060881029 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7fe5f4053080 con 0x7fe6041f30e0 2026-02-17T11:12:26.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.147+0000 7fe5dffff640 1 --2- 10.20.193.49:0/1060881029 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fe5d4079140 0x7fe5d407b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:26.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.147+0000 7fe6037fe640 1 --2- 10.20.193.49:0/1060881029 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fe5d4079140 0x7fe5d407b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:26.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.147+0000 7fe6037fe640 10 monclient: get_auth_request con 0x7fe5d4079140 auth_method 0 2026-02-17T11:12:26.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.148+0000 7fe6037fe640 1 --2- 10.20.193.49:0/1060881029 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fe5d4079140 0x7fe5d407b600 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe60414f440 tx=0x7fe5f0009290 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:12:26.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.148+0000 7fe5dffff640 10 client.4811.objecter ms_handle_connect 0x7fe5d4079140 2026-02-17T11:12:26.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.149+0000 7fe5dffff640 1 -- 10.20.193.49:0/1060881029 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7fe5f4082cf0 con 0x7fe6041f30e0 2026-02-17T11:12:26.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.149+0000 7fe5dffff640 10 client.4811.objecter ms_dispatch2 0x7fe604000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:12:26.151 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.149+0000 7fe5dffff640 3 client.4811.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:12:26.151 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.149+0000 7fe5dffff640 3 client.4811.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:12:26.151 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.149+0000 7fe5dffff640 20 client.4811.objecter dump_active .. 0 homeless 2026-02-17T11:12:26.156 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.155+0000 7fe5dffff640 1 -- 10.20.193.49:0/1060881029 <== mon.2 v2:10.20.193.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe5f4086cb0 con 0x7fe6041f30e0 2026-02-17T11:12:26.157 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.155+0000 7fe5dffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:12:26.157 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.155+0000 7fe5dffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:12:26.254 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.252+0000 7fe60a1de640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:12:26.254 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.252+0000 7fe60a1de640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:12:26.254 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.252+0000 7fe60a1de640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:12:26.254 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.252+0000 7fe60a1de640 1 -- 10.20.193.49:0/1060881029 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe604153fc0 con 0x7fe6041f30e0 2026-02-17T11:12:26.257 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.255+0000 7fe5dffff640 1 -- 10.20.193.49:0/1060881029 <== mon.2 v2:10.20.193.157:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fe5f408afb0 con 0x7fe6041f30e0 2026-02-17T11:12:26.257 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.255+0000 7fe5dffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:12:26.257 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.255+0000 7fe5dffff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:12:26.257 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:12:26.257 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:12:26.259 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.256+0000 7fe60a1de640 10 librados: watch_flush enter 2026-02-17T11:12:26.259 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.256+0000 7fe60a1de640 10 librados: watch_flush exit 2026-02-17T11:12:26.259 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.256+0000 7fe60a1de640 20 client.4811.objecter shutdown clearing up homeless session... 2026-02-17T11:12:26.260 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.256+0000 7fe60a1de640 10 client.4811.objecter successfully canceled tick 2026-02-17T11:12:26.260 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.256+0000 7fe60a1de640 1 -- 10.20.193.49:0/1060881029 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fe5d4079140 msgr2=0x7fe5d407b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:26.260 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.256+0000 7fe60a1de640 1 --2- 10.20.193.49:0/1060881029 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fe5d4079140 0x7fe5d407b600 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe60414f440 tx=0x7fe5f0009290 comp rx=0 tx=0).stop 2026-02-17T11:12:26.260 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.256+0000 7fe60a1de640 10 monclient: shutdown 2026-02-17T11:12:26.260 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.256+0000 7fe60a1de640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:12:26.260 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.256+0000 7fe60a1de640 1 -- 10.20.193.49:0/1060881029 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe6041f30e0 msgr2=0x7fe60414e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:26.260 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.256+0000 7fe60a1de640 1 --2- 10.20.193.49:0/1060881029 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe6041f30e0 0x7fe60414e900 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe5f402fa80 tx=0x7fe6040c5720 comp rx=0 tx=0).stop 2026-02-17T11:12:26.260 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.256+0000 7fe60a1de640 1 -- 10.20.193.49:0/1060881029 shutdown_connections 2026-02-17T11:12:26.260 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.256+0000 7fe60a1de640 1 --2- 10.20.193.49:0/1060881029 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fe5d4079140 0x7fe5d407b600 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:26.260 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.256+0000 7fe60a1de640 1 --2- 10.20.193.49:0/1060881029 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe60414ee40 0x7fe60414ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:26.260 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.256+0000 7fe60a1de640 1 --2- 10.20.193.49:0/1060881029 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe6041f30e0 0x7fe60414e900 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:26.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.256+0000 7fe60a1de640 1 --2- 10.20.193.49:0/1060881029 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe5e8004900 0x7fe604156fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:26.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.256+0000 7fe60a1de640 1 -- 10.20.193.49:0/1060881029 >> 10.20.193.49:0/1060881029 conn(0x7fe6040c9f40 msgr2=0x7fe6040ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:12:26.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.256+0000 7fe60a1de640 1 -- 10.20.193.49:0/1060881029 shutdown_connections 2026-02-17T11:12:26.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.257+0000 7fe60a1de640 1 -- 10.20.193.49:0/1060881029 wait complete. 2026-02-17T11:12:26.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:26.257+0000 7fe60a1de640 1 librados: shutdown 2026-02-17T11:12:29.268 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:12:29.337 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.335+0000 7f95e0b87640 10 monclient: get_monmap_and_config 2026-02-17T11:12:29.337 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.335+0000 7f95e0b87640 10 monclient: build_initial_monmap 2026-02-17T11:12:29.337 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.335+0000 7f95e0b87640 10 monclient: monmap: 2026-02-17T11:12:29.337 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:12:29.337 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:29.337 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:12:29.335694+0000 2026-02-17T11:12:29.337 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:12:29.335694+0000 2026-02-17T11:12:29.337 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:12:29.338 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:29.338 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:12:29.338 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:12:29.338 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:12:29.338 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:12:29.338 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:12:29.338 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:12:29.338 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:29.338 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.335+0000 7f95e0b87640 1 Processor -- start 2026-02-17T11:12:29.338 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.335+0000 7f95e0b87640 1 -- start start 2026-02-17T11:12:29.338 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.335+0000 7f95e0b87640 10 monclient: init 2026-02-17T11:12:29.344 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.336+0000 7f95e0b87640 10 monclient: _reopen_session rank -1 2026-02-17T11:12:29.344 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.336+0000 7f95e0b87640 10 monclient: _add_conns ranks=[0,2,1,3,4,5] 2026-02-17T11:12:29.345 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.336+0000 7f95e0b87640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f95dc0c7170 addr v1:10.20.193.49:6789/0 2026-02-17T11:12:29.345 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.336+0000 7f95e0b87640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f95dc0c7550 addr v1:10.20.193.157:6789/0 2026-02-17T11:12:29.345 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.336+0000 7f95e0b87640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f95dc0c89c0 addr v1:10.20.193.97:6789/0 2026-02-17T11:12:29.345 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.336+0000 7f95e0b87640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95dc0c4fd0 con 0x7f95dc0c7170 2026-02-17T11:12:29.345 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.336+0000 7f95e0b87640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95dc15a9a0 con 0x7f95dc0c89c0 2026-02-17T11:12:29.345 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.336+0000 7f95e0b87640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95dc0c5270 con 0x7f95dc0c7550 2026-02-17T11:12:29.345 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.336+0000 7f95e0b87640 10 monclient(hunting): _renew_subs 2026-02-17T11:12:29.345 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.336+0000 7f95e0b87640 10 monclient(hunting): authenticate will time out at 1225.999175s 2026-02-17T11:12:29.345 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.336+0000 7f95da575640 1 --1- >> v1:10.20.193.49:6789/0 conn(0x7f95dc0c7170 0x7f95dc0c48c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.49:6789/0 says I am v1:10.20.193.49:59304/0 (socket says 10.20.193.49:59304) 2026-02-17T11:12:29.345 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.336+0000 7f95da575640 1 -- 10.20.193.49:0/1049664363 learned_addr learned my addr 10.20.193.49:0/1049664363 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:12:29.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.337+0000 7f95d9573640 1 -- 10.20.193.49:0/1049664363 <== mon.0 v1:10.20.193.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 125094445 0 0) 0x7f95dc0c4fd0 con 0x7f95dc0c7170 2026-02-17T11:12:29.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.337+0000 7f95d9573640 10 monclient(hunting): _negotiate 2026-02-17T11:12:29.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.337+0000 7f95d9573640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:29.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.337+0000 7f95d9573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:29.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.337+0000 7f95d9573640 10 monclient(hunting): my global_id is 4830 2026-02-17T11:12:29.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.337+0000 7f95d9573640 1 -- 10.20.193.49:0/1049664363 --> v1:10.20.193.49:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95c8003620 con 0x7f95dc0c7170 2026-02-17T11:12:29.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.338+0000 7f95d9573640 1 -- 10.20.193.49:0/1049664363 <== mon.2 v1:10.20.193.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3655411437 0 0) 0x7f95dc0c5270 con 0x7f95dc0c7550 2026-02-17T11:12:29.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.338+0000 7f95d9573640 10 monclient(hunting): _negotiate 2026-02-17T11:12:29.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.338+0000 7f95d9573640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:29.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.338+0000 7f95d9573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:29.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.338+0000 7f95d9573640 10 monclient(hunting): my global_id is 4814 2026-02-17T11:12:29.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.338+0000 7f95d9573640 1 -- 10.20.193.49:0/1049664363 --> v1:10.20.193.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95dc0c4fd0 con 0x7f95dc0c7550 2026-02-17T11:12:29.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.338+0000 7f95d9573640 1 -- 10.20.193.49:0/1049664363 <== mon.1 v1:10.20.193.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3555864236 0 0) 0x7f95dc15a9a0 con 0x7f95dc0c89c0 2026-02-17T11:12:29.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.338+0000 7f95d9573640 10 monclient(hunting): _negotiate 2026-02-17T11:12:29.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.338+0000 7f95d9573640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:29.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.338+0000 7f95d9573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:29.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.338+0000 7f95d9573640 10 monclient(hunting): my global_id is 4786 2026-02-17T11:12:29.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.338+0000 7f95d9573640 1 -- 10.20.193.49:0/1049664363 --> v1:10.20.193.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95dc0c5270 con 0x7f95dc0c89c0 2026-02-17T11:12:29.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.339+0000 7f95d9573640 1 -- 10.20.193.49:0/1049664363 <== mon.0 v1:10.20.193.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1709374241 0 0) 0x7f95c8003620 con 0x7f95dc0c7170 2026-02-17T11:12:29.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.339+0000 7f95d9573640 1 -- 10.20.193.49:0/1049664363 >> v1:10.20.193.157:6789/0 conn(0x7f95dc0c7550 legacy=0x7f95dc0749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:29.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.339+0000 7f95d9573640 1 -- 10.20.193.49:0/1049664363 >> v1:10.20.193.97:6789/0 conn(0x7f95dc0c89c0 legacy=0x7f95dc1646d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:29.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.339+0000 7f95d9573640 10 monclient: _finish_hunting 0 2026-02-17T11:12:29.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.339+0000 7f95d9573640 1 monclient: found mon.noname-a-legacy 2026-02-17T11:12:29.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.339+0000 7f95d9573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:12:29.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.339+0000 7f95d9573640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.49:6789/0 2026-02-17T11:12:29.348 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.339+0000 7f95d9573640 1 -- 10.20.193.49:0/1049664363 --> v1:10.20.193.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95dc0c5550 con 0x7f95dc0c7170 2026-02-17T11:12:29.348 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.339+0000 7f95d9573640 10 monclient: _finish_auth 0 2026-02-17T11:12:29.348 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.339+0000 7f95d9573640 10 monclient: _check_auth_tickets 2026-02-17T11:12:29.348 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.339+0000 7f95d9573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:12:29.348 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.339+0000 7f95d9573640 1 -- 10.20.193.49:0/1049664363 <== mon.0 v1:10.20.193.49:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2462710995 0 0) 0x7f95d0002f00 con 0x7f95dc0c7170 2026-02-17T11:12:29.348 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.339+0000 7f95e0b87640 5 monclient: authenticate success, global_id 4830 2026-02-17T11:12:29.348 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.339+0000 7f95e0b87640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:12:29.348 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.339+0000 7f95d9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:29.348 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.339+0000 7f95d9573640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T11:12:29.348 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.339+0000 7f95d9573640 10 monclient: dump: 2026-02-17T11:12:29.348 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:29.348 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:29.349 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:29.349 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:29.349 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:29.349 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:29.349 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:29.349 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:29.349 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:29.349 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:29.349 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.339+0000 7f95d9573640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] but i'm connected to v1:10.20.193.49:6789/0, reconnecting 2026-02-17T11:12:29.349 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.339+0000 7f95d9573640 10 monclient: _reopen_session rank -1 2026-02-17T11:12:29.349 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.339+0000 7f95d9573640 1 -- 10.20.193.49:0/1049664363 >> v1:10.20.193.49:6789/0 conn(0x7f95dc0c7170 legacy=0x7f95dc0c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:29.349 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.339+0000 7f95d9573640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:12:29.350 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.339+0000 7f95d9573640 1 --2- 10.20.193.49:0/1049664363 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f95c8003fe0 0x7f95c8004900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:29.350 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.339+0000 7f95d9573640 10 monclient(hunting): picked mon.c con 0x7f95c8003fe0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:12:29.350 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.339+0000 7f95d9573640 1 --2- 10.20.193.49:0/1049664363 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f95c8004e40 0x7f95c80052c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:29.350 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.339+0000 7f95d9573640 10 monclient(hunting): picked mon.b con 0x7f95c8004e40 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:12:29.350 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.339+0000 7f95d9573640 1 --2- 10.20.193.49:0/1049664363 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f95c8009ab0 0x7f95c800bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:29.350 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.339+0000 7f95d9573640 10 monclient(hunting): picked mon.a con 0x7f95c8009ab0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:12:29.350 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.339+0000 7f95d9573640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:29.350 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.339+0000 7f95d9573640 1 -- 10.20.193.49:0/1049664363 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f95c800c570 con 0x7f95c8009ab0 2026-02-17T11:12:29.350 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.339+0000 7f95d9573640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:29.350 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.339+0000 7f95d9573640 1 -- 10.20.193.49:0/1049664363 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f95c800c6f0 con 0x7f95c8004e40 2026-02-17T11:12:29.350 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.339+0000 7f95d9573640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:29.350 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.339+0000 7f95d9573640 1 -- 10.20.193.49:0/1049664363 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f95c800c8f0 con 0x7f95c8003fe0 2026-02-17T11:12:29.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.339+0000 7f95d9573640 10 monclient(hunting): _renew_subs 2026-02-17T11:12:29.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.339+0000 7f95d9573640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:12:29.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.339+0000 7f95e0b87640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2026-02-17T11:12:29.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.340+0000 7f95da575640 1 --2- 10.20.193.49:0/1049664363 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f95c8003fe0 0x7f95c8004900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:29.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.340+0000 7f95dad76640 1 --2- 10.20.193.49:0/1049664363 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f95c8009ab0 0x7f95c800bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:29.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.340+0000 7f95da575640 10 monclient(hunting): get_auth_request con 0x7f95c8003fe0 auth_method 0 2026-02-17T11:12:29.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.340+0000 7f95da575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:29.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.340+0000 7f95da575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:29.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.340+0000 7f95da575640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:12:29.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.341+0000 7f95d9d74640 1 --2- 10.20.193.49:0/1049664363 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f95c8004e40 0x7f95c80052c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:29.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.341+0000 7f95da575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:29.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.341+0000 7f95da575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:29.352 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.341+0000 7f95da575640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:12:29.352 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.341+0000 7f95d9d74640 10 monclient(hunting): get_auth_request con 0x7f95c8004e40 auth_method 0 2026-02-17T11:12:29.352 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.341+0000 7f95d9d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:29.352 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.341+0000 7f95d9d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:29.352 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.341+0000 7f95d9d74640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:12:29.352 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.341+0000 7f95d9d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:29.352 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.341+0000 7f95d9d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:29.352 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.341+0000 7f95d9d74640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:12:29.352 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.342+0000 7f95dad76640 10 monclient(hunting): get_auth_request con 0x7f95c8009ab0 auth_method 0 2026-02-17T11:12:29.352 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.342+0000 7f95dad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:29.352 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.342+0000 7f95dad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:29.352 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.342+0000 7f95dad76640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:12:29.352 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.342+0000 7f95dad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:29.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.342+0000 7f95dad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:29.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.342+0000 7f95dad76640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:12:29.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.342+0000 7f95da575640 10 monclient(hunting): handle_auth_done global_id 4830 payload 293 2026-02-17T11:12:29.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.342+0000 7f95da575640 1 -- 10.20.193.49:0/1049664363 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f95c8004e40 msgr2=0x7f95c80052c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:12:29.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.342+0000 7f95da575640 1 --2- 10.20.193.49:0/1049664363 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f95c8004e40 0x7f95c80052c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:29.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.342+0000 7f95da575640 1 -- 10.20.193.49:0/1049664363 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f95c8009ab0 msgr2=0x7f95c800bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:12:29.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.342+0000 7f95da575640 1 --2- 10.20.193.49:0/1049664363 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f95c8009ab0 0x7f95c800bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:29.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.342+0000 7f95da575640 10 monclient: _finish_hunting 0 2026-02-17T11:12:29.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.342+0000 7f95da575640 1 monclient: found mon.c 2026-02-17T11:12:29.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.342+0000 7f95da575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:12:29.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.342+0000 7f95dad76640 1 -- 10.20.193.49:0/1049664363 reap_dead start 2026-02-17T11:12:29.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.342+0000 7f95da575640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:12:29.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.342+0000 7f95da575640 1 -- 10.20.193.49:0/1049664363 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95c8003620 con 0x7f95c8003fe0 2026-02-17T11:12:29.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.342+0000 7f95da575640 10 monclient: _finish_auth 0 2026-02-17T11:12:29.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.342+0000 7f95da575640 10 monclient: _check_auth_tickets 2026-02-17T11:12:29.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.342+0000 7f95da575640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:12:29.361 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.343+0000 7f95da575640 1 --2- 10.20.193.49:0/1049664363 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f95c8003fe0 0x7f95c8004900 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f95d000c240 tx=0x7f95d002f530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca597a37c76b1a97 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:12:29.361 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.345+0000 7f95d9573640 1 -- 10.20.193.49:0/1049664363 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d0007d20 con 0x7f95c8003fe0 2026-02-17T11:12:29.361 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.345+0000 7f95d9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:29.361 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.345+0000 7f95d9573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:12:29.361 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.345+0000 7f95d9573640 10 monclient: dump: 2026-02-17T11:12:29.361 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:29.362 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:29.362 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:29.362 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:29.362 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:29.362 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:29.362 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:29.362 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:29.362 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:29.362 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:29.362 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.345+0000 7f95e0b87640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:12:29.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.345+0000 7f95d9573640 1 -- 10.20.193.49:0/1049664363 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95d0005bf0 con 0x7f95c8003fe0 2026-02-17T11:12:29.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.345+0000 7f95d9573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:12:29.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.345+0000 7f95d9573640 1 -- 10.20.193.49:0/1049664363 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d0007070 con 0x7f95c8003fe0 2026-02-17T11:12:29.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.345+0000 7f95d9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:29.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.345+0000 7f95d9573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:12:29.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.345+0000 7f95d9573640 10 monclient: dump: 2026-02-17T11:12:29.363 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:29.363 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:29.363 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:29.363 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:29.363 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:29.363 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:29.364 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:29.364 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:29.364 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:29.364 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:29.364 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.345+0000 7f95e0b87640 10 monclient: get_monmap_and_config success 2026-02-17T11:12:29.364 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.345+0000 7f95e0b87640 4 set_mon_vals no callback set 2026-02-17T11:12:29.364 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.346+0000 7f95e0b87640 10 monclient: shutdown 2026-02-17T11:12:29.364 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.346+0000 7f95e0b87640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:12:29.364 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.346+0000 7f95e0b87640 1 -- 10.20.193.49:0/1049664363 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f95c8003fe0 msgr2=0x7f95c8004900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:29.364 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.346+0000 7f95e0b87640 1 --2- 10.20.193.49:0/1049664363 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f95c8003fe0 0x7f95c8004900 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f95d000c240 tx=0x7f95d002f530 comp rx=0 tx=0).stop 2026-02-17T11:12:29.364 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.346+0000 7f95e0b87640 1 -- 10.20.193.49:0/1049664363 shutdown_connections 2026-02-17T11:12:29.364 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.346+0000 7f95e0b87640 1 --2- 10.20.193.49:0/1049664363 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f95c8003fe0 0x7f95c8004900 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:29.365 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.346+0000 7f95e0b87640 1 -- 10.20.193.49:0/1049664363 >> 10.20.193.49:0/1049664363 conn(0x7f95dc0c9f40 msgr2=0x7f95dc0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:12:29.365 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.346+0000 7f95e0b87640 1 -- 10.20.193.49:0/1049664363 shutdown_connections 2026-02-17T11:12:29.365 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.346+0000 7f95e0b87640 1 -- 10.20.193.49:0/1049664363 wait complete. 2026-02-17T11:12:29.365 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.346+0000 7f95e0b87640 10 monclient: build_initial_monmap 2026-02-17T11:12:29.365 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.346+0000 7f95e0b87640 10 monclient: monmap: 2026-02-17T11:12:29.365 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:12:29.365 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:12:29.365 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:12:29.365 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:12:29.365 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:12:29.365 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:29.365 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:12:29.365 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:12:29.366 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:12:29.366 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:29.366 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.346+0000 7f95e0b87640 1 librados: starting msgr at 2026-02-17T11:12:29.366 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.346+0000 7f95e0b87640 1 librados: starting objecter 2026-02-17T11:12:29.366 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.346+0000 7f95e0b87640 1 Processor -- start 2026-02-17T11:12:29.366 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.346+0000 7f95e0b87640 1 -- start start 2026-02-17T11:12:29.366 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.346+0000 7f95e0b87640 1 librados: setting wanted keys 2026-02-17T11:12:29.366 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.346+0000 7f95e0b87640 1 librados: calling monclient init 2026-02-17T11:12:29.366 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.346+0000 7f95e0b87640 10 monclient: init 2026-02-17T11:12:29.366 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.347+0000 7f95e0b87640 10 monclient: _reopen_session rank -1 2026-02-17T11:12:29.366 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.347+0000 7f95e0b87640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:12:29.366 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.347+0000 7f95e0b87640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f95c8003fe0 0x7f95dc1f1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:29.367 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.347+0000 7f95e0b87640 10 monclient(hunting): picked mon.noname-a con 0x7f95c8003fe0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:12:29.367 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.347+0000 7f95e0b87640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f95dc156800 0x7f95dc1f2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:29.367 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.347+0000 7f95e0b87640 10 monclient(hunting): picked mon.noname-b con 0x7f95dc156800 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:12:29.367 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.347+0000 7f95e0b87640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f95dc156c80 0x7f95dc1f31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:29.367 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.347+0000 7f95e0b87640 10 monclient(hunting): picked mon.noname-c con 0x7f95dc156c80 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:12:29.367 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.347+0000 7f95e0b87640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:29.367 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.347+0000 7f95e0b87640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f95dc0c7ee0 con 0x7f95c8003fe0 2026-02-17T11:12:29.367 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.347+0000 7f95e0b87640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:29.367 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.347+0000 7f95e0b87640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f95dc0c8530 con 0x7f95dc156800 2026-02-17T11:12:29.367 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.347+0000 7f95e0b87640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:29.367 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.347+0000 7f95e0b87640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f95dc0c81c0 con 0x7f95dc156c80 2026-02-17T11:12:29.367 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.347+0000 7f95e0b87640 10 monclient(hunting): _renew_subs 2026-02-17T11:12:29.367 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.347+0000 7f95e0b87640 10 monclient(hunting): authenticate will time out at 1226.010317s 2026-02-17T11:12:29.368 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.347+0000 7f95d9d74640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f95dc156800 0x7f95dc1f2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:29.368 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.347+0000 7f95dad76640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f95dc156c80 0x7f95dc1f31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:29.368 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.347+0000 7f95da575640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f95c8003fe0 0x7f95dc1f1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:29.368 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.347+0000 7f95d9d74640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f95dc156800 0x7f95dc1f2cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:55890/0 (socket says 10.20.193.49:55890) 2026-02-17T11:12:29.368 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.347+0000 7f95d9d74640 1 -- 10.20.193.49:0/812586621 learned_addr learned my addr 10.20.193.49:0/812586621 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:12:29.368 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.347+0000 7f95d9d74640 10 monclient(hunting): get_auth_request con 0x7f95dc156800 auth_method 0 2026-02-17T11:12:29.368 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.347+0000 7f95d9d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:29.368 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.347+0000 7f95d9d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:29.368 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.347+0000 7f95d9d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:29.368 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.347+0000 7f95da575640 10 monclient(hunting): get_auth_request con 0x7f95c8003fe0 auth_method 0 2026-02-17T11:12:29.368 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.347+0000 7f95da575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:29.369 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.347+0000 7f95da575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:29.369 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.347+0000 7f95da575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:29.369 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.347+0000 7f95dad76640 10 monclient(hunting): get_auth_request con 0x7f95dc156c80 auth_method 0 2026-02-17T11:12:29.369 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.347+0000 7f95dad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:29.369 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.347+0000 7f95dad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:29.369 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.347+0000 7f95dad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:29.369 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.347+0000 7f95d9d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:29.369 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.347+0000 7f95d9d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:29.369 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.347+0000 7f95d9d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:29.369 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.348+0000 7f95da575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:29.369 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.348+0000 7f95da575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:29.369 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.348+0000 7f95da575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:29.369 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.348+0000 7f95dad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:29.370 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.348+0000 7f95dad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:29.370 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.348+0000 7f95dad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:29.370 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.349+0000 7f95d9d74640 10 monclient(hunting): handle_auth_done global_id 4789 payload 824 2026-02-17T11:12:29.370 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.349+0000 7f95d9d74640 1 -- 10.20.193.49:0/812586621 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f95dc156c80 msgr2=0x7f95dc1f31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:29.370 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.349+0000 7f95d9d74640 1 --2- 10.20.193.49:0/812586621 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f95dc156c80 0x7f95dc1f31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:29.370 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.349+0000 7f95d9d74640 1 -- 10.20.193.49:0/812586621 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f95c8003fe0 msgr2=0x7f95dc1f1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:29.370 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.349+0000 7f95d9d74640 1 --2- 10.20.193.49:0/812586621 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f95c8003fe0 0x7f95dc1f1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:29.370 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.349+0000 7f95d9d74640 10 monclient: _finish_hunting 0 2026-02-17T11:12:29.370 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.349+0000 7f95d9d74640 1 monclient: found mon.noname-b 2026-02-17T11:12:29.370 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.349+0000 7f95d9d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:12:29.370 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.349+0000 7f95d9d74640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:12:29.370 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.349+0000 7f95d9d74640 1 -- 10.20.193.49:0/812586621 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95dc1f21f0 con 0x7f95dc156800 2026-02-17T11:12:29.370 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.350+0000 7f95d9d74640 1 --2- 10.20.193.49:0/812586621 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f95dc156800 0x7f95dc1f2cb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f95c400ead0 tx=0x7f95c40056d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:12:29.371 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.350+0000 7f95c2ffd640 10 client.?.objecter ms_handle_connect 0x7f95dc156800 2026-02-17T11:12:29.371 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.350+0000 7f95c2ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:12:29.371 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.351+0000 7f95c2ffd640 1 -- 10.20.193.49:0/812586621 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c400c920 con 0x7f95dc156800 2026-02-17T11:12:29.371 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.351+0000 7f95c2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:29.371 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.351+0000 7f95c2ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:12:29.371 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.351+0000 7f95c2ffd640 10 monclient: dump: 2026-02-17T11:12:29.371 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:29.371 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:29.371 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:29.371 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:29.371 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:29.371 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:29.371 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:29.372 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:29.372 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:29.372 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:29.372 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.351+0000 7f95c2ffd640 10 monclient: _finish_auth 0 2026-02-17T11:12:29.372 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.351+0000 7f95c2ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:12:29.372 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.351+0000 7f95c2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:12:29.372 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.351+0000 7f95e0b87640 5 monclient: authenticate success, global_id 4789 2026-02-17T11:12:29.372 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.351+0000 7f95e0b87640 10 monclient: _renew_subs 2026-02-17T11:12:29.372 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.351+0000 7f95e0b87640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:12:29.372 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.351+0000 7f95e0b87640 1 -- 10.20.193.49:0/812586621 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95dc0c1ca0 con 0x7f95dc156800 2026-02-17T11:12:29.372 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.351+0000 7f95e0b87640 10 client.4789.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:12:29.372 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.351+0000 7f95e0b87640 10 monclient: _renew_subs 2026-02-17T11:12:29.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.351+0000 7f95e0b87640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:12:29.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.351+0000 7f95e0b87640 1 -- 10.20.193.49:0/812586621 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95dc0c2260 con 0x7f95dc156800 2026-02-17T11:12:29.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.351+0000 7f95e0b87640 1 librados: init done 2026-02-17T11:12:29.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.351+0000 7f95e0b87640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:12:29.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.351+0000 7f95e0b87640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:12:29.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.351+0000 7f95e0b87640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:12:29.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.351+0000 7f95e0b87640 1 -- 10.20.193.49:0/812586621 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95dc0c8e70 con 0x7f95dc156800 2026-02-17T11:12:29.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.352+0000 7f95c2ffd640 1 -- 10.20.193.49:0/812586621 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95c4018070 con 0x7f95dc156800 2026-02-17T11:12:29.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.352+0000 7f95c2ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:12:29.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.352+0000 7f95c2ffd640 1 -- 10.20.193.49:0/812586621 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c400ccc0 con 0x7f95dc156800 2026-02-17T11:12:29.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.352+0000 7f95c2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:29.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.352+0000 7f95c2ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:12:29.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.352+0000 7f95c2ffd640 10 monclient: dump: 2026-02-17T11:12:29.373 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:29.374 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:29.374 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:29.374 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:29.374 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:29.374 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:29.374 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:29.374 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:29.374 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:29.374 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:29.374 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.352+0000 7f95d8d72640 4 set_mon_vals no callback set 2026-02-17T11:12:29.461 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.459+0000 7f95c2ffd640 1 -- 10.20.193.49:0/812586621 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f95c40068d0 con 0x7f95dc156800 2026-02-17T11:12:29.461 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.460+0000 7f95c2ffd640 1 --2- 10.20.193.49:0/812586621 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f95a8079170 0x7f95a807b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:29.462 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.460+0000 7f95da575640 1 --2- 10.20.193.49:0/812586621 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f95a8079170 0x7f95a807b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:29.462 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.460+0000 7f95da575640 10 monclient: get_auth_request con 0x7f95a8079170 auth_method 0 2026-02-17T11:12:29.463 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.460+0000 7f95c2ffd640 10 client.4789.objecter ms_handle_connect 0x7f95a8079170 2026-02-17T11:12:29.463 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.460+0000 7f95da575640 1 --2- 10.20.193.49:0/812586621 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f95a8079170 0x7f95a807b630 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f95d0036000 tx=0x7f95d0009070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:12:29.463 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.461+0000 7f95c2ffd640 1 -- 10.20.193.49:0/812586621 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f95c405e230 con 0x7f95dc156800 2026-02-17T11:12:29.463 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.461+0000 7f95c2ffd640 10 client.4789.objecter ms_dispatch2 0x7f95dc000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:12:29.463 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.461+0000 7f95c2ffd640 3 client.4789.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:12:29.463 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.461+0000 7f95c2ffd640 3 client.4789.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:12:29.463 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.461+0000 7f95c2ffd640 20 client.4789.objecter dump_active .. 0 homeless 2026-02-17T11:12:29.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.467+0000 7f95c2ffd640 1 -- 10.20.193.49:0/812586621 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f95c4022020 con 0x7f95dc156800 2026-02-17T11:12:29.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.467+0000 7f95c2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:12:29.469 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.467+0000 7f95c2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:12:29.569 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.567+0000 7f95e0b87640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:12:29.569 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.567+0000 7f95e0b87640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:12:29.569 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.567+0000 7f95e0b87640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:12:29.569 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.567+0000 7f95e0b87640 1 -- 10.20.193.49:0/812586621 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f95dc0737f0 con 0x7f95dc156800 2026-02-17T11:12:29.571 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.570+0000 7f95c2ffd640 1 -- 10.20.193.49:0/812586621 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f95c40628f0 con 0x7f95dc156800 2026-02-17T11:12:29.571 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.570+0000 7f95c2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:12:29.571 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.570+0000 7f95c2ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:12:29.571 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:12:29.572 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:12:29.573 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.571+0000 7f95e0b87640 10 librados: watch_flush enter 2026-02-17T11:12:29.573 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.571+0000 7f95e0b87640 10 librados: watch_flush exit 2026-02-17T11:12:29.574 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.571+0000 7f95e0b87640 20 client.4789.objecter shutdown clearing up homeless session... 2026-02-17T11:12:29.574 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.571+0000 7f95e0b87640 10 client.4789.objecter successfully canceled tick 2026-02-17T11:12:29.574 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.571+0000 7f95e0b87640 1 -- 10.20.193.49:0/812586621 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f95a8079170 msgr2=0x7f95a807b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:29.574 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.571+0000 7f95e0b87640 1 --2- 10.20.193.49:0/812586621 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f95a8079170 0x7f95a807b630 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f95d0036000 tx=0x7f95d0009070 comp rx=0 tx=0).stop 2026-02-17T11:12:29.574 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.571+0000 7f95e0b87640 10 monclient: shutdown 2026-02-17T11:12:29.574 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.571+0000 7f95e0b87640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:12:29.574 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.571+0000 7f95e0b87640 1 -- 10.20.193.49:0/812586621 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f95dc156800 msgr2=0x7f95dc1f2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:29.574 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.571+0000 7f95e0b87640 1 --2- 10.20.193.49:0/812586621 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f95dc156800 0x7f95dc1f2cb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f95c400ead0 tx=0x7f95c40056d0 comp rx=0 tx=0).stop 2026-02-17T11:12:29.574 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.571+0000 7f95e0b87640 1 -- 10.20.193.49:0/812586621 shutdown_connections 2026-02-17T11:12:29.574 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.571+0000 7f95e0b87640 1 --2- 10.20.193.49:0/812586621 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f95a8079170 0x7f95a807b630 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:29.574 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.571+0000 7f95e0b87640 1 --2- 10.20.193.49:0/812586621 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f95dc156c80 0x7f95dc1f31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:29.575 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.571+0000 7f95e0b87640 1 --2- 10.20.193.49:0/812586621 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f95dc156800 0x7f95dc1f2cb0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:29.575 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.571+0000 7f95e0b87640 1 --2- 10.20.193.49:0/812586621 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f95c8003fe0 0x7f95dc1f1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:29.575 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.571+0000 7f95e0b87640 1 -- 10.20.193.49:0/812586621 >> 10.20.193.49:0/812586621 conn(0x7f95dc0c9f40 msgr2=0x7f95dc1582a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:12:29.575 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.571+0000 7f95e0b87640 1 -- 10.20.193.49:0/812586621 shutdown_connections 2026-02-17T11:12:29.575 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.571+0000 7f95e0b87640 1 -- 10.20.193.49:0/812586621 wait complete. 2026-02-17T11:12:29.575 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:29.571+0000 7f95e0b87640 1 librados: shutdown 2026-02-17T11:12:32.582 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:12:32.651 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.649+0000 7f37d7ea7640 10 monclient: get_monmap_and_config 2026-02-17T11:12:32.651 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.649+0000 7f37d7ea7640 10 monclient: build_initial_monmap 2026-02-17T11:12:32.651 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.649+0000 7f37d7ea7640 10 monclient: monmap: 2026-02-17T11:12:32.651 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:12:32.652 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:32.652 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:12:32.650319+0000 2026-02-17T11:12:32.652 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:12:32.650319+0000 2026-02-17T11:12:32.652 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:12:32.652 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:32.652 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:12:32.652 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:12:32.652 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:12:32.652 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:12:32.652 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:12:32.652 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:12:32.652 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:32.663 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.650+0000 7f37d7ea7640 1 Processor -- start 2026-02-17T11:12:32.664 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.650+0000 7f37d7ea7640 1 -- start start 2026-02-17T11:12:32.664 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.650+0000 7f37d7ea7640 10 monclient: init 2026-02-17T11:12:32.664 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.650+0000 7f37d7ea7640 10 monclient: _reopen_session rank -1 2026-02-17T11:12:32.664 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.650+0000 7f37d7ea7640 10 monclient: _add_conns ranks=[4,3,0,5,2,1] 2026-02-17T11:12:32.664 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.650+0000 7f37d7ea7640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f37d015d370 0x7f37d015d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:32.664 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.650+0000 7f37d7ea7640 10 monclient(hunting): picked mon.noname-b con 0x7f37d015d370 addr v2:10.20.193.97:3300/0 2026-02-17T11:12:32.664 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.650+0000 7f37d7ea7640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f37d00c7e20 0x7f37d00c74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:32.664 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.650+0000 7f37d7ea7640 10 monclient(hunting): picked mon.noname-a con 0x7f37d00c7e20 addr v2:10.20.193.49:3300/0 2026-02-17T11:12:32.665 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.650+0000 7f37d7ea7640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f37d015b000 addr v1:10.20.193.49:6789/0 2026-02-17T11:12:32.665 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.650+0000 7f37d7ea7640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37d00c8350 con 0x7f37d015b000 2026-02-17T11:12:32.665 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.650+0000 7f37d7ea7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:32.665 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.650+0000 7f37d7ea7640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f37d00c9240 con 0x7f37d00c7e20 2026-02-17T11:12:32.665 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.650+0000 7f37d7ea7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:32.665 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.650+0000 7f37d7ea7640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f37d00c8630 con 0x7f37d015d370 2026-02-17T11:12:32.665 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.650+0000 7f37d7ea7640 10 monclient(hunting): _renew_subs 2026-02-17T11:12:32.665 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.650+0000 7f37d7ea7640 10 monclient(hunting): authenticate will time out at 1229.313899s 2026-02-17T11:12:32.665 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.651+0000 7f37d5c1c640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f37d015d370 0x7f37d015d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:32.665 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.651+0000 7f37d541b640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f37d00c7e20 0x7f37d00c74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:32.665 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.651+0000 7f37d5c1c640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f37d015d370 0x7f37d015d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:55906/0 (socket says 10.20.193.49:55906) 2026-02-17T11:12:32.666 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.651+0000 7f37d5c1c640 1 -- 10.20.193.49:0/330939951 learned_addr learned my addr 10.20.193.49:0/330939951 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:12:32.666 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.651+0000 7f37d5c1c640 10 monclient(hunting): get_auth_request con 0x7f37d015d370 auth_method 0 2026-02-17T11:12:32.666 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.651+0000 7f37d5c1c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:32.666 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.651+0000 7f37d5c1c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:32.666 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.651+0000 7f37d5c1c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:32.666 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.651+0000 7f37d541b640 10 monclient(hunting): get_auth_request con 0x7f37d00c7e20 auth_method 0 2026-02-17T11:12:32.666 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.651+0000 7f37d541b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:32.666 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.651+0000 7f37d541b640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:32.666 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.651+0000 7f37d541b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:32.666 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.652+0000 7f37d5c1c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:32.666 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.652+0000 7f37d5c1c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:32.666 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.652+0000 7f37d5c1c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:32.667 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.652+0000 7f37d541b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:32.667 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.652+0000 7f37d541b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:32.667 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.652+0000 7f37d541b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:32.667 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.653+0000 7f37d5c1c640 10 monclient(hunting): handle_auth_done global_id 4792 payload 274 2026-02-17T11:12:32.667 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.653+0000 7f37d5c1c640 1 -- 10.20.193.49:0/330939951 >> v2:10.20.193.49:3300/0 conn(0x7f37d00c7e20 msgr2=0x7f37d00c74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:12:32.667 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.653+0000 7f37d5c1c640 1 --2- 10.20.193.49:0/330939951 >> v2:10.20.193.49:3300/0 conn(0x7f37d00c7e20 0x7f37d00c74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:32.667 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.653+0000 7f37d5c1c640 1 -- 10.20.193.49:0/330939951 >> v1:10.20.193.49:6789/0 conn(0x7f37d015b000 legacy=0x7f37d00c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:32.667 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.653+0000 7f37d5c1c640 10 monclient: _finish_hunting 0 2026-02-17T11:12:32.667 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.653+0000 7f37d5c1c640 1 monclient: found mon.noname-b 2026-02-17T11:12:32.667 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.653+0000 7f37d5c1c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:12:32.667 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.653+0000 7f37d5c1c640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:12:32.668 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.653+0000 7f37d5c1c640 1 -- 10.20.193.49:0/330939951 --> v2:10.20.193.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37d00c8910 con 0x7f37d015d370 2026-02-17T11:12:32.668 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.654+0000 7f37d5c1c640 1 --2- 10.20.193.49:0/330939951 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f37d015d370 0x7f37d015d750 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f37d00698d0 tx=0x7f37c002eed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccf65b324fe496d4 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:12:32.668 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.655+0000 7f37d4c1a640 1 -- 10.20.193.49:0/330939951 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c003c070 con 0x7f37d015d370 2026-02-17T11:12:32.668 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.655+0000 7f37d4c1a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:32.668 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.655+0000 7f37d4c1a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:12:32.668 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.655+0000 7f37d4c1a640 10 monclient: dump: 2026-02-17T11:12:32.668 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:32.668 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:32.668 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:32.668 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:32.668 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:32.669 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:32.669 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:32.669 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:32.669 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:32.669 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:32.669 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.655+0000 7f37d4c1a640 10 monclient: _finish_auth 0 2026-02-17T11:12:32.669 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.655+0000 7f37d4c1a640 10 monclient: _check_auth_tickets 2026-02-17T11:12:32.669 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.655+0000 7f37d4c1a640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:12:32.669 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.655+0000 7f37d7ea7640 5 monclient: authenticate success, global_id 4792 2026-02-17T11:12:32.669 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.655+0000 7f37d7ea7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:12:32.669 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.656+0000 7f37d4c1a640 1 -- 10.20.193.49:0/330939951 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37c002fbe0 con 0x7f37d015d370 2026-02-17T11:12:32.670 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.656+0000 7f37d4c1a640 10 monclient: handle_config config(0 keys) 2026-02-17T11:12:32.670 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.656+0000 7f37d4c1a640 1 -- 10.20.193.49:0/330939951 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c0037440 con 0x7f37d015d370 2026-02-17T11:12:32.670 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.656+0000 7f37d4c1a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:32.670 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.656+0000 7f37d4c1a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:12:32.670 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.656+0000 7f37d4c1a640 10 monclient: dump: 2026-02-17T11:12:32.670 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:32.670 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:32.670 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:32.670 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:32.670 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:32.670 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:32.670 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:32.671 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:32.671 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:32.671 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:32.671 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.656+0000 7f37d7ea7640 10 monclient: get_monmap_and_config success 2026-02-17T11:12:32.671 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.656+0000 7f37d7ea7640 4 set_mon_vals no callback set 2026-02-17T11:12:32.671 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.656+0000 7f37d7ea7640 10 monclient: shutdown 2026-02-17T11:12:32.671 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.656+0000 7f37d7ea7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:12:32.671 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.656+0000 7f37d7ea7640 1 -- 10.20.193.49:0/330939951 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f37d015d370 msgr2=0x7f37d015d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:32.671 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.656+0000 7f37d7ea7640 1 --2- 10.20.193.49:0/330939951 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f37d015d370 0x7f37d015d750 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f37d00698d0 tx=0x7f37c002eed0 comp rx=0 tx=0).stop 2026-02-17T11:12:32.671 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.656+0000 7f37d7ea7640 1 -- 10.20.193.49:0/330939951 shutdown_connections 2026-02-17T11:12:32.671 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.656+0000 7f37d7ea7640 1 --2- 10.20.193.49:0/330939951 >> v2:10.20.193.49:3300/0 conn(0x7f37d00c7e20 0x7f37d00c74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:32.672 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.656+0000 7f37d7ea7640 1 --2- 10.20.193.49:0/330939951 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f37d015d370 0x7f37d015d750 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:32.672 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.656+0000 7f37d7ea7640 1 -- 10.20.193.49:0/330939951 >> 10.20.193.49:0/330939951 conn(0x7f37d00c9f20 msgr2=0x7f37d00ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:12:32.672 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.656+0000 7f37d7ea7640 1 -- 10.20.193.49:0/330939951 shutdown_connections 2026-02-17T11:12:32.672 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.656+0000 7f37d7ea7640 1 -- 10.20.193.49:0/330939951 wait complete. 2026-02-17T11:12:32.672 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.657+0000 7f37d7ea7640 10 monclient: build_initial_monmap 2026-02-17T11:12:32.672 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.657+0000 7f37d7ea7640 10 monclient: monmap: 2026-02-17T11:12:32.672 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:12:32.672 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:12:32.672 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:12:32.672 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:12:32.672 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:12:32.672 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:32.673 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:12:32.673 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:12:32.673 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:12:32.673 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:32.673 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.657+0000 7f37d7ea7640 1 librados: starting msgr at 2026-02-17T11:12:32.673 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.657+0000 7f37d7ea7640 1 librados: starting objecter 2026-02-17T11:12:32.673 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.657+0000 7f37d7ea7640 1 Processor -- start 2026-02-17T11:12:32.673 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.657+0000 7f37d7ea7640 1 -- start start 2026-02-17T11:12:32.673 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.657+0000 7f37d7ea7640 1 librados: setting wanted keys 2026-02-17T11:12:32.673 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.657+0000 7f37d7ea7640 1 librados: calling monclient init 2026-02-17T11:12:32.674 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.657+0000 7f37d7ea7640 10 monclient: init 2026-02-17T11:12:32.674 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.657+0000 7f37d7ea7640 10 monclient: _reopen_session rank -1 2026-02-17T11:12:32.674 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.657+0000 7f37d7ea7640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:12:32.674 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.658+0000 7f37d7ea7640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f37d00c7e20 0x7f37d0155dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:32.674 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.658+0000 7f37d7ea7640 10 monclient(hunting): picked mon.noname-c con 0x7f37d00c7e20 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:12:32.674 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.658+0000 7f37d7ea7640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f37d015b000 0x7f37d01f4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:32.674 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.658+0000 7f37d7ea7640 10 monclient(hunting): picked mon.noname-b con 0x7f37d015b000 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:12:32.674 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.658+0000 7f37d7ea7640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f37d015d370 0x7f37d006ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:32.674 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.658+0000 7f37d7ea7640 10 monclient(hunting): picked mon.noname-a con 0x7f37d015d370 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:12:32.674 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.658+0000 7f37d7ea7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:32.674 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.658+0000 7f37d7ea7640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f37d00c96d0 con 0x7f37d015d370 2026-02-17T11:12:32.674 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.658+0000 7f37d7ea7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:32.675 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.658+0000 7f37d7ea7640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f37d00c8ed0 con 0x7f37d015b000 2026-02-17T11:12:32.675 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.658+0000 7f37d7ea7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:32.675 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.658+0000 7f37d7ea7640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f37d00cb310 con 0x7f37d00c7e20 2026-02-17T11:12:32.675 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.658+0000 7f37d7ea7640 10 monclient(hunting): _renew_subs 2026-02-17T11:12:32.675 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.658+0000 7f37d7ea7640 10 monclient(hunting): authenticate will time out at 1229.321032s 2026-02-17T11:12:32.675 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.658+0000 7f37d641d640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f37d015d370 0x7f37d006ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:32.675 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.658+0000 7f37d541b640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f37d015b000 0x7f37d01f4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:32.675 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.658+0000 7f37d541b640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f37d015b000 0x7f37d01f4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:55908/0 (socket says 10.20.193.49:55908) 2026-02-17T11:12:32.675 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.658+0000 7f37d641d640 10 monclient(hunting): get_auth_request con 0x7f37d015d370 auth_method 0 2026-02-17T11:12:32.675 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.658+0000 7f37d541b640 1 -- 10.20.193.49:0/3750602284 learned_addr learned my addr 10.20.193.49:0/3750602284 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:12:32.675 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.658+0000 7f37d641d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:32.675 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.658+0000 7f37d641d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:32.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.658+0000 7f37d641d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:32.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.658+0000 7f37d541b640 10 monclient(hunting): get_auth_request con 0x7f37d015b000 auth_method 0 2026-02-17T11:12:32.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.658+0000 7f37d541b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:32.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.658+0000 7f37d541b640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:32.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.658+0000 7f37d541b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:32.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.658+0000 7f37d5c1c640 1 --2- 10.20.193.49:0/3750602284 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f37d00c7e20 0x7f37d0155dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:32.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.658+0000 7f37d5c1c640 10 monclient(hunting): get_auth_request con 0x7f37d00c7e20 auth_method 0 2026-02-17T11:12:32.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.658+0000 7f37d5c1c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:32.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.658+0000 7f37d5c1c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:32.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.658+0000 7f37d5c1c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:32.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.658+0000 7f37d641d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:32.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.658+0000 7f37d641d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:32.677 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.658+0000 7f37d641d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:32.677 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.658+0000 7f37d541b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:32.677 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.658+0000 7f37d541b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:32.677 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.658+0000 7f37d541b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:32.677 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.659+0000 7f37d5c1c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:32.677 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.659+0000 7f37d5c1c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:32.677 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.659+0000 7f37d5c1c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:32.677 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.660+0000 7f37d541b640 10 monclient(hunting): handle_auth_done global_id 4795 payload 824 2026-02-17T11:12:32.677 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.660+0000 7f37d541b640 1 -- 10.20.193.49:0/3750602284 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f37d00c7e20 msgr2=0x7f37d0155dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:32.677 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.660+0000 7f37d541b640 1 --2- 10.20.193.49:0/3750602284 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f37d00c7e20 0x7f37d0155dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:32.677 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.660+0000 7f37d541b640 1 -- 10.20.193.49:0/3750602284 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f37d015d370 msgr2=0x7f37d006ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:32.677 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.660+0000 7f37d541b640 1 --2- 10.20.193.49:0/3750602284 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f37d015d370 0x7f37d006ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:32.677 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.660+0000 7f37d541b640 10 monclient: _finish_hunting 0 2026-02-17T11:12:32.678 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.660+0000 7f37d541b640 1 monclient: found mon.noname-b 2026-02-17T11:12:32.678 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.660+0000 7f37d541b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:12:32.678 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.660+0000 7f37d541b640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:12:32.678 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.660+0000 7f37d541b640 1 -- 10.20.193.49:0/3750602284 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37d0156540 con 0x7f37d015b000 2026-02-17T11:12:32.678 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.661+0000 7f37d541b640 1 --2- 10.20.193.49:0/3750602284 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f37d015b000 0x7f37d01f4090 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f37c400ebe0 tx=0x7f37c400c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:12:32.678 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.661+0000 7f37be7fc640 10 client.?.objecter ms_handle_connect 0x7f37d015b000 2026-02-17T11:12:32.678 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.661+0000 7f37be7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T11:12:32.679 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.662+0000 7f37be7fc640 1 -- 10.20.193.49:0/3750602284 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c4017070 con 0x7f37d015b000 2026-02-17T11:12:32.679 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.662+0000 7f37be7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:32.679 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.662+0000 7f37be7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:12:32.679 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.662+0000 7f37be7fc640 10 monclient: dump: 2026-02-17T11:12:32.679 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:32.679 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:32.679 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:32.679 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:32.679 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:32.679 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:32.679 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:32.679 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:32.679 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:32.679 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:32.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.662+0000 7f37be7fc640 10 monclient: _finish_auth 0 2026-02-17T11:12:32.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.662+0000 7f37be7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:12:32.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.662+0000 7f37be7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:12:32.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.662+0000 7f37d7ea7640 5 monclient: authenticate success, global_id 4795 2026-02-17T11:12:32.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.662+0000 7f37d7ea7640 10 monclient: _renew_subs 2026-02-17T11:12:32.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.662+0000 7f37d7ea7640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:12:32.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.662+0000 7f37d7ea7640 1 -- 10.20.193.49:0/3750602284 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37d0156820 con 0x7f37d015b000 2026-02-17T11:12:32.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.662+0000 7f37d7ea7640 10 client.4795.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:12:32.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.662+0000 7f37d7ea7640 10 monclient: _renew_subs 2026-02-17T11:12:32.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.662+0000 7f37d7ea7640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:12:32.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.662+0000 7f37d7ea7640 1 -- 10.20.193.49:0/3750602284 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37d0156de0 con 0x7f37d015b000 2026-02-17T11:12:32.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.662+0000 7f37d7ea7640 1 librados: init done 2026-02-17T11:12:32.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.662+0000 7f37d7ea7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:12:32.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.662+0000 7f37d7ea7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:12:32.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.662+0000 7f37d7ea7640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:12:32.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.662+0000 7f37d7ea7640 1 -- 10.20.193.49:0/3750602284 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37d015c610 con 0x7f37d015b000 2026-02-17T11:12:32.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.663+0000 7f37be7fc640 1 -- 10.20.193.49:0/3750602284 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37c400cc40 con 0x7f37d015b000 2026-02-17T11:12:32.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.663+0000 7f37be7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:12:32.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.663+0000 7f37be7fc640 1 -- 10.20.193.49:0/3750602284 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c4021060 con 0x7f37d015b000 2026-02-17T11:12:32.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.663+0000 7f37be7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:32.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.663+0000 7f37be7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:12:32.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.663+0000 7f37be7fc640 10 monclient: dump: 2026-02-17T11:12:32.680 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:32.680 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:32.680 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:32.680 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:32.680 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:32.680 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:32.680 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:32.680 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:32.680 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:32.680 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:32.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.663+0000 7f37bffff640 4 set_mon_vals no callback set 2026-02-17T11:12:32.771 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.770+0000 7f37be7fc640 1 -- 10.20.193.49:0/3750602284 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f37c4013470 con 0x7f37d015b000 2026-02-17T11:12:32.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.771+0000 7f37be7fc640 1 --2- 10.20.193.49:0/3750602284 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f37a0079140 0x7f37a007b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:32.773 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.771+0000 7f37d5c1c640 1 --2- 10.20.193.49:0/3750602284 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f37a0079140 0x7f37a007b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:32.773 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.771+0000 7f37d5c1c640 10 monclient: get_auth_request con 0x7f37a0079140 auth_method 0 2026-02-17T11:12:32.773 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.771+0000 7f37be7fc640 10 client.4795.objecter ms_handle_connect 0x7f37a0079140 2026-02-17T11:12:32.773 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.771+0000 7f37d5c1c640 1 --2- 10.20.193.49:0/3750602284 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f37a0079140 0x7f37a007b600 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f37d015dcf0 tx=0x7f37c0039040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:12:32.774 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.772+0000 7f37be7fc640 1 -- 10.20.193.49:0/3750602284 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f37c405e790 con 0x7f37d015b000 2026-02-17T11:12:32.774 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.772+0000 7f37be7fc640 10 client.4795.objecter ms_dispatch2 0x7f37d0000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:12:32.774 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.772+0000 7f37be7fc640 3 client.4795.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:12:32.774 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.772+0000 7f37be7fc640 3 client.4795.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:12:32.774 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.772+0000 7f37be7fc640 20 client.4795.objecter dump_active .. 0 homeless 2026-02-17T11:12:32.780 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.778+0000 7f37be7fc640 1 -- 10.20.193.49:0/3750602284 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f37c4062750 con 0x7f37d015b000 2026-02-17T11:12:32.780 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.778+0000 7f37be7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:12:32.780 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.778+0000 7f37be7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:12:32.880 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.878+0000 7f37d7ea7640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:12:32.880 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.878+0000 7f37d7ea7640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:12:32.880 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.878+0000 7f37d7ea7640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:12:32.880 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.878+0000 7f37d7ea7640 1 -- 10.20.193.49:0/3750602284 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f37d015cc10 con 0x7f37d015b000 2026-02-17T11:12:32.882 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.880+0000 7f37be7fc640 1 -- 10.20.193.49:0/3750602284 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f37c4066a50 con 0x7f37d015b000 2026-02-17T11:12:32.882 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.880+0000 7f37be7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:12:32.882 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.880+0000 7f37be7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:12:32.883 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:12:32.883 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:12:32.885 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.881+0000 7f37d7ea7640 10 librados: watch_flush enter 2026-02-17T11:12:32.885 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.881+0000 7f37d7ea7640 10 librados: watch_flush exit 2026-02-17T11:12:32.885 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.881+0000 7f37d7ea7640 20 client.4795.objecter shutdown clearing up homeless session... 2026-02-17T11:12:32.885 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.881+0000 7f37d7ea7640 10 client.4795.objecter successfully canceled tick 2026-02-17T11:12:32.885 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.881+0000 7f37d7ea7640 1 -- 10.20.193.49:0/3750602284 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f37a0079140 msgr2=0x7f37a007b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:32.885 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.881+0000 7f37d7ea7640 1 --2- 10.20.193.49:0/3750602284 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f37a0079140 0x7f37a007b600 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f37d015dcf0 tx=0x7f37c0039040 comp rx=0 tx=0).stop 2026-02-17T11:12:32.885 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.881+0000 7f37d7ea7640 10 monclient: shutdown 2026-02-17T11:12:32.885 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.881+0000 7f37d7ea7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:12:32.886 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.881+0000 7f37d7ea7640 1 -- 10.20.193.49:0/3750602284 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f37d015b000 msgr2=0x7f37d01f4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:32.886 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.881+0000 7f37d7ea7640 1 --2- 10.20.193.49:0/3750602284 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f37d015b000 0x7f37d01f4090 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f37c400ebe0 tx=0x7f37c400c520 comp rx=0 tx=0).stop 2026-02-17T11:12:32.886 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.881+0000 7f37d7ea7640 1 -- 10.20.193.49:0/3750602284 shutdown_connections 2026-02-17T11:12:32.886 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.881+0000 7f37d7ea7640 1 --2- 10.20.193.49:0/3750602284 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f37a0079140 0x7f37a007b600 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:32.886 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.881+0000 7f37d7ea7640 1 --2- 10.20.193.49:0/3750602284 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f37d015d370 0x7f37d006ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:32.886 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.881+0000 7f37d7ea7640 1 --2- 10.20.193.49:0/3750602284 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f37d015b000 0x7f37d01f4090 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:32.886 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.881+0000 7f37d7ea7640 1 --2- 10.20.193.49:0/3750602284 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f37d00c7e20 0x7f37d0155dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:32.886 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.881+0000 7f37d7ea7640 1 -- 10.20.193.49:0/3750602284 >> 10.20.193.49:0/3750602284 conn(0x7f37d00c9f20 msgr2=0x7f37d00ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:12:32.886 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.881+0000 7f37d7ea7640 1 -- 10.20.193.49:0/3750602284 shutdown_connections 2026-02-17T11:12:32.886 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.881+0000 7f37d7ea7640 1 -- 10.20.193.49:0/3750602284 wait complete. 2026-02-17T11:12:32.886 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:32.882+0000 7f37d7ea7640 1 librados: shutdown 2026-02-17T11:12:35.893 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:12:35.964 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.961+0000 7fe978d3e640 10 monclient: get_monmap_and_config 2026-02-17T11:12:35.964 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.961+0000 7fe978d3e640 10 monclient: build_initial_monmap 2026-02-17T11:12:35.964 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.961+0000 7fe978d3e640 10 monclient: monmap: 2026-02-17T11:12:35.965 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:12:35.965 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:35.965 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:12:35.961749+0000 2026-02-17T11:12:35.965 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:12:35.961749+0000 2026-02-17T11:12:35.965 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:12:35.965 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:35.965 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:12:35.965 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:12:35.965 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:12:35.965 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:12:35.965 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:12:35.965 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:12:35.966 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:35.966 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.961+0000 7fe978d3e640 1 Processor -- start 2026-02-17T11:12:35.966 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.961+0000 7fe978d3e640 1 -- start start 2026-02-17T11:12:35.966 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.961+0000 7fe978d3e640 10 monclient: init 2026-02-17T11:12:35.966 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.962+0000 7fe978d3e640 10 monclient: _reopen_session rank -1 2026-02-17T11:12:35.966 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.962+0000 7fe978d3e640 10 monclient: _add_conns ranks=[0,2,1,5,4,3] 2026-02-17T11:12:35.966 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.962+0000 7fe978d3e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe974152820 addr v1:10.20.193.49:6789/0 2026-02-17T11:12:35.966 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.962+0000 7fe978d3e640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fe974152c00 addr v1:10.20.193.157:6789/0 2026-02-17T11:12:35.966 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.962+0000 7fe978d3e640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fe9740c63f0 addr v1:10.20.193.97:6789/0 2026-02-17T11:12:35.966 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.962+0000 7fe978d3e640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe974073e90 con 0x7fe974152820 2026-02-17T11:12:35.966 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.962+0000 7fe978d3e640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe974074170 con 0x7fe9740c63f0 2026-02-17T11:12:35.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.962+0000 7fe978d3e640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe974074450 con 0x7fe974152c00 2026-02-17T11:12:35.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.962+0000 7fe978d3e640 10 monclient(hunting): _renew_subs 2026-02-17T11:12:35.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.962+0000 7fe978d3e640 10 monclient(hunting): authenticate will time out at 1232.625311s 2026-02-17T11:12:35.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.962+0000 7fe972575640 1 --1- >> v1:10.20.193.49:6789/0 conn(0x7fe974152820 0x7fe9740c7e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.49:6789/0 says I am v1:10.20.193.49:59318/0 (socket says 10.20.193.49:59318) 2026-02-17T11:12:35.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.962+0000 7fe972575640 1 -- 10.20.193.49:0/3559944887 learned_addr learned my addr 10.20.193.49:0/3559944887 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:12:35.973 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.964+0000 7fe971573640 1 -- 10.20.193.49:0/3559944887 <== mon.0 v1:10.20.193.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1047439112 0 0) 0x7fe974073e90 con 0x7fe974152820 2026-02-17T11:12:35.973 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.964+0000 7fe971573640 10 monclient(hunting): _negotiate 2026-02-17T11:12:35.973 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.964+0000 7fe971573640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:35.973 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.964+0000 7fe971573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:35.973 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.964+0000 7fe971573640 10 monclient(hunting): my global_id is 4845 2026-02-17T11:12:35.973 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.964+0000 7fe971573640 1 -- 10.20.193.49:0/3559944887 --> v1:10.20.193.49:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe960003620 con 0x7fe974152820 2026-02-17T11:12:35.973 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.964+0000 7fe971573640 1 -- 10.20.193.49:0/3559944887 <== mon.1 v1:10.20.193.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1710563153 0 0) 0x7fe974074170 con 0x7fe9740c63f0 2026-02-17T11:12:35.973 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.964+0000 7fe971573640 10 monclient(hunting): _negotiate 2026-02-17T11:12:35.973 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.964+0000 7fe971573640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:35.974 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.964+0000 7fe971573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:35.974 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.964+0000 7fe971573640 10 monclient(hunting): my global_id is 4798 2026-02-17T11:12:35.974 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.964+0000 7fe971573640 1 -- 10.20.193.49:0/3559944887 --> v1:10.20.193.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe974073e90 con 0x7fe9740c63f0 2026-02-17T11:12:35.974 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.964+0000 7fe971573640 1 -- 10.20.193.49:0/3559944887 <== mon.2 v1:10.20.193.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3875325367 0 0) 0x7fe974074450 con 0x7fe974152c00 2026-02-17T11:12:35.974 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.964+0000 7fe971573640 10 monclient(hunting): _negotiate 2026-02-17T11:12:35.974 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.964+0000 7fe971573640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:35.974 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.964+0000 7fe971573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:35.974 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.964+0000 7fe971573640 10 monclient(hunting): my global_id is 4823 2026-02-17T11:12:35.974 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.964+0000 7fe971573640 1 -- 10.20.193.49:0/3559944887 --> v1:10.20.193.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe974074170 con 0x7fe974152c00 2026-02-17T11:12:35.974 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.965+0000 7fe971573640 1 -- 10.20.193.49:0/3559944887 <== mon.0 v1:10.20.193.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 690706638 0 0) 0x7fe960003620 con 0x7fe974152820 2026-02-17T11:12:35.974 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.965+0000 7fe971573640 1 -- 10.20.193.49:0/3559944887 >> v1:10.20.193.157:6789/0 conn(0x7fe974152c00 legacy=0x7fe9740c5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:35.974 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.965+0000 7fe971573640 1 -- 10.20.193.49:0/3559944887 >> v1:10.20.193.97:6789/0 conn(0x7fe9740c63f0 legacy=0x7fe9740726d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:35.975 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.965+0000 7fe971573640 10 monclient: _finish_hunting 0 2026-02-17T11:12:35.975 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.965+0000 7fe971573640 1 monclient: found mon.noname-a-legacy 2026-02-17T11:12:35.975 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.965+0000 7fe971573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:12:35.975 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.965+0000 7fe971573640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.49:6789/0 2026-02-17T11:12:35.975 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.965+0000 7fe971573640 1 -- 10.20.193.49:0/3559944887 --> v1:10.20.193.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe974074730 con 0x7fe974152820 2026-02-17T11:12:35.975 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.965+0000 7fe971573640 10 monclient: _finish_auth 0 2026-02-17T11:12:35.975 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.965+0000 7fe971573640 10 monclient: _check_auth_tickets 2026-02-17T11:12:35.975 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.965+0000 7fe971573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:12:35.975 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.965+0000 7fe971573640 1 -- 10.20.193.49:0/3559944887 <== mon.0 v1:10.20.193.49:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2462710995 0 0) 0x7fe968002f00 con 0x7fe974152820 2026-02-17T11:12:35.975 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.965+0000 7fe971573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:35.975 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.965+0000 7fe971573640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T11:12:35.975 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.965+0000 7fe971573640 10 monclient: dump: 2026-02-17T11:12:35.976 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:35.976 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:35.976 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:35.976 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:35.976 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:35.976 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:35.977 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:35.977 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:35.977 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:35.977 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:35.977 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.965+0000 7fe971573640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] but i'm connected to v1:10.20.193.49:6789/0, reconnecting 2026-02-17T11:12:35.977 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.965+0000 7fe971573640 10 monclient: _reopen_session rank -1 2026-02-17T11:12:35.978 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.965+0000 7fe971573640 1 -- 10.20.193.49:0/3559944887 >> v1:10.20.193.49:6789/0 conn(0x7fe974152820 legacy=0x7fe9740c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:35.978 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.965+0000 7fe971573640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:12:35.978 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.966+0000 7fe971573640 1 --2- 10.20.193.49:0/3559944887 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe960003fe0 0x7fe960004900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:35.978 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.966+0000 7fe971573640 10 monclient(hunting): picked mon.a con 0x7fe960003fe0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:12:35.978 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.966+0000 7fe971573640 1 --2- 10.20.193.49:0/3559944887 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe960004e40 0x7fe9600052c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:35.978 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.966+0000 7fe971573640 10 monclient(hunting): picked mon.b con 0x7fe960004e40 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:12:35.979 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.966+0000 7fe971573640 1 --2- 10.20.193.49:0/3559944887 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe96000bd40 0x7fe96000e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:35.979 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.966+0000 7fe971573640 10 monclient(hunting): picked mon.c con 0x7fe96000bd40 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:12:35.979 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.966+0000 7fe971573640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:35.979 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.966+0000 7fe971573640 1 -- 10.20.193.49:0/3559944887 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe96000e720 con 0x7fe960003fe0 2026-02-17T11:12:35.979 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.966+0000 7fe971573640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:35.979 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.966+0000 7fe971573640 1 -- 10.20.193.49:0/3559944887 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe96000e8d0 con 0x7fe960004e40 2026-02-17T11:12:35.979 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.966+0000 7fe971573640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:35.979 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.966+0000 7fe971573640 1 -- 10.20.193.49:0/3559944887 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe96000ead0 con 0x7fe96000bd40 2026-02-17T11:12:35.979 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.966+0000 7fe971573640 10 monclient(hunting): _renew_subs 2026-02-17T11:12:35.979 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.966+0000 7fe971573640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:12:35.980 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.967+0000 7fe971d74640 1 --2- 10.20.193.49:0/3559944887 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe960004e40 0x7fe9600052c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:35.980 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.967+0000 7fe972575640 1 --2- 10.20.193.49:0/3559944887 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe960003fe0 0x7fe960004900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:35.980 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.967+0000 7fe971d74640 10 monclient(hunting): get_auth_request con 0x7fe960004e40 auth_method 0 2026-02-17T11:12:35.980 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.967+0000 7fe971d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:35.980 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.967+0000 7fe971d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:35.980 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.967+0000 7fe971d74640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:12:35.980 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.967+0000 7fe972d76640 1 --2- 10.20.193.49:0/3559944887 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe96000bd40 0x7fe96000e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:35.980 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.967+0000 7fe971d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:35.980 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.967+0000 7fe971d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:35.980 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.967+0000 7fe971d74640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:12:35.980 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.967+0000 7fe972d76640 10 monclient(hunting): get_auth_request con 0x7fe96000bd40 auth_method 0 2026-02-17T11:12:35.980 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.967+0000 7fe972d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:35.981 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.967+0000 7fe972d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:35.981 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.967+0000 7fe972d76640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:12:35.981 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.968+0000 7fe972d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:35.981 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.968+0000 7fe972d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:35.981 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.968+0000 7fe972d76640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:12:35.981 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.968+0000 7fe972575640 10 monclient(hunting): get_auth_request con 0x7fe960003fe0 auth_method 0 2026-02-17T11:12:35.981 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.968+0000 7fe972575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:35.981 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.968+0000 7fe972575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:35.981 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.968+0000 7fe972575640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:12:35.981 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.968+0000 7fe972575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:35.981 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.968+0000 7fe972575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:35.981 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.968+0000 7fe972575640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:12:35.982 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.969+0000 7fe971d74640 10 monclient(hunting): handle_auth_done global_id 4845 payload 293 2026-02-17T11:12:35.982 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.969+0000 7fe971d74640 1 -- 10.20.193.49:0/3559944887 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe96000bd40 msgr2=0x7fe96000e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:12:35.982 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.969+0000 7fe971d74640 1 --2- 10.20.193.49:0/3559944887 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe96000bd40 0x7fe96000e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:35.982 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.969+0000 7fe971d74640 1 -- 10.20.193.49:0/3559944887 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe960003fe0 msgr2=0x7fe960004900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:12:35.982 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.969+0000 7fe971d74640 1 --2- 10.20.193.49:0/3559944887 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe960003fe0 0x7fe960004900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:35.982 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.969+0000 7fe971d74640 10 monclient: _finish_hunting 0 2026-02-17T11:12:35.982 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.969+0000 7fe971d74640 1 monclient: found mon.b 2026-02-17T11:12:35.982 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.969+0000 7fe971d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:12:35.982 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.969+0000 7fe971d74640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:12:35.982 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.969+0000 7fe971d74640 1 -- 10.20.193.49:0/3559944887 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe960003620 con 0x7fe960004e40 2026-02-17T11:12:35.982 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.969+0000 7fe972d76640 1 -- 10.20.193.49:0/3559944887 reap_dead start 2026-02-17T11:12:35.982 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.969+0000 7fe971d74640 10 monclient: _finish_auth 0 2026-02-17T11:12:35.983 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.969+0000 7fe971d74640 10 monclient: _check_auth_tickets 2026-02-17T11:12:35.983 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.969+0000 7fe971d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:12:35.983 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.969+0000 7fe978d3e640 5 monclient: authenticate success, global_id 4845 2026-02-17T11:12:35.983 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.969+0000 7fe978d3e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:12:35.983 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.970+0000 7fe971d74640 1 --2- 10.20.193.49:0/3559944887 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe960004e40 0x7fe9600052c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe95c003170 tx=0x7fe95c02eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f62c5f8f5dbddca1 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:12:35.988 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.971+0000 7fe971573640 1 -- 10.20.193.49:0/3559944887 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe95c002dc0 con 0x7fe960004e40 2026-02-17T11:12:35.988 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.971+0000 7fe971573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:35.988 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.971+0000 7fe971573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:12:35.988 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.971+0000 7fe971573640 10 monclient: dump: 2026-02-17T11:12:35.989 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:35.989 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:35.989 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:35.989 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:35.989 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:35.989 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:35.989 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:35.989 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:35.989 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:35.989 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:35.989 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.971+0000 7fe978d3e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:12:35.990 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.972+0000 7fe971573640 1 -- 10.20.193.49:0/3559944887 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe95c0052d0 con 0x7fe960004e40 2026-02-17T11:12:35.990 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.972+0000 7fe971573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:12:35.990 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.972+0000 7fe971573640 1 -- 10.20.193.49:0/3559944887 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe95c02f710 con 0x7fe960004e40 2026-02-17T11:12:35.990 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.972+0000 7fe971573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:35.990 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.972+0000 7fe971573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:12:35.990 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.972+0000 7fe971573640 10 monclient: dump: 2026-02-17T11:12:35.990 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:35.990 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:35.990 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:35.990 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:35.991 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:35.991 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:35.991 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:35.991 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:35.991 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:35.991 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:35.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.972+0000 7fe978d3e640 10 monclient: get_monmap_and_config success 2026-02-17T11:12:35.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.972+0000 7fe978d3e640 4 set_mon_vals no callback set 2026-02-17T11:12:35.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.973+0000 7fe978d3e640 10 monclient: shutdown 2026-02-17T11:12:35.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.973+0000 7fe978d3e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:12:35.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.973+0000 7fe978d3e640 1 -- 10.20.193.49:0/3559944887 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe960004e40 msgr2=0x7fe9600052c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:35.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.973+0000 7fe978d3e640 1 --2- 10.20.193.49:0/3559944887 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe960004e40 0x7fe9600052c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe95c003170 tx=0x7fe95c02eeb0 comp rx=0 tx=0).stop 2026-02-17T11:12:35.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.973+0000 7fe978d3e640 1 -- 10.20.193.49:0/3559944887 shutdown_connections 2026-02-17T11:12:35.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.973+0000 7fe978d3e640 1 --2- 10.20.193.49:0/3559944887 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe960004e40 0x7fe9600052c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:35.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.973+0000 7fe978d3e640 1 -- 10.20.193.49:0/3559944887 >> 10.20.193.49:0/3559944887 conn(0x7fe9740c9f40 msgr2=0x7fe9740ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:12:35.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.973+0000 7fe978d3e640 1 -- 10.20.193.49:0/3559944887 shutdown_connections 2026-02-17T11:12:35.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.973+0000 7fe978d3e640 1 -- 10.20.193.49:0/3559944887 wait complete. 2026-02-17T11:12:35.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.973+0000 7fe978d3e640 10 monclient: build_initial_monmap 2026-02-17T11:12:35.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.973+0000 7fe978d3e640 10 monclient: monmap: 2026-02-17T11:12:35.992 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:12:35.992 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:12:35.992 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:12:35.993 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:12:35.993 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:12:35.993 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:35.993 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:12:35.993 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:12:35.993 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:12:35.993 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:35.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.973+0000 7fe978d3e640 1 librados: starting msgr at 2026-02-17T11:12:35.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.973+0000 7fe978d3e640 1 librados: starting objecter 2026-02-17T11:12:35.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.973+0000 7fe978d3e640 1 Processor -- start 2026-02-17T11:12:35.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.973+0000 7fe978d3e640 1 -- start start 2026-02-17T11:12:35.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.973+0000 7fe978d3e640 1 librados: setting wanted keys 2026-02-17T11:12:35.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.973+0000 7fe978d3e640 1 librados: calling monclient init 2026-02-17T11:12:35.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.973+0000 7fe978d3e640 10 monclient: init 2026-02-17T11:12:35.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.974+0000 7fe978d3e640 10 monclient: _reopen_session rank -1 2026-02-17T11:12:35.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.974+0000 7fe978d3e640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:12:35.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.974+0000 7fe978d3e640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe960004e40 0x7fe9741f77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:35.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.974+0000 7fe978d3e640 10 monclient(hunting): picked mon.noname-a con 0x7fe960004e40 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:12:35.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.974+0000 7fe978d3e640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe9740c04b0 0x7fe974154df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:35.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.974+0000 7fe978d3e640 10 monclient(hunting): picked mon.noname-c con 0x7fe9740c04b0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:12:35.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.974+0000 7fe978d3e640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe9741502b0 0x7fe97414bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:35.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.974+0000 7fe978d3e640 10 monclient(hunting): picked mon.noname-b con 0x7fe9741502b0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:12:35.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.974+0000 7fe978d3e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:35.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.974+0000 7fe978d3e640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe9740738f0 con 0x7fe960004e40 2026-02-17T11:12:35.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.974+0000 7fe978d3e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:35.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.974+0000 7fe978d3e640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe974074cf0 con 0x7fe9741502b0 2026-02-17T11:12:35.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.974+0000 7fe978d3e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:35.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.974+0000 7fe978d3e640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe974073a70 con 0x7fe9740c04b0 2026-02-17T11:12:35.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.974+0000 7fe978d3e640 10 monclient(hunting): _renew_subs 2026-02-17T11:12:35.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.974+0000 7fe978d3e640 10 monclient(hunting): authenticate will time out at 1232.637321s 2026-02-17T11:12:35.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.974+0000 7fe972d76640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe9741502b0 0x7fe97414bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:35.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.974+0000 7fe971d74640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe9740c04b0 0x7fe974154df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:35.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.974+0000 7fe972d76640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe9741502b0 0x7fe97414bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:55924/0 (socket says 10.20.193.49:55924) 2026-02-17T11:12:35.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.974+0000 7fe972d76640 1 -- 10.20.193.49:0/2252622091 learned_addr learned my addr 10.20.193.49:0/2252622091 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:12:35.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.974+0000 7fe972d76640 10 monclient(hunting): get_auth_request con 0x7fe9741502b0 auth_method 0 2026-02-17T11:12:35.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.974+0000 7fe972d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:35.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.974+0000 7fe972d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:35.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.974+0000 7fe972d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:35.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.974+0000 7fe971d74640 10 monclient(hunting): get_auth_request con 0x7fe9740c04b0 auth_method 0 2026-02-17T11:12:35.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.974+0000 7fe971d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:35.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.974+0000 7fe971d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:35.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.974+0000 7fe971d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:35.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.974+0000 7fe972d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:35.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.974+0000 7fe972d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:35.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.974+0000 7fe972d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:35.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.975+0000 7fe971d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:35.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.975+0000 7fe971d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:35.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.975+0000 7fe971d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:35.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.976+0000 7fe972d76640 10 monclient(hunting): handle_auth_done global_id 4801 payload 824 2026-02-17T11:12:35.997 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.976+0000 7fe972d76640 1 -- 10.20.193.49:0/2252622091 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe9740c04b0 msgr2=0x7fe974154df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:35.997 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.976+0000 7fe972d76640 1 --2- 10.20.193.49:0/2252622091 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe9740c04b0 0x7fe974154df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:35.997 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.976+0000 7fe972d76640 1 -- 10.20.193.49:0/2252622091 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe960004e40 msgr2=0x7fe9741f77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:35.997 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.976+0000 7fe972d76640 1 --2- 10.20.193.49:0/2252622091 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe960004e40 0x7fe9741f77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:35.997 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.976+0000 7fe972d76640 10 monclient: _finish_hunting 0 2026-02-17T11:12:35.997 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.976+0000 7fe972d76640 1 monclient: found mon.noname-b 2026-02-17T11:12:35.997 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.976+0000 7fe972d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:12:35.997 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.976+0000 7fe972d76640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:12:35.997 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.976+0000 7fe972d76640 1 -- 10.20.193.49:0/2252622091 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9740bf410 con 0x7fe9741502b0 2026-02-17T11:12:35.997 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.977+0000 7fe972d76640 1 --2- 10.20.193.49:0/2252622091 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe9741502b0 0x7fe97414bd40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe974069720 tx=0x7fe96400f5a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:12:35.997 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.977+0000 7fe95affd640 10 client.?.objecter ms_handle_connect 0x7fe9741502b0 2026-02-17T11:12:35.997 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:35.977+0000 7fe95affd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:12:36.010 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.007+0000 7fe95affd640 1 -- 10.20.193.49:0/2252622091 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe964019070 con 0x7fe9741502b0 2026-02-17T11:12:36.010 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.007+0000 7fe95affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:36.010 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.007+0000 7fe95affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:12:36.010 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.007+0000 7fe95affd640 10 monclient: dump: 2026-02-17T11:12:36.010 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:36.011 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:36.011 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:36.011 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:36.011 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:36.011 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:36.011 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:36.011 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:36.011 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:36.011 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:36.011 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.007+0000 7fe95affd640 10 monclient: _finish_auth 0 2026-02-17T11:12:36.011 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.007+0000 7fe95affd640 10 monclient: _check_auth_tickets 2026-02-17T11:12:36.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.007+0000 7fe95affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:12:36.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.007+0000 7fe95affd640 1 -- 10.20.193.49:0/2252622091 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe96400fe20 con 0x7fe9741502b0 2026-02-17T11:12:36.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.007+0000 7fe978d3e640 5 monclient: authenticate success, global_id 4801 2026-02-17T11:12:36.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.007+0000 7fe978d3e640 10 monclient: _renew_subs 2026-02-17T11:12:36.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.007+0000 7fe978d3e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:12:36.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.007+0000 7fe978d3e640 1 -- 10.20.193.49:0/2252622091 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9740bf6f0 con 0x7fe9741502b0 2026-02-17T11:12:36.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.007+0000 7fe95affd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:12:36.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.007+0000 7fe95affd640 1 -- 10.20.193.49:0/2252622091 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe964004270 con 0x7fe9741502b0 2026-02-17T11:12:36.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.007+0000 7fe95affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:36.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.007+0000 7fe970d72640 4 set_mon_vals no callback set 2026-02-17T11:12:36.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.007+0000 7fe95affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:12:36.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.007+0000 7fe95affd640 10 monclient: dump: 2026-02-17T11:12:36.012 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:36.013 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:36.013 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:36.013 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:36.013 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:36.013 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:36.013 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:36.013 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:36.013 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:36.013 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:36.013 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.007+0000 7fe978d3e640 10 client.4801.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:12:36.013 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.007+0000 7fe978d3e640 10 monclient: _renew_subs 2026-02-17T11:12:36.013 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.007+0000 7fe978d3e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:12:36.014 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.007+0000 7fe978d3e640 1 -- 10.20.193.49:0/2252622091 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9740bfcb0 con 0x7fe9741502b0 2026-02-17T11:12:36.014 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.007+0000 7fe978d3e640 1 librados: init done 2026-02-17T11:12:36.014 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.008+0000 7fe978d3e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:12:36.014 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.008+0000 7fe978d3e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:12:36.014 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.008+0000 7fe978d3e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:12:36.014 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.008+0000 7fe978d3e640 1 -- 10.20.193.49:0/2252622091 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9741593f0 con 0x7fe9741502b0 2026-02-17T11:12:36.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.113+0000 7fe95affd640 1 -- 10.20.193.49:0/2252622091 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7fe964004410 con 0x7fe9741502b0 2026-02-17T11:12:36.115 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.113+0000 7fe95affd640 1 --2- 10.20.193.49:0/2252622091 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fe940079190 0x7fe94007b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:36.115 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.113+0000 7fe972575640 1 --2- 10.20.193.49:0/2252622091 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fe940079190 0x7fe94007b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:36.115 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.113+0000 7fe972575640 10 monclient: get_auth_request con 0x7fe940079190 auth_method 0 2026-02-17T11:12:36.115 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.114+0000 7fe972575640 1 --2- 10.20.193.49:0/2252622091 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fe940079190 0x7fe94007b650 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe968002a30 tx=0x7fe9680029a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:12:36.115 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.114+0000 7fe95affd640 10 client.4801.objecter ms_handle_connect 0x7fe940079190 2026-02-17T11:12:36.116 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.114+0000 7fe95affd640 1 -- 10.20.193.49:0/2252622091 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7fe96405e060 con 0x7fe9741502b0 2026-02-17T11:12:36.116 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.114+0000 7fe95affd640 10 client.4801.objecter ms_dispatch2 0x7fe974000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:12:36.116 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.114+0000 7fe95affd640 3 client.4801.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:12:36.116 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.114+0000 7fe95affd640 3 client.4801.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:12:36.117 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.114+0000 7fe95affd640 20 client.4801.objecter dump_active .. 0 homeless 2026-02-17T11:12:36.122 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.120+0000 7fe95affd640 1 -- 10.20.193.49:0/2252622091 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe964023020 con 0x7fe9741502b0 2026-02-17T11:12:36.122 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.120+0000 7fe95affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:12:36.122 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.120+0000 7fe95affd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:12:36.221 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.220+0000 7fe978d3e640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:12:36.222 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.220+0000 7fe978d3e640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:12:36.222 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.220+0000 7fe978d3e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:12:36.222 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.220+0000 7fe978d3e640 1 -- 10.20.193.49:0/2252622091 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe97414e800 con 0x7fe9741502b0 2026-02-17T11:12:36.224 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.223+0000 7fe95affd640 1 -- 10.20.193.49:0/2252622091 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fe964062020 con 0x7fe9741502b0 2026-02-17T11:12:36.224 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.223+0000 7fe95affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:12:36.224 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.223+0000 7fe95affd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:12:36.224 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:12:36.224 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:12:36.226 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.223+0000 7fe978d3e640 10 librados: watch_flush enter 2026-02-17T11:12:36.226 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.223+0000 7fe978d3e640 10 librados: watch_flush exit 2026-02-17T11:12:36.226 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.223+0000 7fe978d3e640 20 client.4801.objecter shutdown clearing up homeless session... 2026-02-17T11:12:36.226 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.223+0000 7fe978d3e640 10 client.4801.objecter successfully canceled tick 2026-02-17T11:12:36.226 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.223+0000 7fe978d3e640 1 -- 10.20.193.49:0/2252622091 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fe940079190 msgr2=0x7fe94007b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:36.226 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.223+0000 7fe978d3e640 1 --2- 10.20.193.49:0/2252622091 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fe940079190 0x7fe94007b650 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe968002a30 tx=0x7fe9680029a0 comp rx=0 tx=0).stop 2026-02-17T11:12:36.226 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.223+0000 7fe978d3e640 10 monclient: shutdown 2026-02-17T11:12:36.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.223+0000 7fe978d3e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:12:36.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.223+0000 7fe978d3e640 1 -- 10.20.193.49:0/2252622091 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe9741502b0 msgr2=0x7fe97414bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:36.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.223+0000 7fe978d3e640 1 --2- 10.20.193.49:0/2252622091 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe9741502b0 0x7fe97414bd40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe974069720 tx=0x7fe96400f5a0 comp rx=0 tx=0).stop 2026-02-17T11:12:36.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.223+0000 7fe978d3e640 1 -- 10.20.193.49:0/2252622091 shutdown_connections 2026-02-17T11:12:36.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.223+0000 7fe978d3e640 1 --2- 10.20.193.49:0/2252622091 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fe940079190 0x7fe94007b650 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:36.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.223+0000 7fe978d3e640 1 --2- 10.20.193.49:0/2252622091 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe9741502b0 0x7fe97414bd40 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:36.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.223+0000 7fe978d3e640 1 --2- 10.20.193.49:0/2252622091 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe9740c04b0 0x7fe974154df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:36.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.223+0000 7fe978d3e640 1 --2- 10.20.193.49:0/2252622091 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe960004e40 0x7fe9741f77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:36.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.223+0000 7fe978d3e640 1 -- 10.20.193.49:0/2252622091 >> 10.20.193.49:0/2252622091 conn(0x7fe9740c9f40 msgr2=0x7fe97414ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:12:36.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.223+0000 7fe978d3e640 1 -- 10.20.193.49:0/2252622091 shutdown_connections 2026-02-17T11:12:36.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.223+0000 7fe978d3e640 1 -- 10.20.193.49:0/2252622091 wait complete. 2026-02-17T11:12:36.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:36.223+0000 7fe978d3e640 1 librados: shutdown 2026-02-17T11:12:39.234 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:12:39.302 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.299+0000 7f05922d3640 10 monclient: get_monmap_and_config 2026-02-17T11:12:39.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.299+0000 7f05922d3640 10 monclient: build_initial_monmap 2026-02-17T11:12:39.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.299+0000 7f05922d3640 10 monclient: monmap: 2026-02-17T11:12:39.303 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:12:39.303 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:39.303 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:12:39.301302+0000 2026-02-17T11:12:39.303 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:12:39.301302+0000 2026-02-17T11:12:39.303 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:12:39.303 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:39.303 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:12:39.304 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:12:39.304 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:12:39.304 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:12:39.304 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:12:39.304 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:12:39.304 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:39.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.300+0000 7f05922d3640 1 Processor -- start 2026-02-17T11:12:39.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.300+0000 7f05922d3640 1 -- start start 2026-02-17T11:12:39.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.300+0000 7f05922d3640 10 monclient: init 2026-02-17T11:12:39.307 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.300+0000 7f05922d3640 10 monclient: _reopen_session rank -1 2026-02-17T11:12:39.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.300+0000 7f05922d3640 10 monclient: _add_conns ranks=[4,2,5,0,1,3] 2026-02-17T11:12:39.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.300+0000 7f05922d3640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f058c0c7170 0x7f058c0c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:39.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.300+0000 7f05922d3640 10 monclient(hunting): picked mon.noname-b con 0x7f058c0c7170 addr v2:10.20.193.97:3300/0 2026-02-17T11:12:39.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.300+0000 7f05922d3640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f058c0c48c0 addr v1:10.20.193.157:6789/0 2026-02-17T11:12:39.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.300+0000 7f05922d3640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f058c0c4d10 0x7f058c0c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:39.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.300+0000 7f05922d3640 10 monclient(hunting): picked mon.noname-c con 0x7f058c0c4d10 addr v2:10.20.193.157:3300/0 2026-02-17T11:12:39.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.300+0000 7f05922d3640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f058c15a9a0 con 0x7f058c0c48c0 2026-02-17T11:12:39.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.300+0000 7f05922d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:39.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.300+0000 7f05922d3640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f058c0c8530 con 0x7f058c0c7170 2026-02-17T11:12:39.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.300+0000 7f05922d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:39.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.300+0000 7f05922d3640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f058c0c5270 con 0x7f058c0c4d10 2026-02-17T11:12:39.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.300+0000 7f05922d3640 10 monclient(hunting): _renew_subs 2026-02-17T11:12:39.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.300+0000 7f05922d3640 10 monclient(hunting): authenticate will time out at 1235.964744s 2026-02-17T11:12:39.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.301+0000 7f058bfff640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f058c0c7170 0x7f058c0c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:39.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.301+0000 7f0590849640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f058c0c4d10 0x7f058c0c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:39.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.301+0000 7f058bfff640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f058c0c7170 0x7f058c0c7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:38824/0 (socket says 10.20.193.49:38824) 2026-02-17T11:12:39.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.301+0000 7f058bfff640 1 -- 10.20.193.49:0/2254669908 learned_addr learned my addr 10.20.193.49:0/2254669908 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:12:39.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.301+0000 7f058bfff640 10 monclient(hunting): get_auth_request con 0x7f058c0c7170 auth_method 0 2026-02-17T11:12:39.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.301+0000 7f058bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:39.310 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.301+0000 7f058bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:39.310 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.301+0000 7f058bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:39.310 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.301+0000 7f0590849640 10 monclient(hunting): get_auth_request con 0x7f058c0c4d10 auth_method 0 2026-02-17T11:12:39.310 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.301+0000 7f0590849640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:39.310 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.301+0000 7f0590849640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:39.310 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.301+0000 7f0590849640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:39.310 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.301+0000 7f058bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:39.310 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.301+0000 7f058bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:39.310 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.301+0000 7f058bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:39.310 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.302+0000 7f0590849640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:39.310 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.302+0000 7f0590849640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:39.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.302+0000 7f0590849640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:39.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.302+0000 7f058bfff640 10 monclient(hunting): handle_auth_done global_id 4804 payload 274 2026-02-17T11:12:39.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.302+0000 7f058bfff640 1 -- 10.20.193.49:0/2254669908 >> v2:10.20.193.157:3300/0 conn(0x7f058c0c4d10 msgr2=0x7f058c0c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:12:39.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.302+0000 7f058bfff640 1 --2- 10.20.193.49:0/2254669908 >> v2:10.20.193.157:3300/0 conn(0x7f058c0c4d10 0x7f058c0c89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:39.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.303+0000 7f058bfff640 1 -- 10.20.193.49:0/2254669908 >> v1:10.20.193.157:6789/0 conn(0x7f058c0c48c0 legacy=0x7f058c0749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:39.312 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.303+0000 7f058bfff640 10 monclient: _finish_hunting 0 2026-02-17T11:12:39.312 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.303+0000 7f058bfff640 1 monclient: found mon.noname-b 2026-02-17T11:12:39.312 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.303+0000 7f058bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:12:39.312 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.303+0000 7f058bfff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:12:39.312 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.303+0000 7f058bfff640 1 -- 10.20.193.49:0/2254669908 --> v2:10.20.193.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f058c0c5550 con 0x7f058c0c7170 2026-02-17T11:12:39.312 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.304+0000 7f058bfff640 1 --2- 10.20.193.49:0/2254669908 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f058c0c7170 0x7f058c0c7550 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f058c0c6e90 tx=0x7f057802eed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a53914bcf81f6c4d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:12:39.319 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.306+0000 7f058affd640 1 -- 10.20.193.49:0/2254669908 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f057803c070 con 0x7f058c0c7170 2026-02-17T11:12:39.319 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.306+0000 7f058affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:39.319 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.306+0000 7f058affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:12:39.319 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.306+0000 7f058affd640 10 monclient: dump: 2026-02-17T11:12:39.319 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:39.319 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:39.319 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:39.320 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:39.320 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:39.320 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:39.320 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:39.320 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:39.320 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:39.320 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:39.320 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.306+0000 7f058affd640 10 monclient: _finish_auth 0 2026-02-17T11:12:39.320 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.306+0000 7f058affd640 10 monclient: _check_auth_tickets 2026-02-17T11:12:39.320 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.306+0000 7f058affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:12:39.320 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.306+0000 7f058affd640 1 -- 10.20.193.49:0/2254669908 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f057802fbe0 con 0x7f058c0c7170 2026-02-17T11:12:39.321 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.306+0000 7f05922d3640 5 monclient: authenticate success, global_id 4804 2026-02-17T11:12:39.321 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.306+0000 7f05922d3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:12:39.321 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.306+0000 7f058affd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:12:39.321 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.306+0000 7f058affd640 1 -- 10.20.193.49:0/2254669908 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0578037440 con 0x7f058c0c7170 2026-02-17T11:12:39.321 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.306+0000 7f058affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:39.321 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.306+0000 7f058affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:12:39.321 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.306+0000 7f058affd640 10 monclient: dump: 2026-02-17T11:12:39.321 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:39.321 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:39.321 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:39.321 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:39.321 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:39.322 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:39.322 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:39.322 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:39.322 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:39.322 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:39.322 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.306+0000 7f05922d3640 10 monclient: get_monmap_and_config success 2026-02-17T11:12:39.322 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.306+0000 7f05922d3640 4 set_mon_vals no callback set 2026-02-17T11:12:39.322 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.306+0000 7f05922d3640 10 monclient: shutdown 2026-02-17T11:12:39.322 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.306+0000 7f05922d3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:12:39.322 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.306+0000 7f05922d3640 1 -- 10.20.193.49:0/2254669908 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f058c0c7170 msgr2=0x7f058c0c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:39.322 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.306+0000 7f05922d3640 1 --2- 10.20.193.49:0/2254669908 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f058c0c7170 0x7f058c0c7550 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f058c0c6e90 tx=0x7f057802eed0 comp rx=0 tx=0).stop 2026-02-17T11:12:39.322 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.306+0000 7f05922d3640 1 -- 10.20.193.49:0/2254669908 shutdown_connections 2026-02-17T11:12:39.323 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.306+0000 7f05922d3640 1 --2- 10.20.193.49:0/2254669908 >> v2:10.20.193.157:3300/0 conn(0x7f058c0c4d10 0x7f058c0c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:39.323 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.306+0000 7f05922d3640 1 --2- 10.20.193.49:0/2254669908 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f058c0c7170 0x7f058c0c7550 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:39.323 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.306+0000 7f05922d3640 1 -- 10.20.193.49:0/2254669908 >> 10.20.193.49:0/2254669908 conn(0x7f058c0c9f40 msgr2=0x7f058c0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:12:39.323 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.306+0000 7f05922d3640 1 -- 10.20.193.49:0/2254669908 shutdown_connections 2026-02-17T11:12:39.323 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.306+0000 7f05922d3640 1 -- 10.20.193.49:0/2254669908 wait complete. 2026-02-17T11:12:39.323 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.307+0000 7f05922d3640 10 monclient: build_initial_monmap 2026-02-17T11:12:39.323 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.307+0000 7f05922d3640 10 monclient: monmap: 2026-02-17T11:12:39.323 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:12:39.323 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:12:39.323 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:12:39.323 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:12:39.323 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:12:39.324 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:39.324 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:12:39.324 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:12:39.324 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:12:39.324 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:39.324 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.307+0000 7f05922d3640 1 librados: starting msgr at 2026-02-17T11:12:39.324 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.307+0000 7f05922d3640 1 librados: starting objecter 2026-02-17T11:12:39.324 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.307+0000 7f05922d3640 1 Processor -- start 2026-02-17T11:12:39.324 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.307+0000 7f05922d3640 1 -- start start 2026-02-17T11:12:39.324 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.307+0000 7f05922d3640 1 librados: setting wanted keys 2026-02-17T11:12:39.324 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.307+0000 7f05922d3640 1 librados: calling monclient init 2026-02-17T11:12:39.324 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.307+0000 7f05922d3640 10 monclient: init 2026-02-17T11:12:39.325 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.307+0000 7f05922d3640 10 monclient: _reopen_session rank -1 2026-02-17T11:12:39.325 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.307+0000 7f05922d3640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:12:39.325 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.307+0000 7f05922d3640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f058c0c48c0 0x7f058c1f5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:39.325 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.307+0000 7f05922d3640 10 monclient(hunting): picked mon.noname-a con 0x7f058c0c48c0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:12:39.325 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.307+0000 7f05922d3640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f058c0c4d10 0x7f058c1e6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:39.325 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.307+0000 7f05922d3640 10 monclient(hunting): picked mon.noname-c con 0x7f058c0c4d10 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:12:39.325 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.307+0000 7f05922d3640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f058c0c7170 0x7f058c159390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:39.325 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.307+0000 7f05922d3640 10 monclient(hunting): picked mon.noname-b con 0x7f058c0c7170 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:12:39.325 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.307+0000 7f05922d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:39.325 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.307+0000 7f05922d3640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f058c0c81c0 con 0x7f058c0c48c0 2026-02-17T11:12:39.325 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.307+0000 7f05922d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:39.325 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.307+0000 7f05922d3640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f058c0c7ee0 con 0x7f058c0c7170 2026-02-17T11:12:39.326 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.307+0000 7f05922d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:39.326 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.307+0000 7f05922d3640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f058c0750c0 con 0x7f058c0c4d10 2026-02-17T11:12:39.326 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.307+0000 7f05922d3640 10 monclient(hunting): _renew_subs 2026-02-17T11:12:39.326 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.307+0000 7f05922d3640 10 monclient(hunting): authenticate will time out at 1235.971831s 2026-02-17T11:12:39.326 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.308+0000 7f0590849640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f058c0c7170 0x7f058c159390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:39.326 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.308+0000 7f058bfff640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f058c0c48c0 0x7f058c1f5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:39.326 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.308+0000 7f058b7fe640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f058c0c4d10 0x7f058c1e6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:39.326 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.308+0000 7f0590849640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f058c0c7170 0x7f058c159390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:38830/0 (socket says 10.20.193.49:38830) 2026-02-17T11:12:39.326 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.308+0000 7f0590849640 1 -- 10.20.193.49:0/2072120524 learned_addr learned my addr 10.20.193.49:0/2072120524 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:12:39.326 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.308+0000 7f0590849640 10 monclient(hunting): get_auth_request con 0x7f058c0c7170 auth_method 0 2026-02-17T11:12:39.326 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.308+0000 7f0590849640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:39.326 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.308+0000 7f0590849640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:39.327 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.308+0000 7f0590849640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:39.327 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.308+0000 7f058b7fe640 10 monclient(hunting): get_auth_request con 0x7f058c0c4d10 auth_method 0 2026-02-17T11:12:39.327 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.308+0000 7f058b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:39.327 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.308+0000 7f058b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:39.327 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.308+0000 7f058b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:39.327 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.308+0000 7f058bfff640 10 monclient(hunting): get_auth_request con 0x7f058c0c48c0 auth_method 0 2026-02-17T11:12:39.327 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.308+0000 7f058bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:39.327 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.308+0000 7f058bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:39.327 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.308+0000 7f058bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:39.327 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.308+0000 7f0590849640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:39.328 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.308+0000 7f0590849640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:39.328 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.308+0000 7f0590849640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:39.328 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.308+0000 7f058b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:39.328 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.308+0000 7f058b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:39.328 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.308+0000 7f058b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:39.328 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.308+0000 7f058bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:39.328 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.308+0000 7f058bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:39.328 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.308+0000 7f058bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:39.328 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.310+0000 7f0590849640 10 monclient(hunting): handle_auth_done global_id 4807 payload 824 2026-02-17T11:12:39.328 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.310+0000 7f0590849640 1 -- 10.20.193.49:0/2072120524 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f058c0c4d10 msgr2=0x7f058c1e6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:39.328 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.310+0000 7f0590849640 1 --2- 10.20.193.49:0/2072120524 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f058c0c4d10 0x7f058c1e6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:39.328 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.310+0000 7f0590849640 1 -- 10.20.193.49:0/2072120524 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f058c0c48c0 msgr2=0x7f058c1f5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:39.329 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.310+0000 7f0590849640 1 --2- 10.20.193.49:0/2072120524 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f058c0c48c0 0x7f058c1f5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:39.329 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.310+0000 7f0590849640 10 monclient: _finish_hunting 0 2026-02-17T11:12:39.329 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.310+0000 7f0590849640 1 monclient: found mon.noname-b 2026-02-17T11:12:39.329 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.310+0000 7f0590849640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:12:39.329 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.310+0000 7f0590849640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:12:39.329 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.310+0000 7f0590849640 1 -- 10.20.193.49:0/2072120524 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f058c1e6690 con 0x7f058c0c7170 2026-02-17T11:12:39.329 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.311+0000 7f0590849640 1 --2- 10.20.193.49:0/2072120524 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f058c0c7170 0x7f058c159390 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f058000efc0 tx=0x7f058000c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:12:39.329 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.311+0000 7f0588ff9640 10 client.?.objecter ms_handle_connect 0x7f058c0c7170 2026-02-17T11:12:39.329 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.311+0000 7f0588ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T11:12:39.329 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.311+0000 7f0588ff9640 1 -- 10.20.193.49:0/2072120524 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0580018020 con 0x7f058c0c7170 2026-02-17T11:12:39.329 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.311+0000 7f0588ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:39.330 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.311+0000 7f0588ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:12:39.330 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.311+0000 7f0588ff9640 10 monclient: dump: 2026-02-17T11:12:39.330 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:39.330 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:39.330 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:39.330 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:39.330 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:39.330 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:39.330 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:39.330 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:39.330 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:39.330 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:39.331 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.311+0000 7f0588ff9640 10 monclient: _finish_auth 0 2026-02-17T11:12:39.331 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.311+0000 7f0588ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:12:39.331 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.311+0000 7f0588ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:12:39.331 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.311+0000 7f05922d3640 5 monclient: authenticate success, global_id 4807 2026-02-17T11:12:39.331 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.311+0000 7f05922d3640 10 monclient: _renew_subs 2026-02-17T11:12:39.331 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.311+0000 7f05922d3640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:12:39.331 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.311+0000 7f05922d3640 1 -- 10.20.193.49:0/2072120524 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f058c1f2640 con 0x7f058c0c7170 2026-02-17T11:12:39.331 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.311+0000 7f05922d3640 10 client.4807.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:12:39.331 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.311+0000 7f05922d3640 10 monclient: _renew_subs 2026-02-17T11:12:39.331 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.311+0000 7f05922d3640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:12:39.331 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.311+0000 7f05922d3640 1 -- 10.20.193.49:0/2072120524 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f058c1e5670 con 0x7f058c0c7170 2026-02-17T11:12:39.331 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.311+0000 7f05922d3640 1 librados: init done 2026-02-17T11:12:39.332 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.312+0000 7f05922d3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:12:39.332 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.312+0000 7f05922d3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:12:39.332 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.312+0000 7f05922d3640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:12:39.332 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.312+0000 7f05922d3640 1 -- 10.20.193.49:0/2072120524 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f058c0c7550 con 0x7f058c0c7170 2026-02-17T11:12:39.332 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.312+0000 7f0588ff9640 1 -- 10.20.193.49:0/2072120524 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0580014480 con 0x7f058c0c7170 2026-02-17T11:12:39.332 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.312+0000 7f0588ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:12:39.332 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.312+0000 7f0588ff9640 1 -- 10.20.193.49:0/2072120524 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0580014830 con 0x7f058c0c7170 2026-02-17T11:12:39.332 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.312+0000 7f0588ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:39.332 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.312+0000 7f0588ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:12:39.332 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.312+0000 7f058a7fc640 4 set_mon_vals no callback set 2026-02-17T11:12:39.332 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.312+0000 7f0588ff9640 10 monclient: dump: 2026-02-17T11:12:39.332 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:39.332 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:39.333 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:39.333 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:39.333 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:39.333 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:39.333 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:39.333 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:39.333 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:39.333 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:39.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.417+0000 7f0588ff9640 1 -- 10.20.193.49:0/2072120524 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f05800149d0 con 0x7f058c0c7170 2026-02-17T11:12:39.420 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.417+0000 7f0588ff9640 1 --2- 10.20.193.49:0/2072120524 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f055c079140 0x7f055c07b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:39.420 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.418+0000 7f058bfff640 1 --2- 10.20.193.49:0/2072120524 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f055c079140 0x7f055c07b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:39.420 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.418+0000 7f058bfff640 10 monclient: get_auth_request con 0x7f055c079140 auth_method 0 2026-02-17T11:12:39.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.418+0000 7f0588ff9640 1 -- 10.20.193.49:0/2072120524 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f058005f050 con 0x7f058c0c7170 2026-02-17T11:12:39.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.418+0000 7f0588ff9640 10 client.4807.objecter ms_dispatch2 0x7f058c000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:12:39.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.418+0000 7f0588ff9640 3 client.4807.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:12:39.422 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.418+0000 7f0588ff9640 3 client.4807.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:12:39.422 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.418+0000 7f0588ff9640 20 client.4807.objecter dump_active .. 0 homeless 2026-02-17T11:12:39.422 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.418+0000 7f058bfff640 1 --2- 10.20.193.49:0/2072120524 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f055c079140 0x7f055c07b600 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f058c0c7a90 tx=0x7f0578039040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:12:39.422 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.418+0000 7f0588ff9640 10 client.4807.objecter ms_handle_connect 0x7f055c079140 2026-02-17T11:12:39.428 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.425+0000 7f0588ff9640 1 -- 10.20.193.49:0/2072120524 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f0580022030 con 0x7f058c0c7170 2026-02-17T11:12:39.428 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.425+0000 7f0588ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:12:39.428 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.425+0000 7f0588ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:12:39.525 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.523+0000 7f05922d3640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:12:39.525 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.523+0000 7f05922d3640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:12:39.525 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.523+0000 7f05922d3640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:12:39.525 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.523+0000 7f05922d3640 1 -- 10.20.193.49:0/2072120524 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f058c06c000 con 0x7f058c0c7170 2026-02-17T11:12:39.527 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.525+0000 7f0588ff9640 1 -- 10.20.193.49:0/2072120524 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f0580010040 con 0x7f058c0c7170 2026-02-17T11:12:39.527 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.525+0000 7f0588ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:12:39.527 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.525+0000 7f0588ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:12:39.527 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:12:39.528 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:12:39.529 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.526+0000 7f05922d3640 10 librados: watch_flush enter 2026-02-17T11:12:39.530 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.526+0000 7f05922d3640 10 librados: watch_flush exit 2026-02-17T11:12:39.530 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.526+0000 7f05922d3640 20 client.4807.objecter shutdown clearing up homeless session... 2026-02-17T11:12:39.530 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.526+0000 7f05922d3640 10 client.4807.objecter successfully canceled tick 2026-02-17T11:12:39.530 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.526+0000 7f05922d3640 1 -- 10.20.193.49:0/2072120524 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f055c079140 msgr2=0x7f055c07b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:39.530 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.526+0000 7f05922d3640 1 --2- 10.20.193.49:0/2072120524 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f055c079140 0x7f055c07b600 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f058c0c7a90 tx=0x7f0578039040 comp rx=0 tx=0).stop 2026-02-17T11:12:39.530 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.526+0000 7f05922d3640 10 monclient: shutdown 2026-02-17T11:12:39.530 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.526+0000 7f05922d3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:12:39.530 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.526+0000 7f05922d3640 1 -- 10.20.193.49:0/2072120524 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f058c0c7170 msgr2=0x7f058c159390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:39.531 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.526+0000 7f05922d3640 1 --2- 10.20.193.49:0/2072120524 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f058c0c7170 0x7f058c159390 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f058000efc0 tx=0x7f058000c490 comp rx=0 tx=0).stop 2026-02-17T11:12:39.531 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.526+0000 7f05922d3640 1 -- 10.20.193.49:0/2072120524 shutdown_connections 2026-02-17T11:12:39.531 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.526+0000 7f05922d3640 1 --2- 10.20.193.49:0/2072120524 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f055c079140 0x7f055c07b600 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:39.531 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.526+0000 7f05922d3640 1 --2- 10.20.193.49:0/2072120524 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f058c0c7170 0x7f058c159390 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:39.531 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.526+0000 7f05922d3640 1 --2- 10.20.193.49:0/2072120524 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f058c0c4d10 0x7f058c1e6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:39.531 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.526+0000 7f05922d3640 1 --2- 10.20.193.49:0/2072120524 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f058c0c48c0 0x7f058c1f5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:39.531 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.526+0000 7f05922d3640 1 -- 10.20.193.49:0/2072120524 >> 10.20.193.49:0/2072120524 conn(0x7f058c0c9f40 msgr2=0x7f058c0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:12:39.531 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.526+0000 7f05922d3640 1 -- 10.20.193.49:0/2072120524 shutdown_connections 2026-02-17T11:12:39.531 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.526+0000 7f05922d3640 1 -- 10.20.193.49:0/2072120524 wait complete. 2026-02-17T11:12:39.531 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:39.526+0000 7f05922d3640 1 librados: shutdown 2026-02-17T11:12:42.539 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:12:42.607 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.604+0000 7fea88b2c640 10 monclient: get_monmap_and_config 2026-02-17T11:12:42.607 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.604+0000 7fea88b2c640 10 monclient: build_initial_monmap 2026-02-17T11:12:42.607 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.604+0000 7fea88b2c640 10 monclient: monmap: 2026-02-17T11:12:42.607 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:12:42.608 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:42.608 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:12:42.605687+0000 2026-02-17T11:12:42.608 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:12:42.605687+0000 2026-02-17T11:12:42.608 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:12:42.608 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:42.608 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:12:42.608 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:12:42.608 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:12:42.608 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:12:42.608 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:12:42.608 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:12:42.608 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:42.609 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.604+0000 7fea88b2c640 1 Processor -- start 2026-02-17T11:12:42.609 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.604+0000 7fea88b2c640 1 -- start start 2026-02-17T11:12:42.609 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.604+0000 7fea88b2c640 10 monclient: init 2026-02-17T11:12:42.611 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.605+0000 7fea88b2c640 10 monclient: _reopen_session rank -1 2026-02-17T11:12:42.611 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.605+0000 7fea88b2c640 10 monclient: _add_conns ranks=[3,1,5,2,4,0] 2026-02-17T11:12:42.612 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.605+0000 7fea88b2c640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fea840c7170 0x7fea840c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:42.612 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.605+0000 7fea88b2c640 10 monclient(hunting): picked mon.noname-a con 0x7fea840c7170 addr v2:10.20.193.49:3300/0 2026-02-17T11:12:42.612 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.605+0000 7fea88b2c640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fea840c48c0 addr v1:10.20.193.97:6789/0 2026-02-17T11:12:42.612 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.605+0000 7fea88b2c640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7fea840c4d10 0x7fea840c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:42.612 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.605+0000 7fea88b2c640 10 monclient(hunting): picked mon.noname-c con 0x7fea840c4d10 addr v2:10.20.193.157:3300/0 2026-02-17T11:12:42.612 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.605+0000 7fea88b2c640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea8415a9a0 con 0x7fea840c48c0 2026-02-17T11:12:42.612 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.605+0000 7fea88b2c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:42.612 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.605+0000 7fea88b2c640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7fea840c8530 con 0x7fea840c7170 2026-02-17T11:12:42.612 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.605+0000 7fea88b2c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:42.612 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.605+0000 7fea88b2c640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7fea840c5270 con 0x7fea840c4d10 2026-02-17T11:12:42.612 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.605+0000 7fea88b2c640 10 monclient(hunting): _renew_subs 2026-02-17T11:12:42.613 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.605+0000 7fea88b2c640 10 monclient(hunting): authenticate will time out at 1239.269264s 2026-02-17T11:12:42.613 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.605+0000 7fea82575640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fea840c7170 0x7fea840c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:42.613 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.605+0000 7fea82d76640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7fea840c4d10 0x7fea840c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:42.613 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.605+0000 7fea82575640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fea840c7170 0x7fea840c7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:60442/0 (socket says 10.20.193.49:60442) 2026-02-17T11:12:42.613 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.605+0000 7fea82575640 1 -- 10.20.193.49:0/3081982711 learned_addr learned my addr 10.20.193.49:0/3081982711 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:12:42.613 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.605+0000 7fea82575640 10 monclient(hunting): get_auth_request con 0x7fea840c7170 auth_method 0 2026-02-17T11:12:42.613 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.605+0000 7fea82575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:42.613 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.605+0000 7fea82575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:42.613 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.605+0000 7fea82575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:42.613 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.606+0000 7fea82d76640 10 monclient(hunting): get_auth_request con 0x7fea840c4d10 auth_method 0 2026-02-17T11:12:42.613 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.606+0000 7fea82d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:42.614 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.606+0000 7fea82d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:42.614 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.606+0000 7fea82d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:42.614 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.606+0000 7fea82575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:42.614 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.606+0000 7fea82575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:42.614 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.606+0000 7fea82575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:42.614 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.606+0000 7fea82d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:42.614 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.606+0000 7fea82d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:42.614 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.606+0000 7fea82d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:42.614 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.607+0000 7fea82d76640 10 monclient(hunting): handle_auth_done global_id 4838 payload 274 2026-02-17T11:12:42.614 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.607+0000 7fea82d76640 1 -- 10.20.193.49:0/3081982711 >> v2:10.20.193.49:3300/0 conn(0x7fea840c7170 msgr2=0x7fea840c7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:12:42.614 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.607+0000 7fea82d76640 1 --2- 10.20.193.49:0/3081982711 >> v2:10.20.193.49:3300/0 conn(0x7fea840c7170 0x7fea840c7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:42.614 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.607+0000 7fea82d76640 1 -- 10.20.193.49:0/3081982711 >> v1:10.20.193.97:6789/0 conn(0x7fea840c48c0 legacy=0x7fea840749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:42.614 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.607+0000 7fea82d76640 10 monclient: _finish_hunting 0 2026-02-17T11:12:42.614 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.607+0000 7fea82d76640 1 monclient: found mon.noname-c 2026-02-17T11:12:42.614 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.607+0000 7fea82d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:12:42.614 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.607+0000 7fea82d76640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:12:42.614 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.607+0000 7fea82d76640 1 -- 10.20.193.49:0/3081982711 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea840c5550 con 0x7fea840c4d10 2026-02-17T11:12:42.614 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.607+0000 7fea82575640 1 --2- 10.20.193.49:0/3081982711 >> v2:10.20.193.49:3300/0 conn(0x7fea840c7170 0x7fea840c7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:12:42.614 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.608+0000 7fea82d76640 1 --2- 10.20.193.49:0/3081982711 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fea840c4d10 0x7fea840c89c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fea840c6e90 tx=0x7fea7402f1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c2f1197bb9c3c80 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:12:42.616 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.610+0000 7fea81573640 1 -- 10.20.193.49:0/3081982711 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea7403c070 con 0x7fea840c4d10 2026-02-17T11:12:42.616 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.610+0000 7fea81573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:42.616 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.610+0000 7fea81573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:12:42.616 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.610+0000 7fea81573640 10 monclient: dump: 2026-02-17T11:12:42.616 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:42.616 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:42.616 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:42.616 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:42.616 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:42.616 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:42.616 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:42.616 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:42.616 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:42.616 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:42.616 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.610+0000 7fea81573640 10 monclient: _finish_auth 0 2026-02-17T11:12:42.616 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.610+0000 7fea81573640 10 monclient: _check_auth_tickets 2026-02-17T11:12:42.616 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.610+0000 7fea81573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:12:42.616 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.610+0000 7fea81573640 1 -- 10.20.193.49:0/3081982711 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea74037440 con 0x7fea840c4d10 2026-02-17T11:12:42.616 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.610+0000 7fea88b2c640 5 monclient: authenticate success, global_id 4838 2026-02-17T11:12:42.616 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.610+0000 7fea81573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:12:42.616 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.610+0000 7fea88b2c640 10 monclient: get_monmap_and_config success 2026-02-17T11:12:42.617 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.610+0000 7fea81573640 1 -- 10.20.193.49:0/3081982711 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea74037810 con 0x7fea840c4d10 2026-02-17T11:12:42.617 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.610+0000 7fea88b2c640 4 set_mon_vals no callback set 2026-02-17T11:12:42.617 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.610+0000 7fea81573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:42.617 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.610+0000 7fea81573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:12:42.617 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.610+0000 7fea81573640 10 monclient: dump: 2026-02-17T11:12:42.617 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:42.617 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:42.617 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:42.617 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:42.617 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:42.617 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:42.617 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:42.617 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:42.617 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:42.617 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:42.617 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.610+0000 7fea88b2c640 10 monclient: shutdown 2026-02-17T11:12:42.617 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.610+0000 7fea88b2c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:12:42.617 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.610+0000 7fea88b2c640 1 -- 10.20.193.49:0/3081982711 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fea840c4d10 msgr2=0x7fea840c89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:42.617 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.610+0000 7fea88b2c640 1 --2- 10.20.193.49:0/3081982711 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fea840c4d10 0x7fea840c89c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fea840c6e90 tx=0x7fea7402f1c0 comp rx=0 tx=0).stop 2026-02-17T11:12:42.617 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.610+0000 7fea88b2c640 1 -- 10.20.193.49:0/3081982711 shutdown_connections 2026-02-17T11:12:42.617 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.610+0000 7fea88b2c640 1 --2- 10.20.193.49:0/3081982711 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fea840c4d10 0x7fea840c89c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:42.617 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.610+0000 7fea88b2c640 1 --2- 10.20.193.49:0/3081982711 >> v2:10.20.193.49:3300/0 conn(0x7fea840c7170 0x7fea840c7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:42.617 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.610+0000 7fea88b2c640 1 -- 10.20.193.49:0/3081982711 >> 10.20.193.49:0/3081982711 conn(0x7fea840c9f40 msgr2=0x7fea840ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:12:42.617 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.610+0000 7fea88b2c640 1 -- 10.20.193.49:0/3081982711 shutdown_connections 2026-02-17T11:12:42.617 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.610+0000 7fea88b2c640 1 -- 10.20.193.49:0/3081982711 wait complete. 2026-02-17T11:12:42.617 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.611+0000 7fea88b2c640 10 monclient: build_initial_monmap 2026-02-17T11:12:42.617 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.611+0000 7fea88b2c640 10 monclient: monmap: 2026-02-17T11:12:42.617 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:12:42.617 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:12:42.617 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:12:42.617 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:12:42.617 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:12:42.617 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:42.617 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:12:42.617 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:12:42.617 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:12:42.617 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:42.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.611+0000 7fea88b2c640 1 librados: starting msgr at 2026-02-17T11:12:42.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.611+0000 7fea88b2c640 1 librados: starting objecter 2026-02-17T11:12:42.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.611+0000 7fea88b2c640 1 Processor -- start 2026-02-17T11:12:42.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.611+0000 7fea88b2c640 1 -- start start 2026-02-17T11:12:42.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.611+0000 7fea88b2c640 1 librados: setting wanted keys 2026-02-17T11:12:42.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.611+0000 7fea88b2c640 1 librados: calling monclient init 2026-02-17T11:12:42.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.611+0000 7fea88b2c640 10 monclient: init 2026-02-17T11:12:42.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.611+0000 7fea88b2c640 10 monclient: _reopen_session rank -1 2026-02-17T11:12:42.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.611+0000 7fea88b2c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:12:42.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.611+0000 7fea88b2c640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fea840c48c0 0x7fea841f2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:42.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.611+0000 7fea88b2c640 10 monclient(hunting): picked mon.noname-a con 0x7fea840c48c0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:12:42.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.611+0000 7fea88b2c640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fea840c4d10 0x7fea8415aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:42.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.611+0000 7fea88b2c640 10 monclient(hunting): picked mon.noname-c con 0x7fea840c4d10 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:12:42.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.611+0000 7fea88b2c640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fea840c7170 0x7fea840cb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:42.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.611+0000 7fea88b2c640 10 monclient(hunting): picked mon.noname-b con 0x7fea840c7170 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:12:42.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.611+0000 7fea88b2c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:42.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.611+0000 7fea88b2c640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fea840c81c0 con 0x7fea840c48c0 2026-02-17T11:12:42.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.611+0000 7fea88b2c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:42.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.611+0000 7fea88b2c640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fea840c7ee0 con 0x7fea840c7170 2026-02-17T11:12:42.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.611+0000 7fea88b2c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:42.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.611+0000 7fea88b2c640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fea840750c0 con 0x7fea840c4d10 2026-02-17T11:12:42.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.611+0000 7fea88b2c640 10 monclient(hunting): _renew_subs 2026-02-17T11:12:42.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.611+0000 7fea88b2c640 10 monclient(hunting): authenticate will time out at 1239.275998s 2026-02-17T11:12:42.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.612+0000 7fea82575640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fea840c48c0 0x7fea841f2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:42.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.612+0000 7fea82575640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fea840c48c0 0x7fea841f2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:60454/0 (socket says 10.20.193.49:60454) 2026-02-17T11:12:42.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.612+0000 7fea82575640 1 -- 10.20.193.49:0/22757197 learned_addr learned my addr 10.20.193.49:0/22757197 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:12:42.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.612+0000 7fea82575640 10 monclient(hunting): get_auth_request con 0x7fea840c48c0 auth_method 0 2026-02-17T11:12:42.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.612+0000 7fea82575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:42.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.612+0000 7fea82575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:42.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.612+0000 7fea82575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:42.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.612+0000 7fea82d76640 1 --2- 10.20.193.49:0/22757197 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fea840c7170 0x7fea840cb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:42.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.612+0000 7fea81d74640 1 --2- 10.20.193.49:0/22757197 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fea840c4d10 0x7fea8415aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:42.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.612+0000 7fea81d74640 10 monclient(hunting): get_auth_request con 0x7fea840c4d10 auth_method 0 2026-02-17T11:12:42.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.612+0000 7fea81d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:42.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.612+0000 7fea81d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:42.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.612+0000 7fea81d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:42.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.612+0000 7fea82d76640 10 monclient(hunting): get_auth_request con 0x7fea840c7170 auth_method 0 2026-02-17T11:12:42.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.612+0000 7fea82d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:42.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.612+0000 7fea82d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:42.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.612+0000 7fea82d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:42.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.612+0000 7fea82575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:42.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.612+0000 7fea82575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:42.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.612+0000 7fea82575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:42.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.612+0000 7fea81d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:42.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.612+0000 7fea81d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:42.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.612+0000 7fea81d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:42.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.612+0000 7fea82d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:42.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.612+0000 7fea82d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:42.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.612+0000 7fea82d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:42.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.613+0000 7fea82575640 10 monclient(hunting): handle_auth_done global_id 4854 payload 824 2026-02-17T11:12:42.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.613+0000 7fea82575640 1 -- 10.20.193.49:0/22757197 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fea840c4d10 msgr2=0x7fea8415aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:42.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.613+0000 7fea82575640 1 --2- 10.20.193.49:0/22757197 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fea840c4d10 0x7fea8415aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:42.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.613+0000 7fea82575640 1 -- 10.20.193.49:0/22757197 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fea840c7170 msgr2=0x7fea840cb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:42.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.613+0000 7fea82575640 1 --2- 10.20.193.49:0/22757197 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fea840c7170 0x7fea840cb8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:42.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.613+0000 7fea82575640 10 monclient: _finish_hunting 0 2026-02-17T11:12:42.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.613+0000 7fea82575640 1 monclient: found mon.noname-a 2026-02-17T11:12:42.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.613+0000 7fea82575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:12:42.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.613+0000 7fea82575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:12:42.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.613+0000 7fea82575640 1 -- 10.20.193.49:0/22757197 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea8415b740 con 0x7fea840c48c0 2026-02-17T11:12:42.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.614+0000 7fea82575640 1 --2- 10.20.193.49:0/22757197 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fea840c48c0 0x7fea841f2080 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fea7800ebe0 tx=0x7fea7800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:12:42.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.614+0000 7fea6affd640 10 client.?.objecter ms_handle_connect 0x7fea840c48c0 2026-02-17T11:12:42.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.614+0000 7fea6affd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:12:42.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.616+0000 7fea6affd640 1 -- 10.20.193.49:0/22757197 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea78017070 con 0x7fea840c48c0 2026-02-17T11:12:42.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.616+0000 7fea6affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:42.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.616+0000 7fea6affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:12:42.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.616+0000 7fea6affd640 10 monclient: dump: 2026-02-17T11:12:42.620 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:42.620 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:42.620 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:42.620 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:42.620 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:42.620 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:42.620 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:42.620 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:42.620 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:42.620 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:42.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.616+0000 7fea6affd640 10 monclient: _finish_auth 0 2026-02-17T11:12:42.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.616+0000 7fea6affd640 10 monclient: _check_auth_tickets 2026-02-17T11:12:42.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.616+0000 7fea6affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:12:42.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.616+0000 7fea6affd640 1 -- 10.20.193.49:0/22757197 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea7800cc40 con 0x7fea840c48c0 2026-02-17T11:12:42.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.616+0000 7fea6affd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:12:42.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.616+0000 7fea6affd640 1 -- 10.20.193.49:0/22757197 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea78013470 con 0x7fea840c48c0 2026-02-17T11:12:42.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.616+0000 7fea6affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:42.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.616+0000 7fea6affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:12:42.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.616+0000 7fea80d72640 4 set_mon_vals no callback set 2026-02-17T11:12:42.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.616+0000 7fea6affd640 10 monclient: dump: 2026-02-17T11:12:42.620 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:42.620 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:42.620 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:42.620 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:42.621 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:42.621 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:42.621 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:42.621 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:42.621 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:42.621 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:42.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.616+0000 7fea88b2c640 5 monclient: authenticate success, global_id 4854 2026-02-17T11:12:42.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.616+0000 7fea88b2c640 10 monclient: _renew_subs 2026-02-17T11:12:42.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.616+0000 7fea88b2c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:12:42.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.616+0000 7fea88b2c640 1 -- 10.20.193.49:0/22757197 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea8415ba20 con 0x7fea840c48c0 2026-02-17T11:12:42.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.616+0000 7fea88b2c640 10 client.4854.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:12:42.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.616+0000 7fea88b2c640 10 monclient: _renew_subs 2026-02-17T11:12:42.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.616+0000 7fea88b2c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:12:42.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.616+0000 7fea88b2c640 1 -- 10.20.193.49:0/22757197 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea8415c9e0 con 0x7fea840c48c0 2026-02-17T11:12:42.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.616+0000 7fea88b2c640 1 librados: init done 2026-02-17T11:12:42.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.617+0000 7fea88b2c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:12:42.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.617+0000 7fea88b2c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:12:42.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.617+0000 7fea88b2c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:12:42.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.617+0000 7fea88b2c640 1 -- 10.20.193.49:0/22757197 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea840c7550 con 0x7fea840c48c0 2026-02-17T11:12:42.630 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.628+0000 7fea6affd640 1 -- 10.20.193.49:0/22757197 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7fea78013610 con 0x7fea840c48c0 2026-02-17T11:12:42.631 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.629+0000 7fea6affd640 1 --2- 10.20.193.49:0/22757197 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fea50079190 0x7fea5007b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:42.631 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.629+0000 7fea81d74640 1 --2- 10.20.193.49:0/22757197 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fea50079190 0x7fea5007b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:42.631 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.629+0000 7fea81d74640 10 monclient: get_auth_request con 0x7fea50079190 auth_method 0 2026-02-17T11:12:42.632 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.629+0000 7fea81d74640 1 --2- 10.20.193.49:0/22757197 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fea50079190 0x7fea5007b650 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fea6c005110 tx=0x7fea6c007f30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:12:42.632 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.629+0000 7fea6affd640 10 client.4854.objecter ms_handle_connect 0x7fea50079190 2026-02-17T11:12:42.634 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.631+0000 7fea6affd640 1 -- 10.20.193.49:0/22757197 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7fea7805e630 con 0x7fea840c48c0 2026-02-17T11:12:42.634 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.631+0000 7fea6affd640 10 client.4854.objecter ms_dispatch2 0x7fea84000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:12:42.634 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.631+0000 7fea6affd640 3 client.4854.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:12:42.634 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.631+0000 7fea6affd640 3 client.4854.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:12:42.634 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.631+0000 7fea6affd640 20 client.4854.objecter dump_active .. 0 homeless 2026-02-17T11:12:42.733 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.731+0000 7fea6affd640 1 -- 10.20.193.49:0/22757197 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fea780625f0 con 0x7fea840c48c0 2026-02-17T11:12:42.733 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.731+0000 7fea6affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:12:42.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.731+0000 7fea6affd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:12:42.831 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.829+0000 7fea88b2c640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:12:42.831 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.829+0000 7fea88b2c640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:12:42.832 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.829+0000 7fea88b2c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:12:42.832 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.829+0000 7fea88b2c640 1 -- 10.20.193.49:0/22757197 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fea841574f0 con 0x7fea840c48c0 2026-02-17T11:12:42.833 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.831+0000 7fea6affd640 1 -- 10.20.193.49:0/22757197 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fea780668f0 con 0x7fea840c48c0 2026-02-17T11:12:42.834 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.831+0000 7fea6affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:12:42.834 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.831+0000 7fea6affd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:12:42.834 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:12:42.834 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:12:42.836 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.832+0000 7fea88b2c640 10 librados: watch_flush enter 2026-02-17T11:12:42.836 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.832+0000 7fea88b2c640 10 librados: watch_flush exit 2026-02-17T11:12:42.837 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.832+0000 7fea88b2c640 20 client.4854.objecter shutdown clearing up homeless session... 2026-02-17T11:12:42.837 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.832+0000 7fea88b2c640 10 client.4854.objecter successfully canceled tick 2026-02-17T11:12:42.837 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.832+0000 7fea88b2c640 1 -- 10.20.193.49:0/22757197 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fea50079190 msgr2=0x7fea5007b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:42.837 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.832+0000 7fea88b2c640 1 --2- 10.20.193.49:0/22757197 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fea50079190 0x7fea5007b650 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fea6c005110 tx=0x7fea6c007f30 comp rx=0 tx=0).stop 2026-02-17T11:12:42.837 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.832+0000 7fea88b2c640 10 monclient: shutdown 2026-02-17T11:12:42.837 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.832+0000 7fea88b2c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:12:42.837 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.832+0000 7fea88b2c640 1 -- 10.20.193.49:0/22757197 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fea840c48c0 msgr2=0x7fea841f2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:42.837 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.832+0000 7fea88b2c640 1 --2- 10.20.193.49:0/22757197 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fea840c48c0 0x7fea841f2080 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fea7800ebe0 tx=0x7fea7800c520 comp rx=0 tx=0).stop 2026-02-17T11:12:42.837 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.832+0000 7fea88b2c640 1 -- 10.20.193.49:0/22757197 shutdown_connections 2026-02-17T11:12:42.837 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.832+0000 7fea88b2c640 1 --2- 10.20.193.49:0/22757197 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fea50079190 0x7fea5007b650 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:42.838 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.832+0000 7fea88b2c640 1 --2- 10.20.193.49:0/22757197 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fea840c7170 0x7fea840cb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:42.838 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.832+0000 7fea88b2c640 1 --2- 10.20.193.49:0/22757197 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fea840c4d10 0x7fea8415aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:42.838 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.832+0000 7fea88b2c640 1 --2- 10.20.193.49:0/22757197 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fea840c48c0 0x7fea841f2080 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:42.838 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.832+0000 7fea88b2c640 1 -- 10.20.193.49:0/22757197 >> 10.20.193.49:0/22757197 conn(0x7fea840c9f40 msgr2=0x7fea8414d420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:12:42.838 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.832+0000 7fea88b2c640 1 -- 10.20.193.49:0/22757197 shutdown_connections 2026-02-17T11:12:42.838 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.832+0000 7fea88b2c640 1 -- 10.20.193.49:0/22757197 wait complete. 2026-02-17T11:12:42.838 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:42.832+0000 7fea88b2c640 1 librados: shutdown 2026-02-17T11:12:45.843 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:12:45.912 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.909+0000 7fb14ac6f640 10 monclient: get_monmap_and_config 2026-02-17T11:12:45.912 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.909+0000 7fb14ac6f640 10 monclient: build_initial_monmap 2026-02-17T11:12:45.912 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.909+0000 7fb14ac6f640 10 monclient: monmap: 2026-02-17T11:12:45.912 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:12:45.912 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:45.912 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:12:45.910873+0000 2026-02-17T11:12:45.913 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:12:45.910873+0000 2026-02-17T11:12:45.913 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:12:45.913 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:45.913 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:12:45.913 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:12:45.913 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:12:45.913 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:12:45.913 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:12:45.913 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:12:45.913 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:45.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.909+0000 7fb14ac6f640 1 Processor -- start 2026-02-17T11:12:45.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.909+0000 7fb14ac6f640 1 -- start start 2026-02-17T11:12:45.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.909+0000 7fb14ac6f640 10 monclient: init 2026-02-17T11:12:45.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.910+0000 7fb14ac6f640 10 monclient: _reopen_session rank -1 2026-02-17T11:12:45.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.910+0000 7fb14ac6f640 10 monclient: _add_conns ranks=[5,3,1,4,0,2] 2026-02-17T11:12:45.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.910+0000 7fb14ac6f640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7fb1440c7170 0x7fb1440c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:45.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.910+0000 7fb14ac6f640 10 monclient(hunting): picked mon.noname-c con 0x7fb1440c7170 addr v2:10.20.193.157:3300/0 2026-02-17T11:12:45.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.910+0000 7fb14ac6f640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fb1440c48c0 0x7fb1440749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:45.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.910+0000 7fb14ac6f640 10 monclient(hunting): picked mon.noname-a con 0x7fb1440c48c0 addr v2:10.20.193.49:3300/0 2026-02-17T11:12:45.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.910+0000 7fb14ac6f640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fb144074ef0 addr v1:10.20.193.97:6789/0 2026-02-17T11:12:45.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.910+0000 7fb14ac6f640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb14415a9a0 con 0x7fb144074ef0 2026-02-17T11:12:45.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.910+0000 7fb14ac6f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:45.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.910+0000 7fb14ac6f640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7fb1440c8530 con 0x7fb1440c48c0 2026-02-17T11:12:45.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.910+0000 7fb14ac6f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:45.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.910+0000 7fb14ac6f640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7fb1440c5270 con 0x7fb1440c7170 2026-02-17T11:12:45.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.910+0000 7fb14ac6f640 10 monclient(hunting): _renew_subs 2026-02-17T11:12:45.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.910+0000 7fb14ac6f640 10 monclient(hunting): authenticate will time out at 1242.574317s 2026-02-17T11:12:45.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.910+0000 7fb1491e5640 1 --1- >> v1:10.20.193.97:6789/0 conn(0x7fb144074ef0 0x7fb1440c89c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.97:6789/0 says I am v1:10.20.193.49:57550/0 (socket says 10.20.193.49:57550) 2026-02-17T11:12:45.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.910+0000 7fb1491e5640 1 -- 10.20.193.49:0/2182651750 learned_addr learned my addr 10.20.193.49:0/2182651750 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:12:45.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.910+0000 7fb13bfff640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fb1440c48c0 0x7fb1440749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:45.918 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.910+0000 7fb1489e4640 1 --2- 10.20.193.49:0/2182651750 >> v2:10.20.193.157:3300/0 conn(0x7fb1440c7170 0x7fb1440c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:45.918 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.911+0000 7fb13bfff640 10 monclient(hunting): get_auth_request con 0x7fb1440c48c0 auth_method 0 2026-02-17T11:12:45.918 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.911+0000 7fb13bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:45.918 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.911+0000 7fb13bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:45.918 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.911+0000 7fb13bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:45.918 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.911+0000 7fb1489e4640 10 monclient(hunting): get_auth_request con 0x7fb1440c7170 auth_method 0 2026-02-17T11:12:45.918 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.911+0000 7fb1489e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:45.918 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.911+0000 7fb1489e4640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:45.918 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.911+0000 7fb1489e4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:45.918 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.911+0000 7fb13bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:45.918 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.911+0000 7fb13bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:45.918 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.911+0000 7fb13bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:45.919 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.911+0000 7fb1489e4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:45.919 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.911+0000 7fb1489e4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:45.919 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.911+0000 7fb1489e4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:45.919 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.912+0000 7fb13bfff640 10 monclient(hunting): handle_auth_done global_id 4857 payload 274 2026-02-17T11:12:45.919 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.912+0000 7fb13bfff640 1 -- 10.20.193.49:0/2182651750 >> v2:10.20.193.157:3300/0 conn(0x7fb1440c7170 msgr2=0x7fb1440c7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:12:45.919 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.912+0000 7fb13bfff640 1 --2- 10.20.193.49:0/2182651750 >> v2:10.20.193.157:3300/0 conn(0x7fb1440c7170 0x7fb1440c7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:45.919 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.912+0000 7fb13bfff640 1 -- 10.20.193.49:0/2182651750 >> v1:10.20.193.97:6789/0 conn(0x7fb144074ef0 legacy=0x7fb1440c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:45.919 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.912+0000 7fb13bfff640 10 monclient: _finish_hunting 0 2026-02-17T11:12:45.919 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.912+0000 7fb13bfff640 1 monclient: found mon.noname-a 2026-02-17T11:12:45.919 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.912+0000 7fb13bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:12:45.919 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.912+0000 7fb13bfff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:12:45.919 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.912+0000 7fb13bfff640 1 -- 10.20.193.49:0/2182651750 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1440c5550 con 0x7fb1440c48c0 2026-02-17T11:12:45.920 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.913+0000 7fb13bfff640 1 --2- 10.20.193.49:0/2182651750 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb1440c48c0 0x7fb1440749b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb1440723c0 tx=0x7fb12c02ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80ec25a09b8651ae server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:12:45.926 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.915+0000 7fb13b7fe640 1 -- 10.20.193.49:0/2182651750 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb12c03c070 con 0x7fb1440c48c0 2026-02-17T11:12:45.926 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.915+0000 7fb13b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:45.926 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.915+0000 7fb13b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:12:45.926 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.915+0000 7fb13b7fe640 10 monclient: dump: 2026-02-17T11:12:45.926 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:45.926 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:45.926 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:45.927 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:45.927 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:45.927 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:45.927 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:45.927 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:45.927 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:45.927 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:45.927 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.915+0000 7fb13b7fe640 10 monclient: _finish_auth 0 2026-02-17T11:12:45.927 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.915+0000 7fb13b7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:12:45.927 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.915+0000 7fb13b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:12:45.927 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.915+0000 7fb13b7fe640 1 -- 10.20.193.49:0/2182651750 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb12c02faf0 con 0x7fb1440c48c0 2026-02-17T11:12:45.927 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.915+0000 7fb13b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:12:45.928 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.915+0000 7fb14ac6f640 5 monclient: authenticate success, global_id 4857 2026-02-17T11:12:45.928 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.915+0000 7fb13b7fe640 1 -- 10.20.193.49:0/2182651750 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb12c037440 con 0x7fb1440c48c0 2026-02-17T11:12:45.928 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.915+0000 7fb13b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:45.928 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.915+0000 7fb13b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:12:45.928 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.915+0000 7fb13b7fe640 10 monclient: dump: 2026-02-17T11:12:45.928 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:45.928 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:45.928 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:45.928 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:45.928 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:45.928 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:45.928 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:45.929 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:45.929 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:45.929 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:45.929 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.915+0000 7fb14ac6f640 10 monclient: get_monmap_and_config success 2026-02-17T11:12:45.929 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.915+0000 7fb14ac6f640 4 set_mon_vals no callback set 2026-02-17T11:12:45.929 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.915+0000 7fb14ac6f640 10 monclient: shutdown 2026-02-17T11:12:45.929 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.915+0000 7fb14ac6f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:12:45.929 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.915+0000 7fb14ac6f640 1 -- 10.20.193.49:0/2182651750 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb1440c48c0 msgr2=0x7fb1440749b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:45.929 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.915+0000 7fb14ac6f640 1 --2- 10.20.193.49:0/2182651750 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb1440c48c0 0x7fb1440749b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb1440723c0 tx=0x7fb12c02ede0 comp rx=0 tx=0).stop 2026-02-17T11:12:45.929 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.915+0000 7fb14ac6f640 1 -- 10.20.193.49:0/2182651750 shutdown_connections 2026-02-17T11:12:45.929 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.915+0000 7fb14ac6f640 1 --2- 10.20.193.49:0/2182651750 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb1440c48c0 0x7fb1440749b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:45.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.915+0000 7fb14ac6f640 1 --2- 10.20.193.49:0/2182651750 >> v2:10.20.193.157:3300/0 conn(0x7fb1440c7170 0x7fb1440c7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:45.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.915+0000 7fb14ac6f640 1 -- 10.20.193.49:0/2182651750 >> 10.20.193.49:0/2182651750 conn(0x7fb1440c9f40 msgr2=0x7fb1440ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:12:45.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.915+0000 7fb14ac6f640 1 -- 10.20.193.49:0/2182651750 shutdown_connections 2026-02-17T11:12:45.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.915+0000 7fb14ac6f640 1 -- 10.20.193.49:0/2182651750 wait complete. 2026-02-17T11:12:45.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.916+0000 7fb14ac6f640 10 monclient: build_initial_monmap 2026-02-17T11:12:45.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.916+0000 7fb14ac6f640 10 monclient: monmap: 2026-02-17T11:12:45.930 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:12:45.930 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:12:45.930 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:12:45.930 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:12:45.930 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:12:45.930 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:45.931 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:12:45.931 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:12:45.931 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:12:45.931 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:45.931 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.916+0000 7fb14ac6f640 1 librados: starting msgr at 2026-02-17T11:12:45.931 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.916+0000 7fb14ac6f640 1 librados: starting objecter 2026-02-17T11:12:45.931 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.916+0000 7fb14ac6f640 1 Processor -- start 2026-02-17T11:12:45.931 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.916+0000 7fb14ac6f640 1 -- start start 2026-02-17T11:12:45.931 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.916+0000 7fb14ac6f640 1 librados: setting wanted keys 2026-02-17T11:12:45.931 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.916+0000 7fb14ac6f640 1 librados: calling monclient init 2026-02-17T11:12:45.931 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.916+0000 7fb14ac6f640 10 monclient: init 2026-02-17T11:12:45.931 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.917+0000 7fb14ac6f640 10 monclient: _reopen_session rank -1 2026-02-17T11:12:45.931 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.917+0000 7fb14ac6f640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:12:45.932 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.917+0000 7fb14ac6f640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb144074ef0 0x7fb144154630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:45.932 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.917+0000 7fb14ac6f640 10 monclient(hunting): picked mon.noname-a con 0x7fb144074ef0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:12:45.932 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.917+0000 7fb14ac6f640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb1440c48c0 0x7fb1440c2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:45.932 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.917+0000 7fb14ac6f640 10 monclient(hunting): picked mon.noname-b con 0x7fb1440c48c0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:12:45.932 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.917+0000 7fb14ac6f640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb1440c7170 0x7fb1440c2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:45.932 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.917+0000 7fb14ac6f640 10 monclient(hunting): picked mon.noname-c con 0x7fb1440c7170 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:12:45.932 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.917+0000 7fb14ac6f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:45.932 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.917+0000 7fb14ac6f640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb1440c81c0 con 0x7fb144074ef0 2026-02-17T11:12:45.932 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.917+0000 7fb14ac6f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:45.932 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.917+0000 7fb14ac6f640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb1440c7ee0 con 0x7fb1440c48c0 2026-02-17T11:12:45.932 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.917+0000 7fb14ac6f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:45.932 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.917+0000 7fb14ac6f640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb1440c90d0 con 0x7fb1440c7170 2026-02-17T11:12:45.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.917+0000 7fb14ac6f640 10 monclient(hunting): _renew_subs 2026-02-17T11:12:45.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.917+0000 7fb14ac6f640 10 monclient(hunting): authenticate will time out at 1242.581264s 2026-02-17T11:12:45.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.917+0000 7fb1489e4640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb144074ef0 0x7fb144154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:45.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.917+0000 7fb13bfff640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb1440c48c0 0x7fb1440c2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:45.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.917+0000 7fb1491e5640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb1440c7170 0x7fb1440c2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:45.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.917+0000 7fb13bfff640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb1440c48c0 0x7fb1440c2320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:38848/0 (socket says 10.20.193.49:38848) 2026-02-17T11:12:45.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.917+0000 7fb13bfff640 1 -- 10.20.193.49:0/2715860692 learned_addr learned my addr 10.20.193.49:0/2715860692 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:12:45.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.917+0000 7fb13bfff640 10 monclient(hunting): get_auth_request con 0x7fb1440c48c0 auth_method 0 2026-02-17T11:12:45.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.917+0000 7fb13bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:45.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.917+0000 7fb13bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:45.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.917+0000 7fb13bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:45.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.917+0000 7fb1489e4640 10 monclient(hunting): get_auth_request con 0x7fb144074ef0 auth_method 0 2026-02-17T11:12:45.934 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.917+0000 7fb1489e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:45.934 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.917+0000 7fb1489e4640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:45.934 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.917+0000 7fb1489e4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:45.934 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.917+0000 7fb1491e5640 10 monclient(hunting): get_auth_request con 0x7fb1440c7170 auth_method 0 2026-02-17T11:12:45.934 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.917+0000 7fb1491e5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:45.934 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.917+0000 7fb1491e5640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:45.934 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.917+0000 7fb1491e5640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:45.934 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.918+0000 7fb13bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:45.934 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.918+0000 7fb13bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:45.934 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.918+0000 7fb13bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:45.934 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.918+0000 7fb1489e4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:45.934 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.918+0000 7fb1489e4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:45.935 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.918+0000 7fb1489e4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:45.935 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.918+0000 7fb1491e5640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:45.935 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.918+0000 7fb1491e5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:45.935 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.918+0000 7fb1491e5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:45.935 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.919+0000 7fb1489e4640 10 monclient(hunting): handle_auth_done global_id 4860 payload 824 2026-02-17T11:12:45.935 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.919+0000 7fb1489e4640 1 -- 10.20.193.49:0/2715860692 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb1440c7170 msgr2=0x7fb1440c2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:45.935 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.919+0000 7fb1489e4640 1 --2- 10.20.193.49:0/2715860692 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb1440c7170 0x7fb1440c2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:45.935 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.919+0000 7fb1489e4640 1 -- 10.20.193.49:0/2715860692 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb1440c48c0 msgr2=0x7fb1440c2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:45.935 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.919+0000 7fb1489e4640 1 --2- 10.20.193.49:0/2715860692 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb1440c48c0 0x7fb1440c2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:45.935 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.919+0000 7fb1489e4640 10 monclient: _finish_hunting 0 2026-02-17T11:12:45.935 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.919+0000 7fb1489e4640 1 monclient: found mon.noname-a 2026-02-17T11:12:45.935 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.919+0000 7fb1489e4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:12:45.936 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.919+0000 7fb1489e4640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:12:45.936 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.919+0000 7fb1489e4640 1 -- 10.20.193.49:0/2715860692 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1441f4b30 con 0x7fb144074ef0 2026-02-17T11:12:45.936 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.920+0000 7fb1489e4640 1 --2- 10.20.193.49:0/2715860692 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb144074ef0 0x7fb144154630 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb13400e870 tx=0x7fb13400ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:12:45.936 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.920+0000 7fb1397fa640 10 client.?.objecter ms_handle_connect 0x7fb144074ef0 2026-02-17T11:12:45.936 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.920+0000 7fb1397fa640 10 client.?.objecter resend_mon_ops 2026-02-17T11:12:45.936 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.922+0000 7fb1397fa640 1 -- 10.20.193.49:0/2715860692 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb134017070 con 0x7fb144074ef0 2026-02-17T11:12:45.936 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.922+0000 7fb1397fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:45.936 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.922+0000 7fb1397fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:12:45.936 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.922+0000 7fb1397fa640 10 monclient: dump: 2026-02-17T11:12:45.936 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:45.936 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:45.936 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:45.936 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:45.937 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:45.937 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:45.937 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:45.937 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:45.937 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:45.937 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:45.937 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.922+0000 7fb1397fa640 10 monclient: _finish_auth 0 2026-02-17T11:12:45.937 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.922+0000 7fb1397fa640 10 monclient: _check_auth_tickets 2026-02-17T11:12:45.937 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.922+0000 7fb1397fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:12:45.937 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.922+0000 7fb14ac6f640 5 monclient: authenticate success, global_id 4860 2026-02-17T11:12:45.937 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.922+0000 7fb1397fa640 1 -- 10.20.193.49:0/2715860692 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb13400c940 con 0x7fb144074ef0 2026-02-17T11:12:45.937 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.922+0000 7fb14ac6f640 10 monclient: _renew_subs 2026-02-17T11:12:45.938 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.922+0000 7fb14ac6f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:12:45.938 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.922+0000 7fb14ac6f640 1 -- 10.20.193.49:0/2715860692 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1441f4e10 con 0x7fb144074ef0 2026-02-17T11:12:45.938 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.922+0000 7fb1397fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:12:45.938 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.922+0000 7fb1397fa640 1 -- 10.20.193.49:0/2715860692 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb13400cd10 con 0x7fb144074ef0 2026-02-17T11:12:45.938 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.922+0000 7fb1397fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:45.938 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.922+0000 7fb1397fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:12:45.938 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.922+0000 7fb1397fa640 10 monclient: dump: 2026-02-17T11:12:45.938 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:45.938 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:45.938 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:45.938 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:45.938 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:45.938 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:45.939 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:45.939 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:45.939 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:45.939 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:45.939 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.922+0000 7fb13affd640 4 set_mon_vals no callback set 2026-02-17T11:12:45.939 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.922+0000 7fb14ac6f640 10 client.4860.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:12:45.939 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.922+0000 7fb14ac6f640 10 monclient: _renew_subs 2026-02-17T11:12:45.939 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.922+0000 7fb14ac6f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:12:45.939 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.922+0000 7fb14ac6f640 1 -- 10.20.193.49:0/2715860692 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1441f53d0 con 0x7fb144074ef0 2026-02-17T11:12:45.939 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.922+0000 7fb14ac6f640 1 librados: init done 2026-02-17T11:12:45.939 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.922+0000 7fb14ac6f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:12:45.939 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.922+0000 7fb14ac6f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:12:45.940 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.922+0000 7fb14ac6f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:12:45.940 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.922+0000 7fb14ac6f640 1 -- 10.20.193.49:0/2715860692 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb144076600 con 0x7fb144074ef0 2026-02-17T11:12:45.941 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.934+0000 7fb1397fa640 1 -- 10.20.193.49:0/2715860692 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7fb134013470 con 0x7fb144074ef0 2026-02-17T11:12:45.941 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.934+0000 7fb1397fa640 1 --2- 10.20.193.49:0/2715860692 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb114079190 0x7fb11407b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:45.941 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.934+0000 7fb13bfff640 1 --2- 10.20.193.49:0/2715860692 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb114079190 0x7fb11407b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:45.941 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.934+0000 7fb13bfff640 10 monclient: get_auth_request con 0x7fb114079190 auth_method 0 2026-02-17T11:12:45.941 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.935+0000 7fb13bfff640 1 --2- 10.20.193.49:0/2715860692 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb114079190 0x7fb11407b650 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb12c02ee20 tx=0x7fb12c033000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:12:45.941 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.935+0000 7fb1397fa640 10 client.4860.objecter ms_handle_connect 0x7fb114079190 2026-02-17T11:12:45.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.936+0000 7fb1397fa640 1 -- 10.20.193.49:0/2715860692 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7fb13405e520 con 0x7fb144074ef0 2026-02-17T11:12:45.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.936+0000 7fb1397fa640 10 client.4860.objecter ms_dispatch2 0x7fb144000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:12:45.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.936+0000 7fb1397fa640 3 client.4860.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:12:45.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.936+0000 7fb1397fa640 3 client.4860.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:12:45.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:45.936+0000 7fb1397fa640 20 client.4860.objecter dump_active .. 0 homeless 2026-02-17T11:12:46.039 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:46.036+0000 7fb1397fa640 1 -- 10.20.193.49:0/2715860692 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb144076600 con 0x7fb144074ef0 2026-02-17T11:12:46.039 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:46.036+0000 7fb1397fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:12:46.039 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:46.036+0000 7fb1397fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:12:46.144 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:46.141+0000 7fb14ac6f640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:12:46.144 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:46.141+0000 7fb14ac6f640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:12:46.145 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:46.141+0000 7fb14ac6f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:12:46.145 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:46.141+0000 7fb14ac6f640 1 -- 10.20.193.49:0/2715860692 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb1440c4d10 con 0x7fb144074ef0 2026-02-17T11:12:46.146 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:46.144+0000 7fb1397fa640 1 -- 10.20.193.49:0/2715860692 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fb1340624e0 con 0x7fb144074ef0 2026-02-17T11:12:46.146 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:46.144+0000 7fb1397fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:12:46.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:46.144+0000 7fb1397fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:12:46.147 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:12:46.147 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:12:46.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:46.145+0000 7fb14ac6f640 10 librados: watch_flush enter 2026-02-17T11:12:46.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:46.145+0000 7fb14ac6f640 10 librados: watch_flush exit 2026-02-17T11:12:46.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:46.145+0000 7fb14ac6f640 20 client.4860.objecter shutdown clearing up homeless session... 2026-02-17T11:12:46.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:46.145+0000 7fb14ac6f640 10 client.4860.objecter successfully canceled tick 2026-02-17T11:12:46.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:46.145+0000 7fb14ac6f640 1 -- 10.20.193.49:0/2715860692 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb114079190 msgr2=0x7fb11407b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:46.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:46.145+0000 7fb14ac6f640 1 --2- 10.20.193.49:0/2715860692 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb114079190 0x7fb11407b650 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb12c02ee20 tx=0x7fb12c033000 comp rx=0 tx=0).stop 2026-02-17T11:12:46.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:46.145+0000 7fb14ac6f640 10 monclient: shutdown 2026-02-17T11:12:46.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:46.145+0000 7fb14ac6f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:12:46.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:46.145+0000 7fb14ac6f640 1 -- 10.20.193.49:0/2715860692 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb144074ef0 msgr2=0x7fb144154630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:46.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:46.145+0000 7fb14ac6f640 1 --2- 10.20.193.49:0/2715860692 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb144074ef0 0x7fb144154630 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb13400e870 tx=0x7fb13400ed40 comp rx=0 tx=0).stop 2026-02-17T11:12:46.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:46.145+0000 7fb14ac6f640 1 -- 10.20.193.49:0/2715860692 shutdown_connections 2026-02-17T11:12:46.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:46.145+0000 7fb14ac6f640 1 --2- 10.20.193.49:0/2715860692 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb114079190 0x7fb11407b650 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:46.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:46.145+0000 7fb14ac6f640 1 --2- 10.20.193.49:0/2715860692 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb1440c7170 0x7fb1440c2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:46.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:46.145+0000 7fb14ac6f640 1 --2- 10.20.193.49:0/2715860692 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb1440c48c0 0x7fb1440c2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:46.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:46.145+0000 7fb14ac6f640 1 --2- 10.20.193.49:0/2715860692 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb144074ef0 0x7fb144154630 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:46.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:46.145+0000 7fb14ac6f640 1 -- 10.20.193.49:0/2715860692 >> 10.20.193.49:0/2715860692 conn(0x7fb1440c9f40 msgr2=0x7fb1440cca40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:12:46.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:46.145+0000 7fb14ac6f640 1 -- 10.20.193.49:0/2715860692 shutdown_connections 2026-02-17T11:12:46.151 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:46.145+0000 7fb14ac6f640 1 -- 10.20.193.49:0/2715860692 wait complete. 2026-02-17T11:12:46.151 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:46.145+0000 7fb14ac6f640 1 librados: shutdown 2026-02-17T11:12:49.156 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:12:49.224 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.222+0000 7f55e1955640 10 monclient: get_monmap_and_config 2026-02-17T11:12:49.225 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.222+0000 7f55e1955640 10 monclient: build_initial_monmap 2026-02-17T11:12:49.225 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.222+0000 7f55e1955640 10 monclient: monmap: 2026-02-17T11:12:49.225 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:12:49.225 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:49.225 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:12:49.223906+0000 2026-02-17T11:12:49.225 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:12:49.223906+0000 2026-02-17T11:12:49.225 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:12:49.225 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:49.225 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:12:49.226 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:12:49.226 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:12:49.226 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:12:49.226 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:12:49.226 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:12:49.226 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:49.229 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.223+0000 7f55e1955640 1 Processor -- start 2026-02-17T11:12:49.229 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.223+0000 7f55e1955640 1 -- start start 2026-02-17T11:12:49.229 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.223+0000 7f55e1955640 10 monclient: init 2026-02-17T11:12:49.229 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.223+0000 7f55e1955640 10 monclient: _reopen_session rank -1 2026-02-17T11:12:49.229 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.223+0000 7f55e1955640 10 monclient: _add_conns ranks=[0,3,5,2,1,4] 2026-02-17T11:12:49.229 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.223+0000 7f55e1955640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f55dc0d1b10 addr v1:10.20.193.49:6789/0 2026-02-17T11:12:49.229 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.223+0000 7f55e1955640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f55dc15cc30 0x7f55dc0d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:49.229 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.223+0000 7f55e1955640 10 monclient(hunting): picked mon.noname-a con 0x7f55dc15cc30 addr v2:10.20.193.49:3300/0 2026-02-17T11:12:49.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.223+0000 7f55e1955640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f55dc0cdec0 0x7f55dc0c9560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:49.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.223+0000 7f55e1955640 10 monclient(hunting): picked mon.noname-c con 0x7f55dc0cdec0 addr v2:10.20.193.157:3300/0 2026-02-17T11:12:49.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.223+0000 7f55e1955640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55dc0ce580 con 0x7f55dc0d1b10 2026-02-17T11:12:49.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.223+0000 7f55e1955640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:49.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.223+0000 7f55e1955640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f55dc0c90d0 con 0x7f55dc15cc30 2026-02-17T11:12:49.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.223+0000 7f55e1955640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:49.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.223+0000 7f55e1955640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f55dc0ce860 con 0x7f55dc0cdec0 2026-02-17T11:12:49.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.223+0000 7f55e1955640 10 monclient(hunting): _renew_subs 2026-02-17T11:12:49.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.223+0000 7f55e1955640 10 monclient(hunting): authenticate will time out at 1245.887609s 2026-02-17T11:12:49.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.224+0000 7f55db7fe640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f55dc0cdec0 0x7f55dc0c9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:49.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.224+0000 7f55db7fe640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f55dc0cdec0 0x7f55dc0c9560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:55484/0 (socket says 10.20.193.49:55484) 2026-02-17T11:12:49.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.224+0000 7f55db7fe640 1 -- 10.20.193.49:0/1852730179 learned_addr learned my addr 10.20.193.49:0/1852730179 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:12:49.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.224+0000 7f55db7fe640 10 monclient(hunting): get_auth_request con 0x7f55dc0cdec0 auth_method 0 2026-02-17T11:12:49.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.224+0000 7f55db7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:49.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.224+0000 7f55db7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:49.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.224+0000 7f55db7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:49.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.224+0000 7f55da7fc640 1 --2- 10.20.193.49:0/1852730179 >> v2:10.20.193.49:3300/0 conn(0x7f55dc15cc30 0x7f55dc0d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:49.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.224+0000 7f55db7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:49.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.224+0000 7f55db7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:49.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.224+0000 7f55db7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:49.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.225+0000 7f55da7fc640 10 monclient(hunting): get_auth_request con 0x7f55dc15cc30 auth_method 0 2026-02-17T11:12:49.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.225+0000 7f55da7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:49.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.225+0000 7f55da7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:49.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.225+0000 7f55da7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:49.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.225+0000 7f55da7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:49.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.225+0000 7f55da7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:49.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.225+0000 7f55da7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:49.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.226+0000 7f55db7fe640 10 monclient(hunting): handle_auth_done global_id 4850 payload 274 2026-02-17T11:12:49.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.226+0000 7f55db7fe640 1 -- 10.20.193.49:0/1852730179 >> v2:10.20.193.49:3300/0 conn(0x7f55dc15cc30 msgr2=0x7f55dc0d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:12:49.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.226+0000 7f55db7fe640 1 --2- 10.20.193.49:0/1852730179 >> v2:10.20.193.49:3300/0 conn(0x7f55dc15cc30 0x7f55dc0d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:49.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.226+0000 7f55db7fe640 1 -- 10.20.193.49:0/1852730179 >> v1:10.20.193.49:6789/0 conn(0x7f55dc0d1b10 legacy=0x7f55dc0cb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:49.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.226+0000 7f55db7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:12:49.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.226+0000 7f55db7fe640 1 monclient: found mon.noname-c 2026-02-17T11:12:49.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.226+0000 7f55db7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:12:49.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.226+0000 7f55db7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:12:49.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.226+0000 7f55db7fe640 1 -- 10.20.193.49:0/1852730179 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55dc0ceb40 con 0x7f55dc0cdec0 2026-02-17T11:12:49.237 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.228+0000 7f55db7fe640 1 --2- 10.20.193.49:0/1852730179 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f55dc0cdec0 0x7f55dc0c9560 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f55dc0d2930 tx=0x7f55cc02f310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0a117daddc96d35 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:12:49.237 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.229+0000 7f55d9ffb640 1 -- 10.20.193.49:0/1852730179 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55cc02fe10 con 0x7f55dc0cdec0 2026-02-17T11:12:49.237 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.229+0000 7f55d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:49.237 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.229+0000 7f55d9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:12:49.237 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.229+0000 7f55d9ffb640 10 monclient: dump: 2026-02-17T11:12:49.237 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:49.237 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:49.237 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:49.237 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:49.237 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:49.237 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:49.237 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:49.237 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:49.237 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:49.237 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:49.237 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.229+0000 7f55d9ffb640 10 monclient: _finish_auth 0 2026-02-17T11:12:49.237 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.229+0000 7f55d9ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:12:49.237 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.229+0000 7f55d9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:12:49.237 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.229+0000 7f55e1955640 5 monclient: authenticate success, global_id 4850 2026-02-17T11:12:49.237 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.229+0000 7f55e1955640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:12:49.237 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.230+0000 7f55d9ffb640 1 -- 10.20.193.49:0/1852730179 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55cc0373f0 con 0x7f55dc0cdec0 2026-02-17T11:12:49.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.230+0000 7f55d9ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:12:49.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.230+0000 7f55d9ffb640 1 -- 10.20.193.49:0/1852730179 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55cc0377c0 con 0x7f55dc0cdec0 2026-02-17T11:12:49.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.230+0000 7f55d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:49.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.230+0000 7f55d9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:12:49.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.230+0000 7f55d9ffb640 10 monclient: dump: 2026-02-17T11:12:49.238 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:49.238 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:49.238 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:49.238 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:49.238 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:49.238 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:49.238 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:49.238 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:49.238 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:49.238 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:49.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.230+0000 7f55e1955640 10 monclient: get_monmap_and_config success 2026-02-17T11:12:49.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.230+0000 7f55e1955640 4 set_mon_vals no callback set 2026-02-17T11:12:49.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.230+0000 7f55e1955640 10 monclient: shutdown 2026-02-17T11:12:49.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.230+0000 7f55e1955640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:12:49.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.230+0000 7f55e1955640 1 -- 10.20.193.49:0/1852730179 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f55dc0cdec0 msgr2=0x7f55dc0c9560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:49.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.230+0000 7f55e1955640 1 --2- 10.20.193.49:0/1852730179 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f55dc0cdec0 0x7f55dc0c9560 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f55dc0d2930 tx=0x7f55cc02f310 comp rx=0 tx=0).stop 2026-02-17T11:12:49.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.230+0000 7f55e1955640 1 -- 10.20.193.49:0/1852730179 shutdown_connections 2026-02-17T11:12:49.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.230+0000 7f55e1955640 1 --2- 10.20.193.49:0/1852730179 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f55dc0cdec0 0x7f55dc0c9560 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:49.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.230+0000 7f55e1955640 1 --2- 10.20.193.49:0/1852730179 >> v2:10.20.193.49:3300/0 conn(0x7f55dc15cc30 0x7f55dc0d1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:49.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.230+0000 7f55e1955640 1 -- 10.20.193.49:0/1852730179 >> 10.20.193.49:0/1852730179 conn(0x7f55dc073030 msgr2=0x7f55dc073440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:12:49.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.230+0000 7f55e1955640 1 -- 10.20.193.49:0/1852730179 shutdown_connections 2026-02-17T11:12:49.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.230+0000 7f55e1955640 1 -- 10.20.193.49:0/1852730179 wait complete. 2026-02-17T11:12:49.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.231+0000 7f55e1955640 10 monclient: build_initial_monmap 2026-02-17T11:12:49.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.231+0000 7f55e1955640 10 monclient: monmap: 2026-02-17T11:12:49.239 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:12:49.239 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:12:49.239 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:12:49.239 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:12:49.239 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:12:49.239 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:49.239 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:12:49.239 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:12:49.239 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:12:49.239 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:49.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.231+0000 7f55e1955640 1 librados: starting msgr at 2026-02-17T11:12:49.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.231+0000 7f55e1955640 1 librados: starting objecter 2026-02-17T11:12:49.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.231+0000 7f55e1955640 1 Processor -- start 2026-02-17T11:12:49.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.231+0000 7f55e1955640 1 -- start start 2026-02-17T11:12:49.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.231+0000 7f55e1955640 1 librados: setting wanted keys 2026-02-17T11:12:49.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.231+0000 7f55e1955640 1 librados: calling monclient init 2026-02-17T11:12:49.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.231+0000 7f55e1955640 10 monclient: init 2026-02-17T11:12:49.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.231+0000 7f55e1955640 10 monclient: _reopen_session rank -1 2026-02-17T11:12:49.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.231+0000 7f55e1955640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:12:49.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.231+0000 7f55e1955640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f55dc0cdec0 0x7f55dc1492e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:49.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.231+0000 7f55e1955640 10 monclient(hunting): picked mon.noname-b con 0x7f55dc0cdec0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:12:49.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.231+0000 7f55e1955640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f55dc0d1b10 0x7f55dc15acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:49.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.231+0000 7f55e1955640 10 monclient(hunting): picked mon.noname-c con 0x7f55dc0d1b10 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:12:49.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.231+0000 7f55e1955640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f55dc15cc30 0x7f55dc0d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:49.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.231+0000 7f55e1955640 10 monclient(hunting): picked mon.noname-a con 0x7f55dc15cc30 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:12:49.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.231+0000 7f55e1955640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:49.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.231+0000 7f55e1955640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f55dc0c8d60 con 0x7f55dc15cc30 2026-02-17T11:12:49.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.231+0000 7f55e1955640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:49.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.231+0000 7f55e1955640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f55dc0cf100 con 0x7f55dc0cdec0 2026-02-17T11:12:49.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.231+0000 7f55e1955640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:49.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.231+0000 7f55e1955640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f55dc0c9aa0 con 0x7f55dc0d1b10 2026-02-17T11:12:49.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.231+0000 7f55e1955640 10 monclient(hunting): _renew_subs 2026-02-17T11:12:49.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.231+0000 7f55e1955640 10 monclient(hunting): authenticate will time out at 1245.895928s 2026-02-17T11:12:49.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.232+0000 7f55db7fe640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f55dc15cc30 0x7f55dc0d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:49.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.232+0000 7f55da7fc640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f55dc0d1b10 0x7f55dc15acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:49.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.232+0000 7f55db7fe640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f55dc15cc30 0x7f55dc0d03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:55442/0 (socket says 10.20.193.49:55442) 2026-02-17T11:12:49.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.232+0000 7f55db7fe640 1 -- 10.20.193.49:0/2739210251 learned_addr learned my addr 10.20.193.49:0/2739210251 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:12:49.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.232+0000 7f55db7fe640 10 monclient(hunting): get_auth_request con 0x7f55dc15cc30 auth_method 0 2026-02-17T11:12:49.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.232+0000 7f55db7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:49.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.232+0000 7f55db7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:49.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.232+0000 7f55db7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:49.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.232+0000 7f55daffd640 1 --2- 10.20.193.49:0/2739210251 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f55dc0cdec0 0x7f55dc1492e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:49.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.232+0000 7f55da7fc640 10 monclient(hunting): get_auth_request con 0x7f55dc0d1b10 auth_method 0 2026-02-17T11:12:49.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.232+0000 7f55da7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:49.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.232+0000 7f55da7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:49.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.232+0000 7f55da7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:49.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.232+0000 7f55db7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:49.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.232+0000 7f55db7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:49.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.232+0000 7f55db7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:49.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.232+0000 7f55daffd640 10 monclient(hunting): get_auth_request con 0x7f55dc0cdec0 auth_method 0 2026-02-17T11:12:49.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.232+0000 7f55daffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:49.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.232+0000 7f55daffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:49.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.232+0000 7f55daffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:49.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.232+0000 7f55da7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:49.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.232+0000 7f55da7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:49.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.232+0000 7f55da7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:49.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.232+0000 7f55daffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:49.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.232+0000 7f55daffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:49.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.232+0000 7f55daffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:49.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.233+0000 7f55db7fe640 10 monclient(hunting): handle_auth_done global_id 4869 payload 824 2026-02-17T11:12:49.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.233+0000 7f55db7fe640 1 -- 10.20.193.49:0/2739210251 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f55dc0d1b10 msgr2=0x7f55dc15acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:49.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.233+0000 7f55db7fe640 1 --2- 10.20.193.49:0/2739210251 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f55dc0d1b10 0x7f55dc15acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:49.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.233+0000 7f55db7fe640 1 -- 10.20.193.49:0/2739210251 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f55dc0cdec0 msgr2=0x7f55dc1492e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:49.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.233+0000 7f55db7fe640 1 --2- 10.20.193.49:0/2739210251 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f55dc0cdec0 0x7f55dc1492e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:49.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.233+0000 7f55db7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:12:49.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.233+0000 7f55db7fe640 1 monclient: found mon.noname-a 2026-02-17T11:12:49.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.233+0000 7f55db7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:12:49.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.233+0000 7f55db7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:12:49.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.233+0000 7f55db7fe640 1 -- 10.20.193.49:0/2739210251 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55dc15b6f0 con 0x7f55dc15cc30 2026-02-17T11:12:49.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.234+0000 7f55db7fe640 1 --2- 10.20.193.49:0/2739210251 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f55dc15cc30 0x7f55dc0d03c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f55cc02f840 tx=0x7f55cc004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:12:49.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.234+0000 7f55b3fff640 10 client.?.objecter ms_handle_connect 0x7f55dc15cc30 2026-02-17T11:12:49.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.234+0000 7f55b3fff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:12:49.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.236+0000 7f55b3fff640 1 -- 10.20.193.49:0/2739210251 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55cc046020 con 0x7f55dc15cc30 2026-02-17T11:12:49.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.236+0000 7f55b3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:49.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.236+0000 7f55b3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:12:49.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.236+0000 7f55b3fff640 10 monclient: dump: 2026-02-17T11:12:49.242 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:49.242 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:49.242 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:49.242 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:49.242 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:49.242 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:49.242 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:49.242 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:49.242 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:49.242 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:49.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.236+0000 7f55b3fff640 10 monclient: _finish_auth 0 2026-02-17T11:12:49.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.236+0000 7f55b3fff640 10 monclient: _check_auth_tickets 2026-02-17T11:12:49.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.236+0000 7f55b3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:12:49.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.236+0000 7f55b3fff640 1 -- 10.20.193.49:0/2739210251 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55cc041660 con 0x7f55dc15cc30 2026-02-17T11:12:49.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.236+0000 7f55e1955640 5 monclient: authenticate success, global_id 4869 2026-02-17T11:12:49.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.236+0000 7f55b3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:12:49.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.236+0000 7f55b3fff640 1 -- 10.20.193.49:0/2739210251 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55cc041a70 con 0x7f55dc15cc30 2026-02-17T11:12:49.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.236+0000 7f55e1955640 10 monclient: _renew_subs 2026-02-17T11:12:49.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.236+0000 7f55e1955640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:12:49.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.236+0000 7f55d97fa640 4 set_mon_vals no callback set 2026-02-17T11:12:49.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.236+0000 7f55e1955640 1 -- 10.20.193.49:0/2739210251 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55dc15b9d0 con 0x7f55dc15cc30 2026-02-17T11:12:49.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.236+0000 7f55b3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:49.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.236+0000 7f55b3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:12:49.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.236+0000 7f55b3fff640 10 monclient: dump: 2026-02-17T11:12:49.243 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:49.243 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:49.243 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:49.243 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:49.243 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:49.243 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:49.243 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:49.243 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:49.243 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:49.243 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:49.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.236+0000 7f55e1955640 10 client.4869.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:12:49.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.236+0000 7f55e1955640 10 monclient: _renew_subs 2026-02-17T11:12:49.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.236+0000 7f55e1955640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:12:49.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.236+0000 7f55e1955640 1 -- 10.20.193.49:0/2739210251 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55dc0cfbc0 con 0x7f55dc15cc30 2026-02-17T11:12:49.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.236+0000 7f55e1955640 1 librados: init done 2026-02-17T11:12:49.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.237+0000 7f55e1955640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:12:49.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.237+0000 7f55e1955640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:12:49.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.237+0000 7f55e1955640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:12:49.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.237+0000 7f55e1955640 1 -- 10.20.193.49:0/2739210251 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55dc0c9dd0 con 0x7f55dc15cc30 2026-02-17T11:12:49.345 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.343+0000 7f55b3fff640 1 -- 10.20.193.49:0/2739210251 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f55cc041c10 con 0x7f55dc15cc30 2026-02-17T11:12:49.345 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.343+0000 7f55b3fff640 1 --2- 10.20.193.49:0/2739210251 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f55ac079190 0x7f55ac07b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:49.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.344+0000 7f55daffd640 1 --2- 10.20.193.49:0/2739210251 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f55ac079190 0x7f55ac07b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:49.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.344+0000 7f55daffd640 10 monclient: get_auth_request con 0x7f55ac079190 auth_method 0 2026-02-17T11:12:49.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.344+0000 7f55b3fff640 10 client.4869.objecter ms_handle_connect 0x7f55ac079190 2026-02-17T11:12:49.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.344+0000 7f55daffd640 1 --2- 10.20.193.49:0/2739210251 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f55ac079190 0x7f55ac07b650 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f55d00051f0 tx=0x7f55d0007f30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:12:49.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.351+0000 7f55b3fff640 1 -- 10.20.193.49:0/2739210251 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f55cc083ea0 con 0x7f55dc15cc30 2026-02-17T11:12:49.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.351+0000 7f55b3fff640 10 client.4869.objecter ms_dispatch2 0x7f55dc000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:12:49.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.351+0000 7f55b3fff640 3 client.4869.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:12:49.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.351+0000 7f55b3fff640 3 client.4869.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:12:49.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.351+0000 7f55b3fff640 20 client.4869.objecter dump_active .. 0 homeless 2026-02-17T11:12:49.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.351+0000 7f55b3fff640 1 -- 10.20.193.49:0/2739210251 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f55cc050030 con 0x7f55dc15cc30 2026-02-17T11:12:49.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.351+0000 7f55b3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:12:49.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.351+0000 7f55b3fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:12:49.453 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.451+0000 7f55e1955640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:12:49.454 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.451+0000 7f55e1955640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:12:49.454 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.451+0000 7f55e1955640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:12:49.454 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.451+0000 7f55e1955640 1 -- 10.20.193.49:0/2739210251 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f55dc150d30 con 0x7f55dc15cc30 2026-02-17T11:12:49.457 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.454+0000 7f55b3fff640 1 -- 10.20.193.49:0/2739210251 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f55cc087e60 con 0x7f55dc15cc30 2026-02-17T11:12:49.457 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.454+0000 7f55b3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:12:49.457 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.454+0000 7f55b3fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:12:49.457 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:12:49.457 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:12:49.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.455+0000 7f55e1955640 10 librados: watch_flush enter 2026-02-17T11:12:49.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.455+0000 7f55e1955640 10 librados: watch_flush exit 2026-02-17T11:12:49.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.455+0000 7f55e1955640 20 client.4869.objecter shutdown clearing up homeless session... 2026-02-17T11:12:49.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.455+0000 7f55e1955640 10 client.4869.objecter successfully canceled tick 2026-02-17T11:12:49.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.455+0000 7f55e1955640 1 -- 10.20.193.49:0/2739210251 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f55ac079190 msgr2=0x7f55ac07b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:49.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.455+0000 7f55e1955640 1 --2- 10.20.193.49:0/2739210251 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f55ac079190 0x7f55ac07b650 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f55d00051f0 tx=0x7f55d0007f30 comp rx=0 tx=0).stop 2026-02-17T11:12:49.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.455+0000 7f55e1955640 10 monclient: shutdown 2026-02-17T11:12:49.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.455+0000 7f55e1955640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:12:49.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.455+0000 7f55e1955640 1 -- 10.20.193.49:0/2739210251 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f55dc15cc30 msgr2=0x7f55dc0d03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:49.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.455+0000 7f55e1955640 1 --2- 10.20.193.49:0/2739210251 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f55dc15cc30 0x7f55dc0d03c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f55cc02f840 tx=0x7f55cc004b40 comp rx=0 tx=0).stop 2026-02-17T11:12:49.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.455+0000 7f55e1955640 1 -- 10.20.193.49:0/2739210251 shutdown_connections 2026-02-17T11:12:49.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.455+0000 7f55e1955640 1 --2- 10.20.193.49:0/2739210251 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f55ac079190 0x7f55ac07b650 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:49.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.455+0000 7f55e1955640 1 --2- 10.20.193.49:0/2739210251 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f55dc15cc30 0x7f55dc0d03c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:49.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.455+0000 7f55e1955640 1 --2- 10.20.193.49:0/2739210251 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f55dc0d1b10 0x7f55dc15acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:49.459 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.455+0000 7f55e1955640 1 --2- 10.20.193.49:0/2739210251 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f55dc0cdec0 0x7f55dc1492e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:49.459 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.455+0000 7f55e1955640 1 -- 10.20.193.49:0/2739210251 >> 10.20.193.49:0/2739210251 conn(0x7f55dc073030 msgr2=0x7f55dc155910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:12:49.459 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.455+0000 7f55e1955640 1 -- 10.20.193.49:0/2739210251 shutdown_connections 2026-02-17T11:12:49.459 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.455+0000 7f55e1955640 1 -- 10.20.193.49:0/2739210251 wait complete. 2026-02-17T11:12:49.459 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:49.456+0000 7f55e1955640 1 librados: shutdown 2026-02-17T11:12:51.944 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:04:37.425 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:12:51.945 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:04:37.427 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:12:51.954 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:04:37.435 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:12:51.973 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:04:37.448 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:12:51.974 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:04:37.450 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:12:51.975 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:04:37.417 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:12:51.977 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:04:37.419 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:12:51.985 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:04:37.460 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:12:51.988 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:04:37.430 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:12:52.467 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:12:52.535 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.533+0000 7fbb23975640 10 monclient: get_monmap_and_config 2026-02-17T11:12:52.535 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.533+0000 7fbb23975640 10 monclient: build_initial_monmap 2026-02-17T11:12:52.536 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.533+0000 7fbb23975640 10 monclient: monmap: 2026-02-17T11:12:52.536 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:12:52.536 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:52.536 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:12:52.534235+0000 2026-02-17T11:12:52.536 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:12:52.534235+0000 2026-02-17T11:12:52.536 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:12:52.536 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:52.536 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:12:52.536 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:12:52.536 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:12:52.536 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:12:52.537 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:12:52.537 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:12:52.537 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:52.537 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.534+0000 7fbb23975640 1 Processor -- start 2026-02-17T11:12:52.537 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.534+0000 7fbb23975640 1 -- start start 2026-02-17T11:12:52.537 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.534+0000 7fbb23975640 10 monclient: init 2026-02-17T11:12:52.540 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.534+0000 7fbb23975640 10 monclient: _reopen_session rank -1 2026-02-17T11:12:52.540 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.534+0000 7fbb23975640 10 monclient: _add_conns ranks=[2,5,3,4,0,1] 2026-02-17T11:12:52.540 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.534+0000 7fbb23975640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fbb1c0c7170 addr v1:10.20.193.157:6789/0 2026-02-17T11:12:52.540 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.534+0000 7fbb23975640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7fbb1c0c7550 0x7fbb1c0749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:52.540 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.534+0000 7fbb23975640 10 monclient(hunting): picked mon.noname-c con 0x7fbb1c0c7550 addr v2:10.20.193.157:3300/0 2026-02-17T11:12:52.540 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.534+0000 7fbb23975640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fbb1c074ef0 0x7fbb1c0c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:52.540 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.534+0000 7fbb23975640 10 monclient(hunting): picked mon.noname-a con 0x7fbb1c074ef0 addr v2:10.20.193.49:3300/0 2026-02-17T11:12:52.540 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.534+0000 7fbb23975640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb1c0c4fd0 con 0x7fbb1c0c7170 2026-02-17T11:12:52.540 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.534+0000 7fbb23975640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:52.540 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.534+0000 7fbb23975640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7fbb1c0c8530 con 0x7fbb1c074ef0 2026-02-17T11:12:52.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.534+0000 7fbb23975640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:52.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.534+0000 7fbb23975640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7fbb1c15a9a0 con 0x7fbb1c0c7550 2026-02-17T11:12:52.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.534+0000 7fbb23975640 10 monclient(hunting): _renew_subs 2026-02-17T11:12:52.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.534+0000 7fbb23975640 10 monclient(hunting): authenticate will time out at 1249.197686s 2026-02-17T11:12:52.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.535+0000 7fbb20ee9640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7fbb1c0c7550 0x7fbb1c0749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:52.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.535+0000 7fbb21eeb640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fbb1c074ef0 0x7fbb1c0c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:52.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.535+0000 7fbb216ea640 1 --1- >> v1:10.20.193.157:6789/0 conn(0x7fbb1c0c7170 0x7fbb1c0c48c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.157:6789/0 says I am v1:10.20.193.49:48564/0 (socket says 10.20.193.49:48564) 2026-02-17T11:12:52.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.535+0000 7fbb216ea640 1 -- 10.20.193.49:0/725565571 learned_addr learned my addr 10.20.193.49:0/725565571 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:12:52.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.535+0000 7fbb21eeb640 10 monclient(hunting): get_auth_request con 0x7fbb1c074ef0 auth_method 0 2026-02-17T11:12:52.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.535+0000 7fbb21eeb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:52.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.535+0000 7fbb21eeb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:52.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.535+0000 7fbb21eeb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:52.542 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.535+0000 7fbb20ee9640 10 monclient(hunting): get_auth_request con 0x7fbb1c0c7550 auth_method 0 2026-02-17T11:12:52.542 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.535+0000 7fbb20ee9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:52.542 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.535+0000 7fbb20ee9640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:52.542 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.535+0000 7fbb20ee9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:52.542 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.535+0000 7fbb21eeb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:52.542 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.535+0000 7fbb21eeb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:52.542 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.535+0000 7fbb21eeb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:52.542 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.536+0000 7fbb20ee9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:52.542 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.536+0000 7fbb20ee9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:52.542 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.536+0000 7fbb20ee9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:52.542 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.536+0000 7fbb21eeb640 10 monclient(hunting): handle_auth_done global_id 4872 payload 274 2026-02-17T11:12:52.542 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.536+0000 7fbb21eeb640 1 -- 10.20.193.49:0/725565571 >> v2:10.20.193.157:3300/0 conn(0x7fbb1c0c7550 msgr2=0x7fbb1c0749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:12:52.542 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.536+0000 7fbb21eeb640 1 --2- 10.20.193.49:0/725565571 >> v2:10.20.193.157:3300/0 conn(0x7fbb1c0c7550 0x7fbb1c0749b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:52.543 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.536+0000 7fbb21eeb640 1 -- 10.20.193.49:0/725565571 >> v1:10.20.193.157:6789/0 conn(0x7fbb1c0c7170 legacy=0x7fbb1c0c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:52.543 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.536+0000 7fbb21eeb640 10 monclient: _finish_hunting 0 2026-02-17T11:12:52.543 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.536+0000 7fbb21eeb640 1 monclient: found mon.noname-a 2026-02-17T11:12:52.543 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.536+0000 7fbb21eeb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:12:52.543 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.536+0000 7fbb21eeb640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:12:52.543 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.536+0000 7fbb21eeb640 1 -- 10.20.193.49:0/725565571 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb1c0c5270 con 0x7fbb1c074ef0 2026-02-17T11:12:52.543 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.537+0000 7fbb21eeb640 1 --2- 10.20.193.49:0/725565571 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbb1c074ef0 0x7fbb1c0c89c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c0c6e90 tx=0x7fbb1802f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9185a05271acf029 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:12:52.549 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.539+0000 7fbb0bfff640 1 -- 10.20.193.49:0/725565571 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb1803c070 con 0x7fbb1c074ef0 2026-02-17T11:12:52.549 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.539+0000 7fbb0bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:52.549 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.539+0000 7fbb0bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:12:52.549 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.539+0000 7fbb0bfff640 10 monclient: dump: 2026-02-17T11:12:52.549 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:52.550 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:52.550 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:52.550 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:52.550 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:52.550 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:52.550 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:52.550 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:52.550 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:52.550 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:52.550 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.539+0000 7fbb0bfff640 10 monclient: _finish_auth 0 2026-02-17T11:12:52.550 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.539+0000 7fbb0bfff640 10 monclient: _check_auth_tickets 2026-02-17T11:12:52.550 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.539+0000 7fbb0bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:12:52.551 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.539+0000 7fbb0bfff640 1 -- 10.20.193.49:0/725565571 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb18037440 con 0x7fbb1c074ef0 2026-02-17T11:12:52.551 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.539+0000 7fbb0bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:12:52.551 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.539+0000 7fbb0bfff640 1 -- 10.20.193.49:0/725565571 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb18037810 con 0x7fbb1c074ef0 2026-02-17T11:12:52.551 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.539+0000 7fbb23975640 5 monclient: authenticate success, global_id 4872 2026-02-17T11:12:52.551 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.539+0000 7fbb23975640 10 monclient: get_monmap_and_config success 2026-02-17T11:12:52.551 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.539+0000 7fbb23975640 4 set_mon_vals no callback set 2026-02-17T11:12:52.551 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.539+0000 7fbb0bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:52.551 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.539+0000 7fbb0bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:12:52.551 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.539+0000 7fbb0bfff640 10 monclient: dump: 2026-02-17T11:12:52.551 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:52.551 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:52.551 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:52.552 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:52.552 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:52.552 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:52.552 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:52.552 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:52.552 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:52.552 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:52.552 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.539+0000 7fbb23975640 10 monclient: shutdown 2026-02-17T11:12:52.552 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.539+0000 7fbb23975640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:12:52.552 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.539+0000 7fbb23975640 1 -- 10.20.193.49:0/725565571 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbb1c074ef0 msgr2=0x7fbb1c0c89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:52.552 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.539+0000 7fbb23975640 1 --2- 10.20.193.49:0/725565571 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbb1c074ef0 0x7fbb1c0c89c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c0c6e90 tx=0x7fbb1802f1c0 comp rx=0 tx=0).stop 2026-02-17T11:12:52.552 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.539+0000 7fbb23975640 1 -- 10.20.193.49:0/725565571 shutdown_connections 2026-02-17T11:12:52.553 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.539+0000 7fbb23975640 1 --2- 10.20.193.49:0/725565571 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbb1c074ef0 0x7fbb1c0c89c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:52.553 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.539+0000 7fbb23975640 1 --2- 10.20.193.49:0/725565571 >> v2:10.20.193.157:3300/0 conn(0x7fbb1c0c7550 0x7fbb1c0749b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:52.553 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.539+0000 7fbb23975640 1 -- 10.20.193.49:0/725565571 >> 10.20.193.49:0/725565571 conn(0x7fbb1c0c9f40 msgr2=0x7fbb1c0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:12:52.553 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.539+0000 7fbb23975640 1 -- 10.20.193.49:0/725565571 shutdown_connections 2026-02-17T11:12:52.553 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.539+0000 7fbb23975640 1 -- 10.20.193.49:0/725565571 wait complete. 2026-02-17T11:12:52.553 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.540+0000 7fbb23975640 10 monclient: build_initial_monmap 2026-02-17T11:12:52.553 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.540+0000 7fbb23975640 10 monclient: monmap: 2026-02-17T11:12:52.553 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:12:52.553 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:12:52.553 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:12:52.553 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:12:52.553 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:12:52.553 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:52.554 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:12:52.554 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:12:52.554 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:12:52.554 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:52.554 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.540+0000 7fbb23975640 1 librados: starting msgr at 2026-02-17T11:12:52.554 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.540+0000 7fbb23975640 1 librados: starting objecter 2026-02-17T11:12:52.554 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.540+0000 7fbb23975640 1 Processor -- start 2026-02-17T11:12:52.554 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.540+0000 7fbb23975640 1 -- start start 2026-02-17T11:12:52.554 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.540+0000 7fbb23975640 1 librados: setting wanted keys 2026-02-17T11:12:52.554 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.540+0000 7fbb23975640 1 librados: calling monclient init 2026-02-17T11:12:52.554 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.540+0000 7fbb23975640 10 monclient: init 2026-02-17T11:12:52.554 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.540+0000 7fbb23975640 10 monclient: _reopen_session rank -1 2026-02-17T11:12:52.555 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.540+0000 7fbb23975640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:12:52.555 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.540+0000 7fbb23975640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fbb1c074ef0 0x7fbb1c073890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:52.555 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.540+0000 7fbb23975640 10 monclient(hunting): picked mon.noname-b con 0x7fbb1c074ef0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:12:52.555 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.540+0000 7fbb23975640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbb1c0c7170 0x7fbb1c1f57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:52.555 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.540+0000 7fbb23975640 10 monclient(hunting): picked mon.noname-a con 0x7fbb1c0c7170 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:12:52.555 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.540+0000 7fbb23975640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fbb1c0c7550 0x7fbb1c1f5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:52.555 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.540+0000 7fbb23975640 10 monclient(hunting): picked mon.noname-c con 0x7fbb1c0c7550 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:12:52.555 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.540+0000 7fbb23975640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:52.555 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.540+0000 7fbb23975640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fbb1c0c7ee0 con 0x7fbb1c0c7170 2026-02-17T11:12:52.555 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.540+0000 7fbb23975640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:52.555 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.540+0000 7fbb23975640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fbb1c0c5830 con 0x7fbb1c074ef0 2026-02-17T11:12:52.555 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.540+0000 7fbb23975640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:52.555 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.540+0000 7fbb23975640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fbb1c0c81c0 con 0x7fbb1c0c7550 2026-02-17T11:12:52.556 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.540+0000 7fbb23975640 10 monclient(hunting): _renew_subs 2026-02-17T11:12:52.556 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.540+0000 7fbb23975640 10 monclient(hunting): authenticate will time out at 1249.203926s 2026-02-17T11:12:52.556 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.541+0000 7fbb20ee9640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbb1c0c7170 0x7fbb1c1f57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:52.556 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.541+0000 7fbb216ea640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fbb1c074ef0 0x7fbb1c073890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:52.556 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.541+0000 7fbb21eeb640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fbb1c0c7550 0x7fbb1c1f5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:52.556 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.541+0000 7fbb20ee9640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbb1c0c7170 0x7fbb1c1f57a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:55458/0 (socket says 10.20.193.49:55458) 2026-02-17T11:12:52.556 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.541+0000 7fbb20ee9640 1 -- 10.20.193.49:0/1058763206 learned_addr learned my addr 10.20.193.49:0/1058763206 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:12:52.556 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.541+0000 7fbb20ee9640 10 monclient(hunting): get_auth_request con 0x7fbb1c0c7170 auth_method 0 2026-02-17T11:12:52.556 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.541+0000 7fbb20ee9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:52.556 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.541+0000 7fbb20ee9640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:52.556 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.541+0000 7fbb20ee9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:52.557 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.541+0000 7fbb216ea640 10 monclient(hunting): get_auth_request con 0x7fbb1c074ef0 auth_method 0 2026-02-17T11:12:52.557 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.541+0000 7fbb216ea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:52.557 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.541+0000 7fbb216ea640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:52.557 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.541+0000 7fbb216ea640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:52.557 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.541+0000 7fbb21eeb640 10 monclient(hunting): get_auth_request con 0x7fbb1c0c7550 auth_method 0 2026-02-17T11:12:52.557 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.541+0000 7fbb21eeb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:52.557 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.541+0000 7fbb21eeb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:52.557 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.541+0000 7fbb21eeb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:52.557 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.541+0000 7fbb20ee9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:52.557 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.541+0000 7fbb20ee9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:52.557 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.541+0000 7fbb20ee9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:52.557 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.541+0000 7fbb21eeb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:52.557 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.541+0000 7fbb21eeb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:52.558 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.541+0000 7fbb21eeb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:52.558 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.541+0000 7fbb216ea640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:52.558 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.541+0000 7fbb216ea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:52.558 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.541+0000 7fbb216ea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:52.558 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.543+0000 7fbb20ee9640 10 monclient(hunting): handle_auth_done global_id 4875 payload 824 2026-02-17T11:12:52.558 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.543+0000 7fbb20ee9640 1 -- 10.20.193.49:0/1058763206 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fbb1c0c7550 msgr2=0x7fbb1c1f5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:52.558 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.543+0000 7fbb20ee9640 1 --2- 10.20.193.49:0/1058763206 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fbb1c0c7550 0x7fbb1c1f5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:52.558 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.543+0000 7fbb20ee9640 1 -- 10.20.193.49:0/1058763206 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fbb1c074ef0 msgr2=0x7fbb1c073890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:52.558 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.543+0000 7fbb20ee9640 1 --2- 10.20.193.49:0/1058763206 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fbb1c074ef0 0x7fbb1c073890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:52.558 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.543+0000 7fbb20ee9640 10 monclient: _finish_hunting 0 2026-02-17T11:12:52.558 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.543+0000 7fbb20ee9640 1 monclient: found mon.noname-a 2026-02-17T11:12:52.558 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.543+0000 7fbb20ee9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:12:52.558 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.543+0000 7fbb20ee9640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:12:52.559 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.543+0000 7fbb20ee9640 1 -- 10.20.193.49:0/1058763206 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb1c14c7b0 con 0x7fbb1c0c7170 2026-02-17T11:12:52.559 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.544+0000 7fbb20ee9640 1 --2- 10.20.193.49:0/1058763206 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbb1c0c7170 0x7fbb1c1f57a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbb1000ec10 tx=0x7fbb1000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:12:52.559 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.544+0000 7fbb09ffb640 10 client.?.objecter ms_handle_connect 0x7fbb1c0c7170 2026-02-17T11:12:52.559 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.544+0000 7fbb09ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T11:12:52.559 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.546+0000 7fbb09ffb640 1 -- 10.20.193.49:0/1058763206 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb10017070 con 0x7fbb1c0c7170 2026-02-17T11:12:52.559 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.546+0000 7fbb09ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:52.559 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.546+0000 7fbb09ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:12:52.559 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.546+0000 7fbb09ffb640 10 monclient: dump: 2026-02-17T11:12:52.559 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:52.559 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:52.559 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:52.559 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:52.560 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:52.560 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:52.560 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:52.560 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:52.560 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:52.560 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:52.560 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.546+0000 7fbb09ffb640 10 monclient: _finish_auth 0 2026-02-17T11:12:52.560 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.546+0000 7fbb09ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:12:52.560 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.546+0000 7fbb09ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:12:52.560 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.546+0000 7fbb09ffb640 1 -- 10.20.193.49:0/1058763206 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb1000cc40 con 0x7fbb1c0c7170 2026-02-17T11:12:52.560 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.546+0000 7fbb09ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:12:52.560 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.546+0000 7fbb09ffb640 1 -- 10.20.193.49:0/1058763206 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb10013470 con 0x7fbb1c0c7170 2026-02-17T11:12:52.561 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.546+0000 7fbb09ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:52.561 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.546+0000 7fbb09ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:12:52.561 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.546+0000 7fbb09ffb640 10 monclient: dump: 2026-02-17T11:12:52.561 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:52.561 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:52.561 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:52.561 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:52.561 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:52.561 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:52.561 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:52.561 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:52.561 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:52.562 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:52.562 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.546+0000 7fbb0b7fe640 4 set_mon_vals no callback set 2026-02-17T11:12:52.562 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.546+0000 7fbb23975640 5 monclient: authenticate success, global_id 4875 2026-02-17T11:12:52.562 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.546+0000 7fbb23975640 10 monclient: _renew_subs 2026-02-17T11:12:52.562 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.546+0000 7fbb23975640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:12:52.562 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.546+0000 7fbb23975640 1 -- 10.20.193.49:0/1058763206 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb1c1f4700 con 0x7fbb1c0c7170 2026-02-17T11:12:52.562 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.546+0000 7fbb23975640 10 client.4875.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:12:52.562 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.546+0000 7fbb23975640 10 monclient: _renew_subs 2026-02-17T11:12:52.562 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.546+0000 7fbb23975640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:12:52.562 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.546+0000 7fbb23975640 1 -- 10.20.193.49:0/1058763206 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb1c1f4cc0 con 0x7fbb1c0c7170 2026-02-17T11:12:52.562 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.546+0000 7fbb23975640 1 librados: init done 2026-02-17T11:12:52.562 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.546+0000 7fbb23975640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:12:52.562 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.546+0000 7fbb23975640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:12:52.563 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.546+0000 7fbb23975640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:12:52.563 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.546+0000 7fbb23975640 1 -- 10.20.193.49:0/1058763206 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb1c074990 con 0x7fbb1c0c7170 2026-02-17T11:12:52.654 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.652+0000 7fbb09ffb640 1 -- 10.20.193.49:0/1058763206 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7fbb10013630 con 0x7fbb1c0c7170 2026-02-17T11:12:52.655 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.653+0000 7fbb09ffb640 1 --2- 10.20.193.49:0/1058763206 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fbaec079170 0x7fbaec07b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:52.655 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.653+0000 7fbb216ea640 1 --2- 10.20.193.49:0/1058763206 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fbaec079170 0x7fbaec07b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:52.655 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.653+0000 7fbb216ea640 10 monclient: get_auth_request con 0x7fbaec079170 auth_method 0 2026-02-17T11:12:52.655 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.653+0000 7fbb09ffb640 10 client.4875.objecter ms_handle_connect 0x7fbaec079170 2026-02-17T11:12:52.655 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.653+0000 7fbb216ea640 1 --2- 10.20.193.49:0/1058763206 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fbaec079170 0x7fbaec07b630 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c002770 tx=0x7fbb0c002930 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:12:52.663 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.661+0000 7fbb09ffb640 1 -- 10.20.193.49:0/1058763206 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7fbb1005e710 con 0x7fbb1c0c7170 2026-02-17T11:12:52.663 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.661+0000 7fbb09ffb640 10 client.4875.objecter ms_dispatch2 0x7fbb1c000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:12:52.663 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.661+0000 7fbb09ffb640 3 client.4875.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:12:52.663 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.661+0000 7fbb09ffb640 3 client.4875.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:12:52.663 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.661+0000 7fbb09ffb640 20 client.4875.objecter dump_active .. 0 homeless 2026-02-17T11:12:52.663 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.661+0000 7fbb09ffb640 1 -- 10.20.193.49:0/1058763206 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fbb100626d0 con 0x7fbb1c0c7170 2026-02-17T11:12:52.663 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.661+0000 7fbb09ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:12:52.663 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.661+0000 7fbb09ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:12:52.763 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.761+0000 7fbb23975640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:12:52.763 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.761+0000 7fbb23975640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:12:52.763 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.761+0000 7fbb23975640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:12:52.763 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.761+0000 7fbb23975640 1 -- 10.20.193.49:0/1058763206 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fbb1c0c4a80 con 0x7fbb1c0c7170 2026-02-17T11:12:52.765 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.764+0000 7fbb09ffb640 1 -- 10.20.193.49:0/1058763206 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fbb100669d0 con 0x7fbb1c0c7170 2026-02-17T11:12:52.765 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.764+0000 7fbb09ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:12:52.765 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.764+0000 7fbb09ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:12:52.766 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:12:52.766 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:12:52.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.765+0000 7fbb23975640 10 librados: watch_flush enter 2026-02-17T11:12:52.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.765+0000 7fbb23975640 10 librados: watch_flush exit 2026-02-17T11:12:52.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.765+0000 7fbb23975640 20 client.4875.objecter shutdown clearing up homeless session... 2026-02-17T11:12:52.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.765+0000 7fbb23975640 10 client.4875.objecter successfully canceled tick 2026-02-17T11:12:52.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.765+0000 7fbb23975640 1 -- 10.20.193.49:0/1058763206 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fbaec079170 msgr2=0x7fbaec07b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:52.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.765+0000 7fbb23975640 1 --2- 10.20.193.49:0/1058763206 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fbaec079170 0x7fbaec07b630 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c002770 tx=0x7fbb0c002930 comp rx=0 tx=0).stop 2026-02-17T11:12:52.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.765+0000 7fbb23975640 10 monclient: shutdown 2026-02-17T11:12:52.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.765+0000 7fbb23975640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:12:52.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.765+0000 7fbb23975640 1 -- 10.20.193.49:0/1058763206 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbb1c0c7170 msgr2=0x7fbb1c1f57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:52.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.765+0000 7fbb23975640 1 --2- 10.20.193.49:0/1058763206 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbb1c0c7170 0x7fbb1c1f57a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbb1000ec10 tx=0x7fbb1000c520 comp rx=0 tx=0).stop 2026-02-17T11:12:52.769 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.765+0000 7fbb23975640 1 -- 10.20.193.49:0/1058763206 shutdown_connections 2026-02-17T11:12:52.769 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.765+0000 7fbb23975640 1 --2- 10.20.193.49:0/1058763206 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fbaec079170 0x7fbaec07b630 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:52.769 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.765+0000 7fbb23975640 1 --2- 10.20.193.49:0/1058763206 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fbb1c0c7550 0x7fbb1c1f5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:52.769 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.765+0000 7fbb23975640 1 --2- 10.20.193.49:0/1058763206 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbb1c0c7170 0x7fbb1c1f57a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:52.769 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.765+0000 7fbb23975640 1 --2- 10.20.193.49:0/1058763206 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fbb1c074ef0 0x7fbb1c073890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:52.769 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.765+0000 7fbb23975640 1 -- 10.20.193.49:0/1058763206 >> 10.20.193.49:0/1058763206 conn(0x7fbb1c0c9f40 msgr2=0x7fbb1c158250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:12:52.769 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.765+0000 7fbb23975640 1 -- 10.20.193.49:0/1058763206 shutdown_connections 2026-02-17T11:12:52.769 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.765+0000 7fbb23975640 1 -- 10.20.193.49:0/1058763206 wait complete. 2026-02-17T11:12:52.769 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:52.765+0000 7fbb23975640 1 librados: shutdown 2026-02-17T11:12:55.775 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:12:55.842 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.841+0000 7f7d704da640 10 monclient: get_monmap_and_config 2026-02-17T11:12:55.842 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.841+0000 7f7d704da640 10 monclient: build_initial_monmap 2026-02-17T11:12:55.842 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.841+0000 7f7d704da640 10 monclient: monmap: 2026-02-17T11:12:55.842 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:12:55.842 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:55.842 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:12:55.841546+0000 2026-02-17T11:12:55.842 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:12:55.841546+0000 2026-02-17T11:12:55.842 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:12:55.842 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:55.842 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:12:55.842 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:12:55.842 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:12:55.842 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:12:55.842 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:12:55.843 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:12:55.843 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:55.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.841+0000 7f7d704da640 1 Processor -- start 2026-02-17T11:12:55.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.841+0000 7f7d704da640 1 -- start start 2026-02-17T11:12:55.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.841+0000 7f7d704da640 10 monclient: init 2026-02-17T11:12:55.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.841+0000 7f7d704da640 10 monclient: _reopen_session rank -1 2026-02-17T11:12:55.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.841+0000 7f7d704da640 10 monclient: _add_conns ranks=[4,2,1,0,5,3] 2026-02-17T11:12:55.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.841+0000 7f7d704da640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f7d6815d370 0x7f7d6815d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:55.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.841+0000 7f7d704da640 10 monclient(hunting): picked mon.noname-b con 0x7f7d6815d370 addr v2:10.20.193.97:3300/0 2026-02-17T11:12:55.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.841+0000 7f7d704da640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f7d680c7e20 addr v1:10.20.193.157:6789/0 2026-02-17T11:12:55.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.841+0000 7f7d704da640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f7d680c74c0 addr v1:10.20.193.97:6789/0 2026-02-17T11:12:55.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.842+0000 7f7d704da640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d680c8350 con 0x7f7d680c74c0 2026-02-17T11:12:55.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.842+0000 7f7d704da640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d680c8630 con 0x7f7d680c7e20 2026-02-17T11:12:55.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.842+0000 7f7d704da640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:55.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.842+0000 7f7d704da640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f7d6815b710 con 0x7f7d6815d370 2026-02-17T11:12:55.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.842+0000 7f7d704da640 10 monclient(hunting): _renew_subs 2026-02-17T11:12:55.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.842+0000 7f7d704da640 10 monclient(hunting): authenticate will time out at 1252.505019s 2026-02-17T11:12:55.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.842+0000 7f7d6e24f640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f7d6815d370 0x7f7d6815d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:55.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.842+0000 7f7d6da4e640 1 --1- >> v1:10.20.193.157:6789/0 conn(0x7f7d680c7e20 0x7f7d6815b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.157:6789/0 says I am v1:10.20.193.49:48576/0 (socket says 10.20.193.49:48576) 2026-02-17T11:12:55.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.842+0000 7f7d6da4e640 1 -- 10.20.193.49:0/3372530743 learned_addr learned my addr 10.20.193.49:0/3372530743 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:12:55.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.842+0000 7f7d6e24f640 10 monclient(hunting): get_auth_request con 0x7f7d6815d370 auth_method 0 2026-02-17T11:12:55.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.842+0000 7f7d6e24f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:55.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.842+0000 7f7d6e24f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:55.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.842+0000 7f7d6e24f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:55.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.843+0000 7f7d6e24f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:55.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.843+0000 7f7d6e24f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:55.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.843+0000 7f7d6e24f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:55.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.844+0000 7f7d6d24d640 1 -- 10.20.193.49:0/3372530743 <== mon.2 v1:10.20.193.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2688076308 0 0) 0x7f7d680c8630 con 0x7f7d680c7e20 2026-02-17T11:12:55.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.844+0000 7f7d6d24d640 10 monclient(hunting): _negotiate 2026-02-17T11:12:55.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.844+0000 7f7d6d24d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:55.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.844+0000 7f7d6d24d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:55.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.844+0000 7f7d6d24d640 10 monclient(hunting): my global_id is 4865 2026-02-17T11:12:55.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.844+0000 7f7d6d24d640 1 -- 10.20.193.49:0/3372530743 --> v1:10.20.193.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d50003620 con 0x7f7d680c7e20 2026-02-17T11:12:55.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.844+0000 7f7d6e24f640 10 monclient(hunting): handle_auth_done global_id 4828 payload 274 2026-02-17T11:12:55.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.844+0000 7f7d6e24f640 1 -- 10.20.193.49:0/3372530743 >> v1:10.20.193.157:6789/0 conn(0x7f7d680c7e20 legacy=0x7f7d6815b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:55.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.844+0000 7f7d6e24f640 1 -- 10.20.193.49:0/3372530743 >> v1:10.20.193.97:6789/0 conn(0x7f7d680c74c0 legacy=0x7f7d680c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:55.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.844+0000 7f7d6e24f640 10 monclient: _finish_hunting 0 2026-02-17T11:12:55.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.844+0000 7f7d6e24f640 1 monclient: found mon.noname-b 2026-02-17T11:12:55.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.844+0000 7f7d6e24f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:12:55.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.844+0000 7f7d6e24f640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:12:55.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.844+0000 7f7d6e24f640 1 -- 10.20.193.49:0/3372530743 --> v2:10.20.193.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d680c8910 con 0x7f7d6815d370 2026-02-17T11:12:55.848 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.847+0000 7f7d6e24f640 1 --2- 10.20.193.49:0/3372530743 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f7d6815d370 0x7f7d6815d750 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7d580098a0 tx=0x7f7d5802ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba26486b6622bdb5 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:12:55.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.849+0000 7f7d6d24d640 1 -- 10.20.193.49:0/3372530743 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d5803c070 con 0x7f7d6815d370 2026-02-17T11:12:55.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.849+0000 7f7d6d24d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:55.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.849+0000 7f7d6d24d640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:12:55.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.849+0000 7f7d6d24d640 10 monclient: dump: 2026-02-17T11:12:55.851 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:55.851 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:55.851 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:55.851 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:55.851 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:55.851 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:55.851 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:55.851 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:55.851 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:55.851 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:55.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.849+0000 7f7d6d24d640 10 monclient: _finish_auth 0 2026-02-17T11:12:55.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.849+0000 7f7d6d24d640 10 monclient: _check_auth_tickets 2026-02-17T11:12:55.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.849+0000 7f7d6d24d640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:12:55.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.849+0000 7f7d6d24d640 1 -- 10.20.193.49:0/3372530743 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d5802fb70 con 0x7f7d6815d370 2026-02-17T11:12:55.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.849+0000 7f7d704da640 5 monclient: authenticate success, global_id 4828 2026-02-17T11:12:55.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.849+0000 7f7d6d24d640 10 monclient: handle_config config(0 keys) 2026-02-17T11:12:55.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.849+0000 7f7d6d24d640 1 -- 10.20.193.49:0/3372530743 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d58037440 con 0x7f7d6815d370 2026-02-17T11:12:55.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.849+0000 7f7d704da640 10 monclient: get_monmap_and_config success 2026-02-17T11:12:55.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.849+0000 7f7d704da640 4 set_mon_vals no callback set 2026-02-17T11:12:55.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.849+0000 7f7d6d24d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:55.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.849+0000 7f7d6d24d640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:12:55.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.849+0000 7f7d6d24d640 10 monclient: dump: 2026-02-17T11:12:55.851 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:55.851 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:55.851 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:55.851 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:55.851 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:55.852 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:55.852 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:55.852 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:55.852 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:55.852 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:55.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.849+0000 7f7d704da640 10 monclient: shutdown 2026-02-17T11:12:55.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.849+0000 7f7d704da640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:12:55.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.849+0000 7f7d704da640 1 -- 10.20.193.49:0/3372530743 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f7d6815d370 msgr2=0x7f7d6815d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:55.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.849+0000 7f7d704da640 1 --2- 10.20.193.49:0/3372530743 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f7d6815d370 0x7f7d6815d750 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7d580098a0 tx=0x7f7d5802ee60 comp rx=0 tx=0).stop 2026-02-17T11:12:55.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.849+0000 7f7d704da640 1 -- 10.20.193.49:0/3372530743 shutdown_connections 2026-02-17T11:12:55.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.849+0000 7f7d704da640 1 --2- 10.20.193.49:0/3372530743 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f7d6815d370 0x7f7d6815d750 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:55.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.849+0000 7f7d704da640 1 -- 10.20.193.49:0/3372530743 >> 10.20.193.49:0/3372530743 conn(0x7f7d680c9f20 msgr2=0x7f7d680ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:12:55.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.849+0000 7f7d704da640 1 -- 10.20.193.49:0/3372530743 shutdown_connections 2026-02-17T11:12:55.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.849+0000 7f7d704da640 1 -- 10.20.193.49:0/3372530743 wait complete. 2026-02-17T11:12:55.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.850+0000 7f7d704da640 10 monclient: build_initial_monmap 2026-02-17T11:12:55.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.850+0000 7f7d704da640 10 monclient: monmap: 2026-02-17T11:12:55.853 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:12:55.853 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:12:55.853 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:12:55.853 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:12:55.853 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:12:55.854 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:55.854 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:12:55.854 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:12:55.854 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:12:55.854 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:55.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.850+0000 7f7d704da640 1 librados: starting msgr at 2026-02-17T11:12:55.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.850+0000 7f7d704da640 1 librados: starting objecter 2026-02-17T11:12:55.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.850+0000 7f7d704da640 1 Processor -- start 2026-02-17T11:12:55.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.850+0000 7f7d704da640 1 -- start start 2026-02-17T11:12:55.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.850+0000 7f7d704da640 1 librados: setting wanted keys 2026-02-17T11:12:55.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.850+0000 7f7d704da640 1 librados: calling monclient init 2026-02-17T11:12:55.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.850+0000 7f7d704da640 10 monclient: init 2026-02-17T11:12:55.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.850+0000 7f7d704da640 10 monclient: _reopen_session rank -1 2026-02-17T11:12:55.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.850+0000 7f7d704da640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:12:55.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.850+0000 7f7d704da640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f7d680c74c0 0x7f7d681f2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:55.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.850+0000 7f7d704da640 10 monclient(hunting): picked mon.noname-b con 0x7f7d680c74c0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:12:55.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.850+0000 7f7d704da640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f7d680c7e20 0x7f7d681592c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:55.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.850+0000 7f7d704da640 10 monclient(hunting): picked mon.noname-c con 0x7f7d680c7e20 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:12:55.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.850+0000 7f7d704da640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f7d6815d370 0x7f7d681f46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:55.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.850+0000 7f7d704da640 10 monclient(hunting): picked mon.noname-a con 0x7f7d6815d370 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:12:55.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.850+0000 7f7d704da640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:55.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.850+0000 7f7d704da640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7d680c8ed0 con 0x7f7d6815d370 2026-02-17T11:12:55.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.850+0000 7f7d704da640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:55.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.850+0000 7f7d704da640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7d680c9240 con 0x7f7d680c74c0 2026-02-17T11:12:55.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.850+0000 7f7d704da640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:55.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.851+0000 7f7d704da640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f7d680c96d0 con 0x7f7d680c7e20 2026-02-17T11:12:55.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.851+0000 7f7d704da640 10 monclient(hunting): _renew_subs 2026-02-17T11:12:55.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.851+0000 7f7d704da640 10 monclient(hunting): authenticate will time out at 1252.514006s 2026-02-17T11:12:55.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.851+0000 7f7d6e24f640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f7d680c74c0 0x7f7d681f2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:55.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.851+0000 7f7d6da4e640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f7d680c7e20 0x7f7d681592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:55.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.851+0000 7f7d6e24f640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f7d680c74c0 0x7f7d681f2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:58534/0 (socket says 10.20.193.49:58534) 2026-02-17T11:12:55.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.851+0000 7f7d6e24f640 1 -- 10.20.193.49:0/1309763033 learned_addr learned my addr 10.20.193.49:0/1309763033 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:12:55.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.851+0000 7f7d6e24f640 10 monclient(hunting): get_auth_request con 0x7f7d680c74c0 auth_method 0 2026-02-17T11:12:55.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.851+0000 7f7d6e24f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:55.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.851+0000 7f7d6e24f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:55.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.851+0000 7f7d6e24f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:55.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.851+0000 7f7d6ea50640 1 --2- 10.20.193.49:0/1309763033 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f7d6815d370 0x7f7d681f46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:55.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.851+0000 7f7d6ea50640 10 monclient(hunting): get_auth_request con 0x7f7d6815d370 auth_method 0 2026-02-17T11:12:55.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.851+0000 7f7d6ea50640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:55.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.851+0000 7f7d6ea50640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:55.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.851+0000 7f7d6ea50640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:55.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.851+0000 7f7d6e24f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:55.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.851+0000 7f7d6e24f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:55.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.851+0000 7f7d6e24f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:55.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.851+0000 7f7d6da4e640 10 monclient(hunting): get_auth_request con 0x7f7d680c7e20 auth_method 0 2026-02-17T11:12:55.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.851+0000 7f7d6da4e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:55.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.851+0000 7f7d6da4e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:55.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.851+0000 7f7d6da4e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:55.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.851+0000 7f7d6ea50640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:55.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.851+0000 7f7d6ea50640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:55.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.851+0000 7f7d6ea50640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:55.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.852+0000 7f7d6da4e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:55.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.852+0000 7f7d6da4e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:55.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.852+0000 7f7d6da4e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:55.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.853+0000 7f7d6e24f640 10 monclient(hunting): handle_auth_done global_id 4831 payload 824 2026-02-17T11:12:55.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.853+0000 7f7d6e24f640 1 -- 10.20.193.49:0/1309763033 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f7d680c7e20 msgr2=0x7f7d681592c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:55.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.853+0000 7f7d6e24f640 1 --2- 10.20.193.49:0/1309763033 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f7d680c7e20 0x7f7d681592c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:55.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.853+0000 7f7d6e24f640 1 -- 10.20.193.49:0/1309763033 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f7d6815d370 msgr2=0x7f7d681f46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:55.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.853+0000 7f7d6e24f640 1 --2- 10.20.193.49:0/1309763033 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f7d6815d370 0x7f7d681f46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:55.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.853+0000 7f7d6e24f640 10 monclient: _finish_hunting 0 2026-02-17T11:12:55.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.853+0000 7f7d6e24f640 1 monclient: found mon.noname-b 2026-02-17T11:12:55.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.853+0000 7f7d6e24f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:12:55.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.853+0000 7f7d6e24f640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:12:55.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.853+0000 7f7d6e24f640 1 -- 10.20.193.49:0/1309763033 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d68157f40 con 0x7f7d680c74c0 2026-02-17T11:12:55.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.854+0000 7f7d6e24f640 1 --2- 10.20.193.49:0/1309763033 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f7d680c74c0 0x7f7d681f2370 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7d58009130 tx=0x7f7d580047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:12:55.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.854+0000 7f7d4effd640 10 client.?.objecter ms_handle_connect 0x7f7d680c74c0 2026-02-17T11:12:55.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.854+0000 7f7d4effd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:12:55.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.855+0000 7f7d4effd640 1 -- 10.20.193.49:0/1309763033 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d5803c040 con 0x7f7d680c74c0 2026-02-17T11:12:55.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.855+0000 7f7d4effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:55.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.855+0000 7f7d4effd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:12:55.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.855+0000 7f7d4effd640 10 monclient: dump: 2026-02-17T11:12:55.857 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:55.857 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:55.857 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:55.857 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:55.857 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:55.857 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:55.858 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:55.858 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:55.858 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:55.858 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:55.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.855+0000 7f7d4effd640 10 monclient: _finish_auth 0 2026-02-17T11:12:55.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.855+0000 7f7d4effd640 10 monclient: _check_auth_tickets 2026-02-17T11:12:55.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.855+0000 7f7d4effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:12:55.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.855+0000 7f7d704da640 5 monclient: authenticate success, global_id 4831 2026-02-17T11:12:55.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.855+0000 7f7d704da640 10 monclient: _renew_subs 2026-02-17T11:12:55.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.855+0000 7f7d704da640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:12:55.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.855+0000 7f7d704da640 1 -- 10.20.193.49:0/1309763033 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d68158220 con 0x7f7d680c74c0 2026-02-17T11:12:55.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.855+0000 7f7d704da640 10 client.4831.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:12:55.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.855+0000 7f7d704da640 10 monclient: _renew_subs 2026-02-17T11:12:55.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.855+0000 7f7d704da640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:12:55.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.855+0000 7f7d704da640 1 -- 10.20.193.49:0/1309763033 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d681587e0 con 0x7f7d680c74c0 2026-02-17T11:12:55.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.855+0000 7f7d704da640 1 librados: init done 2026-02-17T11:12:55.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.855+0000 7f7d4effd640 1 -- 10.20.193.49:0/1309763033 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d5802fab0 con 0x7f7d680c74c0 2026-02-17T11:12:55.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.855+0000 7f7d4effd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:12:55.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.855+0000 7f7d4effd640 1 -- 10.20.193.49:0/1309763033 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d58042810 con 0x7f7d680c74c0 2026-02-17T11:12:55.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.855+0000 7f7d4effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:55.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.855+0000 7f7d4effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:12:55.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.855+0000 7f7d4effd640 10 monclient: dump: 2026-02-17T11:12:55.858 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:55.858 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:55.858 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:55.858 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:55.858 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:55.858 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:55.858 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:55.858 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:55.858 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:55.859 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:55.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.855+0000 7f7d6ca4c640 4 set_mon_vals no callback set 2026-02-17T11:12:55.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.855+0000 7f7d704da640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:12:55.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.856+0000 7f7d704da640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:12:55.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.856+0000 7f7d704da640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:12:55.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.856+0000 7f7d704da640 1 -- 10.20.193.49:0/1309763033 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d6815d750 con 0x7f7d680c74c0 2026-02-17T11:12:55.868 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.867+0000 7f7d4effd640 1 -- 10.20.193.49:0/1309763033 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f7d580429b0 con 0x7f7d680c74c0 2026-02-17T11:12:55.869 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.868+0000 7f7d4effd640 1 --2- 10.20.193.49:0/1309763033 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f7d38079140 0x7f7d3807b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:55.869 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.868+0000 7f7d6da4e640 1 --2- 10.20.193.49:0/1309763033 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f7d38079140 0x7f7d3807b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:55.869 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.868+0000 7f7d6da4e640 10 monclient: get_auth_request con 0x7f7d38079140 auth_method 0 2026-02-17T11:12:55.870 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.868+0000 7f7d4effd640 10 client.4831.objecter ms_handle_connect 0x7f7d38079140 2026-02-17T11:12:55.870 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.868+0000 7f7d6da4e640 1 --2- 10.20.193.49:0/1309763033 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f7d38079140 0x7f7d3807b600 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7d6814b780 tx=0x7f7d5c007dd0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:12:55.871 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.870+0000 7f7d4effd640 1 -- 10.20.193.49:0/1309763033 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f7d580bc4b0 con 0x7f7d680c74c0 2026-02-17T11:12:55.871 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.870+0000 7f7d4effd640 10 client.4831.objecter ms_dispatch2 0x7f7d68000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:12:55.871 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.870+0000 7f7d4effd640 3 client.4831.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:12:55.871 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.870+0000 7f7d4effd640 3 client.4831.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:12:55.871 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.870+0000 7f7d4effd640 20 client.4831.objecter dump_active .. 0 homeless 2026-02-17T11:12:55.971 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.970+0000 7f7d4effd640 1 -- 10.20.193.49:0/1309763033 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f7d58051080 con 0x7f7d680c74c0 2026-02-17T11:12:55.971 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.970+0000 7f7d4effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:12:55.971 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:55.970+0000 7f7d4effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:12:56.073 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:56.071+0000 7f7d704da640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:12:56.073 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:56.071+0000 7f7d704da640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:12:56.073 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:56.071+0000 7f7d704da640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:12:56.073 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:56.071+0000 7f7d704da640 1 -- 10.20.193.49:0/1309763033 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7d680c5630 con 0x7f7d680c74c0 2026-02-17T11:12:56.075 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:56.074+0000 7f7d4effd640 1 -- 10.20.193.49:0/1309763033 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f7d58086bf0 con 0x7f7d680c74c0 2026-02-17T11:12:56.075 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:56.074+0000 7f7d4effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:12:56.075 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:56.074+0000 7f7d4effd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:12:56.075 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:12:56.075 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:12:56.076 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:56.075+0000 7f7d704da640 10 librados: watch_flush enter 2026-02-17T11:12:56.076 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:56.075+0000 7f7d704da640 10 librados: watch_flush exit 2026-02-17T11:12:56.077 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:56.075+0000 7f7d704da640 20 client.4831.objecter shutdown clearing up homeless session... 2026-02-17T11:12:56.077 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:56.075+0000 7f7d704da640 10 client.4831.objecter successfully canceled tick 2026-02-17T11:12:56.077 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:56.075+0000 7f7d704da640 1 -- 10.20.193.49:0/1309763033 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f7d38079140 msgr2=0x7f7d3807b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:56.077 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:56.075+0000 7f7d704da640 1 --2- 10.20.193.49:0/1309763033 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f7d38079140 0x7f7d3807b600 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7d6814b780 tx=0x7f7d5c007dd0 comp rx=0 tx=0).stop 2026-02-17T11:12:56.077 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:56.075+0000 7f7d704da640 10 monclient: shutdown 2026-02-17T11:12:56.077 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:56.075+0000 7f7d704da640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:12:56.077 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:56.075+0000 7f7d704da640 1 -- 10.20.193.49:0/1309763033 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f7d680c74c0 msgr2=0x7f7d681f2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:56.077 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:56.075+0000 7f7d704da640 1 --2- 10.20.193.49:0/1309763033 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f7d680c74c0 0x7f7d681f2370 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7d58009130 tx=0x7f7d580047c0 comp rx=0 tx=0).stop 2026-02-17T11:12:56.077 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:56.075+0000 7f7d704da640 1 -- 10.20.193.49:0/1309763033 shutdown_connections 2026-02-17T11:12:56.077 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:56.075+0000 7f7d704da640 1 --2- 10.20.193.49:0/1309763033 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f7d38079140 0x7f7d3807b600 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:56.077 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:56.075+0000 7f7d704da640 1 --2- 10.20.193.49:0/1309763033 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f7d6815d370 0x7f7d681f46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:56.077 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:56.075+0000 7f7d704da640 1 --2- 10.20.193.49:0/1309763033 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f7d680c7e20 0x7f7d681592c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:56.077 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:56.075+0000 7f7d704da640 1 --2- 10.20.193.49:0/1309763033 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f7d680c74c0 0x7f7d681f2370 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:56.077 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:56.075+0000 7f7d704da640 1 -- 10.20.193.49:0/1309763033 >> 10.20.193.49:0/1309763033 conn(0x7f7d680c9f20 msgr2=0x7f7d680ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:12:56.077 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:56.075+0000 7f7d704da640 1 -- 10.20.193.49:0/1309763033 shutdown_connections 2026-02-17T11:12:56.077 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:56.075+0000 7f7d704da640 1 -- 10.20.193.49:0/1309763033 wait complete. 2026-02-17T11:12:56.077 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:56.075+0000 7f7d704da640 1 librados: shutdown 2026-02-17T11:12:59.086 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:12:59.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.151+0000 7f5fcafa0640 10 monclient: get_monmap_and_config 2026-02-17T11:12:59.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.151+0000 7f5fcafa0640 10 monclient: build_initial_monmap 2026-02-17T11:12:59.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.151+0000 7f5fcafa0640 10 monclient: monmap: 2026-02-17T11:12:59.153 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:12:59.153 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:59.153 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:12:59.151603+0000 2026-02-17T11:12:59.153 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:12:59.151603+0000 2026-02-17T11:12:59.153 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:12:59.153 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:59.153 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:12:59.153 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:12:59.153 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:12:59.153 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:12:59.154 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:12:59.154 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:12:59.154 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:59.162 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.151+0000 7f5fcafa0640 1 Processor -- start 2026-02-17T11:12:59.163 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.151+0000 7f5fcafa0640 1 -- start start 2026-02-17T11:12:59.163 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.151+0000 7f5fcafa0640 10 monclient: init 2026-02-17T11:12:59.163 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.152+0000 7f5fcafa0640 10 monclient: _reopen_session rank -1 2026-02-17T11:12:59.163 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.152+0000 7f5fcafa0640 10 monclient: _add_conns ranks=[4,5,3,2,1,0] 2026-02-17T11:12:59.163 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.152+0000 7f5fcafa0640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f5fc40c7170 0x7f5fc40c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:59.163 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.152+0000 7f5fcafa0640 10 monclient(hunting): picked mon.noname-b con 0x7f5fc40c7170 addr v2:10.20.193.97:3300/0 2026-02-17T11:12:59.163 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.152+0000 7f5fcafa0640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f5fc40c48c0 0x7f5fc40749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:59.163 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.152+0000 7f5fcafa0640 10 monclient(hunting): picked mon.noname-c con 0x7f5fc40c48c0 addr v2:10.20.193.157:3300/0 2026-02-17T11:12:59.163 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.152+0000 7f5fcafa0640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f5fc4074ef0 0x7f5fc40c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:59.163 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.152+0000 7f5fcafa0640 10 monclient(hunting): picked mon.noname-a con 0x7f5fc4074ef0 addr v2:10.20.193.49:3300/0 2026-02-17T11:12:59.163 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.152+0000 7f5fcafa0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:59.164 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.152+0000 7f5fcafa0640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f5fc40c8530 con 0x7f5fc4074ef0 2026-02-17T11:12:59.164 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.152+0000 7f5fcafa0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:59.164 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.152+0000 7f5fcafa0640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f5fc415a9a0 con 0x7f5fc40c7170 2026-02-17T11:12:59.164 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.152+0000 7f5fcafa0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:59.164 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.152+0000 7f5fcafa0640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f5fc40c5270 con 0x7f5fc40c48c0 2026-02-17T11:12:59.164 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.152+0000 7f5fcafa0640 10 monclient(hunting): _renew_subs 2026-02-17T11:12:59.164 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.152+0000 7f5fcafa0640 10 monclient(hunting): authenticate will time out at 1255.815072s 2026-02-17T11:12:59.164 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.152+0000 7f5fc8d15640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f5fc40c7170 0x7f5fc40c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:59.164 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.152+0000 7f5fc8d15640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f5fc40c7170 0x7f5fc40c7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:51202/0 (socket says 10.20.193.49:51202) 2026-02-17T11:12:59.164 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.152+0000 7f5fc8d15640 1 -- 10.20.193.49:0/3187830677 learned_addr learned my addr 10.20.193.49:0/3187830677 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:12:59.164 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.152+0000 7f5fc8d15640 10 monclient(hunting): get_auth_request con 0x7f5fc40c7170 auth_method 0 2026-02-17T11:12:59.165 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.152+0000 7f5fc8d15640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:59.165 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.152+0000 7f5fc8d15640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:59.165 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.152+0000 7f5fc8d15640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:59.165 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.152+0000 7f5fbbfff640 1 --2- 10.20.193.49:0/3187830677 >> v2:10.20.193.157:3300/0 conn(0x7f5fc40c48c0 0x7f5fc40749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:59.165 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.152+0000 7f5fc9516640 1 --2- 10.20.193.49:0/3187830677 >> v2:10.20.193.49:3300/0 conn(0x7f5fc4074ef0 0x7f5fc40c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:59.165 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.152+0000 7f5fbbfff640 10 monclient(hunting): get_auth_request con 0x7f5fc40c48c0 auth_method 0 2026-02-17T11:12:59.165 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.152+0000 7f5fbbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:59.165 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.152+0000 7f5fbbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:59.165 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.152+0000 7f5fbbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:59.165 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.152+0000 7f5fc8d15640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:59.165 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.152+0000 7f5fc8d15640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:59.165 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.152+0000 7f5fc8d15640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:59.165 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.152+0000 7f5fc9516640 10 monclient(hunting): get_auth_request con 0x7f5fc4074ef0 auth_method 0 2026-02-17T11:12:59.166 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.152+0000 7f5fc9516640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:59.166 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.152+0000 7f5fc9516640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:59.166 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.152+0000 7f5fc9516640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:59.166 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.153+0000 7f5fbbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:59.166 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.153+0000 7f5fbbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:59.166 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.153+0000 7f5fbbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:59.166 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.153+0000 7f5fc9516640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:59.166 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.153+0000 7f5fc9516640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:59.166 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.153+0000 7f5fc9516640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:59.166 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.153+0000 7f5fc8d15640 10 monclient(hunting): handle_auth_done global_id 4834 payload 274 2026-02-17T11:12:59.166 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.153+0000 7f5fc8d15640 1 -- 10.20.193.49:0/3187830677 >> v2:10.20.193.157:3300/0 conn(0x7f5fc40c48c0 msgr2=0x7f5fc40749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:12:59.166 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.153+0000 7f5fc8d15640 1 --2- 10.20.193.49:0/3187830677 >> v2:10.20.193.157:3300/0 conn(0x7f5fc40c48c0 0x7f5fc40749b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:59.167 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.153+0000 7f5fc8d15640 1 -- 10.20.193.49:0/3187830677 >> v2:10.20.193.49:3300/0 conn(0x7f5fc4074ef0 msgr2=0x7f5fc40c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:12:59.167 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.153+0000 7f5fc8d15640 1 --2- 10.20.193.49:0/3187830677 >> v2:10.20.193.49:3300/0 conn(0x7f5fc4074ef0 0x7f5fc40c89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:59.167 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.153+0000 7f5fc8d15640 10 monclient: _finish_hunting 0 2026-02-17T11:12:59.167 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.153+0000 7f5fc8d15640 1 monclient: found mon.noname-b 2026-02-17T11:12:59.167 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.153+0000 7f5fc8d15640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:12:59.167 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.153+0000 7f5fc8d15640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:12:59.167 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.153+0000 7f5fc8d15640 1 -- 10.20.193.49:0/3187830677 --> v2:10.20.193.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fc40c5550 con 0x7f5fc40c7170 2026-02-17T11:12:59.167 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.154+0000 7f5fc8d15640 1 --2- 10.20.193.49:0/3187830677 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5fc40c7170 0x7f5fc40c7550 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5fc40723c0 tx=0x7f5fb402ee90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c0ba2406f664357 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:12:59.167 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.156+0000 7f5fbb7fe640 1 -- 10.20.193.49:0/3187830677 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb403c070 con 0x7f5fc40c7170 2026-02-17T11:12:59.167 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.156+0000 7f5fbb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:59.167 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.156+0000 7f5fbb7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:12:59.167 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.156+0000 7f5fbb7fe640 10 monclient: dump: 2026-02-17T11:12:59.168 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:59.168 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:59.168 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:59.168 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:59.168 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:59.168 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:59.168 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:59.168 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:59.168 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:59.168 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:59.168 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.156+0000 7f5fbb7fe640 10 monclient: _finish_auth 0 2026-02-17T11:12:59.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.156+0000 7f5fbb7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:12:59.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.156+0000 7f5fbb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:12:59.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.156+0000 7f5fcafa0640 5 monclient: authenticate success, global_id 4834 2026-02-17T11:12:59.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.156+0000 7f5fcafa0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:12:59.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.156+0000 7f5fbb7fe640 1 -- 10.20.193.49:0/3187830677 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fb402fb50 con 0x7f5fc40c7170 2026-02-17T11:12:59.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.156+0000 7f5fbb7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:12:59.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.156+0000 7f5fbb7fe640 1 -- 10.20.193.49:0/3187830677 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb4037440 con 0x7f5fc40c7170 2026-02-17T11:12:59.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.156+0000 7f5fbb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:59.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.156+0000 7f5fbb7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:12:59.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.156+0000 7f5fbb7fe640 10 monclient: dump: 2026-02-17T11:12:59.169 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:59.169 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:59.169 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:59.170 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:59.170 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:59.170 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:59.170 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:59.170 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:59.170 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:59.170 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:59.170 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.156+0000 7f5fcafa0640 10 monclient: get_monmap_and_config success 2026-02-17T11:12:59.170 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.156+0000 7f5fcafa0640 4 set_mon_vals no callback set 2026-02-17T11:12:59.170 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.156+0000 7f5fcafa0640 10 monclient: shutdown 2026-02-17T11:12:59.170 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.156+0000 7f5fcafa0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:12:59.170 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.156+0000 7f5fcafa0640 1 -- 10.20.193.49:0/3187830677 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5fc40c7170 msgr2=0x7f5fc40c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:59.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.156+0000 7f5fcafa0640 1 --2- 10.20.193.49:0/3187830677 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5fc40c7170 0x7f5fc40c7550 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5fc40723c0 tx=0x7f5fb402ee90 comp rx=0 tx=0).stop 2026-02-17T11:12:59.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.156+0000 7f5fcafa0640 1 -- 10.20.193.49:0/3187830677 shutdown_connections 2026-02-17T11:12:59.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.156+0000 7f5fcafa0640 1 --2- 10.20.193.49:0/3187830677 >> v2:10.20.193.49:3300/0 conn(0x7f5fc4074ef0 0x7f5fc40c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:59.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.156+0000 7f5fcafa0640 1 --2- 10.20.193.49:0/3187830677 >> v2:10.20.193.157:3300/0 conn(0x7f5fc40c48c0 0x7f5fc40749b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:59.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.156+0000 7f5fcafa0640 1 --2- 10.20.193.49:0/3187830677 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5fc40c7170 0x7f5fc40c7550 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:59.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.156+0000 7f5fcafa0640 1 -- 10.20.193.49:0/3187830677 >> 10.20.193.49:0/3187830677 conn(0x7f5fc40c9f40 msgr2=0x7f5fc40ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:12:59.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.156+0000 7f5fcafa0640 1 -- 10.20.193.49:0/3187830677 shutdown_connections 2026-02-17T11:12:59.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.156+0000 7f5fcafa0640 1 -- 10.20.193.49:0/3187830677 wait complete. 2026-02-17T11:12:59.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.157+0000 7f5fcafa0640 10 monclient: build_initial_monmap 2026-02-17T11:12:59.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.157+0000 7f5fcafa0640 10 monclient: monmap: 2026-02-17T11:12:59.171 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:12:59.171 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:12:59.172 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:12:59.172 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:12:59.172 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:12:59.172 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:59.172 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:12:59.172 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:12:59.172 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:12:59.172 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:59.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.157+0000 7f5fcafa0640 1 librados: starting msgr at 2026-02-17T11:12:59.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.157+0000 7f5fcafa0640 1 librados: starting objecter 2026-02-17T11:12:59.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.157+0000 7f5fcafa0640 1 Processor -- start 2026-02-17T11:12:59.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.157+0000 7f5fcafa0640 1 -- start start 2026-02-17T11:12:59.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.157+0000 7f5fcafa0640 1 librados: setting wanted keys 2026-02-17T11:12:59.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.157+0000 7f5fcafa0640 1 librados: calling monclient init 2026-02-17T11:12:59.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.157+0000 7f5fcafa0640 10 monclient: init 2026-02-17T11:12:59.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.157+0000 7f5fcafa0640 10 monclient: _reopen_session rank -1 2026-02-17T11:12:59.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.157+0000 7f5fcafa0640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:12:59.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.157+0000 7f5fcafa0640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5fc4074ef0 0x7f5fc41570b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:59.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.157+0000 7f5fcafa0640 10 monclient(hunting): picked mon.noname-b con 0x7f5fc4074ef0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:12:59.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.157+0000 7f5fcafa0640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5fc40c48c0 0x7f5fc415d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:59.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.157+0000 7f5fcafa0640 10 monclient(hunting): picked mon.noname-a con 0x7f5fc40c48c0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:12:59.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.157+0000 7f5fcafa0640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5fc40c7170 0x7f5fc40c3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:59.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.157+0000 7f5fcafa0640 10 monclient(hunting): picked mon.noname-c con 0x7f5fc40c7170 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:12:59.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.157+0000 7f5fcafa0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:59.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.157+0000 7f5fcafa0640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc40c81c0 con 0x7f5fc40c48c0 2026-02-17T11:12:59.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.157+0000 7f5fcafa0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:59.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.157+0000 7f5fcafa0640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc40c7ee0 con 0x7f5fc4074ef0 2026-02-17T11:12:59.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.157+0000 7f5fcafa0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:12:59.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.157+0000 7f5fcafa0640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc40c4d10 con 0x7f5fc40c7170 2026-02-17T11:12:59.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.157+0000 7f5fcafa0640 10 monclient(hunting): _renew_subs 2026-02-17T11:12:59.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.157+0000 7f5fcafa0640 10 monclient(hunting): authenticate will time out at 1255.820895s 2026-02-17T11:12:59.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.158+0000 7f5fc8d15640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5fc4074ef0 0x7f5fc41570b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:59.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.158+0000 7f5fc9516640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5fc40c7170 0x7f5fc40c3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:59.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.158+0000 7f5fbbfff640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5fc40c48c0 0x7f5fc415d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:59.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.158+0000 7f5fc8d15640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5fc4074ef0 0x7f5fc41570b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:51208/0 (socket says 10.20.193.49:51208) 2026-02-17T11:12:59.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.158+0000 7f5fc8d15640 1 -- 10.20.193.49:0/2618472744 learned_addr learned my addr 10.20.193.49:0/2618472744 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:12:59.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.158+0000 7f5fc8d15640 10 monclient(hunting): get_auth_request con 0x7f5fc4074ef0 auth_method 0 2026-02-17T11:12:59.175 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.158+0000 7f5fc8d15640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:59.175 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.158+0000 7f5fc8d15640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:59.175 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.158+0000 7f5fc8d15640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:59.175 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.158+0000 7f5fc9516640 10 monclient(hunting): get_auth_request con 0x7f5fc40c7170 auth_method 0 2026-02-17T11:12:59.175 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.158+0000 7f5fc9516640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:59.175 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.158+0000 7f5fc9516640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:59.175 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.158+0000 7f5fc9516640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:59.175 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.158+0000 7f5fbbfff640 10 monclient(hunting): get_auth_request con 0x7f5fc40c48c0 auth_method 0 2026-02-17T11:12:59.175 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.158+0000 7f5fbbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:12:59.175 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.158+0000 7f5fbbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:12:59.175 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.158+0000 7f5fbbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:12:59.175 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.158+0000 7f5fc8d15640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:59.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.158+0000 7f5fc8d15640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:59.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.158+0000 7f5fc8d15640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:59.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.158+0000 7f5fc9516640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:59.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.158+0000 7f5fc9516640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:59.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.158+0000 7f5fc9516640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:59.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.158+0000 7f5fbbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:12:59.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.158+0000 7f5fbbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:12:59.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.158+0000 7f5fbbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:12:59.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.159+0000 7f5fc8d15640 10 monclient(hunting): handle_auth_done global_id 4837 payload 824 2026-02-17T11:12:59.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.159+0000 7f5fc8d15640 1 -- 10.20.193.49:0/2618472744 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5fc40c7170 msgr2=0x7f5fc40c3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:59.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.159+0000 7f5fc8d15640 1 --2- 10.20.193.49:0/2618472744 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5fc40c7170 0x7f5fc40c3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:59.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.159+0000 7f5fc8d15640 1 -- 10.20.193.49:0/2618472744 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5fc40c48c0 msgr2=0x7f5fc415d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:59.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.159+0000 7f5fc8d15640 1 --2- 10.20.193.49:0/2618472744 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5fc40c48c0 0x7f5fc415d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:59.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.159+0000 7f5fc8d15640 10 monclient: _finish_hunting 0 2026-02-17T11:12:59.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.159+0000 7f5fc8d15640 1 monclient: found mon.noname-b 2026-02-17T11:12:59.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.159+0000 7f5fc8d15640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:12:59.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.159+0000 7f5fc8d15640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:12:59.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.159+0000 7f5fc8d15640 1 -- 10.20.193.49:0/2618472744 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fc40c2bd0 con 0x7f5fc4074ef0 2026-02-17T11:12:59.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.160+0000 7f5fc8d15640 1 --2- 10.20.193.49:0/2618472744 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5fc4074ef0 0x7f5fc41570b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5fb402f3f0 tx=0x7f5fb40047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:12:59.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.160+0000 7f5fb97fa640 10 client.?.objecter ms_handle_connect 0x7f5fc4074ef0 2026-02-17T11:12:59.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.160+0000 7f5fb97fa640 10 client.?.objecter resend_mon_ops 2026-02-17T11:12:59.179 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.162+0000 7f5fb97fa640 1 -- 10.20.193.49:0/2618472744 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb403c040 con 0x7f5fc4074ef0 2026-02-17T11:12:59.180 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.162+0000 7f5fb97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:59.180 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.162+0000 7f5fb97fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:12:59.180 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.162+0000 7f5fb97fa640 10 monclient: dump: 2026-02-17T11:12:59.180 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:59.180 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:59.180 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:59.180 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:59.180 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:59.180 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:59.180 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:59.180 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:59.180 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:59.180 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:59.181 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.162+0000 7f5fb97fa640 10 monclient: _finish_auth 0 2026-02-17T11:12:59.181 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.162+0000 7f5fb97fa640 10 monclient: _check_auth_tickets 2026-02-17T11:12:59.181 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.162+0000 7f5fb97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:12:59.181 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.162+0000 7f5fb97fa640 1 -- 10.20.193.49:0/2618472744 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fb4042430 con 0x7f5fc4074ef0 2026-02-17T11:12:59.181 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.162+0000 7f5fb97fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:12:59.181 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.162+0000 7f5fb97fa640 1 -- 10.20.193.49:0/2618472744 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb4042800 con 0x7f5fc4074ef0 2026-02-17T11:12:59.181 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.162+0000 7f5fb97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:12:59.181 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.162+0000 7f5fb97fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:12:59.181 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.162+0000 7f5fbaffd640 4 set_mon_vals no callback set 2026-02-17T11:12:59.181 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.162+0000 7f5fb97fa640 10 monclient: dump: 2026-02-17T11:12:59.181 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:12:59.181 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:12:59.181 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:59.182 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:12:59.182 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:12:59.182 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:12:59.182 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:12:59.182 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:12:59.182 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:12:59.182 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:12:59.182 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.162+0000 7f5fcafa0640 5 monclient: authenticate success, global_id 4837 2026-02-17T11:12:59.182 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.162+0000 7f5fcafa0640 10 monclient: _renew_subs 2026-02-17T11:12:59.182 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.162+0000 7f5fcafa0640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:12:59.182 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.162+0000 7f5fcafa0640 1 -- 10.20.193.49:0/2618472744 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fc41f4810 con 0x7f5fc4074ef0 2026-02-17T11:12:59.182 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.162+0000 7f5fcafa0640 10 client.4837.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:12:59.182 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.162+0000 7f5fcafa0640 10 monclient: _renew_subs 2026-02-17T11:12:59.182 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.162+0000 7f5fcafa0640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:12:59.182 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.162+0000 7f5fcafa0640 1 -- 10.20.193.49:0/2618472744 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fc40c3150 con 0x7f5fc4074ef0 2026-02-17T11:12:59.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.162+0000 7f5fcafa0640 1 librados: init done 2026-02-17T11:12:59.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.163+0000 7f5fcafa0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:12:59.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.163+0000 7f5fcafa0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:12:59.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.163+0000 7f5fcafa0640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:12:59.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.163+0000 7f5fcafa0640 1 -- 10.20.193.49:0/2618472744 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fc40c7b10 con 0x7f5fc4074ef0 2026-02-17T11:12:59.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.174+0000 7f5fb97fa640 1 -- 10.20.193.49:0/2618472744 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f5fb40429a0 con 0x7f5fc4074ef0 2026-02-17T11:12:59.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.175+0000 7f5fb97fa640 1 --2- 10.20.193.49:0/2618472744 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5f94079190 0x7f5f9407b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:12:59.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.175+0000 7f5fbbfff640 1 --2- 10.20.193.49:0/2618472744 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5f94079190 0x7f5f9407b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:12:59.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.175+0000 7f5fbbfff640 10 monclient: get_auth_request con 0x7f5f94079190 auth_method 0 2026-02-17T11:12:59.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.175+0000 7f5fb97fa640 1 -- 10.20.193.49:0/2618472744 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f5fb4083920 con 0x7f5fc4074ef0 2026-02-17T11:12:59.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.175+0000 7f5fb97fa640 10 client.4837.objecter ms_dispatch2 0x7f5fc4000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:12:59.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.175+0000 7f5fb97fa640 3 client.4837.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:12:59.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.175+0000 7f5fb97fa640 3 client.4837.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:12:59.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.175+0000 7f5fb97fa640 20 client.4837.objecter dump_active .. 0 homeless 2026-02-17T11:12:59.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.176+0000 7f5fb97fa640 10 client.4837.objecter ms_handle_connect 0x7f5f94079190 2026-02-17T11:12:59.184 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.176+0000 7f5fbbfff640 1 --2- 10.20.193.49:0/2618472744 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5f94079190 0x7f5f9407b650 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5fc41f16e0 tx=0x7f5fac009290 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:12:59.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.276+0000 7f5fb97fa640 1 -- 10.20.193.49:0/2618472744 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f5fc40c7b10 con 0x7f5fc4074ef0 2026-02-17T11:12:59.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.276+0000 7f5fb97fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:12:59.278 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.276+0000 7f5fb97fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:12:59.376 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.374+0000 7f5fcafa0640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:12:59.376 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.374+0000 7f5fcafa0640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:12:59.376 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.374+0000 7f5fcafa0640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:12:59.376 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.374+0000 7f5fcafa0640 1 -- 10.20.193.49:0/2618472744 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f5fc40749b0 con 0x7f5fc4074ef0 2026-02-17T11:12:59.378 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.377+0000 7f5fb97fa640 1 -- 10.20.193.49:0/2618472744 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f5fb40878e0 con 0x7f5fc4074ef0 2026-02-17T11:12:59.378 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.377+0000 7f5fb97fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:12:59.378 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.377+0000 7f5fb97fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:12:59.379 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:12:59.379 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:12:59.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.378+0000 7f5fcafa0640 10 librados: watch_flush enter 2026-02-17T11:12:59.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.378+0000 7f5fcafa0640 10 librados: watch_flush exit 2026-02-17T11:12:59.381 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.378+0000 7f5fcafa0640 20 client.4837.objecter shutdown clearing up homeless session... 2026-02-17T11:12:59.381 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.378+0000 7f5fcafa0640 10 client.4837.objecter successfully canceled tick 2026-02-17T11:12:59.381 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.378+0000 7f5fcafa0640 1 -- 10.20.193.49:0/2618472744 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5f94079190 msgr2=0x7f5f9407b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:59.381 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.378+0000 7f5fcafa0640 1 --2- 10.20.193.49:0/2618472744 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5f94079190 0x7f5f9407b650 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5fc41f16e0 tx=0x7f5fac009290 comp rx=0 tx=0).stop 2026-02-17T11:12:59.381 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.378+0000 7f5fcafa0640 10 monclient: shutdown 2026-02-17T11:12:59.381 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.378+0000 7f5fcafa0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:12:59.381 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.378+0000 7f5fcafa0640 1 -- 10.20.193.49:0/2618472744 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5fc4074ef0 msgr2=0x7f5fc41570b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:12:59.381 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.378+0000 7f5fcafa0640 1 --2- 10.20.193.49:0/2618472744 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5fc4074ef0 0x7f5fc41570b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5fb402f3f0 tx=0x7f5fb40047c0 comp rx=0 tx=0).stop 2026-02-17T11:12:59.381 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.378+0000 7f5fcafa0640 1 -- 10.20.193.49:0/2618472744 shutdown_connections 2026-02-17T11:12:59.381 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.378+0000 7f5fcafa0640 1 --2- 10.20.193.49:0/2618472744 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5f94079190 0x7f5f9407b650 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:59.382 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.378+0000 7f5fcafa0640 1 --2- 10.20.193.49:0/2618472744 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5fc40c7170 0x7f5fc40c3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:59.382 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.378+0000 7f5fcafa0640 1 --2- 10.20.193.49:0/2618472744 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5fc40c48c0 0x7f5fc415d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:59.382 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.378+0000 7f5fcafa0640 1 --2- 10.20.193.49:0/2618472744 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5fc4074ef0 0x7f5fc41570b0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:12:59.382 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.378+0000 7f5fcafa0640 1 -- 10.20.193.49:0/2618472744 >> 10.20.193.49:0/2618472744 conn(0x7f5fc40c9f40 msgr2=0x7f5fc40ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:12:59.382 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.378+0000 7f5fcafa0640 1 -- 10.20.193.49:0/2618472744 shutdown_connections 2026-02-17T11:12:59.382 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.378+0000 7f5fcafa0640 1 -- 10.20.193.49:0/2618472744 wait complete. 2026-02-17T11:12:59.382 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:12:59.378+0000 7f5fcafa0640 1 librados: shutdown 2026-02-17T11:13:02.388 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:13:02.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.454+0000 7f6e63e3b640 10 monclient: get_monmap_and_config 2026-02-17T11:13:02.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.454+0000 7f6e63e3b640 10 monclient: build_initial_monmap 2026-02-17T11:13:02.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.454+0000 7f6e63e3b640 10 monclient: monmap: 2026-02-17T11:13:02.456 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:13:02.456 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:02.456 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:13:02.454789+0000 2026-02-17T11:13:02.456 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:13:02.454789+0000 2026-02-17T11:13:02.456 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:13:02.456 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:02.456 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:13:02.456 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:13:02.456 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:13:02.456 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:13:02.456 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:13:02.457 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:13:02.457 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:02.457 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.454+0000 7f6e63e3b640 1 Processor -- start 2026-02-17T11:13:02.457 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.454+0000 7f6e63e3b640 1 -- start start 2026-02-17T11:13:02.457 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.454+0000 7f6e63e3b640 10 monclient: init 2026-02-17T11:13:02.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.455+0000 7f6e63e3b640 10 monclient: _reopen_session rank -1 2026-02-17T11:13:02.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.455+0000 7f6e63e3b640 10 monclient: _add_conns ranks=[4,1,2,3,5,0] 2026-02-17T11:13:02.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.455+0000 7f6e63e3b640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f6e5c0c7170 0x7f6e5c0c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:02.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.455+0000 7f6e63e3b640 10 monclient(hunting): picked mon.noname-b con 0x7f6e5c0c7170 addr v2:10.20.193.97:3300/0 2026-02-17T11:13:02.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.455+0000 7f6e63e3b640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f6e5c0c48c0 addr v1:10.20.193.97:6789/0 2026-02-17T11:13:02.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.455+0000 7f6e63e3b640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f6e5c0c4d10 addr v1:10.20.193.157:6789/0 2026-02-17T11:13:02.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.455+0000 7f6e63e3b640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e5c15a9a0 con 0x7f6e5c0c48c0 2026-02-17T11:13:02.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.455+0000 7f6e63e3b640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e5c0c5270 con 0x7f6e5c0c4d10 2026-02-17T11:13:02.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.455+0000 7f6e63e3b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:02.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.455+0000 7f6e63e3b640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f6e5c0c8530 con 0x7f6e5c0c7170 2026-02-17T11:13:02.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.455+0000 7f6e63e3b640 10 monclient(hunting): _renew_subs 2026-02-17T11:13:02.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.455+0000 7f6e63e3b640 10 monclient(hunting): authenticate will time out at 1259.118237s 2026-02-17T11:13:02.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.455+0000 7f6e61bb0640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f6e5c0c7170 0x7f6e5c0c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:02.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.455+0000 7f6e623b1640 1 --1- >> v1:10.20.193.157:6789/0 conn(0x7f6e5c0c4d10 0x7f6e5c0c89c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.157:6789/0 says I am v1:10.20.193.49:55468/0 (socket says 10.20.193.49:55468) 2026-02-17T11:13:02.459 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.455+0000 7f6e623b1640 1 -- 10.20.193.49:0/2887315594 learned_addr learned my addr 10.20.193.49:0/2887315594 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:13:02.459 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.456+0000 7f6e61bb0640 10 monclient(hunting): get_auth_request con 0x7f6e5c0c7170 auth_method 0 2026-02-17T11:13:02.459 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.456+0000 7f6e61bb0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:02.459 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.456+0000 7f6e61bb0640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:02.459 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.456+0000 7f6e61bb0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:02.459 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.456+0000 7f6e61bb0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:02.459 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.456+0000 7f6e61bb0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:02.459 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.456+0000 7f6e61bb0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:02.460 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.457+0000 7f6e60bae640 1 -- 10.20.193.49:0/2887315594 <== mon.2 v1:10.20.193.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3894989112 0 0) 0x7f6e5c0c5270 con 0x7f6e5c0c4d10 2026-02-17T11:13:02.460 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.457+0000 7f6e60bae640 10 monclient(hunting): _negotiate 2026-02-17T11:13:02.460 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.457+0000 7f6e60bae640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:02.460 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.457+0000 7f6e60bae640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:02.460 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.457+0000 7f6e60bae640 10 monclient(hunting): my global_id is 4877 2026-02-17T11:13:02.460 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.457+0000 7f6e60bae640 1 -- 10.20.193.49:0/2887315594 --> v1:10.20.193.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e44003620 con 0x7f6e5c0c4d10 2026-02-17T11:13:02.460 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.457+0000 7f6e61bb0640 10 monclient(hunting): handle_auth_done global_id 4840 payload 274 2026-02-17T11:13:02.460 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.457+0000 7f6e61bb0640 1 -- 10.20.193.49:0/2887315594 >> v1:10.20.193.157:6789/0 conn(0x7f6e5c0c4d10 legacy=0x7f6e5c0c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:02.460 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.457+0000 7f6e61bb0640 1 -- 10.20.193.49:0/2887315594 >> v1:10.20.193.97:6789/0 conn(0x7f6e5c0c48c0 legacy=0x7f6e5c0749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:02.460 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.457+0000 7f6e61bb0640 10 monclient: _finish_hunting 0 2026-02-17T11:13:02.460 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.457+0000 7f6e61bb0640 1 monclient: found mon.noname-b 2026-02-17T11:13:02.461 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.457+0000 7f6e61bb0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:13:02.461 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.457+0000 7f6e61bb0640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:13:02.461 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.457+0000 7f6e61bb0640 1 -- 10.20.193.49:0/2887315594 --> v2:10.20.193.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e5c0c5550 con 0x7f6e5c0c7170 2026-02-17T11:13:02.462 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.459+0000 7f6e61bb0640 1 --2- 10.20.193.49:0/2887315594 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f6e5c0c7170 0x7f6e5c0c7550 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c0098a0 tx=0x7f6e4c02ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0193190cba94f55 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:13:02.467 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.461+0000 7f6e60bae640 1 -- 10.20.193.49:0/2887315594 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e4c03c070 con 0x7f6e5c0c7170 2026-02-17T11:13:02.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.461+0000 7f6e60bae640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:02.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.461+0000 7f6e60bae640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:13:02.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.461+0000 7f6e60bae640 10 monclient: dump: 2026-02-17T11:13:02.468 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:02.468 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:02.468 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:02.468 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:02.468 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:02.468 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:02.469 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:02.469 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:02.469 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:02.469 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:02.469 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.461+0000 7f6e60bae640 10 monclient: _finish_auth 0 2026-02-17T11:13:02.469 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.461+0000 7f6e60bae640 10 monclient: _check_auth_tickets 2026-02-17T11:13:02.469 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.461+0000 7f6e60bae640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:13:02.469 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.461+0000 7f6e60bae640 1 -- 10.20.193.49:0/2887315594 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e4c02fb70 con 0x7f6e5c0c7170 2026-02-17T11:13:02.469 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.461+0000 7f6e63e3b640 5 monclient: authenticate success, global_id 4840 2026-02-17T11:13:02.469 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.461+0000 7f6e63e3b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:13:02.469 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.461+0000 7f6e60bae640 10 monclient: handle_config config(0 keys) 2026-02-17T11:13:02.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.461+0000 7f6e63e3b640 10 monclient: get_monmap_and_config success 2026-02-17T11:13:02.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.461+0000 7f6e60bae640 1 -- 10.20.193.49:0/2887315594 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e4c037440 con 0x7f6e5c0c7170 2026-02-17T11:13:02.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.461+0000 7f6e63e3b640 4 set_mon_vals no callback set 2026-02-17T11:13:02.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.461+0000 7f6e60bae640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:02.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.461+0000 7f6e60bae640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:13:02.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.461+0000 7f6e60bae640 10 monclient: dump: 2026-02-17T11:13:02.470 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:02.470 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:02.470 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:02.470 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:02.470 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:02.470 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:02.471 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:02.471 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:02.471 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:02.471 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:02.471 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.461+0000 7f6e63e3b640 10 monclient: shutdown 2026-02-17T11:13:02.471 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.461+0000 7f6e63e3b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:13:02.471 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.461+0000 7f6e63e3b640 1 -- 10.20.193.49:0/2887315594 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f6e5c0c7170 msgr2=0x7f6e5c0c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:02.471 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.461+0000 7f6e63e3b640 1 --2- 10.20.193.49:0/2887315594 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f6e5c0c7170 0x7f6e5c0c7550 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c0098a0 tx=0x7f6e4c02ee60 comp rx=0 tx=0).stop 2026-02-17T11:13:02.471 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.461+0000 7f6e63e3b640 1 -- 10.20.193.49:0/2887315594 shutdown_connections 2026-02-17T11:13:02.471 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.461+0000 7f6e63e3b640 1 --2- 10.20.193.49:0/2887315594 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f6e5c0c7170 0x7f6e5c0c7550 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:02.471 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.461+0000 7f6e63e3b640 1 -- 10.20.193.49:0/2887315594 >> 10.20.193.49:0/2887315594 conn(0x7f6e5c0c9f40 msgr2=0x7f6e5c0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:13:02.471 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.461+0000 7f6e63e3b640 1 -- 10.20.193.49:0/2887315594 shutdown_connections 2026-02-17T11:13:02.472 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.461+0000 7f6e63e3b640 1 -- 10.20.193.49:0/2887315594 wait complete. 2026-02-17T11:13:02.472 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.462+0000 7f6e63e3b640 10 monclient: build_initial_monmap 2026-02-17T11:13:02.472 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.462+0000 7f6e63e3b640 10 monclient: monmap: 2026-02-17T11:13:02.472 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:13:02.472 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:13:02.472 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:13:02.472 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:13:02.472 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:13:02.472 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:02.472 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:13:02.472 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:13:02.472 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:13:02.473 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:02.473 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.462+0000 7f6e63e3b640 1 librados: starting msgr at 2026-02-17T11:13:02.473 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.462+0000 7f6e63e3b640 1 librados: starting objecter 2026-02-17T11:13:02.473 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.462+0000 7f6e63e3b640 1 Processor -- start 2026-02-17T11:13:02.473 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.462+0000 7f6e63e3b640 1 -- start start 2026-02-17T11:13:02.473 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.462+0000 7f6e63e3b640 1 librados: setting wanted keys 2026-02-17T11:13:02.473 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.462+0000 7f6e63e3b640 1 librados: calling monclient init 2026-02-17T11:13:02.473 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.462+0000 7f6e63e3b640 10 monclient: init 2026-02-17T11:13:02.473 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.462+0000 7f6e63e3b640 10 monclient: _reopen_session rank -1 2026-02-17T11:13:02.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.462+0000 7f6e63e3b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:13:02.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.462+0000 7f6e63e3b640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f6e5c0c48c0 0x7f6e5c0c0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:02.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.462+0000 7f6e63e3b640 10 monclient(hunting): picked mon.noname-a con 0x7f6e5c0c48c0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:13:02.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.462+0000 7f6e63e3b640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f6e5c0c4d10 0x7f6e5c155410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:02.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.462+0000 7f6e63e3b640 10 monclient(hunting): picked mon.noname-c con 0x7f6e5c0c4d10 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:13:02.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.462+0000 7f6e63e3b640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f6e5c0c7170 0x7f6e5c1488c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:02.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.462+0000 7f6e63e3b640 10 monclient(hunting): picked mon.noname-b con 0x7f6e5c0c7170 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:13:02.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.462+0000 7f6e63e3b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:02.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.462+0000 7f6e63e3b640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6e5c0c81c0 con 0x7f6e5c0c48c0 2026-02-17T11:13:02.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.462+0000 7f6e63e3b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:02.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.462+0000 7f6e63e3b640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6e5c0c7ee0 con 0x7f6e5c0c7170 2026-02-17T11:13:02.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.462+0000 7f6e63e3b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:02.475 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.462+0000 7f6e63e3b640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f6e5c0750c0 con 0x7f6e5c0c4d10 2026-02-17T11:13:02.475 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.462+0000 7f6e63e3b640 10 monclient(hunting): _renew_subs 2026-02-17T11:13:02.475 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.462+0000 7f6e63e3b640 10 monclient(hunting): authenticate will time out at 1259.125729s 2026-02-17T11:13:02.475 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.463+0000 7f6e623b1640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f6e5c0c7170 0x7f6e5c1488c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:02.475 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.463+0000 7f6e613af640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f6e5c0c4d10 0x7f6e5c155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:02.475 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.463+0000 7f6e623b1640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f6e5c0c7170 0x7f6e5c1488c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:51218/0 (socket says 10.20.193.49:51218) 2026-02-17T11:13:02.475 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.463+0000 7f6e623b1640 1 -- 10.20.193.49:0/2516642751 learned_addr learned my addr 10.20.193.49:0/2516642751 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:13:02.475 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.463+0000 7f6e623b1640 10 monclient(hunting): get_auth_request con 0x7f6e5c0c7170 auth_method 0 2026-02-17T11:13:02.475 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.463+0000 7f6e623b1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:02.475 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.463+0000 7f6e623b1640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:02.475 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.463+0000 7f6e623b1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:02.475 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.463+0000 7f6e61bb0640 1 --2- 10.20.193.49:0/2516642751 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f6e5c0c48c0 0x7f6e5c0c0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:02.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.463+0000 7f6e613af640 10 monclient(hunting): get_auth_request con 0x7f6e5c0c4d10 auth_method 0 2026-02-17T11:13:02.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.463+0000 7f6e613af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:02.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.463+0000 7f6e613af640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:02.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.463+0000 7f6e613af640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:02.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.463+0000 7f6e623b1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:02.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.463+0000 7f6e623b1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:02.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.463+0000 7f6e623b1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:02.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.463+0000 7f6e61bb0640 10 monclient(hunting): get_auth_request con 0x7f6e5c0c48c0 auth_method 0 2026-02-17T11:13:02.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.463+0000 7f6e61bb0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:02.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.463+0000 7f6e61bb0640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:02.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.463+0000 7f6e61bb0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:02.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.463+0000 7f6e613af640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:02.477 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.463+0000 7f6e613af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:02.477 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.463+0000 7f6e613af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:02.477 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.463+0000 7f6e61bb0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:02.477 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.463+0000 7f6e61bb0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:02.477 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.463+0000 7f6e61bb0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:02.477 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.464+0000 7f6e623b1640 10 monclient(hunting): handle_auth_done global_id 4846 payload 824 2026-02-17T11:13:02.477 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.464+0000 7f6e623b1640 1 -- 10.20.193.49:0/2516642751 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f6e5c0c4d10 msgr2=0x7f6e5c155410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:02.477 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.464+0000 7f6e623b1640 1 --2- 10.20.193.49:0/2516642751 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f6e5c0c4d10 0x7f6e5c155410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:02.477 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.464+0000 7f6e623b1640 1 -- 10.20.193.49:0/2516642751 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f6e5c0c48c0 msgr2=0x7f6e5c0c0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:02.477 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.464+0000 7f6e623b1640 1 --2- 10.20.193.49:0/2516642751 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f6e5c0c48c0 0x7f6e5c0c0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:02.477 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.464+0000 7f6e623b1640 10 monclient: _finish_hunting 0 2026-02-17T11:13:02.477 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.464+0000 7f6e623b1640 1 monclient: found mon.noname-b 2026-02-17T11:13:02.478 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.464+0000 7f6e623b1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:13:02.478 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.464+0000 7f6e623b1640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:13:02.478 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.464+0000 7f6e623b1640 1 -- 10.20.193.49:0/2516642751 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e5c0c2f10 con 0x7f6e5c0c7170 2026-02-17T11:13:02.478 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.465+0000 7f6e623b1640 1 --2- 10.20.193.49:0/2516642751 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f6e5c0c7170 0x7f6e5c1488c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6e5800ca70 tx=0x7f6e5800cf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:13:02.478 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.465+0000 7f6e4a7fc640 10 client.?.objecter ms_handle_connect 0x7f6e5c0c7170 2026-02-17T11:13:02.478 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.465+0000 7f6e4a7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T11:13:02.480 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.467+0000 7f6e4a7fc640 1 -- 10.20.193.49:0/2516642751 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e5800ac40 con 0x7f6e5c0c7170 2026-02-17T11:13:02.480 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.467+0000 7f6e4a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:02.480 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.467+0000 7f6e4a7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:13:02.480 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.467+0000 7f6e4a7fc640 10 monclient: dump: 2026-02-17T11:13:02.480 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:02.480 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:02.480 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:02.480 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:02.480 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:02.481 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:02.481 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:02.481 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:02.481 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:02.481 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:02.481 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.467+0000 7f6e4a7fc640 10 monclient: _finish_auth 0 2026-02-17T11:13:02.481 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.467+0000 7f6e4a7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:13:02.481 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.467+0000 7f6e4a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:13:02.481 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.467+0000 7f6e63e3b640 5 monclient: authenticate success, global_id 4846 2026-02-17T11:13:02.481 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.467+0000 7f6e63e3b640 10 monclient: _renew_subs 2026-02-17T11:13:02.481 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.467+0000 7f6e63e3b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:13:02.481 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.467+0000 7f6e63e3b640 1 -- 10.20.193.49:0/2516642751 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e5c0c31f0 con 0x7f6e5c0c7170 2026-02-17T11:13:02.482 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.467+0000 7f6e63e3b640 10 client.4846.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:13:02.482 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.467+0000 7f6e63e3b640 10 monclient: _renew_subs 2026-02-17T11:13:02.482 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.467+0000 7f6e63e3b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:13:02.482 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.467+0000 7f6e63e3b640 1 -- 10.20.193.49:0/2516642751 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e5c0c37b0 con 0x7f6e5c0c7170 2026-02-17T11:13:02.482 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.467+0000 7f6e63e3b640 1 librados: init done 2026-02-17T11:13:02.482 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.467+0000 7f6e4a7fc640 1 -- 10.20.193.49:0/2516642751 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e5800ade0 con 0x7f6e5c0c7170 2026-02-17T11:13:02.482 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.467+0000 7f6e4a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:13:02.482 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.467+0000 7f6e4a7fc640 1 -- 10.20.193.49:0/2516642751 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e5801b600 con 0x7f6e5c0c7170 2026-02-17T11:13:02.482 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.467+0000 7f6e4a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:02.482 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.467+0000 7f6e4a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:13:02.482 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.467+0000 7f6e4a7fc640 10 monclient: dump: 2026-02-17T11:13:02.482 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:02.483 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:02.483 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:02.483 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:02.483 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:02.483 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:02.483 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:02.483 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:02.483 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:02.483 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:02.483 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.467+0000 7f6e4bfff640 4 set_mon_vals no callback set 2026-02-17T11:13:02.483 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.467+0000 7f6e63e3b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:13:02.483 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.467+0000 7f6e63e3b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:13:02.484 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.467+0000 7f6e63e3b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:13:02.484 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.467+0000 7f6e63e3b640 1 -- 10.20.193.49:0/2516642751 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e5c0c7550 con 0x7f6e5c0c7170 2026-02-17T11:13:02.575 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.574+0000 7f6e4a7fc640 1 -- 10.20.193.49:0/2516642751 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f6e5801b7a0 con 0x7f6e5c0c7170 2026-02-17T11:13:02.576 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.575+0000 7f6e4a7fc640 1 --2- 10.20.193.49:0/2516642751 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f6e2c079170 0x7f6e2c07b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:02.576 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.575+0000 7f6e61bb0640 1 --2- 10.20.193.49:0/2516642751 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f6e2c079170 0x7f6e2c07b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:02.576 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.575+0000 7f6e61bb0640 10 monclient: get_auth_request con 0x7f6e2c079170 auth_method 0 2026-02-17T11:13:02.577 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.575+0000 7f6e4a7fc640 10 client.4846.objecter ms_handle_connect 0x7f6e2c079170 2026-02-17T11:13:02.577 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.575+0000 7f6e61bb0640 1 --2- 10.20.193.49:0/2516642751 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f6e2c079170 0x7f6e2c07b630 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c039000 tx=0x7f6e4c033000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:13:02.578 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.576+0000 7f6e4a7fc640 1 -- 10.20.193.49:0/2516642751 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f6e580984b0 con 0x7f6e5c0c7170 2026-02-17T11:13:02.578 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.576+0000 7f6e4a7fc640 10 client.4846.objecter ms_dispatch2 0x7f6e5c000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:13:02.578 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.576+0000 7f6e4a7fc640 3 client.4846.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:13:02.578 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.576+0000 7f6e4a7fc640 3 client.4846.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:13:02.578 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.576+0000 7f6e4a7fc640 20 client.4846.objecter dump_active .. 0 homeless 2026-02-17T11:13:02.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.583+0000 7f6e4a7fc640 1 -- 10.20.193.49:0/2516642751 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f6e580629d0 con 0x7f6e5c0c7170 2026-02-17T11:13:02.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.583+0000 7f6e4a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:13:02.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.583+0000 7f6e4a7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:13:02.683 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.682+0000 7f6e63e3b640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:13:02.684 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.682+0000 7f6e63e3b640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:13:02.684 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.682+0000 7f6e63e3b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:13:02.684 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.682+0000 7f6e63e3b640 1 -- 10.20.193.49:0/2516642751 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f6e5c14ecf0 con 0x7f6e5c0c7170 2026-02-17T11:13:02.686 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.684+0000 7f6e4a7fc640 1 -- 10.20.193.49:0/2516642751 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f6e58066cd0 con 0x7f6e5c0c7170 2026-02-17T11:13:02.686 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.684+0000 7f6e4a7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:13:02.686 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.684+0000 7f6e4a7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:13:02.686 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:13:02.686 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:13:02.688 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.685+0000 7f6e63e3b640 10 librados: watch_flush enter 2026-02-17T11:13:02.688 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.685+0000 7f6e63e3b640 10 librados: watch_flush exit 2026-02-17T11:13:02.688 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.685+0000 7f6e63e3b640 20 client.4846.objecter shutdown clearing up homeless session... 2026-02-17T11:13:02.688 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.685+0000 7f6e63e3b640 10 client.4846.objecter successfully canceled tick 2026-02-17T11:13:02.688 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.685+0000 7f6e63e3b640 1 -- 10.20.193.49:0/2516642751 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f6e2c079170 msgr2=0x7f6e2c07b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:02.688 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.685+0000 7f6e63e3b640 1 --2- 10.20.193.49:0/2516642751 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f6e2c079170 0x7f6e2c07b630 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c039000 tx=0x7f6e4c033000 comp rx=0 tx=0).stop 2026-02-17T11:13:02.689 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.685+0000 7f6e63e3b640 10 monclient: shutdown 2026-02-17T11:13:02.689 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.685+0000 7f6e63e3b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:13:02.689 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.685+0000 7f6e63e3b640 1 -- 10.20.193.49:0/2516642751 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f6e5c0c7170 msgr2=0x7f6e5c1488c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:02.689 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.685+0000 7f6e63e3b640 1 --2- 10.20.193.49:0/2516642751 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f6e5c0c7170 0x7f6e5c1488c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6e5800ca70 tx=0x7f6e5800cf40 comp rx=0 tx=0).stop 2026-02-17T11:13:02.689 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.685+0000 7f6e63e3b640 1 -- 10.20.193.49:0/2516642751 shutdown_connections 2026-02-17T11:13:02.689 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.685+0000 7f6e63e3b640 1 --2- 10.20.193.49:0/2516642751 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f6e2c079170 0x7f6e2c07b630 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:02.689 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.685+0000 7f6e63e3b640 1 --2- 10.20.193.49:0/2516642751 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f6e5c0c7170 0x7f6e5c1488c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:02.689 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.685+0000 7f6e63e3b640 1 --2- 10.20.193.49:0/2516642751 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f6e5c0c4d10 0x7f6e5c155410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:02.689 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.685+0000 7f6e63e3b640 1 --2- 10.20.193.49:0/2516642751 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f6e5c0c48c0 0x7f6e5c0c0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:02.689 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.685+0000 7f6e63e3b640 1 -- 10.20.193.49:0/2516642751 >> 10.20.193.49:0/2516642751 conn(0x7f6e5c0c9f40 msgr2=0x7f6e5c0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:13:02.689 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.685+0000 7f6e63e3b640 1 -- 10.20.193.49:0/2516642751 shutdown_connections 2026-02-17T11:13:02.689 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.685+0000 7f6e63e3b640 1 -- 10.20.193.49:0/2516642751 wait complete. 2026-02-17T11:13:02.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:02.685+0000 7f6e63e3b640 1 librados: shutdown 2026-02-17T11:13:05.696 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:13:05.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.765+0000 7f5a80691640 10 monclient: get_monmap_and_config 2026-02-17T11:13:05.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.765+0000 7f5a80691640 10 monclient: build_initial_monmap 2026-02-17T11:13:05.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.765+0000 7f5a80691640 10 monclient: monmap: 2026-02-17T11:13:05.767 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:13:05.767 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:05.767 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:13:05.766042+0000 2026-02-17T11:13:05.767 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:13:05.766042+0000 2026-02-17T11:13:05.767 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:13:05.767 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:05.768 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:13:05.768 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:13:05.768 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:13:05.768 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:13:05.768 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:13:05.768 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:13:05.768 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:05.771 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.766+0000 7f5a80691640 1 Processor -- start 2026-02-17T11:13:05.771 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.766+0000 7f5a80691640 1 -- start start 2026-02-17T11:13:05.771 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.766+0000 7f5a80691640 10 monclient: init 2026-02-17T11:13:05.771 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.766+0000 7f5a80691640 10 monclient: _reopen_session rank -1 2026-02-17T11:13:05.771 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.766+0000 7f5a80691640 10 monclient: _add_conns ranks=[5,0,2,4,3,1] 2026-02-17T11:13:05.771 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.766+0000 7f5a80691640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f5a78155fb0 0x7f5a780cd610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:05.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.766+0000 7f5a80691640 10 monclient(hunting): picked mon.noname-c con 0x7f5a78155fb0 addr v2:10.20.193.157:3300/0 2026-02-17T11:13:05.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.766+0000 7f5a80691640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f5a780cdb50 addr v1:10.20.193.49:6789/0 2026-02-17T11:13:05.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.766+0000 7f5a80691640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f5a780ceaa0 addr v1:10.20.193.157:6789/0 2026-02-17T11:13:05.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.766+0000 7f5a80691640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a780cb950 con 0x7f5a780cdb50 2026-02-17T11:13:05.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.766+0000 7f5a80691640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a780cbc30 con 0x7f5a780ceaa0 2026-02-17T11:13:05.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.766+0000 7f5a80691640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:05.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.766+0000 7f5a80691640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f5a780ccd60 con 0x7f5a78155fb0 2026-02-17T11:13:05.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.766+0000 7f5a80691640 10 monclient(hunting): _renew_subs 2026-02-17T11:13:05.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.766+0000 7f5a80691640 10 monclient(hunting): authenticate will time out at 1262.429640s 2026-02-17T11:13:05.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.767+0000 7f5a7dc05640 1 --1- >> v1:10.20.193.49:6789/0 conn(0x7f5a780cdb50 0x7f5a780ce390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.49:6789/0 says I am v1:10.20.193.49:52844/0 (socket says 10.20.193.49:52844) 2026-02-17T11:13:05.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.767+0000 7f5a7dc05640 1 -- 10.20.193.49:0/2814571389 learned_addr learned my addr 10.20.193.49:0/2814571389 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:13:05.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.767+0000 7f5a7e406640 1 --2- 10.20.193.49:0/2814571389 >> v2:10.20.193.157:3300/0 conn(0x7f5a78155fb0 0x7f5a780cd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:05.773 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.767+0000 7f5a7e406640 10 monclient(hunting): get_auth_request con 0x7f5a78155fb0 auth_method 0 2026-02-17T11:13:05.773 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.767+0000 7f5a7e406640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:05.773 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.767+0000 7f5a7e406640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:05.773 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.767+0000 7f5a7e406640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:05.773 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.768+0000 7f5a7e406640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:05.773 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.768+0000 7f5a7e406640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:05.773 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.768+0000 7f5a7e406640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:05.773 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.768+0000 7f5a7d404640 1 -- 10.20.193.49:0/2814571389 <== mon.0 v1:10.20.193.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 478171761 0 0) 0x7f5a780cb950 con 0x7f5a780cdb50 2026-02-17T11:13:05.773 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.768+0000 7f5a7d404640 10 monclient(hunting): _negotiate 2026-02-17T11:13:05.773 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.768+0000 7f5a7d404640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:05.773 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.768+0000 7f5a7d404640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:05.774 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.768+0000 7f5a7d404640 10 monclient(hunting): my global_id is 4890 2026-02-17T11:13:05.774 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.768+0000 7f5a7d404640 1 -- 10.20.193.49:0/2814571389 --> v1:10.20.193.49:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a60003620 con 0x7f5a780cdb50 2026-02-17T11:13:05.774 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.769+0000 7f5a7e406640 10 monclient(hunting): handle_auth_done global_id 4883 payload 274 2026-02-17T11:13:05.774 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.769+0000 7f5a7e406640 1 -- 10.20.193.49:0/2814571389 >> v1:10.20.193.157:6789/0 conn(0x7f5a780ceaa0 legacy=0x7f5a7815f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:05.774 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.769+0000 7f5a7e406640 1 -- 10.20.193.49:0/2814571389 >> v1:10.20.193.49:6789/0 conn(0x7f5a780cdb50 legacy=0x7f5a780ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:05.774 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.769+0000 7f5a7e406640 10 monclient: _finish_hunting 0 2026-02-17T11:13:05.774 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.769+0000 7f5a7e406640 1 monclient: found mon.noname-c 2026-02-17T11:13:05.774 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.769+0000 7f5a7e406640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:13:05.774 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.769+0000 7f5a7e406640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:13:05.774 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.769+0000 7f5a7e406640 1 -- 10.20.193.49:0/2814571389 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a780cd040 con 0x7f5a78155fb0 2026-02-17T11:13:05.779 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.772+0000 7f5a7e406640 1 --2- 10.20.193.49:0/2814571389 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5a78155fb0 0x7f5a780cd610 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5a680098a0 tx=0x7f5a6802ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8fd17381c0aa90f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:13:05.779 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.773+0000 7f5a7d404640 1 -- 10.20.193.49:0/2814571389 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6803c070 con 0x7f5a78155fb0 2026-02-17T11:13:05.779 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.773+0000 7f5a7d404640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:05.779 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.773+0000 7f5a7d404640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:13:05.779 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.773+0000 7f5a7d404640 10 monclient: dump: 2026-02-17T11:13:05.780 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:05.780 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:05.780 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:05.780 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:05.780 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:05.780 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:05.780 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:05.780 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:05.780 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:05.780 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:05.780 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.773+0000 7f5a7d404640 10 monclient: _finish_auth 0 2026-02-17T11:13:05.780 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.773+0000 7f5a7d404640 10 monclient: _check_auth_tickets 2026-02-17T11:13:05.780 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.773+0000 7f5a7d404640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:13:05.781 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.773+0000 7f5a7d404640 1 -- 10.20.193.49:0/2814571389 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a6802fb70 con 0x7f5a78155fb0 2026-02-17T11:13:05.781 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.773+0000 7f5a80691640 5 monclient: authenticate success, global_id 4883 2026-02-17T11:13:05.781 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.773+0000 7f5a80691640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:13:05.781 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.773+0000 7f5a7d404640 10 monclient: handle_config config(0 keys) 2026-02-17T11:13:05.781 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.773+0000 7f5a7d404640 1 -- 10.20.193.49:0/2814571389 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a68037440 con 0x7f5a78155fb0 2026-02-17T11:13:05.781 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.773+0000 7f5a7d404640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:05.781 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.773+0000 7f5a7d404640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:13:05.781 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.773+0000 7f5a7d404640 10 monclient: dump: 2026-02-17T11:13:05.781 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:05.781 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:05.781 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:05.781 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:05.781 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:05.781 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:05.782 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:05.782 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:05.782 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:05.782 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:05.782 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.773+0000 7f5a80691640 10 monclient: get_monmap_and_config success 2026-02-17T11:13:05.782 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.773+0000 7f5a80691640 4 set_mon_vals no callback set 2026-02-17T11:13:05.782 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.774+0000 7f5a80691640 10 monclient: shutdown 2026-02-17T11:13:05.782 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.774+0000 7f5a80691640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:13:05.782 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.774+0000 7f5a80691640 1 -- 10.20.193.49:0/2814571389 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5a78155fb0 msgr2=0x7f5a780cd610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:05.782 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.774+0000 7f5a80691640 1 --2- 10.20.193.49:0/2814571389 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5a78155fb0 0x7f5a780cd610 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5a680098a0 tx=0x7f5a6802ee60 comp rx=0 tx=0).stop 2026-02-17T11:13:05.782 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.774+0000 7f5a80691640 1 -- 10.20.193.49:0/2814571389 shutdown_connections 2026-02-17T11:13:05.782 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.774+0000 7f5a80691640 1 --2- 10.20.193.49:0/2814571389 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5a78155fb0 0x7f5a780cd610 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:05.782 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.774+0000 7f5a80691640 1 -- 10.20.193.49:0/2814571389 >> 10.20.193.49:0/2814571389 conn(0x7f5a7806da90 msgr2=0x7f5a7806dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:13:05.783 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.774+0000 7f5a80691640 1 -- 10.20.193.49:0/2814571389 shutdown_connections 2026-02-17T11:13:05.783 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.774+0000 7f5a80691640 1 -- 10.20.193.49:0/2814571389 wait complete. 2026-02-17T11:13:05.783 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.774+0000 7f5a80691640 10 monclient: build_initial_monmap 2026-02-17T11:13:05.783 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.774+0000 7f5a80691640 10 monclient: monmap: 2026-02-17T11:13:05.783 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:13:05.783 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:13:05.783 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:13:05.783 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:13:05.783 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:13:05.783 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:05.783 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:13:05.783 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:13:05.783 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:13:05.784 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:05.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.774+0000 7f5a80691640 1 librados: starting msgr at 2026-02-17T11:13:05.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.774+0000 7f5a80691640 1 librados: starting objecter 2026-02-17T11:13:05.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.774+0000 7f5a80691640 1 Processor -- start 2026-02-17T11:13:05.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.774+0000 7f5a80691640 1 -- start start 2026-02-17T11:13:05.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.774+0000 7f5a80691640 1 librados: setting wanted keys 2026-02-17T11:13:05.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.774+0000 7f5a80691640 1 librados: calling monclient init 2026-02-17T11:13:05.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.774+0000 7f5a80691640 10 monclient: init 2026-02-17T11:13:05.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.775+0000 7f5a80691640 10 monclient: _reopen_session rank -1 2026-02-17T11:13:05.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.775+0000 7f5a80691640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:13:05.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.775+0000 7f5a80691640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5a780cdb50 0x7f5a781f4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:05.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.775+0000 7f5a80691640 10 monclient(hunting): picked mon.noname-b con 0x7f5a780cdb50 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:13:05.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.775+0000 7f5a80691640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5a780ceaa0 0x7f5a7814c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:05.784 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.775+0000 7f5a80691640 10 monclient(hunting): picked mon.noname-c con 0x7f5a780ceaa0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:13:05.785 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.775+0000 7f5a80691640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5a78155fb0 0x7f5a781458d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:05.785 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.775+0000 7f5a80691640 10 monclient(hunting): picked mon.noname-a con 0x7f5a78155fb0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:13:05.785 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.775+0000 7f5a80691640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:05.785 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.775+0000 7f5a80691640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5a781603d0 con 0x7f5a78155fb0 2026-02-17T11:13:05.785 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.775+0000 7f5a80691640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:05.785 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.775+0000 7f5a80691640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f5a78156390 con 0x7f5a780cdb50 2026-02-17T11:13:05.785 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.775+0000 7f5a80691640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:05.785 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.775+0000 7f5a80691640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7808f9d0 con 0x7f5a780ceaa0 2026-02-17T11:13:05.785 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.775+0000 7f5a80691640 10 monclient(hunting): _renew_subs 2026-02-17T11:13:05.785 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.775+0000 7f5a80691640 10 monclient(hunting): authenticate will time out at 1262.438291s 2026-02-17T11:13:05.785 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.775+0000 7f5a7ec07640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5a78155fb0 0x7f5a781458d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:05.785 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.775+0000 7f5a7dc05640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5a780ceaa0 0x7f5a7814c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:05.785 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.775+0000 7f5a7e406640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5a780cdb50 0x7f5a781f4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:05.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.775+0000 7f5a7ec07640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5a78155fb0 0x7f5a781458d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:45624/0 (socket says 10.20.193.49:45624) 2026-02-17T11:13:05.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.775+0000 7f5a7ec07640 1 -- 10.20.193.49:0/4207889483 learned_addr learned my addr 10.20.193.49:0/4207889483 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:13:05.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.775+0000 7f5a7ec07640 10 monclient(hunting): get_auth_request con 0x7f5a78155fb0 auth_method 0 2026-02-17T11:13:05.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.775+0000 7f5a7ec07640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:05.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.775+0000 7f5a7ec07640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:05.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.775+0000 7f5a7ec07640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:05.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.775+0000 7f5a7dc05640 10 monclient(hunting): get_auth_request con 0x7f5a780ceaa0 auth_method 0 2026-02-17T11:13:05.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.775+0000 7f5a7dc05640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:05.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.775+0000 7f5a7dc05640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:05.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.775+0000 7f5a7dc05640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:05.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.775+0000 7f5a7e406640 10 monclient(hunting): get_auth_request con 0x7f5a780cdb50 auth_method 0 2026-02-17T11:13:05.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.775+0000 7f5a7e406640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:05.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.775+0000 7f5a7e406640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:05.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.775+0000 7f5a7e406640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:05.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.776+0000 7f5a7dc05640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:05.787 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.776+0000 7f5a7dc05640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:05.787 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.776+0000 7f5a7dc05640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:05.787 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.776+0000 7f5a7ec07640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:05.787 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.776+0000 7f5a7ec07640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:05.787 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.776+0000 7f5a7ec07640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:05.787 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.776+0000 7f5a7e406640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:05.787 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.776+0000 7f5a7e406640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:05.787 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.776+0000 7f5a7e406640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:05.787 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.777+0000 7f5a7dc05640 10 monclient(hunting): handle_auth_done global_id 4889 payload 824 2026-02-17T11:13:05.787 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.777+0000 7f5a7dc05640 1 -- 10.20.193.49:0/4207889483 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5a780cdb50 msgr2=0x7f5a781f4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:05.787 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.777+0000 7f5a7dc05640 1 --2- 10.20.193.49:0/4207889483 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5a780cdb50 0x7f5a781f4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:05.787 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.777+0000 7f5a7dc05640 1 -- 10.20.193.49:0/4207889483 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5a78155fb0 msgr2=0x7f5a781458d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:05.787 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.777+0000 7f5a7dc05640 1 --2- 10.20.193.49:0/4207889483 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5a78155fb0 0x7f5a781458d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:05.787 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.777+0000 7f5a7dc05640 10 monclient: _finish_hunting 0 2026-02-17T11:13:05.787 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.777+0000 7f5a7dc05640 1 monclient: found mon.noname-c 2026-02-17T11:13:05.787 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.777+0000 7f5a7dc05640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:13:05.788 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.777+0000 7f5a7dc05640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:13:05.788 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.777+0000 7f5a7dc05640 1 -- 10.20.193.49:0/4207889483 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a7814ad50 con 0x7f5a780ceaa0 2026-02-17T11:13:05.788 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.777+0000 7f5a7ec07640 1 --2- 10.20.193.49:0/4207889483 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5a78155fb0 0x7f5a781458d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:13:05.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.778+0000 7f5a7dc05640 1 --2- 10.20.193.49:0/4207889483 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5a780ceaa0 0x7f5a7814c0d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c0036c0 tx=0x7f5a6c00c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:13:05.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.778+0000 7f5a5effd640 10 client.?.objecter ms_handle_connect 0x7f5a780ceaa0 2026-02-17T11:13:05.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.778+0000 7f5a5effd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:13:05.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.780+0000 7f5a5effd640 1 -- 10.20.193.49:0/4207889483 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c017070 con 0x7f5a780ceaa0 2026-02-17T11:13:05.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.780+0000 7f5a5effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:05.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.780+0000 7f5a5effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:13:05.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.780+0000 7f5a5effd640 10 monclient: dump: 2026-02-17T11:13:05.790 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:05.790 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:05.790 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:05.790 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:05.790 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:05.790 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:05.790 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:05.791 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:05.791 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:05.791 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:05.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.780+0000 7f5a5effd640 10 monclient: _finish_auth 0 2026-02-17T11:13:05.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.780+0000 7f5a5effd640 10 monclient: _check_auth_tickets 2026-02-17T11:13:05.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.780+0000 7f5a5effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:13:05.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.780+0000 7f5a5effd640 1 -- 10.20.193.49:0/4207889483 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a6c005de0 con 0x7f5a780ceaa0 2026-02-17T11:13:05.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.780+0000 7f5a5effd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:13:05.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.780+0000 7f5a5effd640 1 -- 10.20.193.49:0/4207889483 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c007290 con 0x7f5a780ceaa0 2026-02-17T11:13:05.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.780+0000 7f5a80691640 5 monclient: authenticate success, global_id 4889 2026-02-17T11:13:05.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.780+0000 7f5a80691640 10 monclient: _renew_subs 2026-02-17T11:13:05.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.780+0000 7f5a80691640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:13:05.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.780+0000 7f5a80691640 1 -- 10.20.193.49:0/4207889483 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a7814b030 con 0x7f5a780ceaa0 2026-02-17T11:13:05.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.780+0000 7f5a7cc03640 4 set_mon_vals no callback set 2026-02-17T11:13:05.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.780+0000 7f5a5effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:05.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.780+0000 7f5a5effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:13:05.792 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.780+0000 7f5a5effd640 10 monclient: dump: 2026-02-17T11:13:05.792 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:05.792 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:05.792 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:05.792 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:05.792 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:05.792 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:05.792 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:05.792 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:05.792 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:05.792 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:05.792 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.780+0000 7f5a80691640 10 client.4889.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:13:05.792 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.780+0000 7f5a80691640 10 monclient: _renew_subs 2026-02-17T11:13:05.792 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.780+0000 7f5a80691640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:13:05.792 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.780+0000 7f5a80691640 1 -- 10.20.193.49:0/4207889483 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a7814b5f0 con 0x7f5a780ceaa0 2026-02-17T11:13:05.792 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.780+0000 7f5a80691640 1 librados: init done 2026-02-17T11:13:05.792 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.781+0000 7f5a80691640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:13:05.792 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.781+0000 7f5a80691640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:13:05.793 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.781+0000 7f5a80691640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:13:05.793 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.781+0000 7f5a80691640 1 -- 10.20.193.49:0/4207889483 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a7806e5b0 con 0x7f5a780ceaa0 2026-02-17T11:13:05.793 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.792+0000 7f5a5effd640 1 -- 10.20.193.49:0/4207889483 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f5a6c007430 con 0x7f5a780ceaa0 2026-02-17T11:13:05.793 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.792+0000 7f5a5effd640 1 --2- 10.20.193.49:0/4207889483 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5a480791c0 0x7f5a4807b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:05.794 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.792+0000 7f5a7e406640 1 --2- 10.20.193.49:0/4207889483 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5a480791c0 0x7f5a4807b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:05.794 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.792+0000 7f5a7e406640 10 monclient: get_auth_request con 0x7f5a480791c0 auth_method 0 2026-02-17T11:13:05.795 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.793+0000 7f5a7e406640 1 --2- 10.20.193.49:0/4207889483 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5a480791c0 0x7f5a4807b680 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5a68039000 tx=0x7f5a68033000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:13:05.795 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.793+0000 7f5a5effd640 10 client.4889.objecter ms_handle_connect 0x7f5a480791c0 2026-02-17T11:13:05.795 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.794+0000 7f5a5effd640 1 -- 10.20.193.49:0/4207889483 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f5a6c007750 con 0x7f5a780ceaa0 2026-02-17T11:13:05.796 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.794+0000 7f5a5effd640 10 client.4889.objecter ms_dispatch2 0x7f5a78000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:13:05.796 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.794+0000 7f5a5effd640 3 client.4889.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:13:05.796 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.794+0000 7f5a5effd640 3 client.4889.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:13:05.796 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.794+0000 7f5a5effd640 20 client.4889.objecter dump_active .. 0 homeless 2026-02-17T11:13:05.897 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.896+0000 7f5a5effd640 1 -- 10.20.193.49:0/4207889483 <== mon.2 v2:10.20.193.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f5a6c021020 con 0x7f5a780ceaa0 2026-02-17T11:13:05.898 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.896+0000 7f5a5effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:13:05.898 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.896+0000 7f5a5effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:13:05.997 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.995+0000 7f5a80691640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:13:05.997 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.995+0000 7f5a80691640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:13:05.998 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.995+0000 7f5a80691640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:13:05.998 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.995+0000 7f5a80691640 1 -- 10.20.193.49:0/4207889483 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f5a78074ac0 con 0x7f5a780ceaa0 2026-02-17T11:13:05.999 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.998+0000 7f5a5effd640 1 -- 10.20.193.49:0/4207889483 <== mon.2 v2:10.20.193.157:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f5a6c0616a0 con 0x7f5a780ceaa0 2026-02-17T11:13:05.999 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.998+0000 7f5a5effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:13:05.999 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.998+0000 7f5a5effd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:13:05.999 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:13:06.000 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:13:06.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.999+0000 7f5a80691640 10 librados: watch_flush enter 2026-02-17T11:13:06.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.999+0000 7f5a80691640 10 librados: watch_flush exit 2026-02-17T11:13:06.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.999+0000 7f5a80691640 20 client.4889.objecter shutdown clearing up homeless session... 2026-02-17T11:13:06.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.999+0000 7f5a80691640 10 client.4889.objecter successfully canceled tick 2026-02-17T11:13:06.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.999+0000 7f5a80691640 1 -- 10.20.193.49:0/4207889483 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5a480791c0 msgr2=0x7f5a4807b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:06.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.999+0000 7f5a80691640 1 --2- 10.20.193.49:0/4207889483 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5a480791c0 0x7f5a4807b680 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5a68039000 tx=0x7f5a68033000 comp rx=0 tx=0).stop 2026-02-17T11:13:06.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.999+0000 7f5a80691640 10 monclient: shutdown 2026-02-17T11:13:06.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.999+0000 7f5a80691640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:13:06.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.999+0000 7f5a80691640 1 -- 10.20.193.49:0/4207889483 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5a780ceaa0 msgr2=0x7f5a7814c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:06.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.999+0000 7f5a80691640 1 --2- 10.20.193.49:0/4207889483 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5a780ceaa0 0x7f5a7814c0d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c0036c0 tx=0x7f5a6c00c970 comp rx=0 tx=0).stop 2026-02-17T11:13:06.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.999+0000 7f5a80691640 1 -- 10.20.193.49:0/4207889483 shutdown_connections 2026-02-17T11:13:06.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.999+0000 7f5a80691640 1 --2- 10.20.193.49:0/4207889483 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5a480791c0 0x7f5a4807b680 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:06.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.999+0000 7f5a80691640 1 --2- 10.20.193.49:0/4207889483 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5a78155fb0 0x7f5a781458d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:06.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.999+0000 7f5a80691640 1 --2- 10.20.193.49:0/4207889483 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5a780ceaa0 0x7f5a7814c0d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:06.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.999+0000 7f5a80691640 1 --2- 10.20.193.49:0/4207889483 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5a780cdb50 0x7f5a781f4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:06.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.999+0000 7f5a80691640 1 -- 10.20.193.49:0/4207889483 >> 10.20.193.49:0/4207889483 conn(0x7f5a7806da90 msgr2=0x7f5a780d1920 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:13:06.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.999+0000 7f5a80691640 1 -- 10.20.193.49:0/4207889483 shutdown_connections 2026-02-17T11:13:06.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.999+0000 7f5a80691640 1 -- 10.20.193.49:0/4207889483 wait complete. 2026-02-17T11:13:06.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:05.999+0000 7f5a80691640 1 librados: shutdown 2026-02-17T11:13:09.010 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:13:09.081 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.078+0000 7f58a08fa640 10 monclient: get_monmap_and_config 2026-02-17T11:13:09.081 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.078+0000 7f58a08fa640 10 monclient: build_initial_monmap 2026-02-17T11:13:09.081 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.078+0000 7f58a08fa640 10 monclient: monmap: 2026-02-17T11:13:09.081 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:13:09.081 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:09.081 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:13:09.079657+0000 2026-02-17T11:13:09.081 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:13:09.079657+0000 2026-02-17T11:13:09.082 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:13:09.082 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:09.082 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:13:09.082 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:13:09.082 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:13:09.082 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:13:09.082 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:13:09.082 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:13:09.082 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:09.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.078+0000 7f58a08fa640 1 Processor -- start 2026-02-17T11:13:09.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.078+0000 7f58a08fa640 1 -- start start 2026-02-17T11:13:09.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.078+0000 7f58a08fa640 10 monclient: init 2026-02-17T11:13:09.085 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.079+0000 7f58a08fa640 10 monclient: _reopen_session rank -1 2026-02-17T11:13:09.085 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.079+0000 7f58a08fa640 10 monclient: _add_conns ranks=[4,0,2,1,3,5] 2026-02-17T11:13:09.086 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.079+0000 7f58a08fa640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f58980c7170 0x7f58980c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:09.086 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.079+0000 7f58a08fa640 10 monclient(hunting): picked mon.noname-b con 0x7f58980c7170 addr v2:10.20.193.97:3300/0 2026-02-17T11:13:09.086 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.079+0000 7f58a08fa640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f58980c48c0 addr v1:10.20.193.49:6789/0 2026-02-17T11:13:09.086 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.079+0000 7f58a08fa640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f58980c4d10 addr v1:10.20.193.157:6789/0 2026-02-17T11:13:09.086 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.079+0000 7f58a08fa640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f589815a9a0 con 0x7f58980c48c0 2026-02-17T11:13:09.086 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.079+0000 7f58a08fa640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58980c5270 con 0x7f58980c4d10 2026-02-17T11:13:09.086 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.079+0000 7f58a08fa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:09.086 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.079+0000 7f58a08fa640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f58980c8530 con 0x7f58980c7170 2026-02-17T11:13:09.086 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.079+0000 7f58a08fa640 10 monclient(hunting): _renew_subs 2026-02-17T11:13:09.086 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.079+0000 7f58a08fa640 10 monclient(hunting): authenticate will time out at 1265.743207s 2026-02-17T11:13:09.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.079+0000 7f589de6e640 1 --1- >> v1:10.20.193.49:6789/0 conn(0x7f58980c48c0 0x7f58980749b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.49:6789/0 says I am v1:10.20.193.49:46336/0 (socket says 10.20.193.49:46336) 2026-02-17T11:13:09.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.079+0000 7f589de6e640 1 -- 10.20.193.49:0/3264163500 learned_addr learned my addr 10.20.193.49:0/3264163500 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:13:09.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.079+0000 7f589e66f640 1 --2- 10.20.193.49:0/3264163500 >> v2:10.20.193.97:3300/0 conn(0x7f58980c7170 0x7f58980c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:09.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.079+0000 7f589e66f640 10 monclient(hunting): get_auth_request con 0x7f58980c7170 auth_method 0 2026-02-17T11:13:09.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.079+0000 7f589e66f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:09.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.079+0000 7f589e66f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:09.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.079+0000 7f589e66f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:09.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.080+0000 7f589e66f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:09.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.080+0000 7f589e66f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:09.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.080+0000 7f589e66f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:09.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.080+0000 7f589d66d640 1 -- 10.20.193.49:0/3264163500 <== mon.0 v1:10.20.193.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2340490338 0 0) 0x7f589815a9a0 con 0x7f58980c48c0 2026-02-17T11:13:09.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.080+0000 7f589d66d640 10 monclient(hunting): _negotiate 2026-02-17T11:13:09.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.080+0000 7f589d66d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:09.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.080+0000 7f589d66d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:09.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.080+0000 7f589d66d640 10 monclient(hunting): my global_id is 4896 2026-02-17T11:13:09.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.080+0000 7f589d66d640 1 -- 10.20.193.49:0/3264163500 --> v1:10.20.193.49:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5888003620 con 0x7f58980c48c0 2026-02-17T11:13:09.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.081+0000 7f589d66d640 1 -- 10.20.193.49:0/3264163500 <== mon.2 v1:10.20.193.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3415975662 0 0) 0x7f58980c5270 con 0x7f58980c4d10 2026-02-17T11:13:09.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.081+0000 7f589d66d640 10 monclient(hunting): _negotiate 2026-02-17T11:13:09.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.081+0000 7f589d66d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:09.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.081+0000 7f589d66d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:09.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.081+0000 7f589d66d640 10 monclient(hunting): my global_id is 4892 2026-02-17T11:13:09.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.081+0000 7f589d66d640 1 -- 10.20.193.49:0/3264163500 --> v1:10.20.193.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f589815a9a0 con 0x7f58980c4d10 2026-02-17T11:13:09.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.081+0000 7f589e66f640 10 monclient(hunting): handle_auth_done global_id 4852 payload 274 2026-02-17T11:13:09.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.081+0000 7f589e66f640 1 -- 10.20.193.49:0/3264163500 >> v1:10.20.193.157:6789/0 conn(0x7f58980c4d10 legacy=0x7f58980c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:09.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.081+0000 7f589e66f640 1 -- 10.20.193.49:0/3264163500 >> v1:10.20.193.49:6789/0 conn(0x7f58980c48c0 legacy=0x7f58980749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:09.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.081+0000 7f589e66f640 10 monclient: _finish_hunting 0 2026-02-17T11:13:09.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.081+0000 7f589e66f640 1 monclient: found mon.noname-b 2026-02-17T11:13:09.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.081+0000 7f589e66f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:13:09.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.081+0000 7f589e66f640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:13:09.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.081+0000 7f589e66f640 1 -- 10.20.193.49:0/3264163500 --> v2:10.20.193.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58980c5550 con 0x7f58980c7170 2026-02-17T11:13:09.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.082+0000 7f589e66f640 1 --2- 10.20.193.49:0/3264163500 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f58980c7170 0x7f58980c7550 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f58900098a0 tx=0x7f589002ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbf3477fd1ecff93 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:13:09.096 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.084+0000 7f589d66d640 1 -- 10.20.193.49:0/3264163500 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f589003c070 con 0x7f58980c7170 2026-02-17T11:13:09.096 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.084+0000 7f589d66d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:09.096 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.084+0000 7f589d66d640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:13:09.096 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.084+0000 7f589d66d640 10 monclient: dump: 2026-02-17T11:13:09.096 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:09.097 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:09.097 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:09.097 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:09.097 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:09.097 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:09.097 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:09.097 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:09.097 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:09.097 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:09.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.084+0000 7f589d66d640 10 monclient: _finish_auth 0 2026-02-17T11:13:09.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.084+0000 7f589d66d640 10 monclient: _check_auth_tickets 2026-02-17T11:13:09.098 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.084+0000 7f589d66d640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:13:09.098 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.084+0000 7f589d66d640 1 -- 10.20.193.49:0/3264163500 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f589002fb70 con 0x7f58980c7170 2026-02-17T11:13:09.098 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.084+0000 7f589d66d640 10 monclient: handle_config config(0 keys) 2026-02-17T11:13:09.098 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.084+0000 7f58a08fa640 5 monclient: authenticate success, global_id 4852 2026-02-17T11:13:09.098 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.084+0000 7f589d66d640 1 -- 10.20.193.49:0/3264163500 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5890037440 con 0x7f58980c7170 2026-02-17T11:13:09.098 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.084+0000 7f58a08fa640 10 monclient: get_monmap_and_config success 2026-02-17T11:13:09.098 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.084+0000 7f589d66d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:09.098 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.084+0000 7f58a08fa640 4 set_mon_vals no callback set 2026-02-17T11:13:09.098 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.084+0000 7f589d66d640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:13:09.098 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.084+0000 7f589d66d640 10 monclient: dump: 2026-02-17T11:13:09.098 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:09.098 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:09.099 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:09.099 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:09.099 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:09.099 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:09.099 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:09.099 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:09.099 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:09.099 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:09.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.084+0000 7f58a08fa640 10 monclient: shutdown 2026-02-17T11:13:09.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.084+0000 7f58a08fa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:13:09.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.084+0000 7f58a08fa640 1 -- 10.20.193.49:0/3264163500 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f58980c7170 msgr2=0x7f58980c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:09.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.084+0000 7f58a08fa640 1 --2- 10.20.193.49:0/3264163500 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f58980c7170 0x7f58980c7550 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f58900098a0 tx=0x7f589002ee60 comp rx=0 tx=0).stop 2026-02-17T11:13:09.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.084+0000 7f58a08fa640 1 -- 10.20.193.49:0/3264163500 shutdown_connections 2026-02-17T11:13:09.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.084+0000 7f58a08fa640 1 --2- 10.20.193.49:0/3264163500 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f58980c7170 0x7f58980c7550 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:09.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.084+0000 7f58a08fa640 1 -- 10.20.193.49:0/3264163500 >> 10.20.193.49:0/3264163500 conn(0x7f58980c9f40 msgr2=0x7f58980ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:13:09.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.084+0000 7f58a08fa640 1 -- 10.20.193.49:0/3264163500 shutdown_connections 2026-02-17T11:13:09.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.084+0000 7f58a08fa640 1 -- 10.20.193.49:0/3264163500 wait complete. 2026-02-17T11:13:09.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.085+0000 7f58a08fa640 10 monclient: build_initial_monmap 2026-02-17T11:13:09.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.085+0000 7f58a08fa640 10 monclient: monmap: 2026-02-17T11:13:09.100 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:13:09.100 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:13:09.100 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:13:09.100 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:13:09.100 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:13:09.101 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:09.101 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:13:09.101 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:13:09.101 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:13:09.101 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:09.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.085+0000 7f58a08fa640 1 librados: starting msgr at 2026-02-17T11:13:09.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.085+0000 7f58a08fa640 1 librados: starting objecter 2026-02-17T11:13:09.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.085+0000 7f58a08fa640 1 Processor -- start 2026-02-17T11:13:09.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.085+0000 7f58a08fa640 1 -- start start 2026-02-17T11:13:09.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.085+0000 7f58a08fa640 1 librados: setting wanted keys 2026-02-17T11:13:09.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.085+0000 7f58a08fa640 1 librados: calling monclient init 2026-02-17T11:13:09.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.085+0000 7f58a08fa640 10 monclient: init 2026-02-17T11:13:09.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.085+0000 7f58a08fa640 10 monclient: _reopen_session rank -1 2026-02-17T11:13:09.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.085+0000 7f58a08fa640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:13:09.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.085+0000 7f58a08fa640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f58980c48c0 0x7f5898158140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:09.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.085+0000 7f58a08fa640 10 monclient(hunting): picked mon.noname-c con 0x7f58980c48c0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:13:09.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.085+0000 7f58a08fa640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f58980c4d10 0x7f58981f2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:09.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.085+0000 7f58a08fa640 10 monclient(hunting): picked mon.noname-a con 0x7f58980c4d10 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:13:09.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.085+0000 7f58a08fa640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f58980c7170 0x7f58981f3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:09.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.085+0000 7f58a08fa640 10 monclient(hunting): picked mon.noname-b con 0x7f58980c7170 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:13:09.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.085+0000 7f58a08fa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:09.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.085+0000 7f58a08fa640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f58980c81c0 con 0x7f58980c4d10 2026-02-17T11:13:09.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.085+0000 7f58a08fa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:09.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.085+0000 7f58a08fa640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f58980c7ee0 con 0x7f58980c7170 2026-02-17T11:13:09.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.085+0000 7f58a08fa640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:09.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.085+0000 7f58a08fa640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f58980750c0 con 0x7f58980c48c0 2026-02-17T11:13:09.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.085+0000 7f58a08fa640 10 monclient(hunting): _renew_subs 2026-02-17T11:13:09.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.085+0000 7f58a08fa640 10 monclient(hunting): authenticate will time out at 1265.749760s 2026-02-17T11:13:09.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.085+0000 7f589de6e640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f58980c4d10 0x7f58981f2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:09.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.086+0000 7f589ee70640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f58980c7170 0x7f58981f3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:09.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.086+0000 7f589ee70640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f58980c7170 0x7f58981f3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:35730/0 (socket says 10.20.193.49:35730) 2026-02-17T11:13:09.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.086+0000 7f589ee70640 1 -- 10.20.193.49:0/3213059913 learned_addr learned my addr 10.20.193.49:0/3213059913 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:13:09.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.086+0000 7f589ee70640 10 monclient(hunting): get_auth_request con 0x7f58980c7170 auth_method 0 2026-02-17T11:13:09.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.086+0000 7f589ee70640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:09.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.086+0000 7f589ee70640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:09.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.086+0000 7f589ee70640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:09.104 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.086+0000 7f589e66f640 1 --2- 10.20.193.49:0/3213059913 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f58980c48c0 0x7f5898158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:09.104 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.086+0000 7f589de6e640 10 monclient(hunting): get_auth_request con 0x7f58980c4d10 auth_method 0 2026-02-17T11:13:09.104 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.086+0000 7f589de6e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:09.104 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.086+0000 7f589de6e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:09.104 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.086+0000 7f589de6e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:09.104 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.086+0000 7f589e66f640 10 monclient(hunting): get_auth_request con 0x7f58980c48c0 auth_method 0 2026-02-17T11:13:09.104 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.086+0000 7f589e66f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:09.104 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.086+0000 7f589e66f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:09.104 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.086+0000 7f589e66f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:09.104 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.086+0000 7f589ee70640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:09.104 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.086+0000 7f589ee70640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:09.104 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.086+0000 7f589ee70640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:09.104 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.086+0000 7f589de6e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:09.105 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.086+0000 7f589de6e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:09.105 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.086+0000 7f589de6e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:09.105 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.086+0000 7f589e66f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:09.105 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.086+0000 7f589e66f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:09.105 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.086+0000 7f589e66f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:09.105 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.087+0000 7f589ee70640 10 monclient(hunting): handle_auth_done global_id 4855 payload 824 2026-02-17T11:13:09.105 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.087+0000 7f589ee70640 1 -- 10.20.193.49:0/3213059913 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f58980c48c0 msgr2=0x7f5898158140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:09.105 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.087+0000 7f589ee70640 1 --2- 10.20.193.49:0/3213059913 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f58980c48c0 0x7f5898158140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:09.105 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.087+0000 7f589ee70640 1 -- 10.20.193.49:0/3213059913 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f58980c4d10 msgr2=0x7f58981f2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:09.105 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.087+0000 7f589ee70640 1 --2- 10.20.193.49:0/3213059913 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f58980c4d10 0x7f58981f2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:09.105 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.087+0000 7f589ee70640 10 monclient: _finish_hunting 0 2026-02-17T11:13:09.105 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.087+0000 7f589ee70640 1 monclient: found mon.noname-b 2026-02-17T11:13:09.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.087+0000 7f589ee70640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:13:09.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.087+0000 7f589ee70640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:13:09.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.087+0000 7f589ee70640 1 -- 10.20.193.49:0/3213059913 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f589815d220 con 0x7f58980c7170 2026-02-17T11:13:09.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.088+0000 7f589ee70640 1 --2- 10.20.193.49:0/3213059913 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f58980c7170 0x7f58981f3080 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f588c00cbc0 tx=0x7f588c00a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:13:09.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.088+0000 7f5882ffd640 10 client.?.objecter ms_handle_connect 0x7f58980c7170 2026-02-17T11:13:09.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.088+0000 7f5882ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:13:09.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.089+0000 7f5882ffd640 1 -- 10.20.193.49:0/3213059913 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f588c00acf0 con 0x7f58980c7170 2026-02-17T11:13:09.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.089+0000 7f5882ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:09.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.089+0000 7f5882ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:13:09.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.089+0000 7f5882ffd640 10 monclient: dump: 2026-02-17T11:13:09.106 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:09.106 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:09.106 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:09.107 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:09.107 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:09.107 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:09.107 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:09.107 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:09.107 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:09.107 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:09.107 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.089+0000 7f5882ffd640 10 monclient: _finish_auth 0 2026-02-17T11:13:09.107 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.089+0000 7f5882ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:13:09.107 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.089+0000 7f5882ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:13:09.107 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.089+0000 7f58a08fa640 5 monclient: authenticate success, global_id 4855 2026-02-17T11:13:09.107 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.089+0000 7f58a08fa640 10 monclient: _renew_subs 2026-02-17T11:13:09.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.089+0000 7f58a08fa640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:13:09.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.089+0000 7f58a08fa640 1 -- 10.20.193.49:0/3213059913 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f589815d4c0 con 0x7f58980c7170 2026-02-17T11:13:09.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.089+0000 7f58a08fa640 10 client.4855.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:13:09.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.089+0000 7f58a08fa640 10 monclient: _renew_subs 2026-02-17T11:13:09.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.089+0000 7f58a08fa640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:13:09.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.089+0000 7f58a08fa640 1 -- 10.20.193.49:0/3213059913 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f589815da80 con 0x7f58980c7170 2026-02-17T11:13:09.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.089+0000 7f58a08fa640 1 librados: init done 2026-02-17T11:13:09.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.090+0000 7f58a08fa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:13:09.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.090+0000 7f58a08fa640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:13:09.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.090+0000 7f58a08fa640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:13:09.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.090+0000 7f58a08fa640 1 -- 10.20.193.49:0/3213059913 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58980c7550 con 0x7f58980c7170 2026-02-17T11:13:09.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.090+0000 7f5882ffd640 1 -- 10.20.193.49:0/3213059913 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f588c003c80 con 0x7f58980c7170 2026-02-17T11:13:09.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.090+0000 7f5882ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:13:09.109 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.090+0000 7f5882ffd640 1 -- 10.20.193.49:0/3213059913 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f588c0052d0 con 0x7f58980c7170 2026-02-17T11:13:09.109 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.090+0000 7f5882ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:09.109 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.090+0000 7f5882ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:13:09.109 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.090+0000 7f5882ffd640 10 monclient: dump: 2026-02-17T11:13:09.109 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:09.109 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:09.109 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:09.109 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:09.109 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:09.109 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:09.109 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:09.109 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:09.110 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:09.110 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:09.110 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.090+0000 7f589ce6c640 4 set_mon_vals no callback set 2026-02-17T11:13:09.199 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.196+0000 7f5882ffd640 1 -- 10.20.193.49:0/3213059913 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f588c005470 con 0x7f58980c7170 2026-02-17T11:13:09.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.197+0000 7f5882ffd640 1 --2- 10.20.193.49:0/3213059913 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5868079140 0x7f586807b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:09.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.197+0000 7f589e66f640 1 --2- 10.20.193.49:0/3213059913 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5868079140 0x7f586807b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:09.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.197+0000 7f589e66f640 10 monclient: get_auth_request con 0x7f5868079140 auth_method 0 2026-02-17T11:13:09.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.198+0000 7f589e66f640 1 --2- 10.20.193.49:0/3213059913 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5868079140 0x7f586807b600 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5890039000 tx=0x7f5890033000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:13:09.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.198+0000 7f5882ffd640 10 client.4855.objecter ms_handle_connect 0x7f5868079140 2026-02-17T11:13:09.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.198+0000 7f5882ffd640 1 -- 10.20.193.49:0/3213059913 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f588c05eb60 con 0x7f58980c7170 2026-02-17T11:13:09.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.198+0000 7f5882ffd640 10 client.4855.objecter ms_dispatch2 0x7f5898000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:13:09.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.198+0000 7f5882ffd640 3 client.4855.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:13:09.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.198+0000 7f5882ffd640 3 client.4855.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:13:09.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.198+0000 7f5882ffd640 20 client.4855.objecter dump_active .. 0 homeless 2026-02-17T11:13:09.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.205+0000 7f5882ffd640 1 -- 10.20.193.49:0/3213059913 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f588c062b20 con 0x7f58980c7170 2026-02-17T11:13:09.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.205+0000 7f5882ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:13:09.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.205+0000 7f5882ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:13:09.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.308+0000 7f58a08fa640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:13:09.312 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.308+0000 7f58a08fa640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:13:09.312 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.308+0000 7f58a08fa640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:13:09.312 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.308+0000 7f58a08fa640 1 -- 10.20.193.49:0/3213059913 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f58981579d0 con 0x7f58980c7170 2026-02-17T11:13:09.314 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.312+0000 7f5882ffd640 1 -- 10.20.193.49:0/3213059913 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f588c066e20 con 0x7f58980c7170 2026-02-17T11:13:09.314 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.312+0000 7f5882ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:13:09.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.312+0000 7f5882ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:13:09.315 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:13:09.315 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:13:09.317 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.313+0000 7f58a08fa640 10 librados: watch_flush enter 2026-02-17T11:13:09.317 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.313+0000 7f58a08fa640 10 librados: watch_flush exit 2026-02-17T11:13:09.317 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.313+0000 7f58a08fa640 20 client.4855.objecter shutdown clearing up homeless session... 2026-02-17T11:13:09.317 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.313+0000 7f58a08fa640 10 client.4855.objecter successfully canceled tick 2026-02-17T11:13:09.317 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.313+0000 7f58a08fa640 1 -- 10.20.193.49:0/3213059913 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5868079140 msgr2=0x7f586807b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:09.317 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.313+0000 7f58a08fa640 1 --2- 10.20.193.49:0/3213059913 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5868079140 0x7f586807b600 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5890039000 tx=0x7f5890033000 comp rx=0 tx=0).stop 2026-02-17T11:13:09.318 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.313+0000 7f58a08fa640 10 monclient: shutdown 2026-02-17T11:13:09.318 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.313+0000 7f58a08fa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:13:09.318 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.313+0000 7f58a08fa640 1 -- 10.20.193.49:0/3213059913 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f58980c7170 msgr2=0x7f58981f3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:09.318 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.313+0000 7f58a08fa640 1 --2- 10.20.193.49:0/3213059913 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f58980c7170 0x7f58981f3080 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f588c00cbc0 tx=0x7f588c00a430 comp rx=0 tx=0).stop 2026-02-17T11:13:09.318 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.313+0000 7f58a08fa640 1 -- 10.20.193.49:0/3213059913 shutdown_connections 2026-02-17T11:13:09.318 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.313+0000 7f58a08fa640 1 --2- 10.20.193.49:0/3213059913 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5868079140 0x7f586807b600 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:09.318 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.313+0000 7f58a08fa640 1 --2- 10.20.193.49:0/3213059913 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f58980c7170 0x7f58981f3080 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:09.318 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.313+0000 7f58a08fa640 1 --2- 10.20.193.49:0/3213059913 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f58980c4d10 0x7f58981f2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:09.318 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.313+0000 7f58a08fa640 1 --2- 10.20.193.49:0/3213059913 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f58980c48c0 0x7f5898158140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:09.318 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.313+0000 7f58a08fa640 1 -- 10.20.193.49:0/3213059913 >> 10.20.193.49:0/3213059913 conn(0x7f58980c9f40 msgr2=0x7f58980ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:13:09.318 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.313+0000 7f58a08fa640 1 -- 10.20.193.49:0/3213059913 shutdown_connections 2026-02-17T11:13:09.318 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.313+0000 7f58a08fa640 1 -- 10.20.193.49:0/3213059913 wait complete. 2026-02-17T11:13:09.319 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:09.313+0000 7f58a08fa640 1 librados: shutdown 2026-02-17T11:13:11.969 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:04:57.450 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:13:11.971 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:04:57.452 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:13:11.979 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:04:57.460 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:13:11.997 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:04:57.472 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:13:11.998 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:04:57.473 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:13:11.999 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:04:57.442 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:13:12.003 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:04:57.445 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:13:12.008 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:04:57.483 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:13:12.010 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:04:57.452 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:13:12.325 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:13:12.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.391+0000 7feefe4a9640 10 monclient: get_monmap_and_config 2026-02-17T11:13:12.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.391+0000 7feefe4a9640 10 monclient: build_initial_monmap 2026-02-17T11:13:12.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.391+0000 7feefe4a9640 10 monclient: monmap: 2026-02-17T11:13:12.394 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:13:12.394 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:12.394 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:13:12.393040+0000 2026-02-17T11:13:12.394 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:13:12.393040+0000 2026-02-17T11:13:12.394 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:13:12.395 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:12.395 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:13:12.395 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:13:12.395 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:13:12.395 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:13:12.395 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:13:12.395 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:13:12.395 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:12.398 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.392+0000 7feefe4a9640 1 Processor -- start 2026-02-17T11:13:12.398 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.392+0000 7feefe4a9640 1 -- start start 2026-02-17T11:13:12.398 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.392+0000 7feefe4a9640 10 monclient: init 2026-02-17T11:13:12.398 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.392+0000 7feefe4a9640 10 monclient: _reopen_session rank -1 2026-02-17T11:13:12.398 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.392+0000 7feefe4a9640 10 monclient: _add_conns ranks=[0,2,3,5,1,4] 2026-02-17T11:13:12.398 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.392+0000 7feefe4a9640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7feef80c7170 addr v1:10.20.193.49:6789/0 2026-02-17T11:13:12.398 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.392+0000 7feefe4a9640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7feef80c7550 addr v1:10.20.193.157:6789/0 2026-02-17T11:13:12.398 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.392+0000 7feefe4a9640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7feef80c89c0 0x7feef80c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:12.399 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.392+0000 7feefe4a9640 10 monclient(hunting): picked mon.noname-a con 0x7feef80c89c0 addr v2:10.20.193.49:3300/0 2026-02-17T11:13:12.399 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.392+0000 7feefe4a9640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feef80c4fd0 con 0x7feef80c7170 2026-02-17T11:13:12.399 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.392+0000 7feefe4a9640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feef815a9a0 con 0x7feef80c7550 2026-02-17T11:13:12.399 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.392+0000 7feefe4a9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:12.399 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.392+0000 7feefe4a9640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7feef80c8530 con 0x7feef80c89c0 2026-02-17T11:13:12.399 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.392+0000 7feefe4a9640 10 monclient(hunting): _renew_subs 2026-02-17T11:13:12.399 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.392+0000 7feefe4a9640 10 monclient(hunting): authenticate will time out at 1269.056632s 2026-02-17T11:13:12.399 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.392+0000 7feefca1f640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7feef80c89c0 0x7feef80c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:12.399 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.393+0000 7feef77fe640 1 --1- >> v1:10.20.193.157:6789/0 conn(0x7feef80c7550 0x7feef80749b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.157:6789/0 says I am v1:10.20.193.49:41652/0 (socket says 10.20.193.49:41652) 2026-02-17T11:13:12.399 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.393+0000 7feef77fe640 1 -- 10.20.193.49:0/2345328788 learned_addr learned my addr 10.20.193.49:0/2345328788 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:13:12.399 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.393+0000 7feefca1f640 10 monclient(hunting): get_auth_request con 0x7feef80c89c0 auth_method 0 2026-02-17T11:13:12.400 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.393+0000 7feefca1f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:12.400 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.393+0000 7feefca1f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:12.400 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.393+0000 7feefca1f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:12.400 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.393+0000 7feefca1f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:12.400 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.393+0000 7feefca1f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:12.400 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.393+0000 7feefca1f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:12.400 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.394+0000 7feef6ffd640 1 -- 10.20.193.49:0/2345328788 <== mon.2 v1:10.20.193.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1219965460 0 0) 0x7feef815a9a0 con 0x7feef80c7550 2026-02-17T11:13:12.400 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.394+0000 7feef6ffd640 10 monclient(hunting): _negotiate 2026-02-17T11:13:12.400 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.394+0000 7feef6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:12.400 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.394+0000 7feef6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:12.400 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.394+0000 7feef6ffd640 10 monclient(hunting): my global_id is 4898 2026-02-17T11:13:12.400 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.394+0000 7feef6ffd640 1 -- 10.20.193.49:0/2345328788 --> v1:10.20.193.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feedc003620 con 0x7feef80c7550 2026-02-17T11:13:12.400 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.395+0000 7feefca1f640 10 monclient(hunting): handle_auth_done global_id 4902 payload 274 2026-02-17T11:13:12.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.395+0000 7feefca1f640 1 -- 10.20.193.49:0/2345328788 >> v1:10.20.193.157:6789/0 conn(0x7feef80c7550 legacy=0x7feef80749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:12.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.395+0000 7feefca1f640 1 -- 10.20.193.49:0/2345328788 >> v1:10.20.193.49:6789/0 conn(0x7feef80c7170 legacy=0x7feef80c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:12.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.395+0000 7feefca1f640 10 monclient: _finish_hunting 0 2026-02-17T11:13:12.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.395+0000 7feefca1f640 1 monclient: found mon.noname-a 2026-02-17T11:13:12.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.395+0000 7feefca1f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:13:12.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.395+0000 7feefca1f640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:13:12.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.395+0000 7feefca1f640 1 -- 10.20.193.49:0/2345328788 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feef80c5270 con 0x7feef80c89c0 2026-02-17T11:13:12.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.397+0000 7feefca1f640 1 --2- 10.20.193.49:0/2345328788 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7feef80c89c0 0x7feef80c8e70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7feeec009d90 tx=0x7feeec02f230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9efd559598333e0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:13:12.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.399+0000 7feef6ffd640 1 -- 10.20.193.49:0/2345328788 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeec03c070 con 0x7feef80c89c0 2026-02-17T11:13:12.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.399+0000 7feef6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:12.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.399+0000 7feef6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:13:12.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.399+0000 7feef6ffd640 10 monclient: dump: 2026-02-17T11:13:12.406 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:12.406 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:12.406 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:12.407 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:12.407 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:12.407 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:12.407 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:12.407 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:12.407 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:12.407 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:12.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.399+0000 7feef6ffd640 10 monclient: _finish_auth 0 2026-02-17T11:13:12.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.399+0000 7feef6ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:13:12.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.399+0000 7feef6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:13:12.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.399+0000 7feef6ffd640 1 -- 10.20.193.49:0/2345328788 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feeec037440 con 0x7feef80c89c0 2026-02-17T11:13:12.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.399+0000 7feefe4a9640 5 monclient: authenticate success, global_id 4902 2026-02-17T11:13:12.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.399+0000 7feefe4a9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:13:12.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.399+0000 7feef6ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:13:12.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.399+0000 7feef6ffd640 1 -- 10.20.193.49:0/2345328788 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeec037810 con 0x7feef80c89c0 2026-02-17T11:13:12.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.399+0000 7feef6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:12.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.399+0000 7feef6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:13:12.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.399+0000 7feef6ffd640 10 monclient: dump: 2026-02-17T11:13:12.408 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:12.408 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:12.408 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:12.408 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:12.408 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:12.408 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:12.409 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:12.409 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:12.409 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:12.409 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:12.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.399+0000 7feefe4a9640 10 monclient: get_monmap_and_config success 2026-02-17T11:13:12.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.399+0000 7feefe4a9640 4 set_mon_vals no callback set 2026-02-17T11:13:12.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.399+0000 7feefe4a9640 10 monclient: shutdown 2026-02-17T11:13:12.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.399+0000 7feefe4a9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:13:12.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.399+0000 7feefe4a9640 1 -- 10.20.193.49:0/2345328788 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7feef80c89c0 msgr2=0x7feef80c8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:12.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.399+0000 7feefe4a9640 1 --2- 10.20.193.49:0/2345328788 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7feef80c89c0 0x7feef80c8e70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7feeec009d90 tx=0x7feeec02f230 comp rx=0 tx=0).stop 2026-02-17T11:13:12.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.399+0000 7feefe4a9640 1 -- 10.20.193.49:0/2345328788 shutdown_connections 2026-02-17T11:13:12.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.399+0000 7feefe4a9640 1 --2- 10.20.193.49:0/2345328788 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7feef80c89c0 0x7feef80c8e70 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:12.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.399+0000 7feefe4a9640 1 -- 10.20.193.49:0/2345328788 >> 10.20.193.49:0/2345328788 conn(0x7feef80c9f40 msgr2=0x7feef80ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:13:12.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.399+0000 7feefe4a9640 1 -- 10.20.193.49:0/2345328788 shutdown_connections 2026-02-17T11:13:12.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.399+0000 7feefe4a9640 1 -- 10.20.193.49:0/2345328788 wait complete. 2026-02-17T11:13:12.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.400+0000 7feefe4a9640 10 monclient: build_initial_monmap 2026-02-17T11:13:12.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.400+0000 7feefe4a9640 10 monclient: monmap: 2026-02-17T11:13:12.410 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:13:12.410 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:13:12.410 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:13:12.410 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:13:12.410 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:13:12.410 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:12.410 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:13:12.410 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:13:12.411 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:13:12.411 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:12.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.400+0000 7feefe4a9640 1 librados: starting msgr at 2026-02-17T11:13:12.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.400+0000 7feefe4a9640 1 librados: starting objecter 2026-02-17T11:13:12.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.400+0000 7feefe4a9640 1 Processor -- start 2026-02-17T11:13:12.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.400+0000 7feefe4a9640 1 -- start start 2026-02-17T11:13:12.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.400+0000 7feefe4a9640 1 librados: setting wanted keys 2026-02-17T11:13:12.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.400+0000 7feefe4a9640 1 librados: calling monclient init 2026-02-17T11:13:12.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.400+0000 7feefe4a9640 10 monclient: init 2026-02-17T11:13:12.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.400+0000 7feefe4a9640 10 monclient: _reopen_session rank -1 2026-02-17T11:13:12.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.400+0000 7feefe4a9640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:13:12.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.400+0000 7feefe4a9640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7feef80c7170 0x7feef81f5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:12.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.400+0000 7feefe4a9640 10 monclient(hunting): picked mon.noname-b con 0x7feef80c7170 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:13:12.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.400+0000 7feefe4a9640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7feef80c7550 0x7feef80c3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:12.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.400+0000 7feefe4a9640 10 monclient(hunting): picked mon.noname-a con 0x7feef80c7550 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:13:12.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.400+0000 7feefe4a9640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7feef80c89c0 0x7feef81468a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:12.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.400+0000 7feefe4a9640 10 monclient(hunting): picked mon.noname-c con 0x7feef80c89c0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:13:12.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.400+0000 7feefe4a9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:12.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.400+0000 7feefe4a9640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7feef80c5830 con 0x7feef80c7550 2026-02-17T11:13:12.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.400+0000 7feefe4a9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:12.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.400+0000 7feefe4a9640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7feef80c93b0 con 0x7feef80c7170 2026-02-17T11:13:12.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.400+0000 7feefe4a9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:12.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.400+0000 7feefe4a9640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7feef80c7ee0 con 0x7feef80c89c0 2026-02-17T11:13:12.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.400+0000 7feefe4a9640 10 monclient(hunting): _renew_subs 2026-02-17T11:13:12.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.400+0000 7feefe4a9640 10 monclient(hunting): authenticate will time out at 1269.064824s 2026-02-17T11:13:12.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.401+0000 7feef77fe640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7feef80c7550 0x7feef80c3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:12.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.401+0000 7feefca1f640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7feef80c89c0 0x7feef81468a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:12.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.401+0000 7feef7fff640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7feef80c7170 0x7feef81f5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:12.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.401+0000 7feefca1f640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7feef80c89c0 0x7feef81468a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:37834/0 (socket says 10.20.193.49:37834) 2026-02-17T11:13:12.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.401+0000 7feefca1f640 1 -- 10.20.193.49:0/301628305 learned_addr learned my addr 10.20.193.49:0/301628305 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:13:12.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.401+0000 7feefca1f640 10 monclient(hunting): get_auth_request con 0x7feef80c89c0 auth_method 0 2026-02-17T11:13:12.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.401+0000 7feefca1f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:12.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.401+0000 7feefca1f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:12.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.401+0000 7feefca1f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:12.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.401+0000 7feef7fff640 10 monclient(hunting): get_auth_request con 0x7feef80c7170 auth_method 0 2026-02-17T11:13:12.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.401+0000 7feef7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:12.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.401+0000 7feef7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:12.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.401+0000 7feef7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:12.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.401+0000 7feefca1f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:12.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.401+0000 7feefca1f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:12.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.401+0000 7feefca1f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:12.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.401+0000 7feef7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:12.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.401+0000 7feef7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:12.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.401+0000 7feef7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:12.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.403+0000 7feefca1f640 10 monclient(hunting): handle_auth_done global_id 4901 payload 824 2026-02-17T11:13:12.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.403+0000 7feefca1f640 1 -- 10.20.193.49:0/301628305 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7feef80c7170 msgr2=0x7feef81f5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:12.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.403+0000 7feefca1f640 1 --2- 10.20.193.49:0/301628305 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7feef80c7170 0x7feef81f5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:12.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.403+0000 7feefca1f640 1 -- 10.20.193.49:0/301628305 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7feef80c7550 msgr2=0x7feef80c3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:12.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.403+0000 7feefca1f640 1 --2- 10.20.193.49:0/301628305 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7feef80c7550 0x7feef80c3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:12.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.403+0000 7feefca1f640 10 monclient: _finish_hunting 0 2026-02-17T11:13:12.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.403+0000 7feefca1f640 1 monclient: found mon.noname-c 2026-02-17T11:13:12.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.403+0000 7feefca1f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:13:12.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.403+0000 7feefca1f640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:13:12.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.403+0000 7feefca1f640 1 -- 10.20.193.49:0/301628305 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feef80c27d0 con 0x7feef80c89c0 2026-02-17T11:13:12.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.404+0000 7feefca1f640 1 --2- 10.20.193.49:0/301628305 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7feef80c89c0 0x7feef81468a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7feeec03a040 tx=0x7feeec004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:13:12.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.404+0000 7feef4ff9640 10 client.?.objecter ms_handle_connect 0x7feef80c89c0 2026-02-17T11:13:12.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.404+0000 7feef4ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T11:13:12.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.406+0000 7feef4ff9640 1 -- 10.20.193.49:0/301628305 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeec03c050 con 0x7feef80c89c0 2026-02-17T11:13:12.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.406+0000 7feef4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:12.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.406+0000 7feef4ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:13:12.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.406+0000 7feef4ff9640 10 monclient: dump: 2026-02-17T11:13:12.417 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:12.417 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:12.417 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:12.417 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:12.417 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:12.417 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:12.418 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:12.418 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:12.418 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:12.418 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:12.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.406+0000 7feef4ff9640 10 monclient: _finish_auth 0 2026-02-17T11:13:12.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.406+0000 7feef4ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:13:12.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.406+0000 7feef4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:13:12.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.406+0000 7feef4ff9640 1 -- 10.20.193.49:0/301628305 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feeec048070 con 0x7feef80c89c0 2026-02-17T11:13:12.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.406+0000 7feefe4a9640 5 monclient: authenticate success, global_id 4901 2026-02-17T11:13:12.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.406+0000 7feefe4a9640 10 monclient: _renew_subs 2026-02-17T11:13:12.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.406+0000 7feefe4a9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:13:12.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.406+0000 7feefe4a9640 1 -- 10.20.193.49:0/301628305 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feef81f5780 con 0x7feef80c89c0 2026-02-17T11:13:12.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.406+0000 7feef4ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:13:12.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.406+0000 7feef4ff9640 1 -- 10.20.193.49:0/301628305 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeec041a30 con 0x7feef80c89c0 2026-02-17T11:13:12.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.406+0000 7feef4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:12.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.406+0000 7feef4ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:13:12.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.406+0000 7feef67fc640 4 set_mon_vals no callback set 2026-02-17T11:13:12.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.406+0000 7feef4ff9640 10 monclient: dump: 2026-02-17T11:13:12.419 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:12.419 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:12.419 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:12.419 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:12.419 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:12.419 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:12.419 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:12.419 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:12.419 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:12.419 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:12.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.406+0000 7feefe4a9640 10 client.4901.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:13:12.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.406+0000 7feefe4a9640 10 monclient: _renew_subs 2026-02-17T11:13:12.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.406+0000 7feefe4a9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:13:12.420 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.406+0000 7feefe4a9640 1 -- 10.20.193.49:0/301628305 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feef80c1730 con 0x7feef80c89c0 2026-02-17T11:13:12.420 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.406+0000 7feefe4a9640 1 librados: init done 2026-02-17T11:13:12.420 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.406+0000 7feefe4a9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:13:12.420 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.406+0000 7feefe4a9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:13:12.420 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.406+0000 7feefe4a9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:13:12.420 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.406+0000 7feefe4a9640 1 -- 10.20.193.49:0/301628305 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feef80c81c0 con 0x7feef80c89c0 2026-02-17T11:13:12.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.419+0000 7feef4ff9640 1 -- 10.20.193.49:0/301628305 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7feeec041bd0 con 0x7feef80c89c0 2026-02-17T11:13:12.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.419+0000 7feef4ff9640 1 --2- 10.20.193.49:0/301628305 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7feec8079190 0x7feec807b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:12.422 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.419+0000 7feef7fff640 1 --2- 10.20.193.49:0/301628305 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7feec8079190 0x7feec807b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:12.422 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.419+0000 7feef7fff640 10 monclient: get_auth_request con 0x7feec8079190 auth_method 0 2026-02-17T11:13:12.422 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.420+0000 7feef7fff640 1 --2- 10.20.193.49:0/301628305 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7feec8079190 0x7feec807b650 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7feee4002770 tx=0x7feee4007ef0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:13:12.423 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.420+0000 7feef4ff9640 10 client.4901.objecter ms_handle_connect 0x7feec8079190 2026-02-17T11:13:12.521 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.519+0000 7feef4ff9640 1 -- 10.20.193.49:0/301628305 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7feeec0845f0 con 0x7feef80c89c0 2026-02-17T11:13:12.521 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.519+0000 7feef4ff9640 10 client.4901.objecter ms_dispatch2 0x7feef8000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:13:12.521 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.519+0000 7feef4ff9640 3 client.4901.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:13:12.521 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.519+0000 7feef4ff9640 3 client.4901.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:13:12.521 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.519+0000 7feef4ff9640 20 client.4901.objecter dump_active .. 0 homeless 2026-02-17T11:13:12.528 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.525+0000 7feef4ff9640 1 -- 10.20.193.49:0/301628305 <== mon.2 v2:10.20.193.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7feeec088cb0 con 0x7feef80c89c0 2026-02-17T11:13:12.528 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.525+0000 7feef4ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:13:12.528 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.525+0000 7feef4ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:13:12.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.625+0000 7feefe4a9640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:13:12.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.625+0000 7feefe4a9640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:13:12.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.625+0000 7feefe4a9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:13:12.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.625+0000 7feefe4a9640 1 -- 10.20.193.49:0/301628305 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7feef8076630 con 0x7feef80c89c0 2026-02-17T11:13:12.630 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.628+0000 7feef4ff9640 1 -- 10.20.193.49:0/301628305 <== mon.2 v2:10.20.193.157:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7feeec0885b0 con 0x7feef80c89c0 2026-02-17T11:13:12.630 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.628+0000 7feef4ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:13:12.630 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.628+0000 7feef4ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:13:12.630 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:13:12.631 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:13:12.632 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.629+0000 7feefe4a9640 10 librados: watch_flush enter 2026-02-17T11:13:12.632 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.629+0000 7feefe4a9640 10 librados: watch_flush exit 2026-02-17T11:13:12.633 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.629+0000 7feefe4a9640 20 client.4901.objecter shutdown clearing up homeless session... 2026-02-17T11:13:12.633 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.629+0000 7feefe4a9640 10 client.4901.objecter successfully canceled tick 2026-02-17T11:13:12.633 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.629+0000 7feefe4a9640 1 -- 10.20.193.49:0/301628305 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7feec8079190 msgr2=0x7feec807b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:12.633 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.629+0000 7feefe4a9640 1 --2- 10.20.193.49:0/301628305 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7feec8079190 0x7feec807b650 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7feee4002770 tx=0x7feee4007ef0 comp rx=0 tx=0).stop 2026-02-17T11:13:12.633 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.629+0000 7feefe4a9640 10 monclient: shutdown 2026-02-17T11:13:12.633 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.629+0000 7feefe4a9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:13:12.633 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.629+0000 7feefe4a9640 1 -- 10.20.193.49:0/301628305 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7feef80c89c0 msgr2=0x7feef81468a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:12.633 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.629+0000 7feefe4a9640 1 --2- 10.20.193.49:0/301628305 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7feef80c89c0 0x7feef81468a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7feeec03a040 tx=0x7feeec004b40 comp rx=0 tx=0).stop 2026-02-17T11:13:12.633 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.629+0000 7feefe4a9640 1 -- 10.20.193.49:0/301628305 shutdown_connections 2026-02-17T11:13:12.633 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.629+0000 7feefe4a9640 1 --2- 10.20.193.49:0/301628305 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7feec8079190 0x7feec807b650 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:12.633 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.629+0000 7feefe4a9640 1 --2- 10.20.193.49:0/301628305 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7feef80c89c0 0x7feef81468a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:12.634 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.629+0000 7feefe4a9640 1 --2- 10.20.193.49:0/301628305 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7feef80c7550 0x7feef80c3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:12.634 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.629+0000 7feefe4a9640 1 --2- 10.20.193.49:0/301628305 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7feef80c7170 0x7feef81f5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:12.634 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.629+0000 7feefe4a9640 1 -- 10.20.193.49:0/301628305 >> 10.20.193.49:0/301628305 conn(0x7feef80c9f40 msgr2=0x7feef80cb2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:13:12.634 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.629+0000 7feefe4a9640 1 -- 10.20.193.49:0/301628305 shutdown_connections 2026-02-17T11:13:12.634 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.629+0000 7feefe4a9640 1 -- 10.20.193.49:0/301628305 wait complete. 2026-02-17T11:13:12.634 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:12.629+0000 7feefe4a9640 1 librados: shutdown 2026-02-17T11:13:15.641 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:13:15.709 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.706+0000 7f5f68703640 10 monclient: get_monmap_and_config 2026-02-17T11:13:15.709 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.706+0000 7f5f68703640 10 monclient: build_initial_monmap 2026-02-17T11:13:15.709 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.706+0000 7f5f68703640 10 monclient: monmap: 2026-02-17T11:13:15.709 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:13:15.710 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:15.710 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:13:15.707905+0000 2026-02-17T11:13:15.710 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:13:15.707905+0000 2026-02-17T11:13:15.710 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:13:15.710 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:15.710 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:13:15.710 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:13:15.710 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:13:15.710 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:13:15.710 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:13:15.710 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:13:15.710 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:15.711 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.706+0000 7f5f68703640 1 Processor -- start 2026-02-17T11:13:15.711 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.706+0000 7f5f68703640 1 -- start start 2026-02-17T11:13:15.711 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.706+0000 7f5f68703640 10 monclient: init 2026-02-17T11:13:15.715 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.707+0000 7f5f68703640 10 monclient: _reopen_session rank -1 2026-02-17T11:13:15.715 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.707+0000 7f5f68703640 10 monclient: _add_conns ranks=[0,1,2,3,4,5] 2026-02-17T11:13:15.715 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.707+0000 7f5f68703640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f5f6015f690 addr v1:10.20.193.49:6789/0 2026-02-17T11:13:15.715 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.707+0000 7f5f68703640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f5f6015fa70 addr v1:10.20.193.97:6789/0 2026-02-17T11:13:15.715 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.707+0000 7f5f68703640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f5f60072de0 addr v1:10.20.193.157:6789/0 2026-02-17T11:13:15.715 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.707+0000 7f5f68703640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f600732e0 con 0x7f5f6015f690 2026-02-17T11:13:15.715 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.707+0000 7f5f68703640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f600735c0 con 0x7f5f6015fa70 2026-02-17T11:13:15.715 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.707+0000 7f5f68703640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f600738a0 con 0x7f5f60072de0 2026-02-17T11:13:15.715 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.707+0000 7f5f68703640 10 monclient(hunting): _renew_subs 2026-02-17T11:13:15.715 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.707+0000 7f5f68703640 10 monclient(hunting): authenticate will time out at 1272.371502s 2026-02-17T11:13:15.715 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.707+0000 7f5f66478640 1 --1- >> v1:10.20.193.49:6789/0 conn(0x7f5f6015f690 0x7f5f600c9050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.49:6789/0 says I am v1:10.20.193.49:46346/0 (socket says 10.20.193.49:46346) 2026-02-17T11:13:15.715 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.707+0000 7f5f66478640 1 -- 10.20.193.49:0/3983613159 learned_addr learned my addr 10.20.193.49:0/3983613159 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:13:15.715 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.709+0000 7f5f65476640 1 -- 10.20.193.49:0/3983613159 <== mon.0 v1:10.20.193.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4147749809 0 0) 0x7f5f600732e0 con 0x7f5f6015f690 2026-02-17T11:13:15.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.709+0000 7f5f65476640 10 monclient(hunting): _negotiate 2026-02-17T11:13:15.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.709+0000 7f5f65476640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:15.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.709+0000 7f5f65476640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:15.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.709+0000 7f5f65476640 10 monclient(hunting): my global_id is 4908 2026-02-17T11:13:15.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.709+0000 7f5f65476640 1 -- 10.20.193.49:0/3983613159 --> v1:10.20.193.49:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f48003620 con 0x7f5f6015f690 2026-02-17T11:13:15.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.709+0000 7f5f65476640 1 -- 10.20.193.49:0/3983613159 <== mon.2 v1:10.20.193.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 434660577 0 0) 0x7f5f600738a0 con 0x7f5f60072de0 2026-02-17T11:13:15.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.709+0000 7f5f65476640 10 monclient(hunting): _negotiate 2026-02-17T11:13:15.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.709+0000 7f5f65476640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:15.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.709+0000 7f5f65476640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:15.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.709+0000 7f5f65476640 10 monclient(hunting): my global_id is 4904 2026-02-17T11:13:15.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.709+0000 7f5f65476640 1 -- 10.20.193.49:0/3983613159 --> v1:10.20.193.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f600732e0 con 0x7f5f60072de0 2026-02-17T11:13:15.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.709+0000 7f5f65476640 1 -- 10.20.193.49:0/3983613159 <== mon.1 v1:10.20.193.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 632353779 0 0) 0x7f5f600735c0 con 0x7f5f6015fa70 2026-02-17T11:13:15.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.709+0000 7f5f65476640 10 monclient(hunting): _negotiate 2026-02-17T11:13:15.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.709+0000 7f5f65476640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:15.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.709+0000 7f5f65476640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:15.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.709+0000 7f5f65476640 10 monclient(hunting): my global_id is 4861 2026-02-17T11:13:15.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.709+0000 7f5f65476640 1 -- 10.20.193.49:0/3983613159 --> v1:10.20.193.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f600738a0 con 0x7f5f6015fa70 2026-02-17T11:13:15.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.711+0000 7f5f65476640 1 -- 10.20.193.49:0/3983613159 <== mon.0 v1:10.20.193.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2497830804 0 0) 0x7f5f48003620 con 0x7f5f6015f690 2026-02-17T11:13:15.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.711+0000 7f5f65476640 1 -- 10.20.193.49:0/3983613159 >> v1:10.20.193.157:6789/0 conn(0x7f5f60072de0 legacy=0x7f5f6015d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:15.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.711+0000 7f5f65476640 1 -- 10.20.193.49:0/3983613159 >> v1:10.20.193.97:6789/0 conn(0x7f5f6015fa70 legacy=0x7f5f600726d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:15.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.711+0000 7f5f65476640 10 monclient: _finish_hunting 0 2026-02-17T11:13:15.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.711+0000 7f5f65476640 1 monclient: found mon.noname-a-legacy 2026-02-17T11:13:15.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.711+0000 7f5f65476640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:13:15.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.711+0000 7f5f65476640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.49:6789/0 2026-02-17T11:13:15.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.711+0000 7f5f65476640 1 -- 10.20.193.49:0/3983613159 --> v1:10.20.193.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f60073b80 con 0x7f5f6015f690 2026-02-17T11:13:15.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.711+0000 7f5f65476640 10 monclient: _finish_auth 0 2026-02-17T11:13:15.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.711+0000 7f5f65476640 10 monclient: _check_auth_tickets 2026-02-17T11:13:15.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.711+0000 7f5f65476640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:13:15.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.711+0000 7f5f65476640 1 -- 10.20.193.49:0/3983613159 <== mon.0 v1:10.20.193.49:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2462710995 0 0) 0x7f5f50002f00 con 0x7f5f6015f690 2026-02-17T11:13:15.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.711+0000 7f5f68703640 5 monclient: authenticate success, global_id 4908 2026-02-17T11:13:15.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.711+0000 7f5f68703640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:13:15.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.711+0000 7f5f65476640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:15.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.711+0000 7f5f65476640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T11:13:15.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.711+0000 7f5f65476640 10 monclient: dump: 2026-02-17T11:13:15.716 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:15.716 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:15.716 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:15.716 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:15.716 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:15.716 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:15.716 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:15.716 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:15.717 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:15.717 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:15.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.711+0000 7f5f65476640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] but i'm connected to v1:10.20.193.49:6789/0, reconnecting 2026-02-17T11:13:15.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.711+0000 7f5f65476640 10 monclient: _reopen_session rank -1 2026-02-17T11:13:15.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.711+0000 7f5f65476640 1 -- 10.20.193.49:0/3983613159 >> v1:10.20.193.49:6789/0 conn(0x7f5f6015f690 legacy=0x7f5f600c9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:15.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.711+0000 7f5f65476640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:13:15.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.711+0000 7f5f65476640 1 --2- 10.20.193.49:0/3983613159 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5f48003fe0 0x7f5f48004900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:15.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.711+0000 7f5f65476640 10 monclient(hunting): picked mon.a con 0x7f5f48003fe0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:13:15.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.711+0000 7f5f65476640 1 --2- 10.20.193.49:0/3983613159 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5f48004e40 0x7f5f480052c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:15.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.711+0000 7f5f65476640 10 monclient(hunting): picked mon.c con 0x7f5f48004e40 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:13:15.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.711+0000 7f5f65476640 1 --2- 10.20.193.49:0/3983613159 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5f48009ab0 0x7f5f4800bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:15.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.711+0000 7f5f65476640 10 monclient(hunting): picked mon.b con 0x7f5f48009ab0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:13:15.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.711+0000 7f5f65476640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:15.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.711+0000 7f5f65476640 1 -- 10.20.193.49:0/3983613159 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5f4800c5c0 con 0x7f5f48003fe0 2026-02-17T11:13:15.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.711+0000 7f5f65476640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:15.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.711+0000 7f5f65476640 1 -- 10.20.193.49:0/3983613159 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f5f4800c770 con 0x7f5f48009ab0 2026-02-17T11:13:15.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.711+0000 7f5f65476640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:15.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.711+0000 7f5f65476640 1 -- 10.20.193.49:0/3983613159 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f5f4800c970 con 0x7f5f48004e40 2026-02-17T11:13:15.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.711+0000 7f5f65476640 10 monclient(hunting): _renew_subs 2026-02-17T11:13:15.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.711+0000 7f5f65476640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:13:15.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.711+0000 7f5f68703640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2026-02-17T11:13:15.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.712+0000 7f5f65c77640 1 --2- 10.20.193.49:0/3983613159 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5f48004e40 0x7f5f480052c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:15.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.712+0000 7f5f66478640 1 --2- 10.20.193.49:0/3983613159 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5f48003fe0 0x7f5f48004900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:15.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.712+0000 7f5f66478640 10 monclient(hunting): get_auth_request con 0x7f5f48003fe0 auth_method 0 2026-02-17T11:13:15.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.712+0000 7f5f66478640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:15.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.712+0000 7f5f66478640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:15.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.712+0000 7f5f66478640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:13:15.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.712+0000 7f5f66c79640 1 --2- 10.20.193.49:0/3983613159 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5f48009ab0 0x7f5f4800bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:15.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.712+0000 7f5f65c77640 10 monclient(hunting): get_auth_request con 0x7f5f48004e40 auth_method 0 2026-02-17T11:13:15.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.712+0000 7f5f65c77640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:15.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.712+0000 7f5f65c77640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:15.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.712+0000 7f5f65c77640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:13:15.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.712+0000 7f5f66c79640 10 monclient(hunting): get_auth_request con 0x7f5f48009ab0 auth_method 0 2026-02-17T11:13:15.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.712+0000 7f5f66c79640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:15.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.712+0000 7f5f66c79640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:15.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.712+0000 7f5f66c79640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:13:15.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.712+0000 7f5f66478640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:15.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.712+0000 7f5f66478640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:15.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.712+0000 7f5f66478640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:13:15.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.713+0000 7f5f65c77640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:15.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.713+0000 7f5f65c77640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:15.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.713+0000 7f5f65c77640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:13:15.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.713+0000 7f5f66c79640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:15.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.713+0000 7f5f66c79640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:15.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.713+0000 7f5f66c79640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:13:15.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.713+0000 7f5f66478640 10 monclient(hunting): handle_auth_done global_id 4908 payload 293 2026-02-17T11:13:15.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.713+0000 7f5f66478640 1 -- 10.20.193.49:0/3983613159 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5f48004e40 msgr2=0x7f5f480052c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:13:15.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.713+0000 7f5f66478640 1 --2- 10.20.193.49:0/3983613159 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5f48004e40 0x7f5f480052c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:15.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.713+0000 7f5f66478640 1 -- 10.20.193.49:0/3983613159 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5f48009ab0 msgr2=0x7f5f4800bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:13:15.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.713+0000 7f5f66478640 1 --2- 10.20.193.49:0/3983613159 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5f48009ab0 0x7f5f4800bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:15.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.713+0000 7f5f66478640 10 monclient: _finish_hunting 0 2026-02-17T11:13:15.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.713+0000 7f5f66478640 1 monclient: found mon.a 2026-02-17T11:13:15.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.713+0000 7f5f66478640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:13:15.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.713+0000 7f5f66c79640 1 -- 10.20.193.49:0/3983613159 reap_dead start 2026-02-17T11:13:15.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.713+0000 7f5f66478640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:13:15.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.713+0000 7f5f66478640 1 -- 10.20.193.49:0/3983613159 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f48003620 con 0x7f5f48003fe0 2026-02-17T11:13:15.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.713+0000 7f5f66478640 10 monclient: _finish_auth 0 2026-02-17T11:13:15.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.713+0000 7f5f66478640 10 monclient: _check_auth_tickets 2026-02-17T11:13:15.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.713+0000 7f5f66478640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:13:15.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.714+0000 7f5f66478640 1 --2- 10.20.193.49:0/3983613159 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5f48003fe0 0x7f5f48004900 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5f5000c1c0 tx=0x7f5f5002f540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=259fd97e2c810250 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:13:15.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.716+0000 7f5f65476640 1 -- 10.20.193.49:0/3983613159 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f50007d00 con 0x7f5f48003fe0 2026-02-17T11:13:15.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.716+0000 7f5f65476640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:15.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.716+0000 7f5f65476640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:13:15.719 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.716+0000 7f5f65476640 10 monclient: dump: 2026-02-17T11:13:15.719 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:15.719 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:15.719 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:15.719 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:15.719 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:15.719 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:15.719 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:15.719 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:15.719 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:15.719 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:15.719 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.716+0000 7f5f65476640 1 -- 10.20.193.49:0/3983613159 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f50005bf0 con 0x7f5f48003fe0 2026-02-17T11:13:15.719 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.716+0000 7f5f68703640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:13:15.719 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.716+0000 7f5f65476640 10 monclient: handle_config config(0 keys) 2026-02-17T11:13:15.719 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.716+0000 7f5f65476640 1 -- 10.20.193.49:0/3983613159 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f50007070 con 0x7f5f48003fe0 2026-02-17T11:13:15.719 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.716+0000 7f5f65476640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:15.719 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.716+0000 7f5f65476640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:13:15.719 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.716+0000 7f5f65476640 10 monclient: dump: 2026-02-17T11:13:15.719 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:15.719 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:15.719 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:15.719 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:15.719 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:15.719 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:15.719 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:15.719 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:15.719 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:15.719 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:15.719 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.716+0000 7f5f68703640 10 monclient: get_monmap_and_config success 2026-02-17T11:13:15.719 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.716+0000 7f5f68703640 4 set_mon_vals no callback set 2026-02-17T11:13:15.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.716+0000 7f5f68703640 10 monclient: shutdown 2026-02-17T11:13:15.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.716+0000 7f5f68703640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:13:15.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.716+0000 7f5f68703640 1 -- 10.20.193.49:0/3983613159 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5f48003fe0 msgr2=0x7f5f48004900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:15.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.716+0000 7f5f68703640 1 --2- 10.20.193.49:0/3983613159 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5f48003fe0 0x7f5f48004900 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5f5000c1c0 tx=0x7f5f5002f540 comp rx=0 tx=0).stop 2026-02-17T11:13:15.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.716+0000 7f5f68703640 1 -- 10.20.193.49:0/3983613159 shutdown_connections 2026-02-17T11:13:15.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.716+0000 7f5f68703640 1 --2- 10.20.193.49:0/3983613159 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5f48003fe0 0x7f5f48004900 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:15.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.716+0000 7f5f68703640 1 -- 10.20.193.49:0/3983613159 >> 10.20.193.49:0/3983613159 conn(0x7f5f600c9f20 msgr2=0x7f5f600ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:13:15.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.716+0000 7f5f68703640 1 -- 10.20.193.49:0/3983613159 shutdown_connections 2026-02-17T11:13:15.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.716+0000 7f5f68703640 1 -- 10.20.193.49:0/3983613159 wait complete. 2026-02-17T11:13:15.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.717+0000 7f5f68703640 10 monclient: build_initial_monmap 2026-02-17T11:13:15.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.717+0000 7f5f68703640 10 monclient: monmap: 2026-02-17T11:13:15.720 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:13:15.720 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:13:15.720 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:13:15.720 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:13:15.720 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:13:15.720 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:15.720 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:13:15.720 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:13:15.720 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:13:15.720 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:15.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.717+0000 7f5f68703640 1 librados: starting msgr at 2026-02-17T11:13:15.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.717+0000 7f5f68703640 1 librados: starting objecter 2026-02-17T11:13:15.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.717+0000 7f5f68703640 1 Processor -- start 2026-02-17T11:13:15.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.717+0000 7f5f68703640 1 -- start start 2026-02-17T11:13:15.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.717+0000 7f5f68703640 1 librados: setting wanted keys 2026-02-17T11:13:15.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.717+0000 7f5f68703640 1 librados: calling monclient init 2026-02-17T11:13:15.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.717+0000 7f5f68703640 10 monclient: init 2026-02-17T11:13:15.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.717+0000 7f5f68703640 10 monclient: _reopen_session rank -1 2026-02-17T11:13:15.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.717+0000 7f5f68703640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:13:15.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.718+0000 7f5f68703640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5f48003fe0 0x7f5f6015c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:15.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.718+0000 7f5f68703640 10 monclient(hunting): picked mon.noname-a con 0x7f5f48003fe0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:13:15.721 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.718+0000 7f5f68703640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5f6015ce20 0x7f5f6006e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:15.721 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.718+0000 7f5f68703640 10 monclient(hunting): picked mon.noname-b con 0x7f5f6015ce20 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:13:15.721 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.718+0000 7f5f68703640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5f6006ea80 0x7f5f60159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:15.721 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.718+0000 7f5f68703640 10 monclient(hunting): picked mon.noname-c con 0x7f5f6006ea80 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:13:15.721 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.718+0000 7f5f68703640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:15.721 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.718+0000 7f5f68703640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5f60072850 con 0x7f5f48003fe0 2026-02-17T11:13:15.721 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.718+0000 7f5f68703640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:15.721 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.718+0000 7f5f68703640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f5f600726d0 con 0x7f5f6015ce20 2026-02-17T11:13:15.721 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.718+0000 7f5f68703640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:15.721 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.718+0000 7f5f68703640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f5f600729d0 con 0x7f5f6006ea80 2026-02-17T11:13:15.721 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.718+0000 7f5f68703640 10 monclient(hunting): _renew_subs 2026-02-17T11:13:15.721 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.718+0000 7f5f68703640 10 monclient(hunting): authenticate will time out at 1272.382034s 2026-02-17T11:13:15.721 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.718+0000 7f5f66478640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5f48003fe0 0x7f5f6015c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:15.721 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.718+0000 7f5f66c79640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5f6006ea80 0x7f5f60159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:15.721 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.718+0000 7f5f65c77640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5f6015ce20 0x7f5f6006e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:15.721 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.718+0000 7f5f66478640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5f48003fe0 0x7f5f6015c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:46644/0 (socket says 10.20.193.49:46644) 2026-02-17T11:13:15.721 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.718+0000 7f5f66478640 1 -- 10.20.193.49:0/2566050954 learned_addr learned my addr 10.20.193.49:0/2566050954 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:13:15.721 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.718+0000 7f5f66478640 10 monclient(hunting): get_auth_request con 0x7f5f48003fe0 auth_method 0 2026-02-17T11:13:15.721 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.718+0000 7f5f66478640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:15.721 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.718+0000 7f5f66478640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:15.721 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.718+0000 7f5f66478640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:15.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.718+0000 7f5f65c77640 10 monclient(hunting): get_auth_request con 0x7f5f6015ce20 auth_method 0 2026-02-17T11:13:15.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.718+0000 7f5f65c77640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:15.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.718+0000 7f5f65c77640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:15.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.718+0000 7f5f65c77640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:15.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.718+0000 7f5f66c79640 10 monclient(hunting): get_auth_request con 0x7f5f6006ea80 auth_method 0 2026-02-17T11:13:15.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.718+0000 7f5f66c79640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:15.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.718+0000 7f5f66c79640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:15.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.718+0000 7f5f66c79640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:15.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.718+0000 7f5f65c77640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:15.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.718+0000 7f5f65c77640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:15.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.718+0000 7f5f65c77640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:15.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.718+0000 7f5f66478640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:15.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.718+0000 7f5f66478640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:15.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.718+0000 7f5f66478640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:15.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.718+0000 7f5f66c79640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:15.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.718+0000 7f5f66c79640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:15.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.718+0000 7f5f66c79640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:15.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.720+0000 7f5f65c77640 10 monclient(hunting): handle_auth_done global_id 4864 payload 824 2026-02-17T11:13:15.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.720+0000 7f5f65c77640 1 -- 10.20.193.49:0/2566050954 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5f6006ea80 msgr2=0x7f5f60159ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:15.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.720+0000 7f5f65c77640 1 --2- 10.20.193.49:0/2566050954 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5f6006ea80 0x7f5f60159ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:15.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.720+0000 7f5f65c77640 1 -- 10.20.193.49:0/2566050954 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5f48003fe0 msgr2=0x7f5f6015c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:15.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.720+0000 7f5f65c77640 1 --2- 10.20.193.49:0/2566050954 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5f48003fe0 0x7f5f6015c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:15.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.720+0000 7f5f65c77640 10 monclient: _finish_hunting 0 2026-02-17T11:13:15.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.720+0000 7f5f65c77640 1 monclient: found mon.noname-b 2026-02-17T11:13:15.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.720+0000 7f5f65c77640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:13:15.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.720+0000 7f5f65c77640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:13:15.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.720+0000 7f5f65c77640 1 -- 10.20.193.49:0/2566050954 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f601f4550 con 0x7f5f6015ce20 2026-02-17T11:13:15.723 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.721+0000 7f5f65c77640 1 --2- 10.20.193.49:0/2566050954 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5f6015ce20 0x7f5f6006e540 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5f6006a6b0 tx=0x7f5f5400ef80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:13:15.723 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.721+0000 7f5f46ffd640 10 client.?.objecter ms_handle_connect 0x7f5f6015ce20 2026-02-17T11:13:15.723 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.721+0000 7f5f46ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:13:15.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.723+0000 7f5f46ffd640 1 -- 10.20.193.49:0/2566050954 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f5400c870 con 0x7f5f6015ce20 2026-02-17T11:13:15.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.723+0000 7f5f46ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:15.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.723+0000 7f5f46ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:13:15.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.723+0000 7f5f46ffd640 10 monclient: dump: 2026-02-17T11:13:15.725 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:15.725 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:15.725 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:15.725 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:15.725 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:15.725 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:15.725 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:15.725 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:15.725 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:15.725 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:15.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.723+0000 7f5f46ffd640 10 monclient: _finish_auth 0 2026-02-17T11:13:15.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.723+0000 7f5f46ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:13:15.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.723+0000 7f5f46ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:13:15.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.723+0000 7f5f46ffd640 1 -- 10.20.193.49:0/2566050954 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f5401a070 con 0x7f5f6015ce20 2026-02-17T11:13:15.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.723+0000 7f5f46ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:13:15.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.723+0000 7f5f46ffd640 1 -- 10.20.193.49:0/2566050954 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f5400cc50 con 0x7f5f6015ce20 2026-02-17T11:13:15.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.723+0000 7f5f46ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:15.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.723+0000 7f5f46ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:13:15.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.723+0000 7f5f64c75640 4 set_mon_vals no callback set 2026-02-17T11:13:15.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.723+0000 7f5f46ffd640 10 monclient: dump: 2026-02-17T11:13:15.726 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:15.726 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:15.726 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:15.726 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:15.726 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:15.726 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:15.726 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:15.726 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:15.726 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:15.726 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:15.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.723+0000 7f5f68703640 5 monclient: authenticate success, global_id 4864 2026-02-17T11:13:15.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.723+0000 7f5f68703640 10 monclient: _renew_subs 2026-02-17T11:13:15.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.723+0000 7f5f68703640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:13:15.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.723+0000 7f5f68703640 1 -- 10.20.193.49:0/2566050954 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f601f4b90 con 0x7f5f6015ce20 2026-02-17T11:13:15.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.723+0000 7f5f68703640 10 client.4864.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:13:15.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.723+0000 7f5f68703640 10 monclient: _renew_subs 2026-02-17T11:13:15.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.723+0000 7f5f68703640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:13:15.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.723+0000 7f5f68703640 1 -- 10.20.193.49:0/2566050954 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f6015ad10 con 0x7f5f6015ce20 2026-02-17T11:13:15.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.723+0000 7f5f68703640 1 librados: init done 2026-02-17T11:13:15.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.723+0000 7f5f68703640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:13:15.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.723+0000 7f5f68703640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:13:15.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.723+0000 7f5f68703640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:13:15.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.723+0000 7f5f68703640 1 -- 10.20.193.49:0/2566050954 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f600c9050 con 0x7f5f6015ce20 2026-02-17T11:13:15.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.735+0000 7f5f46ffd640 1 -- 10.20.193.49:0/2566050954 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f5f54014070 con 0x7f5f6015ce20 2026-02-17T11:13:15.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.735+0000 7f5f46ffd640 1 --2- 10.20.193.49:0/2566050954 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5f30079190 0x7f5f3007b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:15.738 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.736+0000 7f5f66478640 1 --2- 10.20.193.49:0/2566050954 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5f30079190 0x7f5f3007b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:15.738 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.736+0000 7f5f66478640 10 monclient: get_auth_request con 0x7f5f30079190 auth_method 0 2026-02-17T11:13:15.738 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.736+0000 7f5f66478640 1 --2- 10.20.193.49:0/2566050954 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5f30079190 0x7f5f3007b650 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5f6014bc60 tx=0x7f5f50009070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:13:15.738 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.736+0000 7f5f46ffd640 10 client.4864.objecter ms_handle_connect 0x7f5f30079190 2026-02-17T11:13:15.739 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.738+0000 7f5f46ffd640 1 -- 10.20.193.49:0/2566050954 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f5f5400cdf0 con 0x7f5f6015ce20 2026-02-17T11:13:15.739 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.738+0000 7f5f46ffd640 10 client.4864.objecter ms_dispatch2 0x7f5f60000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:13:15.739 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.738+0000 7f5f46ffd640 3 client.4864.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:13:15.739 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.738+0000 7f5f46ffd640 3 client.4864.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:13:15.739 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.738+0000 7f5f46ffd640 20 client.4864.objecter dump_active .. 0 homeless 2026-02-17T11:13:15.840 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.838+0000 7f5f46ffd640 1 -- 10.20.193.49:0/2566050954 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f5f54063360 con 0x7f5f6015ce20 2026-02-17T11:13:15.840 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.838+0000 7f5f46ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:13:15.840 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.838+0000 7f5f46ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:13:15.941 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.939+0000 7f5f68703640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:13:15.941 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.939+0000 7f5f68703640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:13:15.941 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.939+0000 7f5f68703640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:13:15.941 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.939+0000 7f5f68703640 1 -- 10.20.193.49:0/2566050954 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f5f6015deb0 con 0x7f5f6015ce20 2026-02-17T11:13:15.944 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.943+0000 7f5f46ffd640 1 -- 10.20.193.49:0/2566050954 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f5f54062c60 con 0x7f5f6015ce20 2026-02-17T11:13:15.944 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.943+0000 7f5f46ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:13:15.944 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.943+0000 7f5f46ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:13:15.944 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:13:15.944 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:13:15.946 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.943+0000 7f5f68703640 10 librados: watch_flush enter 2026-02-17T11:13:15.946 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.943+0000 7f5f68703640 10 librados: watch_flush exit 2026-02-17T11:13:15.946 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.943+0000 7f5f68703640 20 client.4864.objecter shutdown clearing up homeless session... 2026-02-17T11:13:15.946 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.943+0000 7f5f68703640 10 client.4864.objecter successfully canceled tick 2026-02-17T11:13:15.946 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.943+0000 7f5f68703640 1 -- 10.20.193.49:0/2566050954 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5f30079190 msgr2=0x7f5f3007b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:15.946 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.943+0000 7f5f68703640 1 --2- 10.20.193.49:0/2566050954 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5f30079190 0x7f5f3007b650 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5f6014bc60 tx=0x7f5f50009070 comp rx=0 tx=0).stop 2026-02-17T11:13:15.946 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.943+0000 7f5f68703640 10 monclient: shutdown 2026-02-17T11:13:15.946 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.943+0000 7f5f68703640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:13:15.946 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.943+0000 7f5f68703640 1 -- 10.20.193.49:0/2566050954 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5f6015ce20 msgr2=0x7f5f6006e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:15.946 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.943+0000 7f5f68703640 1 --2- 10.20.193.49:0/2566050954 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5f6015ce20 0x7f5f6006e540 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5f6006a6b0 tx=0x7f5f5400ef80 comp rx=0 tx=0).stop 2026-02-17T11:13:15.946 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.943+0000 7f5f68703640 1 -- 10.20.193.49:0/2566050954 shutdown_connections 2026-02-17T11:13:15.946 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.943+0000 7f5f68703640 1 --2- 10.20.193.49:0/2566050954 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5f30079190 0x7f5f3007b650 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:15.946 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.943+0000 7f5f68703640 1 --2- 10.20.193.49:0/2566050954 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5f6006ea80 0x7f5f60159ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:15.946 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.943+0000 7f5f68703640 1 --2- 10.20.193.49:0/2566050954 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5f6015ce20 0x7f5f6006e540 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:15.946 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.943+0000 7f5f68703640 1 --2- 10.20.193.49:0/2566050954 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5f48003fe0 0x7f5f6015c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:15.946 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.943+0000 7f5f68703640 1 -- 10.20.193.49:0/2566050954 >> 10.20.193.49:0/2566050954 conn(0x7f5f600c9f20 msgr2=0x7f5f60155470 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:13:15.946 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.943+0000 7f5f68703640 1 -- 10.20.193.49:0/2566050954 shutdown_connections 2026-02-17T11:13:15.946 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.943+0000 7f5f68703640 1 -- 10.20.193.49:0/2566050954 wait complete. 2026-02-17T11:13:15.946 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:15.944+0000 7f5f68703640 1 librados: shutdown 2026-02-17T11:13:18.955 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:13:19.022 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.020+0000 7fad670db640 10 monclient: get_monmap_and_config 2026-02-17T11:13:19.023 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.020+0000 7fad670db640 10 monclient: build_initial_monmap 2026-02-17T11:13:19.023 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.020+0000 7fad670db640 10 monclient: monmap: 2026-02-17T11:13:19.023 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:13:19.023 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:19.023 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:13:19.021835+0000 2026-02-17T11:13:19.023 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:13:19.021835+0000 2026-02-17T11:13:19.023 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:13:19.023 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:19.023 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:13:19.023 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:13:19.023 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:13:19.024 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:13:19.024 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:13:19.024 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:13:19.024 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:19.026 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.020+0000 7fad670db640 1 Processor -- start 2026-02-17T11:13:19.026 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.020+0000 7fad670db640 1 -- start start 2026-02-17T11:13:19.027 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.020+0000 7fad670db640 10 monclient: init 2026-02-17T11:13:19.027 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.021+0000 7fad670db640 10 monclient: _reopen_session rank -1 2026-02-17T11:13:19.027 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.021+0000 7fad670db640 10 monclient: _add_conns ranks=[1,3,4,5,2,0] 2026-02-17T11:13:19.027 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.021+0000 7fad670db640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fad60150230 addr v1:10.20.193.97:6789/0 2026-02-17T11:13:19.027 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.021+0000 7fad670db640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fad600c9b90 0x7fad6006f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:19.027 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.021+0000 7fad670db640 10 monclient(hunting): picked mon.noname-a con 0x7fad600c9b90 addr v2:10.20.193.49:3300/0 2026-02-17T11:13:19.027 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.021+0000 7fad670db640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7fad60150610 0x7fad600c6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:19.027 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.021+0000 7fad670db640 10 monclient(hunting): picked mon.noname-b con 0x7fad60150610 addr v2:10.20.193.97:3300/0 2026-02-17T11:13:19.027 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.021+0000 7fad670db640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad6015a8f0 con 0x7fad60150230 2026-02-17T11:13:19.027 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.021+0000 7fad670db640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:19.027 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.021+0000 7fad670db640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7fad6006f8a0 con 0x7fad600c9b90 2026-02-17T11:13:19.027 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.021+0000 7fad670db640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:19.028 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.021+0000 7fad670db640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7fad600c83e0 con 0x7fad60150610 2026-02-17T11:13:19.028 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.021+0000 7fad670db640 10 monclient(hunting): _renew_subs 2026-02-17T11:13:19.028 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.021+0000 7fad670db640 10 monclient(hunting): authenticate will time out at 1275.685488s 2026-02-17T11:13:19.028 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.022+0000 7fad57fff640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fad600c9b90 0x7fad6006f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:19.028 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.022+0000 7fad57fff640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fad600c9b90 0x7fad6006f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:56390/0 (socket says 10.20.193.49:56390) 2026-02-17T11:13:19.028 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.022+0000 7fad57fff640 1 -- 10.20.193.49:0/497634117 learned_addr learned my addr 10.20.193.49:0/497634117 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:13:19.028 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.022+0000 7fad57fff640 10 monclient(hunting): get_auth_request con 0x7fad600c9b90 auth_method 0 2026-02-17T11:13:19.028 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.022+0000 7fad57fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:19.028 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.022+0000 7fad57fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:19.028 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.022+0000 7fad57fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:19.028 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.023+0000 7fad57fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:19.028 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.023+0000 7fad57fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:19.029 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.023+0000 7fad57fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:19.029 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.023+0000 7fad65651640 1 --2- 10.20.193.49:0/497634117 >> v2:10.20.193.97:3300/0 conn(0x7fad60150610 0x7fad600c6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:19.029 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.023+0000 7fad65651640 10 monclient(hunting): get_auth_request con 0x7fad60150610 auth_method 0 2026-02-17T11:13:19.029 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.023+0000 7fad65651640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:19.029 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.023+0000 7fad65651640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:19.029 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.023+0000 7fad65651640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:19.029 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.024+0000 7fad57fff640 10 monclient(hunting): handle_auth_done global_id 4914 payload 274 2026-02-17T11:13:19.029 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.024+0000 7fad57fff640 1 -- 10.20.193.49:0/497634117 >> v2:10.20.193.97:3300/0 conn(0x7fad60150610 msgr2=0x7fad600c6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:13:19.029 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.024+0000 7fad57fff640 1 --2- 10.20.193.49:0/497634117 >> v2:10.20.193.97:3300/0 conn(0x7fad60150610 0x7fad600c6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:19.029 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.024+0000 7fad57fff640 1 -- 10.20.193.49:0/497634117 >> v1:10.20.193.97:6789/0 conn(0x7fad60150230 legacy=0x7fad600c9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:13:19.029 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.024+0000 7fad57fff640 10 monclient: _finish_hunting 0 2026-02-17T11:13:19.029 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.024+0000 7fad57fff640 1 monclient: found mon.noname-a 2026-02-17T11:13:19.030 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.024+0000 7fad57fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:13:19.030 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.024+0000 7fad57fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:13:19.030 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.024+0000 7fad57fff640 1 -- 10.20.193.49:0/497634117 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad600c86c0 con 0x7fad600c9b90 2026-02-17T11:13:19.034 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.025+0000 7fad57fff640 1 --2- 10.20.193.49:0/497634117 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fad600c9b90 0x7fad6006f360 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fad600713d0 tx=0x7fad4802ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=468919d98bdd1452 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:13:19.034 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.027+0000 7fad577fe640 1 -- 10.20.193.49:0/497634117 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad4803c070 con 0x7fad600c9b90 2026-02-17T11:13:19.034 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.027+0000 7fad577fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:19.034 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.027+0000 7fad577fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:13:19.034 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.027+0000 7fad577fe640 10 monclient: dump: 2026-02-17T11:13:19.034 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:19.034 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:19.034 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:19.034 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:19.034 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:19.034 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:19.035 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:19.035 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:19.035 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:19.035 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:19.035 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.027+0000 7fad577fe640 10 monclient: _finish_auth 0 2026-02-17T11:13:19.035 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.027+0000 7fad577fe640 10 monclient: _check_auth_tickets 2026-02-17T11:13:19.035 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.027+0000 7fad577fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:13:19.035 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.027+0000 7fad670db640 5 monclient: authenticate success, global_id 4914 2026-02-17T11:13:19.035 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.027+0000 7fad670db640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:13:19.035 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.028+0000 7fad577fe640 1 -- 10.20.193.49:0/497634117 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad4802fbd0 con 0x7fad600c9b90 2026-02-17T11:13:19.035 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.028+0000 7fad577fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:13:19.035 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.028+0000 7fad577fe640 1 -- 10.20.193.49:0/497634117 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad48037440 con 0x7fad600c9b90 2026-02-17T11:13:19.036 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.028+0000 7fad670db640 10 monclient: get_monmap_and_config success 2026-02-17T11:13:19.036 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.028+0000 7fad670db640 4 set_mon_vals no callback set 2026-02-17T11:13:19.036 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.028+0000 7fad577fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:19.036 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.028+0000 7fad577fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:13:19.036 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.028+0000 7fad577fe640 10 monclient: dump: 2026-02-17T11:13:19.036 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:19.036 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:19.036 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:19.036 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:19.036 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:19.036 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:19.036 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:19.037 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:19.037 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:19.037 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:19.037 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.028+0000 7fad670db640 10 monclient: shutdown 2026-02-17T11:13:19.037 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.028+0000 7fad670db640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:13:19.037 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.028+0000 7fad670db640 1 -- 10.20.193.49:0/497634117 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fad600c9b90 msgr2=0x7fad6006f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:19.037 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.028+0000 7fad670db640 1 --2- 10.20.193.49:0/497634117 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fad600c9b90 0x7fad6006f360 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fad600713d0 tx=0x7fad4802ef60 comp rx=0 tx=0).stop 2026-02-17T11:13:19.037 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.028+0000 7fad670db640 1 -- 10.20.193.49:0/497634117 shutdown_connections 2026-02-17T11:13:19.037 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.028+0000 7fad670db640 1 --2- 10.20.193.49:0/497634117 >> v2:10.20.193.97:3300/0 conn(0x7fad60150610 0x7fad600c6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:19.037 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.028+0000 7fad670db640 1 --2- 10.20.193.49:0/497634117 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fad600c9b90 0x7fad6006f360 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:19.037 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.028+0000 7fad670db640 1 -- 10.20.193.49:0/497634117 >> 10.20.193.49:0/497634117 conn(0x7fad600ca2e0 msgr2=0x7fad600ca6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:13:19.037 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.028+0000 7fad670db640 1 -- 10.20.193.49:0/497634117 shutdown_connections 2026-02-17T11:13:19.038 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.028+0000 7fad670db640 1 -- 10.20.193.49:0/497634117 wait complete. 2026-02-17T11:13:19.038 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.029+0000 7fad670db640 10 monclient: build_initial_monmap 2026-02-17T11:13:19.038 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.029+0000 7fad670db640 10 monclient: monmap: 2026-02-17T11:13:19.038 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:13:19.038 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:13:19.038 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:13:19.038 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:13:19.038 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:13:19.038 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:19.038 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:13:19.038 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:13:19.038 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:13:19.038 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:19.039 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.029+0000 7fad670db640 1 librados: starting msgr at 2026-02-17T11:13:19.039 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.029+0000 7fad670db640 1 librados: starting objecter 2026-02-17T11:13:19.039 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.029+0000 7fad670db640 1 Processor -- start 2026-02-17T11:13:19.039 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.029+0000 7fad670db640 1 -- start start 2026-02-17T11:13:19.039 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.029+0000 7fad670db640 1 librados: setting wanted keys 2026-02-17T11:13:19.039 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.029+0000 7fad670db640 1 librados: calling monclient init 2026-02-17T11:13:19.039 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.029+0000 7fad670db640 10 monclient: init 2026-02-17T11:13:19.039 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.030+0000 7fad670db640 10 monclient: _reopen_session rank -1 2026-02-17T11:13:19.039 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.030+0000 7fad670db640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:13:19.039 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.030+0000 7fad670db640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fad600c9b90 0x7fad601f4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:19.039 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.030+0000 7fad670db640 10 monclient(hunting): picked mon.noname-c con 0x7fad600c9b90 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:13:19.039 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.030+0000 7fad670db640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fad60150230 0x7fad60074320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:19.040 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.030+0000 7fad670db640 10 monclient(hunting): picked mon.noname-a con 0x7fad60150230 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:13:19.040 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.030+0000 7fad670db640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fad60150610 0x7fad6014b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:19.040 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.030+0000 7fad670db640 10 monclient(hunting): picked mon.noname-b con 0x7fad60150610 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:13:19.040 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.030+0000 7fad670db640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:19.040 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.030+0000 7fad670db640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fad600c8f60 con 0x7fad60150230 2026-02-17T11:13:19.040 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.030+0000 7fad670db640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:19.040 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.030+0000 7fad670db640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fad600c8c80 con 0x7fad60150610 2026-02-17T11:13:19.040 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.030+0000 7fad670db640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:19.040 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.030+0000 7fad670db640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fad600c74b0 con 0x7fad600c9b90 2026-02-17T11:13:19.040 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.030+0000 7fad670db640 10 monclient(hunting): _renew_subs 2026-02-17T11:13:19.040 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.030+0000 7fad670db640 10 monclient(hunting): authenticate will time out at 1275.694193s 2026-02-17T11:13:19.040 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.030+0000 7fad65651640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fad60150610 0x7fad6014b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:19.040 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.030+0000 7fad64e50640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fad600c9b90 0x7fad601f4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:19.041 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.030+0000 7fad65651640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fad60150610 0x7fad6014b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:38452/0 (socket says 10.20.193.49:38452) 2026-02-17T11:13:19.041 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.030+0000 7fad65651640 1 -- 10.20.193.49:0/2064223694 learned_addr learned my addr 10.20.193.49:0/2064223694 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:13:19.041 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.030+0000 7fad65651640 10 monclient(hunting): get_auth_request con 0x7fad60150610 auth_method 0 2026-02-17T11:13:19.041 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.030+0000 7fad65651640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:19.041 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.030+0000 7fad65651640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:19.041 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.030+0000 7fad65651640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:19.041 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.030+0000 7fad64e50640 10 monclient(hunting): get_auth_request con 0x7fad600c9b90 auth_method 0 2026-02-17T11:13:19.041 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.030+0000 7fad64e50640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:19.041 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.030+0000 7fad64e50640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:19.041 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.030+0000 7fad64e50640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:19.041 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.031+0000 7fad65651640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:19.041 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.031+0000 7fad65651640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:19.042 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.031+0000 7fad65651640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:19.042 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.031+0000 7fad64e50640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:19.042 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.031+0000 7fad64e50640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:19.042 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.031+0000 7fad64e50640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:19.045 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.032+0000 7fad65651640 10 monclient(hunting): handle_auth_done global_id 4870 payload 824 2026-02-17T11:13:19.045 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.032+0000 7fad65651640 1 -- 10.20.193.49:0/2064223694 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fad600c9b90 msgr2=0x7fad601f4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:19.045 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.032+0000 7fad65651640 1 --2- 10.20.193.49:0/2064223694 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fad600c9b90 0x7fad601f4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:19.045 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.032+0000 7fad65651640 1 -- 10.20.193.49:0/2064223694 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fad60150230 msgr2=0x7fad60074320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:19.045 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.032+0000 7fad65651640 1 --2- 10.20.193.49:0/2064223694 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fad60150230 0x7fad60074320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:19.045 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.032+0000 7fad65651640 10 monclient: _finish_hunting 0 2026-02-17T11:13:19.045 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.032+0000 7fad65651640 1 monclient: found mon.noname-b 2026-02-17T11:13:19.045 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.032+0000 7fad65651640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:13:19.045 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.032+0000 7fad65651640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:13:19.045 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.032+0000 7fad65651640 1 -- 10.20.193.49:0/2064223694 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad600c4e30 con 0x7fad60150610 2026-02-17T11:13:19.046 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.033+0000 7fad65651640 1 --2- 10.20.193.49:0/2064223694 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fad60150610 0x7fad6014b170 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fad5c007e60 tx=0x7fad5c00e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:13:19.046 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.033+0000 7fad557fa640 10 client.?.objecter ms_handle_connect 0x7fad60150610 2026-02-17T11:13:19.046 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.033+0000 7fad557fa640 10 client.?.objecter resend_mon_ops 2026-02-17T11:13:19.046 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.035+0000 7fad557fa640 1 -- 10.20.193.49:0/2064223694 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad5c014420 con 0x7fad60150610 2026-02-17T11:13:19.046 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.035+0000 7fad557fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:19.046 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.035+0000 7fad557fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:13:19.046 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.035+0000 7fad557fa640 10 monclient: dump: 2026-02-17T11:13:19.046 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:19.046 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:19.046 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:19.046 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:19.046 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:19.047 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:19.047 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:19.047 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:19.047 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:19.047 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:19.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.035+0000 7fad557fa640 10 monclient: _finish_auth 0 2026-02-17T11:13:19.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.035+0000 7fad557fa640 10 monclient: _check_auth_tickets 2026-02-17T11:13:19.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.035+0000 7fad557fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:13:19.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.035+0000 7fad557fa640 1 -- 10.20.193.49:0/2064223694 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad5c019070 con 0x7fad60150610 2026-02-17T11:13:19.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.035+0000 7fad670db640 5 monclient: authenticate success, global_id 4870 2026-02-17T11:13:19.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.035+0000 7fad670db640 10 monclient: _renew_subs 2026-02-17T11:13:19.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.035+0000 7fad670db640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:13:19.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.035+0000 7fad670db640 1 -- 10.20.193.49:0/2064223694 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad600c5110 con 0x7fad60150610 2026-02-17T11:13:19.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.035+0000 7fad557fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:13:19.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.035+0000 7fad557fa640 1 -- 10.20.193.49:0/2064223694 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad5c014800 con 0x7fad60150610 2026-02-17T11:13:19.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.035+0000 7fad557fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:19.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.035+0000 7fad56ffd640 4 set_mon_vals no callback set 2026-02-17T11:13:19.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.035+0000 7fad557fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:13:19.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.035+0000 7fad557fa640 10 monclient: dump: 2026-02-17T11:13:19.048 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:19.048 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:19.048 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:19.048 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:19.048 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:19.048 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:19.049 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:19.049 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:19.049 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:19.049 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:19.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.035+0000 7fad670db640 10 client.4870.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:13:19.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.035+0000 7fad670db640 10 monclient: _renew_subs 2026-02-17T11:13:19.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.035+0000 7fad670db640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:13:19.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.035+0000 7fad670db640 1 -- 10.20.193.49:0/2064223694 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad601f5590 con 0x7fad60150610 2026-02-17T11:13:19.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.035+0000 7fad670db640 1 librados: init done 2026-02-17T11:13:19.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.036+0000 7fad670db640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:13:19.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.036+0000 7fad670db640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:13:19.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.036+0000 7fad670db640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:13:19.050 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.036+0000 7fad670db640 1 -- 10.20.193.49:0/2064223694 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad600c7890 con 0x7fad60150610 2026-02-17T11:13:19.051 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.046+0000 7fad557fa640 1 -- 10.20.193.49:0/2064223694 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7fad5c0149a0 con 0x7fad60150610 2026-02-17T11:13:19.051 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.047+0000 7fad557fa640 1 --2- 10.20.193.49:0/2064223694 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fad300791c0 0x7fad3007b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:19.051 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.047+0000 7fad64e50640 1 --2- 10.20.193.49:0/2064223694 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fad300791c0 0x7fad3007b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:19.051 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.047+0000 7fad64e50640 10 monclient: get_auth_request con 0x7fad300791c0 auth_method 0 2026-02-17T11:13:19.051 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.048+0000 7fad64e50640 1 --2- 10.20.193.49:0/2064223694 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fad300791c0 0x7fad3007b680 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fad50005160 tx=0x7fad50007f30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:13:19.051 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.048+0000 7fad557fa640 10 client.4870.objecter ms_handle_connect 0x7fad300791c0 2026-02-17T11:13:19.051 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.048+0000 7fad557fa640 1 -- 10.20.193.49:0/2064223694 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7fad5c05f160 con 0x7fad60150610 2026-02-17T11:13:19.051 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.048+0000 7fad557fa640 10 client.4870.objecter ms_dispatch2 0x7fad60000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:13:19.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.048+0000 7fad557fa640 3 client.4870.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:13:19.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.048+0000 7fad557fa640 3 client.4870.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:13:19.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.048+0000 7fad557fa640 20 client.4870.objecter dump_active .. 0 homeless 2026-02-17T11:13:19.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.148+0000 7fad557fa640 1 -- 10.20.193.49:0/2064223694 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fad5c063820 con 0x7fad60150610 2026-02-17T11:13:19.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.148+0000 7fad557fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:13:19.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.148+0000 7fad557fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:13:19.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.251+0000 7fad670db640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:13:19.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.251+0000 7fad670db640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:13:19.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.251+0000 7fad670db640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:13:19.254 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.251+0000 7fad670db640 1 -- 10.20.193.49:0/2064223694 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fad60070460 con 0x7fad60150610 2026-02-17T11:13:19.255 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.254+0000 7fad557fa640 1 -- 10.20.193.49:0/2064223694 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fad5c063120 con 0x7fad60150610 2026-02-17T11:13:19.255 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.254+0000 7fad557fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:13:19.256 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.254+0000 7fad557fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:13:19.256 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:13:19.256 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:13:19.258 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.254+0000 7fad670db640 10 librados: watch_flush enter 2026-02-17T11:13:19.258 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.254+0000 7fad670db640 10 librados: watch_flush exit 2026-02-17T11:13:19.258 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.254+0000 7fad670db640 20 client.4870.objecter shutdown clearing up homeless session... 2026-02-17T11:13:19.258 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.254+0000 7fad670db640 10 client.4870.objecter successfully canceled tick 2026-02-17T11:13:19.258 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.254+0000 7fad670db640 1 -- 10.20.193.49:0/2064223694 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fad300791c0 msgr2=0x7fad3007b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:19.258 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.254+0000 7fad670db640 1 --2- 10.20.193.49:0/2064223694 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fad300791c0 0x7fad3007b680 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fad50005160 tx=0x7fad50007f30 comp rx=0 tx=0).stop 2026-02-17T11:13:19.258 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.254+0000 7fad670db640 10 monclient: shutdown 2026-02-17T11:13:19.258 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.254+0000 7fad670db640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:13:19.258 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.254+0000 7fad670db640 1 -- 10.20.193.49:0/2064223694 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fad60150610 msgr2=0x7fad6014b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:19.258 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.254+0000 7fad670db640 1 --2- 10.20.193.49:0/2064223694 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fad60150610 0x7fad6014b170 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fad5c007e60 tx=0x7fad5c00e4b0 comp rx=0 tx=0).stop 2026-02-17T11:13:19.259 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.254+0000 7fad670db640 1 -- 10.20.193.49:0/2064223694 shutdown_connections 2026-02-17T11:13:19.259 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.254+0000 7fad670db640 1 --2- 10.20.193.49:0/2064223694 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fad300791c0 0x7fad3007b680 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:19.259 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.254+0000 7fad670db640 1 --2- 10.20.193.49:0/2064223694 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fad60150610 0x7fad6014b170 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:19.259 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.254+0000 7fad670db640 1 --2- 10.20.193.49:0/2064223694 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fad60150230 0x7fad60074320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:19.259 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.254+0000 7fad670db640 1 --2- 10.20.193.49:0/2064223694 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fad600c9b90 0x7fad601f4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:19.259 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.254+0000 7fad670db640 1 -- 10.20.193.49:0/2064223694 >> 10.20.193.49:0/2064223694 conn(0x7fad600ca2e0 msgr2=0x7fad600ca6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:13:19.259 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.254+0000 7fad670db640 1 -- 10.20.193.49:0/2064223694 shutdown_connections 2026-02-17T11:13:19.259 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.254+0000 7fad670db640 1 -- 10.20.193.49:0/2064223694 wait complete. 2026-02-17T11:13:19.259 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:19.254+0000 7fad670db640 1 librados: shutdown 2026-02-17T11:13:22.266 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:13:22.334 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.332+0000 7f9a0efd3640 10 monclient: get_monmap_and_config 2026-02-17T11:13:22.334 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.332+0000 7f9a0efd3640 10 monclient: build_initial_monmap 2026-02-17T11:13:22.334 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.332+0000 7f9a0efd3640 10 monclient: monmap: 2026-02-17T11:13:22.335 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:13:22.335 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:22.335 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:13:22.333033+0000 2026-02-17T11:13:22.335 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:13:22.333033+0000 2026-02-17T11:13:22.335 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:13:22.335 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:22.335 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:13:22.335 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:13:22.335 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:13:22.335 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:13:22.335 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:13:22.335 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:13:22.336 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:22.336 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.332+0000 7f9a0efd3640 1 Processor -- start 2026-02-17T11:13:22.336 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.332+0000 7f9a0efd3640 1 -- start start 2026-02-17T11:13:22.336 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.332+0000 7f9a0efd3640 10 monclient: init 2026-02-17T11:13:22.338 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.333+0000 7f9a0efd3640 10 monclient: _reopen_session rank -1 2026-02-17T11:13:22.339 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.333+0000 7f9a0efd3640 10 monclient: _add_conns ranks=[3,4,0,2,5,1] 2026-02-17T11:13:22.339 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.333+0000 7f9a0efd3640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f9a0815d370 0x7f9a0815d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:22.339 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.333+0000 7f9a0efd3640 10 monclient(hunting): picked mon.noname-a con 0x7f9a0815d370 addr v2:10.20.193.49:3300/0 2026-02-17T11:13:22.339 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.333+0000 7f9a0efd3640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f9a080c7e20 0x7f9a080c74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:22.339 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.333+0000 7f9a0efd3640 10 monclient(hunting): picked mon.noname-b con 0x7f9a080c7e20 addr v2:10.20.193.97:3300/0 2026-02-17T11:13:22.339 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.333+0000 7f9a0efd3640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f9a0815b000 addr v1:10.20.193.49:6789/0 2026-02-17T11:13:22.339 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.333+0000 7f9a0efd3640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a080c8350 con 0x7f9a0815b000 2026-02-17T11:13:22.339 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.333+0000 7f9a0efd3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:22.339 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.333+0000 7f9a0efd3640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f9a080c9240 con 0x7f9a0815d370 2026-02-17T11:13:22.339 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.333+0000 7f9a0efd3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:22.340 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.333+0000 7f9a0efd3640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f9a080c8630 con 0x7f9a080c7e20 2026-02-17T11:13:22.340 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.333+0000 7f9a0efd3640 10 monclient(hunting): _renew_subs 2026-02-17T11:13:22.340 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.333+0000 7f9a0efd3640 10 monclient(hunting): authenticate will time out at 1278.996502s 2026-02-17T11:13:22.340 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.333+0000 7f99fffff640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f9a080c7e20 0x7f9a080c74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:22.340 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.334+0000 7f9a0cd48640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f9a0815d370 0x7f9a0815d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:22.340 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.334+0000 7f99fffff640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f9a080c7e20 0x7f9a080c74c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:38466/0 (socket says 10.20.193.49:38466) 2026-02-17T11:13:22.340 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.334+0000 7f99fffff640 1 -- 10.20.193.49:0/2003595611 learned_addr learned my addr 10.20.193.49:0/2003595611 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:13:22.340 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.334+0000 7f99fffff640 10 monclient(hunting): get_auth_request con 0x7f9a080c7e20 auth_method 0 2026-02-17T11:13:22.340 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.334+0000 7f99fffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:22.340 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.334+0000 7f99fffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:22.340 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.334+0000 7f99fffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:22.340 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.334+0000 7f9a0cd48640 10 monclient(hunting): get_auth_request con 0x7f9a0815d370 auth_method 0 2026-02-17T11:13:22.341 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.334+0000 7f9a0cd48640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:22.341 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.334+0000 7f9a0cd48640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:22.341 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.334+0000 7f9a0cd48640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:22.341 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.334+0000 7f9a0cd48640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:22.341 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.334+0000 7f9a0cd48640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:22.341 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.334+0000 7f9a0cd48640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:22.341 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.334+0000 7f99fffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:22.341 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.334+0000 7f99fffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:22.341 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.334+0000 7f99fffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:22.341 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.335+0000 7f9a0cd48640 10 monclient(hunting): handle_auth_done global_id 4917 payload 274 2026-02-17T11:13:22.341 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.335+0000 7f9a0cd48640 1 -- 10.20.193.49:0/2003595611 >> v2:10.20.193.97:3300/0 conn(0x7f9a080c7e20 msgr2=0x7f9a080c74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:13:22.341 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.335+0000 7f9a0cd48640 1 --2- 10.20.193.49:0/2003595611 >> v2:10.20.193.97:3300/0 conn(0x7f9a080c7e20 0x7f9a080c74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:22.342 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.335+0000 7f9a0cd48640 1 -- 10.20.193.49:0/2003595611 >> v1:10.20.193.49:6789/0 conn(0x7f9a0815b000 legacy=0x7f9a080c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:13:22.342 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.335+0000 7f9a0cd48640 10 monclient: _finish_hunting 0 2026-02-17T11:13:22.342 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.335+0000 7f9a0cd48640 1 monclient: found mon.noname-a 2026-02-17T11:13:22.342 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.335+0000 7f9a0cd48640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:13:22.342 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.335+0000 7f9a0cd48640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:13:22.342 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.335+0000 7f9a0cd48640 1 -- 10.20.193.49:0/2003595611 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a080c8910 con 0x7f9a0815d370 2026-02-17T11:13:22.342 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.336+0000 7f9a0cd48640 1 --2- 10.20.193.49:0/2003595611 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f9a0815d370 0x7f9a0815d750 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9a0815d060 tx=0x7f99f802ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1012d226472c84a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:13:22.349 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.339+0000 7f99ff7fe640 1 -- 10.20.193.49:0/2003595611 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99f803c070 con 0x7f9a0815d370 2026-02-17T11:13:22.349 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.339+0000 7f99ff7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:22.349 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.339+0000 7f99ff7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:13:22.349 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.339+0000 7f99ff7fe640 10 monclient: dump: 2026-02-17T11:13:22.349 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:22.350 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:22.350 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:22.350 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:22.350 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:22.350 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:22.350 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:22.350 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:22.350 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:22.350 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:22.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.339+0000 7f99ff7fe640 10 monclient: _finish_auth 0 2026-02-17T11:13:22.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.339+0000 7f99ff7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:13:22.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.339+0000 7f99ff7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:13:22.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.339+0000 7f99ff7fe640 1 -- 10.20.193.49:0/2003595611 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99f802fa50 con 0x7f9a0815d370 2026-02-17T11:13:22.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.339+0000 7f9a0efd3640 5 monclient: authenticate success, global_id 4917 2026-02-17T11:13:22.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.339+0000 7f9a0efd3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:13:22.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.339+0000 7f99ff7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:13:22.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.339+0000 7f99ff7fe640 1 -- 10.20.193.49:0/2003595611 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99f802fe20 con 0x7f9a0815d370 2026-02-17T11:13:22.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.339+0000 7f99ff7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:22.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.339+0000 7f99ff7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:13:22.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.339+0000 7f99ff7fe640 10 monclient: dump: 2026-02-17T11:13:22.352 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:22.352 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:22.352 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:22.352 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:22.352 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:22.352 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:22.352 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:22.352 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:22.352 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:22.352 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:22.352 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.339+0000 7f9a0efd3640 10 monclient: get_monmap_and_config success 2026-02-17T11:13:22.352 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.339+0000 7f9a0efd3640 4 set_mon_vals no callback set 2026-02-17T11:13:22.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.340+0000 7f9a0efd3640 10 monclient: shutdown 2026-02-17T11:13:22.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.340+0000 7f9a0efd3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:13:22.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.340+0000 7f9a0efd3640 1 -- 10.20.193.49:0/2003595611 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f9a0815d370 msgr2=0x7f9a0815d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:22.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.340+0000 7f9a0efd3640 1 --2- 10.20.193.49:0/2003595611 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f9a0815d370 0x7f9a0815d750 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9a0815d060 tx=0x7f99f802ede0 comp rx=0 tx=0).stop 2026-02-17T11:13:22.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.340+0000 7f9a0efd3640 1 -- 10.20.193.49:0/2003595611 shutdown_connections 2026-02-17T11:13:22.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.340+0000 7f9a0efd3640 1 --2- 10.20.193.49:0/2003595611 >> v2:10.20.193.97:3300/0 conn(0x7f9a080c7e20 0x7f9a080c74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:22.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.340+0000 7f9a0efd3640 1 --2- 10.20.193.49:0/2003595611 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f9a0815d370 0x7f9a0815d750 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:22.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.340+0000 7f9a0efd3640 1 -- 10.20.193.49:0/2003595611 >> 10.20.193.49:0/2003595611 conn(0x7f9a080c9f20 msgr2=0x7f9a080ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:13:22.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.340+0000 7f9a0efd3640 1 -- 10.20.193.49:0/2003595611 shutdown_connections 2026-02-17T11:13:22.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.340+0000 7f9a0efd3640 1 -- 10.20.193.49:0/2003595611 wait complete. 2026-02-17T11:13:22.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.340+0000 7f9a0efd3640 10 monclient: build_initial_monmap 2026-02-17T11:13:22.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.340+0000 7f9a0efd3640 10 monclient: monmap: 2026-02-17T11:13:22.354 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:13:22.354 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:13:22.354 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:13:22.354 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:13:22.354 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:13:22.354 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:22.354 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:13:22.354 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:13:22.354 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:13:22.354 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:22.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.341+0000 7f9a0efd3640 1 librados: starting msgr at 2026-02-17T11:13:22.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.341+0000 7f9a0efd3640 1 librados: starting objecter 2026-02-17T11:13:22.355 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.341+0000 7f9a0efd3640 1 Processor -- start 2026-02-17T11:13:22.355 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.341+0000 7f9a0efd3640 1 -- start start 2026-02-17T11:13:22.355 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.341+0000 7f9a0efd3640 1 librados: setting wanted keys 2026-02-17T11:13:22.355 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.341+0000 7f9a0efd3640 1 librados: calling monclient init 2026-02-17T11:13:22.355 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.341+0000 7f9a0efd3640 10 monclient: init 2026-02-17T11:13:22.355 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.341+0000 7f9a0efd3640 10 monclient: _reopen_session rank -1 2026-02-17T11:13:22.355 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.341+0000 7f9a0efd3640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:13:22.355 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.341+0000 7f9a0efd3640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f9a080c7e20 0x7f9a08159080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:22.355 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.341+0000 7f9a0efd3640 10 monclient(hunting): picked mon.noname-c con 0x7f9a080c7e20 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:13:22.355 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.341+0000 7f9a0efd3640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f9a0815b000 0x7f9a081f6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:22.355 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.341+0000 7f9a0efd3640 10 monclient(hunting): picked mon.noname-a con 0x7f9a0815b000 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:13:22.355 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.341+0000 7f9a0efd3640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f9a0815d370 0x7f9a0806ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:22.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.341+0000 7f9a0efd3640 10 monclient(hunting): picked mon.noname-b con 0x7f9a0815d370 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:13:22.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.341+0000 7f9a0efd3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:22.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.341+0000 7f9a0efd3640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9a080c96d0 con 0x7f9a0815b000 2026-02-17T11:13:22.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.341+0000 7f9a0efd3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:22.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.341+0000 7f9a0efd3640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f9a080c8ed0 con 0x7f9a0815d370 2026-02-17T11:13:22.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.341+0000 7f9a0efd3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:22.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.341+0000 7f9a0efd3640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f9a0815a8b0 con 0x7f9a080c7e20 2026-02-17T11:13:22.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.341+0000 7f9a0efd3640 10 monclient(hunting): _renew_subs 2026-02-17T11:13:22.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.341+0000 7f9a0efd3640 10 monclient(hunting): authenticate will time out at 1279.004534s 2026-02-17T11:13:22.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.341+0000 7f99fffff640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f9a0815b000 0x7f9a081f6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:22.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.341+0000 7f99fffff640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f9a0815b000 0x7f9a081f6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:56430/0 (socket says 10.20.193.49:56430) 2026-02-17T11:13:22.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.341+0000 7f99fffff640 1 -- 10.20.193.49:0/3657546131 learned_addr learned my addr 10.20.193.49:0/3657546131 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:13:22.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.341+0000 7f99fffff640 10 monclient(hunting): get_auth_request con 0x7f9a0815b000 auth_method 0 2026-02-17T11:13:22.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.341+0000 7f99fffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:22.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.341+0000 7f99fffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:22.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.341+0000 7f99fffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:22.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.341+0000 7f9a0cd48640 1 --2- 10.20.193.49:0/3657546131 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f9a080c7e20 0x7f9a08159080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:22.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.341+0000 7f9a0d549640 1 --2- 10.20.193.49:0/3657546131 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f9a0815d370 0x7f9a0806ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:22.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.342+0000 7f9a0d549640 10 monclient(hunting): get_auth_request con 0x7f9a0815d370 auth_method 0 2026-02-17T11:13:22.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.342+0000 7f9a0d549640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:22.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.342+0000 7f9a0d549640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:22.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.342+0000 7f9a0d549640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:22.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.342+0000 7f9a0cd48640 10 monclient(hunting): get_auth_request con 0x7f9a080c7e20 auth_method 0 2026-02-17T11:13:22.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.342+0000 7f9a0cd48640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:22.358 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.342+0000 7f9a0cd48640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:22.358 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.342+0000 7f9a0cd48640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:22.358 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.342+0000 7f99fffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:22.358 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.342+0000 7f99fffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:22.358 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.342+0000 7f99fffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:22.358 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.342+0000 7f9a0cd48640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:22.358 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.342+0000 7f9a0cd48640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:22.358 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.342+0000 7f9a0cd48640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:22.358 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.342+0000 7f9a0d549640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:22.358 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.342+0000 7f9a0d549640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:22.358 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.342+0000 7f9a0d549640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:22.358 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.343+0000 7f99fffff640 10 monclient(hunting): handle_auth_done global_id 4920 payload 824 2026-02-17T11:13:22.359 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.343+0000 7f99fffff640 1 -- 10.20.193.49:0/3657546131 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f9a080c7e20 msgr2=0x7f9a08159080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:22.359 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.343+0000 7f99fffff640 1 --2- 10.20.193.49:0/3657546131 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f9a080c7e20 0x7f9a08159080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:22.359 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.343+0000 7f99fffff640 1 -- 10.20.193.49:0/3657546131 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f9a0815d370 msgr2=0x7f9a0806ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:22.359 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.343+0000 7f99fffff640 1 --2- 10.20.193.49:0/3657546131 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f9a0815d370 0x7f9a0806ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:22.359 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.343+0000 7f99fffff640 10 monclient: _finish_hunting 0 2026-02-17T11:13:22.359 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.343+0000 7f99fffff640 1 monclient: found mon.noname-a 2026-02-17T11:13:22.359 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.343+0000 7f99fffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:13:22.359 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.343+0000 7f99fffff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:13:22.359 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.343+0000 7f99fffff640 1 -- 10.20.193.49:0/3657546131 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a08159a50 con 0x7f9a0815b000 2026-02-17T11:13:22.359 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.344+0000 7f99fffff640 1 --2- 10.20.193.49:0/3657546131 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f9a0815b000 0x7f9a081f6dd0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f99f000e930 tx=0x7f99f000ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:13:22.359 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.344+0000 7f99fd7fa640 10 client.?.objecter ms_handle_connect 0x7f9a0815b000 2026-02-17T11:13:22.359 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.344+0000 7f99fd7fa640 10 client.?.objecter resend_mon_ops 2026-02-17T11:13:22.359 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.346+0000 7f99fd7fa640 1 -- 10.20.193.49:0/3657546131 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99f0017070 con 0x7f9a0815b000 2026-02-17T11:13:22.360 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.346+0000 7f99fd7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:22.360 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.346+0000 7f99fd7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:13:22.360 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.346+0000 7f99fd7fa640 10 monclient: dump: 2026-02-17T11:13:22.360 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:22.360 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:22.360 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:22.360 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:22.360 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:22.360 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:22.360 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:22.360 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:22.360 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:22.361 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:22.361 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.346+0000 7f99fd7fa640 10 monclient: _finish_auth 0 2026-02-17T11:13:22.361 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.346+0000 7f99fd7fa640 10 monclient: _check_auth_tickets 2026-02-17T11:13:22.361 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.346+0000 7f99fd7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:13:22.361 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.346+0000 7f99fd7fa640 1 -- 10.20.193.49:0/3657546131 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99f000c9a0 con 0x7f9a0815b000 2026-02-17T11:13:22.361 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.346+0000 7f9a0efd3640 5 monclient: authenticate success, global_id 4920 2026-02-17T11:13:22.361 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.346+0000 7f9a0efd3640 10 monclient: _renew_subs 2026-02-17T11:13:22.361 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.346+0000 7f9a0efd3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:13:22.361 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.346+0000 7f9a0efd3640 1 -- 10.20.193.49:0/3657546131 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a08159d30 con 0x7f9a0815b000 2026-02-17T11:13:22.361 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.346+0000 7f99fd7fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:13:22.361 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.346+0000 7f99fd7fa640 1 -- 10.20.193.49:0/3657546131 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99f000cd90 con 0x7f9a0815b000 2026-02-17T11:13:22.361 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.346+0000 7f99fd7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:22.362 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.346+0000 7f99fd7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:13:22.362 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.346+0000 7f99feffd640 4 set_mon_vals no callback set 2026-02-17T11:13:22.362 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.346+0000 7f99fd7fa640 10 monclient: dump: 2026-02-17T11:13:22.362 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:22.362 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:22.362 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:22.362 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:22.362 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:22.362 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:22.362 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:22.362 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:22.362 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:22.362 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:22.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.346+0000 7f9a0efd3640 10 client.4920.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:13:22.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.346+0000 7f9a0efd3640 10 monclient: _renew_subs 2026-02-17T11:13:22.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.346+0000 7f9a0efd3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:13:22.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.346+0000 7f9a0efd3640 1 -- 10.20.193.49:0/3657546131 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a0815a2f0 con 0x7f9a0815b000 2026-02-17T11:13:22.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.346+0000 7f9a0efd3640 1 librados: init done 2026-02-17T11:13:22.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.347+0000 7f9a0efd3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:13:22.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.347+0000 7f9a0efd3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:13:22.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.347+0000 7f9a0efd3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:13:22.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.347+0000 7f9a0efd3640 1 -- 10.20.193.49:0/3657546131 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a0815b490 con 0x7f9a0815b000 2026-02-17T11:13:22.364 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.358+0000 7f99fd7fa640 1 -- 10.20.193.49:0/3657546131 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f99f0013470 con 0x7f9a0815b000 2026-02-17T11:13:22.365 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.359+0000 7f99fd7fa640 1 --2- 10.20.193.49:0/3657546131 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f99d8079190 0x7f99d807b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:22.365 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.359+0000 7f9a0cd48640 1 --2- 10.20.193.49:0/3657546131 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f99d8079190 0x7f99d807b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:22.365 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.359+0000 7f9a0cd48640 10 monclient: get_auth_request con 0x7f99d8079190 auth_method 0 2026-02-17T11:13:22.365 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.360+0000 7f9a0cd48640 1 --2- 10.20.193.49:0/3657546131 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f99d8079190 0x7f99d807b650 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f99f8039000 tx=0x7f99f8033000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:13:22.365 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.360+0000 7f99fd7fa640 10 client.4920.objecter ms_handle_connect 0x7f99d8079190 2026-02-17T11:13:22.464 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.462+0000 7f99fd7fa640 1 -- 10.20.193.49:0/3657546131 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f99f005e5f0 con 0x7f9a0815b000 2026-02-17T11:13:22.465 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.462+0000 7f99fd7fa640 10 client.4920.objecter ms_dispatch2 0x7f9a08000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:13:22.465 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.462+0000 7f99fd7fa640 3 client.4920.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:13:22.465 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.462+0000 7f99fd7fa640 3 client.4920.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:13:22.465 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.462+0000 7f99fd7fa640 20 client.4920.objecter dump_active .. 0 homeless 2026-02-17T11:13:22.465 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.462+0000 7f99fd7fa640 1 -- 10.20.193.49:0/3657546131 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f99f00625b0 con 0x7f9a0815b000 2026-02-17T11:13:22.465 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.463+0000 7f99fd7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:13:22.465 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.463+0000 7f99fd7fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:13:22.565 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.564+0000 7f9a0efd3640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:13:22.565 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.564+0000 7f9a0efd3640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:13:22.566 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.564+0000 7f9a0efd3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:13:22.566 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.564+0000 7f9a0efd3640 1 -- 10.20.193.49:0/3657546131 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9a080c5d90 con 0x7f9a0815b000 2026-02-17T11:13:22.568 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.567+0000 7f99fd7fa640 1 -- 10.20.193.49:0/3657546131 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f99f00668b0 con 0x7f9a0815b000 2026-02-17T11:13:22.569 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.567+0000 7f99fd7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:13:22.569 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.567+0000 7f99fd7fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:13:22.569 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:13:22.569 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:13:22.571 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.568+0000 7f9a0efd3640 10 librados: watch_flush enter 2026-02-17T11:13:22.571 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.568+0000 7f9a0efd3640 10 librados: watch_flush exit 2026-02-17T11:13:22.571 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.568+0000 7f9a0efd3640 20 client.4920.objecter shutdown clearing up homeless session... 2026-02-17T11:13:22.571 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.568+0000 7f9a0efd3640 10 client.4920.objecter successfully canceled tick 2026-02-17T11:13:22.571 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.568+0000 7f9a0efd3640 1 -- 10.20.193.49:0/3657546131 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f99d8079190 msgr2=0x7f99d807b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:22.571 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.568+0000 7f9a0efd3640 1 --2- 10.20.193.49:0/3657546131 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f99d8079190 0x7f99d807b650 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f99f8039000 tx=0x7f99f8033000 comp rx=0 tx=0).stop 2026-02-17T11:13:22.571 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.568+0000 7f9a0efd3640 10 monclient: shutdown 2026-02-17T11:13:22.572 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.568+0000 7f9a0efd3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:13:22.572 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.568+0000 7f9a0efd3640 1 -- 10.20.193.49:0/3657546131 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f9a0815b000 msgr2=0x7f9a081f6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:22.572 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.568+0000 7f9a0efd3640 1 --2- 10.20.193.49:0/3657546131 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f9a0815b000 0x7f9a081f6dd0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f99f000e930 tx=0x7f99f000ee00 comp rx=0 tx=0).stop 2026-02-17T11:13:22.572 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.568+0000 7f9a0efd3640 1 -- 10.20.193.49:0/3657546131 shutdown_connections 2026-02-17T11:13:22.572 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.568+0000 7f9a0efd3640 1 --2- 10.20.193.49:0/3657546131 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f99d8079190 0x7f99d807b650 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:22.572 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.568+0000 7f9a0efd3640 1 --2- 10.20.193.49:0/3657546131 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f9a0815d370 0x7f9a0806ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:22.572 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.568+0000 7f9a0efd3640 1 --2- 10.20.193.49:0/3657546131 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f9a0815b000 0x7f9a081f6dd0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:22.572 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.568+0000 7f9a0efd3640 1 --2- 10.20.193.49:0/3657546131 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f9a080c7e20 0x7f9a08159080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:22.572 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.568+0000 7f9a0efd3640 1 -- 10.20.193.49:0/3657546131 >> 10.20.193.49:0/3657546131 conn(0x7f9a080c9f20 msgr2=0x7f9a080ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:13:22.572 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.568+0000 7f9a0efd3640 1 -- 10.20.193.49:0/3657546131 shutdown_connections 2026-02-17T11:13:22.572 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.568+0000 7f9a0efd3640 1 -- 10.20.193.49:0/3657546131 wait complete. 2026-02-17T11:13:22.573 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:22.568+0000 7f9a0efd3640 1 librados: shutdown 2026-02-17T11:13:25.580 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:13:25.647 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.645+0000 7f31250b9640 10 monclient: get_monmap_and_config 2026-02-17T11:13:25.647 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.645+0000 7f31250b9640 10 monclient: build_initial_monmap 2026-02-17T11:13:25.647 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.645+0000 7f31250b9640 10 monclient: monmap: 2026-02-17T11:13:25.647 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:13:25.647 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:25.647 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:13:25.646461+0000 2026-02-17T11:13:25.647 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:13:25.646461+0000 2026-02-17T11:13:25.647 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:13:25.647 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:25.647 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:13:25.648 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:13:25.648 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:13:25.648 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:13:25.648 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:13:25.648 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:13:25.648 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:25.648 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.646+0000 7f31250b9640 1 Processor -- start 2026-02-17T11:13:25.648 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.646+0000 7f31250b9640 1 -- start start 2026-02-17T11:13:25.648 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.646+0000 7f31250b9640 10 monclient: init 2026-02-17T11:13:25.648 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.646+0000 7f31250b9640 10 monclient: _reopen_session rank -1 2026-02-17T11:13:25.648 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.646+0000 7f31250b9640 10 monclient: _add_conns ranks=[5,4,2,1,0,3] 2026-02-17T11:13:25.648 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.646+0000 7f31250b9640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f312015d370 0x7f312015d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:25.648 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.646+0000 7f31250b9640 10 monclient(hunting): picked mon.noname-c con 0x7f312015d370 addr v2:10.20.193.157:3300/0 2026-02-17T11:13:25.648 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.646+0000 7f31250b9640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f31200c7e20 0x7f31200c74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:25.648 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.646+0000 7f31250b9640 10 monclient(hunting): picked mon.noname-b con 0x7f31200c7e20 addr v2:10.20.193.97:3300/0 2026-02-17T11:13:25.648 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.646+0000 7f31250b9640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f312015b000 addr v1:10.20.193.157:6789/0 2026-02-17T11:13:25.648 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.646+0000 7f31250b9640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31200c8350 con 0x7f312015b000 2026-02-17T11:13:25.648 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.646+0000 7f31250b9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:25.648 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.646+0000 7f31250b9640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f31200c9240 con 0x7f31200c7e20 2026-02-17T11:13:25.648 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.646+0000 7f31250b9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:25.648 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.646+0000 7f31250b9640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f31200c8630 con 0x7f312015d370 2026-02-17T11:13:25.648 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.646+0000 7f31250b9640 10 monclient(hunting): _renew_subs 2026-02-17T11:13:25.649 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.646+0000 7f31250b9640 10 monclient(hunting): authenticate will time out at 1282.309921s 2026-02-17T11:13:25.649 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.647+0000 7f311e575640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f31200c7e20 0x7f31200c74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:25.649 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.647+0000 7f311ed76640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f312015d370 0x7f312015d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:25.649 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.647+0000 7f311e575640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f31200c7e20 0x7f31200c74c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:38472/0 (socket says 10.20.193.49:38472) 2026-02-17T11:13:25.649 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.647+0000 7f311e575640 1 -- 10.20.193.49:0/3860821503 learned_addr learned my addr 10.20.193.49:0/3860821503 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:13:25.649 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.647+0000 7f311e575640 10 monclient(hunting): get_auth_request con 0x7f31200c7e20 auth_method 0 2026-02-17T11:13:25.649 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.647+0000 7f311e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:25.649 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.647+0000 7f311e575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:25.649 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.647+0000 7f311e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:25.649 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.647+0000 7f311ed76640 10 monclient(hunting): get_auth_request con 0x7f312015d370 auth_method 0 2026-02-17T11:13:25.649 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.647+0000 7f311ed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:25.649 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.647+0000 7f311ed76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:25.649 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.647+0000 7f311ed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:25.649 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.647+0000 7f311e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:25.649 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.647+0000 7f311e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:25.649 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.648+0000 7f311e575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:25.649 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.648+0000 7f311ed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:25.649 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.648+0000 7f311ed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:25.649 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.648+0000 7f311ed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:25.650 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.648+0000 7f311e575640 10 monclient(hunting): handle_auth_done global_id 4879 payload 274 2026-02-17T11:13:25.650 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.649+0000 7f311e575640 1 -- 10.20.193.49:0/3860821503 >> v2:10.20.193.157:3300/0 conn(0x7f312015d370 msgr2=0x7f312015d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:13:25.650 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.649+0000 7f311e575640 1 --2- 10.20.193.49:0/3860821503 >> v2:10.20.193.157:3300/0 conn(0x7f312015d370 0x7f312015d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:25.650 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.649+0000 7f311e575640 1 -- 10.20.193.49:0/3860821503 >> v1:10.20.193.157:6789/0 conn(0x7f312015b000 legacy=0x7f31200c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:25.650 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.649+0000 7f311e575640 10 monclient: _finish_hunting 0 2026-02-17T11:13:25.650 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.649+0000 7f311e575640 1 monclient: found mon.noname-b 2026-02-17T11:13:25.650 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.649+0000 7f311e575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:13:25.650 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.649+0000 7f311e575640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:13:25.650 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.649+0000 7f311e575640 1 -- 10.20.193.49:0/3860821503 --> v2:10.20.193.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31200c8910 con 0x7f31200c7e20 2026-02-17T11:13:25.651 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.649+0000 7f311e575640 1 --2- 10.20.193.49:0/3860821503 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f31200c7e20 0x7f31200c74c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f31200698d0 tx=0x7f310802eed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11a1d3a2e81638c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:13:25.653 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.651+0000 7f311dd74640 1 -- 10.20.193.49:0/3860821503 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f310803c070 con 0x7f31200c7e20 2026-02-17T11:13:25.653 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.651+0000 7f311dd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:25.653 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.651+0000 7f311dd74640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:13:25.653 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.651+0000 7f311dd74640 10 monclient: dump: 2026-02-17T11:13:25.653 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:25.653 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:25.653 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:25.653 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:25.653 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:25.653 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:25.653 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:25.653 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:25.653 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:25.653 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:25.653 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.651+0000 7f311dd74640 10 monclient: _finish_auth 0 2026-02-17T11:13:25.653 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.651+0000 7f311dd74640 10 monclient: _check_auth_tickets 2026-02-17T11:13:25.653 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.651+0000 7f311dd74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:13:25.653 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.651+0000 7f311dd74640 1 -- 10.20.193.49:0/3860821503 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f310802fbe0 con 0x7f31200c7e20 2026-02-17T11:13:25.653 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.651+0000 7f31250b9640 5 monclient: authenticate success, global_id 4879 2026-02-17T11:13:25.654 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.651+0000 7f31250b9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:13:25.654 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.651+0000 7f311dd74640 10 monclient: handle_config config(0 keys) 2026-02-17T11:13:25.654 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.651+0000 7f311dd74640 1 -- 10.20.193.49:0/3860821503 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3108037440 con 0x7f31200c7e20 2026-02-17T11:13:25.654 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.651+0000 7f31250b9640 10 monclient: get_monmap_and_config success 2026-02-17T11:13:25.654 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.651+0000 7f31250b9640 4 set_mon_vals no callback set 2026-02-17T11:13:25.654 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.651+0000 7f311dd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:25.654 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.651+0000 7f311dd74640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:13:25.654 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.651+0000 7f311dd74640 10 monclient: dump: 2026-02-17T11:13:25.654 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:25.654 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:25.654 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:25.654 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:25.654 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:25.654 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:25.654 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:25.654 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:25.654 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:25.654 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:25.654 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.652+0000 7f31250b9640 10 monclient: shutdown 2026-02-17T11:13:25.654 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.652+0000 7f31250b9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:13:25.654 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.652+0000 7f31250b9640 1 -- 10.20.193.49:0/3860821503 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f31200c7e20 msgr2=0x7f31200c74c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:25.654 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.652+0000 7f31250b9640 1 --2- 10.20.193.49:0/3860821503 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f31200c7e20 0x7f31200c74c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f31200698d0 tx=0x7f310802eed0 comp rx=0 tx=0).stop 2026-02-17T11:13:25.654 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.652+0000 7f31250b9640 1 -- 10.20.193.49:0/3860821503 shutdown_connections 2026-02-17T11:13:25.654 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.652+0000 7f31250b9640 1 --2- 10.20.193.49:0/3860821503 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f31200c7e20 0x7f31200c74c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:25.654 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.652+0000 7f31250b9640 1 --2- 10.20.193.49:0/3860821503 >> v2:10.20.193.157:3300/0 conn(0x7f312015d370 0x7f312015d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:25.654 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.652+0000 7f31250b9640 1 -- 10.20.193.49:0/3860821503 >> 10.20.193.49:0/3860821503 conn(0x7f31200c9f20 msgr2=0x7f31200ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:13:25.654 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.652+0000 7f31250b9640 1 -- 10.20.193.49:0/3860821503 shutdown_connections 2026-02-17T11:13:25.654 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.652+0000 7f31250b9640 1 -- 10.20.193.49:0/3860821503 wait complete. 2026-02-17T11:13:25.655 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.652+0000 7f31250b9640 10 monclient: build_initial_monmap 2026-02-17T11:13:25.655 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.652+0000 7f31250b9640 10 monclient: monmap: 2026-02-17T11:13:25.655 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:13:25.655 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:13:25.655 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:13:25.655 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:13:25.655 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:13:25.655 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:25.655 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:13:25.655 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:13:25.656 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:13:25.656 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:25.656 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.652+0000 7f31250b9640 1 librados: starting msgr at 2026-02-17T11:13:25.656 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.652+0000 7f31250b9640 1 librados: starting objecter 2026-02-17T11:13:25.656 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.652+0000 7f31250b9640 1 Processor -- start 2026-02-17T11:13:25.656 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.652+0000 7f31250b9640 1 -- start start 2026-02-17T11:13:25.656 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.652+0000 7f31250b9640 1 librados: setting wanted keys 2026-02-17T11:13:25.656 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.652+0000 7f31250b9640 1 librados: calling monclient init 2026-02-17T11:13:25.656 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.652+0000 7f31250b9640 10 monclient: init 2026-02-17T11:13:25.656 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.653+0000 7f31250b9640 10 monclient: _reopen_session rank -1 2026-02-17T11:13:25.656 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.653+0000 7f31250b9640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:13:25.656 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.653+0000 7f31250b9640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f31200c7e20 0x7f3120158390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:25.656 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.653+0000 7f31250b9640 10 monclient(hunting): picked mon.noname-b con 0x7f31200c7e20 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:13:25.656 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.653+0000 7f31250b9640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f312015b000 0x7f3120143ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:25.656 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.653+0000 7f31250b9640 10 monclient(hunting): picked mon.noname-c con 0x7f312015b000 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:13:25.656 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.653+0000 7f31250b9640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f312015d370 0x7f312006dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:25.656 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.653+0000 7f31250b9640 10 monclient(hunting): picked mon.noname-a con 0x7f312015d370 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:13:25.656 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.653+0000 7f31250b9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:25.656 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.653+0000 7f31250b9640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f31200c96d0 con 0x7f312015d370 2026-02-17T11:13:25.656 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.653+0000 7f31250b9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:25.656 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.653+0000 7f31250b9640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f31200c8ed0 con 0x7f31200c7e20 2026-02-17T11:13:25.656 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.653+0000 7f31250b9640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:25.656 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.653+0000 7f31250b9640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f312006d280 con 0x7f312015b000 2026-02-17T11:13:25.656 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.653+0000 7f31250b9640 10 monclient(hunting): _renew_subs 2026-02-17T11:13:25.656 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.653+0000 7f31250b9640 10 monclient(hunting): authenticate will time out at 1282.316471s 2026-02-17T11:13:25.656 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.653+0000 7f311ed76640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f31200c7e20 0x7f3120158390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:25.656 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.653+0000 7f311e575640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f312015b000 0x7f3120143ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:25.656 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.653+0000 7f311f577640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f312015d370 0x7f312006dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:25.656 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.653+0000 7f311ed76640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f31200c7e20 0x7f3120158390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:38474/0 (socket says 10.20.193.49:38474) 2026-02-17T11:13:25.656 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.653+0000 7f311ed76640 1 -- 10.20.193.49:0/3103138520 learned_addr learned my addr 10.20.193.49:0/3103138520 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:13:25.656 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.653+0000 7f311ed76640 10 monclient(hunting): get_auth_request con 0x7f31200c7e20 auth_method 0 2026-02-17T11:13:25.656 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.653+0000 7f311ed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:25.656 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.653+0000 7f311ed76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:25.656 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.653+0000 7f311ed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:25.656 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.653+0000 7f311e575640 10 monclient(hunting): get_auth_request con 0x7f312015b000 auth_method 0 2026-02-17T11:13:25.656 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.653+0000 7f311e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:25.656 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.653+0000 7f311e575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:25.656 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.653+0000 7f311e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:25.656 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.654+0000 7f311f577640 10 monclient(hunting): get_auth_request con 0x7f312015d370 auth_method 0 2026-02-17T11:13:25.656 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.654+0000 7f311f577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:25.657 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.654+0000 7f311f577640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:25.657 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.654+0000 7f311f577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:25.657 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.654+0000 7f311ed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:25.657 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.654+0000 7f311ed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:25.657 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.654+0000 7f311ed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:25.657 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.654+0000 7f311e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:25.657 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.654+0000 7f311e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:25.657 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.654+0000 7f311e575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:25.657 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.654+0000 7f311f577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:25.657 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.654+0000 7f311f577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:25.657 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.654+0000 7f311f577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:25.657 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.655+0000 7f311ed76640 10 monclient(hunting): handle_auth_done global_id 4882 payload 824 2026-02-17T11:13:25.657 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.655+0000 7f311ed76640 1 -- 10.20.193.49:0/3103138520 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f312015b000 msgr2=0x7f3120143ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:25.657 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.655+0000 7f311ed76640 1 --2- 10.20.193.49:0/3103138520 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f312015b000 0x7f3120143ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:25.657 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.655+0000 7f311ed76640 1 -- 10.20.193.49:0/3103138520 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f312015d370 msgr2=0x7f312006dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:25.657 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.655+0000 7f311ed76640 1 --2- 10.20.193.49:0/3103138520 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f312015d370 0x7f312006dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:25.657 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.655+0000 7f311ed76640 10 monclient: _finish_hunting 0 2026-02-17T11:13:25.657 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.655+0000 7f311ed76640 1 monclient: found mon.noname-b 2026-02-17T11:13:25.657 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.655+0000 7f311ed76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:13:25.657 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.655+0000 7f311ed76640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:13:25.657 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.655+0000 7f311ed76640 1 -- 10.20.193.49:0/3103138520 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31201589f0 con 0x7f31200c7e20 2026-02-17T11:13:25.657 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.656+0000 7f311ed76640 1 --2- 10.20.193.49:0/3103138520 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f31200c7e20 0x7f3120158390 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f311400e8c0 tx=0x7f311400ed90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:13:25.658 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.656+0000 7f30ff7fe640 10 client.?.objecter ms_handle_connect 0x7f31200c7e20 2026-02-17T11:13:25.658 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.656+0000 7f30ff7fe640 10 client.?.objecter resend_mon_ops 2026-02-17T11:13:25.658 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.657+0000 7f30ff7fe640 1 -- 10.20.193.49:0/3103138520 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3114017070 con 0x7f31200c7e20 2026-02-17T11:13:25.658 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.657+0000 7f30ff7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:25.658 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.657+0000 7f30ff7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:13:25.658 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.657+0000 7f30ff7fe640 10 monclient: dump: 2026-02-17T11:13:25.658 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:25.658 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:25.659 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:25.659 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:25.659 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:25.659 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:25.659 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:25.659 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:25.659 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:25.659 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:25.659 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.657+0000 7f30ff7fe640 10 monclient: _finish_auth 0 2026-02-17T11:13:25.659 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.657+0000 7f30ff7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:13:25.659 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.657+0000 7f30ff7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:13:25.659 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.657+0000 7f31250b9640 5 monclient: authenticate success, global_id 4882 2026-02-17T11:13:25.659 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.657+0000 7f31250b9640 10 monclient: _renew_subs 2026-02-17T11:13:25.659 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.657+0000 7f31250b9640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:13:25.659 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.657+0000 7f31250b9640 1 -- 10.20.193.49:0/3103138520 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3120158cd0 con 0x7f31200c7e20 2026-02-17T11:13:25.659 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.657+0000 7f31250b9640 10 client.4882.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:13:25.659 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.657+0000 7f31250b9640 10 monclient: _renew_subs 2026-02-17T11:13:25.659 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.657+0000 7f31250b9640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:13:25.659 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.657+0000 7f31250b9640 1 -- 10.20.193.49:0/3103138520 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f312006d520 con 0x7f31200c7e20 2026-02-17T11:13:25.659 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.657+0000 7f31250b9640 1 librados: init done 2026-02-17T11:13:25.659 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.657+0000 7f31250b9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:13:25.659 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.657+0000 7f31250b9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:13:25.659 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.657+0000 7f31250b9640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:13:25.659 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.657+0000 7f31250b9640 1 -- 10.20.193.49:0/3103138520 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f312015b490 con 0x7f31200c7e20 2026-02-17T11:13:25.659 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.658+0000 7f30ff7fe640 1 -- 10.20.193.49:0/3103138520 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3114005a90 con 0x7f31200c7e20 2026-02-17T11:13:25.659 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.658+0000 7f30ff7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:13:25.660 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.658+0000 7f311d573640 4 set_mon_vals no callback set 2026-02-17T11:13:25.660 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.658+0000 7f30ff7fe640 1 -- 10.20.193.49:0/3103138520 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3114021060 con 0x7f31200c7e20 2026-02-17T11:13:25.660 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.658+0000 7f30ff7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:25.660 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.658+0000 7f30ff7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:13:25.660 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.658+0000 7f30ff7fe640 10 monclient: dump: 2026-02-17T11:13:25.660 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:25.660 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:25.660 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:25.660 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:25.660 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:25.660 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:25.660 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:25.660 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:25.660 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:25.660 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:25.766 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.764+0000 7f30ff7fe640 1 -- 10.20.193.49:0/3103138520 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f311400c940 con 0x7f31200c7e20 2026-02-17T11:13:25.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.765+0000 7f30ff7fe640 1 --2- 10.20.193.49:0/3103138520 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f30ec079140 0x7f30ec07b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:25.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.765+0000 7f311e575640 1 --2- 10.20.193.49:0/3103138520 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f30ec079140 0x7f30ec07b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:25.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.765+0000 7f311e575640 10 monclient: get_auth_request con 0x7f30ec079140 auth_method 0 2026-02-17T11:13:25.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.766+0000 7f30ff7fe640 10 client.4882.objecter ms_handle_connect 0x7f30ec079140 2026-02-17T11:13:25.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.766+0000 7f311e575640 1 --2- 10.20.193.49:0/3103138520 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f30ec079140 0x7f30ec07b600 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f312015dcf0 tx=0x7f3108039040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:13:25.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.766+0000 7f30ff7fe640 1 -- 10.20.193.49:0/3103138520 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f3114098090 con 0x7f31200c7e20 2026-02-17T11:13:25.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.766+0000 7f30ff7fe640 10 client.4882.objecter ms_dispatch2 0x7f3120000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:13:25.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.766+0000 7f30ff7fe640 3 client.4882.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:13:25.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.766+0000 7f30ff7fe640 3 client.4882.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:13:25.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.766+0000 7f30ff7fe640 20 client.4882.objecter dump_active .. 0 homeless 2026-02-17T11:13:25.774 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.772+0000 7f30ff7fe640 1 -- 10.20.193.49:0/3103138520 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f31140626c0 con 0x7f31200c7e20 2026-02-17T11:13:25.774 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.772+0000 7f30ff7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:13:25.774 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.772+0000 7f30ff7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:13:25.874 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.873+0000 7f31250b9640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:13:25.875 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.873+0000 7f31250b9640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:13:25.875 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.873+0000 7f31250b9640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:13:25.875 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.873+0000 7f31250b9640 1 -- 10.20.193.49:0/3103138520 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f3120070710 con 0x7f31200c7e20 2026-02-17T11:13:25.878 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.876+0000 7f30ff7fe640 1 -- 10.20.193.49:0/3103138520 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f31140669c0 con 0x7f31200c7e20 2026-02-17T11:13:25.878 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.876+0000 7f30ff7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:13:25.878 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.876+0000 7f30ff7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:13:25.878 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:13:25.878 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:13:25.880 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.877+0000 7f31250b9640 10 librados: watch_flush enter 2026-02-17T11:13:25.880 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.877+0000 7f31250b9640 10 librados: watch_flush exit 2026-02-17T11:13:25.880 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.877+0000 7f31250b9640 20 client.4882.objecter shutdown clearing up homeless session... 2026-02-17T11:13:25.880 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.877+0000 7f31250b9640 10 client.4882.objecter successfully canceled tick 2026-02-17T11:13:25.880 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.877+0000 7f31250b9640 1 -- 10.20.193.49:0/3103138520 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f30ec079140 msgr2=0x7f30ec07b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:25.880 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.877+0000 7f31250b9640 1 --2- 10.20.193.49:0/3103138520 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f30ec079140 0x7f30ec07b600 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f312015dcf0 tx=0x7f3108039040 comp rx=0 tx=0).stop 2026-02-17T11:13:25.881 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.877+0000 7f31250b9640 10 monclient: shutdown 2026-02-17T11:13:25.881 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.877+0000 7f31250b9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:13:25.881 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.877+0000 7f31250b9640 1 -- 10.20.193.49:0/3103138520 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f31200c7e20 msgr2=0x7f3120158390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:25.881 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.877+0000 7f31250b9640 1 --2- 10.20.193.49:0/3103138520 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f31200c7e20 0x7f3120158390 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f311400e8c0 tx=0x7f311400ed90 comp rx=0 tx=0).stop 2026-02-17T11:13:25.881 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.877+0000 7f31250b9640 1 -- 10.20.193.49:0/3103138520 shutdown_connections 2026-02-17T11:13:25.881 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.877+0000 7f31250b9640 1 --2- 10.20.193.49:0/3103138520 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f30ec079140 0x7f30ec07b600 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:25.881 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.877+0000 7f31250b9640 1 --2- 10.20.193.49:0/3103138520 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f312015d370 0x7f312006dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:25.881 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.877+0000 7f31250b9640 1 --2- 10.20.193.49:0/3103138520 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f312015b000 0x7f3120143ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:25.881 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.877+0000 7f31250b9640 1 --2- 10.20.193.49:0/3103138520 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f31200c7e20 0x7f3120158390 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:25.881 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.877+0000 7f31250b9640 1 -- 10.20.193.49:0/3103138520 >> 10.20.193.49:0/3103138520 conn(0x7f31200c9f20 msgr2=0x7f31200ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:13:25.881 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.877+0000 7f31250b9640 1 -- 10.20.193.49:0/3103138520 shutdown_connections 2026-02-17T11:13:25.882 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.877+0000 7f31250b9640 1 -- 10.20.193.49:0/3103138520 wait complete. 2026-02-17T11:13:25.882 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:25.877+0000 7f31250b9640 1 librados: shutdown 2026-02-17T11:13:28.888 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:13:28.957 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.956+0000 7fb436091640 10 monclient: get_monmap_and_config 2026-02-17T11:13:28.957 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.956+0000 7fb436091640 10 monclient: build_initial_monmap 2026-02-17T11:13:28.958 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.956+0000 7fb436091640 10 monclient: monmap: 2026-02-17T11:13:28.958 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:13:28.958 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:28.958 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:13:28.956569+0000 2026-02-17T11:13:28.958 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:13:28.956569+0000 2026-02-17T11:13:28.958 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:13:28.958 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:28.958 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:13:28.958 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:13:28.959 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:13:28.959 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:13:28.959 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:13:28.959 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:13:28.959 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:28.962 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.956+0000 7fb436091640 1 Processor -- start 2026-02-17T11:13:28.962 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.956+0000 7fb436091640 1 -- start start 2026-02-17T11:13:28.962 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.956+0000 7fb436091640 10 monclient: init 2026-02-17T11:13:28.962 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.956+0000 7fb436091640 10 monclient: _reopen_session rank -1 2026-02-17T11:13:28.962 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.956+0000 7fb436091640 10 monclient: _add_conns ranks=[5,3,4,0,2,1] 2026-02-17T11:13:28.962 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.956+0000 7fb436091640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7fb43015d370 0x7fb43015d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:28.962 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.956+0000 7fb436091640 10 monclient(hunting): picked mon.noname-c con 0x7fb43015d370 addr v2:10.20.193.157:3300/0 2026-02-17T11:13:28.963 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.957+0000 7fb436091640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fb4300c7e20 0x7fb4300c74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:28.963 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.957+0000 7fb436091640 10 monclient(hunting): picked mon.noname-a con 0x7fb4300c7e20 addr v2:10.20.193.49:3300/0 2026-02-17T11:13:28.963 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.957+0000 7fb436091640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7fb43015b000 0x7fb4300c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:28.963 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.957+0000 7fb436091640 10 monclient(hunting): picked mon.noname-b con 0x7fb43015b000 addr v2:10.20.193.97:3300/0 2026-02-17T11:13:28.963 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.957+0000 7fb436091640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:28.963 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.957+0000 7fb436091640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7fb4300c9240 con 0x7fb4300c7e20 2026-02-17T11:13:28.963 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.957+0000 7fb436091640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:28.963 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.957+0000 7fb436091640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7fb4300c8350 con 0x7fb43015b000 2026-02-17T11:13:28.963 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.957+0000 7fb436091640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:28.963 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.957+0000 7fb436091640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7fb4300c8630 con 0x7fb43015d370 2026-02-17T11:13:28.963 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.957+0000 7fb436091640 10 monclient(hunting): _renew_subs 2026-02-17T11:13:28.963 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.957+0000 7fb436091640 10 monclient(hunting): authenticate will time out at 1285.620026s 2026-02-17T11:13:28.964 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.957+0000 7fb42effd640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fb4300c7e20 0x7fb4300c74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:28.964 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.957+0000 7fb42f7fe640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7fb43015d370 0x7fb43015d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:28.964 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.957+0000 7fb42ffff640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7fb43015b000 0x7fb4300c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:28.964 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.957+0000 7fb42f7fe640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7fb43015d370 0x7fb43015d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:43034/0 (socket says 10.20.193.49:43034) 2026-02-17T11:13:28.964 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.957+0000 7fb42f7fe640 1 -- 10.20.193.49:0/4222350066 learned_addr learned my addr 10.20.193.49:0/4222350066 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:13:28.964 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.957+0000 7fb42f7fe640 10 monclient(hunting): get_auth_request con 0x7fb43015d370 auth_method 0 2026-02-17T11:13:28.964 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.957+0000 7fb42f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:28.964 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.957+0000 7fb42f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:28.964 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.957+0000 7fb42f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:28.964 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.957+0000 7fb42effd640 10 monclient(hunting): get_auth_request con 0x7fb4300c7e20 auth_method 0 2026-02-17T11:13:28.964 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.957+0000 7fb42effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:28.964 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.957+0000 7fb42effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:28.965 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.957+0000 7fb42effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:28.965 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.957+0000 7fb42ffff640 10 monclient(hunting): get_auth_request con 0x7fb43015b000 auth_method 0 2026-02-17T11:13:28.965 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.957+0000 7fb42ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:28.965 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.957+0000 7fb42ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:28.965 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.957+0000 7fb42ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:28.965 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.957+0000 7fb42effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:28.965 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.957+0000 7fb42effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:28.965 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.957+0000 7fb42effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:28.965 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.957+0000 7fb42f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:28.965 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.957+0000 7fb42f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:28.965 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.958+0000 7fb42f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:28.965 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.958+0000 7fb42ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:28.965 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.958+0000 7fb42ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:28.966 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.958+0000 7fb42ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:28.966 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.958+0000 7fb42effd640 10 monclient(hunting): handle_auth_done global_id 4926 payload 274 2026-02-17T11:13:28.966 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.958+0000 7fb42effd640 1 -- 10.20.193.49:0/4222350066 >> v2:10.20.193.157:3300/0 conn(0x7fb43015d370 msgr2=0x7fb43015d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:13:28.966 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.958+0000 7fb42effd640 1 --2- 10.20.193.49:0/4222350066 >> v2:10.20.193.157:3300/0 conn(0x7fb43015d370 0x7fb43015d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:28.966 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.958+0000 7fb42effd640 1 -- 10.20.193.49:0/4222350066 >> v2:10.20.193.97:3300/0 conn(0x7fb43015b000 msgr2=0x7fb4300c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:13:28.966 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.958+0000 7fb42effd640 1 --2- 10.20.193.49:0/4222350066 >> v2:10.20.193.97:3300/0 conn(0x7fb43015b000 0x7fb4300c52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:28.966 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.958+0000 7fb42effd640 10 monclient: _finish_hunting 0 2026-02-17T11:13:28.966 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.958+0000 7fb42effd640 1 monclient: found mon.noname-a 2026-02-17T11:13:28.966 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.958+0000 7fb42effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:13:28.966 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.958+0000 7fb42effd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:13:28.966 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.958+0000 7fb42effd640 1 -- 10.20.193.49:0/4222350066 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4300c8910 con 0x7fb4300c7e20 2026-02-17T11:13:28.966 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.959+0000 7fb42effd640 1 --2- 10.20.193.49:0/4222350066 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb4300c7e20 0x7fb4300c74c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb43015dcf0 tx=0x7fb42002edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f5c6ee6fd79fe3f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:13:28.973 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.961+0000 7fb42e7fc640 1 -- 10.20.193.49:0/4222350066 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb42003c070 con 0x7fb4300c7e20 2026-02-17T11:13:28.973 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.961+0000 7fb42e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:28.973 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.961+0000 7fb42e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:13:28.973 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.961+0000 7fb42e7fc640 10 monclient: dump: 2026-02-17T11:13:28.973 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:28.973 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:28.973 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:28.973 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:28.974 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:28.974 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:28.974 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:28.974 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:28.974 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:28.974 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:28.974 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.961+0000 7fb42e7fc640 10 monclient: _finish_auth 0 2026-02-17T11:13:28.974 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.961+0000 7fb42e7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:13:28.974 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.961+0000 7fb42e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:13:28.974 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.961+0000 7fb42e7fc640 1 -- 10.20.193.49:0/4222350066 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb42002fa80 con 0x7fb4300c7e20 2026-02-17T11:13:28.974 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.961+0000 7fb42e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:13:28.975 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.961+0000 7fb436091640 5 monclient: authenticate success, global_id 4926 2026-02-17T11:13:28.975 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.961+0000 7fb42e7fc640 1 -- 10.20.193.49:0/4222350066 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb42002fe50 con 0x7fb4300c7e20 2026-02-17T11:13:28.975 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.961+0000 7fb436091640 10 monclient: get_monmap_and_config success 2026-02-17T11:13:28.975 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.961+0000 7fb42e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:28.975 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.961+0000 7fb436091640 4 set_mon_vals no callback set 2026-02-17T11:13:28.975 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.961+0000 7fb42e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:13:28.975 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.961+0000 7fb42e7fc640 10 monclient: dump: 2026-02-17T11:13:28.975 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:28.975 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:28.975 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:28.975 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:28.975 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:28.976 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:28.976 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:28.976 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:28.976 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:28.976 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:28.976 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.962+0000 7fb436091640 10 monclient: shutdown 2026-02-17T11:13:28.976 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.962+0000 7fb436091640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:13:28.976 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.962+0000 7fb436091640 1 -- 10.20.193.49:0/4222350066 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb4300c7e20 msgr2=0x7fb4300c74c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:28.976 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.962+0000 7fb436091640 1 --2- 10.20.193.49:0/4222350066 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb4300c7e20 0x7fb4300c74c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb43015dcf0 tx=0x7fb42002edc0 comp rx=0 tx=0).stop 2026-02-17T11:13:28.976 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.962+0000 7fb436091640 1 -- 10.20.193.49:0/4222350066 shutdown_connections 2026-02-17T11:13:28.976 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.962+0000 7fb436091640 1 --2- 10.20.193.49:0/4222350066 >> v2:10.20.193.97:3300/0 conn(0x7fb43015b000 0x7fb4300c52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:28.976 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.962+0000 7fb436091640 1 --2- 10.20.193.49:0/4222350066 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb4300c7e20 0x7fb4300c74c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:28.976 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.962+0000 7fb436091640 1 --2- 10.20.193.49:0/4222350066 >> v2:10.20.193.157:3300/0 conn(0x7fb43015d370 0x7fb43015d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:28.977 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.962+0000 7fb436091640 1 -- 10.20.193.49:0/4222350066 >> 10.20.193.49:0/4222350066 conn(0x7fb4300c9f20 msgr2=0x7fb4300ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:13:28.977 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.962+0000 7fb436091640 1 -- 10.20.193.49:0/4222350066 shutdown_connections 2026-02-17T11:13:28.977 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.962+0000 7fb436091640 1 -- 10.20.193.49:0/4222350066 wait complete. 2026-02-17T11:13:28.977 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.962+0000 7fb436091640 10 monclient: build_initial_monmap 2026-02-17T11:13:28.977 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.962+0000 7fb436091640 10 monclient: monmap: 2026-02-17T11:13:28.977 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:13:28.977 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:13:28.977 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:13:28.977 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:13:28.977 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:13:28.977 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:28.977 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:13:28.978 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:13:28.978 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:13:28.978 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:28.978 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.962+0000 7fb436091640 1 librados: starting msgr at 2026-02-17T11:13:28.978 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.962+0000 7fb436091640 1 librados: starting objecter 2026-02-17T11:13:28.978 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.962+0000 7fb436091640 1 Processor -- start 2026-02-17T11:13:28.978 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.962+0000 7fb436091640 1 -- start start 2026-02-17T11:13:28.978 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.962+0000 7fb436091640 1 librados: setting wanted keys 2026-02-17T11:13:28.978 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.962+0000 7fb436091640 1 librados: calling monclient init 2026-02-17T11:13:28.978 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.962+0000 7fb436091640 10 monclient: init 2026-02-17T11:13:28.978 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.963+0000 7fb436091640 10 monclient: _reopen_session rank -1 2026-02-17T11:13:28.978 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.963+0000 7fb436091640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:13:28.979 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.963+0000 7fb436091640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb4300c7e20 0x7fb43006f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:28.979 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.963+0000 7fb436091640 10 monclient(hunting): picked mon.noname-c con 0x7fb4300c7e20 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:13:28.979 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.963+0000 7fb436091640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb43015b000 0x7fb4300cc560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:28.979 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.963+0000 7fb436091640 10 monclient(hunting): picked mon.noname-b con 0x7fb43015b000 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:13:28.979 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.963+0000 7fb436091640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb43015d370 0x7fb4301f3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:28.979 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.963+0000 7fb436091640 10 monclient(hunting): picked mon.noname-a con 0x7fb43015d370 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:13:28.979 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.963+0000 7fb436091640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:28.979 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.963+0000 7fb436091640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb4300c96d0 con 0x7fb43015d370 2026-02-17T11:13:28.979 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.963+0000 7fb436091640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:28.979 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.963+0000 7fb436091640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb4300c8ed0 con 0x7fb43015b000 2026-02-17T11:13:28.980 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.963+0000 7fb436091640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:28.980 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.963+0000 7fb436091640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb4301f6de0 con 0x7fb4300c7e20 2026-02-17T11:13:28.980 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.963+0000 7fb436091640 10 monclient(hunting): _renew_subs 2026-02-17T11:13:28.980 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.963+0000 7fb436091640 10 monclient(hunting): authenticate will time out at 1285.626420s 2026-02-17T11:13:28.980 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.963+0000 7fb42ffff640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb43015d370 0x7fb4301f3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:28.980 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.963+0000 7fb42f7fe640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb4300c7e20 0x7fb43006f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:28.980 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.963+0000 7fb42effd640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb43015b000 0x7fb4300cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:28.980 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.963+0000 7fb42ffff640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb43015d370 0x7fb4301f3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:50762/0 (socket says 10.20.193.49:50762) 2026-02-17T11:13:28.980 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.963+0000 7fb42ffff640 1 -- 10.20.193.49:0/4236740312 learned_addr learned my addr 10.20.193.49:0/4236740312 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:13:28.980 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.963+0000 7fb42ffff640 10 monclient(hunting): get_auth_request con 0x7fb43015d370 auth_method 0 2026-02-17T11:13:28.980 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.963+0000 7fb42ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:28.981 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.963+0000 7fb42ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:28.981 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.963+0000 7fb42ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:28.981 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.963+0000 7fb42f7fe640 10 monclient(hunting): get_auth_request con 0x7fb4300c7e20 auth_method 0 2026-02-17T11:13:28.981 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.963+0000 7fb42f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:28.981 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.963+0000 7fb42f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:28.981 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.963+0000 7fb42f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:28.981 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.964+0000 7fb42effd640 10 monclient(hunting): get_auth_request con 0x7fb43015b000 auth_method 0 2026-02-17T11:13:28.981 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.964+0000 7fb42effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:28.981 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.964+0000 7fb42effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:28.981 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.964+0000 7fb42effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:28.981 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.964+0000 7fb42ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:28.981 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.964+0000 7fb42ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:28.981 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.964+0000 7fb42ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:28.982 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.964+0000 7fb42f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:28.982 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.964+0000 7fb42f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:28.982 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.964+0000 7fb42f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:28.982 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.964+0000 7fb42effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:28.982 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.964+0000 7fb42effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:28.982 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.964+0000 7fb42effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:28.982 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.965+0000 7fb42effd640 10 monclient(hunting): handle_auth_done global_id 4888 payload 824 2026-02-17T11:13:28.982 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.965+0000 7fb42effd640 1 -- 10.20.193.49:0/4236740312 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb4300c7e20 msgr2=0x7fb43006f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:28.982 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.965+0000 7fb42effd640 1 --2- 10.20.193.49:0/4236740312 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb4300c7e20 0x7fb43006f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:28.982 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.965+0000 7fb42effd640 1 -- 10.20.193.49:0/4236740312 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb43015d370 msgr2=0x7fb4301f3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:28.982 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.965+0000 7fb42effd640 1 --2- 10.20.193.49:0/4236740312 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb43015d370 0x7fb4301f3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:28.982 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.965+0000 7fb42effd640 10 monclient: _finish_hunting 0 2026-02-17T11:13:28.982 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.965+0000 7fb42effd640 1 monclient: found mon.noname-b 2026-02-17T11:13:28.983 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.965+0000 7fb42effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:13:28.983 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.965+0000 7fb42effd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:13:28.983 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.965+0000 7fb42effd640 1 -- 10.20.193.49:0/4236740312 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4301f7030 con 0x7fb43015b000 2026-02-17T11:13:28.983 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.966+0000 7fb42effd640 1 --2- 10.20.193.49:0/4236740312 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb43015b000 0x7fb4300cc560 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb420036000 tx=0x7fb4200047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:13:28.983 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.966+0000 7fb40bfff640 10 client.?.objecter ms_handle_connect 0x7fb43015b000 2026-02-17T11:13:28.983 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.966+0000 7fb40bfff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:13:28.983 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.968+0000 7fb40bfff640 1 -- 10.20.193.49:0/4236740312 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb420046020 con 0x7fb43015b000 2026-02-17T11:13:28.983 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.968+0000 7fb40bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:28.983 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.968+0000 7fb40bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:13:28.983 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.968+0000 7fb40bfff640 10 monclient: dump: 2026-02-17T11:13:28.983 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:28.983 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:28.983 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:28.984 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:28.984 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:28.984 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:28.984 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:28.984 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:28.984 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:28.984 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:28.984 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.968+0000 7fb40bfff640 10 monclient: _finish_auth 0 2026-02-17T11:13:28.984 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.968+0000 7fb40bfff640 10 monclient: _check_auth_tickets 2026-02-17T11:13:28.984 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.968+0000 7fb40bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:13:28.984 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.968+0000 7fb40bfff640 1 -- 10.20.193.49:0/4236740312 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb420042650 con 0x7fb43015b000 2026-02-17T11:13:28.984 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.968+0000 7fb436091640 5 monclient: authenticate success, global_id 4888 2026-02-17T11:13:28.985 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.968+0000 7fb40bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:13:28.985 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.968+0000 7fb40bfff640 1 -- 10.20.193.49:0/4236740312 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb42003c040 con 0x7fb43015b000 2026-02-17T11:13:28.985 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.968+0000 7fb40bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:28.985 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.968+0000 7fb42dffb640 4 set_mon_vals no callback set 2026-02-17T11:13:28.985 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.968+0000 7fb40bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:13:28.985 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.968+0000 7fb40bfff640 10 monclient: dump: 2026-02-17T11:13:28.985 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:28.985 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:28.985 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:28.985 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:28.985 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:28.985 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:28.986 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:28.986 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:28.986 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:28.986 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:28.986 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.968+0000 7fb436091640 10 monclient: _renew_subs 2026-02-17T11:13:28.986 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.968+0000 7fb436091640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:13:28.986 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.968+0000 7fb436091640 1 -- 10.20.193.49:0/4236740312 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4301f7310 con 0x7fb43015b000 2026-02-17T11:13:28.986 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.968+0000 7fb436091640 10 client.4888.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:13:28.986 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.968+0000 7fb436091640 10 monclient: _renew_subs 2026-02-17T11:13:28.986 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.968+0000 7fb436091640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:13:28.986 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.968+0000 7fb436091640 1 -- 10.20.193.49:0/4236740312 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4301f78d0 con 0x7fb43015b000 2026-02-17T11:13:28.986 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.968+0000 7fb436091640 1 librados: init done 2026-02-17T11:13:28.986 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.969+0000 7fb436091640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:13:28.987 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.969+0000 7fb436091640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:13:28.987 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.969+0000 7fb436091640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:13:28.987 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:28.969+0000 7fb436091640 1 -- 10.20.193.49:0/4236740312 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb43015b490 con 0x7fb43015b000 2026-02-17T11:13:29.078 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:29.076+0000 7fb40bfff640 1 -- 10.20.193.49:0/4236740312 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7fb420053070 con 0x7fb43015b000 2026-02-17T11:13:29.079 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:29.076+0000 7fb40bfff640 1 --2- 10.20.193.49:0/4236740312 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb400079190 0x7fb40007b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:29.079 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:29.077+0000 7fb42f7fe640 1 --2- 10.20.193.49:0/4236740312 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb400079190 0x7fb40007b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:29.079 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:29.077+0000 7fb42f7fe640 10 monclient: get_auth_request con 0x7fb400079190 auth_method 0 2026-02-17T11:13:29.079 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:29.077+0000 7fb42f7fe640 1 --2- 10.20.193.49:0/4236740312 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb400079190 0x7fb40007b650 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb41c006fd0 tx=0x7fb41c009340 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:13:29.079 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:29.077+0000 7fb40bfff640 10 client.4888.objecter ms_handle_connect 0x7fb400079190 2026-02-17T11:13:29.080 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:29.079+0000 7fb40bfff640 1 -- 10.20.193.49:0/4236740312 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7fb42002f940 con 0x7fb43015b000 2026-02-17T11:13:29.080 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:29.079+0000 7fb40bfff640 10 client.4888.objecter ms_dispatch2 0x7fb430000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:13:29.081 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:29.079+0000 7fb40bfff640 3 client.4888.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:13:29.081 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:29.079+0000 7fb40bfff640 3 client.4888.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:13:29.081 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:29.079+0000 7fb40bfff640 20 client.4888.objecter dump_active .. 0 homeless 2026-02-17T11:13:29.086 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:29.085+0000 7fb40bfff640 1 -- 10.20.193.49:0/4236740312 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb420050020 con 0x7fb43015b000 2026-02-17T11:13:29.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:29.085+0000 7fb40bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:13:29.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:29.085+0000 7fb40bfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:13:29.189 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:29.188+0000 7fb436091640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:13:29.189 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:29.188+0000 7fb436091640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:13:29.190 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:29.188+0000 7fb436091640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:13:29.190 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:29.188+0000 7fb436091640 1 -- 10.20.193.49:0/4236740312 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb430157530 con 0x7fb43015b000 2026-02-17T11:13:29.192 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:29.191+0000 7fb40bfff640 1 -- 10.20.193.49:0/4236740312 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fb420087690 con 0x7fb43015b000 2026-02-17T11:13:29.192 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:29.191+0000 7fb40bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:13:29.193 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:29.191+0000 7fb40bfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:13:29.193 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:13:29.193 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:13:29.195 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:29.192+0000 7fb436091640 10 librados: watch_flush enter 2026-02-17T11:13:29.195 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:29.192+0000 7fb436091640 10 librados: watch_flush exit 2026-02-17T11:13:29.195 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:29.192+0000 7fb436091640 20 client.4888.objecter shutdown clearing up homeless session... 2026-02-17T11:13:29.195 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:29.192+0000 7fb436091640 10 client.4888.objecter successfully canceled tick 2026-02-17T11:13:29.195 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:29.192+0000 7fb436091640 1 -- 10.20.193.49:0/4236740312 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb400079190 msgr2=0x7fb40007b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:29.196 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:29.192+0000 7fb436091640 1 --2- 10.20.193.49:0/4236740312 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb400079190 0x7fb40007b650 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb41c006fd0 tx=0x7fb41c009340 comp rx=0 tx=0).stop 2026-02-17T11:13:29.196 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:29.192+0000 7fb436091640 10 monclient: shutdown 2026-02-17T11:13:29.196 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:29.192+0000 7fb436091640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:13:29.196 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:29.192+0000 7fb436091640 1 -- 10.20.193.49:0/4236740312 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb43015b000 msgr2=0x7fb4300cc560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:29.196 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:29.192+0000 7fb436091640 1 --2- 10.20.193.49:0/4236740312 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb43015b000 0x7fb4300cc560 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb420036000 tx=0x7fb4200047c0 comp rx=0 tx=0).stop 2026-02-17T11:13:29.196 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:29.192+0000 7fb436091640 1 -- 10.20.193.49:0/4236740312 shutdown_connections 2026-02-17T11:13:29.196 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:29.192+0000 7fb436091640 1 --2- 10.20.193.49:0/4236740312 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb400079190 0x7fb40007b650 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:29.196 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:29.192+0000 7fb436091640 1 --2- 10.20.193.49:0/4236740312 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb43015d370 0x7fb4301f3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:29.196 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:29.192+0000 7fb436091640 1 --2- 10.20.193.49:0/4236740312 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb43015b000 0x7fb4300cc560 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:29.196 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:29.192+0000 7fb436091640 1 --2- 10.20.193.49:0/4236740312 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb4300c7e20 0x7fb43006f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:29.196 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:29.192+0000 7fb436091640 1 -- 10.20.193.49:0/4236740312 >> 10.20.193.49:0/4236740312 conn(0x7fb4300c9f20 msgr2=0x7fb43015b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:13:29.196 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:29.192+0000 7fb436091640 1 -- 10.20.193.49:0/4236740312 shutdown_connections 2026-02-17T11:13:29.197 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:29.193+0000 7fb436091640 1 -- 10.20.193.49:0/4236740312 wait complete. 2026-02-17T11:13:29.197 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:29.193+0000 7fb436091640 1 librados: shutdown 2026-02-17T11:13:31.997 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:05:17.479 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:13:31.998 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:05:17.480 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:13:32.006 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:05:17.488 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:13:32.027 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:05:17.502 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:13:32.028 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:05:17.503 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:13:32.029 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:05:17.471 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:13:32.030 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:05:17.472 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:13:32.036 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:05:17.511 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:13:32.038 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:05:17.480 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:13:32.204 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:13:32.271 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.269+0000 7fa852d8d640 10 monclient: get_monmap_and_config 2026-02-17T11:13:32.271 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.269+0000 7fa852d8d640 10 monclient: build_initial_monmap 2026-02-17T11:13:32.271 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.269+0000 7fa852d8d640 10 monclient: monmap: 2026-02-17T11:13:32.271 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:13:32.271 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:32.271 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:13:32.269677+0000 2026-02-17T11:13:32.271 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:13:32.269677+0000 2026-02-17T11:13:32.272 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:13:32.272 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:32.272 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:13:32.272 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:13:32.272 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:13:32.272 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:13:32.272 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:13:32.272 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:13:32.272 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:32.272 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.269+0000 7fa852d8d640 1 Processor -- start 2026-02-17T11:13:32.272 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.269+0000 7fa852d8d640 1 -- start start 2026-02-17T11:13:32.272 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.269+0000 7fa852d8d640 10 monclient: init 2026-02-17T11:13:32.275 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.270+0000 7fa852d8d640 10 monclient: _reopen_session rank -1 2026-02-17T11:13:32.275 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.270+0000 7fa852d8d640 10 monclient: _add_conns ranks=[0,3,4,2,1,5] 2026-02-17T11:13:32.275 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.270+0000 7fa852d8d640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fa84c0c7170 addr v1:10.20.193.49:6789/0 2026-02-17T11:13:32.275 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.270+0000 7fa852d8d640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fa84c0c7550 0x7fa84c0749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:32.275 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.270+0000 7fa852d8d640 10 monclient(hunting): picked mon.noname-a con 0x7fa84c0c7550 addr v2:10.20.193.49:3300/0 2026-02-17T11:13:32.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.270+0000 7fa852d8d640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7fa84c074ef0 0x7fa84c0c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:32.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.270+0000 7fa852d8d640 10 monclient(hunting): picked mon.noname-b con 0x7fa84c074ef0 addr v2:10.20.193.97:3300/0 2026-02-17T11:13:32.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.270+0000 7fa852d8d640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa84c0c4fd0 con 0x7fa84c0c7170 2026-02-17T11:13:32.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.270+0000 7fa852d8d640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:32.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.270+0000 7fa852d8d640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7fa84c0c8530 con 0x7fa84c0c7550 2026-02-17T11:13:32.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.270+0000 7fa852d8d640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:32.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.270+0000 7fa852d8d640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7fa84c15a9a0 con 0x7fa84c074ef0 2026-02-17T11:13:32.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.270+0000 7fa852d8d640 10 monclient(hunting): _renew_subs 2026-02-17T11:13:32.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.270+0000 7fa852d8d640 10 monclient(hunting): authenticate will time out at 1288.933158s 2026-02-17T11:13:32.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.270+0000 7fa843fff640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fa84c0c7550 0x7fa84c0749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:32.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.270+0000 7fa851303640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7fa84c074ef0 0x7fa84c0c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:32.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.270+0000 7fa843fff640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fa84c0c7550 0x7fa84c0749b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:50768/0 (socket says 10.20.193.49:50768) 2026-02-17T11:13:32.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.270+0000 7fa843fff640 1 -- 10.20.193.49:0/2177678061 learned_addr learned my addr 10.20.193.49:0/2177678061 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:13:32.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.270+0000 7fa843fff640 10 monclient(hunting): get_auth_request con 0x7fa84c0c7550 auth_method 0 2026-02-17T11:13:32.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.270+0000 7fa843fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:32.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.270+0000 7fa843fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:32.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.270+0000 7fa843fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:32.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.270+0000 7fa851303640 10 monclient(hunting): get_auth_request con 0x7fa84c074ef0 auth_method 0 2026-02-17T11:13:32.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.270+0000 7fa851303640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:32.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.270+0000 7fa851303640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:32.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.270+0000 7fa851303640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:32.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.271+0000 7fa843fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:32.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.271+0000 7fa843fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:32.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.271+0000 7fa843fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:32.278 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.271+0000 7fa851303640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:32.278 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.271+0000 7fa851303640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:32.278 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.271+0000 7fa851303640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:32.278 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.272+0000 7fa843fff640 10 monclient(hunting): handle_auth_done global_id 4932 payload 274 2026-02-17T11:13:32.278 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.272+0000 7fa843fff640 1 -- 10.20.193.49:0/2177678061 >> v2:10.20.193.97:3300/0 conn(0x7fa84c074ef0 msgr2=0x7fa84c0c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:13:32.278 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.272+0000 7fa843fff640 1 --2- 10.20.193.49:0/2177678061 >> v2:10.20.193.97:3300/0 conn(0x7fa84c074ef0 0x7fa84c0c89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:32.278 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.272+0000 7fa843fff640 1 -- 10.20.193.49:0/2177678061 >> v1:10.20.193.49:6789/0 conn(0x7fa84c0c7170 legacy=0x7fa84c0c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:13:32.278 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.272+0000 7fa843fff640 10 monclient: _finish_hunting 0 2026-02-17T11:13:32.278 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.272+0000 7fa843fff640 1 monclient: found mon.noname-a 2026-02-17T11:13:32.278 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.272+0000 7fa843fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:13:32.278 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.272+0000 7fa843fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:13:32.278 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.272+0000 7fa843fff640 1 -- 10.20.193.49:0/2177678061 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa84c0c5270 con 0x7fa84c0c7550 2026-02-17T11:13:32.279 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.273+0000 7fa843fff640 1 --2- 10.20.193.49:0/2177678061 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fa84c0c7550 0x7fa84c0749b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa84c0c6e90 tx=0x7fa83402eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=674a371bd5a8b2a4 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:13:32.286 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.275+0000 7fa8437fe640 1 -- 10.20.193.49:0/2177678061 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa83403c070 con 0x7fa84c0c7550 2026-02-17T11:13:32.286 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.275+0000 7fa8437fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:32.286 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.275+0000 7fa8437fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:13:32.286 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.275+0000 7fa8437fe640 10 monclient: dump: 2026-02-17T11:13:32.286 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:32.286 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:32.286 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:32.286 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:32.287 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:32.287 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:32.287 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:32.287 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:32.287 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:32.287 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:32.287 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.275+0000 7fa8437fe640 10 monclient: _finish_auth 0 2026-02-17T11:13:32.287 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.275+0000 7fa8437fe640 10 monclient: _check_auth_tickets 2026-02-17T11:13:32.287 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.275+0000 7fa8437fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:13:32.288 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.275+0000 7fa8437fe640 1 -- 10.20.193.49:0/2177678061 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa83402fb20 con 0x7fa84c0c7550 2026-02-17T11:13:32.288 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.275+0000 7fa8437fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:13:32.288 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.275+0000 7fa8437fe640 1 -- 10.20.193.49:0/2177678061 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa834037440 con 0x7fa84c0c7550 2026-02-17T11:13:32.288 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.275+0000 7fa852d8d640 5 monclient: authenticate success, global_id 4932 2026-02-17T11:13:32.288 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.275+0000 7fa852d8d640 10 monclient: get_monmap_and_config success 2026-02-17T11:13:32.288 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.275+0000 7fa852d8d640 4 set_mon_vals no callback set 2026-02-17T11:13:32.289 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.275+0000 7fa8437fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:32.289 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.275+0000 7fa8437fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:13:32.289 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.275+0000 7fa8437fe640 10 monclient: dump: 2026-02-17T11:13:32.289 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:32.289 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:32.289 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:32.289 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:32.289 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:32.289 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:32.289 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:32.289 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:32.290 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:32.290 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:32.290 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.275+0000 7fa852d8d640 10 monclient: shutdown 2026-02-17T11:13:32.290 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.275+0000 7fa852d8d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:13:32.290 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.275+0000 7fa852d8d640 1 -- 10.20.193.49:0/2177678061 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fa84c0c7550 msgr2=0x7fa84c0749b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:32.290 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.275+0000 7fa852d8d640 1 --2- 10.20.193.49:0/2177678061 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fa84c0c7550 0x7fa84c0749b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa84c0c6e90 tx=0x7fa83402eeb0 comp rx=0 tx=0).stop 2026-02-17T11:13:32.290 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.275+0000 7fa852d8d640 1 -- 10.20.193.49:0/2177678061 shutdown_connections 2026-02-17T11:13:32.290 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.275+0000 7fa852d8d640 1 --2- 10.20.193.49:0/2177678061 >> v2:10.20.193.97:3300/0 conn(0x7fa84c074ef0 0x7fa84c0c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:32.290 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.275+0000 7fa852d8d640 1 --2- 10.20.193.49:0/2177678061 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fa84c0c7550 0x7fa84c0749b0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:32.290 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.275+0000 7fa852d8d640 1 -- 10.20.193.49:0/2177678061 >> 10.20.193.49:0/2177678061 conn(0x7fa84c0c9f40 msgr2=0x7fa84c0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:13:32.290 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.275+0000 7fa852d8d640 1 -- 10.20.193.49:0/2177678061 shutdown_connections 2026-02-17T11:13:32.291 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.275+0000 7fa852d8d640 1 -- 10.20.193.49:0/2177678061 wait complete. 2026-02-17T11:13:32.291 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.276+0000 7fa852d8d640 10 monclient: build_initial_monmap 2026-02-17T11:13:32.291 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.276+0000 7fa852d8d640 10 monclient: monmap: 2026-02-17T11:13:32.291 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:13:32.291 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:13:32.291 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:13:32.291 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:13:32.291 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:13:32.291 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:32.291 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:13:32.291 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:13:32.291 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:13:32.291 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:32.291 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.276+0000 7fa852d8d640 1 librados: starting msgr at 2026-02-17T11:13:32.292 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.276+0000 7fa852d8d640 1 librados: starting objecter 2026-02-17T11:13:32.292 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.276+0000 7fa852d8d640 1 Processor -- start 2026-02-17T11:13:32.292 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.276+0000 7fa852d8d640 1 -- start start 2026-02-17T11:13:32.292 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.276+0000 7fa852d8d640 1 librados: setting wanted keys 2026-02-17T11:13:32.292 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.276+0000 7fa852d8d640 1 librados: calling monclient init 2026-02-17T11:13:32.292 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.276+0000 7fa852d8d640 10 monclient: init 2026-02-17T11:13:32.292 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.277+0000 7fa852d8d640 10 monclient: _reopen_session rank -1 2026-02-17T11:13:32.292 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.277+0000 7fa852d8d640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:13:32.292 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.277+0000 7fa852d8d640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fa84c074ef0 0x7fa84c1f4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:32.292 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.277+0000 7fa852d8d640 10 monclient(hunting): picked mon.noname-c con 0x7fa84c074ef0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:13:32.292 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.277+0000 7fa852d8d640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fa84c0c7170 0x7fa84c156780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:32.292 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.277+0000 7fa852d8d640 10 monclient(hunting): picked mon.noname-a con 0x7fa84c0c7170 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:13:32.292 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.277+0000 7fa852d8d640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fa84c0c7550 0x7fa84c1f3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:32.293 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.277+0000 7fa852d8d640 10 monclient(hunting): picked mon.noname-b con 0x7fa84c0c7550 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:13:32.293 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.277+0000 7fa852d8d640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:32.293 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.277+0000 7fa852d8d640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa84c0c7ee0 con 0x7fa84c0c7170 2026-02-17T11:13:32.293 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.277+0000 7fa852d8d640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:32.293 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.277+0000 7fa852d8d640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa84c0c5830 con 0x7fa84c0c7550 2026-02-17T11:13:32.293 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.277+0000 7fa852d8d640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:32.293 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.277+0000 7fa852d8d640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fa84c0c81c0 con 0x7fa84c074ef0 2026-02-17T11:13:32.293 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.277+0000 7fa852d8d640 10 monclient(hunting): _renew_subs 2026-02-17T11:13:32.293 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.277+0000 7fa852d8d640 10 monclient(hunting): authenticate will time out at 1288.940249s 2026-02-17T11:13:32.293 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.277+0000 7fa843fff640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fa84c0c7170 0x7fa84c156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:32.293 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.277+0000 7fa850b02640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fa84c074ef0 0x7fa84c1f4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:32.293 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.277+0000 7fa851303640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fa84c0c7550 0x7fa84c1f3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:32.293 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.277+0000 7fa843fff640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fa84c0c7170 0x7fa84c156780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:50774/0 (socket says 10.20.193.49:50774) 2026-02-17T11:13:32.293 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.277+0000 7fa843fff640 1 -- 10.20.193.49:0/3023119212 learned_addr learned my addr 10.20.193.49:0/3023119212 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:13:32.294 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.277+0000 7fa843fff640 10 monclient(hunting): get_auth_request con 0x7fa84c0c7170 auth_method 0 2026-02-17T11:13:32.294 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.277+0000 7fa843fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:32.294 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.277+0000 7fa843fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:32.294 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.277+0000 7fa843fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:32.294 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.277+0000 7fa850b02640 10 monclient(hunting): get_auth_request con 0x7fa84c074ef0 auth_method 0 2026-02-17T11:13:32.294 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.277+0000 7fa850b02640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:32.294 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.277+0000 7fa850b02640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:32.294 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.277+0000 7fa850b02640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:32.294 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.277+0000 7fa851303640 10 monclient(hunting): get_auth_request con 0x7fa84c0c7550 auth_method 0 2026-02-17T11:13:32.294 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.277+0000 7fa851303640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:32.294 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.277+0000 7fa851303640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:32.294 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.277+0000 7fa851303640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:32.294 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.277+0000 7fa843fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:32.295 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.277+0000 7fa843fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:32.295 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.277+0000 7fa843fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:32.295 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.278+0000 7fa850b02640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:32.295 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.278+0000 7fa850b02640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:32.295 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.278+0000 7fa850b02640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:32.295 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.278+0000 7fa851303640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:32.295 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.278+0000 7fa851303640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:32.295 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.278+0000 7fa851303640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:32.295 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.279+0000 7fa843fff640 10 monclient(hunting): handle_auth_done global_id 4935 payload 824 2026-02-17T11:13:32.295 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.279+0000 7fa843fff640 1 -- 10.20.193.49:0/3023119212 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fa84c074ef0 msgr2=0x7fa84c1f4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:32.295 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.279+0000 7fa843fff640 1 --2- 10.20.193.49:0/3023119212 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fa84c074ef0 0x7fa84c1f4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:32.295 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.279+0000 7fa843fff640 1 -- 10.20.193.49:0/3023119212 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fa84c0c7550 msgr2=0x7fa84c1f3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:32.295 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.279+0000 7fa843fff640 1 --2- 10.20.193.49:0/3023119212 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fa84c0c7550 0x7fa84c1f3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:32.295 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.279+0000 7fa843fff640 10 monclient: _finish_hunting 0 2026-02-17T11:13:32.295 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.279+0000 7fa843fff640 1 monclient: found mon.noname-a 2026-02-17T11:13:32.295 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.279+0000 7fa843fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:13:32.296 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.279+0000 7fa843fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:13:32.296 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.279+0000 7fa843fff640 1 -- 10.20.193.49:0/3023119212 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa84c1f27c0 con 0x7fa84c0c7170 2026-02-17T11:13:32.296 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.280+0000 7fa843fff640 1 --2- 10.20.193.49:0/3023119212 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fa84c0c7170 0x7fa84c156780 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa834009a40 tx=0x7fa8340047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:13:32.296 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.280+0000 7fa8417fa640 10 client.?.objecter ms_handle_connect 0x7fa84c0c7170 2026-02-17T11:13:32.296 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.280+0000 7fa8417fa640 10 client.?.objecter resend_mon_ops 2026-02-17T11:13:32.296 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.282+0000 7fa8417fa640 1 -- 10.20.193.49:0/3023119212 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa83403c040 con 0x7fa84c0c7170 2026-02-17T11:13:32.296 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.282+0000 7fa8417fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:32.296 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.282+0000 7fa8417fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:13:32.296 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.282+0000 7fa8417fa640 10 monclient: dump: 2026-02-17T11:13:32.296 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:32.296 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:32.296 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:32.296 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:32.296 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:32.296 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:32.297 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:32.297 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:32.297 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:32.297 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:32.297 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.282+0000 7fa8417fa640 10 monclient: _finish_auth 0 2026-02-17T11:13:32.297 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.282+0000 7fa8417fa640 10 monclient: _check_auth_tickets 2026-02-17T11:13:32.297 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.282+0000 7fa8417fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:13:32.297 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.282+0000 7fa8417fa640 1 -- 10.20.193.49:0/3023119212 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa834042410 con 0x7fa84c0c7170 2026-02-17T11:13:32.297 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.282+0000 7fa8417fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:13:32.297 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.282+0000 7fa852d8d640 5 monclient: authenticate success, global_id 4935 2026-02-17T11:13:32.297 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.282+0000 7fa852d8d640 10 monclient: _renew_subs 2026-02-17T11:13:32.297 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.282+0000 7fa842ffd640 4 set_mon_vals no callback set 2026-02-17T11:13:32.297 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.282+0000 7fa852d8d640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:13:32.297 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.282+0000 7fa852d8d640 1 -- 10.20.193.49:0/3023119212 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa84c1556e0 con 0x7fa84c0c7170 2026-02-17T11:13:32.297 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.282+0000 7fa852d8d640 10 client.4935.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:13:32.297 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.282+0000 7fa852d8d640 10 monclient: _renew_subs 2026-02-17T11:13:32.298 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.282+0000 7fa852d8d640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:13:32.298 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.282+0000 7fa852d8d640 1 -- 10.20.193.49:0/3023119212 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa84c155ca0 con 0x7fa84c0c7170 2026-02-17T11:13:32.298 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.282+0000 7fa852d8d640 1 librados: init done 2026-02-17T11:13:32.298 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.282+0000 7fa8417fa640 1 -- 10.20.193.49:0/3023119212 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8340427c0 con 0x7fa84c0c7170 2026-02-17T11:13:32.298 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.282+0000 7fa8417fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:32.298 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.282+0000 7fa8417fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:13:32.298 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.282+0000 7fa8417fa640 10 monclient: dump: 2026-02-17T11:13:32.298 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:32.298 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:32.298 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:32.298 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:32.298 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:32.298 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:32.298 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:32.298 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:32.298 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:32.298 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:32.299 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.282+0000 7fa852d8d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:13:32.299 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.282+0000 7fa852d8d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:13:32.299 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.282+0000 7fa852d8d640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:13:32.299 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.282+0000 7fa852d8d640 1 -- 10.20.193.49:0/3023119212 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa84c0749b0 con 0x7fa84c0c7170 2026-02-17T11:13:32.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.294+0000 7fa8417fa640 1 -- 10.20.193.49:0/3023119212 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7fa834042960 con 0x7fa84c0c7170 2026-02-17T11:13:32.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.295+0000 7fa8417fa640 1 --2- 10.20.193.49:0/3023119212 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fa81c079190 0x7fa81c07b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:32.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.295+0000 7fa850b02640 1 --2- 10.20.193.49:0/3023119212 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fa81c079190 0x7fa81c07b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:32.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.295+0000 7fa850b02640 10 monclient: get_auth_request con 0x7fa81c079190 auth_method 0 2026-02-17T11:13:32.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.295+0000 7fa850b02640 1 --2- 10.20.193.49:0/3023119212 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fa81c079190 0x7fa81c07b650 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa84c1f59c0 tx=0x7fa83c0091c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:13:32.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.295+0000 7fa8417fa640 10 client.4935.objecter ms_handle_connect 0x7fa81c079190 2026-02-17T11:13:32.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.296+0000 7fa8417fa640 1 -- 10.20.193.49:0/3023119212 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7fa834083a30 con 0x7fa84c0c7170 2026-02-17T11:13:32.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.296+0000 7fa8417fa640 10 client.4935.objecter ms_dispatch2 0x7fa84c000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:13:32.301 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.296+0000 7fa8417fa640 3 client.4935.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:13:32.301 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.296+0000 7fa8417fa640 3 client.4935.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:13:32.301 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.297+0000 7fa8417fa640 20 client.4935.objecter dump_active .. 0 homeless 2026-02-17T11:13:32.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.399+0000 7fa8417fa640 1 -- 10.20.193.49:0/3023119212 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fa8340879f0 con 0x7fa84c0c7170 2026-02-17T11:13:32.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.399+0000 7fa8417fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:13:32.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.399+0000 7fa8417fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:13:32.501 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.499+0000 7fa852d8d640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:13:32.501 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.499+0000 7fa852d8d640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:13:32.501 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.499+0000 7fa852d8d640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:13:32.501 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.499+0000 7fa852d8d640 1 -- 10.20.193.49:0/3023119212 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa84c076dc0 con 0x7fa84c0c7170 2026-02-17T11:13:32.503 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.502+0000 7fa8417fa640 1 -- 10.20.193.49:0/3023119212 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fa83408bcf0 con 0x7fa84c0c7170 2026-02-17T11:13:32.503 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.502+0000 7fa8417fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:13:32.503 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.502+0000 7fa8417fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:13:32.504 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:13:32.504 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:13:32.505 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.503+0000 7fa852d8d640 10 librados: watch_flush enter 2026-02-17T11:13:32.505 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.503+0000 7fa852d8d640 10 librados: watch_flush exit 2026-02-17T11:13:32.505 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.503+0000 7fa852d8d640 20 client.4935.objecter shutdown clearing up homeless session... 2026-02-17T11:13:32.506 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.503+0000 7fa852d8d640 10 client.4935.objecter successfully canceled tick 2026-02-17T11:13:32.506 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.503+0000 7fa852d8d640 1 -- 10.20.193.49:0/3023119212 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fa81c079190 msgr2=0x7fa81c07b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:32.506 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.503+0000 7fa852d8d640 1 --2- 10.20.193.49:0/3023119212 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fa81c079190 0x7fa81c07b650 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa84c1f59c0 tx=0x7fa83c0091c0 comp rx=0 tx=0).stop 2026-02-17T11:13:32.506 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.503+0000 7fa852d8d640 10 monclient: shutdown 2026-02-17T11:13:32.506 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.503+0000 7fa852d8d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:13:32.506 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.503+0000 7fa852d8d640 1 -- 10.20.193.49:0/3023119212 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fa84c0c7170 msgr2=0x7fa84c156780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:32.506 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.503+0000 7fa852d8d640 1 --2- 10.20.193.49:0/3023119212 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fa84c0c7170 0x7fa84c156780 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa834009a40 tx=0x7fa8340047c0 comp rx=0 tx=0).stop 2026-02-17T11:13:32.506 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.503+0000 7fa852d8d640 1 -- 10.20.193.49:0/3023119212 shutdown_connections 2026-02-17T11:13:32.506 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.503+0000 7fa852d8d640 1 --2- 10.20.193.49:0/3023119212 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fa81c079190 0x7fa81c07b650 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:32.506 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.503+0000 7fa852d8d640 1 --2- 10.20.193.49:0/3023119212 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fa84c0c7550 0x7fa84c1f3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:32.507 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.503+0000 7fa852d8d640 1 --2- 10.20.193.49:0/3023119212 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fa84c0c7170 0x7fa84c156780 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:32.507 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.503+0000 7fa852d8d640 1 --2- 10.20.193.49:0/3023119212 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fa84c074ef0 0x7fa84c1f4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:32.507 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.503+0000 7fa852d8d640 1 -- 10.20.193.49:0/3023119212 >> 10.20.193.49:0/3023119212 conn(0x7fa84c0c9f40 msgr2=0x7fa84c073ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:13:32.507 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.503+0000 7fa852d8d640 1 -- 10.20.193.49:0/3023119212 shutdown_connections 2026-02-17T11:13:32.507 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.503+0000 7fa852d8d640 1 -- 10.20.193.49:0/3023119212 wait complete. 2026-02-17T11:13:32.507 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:32.503+0000 7fa852d8d640 1 librados: shutdown 2026-02-17T11:13:35.513 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:13:35.582 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.580+0000 7f64d9d22640 10 monclient: get_monmap_and_config 2026-02-17T11:13:35.582 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.580+0000 7f64d9d22640 10 monclient: build_initial_monmap 2026-02-17T11:13:35.582 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.580+0000 7f64d9d22640 10 monclient: monmap: 2026-02-17T11:13:35.582 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:13:35.582 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:35.582 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:13:35.581443+0000 2026-02-17T11:13:35.582 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:13:35.581443+0000 2026-02-17T11:13:35.582 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:13:35.582 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:35.582 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:13:35.582 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:13:35.582 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:13:35.582 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:13:35.582 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:13:35.583 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:13:35.583 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:35.583 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.581+0000 7f64d9d22640 1 Processor -- start 2026-02-17T11:13:35.583 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.581+0000 7f64d9d22640 1 -- start start 2026-02-17T11:13:35.583 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.581+0000 7f64d9d22640 10 monclient: init 2026-02-17T11:13:35.583 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.581+0000 7f64d9d22640 10 monclient: _reopen_session rank -1 2026-02-17T11:13:35.583 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.581+0000 7f64d9d22640 10 monclient: _add_conns ranks=[5,2,1,4,0,3] 2026-02-17T11:13:35.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.581+0000 7f64d9d22640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f64d4155d40 0x7f64d4156120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:35.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.581+0000 7f64d9d22640 10 monclient(hunting): picked mon.noname-c con 0x7f64d4155d40 addr v2:10.20.193.157:3300/0 2026-02-17T11:13:35.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.581+0000 7f64d9d22640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f64d40ccc00 addr v1:10.20.193.157:6789/0 2026-02-17T11:13:35.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.582+0000 7f64d9d22640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f64d40caff0 addr v1:10.20.193.97:6789/0 2026-02-17T11:13:35.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.582+0000 7f64d9d22640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64d415c8d0 con 0x7f64d40caff0 2026-02-17T11:13:35.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.582+0000 7f64d9d22640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64d415cbb0 con 0x7f64d40ccc00 2026-02-17T11:13:35.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.582+0000 7f64d9d22640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:35.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.582+0000 7f64d9d22640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f64d406c890 con 0x7f64d4155d40 2026-02-17T11:13:35.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.582+0000 7f64d9d22640 10 monclient(hunting): _renew_subs 2026-02-17T11:13:35.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.582+0000 7f64d9d22640 10 monclient(hunting): authenticate will time out at 1292.245025s 2026-02-17T11:13:35.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.582+0000 7f64d3fff640 1 --1- >> v1:10.20.193.97:6789/0 conn(0x7f64d40caff0 0x7f64d40cb480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.97:6789/0 says I am v1:10.20.193.49:46724/0 (socket says 10.20.193.49:46724) 2026-02-17T11:13:35.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.582+0000 7f64d3fff640 1 -- 10.20.193.49:0/2371860437 learned_addr learned my addr 10.20.193.49:0/2371860437 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:13:35.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.582+0000 7f64d37fe640 1 --2- 10.20.193.49:0/2371860437 >> v2:10.20.193.157:3300/0 conn(0x7f64d4155d40 0x7f64d4156120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:35.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.582+0000 7f64d37fe640 10 monclient(hunting): get_auth_request con 0x7f64d4155d40 auth_method 0 2026-02-17T11:13:35.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.582+0000 7f64d37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:35.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.582+0000 7f64d37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:35.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.582+0000 7f64d37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:35.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.583+0000 7f64d37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:35.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.583+0000 7f64d37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:35.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.583+0000 7f64d37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:35.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.584+0000 7f64d27fc640 1 -- 10.20.193.49:0/2371860437 <== mon.1 v1:10.20.193.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4254129036 0 0) 0x7f64d415c8d0 con 0x7f64d40caff0 2026-02-17T11:13:35.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.584+0000 7f64d27fc640 10 monclient(hunting): _negotiate 2026-02-17T11:13:35.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.584+0000 7f64d27fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:35.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.584+0000 7f64d27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:35.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.584+0000 7f64d27fc640 10 monclient(hunting): my global_id is 4897 2026-02-17T11:13:35.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.584+0000 7f64d27fc640 1 -- 10.20.193.49:0/2371860437 --> v1:10.20.193.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f64b8003620 con 0x7f64d40caff0 2026-02-17T11:13:35.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.585+0000 7f64d37fe640 10 monclient(hunting): handle_auth_done global_id 4931 payload 274 2026-02-17T11:13:35.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.585+0000 7f64d37fe640 1 -- 10.20.193.49:0/2371860437 >> v1:10.20.193.157:6789/0 conn(0x7f64d40ccc00 legacy=0x7f64d415d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:35.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.585+0000 7f64d37fe640 1 -- 10.20.193.49:0/2371860437 >> v1:10.20.193.97:6789/0 conn(0x7f64d40caff0 legacy=0x7f64d40cb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:35.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.585+0000 7f64d37fe640 10 monclient: _finish_hunting 0 2026-02-17T11:13:35.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.585+0000 7f64d37fe640 1 monclient: found mon.noname-c 2026-02-17T11:13:35.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.585+0000 7f64d37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:13:35.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.585+0000 7f64d37fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:13:35.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.585+0000 7f64d37fe640 1 -- 10.20.193.49:0/2371860437 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64d406cae0 con 0x7f64d4155d40 2026-02-17T11:13:35.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.587+0000 7f64d37fe640 1 --2- 10.20.193.49:0/2371860437 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f64d4155d40 0x7f64d4156120 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f64c00098a0 tx=0x7f64c002edd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=311569a8a54279da server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:13:35.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.590+0000 7f64d27fc640 1 -- 10.20.193.49:0/2371860437 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64c003c070 con 0x7f64d4155d40 2026-02-17T11:13:35.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.590+0000 7f64d27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:35.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.590+0000 7f64d27fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:13:35.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.590+0000 7f64d27fc640 10 monclient: dump: 2026-02-17T11:13:35.591 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:35.591 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:35.591 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:35.592 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:35.592 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:35.592 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:35.592 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:35.592 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:35.592 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:35.592 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:35.592 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.590+0000 7f64d27fc640 10 monclient: _finish_auth 0 2026-02-17T11:13:35.592 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.590+0000 7f64d27fc640 10 monclient: _check_auth_tickets 2026-02-17T11:13:35.592 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.590+0000 7f64d27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:13:35.592 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.590+0000 7f64d27fc640 1 -- 10.20.193.49:0/2371860437 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64c002fae0 con 0x7f64d4155d40 2026-02-17T11:13:35.592 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.590+0000 7f64d9d22640 5 monclient: authenticate success, global_id 4931 2026-02-17T11:13:35.592 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.590+0000 7f64d27fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:13:35.592 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.590+0000 7f64d9d22640 10 monclient: get_monmap_and_config success 2026-02-17T11:13:35.592 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.590+0000 7f64d27fc640 1 -- 10.20.193.49:0/2371860437 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64c0037440 con 0x7f64d4155d40 2026-02-17T11:13:35.592 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.590+0000 7f64d9d22640 4 set_mon_vals no callback set 2026-02-17T11:13:35.592 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.590+0000 7f64d27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:35.592 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.590+0000 7f64d27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:13:35.592 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.590+0000 7f64d27fc640 10 monclient: dump: 2026-02-17T11:13:35.592 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:35.592 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:35.592 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:35.592 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:35.592 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:35.592 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:35.592 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:35.592 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:35.593 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:35.593 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:35.594 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.590+0000 7f64d9d22640 10 monclient: shutdown 2026-02-17T11:13:35.594 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.590+0000 7f64d9d22640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:13:35.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.590+0000 7f64d9d22640 1 -- 10.20.193.49:0/2371860437 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f64d4155d40 msgr2=0x7f64d4156120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:35.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.590+0000 7f64d9d22640 1 --2- 10.20.193.49:0/2371860437 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f64d4155d40 0x7f64d4156120 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f64c00098a0 tx=0x7f64c002edd0 comp rx=0 tx=0).stop 2026-02-17T11:13:35.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.590+0000 7f64d9d22640 1 -- 10.20.193.49:0/2371860437 shutdown_connections 2026-02-17T11:13:35.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.590+0000 7f64d9d22640 1 --2- 10.20.193.49:0/2371860437 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f64d4155d40 0x7f64d4156120 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:35.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.590+0000 7f64d9d22640 1 -- 10.20.193.49:0/2371860437 >> 10.20.193.49:0/2371860437 conn(0x7f64d40cc0e0 msgr2=0x7f64d40cc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:13:35.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.590+0000 7f64d9d22640 1 -- 10.20.193.49:0/2371860437 shutdown_connections 2026-02-17T11:13:35.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.590+0000 7f64d9d22640 1 -- 10.20.193.49:0/2371860437 wait complete. 2026-02-17T11:13:35.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.591+0000 7f64d9d22640 10 monclient: build_initial_monmap 2026-02-17T11:13:35.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.591+0000 7f64d9d22640 10 monclient: monmap: 2026-02-17T11:13:35.595 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:13:35.595 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:13:35.595 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:13:35.595 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:13:35.595 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:13:35.595 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:35.595 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:13:35.595 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:13:35.595 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:13:35.595 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:35.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.591+0000 7f64d9d22640 1 librados: starting msgr at 2026-02-17T11:13:35.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.591+0000 7f64d9d22640 1 librados: starting objecter 2026-02-17T11:13:35.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.591+0000 7f64d9d22640 1 Processor -- start 2026-02-17T11:13:35.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.591+0000 7f64d9d22640 1 -- start start 2026-02-17T11:13:35.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.591+0000 7f64d9d22640 1 librados: setting wanted keys 2026-02-17T11:13:35.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.591+0000 7f64d9d22640 1 librados: calling monclient init 2026-02-17T11:13:35.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.591+0000 7f64d9d22640 10 monclient: init 2026-02-17T11:13:35.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.591+0000 7f64d9d22640 10 monclient: _reopen_session rank -1 2026-02-17T11:13:35.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.591+0000 7f64d9d22640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:13:35.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.591+0000 7f64d9d22640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f64d40caff0 0x7f64d41f4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:35.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.591+0000 7f64d9d22640 10 monclient(hunting): picked mon.noname-a con 0x7f64d40caff0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:13:35.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.591+0000 7f64d9d22640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f64d40ccc00 0x7f64d40c3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:35.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.591+0000 7f64d9d22640 10 monclient(hunting): picked mon.noname-c con 0x7f64d40ccc00 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:13:35.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.591+0000 7f64d9d22640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f64d4155d40 0x7f64d41f4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:35.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.591+0000 7f64d9d22640 10 monclient(hunting): picked mon.noname-b con 0x7f64d4155d40 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:13:35.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.591+0000 7f64d9d22640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:35.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.591+0000 7f64d9d22640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f64d406d0a0 con 0x7f64d40caff0 2026-02-17T11:13:35.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.591+0000 7f64d9d22640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:35.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.591+0000 7f64d9d22640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f64d406d410 con 0x7f64d4155d40 2026-02-17T11:13:35.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.591+0000 7f64d9d22640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:35.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.591+0000 7f64d9d22640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f64d415d9b0 con 0x7f64d40ccc00 2026-02-17T11:13:35.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.591+0000 7f64d9d22640 10 monclient(hunting): _renew_subs 2026-02-17T11:13:35.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.591+0000 7f64d9d22640 10 monclient(hunting): authenticate will time out at 1292.254814s 2026-02-17T11:13:35.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.592+0000 7f64d2ffd640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f64d40ccc00 0x7f64d40c3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:35.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.592+0000 7f64d3fff640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f64d4155d40 0x7f64d41f4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:35.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.592+0000 7f64d2ffd640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f64d40ccc00 0x7f64d40c3100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:43080/0 (socket says 10.20.193.49:43080) 2026-02-17T11:13:35.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.592+0000 7f64d2ffd640 1 -- 10.20.193.49:0/407649665 learned_addr learned my addr 10.20.193.49:0/407649665 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:13:35.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.592+0000 7f64d2ffd640 10 monclient(hunting): get_auth_request con 0x7f64d40ccc00 auth_method 0 2026-02-17T11:13:35.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.592+0000 7f64d2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:35.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.592+0000 7f64d2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:35.597 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.592+0000 7f64d2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:35.597 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.592+0000 7f64d3fff640 10 monclient(hunting): get_auth_request con 0x7f64d4155d40 auth_method 0 2026-02-17T11:13:35.597 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.592+0000 7f64d3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:35.597 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.592+0000 7f64d3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:35.597 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.592+0000 7f64d3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:35.597 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.592+0000 7f64d37fe640 1 --2- 10.20.193.49:0/407649665 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f64d40caff0 0x7f64d41f4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:35.597 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.592+0000 7f64d2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:35.597 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.592+0000 7f64d2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:35.597 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.592+0000 7f64d2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:35.597 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.592+0000 7f64d37fe640 10 monclient(hunting): get_auth_request con 0x7f64d40caff0 auth_method 0 2026-02-17T11:13:35.597 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.592+0000 7f64d37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:35.597 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.592+0000 7f64d37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:35.597 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.592+0000 7f64d37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:35.597 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.592+0000 7f64d3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:35.597 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.592+0000 7f64d3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:35.597 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.592+0000 7f64d3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:35.597 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.593+0000 7f64d37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:35.597 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.593+0000 7f64d37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:35.597 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.593+0000 7f64d37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:35.600 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.593+0000 7f64d2ffd640 10 monclient(hunting): handle_auth_done global_id 4937 payload 824 2026-02-17T11:13:35.600 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.593+0000 7f64d2ffd640 1 -- 10.20.193.49:0/407649665 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f64d4155d40 msgr2=0x7f64d41f4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:35.600 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.593+0000 7f64d2ffd640 1 --2- 10.20.193.49:0/407649665 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f64d4155d40 0x7f64d41f4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:35.600 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.593+0000 7f64d2ffd640 1 -- 10.20.193.49:0/407649665 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f64d40caff0 msgr2=0x7f64d41f4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:35.600 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.593+0000 7f64d2ffd640 1 --2- 10.20.193.49:0/407649665 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f64d40caff0 0x7f64d41f4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:35.600 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.593+0000 7f64d2ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:13:35.601 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.593+0000 7f64d2ffd640 1 monclient: found mon.noname-c 2026-02-17T11:13:35.601 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.593+0000 7f64d2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:13:35.601 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.593+0000 7f64d2ffd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:13:35.601 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.593+0000 7f64d2ffd640 1 -- 10.20.193.49:0/407649665 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64d40c3a20 con 0x7f64d40ccc00 2026-02-17T11:13:35.601 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.595+0000 7f64d2ffd640 1 --2- 10.20.193.49:0/407649665 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f64d40ccc00 0x7f64d40c3100 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f64c400c730 tx=0x7f64c400cc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:13:35.601 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.595+0000 7f64affff640 10 client.?.objecter ms_handle_connect 0x7f64d40ccc00 2026-02-17T11:13:35.601 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.595+0000 7f64affff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:13:35.601 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.596+0000 7f64affff640 1 -- 10.20.193.49:0/407649665 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64c40052d0 con 0x7f64d40ccc00 2026-02-17T11:13:35.601 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.596+0000 7f64affff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:35.601 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.596+0000 7f64affff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:13:35.601 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.596+0000 7f64affff640 10 monclient: dump: 2026-02-17T11:13:35.602 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:35.602 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:35.602 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:35.602 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:35.602 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:35.602 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:35.602 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:35.602 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:35.602 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:35.602 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:35.602 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.596+0000 7f64affff640 10 monclient: _finish_auth 0 2026-02-17T11:13:35.603 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.596+0000 7f64affff640 10 monclient: _check_auth_tickets 2026-02-17T11:13:35.603 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.596+0000 7f64affff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:13:35.603 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.596+0000 7f64d9d22640 5 monclient: authenticate success, global_id 4937 2026-02-17T11:13:35.603 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.596+0000 7f64d9d22640 10 monclient: _renew_subs 2026-02-17T11:13:35.603 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.596+0000 7f64d9d22640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:13:35.603 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.596+0000 7f64d9d22640 1 -- 10.20.193.49:0/407649665 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64d40c3d00 con 0x7f64d40ccc00 2026-02-17T11:13:35.603 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.596+0000 7f64d9d22640 10 client.4937.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:13:35.603 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.596+0000 7f64d9d22640 10 monclient: _renew_subs 2026-02-17T11:13:35.603 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.596+0000 7f64d9d22640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:13:35.603 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.596+0000 7f64d9d22640 1 -- 10.20.193.49:0/407649665 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64d40c42c0 con 0x7f64d40ccc00 2026-02-17T11:13:35.603 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.596+0000 7f64d9d22640 1 librados: init done 2026-02-17T11:13:35.603 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.596+0000 7f64d9d22640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:13:35.604 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.596+0000 7f64d9d22640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:13:35.604 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.596+0000 7f64d9d22640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:13:35.604 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.596+0000 7f64d9d22640 1 -- 10.20.193.49:0/407649665 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64d415c830 con 0x7f64d40ccc00 2026-02-17T11:13:35.604 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.596+0000 7f64affff640 1 -- 10.20.193.49:0/407649665 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64c4005470 con 0x7f64d40ccc00 2026-02-17T11:13:35.604 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.596+0000 7f64affff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:13:35.604 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.596+0000 7f64affff640 1 -- 10.20.193.49:0/407649665 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64c400a840 con 0x7f64d40ccc00 2026-02-17T11:13:35.604 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.596+0000 7f64affff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:35.604 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.596+0000 7f64affff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:13:35.604 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.596+0000 7f64d1ffb640 4 set_mon_vals no callback set 2026-02-17T11:13:35.604 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.596+0000 7f64affff640 10 monclient: dump: 2026-02-17T11:13:35.604 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:35.604 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:35.605 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:35.605 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:35.605 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:35.605 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:35.605 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:35.605 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:35.605 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:35.605 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:35.650 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.649+0000 7f64affff640 1 -- 10.20.193.49:0/407649665 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f64c400a9e0 con 0x7f64d40ccc00 2026-02-17T11:13:35.651 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.649+0000 7f64affff640 1 --2- 10.20.193.49:0/407649665 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f64a4079140 0x7f64a407b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:35.651 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.650+0000 7f64d37fe640 1 --2- 10.20.193.49:0/407649665 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f64a4079140 0x7f64a407b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:35.651 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.650+0000 7f64d37fe640 10 monclient: get_auth_request con 0x7f64a4079140 auth_method 0 2026-02-17T11:13:35.652 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.650+0000 7f64d37fe640 1 --2- 10.20.193.49:0/407649665 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f64a4079140 0x7f64a407b600 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f64c0039000 tx=0x7f64c0033000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:13:35.652 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.650+0000 7f64affff640 10 client.4937.objecter ms_handle_connect 0x7f64a4079140 2026-02-17T11:13:35.709 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.708+0000 7f64affff640 1 -- 10.20.193.49:0/407649665 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f64c4097ca0 con 0x7f64d40ccc00 2026-02-17T11:13:35.709 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.708+0000 7f64affff640 10 client.4937.objecter ms_dispatch2 0x7f64d4000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:13:35.709 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.708+0000 7f64affff640 3 client.4937.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:13:35.709 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.708+0000 7f64affff640 3 client.4937.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:13:35.709 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.708+0000 7f64affff640 20 client.4937.objecter dump_active .. 0 homeless 2026-02-17T11:13:35.715 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.714+0000 7f64affff640 1 -- 10.20.193.49:0/407649665 <== mon.2 v2:10.20.193.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f64c40621c0 con 0x7f64d40ccc00 2026-02-17T11:13:35.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.714+0000 7f64affff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:13:35.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.714+0000 7f64affff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:13:35.814 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.813+0000 7f64d9d22640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:13:35.815 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.813+0000 7f64d9d22640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:13:35.815 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.813+0000 7f64d9d22640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:13:35.815 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.813+0000 7f64d9d22640 1 -- 10.20.193.49:0/407649665 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f64d40701c0 con 0x7f64d40ccc00 2026-02-17T11:13:35.817 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.816+0000 7f64affff640 1 -- 10.20.193.49:0/407649665 <== mon.2 v2:10.20.193.157:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f64c40664c0 con 0x7f64d40ccc00 2026-02-17T11:13:35.818 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.816+0000 7f64affff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:13:35.818 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.816+0000 7f64affff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:13:35.818 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:13:35.818 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:13:35.820 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.817+0000 7f64d9d22640 10 librados: watch_flush enter 2026-02-17T11:13:35.820 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.817+0000 7f64d9d22640 10 librados: watch_flush exit 2026-02-17T11:13:35.820 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.817+0000 7f64d9d22640 20 client.4937.objecter shutdown clearing up homeless session... 2026-02-17T11:13:35.820 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.817+0000 7f64d9d22640 10 client.4937.objecter successfully canceled tick 2026-02-17T11:13:35.820 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.817+0000 7f64d9d22640 1 -- 10.20.193.49:0/407649665 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f64a4079140 msgr2=0x7f64a407b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:35.820 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.817+0000 7f64d9d22640 1 --2- 10.20.193.49:0/407649665 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f64a4079140 0x7f64a407b600 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f64c0039000 tx=0x7f64c0033000 comp rx=0 tx=0).stop 2026-02-17T11:13:35.820 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.817+0000 7f64d9d22640 10 monclient: shutdown 2026-02-17T11:13:35.820 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.817+0000 7f64d9d22640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:13:35.820 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.817+0000 7f64d9d22640 1 -- 10.20.193.49:0/407649665 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f64d40ccc00 msgr2=0x7f64d40c3100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:35.821 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.817+0000 7f64d9d22640 1 --2- 10.20.193.49:0/407649665 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f64d40ccc00 0x7f64d40c3100 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f64c400c730 tx=0x7f64c400cc00 comp rx=0 tx=0).stop 2026-02-17T11:13:35.821 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.817+0000 7f64d9d22640 1 -- 10.20.193.49:0/407649665 shutdown_connections 2026-02-17T11:13:35.821 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.817+0000 7f64d9d22640 1 --2- 10.20.193.49:0/407649665 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f64a4079140 0x7f64a407b600 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:35.821 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.817+0000 7f64d9d22640 1 --2- 10.20.193.49:0/407649665 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f64d4155d40 0x7f64d41f4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:35.821 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.817+0000 7f64d9d22640 1 --2- 10.20.193.49:0/407649665 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f64d40ccc00 0x7f64d40c3100 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:35.821 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.817+0000 7f64d9d22640 1 --2- 10.20.193.49:0/407649665 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f64d40caff0 0x7f64d41f4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:35.821 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.817+0000 7f64d9d22640 1 -- 10.20.193.49:0/407649665 >> 10.20.193.49:0/407649665 conn(0x7f64d40cc0e0 msgr2=0x7f64d406b600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:13:35.821 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.817+0000 7f64d9d22640 1 -- 10.20.193.49:0/407649665 shutdown_connections 2026-02-17T11:13:35.821 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.817+0000 7f64d9d22640 1 -- 10.20.193.49:0/407649665 wait complete. 2026-02-17T11:13:35.821 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:35.817+0000 7f64d9d22640 1 librados: shutdown 2026-02-17T11:13:38.827 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:13:38.894 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.892+0000 7f3b98587640 10 monclient: get_monmap_and_config 2026-02-17T11:13:38.894 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.892+0000 7f3b98587640 10 monclient: build_initial_monmap 2026-02-17T11:13:38.894 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.892+0000 7f3b98587640 10 monclient: monmap: 2026-02-17T11:13:38.894 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:13:38.894 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:38.894 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:13:38.893798+0000 2026-02-17T11:13:38.894 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:13:38.893798+0000 2026-02-17T11:13:38.894 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:13:38.894 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:38.894 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:13:38.894 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:13:38.894 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:13:38.894 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:13:38.894 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:13:38.895 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:13:38.895 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:38.895 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.892+0000 7f3b98587640 1 Processor -- start 2026-02-17T11:13:38.895 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.892+0000 7f3b98587640 1 -- start start 2026-02-17T11:13:38.895 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.892+0000 7f3b98587640 10 monclient: init 2026-02-17T11:13:38.895 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.893+0000 7f3b98587640 10 monclient: _reopen_session rank -1 2026-02-17T11:13:38.895 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.893+0000 7f3b98587640 10 monclient: _add_conns ranks=[1,0,5,3,4,2] 2026-02-17T11:13:38.895 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.893+0000 7f3b98587640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f3b9015d370 addr v1:10.20.193.97:6789/0 2026-02-17T11:13:38.895 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.893+0000 7f3b98587640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f3b900c7e20 addr v1:10.20.193.49:6789/0 2026-02-17T11:13:38.895 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.893+0000 7f3b98587640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f3b900c59c0 0x7f3b9015d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:38.895 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.893+0000 7f3b98587640 10 monclient(hunting): picked mon.noname-c con 0x7f3b900c59c0 addr v2:10.20.193.157:3300/0 2026-02-17T11:13:38.895 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.893+0000 7f3b98587640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b900c8350 con 0x7f3b900c7e20 2026-02-17T11:13:38.895 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.893+0000 7f3b98587640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b900c8630 con 0x7f3b9015d370 2026-02-17T11:13:38.895 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.893+0000 7f3b98587640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:38.895 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.893+0000 7f3b98587640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f3b9015b710 con 0x7f3b900c59c0 2026-02-17T11:13:38.895 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.893+0000 7f3b98587640 10 monclient(hunting): _renew_subs 2026-02-17T11:13:38.895 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.893+0000 7f3b98587640 10 monclient(hunting): authenticate will time out at 1295.557258s 2026-02-17T11:13:38.895 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.893+0000 7f3b95afb640 1 --1- >> v1:10.20.193.49:6789/0 conn(0x7f3b900c7e20 0x7f3b900c52b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.49:6789/0 says I am v1:10.20.193.49:41530/0 (socket says 10.20.193.49:41530) 2026-02-17T11:13:38.896 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.893+0000 7f3b95afb640 1 -- 10.20.193.49:0/1940807499 learned_addr learned my addr 10.20.193.49:0/1940807499 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:13:38.896 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.893+0000 7f3b962fc640 1 --1- 10.20.193.49:0/1940807499 >> v1:10.20.193.97:6789/0 conn(0x7f3b9015d370 0x7f3b9015b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.97:6789/0 says I am v1:10.20.193.49:50926/0 (socket says 10.20.193.49:50926) 2026-02-17T11:13:38.896 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.893+0000 7f3b96afd640 1 --2- 10.20.193.49:0/1940807499 >> v2:10.20.193.157:3300/0 conn(0x7f3b900c59c0 0x7f3b9015d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:38.896 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.893+0000 7f3b96afd640 10 monclient(hunting): get_auth_request con 0x7f3b900c59c0 auth_method 0 2026-02-17T11:13:38.896 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.893+0000 7f3b96afd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:38.896 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.893+0000 7f3b96afd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:38.896 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.893+0000 7f3b96afd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:38.896 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.894+0000 7f3b96afd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:38.896 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.894+0000 7f3b96afd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:38.896 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.894+0000 7f3b96afd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:38.899 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.895+0000 7f3b952fa640 1 -- 10.20.193.49:0/1940807499 <== mon.0 v1:10.20.193.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1228394698 0 0) 0x7f3b900c8350 con 0x7f3b900c7e20 2026-02-17T11:13:38.899 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.895+0000 7f3b952fa640 10 monclient(hunting): _negotiate 2026-02-17T11:13:38.899 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.895+0000 7f3b952fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:38.899 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.895+0000 7f3b952fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:38.899 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.895+0000 7f3b952fa640 10 monclient(hunting): my global_id is 4941 2026-02-17T11:13:38.899 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.895+0000 7f3b952fa640 1 -- 10.20.193.49:0/1940807499 --> v1:10.20.193.49:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b78003620 con 0x7f3b900c7e20 2026-02-17T11:13:38.899 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.895+0000 7f3b952fa640 1 -- 10.20.193.49:0/1940807499 <== mon.1 v1:10.20.193.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1183333369 0 0) 0x7f3b900c8630 con 0x7f3b9015d370 2026-02-17T11:13:38.899 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.895+0000 7f3b952fa640 10 monclient(hunting): _negotiate 2026-02-17T11:13:38.899 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.895+0000 7f3b952fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:38.900 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.895+0000 7f3b952fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:38.900 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.895+0000 7f3b952fa640 10 monclient(hunting): my global_id is 4903 2026-02-17T11:13:38.900 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.895+0000 7f3b952fa640 1 -- 10.20.193.49:0/1940807499 --> v1:10.20.193.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b900c8350 con 0x7f3b9015d370 2026-02-17T11:13:38.900 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.895+0000 7f3b96afd640 10 monclient(hunting): handle_auth_done global_id 4940 payload 274 2026-02-17T11:13:38.900 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.895+0000 7f3b96afd640 1 -- 10.20.193.49:0/1940807499 >> v1:10.20.193.97:6789/0 conn(0x7f3b9015d370 legacy=0x7f3b9015b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:38.900 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.895+0000 7f3b96afd640 1 -- 10.20.193.49:0/1940807499 >> v1:10.20.193.49:6789/0 conn(0x7f3b900c7e20 legacy=0x7f3b900c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:38.900 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.895+0000 7f3b96afd640 10 monclient: _finish_hunting 0 2026-02-17T11:13:38.900 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.895+0000 7f3b96afd640 1 monclient: found mon.noname-c 2026-02-17T11:13:38.900 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.895+0000 7f3b96afd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:13:38.900 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.895+0000 7f3b96afd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:13:38.900 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.895+0000 7f3b96afd640 1 -- 10.20.193.49:0/1940807499 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b900c8910 con 0x7f3b900c59c0 2026-02-17T11:13:38.901 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.896+0000 7f3b96afd640 1 --2- 10.20.193.49:0/1940807499 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f3b900c59c0 0x7f3b9015d750 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c009d90 tx=0x7f3b8c02f230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc239a643a4f2eca server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:13:38.908 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.898+0000 7f3b952fa640 1 -- 10.20.193.49:0/1940807499 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c03c070 con 0x7f3b900c59c0 2026-02-17T11:13:38.909 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.898+0000 7f3b952fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:38.909 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.898+0000 7f3b952fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:13:38.909 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.898+0000 7f3b952fa640 10 monclient: dump: 2026-02-17T11:13:38.909 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:38.909 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:38.909 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:38.909 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:38.909 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:38.909 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:38.910 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:38.910 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:38.910 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:38.910 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:38.910 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.898+0000 7f3b952fa640 10 monclient: _finish_auth 0 2026-02-17T11:13:38.910 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.898+0000 7f3b952fa640 10 monclient: _check_auth_tickets 2026-02-17T11:13:38.910 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.898+0000 7f3b952fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:13:38.910 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.898+0000 7f3b952fa640 1 -- 10.20.193.49:0/1940807499 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b8c037440 con 0x7f3b900c59c0 2026-02-17T11:13:38.910 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.898+0000 7f3b952fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:13:38.910 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.898+0000 7f3b952fa640 1 -- 10.20.193.49:0/1940807499 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c037810 con 0x7f3b900c59c0 2026-02-17T11:13:38.910 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.898+0000 7f3b952fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:38.910 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.898+0000 7f3b952fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:13:38.911 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.898+0000 7f3b952fa640 10 monclient: dump: 2026-02-17T11:13:38.911 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:38.911 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:38.911 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:38.911 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:38.911 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:38.911 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:38.911 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:38.911 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:38.911 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:38.912 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:38.912 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.898+0000 7f3b98587640 5 monclient: authenticate success, global_id 4940 2026-02-17T11:13:38.912 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.898+0000 7f3b98587640 10 monclient: get_monmap_and_config success 2026-02-17T11:13:38.912 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.898+0000 7f3b98587640 4 set_mon_vals no callback set 2026-02-17T11:13:38.912 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.898+0000 7f3b98587640 10 monclient: shutdown 2026-02-17T11:13:38.912 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.898+0000 7f3b98587640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:13:38.912 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.898+0000 7f3b98587640 1 -- 10.20.193.49:0/1940807499 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f3b900c59c0 msgr2=0x7f3b9015d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:38.912 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.898+0000 7f3b98587640 1 --2- 10.20.193.49:0/1940807499 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f3b900c59c0 0x7f3b9015d750 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c009d90 tx=0x7f3b8c02f230 comp rx=0 tx=0).stop 2026-02-17T11:13:38.912 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.898+0000 7f3b98587640 1 -- 10.20.193.49:0/1940807499 shutdown_connections 2026-02-17T11:13:38.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.898+0000 7f3b98587640 1 --2- 10.20.193.49:0/1940807499 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f3b900c59c0 0x7f3b9015d750 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:38.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.898+0000 7f3b98587640 1 -- 10.20.193.49:0/1940807499 >> 10.20.193.49:0/1940807499 conn(0x7f3b900c9f20 msgr2=0x7f3b900ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:13:38.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.898+0000 7f3b98587640 1 -- 10.20.193.49:0/1940807499 shutdown_connections 2026-02-17T11:13:38.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.898+0000 7f3b98587640 1 -- 10.20.193.49:0/1940807499 wait complete. 2026-02-17T11:13:38.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.899+0000 7f3b98587640 10 monclient: build_initial_monmap 2026-02-17T11:13:38.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.899+0000 7f3b98587640 10 monclient: monmap: 2026-02-17T11:13:38.913 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:13:38.913 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:13:38.913 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:13:38.913 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:13:38.913 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:13:38.913 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:38.914 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:13:38.914 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:13:38.914 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:13:38.914 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:38.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.899+0000 7f3b98587640 1 librados: starting msgr at 2026-02-17T11:13:38.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.899+0000 7f3b98587640 1 librados: starting objecter 2026-02-17T11:13:38.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.899+0000 7f3b98587640 1 Processor -- start 2026-02-17T11:13:38.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.899+0000 7f3b98587640 1 -- start start 2026-02-17T11:13:38.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.899+0000 7f3b98587640 1 librados: setting wanted keys 2026-02-17T11:13:38.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.899+0000 7f3b98587640 1 librados: calling monclient init 2026-02-17T11:13:38.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.899+0000 7f3b98587640 10 monclient: init 2026-02-17T11:13:38.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.899+0000 7f3b98587640 10 monclient: _reopen_session rank -1 2026-02-17T11:13:38.915 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.899+0000 7f3b98587640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:13:38.915 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.899+0000 7f3b98587640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f3b900c59c0 0x7f3b90149bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:38.915 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.899+0000 7f3b98587640 10 monclient(hunting): picked mon.noname-b con 0x7f3b900c59c0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:13:38.915 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.899+0000 7f3b98587640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f3b900c7e20 0x7f3b900726d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:38.915 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.899+0000 7f3b98587640 10 monclient(hunting): picked mon.noname-a con 0x7f3b900c7e20 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:13:38.915 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.899+0000 7f3b98587640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f3b9015d370 0x7f3b901488a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:38.915 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.899+0000 7f3b98587640 10 monclient(hunting): picked mon.noname-c con 0x7f3b9015d370 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:13:38.915 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.899+0000 7f3b98587640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:38.915 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.899+0000 7f3b98587640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f3b900c8ed0 con 0x7f3b900c7e20 2026-02-17T11:13:38.915 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.899+0000 7f3b98587640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:38.915 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.899+0000 7f3b98587640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f3b900c9240 con 0x7f3b900c59c0 2026-02-17T11:13:38.915 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.899+0000 7f3b98587640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:38.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.899+0000 7f3b98587640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f3b900c96d0 con 0x7f3b9015d370 2026-02-17T11:13:38.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.899+0000 7f3b98587640 10 monclient(hunting): _renew_subs 2026-02-17T11:13:38.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.899+0000 7f3b98587640 10 monclient(hunting): authenticate will time out at 1295.563999s 2026-02-17T11:13:38.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.900+0000 7f3b95afb640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f3b900c7e20 0x7f3b900726d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:38.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.900+0000 7f3b96afd640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f3b9015d370 0x7f3b901488a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:38.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.900+0000 7f3b96afd640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f3b9015d370 0x7f3b901488a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:39750/0 (socket says 10.20.193.49:39750) 2026-02-17T11:13:38.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.900+0000 7f3b96afd640 1 -- 10.20.193.49:0/2290934902 learned_addr learned my addr 10.20.193.49:0/2290934902 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:13:38.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.900+0000 7f3b96afd640 10 monclient(hunting): get_auth_request con 0x7f3b9015d370 auth_method 0 2026-02-17T11:13:38.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.900+0000 7f3b96afd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:38.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.900+0000 7f3b96afd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:38.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.900+0000 7f3b96afd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:38.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.900+0000 7f3b962fc640 1 --2- 10.20.193.49:0/2290934902 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f3b900c59c0 0x7f3b90149bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:38.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.900+0000 7f3b95afb640 10 monclient(hunting): get_auth_request con 0x7f3b900c7e20 auth_method 0 2026-02-17T11:13:38.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.900+0000 7f3b95afb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:38.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.900+0000 7f3b95afb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:38.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.900+0000 7f3b95afb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:38.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.900+0000 7f3b962fc640 10 monclient(hunting): get_auth_request con 0x7f3b900c59c0 auth_method 0 2026-02-17T11:13:38.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.900+0000 7f3b962fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:38.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.900+0000 7f3b962fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:38.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.900+0000 7f3b962fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:38.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.900+0000 7f3b96afd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:38.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.900+0000 7f3b96afd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:38.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.900+0000 7f3b96afd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:38.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.900+0000 7f3b962fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:38.918 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.900+0000 7f3b962fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:38.918 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.900+0000 7f3b962fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:38.918 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.900+0000 7f3b95afb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:38.918 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.900+0000 7f3b95afb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:38.918 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.900+0000 7f3b95afb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:38.918 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.901+0000 7f3b96afd640 10 monclient(hunting): handle_auth_done global_id 4943 payload 824 2026-02-17T11:13:38.918 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.902+0000 7f3b96afd640 1 -- 10.20.193.49:0/2290934902 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f3b900c59c0 msgr2=0x7f3b90149bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:38.918 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.902+0000 7f3b96afd640 1 --2- 10.20.193.49:0/2290934902 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f3b900c59c0 0x7f3b90149bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:38.918 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.902+0000 7f3b96afd640 1 -- 10.20.193.49:0/2290934902 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f3b900c7e20 msgr2=0x7f3b900726d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:38.918 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.902+0000 7f3b96afd640 1 --2- 10.20.193.49:0/2290934902 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f3b900c7e20 0x7f3b900726d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:38.918 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.902+0000 7f3b96afd640 10 monclient: _finish_hunting 0 2026-02-17T11:13:38.918 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.902+0000 7f3b96afd640 1 monclient: found mon.noname-c 2026-02-17T11:13:38.918 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.902+0000 7f3b96afd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:13:38.919 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.902+0000 7f3b96afd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:13:38.919 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.902+0000 7f3b96afd640 1 -- 10.20.193.49:0/2290934902 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b90157c70 con 0x7f3b9015d370 2026-02-17T11:13:38.919 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.903+0000 7f3b96afd640 1 --2- 10.20.193.49:0/2290934902 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f3b9015d370 0x7f3b901488a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c009d90 tx=0x7f3b8c004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:13:38.919 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.903+0000 7f3b76ffd640 10 client.?.objecter ms_handle_connect 0x7f3b9015d370 2026-02-17T11:13:38.919 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.903+0000 7f3b76ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:13:38.919 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.904+0000 7f3b76ffd640 1 -- 10.20.193.49:0/2290934902 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c047020 con 0x7f3b9015d370 2026-02-17T11:13:38.919 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.904+0000 7f3b76ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:38.919 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.904+0000 7f3b76ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:13:38.919 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.904+0000 7f3b76ffd640 10 monclient: dump: 2026-02-17T11:13:38.919 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:38.919 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:38.919 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:38.920 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:38.920 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:38.920 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:38.920 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:38.920 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:38.920 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:38.920 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:38.920 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.904+0000 7f3b76ffd640 10 monclient: _finish_auth 0 2026-02-17T11:13:38.920 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.904+0000 7f3b76ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:13:38.920 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.904+0000 7f3b76ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:13:38.920 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.904+0000 7f3b76ffd640 1 -- 10.20.193.49:0/2290934902 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b8c03d040 con 0x7f3b9015d370 2026-02-17T11:13:38.920 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.904+0000 7f3b76ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:13:38.921 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.904+0000 7f3b76ffd640 1 -- 10.20.193.49:0/2290934902 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c03c050 con 0x7f3b9015d370 2026-02-17T11:13:38.921 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.904+0000 7f3b98587640 5 monclient: authenticate success, global_id 4943 2026-02-17T11:13:38.921 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.904+0000 7f3b98587640 10 monclient: _renew_subs 2026-02-17T11:13:38.921 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.904+0000 7f3b94af9640 4 set_mon_vals no callback set 2026-02-17T11:13:38.921 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.904+0000 7f3b98587640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:13:38.921 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.904+0000 7f3b98587640 1 -- 10.20.193.49:0/2290934902 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b90074930 con 0x7f3b9015d370 2026-02-17T11:13:38.921 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.904+0000 7f3b76ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:38.921 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.904+0000 7f3b76ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:13:38.921 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.904+0000 7f3b76ffd640 10 monclient: dump: 2026-02-17T11:13:38.921 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:38.921 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:38.921 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:38.921 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:38.922 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:38.922 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:38.922 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:38.922 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:38.922 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:38.922 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:38.922 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.904+0000 7f3b98587640 10 client.4943.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:13:38.922 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.904+0000 7f3b98587640 10 monclient: _renew_subs 2026-02-17T11:13:38.922 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.904+0000 7f3b98587640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:13:38.923 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.904+0000 7f3b98587640 1 -- 10.20.193.49:0/2290934902 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b90157f10 con 0x7f3b9015d370 2026-02-17T11:13:38.923 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.904+0000 7f3b98587640 1 librados: init done 2026-02-17T11:13:38.923 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.905+0000 7f3b98587640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:13:38.923 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.905+0000 7f3b98587640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:13:38.923 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.905+0000 7f3b98587640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:13:38.923 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.905+0000 7f3b98587640 1 -- 10.20.193.49:0/2290934902 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b9015d750 con 0x7f3b9015d370 2026-02-17T11:13:38.924 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.916+0000 7f3b76ffd640 1 -- 10.20.193.49:0/2290934902 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f3b8c054070 con 0x7f3b9015d370 2026-02-17T11:13:38.924 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.917+0000 7f3b76ffd640 1 --2- 10.20.193.49:0/2290934902 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3b60079190 0x7f3b6007b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:38.924 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.917+0000 7f3b962fc640 1 --2- 10.20.193.49:0/2290934902 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3b60079190 0x7f3b6007b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:38.925 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.917+0000 7f3b962fc640 10 monclient: get_auth_request con 0x7f3b60079190 auth_method 0 2026-02-17T11:13:38.925 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.917+0000 7f3b962fc640 1 --2- 10.20.193.49:0/2290934902 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3b60079190 0x7f3b6007b650 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3b900c3a80 tx=0x7f3b80007e10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:13:38.925 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.917+0000 7f3b76ffd640 10 client.4943.objecter ms_handle_connect 0x7f3b60079190 2026-02-17T11:13:38.925 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.918+0000 7f3b76ffd640 1 -- 10.20.193.49:0/2290934902 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f3b8c083fb0 con 0x7f3b9015d370 2026-02-17T11:13:38.925 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.918+0000 7f3b76ffd640 10 client.4943.objecter ms_dispatch2 0x7f3b90000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:13:38.925 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.918+0000 7f3b76ffd640 3 client.4943.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:13:38.925 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.918+0000 7f3b76ffd640 3 client.4943.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:13:38.925 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:38.918+0000 7f3b76ffd640 20 client.4943.objecter dump_active .. 0 homeless 2026-02-17T11:13:39.025 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:39.022+0000 7f3b76ffd640 1 -- 10.20.193.49:0/2290934902 <== mon.2 v2:10.20.193.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f3b8c051020 con 0x7f3b9015d370 2026-02-17T11:13:39.025 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:39.022+0000 7f3b76ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:13:39.025 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:39.022+0000 7f3b76ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:13:39.124 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:39.121+0000 7f3b98587640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:13:39.125 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:39.121+0000 7f3b98587640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:13:39.125 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:39.121+0000 7f3b98587640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:13:39.125 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:39.121+0000 7f3b98587640 1 -- 10.20.193.49:0/2290934902 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f3b9015b310 con 0x7f3b9015d370 2026-02-17T11:13:39.126 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:39.123+0000 7f3b76ffd640 1 -- 10.20.193.49:0/2290934902 <== mon.2 v2:10.20.193.157:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f3b8c087f70 con 0x7f3b9015d370 2026-02-17T11:13:39.126 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:39.123+0000 7f3b76ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:13:39.126 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:39.123+0000 7f3b76ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:13:39.127 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:13:39.127 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:13:39.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:39.125+0000 7f3b98587640 10 librados: watch_flush enter 2026-02-17T11:13:39.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:39.125+0000 7f3b98587640 10 librados: watch_flush exit 2026-02-17T11:13:39.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:39.125+0000 7f3b98587640 20 client.4943.objecter shutdown clearing up homeless session... 2026-02-17T11:13:39.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:39.125+0000 7f3b98587640 10 client.4943.objecter successfully canceled tick 2026-02-17T11:13:39.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:39.125+0000 7f3b98587640 1 -- 10.20.193.49:0/2290934902 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3b60079190 msgr2=0x7f3b6007b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:39.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:39.125+0000 7f3b98587640 1 --2- 10.20.193.49:0/2290934902 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3b60079190 0x7f3b6007b650 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3b900c3a80 tx=0x7f3b80007e10 comp rx=0 tx=0).stop 2026-02-17T11:13:39.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:39.125+0000 7f3b98587640 10 monclient: shutdown 2026-02-17T11:13:39.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:39.125+0000 7f3b98587640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:13:39.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:39.125+0000 7f3b98587640 1 -- 10.20.193.49:0/2290934902 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f3b9015d370 msgr2=0x7f3b901488a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:39.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:39.125+0000 7f3b98587640 1 --2- 10.20.193.49:0/2290934902 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f3b9015d370 0x7f3b901488a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c009d90 tx=0x7f3b8c004b40 comp rx=0 tx=0).stop 2026-02-17T11:13:39.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:39.125+0000 7f3b98587640 1 -- 10.20.193.49:0/2290934902 shutdown_connections 2026-02-17T11:13:39.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:39.125+0000 7f3b98587640 1 --2- 10.20.193.49:0/2290934902 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3b60079190 0x7f3b6007b650 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:39.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:39.125+0000 7f3b98587640 1 --2- 10.20.193.49:0/2290934902 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f3b9015d370 0x7f3b901488a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:39.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:39.125+0000 7f3b98587640 1 --2- 10.20.193.49:0/2290934902 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f3b900c7e20 0x7f3b900726d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:39.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:39.125+0000 7f3b98587640 1 --2- 10.20.193.49:0/2290934902 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f3b900c59c0 0x7f3b90149bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:39.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:39.125+0000 7f3b98587640 1 -- 10.20.193.49:0/2290934902 >> 10.20.193.49:0/2290934902 conn(0x7f3b900c9f20 msgr2=0x7f3b90152960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:13:39.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:39.125+0000 7f3b98587640 1 -- 10.20.193.49:0/2290934902 shutdown_connections 2026-02-17T11:13:39.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:39.125+0000 7f3b98587640 1 -- 10.20.193.49:0/2290934902 wait complete. 2026-02-17T11:13:39.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:39.125+0000 7f3b98587640 1 librados: shutdown 2026-02-17T11:13:42.137 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:13:42.206 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.203+0000 7f6b1583a640 10 monclient: get_monmap_and_config 2026-02-17T11:13:42.206 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.203+0000 7f6b1583a640 10 monclient: build_initial_monmap 2026-02-17T11:13:42.206 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.203+0000 7f6b1583a640 10 monclient: monmap: 2026-02-17T11:13:42.207 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:13:42.207 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:42.207 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:13:42.205114+0000 2026-02-17T11:13:42.207 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:13:42.205114+0000 2026-02-17T11:13:42.207 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:13:42.207 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:42.207 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:13:42.207 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:13:42.207 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:13:42.207 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:13:42.207 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:13:42.208 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:13:42.208 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:42.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.204+0000 7f6b1583a640 1 Processor -- start 2026-02-17T11:13:42.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.204+0000 7f6b1583a640 1 -- start start 2026-02-17T11:13:42.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.204+0000 7f6b1583a640 10 monclient: init 2026-02-17T11:13:42.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.204+0000 7f6b1583a640 10 monclient: _reopen_session rank -1 2026-02-17T11:13:42.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.204+0000 7f6b1583a640 10 monclient: _add_conns ranks=[2,1,4,3,0,5] 2026-02-17T11:13:42.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.204+0000 7f6b1583a640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f6b1014f280 addr v1:10.20.193.157:6789/0 2026-02-17T11:13:42.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.204+0000 7f6b1583a640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f6b1014f660 addr v1:10.20.193.97:6789/0 2026-02-17T11:13:42.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.204+0000 7f6b1583a640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f6b1015abc0 0x7f6b1015afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:42.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.204+0000 7f6b1583a640 10 monclient(hunting): picked mon.noname-b con 0x7f6b1015abc0 addr v2:10.20.193.97:3300/0 2026-02-17T11:13:42.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.204+0000 7f6b1583a640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b100c7110 con 0x7f6b1014f660 2026-02-17T11:13:42.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.204+0000 7f6b1583a640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b100c7390 con 0x7f6b1014f280 2026-02-17T11:13:42.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.204+0000 7f6b1583a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:42.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.204+0000 7f6b1583a640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f6b100c7950 con 0x7f6b1015abc0 2026-02-17T11:13:42.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.204+0000 7f6b1583a640 10 monclient(hunting): _renew_subs 2026-02-17T11:13:42.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.204+0000 7f6b1583a640 10 monclient(hunting): authenticate will time out at 1298.868593s 2026-02-17T11:13:42.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.204+0000 7f6b0effd640 1 --1- >> v1:10.20.193.157:6789/0 conn(0x7f6b1014f280 0x7f6b100c7e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.157:6789/0 says I am v1:10.20.193.49:37640/0 (socket says 10.20.193.49:37640) 2026-02-17T11:13:42.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.204+0000 7f6b0effd640 1 -- 10.20.193.49:0/2878761373 learned_addr learned my addr 10.20.193.49:0/2878761373 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:13:42.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.205+0000 7f6b0f7fe640 1 --2- 10.20.193.49:0/2878761373 >> v2:10.20.193.97:3300/0 conn(0x7f6b1015abc0 0x7f6b1015afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:42.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.205+0000 7f6b0f7fe640 10 monclient(hunting): get_auth_request con 0x7f6b1015abc0 auth_method 0 2026-02-17T11:13:42.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.205+0000 7f6b0f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:42.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.205+0000 7f6b0f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:42.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.205+0000 7f6b0f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:42.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.206+0000 7f6b0f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:42.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.206+0000 7f6b0f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:42.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.206+0000 7f6b0f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:42.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.206+0000 7f6b0dffb640 1 -- 10.20.193.49:0/2878761373 <== mon.2 v1:10.20.193.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4125740954 0 0) 0x7f6b100c7390 con 0x7f6b1014f280 2026-02-17T11:13:42.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.206+0000 7f6b0dffb640 10 monclient(hunting): _negotiate 2026-02-17T11:13:42.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.206+0000 7f6b0dffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:42.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.206+0000 7f6b0dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:42.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.206+0000 7f6b0dffb640 10 monclient(hunting): my global_id is 4946 2026-02-17T11:13:42.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.206+0000 7f6b0dffb640 1 -- 10.20.193.49:0/2878761373 --> v1:10.20.193.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6afc003620 con 0x7f6b1014f280 2026-02-17T11:13:42.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.208+0000 7f6b0dffb640 1 -- 10.20.193.49:0/2878761373 <== mon.2 v1:10.20.193.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2382654804 0 0) 0x7f6afc003620 con 0x7f6b1014f280 2026-02-17T11:13:42.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.208+0000 7f6b0dffb640 1 -- 10.20.193.49:0/2878761373 >> v2:10.20.193.97:3300/0 conn(0x7f6b1015abc0 msgr2=0x7f6b1015afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:13:42.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.208+0000 7f6b0dffb640 1 --2- 10.20.193.49:0/2878761373 >> v2:10.20.193.97:3300/0 conn(0x7f6b1015abc0 0x7f6b1015afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:42.216 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.208+0000 7f6b0dffb640 1 -- 10.20.193.49:0/2878761373 >> v1:10.20.193.97:6789/0 conn(0x7f6b1014f660 legacy=0x7f6b100c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:42.216 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.208+0000 7f6b0dffb640 10 monclient: _finish_hunting 0 2026-02-17T11:13:42.216 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.208+0000 7f6b0dffb640 1 monclient: found mon.noname-c-legacy 2026-02-17T11:13:42.216 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.208+0000 7f6b0dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:13:42.216 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.208+0000 7f6b0dffb640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:10.20.193.157:6789/0 2026-02-17T11:13:42.216 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.208+0000 7f6b0dffb640 1 -- 10.20.193.49:0/2878761373 --> v1:10.20.193.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b100c7670 con 0x7f6b1014f280 2026-02-17T11:13:42.216 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.208+0000 7f6b0dffb640 10 monclient: _finish_auth 0 2026-02-17T11:13:42.216 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.208+0000 7f6b0dffb640 10 monclient: _check_auth_tickets 2026-02-17T11:13:42.216 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.208+0000 7f6b0dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:13:42.216 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.208+0000 7f6b0dffb640 1 -- 10.20.193.49:0/2878761373 <== mon.2 v1:10.20.193.157:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2462710995 0 0) 0x7f6b04002f00 con 0x7f6b1014f280 2026-02-17T11:13:42.216 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.208+0000 7f6b0dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:42.217 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.208+0000 7f6b0dffb640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2026-02-17T11:13:42.217 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.208+0000 7f6b0dffb640 10 monclient: dump: 2026-02-17T11:13:42.217 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:42.217 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:42.217 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:42.217 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:42.217 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:42.217 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:42.217 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:42.217 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:42.217 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:42.217 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:42.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.208+0000 7f6b0dffb640 1 monclient: mon.c has (v2) addrs [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] but i'm connected to v1:10.20.193.157:6789/0, reconnecting 2026-02-17T11:13:42.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.208+0000 7f6b0dffb640 10 monclient: _reopen_session rank -1 2026-02-17T11:13:42.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.208+0000 7f6b0dffb640 1 -- 10.20.193.49:0/2878761373 >> v1:10.20.193.157:6789/0 conn(0x7f6b1014f280 legacy=0x7f6b100c7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:42.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.208+0000 7f6b0dffb640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:13:42.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.208+0000 7f6b0dffb640 1 --2- 10.20.193.49:0/2878761373 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f6afc003bf0 0x7f6afc004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:42.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.208+0000 7f6b0dffb640 10 monclient(hunting): picked mon.b con 0x7f6afc003bf0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:13:42.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.208+0000 7f6b0dffb640 1 --2- 10.20.193.49:0/2878761373 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f6afc004900 0x7f6afc004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:42.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.208+0000 7f6b0dffb640 10 monclient(hunting): picked mon.a con 0x7f6afc004900 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:13:42.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.208+0000 7f6b0dffb640 1 --2- 10.20.193.49:0/2878761373 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f6afc0053e0 0x7f6afc00bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:42.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.208+0000 7f6b0dffb640 10 monclient(hunting): picked mon.c con 0x7f6afc0053e0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:13:42.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.208+0000 7f6b0dffb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:42.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.208+0000 7f6b0dffb640 1 -- 10.20.193.49:0/2878761373 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6b100c7950 con 0x7f6afc004900 2026-02-17T11:13:42.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.208+0000 7f6b0dffb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:42.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.208+0000 7f6b0dffb640 1 -- 10.20.193.49:0/2878761373 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6afc00c2b0 con 0x7f6afc003bf0 2026-02-17T11:13:42.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.208+0000 7f6b0dffb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:42.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.208+0000 7f6b0dffb640 1 -- 10.20.193.49:0/2878761373 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f6afc00c4b0 con 0x7f6afc0053e0 2026-02-17T11:13:42.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.208+0000 7f6b0dffb640 10 monclient(hunting): _renew_subs 2026-02-17T11:13:42.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.208+0000 7f6b0dffb640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:13:42.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.208+0000 7f6b0e7fc640 1 --2- 10.20.193.49:0/2878761373 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f6afc004900 0x7f6afc004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:42.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.208+0000 7f6b0e7fc640 10 monclient(hunting): get_auth_request con 0x7f6afc004900 auth_method 0 2026-02-17T11:13:42.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.208+0000 7f6b0e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:42.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.208+0000 7f6b0e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:42.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.208+0000 7f6b0e7fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:13:42.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.209+0000 7f6b0e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:42.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.209+0000 7f6b0e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:42.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.209+0000 7f6b0e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:13:42.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.209+0000 7f6b0f7fe640 1 --2- 10.20.193.49:0/2878761373 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f6afc0053e0 0x7f6afc00bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:42.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.209+0000 7f6b0f7fe640 10 monclient(hunting): get_auth_request con 0x7f6afc0053e0 auth_method 0 2026-02-17T11:13:42.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.210+0000 7f6b0f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:42.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.210+0000 7f6b0f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:42.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.210+0000 7f6b0f7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:13:42.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.210+0000 7f6b0e7fc640 10 monclient(hunting): handle_auth_done global_id 4946 payload 293 2026-02-17T11:13:42.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.210+0000 7f6b0e7fc640 1 -- 10.20.193.49:0/2878761373 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f6afc0053e0 msgr2=0x7f6afc00bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:13:42.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.210+0000 7f6b0e7fc640 1 --2- 10.20.193.49:0/2878761373 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f6afc0053e0 0x7f6afc00bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:42.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.210+0000 7f6b0e7fc640 1 -- 10.20.193.49:0/2878761373 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f6afc003bf0 msgr2=0x7f6afc004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:13:42.221 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.210+0000 7f6b0e7fc640 1 --2- 10.20.193.49:0/2878761373 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f6afc003bf0 0x7f6afc004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:42.221 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.210+0000 7f6b0e7fc640 10 monclient: _finish_hunting 0 2026-02-17T11:13:42.221 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.210+0000 7f6b0e7fc640 1 monclient: found mon.a 2026-02-17T11:13:42.221 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.210+0000 7f6b0e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:13:42.221 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.210+0000 7f6b0e7fc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:13:42.221 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.210+0000 7f6b0f7fe640 1 -- 10.20.193.49:0/2878761373 reap_dead start 2026-02-17T11:13:42.221 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.210+0000 7f6b0e7fc640 1 -- 10.20.193.49:0/2878761373 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6afc003620 con 0x7f6afc004900 2026-02-17T11:13:42.221 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.210+0000 7f6b0e7fc640 10 monclient: _finish_auth 0 2026-02-17T11:13:42.221 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.210+0000 7f6b0e7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:13:42.221 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.210+0000 7f6b0e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:13:42.221 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.210+0000 7f6b1583a640 5 monclient: authenticate success, global_id 4946 2026-02-17T11:13:42.221 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.210+0000 7f6b1583a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:13:42.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.211+0000 7f6b0e7fc640 1 --2- 10.20.193.49:0/2878761373 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f6afc004900 0x7f6afc004d80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6af8003070 tx=0x7f6af802ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=643c573c5a169a67 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:13:42.229 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.212+0000 7f6b0dffb640 1 -- 10.20.193.49:0/2878761373 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af8002cc0 con 0x7f6afc004900 2026-02-17T11:13:42.229 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.212+0000 7f6b0dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:42.229 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.212+0000 7f6b0dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:13:42.229 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.212+0000 7f6b0dffb640 10 monclient: dump: 2026-02-17T11:13:42.229 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:42.229 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:42.229 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:42.229 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:42.229 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:42.229 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:42.230 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:42.230 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:42.230 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:42.230 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:42.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.212+0000 7f6b0dffb640 1 -- 10.20.193.49:0/2878761373 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6af80052d0 con 0x7f6afc004900 2026-02-17T11:13:42.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.212+0000 7f6b0dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:13:42.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.212+0000 7f6b1583a640 10 monclient: get_monmap_and_config success 2026-02-17T11:13:42.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.212+0000 7f6b0dffb640 1 -- 10.20.193.49:0/2878761373 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af80036f0 con 0x7f6afc004900 2026-02-17T11:13:42.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.212+0000 7f6b1583a640 4 set_mon_vals no callback set 2026-02-17T11:13:42.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.212+0000 7f6b0dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:42.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.212+0000 7f6b0dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:13:42.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.212+0000 7f6b0dffb640 10 monclient: dump: 2026-02-17T11:13:42.231 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:42.231 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:42.231 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:42.231 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:42.231 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:42.231 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:42.231 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:42.231 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:42.231 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:42.231 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:42.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.213+0000 7f6b1583a640 10 monclient: shutdown 2026-02-17T11:13:42.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.213+0000 7f6b1583a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:13:42.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.213+0000 7f6b1583a640 1 -- 10.20.193.49:0/2878761373 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f6afc004900 msgr2=0x7f6afc004d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:42.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.213+0000 7f6b1583a640 1 --2- 10.20.193.49:0/2878761373 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f6afc004900 0x7f6afc004d80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6af8003070 tx=0x7f6af802ed80 comp rx=0 tx=0).stop 2026-02-17T11:13:42.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.213+0000 7f6b1583a640 1 -- 10.20.193.49:0/2878761373 shutdown_connections 2026-02-17T11:13:42.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.213+0000 7f6b1583a640 1 --2- 10.20.193.49:0/2878761373 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f6afc004900 0x7f6afc004d80 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:42.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.213+0000 7f6b1583a640 1 -- 10.20.193.49:0/2878761373 >> 10.20.193.49:0/2878761373 conn(0x7f6b100c9f20 msgr2=0x7f6b100ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:13:42.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.213+0000 7f6b1583a640 1 -- 10.20.193.49:0/2878761373 shutdown_connections 2026-02-17T11:13:42.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.213+0000 7f6b1583a640 1 -- 10.20.193.49:0/2878761373 wait complete. 2026-02-17T11:13:42.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.213+0000 7f6b1583a640 10 monclient: build_initial_monmap 2026-02-17T11:13:42.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.213+0000 7f6b1583a640 10 monclient: monmap: 2026-02-17T11:13:42.232 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:13:42.232 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:13:42.233 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:13:42.233 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:13:42.233 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:13:42.233 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:42.233 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:13:42.233 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:13:42.233 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:13:42.233 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:42.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.213+0000 7f6b1583a640 1 librados: starting msgr at 2026-02-17T11:13:42.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.213+0000 7f6b1583a640 1 librados: starting objecter 2026-02-17T11:13:42.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.214+0000 7f6b1583a640 1 Processor -- start 2026-02-17T11:13:42.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.214+0000 7f6b1583a640 1 -- start start 2026-02-17T11:13:42.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.214+0000 7f6b1583a640 1 librados: setting wanted keys 2026-02-17T11:13:42.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.214+0000 7f6b1583a640 1 librados: calling monclient init 2026-02-17T11:13:42.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.214+0000 7f6b1583a640 10 monclient: init 2026-02-17T11:13:42.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.214+0000 7f6b1583a640 10 monclient: _reopen_session rank -1 2026-02-17T11:13:42.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.214+0000 7f6b1583a640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:13:42.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.214+0000 7f6b1583a640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f6afc004900 0x7f6b10159200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:42.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.214+0000 7f6b1583a640 10 monclient(hunting): picked mon.noname-c con 0x7f6afc004900 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:13:42.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.214+0000 7f6b1583a640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f6b10140070 0x7f6b100726d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:42.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.214+0000 7f6b1583a640 10 monclient(hunting): picked mon.noname-b con 0x7f6b10140070 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:13:42.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.214+0000 7f6b1583a640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f6b10072c10 0x7f6b101f10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:42.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.214+0000 7f6b1583a640 10 monclient(hunting): picked mon.noname-a con 0x7f6b10072c10 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:13:42.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.214+0000 7f6b1583a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:42.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.214+0000 7f6b1583a640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6b1015a3c0 con 0x7f6b10072c10 2026-02-17T11:13:42.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.214+0000 7f6b1583a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:42.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.214+0000 7f6b1583a640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6b1015a730 con 0x7f6b10140070 2026-02-17T11:13:42.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.214+0000 7f6b1583a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:42.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.214+0000 7f6b1583a640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f6b100c9b70 con 0x7f6afc004900 2026-02-17T11:13:42.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.214+0000 7f6b1583a640 10 monclient(hunting): _renew_subs 2026-02-17T11:13:42.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.214+0000 7f6b1583a640 10 monclient(hunting): authenticate will time out at 1298.878480s 2026-02-17T11:13:42.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.214+0000 7f6b0f7fe640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f6b10072c10 0x7f6b101f10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:42.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.214+0000 7f6b0f7fe640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f6b10072c10 0x7f6b101f10b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:34700/0 (socket says 10.20.193.49:34700) 2026-02-17T11:13:42.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.214+0000 7f6b0f7fe640 1 -- 10.20.193.49:0/3701056332 learned_addr learned my addr 10.20.193.49:0/3701056332 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:13:42.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.214+0000 7f6b0f7fe640 10 monclient(hunting): get_auth_request con 0x7f6b10072c10 auth_method 0 2026-02-17T11:13:42.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.214+0000 7f6b0f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:42.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.214+0000 7f6b0f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:42.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.214+0000 7f6b0f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:42.236 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.214+0000 7f6b0e7fc640 1 --2- 10.20.193.49:0/3701056332 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f6b10140070 0x7f6b100726d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:42.236 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.214+0000 7f6b0effd640 1 --2- 10.20.193.49:0/3701056332 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f6afc004900 0x7f6b10159200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:42.236 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.215+0000 7f6b0e7fc640 10 monclient(hunting): get_auth_request con 0x7f6b10140070 auth_method 0 2026-02-17T11:13:42.236 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.215+0000 7f6b0e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:42.236 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.215+0000 7f6b0e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:42.236 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.215+0000 7f6b0e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:42.236 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.215+0000 7f6b0effd640 10 monclient(hunting): get_auth_request con 0x7f6afc004900 auth_method 0 2026-02-17T11:13:42.236 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.215+0000 7f6b0effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:42.236 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.215+0000 7f6b0effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:42.236 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.215+0000 7f6b0effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:42.236 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.215+0000 7f6b0f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:42.236 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.215+0000 7f6b0f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:42.237 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.215+0000 7f6b0f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:42.237 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.215+0000 7f6b0effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:42.237 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.215+0000 7f6b0effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:42.237 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.215+0000 7f6b0effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:42.237 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.215+0000 7f6b0e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:42.237 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.215+0000 7f6b0e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:42.237 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.215+0000 7f6b0e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:42.237 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.216+0000 7f6b0f7fe640 10 monclient(hunting): handle_auth_done global_id 4947 payload 824 2026-02-17T11:13:42.237 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.216+0000 7f6b0f7fe640 1 -- 10.20.193.49:0/3701056332 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f6afc004900 msgr2=0x7f6b10159200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:42.237 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.216+0000 7f6b0f7fe640 1 --2- 10.20.193.49:0/3701056332 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f6afc004900 0x7f6b10159200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:42.237 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.216+0000 7f6b0f7fe640 1 -- 10.20.193.49:0/3701056332 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f6b10140070 msgr2=0x7f6b100726d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:42.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.216+0000 7f6b0f7fe640 1 --2- 10.20.193.49:0/3701056332 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f6b10140070 0x7f6b100726d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:42.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.216+0000 7f6b0f7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:13:42.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.216+0000 7f6b0f7fe640 1 monclient: found mon.noname-a 2026-02-17T11:13:42.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.216+0000 7f6b0f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:13:42.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.216+0000 7f6b0f7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:13:42.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.216+0000 7f6b0f7fe640 1 -- 10.20.193.49:0/3701056332 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b10073090 con 0x7f6b10072c10 2026-02-17T11:13:42.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.217+0000 7f6b0f7fe640 1 --2- 10.20.193.49:0/3701056332 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f6b10072c10 0x7f6b101f10b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6b10072330 tx=0x7f6b000115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:13:42.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.217+0000 7f6ae7fff640 10 client.?.objecter ms_handle_connect 0x7f6b10072c10 2026-02-17T11:13:42.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.217+0000 7f6ae7fff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:13:42.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.219+0000 7f6ae7fff640 1 -- 10.20.193.49:0/3701056332 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b00011df0 con 0x7f6b10072c10 2026-02-17T11:13:42.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.219+0000 7f6ae7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:42.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.219+0000 7f6ae7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:13:42.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.219+0000 7f6ae7fff640 10 monclient: dump: 2026-02-17T11:13:42.239 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:42.239 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:42.239 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:42.239 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:42.239 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:42.239 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:42.239 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:42.239 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:42.239 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:42.239 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:42.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.219+0000 7f6ae7fff640 10 monclient: _finish_auth 0 2026-02-17T11:13:42.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.219+0000 7f6ae7fff640 10 monclient: _check_auth_tickets 2026-02-17T11:13:42.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.219+0000 7f6ae7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:13:42.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.219+0000 7f6ae7fff640 1 -- 10.20.193.49:0/3701056332 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b0001b070 con 0x7f6b10072c10 2026-02-17T11:13:42.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.219+0000 7f6b1583a640 5 monclient: authenticate success, global_id 4947 2026-02-17T11:13:42.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.219+0000 7f6b1583a640 10 monclient: _renew_subs 2026-02-17T11:13:42.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.219+0000 7f6b1583a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:13:42.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.219+0000 7f6b1583a640 1 -- 10.20.193.49:0/3701056332 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b10158160 con 0x7f6b10072c10 2026-02-17T11:13:42.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.219+0000 7f6ae7fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:13:42.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.219+0000 7f6ae7fff640 1 -- 10.20.193.49:0/3701056332 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b00003a90 con 0x7f6b10072c10 2026-02-17T11:13:42.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.219+0000 7f6ae7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:42.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.219+0000 7f6ae7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:13:42.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.219+0000 7f6b0d7fa640 4 set_mon_vals no callback set 2026-02-17T11:13:42.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.219+0000 7f6ae7fff640 10 monclient: dump: 2026-02-17T11:13:42.241 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:42.241 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:42.241 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:42.241 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:42.241 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:42.241 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:42.241 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:42.241 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:42.241 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:42.241 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:42.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.219+0000 7f6b1583a640 10 client.4947.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:13:42.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.219+0000 7f6b1583a640 10 monclient: _renew_subs 2026-02-17T11:13:42.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.219+0000 7f6b1583a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:13:42.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.219+0000 7f6b1583a640 1 -- 10.20.193.49:0/3701056332 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b10158720 con 0x7f6b10072c10 2026-02-17T11:13:42.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.219+0000 7f6b1583a640 1 librados: init done 2026-02-17T11:13:42.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.219+0000 7f6b1583a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:13:42.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.219+0000 7f6b1583a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:13:42.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.219+0000 7f6b1583a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:13:42.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.219+0000 7f6b1583a640 1 -- 10.20.193.49:0/3701056332 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b100c7390 con 0x7f6b10072c10 2026-02-17T11:13:42.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.231+0000 7f6ae7fff640 1 -- 10.20.193.49:0/3701056332 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f6b00003c30 con 0x7f6b10072c10 2026-02-17T11:13:42.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.232+0000 7f6ae7fff640 1 --2- 10.20.193.49:0/3701056332 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f6ae00791c0 0x7f6ae007b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:42.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.232+0000 7f6b0effd640 1 --2- 10.20.193.49:0/3701056332 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f6ae00791c0 0x7f6ae007b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:42.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.232+0000 7f6b0effd640 10 monclient: get_auth_request con 0x7f6ae00791c0 auth_method 0 2026-02-17T11:13:42.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.232+0000 7f6b0effd640 1 --2- 10.20.193.49:0/3701056332 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f6ae00791c0 0x7f6ae007b680 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6b040033e0 tx=0x7f6b04003370 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:13:42.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.232+0000 7f6ae7fff640 10 client.4947.objecter ms_handle_connect 0x7f6ae00791c0 2026-02-17T11:13:42.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.233+0000 7f6ae7fff640 1 -- 10.20.193.49:0/3701056332 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f6b0005f190 con 0x7f6b10072c10 2026-02-17T11:13:42.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.233+0000 7f6ae7fff640 10 client.4947.objecter ms_dispatch2 0x7f6b10000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:13:42.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.233+0000 7f6ae7fff640 3 client.4947.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:13:42.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.233+0000 7f6ae7fff640 3 client.4947.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:13:42.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.233+0000 7f6ae7fff640 20 client.4947.objecter dump_active .. 0 homeless 2026-02-17T11:13:42.335 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.333+0000 7f6ae7fff640 1 -- 10.20.193.49:0/3701056332 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f6b00025020 con 0x7f6b10072c10 2026-02-17T11:13:42.335 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.333+0000 7f6ae7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:13:42.336 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.333+0000 7f6ae7fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:13:42.434 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.431+0000 7f6b1583a640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:13:42.434 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.431+0000 7f6b1583a640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:13:42.434 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.431+0000 7f6b1583a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:13:42.435 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.431+0000 7f6b1583a640 1 -- 10.20.193.49:0/3701056332 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f6b100c6400 con 0x7f6b10072c10 2026-02-17T11:13:42.436 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.434+0000 7f6ae7fff640 1 -- 10.20.193.49:0/3701056332 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f6b00063150 con 0x7f6b10072c10 2026-02-17T11:13:42.436 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.434+0000 7f6ae7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:13:42.436 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.434+0000 7f6ae7fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:13:42.437 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:13:42.437 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:13:42.438 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.435+0000 7f6b1583a640 10 librados: watch_flush enter 2026-02-17T11:13:42.438 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.435+0000 7f6b1583a640 10 librados: watch_flush exit 2026-02-17T11:13:42.439 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.435+0000 7f6b1583a640 20 client.4947.objecter shutdown clearing up homeless session... 2026-02-17T11:13:42.439 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.435+0000 7f6b1583a640 10 client.4947.objecter successfully canceled tick 2026-02-17T11:13:42.439 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.435+0000 7f6b1583a640 1 -- 10.20.193.49:0/3701056332 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f6ae00791c0 msgr2=0x7f6ae007b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:42.439 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.435+0000 7f6b1583a640 1 --2- 10.20.193.49:0/3701056332 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f6ae00791c0 0x7f6ae007b680 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6b040033e0 tx=0x7f6b04003370 comp rx=0 tx=0).stop 2026-02-17T11:13:42.439 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.435+0000 7f6b1583a640 10 monclient: shutdown 2026-02-17T11:13:42.439 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.435+0000 7f6b1583a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:13:42.439 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.435+0000 7f6b1583a640 1 -- 10.20.193.49:0/3701056332 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f6b10072c10 msgr2=0x7f6b101f10b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:42.439 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.435+0000 7f6b1583a640 1 --2- 10.20.193.49:0/3701056332 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f6b10072c10 0x7f6b101f10b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6b10072330 tx=0x7f6b000115a0 comp rx=0 tx=0).stop 2026-02-17T11:13:42.439 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.435+0000 7f6b1583a640 1 -- 10.20.193.49:0/3701056332 shutdown_connections 2026-02-17T11:13:42.439 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.435+0000 7f6b1583a640 1 --2- 10.20.193.49:0/3701056332 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f6ae00791c0 0x7f6ae007b680 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:42.439 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.435+0000 7f6b1583a640 1 --2- 10.20.193.49:0/3701056332 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f6b10072c10 0x7f6b101f10b0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:42.439 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.435+0000 7f6b1583a640 1 --2- 10.20.193.49:0/3701056332 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f6b10140070 0x7f6b100726d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:42.440 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.435+0000 7f6b1583a640 1 --2- 10.20.193.49:0/3701056332 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f6afc004900 0x7f6b10159200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:42.440 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.435+0000 7f6b1583a640 1 -- 10.20.193.49:0/3701056332 >> 10.20.193.49:0/3701056332 conn(0x7f6b100c9f20 msgr2=0x7f6b100c6920 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:13:42.440 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.435+0000 7f6b1583a640 1 -- 10.20.193.49:0/3701056332 shutdown_connections 2026-02-17T11:13:42.440 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.435+0000 7f6b1583a640 1 -- 10.20.193.49:0/3701056332 wait complete. 2026-02-17T11:13:42.440 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:42.435+0000 7f6b1583a640 1 librados: shutdown 2026-02-17T11:13:45.446 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:13:45.514 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.512+0000 7f77d83e4640 10 monclient: get_monmap_and_config 2026-02-17T11:13:45.515 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.512+0000 7f77d83e4640 10 monclient: build_initial_monmap 2026-02-17T11:13:45.515 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.512+0000 7f77d83e4640 10 monclient: monmap: 2026-02-17T11:13:45.515 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:13:45.515 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:45.515 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:13:45.513795+0000 2026-02-17T11:13:45.515 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:13:45.513795+0000 2026-02-17T11:13:45.515 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:13:45.515 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:45.515 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:13:45.515 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:13:45.515 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:13:45.516 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:13:45.516 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:13:45.516 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:13:45.516 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:45.518 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.512+0000 7f77d83e4640 1 Processor -- start 2026-02-17T11:13:45.519 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.512+0000 7f77d83e4640 1 -- start start 2026-02-17T11:13:45.519 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.512+0000 7f77d83e4640 10 monclient: init 2026-02-17T11:13:45.519 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.513+0000 7f77d83e4640 10 monclient: _reopen_session rank -1 2026-02-17T11:13:45.519 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.513+0000 7f77d83e4640 10 monclient: _add_conns ranks=[3,4,0,2,5,1] 2026-02-17T11:13:45.519 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.513+0000 7f77d83e4640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f77d014f280 0x7f77d00c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:45.519 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.513+0000 7f77d83e4640 10 monclient(hunting): picked mon.noname-a con 0x7f77d014f280 addr v2:10.20.193.49:3300/0 2026-02-17T11:13:45.519 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.513+0000 7f77d83e4640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f77d014f660 0x7f77d00c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:45.519 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.513+0000 7f77d83e4640 10 monclient(hunting): picked mon.noname-b con 0x7f77d014f660 addr v2:10.20.193.97:3300/0 2026-02-17T11:13:45.519 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.513+0000 7f77d83e4640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f77d015abc0 addr v1:10.20.193.49:6789/0 2026-02-17T11:13:45.519 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.513+0000 7f77d83e4640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77d00c7390 con 0x7f77d015abc0 2026-02-17T11:13:45.520 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.513+0000 7f77d83e4640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:45.520 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.513+0000 7f77d83e4640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f77d00c7950 con 0x7f77d014f280 2026-02-17T11:13:45.520 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.513+0000 7f77d83e4640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:45.520 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.513+0000 7f77d83e4640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f77d015a730 con 0x7f77d014f660 2026-02-17T11:13:45.520 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.513+0000 7f77d83e4640 10 monclient(hunting): _renew_subs 2026-02-17T11:13:45.520 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.513+0000 7f77d83e4640 10 monclient(hunting): authenticate will time out at 1302.177367s 2026-02-17T11:13:45.520 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.513+0000 7f77d6159640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f77d014f280 0x7f77d00c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:45.520 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.513+0000 7f77d5958640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f77d014f660 0x7f77d00c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:45.520 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.514+0000 7f77d6159640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f77d014f280 0x7f77d00c7e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:34702/0 (socket says 10.20.193.49:34702) 2026-02-17T11:13:45.520 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.514+0000 7f77d6159640 1 -- 10.20.193.49:0/3640048731 learned_addr learned my addr 10.20.193.49:0/3640048731 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:13:45.520 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.514+0000 7f77d6159640 10 monclient(hunting): get_auth_request con 0x7f77d014f280 auth_method 0 2026-02-17T11:13:45.520 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.514+0000 7f77d6159640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:45.521 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.514+0000 7f77d6159640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:45.521 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.514+0000 7f77d6159640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:45.521 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.514+0000 7f77d5958640 10 monclient(hunting): get_auth_request con 0x7f77d014f660 auth_method 0 2026-02-17T11:13:45.521 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.514+0000 7f77d5958640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:45.521 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.514+0000 7f77d5958640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:45.521 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.514+0000 7f77d5958640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:45.521 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.514+0000 7f77d6159640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:45.521 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.514+0000 7f77d6159640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:45.521 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.514+0000 7f77d6159640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:45.521 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.514+0000 7f77d5958640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:45.521 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.514+0000 7f77d5958640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:45.521 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.514+0000 7f77d5958640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:45.521 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.515+0000 7f77d6159640 10 monclient(hunting): handle_auth_done global_id 4950 payload 274 2026-02-17T11:13:45.522 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.515+0000 7f77d6159640 1 -- 10.20.193.49:0/3640048731 >> v2:10.20.193.97:3300/0 conn(0x7f77d014f660 msgr2=0x7f77d00c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:13:45.522 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.515+0000 7f77d6159640 1 --2- 10.20.193.49:0/3640048731 >> v2:10.20.193.97:3300/0 conn(0x7f77d014f660 0x7f77d00c6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:45.522 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.515+0000 7f77d6159640 1 -- 10.20.193.49:0/3640048731 >> v1:10.20.193.49:6789/0 conn(0x7f77d015abc0 legacy=0x7f77d015afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:13:45.522 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.515+0000 7f77d6159640 10 monclient: _finish_hunting 0 2026-02-17T11:13:45.522 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.515+0000 7f77d6159640 1 monclient: found mon.noname-a 2026-02-17T11:13:45.522 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.515+0000 7f77d6159640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:13:45.522 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.515+0000 7f77d6159640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:13:45.522 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.515+0000 7f77d6159640 1 -- 10.20.193.49:0/3640048731 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77d00c7670 con 0x7f77d014f280 2026-02-17T11:13:45.522 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.516+0000 7f77d6159640 1 --2- 10.20.193.49:0/3640048731 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f77d014f280 0x7f77d00c7e20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f77d0153310 tx=0x7f77c002ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a4fe207bbc22d6d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:13:45.529 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.518+0000 7f77d5157640 1 -- 10.20.193.49:0/3640048731 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77c003c070 con 0x7f77d014f280 2026-02-17T11:13:45.529 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.518+0000 7f77d5157640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:45.529 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.518+0000 7f77d5157640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:13:45.529 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.518+0000 7f77d5157640 10 monclient: dump: 2026-02-17T11:13:45.529 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:45.529 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:45.529 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:45.529 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:45.529 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:45.529 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:45.529 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:45.530 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:45.530 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:45.530 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:45.530 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.518+0000 7f77d5157640 10 monclient: _finish_auth 0 2026-02-17T11:13:45.530 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.518+0000 7f77d5157640 10 monclient: _check_auth_tickets 2026-02-17T11:13:45.530 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.518+0000 7f77d5157640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:13:45.530 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.518+0000 7f77d5157640 1 -- 10.20.193.49:0/3640048731 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77c002fbd0 con 0x7f77d014f280 2026-02-17T11:13:45.530 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.518+0000 7f77d83e4640 5 monclient: authenticate success, global_id 4950 2026-02-17T11:13:45.530 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.518+0000 7f77d5157640 10 monclient: handle_config config(0 keys) 2026-02-17T11:13:45.530 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.518+0000 7f77d5157640 1 -- 10.20.193.49:0/3640048731 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77c0037440 con 0x7f77d014f280 2026-02-17T11:13:45.530 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.518+0000 7f77d5157640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:45.531 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.518+0000 7f77d5157640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:13:45.531 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.518+0000 7f77d5157640 10 monclient: dump: 2026-02-17T11:13:45.531 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:45.531 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:45.531 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:45.531 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:45.531 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:45.531 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:45.531 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:45.531 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:45.531 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:45.531 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:45.532 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.518+0000 7f77d83e4640 10 monclient: get_monmap_and_config success 2026-02-17T11:13:45.532 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.518+0000 7f77d83e4640 4 set_mon_vals no callback set 2026-02-17T11:13:45.532 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.518+0000 7f77d83e4640 10 monclient: shutdown 2026-02-17T11:13:45.532 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.518+0000 7f77d83e4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:13:45.532 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.518+0000 7f77d83e4640 1 -- 10.20.193.49:0/3640048731 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f77d014f280 msgr2=0x7f77d00c7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:45.532 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.518+0000 7f77d83e4640 1 --2- 10.20.193.49:0/3640048731 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f77d014f280 0x7f77d00c7e20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f77d0153310 tx=0x7f77c002ef60 comp rx=0 tx=0).stop 2026-02-17T11:13:45.532 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.518+0000 7f77d83e4640 1 -- 10.20.193.49:0/3640048731 shutdown_connections 2026-02-17T11:13:45.532 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.518+0000 7f77d83e4640 1 --2- 10.20.193.49:0/3640048731 >> v2:10.20.193.97:3300/0 conn(0x7f77d014f660 0x7f77d00c6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:45.532 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.518+0000 7f77d83e4640 1 --2- 10.20.193.49:0/3640048731 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f77d014f280 0x7f77d00c7e20 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:45.532 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.518+0000 7f77d83e4640 1 -- 10.20.193.49:0/3640048731 >> 10.20.193.49:0/3640048731 conn(0x7f77d00c9f20 msgr2=0x7f77d00ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:13:45.532 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.518+0000 7f77d83e4640 1 -- 10.20.193.49:0/3640048731 shutdown_connections 2026-02-17T11:13:45.532 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.518+0000 7f77d83e4640 1 -- 10.20.193.49:0/3640048731 wait complete. 2026-02-17T11:13:45.533 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.519+0000 7f77d83e4640 10 monclient: build_initial_monmap 2026-02-17T11:13:45.533 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.519+0000 7f77d83e4640 10 monclient: monmap: 2026-02-17T11:13:45.533 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:13:45.533 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:13:45.533 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:13:45.533 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:13:45.533 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:13:45.533 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:45.533 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:13:45.533 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:13:45.533 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:13:45.533 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:45.533 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.519+0000 7f77d83e4640 1 librados: starting msgr at 2026-02-17T11:13:45.534 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.519+0000 7f77d83e4640 1 librados: starting objecter 2026-02-17T11:13:45.534 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.519+0000 7f77d83e4640 1 Processor -- start 2026-02-17T11:13:45.534 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.519+0000 7f77d83e4640 1 -- start start 2026-02-17T11:13:45.534 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.519+0000 7f77d83e4640 1 librados: setting wanted keys 2026-02-17T11:13:45.534 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.519+0000 7f77d83e4640 1 librados: calling monclient init 2026-02-17T11:13:45.534 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.519+0000 7f77d83e4640 10 monclient: init 2026-02-17T11:13:45.534 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.520+0000 7f77d83e4640 10 monclient: _reopen_session rank -1 2026-02-17T11:13:45.534 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.520+0000 7f77d83e4640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:13:45.534 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.520+0000 7f77d83e4640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f77d014f280 0x7f77d01f7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:45.534 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.520+0000 7f77d83e4640 10 monclient(hunting): picked mon.noname-a con 0x7f77d014f280 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:13:45.534 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.520+0000 7f77d83e4640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f77d014f660 0x7f77d006ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:45.534 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.520+0000 7f77d83e4640 10 monclient(hunting): picked mon.noname-b con 0x7f77d014f660 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:13:45.535 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.520+0000 7f77d83e4640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f77d015abc0 0x7f77d01f3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:45.535 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.520+0000 7f77d83e4640 10 monclient(hunting): picked mon.noname-c con 0x7f77d015abc0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:13:45.535 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.520+0000 7f77d83e4640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:45.535 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.520+0000 7f77d83e4640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f77d00c8360 con 0x7f77d014f280 2026-02-17T11:13:45.535 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.520+0000 7f77d83e4640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:45.535 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.520+0000 7f77d83e4640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f77d015a3c0 con 0x7f77d014f660 2026-02-17T11:13:45.535 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.520+0000 7f77d83e4640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:45.535 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.520+0000 7f77d83e4640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f77d00c84e0 con 0x7f77d015abc0 2026-02-17T11:13:45.535 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.520+0000 7f77d83e4640 10 monclient(hunting): _renew_subs 2026-02-17T11:13:45.535 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.520+0000 7f77d83e4640 10 monclient(hunting): authenticate will time out at 1302.184291s 2026-02-17T11:13:45.535 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.520+0000 7f77d5958640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f77d014f660 0x7f77d006ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:45.535 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.520+0000 7f77d6159640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f77d014f280 0x7f77d01f7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:45.535 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.520+0000 7f77d5958640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f77d014f660 0x7f77d006ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:58154/0 (socket says 10.20.193.49:58154) 2026-02-17T11:13:45.536 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.520+0000 7f77d5958640 1 -- 10.20.193.49:0/1319418946 learned_addr learned my addr 10.20.193.49:0/1319418946 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:13:45.536 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.520+0000 7f77d5958640 10 monclient(hunting): get_auth_request con 0x7f77d014f660 auth_method 0 2026-02-17T11:13:45.536 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.520+0000 7f77d5958640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:45.536 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.520+0000 7f77d5958640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:45.536 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.520+0000 7f77d5958640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:45.536 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.520+0000 7f77d6159640 10 monclient(hunting): get_auth_request con 0x7f77d014f280 auth_method 0 2026-02-17T11:13:45.536 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.520+0000 7f77d6159640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:45.536 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.520+0000 7f77d6159640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:45.536 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.520+0000 7f77d6159640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:45.536 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.520+0000 7f77d695a640 1 --2- 10.20.193.49:0/1319418946 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f77d015abc0 0x7f77d01f3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:45.536 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.521+0000 7f77d5958640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:45.537 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.521+0000 7f77d5958640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:45.537 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.521+0000 7f77d5958640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:45.537 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.521+0000 7f77d6159640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:45.537 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.521+0000 7f77d6159640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:45.537 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.521+0000 7f77d6159640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:45.537 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.521+0000 7f77d695a640 10 monclient(hunting): get_auth_request con 0x7f77d015abc0 auth_method 0 2026-02-17T11:13:45.537 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.521+0000 7f77d695a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:45.537 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.521+0000 7f77d695a640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:45.537 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.521+0000 7f77d695a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:45.537 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.521+0000 7f77d695a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:45.537 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.521+0000 7f77d695a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:45.537 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.521+0000 7f77d695a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:45.537 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.522+0000 7f77d6159640 10 monclient(hunting): handle_auth_done global_id 4953 payload 824 2026-02-17T11:13:45.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.522+0000 7f77d6159640 1 -- 10.20.193.49:0/1319418946 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f77d015abc0 msgr2=0x7f77d01f3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:45.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.522+0000 7f77d6159640 1 --2- 10.20.193.49:0/1319418946 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f77d015abc0 0x7f77d01f3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:45.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.522+0000 7f77d6159640 1 -- 10.20.193.49:0/1319418946 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f77d014f660 msgr2=0x7f77d006ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:45.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.522+0000 7f77d6159640 1 --2- 10.20.193.49:0/1319418946 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f77d014f660 0x7f77d006ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:45.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.522+0000 7f77d6159640 10 monclient: _finish_hunting 0 2026-02-17T11:13:45.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.522+0000 7f77d6159640 1 monclient: found mon.noname-a 2026-02-17T11:13:45.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.522+0000 7f77d6159640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:13:45.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.522+0000 7f77d6159640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:13:45.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.522+0000 7f77d6159640 1 -- 10.20.193.49:0/1319418946 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77d01f4070 con 0x7f77d014f280 2026-02-17T11:13:45.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.523+0000 7f77d6159640 1 --2- 10.20.193.49:0/1319418946 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f77d014f280 0x7f77d01f7580 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f77c0006fd0 tx=0x7f77c00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:13:45.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.523+0000 7f77b6ffd640 10 client.?.objecter ms_handle_connect 0x7f77d014f280 2026-02-17T11:13:45.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.523+0000 7f77b6ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:13:45.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.524+0000 7f77b6ffd640 1 -- 10.20.193.49:0/1319418946 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77c003c040 con 0x7f77d014f280 2026-02-17T11:13:45.539 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.524+0000 7f77b6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:45.539 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.524+0000 7f77b6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:13:45.539 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.524+0000 7f77b6ffd640 10 monclient: dump: 2026-02-17T11:13:45.539 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:45.539 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:45.539 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:45.539 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:45.539 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:45.539 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:45.539 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:45.539 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:45.539 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:45.540 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:45.540 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.524+0000 7f77b6ffd640 10 monclient: _finish_auth 0 2026-02-17T11:13:45.540 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.524+0000 7f77b6ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:13:45.540 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.524+0000 7f77b6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:13:45.540 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.524+0000 7f77b6ffd640 1 -- 10.20.193.49:0/1319418946 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77c0042650 con 0x7f77d014f280 2026-02-17T11:13:45.540 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.524+0000 7f77d83e4640 5 monclient: authenticate success, global_id 4953 2026-02-17T11:13:45.540 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.524+0000 7f77b6ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:13:45.540 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.524+0000 7f77b6ffd640 1 -- 10.20.193.49:0/1319418946 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77c0042a40 con 0x7f77d014f280 2026-02-17T11:13:45.540 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.524+0000 7f77b6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:45.540 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.524+0000 7f77b6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:13:45.540 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.524+0000 7f77d4956640 4 set_mon_vals no callback set 2026-02-17T11:13:45.540 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.524+0000 7f77b6ffd640 10 monclient: dump: 2026-02-17T11:13:45.540 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:45.541 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:45.541 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:45.541 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:45.541 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:45.541 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:45.541 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:45.541 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:45.541 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:45.541 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:45.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.524+0000 7f77d83e4640 10 monclient: _renew_subs 2026-02-17T11:13:45.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.524+0000 7f77d83e4640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:13:45.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.524+0000 7f77d83e4640 1 -- 10.20.193.49:0/1319418946 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77d01f4350 con 0x7f77d014f280 2026-02-17T11:13:45.542 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.524+0000 7f77d83e4640 10 client.4953.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:13:45.542 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.524+0000 7f77d83e4640 10 monclient: _renew_subs 2026-02-17T11:13:45.542 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.524+0000 7f77d83e4640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:13:45.542 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.524+0000 7f77d83e4640 1 -- 10.20.193.49:0/1319418946 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77d006df10 con 0x7f77d014f280 2026-02-17T11:13:45.542 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.524+0000 7f77d83e4640 1 librados: init done 2026-02-17T11:13:45.542 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.525+0000 7f77d83e4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:13:45.542 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.525+0000 7f77d83e4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:13:45.542 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.525+0000 7f77d83e4640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:13:45.542 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.525+0000 7f77d83e4640 1 -- 10.20.193.49:0/1319418946 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77d00c9b70 con 0x7f77d014f280 2026-02-17T11:13:45.544 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.537+0000 7f77b6ffd640 1 -- 10.20.193.49:0/1319418946 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f77c0042be0 con 0x7f77d014f280 2026-02-17T11:13:45.544 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.537+0000 7f77b6ffd640 1 --2- 10.20.193.49:0/1319418946 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f77a0079190 0x7f77a007b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:45.544 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.538+0000 7f77d5958640 1 --2- 10.20.193.49:0/1319418946 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f77a0079190 0x7f77a007b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:45.544 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.538+0000 7f77d5958640 10 monclient: get_auth_request con 0x7f77a0079190 auth_method 0 2026-02-17T11:13:45.544 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.538+0000 7f77d5958640 1 --2- 10.20.193.49:0/1319418946 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f77a0079190 0x7f77a007b650 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f77d00c71f0 tx=0x7f77c4009290 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:13:45.544 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.538+0000 7f77b6ffd640 10 client.4953.objecter ms_handle_connect 0x7f77a0079190 2026-02-17T11:13:45.642 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.639+0000 7f77b6ffd640 1 -- 10.20.193.49:0/1319418946 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f77c002fa90 con 0x7f77d014f280 2026-02-17T11:13:45.643 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.639+0000 7f77b6ffd640 10 client.4953.objecter ms_dispatch2 0x7f77d0000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:13:45.643 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.639+0000 7f77b6ffd640 3 client.4953.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:13:45.643 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.639+0000 7f77b6ffd640 3 client.4953.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:13:45.643 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.640+0000 7f77b6ffd640 20 client.4953.objecter dump_active .. 0 homeless 2026-02-17T11:13:45.643 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.640+0000 7f77b6ffd640 1 -- 10.20.193.49:0/1319418946 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f77c00879f0 con 0x7f77d014f280 2026-02-17T11:13:45.643 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.640+0000 7f77b6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:13:45.643 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.640+0000 7f77b6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:13:45.743 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.740+0000 7f77d83e4640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:13:45.743 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.740+0000 7f77d83e4640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:13:45.743 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.740+0000 7f77d83e4640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:13:45.743 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.740+0000 7f77d83e4640 1 -- 10.20.193.49:0/1319418946 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f77d00c6af0 con 0x7f77d014f280 2026-02-17T11:13:45.745 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.743+0000 7f77b6ffd640 1 -- 10.20.193.49:0/1319418946 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f77c008bcf0 con 0x7f77d014f280 2026-02-17T11:13:45.745 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.743+0000 7f77b6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:13:45.745 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.743+0000 7f77b6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:13:45.746 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:13:45.746 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:13:45.747 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.744+0000 7f77d83e4640 10 librados: watch_flush enter 2026-02-17T11:13:45.748 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.744+0000 7f77d83e4640 10 librados: watch_flush exit 2026-02-17T11:13:45.748 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.744+0000 7f77d83e4640 20 client.4953.objecter shutdown clearing up homeless session... 2026-02-17T11:13:45.748 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.744+0000 7f77d83e4640 10 client.4953.objecter successfully canceled tick 2026-02-17T11:13:45.748 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.744+0000 7f77d83e4640 1 -- 10.20.193.49:0/1319418946 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f77a0079190 msgr2=0x7f77a007b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:45.748 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.744+0000 7f77d83e4640 1 --2- 10.20.193.49:0/1319418946 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f77a0079190 0x7f77a007b650 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f77d00c71f0 tx=0x7f77c4009290 comp rx=0 tx=0).stop 2026-02-17T11:13:45.748 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.744+0000 7f77d83e4640 10 monclient: shutdown 2026-02-17T11:13:45.748 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.744+0000 7f77d83e4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:13:45.748 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.744+0000 7f77d83e4640 1 -- 10.20.193.49:0/1319418946 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f77d014f280 msgr2=0x7f77d01f7580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:45.748 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.744+0000 7f77d83e4640 1 --2- 10.20.193.49:0/1319418946 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f77d014f280 0x7f77d01f7580 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f77c0006fd0 tx=0x7f77c00047c0 comp rx=0 tx=0).stop 2026-02-17T11:13:45.748 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.744+0000 7f77d83e4640 1 -- 10.20.193.49:0/1319418946 shutdown_connections 2026-02-17T11:13:45.748 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.744+0000 7f77d83e4640 1 --2- 10.20.193.49:0/1319418946 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f77a0079190 0x7f77a007b650 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:45.749 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.744+0000 7f77d83e4640 1 --2- 10.20.193.49:0/1319418946 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f77d015abc0 0x7f77d01f3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:45.749 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.744+0000 7f77d83e4640 1 --2- 10.20.193.49:0/1319418946 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f77d014f660 0x7f77d006ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:45.749 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.744+0000 7f77d83e4640 1 --2- 10.20.193.49:0/1319418946 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f77d014f280 0x7f77d01f7580 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:45.749 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.744+0000 7f77d83e4640 1 -- 10.20.193.49:0/1319418946 >> 10.20.193.49:0/1319418946 conn(0x7f77d00c9f20 msgr2=0x7f77d014d480 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:13:45.749 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.744+0000 7f77d83e4640 1 -- 10.20.193.49:0/1319418946 shutdown_connections 2026-02-17T11:13:45.749 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.744+0000 7f77d83e4640 1 -- 10.20.193.49:0/1319418946 wait complete. 2026-02-17T11:13:45.749 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:45.744+0000 7f77d83e4640 1 librados: shutdown 2026-02-17T11:13:48.756 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:13:48.824 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.820+0000 7f1c28ff8640 10 monclient: get_monmap_and_config 2026-02-17T11:13:48.824 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.820+0000 7f1c28ff8640 10 monclient: build_initial_monmap 2026-02-17T11:13:48.824 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.821+0000 7f1c28ff8640 10 monclient: monmap: 2026-02-17T11:13:48.824 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:13:48.824 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:48.824 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:13:48.822524+0000 2026-02-17T11:13:48.824 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:13:48.822524+0000 2026-02-17T11:13:48.824 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:13:48.825 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:48.825 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:13:48.825 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:13:48.825 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:13:48.825 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:13:48.825 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:13:48.825 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:13:48.825 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:48.825 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.821+0000 7f1c28ff8640 1 Processor -- start 2026-02-17T11:13:48.825 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.821+0000 7f1c28ff8640 1 -- start start 2026-02-17T11:13:48.825 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.821+0000 7f1c28ff8640 10 monclient: init 2026-02-17T11:13:48.828 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.822+0000 7f1c28ff8640 10 monclient: _reopen_session rank -1 2026-02-17T11:13:48.828 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.822+0000 7f1c28ff8640 10 monclient: _add_conns ranks=[0,1,3,5,2,4] 2026-02-17T11:13:48.829 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.822+0000 7f1c28ff8640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f1c240cb350 addr v1:10.20.193.49:6789/0 2026-02-17T11:13:48.829 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.822+0000 7f1c28ff8640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f1c2406d800 addr v1:10.20.193.97:6789/0 2026-02-17T11:13:48.829 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.822+0000 7f1c28ff8640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f1c240714f0 0x7f1c240cb730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:48.829 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.822+0000 7f1c28ff8640 10 monclient(hunting): picked mon.noname-a con 0x7f1c240714f0 addr v2:10.20.193.49:3300/0 2026-02-17T11:13:48.829 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.822+0000 7f1c28ff8640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c2406c930 con 0x7f1c240cb350 2026-02-17T11:13:48.829 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.822+0000 7f1c28ff8640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c240cceb0 con 0x7f1c2406d800 2026-02-17T11:13:48.829 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.822+0000 7f1c28ff8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:48.829 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.822+0000 7f1c28ff8640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f1c2406cc60 con 0x7f1c240714f0 2026-02-17T11:13:48.829 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.822+0000 7f1c28ff8640 10 monclient(hunting): _renew_subs 2026-02-17T11:13:48.829 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.822+0000 7f1c28ff8640 10 monclient(hunting): authenticate will time out at 1305.486366s 2026-02-17T11:13:48.829 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.822+0000 7f1c22d76640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f1c240714f0 0x7f1c240cb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:48.830 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.822+0000 7f1c21d74640 1 --1- >> v1:10.20.193.97:6789/0 conn(0x7f1c2406d800 0x7f1c24159220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.97:6789/0 says I am v1:10.20.193.49:46456/0 (socket says 10.20.193.49:46456) 2026-02-17T11:13:48.830 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.822+0000 7f1c21d74640 1 -- 10.20.193.49:0/618153787 learned_addr learned my addr 10.20.193.49:0/618153787 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:13:48.830 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.823+0000 7f1c22d76640 10 monclient(hunting): get_auth_request con 0x7f1c240714f0 auth_method 0 2026-02-17T11:13:48.830 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.823+0000 7f1c22d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:48.830 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.823+0000 7f1c22d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:48.830 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.823+0000 7f1c22d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:48.830 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.823+0000 7f1c22d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:48.830 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.823+0000 7f1c22d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:48.830 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.823+0000 7f1c22d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:48.830 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.824+0000 7f1c21573640 1 -- 10.20.193.49:0/618153787 <== mon.1 v1:10.20.193.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3596843528 0 0) 0x7f1c240cceb0 con 0x7f1c2406d800 2026-02-17T11:13:48.830 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.824+0000 7f1c21573640 10 monclient(hunting): _negotiate 2026-02-17T11:13:48.830 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.824+0000 7f1c21573640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:48.831 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.824+0000 7f1c21573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:48.831 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.824+0000 7f1c21573640 10 monclient(hunting): my global_id is 4924 2026-02-17T11:13:48.831 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.824+0000 7f1c21573640 1 -- 10.20.193.49:0/618153787 --> v1:10.20.193.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c10003620 con 0x7f1c2406d800 2026-02-17T11:13:48.831 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.824+0000 7f1c22d76640 10 monclient(hunting): handle_auth_done global_id 4956 payload 274 2026-02-17T11:13:48.831 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.824+0000 7f1c22d76640 1 -- 10.20.193.49:0/618153787 >> v1:10.20.193.97:6789/0 conn(0x7f1c2406d800 legacy=0x7f1c24159220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:48.831 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.824+0000 7f1c22d76640 1 -- 10.20.193.49:0/618153787 >> v1:10.20.193.49:6789/0 conn(0x7f1c240cb350 legacy=0x7f1c2406d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:13:48.831 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.824+0000 7f1c22d76640 10 monclient: _finish_hunting 0 2026-02-17T11:13:48.831 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.824+0000 7f1c22d76640 1 monclient: found mon.noname-a 2026-02-17T11:13:48.831 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.824+0000 7f1c22d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:13:48.831 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.824+0000 7f1c22d76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:13:48.831 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.824+0000 7f1c22d76640 1 -- 10.20.193.49:0/618153787 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c2415cdc0 con 0x7f1c240714f0 2026-02-17T11:13:48.831 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.825+0000 7f1c22d76640 1 --2- 10.20.193.49:0/618153787 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1c240714f0 0x7f1c240cb730 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1c14009d90 tx=0x7f1c1402f270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f316ff33094067a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:13:48.838 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.828+0000 7f1c21573640 1 -- 10.20.193.49:0/618153787 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1403c070 con 0x7f1c240714f0 2026-02-17T11:13:48.838 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.828+0000 7f1c21573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:48.838 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.828+0000 7f1c21573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:13:48.838 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.828+0000 7f1c21573640 10 monclient: dump: 2026-02-17T11:13:48.838 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:48.838 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:48.838 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:48.838 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:48.839 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:48.839 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:48.839 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:48.839 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:48.839 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:48.839 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:48.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.828+0000 7f1c21573640 10 monclient: _finish_auth 0 2026-02-17T11:13:48.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.828+0000 7f1c21573640 10 monclient: _check_auth_tickets 2026-02-17T11:13:48.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.828+0000 7f1c21573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:13:48.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.828+0000 7f1c21573640 1 -- 10.20.193.49:0/618153787 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c14037440 con 0x7f1c240714f0 2026-02-17T11:13:48.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.828+0000 7f1c28ff8640 5 monclient: authenticate success, global_id 4956 2026-02-17T11:13:48.840 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.828+0000 7f1c28ff8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:13:48.840 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.828+0000 7f1c21573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:13:48.840 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.828+0000 7f1c21573640 1 -- 10.20.193.49:0/618153787 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c14037810 con 0x7f1c240714f0 2026-02-17T11:13:48.840 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.828+0000 7f1c28ff8640 10 monclient: get_monmap_and_config success 2026-02-17T11:13:48.840 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.828+0000 7f1c28ff8640 4 set_mon_vals no callback set 2026-02-17T11:13:48.840 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.828+0000 7f1c21573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:48.840 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.828+0000 7f1c21573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:13:48.840 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.828+0000 7f1c21573640 10 monclient: dump: 2026-02-17T11:13:48.840 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:48.840 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:48.840 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:48.840 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:48.841 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:48.841 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:48.841 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:48.841 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:48.841 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:48.841 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:48.841 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.828+0000 7f1c28ff8640 10 monclient: shutdown 2026-02-17T11:13:48.841 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.828+0000 7f1c28ff8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:13:48.841 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.828+0000 7f1c28ff8640 1 -- 10.20.193.49:0/618153787 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1c240714f0 msgr2=0x7f1c240cb730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:48.841 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.828+0000 7f1c28ff8640 1 --2- 10.20.193.49:0/618153787 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1c240714f0 0x7f1c240cb730 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1c14009d90 tx=0x7f1c1402f270 comp rx=0 tx=0).stop 2026-02-17T11:13:48.841 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.828+0000 7f1c28ff8640 1 -- 10.20.193.49:0/618153787 shutdown_connections 2026-02-17T11:13:48.841 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.828+0000 7f1c28ff8640 1 --2- 10.20.193.49:0/618153787 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1c240714f0 0x7f1c240cb730 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:48.842 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.828+0000 7f1c28ff8640 1 -- 10.20.193.49:0/618153787 >> 10.20.193.49:0/618153787 conn(0x7f1c240cc1d0 msgr2=0x7f1c240cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:13:48.842 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.828+0000 7f1c28ff8640 1 -- 10.20.193.49:0/618153787 shutdown_connections 2026-02-17T11:13:48.842 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.828+0000 7f1c28ff8640 1 -- 10.20.193.49:0/618153787 wait complete. 2026-02-17T11:13:48.842 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.828+0000 7f1c28ff8640 10 monclient: build_initial_monmap 2026-02-17T11:13:48.842 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.828+0000 7f1c28ff8640 10 monclient: monmap: 2026-02-17T11:13:48.842 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:13:48.842 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:13:48.842 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:13:48.842 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:13:48.842 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:13:48.842 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:48.842 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:13:48.843 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:13:48.843 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:13:48.843 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:48.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.829+0000 7f1c28ff8640 1 librados: starting msgr at 2026-02-17T11:13:48.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.829+0000 7f1c28ff8640 1 librados: starting objecter 2026-02-17T11:13:48.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.829+0000 7f1c28ff8640 1 Processor -- start 2026-02-17T11:13:48.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.829+0000 7f1c28ff8640 1 -- start start 2026-02-17T11:13:48.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.829+0000 7f1c28ff8640 1 librados: setting wanted keys 2026-02-17T11:13:48.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.829+0000 7f1c28ff8640 1 librados: calling monclient init 2026-02-17T11:13:48.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.829+0000 7f1c28ff8640 10 monclient: init 2026-02-17T11:13:48.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.829+0000 7f1c28ff8640 10 monclient: _reopen_session rank -1 2026-02-17T11:13:48.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.829+0000 7f1c28ff8640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:13:48.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.829+0000 7f1c28ff8640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f1c2406d800 0x7f1c240c8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:48.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.829+0000 7f1c28ff8640 10 monclient(hunting): picked mon.noname-c con 0x7f1c2406d800 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:13:48.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.829+0000 7f1c28ff8640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1c240714f0 0x7f1c241f7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:48.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.829+0000 7f1c28ff8640 10 monclient(hunting): picked mon.noname-a con 0x7f1c240714f0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:13:48.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.829+0000 7f1c28ff8640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f1c240cb350 0x7f1c240c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:48.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.829+0000 7f1c28ff8640 10 monclient(hunting): picked mon.noname-b con 0x7f1c240cb350 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:13:48.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.829+0000 7f1c28ff8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:48.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.829+0000 7f1c28ff8640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1c24074ab0 con 0x7f1c240714f0 2026-02-17T11:13:48.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.829+0000 7f1c28ff8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:48.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.829+0000 7f1c28ff8640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1c240d05a0 con 0x7f1c240cb350 2026-02-17T11:13:48.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.829+0000 7f1c28ff8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:48.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.829+0000 7f1c28ff8640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f1c24069130 con 0x7f1c2406d800 2026-02-17T11:13:48.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.829+0000 7f1c28ff8640 10 monclient(hunting): _renew_subs 2026-02-17T11:13:48.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.829+0000 7f1c28ff8640 10 monclient(hunting): authenticate will time out at 1305.493511s 2026-02-17T11:13:48.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.829+0000 7f1c21d74640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1c240714f0 0x7f1c241f7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:48.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.829+0000 7f1c22d76640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f1c240cb350 0x7f1c240c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:48.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.829+0000 7f1c21d74640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1c240714f0 0x7f1c241f7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:56360/0 (socket says 10.20.193.49:56360) 2026-02-17T11:13:48.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.829+0000 7f1c22d76640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f1c240cb350 0x7f1c240c8a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:58140/0 (socket says 10.20.193.49:58140) 2026-02-17T11:13:48.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.829+0000 7f1c21d74640 1 -- 10.20.193.49:0/430570565 learned_addr learned my addr 10.20.193.49:0/430570565 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:13:48.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.829+0000 7f1c21d74640 10 monclient(hunting): get_auth_request con 0x7f1c240714f0 auth_method 0 2026-02-17T11:13:48.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.829+0000 7f1c21d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:48.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.829+0000 7f1c21d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:48.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.829+0000 7f1c21d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:48.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.829+0000 7f1c22d76640 10 monclient(hunting): get_auth_request con 0x7f1c240cb350 auth_method 0 2026-02-17T11:13:48.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.829+0000 7f1c22d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:48.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.829+0000 7f1c22d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:48.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.829+0000 7f1c22d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:48.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.830+0000 7f1c22575640 1 --2- 10.20.193.49:0/430570565 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f1c2406d800 0x7f1c240c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:48.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.830+0000 7f1c21d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:48.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.830+0000 7f1c21d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:48.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.830+0000 7f1c21d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:48.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.830+0000 7f1c22d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:48.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.830+0000 7f1c22d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:48.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.830+0000 7f1c22d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:48.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.830+0000 7f1c22575640 10 monclient(hunting): get_auth_request con 0x7f1c2406d800 auth_method 0 2026-02-17T11:13:48.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.830+0000 7f1c22575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:48.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.830+0000 7f1c22575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:48.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.830+0000 7f1c22575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:48.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.830+0000 7f1c22575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:48.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.830+0000 7f1c22575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:48.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.830+0000 7f1c22575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:48.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.831+0000 7f1c22d76640 10 monclient(hunting): handle_auth_done global_id 4927 payload 824 2026-02-17T11:13:48.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.831+0000 7f1c22d76640 1 -- 10.20.193.49:0/430570565 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f1c2406d800 msgr2=0x7f1c240c8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:48.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.831+0000 7f1c22d76640 1 --2- 10.20.193.49:0/430570565 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f1c2406d800 0x7f1c240c8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:48.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.831+0000 7f1c22d76640 1 -- 10.20.193.49:0/430570565 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1c240714f0 msgr2=0x7f1c241f7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:48.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.831+0000 7f1c22d76640 1 --2- 10.20.193.49:0/430570565 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1c240714f0 0x7f1c241f7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:48.848 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.831+0000 7f1c22d76640 10 monclient: _finish_hunting 0 2026-02-17T11:13:48.848 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.831+0000 7f1c22d76640 1 monclient: found mon.noname-b 2026-02-17T11:13:48.848 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.831+0000 7f1c22d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:13:48.848 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.831+0000 7f1c22d76640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:13:48.848 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.831+0000 7f1c22d76640 1 -- 10.20.193.49:0/430570565 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c240c8f60 con 0x7f1c240cb350 2026-02-17T11:13:48.848 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.832+0000 7f1c22d76640 1 --2- 10.20.193.49:0/430570565 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f1c240cb350 0x7f1c240c8a20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1c24071b30 tx=0x7f1c14004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:13:48.848 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.832+0000 7f1c0affd640 10 client.?.objecter ms_handle_connect 0x7f1c240cb350 2026-02-17T11:13:48.848 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.832+0000 7f1c0affd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:13:48.848 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.834+0000 7f1c0affd640 1 -- 10.20.193.49:0/430570565 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c14047020 con 0x7f1c240cb350 2026-02-17T11:13:48.848 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.834+0000 7f1c0affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:48.848 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.834+0000 7f1c0affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:13:48.848 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.834+0000 7f1c0affd640 10 monclient: dump: 2026-02-17T11:13:48.849 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:48.849 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:48.849 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:48.849 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:48.849 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:48.849 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:48.849 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:48.849 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:48.849 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:48.849 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:48.849 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.834+0000 7f1c0affd640 10 monclient: _finish_auth 0 2026-02-17T11:13:48.849 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.834+0000 7f1c0affd640 10 monclient: _check_auth_tickets 2026-02-17T11:13:48.849 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.834+0000 7f1c0affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:13:48.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.834+0000 7f1c28ff8640 5 monclient: authenticate success, global_id 4927 2026-02-17T11:13:48.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.834+0000 7f1c28ff8640 10 monclient: _renew_subs 2026-02-17T11:13:48.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.834+0000 7f1c28ff8640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:13:48.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.834+0000 7f1c28ff8640 1 -- 10.20.193.49:0/430570565 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c241f3f70 con 0x7f1c240cb350 2026-02-17T11:13:48.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.834+0000 7f1c28ff8640 10 client.4927.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:13:48.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.834+0000 7f1c28ff8640 10 monclient: _renew_subs 2026-02-17T11:13:48.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.834+0000 7f1c28ff8640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:13:48.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.834+0000 7f1c28ff8640 1 -- 10.20.193.49:0/430570565 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c241f4530 con 0x7f1c240cb350 2026-02-17T11:13:48.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.834+0000 7f1c28ff8640 1 librados: init done 2026-02-17T11:13:48.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.834+0000 7f1c0affd640 1 -- 10.20.193.49:0/430570565 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c14037440 con 0x7f1c240cb350 2026-02-17T11:13:48.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.834+0000 7f1c0affd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:13:48.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.834+0000 7f1c20d72640 4 set_mon_vals no callback set 2026-02-17T11:13:48.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.834+0000 7f1c0affd640 1 -- 10.20.193.49:0/430570565 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1403c040 con 0x7f1c240cb350 2026-02-17T11:13:48.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.834+0000 7f1c0affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:48.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.834+0000 7f1c0affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:13:48.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.834+0000 7f1c0affd640 10 monclient: dump: 2026-02-17T11:13:48.851 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:48.851 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:48.851 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:48.851 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:48.851 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:48.851 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:48.851 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:48.851 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:48.851 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:48.852 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:48.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.834+0000 7f1c28ff8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:13:48.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.834+0000 7f1c28ff8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:13:48.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.834+0000 7f1c28ff8640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:13:48.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.834+0000 7f1c28ff8640 1 -- 10.20.193.49:0/430570565 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c2406e6d0 con 0x7f1c240cb350 2026-02-17T11:13:48.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.846+0000 7f1c0affd640 1 -- 10.20.193.49:0/430570565 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f1c14042870 con 0x7f1c240cb350 2026-02-17T11:13:48.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.846+0000 7f1c0affd640 1 --2- 10.20.193.49:0/430570565 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f1bf0079140 0x7f1bf007b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:48.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.847+0000 7f1c22575640 1 --2- 10.20.193.49:0/430570565 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f1bf0079140 0x7f1bf007b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:48.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.847+0000 7f1c22575640 10 monclient: get_auth_request con 0x7f1bf0079140 auth_method 0 2026-02-17T11:13:48.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.847+0000 7f1c0affd640 10 client.4927.objecter ms_handle_connect 0x7f1bf0079140 2026-02-17T11:13:48.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.847+0000 7f1c22575640 1 --2- 10.20.193.49:0/430570565 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f1bf0079140 0x7f1bf007b600 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1c24153e40 tx=0x7f1c18009110 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:13:48.946 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.944+0000 7f1c0affd640 1 -- 10.20.193.49:0/430570565 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f1c140bda50 con 0x7f1c240cb350 2026-02-17T11:13:48.946 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.944+0000 7f1c0affd640 10 client.4927.objecter ms_dispatch2 0x7f1c24000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:13:48.946 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.944+0000 7f1c0affd640 3 client.4927.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:13:48.946 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.944+0000 7f1c0affd640 3 client.4927.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:13:48.946 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.944+0000 7f1c0affd640 20 client.4927.objecter dump_active .. 0 homeless 2026-02-17T11:13:48.952 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.950+0000 7f1c0affd640 1 -- 10.20.193.49:0/430570565 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f1c2406e6d0 con 0x7f1c240cb350 2026-02-17T11:13:48.952 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.950+0000 7f1c0affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:13:48.952 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:48.950+0000 7f1c0affd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:13:49.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:49.049+0000 7f1c28ff8640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:13:49.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:49.049+0000 7f1c28ff8640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:13:49.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:49.049+0000 7f1c28ff8640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:13:49.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:49.049+0000 7f1c28ff8640 1 -- 10.20.193.49:0/430570565 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f1c240c94a0 con 0x7f1c240cb350 2026-02-17T11:13:49.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:49.053+0000 7f1c0affd640 1 -- 10.20.193.49:0/430570565 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f1c14051030 con 0x7f1c240cb350 2026-02-17T11:13:49.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:49.053+0000 7f1c0affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:13:49.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:49.053+0000 7f1c0affd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:13:49.056 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:13:49.056 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:13:49.057 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:49.054+0000 7f1c28ff8640 10 librados: watch_flush enter 2026-02-17T11:13:49.058 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:49.054+0000 7f1c28ff8640 10 librados: watch_flush exit 2026-02-17T11:13:49.058 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:49.054+0000 7f1c28ff8640 20 client.4927.objecter shutdown clearing up homeless session... 2026-02-17T11:13:49.058 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:49.054+0000 7f1c28ff8640 10 client.4927.objecter successfully canceled tick 2026-02-17T11:13:49.058 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:49.054+0000 7f1c28ff8640 1 -- 10.20.193.49:0/430570565 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f1bf0079140 msgr2=0x7f1bf007b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:49.058 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:49.054+0000 7f1c28ff8640 1 --2- 10.20.193.49:0/430570565 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f1bf0079140 0x7f1bf007b600 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1c24153e40 tx=0x7f1c18009110 comp rx=0 tx=0).stop 2026-02-17T11:13:49.058 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:49.054+0000 7f1c28ff8640 10 monclient: shutdown 2026-02-17T11:13:49.058 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:49.054+0000 7f1c28ff8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:13:49.058 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:49.054+0000 7f1c28ff8640 1 -- 10.20.193.49:0/430570565 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f1c240cb350 msgr2=0x7f1c240c8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:49.058 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:49.054+0000 7f1c28ff8640 1 --2- 10.20.193.49:0/430570565 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f1c240cb350 0x7f1c240c8a20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1c24071b30 tx=0x7f1c14004b40 comp rx=0 tx=0).stop 2026-02-17T11:13:49.058 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:49.054+0000 7f1c28ff8640 1 -- 10.20.193.49:0/430570565 shutdown_connections 2026-02-17T11:13:49.058 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:49.054+0000 7f1c28ff8640 1 --2- 10.20.193.49:0/430570565 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f1bf0079140 0x7f1bf007b600 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:49.058 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:49.054+0000 7f1c28ff8640 1 --2- 10.20.193.49:0/430570565 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f1c240cb350 0x7f1c240c8a20 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:49.059 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:49.054+0000 7f1c28ff8640 1 --2- 10.20.193.49:0/430570565 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1c240714f0 0x7f1c241f7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:49.059 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:49.054+0000 7f1c28ff8640 1 --2- 10.20.193.49:0/430570565 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f1c2406d800 0x7f1c240c8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:49.059 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:49.054+0000 7f1c28ff8640 1 -- 10.20.193.49:0/430570565 >> 10.20.193.49:0/430570565 conn(0x7f1c240cc1d0 msgr2=0x7f1c24158510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:13:49.059 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:49.054+0000 7f1c28ff8640 1 -- 10.20.193.49:0/430570565 shutdown_connections 2026-02-17T11:13:49.059 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:49.054+0000 7f1c28ff8640 1 -- 10.20.193.49:0/430570565 wait complete. 2026-02-17T11:13:49.059 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:49.054+0000 7f1c28ff8640 1 librados: shutdown 2026-02-17T11:13:52.027 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:05:37.508 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:13:52.028 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:05:37.510 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:13:52.037 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:05:37.519 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:13:52.056 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:05:37.531 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:13:52.056 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:05:37.532 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:13:52.058 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:05:37.500 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:13:52.059 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:05:37.502 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:13:52.065 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:05:37.541 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:13:52.066 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:13:52.068 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:05:37.510 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:13:52.134 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.132+0000 7f82ee3c1640 10 monclient: get_monmap_and_config 2026-02-17T11:13:52.134 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.132+0000 7f82ee3c1640 10 monclient: build_initial_monmap 2026-02-17T11:13:52.134 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.132+0000 7f82ee3c1640 10 monclient: monmap: 2026-02-17T11:13:52.134 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:13:52.134 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:52.134 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:13:52.133496+0000 2026-02-17T11:13:52.134 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:13:52.133496+0000 2026-02-17T11:13:52.134 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:13:52.134 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:52.134 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:13:52.134 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:13:52.135 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:13:52.135 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:13:52.135 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:13:52.135 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:13:52.135 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:52.135 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.133+0000 7f82ee3c1640 1 Processor -- start 2026-02-17T11:13:52.136 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.133+0000 7f82ee3c1640 1 -- start start 2026-02-17T11:13:52.136 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.133+0000 7f82ee3c1640 10 monclient: init 2026-02-17T11:13:52.136 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.133+0000 7f82ee3c1640 10 monclient: _reopen_session rank -1 2026-02-17T11:13:52.136 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.133+0000 7f82ee3c1640 10 monclient: _add_conns ranks=[2,0,3,1,5,4] 2026-02-17T11:13:52.136 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.133+0000 7f82ee3c1640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f82e814f280 addr v1:10.20.193.157:6789/0 2026-02-17T11:13:52.136 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.133+0000 7f82ee3c1640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f82e814f660 addr v1:10.20.193.49:6789/0 2026-02-17T11:13:52.136 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.133+0000 7f82ee3c1640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f82e815abc0 0x7f82e815afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:52.136 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.133+0000 7f82ee3c1640 10 monclient(hunting): picked mon.noname-a con 0x7f82e815abc0 addr v2:10.20.193.49:3300/0 2026-02-17T11:13:52.136 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.133+0000 7f82ee3c1640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82e80c7110 con 0x7f82e814f660 2026-02-17T11:13:52.136 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.133+0000 7f82ee3c1640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82e80c7390 con 0x7f82e814f280 2026-02-17T11:13:52.136 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.133+0000 7f82ee3c1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:52.136 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.133+0000 7f82ee3c1640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f82e80c7950 con 0x7f82e815abc0 2026-02-17T11:13:52.136 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.133+0000 7f82ee3c1640 10 monclient(hunting): _renew_subs 2026-02-17T11:13:52.136 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.133+0000 7f82ee3c1640 10 monclient(hunting): authenticate will time out at 1308.796976s 2026-02-17T11:13:52.136 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.134+0000 7f82ec937640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f82e815abc0 0x7f82e815afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:52.136 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.134+0000 7f82ec937640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f82e815abc0 0x7f82e815afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:56372/0 (socket says 10.20.193.49:56372) 2026-02-17T11:13:52.136 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.134+0000 7f82ec937640 1 -- 10.20.193.49:0/531708464 learned_addr learned my addr 10.20.193.49:0/531708464 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:13:52.136 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.134+0000 7f82ec937640 10 monclient(hunting): get_auth_request con 0x7f82e815abc0 auth_method 0 2026-02-17T11:13:52.136 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.134+0000 7f82ec937640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:52.136 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.134+0000 7f82ec937640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:52.136 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.134+0000 7f82ec937640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:52.137 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.134+0000 7f82ec937640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:52.137 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.134+0000 7f82ec937640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:52.137 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.135+0000 7f82ec937640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:52.137 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.136+0000 7f82ec937640 10 monclient(hunting): handle_auth_done global_id 4962 payload 274 2026-02-17T11:13:52.137 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.136+0000 7f82ec937640 1 -- 10.20.193.49:0/531708464 >> v1:10.20.193.157:6789/0 conn(0x7f82e814f280 legacy=0x7f82e80c7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:52.137 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.136+0000 7f82ec937640 1 -- 10.20.193.49:0/531708464 >> v1:10.20.193.49:6789/0 conn(0x7f82e814f660 legacy=0x7f82e80c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:13:52.137 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.136+0000 7f82ec937640 10 monclient: _finish_hunting 0 2026-02-17T11:13:52.137 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.136+0000 7f82ec937640 1 monclient: found mon.noname-a 2026-02-17T11:13:52.137 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.136+0000 7f82ec937640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:13:52.138 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.136+0000 7f82ec937640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:13:52.138 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.136+0000 7f82ec937640 1 -- 10.20.193.49:0/531708464 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82e80c7670 con 0x7f82e815abc0 2026-02-17T11:13:52.138 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.137+0000 7f82ec937640 1 --2- 10.20.193.49:0/531708464 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f82e815abc0 0x7f82e815afe0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f82dc009e50 tx=0x7f82dc02f330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=315367d7704000b0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:13:52.141 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.140+0000 7f82e6ffd640 1 -- 10.20.193.49:0/531708464 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82dc02fde0 con 0x7f82e815abc0 2026-02-17T11:13:52.141 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.140+0000 7f82e6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:52.141 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.140+0000 7f82e6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:13:52.142 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.140+0000 7f82e6ffd640 10 monclient: dump: 2026-02-17T11:13:52.142 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:52.142 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:52.142 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:52.142 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:52.142 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:52.142 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:52.142 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:52.142 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:52.142 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:52.142 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:52.142 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.140+0000 7f82e6ffd640 10 monclient: _finish_auth 0 2026-02-17T11:13:52.142 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.140+0000 7f82e6ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:13:52.142 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.140+0000 7f82e6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:13:52.142 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.140+0000 7f82ee3c1640 5 monclient: authenticate success, global_id 4962 2026-02-17T11:13:52.142 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.140+0000 7f82e6ffd640 1 -- 10.20.193.49:0/531708464 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82dc0373f0 con 0x7f82e815abc0 2026-02-17T11:13:52.142 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.140+0000 7f82ee3c1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:13:52.142 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.140+0000 7f82e6ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:13:52.142 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.140+0000 7f82e6ffd640 1 -- 10.20.193.49:0/531708464 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82dc0377c0 con 0x7f82e815abc0 2026-02-17T11:13:52.142 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.140+0000 7f82e6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:52.142 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.140+0000 7f82e6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:13:52.142 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.140+0000 7f82e6ffd640 10 monclient: dump: 2026-02-17T11:13:52.142 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:52.142 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:52.143 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:52.143 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:52.143 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:52.143 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:52.143 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:52.143 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:52.143 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:52.143 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:52.143 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.140+0000 7f82ee3c1640 10 monclient: get_monmap_and_config success 2026-02-17T11:13:52.143 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.140+0000 7f82ee3c1640 4 set_mon_vals no callback set 2026-02-17T11:13:52.143 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.140+0000 7f82ee3c1640 10 monclient: shutdown 2026-02-17T11:13:52.143 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.140+0000 7f82ee3c1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:13:52.143 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.140+0000 7f82ee3c1640 1 -- 10.20.193.49:0/531708464 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f82e815abc0 msgr2=0x7f82e815afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:52.143 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.140+0000 7f82ee3c1640 1 --2- 10.20.193.49:0/531708464 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f82e815abc0 0x7f82e815afe0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f82dc009e50 tx=0x7f82dc02f330 comp rx=0 tx=0).stop 2026-02-17T11:13:52.143 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.140+0000 7f82ee3c1640 1 -- 10.20.193.49:0/531708464 shutdown_connections 2026-02-17T11:13:52.143 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.140+0000 7f82ee3c1640 1 --2- 10.20.193.49:0/531708464 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f82e815abc0 0x7f82e815afe0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:52.143 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.140+0000 7f82ee3c1640 1 -- 10.20.193.49:0/531708464 >> 10.20.193.49:0/531708464 conn(0x7f82e80c9f20 msgr2=0x7f82e80ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:13:52.143 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.140+0000 7f82ee3c1640 1 -- 10.20.193.49:0/531708464 shutdown_connections 2026-02-17T11:13:52.143 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.140+0000 7f82ee3c1640 1 -- 10.20.193.49:0/531708464 wait complete. 2026-02-17T11:13:52.146 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.140+0000 7f82ee3c1640 10 monclient: build_initial_monmap 2026-02-17T11:13:52.146 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.140+0000 7f82ee3c1640 10 monclient: monmap: 2026-02-17T11:13:52.146 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:13:52.146 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:13:52.146 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:13:52.146 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:13:52.147 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:13:52.147 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:52.147 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:13:52.147 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:13:52.147 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:13:52.147 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:52.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.141+0000 7f82ee3c1640 1 librados: starting msgr at 2026-02-17T11:13:52.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.141+0000 7f82ee3c1640 1 librados: starting objecter 2026-02-17T11:13:52.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.141+0000 7f82ee3c1640 1 Processor -- start 2026-02-17T11:13:52.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.141+0000 7f82ee3c1640 1 -- start start 2026-02-17T11:13:52.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.141+0000 7f82ee3c1640 1 librados: setting wanted keys 2026-02-17T11:13:52.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.141+0000 7f82ee3c1640 1 librados: calling monclient init 2026-02-17T11:13:52.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.141+0000 7f82ee3c1640 10 monclient: init 2026-02-17T11:13:52.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.141+0000 7f82ee3c1640 10 monclient: _reopen_session rank -1 2026-02-17T11:13:52.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.141+0000 7f82ee3c1640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:13:52.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.141+0000 7f82ee3c1640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f82e814f280 0x7f82e81590e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:52.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.141+0000 7f82ee3c1640 10 monclient(hunting): picked mon.noname-c con 0x7f82e814f280 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:13:52.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.141+0000 7f82ee3c1640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f82e814f660 0x7f82e8072760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:52.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.141+0000 7f82ee3c1640 10 monclient(hunting): picked mon.noname-a con 0x7f82e814f660 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:13:52.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.141+0000 7f82ee3c1640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f82e815abc0 0x7f82e8072ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:52.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.141+0000 7f82ee3c1640 10 monclient(hunting): picked mon.noname-b con 0x7f82e815abc0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:13:52.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.141+0000 7f82ee3c1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:52.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.141+0000 7f82ee3c1640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f82e815a730 con 0x7f82e814f660 2026-02-17T11:13:52.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.141+0000 7f82ee3c1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:52.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.141+0000 7f82ee3c1640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f82e80c8530 con 0x7f82e815abc0 2026-02-17T11:13:52.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.141+0000 7f82ee3c1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:52.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.141+0000 7f82ee3c1640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f82e815a3c0 con 0x7f82e814f280 2026-02-17T11:13:52.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.141+0000 7f82ee3c1640 10 monclient(hunting): _renew_subs 2026-02-17T11:13:52.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.141+0000 7f82ee3c1640 10 monclient(hunting): authenticate will time out at 1308.804559s 2026-02-17T11:13:52.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.141+0000 7f82e77fe640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f82e814f660 0x7f82e8072760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:52.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.141+0000 7f82e77fe640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f82e814f660 0x7f82e8072760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:56380/0 (socket says 10.20.193.49:56380) 2026-02-17T11:13:52.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.141+0000 7f82e77fe640 1 -- 10.20.193.49:0/3170801733 learned_addr learned my addr 10.20.193.49:0/3170801733 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:13:52.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.141+0000 7f82e77fe640 10 monclient(hunting): get_auth_request con 0x7f82e814f660 auth_method 0 2026-02-17T11:13:52.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.141+0000 7f82e77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:52.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.141+0000 7f82e77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:52.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.141+0000 7f82e77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:52.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.142+0000 7f82ec937640 1 --2- 10.20.193.49:0/3170801733 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f82e815abc0 0x7f82e8072ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:52.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.142+0000 7f82e7fff640 1 --2- 10.20.193.49:0/3170801733 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f82e814f280 0x7f82e81590e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:52.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.142+0000 7f82e77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:52.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.142+0000 7f82e77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:52.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.142+0000 7f82e77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:52.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.142+0000 7f82ec937640 10 monclient(hunting): get_auth_request con 0x7f82e815abc0 auth_method 0 2026-02-17T11:13:52.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.142+0000 7f82ec937640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:52.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.142+0000 7f82ec937640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:52.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.142+0000 7f82ec937640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:52.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.142+0000 7f82e7fff640 10 monclient(hunting): get_auth_request con 0x7f82e814f280 auth_method 0 2026-02-17T11:13:52.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.142+0000 7f82e7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:52.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.142+0000 7f82e7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:52.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.142+0000 7f82e7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:52.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.142+0000 7f82e7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:52.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.142+0000 7f82e7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:52.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.142+0000 7f82e7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:52.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.142+0000 7f82ec937640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:52.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.142+0000 7f82ec937640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:52.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.142+0000 7f82ec937640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:52.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.143+0000 7f82e77fe640 10 monclient(hunting): handle_auth_done global_id 4965 payload 824 2026-02-17T11:13:52.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.143+0000 7f82e77fe640 1 -- 10.20.193.49:0/3170801733 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f82e814f280 msgr2=0x7f82e81590e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:52.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.143+0000 7f82e77fe640 1 --2- 10.20.193.49:0/3170801733 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f82e814f280 0x7f82e81590e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:52.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.143+0000 7f82e77fe640 1 -- 10.20.193.49:0/3170801733 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f82e815abc0 msgr2=0x7f82e8072ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:52.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.143+0000 7f82e77fe640 1 --2- 10.20.193.49:0/3170801733 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f82e815abc0 0x7f82e8072ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:52.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.143+0000 7f82e77fe640 10 monclient: _finish_hunting 0 2026-02-17T11:13:52.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.143+0000 7f82e77fe640 1 monclient: found mon.noname-a 2026-02-17T11:13:52.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.143+0000 7f82e77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:13:52.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.143+0000 7f82e77fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:13:52.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.143+0000 7f82e77fe640 1 -- 10.20.193.49:0/3170801733 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82e8144380 con 0x7f82e814f660 2026-02-17T11:13:52.151 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.144+0000 7f82e77fe640 1 --2- 10.20.193.49:0/3170801733 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f82e814f660 0x7f82e8072760 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f82d800b570 tx=0x7f82d800ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:13:52.151 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.144+0000 7f82e4ff9640 10 client.?.objecter ms_handle_connect 0x7f82e814f660 2026-02-17T11:13:52.151 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.144+0000 7f82e4ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T11:13:52.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.146+0000 7f82e4ff9640 1 -- 10.20.193.49:0/3170801733 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d8013020 con 0x7f82e814f660 2026-02-17T11:13:52.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.146+0000 7f82e4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:52.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.146+0000 7f82e4ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:13:52.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.146+0000 7f82e4ff9640 10 monclient: dump: 2026-02-17T11:13:52.152 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:52.152 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:52.152 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:52.153 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:52.153 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:52.153 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:52.153 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:52.153 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:52.153 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:52.153 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:52.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.146+0000 7f82e4ff9640 10 monclient: _finish_auth 0 2026-02-17T11:13:52.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.146+0000 7f82e4ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:13:52.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.146+0000 7f82e4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:13:52.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.146+0000 7f82e4ff9640 1 -- 10.20.193.49:0/3170801733 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82d80044a0 con 0x7f82e814f660 2026-02-17T11:13:52.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.146+0000 7f82e4ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:13:52.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.146+0000 7f82e4ff9640 1 -- 10.20.193.49:0/3170801733 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d80029c0 con 0x7f82e814f660 2026-02-17T11:13:52.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.146+0000 7f82e4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:52.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.146+0000 7f82e67fc640 4 set_mon_vals no callback set 2026-02-17T11:13:52.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.146+0000 7f82e4ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:13:52.154 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.146+0000 7f82e4ff9640 10 monclient: dump: 2026-02-17T11:13:52.154 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:52.154 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:52.154 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:52.154 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:52.154 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:52.154 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:52.154 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:52.154 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:52.154 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:52.154 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:52.154 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.146+0000 7f82ee3c1640 5 monclient: authenticate success, global_id 4965 2026-02-17T11:13:52.154 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.146+0000 7f82ee3c1640 10 monclient: _renew_subs 2026-02-17T11:13:52.154 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.146+0000 7f82ee3c1640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:13:52.155 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.146+0000 7f82ee3c1640 1 -- 10.20.193.49:0/3170801733 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82e8159760 con 0x7f82e814f660 2026-02-17T11:13:52.155 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.146+0000 7f82ee3c1640 10 client.4965.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:13:52.155 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.146+0000 7f82ee3c1640 10 monclient: _renew_subs 2026-02-17T11:13:52.155 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.146+0000 7f82ee3c1640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:13:52.155 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.146+0000 7f82ee3c1640 1 -- 10.20.193.49:0/3170801733 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82e814d520 con 0x7f82e814f660 2026-02-17T11:13:52.155 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.146+0000 7f82ee3c1640 1 librados: init done 2026-02-17T11:13:52.155 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.146+0000 7f82ee3c1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:13:52.155 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.146+0000 7f82ee3c1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:13:52.155 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.146+0000 7f82ee3c1640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:13:52.155 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.146+0000 7f82ee3c1640 1 -- 10.20.193.49:0/3170801733 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82e80c9b70 con 0x7f82e814f660 2026-02-17T11:13:52.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.159+0000 7f82e4ff9640 1 -- 10.20.193.49:0/3170801733 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f82d8002b60 con 0x7f82e814f660 2026-02-17T11:13:52.161 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.159+0000 7f82e4ff9640 1 --2- 10.20.193.49:0/3170801733 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f82b8079170 0x7f82b807b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:52.161 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.159+0000 7f82e7fff640 1 --2- 10.20.193.49:0/3170801733 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f82b8079170 0x7f82b807b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:52.161 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.159+0000 7f82e7fff640 10 monclient: get_auth_request con 0x7f82b8079170 auth_method 0 2026-02-17T11:13:52.161 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.160+0000 7f82e4ff9640 10 client.4965.objecter ms_handle_connect 0x7f82b8079170 2026-02-17T11:13:52.162 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.160+0000 7f82e7fff640 1 --2- 10.20.193.49:0/3170801733 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f82b8079170 0x7f82b807b630 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f82d4005110 tx=0x7f82d4007f30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:13:52.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.266+0000 7f82e4ff9640 1 -- 10.20.193.49:0/3170801733 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f82d805e210 con 0x7f82e814f660 2026-02-17T11:13:52.269 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.266+0000 7f82e4ff9640 10 client.4965.objecter ms_dispatch2 0x7f82e8000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:13:52.269 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.266+0000 7f82e4ff9640 3 client.4965.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:13:52.269 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.266+0000 7f82e4ff9640 3 client.4965.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:13:52.269 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.266+0000 7f82e4ff9640 20 client.4965.objecter dump_active .. 0 homeless 2026-02-17T11:13:52.269 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.266+0000 7f82e4ff9640 1 -- 10.20.193.49:0/3170801733 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f82d801d020 con 0x7f82e814f660 2026-02-17T11:13:52.269 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.266+0000 7f82e4ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:13:52.269 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.266+0000 7f82e4ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:13:52.367 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.365+0000 7f82ee3c1640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:13:52.367 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.366+0000 7f82ee3c1640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:13:52.368 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.366+0000 7f82ee3c1640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:13:52.368 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.366+0000 7f82ee3c1640 1 -- 10.20.193.49:0/3170801733 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f82e815ca50 con 0x7f82e814f660 2026-02-17T11:13:52.374 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.372+0000 7f82e4ff9640 1 -- 10.20.193.49:0/3170801733 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f82e8144380 con 0x7f82e814f660 2026-02-17T11:13:52.374 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.372+0000 7f82e4ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:13:52.374 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.372+0000 7f82e4ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:13:52.374 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:13:52.374 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:13:52.376 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.374+0000 7f82ee3c1640 10 librados: watch_flush enter 2026-02-17T11:13:52.376 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.374+0000 7f82ee3c1640 10 librados: watch_flush exit 2026-02-17T11:13:52.376 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.374+0000 7f82ee3c1640 20 client.4965.objecter shutdown clearing up homeless session... 2026-02-17T11:13:52.376 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.374+0000 7f82ee3c1640 10 client.4965.objecter successfully canceled tick 2026-02-17T11:13:52.376 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.374+0000 7f82ee3c1640 1 -- 10.20.193.49:0/3170801733 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f82b8079170 msgr2=0x7f82b807b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:52.376 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.374+0000 7f82ee3c1640 1 --2- 10.20.193.49:0/3170801733 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f82b8079170 0x7f82b807b630 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f82d4005110 tx=0x7f82d4007f30 comp rx=0 tx=0).stop 2026-02-17T11:13:52.376 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.374+0000 7f82ee3c1640 10 monclient: shutdown 2026-02-17T11:13:52.376 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.374+0000 7f82ee3c1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:13:52.376 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.374+0000 7f82ee3c1640 1 -- 10.20.193.49:0/3170801733 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f82e814f660 msgr2=0x7f82e8072760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:52.376 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.374+0000 7f82ee3c1640 1 --2- 10.20.193.49:0/3170801733 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f82e814f660 0x7f82e8072760 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f82d800b570 tx=0x7f82d800ba40 comp rx=0 tx=0).stop 2026-02-17T11:13:52.376 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.374+0000 7f82ee3c1640 1 -- 10.20.193.49:0/3170801733 shutdown_connections 2026-02-17T11:13:52.377 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.374+0000 7f82ee3c1640 1 --2- 10.20.193.49:0/3170801733 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f82b8079170 0x7f82b807b630 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:52.377 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.374+0000 7f82ee3c1640 1 --2- 10.20.193.49:0/3170801733 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f82e815abc0 0x7f82e8072ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:52.377 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.374+0000 7f82ee3c1640 1 --2- 10.20.193.49:0/3170801733 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f82e814f660 0x7f82e8072760 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:52.377 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.374+0000 7f82ee3c1640 1 --2- 10.20.193.49:0/3170801733 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f82e814f280 0x7f82e81590e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:52.377 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.374+0000 7f82ee3c1640 1 -- 10.20.193.49:0/3170801733 >> 10.20.193.49:0/3170801733 conn(0x7f82e80c9f20 msgr2=0x7f82e80c5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:13:52.377 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.374+0000 7f82ee3c1640 1 -- 10.20.193.49:0/3170801733 shutdown_connections 2026-02-17T11:13:52.377 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.374+0000 7f82ee3c1640 1 -- 10.20.193.49:0/3170801733 wait complete. 2026-02-17T11:13:52.377 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:52.374+0000 7f82ee3c1640 1 librados: shutdown 2026-02-17T11:13:55.384 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:13:55.454 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.452+0000 7f1c67fff640 10 monclient: get_monmap_and_config 2026-02-17T11:13:55.454 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.452+0000 7f1c67fff640 10 monclient: build_initial_monmap 2026-02-17T11:13:55.454 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.452+0000 7f1c67fff640 10 monclient: monmap: 2026-02-17T11:13:55.454 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:13:55.454 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:55.454 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:13:55.453453+0000 2026-02-17T11:13:55.454 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:13:55.453453+0000 2026-02-17T11:13:55.454 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:13:55.454 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:55.454 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:13:55.454 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:13:55.454 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:13:55.455 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:13:55.455 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:13:55.455 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:13:55.455 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:55.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.453+0000 7f1c67fff640 1 Processor -- start 2026-02-17T11:13:55.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.453+0000 7f1c67fff640 1 -- start start 2026-02-17T11:13:55.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.453+0000 7f1c67fff640 10 monclient: init 2026-02-17T11:13:55.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.454+0000 7f1c67fff640 10 monclient: _reopen_session rank -1 2026-02-17T11:13:55.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.454+0000 7f1c67fff640 10 monclient: _add_conns ranks=[0,5,2,3,4,1] 2026-02-17T11:13:55.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.454+0000 7f1c67fff640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f1c6815b6a0 addr v1:10.20.193.49:6789/0 2026-02-17T11:13:55.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.454+0000 7f1c67fff640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f1c6815ba80 0x7f1c6806d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:55.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.454+0000 7f1c67fff640 10 monclient(hunting): picked mon.noname-c con 0x7f1c6815ba80 addr v2:10.20.193.157:3300/0 2026-02-17T11:13:55.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.454+0000 7f1c67fff640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f1c680c8ad0 addr v1:10.20.193.157:6789/0 2026-02-17T11:13:55.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.454+0000 7f1c67fff640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c6806dd70 con 0x7f1c6815b6a0 2026-02-17T11:13:55.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.454+0000 7f1c67fff640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c6806e050 con 0x7f1c680c8ad0 2026-02-17T11:13:55.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.454+0000 7f1c67fff640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:55.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.454+0000 7f1c67fff640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f1c6806e330 con 0x7f1c6815ba80 2026-02-17T11:13:55.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.454+0000 7f1c67fff640 10 monclient(hunting): _renew_subs 2026-02-17T11:13:55.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.454+0000 7f1c67fff640 10 monclient(hunting): authenticate will time out at 1312.117108s 2026-02-17T11:13:55.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.454+0000 7f1c66ffd640 1 --1- >> v1:10.20.193.49:6789/0 conn(0x7f1c6815b6a0 0x7f1c68159330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.49:6789/0 says I am v1:10.20.193.49:36186/0 (socket says 10.20.193.49:36186) 2026-02-17T11:13:55.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.454+0000 7f1c66ffd640 1 -- 10.20.193.49:0/4078238098 learned_addr learned my addr 10.20.193.49:0/4078238098 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:13:55.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.454+0000 7f1c667fc640 1 --2- 10.20.193.49:0/4078238098 >> v2:10.20.193.157:3300/0 conn(0x7f1c6815ba80 0x7f1c6806d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:55.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.454+0000 7f1c667fc640 10 monclient(hunting): get_auth_request con 0x7f1c6815ba80 auth_method 0 2026-02-17T11:13:55.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.454+0000 7f1c667fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:55.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.454+0000 7f1c667fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:55.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.454+0000 7f1c667fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:55.457 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.455+0000 7f1c667fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:55.457 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.455+0000 7f1c667fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:55.457 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.455+0000 7f1c667fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:55.457 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.455+0000 7f1c65ffb640 1 -- 10.20.193.49:0/4078238098 <== mon.0 v1:10.20.193.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1073183079 0 0) 0x7f1c6806dd70 con 0x7f1c6815b6a0 2026-02-17T11:13:55.457 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.455+0000 7f1c65ffb640 10 monclient(hunting): _negotiate 2026-02-17T11:13:55.457 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.455+0000 7f1c65ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:55.457 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.455+0000 7f1c65ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:55.457 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.455+0000 7f1c65ffb640 10 monclient(hunting): my global_id is 4968 2026-02-17T11:13:55.457 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.455+0000 7f1c65ffb640 1 -- 10.20.193.49:0/4078238098 --> v1:10.20.193.49:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c54003620 con 0x7f1c6815b6a0 2026-02-17T11:13:55.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.456+0000 7f1c667fc640 10 monclient(hunting): handle_auth_done global_id 4964 payload 274 2026-02-17T11:13:55.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.456+0000 7f1c667fc640 1 -- 10.20.193.49:0/4078238098 >> v1:10.20.193.157:6789/0 conn(0x7f1c680c8ad0 legacy=0x7f1c680c8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:55.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.456+0000 7f1c667fc640 1 -- 10.20.193.49:0/4078238098 >> v1:10.20.193.49:6789/0 conn(0x7f1c6815b6a0 legacy=0x7f1c68159330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:55.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.456+0000 7f1c667fc640 10 monclient: _finish_hunting 0 2026-02-17T11:13:55.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.456+0000 7f1c667fc640 1 monclient: found mon.noname-c 2026-02-17T11:13:55.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.456+0000 7f1c667fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:13:55.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.456+0000 7f1c667fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:13:55.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.456+0000 7f1c667fc640 1 -- 10.20.193.49:0/4078238098 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c6806e610 con 0x7f1c6815ba80 2026-02-17T11:13:55.459 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.458+0000 7f1c667fc640 1 --2- 10.20.193.49:0/4078238098 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f1c6815ba80 0x7f1c6806d430 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1c5000aa80 tx=0x7f1c500302e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47c345a82b186ac5 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:13:55.462 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.460+0000 7f1c65ffb640 1 -- 10.20.193.49:0/4078238098 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c5003d070 con 0x7f1c6815ba80 2026-02-17T11:13:55.462 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.460+0000 7f1c65ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:55.462 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.460+0000 7f1c65ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:13:55.462 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.460+0000 7f1c65ffb640 10 monclient: dump: 2026-02-17T11:13:55.462 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:55.462 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:55.462 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:55.462 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:55.462 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:55.462 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:55.462 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:55.462 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:55.462 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:55.462 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:55.462 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.460+0000 7f1c65ffb640 10 monclient: _finish_auth 0 2026-02-17T11:13:55.462 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.460+0000 7f1c65ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:13:55.462 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.460+0000 7f1c65ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:13:55.462 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.460+0000 7f1c65ffb640 1 -- 10.20.193.49:0/4078238098 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c50038440 con 0x7f1c6815ba80 2026-02-17T11:13:55.462 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.460+0000 7f1c65ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:13:55.462 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.460+0000 7f1c65ffb640 1 -- 10.20.193.49:0/4078238098 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c50038810 con 0x7f1c6815ba80 2026-02-17T11:13:55.462 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.460+0000 7f1c67fff640 5 monclient: authenticate success, global_id 4964 2026-02-17T11:13:55.462 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.460+0000 7f1c67fff640 10 monclient: get_monmap_and_config success 2026-02-17T11:13:55.462 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.460+0000 7f1c67fff640 4 set_mon_vals no callback set 2026-02-17T11:13:55.463 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.460+0000 7f1c65ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:55.463 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.460+0000 7f1c65ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:13:55.463 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.460+0000 7f1c65ffb640 10 monclient: dump: 2026-02-17T11:13:55.463 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:55.463 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:55.463 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:55.463 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:55.463 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:55.463 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:55.463 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:55.463 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:55.463 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:55.463 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:55.463 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.460+0000 7f1c67fff640 10 monclient: shutdown 2026-02-17T11:13:55.463 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.460+0000 7f1c67fff640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:13:55.463 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.460+0000 7f1c67fff640 1 -- 10.20.193.49:0/4078238098 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f1c6815ba80 msgr2=0x7f1c6806d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:55.463 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.460+0000 7f1c67fff640 1 --2- 10.20.193.49:0/4078238098 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f1c6815ba80 0x7f1c6806d430 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1c5000aa80 tx=0x7f1c500302e0 comp rx=0 tx=0).stop 2026-02-17T11:13:55.463 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.460+0000 7f1c67fff640 1 -- 10.20.193.49:0/4078238098 shutdown_connections 2026-02-17T11:13:55.463 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.460+0000 7f1c67fff640 1 --2- 10.20.193.49:0/4078238098 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f1c6815ba80 0x7f1c6806d430 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:55.463 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.460+0000 7f1c67fff640 1 -- 10.20.193.49:0/4078238098 >> 10.20.193.49:0/4078238098 conn(0x7f1c680cd5c0 msgr2=0x7f1c680cd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:13:55.463 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.460+0000 7f1c67fff640 1 -- 10.20.193.49:0/4078238098 shutdown_connections 2026-02-17T11:13:55.463 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.460+0000 7f1c67fff640 1 -- 10.20.193.49:0/4078238098 wait complete. 2026-02-17T11:13:55.465 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.461+0000 7f1c67fff640 10 monclient: build_initial_monmap 2026-02-17T11:13:55.465 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.461+0000 7f1c67fff640 10 monclient: monmap: 2026-02-17T11:13:55.465 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:13:55.465 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:13:55.465 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:13:55.465 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:13:55.465 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:13:55.465 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:55.465 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:13:55.465 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:13:55.465 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:13:55.465 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:55.465 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.461+0000 7f1c67fff640 1 librados: starting msgr at 2026-02-17T11:13:55.465 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.461+0000 7f1c67fff640 1 librados: starting objecter 2026-02-17T11:13:55.465 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.461+0000 7f1c67fff640 1 Processor -- start 2026-02-17T11:13:55.465 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.461+0000 7f1c67fff640 1 -- start start 2026-02-17T11:13:55.465 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.461+0000 7f1c67fff640 1 librados: setting wanted keys 2026-02-17T11:13:55.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.461+0000 7f1c67fff640 1 librados: calling monclient init 2026-02-17T11:13:55.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.461+0000 7f1c67fff640 10 monclient: init 2026-02-17T11:13:55.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.462+0000 7f1c67fff640 10 monclient: _reopen_session rank -1 2026-02-17T11:13:55.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.462+0000 7f1c67fff640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:13:55.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.462+0000 7f1c67fff640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f1c680c8ad0 0x7f1c68152730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:55.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.462+0000 7f1c67fff640 10 monclient(hunting): picked mon.noname-b con 0x7f1c680c8ad0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:13:55.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.462+0000 7f1c67fff640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f1c6815b6a0 0x7f1c681495e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:55.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.462+0000 7f1c67fff640 10 monclient(hunting): picked mon.noname-c con 0x7f1c6815b6a0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:13:55.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.462+0000 7f1c67fff640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1c6815ba80 0x7f1c681542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:55.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.462+0000 7f1c67fff640 10 monclient(hunting): picked mon.noname-a con 0x7f1c6815ba80 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:13:55.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.462+0000 7f1c67fff640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:55.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.462+0000 7f1c67fff640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1c6806f0f0 con 0x7f1c6815ba80 2026-02-17T11:13:55.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.462+0000 7f1c67fff640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:55.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.462+0000 7f1c67fff640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1c6806ebd0 con 0x7f1c680c8ad0 2026-02-17T11:13:55.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.462+0000 7f1c67fff640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:55.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.462+0000 7f1c67fff640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f1c681f4e30 con 0x7f1c6815b6a0 2026-02-17T11:13:55.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.462+0000 7f1c67fff640 10 monclient(hunting): _renew_subs 2026-02-17T11:13:55.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.462+0000 7f1c67fff640 10 monclient(hunting): authenticate will time out at 1312.125179s 2026-02-17T11:13:55.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.462+0000 7f1c677fe640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1c6815ba80 0x7f1c681542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:55.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.462+0000 7f1c667fc640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f1c6815b6a0 0x7f1c681495e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:55.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.462+0000 7f1c677fe640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1c6815ba80 0x7f1c681542c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:56384/0 (socket says 10.20.193.49:56384) 2026-02-17T11:13:55.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.462+0000 7f1c677fe640 1 -- 10.20.193.49:0/1488785261 learned_addr learned my addr 10.20.193.49:0/1488785261 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:13:55.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.462+0000 7f1c677fe640 10 monclient(hunting): get_auth_request con 0x7f1c6815ba80 auth_method 0 2026-02-17T11:13:55.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.462+0000 7f1c677fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:55.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.462+0000 7f1c677fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:55.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.462+0000 7f1c677fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:55.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.462+0000 7f1c66ffd640 1 --2- 10.20.193.49:0/1488785261 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f1c680c8ad0 0x7f1c68152730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:55.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.462+0000 7f1c667fc640 10 monclient(hunting): get_auth_request con 0x7f1c6815b6a0 auth_method 0 2026-02-17T11:13:55.467 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.462+0000 7f1c667fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:55.467 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.462+0000 7f1c667fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:55.467 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.462+0000 7f1c667fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:55.467 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.462+0000 7f1c66ffd640 10 monclient(hunting): get_auth_request con 0x7f1c680c8ad0 auth_method 0 2026-02-17T11:13:55.467 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.462+0000 7f1c66ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:55.467 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.462+0000 7f1c66ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:55.467 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.462+0000 7f1c66ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:55.467 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.462+0000 7f1c677fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:55.467 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.462+0000 7f1c677fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:55.467 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.462+0000 7f1c677fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:55.467 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.462+0000 7f1c667fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:55.467 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.462+0000 7f1c667fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:55.467 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.462+0000 7f1c667fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:55.467 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.463+0000 7f1c66ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:55.467 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.463+0000 7f1c66ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:55.467 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.463+0000 7f1c66ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:55.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.464+0000 7f1c677fe640 10 monclient(hunting): handle_auth_done global_id 4971 payload 824 2026-02-17T11:13:55.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.464+0000 7f1c677fe640 1 -- 10.20.193.49:0/1488785261 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f1c6815b6a0 msgr2=0x7f1c681495e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:55.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.464+0000 7f1c677fe640 1 --2- 10.20.193.49:0/1488785261 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f1c6815b6a0 0x7f1c681495e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:55.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.464+0000 7f1c677fe640 1 -- 10.20.193.49:0/1488785261 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f1c680c8ad0 msgr2=0x7f1c68152730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:55.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.464+0000 7f1c677fe640 1 --2- 10.20.193.49:0/1488785261 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f1c680c8ad0 0x7f1c68152730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:55.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.464+0000 7f1c677fe640 10 monclient: _finish_hunting 0 2026-02-17T11:13:55.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.464+0000 7f1c677fe640 1 monclient: found mon.noname-a 2026-02-17T11:13:55.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.464+0000 7f1c677fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:13:55.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.464+0000 7f1c677fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:13:55.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.464+0000 7f1c677fe640 1 -- 10.20.193.49:0/1488785261 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c68154e20 con 0x7f1c6815ba80 2026-02-17T11:13:55.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.465+0000 7f1c677fe640 1 --2- 10.20.193.49:0/1488785261 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1c6815ba80 0x7f1c681542c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1c5800cc50 tx=0x7f1c5800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:13:55.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.465+0000 7f1c477fe640 10 client.?.objecter ms_handle_connect 0x7f1c6815ba80 2026-02-17T11:13:55.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.465+0000 7f1c477fe640 10 client.?.objecter resend_mon_ops 2026-02-17T11:13:55.469 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.467+0000 7f1c477fe640 1 -- 10.20.193.49:0/1488785261 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c58003a70 con 0x7f1c6815ba80 2026-02-17T11:13:55.469 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.467+0000 7f1c477fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:55.469 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.467+0000 7f1c477fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:13:55.469 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.467+0000 7f1c477fe640 10 monclient: dump: 2026-02-17T11:13:55.469 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:55.469 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:55.469 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:55.469 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:55.469 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:55.469 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:55.469 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:55.469 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:55.469 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:55.469 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:55.469 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.467+0000 7f1c477fe640 10 monclient: _finish_auth 0 2026-02-17T11:13:55.469 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.467+0000 7f1c477fe640 10 monclient: _check_auth_tickets 2026-02-17T11:13:55.469 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.467+0000 7f1c477fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:13:55.469 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.467+0000 7f1c477fe640 1 -- 10.20.193.49:0/1488785261 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c58003c10 con 0x7f1c6815ba80 2026-02-17T11:13:55.469 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.467+0000 7f1c67fff640 5 monclient: authenticate success, global_id 4971 2026-02-17T11:13:55.469 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.467+0000 7f1c67fff640 10 monclient: _renew_subs 2026-02-17T11:13:55.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.467+0000 7f1c67fff640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:13:55.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.467+0000 7f1c67fff640 1 -- 10.20.193.49:0/1488785261 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c68155100 con 0x7f1c6815ba80 2026-02-17T11:13:55.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.467+0000 7f1c477fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:13:55.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.467+0000 7f1c477fe640 1 -- 10.20.193.49:0/1488785261 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c580050d0 con 0x7f1c6815ba80 2026-02-17T11:13:55.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.467+0000 7f1c477fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:55.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.467+0000 7f1c657fa640 4 set_mon_vals no callback set 2026-02-17T11:13:55.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.467+0000 7f1c477fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:13:55.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.467+0000 7f1c477fe640 10 monclient: dump: 2026-02-17T11:13:55.470 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:55.470 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:55.470 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:55.470 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:55.470 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:55.470 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:55.470 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:55.470 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:55.470 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:55.470 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:55.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.467+0000 7f1c67fff640 10 client.4971.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:13:55.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.467+0000 7f1c67fff640 10 monclient: _renew_subs 2026-02-17T11:13:55.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.467+0000 7f1c67fff640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:13:55.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.467+0000 7f1c67fff640 1 -- 10.20.193.49:0/1488785261 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c681f4ac0 con 0x7f1c6815ba80 2026-02-17T11:13:55.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.467+0000 7f1c67fff640 1 librados: init done 2026-02-17T11:13:55.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.467+0000 7f1c67fff640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:13:55.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.467+0000 7f1c67fff640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:13:55.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.467+0000 7f1c67fff640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:13:55.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.467+0000 7f1c67fff640 1 -- 10.20.193.49:0/1488785261 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c68155620 con 0x7f1c6815ba80 2026-02-17T11:13:55.479 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.478+0000 7f1c477fe640 1 -- 10.20.193.49:0/1488785261 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f1c58005270 con 0x7f1c6815ba80 2026-02-17T11:13:55.480 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.479+0000 7f1c477fe640 1 --2- 10.20.193.49:0/1488785261 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f1c34079140 0x7f1c3407b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:55.481 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.479+0000 7f1c66ffd640 1 --2- 10.20.193.49:0/1488785261 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f1c34079140 0x7f1c3407b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:55.481 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.479+0000 7f1c66ffd640 10 monclient: get_auth_request con 0x7f1c34079140 auth_method 0 2026-02-17T11:13:55.482 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.479+0000 7f1c66ffd640 1 --2- 10.20.193.49:0/1488785261 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f1c34079140 0x7f1c3407b600 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c005980 tx=0x7f1c5c007dd0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:13:55.482 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.479+0000 7f1c477fe640 10 client.4971.objecter ms_handle_connect 0x7f1c34079140 2026-02-17T11:13:55.482 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.480+0000 7f1c477fe640 1 -- 10.20.193.49:0/1488785261 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f1c5805e9b0 con 0x7f1c6815ba80 2026-02-17T11:13:55.482 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.480+0000 7f1c477fe640 10 client.4971.objecter ms_dispatch2 0x7f1c68000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:13:55.482 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.480+0000 7f1c477fe640 3 client.4971.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:13:55.482 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.480+0000 7f1c477fe640 3 client.4971.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:13:55.482 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.480+0000 7f1c477fe640 20 client.4971.objecter dump_active .. 0 homeless 2026-02-17T11:13:55.580 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.578+0000 7f1c477fe640 1 -- 10.20.193.49:0/1488785261 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f1c68155620 con 0x7f1c6815ba80 2026-02-17T11:13:55.580 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.578+0000 7f1c477fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:13:55.580 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.578+0000 7f1c477fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:13:55.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.679+0000 7f1c67fff640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:13:55.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.679+0000 7f1c67fff640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:13:55.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.679+0000 7f1c67fff640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:13:55.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.679+0000 7f1c67fff640 1 -- 10.20.193.49:0/1488785261 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f1c680c8f60 con 0x7f1c6815ba80 2026-02-17T11:13:55.683 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.681+0000 7f1c477fe640 1 -- 10.20.193.49:0/1488785261 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f1c58062970 con 0x7f1c6815ba80 2026-02-17T11:13:55.683 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.681+0000 7f1c477fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:13:55.683 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.681+0000 7f1c477fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:13:55.683 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:13:55.683 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:13:55.685 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.682+0000 7f1c67fff640 10 librados: watch_flush enter 2026-02-17T11:13:55.685 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.682+0000 7f1c67fff640 10 librados: watch_flush exit 2026-02-17T11:13:55.685 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.682+0000 7f1c67fff640 20 client.4971.objecter shutdown clearing up homeless session... 2026-02-17T11:13:55.685 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.682+0000 7f1c67fff640 10 client.4971.objecter successfully canceled tick 2026-02-17T11:13:55.685 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.682+0000 7f1c67fff640 1 -- 10.20.193.49:0/1488785261 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f1c34079140 msgr2=0x7f1c3407b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:55.686 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.682+0000 7f1c67fff640 1 --2- 10.20.193.49:0/1488785261 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f1c34079140 0x7f1c3407b600 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c005980 tx=0x7f1c5c007dd0 comp rx=0 tx=0).stop 2026-02-17T11:13:55.686 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.682+0000 7f1c67fff640 10 monclient: shutdown 2026-02-17T11:13:55.686 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.682+0000 7f1c67fff640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:13:55.686 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.682+0000 7f1c67fff640 1 -- 10.20.193.49:0/1488785261 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1c6815ba80 msgr2=0x7f1c681542c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:55.686 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.682+0000 7f1c67fff640 1 --2- 10.20.193.49:0/1488785261 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1c6815ba80 0x7f1c681542c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1c5800cc50 tx=0x7f1c5800a430 comp rx=0 tx=0).stop 2026-02-17T11:13:55.686 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.682+0000 7f1c67fff640 1 -- 10.20.193.49:0/1488785261 shutdown_connections 2026-02-17T11:13:55.686 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.682+0000 7f1c67fff640 1 --2- 10.20.193.49:0/1488785261 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f1c34079140 0x7f1c3407b600 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:55.686 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.682+0000 7f1c67fff640 1 --2- 10.20.193.49:0/1488785261 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1c6815ba80 0x7f1c681542c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:55.686 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.682+0000 7f1c67fff640 1 --2- 10.20.193.49:0/1488785261 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f1c6815b6a0 0x7f1c681495e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:55.686 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.682+0000 7f1c67fff640 1 --2- 10.20.193.49:0/1488785261 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f1c680c8ad0 0x7f1c68152730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:55.686 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.682+0000 7f1c67fff640 1 -- 10.20.193.49:0/1488785261 >> 10.20.193.49:0/1488785261 conn(0x7f1c680cd5c0 msgr2=0x7f1c681e5d50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:13:55.686 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.682+0000 7f1c67fff640 1 -- 10.20.193.49:0/1488785261 shutdown_connections 2026-02-17T11:13:55.687 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.682+0000 7f1c67fff640 1 -- 10.20.193.49:0/1488785261 wait complete. 2026-02-17T11:13:55.687 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:55.682+0000 7f1c67fff640 1 librados: shutdown 2026-02-17T11:13:58.694 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:13:58.773 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.772+0000 7f611307e640 10 monclient: get_monmap_and_config 2026-02-17T11:13:58.773 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.772+0000 7f611307e640 10 monclient: build_initial_monmap 2026-02-17T11:13:58.773 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.772+0000 7f611307e640 10 monclient: monmap: 2026-02-17T11:13:58.774 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:13:58.774 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:58.774 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:13:58.772879+0000 2026-02-17T11:13:58.774 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:13:58.772879+0000 2026-02-17T11:13:58.774 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:13:58.774 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:58.774 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:13:58.774 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:13:58.774 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:13:58.774 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:13:58.774 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:13:58.774 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:13:58.774 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:58.774 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.772+0000 7f611307e640 1 Processor -- start 2026-02-17T11:13:58.774 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.772+0000 7f611307e640 1 -- start start 2026-02-17T11:13:58.774 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.772+0000 7f611307e640 10 monclient: init 2026-02-17T11:13:58.774 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.773+0000 7f611307e640 10 monclient: _reopen_session rank -1 2026-02-17T11:13:58.774 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.773+0000 7f611307e640 10 monclient: _add_conns ranks=[5,3,4,1,0,2] 2026-02-17T11:13:58.774 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.773+0000 7f611307e640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f610c0c7170 0x7f610c0c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:58.774 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.773+0000 7f611307e640 10 monclient(hunting): picked mon.noname-c con 0x7f610c0c7170 addr v2:10.20.193.157:3300/0 2026-02-17T11:13:58.774 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.773+0000 7f611307e640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f610c0c48c0 0x7f610c0749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:58.774 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.773+0000 7f611307e640 10 monclient(hunting): picked mon.noname-a con 0x7f610c0c48c0 addr v2:10.20.193.49:3300/0 2026-02-17T11:13:58.774 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.773+0000 7f611307e640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f610c074ef0 0x7f610c0c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:58.774 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.773+0000 7f611307e640 10 monclient(hunting): picked mon.noname-b con 0x7f610c074ef0 addr v2:10.20.193.97:3300/0 2026-02-17T11:13:58.774 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.773+0000 7f611307e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:58.774 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.773+0000 7f611307e640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f610c0c8530 con 0x7f610c0c48c0 2026-02-17T11:13:58.775 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.773+0000 7f611307e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:58.775 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.773+0000 7f611307e640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f610c15a9a0 con 0x7f610c074ef0 2026-02-17T11:13:58.775 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.773+0000 7f611307e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:58.775 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.773+0000 7f611307e640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f610c0c5270 con 0x7f610c0c7170 2026-02-17T11:13:58.775 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.773+0000 7f611307e640 10 monclient(hunting): _renew_subs 2026-02-17T11:13:58.775 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.773+0000 7f611307e640 10 monclient(hunting): authenticate will time out at 1315.436328s 2026-02-17T11:13:58.775 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.773+0000 7f6103fff640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f610c0c48c0 0x7f610c0749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:58.775 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.773+0000 7f61115f4640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f610c074ef0 0x7f610c0c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:58.775 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.773+0000 7f6110df3640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f610c0c7170 0x7f610c0c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:58.775 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.773+0000 7f6103fff640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f610c0c48c0 0x7f610c0749b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:45826/0 (socket says 10.20.193.49:45826) 2026-02-17T11:13:58.775 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.773+0000 7f6103fff640 1 -- 10.20.193.49:0/866893032 learned_addr learned my addr 10.20.193.49:0/866893032 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:13:58.775 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.773+0000 7f6103fff640 10 monclient(hunting): get_auth_request con 0x7f610c0c48c0 auth_method 0 2026-02-17T11:13:58.775 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.773+0000 7f6103fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:58.775 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.773+0000 7f6103fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:58.775 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.773+0000 7f6103fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:58.775 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.774+0000 7f61115f4640 10 monclient(hunting): get_auth_request con 0x7f610c074ef0 auth_method 0 2026-02-17T11:13:58.775 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.774+0000 7f61115f4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:58.775 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.774+0000 7f61115f4640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:58.776 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.774+0000 7f61115f4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:58.776 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.774+0000 7f6110df3640 10 monclient(hunting): get_auth_request con 0x7f610c0c7170 auth_method 0 2026-02-17T11:13:58.776 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.774+0000 7f6110df3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:58.776 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.774+0000 7f6110df3640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:58.776 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.774+0000 7f6110df3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:58.776 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.774+0000 7f6103fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:58.776 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.774+0000 7f6103fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:58.776 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.774+0000 7f6103fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:58.776 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.774+0000 7f61115f4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:58.776 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.774+0000 7f61115f4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:58.776 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.774+0000 7f61115f4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:58.776 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.774+0000 7f6110df3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:58.776 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.774+0000 7f6110df3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:58.776 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.774+0000 7f6110df3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:58.776 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.775+0000 7f6103fff640 10 monclient(hunting): handle_auth_done global_id 4974 payload 274 2026-02-17T11:13:58.776 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.775+0000 7f6103fff640 1 -- 10.20.193.49:0/866893032 >> v2:10.20.193.157:3300/0 conn(0x7f610c0c7170 msgr2=0x7f610c0c7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:13:58.776 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.775+0000 7f6103fff640 1 --2- 10.20.193.49:0/866893032 >> v2:10.20.193.157:3300/0 conn(0x7f610c0c7170 0x7f610c0c7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:58.776 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.775+0000 7f6103fff640 1 -- 10.20.193.49:0/866893032 >> v2:10.20.193.97:3300/0 conn(0x7f610c074ef0 msgr2=0x7f610c0c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:13:58.776 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.775+0000 7f6103fff640 1 --2- 10.20.193.49:0/866893032 >> v2:10.20.193.97:3300/0 conn(0x7f610c074ef0 0x7f610c0c89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:58.776 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.775+0000 7f6103fff640 10 monclient: _finish_hunting 0 2026-02-17T11:13:58.776 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.775+0000 7f6103fff640 1 monclient: found mon.noname-a 2026-02-17T11:13:58.776 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.775+0000 7f6103fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:13:58.776 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.775+0000 7f6103fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:13:58.776 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.775+0000 7f6103fff640 1 -- 10.20.193.49:0/866893032 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f610c0c5550 con 0x7f610c0c48c0 2026-02-17T11:13:58.777 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.776+0000 7f6103fff640 1 --2- 10.20.193.49:0/866893032 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f610c0c48c0 0x7f610c0749b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f610c0c6e90 tx=0x7f60f402ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afe741b62f7ef61 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:13:58.779 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.777+0000 7f61037fe640 1 -- 10.20.193.49:0/866893032 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f403c070 con 0x7f610c0c48c0 2026-02-17T11:13:58.779 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.777+0000 7f61037fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:58.779 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.777+0000 7f61037fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:13:58.779 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.777+0000 7f61037fe640 10 monclient: dump: 2026-02-17T11:13:58.779 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:58.779 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:58.779 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:58.779 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:58.779 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:58.779 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:58.779 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:58.779 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:58.779 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:58.779 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:58.779 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.777+0000 7f61037fe640 10 monclient: _finish_auth 0 2026-02-17T11:13:58.779 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.777+0000 7f61037fe640 10 monclient: _check_auth_tickets 2026-02-17T11:13:58.779 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.777+0000 7f61037fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:13:58.779 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.777+0000 7f61037fe640 1 -- 10.20.193.49:0/866893032 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60f402fb50 con 0x7f610c0c48c0 2026-02-17T11:13:58.779 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.777+0000 7f611307e640 5 monclient: authenticate success, global_id 4974 2026-02-17T11:13:58.779 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.777+0000 7f61037fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:13:58.779 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.777+0000 7f61037fe640 1 -- 10.20.193.49:0/866893032 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f4037440 con 0x7f610c0c48c0 2026-02-17T11:13:58.779 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.777+0000 7f61037fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:58.779 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.777+0000 7f61037fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:13:58.779 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.777+0000 7f61037fe640 10 monclient: dump: 2026-02-17T11:13:58.779 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:58.779 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:58.779 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:58.779 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:58.779 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:58.779 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:58.779 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:58.779 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:58.779 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:58.779 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:58.779 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.777+0000 7f611307e640 10 monclient: get_monmap_and_config success 2026-02-17T11:13:58.779 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.777+0000 7f611307e640 4 set_mon_vals no callback set 2026-02-17T11:13:58.780 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.778+0000 7f611307e640 10 monclient: shutdown 2026-02-17T11:13:58.780 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.778+0000 7f611307e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:13:58.780 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.778+0000 7f611307e640 1 -- 10.20.193.49:0/866893032 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f610c0c48c0 msgr2=0x7f610c0749b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:58.780 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.778+0000 7f611307e640 1 --2- 10.20.193.49:0/866893032 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f610c0c48c0 0x7f610c0749b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f610c0c6e90 tx=0x7f60f402ee90 comp rx=0 tx=0).stop 2026-02-17T11:13:58.780 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.778+0000 7f611307e640 1 -- 10.20.193.49:0/866893032 shutdown_connections 2026-02-17T11:13:58.780 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.778+0000 7f611307e640 1 --2- 10.20.193.49:0/866893032 >> v2:10.20.193.97:3300/0 conn(0x7f610c074ef0 0x7f610c0c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:58.780 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.778+0000 7f611307e640 1 --2- 10.20.193.49:0/866893032 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f610c0c48c0 0x7f610c0749b0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:58.780 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.778+0000 7f611307e640 1 --2- 10.20.193.49:0/866893032 >> v2:10.20.193.157:3300/0 conn(0x7f610c0c7170 0x7f610c0c7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:58.780 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.778+0000 7f611307e640 1 -- 10.20.193.49:0/866893032 >> 10.20.193.49:0/866893032 conn(0x7f610c0c9f40 msgr2=0x7f610c0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:13:58.780 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.778+0000 7f611307e640 1 -- 10.20.193.49:0/866893032 shutdown_connections 2026-02-17T11:13:58.780 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.778+0000 7f611307e640 1 -- 10.20.193.49:0/866893032 wait complete. 2026-02-17T11:13:58.780 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.778+0000 7f611307e640 10 monclient: build_initial_monmap 2026-02-17T11:13:58.780 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.778+0000 7f611307e640 10 monclient: monmap: 2026-02-17T11:13:58.780 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:13:58.780 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:13:58.780 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:13:58.780 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:13:58.780 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:13:58.780 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:58.780 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:13:58.780 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:13:58.780 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:13:58.780 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:58.780 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.779+0000 7f611307e640 1 librados: starting msgr at 2026-02-17T11:13:58.780 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.779+0000 7f611307e640 1 librados: starting objecter 2026-02-17T11:13:58.780 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.779+0000 7f611307e640 1 Processor -- start 2026-02-17T11:13:58.781 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.779+0000 7f611307e640 1 -- start start 2026-02-17T11:13:58.781 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.779+0000 7f611307e640 1 librados: setting wanted keys 2026-02-17T11:13:58.781 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.779+0000 7f611307e640 1 librados: calling monclient init 2026-02-17T11:13:58.781 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.779+0000 7f611307e640 10 monclient: init 2026-02-17T11:13:58.781 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.779+0000 7f611307e640 10 monclient: _reopen_session rank -1 2026-02-17T11:13:58.781 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.779+0000 7f611307e640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:13:58.781 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.779+0000 7f611307e640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f610c074ef0 0x7f610c157000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:58.781 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.779+0000 7f611307e640 10 monclient(hunting): picked mon.noname-b con 0x7f610c074ef0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:13:58.781 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.779+0000 7f611307e640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f610c0c48c0 0x7f610c1f3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:58.781 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.779+0000 7f611307e640 10 monclient(hunting): picked mon.noname-c con 0x7f610c0c48c0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:13:58.781 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.779+0000 7f611307e640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f610c0c7170 0x7f610c1f3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:58.781 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.779+0000 7f611307e640 10 monclient(hunting): picked mon.noname-a con 0x7f610c0c7170 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:13:58.781 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.779+0000 7f611307e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:58.781 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.779+0000 7f611307e640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f610c0c81c0 con 0x7f610c0c7170 2026-02-17T11:13:58.781 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.779+0000 7f611307e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:58.781 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.779+0000 7f611307e640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f610c0c7ee0 con 0x7f610c074ef0 2026-02-17T11:13:58.782 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.779+0000 7f611307e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:13:58.782 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.779+0000 7f611307e640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f610c0c4d10 con 0x7f610c0c48c0 2026-02-17T11:13:58.782 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.779+0000 7f611307e640 10 monclient(hunting): _renew_subs 2026-02-17T11:13:58.782 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.779+0000 7f611307e640 10 monclient(hunting): authenticate will time out at 1315.442740s 2026-02-17T11:13:58.782 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.780+0000 7f61115f4640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f610c0c7170 0x7f610c1f3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:58.782 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.780+0000 7f6110df3640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f610c074ef0 0x7f610c157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:58.782 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.780+0000 7f61115f4640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f610c0c7170 0x7f610c1f3660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:45830/0 (socket says 10.20.193.49:45830) 2026-02-17T11:13:58.782 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.780+0000 7f61115f4640 1 -- 10.20.193.49:0/4289349328 learned_addr learned my addr 10.20.193.49:0/4289349328 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:13:58.782 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.780+0000 7f61115f4640 10 monclient(hunting): get_auth_request con 0x7f610c0c7170 auth_method 0 2026-02-17T11:13:58.782 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.780+0000 7f61115f4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:58.782 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.780+0000 7f61115f4640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:58.782 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.780+0000 7f61115f4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:58.782 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.780+0000 7f6103fff640 1 --2- 10.20.193.49:0/4289349328 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f610c0c48c0 0x7f610c1f3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:58.782 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.780+0000 7f6110df3640 10 monclient(hunting): get_auth_request con 0x7f610c074ef0 auth_method 0 2026-02-17T11:13:58.782 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.780+0000 7f6110df3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:58.782 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.780+0000 7f6110df3640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:58.782 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.780+0000 7f6110df3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:58.782 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.780+0000 7f6103fff640 10 monclient(hunting): get_auth_request con 0x7f610c0c48c0 auth_method 0 2026-02-17T11:13:58.782 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.780+0000 7f6103fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:13:58.782 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.780+0000 7f6103fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:13:58.782 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.780+0000 7f6103fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:13:58.782 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.780+0000 7f61115f4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:58.782 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.780+0000 7f61115f4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:58.782 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.780+0000 7f61115f4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:58.782 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.780+0000 7f6103fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:58.782 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.780+0000 7f6103fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:58.782 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.780+0000 7f6103fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:58.782 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.780+0000 7f6110df3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:13:58.782 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.780+0000 7f6110df3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:13:58.782 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.780+0000 7f6110df3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:13:58.783 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.781+0000 7f61115f4640 10 monclient(hunting): handle_auth_done global_id 4977 payload 824 2026-02-17T11:13:58.783 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.781+0000 7f61115f4640 1 -- 10.20.193.49:0/4289349328 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f610c0c48c0 msgr2=0x7f610c1f3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:58.783 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.781+0000 7f61115f4640 1 --2- 10.20.193.49:0/4289349328 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f610c0c48c0 0x7f610c1f3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:58.783 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.781+0000 7f61115f4640 1 -- 10.20.193.49:0/4289349328 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f610c074ef0 msgr2=0x7f610c157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:58.783 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.781+0000 7f61115f4640 1 --2- 10.20.193.49:0/4289349328 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f610c074ef0 0x7f610c157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:58.783 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.781+0000 7f61115f4640 10 monclient: _finish_hunting 0 2026-02-17T11:13:58.783 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.781+0000 7f61115f4640 1 monclient: found mon.noname-a 2026-02-17T11:13:58.783 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.781+0000 7f61115f4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:13:58.783 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.781+0000 7f61115f4640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:13:58.783 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.781+0000 7f61115f4640 1 -- 10.20.193.49:0/4289349328 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f610c154f70 con 0x7f610c0c7170 2026-02-17T11:13:58.783 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.782+0000 7f61115f4640 1 --2- 10.20.193.49:0/4289349328 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f610c0c7170 0x7f610c1f3660 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f610800eed0 tx=0x7f610800b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:13:58.783 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.782+0000 7f61017fa640 10 client.?.objecter ms_handle_connect 0x7f610c0c7170 2026-02-17T11:13:58.783 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.782+0000 7f61017fa640 10 client.?.objecter resend_mon_ops 2026-02-17T11:13:58.785 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.784+0000 7f61017fa640 1 -- 10.20.193.49:0/4289349328 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6108018020 con 0x7f610c0c7170 2026-02-17T11:13:58.785 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.784+0000 7f61017fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:58.785 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.784+0000 7f61017fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:13:58.785 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.784+0000 7f61017fa640 10 monclient: dump: 2026-02-17T11:13:58.785 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:58.785 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:58.785 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:58.785 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:58.785 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:58.785 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:58.786 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:58.786 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:58.786 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:58.786 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:58.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.784+0000 7f61017fa640 10 monclient: _finish_auth 0 2026-02-17T11:13:58.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.784+0000 7f61017fa640 10 monclient: _check_auth_tickets 2026-02-17T11:13:58.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.784+0000 7f61017fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:13:58.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.784+0000 7f61017fa640 1 -- 10.20.193.49:0/4289349328 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6108014400 con 0x7f610c0c7170 2026-02-17T11:13:58.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.784+0000 7f61017fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:13:58.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.784+0000 7f61017fa640 1 -- 10.20.193.49:0/4289349328 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61080147f0 con 0x7f610c0c7170 2026-02-17T11:13:58.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.784+0000 7f61017fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:13:58.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.784+0000 7f61017fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:13:58.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.784+0000 7f61017fa640 10 monclient: dump: 2026-02-17T11:13:58.786 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:13:58.786 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:13:58.786 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:58.786 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:13:58.786 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:13:58.786 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:13:58.786 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:13:58.786 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:13:58.786 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:13:58.786 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:13:58.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.784+0000 7f6102ffd640 4 set_mon_vals no callback set 2026-02-17T11:13:58.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.784+0000 7f611307e640 5 monclient: authenticate success, global_id 4977 2026-02-17T11:13:58.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.784+0000 7f611307e640 10 monclient: _renew_subs 2026-02-17T11:13:58.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.784+0000 7f611307e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:13:58.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.784+0000 7f611307e640 1 -- 10.20.193.49:0/4289349328 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f610c155210 con 0x7f610c0c7170 2026-02-17T11:13:58.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.784+0000 7f611307e640 10 client.4977.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:13:58.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.784+0000 7f611307e640 10 monclient: _renew_subs 2026-02-17T11:13:58.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.784+0000 7f611307e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:13:58.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.784+0000 7f611307e640 1 -- 10.20.193.49:0/4289349328 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f610c1557d0 con 0x7f610c0c7170 2026-02-17T11:13:58.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.784+0000 7f611307e640 1 librados: init done 2026-02-17T11:13:58.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.784+0000 7f611307e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:13:58.787 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.785+0000 7f611307e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:13:58.787 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.785+0000 7f611307e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:13:58.787 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.785+0000 7f611307e640 1 -- 10.20.193.49:0/4289349328 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f610c0749b0 con 0x7f610c0c7170 2026-02-17T11:13:58.797 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.796+0000 7f61017fa640 1 -- 10.20.193.49:0/4289349328 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f6108014990 con 0x7f610c0c7170 2026-02-17T11:13:58.797 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.796+0000 7f61017fa640 1 --2- 10.20.193.49:0/4289349328 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f60dc079190 0x7f60dc07b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:13:58.798 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.796+0000 7f6110df3640 1 --2- 10.20.193.49:0/4289349328 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f60dc079190 0x7f60dc07b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:13:58.798 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.797+0000 7f6110df3640 10 monclient: get_auth_request con 0x7f60dc079190 auth_method 0 2026-02-17T11:13:58.798 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.797+0000 7f61017fa640 1 -- 10.20.193.49:0/4289349328 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f610805ecb0 con 0x7f610c0c7170 2026-02-17T11:13:58.798 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.797+0000 7f61017fa640 10 client.4977.objecter ms_dispatch2 0x7f610c000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:13:58.798 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.797+0000 7f61017fa640 3 client.4977.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:13:58.798 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.797+0000 7f61017fa640 3 client.4977.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:13:58.798 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.797+0000 7f61017fa640 20 client.4977.objecter dump_active .. 0 homeless 2026-02-17T11:13:58.799 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.797+0000 7f61017fa640 10 client.4977.objecter ms_handle_connect 0x7f60dc079190 2026-02-17T11:13:58.799 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.797+0000 7f6110df3640 1 --2- 10.20.193.49:0/4289349328 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f60dc079190 0x7f60dc07b650 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f60fc009ba0 tx=0x7f60fc009290 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:13:58.899 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.897+0000 7f61017fa640 1 -- 10.20.193.49:0/4289349328 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f6108022030 con 0x7f610c0c7170 2026-02-17T11:13:58.899 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.897+0000 7f61017fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:13:58.899 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.897+0000 7f61017fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:13:58.997 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.996+0000 7f611307e640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:13:58.998 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.996+0000 7f611307e640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:13:58.998 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.996+0000 7f611307e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:13:58.998 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.996+0000 7f611307e640 1 -- 10.20.193.49:0/4289349328 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f610c1f2e80 con 0x7f610c0c7170 2026-02-17T11:13:59.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.999+0000 7f61017fa640 1 -- 10.20.193.49:0/4289349328 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f6108062c70 con 0x7f610c0c7170 2026-02-17T11:13:59.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.999+0000 7f61017fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:13:59.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:58.999+0000 7f61017fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:13:59.001 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:13:59.001 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:13:59.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:59.000+0000 7f611307e640 10 librados: watch_flush enter 2026-02-17T11:13:59.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:59.000+0000 7f611307e640 10 librados: watch_flush exit 2026-02-17T11:13:59.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:59.000+0000 7f611307e640 20 client.4977.objecter shutdown clearing up homeless session... 2026-02-17T11:13:59.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:59.000+0000 7f611307e640 10 client.4977.objecter successfully canceled tick 2026-02-17T11:13:59.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:59.000+0000 7f611307e640 1 -- 10.20.193.49:0/4289349328 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f60dc079190 msgr2=0x7f60dc07b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:59.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:59.000+0000 7f611307e640 1 --2- 10.20.193.49:0/4289349328 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f60dc079190 0x7f60dc07b650 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f60fc009ba0 tx=0x7f60fc009290 comp rx=0 tx=0).stop 2026-02-17T11:13:59.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:59.000+0000 7f611307e640 10 monclient: shutdown 2026-02-17T11:13:59.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:59.000+0000 7f611307e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:13:59.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:59.000+0000 7f611307e640 1 -- 10.20.193.49:0/4289349328 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f610c0c7170 msgr2=0x7f610c1f3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:13:59.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:59.000+0000 7f611307e640 1 --2- 10.20.193.49:0/4289349328 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f610c0c7170 0x7f610c1f3660 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f610800eed0 tx=0x7f610800b480 comp rx=0 tx=0).stop 2026-02-17T11:13:59.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:59.000+0000 7f611307e640 1 -- 10.20.193.49:0/4289349328 shutdown_connections 2026-02-17T11:13:59.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:59.000+0000 7f611307e640 1 --2- 10.20.193.49:0/4289349328 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f60dc079190 0x7f60dc07b650 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:59.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:59.000+0000 7f611307e640 1 --2- 10.20.193.49:0/4289349328 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f610c0c7170 0x7f610c1f3660 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:59.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:59.000+0000 7f611307e640 1 --2- 10.20.193.49:0/4289349328 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f610c0c48c0 0x7f610c1f3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:59.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:59.000+0000 7f611307e640 1 --2- 10.20.193.49:0/4289349328 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f610c074ef0 0x7f610c157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:13:59.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:59.000+0000 7f611307e640 1 -- 10.20.193.49:0/4289349328 >> 10.20.193.49:0/4289349328 conn(0x7f610c0c9f40 msgr2=0x7f610c0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:13:59.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:59.000+0000 7f611307e640 1 -- 10.20.193.49:0/4289349328 shutdown_connections 2026-02-17T11:13:59.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:59.000+0000 7f611307e640 1 -- 10.20.193.49:0/4289349328 wait complete. 2026-02-17T11:13:59.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:13:59.000+0000 7f611307e640 1 librados: shutdown 2026-02-17T11:14:02.011 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:14:02.081 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.079+0000 7fbaddbcc640 10 monclient: get_monmap_and_config 2026-02-17T11:14:02.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.079+0000 7fbaddbcc640 10 monclient: build_initial_monmap 2026-02-17T11:14:02.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.079+0000 7fbaddbcc640 10 monclient: monmap: 2026-02-17T11:14:02.082 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:14:02.082 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:02.082 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:14:02.080259+0000 2026-02-17T11:14:02.082 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:14:02.080259+0000 2026-02-17T11:14:02.082 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:14:02.083 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:02.083 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:14:02.083 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:14:02.083 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:14:02.083 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:14:02.083 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:14:02.083 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:14:02.083 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:02.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.080+0000 7fbaddbcc640 1 Processor -- start 2026-02-17T11:14:02.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.080+0000 7fbaddbcc640 1 -- start start 2026-02-17T11:14:02.084 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.080+0000 7fbaddbcc640 10 monclient: init 2026-02-17T11:14:02.095 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.080+0000 7fbaddbcc640 10 monclient: _reopen_session rank -1 2026-02-17T11:14:02.095 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.080+0000 7fbaddbcc640 10 monclient: _add_conns ranks=[2,4,5,0,1,3] 2026-02-17T11:14:02.095 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.080+0000 7fbaddbcc640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fbad80c7170 addr v1:10.20.193.157:6789/0 2026-02-17T11:14:02.095 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.080+0000 7fbaddbcc640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7fbad80c7550 0x7fbad80749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:02.095 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.080+0000 7fbaddbcc640 10 monclient(hunting): picked mon.noname-b con 0x7fbad80c7550 addr v2:10.20.193.97:3300/0 2026-02-17T11:14:02.095 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.080+0000 7fbaddbcc640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7fbad8074ef0 0x7fbad80c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:02.095 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.080+0000 7fbaddbcc640 10 monclient(hunting): picked mon.noname-c con 0x7fbad8074ef0 addr v2:10.20.193.157:3300/0 2026-02-17T11:14:02.096 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.080+0000 7fbaddbcc640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbad80c4fd0 con 0x7fbad80c7170 2026-02-17T11:14:02.096 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.080+0000 7fbaddbcc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:02.096 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.080+0000 7fbaddbcc640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7fbad80c8530 con 0x7fbad80c7550 2026-02-17T11:14:02.096 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.080+0000 7fbaddbcc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:02.096 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.080+0000 7fbaddbcc640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7fbad815a9a0 con 0x7fbad8074ef0 2026-02-17T11:14:02.096 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.080+0000 7fbaddbcc640 10 monclient(hunting): _renew_subs 2026-02-17T11:14:02.096 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.080+0000 7fbaddbcc640 10 monclient(hunting): authenticate will time out at 1318.743782s 2026-02-17T11:14:02.096 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.081+0000 7fbad6ffd640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7fbad80c7550 0x7fbad80749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:02.096 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.081+0000 7fbad7fff640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7fbad8074ef0 0x7fbad80c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:02.096 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.081+0000 7fbad6ffd640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7fbad80c7550 0x7fbad80749b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:46526/0 (socket says 10.20.193.49:46526) 2026-02-17T11:14:02.096 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.081+0000 7fbad6ffd640 1 -- 10.20.193.49:0/4258444265 learned_addr learned my addr 10.20.193.49:0/4258444265 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:14:02.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.081+0000 7fbad6ffd640 10 monclient(hunting): get_auth_request con 0x7fbad80c7550 auth_method 0 2026-02-17T11:14:02.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.081+0000 7fbad6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:02.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.081+0000 7fbad6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:02.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.081+0000 7fbad6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:02.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.081+0000 7fbad6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:02.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.081+0000 7fbad6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:02.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.081+0000 7fbad6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:02.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.081+0000 7fbad7fff640 10 monclient(hunting): get_auth_request con 0x7fbad8074ef0 auth_method 0 2026-02-17T11:14:02.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.081+0000 7fbad7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:02.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.081+0000 7fbad7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:02.098 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.081+0000 7fbad7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:02.098 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.082+0000 7fbad7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:02.098 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.082+0000 7fbad7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:02.098 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.082+0000 7fbad7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:02.098 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.082+0000 7fbad6ffd640 10 monclient(hunting): handle_auth_done global_id 4942 payload 274 2026-02-17T11:14:02.098 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.082+0000 7fbad6ffd640 1 -- 10.20.193.49:0/4258444265 >> v2:10.20.193.157:3300/0 conn(0x7fbad8074ef0 msgr2=0x7fbad80c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:14:02.098 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.082+0000 7fbad6ffd640 1 --2- 10.20.193.49:0/4258444265 >> v2:10.20.193.157:3300/0 conn(0x7fbad8074ef0 0x7fbad80c89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:02.098 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.082+0000 7fbad6ffd640 1 -- 10.20.193.49:0/4258444265 >> v1:10.20.193.157:6789/0 conn(0x7fbad80c7170 legacy=0x7fbad80c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:02.098 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.082+0000 7fbad6ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:14:02.098 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.082+0000 7fbad6ffd640 1 monclient: found mon.noname-b 2026-02-17T11:14:02.098 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.082+0000 7fbad6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:14:02.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.082+0000 7fbad6ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:14:02.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.082+0000 7fbad6ffd640 1 -- 10.20.193.49:0/4258444265 --> v2:10.20.193.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbad80c5270 con 0x7fbad80c7550 2026-02-17T11:14:02.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.083+0000 7fbad6ffd640 1 --2- 10.20.193.49:0/4258444265 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fbad80c7550 0x7fbad80749b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbad80c84a0 tx=0x7fbac802eed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef2058492c8aa785 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:14:02.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.084+0000 7fbad67fc640 1 -- 10.20.193.49:0/4258444265 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac803c070 con 0x7fbad80c7550 2026-02-17T11:14:02.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.084+0000 7fbad67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:02.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.085+0000 7fbad67fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:14:02.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.085+0000 7fbad67fc640 10 monclient: dump: 2026-02-17T11:14:02.099 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:02.099 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:02.099 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:02.100 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:02.100 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:02.100 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:02.100 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:02.100 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:02.100 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:02.100 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:02.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.085+0000 7fbad67fc640 10 monclient: _finish_auth 0 2026-02-17T11:14:02.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.085+0000 7fbad67fc640 10 monclient: _check_auth_tickets 2026-02-17T11:14:02.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.085+0000 7fbad67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:14:02.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.085+0000 7fbaddbcc640 5 monclient: authenticate success, global_id 4942 2026-02-17T11:14:02.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.085+0000 7fbaddbcc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:14:02.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.085+0000 7fbad67fc640 1 -- 10.20.193.49:0/4258444265 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbac802fbe0 con 0x7fbad80c7550 2026-02-17T11:14:02.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.085+0000 7fbad67fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:14:02.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.085+0000 7fbad67fc640 1 -- 10.20.193.49:0/4258444265 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac8037440 con 0x7fbad80c7550 2026-02-17T11:14:02.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.085+0000 7fbad67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:02.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.085+0000 7fbad67fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:14:02.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.085+0000 7fbad67fc640 10 monclient: dump: 2026-02-17T11:14:02.101 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:02.101 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:02.101 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:02.102 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:02.102 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:02.102 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:02.102 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:02.102 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:02.102 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:02.102 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:02.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.085+0000 7fbaddbcc640 10 monclient: get_monmap_and_config success 2026-02-17T11:14:02.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.085+0000 7fbaddbcc640 4 set_mon_vals no callback set 2026-02-17T11:14:02.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.085+0000 7fbaddbcc640 10 monclient: shutdown 2026-02-17T11:14:02.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.085+0000 7fbaddbcc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:14:02.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.085+0000 7fbaddbcc640 1 -- 10.20.193.49:0/4258444265 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fbad80c7550 msgr2=0x7fbad80749b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:02.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.085+0000 7fbaddbcc640 1 --2- 10.20.193.49:0/4258444265 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fbad80c7550 0x7fbad80749b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbad80c84a0 tx=0x7fbac802eed0 comp rx=0 tx=0).stop 2026-02-17T11:14:02.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.085+0000 7fbaddbcc640 1 -- 10.20.193.49:0/4258444265 shutdown_connections 2026-02-17T11:14:02.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.085+0000 7fbaddbcc640 1 --2- 10.20.193.49:0/4258444265 >> v2:10.20.193.157:3300/0 conn(0x7fbad8074ef0 0x7fbad80c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:02.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.085+0000 7fbaddbcc640 1 --2- 10.20.193.49:0/4258444265 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fbad80c7550 0x7fbad80749b0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:02.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.085+0000 7fbaddbcc640 1 -- 10.20.193.49:0/4258444265 >> 10.20.193.49:0/4258444265 conn(0x7fbad80c9f40 msgr2=0x7fbad80ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:14:02.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.085+0000 7fbaddbcc640 1 -- 10.20.193.49:0/4258444265 shutdown_connections 2026-02-17T11:14:02.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.085+0000 7fbaddbcc640 1 -- 10.20.193.49:0/4258444265 wait complete. 2026-02-17T11:14:02.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.086+0000 7fbaddbcc640 10 monclient: build_initial_monmap 2026-02-17T11:14:02.104 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.086+0000 7fbaddbcc640 10 monclient: monmap: 2026-02-17T11:14:02.104 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:14:02.104 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:14:02.104 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:14:02.104 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:14:02.104 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:14:02.104 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:02.104 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:14:02.104 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:14:02.104 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:14:02.104 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:02.105 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.086+0000 7fbaddbcc640 1 librados: starting msgr at 2026-02-17T11:14:02.105 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.086+0000 7fbaddbcc640 1 librados: starting objecter 2026-02-17T11:14:02.105 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.086+0000 7fbaddbcc640 1 Processor -- start 2026-02-17T11:14:02.105 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.086+0000 7fbaddbcc640 1 -- start start 2026-02-17T11:14:02.105 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.086+0000 7fbaddbcc640 1 librados: setting wanted keys 2026-02-17T11:14:02.105 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.086+0000 7fbaddbcc640 1 librados: calling monclient init 2026-02-17T11:14:02.105 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.086+0000 7fbaddbcc640 10 monclient: init 2026-02-17T11:14:02.105 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.086+0000 7fbaddbcc640 10 monclient: _reopen_session rank -1 2026-02-17T11:14:02.105 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.086+0000 7fbaddbcc640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:14:02.105 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.086+0000 7fbaddbcc640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fbad8074ef0 0x7fbad815d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:02.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.086+0000 7fbaddbcc640 10 monclient(hunting): picked mon.noname-c con 0x7fbad8074ef0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:14:02.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.086+0000 7fbaddbcc640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fbad80c7170 0x7fbad8156bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:02.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.086+0000 7fbaddbcc640 10 monclient(hunting): picked mon.noname-b con 0x7fbad80c7170 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:14:02.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.086+0000 7fbaddbcc640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbad80c7550 0x7fbad806d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:02.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.086+0000 7fbaddbcc640 10 monclient(hunting): picked mon.noname-a con 0x7fbad80c7550 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:14:02.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.086+0000 7fbaddbcc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:02.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.086+0000 7fbaddbcc640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fbad80c7ee0 con 0x7fbad80c7550 2026-02-17T11:14:02.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.086+0000 7fbaddbcc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:02.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.086+0000 7fbaddbcc640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fbad80c5830 con 0x7fbad80c7170 2026-02-17T11:14:02.107 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.086+0000 7fbaddbcc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:02.107 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.086+0000 7fbaddbcc640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fbad80c81c0 con 0x7fbad8074ef0 2026-02-17T11:14:02.107 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.086+0000 7fbaddbcc640 10 monclient(hunting): _renew_subs 2026-02-17T11:14:02.107 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.086+0000 7fbaddbcc640 10 monclient(hunting): authenticate will time out at 1318.749898s 2026-02-17T11:14:02.107 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.087+0000 7fbad6ffd640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fbad80c7170 0x7fbad8156bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:02.107 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.087+0000 7fbad77fe640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fbad8074ef0 0x7fbad815d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:02.107 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.087+0000 7fbad7fff640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbad80c7550 0x7fbad806d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:02.107 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.087+0000 7fbad6ffd640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fbad80c7170 0x7fbad8156bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:46542/0 (socket says 10.20.193.49:46542) 2026-02-17T11:14:02.107 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.087+0000 7fbad6ffd640 1 -- 10.20.193.49:0/4031483614 learned_addr learned my addr 10.20.193.49:0/4031483614 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:14:02.107 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.087+0000 7fbad6ffd640 10 monclient(hunting): get_auth_request con 0x7fbad80c7170 auth_method 0 2026-02-17T11:14:02.107 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.087+0000 7fbad6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:02.107 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.087+0000 7fbad6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:02.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.087+0000 7fbad6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:02.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.087+0000 7fbad77fe640 10 monclient(hunting): get_auth_request con 0x7fbad8074ef0 auth_method 0 2026-02-17T11:14:02.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.087+0000 7fbad77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:02.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.087+0000 7fbad77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:02.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.087+0000 7fbad77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:02.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.087+0000 7fbad7fff640 10 monclient(hunting): get_auth_request con 0x7fbad80c7550 auth_method 0 2026-02-17T11:14:02.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.087+0000 7fbad7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:02.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.087+0000 7fbad7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:02.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.087+0000 7fbad7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:02.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.087+0000 7fbad6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:02.109 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.087+0000 7fbad6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:02.109 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.087+0000 7fbad6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:02.109 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.087+0000 7fbad77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:02.109 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.087+0000 7fbad77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:02.109 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.087+0000 7fbad77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:02.109 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.087+0000 7fbad7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:02.109 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.087+0000 7fbad7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:02.109 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.087+0000 7fbad7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:02.109 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.089+0000 7fbad77fe640 10 monclient(hunting): handle_auth_done global_id 4985 payload 824 2026-02-17T11:14:02.109 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.089+0000 7fbad77fe640 1 -- 10.20.193.49:0/4031483614 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fbad80c7170 msgr2=0x7fbad8156bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:02.109 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.089+0000 7fbad77fe640 1 --2- 10.20.193.49:0/4031483614 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fbad80c7170 0x7fbad8156bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:02.110 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.089+0000 7fbad77fe640 1 -- 10.20.193.49:0/4031483614 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbad80c7550 msgr2=0x7fbad806d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:02.110 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.089+0000 7fbad77fe640 1 --2- 10.20.193.49:0/4031483614 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbad80c7550 0x7fbad806d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:02.110 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.089+0000 7fbad77fe640 10 monclient: _finish_hunting 0 2026-02-17T11:14:02.110 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.089+0000 7fbad77fe640 1 monclient: found mon.noname-c 2026-02-17T11:14:02.110 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.089+0000 7fbad77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:14:02.110 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.089+0000 7fbad77fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:14:02.110 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.089+0000 7fbad77fe640 1 -- 10.20.193.49:0/4031483614 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbad8155ba0 con 0x7fbad8074ef0 2026-02-17T11:14:02.110 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.089+0000 7fbad6ffd640 1 --2- 10.20.193.49:0/4031483614 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fbad80c7170 0x7fbad8156bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:14:02.110 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.090+0000 7fbad77fe640 1 --2- 10.20.193.49:0/4031483614 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fbad8074ef0 0x7fbad815d8c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbac400c480 tx=0x7fbac400c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:14:02.110 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.090+0000 7fbab3fff640 10 client.?.objecter ms_handle_connect 0x7fbad8074ef0 2026-02-17T11:14:02.111 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.090+0000 7fbab3fff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:14:02.111 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.091+0000 7fbab3fff640 1 -- 10.20.193.49:0/4031483614 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac40052d0 con 0x7fbad8074ef0 2026-02-17T11:14:02.111 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.091+0000 7fbab3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:02.111 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.091+0000 7fbab3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:14:02.111 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.091+0000 7fbab3fff640 10 monclient: dump: 2026-02-17T11:14:02.111 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:02.111 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:02.111 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:02.111 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:02.111 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:02.112 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:02.112 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:02.112 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:02.112 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:02.112 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:02.112 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.091+0000 7fbab3fff640 10 monclient: _finish_auth 0 2026-02-17T11:14:02.112 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.091+0000 7fbab3fff640 10 monclient: _check_auth_tickets 2026-02-17T11:14:02.112 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.091+0000 7fbab3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:14:02.112 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.091+0000 7fbab3fff640 1 -- 10.20.193.49:0/4031483614 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbac4005490 con 0x7fbad8074ef0 2026-02-17T11:14:02.112 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.091+0000 7fbaddbcc640 5 monclient: authenticate success, global_id 4985 2026-02-17T11:14:02.112 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.091+0000 7fbaddbcc640 10 monclient: _renew_subs 2026-02-17T11:14:02.113 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.091+0000 7fbaddbcc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:14:02.113 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.092+0000 7fbaddbcc640 1 -- 10.20.193.49:0/4031483614 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbad806f470 con 0x7fbad8074ef0 2026-02-17T11:14:02.113 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.092+0000 7fbab3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:14:02.113 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.092+0000 7fbab3fff640 1 -- 10.20.193.49:0/4031483614 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac4006b10 con 0x7fbad8074ef0 2026-02-17T11:14:02.113 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.092+0000 7fbab3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:02.113 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.092+0000 7fbab3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:14:02.113 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.092+0000 7fbad5ffb640 4 set_mon_vals no callback set 2026-02-17T11:14:02.113 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.092+0000 7fbab3fff640 10 monclient: dump: 2026-02-17T11:14:02.113 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:02.113 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:02.113 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:02.114 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:02.114 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:02.114 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:02.114 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:02.114 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:02.114 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:02.114 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:02.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.092+0000 7fbaddbcc640 10 client.4985.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:14:02.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.092+0000 7fbaddbcc640 10 monclient: _renew_subs 2026-02-17T11:14:02.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.092+0000 7fbaddbcc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:14:02.115 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.092+0000 7fbaddbcc640 1 -- 10.20.193.49:0/4031483614 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbad81560f0 con 0x7fbad8074ef0 2026-02-17T11:14:02.115 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.092+0000 7fbaddbcc640 1 librados: init done 2026-02-17T11:14:02.115 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.092+0000 7fbaddbcc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:14:02.115 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.092+0000 7fbaddbcc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:14:02.115 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.092+0000 7fbaddbcc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:14:02.115 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.092+0000 7fbaddbcc640 1 -- 10.20.193.49:0/4031483614 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbad80749b0 con 0x7fbad8074ef0 2026-02-17T11:14:02.116 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.104+0000 7fbab3fff640 1 -- 10.20.193.49:0/4031483614 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7fbac4006cb0 con 0x7fbad8074ef0 2026-02-17T11:14:02.116 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.105+0000 7fbab3fff640 1 --2- 10.20.193.49:0/4031483614 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fbaa8079190 0x7fbaa807b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:02.117 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.105+0000 7fbad6ffd640 1 --2- 10.20.193.49:0/4031483614 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fbaa8079190 0x7fbaa807b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:02.117 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.105+0000 7fbad6ffd640 10 monclient: get_auth_request con 0x7fbaa8079190 auth_method 0 2026-02-17T11:14:02.117 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.106+0000 7fbab3fff640 10 client.4985.objecter ms_handle_connect 0x7fbaa8079190 2026-02-17T11:14:02.117 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.106+0000 7fbad6ffd640 1 --2- 10.20.193.49:0/4031483614 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fbaa8079190 0x7fbaa807b650 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbac80091b0 tx=0x7fbac8033000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:14:02.205 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.203+0000 7fbab3fff640 1 -- 10.20.193.49:0/4031483614 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7fbac405d4a0 con 0x7fbad8074ef0 2026-02-17T11:14:02.205 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.203+0000 7fbab3fff640 10 client.4985.objecter ms_dispatch2 0x7fbad8000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:14:02.205 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.203+0000 7fbab3fff640 3 client.4985.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:14:02.205 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.203+0000 7fbab3fff640 3 client.4985.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:14:02.205 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.203+0000 7fbab3fff640 20 client.4985.objecter dump_active .. 0 homeless 2026-02-17T11:14:02.211 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.210+0000 7fbab3fff640 1 -- 10.20.193.49:0/4031483614 <== mon.2 v2:10.20.193.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fbac4061460 con 0x7fbad8074ef0 2026-02-17T11:14:02.211 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.210+0000 7fbab3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:14:02.211 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.210+0000 7fbab3fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:14:02.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.309+0000 7fbaddbcc640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:14:02.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.309+0000 7fbaddbcc640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:14:02.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.309+0000 7fbaddbcc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:14:02.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.309+0000 7fbaddbcc640 1 -- 10.20.193.49:0/4031483614 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fbad80ca570 con 0x7fbad8074ef0 2026-02-17T11:14:02.313 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.311+0000 7fbab3fff640 1 -- 10.20.193.49:0/4031483614 <== mon.2 v2:10.20.193.157:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fbac4065760 con 0x7fbad8074ef0 2026-02-17T11:14:02.313 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.311+0000 7fbab3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:14:02.313 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.311+0000 7fbab3fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:14:02.313 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:14:02.313 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:14:02.314 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.312+0000 7fbaddbcc640 10 librados: watch_flush enter 2026-02-17T11:14:02.314 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.312+0000 7fbaddbcc640 10 librados: watch_flush exit 2026-02-17T11:14:02.314 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.312+0000 7fbaddbcc640 20 client.4985.objecter shutdown clearing up homeless session... 2026-02-17T11:14:02.314 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.312+0000 7fbaddbcc640 10 client.4985.objecter successfully canceled tick 2026-02-17T11:14:02.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.312+0000 7fbaddbcc640 1 -- 10.20.193.49:0/4031483614 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fbaa8079190 msgr2=0x7fbaa807b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:02.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.312+0000 7fbaddbcc640 1 --2- 10.20.193.49:0/4031483614 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fbaa8079190 0x7fbaa807b650 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbac80091b0 tx=0x7fbac8033000 comp rx=0 tx=0).stop 2026-02-17T11:14:02.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.312+0000 7fbaddbcc640 10 monclient: shutdown 2026-02-17T11:14:02.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.312+0000 7fbaddbcc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:14:02.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.312+0000 7fbaddbcc640 1 -- 10.20.193.49:0/4031483614 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fbad8074ef0 msgr2=0x7fbad815d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:02.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.312+0000 7fbaddbcc640 1 --2- 10.20.193.49:0/4031483614 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fbad8074ef0 0x7fbad815d8c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbac400c480 tx=0x7fbac400c950 comp rx=0 tx=0).stop 2026-02-17T11:14:02.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.312+0000 7fbaddbcc640 1 -- 10.20.193.49:0/4031483614 shutdown_connections 2026-02-17T11:14:02.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.312+0000 7fbaddbcc640 1 --2- 10.20.193.49:0/4031483614 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fbaa8079190 0x7fbaa807b650 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:02.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.312+0000 7fbaddbcc640 1 --2- 10.20.193.49:0/4031483614 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbad80c7550 0x7fbad806d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:02.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.312+0000 7fbaddbcc640 1 --2- 10.20.193.49:0/4031483614 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fbad80c7170 0x7fbad8156bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:02.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.312+0000 7fbaddbcc640 1 --2- 10.20.193.49:0/4031483614 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fbad8074ef0 0x7fbad815d8c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:02.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.312+0000 7fbaddbcc640 1 -- 10.20.193.49:0/4031483614 >> 10.20.193.49:0/4031483614 conn(0x7fbad80c9f40 msgr2=0x7fbad80cbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:14:02.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.312+0000 7fbaddbcc640 1 -- 10.20.193.49:0/4031483614 shutdown_connections 2026-02-17T11:14:02.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.312+0000 7fbaddbcc640 1 -- 10.20.193.49:0/4031483614 wait complete. 2026-02-17T11:14:02.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:02.312+0000 7fbaddbcc640 1 librados: shutdown 2026-02-17T11:14:05.323 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:14:05.391 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.389+0000 7fcfc0d3e640 10 monclient: get_monmap_and_config 2026-02-17T11:14:05.391 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.389+0000 7fcfc0d3e640 10 monclient: build_initial_monmap 2026-02-17T11:14:05.391 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.389+0000 7fcfc0d3e640 10 monclient: monmap: 2026-02-17T11:14:05.392 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:14:05.392 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:05.392 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:14:05.390168+0000 2026-02-17T11:14:05.392 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:14:05.390168+0000 2026-02-17T11:14:05.392 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:14:05.392 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:05.392 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:14:05.392 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:14:05.392 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:14:05.392 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:14:05.392 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:14:05.393 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:14:05.393 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:05.393 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.390+0000 7fcfc0d3e640 1 Processor -- start 2026-02-17T11:14:05.393 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.390+0000 7fcfc0d3e640 1 -- start start 2026-02-17T11:14:05.393 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.390+0000 7fcfc0d3e640 10 monclient: init 2026-02-17T11:14:05.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.390+0000 7fcfc0d3e640 10 monclient: _reopen_session rank -1 2026-02-17T11:14:05.396 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.390+0000 7fcfc0d3e640 10 monclient: _add_conns ranks=[3,5,1,0,2,4] 2026-02-17T11:14:05.396 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.390+0000 7fcfc0d3e640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fcfbc0c7170 0x7fcfbc0c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:05.396 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.390+0000 7fcfc0d3e640 10 monclient(hunting): picked mon.noname-a con 0x7fcfbc0c7170 addr v2:10.20.193.49:3300/0 2026-02-17T11:14:05.396 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.390+0000 7fcfc0d3e640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7fcfbc0c48c0 0x7fcfbc0749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:05.396 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.390+0000 7fcfc0d3e640 10 monclient(hunting): picked mon.noname-c con 0x7fcfbc0c48c0 addr v2:10.20.193.157:3300/0 2026-02-17T11:14:05.396 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.390+0000 7fcfc0d3e640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fcfbc074ef0 addr v1:10.20.193.97:6789/0 2026-02-17T11:14:05.396 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.390+0000 7fcfc0d3e640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfbc15a9a0 con 0x7fcfbc074ef0 2026-02-17T11:14:05.396 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.390+0000 7fcfc0d3e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:05.396 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.390+0000 7fcfc0d3e640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7fcfbc0c8530 con 0x7fcfbc0c7170 2026-02-17T11:14:05.396 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.390+0000 7fcfc0d3e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:05.397 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.390+0000 7fcfc0d3e640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7fcfbc0c5270 con 0x7fcfbc0c48c0 2026-02-17T11:14:05.397 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.390+0000 7fcfc0d3e640 10 monclient(hunting): _renew_subs 2026-02-17T11:14:05.397 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.390+0000 7fcfc0d3e640 10 monclient(hunting): authenticate will time out at 1322.053624s 2026-02-17T11:14:05.397 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.390+0000 7fcfbad76640 1 --1- >> v1:10.20.193.97:6789/0 conn(0x7fcfbc074ef0 0x7fcfbc0c89c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.97:6789/0 says I am v1:10.20.193.49:36420/0 (socket says 10.20.193.49:36420) 2026-02-17T11:14:05.397 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.390+0000 7fcfbad76640 1 -- 10.20.193.49:0/2564355425 learned_addr learned my addr 10.20.193.49:0/2564355425 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:14:05.397 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.391+0000 7fcfba575640 1 --2- 10.20.193.49:0/2564355425 >> v2:10.20.193.49:3300/0 conn(0x7fcfbc0c7170 0x7fcfbc0c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:05.397 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.391+0000 7fcfb9d74640 1 --2- 10.20.193.49:0/2564355425 >> v2:10.20.193.157:3300/0 conn(0x7fcfbc0c48c0 0x7fcfbc0749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:05.397 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.391+0000 7fcfba575640 10 monclient(hunting): get_auth_request con 0x7fcfbc0c7170 auth_method 0 2026-02-17T11:14:05.397 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.391+0000 7fcfba575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:05.397 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.391+0000 7fcfba575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:05.397 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.391+0000 7fcfba575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:05.397 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.391+0000 7fcfb9d74640 10 monclient(hunting): get_auth_request con 0x7fcfbc0c48c0 auth_method 0 2026-02-17T11:14:05.398 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.391+0000 7fcfb9d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:05.398 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.391+0000 7fcfb9d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:05.398 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.391+0000 7fcfb9d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:05.398 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.391+0000 7fcfba575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:05.398 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.391+0000 7fcfba575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:05.398 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.391+0000 7fcfba575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:05.398 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.391+0000 7fcfb9d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:05.398 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.391+0000 7fcfb9d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:05.398 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.391+0000 7fcfb9d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:05.398 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.392+0000 7fcfba575640 10 monclient(hunting): handle_auth_done global_id 4983 payload 274 2026-02-17T11:14:05.398 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.392+0000 7fcfba575640 1 -- 10.20.193.49:0/2564355425 >> v2:10.20.193.157:3300/0 conn(0x7fcfbc0c48c0 msgr2=0x7fcfbc0749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:14:05.398 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.392+0000 7fcfba575640 1 --2- 10.20.193.49:0/2564355425 >> v2:10.20.193.157:3300/0 conn(0x7fcfbc0c48c0 0x7fcfbc0749b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:05.398 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.392+0000 7fcfba575640 1 -- 10.20.193.49:0/2564355425 >> v1:10.20.193.97:6789/0 conn(0x7fcfbc074ef0 legacy=0x7fcfbc0c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:05.399 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.392+0000 7fcfba575640 10 monclient: _finish_hunting 0 2026-02-17T11:14:05.399 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.392+0000 7fcfba575640 1 monclient: found mon.noname-a 2026-02-17T11:14:05.399 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.392+0000 7fcfba575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:14:05.399 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.392+0000 7fcfba575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:14:05.399 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.392+0000 7fcfba575640 1 -- 10.20.193.49:0/2564355425 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfbc0c5550 con 0x7fcfbc0c7170 2026-02-17T11:14:05.399 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.393+0000 7fcfba575640 1 --2- 10.20.193.49:0/2564355425 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fcfbc0c7170 0x7fcfbc0c7550 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc0c7a90 tx=0x7fcfb002ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6705f44dd3e2e7 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:14:05.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.395+0000 7fcfb9573640 1 -- 10.20.193.49:0/2564355425 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb003c070 con 0x7fcfbc0c7170 2026-02-17T11:14:05.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.395+0000 7fcfb9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:05.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.395+0000 7fcfb9573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:14:05.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.395+0000 7fcfb9573640 10 monclient: dump: 2026-02-17T11:14:05.406 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:05.407 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:05.407 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:05.407 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:05.407 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:05.407 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:05.407 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:05.407 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:05.407 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:05.407 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:05.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.395+0000 7fcfb9573640 10 monclient: _finish_auth 0 2026-02-17T11:14:05.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.395+0000 7fcfb9573640 10 monclient: _check_auth_tickets 2026-02-17T11:14:05.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.395+0000 7fcfb9573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:14:05.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.395+0000 7fcfc0d3e640 5 monclient: authenticate success, global_id 4983 2026-02-17T11:14:05.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.395+0000 7fcfc0d3e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:14:05.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.395+0000 7fcfb9573640 1 -- 10.20.193.49:0/2564355425 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfb002faf0 con 0x7fcfbc0c7170 2026-02-17T11:14:05.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.395+0000 7fcfb9573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:14:05.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.395+0000 7fcfb9573640 1 -- 10.20.193.49:0/2564355425 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb0037440 con 0x7fcfbc0c7170 2026-02-17T11:14:05.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.395+0000 7fcfb9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:05.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.395+0000 7fcfb9573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:14:05.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.395+0000 7fcfb9573640 10 monclient: dump: 2026-02-17T11:14:05.408 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:05.408 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:05.408 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:05.409 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:05.409 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:05.409 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:05.409 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:05.409 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:05.409 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:05.409 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:05.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.395+0000 7fcfc0d3e640 10 monclient: get_monmap_and_config success 2026-02-17T11:14:05.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.395+0000 7fcfc0d3e640 4 set_mon_vals no callback set 2026-02-17T11:14:05.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.395+0000 7fcfc0d3e640 10 monclient: shutdown 2026-02-17T11:14:05.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.395+0000 7fcfc0d3e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:14:05.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.395+0000 7fcfc0d3e640 1 -- 10.20.193.49:0/2564355425 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fcfbc0c7170 msgr2=0x7fcfbc0c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:05.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.395+0000 7fcfc0d3e640 1 --2- 10.20.193.49:0/2564355425 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fcfbc0c7170 0x7fcfbc0c7550 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc0c7a90 tx=0x7fcfb002ede0 comp rx=0 tx=0).stop 2026-02-17T11:14:05.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.395+0000 7fcfc0d3e640 1 -- 10.20.193.49:0/2564355425 shutdown_connections 2026-02-17T11:14:05.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.395+0000 7fcfc0d3e640 1 --2- 10.20.193.49:0/2564355425 >> v2:10.20.193.157:3300/0 conn(0x7fcfbc0c48c0 0x7fcfbc0749b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:05.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.395+0000 7fcfc0d3e640 1 --2- 10.20.193.49:0/2564355425 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fcfbc0c7170 0x7fcfbc0c7550 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:05.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.395+0000 7fcfc0d3e640 1 -- 10.20.193.49:0/2564355425 >> 10.20.193.49:0/2564355425 conn(0x7fcfbc0c9f40 msgr2=0x7fcfbc0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:14:05.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.395+0000 7fcfc0d3e640 1 -- 10.20.193.49:0/2564355425 shutdown_connections 2026-02-17T11:14:05.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.395+0000 7fcfc0d3e640 1 -- 10.20.193.49:0/2564355425 wait complete. 2026-02-17T11:14:05.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.396+0000 7fcfc0d3e640 10 monclient: build_initial_monmap 2026-02-17T11:14:05.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.396+0000 7fcfc0d3e640 10 monclient: monmap: 2026-02-17T11:14:05.410 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:14:05.410 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:14:05.410 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:14:05.410 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:14:05.411 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:14:05.411 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:05.411 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:14:05.411 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:14:05.411 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:14:05.411 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:05.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.396+0000 7fcfc0d3e640 1 librados: starting msgr at 2026-02-17T11:14:05.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.396+0000 7fcfc0d3e640 1 librados: starting objecter 2026-02-17T11:14:05.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.396+0000 7fcfc0d3e640 1 Processor -- start 2026-02-17T11:14:05.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.396+0000 7fcfc0d3e640 1 -- start start 2026-02-17T11:14:05.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.396+0000 7fcfc0d3e640 1 librados: setting wanted keys 2026-02-17T11:14:05.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.396+0000 7fcfc0d3e640 1 librados: calling monclient init 2026-02-17T11:14:05.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.396+0000 7fcfc0d3e640 10 monclient: init 2026-02-17T11:14:05.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.397+0000 7fcfc0d3e640 10 monclient: _reopen_session rank -1 2026-02-17T11:14:05.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.397+0000 7fcfc0d3e640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:14:05.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.397+0000 7fcfc0d3e640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fcfbc074ef0 0x7fcfbc1f5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:05.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.397+0000 7fcfc0d3e640 10 monclient(hunting): picked mon.noname-c con 0x7fcfbc074ef0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:14:05.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.397+0000 7fcfc0d3e640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fcfbc0c48c0 0x7fcfbc153020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:05.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.397+0000 7fcfc0d3e640 10 monclient(hunting): picked mon.noname-a con 0x7fcfbc0c48c0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:14:05.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.397+0000 7fcfc0d3e640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fcfbc0c7170 0x7fcfbc158100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:05.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.397+0000 7fcfc0d3e640 10 monclient(hunting): picked mon.noname-b con 0x7fcfbc0c7170 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:14:05.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.397+0000 7fcfc0d3e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:05.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.397+0000 7fcfc0d3e640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fcfbc0c81c0 con 0x7fcfbc0c48c0 2026-02-17T11:14:05.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.397+0000 7fcfc0d3e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:05.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.397+0000 7fcfc0d3e640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fcfbc0c7ee0 con 0x7fcfbc0c7170 2026-02-17T11:14:05.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.397+0000 7fcfc0d3e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:05.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.397+0000 7fcfc0d3e640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fcfbc0c90d0 con 0x7fcfbc074ef0 2026-02-17T11:14:05.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.397+0000 7fcfc0d3e640 10 monclient(hunting): _renew_subs 2026-02-17T11:14:05.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.397+0000 7fcfc0d3e640 10 monclient(hunting): authenticate will time out at 1322.060209s 2026-02-17T11:14:05.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.397+0000 7fcfb9d74640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fcfbc0c48c0 0x7fcfbc153020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:05.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.397+0000 7fcfba575640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fcfbc074ef0 0x7fcfbc1f5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:05.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.397+0000 7fcfbad76640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fcfbc0c7170 0x7fcfbc158100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:05.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.397+0000 7fcfba575640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fcfbc074ef0 0x7fcfbc1f5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:46052/0 (socket says 10.20.193.49:46052) 2026-02-17T11:14:05.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.397+0000 7fcfba575640 1 -- 10.20.193.49:0/4000526676 learned_addr learned my addr 10.20.193.49:0/4000526676 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:14:05.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.397+0000 7fcfba575640 10 monclient(hunting): get_auth_request con 0x7fcfbc074ef0 auth_method 0 2026-02-17T11:14:05.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.397+0000 7fcfba575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:05.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.397+0000 7fcfba575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:05.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.397+0000 7fcfba575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:05.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.397+0000 7fcfb9d74640 10 monclient(hunting): get_auth_request con 0x7fcfbc0c48c0 auth_method 0 2026-02-17T11:14:05.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.397+0000 7fcfb9d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:05.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.397+0000 7fcfb9d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:05.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.397+0000 7fcfb9d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:05.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.397+0000 7fcfbad76640 10 monclient(hunting): get_auth_request con 0x7fcfbc0c7170 auth_method 0 2026-02-17T11:14:05.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.397+0000 7fcfbad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:05.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.397+0000 7fcfbad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:05.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.397+0000 7fcfbad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:05.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.397+0000 7fcfba575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:05.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.397+0000 7fcfba575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:05.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.397+0000 7fcfba575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:05.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.397+0000 7fcfb9d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:05.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.397+0000 7fcfb9d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:05.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.398+0000 7fcfb9d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:05.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.398+0000 7fcfbad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:05.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.398+0000 7fcfbad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:05.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.398+0000 7fcfbad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:05.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.399+0000 7fcfba575640 10 monclient(hunting): handle_auth_done global_id 4991 payload 824 2026-02-17T11:14:05.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.399+0000 7fcfba575640 1 -- 10.20.193.49:0/4000526676 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fcfbc0c7170 msgr2=0x7fcfbc158100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:05.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.399+0000 7fcfba575640 1 --2- 10.20.193.49:0/4000526676 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fcfbc0c7170 0x7fcfbc158100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:05.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.399+0000 7fcfba575640 1 -- 10.20.193.49:0/4000526676 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fcfbc0c48c0 msgr2=0x7fcfbc153020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:05.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.399+0000 7fcfba575640 1 --2- 10.20.193.49:0/4000526676 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fcfbc0c48c0 0x7fcfbc153020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:05.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.399+0000 7fcfba575640 10 monclient: _finish_hunting 0 2026-02-17T11:14:05.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.399+0000 7fcfba575640 1 monclient: found mon.noname-c 2026-02-17T11:14:05.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.399+0000 7fcfba575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:14:05.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.399+0000 7fcfba575640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:14:05.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.399+0000 7fcfba575640 1 -- 10.20.193.49:0/4000526676 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfbc1f6460 con 0x7fcfbc074ef0 2026-02-17T11:14:05.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.400+0000 7fcfba575640 1 --2- 10.20.193.49:0/4000526676 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fcfbc074ef0 0x7fcfbc1f5f20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0009130 tx=0x7fcfb00047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:14:05.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.400+0000 7fcfa2ffd640 10 client.?.objecter ms_handle_connect 0x7fcfbc074ef0 2026-02-17T11:14:05.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.400+0000 7fcfa2ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:14:05.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.401+0000 7fcfa2ffd640 1 -- 10.20.193.49:0/4000526676 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb003c040 con 0x7fcfbc074ef0 2026-02-17T11:14:05.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.401+0000 7fcfa2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:05.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.401+0000 7fcfa2ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:14:05.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.401+0000 7fcfa2ffd640 10 monclient: dump: 2026-02-17T11:14:05.417 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:05.417 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:05.417 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:05.417 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:05.417 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:05.417 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:05.417 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:05.418 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:05.418 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:05.418 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:05.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.401+0000 7fcfa2ffd640 10 monclient: _finish_auth 0 2026-02-17T11:14:05.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.401+0000 7fcfa2ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:14:05.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.401+0000 7fcfa2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:14:05.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.401+0000 7fcfc0d3e640 5 monclient: authenticate success, global_id 4991 2026-02-17T11:14:05.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.401+0000 7fcfc0d3e640 10 monclient: _renew_subs 2026-02-17T11:14:05.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.401+0000 7fcfc0d3e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:14:05.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.401+0000 7fcfc0d3e640 1 -- 10.20.193.49:0/4000526676 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfbc1f4ba0 con 0x7fcfbc074ef0 2026-02-17T11:14:05.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.401+0000 7fcfc0d3e640 10 client.4991.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:14:05.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.401+0000 7fcfc0d3e640 10 monclient: _renew_subs 2026-02-17T11:14:05.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.401+0000 7fcfc0d3e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:14:05.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.401+0000 7fcfc0d3e640 1 -- 10.20.193.49:0/4000526676 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfbc1f5160 con 0x7fcfbc074ef0 2026-02-17T11:14:05.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.401+0000 7fcfc0d3e640 1 librados: init done 2026-02-17T11:14:05.420 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.402+0000 7fcfa2ffd640 1 -- 10.20.193.49:0/4000526676 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfb002fa70 con 0x7fcfbc074ef0 2026-02-17T11:14:05.420 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.402+0000 7fcfa2ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:14:05.420 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.402+0000 7fcfb8d72640 4 set_mon_vals no callback set 2026-02-17T11:14:05.420 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.402+0000 7fcfa2ffd640 1 -- 10.20.193.49:0/4000526676 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb0042810 con 0x7fcfbc074ef0 2026-02-17T11:14:05.420 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.402+0000 7fcfa2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:05.420 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.402+0000 7fcfa2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:14:05.420 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.402+0000 7fcfa2ffd640 10 monclient: dump: 2026-02-17T11:14:05.420 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:05.420 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:05.420 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:05.420 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:05.420 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:05.420 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:05.421 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:05.421 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:05.421 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:05.421 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:05.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.402+0000 7fcfc0d3e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:14:05.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.402+0000 7fcfc0d3e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:14:05.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.402+0000 7fcfc0d3e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:14:05.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.402+0000 7fcfc0d3e640 1 -- 10.20.193.49:0/4000526676 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfbc0c4d10 con 0x7fcfbc074ef0 2026-02-17T11:14:05.511 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.510+0000 7fcfa2ffd640 1 -- 10.20.193.49:0/4000526676 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7fcfb00429b0 con 0x7fcfbc074ef0 2026-02-17T11:14:05.512 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.510+0000 7fcfa2ffd640 1 --2- 10.20.193.49:0/4000526676 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fcf88079170 0x7fcf8807b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:05.512 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.511+0000 7fcfb9d74640 1 --2- 10.20.193.49:0/4000526676 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fcf88079170 0x7fcf8807b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:05.512 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.511+0000 7fcfb9d74640 10 monclient: get_auth_request con 0x7fcf88079170 auth_method 0 2026-02-17T11:14:05.513 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.511+0000 7fcfb9d74640 1 --2- 10.20.193.49:0/4000526676 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fcf88079170 0x7fcf8807b630 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc073c60 tx=0x7fcfa4009290 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:14:05.513 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.511+0000 7fcfa2ffd640 10 client.4991.objecter ms_handle_connect 0x7fcf88079170 2026-02-17T11:14:05.513 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.512+0000 7fcfa2ffd640 1 -- 10.20.193.49:0/4000526676 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7fcfb00bc530 con 0x7fcfbc074ef0 2026-02-17T11:14:05.514 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.512+0000 7fcfa2ffd640 10 client.4991.objecter ms_dispatch2 0x7fcfbc000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:14:05.514 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.512+0000 7fcfa2ffd640 3 client.4991.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:14:05.514 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.512+0000 7fcfa2ffd640 3 client.4991.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:14:05.514 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.512+0000 7fcfa2ffd640 20 client.4991.objecter dump_active .. 0 homeless 2026-02-17T11:14:05.520 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.518+0000 7fcfa2ffd640 1 -- 10.20.193.49:0/4000526676 <== mon.2 v2:10.20.193.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fcfb0051080 con 0x7fcfbc074ef0 2026-02-17T11:14:05.520 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.518+0000 7fcfa2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:14:05.520 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.518+0000 7fcfa2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:14:05.622 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.620+0000 7fcfc0d3e640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:14:05.622 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.620+0000 7fcfc0d3e640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:14:05.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.620+0000 7fcfc0d3e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:14:05.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.620+0000 7fcfc0d3e640 1 -- 10.20.193.49:0/4000526676 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fcfbc1f5b40 con 0x7fcfbc074ef0 2026-02-17T11:14:05.625 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.624+0000 7fcfa2ffd640 1 -- 10.20.193.49:0/4000526676 <== mon.2 v2:10.20.193.157:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fcfb0086c70 con 0x7fcfbc074ef0 2026-02-17T11:14:05.625 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.624+0000 7fcfa2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:14:05.625 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.624+0000 7fcfa2ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:14:05.625 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:14:05.626 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:14:05.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.625+0000 7fcfc0d3e640 10 librados: watch_flush enter 2026-02-17T11:14:05.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.625+0000 7fcfc0d3e640 10 librados: watch_flush exit 2026-02-17T11:14:05.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.625+0000 7fcfc0d3e640 20 client.4991.objecter shutdown clearing up homeless session... 2026-02-17T11:14:05.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.625+0000 7fcfc0d3e640 10 client.4991.objecter successfully canceled tick 2026-02-17T11:14:05.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.625+0000 7fcfc0d3e640 1 -- 10.20.193.49:0/4000526676 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fcf88079170 msgr2=0x7fcf8807b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:05.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.625+0000 7fcfc0d3e640 1 --2- 10.20.193.49:0/4000526676 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fcf88079170 0x7fcf8807b630 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc073c60 tx=0x7fcfa4009290 comp rx=0 tx=0).stop 2026-02-17T11:14:05.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.625+0000 7fcfc0d3e640 10 monclient: shutdown 2026-02-17T11:14:05.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.625+0000 7fcfc0d3e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:14:05.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.625+0000 7fcfc0d3e640 1 -- 10.20.193.49:0/4000526676 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fcfbc074ef0 msgr2=0x7fcfbc1f5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:05.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.625+0000 7fcfc0d3e640 1 --2- 10.20.193.49:0/4000526676 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fcfbc074ef0 0x7fcfbc1f5f20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0009130 tx=0x7fcfb00047c0 comp rx=0 tx=0).stop 2026-02-17T11:14:05.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.625+0000 7fcfc0d3e640 1 -- 10.20.193.49:0/4000526676 shutdown_connections 2026-02-17T11:14:05.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.625+0000 7fcfc0d3e640 1 --2- 10.20.193.49:0/4000526676 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fcf88079170 0x7fcf8807b630 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:05.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.625+0000 7fcfc0d3e640 1 --2- 10.20.193.49:0/4000526676 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fcfbc0c7170 0x7fcfbc158100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:05.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.625+0000 7fcfc0d3e640 1 --2- 10.20.193.49:0/4000526676 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fcfbc0c48c0 0x7fcfbc153020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:05.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.625+0000 7fcfc0d3e640 1 --2- 10.20.193.49:0/4000526676 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fcfbc074ef0 0x7fcfbc1f5f20 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:05.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.625+0000 7fcfc0d3e640 1 -- 10.20.193.49:0/4000526676 >> 10.20.193.49:0/4000526676 conn(0x7fcfbc0c9f40 msgr2=0x7fcfbc073070 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:14:05.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.625+0000 7fcfc0d3e640 1 -- 10.20.193.49:0/4000526676 shutdown_connections 2026-02-17T11:14:05.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.625+0000 7fcfc0d3e640 1 -- 10.20.193.49:0/4000526676 wait complete. 2026-02-17T11:14:05.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:05.625+0000 7fcfc0d3e640 1 librados: shutdown 2026-02-17T11:14:08.636 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:14:08.704 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.701+0000 7ffa6ff2c640 10 monclient: get_monmap_and_config 2026-02-17T11:14:08.704 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.701+0000 7ffa6ff2c640 10 monclient: build_initial_monmap 2026-02-17T11:14:08.704 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.701+0000 7ffa6ff2c640 10 monclient: monmap: 2026-02-17T11:14:08.704 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:14:08.705 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:08.705 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:14:08.703333+0000 2026-02-17T11:14:08.705 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:14:08.703333+0000 2026-02-17T11:14:08.705 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:14:08.705 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:08.705 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:14:08.705 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:14:08.705 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:14:08.705 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:14:08.705 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:14:08.705 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:14:08.705 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:08.708 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.702+0000 7ffa6ff2c640 1 Processor -- start 2026-02-17T11:14:08.708 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.702+0000 7ffa6ff2c640 1 -- start start 2026-02-17T11:14:08.708 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.702+0000 7ffa6ff2c640 10 monclient: init 2026-02-17T11:14:08.709 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.702+0000 7ffa6ff2c640 10 monclient: _reopen_session rank -1 2026-02-17T11:14:08.709 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.702+0000 7ffa6ff2c640 10 monclient: _add_conns ranks=[1,3,5,4,2,0] 2026-02-17T11:14:08.709 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.702+0000 7ffa6ff2c640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7ffa68152700 addr v1:10.20.193.97:6789/0 2026-02-17T11:14:08.709 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.702+0000 7ffa6ff2c640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7ffa6815ef80 0x7ffa680c9730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:08.709 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.702+0000 7ffa6ff2c640 10 monclient(hunting): picked mon.noname-a con 0x7ffa6815ef80 addr v2:10.20.193.49:3300/0 2026-02-17T11:14:08.709 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.702+0000 7ffa6ff2c640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7ffa68152ae0 0x7ffa680c9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:08.709 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.702+0000 7ffa6ff2c640 10 monclient(hunting): picked mon.noname-c con 0x7ffa68152ae0 addr v2:10.20.193.157:3300/0 2026-02-17T11:14:08.709 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.702+0000 7ffa6ff2c640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa6815d4f0 con 0x7ffa68152700 2026-02-17T11:14:08.709 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.702+0000 7ffa6ff2c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:08.709 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.702+0000 7ffa6ff2c640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7ffa6815d7d0 con 0x7ffa6815ef80 2026-02-17T11:14:08.710 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.702+0000 7ffa6ff2c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:08.710 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.702+0000 7ffa6ff2c640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7ffa6815dab0 con 0x7ffa68152ae0 2026-02-17T11:14:08.710 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.702+0000 7ffa6ff2c640 10 monclient(hunting): _renew_subs 2026-02-17T11:14:08.710 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.702+0000 7ffa6ff2c640 10 monclient(hunting): authenticate will time out at 1325.366905s 2026-02-17T11:14:08.710 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.703+0000 7ffa6e4a2640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7ffa68152ae0 0x7ffa680c9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:08.710 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.703+0000 7ffa6d4a0640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7ffa6815ef80 0x7ffa680c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:08.710 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.703+0000 7ffa6dca1640 1 --1- >> v1:10.20.193.97:6789/0 conn(0x7ffa68152700 0x7ffa6815e870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.97:6789/0 says I am v1:10.20.193.49:42688/0 (socket says 10.20.193.49:42688) 2026-02-17T11:14:08.710 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.703+0000 7ffa6dca1640 1 -- 10.20.193.49:0/2597186191 learned_addr learned my addr 10.20.193.49:0/2597186191 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:14:08.710 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.703+0000 7ffa6e4a2640 10 monclient(hunting): get_auth_request con 0x7ffa68152ae0 auth_method 0 2026-02-17T11:14:08.710 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.703+0000 7ffa6e4a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:08.711 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.703+0000 7ffa6e4a2640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:08.711 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.703+0000 7ffa6e4a2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:08.711 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.703+0000 7ffa6d4a0640 10 monclient(hunting): get_auth_request con 0x7ffa6815ef80 auth_method 0 2026-02-17T11:14:08.711 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.703+0000 7ffa6d4a0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:08.711 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.703+0000 7ffa6d4a0640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:08.711 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.703+0000 7ffa6d4a0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:08.711 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.703+0000 7ffa6e4a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:08.711 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.703+0000 7ffa6e4a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:08.711 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.703+0000 7ffa6e4a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:08.711 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.703+0000 7ffa6d4a0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:08.711 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.703+0000 7ffa6d4a0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:08.712 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.703+0000 7ffa6d4a0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:08.712 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.704+0000 7ffa6e4a2640 10 monclient(hunting): handle_auth_done global_id 4994 payload 274 2026-02-17T11:14:08.712 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.704+0000 7ffa6e4a2640 1 -- 10.20.193.49:0/2597186191 >> v2:10.20.193.49:3300/0 conn(0x7ffa6815ef80 msgr2=0x7ffa680c9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:14:08.712 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.704+0000 7ffa6e4a2640 1 --2- 10.20.193.49:0/2597186191 >> v2:10.20.193.49:3300/0 conn(0x7ffa6815ef80 0x7ffa680c9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:08.712 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.704+0000 7ffa6e4a2640 1 -- 10.20.193.49:0/2597186191 >> v1:10.20.193.97:6789/0 conn(0x7ffa68152700 legacy=0x7ffa6815e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:08.712 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.704+0000 7ffa6e4a2640 10 monclient: _finish_hunting 0 2026-02-17T11:14:08.712 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.704+0000 7ffa6e4a2640 1 monclient: found mon.noname-c 2026-02-17T11:14:08.712 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.704+0000 7ffa6e4a2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:14:08.712 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.704+0000 7ffa6e4a2640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:14:08.712 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.704+0000 7ffa6e4a2640 1 -- 10.20.193.49:0/2597186191 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa6815dd90 con 0x7ffa68152ae0 2026-02-17T11:14:08.713 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.705+0000 7ffa6e4a2640 1 --2- 10.20.193.49:0/2597186191 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ffa68152ae0 0x7ffa680c9c70 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ffa680cbf60 tx=0x7ffa6402f1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b26b35a06f716619 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:14:08.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.707+0000 7ffa6cc9f640 1 -- 10.20.193.49:0/2597186191 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa6403c070 con 0x7ffa68152ae0 2026-02-17T11:14:08.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.707+0000 7ffa6cc9f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:08.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.707+0000 7ffa6cc9f640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:14:08.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.707+0000 7ffa6cc9f640 10 monclient: dump: 2026-02-17T11:14:08.720 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:08.720 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:08.721 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:08.721 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:08.721 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:08.721 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:08.721 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:08.721 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:08.721 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:08.721 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:08.721 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.707+0000 7ffa6cc9f640 10 monclient: _finish_auth 0 2026-02-17T11:14:08.721 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.707+0000 7ffa6cc9f640 10 monclient: _check_auth_tickets 2026-02-17T11:14:08.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.707+0000 7ffa6cc9f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:14:08.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.707+0000 7ffa6cc9f640 1 -- 10.20.193.49:0/2597186191 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa64037440 con 0x7ffa68152ae0 2026-02-17T11:14:08.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.707+0000 7ffa6ff2c640 5 monclient: authenticate success, global_id 4994 2026-02-17T11:14:08.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.707+0000 7ffa6ff2c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:14:08.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.707+0000 7ffa6cc9f640 10 monclient: handle_config config(0 keys) 2026-02-17T11:14:08.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.707+0000 7ffa6cc9f640 1 -- 10.20.193.49:0/2597186191 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa64037810 con 0x7ffa68152ae0 2026-02-17T11:14:08.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.707+0000 7ffa6ff2c640 10 monclient: get_monmap_and_config success 2026-02-17T11:14:08.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.707+0000 7ffa6ff2c640 4 set_mon_vals no callback set 2026-02-17T11:14:08.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.707+0000 7ffa6cc9f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:08.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.707+0000 7ffa6cc9f640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:14:08.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.707+0000 7ffa6cc9f640 10 monclient: dump: 2026-02-17T11:14:08.723 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:08.723 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:08.723 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:08.723 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:08.723 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:08.723 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:08.723 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:08.723 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:08.723 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:08.723 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:08.723 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.707+0000 7ffa6ff2c640 10 monclient: shutdown 2026-02-17T11:14:08.723 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.707+0000 7ffa6ff2c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:14:08.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.707+0000 7ffa6ff2c640 1 -- 10.20.193.49:0/2597186191 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ffa68152ae0 msgr2=0x7ffa680c9c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:08.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.707+0000 7ffa6ff2c640 1 --2- 10.20.193.49:0/2597186191 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ffa68152ae0 0x7ffa680c9c70 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ffa680cbf60 tx=0x7ffa6402f1c0 comp rx=0 tx=0).stop 2026-02-17T11:14:08.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.707+0000 7ffa6ff2c640 1 -- 10.20.193.49:0/2597186191 shutdown_connections 2026-02-17T11:14:08.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.707+0000 7ffa6ff2c640 1 --2- 10.20.193.49:0/2597186191 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ffa68152ae0 0x7ffa680c9c70 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:08.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.707+0000 7ffa6ff2c640 1 --2- 10.20.193.49:0/2597186191 >> v2:10.20.193.49:3300/0 conn(0x7ffa6815ef80 0x7ffa680c9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:08.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.707+0000 7ffa6ff2c640 1 -- 10.20.193.49:0/2597186191 >> 10.20.193.49:0/2597186191 conn(0x7ffa68073030 msgr2=0x7ffa68073440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:14:08.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.707+0000 7ffa6ff2c640 1 -- 10.20.193.49:0/2597186191 shutdown_connections 2026-02-17T11:14:08.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.707+0000 7ffa6ff2c640 1 -- 10.20.193.49:0/2597186191 wait complete. 2026-02-17T11:14:08.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.708+0000 7ffa6ff2c640 10 monclient: build_initial_monmap 2026-02-17T11:14:08.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.708+0000 7ffa6ff2c640 10 monclient: monmap: 2026-02-17T11:14:08.725 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:14:08.725 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:14:08.725 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:14:08.725 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:14:08.725 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:14:08.725 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:08.725 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:14:08.725 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:14:08.725 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:14:08.725 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:08.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.708+0000 7ffa6ff2c640 1 librados: starting msgr at 2026-02-17T11:14:08.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.708+0000 7ffa6ff2c640 1 librados: starting objecter 2026-02-17T11:14:08.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.708+0000 7ffa6ff2c640 1 Processor -- start 2026-02-17T11:14:08.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.708+0000 7ffa6ff2c640 1 -- start start 2026-02-17T11:14:08.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.708+0000 7ffa6ff2c640 1 librados: setting wanted keys 2026-02-17T11:14:08.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.708+0000 7ffa6ff2c640 1 librados: calling monclient init 2026-02-17T11:14:08.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.708+0000 7ffa6ff2c640 10 monclient: init 2026-02-17T11:14:08.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.709+0000 7ffa6ff2c640 10 monclient: _reopen_session rank -1 2026-02-17T11:14:08.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.709+0000 7ffa6ff2c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:14:08.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.709+0000 7ffa6ff2c640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ffa68152700 0x7ffa681f8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:08.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.709+0000 7ffa6ff2c640 10 monclient(hunting): picked mon.noname-a con 0x7ffa68152700 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:14:08.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.709+0000 7ffa6ff2c640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ffa68152ae0 0x7ffa68155690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:08.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.709+0000 7ffa6ff2c640 10 monclient(hunting): picked mon.noname-c con 0x7ffa68152ae0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:14:08.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.709+0000 7ffa6ff2c640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7ffa6815ef80 0x7ffa68152ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:08.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.709+0000 7ffa6ff2c640 10 monclient(hunting): picked mon.noname-b con 0x7ffa6815ef80 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:14:08.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.709+0000 7ffa6ff2c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:08.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.709+0000 7ffa6ff2c640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7ffa680ca1b0 con 0x7ffa68152700 2026-02-17T11:14:08.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.709+0000 7ffa6ff2c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:08.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.709+0000 7ffa6ff2c640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7ffa6815e350 con 0x7ffa6815ef80 2026-02-17T11:14:08.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.709+0000 7ffa6ff2c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:08.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.709+0000 7ffa6ff2c640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7ffa680ca330 con 0x7ffa68152ae0 2026-02-17T11:14:08.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.709+0000 7ffa6ff2c640 10 monclient(hunting): _renew_subs 2026-02-17T11:14:08.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.709+0000 7ffa6ff2c640 10 monclient(hunting): authenticate will time out at 1325.373111s 2026-02-17T11:14:08.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.709+0000 7ffa6e4a2640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7ffa6815ef80 0x7ffa68152ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:08.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.709+0000 7ffa6dca1640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ffa68152700 0x7ffa681f8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:08.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.709+0000 7ffa6d4a0640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ffa68152ae0 0x7ffa68155690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:08.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.709+0000 7ffa6e4a2640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7ffa6815ef80 0x7ffa68152ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:49076/0 (socket says 10.20.193.49:49076) 2026-02-17T11:14:08.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.709+0000 7ffa6e4a2640 1 -- 10.20.193.49:0/2924462253 learned_addr learned my addr 10.20.193.49:0/2924462253 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:14:08.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.709+0000 7ffa6e4a2640 10 monclient(hunting): get_auth_request con 0x7ffa6815ef80 auth_method 0 2026-02-17T11:14:08.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.709+0000 7ffa6e4a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:08.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.709+0000 7ffa6e4a2640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:08.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.709+0000 7ffa6e4a2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:08.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.709+0000 7ffa6dca1640 10 monclient(hunting): get_auth_request con 0x7ffa68152700 auth_method 0 2026-02-17T11:14:08.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.709+0000 7ffa6dca1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:08.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.709+0000 7ffa6dca1640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:08.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.709+0000 7ffa6dca1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:08.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.709+0000 7ffa6d4a0640 10 monclient(hunting): get_auth_request con 0x7ffa68152ae0 auth_method 0 2026-02-17T11:14:08.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.709+0000 7ffa6d4a0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:08.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.709+0000 7ffa6d4a0640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:08.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.709+0000 7ffa6d4a0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:08.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.709+0000 7ffa6d4a0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:08.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.709+0000 7ffa6d4a0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:08.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.709+0000 7ffa6d4a0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:08.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.709+0000 7ffa6e4a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:08.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.709+0000 7ffa6e4a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:08.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.709+0000 7ffa6e4a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:08.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.709+0000 7ffa6dca1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:08.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.709+0000 7ffa6dca1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:08.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.709+0000 7ffa6dca1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:08.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.711+0000 7ffa6d4a0640 10 monclient(hunting): handle_auth_done global_id 4997 payload 824 2026-02-17T11:14:08.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.711+0000 7ffa6d4a0640 1 -- 10.20.193.49:0/2924462253 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7ffa6815ef80 msgr2=0x7ffa68152ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:08.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.711+0000 7ffa6d4a0640 1 --2- 10.20.193.49:0/2924462253 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7ffa6815ef80 0x7ffa68152ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:08.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.711+0000 7ffa6d4a0640 1 -- 10.20.193.49:0/2924462253 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ffa68152700 msgr2=0x7ffa681f8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:08.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.711+0000 7ffa6d4a0640 1 --2- 10.20.193.49:0/2924462253 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ffa68152700 0x7ffa681f8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:08.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.711+0000 7ffa6d4a0640 10 monclient: _finish_hunting 0 2026-02-17T11:14:08.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.711+0000 7ffa6d4a0640 1 monclient: found mon.noname-c 2026-02-17T11:14:08.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.711+0000 7ffa6d4a0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:14:08.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.711+0000 7ffa6d4a0640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:14:08.731 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.711+0000 7ffa6d4a0640 1 -- 10.20.193.49:0/2924462253 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa68153a30 con 0x7ffa68152ae0 2026-02-17T11:14:08.731 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.712+0000 7ffa6d4a0640 1 --2- 10.20.193.49:0/2924462253 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ffa68152ae0 0x7ffa68155690 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c00e870 tx=0x7ffa5c00ed40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:14:08.731 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.712+0000 7ffa567fc640 10 client.?.objecter ms_handle_connect 0x7ffa68152ae0 2026-02-17T11:14:08.731 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.712+0000 7ffa567fc640 10 client.?.objecter resend_mon_ops 2026-02-17T11:14:08.731 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.713+0000 7ffa567fc640 1 -- 10.20.193.49:0/2924462253 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c017070 con 0x7ffa68152ae0 2026-02-17T11:14:08.731 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.713+0000 7ffa567fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:08.731 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.713+0000 7ffa567fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:14:08.731 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.713+0000 7ffa567fc640 10 monclient: dump: 2026-02-17T11:14:08.731 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:08.731 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:08.732 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:08.732 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:08.732 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:08.732 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:08.732 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:08.732 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:08.732 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:08.732 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:08.732 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.713+0000 7ffa567fc640 10 monclient: _finish_auth 0 2026-02-17T11:14:08.732 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.713+0000 7ffa567fc640 10 monclient: _check_auth_tickets 2026-02-17T11:14:08.732 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.713+0000 7ffa567fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:14:08.732 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.713+0000 7ffa567fc640 1 -- 10.20.193.49:0/2924462253 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa5c00c940 con 0x7ffa68152ae0 2026-02-17T11:14:08.733 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.713+0000 7ffa567fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:14:08.733 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.713+0000 7ffa567fc640 1 -- 10.20.193.49:0/2924462253 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c00cd10 con 0x7ffa68152ae0 2026-02-17T11:14:08.733 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.713+0000 7ffa567fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:08.733 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.713+0000 7ffa567fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:14:08.733 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.713+0000 7ffa567fc640 10 monclient: dump: 2026-02-17T11:14:08.733 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:08.733 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:08.733 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:08.733 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:08.733 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:08.733 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:08.733 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:08.734 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:08.734 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:08.734 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:08.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.713+0000 7ffa57fff640 4 set_mon_vals no callback set 2026-02-17T11:14:08.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.713+0000 7ffa6ff2c640 5 monclient: authenticate success, global_id 4997 2026-02-17T11:14:08.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.713+0000 7ffa6ff2c640 10 monclient: _renew_subs 2026-02-17T11:14:08.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.713+0000 7ffa6ff2c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:14:08.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.713+0000 7ffa6ff2c640 1 -- 10.20.193.49:0/2924462253 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa68153d10 con 0x7ffa68152ae0 2026-02-17T11:14:08.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.713+0000 7ffa6ff2c640 10 client.4997.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:14:08.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.713+0000 7ffa6ff2c640 10 monclient: _renew_subs 2026-02-17T11:14:08.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.713+0000 7ffa6ff2c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:14:08.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.713+0000 7ffa6ff2c640 1 -- 10.20.193.49:0/2924462253 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa68145c50 con 0x7ffa68152ae0 2026-02-17T11:14:08.735 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.713+0000 7ffa6ff2c640 1 librados: init done 2026-02-17T11:14:08.735 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.714+0000 7ffa6ff2c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:14:08.735 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.714+0000 7ffa6ff2c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:14:08.735 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.714+0000 7ffa6ff2c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:14:08.735 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.714+0000 7ffa6ff2c640 1 -- 10.20.193.49:0/2924462253 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa6806a240 con 0x7ffa68152ae0 2026-02-17T11:14:08.736 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.725+0000 7ffa567fc640 1 -- 10.20.193.49:0/2924462253 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7ffa5c013470 con 0x7ffa68152ae0 2026-02-17T11:14:08.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.725+0000 7ffa567fc640 1 --2- 10.20.193.49:0/2924462253 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ffa38079190 0x7ffa3807b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:08.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.725+0000 7ffa6dca1640 1 --2- 10.20.193.49:0/2924462253 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ffa38079190 0x7ffa3807b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:08.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.725+0000 7ffa6dca1640 10 monclient: get_auth_request con 0x7ffa38079190 auth_method 0 2026-02-17T11:14:08.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.726+0000 7ffa6dca1640 1 --2- 10.20.193.49:0/2924462253 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ffa38079190 0x7ffa3807b650 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ffa58002770 tx=0x7ffa58009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:14:08.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.726+0000 7ffa567fc640 10 client.4997.objecter ms_handle_connect 0x7ffa38079190 2026-02-17T11:14:08.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.726+0000 7ffa567fc640 1 -- 10.20.193.49:0/2924462253 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7ffa5c05e510 con 0x7ffa68152ae0 2026-02-17T11:14:08.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.726+0000 7ffa567fc640 10 client.4997.objecter ms_dispatch2 0x7ffa68000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:14:08.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.726+0000 7ffa567fc640 3 client.4997.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:14:08.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.726+0000 7ffa567fc640 3 client.4997.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:14:08.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.726+0000 7ffa567fc640 20 client.4997.objecter dump_active .. 0 homeless 2026-02-17T11:14:08.830 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.828+0000 7ffa567fc640 1 -- 10.20.193.49:0/2924462253 <== mon.2 v2:10.20.193.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ffa6806a240 con 0x7ffa68152ae0 2026-02-17T11:14:08.830 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.828+0000 7ffa567fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:14:08.830 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.828+0000 7ffa567fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:14:08.929 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.926+0000 7ffa6ff2c640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:14:08.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.926+0000 7ffa6ff2c640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:14:08.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.926+0000 7ffa6ff2c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:14:08.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.926+0000 7ffa6ff2c640 1 -- 10.20.193.49:0/2924462253 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ffa68160610 con 0x7ffa68152ae0 2026-02-17T11:14:08.931 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.929+0000 7ffa567fc640 1 -- 10.20.193.49:0/2924462253 <== mon.2 v2:10.20.193.157:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7ffa68160610 con 0x7ffa68152ae0 2026-02-17T11:14:08.931 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.929+0000 7ffa567fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:14:08.932 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.929+0000 7ffa567fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:14:08.932 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:14:08.932 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:14:08.934 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.930+0000 7ffa6ff2c640 10 librados: watch_flush enter 2026-02-17T11:14:08.934 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.930+0000 7ffa6ff2c640 10 librados: watch_flush exit 2026-02-17T11:14:08.934 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.930+0000 7ffa6ff2c640 20 client.4997.objecter shutdown clearing up homeless session... 2026-02-17T11:14:08.934 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.930+0000 7ffa6ff2c640 10 client.4997.objecter successfully canceled tick 2026-02-17T11:14:08.934 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.930+0000 7ffa6ff2c640 1 -- 10.20.193.49:0/2924462253 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ffa38079190 msgr2=0x7ffa3807b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:08.935 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.930+0000 7ffa6ff2c640 1 --2- 10.20.193.49:0/2924462253 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ffa38079190 0x7ffa3807b650 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ffa58002770 tx=0x7ffa58009040 comp rx=0 tx=0).stop 2026-02-17T11:14:08.935 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.930+0000 7ffa6ff2c640 10 monclient: shutdown 2026-02-17T11:14:08.935 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.930+0000 7ffa6ff2c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:14:08.935 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.930+0000 7ffa6ff2c640 1 -- 10.20.193.49:0/2924462253 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ffa68152ae0 msgr2=0x7ffa68155690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:08.935 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.930+0000 7ffa6ff2c640 1 --2- 10.20.193.49:0/2924462253 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ffa68152ae0 0x7ffa68155690 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c00e870 tx=0x7ffa5c00ed40 comp rx=0 tx=0).stop 2026-02-17T11:14:08.935 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.930+0000 7ffa6ff2c640 1 -- 10.20.193.49:0/2924462253 shutdown_connections 2026-02-17T11:14:08.935 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.930+0000 7ffa6ff2c640 1 --2- 10.20.193.49:0/2924462253 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ffa38079190 0x7ffa3807b650 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:08.935 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.930+0000 7ffa6ff2c640 1 --2- 10.20.193.49:0/2924462253 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7ffa6815ef80 0x7ffa68152ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:08.935 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.930+0000 7ffa6ff2c640 1 --2- 10.20.193.49:0/2924462253 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ffa68152ae0 0x7ffa68155690 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:08.936 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.930+0000 7ffa6ff2c640 1 --2- 10.20.193.49:0/2924462253 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ffa68152700 0x7ffa681f8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:08.936 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.930+0000 7ffa6ff2c640 1 -- 10.20.193.49:0/2924462253 >> 10.20.193.49:0/2924462253 conn(0x7ffa68073030 msgr2=0x7ffa6814f540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:14:08.936 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.930+0000 7ffa6ff2c640 1 -- 10.20.193.49:0/2924462253 shutdown_connections 2026-02-17T11:14:08.936 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.930+0000 7ffa6ff2c640 1 -- 10.20.193.49:0/2924462253 wait complete. 2026-02-17T11:14:08.936 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:08.930+0000 7ffa6ff2c640 1 librados: shutdown 2026-02-17T11:14:11.942 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:14:12.010 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.008+0000 7fb3db1e4640 10 monclient: get_monmap_and_config 2026-02-17T11:14:12.011 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.008+0000 7fb3db1e4640 10 monclient: build_initial_monmap 2026-02-17T11:14:12.011 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.008+0000 7fb3db1e4640 10 monclient: monmap: 2026-02-17T11:14:12.011 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:14:12.011 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:12.011 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:14:12.009739+0000 2026-02-17T11:14:12.011 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:14:12.009739+0000 2026-02-17T11:14:12.011 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:14:12.011 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:12.011 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:14:12.012 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:14:12.012 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:14:12.012 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:14:12.012 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:14:12.012 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:14:12.012 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:12.015 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.008+0000 7fb3db1e4640 1 Processor -- start 2026-02-17T11:14:12.015 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.008+0000 7fb3db1e4640 1 -- start start 2026-02-17T11:14:12.015 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.008+0000 7fb3db1e4640 10 monclient: init 2026-02-17T11:14:12.015 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.009+0000 7fb3db1e4640 10 monclient: _reopen_session rank -1 2026-02-17T11:14:12.016 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.009+0000 7fb3db1e4640 10 monclient: _add_conns ranks=[4,5,1,0,2,3] 2026-02-17T11:14:12.016 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.009+0000 7fb3db1e4640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7fb3d40d1b60 0x7fb3d40d1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:12.016 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.009+0000 7fb3db1e4640 10 monclient(hunting): picked mon.noname-b con 0x7fb3d40d1b60 addr v2:10.20.193.97:3300/0 2026-02-17T11:14:12.016 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.009+0000 7fb3db1e4640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7fb3d415c840 0x7fb3d40c8d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:12.016 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.009+0000 7fb3db1e4640 10 monclient(hunting): picked mon.noname-c con 0x7fb3d415c840 addr v2:10.20.193.157:3300/0 2026-02-17T11:14:12.016 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.009+0000 7fb3db1e4640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fb3d40c92a0 addr v1:10.20.193.97:6789/0 2026-02-17T11:14:12.016 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.009+0000 7fb3db1e4640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3d40c98e0 con 0x7fb3d40c92a0 2026-02-17T11:14:12.016 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.009+0000 7fb3db1e4640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:12.016 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.009+0000 7fb3db1e4640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7fb3d40ca460 con 0x7fb3d40d1b60 2026-02-17T11:14:12.016 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.009+0000 7fb3db1e4640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:12.016 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.009+0000 7fb3db1e4640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7fb3d415d4c0 con 0x7fb3d415c840 2026-02-17T11:14:12.017 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.009+0000 7fb3db1e4640 10 monclient(hunting): _renew_subs 2026-02-17T11:14:12.017 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.009+0000 7fb3db1e4640 10 monclient(hunting): authenticate will time out at 1328.673502s 2026-02-17T11:14:12.017 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.010+0000 7fb3d8f59640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7fb3d40d1b60 0x7fb3d40d1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:12.017 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.010+0000 7fb3cbfff640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7fb3d415c840 0x7fb3d40c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:12.017 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.010+0000 7fb3d975a640 1 --1- >> v1:10.20.193.97:6789/0 conn(0x7fb3d40c92a0 0x7fb3d415d950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.97:6789/0 says I am v1:10.20.193.49:42704/0 (socket says 10.20.193.49:42704) 2026-02-17T11:14:12.017 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.010+0000 7fb3d975a640 1 -- 10.20.193.49:0/3196402545 learned_addr learned my addr 10.20.193.49:0/3196402545 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:14:12.017 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.010+0000 7fb3cbfff640 10 monclient(hunting): get_auth_request con 0x7fb3d415c840 auth_method 0 2026-02-17T11:14:12.017 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.010+0000 7fb3cbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:12.017 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.010+0000 7fb3cbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:12.017 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.010+0000 7fb3cbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:12.017 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.010+0000 7fb3d8f59640 10 monclient(hunting): get_auth_request con 0x7fb3d40d1b60 auth_method 0 2026-02-17T11:14:12.018 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.010+0000 7fb3d8f59640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:12.018 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.010+0000 7fb3d8f59640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:12.018 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.010+0000 7fb3d8f59640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:12.018 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.010+0000 7fb3cbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:12.018 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.010+0000 7fb3cbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:12.018 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.010+0000 7fb3cbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:12.018 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.010+0000 7fb3d8f59640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:12.018 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.010+0000 7fb3d8f59640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:12.018 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.010+0000 7fb3d8f59640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:12.018 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.011+0000 7fb3cbfff640 10 monclient(hunting): handle_auth_done global_id 5000 payload 274 2026-02-17T11:14:12.018 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.011+0000 7fb3cbfff640 1 -- 10.20.193.49:0/3196402545 >> v2:10.20.193.97:3300/0 conn(0x7fb3d40d1b60 msgr2=0x7fb3d40d1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:14:12.018 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.011+0000 7fb3cbfff640 1 --2- 10.20.193.49:0/3196402545 >> v2:10.20.193.97:3300/0 conn(0x7fb3d40d1b60 0x7fb3d40d1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:12.018 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.011+0000 7fb3cbfff640 1 -- 10.20.193.49:0/3196402545 >> v1:10.20.193.97:6789/0 conn(0x7fb3d40c92a0 legacy=0x7fb3d415d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:12.019 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.011+0000 7fb3cbfff640 10 monclient: _finish_hunting 0 2026-02-17T11:14:12.019 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.011+0000 7fb3cbfff640 1 monclient: found mon.noname-c 2026-02-17T11:14:12.019 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.011+0000 7fb3cbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:14:12.019 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.011+0000 7fb3cbfff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:14:12.019 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.011+0000 7fb3cbfff640 1 -- 10.20.193.49:0/3196402545 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3d40c9bc0 con 0x7fb3d415c840 2026-02-17T11:14:12.019 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.013+0000 7fb3cbfff640 1 --2- 10.20.193.49:0/3196402545 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb3d415c840 0x7fb3d40c8d60 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb3d408fc80 tx=0x7fb3bc02ede0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67898354cbf5e65f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:14:12.023 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.015+0000 7fb3cb7fe640 1 -- 10.20.193.49:0/3196402545 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3bc03c070 con 0x7fb3d415c840 2026-02-17T11:14:12.024 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.015+0000 7fb3cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:12.024 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.015+0000 7fb3cb7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:14:12.024 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.015+0000 7fb3cb7fe640 10 monclient: dump: 2026-02-17T11:14:12.024 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:12.024 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:12.024 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:12.024 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:12.024 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:12.024 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:12.024 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:12.024 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:12.025 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:12.025 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:12.025 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.015+0000 7fb3cb7fe640 10 monclient: _finish_auth 0 2026-02-17T11:14:12.025 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.015+0000 7fb3cb7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:14:12.025 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.015+0000 7fb3cb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:14:12.025 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.015+0000 7fb3cb7fe640 1 -- 10.20.193.49:0/3196402545 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3bc02faf0 con 0x7fb3d415c840 2026-02-17T11:14:12.025 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.015+0000 7fb3cb7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:14:12.025 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.015+0000 7fb3cb7fe640 1 -- 10.20.193.49:0/3196402545 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3bc037440 con 0x7fb3d415c840 2026-02-17T11:14:12.025 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.015+0000 7fb3db1e4640 5 monclient: authenticate success, global_id 5000 2026-02-17T11:14:12.025 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.015+0000 7fb3db1e4640 10 monclient: get_monmap_and_config success 2026-02-17T11:14:12.025 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.015+0000 7fb3db1e4640 4 set_mon_vals no callback set 2026-02-17T11:14:12.025 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.015+0000 7fb3cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:12.026 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.015+0000 7fb3cb7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:14:12.026 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.015+0000 7fb3cb7fe640 10 monclient: dump: 2026-02-17T11:14:12.026 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:12.026 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:12.026 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:12.026 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:12.026 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:12.026 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:12.026 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:12.026 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:12.026 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:12.026 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:12.027 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.015+0000 7fb3db1e4640 10 monclient: shutdown 2026-02-17T11:14:12.027 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.015+0000 7fb3db1e4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:14:12.027 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.015+0000 7fb3db1e4640 1 -- 10.20.193.49:0/3196402545 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb3d415c840 msgr2=0x7fb3d40c8d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:12.027 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.015+0000 7fb3db1e4640 1 --2- 10.20.193.49:0/3196402545 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb3d415c840 0x7fb3d40c8d60 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb3d408fc80 tx=0x7fb3bc02ede0 comp rx=0 tx=0).stop 2026-02-17T11:14:12.027 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.015+0000 7fb3db1e4640 1 -- 10.20.193.49:0/3196402545 shutdown_connections 2026-02-17T11:14:12.027 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.015+0000 7fb3db1e4640 1 --2- 10.20.193.49:0/3196402545 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb3d415c840 0x7fb3d40c8d60 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:12.027 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.015+0000 7fb3db1e4640 1 --2- 10.20.193.49:0/3196402545 >> v2:10.20.193.97:3300/0 conn(0x7fb3d40d1b60 0x7fb3d40d1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:12.027 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.015+0000 7fb3db1e4640 1 -- 10.20.193.49:0/3196402545 >> 10.20.193.49:0/3196402545 conn(0x7fb3d406d9b0 msgr2=0x7fb3d406ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:14:12.027 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.015+0000 7fb3db1e4640 1 -- 10.20.193.49:0/3196402545 shutdown_connections 2026-02-17T11:14:12.027 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.015+0000 7fb3db1e4640 1 -- 10.20.193.49:0/3196402545 wait complete. 2026-02-17T11:14:12.027 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.016+0000 7fb3db1e4640 10 monclient: build_initial_monmap 2026-02-17T11:14:12.027 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.016+0000 7fb3db1e4640 10 monclient: monmap: 2026-02-17T11:14:12.028 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:14:12.028 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:14:12.028 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:14:12.028 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:14:12.028 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:14:12.028 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:12.028 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:14:12.028 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:14:12.028 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:14:12.028 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:12.028 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.016+0000 7fb3db1e4640 1 librados: starting msgr at 2026-02-17T11:14:12.028 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.016+0000 7fb3db1e4640 1 librados: starting objecter 2026-02-17T11:14:12.029 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.016+0000 7fb3db1e4640 1 Processor -- start 2026-02-17T11:14:12.029 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.016+0000 7fb3db1e4640 1 -- start start 2026-02-17T11:14:12.029 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.016+0000 7fb3db1e4640 1 librados: setting wanted keys 2026-02-17T11:14:12.029 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.016+0000 7fb3db1e4640 1 librados: calling monclient init 2026-02-17T11:14:12.029 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.016+0000 7fb3db1e4640 10 monclient: init 2026-02-17T11:14:12.029 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.016+0000 7fb3db1e4640 10 monclient: _reopen_session rank -1 2026-02-17T11:14:12.029 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.017+0000 7fb3db1e4640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:14:12.029 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.017+0000 7fb3db1e4640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb3d40c92a0 0x7fb3d41f32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:12.029 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.017+0000 7fb3db1e4640 10 monclient(hunting): picked mon.noname-b con 0x7fb3d40c92a0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:14:12.029 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.017+0000 7fb3db1e4640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb3d40d1b60 0x7fb3d41471a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:12.029 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.017+0000 7fb3db1e4640 10 monclient(hunting): picked mon.noname-a con 0x7fb3d40d1b60 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:14:12.029 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.017+0000 7fb3db1e4640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb3d415c840 0x7fb3d4148480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:12.030 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.017+0000 7fb3db1e4640 10 monclient(hunting): picked mon.noname-c con 0x7fb3d415c840 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:14:12.030 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.017+0000 7fb3db1e4640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:12.030 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.017+0000 7fb3db1e4640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d415cc90 con 0x7fb3d40d1b60 2026-02-17T11:14:12.030 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.017+0000 7fb3db1e4640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:12.030 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.017+0000 7fb3db1e4640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d40ca180 con 0x7fb3d40c92a0 2026-02-17T11:14:12.030 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.017+0000 7fb3db1e4640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:12.030 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.017+0000 7fb3db1e4640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d406e7b0 con 0x7fb3d415c840 2026-02-17T11:14:12.030 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.017+0000 7fb3db1e4640 10 monclient(hunting): _renew_subs 2026-02-17T11:14:12.030 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.017+0000 7fb3db1e4640 10 monclient(hunting): authenticate will time out at 1328.681037s 2026-02-17T11:14:12.030 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.017+0000 7fb3d975a640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb3d415c840 0x7fb3d4148480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:12.030 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.017+0000 7fb3d8f59640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb3d40c92a0 0x7fb3d41f32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:12.030 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.017+0000 7fb3d975a640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb3d415c840 0x7fb3d4148480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:47196/0 (socket says 10.20.193.49:47196) 2026-02-17T11:14:12.031 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.017+0000 7fb3d975a640 1 -- 10.20.193.49:0/2890764814 learned_addr learned my addr 10.20.193.49:0/2890764814 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:14:12.031 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.017+0000 7fb3d975a640 10 monclient(hunting): get_auth_request con 0x7fb3d415c840 auth_method 0 2026-02-17T11:14:12.031 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.017+0000 7fb3d975a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:12.031 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.017+0000 7fb3d975a640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:12.031 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.017+0000 7fb3d975a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:12.031 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.017+0000 7fb3d8f59640 10 monclient(hunting): get_auth_request con 0x7fb3d40c92a0 auth_method 0 2026-02-17T11:14:12.031 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.017+0000 7fb3d8f59640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:12.031 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.017+0000 7fb3d8f59640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:12.031 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.017+0000 7fb3d8f59640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:12.031 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.017+0000 7fb3d975a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:12.031 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.017+0000 7fb3d975a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:12.031 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.017+0000 7fb3d975a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:12.032 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.017+0000 7fb3d8f59640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:12.032 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.017+0000 7fb3d8f59640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:12.032 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.017+0000 7fb3d8f59640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:12.032 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.019+0000 7fb3d975a640 10 monclient(hunting): handle_auth_done global_id 5003 payload 824 2026-02-17T11:14:12.032 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.019+0000 7fb3d975a640 1 -- 10.20.193.49:0/2890764814 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb3d40c92a0 msgr2=0x7fb3d41f32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:12.032 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.019+0000 7fb3d975a640 1 --2- 10.20.193.49:0/2890764814 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb3d40c92a0 0x7fb3d41f32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:12.032 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.019+0000 7fb3d975a640 1 -- 10.20.193.49:0/2890764814 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb3d40d1b60 msgr2=0x7fb3d41471a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:12.032 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.019+0000 7fb3d975a640 1 --2- 10.20.193.49:0/2890764814 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb3d40d1b60 0x7fb3d41471a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:12.032 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.019+0000 7fb3d975a640 10 monclient: _finish_hunting 0 2026-02-17T11:14:12.032 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.019+0000 7fb3d975a640 1 monclient: found mon.noname-c 2026-02-17T11:14:12.032 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.019+0000 7fb3d975a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:14:12.032 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.019+0000 7fb3d975a640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:14:12.033 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.019+0000 7fb3d975a640 1 -- 10.20.193.49:0/2890764814 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3d41f3a10 con 0x7fb3d415c840 2026-02-17T11:14:12.033 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.020+0000 7fb3d975a640 1 --2- 10.20.193.49:0/2890764814 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb3d415c840 0x7fb3d4148480 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb3d000cb40 tx=0x7fb3d000a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:14:12.033 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.020+0000 7fb3c97fa640 10 client.?.objecter ms_handle_connect 0x7fb3d415c840 2026-02-17T11:14:12.033 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.020+0000 7fb3c97fa640 10 client.?.objecter resend_mon_ops 2026-02-17T11:14:12.035 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.022+0000 7fb3c97fa640 1 -- 10.20.193.49:0/2890764814 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3d0017070 con 0x7fb3d415c840 2026-02-17T11:14:12.035 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.022+0000 7fb3c97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:12.035 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.022+0000 7fb3c97fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:14:12.035 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.022+0000 7fb3c97fa640 10 monclient: dump: 2026-02-17T11:14:12.035 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:12.035 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:12.035 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:12.035 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:12.035 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:12.035 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:12.036 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:12.036 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:12.036 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:12.036 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:12.036 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.022+0000 7fb3c97fa640 10 monclient: _finish_auth 0 2026-02-17T11:14:12.036 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.022+0000 7fb3c97fa640 10 monclient: _check_auth_tickets 2026-02-17T11:14:12.036 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.022+0000 7fb3c97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:14:12.036 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.022+0000 7fb3c97fa640 1 -- 10.20.193.49:0/2890764814 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3d000acf0 con 0x7fb3d415c840 2026-02-17T11:14:12.036 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.022+0000 7fb3db1e4640 5 monclient: authenticate success, global_id 5003 2026-02-17T11:14:12.036 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.022+0000 7fb3db1e4640 10 monclient: _renew_subs 2026-02-17T11:14:12.036 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.022+0000 7fb3db1e4640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:14:12.037 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.022+0000 7fb3db1e4640 1 -- 10.20.193.49:0/2890764814 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3d41f3cf0 con 0x7fb3d415c840 2026-02-17T11:14:12.037 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.022+0000 7fb3c97fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:14:12.037 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.022+0000 7fb3c97fa640 1 -- 10.20.193.49:0/2890764814 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3d0012600 con 0x7fb3d415c840 2026-02-17T11:14:12.037 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.022+0000 7fb3c97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:12.037 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.022+0000 7fb3c97fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:14:12.037 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.022+0000 7fb3c97fa640 10 monclient: dump: 2026-02-17T11:14:12.037 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:12.037 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:12.037 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:12.037 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:12.037 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:12.037 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:12.037 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:12.038 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:12.038 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:12.038 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:12.038 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.022+0000 7fb3caffd640 4 set_mon_vals no callback set 2026-02-17T11:14:12.038 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.022+0000 7fb3db1e4640 10 client.5003.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:14:12.038 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.022+0000 7fb3db1e4640 10 monclient: _renew_subs 2026-02-17T11:14:12.038 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.022+0000 7fb3db1e4640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:14:12.038 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.022+0000 7fb3db1e4640 1 -- 10.20.193.49:0/2890764814 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3d4147c80 con 0x7fb3d415c840 2026-02-17T11:14:12.038 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.022+0000 7fb3db1e4640 1 librados: init done 2026-02-17T11:14:12.038 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.022+0000 7fb3db1e4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:14:12.038 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.022+0000 7fb3db1e4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:14:12.039 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.022+0000 7fb3db1e4640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:14:12.039 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.022+0000 7fb3db1e4640 1 -- 10.20.193.49:0/2890764814 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3d40d1f40 con 0x7fb3d415c840 2026-02-17T11:14:12.039 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:05:57.513 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:14:12.059 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:05:57.534 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:14:12.059 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:05:57.540 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:14:12.060 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:05:57.535 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:14:12.067 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:05:57.549 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:14:12.068 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:05:57.543 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:14:12.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.129+0000 7fb3c97fa640 1 -- 10.20.193.49:0/2890764814 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7fb3d0024080 con 0x7fb3d415c840 2026-02-17T11:14:12.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.129+0000 7fb3c97fa640 1 --2- 10.20.193.49:0/2890764814 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb3a4079140 0x7fb3a407b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:12.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.129+0000 7fb3d8f59640 1 --2- 10.20.193.49:0/2890764814 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb3a4079140 0x7fb3a407b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:12.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.130+0000 7fb3d8f59640 10 monclient: get_auth_request con 0x7fb3a4079140 auth_method 0 2026-02-17T11:14:12.133 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.130+0000 7fb3c97fa640 10 client.5003.objecter ms_handle_connect 0x7fb3a4079140 2026-02-17T11:14:12.133 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.130+0000 7fb3d8f59640 1 --2- 10.20.193.49:0/2890764814 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb3a4079140 0x7fb3a407b600 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb3c4009ba0 tx=0x7fb3c4009290 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:14:12.135 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.132+0000 7fb3c97fa640 1 -- 10.20.193.49:0/2890764814 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7fb3d005dfd0 con 0x7fb3d415c840 2026-02-17T11:14:12.135 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.132+0000 7fb3c97fa640 10 client.5003.objecter ms_dispatch2 0x7fb3d4000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:14:12.135 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.132+0000 7fb3c97fa640 3 client.5003.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:14:12.135 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.132+0000 7fb3c97fa640 3 client.5003.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:14:12.135 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.132+0000 7fb3c97fa640 20 client.5003.objecter dump_active .. 0 homeless 2026-02-17T11:14:12.141 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.138+0000 7fb3c97fa640 1 -- 10.20.193.49:0/2890764814 <== mon.2 v2:10.20.193.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb3d0061f90 con 0x7fb3d415c840 2026-02-17T11:14:12.141 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.138+0000 7fb3c97fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:14:12.141 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.138+0000 7fb3c97fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:14:12.171 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:05:57.613 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:14:12.172 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:05:57.614 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:14:12.180 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:05:57.622 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:14:12.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.239+0000 7fb3db1e4640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:14:12.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.239+0000 7fb3db1e4640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:14:12.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.239+0000 7fb3db1e4640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:14:12.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.239+0000 7fb3db1e4640 1 -- 10.20.193.49:0/2890764814 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb3d414f280 con 0x7fb3d415c840 2026-02-17T11:14:12.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.244+0000 7fb3c97fa640 1 -- 10.20.193.49:0/2890764814 <== mon.2 v2:10.20.193.157:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fb3d0066290 con 0x7fb3d415c840 2026-02-17T11:14:12.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.244+0000 7fb3c97fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:14:12.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.244+0000 7fb3c97fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:14:12.246 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:14:12.246 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:14:12.248 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.244+0000 7fb3db1e4640 10 librados: watch_flush enter 2026-02-17T11:14:12.248 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.244+0000 7fb3db1e4640 10 librados: watch_flush exit 2026-02-17T11:14:12.248 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.244+0000 7fb3db1e4640 20 client.5003.objecter shutdown clearing up homeless session... 2026-02-17T11:14:12.248 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.244+0000 7fb3db1e4640 10 client.5003.objecter successfully canceled tick 2026-02-17T11:14:12.248 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.244+0000 7fb3db1e4640 1 -- 10.20.193.49:0/2890764814 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb3a4079140 msgr2=0x7fb3a407b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:12.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.244+0000 7fb3db1e4640 1 --2- 10.20.193.49:0/2890764814 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb3a4079140 0x7fb3a407b600 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb3c4009ba0 tx=0x7fb3c4009290 comp rx=0 tx=0).stop 2026-02-17T11:14:12.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.244+0000 7fb3db1e4640 10 monclient: shutdown 2026-02-17T11:14:12.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.244+0000 7fb3db1e4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:14:12.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.244+0000 7fb3db1e4640 1 -- 10.20.193.49:0/2890764814 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb3d415c840 msgr2=0x7fb3d4148480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:12.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.244+0000 7fb3db1e4640 1 --2- 10.20.193.49:0/2890764814 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb3d415c840 0x7fb3d4148480 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb3d000cb40 tx=0x7fb3d000a430 comp rx=0 tx=0).stop 2026-02-17T11:14:12.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.244+0000 7fb3db1e4640 1 -- 10.20.193.49:0/2890764814 shutdown_connections 2026-02-17T11:14:12.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.245+0000 7fb3db1e4640 1 --2- 10.20.193.49:0/2890764814 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb3a4079140 0x7fb3a407b600 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:12.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.245+0000 7fb3db1e4640 1 --2- 10.20.193.49:0/2890764814 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb3d415c840 0x7fb3d4148480 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:12.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.245+0000 7fb3db1e4640 1 --2- 10.20.193.49:0/2890764814 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb3d40d1b60 0x7fb3d41471a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:12.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.245+0000 7fb3db1e4640 1 --2- 10.20.193.49:0/2890764814 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb3d40c92a0 0x7fb3d41f32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:12.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.245+0000 7fb3db1e4640 1 -- 10.20.193.49:0/2890764814 >> 10.20.193.49:0/2890764814 conn(0x7fb3d406d9b0 msgr2=0x7fb3d414fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:14:12.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.245+0000 7fb3db1e4640 1 -- 10.20.193.49:0/2890764814 shutdown_connections 2026-02-17T11:14:12.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.245+0000 7fb3db1e4640 1 -- 10.20.193.49:0/2890764814 wait complete. 2026-02-17T11:14:12.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:12.245+0000 7fb3db1e4640 1 librados: shutdown 2026-02-17T11:14:15.256 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:14:15.329 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.322+0000 7f26f7ec6640 10 monclient: get_monmap_and_config 2026-02-17T11:14:15.330 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.322+0000 7f26f7ec6640 10 monclient: build_initial_monmap 2026-02-17T11:14:15.330 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.322+0000 7f26f7ec6640 10 monclient: monmap: 2026-02-17T11:14:15.330 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:14:15.330 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:15.331 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:14:15.324118+0000 2026-02-17T11:14:15.331 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:14:15.324118+0000 2026-02-17T11:14:15.331 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:14:15.331 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:15.331 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:14:15.331 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:14:15.332 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:14:15.332 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:14:15.332 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:14:15.332 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:14:15.332 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:15.332 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.323+0000 7f26f7ec6640 1 Processor -- start 2026-02-17T11:14:15.333 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.323+0000 7f26f7ec6640 1 -- start start 2026-02-17T11:14:15.333 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.323+0000 7f26f7ec6640 10 monclient: init 2026-02-17T11:14:15.333 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.323+0000 7f26f7ec6640 10 monclient: _reopen_session rank -1 2026-02-17T11:14:15.333 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.323+0000 7f26f7ec6640 10 monclient: _add_conns ranks=[2,5,4,3,1,0] 2026-02-17T11:14:15.333 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.323+0000 7f26f7ec6640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f26f015f690 addr v1:10.20.193.157:6789/0 2026-02-17T11:14:15.333 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.323+0000 7f26f7ec6640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f26f015fa70 0x7f26f00726d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:15.334 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.323+0000 7f26f7ec6640 10 monclient(hunting): picked mon.noname-c con 0x7f26f015fa70 addr v2:10.20.193.157:3300/0 2026-02-17T11:14:15.334 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.323+0000 7f26f7ec6640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f26f0072c10 0x7f26f015d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:15.334 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.323+0000 7f26f7ec6640 10 monclient(hunting): picked mon.noname-b con 0x7f26f0072c10 addr v2:10.20.193.97:3300/0 2026-02-17T11:14:15.334 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.323+0000 7f26f7ec6640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26f00732e0 con 0x7f26f015f690 2026-02-17T11:14:15.334 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.323+0000 7f26f7ec6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:15.334 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.323+0000 7f26f7ec6640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f26f00730a0 con 0x7f26f0072c10 2026-02-17T11:14:15.335 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.323+0000 7f26f7ec6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:15.335 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.323+0000 7f26f7ec6640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f26f00735c0 con 0x7f26f015fa70 2026-02-17T11:14:15.335 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.323+0000 7f26f7ec6640 10 monclient(hunting): _renew_subs 2026-02-17T11:14:15.335 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.323+0000 7f26f7ec6640 10 monclient(hunting): authenticate will time out at 1331.987578s 2026-02-17T11:14:15.335 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.324+0000 7f26f643c640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f26f0072c10 0x7f26f015d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:15.335 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.324+0000 7f26f543a640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f26f015fa70 0x7f26f00726d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:15.336 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.324+0000 7f26f643c640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f26f0072c10 0x7f26f015d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:49106/0 (socket says 10.20.193.49:49106) 2026-02-17T11:14:15.336 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.324+0000 7f26f643c640 1 -- 10.20.193.49:0/2968519796 learned_addr learned my addr 10.20.193.49:0/2968519796 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:14:15.336 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.324+0000 7f26f643c640 10 monclient(hunting): get_auth_request con 0x7f26f0072c10 auth_method 0 2026-02-17T11:14:15.336 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.324+0000 7f26f643c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:15.336 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.324+0000 7f26f643c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:15.336 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.324+0000 7f26f643c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:15.336 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.324+0000 7f26f643c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:15.337 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.324+0000 7f26f643c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:15.337 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.324+0000 7f26f643c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:15.337 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.324+0000 7f26f543a640 10 monclient(hunting): get_auth_request con 0x7f26f015fa70 auth_method 0 2026-02-17T11:14:15.337 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.324+0000 7f26f543a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:15.337 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.324+0000 7f26f543a640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:15.337 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.324+0000 7f26f543a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:15.337 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.325+0000 7f26f543a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:15.338 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.325+0000 7f26f543a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:15.338 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.325+0000 7f26f543a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:15.338 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.325+0000 7f26f643c640 10 monclient(hunting): handle_auth_done global_id 4969 payload 274 2026-02-17T11:14:15.338 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.325+0000 7f26f643c640 1 -- 10.20.193.49:0/2968519796 >> v2:10.20.193.157:3300/0 conn(0x7f26f015fa70 msgr2=0x7f26f00726d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:14:15.338 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.325+0000 7f26f643c640 1 --2- 10.20.193.49:0/2968519796 >> v2:10.20.193.157:3300/0 conn(0x7f26f015fa70 0x7f26f00726d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:15.338 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.325+0000 7f26f643c640 1 -- 10.20.193.49:0/2968519796 >> v1:10.20.193.157:6789/0 conn(0x7f26f015f690 legacy=0x7f26f00c9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:15.339 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.325+0000 7f26f643c640 10 monclient: _finish_hunting 0 2026-02-17T11:14:15.339 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.325+0000 7f26f643c640 1 monclient: found mon.noname-b 2026-02-17T11:14:15.339 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.325+0000 7f26f643c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:14:15.339 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.325+0000 7f26f643c640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:14:15.339 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.325+0000 7f26f643c640 1 -- 10.20.193.49:0/2968519796 --> v2:10.20.193.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26f00738a0 con 0x7f26f0072c10 2026-02-17T11:14:15.339 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.326+0000 7f26f643c640 1 --2- 10.20.193.49:0/2968519796 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f26f0072c10 0x7f26f015d420 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f26f006f820 tx=0x7f26ec02f230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e34be2bd8902f6a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:14:15.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.327+0000 7f26f4c39640 1 -- 10.20.193.49:0/2968519796 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26ec02fcf0 con 0x7f26f0072c10 2026-02-17T11:14:15.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.327+0000 7f26f4c39640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:15.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.327+0000 7f26f4c39640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:14:15.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.327+0000 7f26f4c39640 10 monclient: dump: 2026-02-17T11:14:15.346 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:15.346 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:15.346 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:15.346 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:15.346 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:15.346 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:15.347 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:15.347 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:15.347 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:15.347 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:15.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.327+0000 7f26f4c39640 10 monclient: _finish_auth 0 2026-02-17T11:14:15.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.327+0000 7f26f4c39640 10 monclient: _check_auth_tickets 2026-02-17T11:14:15.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.327+0000 7f26f4c39640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:14:15.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.327+0000 7f26f7ec6640 5 monclient: authenticate success, global_id 4969 2026-02-17T11:14:15.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.327+0000 7f26f7ec6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:14:15.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.328+0000 7f26f4c39640 1 -- 10.20.193.49:0/2968519796 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26ec0373f0 con 0x7f26f0072c10 2026-02-17T11:14:15.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.328+0000 7f26f4c39640 10 monclient: handle_config config(0 keys) 2026-02-17T11:14:15.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.328+0000 7f26f4c39640 1 -- 10.20.193.49:0/2968519796 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26ec0377c0 con 0x7f26f0072c10 2026-02-17T11:14:15.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.328+0000 7f26f7ec6640 10 monclient: get_monmap_and_config success 2026-02-17T11:14:15.348 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.328+0000 7f26f7ec6640 4 set_mon_vals no callback set 2026-02-17T11:14:15.348 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.328+0000 7f26f4c39640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:15.348 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.328+0000 7f26f4c39640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:14:15.348 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.328+0000 7f26f4c39640 10 monclient: dump: 2026-02-17T11:14:15.348 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:15.348 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:15.348 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:15.348 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:15.348 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:15.348 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:15.348 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:15.348 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:15.348 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:15.349 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:15.349 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.328+0000 7f26f7ec6640 10 monclient: shutdown 2026-02-17T11:14:15.349 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.328+0000 7f26f7ec6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:14:15.349 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.328+0000 7f26f7ec6640 1 -- 10.20.193.49:0/2968519796 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f26f0072c10 msgr2=0x7f26f015d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:15.349 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.328+0000 7f26f7ec6640 1 --2- 10.20.193.49:0/2968519796 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f26f0072c10 0x7f26f015d420 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f26f006f820 tx=0x7f26ec02f230 comp rx=0 tx=0).stop 2026-02-17T11:14:15.349 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.328+0000 7f26f7ec6640 1 -- 10.20.193.49:0/2968519796 shutdown_connections 2026-02-17T11:14:15.349 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.328+0000 7f26f7ec6640 1 --2- 10.20.193.49:0/2968519796 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f26f0072c10 0x7f26f015d420 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:15.349 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.328+0000 7f26f7ec6640 1 --2- 10.20.193.49:0/2968519796 >> v2:10.20.193.157:3300/0 conn(0x7f26f015fa70 0x7f26f00726d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:15.349 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.328+0000 7f26f7ec6640 1 -- 10.20.193.49:0/2968519796 >> 10.20.193.49:0/2968519796 conn(0x7f26f00c9f20 msgr2=0x7f26f00ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:14:15.349 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.328+0000 7f26f7ec6640 1 -- 10.20.193.49:0/2968519796 shutdown_connections 2026-02-17T11:14:15.349 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.328+0000 7f26f7ec6640 1 -- 10.20.193.49:0/2968519796 wait complete. 2026-02-17T11:14:15.349 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.328+0000 7f26f7ec6640 10 monclient: build_initial_monmap 2026-02-17T11:14:15.349 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.328+0000 7f26f7ec6640 10 monclient: monmap: 2026-02-17T11:14:15.350 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:14:15.350 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:14:15.350 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:14:15.350 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:14:15.350 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:14:15.350 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:15.350 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:14:15.350 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:14:15.350 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:14:15.350 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:15.350 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.329+0000 7f26f7ec6640 1 librados: starting msgr at 2026-02-17T11:14:15.350 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.329+0000 7f26f7ec6640 1 librados: starting objecter 2026-02-17T11:14:15.350 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.329+0000 7f26f7ec6640 1 Processor -- start 2026-02-17T11:14:15.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.329+0000 7f26f7ec6640 1 -- start start 2026-02-17T11:14:15.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.329+0000 7f26f7ec6640 1 librados: setting wanted keys 2026-02-17T11:14:15.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.329+0000 7f26f7ec6640 1 librados: calling monclient init 2026-02-17T11:14:15.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.329+0000 7f26f7ec6640 10 monclient: init 2026-02-17T11:14:15.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.329+0000 7f26f7ec6640 10 monclient: _reopen_session rank -1 2026-02-17T11:14:15.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.329+0000 7f26f7ec6640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:14:15.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.329+0000 7f26f7ec6640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f26f0072c10 0x7f26f00cc560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:15.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.329+0000 7f26f7ec6640 10 monclient(hunting): picked mon.noname-a con 0x7f26f0072c10 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:14:15.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.329+0000 7f26f7ec6640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f26f015f690 0x7f26f01523b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:15.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.329+0000 7f26f7ec6640 10 monclient(hunting): picked mon.noname-c con 0x7f26f015f690 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:14:15.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.329+0000 7f26f7ec6640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f26f015fa70 0x7f26f01528f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:15.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.329+0000 7f26f7ec6640 10 monclient(hunting): picked mon.noname-b con 0x7f26f015fa70 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:14:15.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.329+0000 7f26f7ec6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:15.352 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.329+0000 7f26f7ec6640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f26f00c9760 con 0x7f26f0072c10 2026-02-17T11:14:15.352 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.329+0000 7f26f7ec6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:15.352 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.329+0000 7f26f7ec6640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f26f0073e60 con 0x7f26f015fa70 2026-02-17T11:14:15.352 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.329+0000 7f26f7ec6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:15.352 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.329+0000 7f26f7ec6640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f26f015d960 con 0x7f26f015f690 2026-02-17T11:14:15.352 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.329+0000 7f26f7ec6640 10 monclient(hunting): _renew_subs 2026-02-17T11:14:15.352 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.329+0000 7f26f7ec6640 10 monclient(hunting): authenticate will time out at 1331.993857s 2026-02-17T11:14:15.352 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.330+0000 7f26f643c640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f26f015fa70 0x7f26f01528f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:15.352 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.330+0000 7f26f543a640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f26f015f690 0x7f26f01523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:15.352 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.330+0000 7f26f5c3b640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f26f0072c10 0x7f26f00cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:15.352 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.330+0000 7f26f643c640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f26f015fa70 0x7f26f01528f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:49120/0 (socket says 10.20.193.49:49120) 2026-02-17T11:14:15.352 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.330+0000 7f26f643c640 1 -- 10.20.193.49:0/2980070930 learned_addr learned my addr 10.20.193.49:0/2980070930 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:14:15.352 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.330+0000 7f26f643c640 10 monclient(hunting): get_auth_request con 0x7f26f015fa70 auth_method 0 2026-02-17T11:14:15.352 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.330+0000 7f26f643c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:15.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.330+0000 7f26f643c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:15.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.330+0000 7f26f643c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:15.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.330+0000 7f26f543a640 10 monclient(hunting): get_auth_request con 0x7f26f015f690 auth_method 0 2026-02-17T11:14:15.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.330+0000 7f26f543a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:15.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.330+0000 7f26f543a640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:15.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.330+0000 7f26f543a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:15.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.330+0000 7f26f5c3b640 10 monclient(hunting): get_auth_request con 0x7f26f0072c10 auth_method 0 2026-02-17T11:14:15.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.330+0000 7f26f5c3b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:15.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.330+0000 7f26f5c3b640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:15.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.330+0000 7f26f5c3b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:15.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.330+0000 7f26f643c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:15.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.330+0000 7f26f643c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:15.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.330+0000 7f26f643c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:15.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.330+0000 7f26f543a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:15.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.330+0000 7f26f543a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:15.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.330+0000 7f26f543a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:15.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.330+0000 7f26f5c3b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:15.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.330+0000 7f26f5c3b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:15.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.330+0000 7f26f5c3b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:15.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.331+0000 7f26f643c640 10 monclient(hunting): handle_auth_done global_id 4972 payload 824 2026-02-17T11:14:15.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.331+0000 7f26f643c640 1 -- 10.20.193.49:0/2980070930 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f26f015f690 msgr2=0x7f26f01523b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:15.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.331+0000 7f26f643c640 1 --2- 10.20.193.49:0/2980070930 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f26f015f690 0x7f26f01523b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:15.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.331+0000 7f26f643c640 1 -- 10.20.193.49:0/2980070930 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f26f0072c10 msgr2=0x7f26f00cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:15.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.331+0000 7f26f643c640 1 --2- 10.20.193.49:0/2980070930 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f26f0072c10 0x7f26f00cc560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:15.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.331+0000 7f26f643c640 10 monclient: _finish_hunting 0 2026-02-17T11:14:15.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.331+0000 7f26f643c640 1 monclient: found mon.noname-b 2026-02-17T11:14:15.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.331+0000 7f26f643c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:14:15.355 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.331+0000 7f26f643c640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:14:15.355 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.331+0000 7f26f643c640 1 -- 10.20.193.49:0/2980070930 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26f01f3630 con 0x7f26f015fa70 2026-02-17T11:14:15.355 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.332+0000 7f26f643c640 1 --2- 10.20.193.49:0/2980070930 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f26f015fa70 0x7f26f01528f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f26ec009f50 tx=0x7f26ec004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:14:15.355 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.332+0000 7f26de7fc640 10 client.?.objecter ms_handle_connect 0x7f26f015fa70 2026-02-17T11:14:15.355 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.332+0000 7f26de7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T11:14:15.355 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.333+0000 7f26de7fc640 1 -- 10.20.193.49:0/2980070930 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26ec046020 con 0x7f26f015fa70 2026-02-17T11:14:15.355 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.333+0000 7f26de7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:15.355 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.333+0000 7f26de7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:14:15.355 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.333+0000 7f26de7fc640 10 monclient: dump: 2026-02-17T11:14:15.355 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:15.355 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:15.355 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:15.355 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:15.355 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:15.356 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:15.356 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:15.356 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:15.356 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:15.356 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:15.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.333+0000 7f26de7fc640 10 monclient: _finish_auth 0 2026-02-17T11:14:15.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.333+0000 7f26de7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:14:15.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.333+0000 7f26de7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:14:15.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.333+0000 7f26f7ec6640 5 monclient: authenticate success, global_id 4972 2026-02-17T11:14:15.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.333+0000 7f26f7ec6640 10 monclient: _renew_subs 2026-02-17T11:14:15.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.333+0000 7f26f7ec6640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:14:15.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.333+0000 7f26f7ec6640 1 -- 10.20.193.49:0/2980070930 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26f01f38f0 con 0x7f26f015fa70 2026-02-17T11:14:15.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.334+0000 7f26f7ec6640 10 client.4972.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:14:15.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.334+0000 7f26f7ec6640 10 monclient: _renew_subs 2026-02-17T11:14:15.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.334+0000 7f26f7ec6640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:14:15.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.334+0000 7f26f7ec6640 1 -- 10.20.193.49:0/2980070930 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26f01f3eb0 con 0x7f26f015fa70 2026-02-17T11:14:15.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.334+0000 7f26f7ec6640 1 librados: init done 2026-02-17T11:14:15.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.334+0000 7f26de7fc640 1 -- 10.20.193.49:0/2980070930 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26ec0373f0 con 0x7f26f015fa70 2026-02-17T11:14:15.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.334+0000 7f26de7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:14:15.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.334+0000 7f26de7fc640 1 -- 10.20.193.49:0/2980070930 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26ec037e60 con 0x7f26f015fa70 2026-02-17T11:14:15.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.334+0000 7f26de7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:15.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.334+0000 7f26de7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:14:15.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.334+0000 7f26de7fc640 10 monclient: dump: 2026-02-17T11:14:15.357 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:15.357 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:15.357 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:15.357 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:15.357 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:15.358 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:15.358 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:15.358 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:15.358 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:15.358 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:15.358 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.334+0000 7f26dffff640 4 set_mon_vals no callback set 2026-02-17T11:14:15.358 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.334+0000 7f26f7ec6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:14:15.358 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.334+0000 7f26f7ec6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:14:15.358 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.334+0000 7f26f7ec6640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:14:15.358 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.334+0000 7f26f7ec6640 1 -- 10.20.193.49:0/2980070930 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26f015dcf0 con 0x7f26f015fa70 2026-02-17T11:14:15.359 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.345+0000 7f26de7fc640 1 -- 10.20.193.49:0/2980070930 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f26ec041650 con 0x7f26f015fa70 2026-02-17T11:14:15.360 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.346+0000 7f26de7fc640 1 --2- 10.20.193.49:0/2980070930 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f26c0079140 0x7f26c007b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:15.360 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.346+0000 7f26f5c3b640 1 --2- 10.20.193.49:0/2980070930 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f26c0079140 0x7f26c007b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:15.360 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.346+0000 7f26f5c3b640 10 monclient: get_auth_request con 0x7f26c0079140 auth_method 0 2026-02-17T11:14:15.360 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.347+0000 7f26f5c3b640 1 --2- 10.20.193.49:0/2980070930 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f26c0079140 0x7f26c007b600 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f26f006ea60 tx=0x7f26e0007f30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:14:15.360 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.347+0000 7f26de7fc640 10 client.4972.objecter ms_handle_connect 0x7f26c0079140 2026-02-17T11:14:15.360 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.347+0000 7f26de7fc640 1 -- 10.20.193.49:0/2980070930 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f26ec0bd500 con 0x7f26f015fa70 2026-02-17T11:14:15.360 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.347+0000 7f26de7fc640 10 client.4972.objecter ms_dispatch2 0x7f26f0000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:14:15.360 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.347+0000 7f26de7fc640 3 client.4972.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:14:15.360 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.347+0000 7f26de7fc640 3 client.4972.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:14:15.360 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.347+0000 7f26de7fc640 20 client.4972.objecter dump_active .. 0 homeless 2026-02-17T11:14:15.448 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.446+0000 7f26de7fc640 1 -- 10.20.193.49:0/2980070930 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f26ec050030 con 0x7f26f015fa70 2026-02-17T11:14:15.448 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.446+0000 7f26de7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:14:15.448 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.446+0000 7f26de7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:14:15.547 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.544+0000 7f26f7ec6640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:14:15.547 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.544+0000 7f26f7ec6640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:14:15.547 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.544+0000 7f26f7ec6640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:14:15.547 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.544+0000 7f26f7ec6640 1 -- 10.20.193.49:0/2980070930 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f26f00c6f00 con 0x7f26f015fa70 2026-02-17T11:14:15.549 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.548+0000 7f26de7fc640 1 -- 10.20.193.49:0/2980070930 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f26ec087a20 con 0x7f26f015fa70 2026-02-17T11:14:15.549 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.548+0000 7f26de7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:14:15.549 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.548+0000 7f26de7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:14:15.550 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:14:15.550 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:14:15.551 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.548+0000 7f26f7ec6640 10 librados: watch_flush enter 2026-02-17T11:14:15.551 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.548+0000 7f26f7ec6640 10 librados: watch_flush exit 2026-02-17T11:14:15.551 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.548+0000 7f26f7ec6640 20 client.4972.objecter shutdown clearing up homeless session... 2026-02-17T11:14:15.551 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.548+0000 7f26f7ec6640 10 client.4972.objecter successfully canceled tick 2026-02-17T11:14:15.551 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.548+0000 7f26f7ec6640 1 -- 10.20.193.49:0/2980070930 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f26c0079140 msgr2=0x7f26c007b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:15.552 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.548+0000 7f26f7ec6640 1 --2- 10.20.193.49:0/2980070930 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f26c0079140 0x7f26c007b600 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f26f006ea60 tx=0x7f26e0007f30 comp rx=0 tx=0).stop 2026-02-17T11:14:15.552 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.548+0000 7f26f7ec6640 10 monclient: shutdown 2026-02-17T11:14:15.552 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.548+0000 7f26f7ec6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:14:15.552 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.548+0000 7f26f7ec6640 1 -- 10.20.193.49:0/2980070930 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f26f015fa70 msgr2=0x7f26f01528f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:15.552 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.548+0000 7f26f7ec6640 1 --2- 10.20.193.49:0/2980070930 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f26f015fa70 0x7f26f01528f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f26ec009f50 tx=0x7f26ec004b40 comp rx=0 tx=0).stop 2026-02-17T11:14:15.552 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.548+0000 7f26f7ec6640 1 -- 10.20.193.49:0/2980070930 shutdown_connections 2026-02-17T11:14:15.552 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.548+0000 7f26f7ec6640 1 --2- 10.20.193.49:0/2980070930 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f26c0079140 0x7f26c007b600 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:15.552 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.548+0000 7f26f7ec6640 1 --2- 10.20.193.49:0/2980070930 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f26f015fa70 0x7f26f01528f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:15.552 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.548+0000 7f26f7ec6640 1 --2- 10.20.193.49:0/2980070930 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f26f015f690 0x7f26f01523b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:15.552 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.548+0000 7f26f7ec6640 1 --2- 10.20.193.49:0/2980070930 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f26f0072c10 0x7f26f00cc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:15.552 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.548+0000 7f26f7ec6640 1 -- 10.20.193.49:0/2980070930 >> 10.20.193.49:0/2980070930 conn(0x7f26f00c9f20 msgr2=0x7f26f00c7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:14:15.552 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.548+0000 7f26f7ec6640 1 -- 10.20.193.49:0/2980070930 shutdown_connections 2026-02-17T11:14:15.552 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.548+0000 7f26f7ec6640 1 -- 10.20.193.49:0/2980070930 wait complete. 2026-02-17T11:14:15.553 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:15.548+0000 7f26f7ec6640 1 librados: shutdown 2026-02-17T11:14:18.560 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:14:18.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.626+0000 7f1fddbce640 10 monclient: get_monmap_and_config 2026-02-17T11:14:18.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.626+0000 7f1fddbce640 10 monclient: build_initial_monmap 2026-02-17T11:14:18.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.626+0000 7f1fddbce640 10 monclient: monmap: 2026-02-17T11:14:18.629 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:14:18.629 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:18.629 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:14:18.627920+0000 2026-02-17T11:14:18.630 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:14:18.627920+0000 2026-02-17T11:14:18.630 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:14:18.630 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:18.630 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:14:18.630 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:14:18.630 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:14:18.630 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:14:18.630 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:14:18.630 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:14:18.630 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:18.630 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.626+0000 7f1fddbce640 1 Processor -- start 2026-02-17T11:14:18.630 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.626+0000 7f1fddbce640 1 -- start start 2026-02-17T11:14:18.631 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.626+0000 7f1fddbce640 10 monclient: init 2026-02-17T11:14:18.633 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.627+0000 7f1fddbce640 10 monclient: _reopen_session rank -1 2026-02-17T11:14:18.633 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.627+0000 7f1fddbce640 10 monclient: _add_conns ranks=[4,3,2,0,1,5] 2026-02-17T11:14:18.634 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.627+0000 7f1fddbce640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f1fd80c7240 0x7f1fd80726d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:18.634 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.627+0000 7f1fddbce640 10 monclient(hunting): picked mon.noname-b con 0x7f1fd80c7240 addr v2:10.20.193.97:3300/0 2026-02-17T11:14:18.634 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.627+0000 7f1fddbce640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f1fd80c7620 0x7f1fd8161710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:18.634 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.627+0000 7f1fddbce640 10 monclient(hunting): picked mon.noname-a con 0x7f1fd80c7620 addr v2:10.20.193.49:3300/0 2026-02-17T11:14:18.634 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.627+0000 7f1fddbce640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f1fd8161c50 addr v1:10.20.193.157:6789/0 2026-02-17T11:14:18.634 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.627+0000 7f1fddbce640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fd8074140 con 0x7f1fd8161c50 2026-02-17T11:14:18.634 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.627+0000 7f1fddbce640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:18.634 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.627+0000 7f1fddbce640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f1fd815a720 con 0x7f1fd80c7620 2026-02-17T11:14:18.634 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.627+0000 7f1fddbce640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:18.634 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.627+0000 7f1fddbce640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f1fd8072dc0 con 0x7f1fd80c7240 2026-02-17T11:14:18.634 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.627+0000 7f1fddbce640 10 monclient(hunting): _renew_subs 2026-02-17T11:14:18.634 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.627+0000 7f1fddbce640 10 monclient(hunting): authenticate will time out at 1335.291388s 2026-02-17T11:14:18.635 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.627+0000 7f1fd6ffd640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f1fd80c7620 0x7f1fd8161710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:18.635 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.627+0000 7f1fd7fff640 1 --1- >> v1:10.20.193.157:6789/0 conn(0x7f1fd8161c50 0x7f1fd8163810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.157:6789/0 says I am v1:10.20.193.49:34530/0 (socket says 10.20.193.49:34530) 2026-02-17T11:14:18.635 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.627+0000 7f1fd7fff640 1 -- 10.20.193.49:0/665313805 learned_addr learned my addr 10.20.193.49:0/665313805 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:14:18.635 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.627+0000 7f1fd77fe640 1 --2- 10.20.193.49:0/665313805 >> v2:10.20.193.97:3300/0 conn(0x7f1fd80c7240 0x7f1fd80726d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:18.635 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.627+0000 7f1fd6ffd640 10 monclient(hunting): get_auth_request con 0x7f1fd80c7620 auth_method 0 2026-02-17T11:14:18.635 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.628+0000 7f1fd6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:18.635 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.628+0000 7f1fd6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:18.635 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.628+0000 7f1fd6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:18.635 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.628+0000 7f1fd77fe640 10 monclient(hunting): get_auth_request con 0x7f1fd80c7240 auth_method 0 2026-02-17T11:14:18.635 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.628+0000 7f1fd77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:18.635 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.628+0000 7f1fd77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:18.636 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.628+0000 7f1fd77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:18.636 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.628+0000 7f1fd6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:18.636 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.628+0000 7f1fd6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:18.636 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.628+0000 7f1fd6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:18.636 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.628+0000 7f1fd77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:18.636 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.628+0000 7f1fd77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:18.636 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.628+0000 7f1fd77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:18.636 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.629+0000 7f1fd6ffd640 10 monclient(hunting): handle_auth_done global_id 4998 payload 274 2026-02-17T11:14:18.636 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.629+0000 7f1fd6ffd640 1 -- 10.20.193.49:0/665313805 >> v2:10.20.193.97:3300/0 conn(0x7f1fd80c7240 msgr2=0x7f1fd80726d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:14:18.636 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.629+0000 7f1fd6ffd640 1 --2- 10.20.193.49:0/665313805 >> v2:10.20.193.97:3300/0 conn(0x7f1fd80c7240 0x7f1fd80726d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:18.636 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.629+0000 7f1fd6ffd640 1 -- 10.20.193.49:0/665313805 >> v1:10.20.193.157:6789/0 conn(0x7f1fd8161c50 legacy=0x7f1fd8163810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:18.636 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.629+0000 7f1fd6ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:14:18.636 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.629+0000 7f1fd6ffd640 1 monclient: found mon.noname-a 2026-02-17T11:14:18.637 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.629+0000 7f1fd6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:14:18.637 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.629+0000 7f1fd6ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:14:18.637 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.629+0000 7f1fd6ffd640 1 -- 10.20.193.49:0/665313805 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fd80730a0 con 0x7f1fd80c7620 2026-02-17T11:14:18.637 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.630+0000 7f1fd6ffd640 1 --2- 10.20.193.49:0/665313805 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1fd80c7620 0x7f1fd8161710 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1fd8069720 tx=0x7f1fc802ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fff5503484faf93 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:14:18.646 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.631+0000 7f1fd67fc640 1 -- 10.20.193.49:0/665313805 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fc803c070 con 0x7f1fd80c7620 2026-02-17T11:14:18.647 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.631+0000 7f1fd67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:18.647 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.631+0000 7f1fd67fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:14:18.647 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.631+0000 7f1fd67fc640 10 monclient: dump: 2026-02-17T11:14:18.647 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:18.647 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:18.647 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:18.647 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:18.647 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:18.648 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:18.648 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:18.648 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:18.648 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:18.648 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:18.648 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.631+0000 7f1fd67fc640 10 monclient: _finish_auth 0 2026-02-17T11:14:18.648 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.631+0000 7f1fd67fc640 10 monclient: _check_auth_tickets 2026-02-17T11:14:18.648 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.631+0000 7f1fd67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:14:18.648 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.631+0000 7f1fd67fc640 1 -- 10.20.193.49:0/665313805 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fc802faf0 con 0x7f1fd80c7620 2026-02-17T11:14:18.648 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.631+0000 7f1fddbce640 5 monclient: authenticate success, global_id 4998 2026-02-17T11:14:18.648 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.631+0000 7f1fd67fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:14:18.649 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.631+0000 7f1fddbce640 10 monclient: get_monmap_and_config success 2026-02-17T11:14:18.649 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.631+0000 7f1fddbce640 4 set_mon_vals no callback set 2026-02-17T11:14:18.649 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.631+0000 7f1fd67fc640 1 -- 10.20.193.49:0/665313805 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fc8037440 con 0x7f1fd80c7620 2026-02-17T11:14:18.649 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.631+0000 7f1fd67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:18.649 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.631+0000 7f1fd67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:14:18.649 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.631+0000 7f1fd67fc640 10 monclient: dump: 2026-02-17T11:14:18.649 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:18.649 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:18.649 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:18.649 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:18.649 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:18.649 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:18.650 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:18.650 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:18.650 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:18.650 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:18.650 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.632+0000 7f1fddbce640 10 monclient: shutdown 2026-02-17T11:14:18.650 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.632+0000 7f1fddbce640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:14:18.650 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.632+0000 7f1fddbce640 1 -- 10.20.193.49:0/665313805 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1fd80c7620 msgr2=0x7f1fd8161710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:18.650 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.632+0000 7f1fddbce640 1 --2- 10.20.193.49:0/665313805 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1fd80c7620 0x7f1fd8161710 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1fd8069720 tx=0x7f1fc802ede0 comp rx=0 tx=0).stop 2026-02-17T11:14:18.650 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.632+0000 7f1fddbce640 1 -- 10.20.193.49:0/665313805 shutdown_connections 2026-02-17T11:14:18.650 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.632+0000 7f1fddbce640 1 --2- 10.20.193.49:0/665313805 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1fd80c7620 0x7f1fd8161710 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:18.650 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.632+0000 7f1fddbce640 1 --2- 10.20.193.49:0/665313805 >> v2:10.20.193.97:3300/0 conn(0x7f1fd80c7240 0x7f1fd80726d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:18.651 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.632+0000 7f1fddbce640 1 -- 10.20.193.49:0/665313805 >> 10.20.193.49:0/665313805 conn(0x7f1fd80c9f40 msgr2=0x7f1fd80ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:14:18.651 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.632+0000 7f1fddbce640 1 -- 10.20.193.49:0/665313805 shutdown_connections 2026-02-17T11:14:18.651 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.632+0000 7f1fddbce640 1 -- 10.20.193.49:0/665313805 wait complete. 2026-02-17T11:14:18.651 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.632+0000 7f1fddbce640 10 monclient: build_initial_monmap 2026-02-17T11:14:18.651 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.632+0000 7f1fddbce640 10 monclient: monmap: 2026-02-17T11:14:18.651 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:14:18.651 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:14:18.651 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:14:18.651 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:14:18.651 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:14:18.651 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:18.651 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:14:18.651 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:14:18.652 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:14:18.652 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:18.652 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.633+0000 7f1fddbce640 1 librados: starting msgr at 2026-02-17T11:14:18.652 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.633+0000 7f1fddbce640 1 librados: starting objecter 2026-02-17T11:14:18.652 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.633+0000 7f1fddbce640 1 Processor -- start 2026-02-17T11:14:18.652 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.633+0000 7f1fddbce640 1 -- start start 2026-02-17T11:14:18.652 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.633+0000 7f1fddbce640 1 librados: setting wanted keys 2026-02-17T11:14:18.652 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.633+0000 7f1fddbce640 1 librados: calling monclient init 2026-02-17T11:14:18.652 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.633+0000 7f1fddbce640 10 monclient: init 2026-02-17T11:14:18.652 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.633+0000 7f1fddbce640 10 monclient: _reopen_session rank -1 2026-02-17T11:14:18.652 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.633+0000 7f1fddbce640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:14:18.652 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.633+0000 7f1fddbce640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1fd80c7240 0x7f1fd81633d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:18.653 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.633+0000 7f1fddbce640 10 monclient(hunting): picked mon.noname-a con 0x7f1fd80c7240 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:14:18.653 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.633+0000 7f1fddbce640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f1fd80c7620 0x7f1fd81f61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:18.653 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.633+0000 7f1fddbce640 10 monclient(hunting): picked mon.noname-b con 0x7f1fd80c7620 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:14:18.653 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.633+0000 7f1fddbce640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f1fd8161c50 0x7f1fd81f6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:18.653 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.633+0000 7f1fddbce640 10 monclient(hunting): picked mon.noname-c con 0x7f1fd8161c50 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:14:18.653 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.633+0000 7f1fddbce640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:18.653 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.633+0000 7f1fddbce640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1fd8073940 con 0x7f1fd80c7240 2026-02-17T11:14:18.653 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.633+0000 7f1fddbce640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:18.653 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.633+0000 7f1fddbce640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1fd8073660 con 0x7f1fd80c7620 2026-02-17T11:14:18.653 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.633+0000 7f1fddbce640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:18.653 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.633+0000 7f1fddbce640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f1fd8073c20 con 0x7f1fd8161c50 2026-02-17T11:14:18.653 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.633+0000 7f1fddbce640 10 monclient(hunting): _renew_subs 2026-02-17T11:14:18.654 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.633+0000 7f1fddbce640 10 monclient(hunting): authenticate will time out at 1335.297534s 2026-02-17T11:14:18.654 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.633+0000 7f1fd77fe640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1fd80c7240 0x7f1fd81633d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:18.654 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.633+0000 7f1fd7fff640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f1fd8161c50 0x7f1fd81f6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:18.654 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.633+0000 7f1fd6ffd640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f1fd80c7620 0x7f1fd81f61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:18.654 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.633+0000 7f1fd77fe640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1fd80c7240 0x7f1fd81633d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:43478/0 (socket says 10.20.193.49:43478) 2026-02-17T11:14:18.654 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.633+0000 7f1fd77fe640 1 -- 10.20.193.49:0/2501731100 learned_addr learned my addr 10.20.193.49:0/2501731100 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:14:18.654 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.633+0000 7f1fd77fe640 10 monclient(hunting): get_auth_request con 0x7f1fd80c7240 auth_method 0 2026-02-17T11:14:18.654 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.633+0000 7f1fd77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:18.654 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.633+0000 7f1fd77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:18.654 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.633+0000 7f1fd77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:18.654 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.634+0000 7f1fd6ffd640 10 monclient(hunting): get_auth_request con 0x7f1fd80c7620 auth_method 0 2026-02-17T11:14:18.654 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.634+0000 7f1fd6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:18.655 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.634+0000 7f1fd6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:18.655 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.634+0000 7f1fd6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:18.655 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.634+0000 7f1fd7fff640 10 monclient(hunting): get_auth_request con 0x7f1fd8161c50 auth_method 0 2026-02-17T11:14:18.655 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.634+0000 7f1fd7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:18.655 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.634+0000 7f1fd7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:18.655 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.634+0000 7f1fd7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:18.655 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.634+0000 7f1fd77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:18.655 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.634+0000 7f1fd77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:18.655 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.634+0000 7f1fd77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:18.655 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.634+0000 7f1fd6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:18.655 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.634+0000 7f1fd6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:18.655 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.634+0000 7f1fd6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:18.656 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.634+0000 7f1fd7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:18.656 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.634+0000 7f1fd7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:18.656 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.634+0000 7f1fd7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:18.656 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.635+0000 7f1fd77fe640 10 monclient(hunting): handle_auth_done global_id 5001 payload 824 2026-02-17T11:14:18.656 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.635+0000 7f1fd77fe640 1 -- 10.20.193.49:0/2501731100 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f1fd8161c50 msgr2=0x7f1fd81f6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:18.656 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.635+0000 7f1fd77fe640 1 --2- 10.20.193.49:0/2501731100 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f1fd8161c50 0x7f1fd81f6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:18.656 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.635+0000 7f1fd77fe640 1 -- 10.20.193.49:0/2501731100 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f1fd80c7620 msgr2=0x7f1fd81f61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:18.656 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.635+0000 7f1fd77fe640 1 --2- 10.20.193.49:0/2501731100 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f1fd80c7620 0x7f1fd81f61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:18.656 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.635+0000 7f1fd77fe640 10 monclient: _finish_hunting 0 2026-02-17T11:14:18.656 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.635+0000 7f1fd77fe640 1 monclient: found mon.noname-a 2026-02-17T11:14:18.656 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.635+0000 7f1fd77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:14:18.656 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.635+0000 7f1fd77fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:14:18.656 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.635+0000 7f1fd77fe640 1 -- 10.20.193.49:0/2501731100 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fd81fa400 con 0x7f1fd80c7240 2026-02-17T11:14:18.657 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.636+0000 7f1fd77fe640 1 --2- 10.20.193.49:0/2501731100 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1fd80c7240 0x7f1fd81633d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1fc400e8c0 tx=0x7f1fc400ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:14:18.657 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.636+0000 7f1fb3fff640 10 client.?.objecter ms_handle_connect 0x7f1fd80c7240 2026-02-17T11:14:18.657 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.636+0000 7f1fb3fff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:14:18.657 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.636+0000 7f1fd77fe640 1 -- 10.20.193.49:0/2501731100 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1fd80c7240 msgr2=0x7f1fd81633d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T11:14:18.657 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.636+0000 7f1fd77fe640 1 -- 10.20.193.49:0/2501731100 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1fd80c7240 msgr2=0x7f1fd81633d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:14:18.657 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.636+0000 7f1fd77fe640 1 --2- 10.20.193.49:0/2501731100 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1fd80c7240 0x7f1fd81633d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1fc400e8c0 tx=0x7f1fc400ed90 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:14:18.657 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.636+0000 7f1fd77fe640 1 --2- 10.20.193.49:0/2501731100 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1fd80c7240 0x7f1fd81633d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1fc400e8c0 tx=0x7f1fc400ed90 comp rx=0 tx=0).stop 2026-02-17T11:14:18.657 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.636+0000 7f1fb3fff640 10 monclient: ms_handle_reset current mon [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:14:18.657 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.636+0000 7f1fb3fff640 10 monclient: _reopen_session rank -1 2026-02-17T11:14:18.657 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.636+0000 7f1fb3fff640 1 -- 10.20.193.49:0/2501731100 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1fd80c7240 msgr2=0x7f1fd81633d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T11:14:18.657 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.636+0000 7f1fb3fff640 1 --2- 10.20.193.49:0/2501731100 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1fd80c7240 0x7f1fd81633d0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:18.657 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.636+0000 7f1fb3fff640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:14:18.658 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.636+0000 7f1fb3fff640 1 --2- 10.20.193.49:0/2501731100 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f1fd8161c50 0x7f1fa8006f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:18.658 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.636+0000 7f1fb3fff640 10 monclient(hunting): picked mon.noname-c con 0x7f1fd8161c50 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:14:18.658 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.636+0000 7f1fb3fff640 1 --2- 10.20.193.49:0/2501731100 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f1fd80c7620 0x7f1fa8009a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:18.658 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.636+0000 7f1fb3fff640 10 monclient(hunting): picked mon.noname-b con 0x7f1fd80c7620 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:14:18.658 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.636+0000 7f1fb3fff640 1 --2- 10.20.193.49:0/2501731100 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1fa800a470 0x7f1fa800c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:18.658 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.636+0000 7f1fb3fff640 10 monclient(hunting): picked mon.noname-a con 0x7f1fa800a470 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:14:18.658 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.636+0000 7f1fb3fff640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:18.658 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.636+0000 7f1fb3fff640 1 -- 10.20.193.49:0/2501731100 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa800d400 con 0x7f1fa800a470 2026-02-17T11:14:18.658 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.636+0000 7f1fb3fff640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:18.658 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.636+0000 7f1fb3fff640 1 -- 10.20.193.49:0/2501731100 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa800d5b0 con 0x7f1fd80c7620 2026-02-17T11:14:18.658 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.636+0000 7f1fb3fff640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:18.658 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.636+0000 7f1fb3fff640 1 -- 10.20.193.49:0/2501731100 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa800d7b0 con 0x7f1fd8161c50 2026-02-17T11:14:18.659 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.636+0000 7f1fb3fff640 10 monclient(hunting): _renew_subs 2026-02-17T11:14:18.659 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.637+0000 7f1fd6ffd640 1 --2- 10.20.193.49:0/2501731100 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f1fd80c7620 0x7f1fa8009a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:18.659 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.637+0000 7f1fd77fe640 1 --2- 10.20.193.49:0/2501731100 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f1fd8161c50 0x7f1fa8006f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:18.659 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.637+0000 7f1fd6ffd640 10 monclient(hunting): get_auth_request con 0x7f1fd80c7620 auth_method 0 2026-02-17T11:14:18.659 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.637+0000 7f1fd6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:18.659 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.637+0000 7f1fd6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:18.659 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.637+0000 7f1fd6ffd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:14:18.659 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.637+0000 7f1fd77fe640 10 monclient(hunting): get_auth_request con 0x7f1fd8161c50 auth_method 0 2026-02-17T11:14:18.659 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.637+0000 7f1fd77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:18.659 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.637+0000 7f1fd77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:18.659 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.637+0000 7f1fd77fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:14:18.659 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.637+0000 7f1fd6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:18.659 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.637+0000 7f1fd6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:18.660 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.637+0000 7f1fd6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:14:18.660 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.637+0000 7f1fd77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:18.660 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.637+0000 7f1fd77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:18.660 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.637+0000 7f1fd77fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:14:18.660 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.638+0000 7f1fd6ffd640 10 monclient(hunting): handle_auth_done global_id 5001 payload 293 2026-02-17T11:14:18.660 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.638+0000 7f1fd6ffd640 1 -- 10.20.193.49:0/2501731100 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f1fd8161c50 msgr2=0x7f1fa8006f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:18.660 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.638+0000 7f1fd6ffd640 1 --2- 10.20.193.49:0/2501731100 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f1fd8161c50 0x7f1fa8006f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:18.660 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.638+0000 7f1fd7fff640 1 --2- 10.20.193.49:0/2501731100 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1fa800a470 0x7f1fa800c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:18.660 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.638+0000 7f1fd6ffd640 1 -- 10.20.193.49:0/2501731100 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1fa800a470 msgr2=0x7f1fa800c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:18.660 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.638+0000 7f1fd6ffd640 1 --2- 10.20.193.49:0/2501731100 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1fa800a470 0x7f1fa800c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:18.660 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.638+0000 7f1fd6ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:14:18.660 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.638+0000 7f1fd6ffd640 1 monclient: found mon.noname-b 2026-02-17T11:14:18.661 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.638+0000 7f1fd6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:14:18.661 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.638+0000 7f1fd6ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:14:18.661 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.638+0000 7f1fd6ffd640 1 -- 10.20.193.49:0/2501731100 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fa800da70 con 0x7f1fd80c7620 2026-02-17T11:14:18.661 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.639+0000 7f1fd6ffd640 1 --2- 10.20.193.49:0/2501731100 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f1fd80c7620 0x7f1fa8009a10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1fc8036000 tx=0x7f1fc4009290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:14:18.661 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.639+0000 7f1fb3fff640 10 client.?.objecter ms_handle_connect 0x7f1fd80c7620 2026-02-17T11:14:18.661 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.639+0000 7f1fb3fff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:14:18.661 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.640+0000 7f1fb3fff640 1 -- 10.20.193.49:0/2501731100 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fc8046020 con 0x7f1fd80c7620 2026-02-17T11:14:18.661 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.640+0000 7f1fb3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:18.661 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.640+0000 7f1fb3fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:14:18.661 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.640+0000 7f1fb3fff640 10 monclient: dump: 2026-02-17T11:14:18.661 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:18.661 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:18.662 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:18.662 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:18.662 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:18.662 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:18.662 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:18.662 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:18.662 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:18.662 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:18.662 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.640+0000 7f1fb3fff640 10 monclient: _finish_auth 0 2026-02-17T11:14:18.662 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.640+0000 7f1fb3fff640 10 monclient: _check_auth_tickets 2026-02-17T11:14:18.662 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.640+0000 7f1fb3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:14:18.662 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.640+0000 7f1fddbce640 5 monclient: authenticate success, global_id 5001 2026-02-17T11:14:18.663 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.640+0000 7f1fddbce640 10 monclient: _renew_subs 2026-02-17T11:14:18.663 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.640+0000 7f1fddbce640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:14:18.663 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.640+0000 7f1fddbce640 1 -- 10.20.193.49:0/2501731100 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fd81fa6e0 con 0x7f1fd80c7620 2026-02-17T11:14:18.663 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.640+0000 7f1fddbce640 10 client.5001.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:14:18.663 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.640+0000 7f1fddbce640 10 monclient: _renew_subs 2026-02-17T11:14:18.663 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.640+0000 7f1fddbce640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:14:18.663 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.640+0000 7f1fddbce640 1 -- 10.20.193.49:0/2501731100 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fd81faca0 con 0x7f1fd80c7620 2026-02-17T11:14:18.663 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.640+0000 7f1fddbce640 1 librados: init done 2026-02-17T11:14:18.663 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.640+0000 7f1fb3fff640 1 -- 10.20.193.49:0/2501731100 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fc802faa0 con 0x7f1fd80c7620 2026-02-17T11:14:18.663 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.640+0000 7f1fb3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:14:18.663 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.640+0000 7f1fb3fff640 1 -- 10.20.193.49:0/2501731100 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fc803c040 con 0x7f1fd80c7620 2026-02-17T11:14:18.663 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.640+0000 7f1fb3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:18.664 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.640+0000 7f1fb3fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:14:18.664 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.640+0000 7f1fb3fff640 10 monclient: dump: 2026-02-17T11:14:18.664 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:18.664 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:18.664 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:18.664 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:18.664 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:18.664 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:18.664 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:18.664 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:18.664 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:18.664 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:18.665 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.640+0000 7f1fd5ffb640 4 set_mon_vals no callback set 2026-02-17T11:14:18.665 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.640+0000 7f1fddbce640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:14:18.665 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.640+0000 7f1fddbce640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:14:18.665 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.640+0000 7f1fddbce640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:14:18.665 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.640+0000 7f1fddbce640 1 -- 10.20.193.49:0/2501731100 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fd8163b90 con 0x7f1fd80c7620 2026-02-17T11:14:18.723 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.721+0000 7f1fb3fff640 1 -- 10.20.193.49:0/2501731100 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f1fc8004220 con 0x7f1fd80c7620 2026-02-17T11:14:18.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.721+0000 7f1fb3fff640 1 --2- 10.20.193.49:0/2501731100 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f1fd80c7240 0x7f1fa8083750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:18.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.722+0000 7f1fd77fe640 1 --2- 10.20.193.49:0/2501731100 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f1fd80c7240 0x7f1fa8083750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:18.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.722+0000 7f1fd77fe640 10 monclient: get_auth_request con 0x7f1fd80c7240 auth_method 0 2026-02-17T11:14:18.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.722+0000 7f1fd77fe640 1 --2- 10.20.193.49:0/2501731100 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f1fd80c7240 0x7f1fa8083750 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1fc400edd0 tx=0x7f1fc4020040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:14:18.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.722+0000 7f1fb3fff640 10 client.5001.objecter ms_handle_connect 0x7f1fd80c7240 2026-02-17T11:14:18.747 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.746+0000 7f1fb3fff640 1 -- 10.20.193.49:0/2501731100 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f1fc8004540 con 0x7f1fd80c7620 2026-02-17T11:14:18.747 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.746+0000 7f1fb3fff640 10 client.5001.objecter ms_dispatch2 0x7f1fd8000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:14:18.747 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.746+0000 7f1fb3fff640 3 client.5001.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:14:18.747 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.746+0000 7f1fb3fff640 3 client.5001.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:14:18.747 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.746+0000 7f1fb3fff640 20 client.5001.objecter dump_active .. 0 homeless 2026-02-17T11:14:18.754 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.752+0000 7f1fb3fff640 1 -- 10.20.193.49:0/2501731100 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f1fc8086130 con 0x7f1fd80c7620 2026-02-17T11:14:18.754 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.752+0000 7f1fb3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:14:18.754 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.752+0000 7f1fb3fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:14:18.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.851+0000 7f1fddbce640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:14:18.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.851+0000 7f1fddbce640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:14:18.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.851+0000 7f1fddbce640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:14:18.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.851+0000 7f1fddbce640 1 -- 10.20.193.49:0/2501731100 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f1fd80726d0 con 0x7f1fd80c7620 2026-02-17T11:14:18.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.854+0000 7f1fb3fff640 1 -- 10.20.193.49:0/2501731100 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f1fc808a430 con 0x7f1fd80c7620 2026-02-17T11:14:18.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.854+0000 7f1fb3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:14:18.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.854+0000 7f1fb3fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:14:18.857 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:14:18.857 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:14:18.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.855+0000 7f1fddbce640 10 librados: watch_flush enter 2026-02-17T11:14:18.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.855+0000 7f1fddbce640 10 librados: watch_flush exit 2026-02-17T11:14:18.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.855+0000 7f1fddbce640 20 client.5001.objecter shutdown clearing up homeless session... 2026-02-17T11:14:18.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.855+0000 7f1fddbce640 10 client.5001.objecter successfully canceled tick 2026-02-17T11:14:18.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.855+0000 7f1fddbce640 1 -- 10.20.193.49:0/2501731100 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f1fd80c7240 msgr2=0x7f1fa8083750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:18.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.855+0000 7f1fddbce640 1 --2- 10.20.193.49:0/2501731100 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f1fd80c7240 0x7f1fa8083750 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1fc400edd0 tx=0x7f1fc4020040 comp rx=0 tx=0).stop 2026-02-17T11:14:18.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.855+0000 7f1fddbce640 10 monclient: shutdown 2026-02-17T11:14:18.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.855+0000 7f1fddbce640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:14:18.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.855+0000 7f1fddbce640 1 -- 10.20.193.49:0/2501731100 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f1fd80c7620 msgr2=0x7f1fa8009a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:18.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.855+0000 7f1fddbce640 1 --2- 10.20.193.49:0/2501731100 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f1fd80c7620 0x7f1fa8009a10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1fc8036000 tx=0x7f1fc4009290 comp rx=0 tx=0).stop 2026-02-17T11:14:18.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.855+0000 7f1fddbce640 1 -- 10.20.193.49:0/2501731100 shutdown_connections 2026-02-17T11:14:18.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.855+0000 7f1fddbce640 1 --2- 10.20.193.49:0/2501731100 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f1fd80c7240 0x7f1fa8083750 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:18.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.855+0000 7f1fddbce640 1 --2- 10.20.193.49:0/2501731100 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1fa800a470 0x7f1fa800c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:18.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.855+0000 7f1fddbce640 1 --2- 10.20.193.49:0/2501731100 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f1fd80c7620 0x7f1fa8009a10 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:18.860 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.855+0000 7f1fddbce640 1 --2- 10.20.193.49:0/2501731100 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f1fd8161c50 0x7f1fa8006f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:18.860 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.855+0000 7f1fddbce640 1 -- 10.20.193.49:0/2501731100 >> 10.20.193.49:0/2501731100 conn(0x7f1fd80c9f40 msgr2=0x7f1fd806d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:14:18.860 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.855+0000 7f1fddbce640 1 -- 10.20.193.49:0/2501731100 shutdown_connections 2026-02-17T11:14:18.860 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.855+0000 7f1fddbce640 1 -- 10.20.193.49:0/2501731100 wait complete. 2026-02-17T11:14:18.860 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:18.855+0000 7f1fddbce640 1 librados: shutdown 2026-02-17T11:14:21.867 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:14:21.937 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.935+0000 7efee5de4640 10 monclient: get_monmap_and_config 2026-02-17T11:14:21.937 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.935+0000 7efee5de4640 10 monclient: build_initial_monmap 2026-02-17T11:14:21.937 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.935+0000 7efee5de4640 10 monclient: monmap: 2026-02-17T11:14:21.937 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:14:21.937 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:21.937 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:14:21.935736+0000 2026-02-17T11:14:21.937 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:14:21.935736+0000 2026-02-17T11:14:21.937 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:14:21.938 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:21.938 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:14:21.938 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:14:21.938 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:14:21.938 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:14:21.938 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:14:21.938 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:14:21.938 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:21.938 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.935+0000 7efee5de4640 1 Processor -- start 2026-02-17T11:14:21.938 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.935+0000 7efee5de4640 1 -- start start 2026-02-17T11:14:21.938 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.935+0000 7efee5de4640 10 monclient: init 2026-02-17T11:14:21.940 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.936+0000 7efee5de4640 10 monclient: _reopen_session rank -1 2026-02-17T11:14:21.941 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.936+0000 7efee5de4640 10 monclient: _add_conns ranks=[1,0,2,5,3,4] 2026-02-17T11:14:21.941 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.936+0000 7efee5de4640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7efee015d370 addr v1:10.20.193.97:6789/0 2026-02-17T11:14:21.941 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.936+0000 7efee5de4640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7efee00c7e20 addr v1:10.20.193.49:6789/0 2026-02-17T11:14:21.941 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.936+0000 7efee5de4640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7efee00c59c0 addr v1:10.20.193.157:6789/0 2026-02-17T11:14:21.941 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.936+0000 7efee5de4640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efee00c8350 con 0x7efee00c7e20 2026-02-17T11:14:21.941 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.936+0000 7efee5de4640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efee00c8630 con 0x7efee015d370 2026-02-17T11:14:21.941 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.936+0000 7efee5de4640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efee00c8910 con 0x7efee00c59c0 2026-02-17T11:14:21.941 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.936+0000 7efee5de4640 10 monclient(hunting): _renew_subs 2026-02-17T11:14:21.941 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.936+0000 7efee5de4640 10 monclient(hunting): authenticate will time out at 1338.599222s 2026-02-17T11:14:21.941 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.936+0000 7efedf7fe640 1 --1- >> v1:10.20.193.97:6789/0 conn(0x7efee015d370 0x7efee015b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.97:6789/0 says I am v1:10.20.193.49:50444/0 (socket says 10.20.193.49:50444) 2026-02-17T11:14:21.941 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.936+0000 7efedf7fe640 1 -- 10.20.193.49:0/3666555904 learned_addr learned my addr 10.20.193.49:0/3666555904 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:14:21.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.938+0000 7efede7fc640 1 -- 10.20.193.49:0/3666555904 <== mon.2 v1:10.20.193.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 523919967 0 0) 0x7efee00c8910 con 0x7efee00c59c0 2026-02-17T11:14:21.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.938+0000 7efede7fc640 10 monclient(hunting): _negotiate 2026-02-17T11:14:21.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.938+0000 7efede7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:21.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.938+0000 7efede7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:21.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.938+0000 7efede7fc640 10 monclient(hunting): my global_id is 5021 2026-02-17T11:14:21.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.938+0000 7efede7fc640 1 -- 10.20.193.49:0/3666555904 --> v1:10.20.193.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efec4003620 con 0x7efee00c59c0 2026-02-17T11:14:21.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.938+0000 7efede7fc640 1 -- 10.20.193.49:0/3666555904 <== mon.1 v1:10.20.193.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3986942259 0 0) 0x7efee00c8630 con 0x7efee015d370 2026-02-17T11:14:21.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.938+0000 7efede7fc640 10 monclient(hunting): _negotiate 2026-02-17T11:14:21.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.938+0000 7efede7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:21.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.938+0000 7efede7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:21.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.938+0000 7efede7fc640 10 monclient(hunting): my global_id is 4981 2026-02-17T11:14:21.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.938+0000 7efede7fc640 1 -- 10.20.193.49:0/3666555904 --> v1:10.20.193.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efee00c8910 con 0x7efee015d370 2026-02-17T11:14:21.943 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.938+0000 7efede7fc640 1 -- 10.20.193.49:0/3666555904 <== mon.0 v1:10.20.193.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2078738310 0 0) 0x7efee00c8350 con 0x7efee00c7e20 2026-02-17T11:14:21.943 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.938+0000 7efede7fc640 10 monclient(hunting): _negotiate 2026-02-17T11:14:21.943 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.938+0000 7efede7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:21.943 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.938+0000 7efede7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:21.943 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.938+0000 7efede7fc640 10 monclient(hunting): my global_id is 5004 2026-02-17T11:14:21.943 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.938+0000 7efede7fc640 1 -- 10.20.193.49:0/3666555904 --> v1:10.20.193.49:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efee00c8630 con 0x7efee00c7e20 2026-02-17T11:14:21.955 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.939+0000 7efede7fc640 1 -- 10.20.193.49:0/3666555904 <== mon.1 v1:10.20.193.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1905162450 0 0) 0x7efee00c8910 con 0x7efee015d370 2026-02-17T11:14:21.955 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.939+0000 7efede7fc640 1 -- 10.20.193.49:0/3666555904 >> v1:10.20.193.157:6789/0 conn(0x7efee00c59c0 legacy=0x7efee0153480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:21.955 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.939+0000 7efede7fc640 1 -- 10.20.193.49:0/3666555904 >> v1:10.20.193.49:6789/0 conn(0x7efee00c7e20 legacy=0x7efee00c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:21.955 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.939+0000 7efede7fc640 10 monclient: _finish_hunting 0 2026-02-17T11:14:21.955 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.939+0000 7efede7fc640 1 monclient: found mon.noname-b-legacy 2026-02-17T11:14:21.955 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.939+0000 7efede7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:14:21.955 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.939+0000 7efede7fc640 10 monclient: _send_mon_message to mon.noname-b-legacy at v1:10.20.193.97:6789/0 2026-02-17T11:14:21.955 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.939+0000 7efede7fc640 1 -- 10.20.193.49:0/3666555904 --> v1:10.20.193.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efee00c8bf0 con 0x7efee015d370 2026-02-17T11:14:21.956 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.939+0000 7efede7fc640 10 monclient: _finish_auth 0 2026-02-17T11:14:21.956 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.939+0000 7efede7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:14:21.956 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.939+0000 7efede7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:14:21.956 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.939+0000 7efede7fc640 1 -- 10.20.193.49:0/3666555904 <== mon.1 v1:10.20.193.97:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2462710995 0 0) 0x7efecc002ee0 con 0x7efee015d370 2026-02-17T11:14:21.956 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.939+0000 7efee5de4640 5 monclient: authenticate success, global_id 4981 2026-02-17T11:14:21.956 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.939+0000 7efede7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:21.956 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.939+0000 7efede7fc640 10 monclient: got monmap 1 from mon.noname-b-legacy (according to old e1) 2026-02-17T11:14:21.956 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.939+0000 7efede7fc640 10 monclient: dump: 2026-02-17T11:14:21.956 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:21.956 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:21.956 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:21.957 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:21.957 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:21.957 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:21.957 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:21.957 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:21.957 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:21.957 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:21.957 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.939+0000 7efede7fc640 1 monclient: mon.b has (v2) addrs [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] but i'm connected to v1:10.20.193.97:6789/0, reconnecting 2026-02-17T11:14:21.957 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.939+0000 7efede7fc640 10 monclient: _reopen_session rank -1 2026-02-17T11:14:21.957 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.939+0000 7efede7fc640 1 -- 10.20.193.49:0/3666555904 >> v1:10.20.193.97:6789/0 conn(0x7efee015d370 legacy=0x7efee015b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:21.957 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.939+0000 7efede7fc640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:14:21.957 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.939+0000 7efede7fc640 1 --2- 10.20.193.49:0/3666555904 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7efec4005040 0x7efec40038a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:21.958 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.939+0000 7efede7fc640 10 monclient(hunting): picked mon.a con 0x7efec4005040 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:14:21.958 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.939+0000 7efede7fc640 1 --2- 10.20.193.49:0/3666555904 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7efec4003de0 0x7efec4004260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:21.958 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.939+0000 7efede7fc640 10 monclient(hunting): picked mon.c con 0x7efec4003de0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:14:21.958 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.939+0000 7efede7fc640 1 --2- 10.20.193.49:0/3666555904 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7efec4009ab0 0x7efec400bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:21.958 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.939+0000 7efede7fc640 10 monclient(hunting): picked mon.b con 0x7efec4009ab0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:14:21.958 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.939+0000 7efede7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:21.958 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.939+0000 7efede7fc640 1 -- 10.20.193.49:0/3666555904 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7efec400c570 con 0x7efec4005040 2026-02-17T11:14:21.958 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.939+0000 7efede7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:21.958 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.939+0000 7efede7fc640 1 -- 10.20.193.49:0/3666555904 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7efec400c6f0 con 0x7efec4009ab0 2026-02-17T11:14:21.958 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.939+0000 7efede7fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:21.958 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.939+0000 7efede7fc640 1 -- 10.20.193.49:0/3666555904 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7efec400c8f0 con 0x7efec4003de0 2026-02-17T11:14:21.958 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.940+0000 7efede7fc640 10 monclient(hunting): _renew_subs 2026-02-17T11:14:21.959 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.940+0000 7efede7fc640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:14:21.959 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.940+0000 7efee5de4640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2026-02-17T11:14:21.959 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.940+0000 7efedeffd640 1 --2- 10.20.193.49:0/3666555904 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7efec4003de0 0x7efec4004260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:21.959 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.940+0000 7efedf7fe640 1 --2- 10.20.193.49:0/3666555904 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7efec4005040 0x7efec40038a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:21.959 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.940+0000 7efedf7fe640 10 monclient(hunting): get_auth_request con 0x7efec4005040 auth_method 0 2026-02-17T11:14:21.959 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.940+0000 7efedf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:21.959 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.940+0000 7efedf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:21.959 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.940+0000 7efedf7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:14:21.959 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.941+0000 7efedeffd640 10 monclient(hunting): get_auth_request con 0x7efec4003de0 auth_method 0 2026-02-17T11:14:21.959 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.941+0000 7efedeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:21.959 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.941+0000 7efedeffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:21.959 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.941+0000 7efedeffd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:14:21.960 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.941+0000 7efedf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:21.960 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.941+0000 7efedf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:21.960 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.941+0000 7efedf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:14:21.960 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.941+0000 7efedffff640 1 --2- 10.20.193.49:0/3666555904 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7efec4009ab0 0x7efec400bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:21.960 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.941+0000 7efedffff640 10 monclient(hunting): get_auth_request con 0x7efec4009ab0 auth_method 0 2026-02-17T11:14:21.960 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.941+0000 7efedffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:21.960 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.941+0000 7efedffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:21.960 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.941+0000 7efedffff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:14:21.960 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.941+0000 7efedeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:21.960 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.941+0000 7efedeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:21.960 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.941+0000 7efedeffd640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:14:21.960 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.941+0000 7efedffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:21.960 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.941+0000 7efedffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:21.961 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.941+0000 7efedffff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:14:21.961 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.942+0000 7efedf7fe640 10 monclient(hunting): handle_auth_done global_id 4981 payload 293 2026-02-17T11:14:21.961 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.942+0000 7efedf7fe640 1 -- 10.20.193.49:0/3666555904 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7efec4003de0 msgr2=0x7efec4004260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:14:21.961 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.942+0000 7efedf7fe640 1 --2- 10.20.193.49:0/3666555904 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7efec4003de0 0x7efec4004260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:21.961 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.942+0000 7efedf7fe640 1 -- 10.20.193.49:0/3666555904 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7efec4009ab0 msgr2=0x7efec400bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:14:21.961 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.942+0000 7efedf7fe640 1 --2- 10.20.193.49:0/3666555904 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7efec4009ab0 0x7efec400bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:21.961 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.942+0000 7efedf7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:14:21.961 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.942+0000 7efedf7fe640 1 monclient: found mon.a 2026-02-17T11:14:21.961 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.942+0000 7efedffff640 1 -- 10.20.193.49:0/3666555904 reap_dead start 2026-02-17T11:14:21.961 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.942+0000 7efedf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:14:21.961 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.942+0000 7efedf7fe640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:14:21.961 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.942+0000 7efedf7fe640 1 -- 10.20.193.49:0/3666555904 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efee00c8910 con 0x7efec4005040 2026-02-17T11:14:21.962 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.942+0000 7efedf7fe640 10 monclient: _finish_auth 0 2026-02-17T11:14:21.962 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.942+0000 7efedf7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:14:21.962 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.942+0000 7efedf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:14:21.962 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.943+0000 7efedf7fe640 1 --2- 10.20.193.49:0/3666555904 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7efec4005040 0x7efec40038a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7efecc00c190 tx=0x7efecc02f4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4247bcacde4a19f2 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:14:21.962 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.944+0000 7efede7fc640 1 -- 10.20.193.49:0/3666555904 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efecc007c80 con 0x7efec4005040 2026-02-17T11:14:21.962 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.944+0000 7efede7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:21.962 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.944+0000 7efede7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:14:21.962 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.944+0000 7efede7fc640 10 monclient: dump: 2026-02-17T11:14:21.962 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:21.962 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:21.962 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:21.962 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:21.962 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:21.963 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:21.963 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:21.963 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:21.963 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:21.963 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:21.963 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.944+0000 7efee5de4640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:14:21.963 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.944+0000 7efede7fc640 1 -- 10.20.193.49:0/3666555904 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efecc033030 con 0x7efec4005040 2026-02-17T11:14:21.963 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.944+0000 7efede7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:14:21.963 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.944+0000 7efede7fc640 1 -- 10.20.193.49:0/3666555904 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efecc005bf0 con 0x7efec4005040 2026-02-17T11:14:21.963 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.944+0000 7efede7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:21.963 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.944+0000 7efede7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:14:21.963 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.944+0000 7efede7fc640 10 monclient: dump: 2026-02-17T11:14:21.964 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:21.964 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:21.964 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:21.964 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:21.964 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:21.964 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:21.964 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:21.964 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:21.964 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:21.964 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:21.964 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.944+0000 7efee5de4640 10 monclient: get_monmap_and_config success 2026-02-17T11:14:21.964 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.944+0000 7efee5de4640 4 set_mon_vals no callback set 2026-02-17T11:14:21.965 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.945+0000 7efee5de4640 10 monclient: shutdown 2026-02-17T11:14:21.965 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.945+0000 7efee5de4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:14:21.965 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.945+0000 7efee5de4640 1 -- 10.20.193.49:0/3666555904 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7efec4005040 msgr2=0x7efec40038a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:21.965 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.945+0000 7efee5de4640 1 --2- 10.20.193.49:0/3666555904 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7efec4005040 0x7efec40038a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7efecc00c190 tx=0x7efecc02f4c0 comp rx=0 tx=0).stop 2026-02-17T11:14:21.965 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.945+0000 7efee5de4640 1 -- 10.20.193.49:0/3666555904 shutdown_connections 2026-02-17T11:14:21.965 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.945+0000 7efee5de4640 1 --2- 10.20.193.49:0/3666555904 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7efec4005040 0x7efec40038a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:21.965 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.945+0000 7efee5de4640 1 -- 10.20.193.49:0/3666555904 >> 10.20.193.49:0/3666555904 conn(0x7efee00c9f20 msgr2=0x7efee00ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:14:21.965 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.945+0000 7efee5de4640 1 -- 10.20.193.49:0/3666555904 shutdown_connections 2026-02-17T11:14:21.965 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.945+0000 7efee5de4640 1 -- 10.20.193.49:0/3666555904 wait complete. 2026-02-17T11:14:21.965 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.945+0000 7efee5de4640 10 monclient: build_initial_monmap 2026-02-17T11:14:21.965 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.945+0000 7efee5de4640 10 monclient: monmap: 2026-02-17T11:14:21.965 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:14:21.965 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:14:21.965 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:14:21.966 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:14:21.966 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:14:21.966 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:21.966 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:14:21.966 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:14:21.966 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:14:21.966 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:21.966 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.946+0000 7efee5de4640 1 librados: starting msgr at 2026-02-17T11:14:21.966 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.946+0000 7efee5de4640 1 librados: starting objecter 2026-02-17T11:14:21.966 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.946+0000 7efee5de4640 1 Processor -- start 2026-02-17T11:14:21.966 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.946+0000 7efee5de4640 1 -- start start 2026-02-17T11:14:21.966 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.946+0000 7efee5de4640 1 librados: setting wanted keys 2026-02-17T11:14:21.966 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.946+0000 7efee5de4640 1 librados: calling monclient init 2026-02-17T11:14:21.966 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.946+0000 7efee5de4640 10 monclient: init 2026-02-17T11:14:21.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.946+0000 7efee5de4640 10 monclient: _reopen_session rank -1 2026-02-17T11:14:21.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.946+0000 7efee5de4640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:14:21.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.946+0000 7efee5de4640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7efec4005040 0x7efee01f3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:21.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.946+0000 7efee5de4640 10 monclient(hunting): picked mon.noname-b con 0x7efec4005040 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:14:21.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.946+0000 7efee5de4640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7efee01f43d0 0x7efee01432e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:21.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.946+0000 7efee5de4640 10 monclient(hunting): picked mon.noname-a con 0x7efee01f43d0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:14:21.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.946+0000 7efee5de4640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7efee0143820 0x7efee01f5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:21.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.946+0000 7efee5de4640 10 monclient(hunting): picked mon.noname-c con 0x7efee0143820 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:14:21.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.946+0000 7efee5de4640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:21.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.946+0000 7efee5de4640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7efee00c96d0 con 0x7efee01f43d0 2026-02-17T11:14:21.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.946+0000 7efee5de4640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:21.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.946+0000 7efee5de4640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7efee00c9240 con 0x7efec4005040 2026-02-17T11:14:21.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.946+0000 7efee5de4640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:21.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.946+0000 7efee5de4640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7efee00cccb0 con 0x7efee0143820 2026-02-17T11:14:21.968 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.946+0000 7efee5de4640 10 monclient(hunting): _renew_subs 2026-02-17T11:14:21.968 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.946+0000 7efee5de4640 10 monclient(hunting): authenticate will time out at 1338.609843s 2026-02-17T11:14:21.968 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.947+0000 7efedeffd640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7efee01f43d0 0x7efee01432e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:21.968 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.947+0000 7efedffff640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7efee0143820 0x7efee01f5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:21.968 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.947+0000 7efedf7fe640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7efec4005040 0x7efee01f3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:21.968 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.947+0000 7efedeffd640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7efee01f43d0 0x7efee01432e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:43502/0 (socket says 10.20.193.49:43502) 2026-02-17T11:14:21.968 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.947+0000 7efedeffd640 1 -- 10.20.193.49:0/3981309037 learned_addr learned my addr 10.20.193.49:0/3981309037 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:14:21.968 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.947+0000 7efedeffd640 10 monclient(hunting): get_auth_request con 0x7efee01f43d0 auth_method 0 2026-02-17T11:14:21.968 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.947+0000 7efedeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:21.968 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.947+0000 7efedeffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:21.968 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.947+0000 7efedeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:21.968 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.947+0000 7efedffff640 10 monclient(hunting): get_auth_request con 0x7efee0143820 auth_method 0 2026-02-17T11:14:21.968 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.947+0000 7efedffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:21.969 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.947+0000 7efedffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:21.969 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.947+0000 7efedffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:21.969 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.947+0000 7efedf7fe640 10 monclient(hunting): get_auth_request con 0x7efec4005040 auth_method 0 2026-02-17T11:14:21.969 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.947+0000 7efedf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:21.969 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.947+0000 7efedf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:21.969 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.947+0000 7efedf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:21.969 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.947+0000 7efedeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:21.969 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.947+0000 7efedeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:21.969 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.947+0000 7efedeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:21.969 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.947+0000 7efedffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:21.970 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.947+0000 7efedffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:21.970 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.947+0000 7efedffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:21.970 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.947+0000 7efedf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:21.970 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.947+0000 7efedf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:21.970 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.947+0000 7efedf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:21.970 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.948+0000 7efedffff640 10 monclient(hunting): handle_auth_done global_id 5024 payload 824 2026-02-17T11:14:21.970 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.949+0000 7efedffff640 1 -- 10.20.193.49:0/3981309037 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7efec4005040 msgr2=0x7efee01f3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:21.970 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.949+0000 7efedffff640 1 --2- 10.20.193.49:0/3981309037 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7efec4005040 0x7efee01f3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:21.970 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.949+0000 7efedffff640 1 -- 10.20.193.49:0/3981309037 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7efee01f43d0 msgr2=0x7efee01432e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:21.971 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.949+0000 7efedffff640 1 --2- 10.20.193.49:0/3981309037 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7efee01f43d0 0x7efee01432e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:21.971 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.949+0000 7efedffff640 10 monclient: _finish_hunting 0 2026-02-17T11:14:21.971 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.949+0000 7efedffff640 1 monclient: found mon.noname-c 2026-02-17T11:14:21.971 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.949+0000 7efedffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:14:21.971 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.949+0000 7efedffff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:14:21.971 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.949+0000 7efedffff640 1 -- 10.20.193.49:0/3981309037 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efee01f4850 con 0x7efee0143820 2026-02-17T11:14:21.971 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.950+0000 7efedffff640 1 --2- 10.20.193.49:0/3981309037 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7efee0143820 0x7efee01f5030 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7efee00722e0 tx=0x7efed400f5a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:14:21.971 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.950+0000 7efebbfff640 10 client.?.objecter ms_handle_connect 0x7efee0143820 2026-02-17T11:14:21.971 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.950+0000 7efebbfff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:14:21.971 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.951+0000 7efebbfff640 1 -- 10.20.193.49:0/3981309037 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed4017020 con 0x7efee0143820 2026-02-17T11:14:21.972 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.951+0000 7efebbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:21.972 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.951+0000 7efebbfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:14:21.972 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.951+0000 7efebbfff640 10 monclient: dump: 2026-02-17T11:14:21.972 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:21.972 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:21.972 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:21.972 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:21.972 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:21.972 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:21.972 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:21.973 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:21.973 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:21.973 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:21.973 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.951+0000 7efebbfff640 10 monclient: _finish_auth 0 2026-02-17T11:14:21.973 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.951+0000 7efebbfff640 10 monclient: _check_auth_tickets 2026-02-17T11:14:21.973 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.951+0000 7efebbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:14:21.973 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.951+0000 7efebbfff640 1 -- 10.20.193.49:0/3981309037 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efed4005910 con 0x7efee0143820 2026-02-17T11:14:21.973 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.951+0000 7efebbfff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:14:21.973 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.951+0000 7efebbfff640 1 -- 10.20.193.49:0/3981309037 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed40133f0 con 0x7efee0143820 2026-02-17T11:14:21.973 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.951+0000 7efebbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:21.974 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.951+0000 7efebbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:14:21.974 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.951+0000 7efebbfff640 10 monclient: dump: 2026-02-17T11:14:21.974 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:21.974 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:21.974 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:21.974 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:21.974 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:21.974 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:21.974 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:21.974 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:21.974 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:21.975 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:21.975 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.951+0000 7efeddffb640 4 set_mon_vals no callback set 2026-02-17T11:14:21.975 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.951+0000 7efee5de4640 5 monclient: authenticate success, global_id 5024 2026-02-17T11:14:21.975 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.951+0000 7efee5de4640 10 monclient: _renew_subs 2026-02-17T11:14:21.975 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.951+0000 7efee5de4640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:14:21.975 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.951+0000 7efee5de4640 1 -- 10.20.193.49:0/3981309037 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efee01f2df0 con 0x7efee0143820 2026-02-17T11:14:21.975 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.951+0000 7efee5de4640 10 client.5024.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:14:21.975 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.951+0000 7efee5de4640 10 monclient: _renew_subs 2026-02-17T11:14:21.975 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.951+0000 7efee5de4640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:14:21.975 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.951+0000 7efee5de4640 1 -- 10.20.193.49:0/3981309037 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efee01f33b0 con 0x7efee0143820 2026-02-17T11:14:21.975 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.951+0000 7efee5de4640 1 librados: init done 2026-02-17T11:14:21.976 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.952+0000 7efee5de4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:14:21.976 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.952+0000 7efee5de4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:14:21.976 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.952+0000 7efee5de4640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:14:21.976 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.952+0000 7efee5de4640 1 -- 10.20.193.49:0/3981309037 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efee015d870 con 0x7efee0143820 2026-02-17T11:14:21.977 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.964+0000 7efebbfff640 1 -- 10.20.193.49:0/3981309037 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7efed4013590 con 0x7efee0143820 2026-02-17T11:14:21.977 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.965+0000 7efebbfff640 1 --2- 10.20.193.49:0/3981309037 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7efeb00791c0 0x7efeb007b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:21.977 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.965+0000 7efedf7fe640 1 --2- 10.20.193.49:0/3981309037 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7efeb00791c0 0x7efeb007b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:21.977 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.965+0000 7efedf7fe640 10 monclient: get_auth_request con 0x7efeb00791c0 auth_method 0 2026-02-17T11:14:21.978 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.966+0000 7efedf7fe640 1 --2- 10.20.193.49:0/3981309037 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7efeb00791c0 0x7efeb007b680 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7efecc036000 tx=0x7efecc006040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:14:21.978 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:21.966+0000 7efebbfff640 10 client.5024.objecter ms_handle_connect 0x7efeb00791c0 2026-02-17T11:14:22.032 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:22.030+0000 7efebbfff640 1 -- 10.20.193.49:0/3981309037 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7efed405e390 con 0x7efee0143820 2026-02-17T11:14:22.032 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:22.031+0000 7efebbfff640 10 client.5024.objecter ms_dispatch2 0x7efee0000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:14:22.032 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:22.031+0000 7efebbfff640 3 client.5024.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:14:22.032 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:22.031+0000 7efebbfff640 3 client.5024.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:14:22.032 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:22.031+0000 7efebbfff640 20 client.5024.objecter dump_active .. 0 homeless 2026-02-17T11:14:22.071 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:22.070+0000 7efebbfff640 1 -- 10.20.193.49:0/3981309037 <== mon.2 v2:10.20.193.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7efed4021030 con 0x7efee0143820 2026-02-17T11:14:22.071 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:22.070+0000 7efebbfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:14:22.071 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:22.070+0000 7efebbfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:14:22.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:22.170+0000 7efee5de4640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:14:22.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:22.170+0000 7efee5de4640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:14:22.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:22.170+0000 7efee5de4640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:14:22.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:22.170+0000 7efee5de4640 1 -- 10.20.193.49:0/3981309037 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7efee00c5760 con 0x7efee0143820 2026-02-17T11:14:22.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:22.172+0000 7efebbfff640 1 -- 10.20.193.49:0/3981309037 <== mon.2 v2:10.20.193.157:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7efee01f4850 con 0x7efee0143820 2026-02-17T11:14:22.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:22.172+0000 7efebbfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:14:22.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:22.172+0000 7efebbfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:14:22.174 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:14:22.174 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:14:22.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:22.173+0000 7efee5de4640 10 librados: watch_flush enter 2026-02-17T11:14:22.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:22.173+0000 7efee5de4640 10 librados: watch_flush exit 2026-02-17T11:14:22.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:22.173+0000 7efee5de4640 20 client.5024.objecter shutdown clearing up homeless session... 2026-02-17T11:14:22.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:22.173+0000 7efee5de4640 10 client.5024.objecter successfully canceled tick 2026-02-17T11:14:22.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:22.173+0000 7efee5de4640 1 -- 10.20.193.49:0/3981309037 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7efeb00791c0 msgr2=0x7efeb007b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:22.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:22.173+0000 7efee5de4640 1 --2- 10.20.193.49:0/3981309037 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7efeb00791c0 0x7efeb007b680 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7efecc036000 tx=0x7efecc006040 comp rx=0 tx=0).stop 2026-02-17T11:14:22.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:22.173+0000 7efee5de4640 10 monclient: shutdown 2026-02-17T11:14:22.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:22.173+0000 7efee5de4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:14:22.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:22.173+0000 7efee5de4640 1 -- 10.20.193.49:0/3981309037 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7efee0143820 msgr2=0x7efee01f5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:22.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:22.173+0000 7efee5de4640 1 --2- 10.20.193.49:0/3981309037 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7efee0143820 0x7efee01f5030 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7efee00722e0 tx=0x7efed400f5a0 comp rx=0 tx=0).stop 2026-02-17T11:14:22.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:22.173+0000 7efee5de4640 1 -- 10.20.193.49:0/3981309037 shutdown_connections 2026-02-17T11:14:22.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:22.173+0000 7efee5de4640 1 --2- 10.20.193.49:0/3981309037 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7efeb00791c0 0x7efeb007b680 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:22.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:22.173+0000 7efee5de4640 1 --2- 10.20.193.49:0/3981309037 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7efee0143820 0x7efee01f5030 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:22.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:22.173+0000 7efee5de4640 1 --2- 10.20.193.49:0/3981309037 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7efee01f43d0 0x7efee01432e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:22.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:22.173+0000 7efee5de4640 1 --2- 10.20.193.49:0/3981309037 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7efec4005040 0x7efee01f3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:22.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:22.173+0000 7efee5de4640 1 -- 10.20.193.49:0/3981309037 >> 10.20.193.49:0/3981309037 conn(0x7efee00c9f20 msgr2=0x7efee00ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:14:22.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:22.173+0000 7efee5de4640 1 -- 10.20.193.49:0/3981309037 shutdown_connections 2026-02-17T11:14:22.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:22.173+0000 7efee5de4640 1 -- 10.20.193.49:0/3981309037 wait complete. 2026-02-17T11:14:22.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:22.173+0000 7efee5de4640 1 librados: shutdown 2026-02-17T11:14:25.185 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:14:25.254 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.252+0000 7ff775276640 10 monclient: get_monmap_and_config 2026-02-17T11:14:25.254 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.252+0000 7ff775276640 10 monclient: build_initial_monmap 2026-02-17T11:14:25.254 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.252+0000 7ff775276640 10 monclient: monmap: 2026-02-17T11:14:25.254 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:14:25.254 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:25.254 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:14:25.253348+0000 2026-02-17T11:14:25.254 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:14:25.253348+0000 2026-02-17T11:14:25.254 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:14:25.254 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:25.254 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:14:25.254 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:14:25.254 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:14:25.254 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:14:25.254 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:14:25.254 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:14:25.254 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:25.256 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.253+0000 7ff775276640 1 Processor -- start 2026-02-17T11:14:25.256 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.253+0000 7ff775276640 1 -- start start 2026-02-17T11:14:25.256 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.253+0000 7ff775276640 10 monclient: init 2026-02-17T11:14:25.256 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.253+0000 7ff775276640 10 monclient: _reopen_session rank -1 2026-02-17T11:14:25.256 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.253+0000 7ff775276640 10 monclient: _add_conns ranks=[4,2,3,5,0,1] 2026-02-17T11:14:25.256 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.253+0000 7ff775276640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7ff770152060 0x7ff770158c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:25.256 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.253+0000 7ff775276640 10 monclient(hunting): picked mon.noname-b con 0x7ff770152060 addr v2:10.20.193.97:3300/0 2026-02-17T11:14:25.256 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.253+0000 7ff775276640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ff770152440 addr v1:10.20.193.157:6789/0 2026-02-17T11:14:25.256 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.253+0000 7ff775276640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7ff770156940 0x7ff7700c9330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:25.256 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.253+0000 7ff775276640 10 monclient(hunting): picked mon.noname-a con 0x7ff770156940 addr v2:10.20.193.49:3300/0 2026-02-17T11:14:25.256 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.253+0000 7ff775276640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff77015a470 con 0x7ff770152440 2026-02-17T11:14:25.256 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.253+0000 7ff775276640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:25.256 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.253+0000 7ff775276640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7ff770159180 con 0x7ff770156940 2026-02-17T11:14:25.256 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.253+0000 7ff775276640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:25.256 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.253+0000 7ff775276640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7ff77015a750 con 0x7ff770152060 2026-02-17T11:14:25.256 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.253+0000 7ff775276640 10 monclient(hunting): _renew_subs 2026-02-17T11:14:25.256 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.253+0000 7ff775276640 10 monclient(hunting): authenticate will time out at 1341.916811s 2026-02-17T11:14:25.256 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.254+0000 7ff76f577640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7ff770156940 0x7ff7700c9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:25.256 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.254+0000 7ff76e575640 1 --1- >> v1:10.20.193.157:6789/0 conn(0x7ff770152440 0x7ff770156230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.157:6789/0 says I am v1:10.20.193.49:34544/0 (socket says 10.20.193.49:34544) 2026-02-17T11:14:25.256 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.254+0000 7ff76e575640 1 -- 10.20.193.49:0/641173674 learned_addr learned my addr 10.20.193.49:0/641173674 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:14:25.256 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.254+0000 7ff76ed76640 1 --2- 10.20.193.49:0/641173674 >> v2:10.20.193.97:3300/0 conn(0x7ff770152060 0x7ff770158c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:25.256 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.254+0000 7ff76f577640 10 monclient(hunting): get_auth_request con 0x7ff770156940 auth_method 0 2026-02-17T11:14:25.257 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.254+0000 7ff76f577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:25.257 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.254+0000 7ff76f577640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:25.257 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.254+0000 7ff76f577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:25.257 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.254+0000 7ff76ed76640 10 monclient(hunting): get_auth_request con 0x7ff770152060 auth_method 0 2026-02-17T11:14:25.257 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.254+0000 7ff76ed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:25.257 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.254+0000 7ff76ed76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:25.257 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.254+0000 7ff76ed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:25.257 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.254+0000 7ff76f577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:25.257 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.254+0000 7ff76f577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:25.257 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.254+0000 7ff76f577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:25.257 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.254+0000 7ff76ed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:25.257 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.254+0000 7ff76ed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:25.257 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.254+0000 7ff76ed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:25.257 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.255+0000 7ff76f577640 10 monclient(hunting): handle_auth_done global_id 5010 payload 274 2026-02-17T11:14:25.257 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.255+0000 7ff76f577640 1 -- 10.20.193.49:0/641173674 >> v2:10.20.193.97:3300/0 conn(0x7ff770152060 msgr2=0x7ff770158c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:14:25.258 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.255+0000 7ff76f577640 1 --2- 10.20.193.49:0/641173674 >> v2:10.20.193.97:3300/0 conn(0x7ff770152060 0x7ff770158c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:25.258 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.255+0000 7ff76f577640 1 -- 10.20.193.49:0/641173674 >> v1:10.20.193.157:6789/0 conn(0x7ff770152440 legacy=0x7ff770156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:25.258 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.255+0000 7ff76f577640 10 monclient: _finish_hunting 0 2026-02-17T11:14:25.258 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.255+0000 7ff76f577640 1 monclient: found mon.noname-a 2026-02-17T11:14:25.258 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.255+0000 7ff76f577640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:14:25.258 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.255+0000 7ff76f577640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:14:25.258 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.255+0000 7ff76f577640 1 -- 10.20.193.49:0/641173674 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff77015aa30 con 0x7ff770156940 2026-02-17T11:14:25.258 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.256+0000 7ff76f577640 1 --2- 10.20.193.49:0/641173674 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ff770156940 0x7ff7700c9330 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff770159300 tx=0x7ff76002f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed5e1047bf8910c8 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:14:25.260 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.258+0000 7ff76dd74640 1 -- 10.20.193.49:0/641173674 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff76003c070 con 0x7ff770156940 2026-02-17T11:14:25.260 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.258+0000 7ff76dd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:25.260 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.258+0000 7ff76dd74640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:14:25.260 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.258+0000 7ff76dd74640 10 monclient: dump: 2026-02-17T11:14:25.260 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:25.260 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:25.260 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:25.260 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:25.260 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:25.260 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:25.260 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:25.260 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:25.260 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:25.260 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:25.260 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.258+0000 7ff76dd74640 10 monclient: _finish_auth 0 2026-02-17T11:14:25.260 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.258+0000 7ff76dd74640 10 monclient: _check_auth_tickets 2026-02-17T11:14:25.260 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.258+0000 7ff76dd74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:14:25.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.258+0000 7ff76dd74640 1 -- 10.20.193.49:0/641173674 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff76002fe20 con 0x7ff770156940 2026-02-17T11:14:25.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.258+0000 7ff76dd74640 10 monclient: handle_config config(0 keys) 2026-02-17T11:14:25.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.258+0000 7ff76dd74640 1 -- 10.20.193.49:0/641173674 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff760037660 con 0x7ff770156940 2026-02-17T11:14:25.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.258+0000 7ff76dd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:25.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.258+0000 7ff76dd74640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:14:25.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.258+0000 7ff76dd74640 10 monclient: dump: 2026-02-17T11:14:25.261 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:25.261 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:25.261 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:25.261 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:25.261 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:25.261 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:25.261 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:25.261 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:25.261 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:25.261 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:25.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.258+0000 7ff775276640 5 monclient: authenticate success, global_id 5010 2026-02-17T11:14:25.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.258+0000 7ff775276640 10 monclient: get_monmap_and_config success 2026-02-17T11:14:25.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.258+0000 7ff775276640 4 set_mon_vals no callback set 2026-02-17T11:14:25.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.258+0000 7ff775276640 10 monclient: shutdown 2026-02-17T11:14:25.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.258+0000 7ff775276640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:14:25.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.258+0000 7ff775276640 1 -- 10.20.193.49:0/641173674 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ff770156940 msgr2=0x7ff7700c9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:25.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.258+0000 7ff775276640 1 --2- 10.20.193.49:0/641173674 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ff770156940 0x7ff7700c9330 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff770159300 tx=0x7ff76002f150 comp rx=0 tx=0).stop 2026-02-17T11:14:25.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.258+0000 7ff775276640 1 -- 10.20.193.49:0/641173674 shutdown_connections 2026-02-17T11:14:25.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.258+0000 7ff775276640 1 --2- 10.20.193.49:0/641173674 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ff770156940 0x7ff7700c9330 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:25.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.258+0000 7ff775276640 1 --2- 10.20.193.49:0/641173674 >> v2:10.20.193.97:3300/0 conn(0x7ff770152060 0x7ff770158c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:25.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.258+0000 7ff775276640 1 -- 10.20.193.49:0/641173674 >> 10.20.193.49:0/641173674 conn(0x7ff7700c9f20 msgr2=0x7ff7700ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:14:25.262 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.258+0000 7ff775276640 1 -- 10.20.193.49:0/641173674 shutdown_connections 2026-02-17T11:14:25.262 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.259+0000 7ff775276640 1 -- 10.20.193.49:0/641173674 wait complete. 2026-02-17T11:14:25.263 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.259+0000 7ff775276640 10 monclient: build_initial_monmap 2026-02-17T11:14:25.263 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.259+0000 7ff775276640 10 monclient: monmap: 2026-02-17T11:14:25.263 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:14:25.263 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:14:25.263 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:14:25.263 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:14:25.264 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:14:25.264 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:25.264 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:14:25.264 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:14:25.264 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:14:25.264 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:25.264 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.259+0000 7ff775276640 1 librados: starting msgr at 2026-02-17T11:14:25.264 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.259+0000 7ff775276640 1 librados: starting objecter 2026-02-17T11:14:25.264 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.259+0000 7ff775276640 1 Processor -- start 2026-02-17T11:14:25.264 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.259+0000 7ff775276640 1 -- start start 2026-02-17T11:14:25.264 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.259+0000 7ff775276640 1 librados: setting wanted keys 2026-02-17T11:14:25.264 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.259+0000 7ff775276640 1 librados: calling monclient init 2026-02-17T11:14:25.264 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.259+0000 7ff775276640 10 monclient: init 2026-02-17T11:14:25.264 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.260+0000 7ff775276640 10 monclient: _reopen_session rank -1 2026-02-17T11:14:25.264 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.260+0000 7ff775276640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:14:25.264 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.260+0000 7ff775276640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ff770152060 0x7ff770157970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:25.264 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.260+0000 7ff775276640 10 monclient(hunting): picked mon.noname-a con 0x7ff770152060 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:14:25.264 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.260+0000 7ff775276640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7ff770152440 0x7ff770074060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:25.264 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.260+0000 7ff775276640 10 monclient(hunting): picked mon.noname-b con 0x7ff770152440 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:14:25.264 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.260+0000 7ff775276640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff770156940 0x7ff7700745a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:25.264 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.260+0000 7ff775276640 10 monclient(hunting): picked mon.noname-c con 0x7ff770156940 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:14:25.264 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.260+0000 7ff775276640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:25.264 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.260+0000 7ff775276640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff77015b2d0 con 0x7ff770152060 2026-02-17T11:14:25.264 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.260+0000 7ff775276640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:25.264 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.260+0000 7ff775276640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7ff77015aff0 con 0x7ff770152440 2026-02-17T11:14:25.264 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.260+0000 7ff775276640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:25.265 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.260+0000 7ff775276640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7ff7700c9870 con 0x7ff770156940 2026-02-17T11:14:25.265 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.260+0000 7ff775276640 10 monclient(hunting): _renew_subs 2026-02-17T11:14:25.265 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.260+0000 7ff775276640 10 monclient(hunting): authenticate will time out at 1341.923331s 2026-02-17T11:14:25.265 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.260+0000 7ff76ed76640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ff770152060 0x7ff770157970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:25.265 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.260+0000 7ff76e575640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7ff770152440 0x7ff770074060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:25.265 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.260+0000 7ff76f577640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff770156940 0x7ff7700745a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:25.265 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.260+0000 7ff76ed76640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ff770152060 0x7ff770157970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:43522/0 (socket says 10.20.193.49:43522) 2026-02-17T11:14:25.265 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.260+0000 7ff76ed76640 1 -- 10.20.193.49:0/459743300 learned_addr learned my addr 10.20.193.49:0/459743300 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:14:25.265 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.260+0000 7ff76ed76640 10 monclient(hunting): get_auth_request con 0x7ff770152060 auth_method 0 2026-02-17T11:14:25.265 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.260+0000 7ff76ed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:25.265 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.260+0000 7ff76ed76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:25.265 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.260+0000 7ff76ed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:25.265 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.260+0000 7ff76e575640 10 monclient(hunting): get_auth_request con 0x7ff770152440 auth_method 0 2026-02-17T11:14:25.265 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.260+0000 7ff76e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:25.265 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.260+0000 7ff76e575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:25.265 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.260+0000 7ff76e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:25.265 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.260+0000 7ff76f577640 10 monclient(hunting): get_auth_request con 0x7ff770156940 auth_method 0 2026-02-17T11:14:25.265 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.260+0000 7ff76f577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:25.265 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.260+0000 7ff76f577640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:25.265 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.260+0000 7ff76f577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:25.265 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.260+0000 7ff76ed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:25.265 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.260+0000 7ff76ed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:25.265 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.260+0000 7ff76ed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:25.265 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.261+0000 7ff76e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:25.265 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.261+0000 7ff76e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:25.265 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.261+0000 7ff76e575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:25.265 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.261+0000 7ff76f577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:25.266 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.261+0000 7ff76f577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:25.266 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.261+0000 7ff76f577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:25.266 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.262+0000 7ff76e575640 10 monclient(hunting): handle_auth_done global_id 4990 payload 824 2026-02-17T11:14:25.266 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.262+0000 7ff76e575640 1 -- 10.20.193.49:0/459743300 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff770156940 msgr2=0x7ff7700745a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:25.266 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.262+0000 7ff76e575640 1 --2- 10.20.193.49:0/459743300 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff770156940 0x7ff7700745a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:25.266 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.262+0000 7ff76e575640 1 -- 10.20.193.49:0/459743300 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ff770152060 msgr2=0x7ff770157970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:25.266 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.262+0000 7ff76e575640 1 --2- 10.20.193.49:0/459743300 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ff770152060 0x7ff770157970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:25.266 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.262+0000 7ff76e575640 10 monclient: _finish_hunting 0 2026-02-17T11:14:25.266 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.262+0000 7ff76e575640 1 monclient: found mon.noname-b 2026-02-17T11:14:25.266 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.262+0000 7ff76e575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:14:25.266 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.262+0000 7ff76e575640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:14:25.266 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.262+0000 7ff76e575640 1 -- 10.20.193.49:0/459743300 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff770072ce0 con 0x7ff770152440 2026-02-17T11:14:25.267 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.263+0000 7ff76e575640 1 --2- 10.20.193.49:0/459743300 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7ff770152440 0x7ff770074060 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff75800c500 tx=0x7ff75800c9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:14:25.267 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.263+0000 7ff74f7fe640 10 client.?.objecter ms_handle_connect 0x7ff770152440 2026-02-17T11:14:25.267 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.263+0000 7ff74f7fe640 10 client.?.objecter resend_mon_ops 2026-02-17T11:14:25.267 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.265+0000 7ff74f7fe640 1 -- 10.20.193.49:0/459743300 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff758017070 con 0x7ff770152440 2026-02-17T11:14:25.267 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.265+0000 7ff74f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:25.267 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.265+0000 7ff74f7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:14:25.267 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.265+0000 7ff74f7fe640 10 monclient: dump: 2026-02-17T11:14:25.267 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:25.267 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:25.267 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:25.267 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:25.267 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:25.267 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:25.267 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:25.267 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:25.267 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:25.267 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:25.267 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.265+0000 7ff74f7fe640 10 monclient: _finish_auth 0 2026-02-17T11:14:25.267 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.265+0000 7ff74f7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:14:25.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.265+0000 7ff74f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:14:25.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.265+0000 7ff775276640 5 monclient: authenticate success, global_id 4990 2026-02-17T11:14:25.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.265+0000 7ff775276640 10 monclient: _renew_subs 2026-02-17T11:14:25.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.265+0000 7ff775276640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:14:25.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.265+0000 7ff775276640 1 -- 10.20.193.49:0/459743300 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff770072fc0 con 0x7ff770152440 2026-02-17T11:14:25.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.265+0000 7ff775276640 10 client.4990.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:14:25.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.265+0000 7ff775276640 10 monclient: _renew_subs 2026-02-17T11:14:25.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.265+0000 7ff775276640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:14:25.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.265+0000 7ff775276640 1 -- 10.20.193.49:0/459743300 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff770073580 con 0x7ff770152440 2026-02-17T11:14:25.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.265+0000 7ff775276640 1 librados: init done 2026-02-17T11:14:25.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.265+0000 7ff74f7fe640 1 -- 10.20.193.49:0/459743300 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff758005de0 con 0x7ff770152440 2026-02-17T11:14:25.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.265+0000 7ff74f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:14:25.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.265+0000 7ff74f7fe640 1 -- 10.20.193.49:0/459743300 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff758021060 con 0x7ff770152440 2026-02-17T11:14:25.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.265+0000 7ff74f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:25.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.265+0000 7ff74f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:14:25.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.265+0000 7ff74f7fe640 10 monclient: dump: 2026-02-17T11:14:25.268 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:25.268 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:25.268 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:25.268 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:25.268 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:25.268 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:25.268 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:25.268 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:25.268 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:25.268 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:25.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.265+0000 7ff76d573640 4 set_mon_vals no callback set 2026-02-17T11:14:25.269 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.265+0000 7ff775276640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:14:25.269 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.265+0000 7ff775276640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:14:25.269 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.265+0000 7ff775276640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:14:25.269 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.265+0000 7ff775276640 1 -- 10.20.193.49:0/459743300 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7700c9b60 con 0x7ff770152440 2026-02-17T11:14:25.278 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.277+0000 7ff74f7fe640 1 -- 10.20.193.49:0/459743300 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7ff758024080 con 0x7ff770152440 2026-02-17T11:14:25.279 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.277+0000 7ff74f7fe640 1 --2- 10.20.193.49:0/459743300 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ff73c079140 0x7ff73c07b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:25.279 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.278+0000 7ff76ed76640 1 --2- 10.20.193.49:0/459743300 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ff73c079140 0x7ff73c07b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:25.279 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.278+0000 7ff76ed76640 10 monclient: get_auth_request con 0x7ff73c079140 auth_method 0 2026-02-17T11:14:25.279 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.278+0000 7ff76ed76640 1 --2- 10.20.193.49:0/459743300 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ff73c079140 0x7ff73c07b600 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff764009d00 tx=0x7ff764009290 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:14:25.279 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.278+0000 7ff74f7fe640 10 client.4990.objecter ms_handle_connect 0x7ff73c079140 2026-02-17T11:14:25.280 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.279+0000 7ff74f7fe640 1 -- 10.20.193.49:0/459743300 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7ff7580971b0 con 0x7ff770152440 2026-02-17T11:14:25.280 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.279+0000 7ff74f7fe640 10 client.4990.objecter ms_dispatch2 0x7ff770000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:14:25.280 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.279+0000 7ff74f7fe640 3 client.4990.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:14:25.280 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.279+0000 7ff74f7fe640 3 client.4990.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:14:25.280 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.279+0000 7ff74f7fe640 20 client.4990.objecter dump_active .. 0 homeless 2026-02-17T11:14:25.381 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.380+0000 7ff74f7fe640 1 -- 10.20.193.49:0/459743300 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ff7580616d0 con 0x7ff770152440 2026-02-17T11:14:25.381 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.380+0000 7ff74f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:14:25.381 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.380+0000 7ff74f7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:14:25.481 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.480+0000 7ff775276640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:14:25.481 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.480+0000 7ff775276640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:14:25.481 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.480+0000 7ff775276640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:14:25.481 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.480+0000 7ff775276640 1 -- 10.20.193.49:0/459743300 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff7700c4550 con 0x7ff770152440 2026-02-17T11:14:25.484 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.482+0000 7ff74f7fe640 1 -- 10.20.193.49:0/459743300 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7ff7580659d0 con 0x7ff770152440 2026-02-17T11:14:25.484 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.482+0000 7ff74f7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:14:25.484 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.482+0000 7ff74f7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:14:25.484 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:14:25.484 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:14:25.485 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.483+0000 7ff775276640 10 librados: watch_flush enter 2026-02-17T11:14:25.485 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.483+0000 7ff775276640 10 librados: watch_flush exit 2026-02-17T11:14:25.485 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.483+0000 7ff775276640 20 client.4990.objecter shutdown clearing up homeless session... 2026-02-17T11:14:25.485 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.483+0000 7ff775276640 10 client.4990.objecter successfully canceled tick 2026-02-17T11:14:25.485 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.484+0000 7ff775276640 1 -- 10.20.193.49:0/459743300 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ff73c079140 msgr2=0x7ff73c07b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:25.485 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.484+0000 7ff775276640 1 --2- 10.20.193.49:0/459743300 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ff73c079140 0x7ff73c07b600 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff764009d00 tx=0x7ff764009290 comp rx=0 tx=0).stop 2026-02-17T11:14:25.485 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.484+0000 7ff775276640 10 monclient: shutdown 2026-02-17T11:14:25.485 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.484+0000 7ff775276640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:14:25.485 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.484+0000 7ff775276640 1 -- 10.20.193.49:0/459743300 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7ff770152440 msgr2=0x7ff770074060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:25.485 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.484+0000 7ff775276640 1 --2- 10.20.193.49:0/459743300 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7ff770152440 0x7ff770074060 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff75800c500 tx=0x7ff75800c9d0 comp rx=0 tx=0).stop 2026-02-17T11:14:25.486 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.484+0000 7ff775276640 1 -- 10.20.193.49:0/459743300 shutdown_connections 2026-02-17T11:14:25.486 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.484+0000 7ff775276640 1 --2- 10.20.193.49:0/459743300 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ff73c079140 0x7ff73c07b600 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:25.486 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.484+0000 7ff775276640 1 --2- 10.20.193.49:0/459743300 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff770156940 0x7ff7700745a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:25.486 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.484+0000 7ff775276640 1 --2- 10.20.193.49:0/459743300 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7ff770152440 0x7ff770074060 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:25.486 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.484+0000 7ff775276640 1 --2- 10.20.193.49:0/459743300 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ff770152060 0x7ff770157970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:25.486 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.484+0000 7ff775276640 1 -- 10.20.193.49:0/459743300 >> 10.20.193.49:0/459743300 conn(0x7ff7700c9f20 msgr2=0x7ff77006b600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:14:25.486 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.484+0000 7ff775276640 1 -- 10.20.193.49:0/459743300 shutdown_connections 2026-02-17T11:14:25.486 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.484+0000 7ff775276640 1 -- 10.20.193.49:0/459743300 wait complete. 2026-02-17T11:14:25.486 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:25.484+0000 7ff775276640 1 librados: shutdown 2026-02-17T11:14:28.494 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:14:28.562 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.561+0000 7f54c3dcc640 10 monclient: get_monmap_and_config 2026-02-17T11:14:28.563 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.561+0000 7f54c3dcc640 10 monclient: build_initial_monmap 2026-02-17T11:14:28.563 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.561+0000 7f54c3dcc640 10 monclient: monmap: 2026-02-17T11:14:28.563 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:14:28.563 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:28.563 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:14:28.561979+0000 2026-02-17T11:14:28.563 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:14:28.561979+0000 2026-02-17T11:14:28.563 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:14:28.563 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:28.564 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:14:28.564 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:14:28.564 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:14:28.564 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:14:28.564 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:14:28.564 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:14:28.564 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:28.568 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.561+0000 7f54c3dcc640 1 Processor -- start 2026-02-17T11:14:28.568 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.561+0000 7f54c3dcc640 1 -- start start 2026-02-17T11:14:28.568 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.561+0000 7f54c3dcc640 10 monclient: init 2026-02-17T11:14:28.568 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.562+0000 7f54c3dcc640 10 monclient: _reopen_session rank -1 2026-02-17T11:14:28.568 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.562+0000 7f54c3dcc640 10 monclient: _add_conns ranks=[3,4,5,2,0,1] 2026-02-17T11:14:28.568 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.562+0000 7f54c3dcc640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f54bc0c7170 0x7f54bc0c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:28.568 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.562+0000 7f54c3dcc640 10 monclient(hunting): picked mon.noname-a con 0x7f54bc0c7170 addr v2:10.20.193.49:3300/0 2026-02-17T11:14:28.568 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.562+0000 7f54c3dcc640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f54bc0c48c0 0x7f54bc0749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:28.568 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.562+0000 7f54c3dcc640 10 monclient(hunting): picked mon.noname-b con 0x7f54bc0c48c0 addr v2:10.20.193.97:3300/0 2026-02-17T11:14:28.568 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.562+0000 7f54c3dcc640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f54bc074ef0 0x7f54bc0c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:28.569 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.562+0000 7f54c3dcc640 10 monclient(hunting): picked mon.noname-c con 0x7f54bc074ef0 addr v2:10.20.193.157:3300/0 2026-02-17T11:14:28.569 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.562+0000 7f54c3dcc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:28.569 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.562+0000 7f54c3dcc640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f54bc0c8530 con 0x7f54bc0c7170 2026-02-17T11:14:28.569 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.562+0000 7f54c3dcc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:28.569 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.562+0000 7f54c3dcc640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f54bc15a9a0 con 0x7f54bc0c48c0 2026-02-17T11:14:28.569 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.562+0000 7f54c3dcc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:28.569 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.562+0000 7f54c3dcc640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f54bc0c5270 con 0x7f54bc074ef0 2026-02-17T11:14:28.569 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.562+0000 7f54c3dcc640 10 monclient(hunting): _renew_subs 2026-02-17T11:14:28.569 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.562+0000 7f54c3dcc640 10 monclient(hunting): authenticate will time out at 1345.225447s 2026-02-17T11:14:28.569 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.562+0000 7f54c1b41640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f54bc0c7170 0x7f54bc0c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:28.569 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.562+0000 7f54c2342640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f54bc074ef0 0x7f54bc0c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:28.569 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.563+0000 7f54c1340640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f54bc0c48c0 0x7f54bc0749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:28.570 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.563+0000 7f54c1b41640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f54bc0c7170 0x7f54bc0c7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:48748/0 (socket says 10.20.193.49:48748) 2026-02-17T11:14:28.570 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.563+0000 7f54c1b41640 1 -- 10.20.193.49:0/3140871299 learned_addr learned my addr 10.20.193.49:0/3140871299 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:14:28.570 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.563+0000 7f54c1b41640 10 monclient(hunting): get_auth_request con 0x7f54bc0c7170 auth_method 0 2026-02-17T11:14:28.570 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.563+0000 7f54c1b41640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:28.570 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.563+0000 7f54c1b41640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:28.570 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.563+0000 7f54c1b41640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:28.570 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.563+0000 7f54c2342640 10 monclient(hunting): get_auth_request con 0x7f54bc074ef0 auth_method 0 2026-02-17T11:14:28.570 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.563+0000 7f54c2342640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:28.570 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.563+0000 7f54c2342640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:28.570 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.563+0000 7f54c2342640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:28.570 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.563+0000 7f54c1340640 10 monclient(hunting): get_auth_request con 0x7f54bc0c48c0 auth_method 0 2026-02-17T11:14:28.571 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.563+0000 7f54c1340640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:28.571 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.563+0000 7f54c1340640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:28.571 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.563+0000 7f54c1340640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:28.571 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.563+0000 7f54c1b41640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:28.571 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.563+0000 7f54c1b41640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:28.571 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.563+0000 7f54c1b41640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:28.571 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.563+0000 7f54c2342640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:28.571 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.563+0000 7f54c2342640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:28.571 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.563+0000 7f54c2342640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:28.571 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.563+0000 7f54c1340640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:28.571 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.563+0000 7f54c1340640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:28.571 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.563+0000 7f54c1340640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:28.571 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.564+0000 7f54c1b41640 10 monclient(hunting): handle_auth_done global_id 5016 payload 274 2026-02-17T11:14:28.571 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.564+0000 7f54c1b41640 1 -- 10.20.193.49:0/3140871299 >> v2:10.20.193.157:3300/0 conn(0x7f54bc074ef0 msgr2=0x7f54bc0c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:14:28.572 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.564+0000 7f54c1b41640 1 --2- 10.20.193.49:0/3140871299 >> v2:10.20.193.157:3300/0 conn(0x7f54bc074ef0 0x7f54bc0c89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:28.572 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.564+0000 7f54c1b41640 1 -- 10.20.193.49:0/3140871299 >> v2:10.20.193.97:3300/0 conn(0x7f54bc0c48c0 msgr2=0x7f54bc0749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:14:28.572 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.564+0000 7f54c1b41640 1 --2- 10.20.193.49:0/3140871299 >> v2:10.20.193.97:3300/0 conn(0x7f54bc0c48c0 0x7f54bc0749b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:28.572 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.564+0000 7f54c1b41640 10 monclient: _finish_hunting 0 2026-02-17T11:14:28.572 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.564+0000 7f54c1b41640 1 monclient: found mon.noname-a 2026-02-17T11:14:28.572 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.564+0000 7f54c1b41640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:14:28.572 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.564+0000 7f54c1b41640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:14:28.572 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.564+0000 7f54c1b41640 1 -- 10.20.193.49:0/3140871299 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54bc0c5550 con 0x7f54bc0c7170 2026-02-17T11:14:28.572 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.565+0000 7f54c1b41640 1 --2- 10.20.193.49:0/3140871299 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f54bc0c7170 0x7f54bc0c7550 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f54bc0c7a90 tx=0x7f54ac02ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c173cf85aeaea403 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:14:28.579 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.567+0000 7f54c0b3f640 1 -- 10.20.193.49:0/3140871299 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54ac03c070 con 0x7f54bc0c7170 2026-02-17T11:14:28.579 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.567+0000 7f54c0b3f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:28.579 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.567+0000 7f54c0b3f640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:14:28.579 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.567+0000 7f54c0b3f640 10 monclient: dump: 2026-02-17T11:14:28.579 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:28.579 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:28.580 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:28.580 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:28.580 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:28.580 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:28.580 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:28.580 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:28.580 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:28.580 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:28.580 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.567+0000 7f54c0b3f640 10 monclient: _finish_auth 0 2026-02-17T11:14:28.580 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.567+0000 7f54c0b3f640 10 monclient: _check_auth_tickets 2026-02-17T11:14:28.580 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.567+0000 7f54c0b3f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:14:28.581 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.567+0000 7f54c0b3f640 1 -- 10.20.193.49:0/3140871299 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54ac02fb50 con 0x7f54bc0c7170 2026-02-17T11:14:28.581 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.567+0000 7f54c0b3f640 10 monclient: handle_config config(0 keys) 2026-02-17T11:14:28.581 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.567+0000 7f54c3dcc640 5 monclient: authenticate success, global_id 5016 2026-02-17T11:14:28.581 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.567+0000 7f54c0b3f640 1 -- 10.20.193.49:0/3140871299 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54ac037440 con 0x7f54bc0c7170 2026-02-17T11:14:28.581 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.567+0000 7f54c3dcc640 10 monclient: get_monmap_and_config success 2026-02-17T11:14:28.581 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.567+0000 7f54c3dcc640 4 set_mon_vals no callback set 2026-02-17T11:14:28.581 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.567+0000 7f54c0b3f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:28.581 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.567+0000 7f54c0b3f640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:14:28.581 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.567+0000 7f54c0b3f640 10 monclient: dump: 2026-02-17T11:14:28.581 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:28.581 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:28.581 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:28.582 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:28.582 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:28.582 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:28.582 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:28.582 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:28.582 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:28.582 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:28.582 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.567+0000 7f54c3dcc640 10 monclient: shutdown 2026-02-17T11:14:28.582 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.567+0000 7f54c3dcc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:14:28.582 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.567+0000 7f54c3dcc640 1 -- 10.20.193.49:0/3140871299 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f54bc0c7170 msgr2=0x7f54bc0c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:28.582 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.567+0000 7f54c3dcc640 1 --2- 10.20.193.49:0/3140871299 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f54bc0c7170 0x7f54bc0c7550 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f54bc0c7a90 tx=0x7f54ac02ee90 comp rx=0 tx=0).stop 2026-02-17T11:14:28.582 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.567+0000 7f54c3dcc640 1 -- 10.20.193.49:0/3140871299 shutdown_connections 2026-02-17T11:14:28.583 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.567+0000 7f54c3dcc640 1 --2- 10.20.193.49:0/3140871299 >> v2:10.20.193.97:3300/0 conn(0x7f54bc0c48c0 0x7f54bc0749b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:28.583 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.567+0000 7f54c3dcc640 1 --2- 10.20.193.49:0/3140871299 >> v2:10.20.193.157:3300/0 conn(0x7f54bc074ef0 0x7f54bc0c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:28.583 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.567+0000 7f54c3dcc640 1 --2- 10.20.193.49:0/3140871299 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f54bc0c7170 0x7f54bc0c7550 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:28.583 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.567+0000 7f54c3dcc640 1 -- 10.20.193.49:0/3140871299 >> 10.20.193.49:0/3140871299 conn(0x7f54bc0c9f40 msgr2=0x7f54bc0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:14:28.583 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.567+0000 7f54c3dcc640 1 -- 10.20.193.49:0/3140871299 shutdown_connections 2026-02-17T11:14:28.583 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.567+0000 7f54c3dcc640 1 -- 10.20.193.49:0/3140871299 wait complete. 2026-02-17T11:14:28.583 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.567+0000 7f54c3dcc640 10 monclient: build_initial_monmap 2026-02-17T11:14:28.583 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.567+0000 7f54c3dcc640 10 monclient: monmap: 2026-02-17T11:14:28.583 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:14:28.583 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:14:28.583 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:14:28.583 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:14:28.583 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:14:28.584 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:28.584 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:14:28.584 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:14:28.584 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:14:28.584 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:28.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.568+0000 7f54c3dcc640 1 librados: starting msgr at 2026-02-17T11:14:28.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.568+0000 7f54c3dcc640 1 librados: starting objecter 2026-02-17T11:14:28.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.568+0000 7f54c3dcc640 1 Processor -- start 2026-02-17T11:14:28.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.568+0000 7f54c3dcc640 1 -- start start 2026-02-17T11:14:28.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.568+0000 7f54c3dcc640 1 librados: setting wanted keys 2026-02-17T11:14:28.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.568+0000 7f54c3dcc640 1 librados: calling monclient init 2026-02-17T11:14:28.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.568+0000 7f54c3dcc640 10 monclient: init 2026-02-17T11:14:28.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.568+0000 7f54c3dcc640 10 monclient: _reopen_session rank -1 2026-02-17T11:14:28.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.568+0000 7f54c3dcc640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:14:28.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.568+0000 7f54c3dcc640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f54bc074ef0 0x7f54bc0c0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:28.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.568+0000 7f54c3dcc640 10 monclient(hunting): picked mon.noname-b con 0x7f54bc074ef0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:14:28.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.568+0000 7f54c3dcc640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f54bc0c48c0 0x7f54bc1f6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:28.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.568+0000 7f54c3dcc640 10 monclient(hunting): picked mon.noname-a con 0x7f54bc0c48c0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:14:28.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.568+0000 7f54c3dcc640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f54bc0c7170 0x7f54bc1f4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:28.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.568+0000 7f54c3dcc640 10 monclient(hunting): picked mon.noname-c con 0x7f54bc0c7170 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:14:28.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.568+0000 7f54c3dcc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:28.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.568+0000 7f54c3dcc640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f54bc0c81c0 con 0x7f54bc0c48c0 2026-02-17T11:14:28.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.568+0000 7f54c3dcc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:28.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.568+0000 7f54c3dcc640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f54bc0c7ee0 con 0x7f54bc074ef0 2026-02-17T11:14:28.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.568+0000 7f54c3dcc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:28.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.568+0000 7f54c3dcc640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f54bc0c4d10 con 0x7f54bc0c7170 2026-02-17T11:14:28.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.568+0000 7f54c3dcc640 10 monclient(hunting): _renew_subs 2026-02-17T11:14:28.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.568+0000 7f54c3dcc640 10 monclient(hunting): authenticate will time out at 1345.231788s 2026-02-17T11:14:28.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.569+0000 7f54c1340640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f54bc0c48c0 0x7f54bc1f6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:28.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.569+0000 7f54c1b41640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f54bc074ef0 0x7f54bc0c0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:28.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.569+0000 7f54c2342640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f54bc0c7170 0x7f54bc1f4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:28.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.569+0000 7f54c1340640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f54bc0c48c0 0x7f54bc1f6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:48758/0 (socket says 10.20.193.49:48758) 2026-02-17T11:14:28.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.569+0000 7f54c1340640 1 -- 10.20.193.49:0/3837045781 learned_addr learned my addr 10.20.193.49:0/3837045781 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:14:28.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.569+0000 7f54c1340640 10 monclient(hunting): get_auth_request con 0x7f54bc0c48c0 auth_method 0 2026-02-17T11:14:28.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.569+0000 7f54c1340640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:28.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.569+0000 7f54c1340640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:28.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.569+0000 7f54c1340640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:28.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.569+0000 7f54c1b41640 10 monclient(hunting): get_auth_request con 0x7f54bc074ef0 auth_method 0 2026-02-17T11:14:28.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.569+0000 7f54c1b41640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:28.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.569+0000 7f54c1b41640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:28.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.569+0000 7f54c1b41640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:28.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.569+0000 7f54c2342640 10 monclient(hunting): get_auth_request con 0x7f54bc0c7170 auth_method 0 2026-02-17T11:14:28.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.569+0000 7f54c2342640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:28.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.569+0000 7f54c2342640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:28.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.569+0000 7f54c2342640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:28.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.569+0000 7f54c1340640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:28.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.569+0000 7f54c1340640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:28.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.569+0000 7f54c1340640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:28.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.569+0000 7f54c1b41640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:28.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.569+0000 7f54c1b41640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:28.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.569+0000 7f54c1b41640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:28.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.569+0000 7f54c2342640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:28.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.569+0000 7f54c2342640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:28.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.569+0000 7f54c2342640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:28.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.570+0000 7f54c1340640 10 monclient(hunting): handle_auth_done global_id 5019 payload 824 2026-02-17T11:14:28.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.570+0000 7f54c1340640 1 -- 10.20.193.49:0/3837045781 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f54bc0c7170 msgr2=0x7f54bc1f4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:28.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.570+0000 7f54c1340640 1 --2- 10.20.193.49:0/3837045781 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f54bc0c7170 0x7f54bc1f4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:28.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.570+0000 7f54c1340640 1 -- 10.20.193.49:0/3837045781 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f54bc074ef0 msgr2=0x7f54bc0c0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:28.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.570+0000 7f54c1340640 1 --2- 10.20.193.49:0/3837045781 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f54bc074ef0 0x7f54bc0c0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:28.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.570+0000 7f54c1340640 10 monclient: _finish_hunting 0 2026-02-17T11:14:28.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.570+0000 7f54c1340640 1 monclient: found mon.noname-a 2026-02-17T11:14:28.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.570+0000 7f54c1340640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:14:28.589 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.570+0000 7f54c1340640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:14:28.589 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.570+0000 7f54c1340640 1 -- 10.20.193.49:0/3837045781 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54bc06e270 con 0x7f54bc0c48c0 2026-02-17T11:14:28.589 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.571+0000 7f54c1340640 1 --2- 10.20.193.49:0/3837045781 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f54bc0c48c0 0x7f54bc1f6c80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f54b000ebe0 tx=0x7f54b000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:14:28.589 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.571+0000 7f54aa7fc640 10 client.?.objecter ms_handle_connect 0x7f54bc0c48c0 2026-02-17T11:14:28.589 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.571+0000 7f54aa7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T11:14:28.589 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.573+0000 7f54aa7fc640 1 -- 10.20.193.49:0/3837045781 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b0017070 con 0x7f54bc0c48c0 2026-02-17T11:14:28.589 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.573+0000 7f54aa7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:28.589 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.573+0000 7f54aa7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:14:28.589 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.573+0000 7f54aa7fc640 10 monclient: dump: 2026-02-17T11:14:28.589 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:28.589 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:28.589 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:28.590 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:28.590 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:28.590 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:28.590 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:28.590 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:28.590 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:28.590 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:28.590 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.573+0000 7f54aa7fc640 10 monclient: _finish_auth 0 2026-02-17T11:14:28.590 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.573+0000 7f54aa7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:14:28.590 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.573+0000 7f54aa7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:14:28.590 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.573+0000 7f54aa7fc640 1 -- 10.20.193.49:0/3837045781 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54b000cc40 con 0x7f54bc0c48c0 2026-02-17T11:14:28.590 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.573+0000 7f54aa7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:14:28.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.573+0000 7f54aa7fc640 1 -- 10.20.193.49:0/3837045781 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b0013470 con 0x7f54bc0c48c0 2026-02-17T11:14:28.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.573+0000 7f54aa7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:28.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.573+0000 7f54aa7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:14:28.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.573+0000 7f54aa7fc640 10 monclient: dump: 2026-02-17T11:14:28.591 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:28.591 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:28.591 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:28.591 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:28.591 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:28.591 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:28.591 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:28.591 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:28.591 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:28.592 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:28.592 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.573+0000 7f54abfff640 4 set_mon_vals no callback set 2026-02-17T11:14:28.592 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.573+0000 7f54c3dcc640 5 monclient: authenticate success, global_id 5019 2026-02-17T11:14:28.592 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.573+0000 7f54c3dcc640 10 monclient: _renew_subs 2026-02-17T11:14:28.592 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.573+0000 7f54c3dcc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:14:28.592 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.573+0000 7f54c3dcc640 1 -- 10.20.193.49:0/3837045781 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54bc06e550 con 0x7f54bc0c48c0 2026-02-17T11:14:28.592 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.573+0000 7f54c3dcc640 10 client.5019.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:14:28.592 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.573+0000 7f54c3dcc640 10 monclient: _renew_subs 2026-02-17T11:14:28.592 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.573+0000 7f54c3dcc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:14:28.592 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.573+0000 7f54c3dcc640 1 -- 10.20.193.49:0/3837045781 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54bc06eb10 con 0x7f54bc0c48c0 2026-02-17T11:14:28.592 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.573+0000 7f54c3dcc640 1 librados: init done 2026-02-17T11:14:28.592 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.574+0000 7f54c3dcc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:14:28.593 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.574+0000 7f54c3dcc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:14:28.593 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.574+0000 7f54c3dcc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:14:28.593 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.574+0000 7f54c3dcc640 1 -- 10.20.193.49:0/3837045781 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54bc0749b0 con 0x7f54bc0c48c0 2026-02-17T11:14:28.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.678+0000 7f54aa7fc640 1 -- 10.20.193.49:0/3837045781 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f54b0013610 con 0x7f54bc0c48c0 2026-02-17T11:14:28.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.679+0000 7f54aa7fc640 1 --2- 10.20.193.49:0/3837045781 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f548c079140 0x7f548c07b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:28.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.679+0000 7f54c1b41640 1 --2- 10.20.193.49:0/3837045781 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f548c079140 0x7f548c07b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:28.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.679+0000 7f54c1b41640 10 monclient: get_auth_request con 0x7f548c079140 auth_method 0 2026-02-17T11:14:28.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.680+0000 7f54c1b41640 1 --2- 10.20.193.49:0/3837045781 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f548c079140 0x7f548c07b600 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f54bc0723c0 tx=0x7f54ac033000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:14:28.682 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.680+0000 7f54aa7fc640 10 client.5019.objecter ms_handle_connect 0x7f548c079140 2026-02-17T11:14:28.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.688+0000 7f54aa7fc640 1 -- 10.20.193.49:0/3837045781 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f54b005e770 con 0x7f54bc0c48c0 2026-02-17T11:14:28.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.688+0000 7f54aa7fc640 10 client.5019.objecter ms_dispatch2 0x7f54bc000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:14:28.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.688+0000 7f54aa7fc640 3 client.5019.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:14:28.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.688+0000 7f54aa7fc640 3 client.5019.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:14:28.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.688+0000 7f54aa7fc640 20 client.5019.objecter dump_active .. 0 homeless 2026-02-17T11:14:28.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.688+0000 7f54aa7fc640 1 -- 10.20.193.49:0/3837045781 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f54b0062730 con 0x7f54bc0c48c0 2026-02-17T11:14:28.691 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.688+0000 7f54aa7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:14:28.691 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.688+0000 7f54aa7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:14:28.797 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.795+0000 7f54c3dcc640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:14:28.797 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.795+0000 7f54c3dcc640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:14:28.797 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.795+0000 7f54c3dcc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:14:28.797 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.795+0000 7f54c3dcc640 1 -- 10.20.193.49:0/3837045781 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f54bc15ac60 con 0x7f54bc0c48c0 2026-02-17T11:14:28.799 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.798+0000 7f54aa7fc640 1 -- 10.20.193.49:0/3837045781 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f54b0066a30 con 0x7f54bc0c48c0 2026-02-17T11:14:28.800 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.798+0000 7f54aa7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:14:28.800 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.798+0000 7f54aa7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:14:28.800 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:14:28.800 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:14:28.802 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.799+0000 7f54c3dcc640 10 librados: watch_flush enter 2026-02-17T11:14:28.802 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.799+0000 7f54c3dcc640 10 librados: watch_flush exit 2026-02-17T11:14:28.802 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.799+0000 7f54c3dcc640 20 client.5019.objecter shutdown clearing up homeless session... 2026-02-17T11:14:28.802 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.799+0000 7f54c3dcc640 10 client.5019.objecter successfully canceled tick 2026-02-17T11:14:28.802 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.799+0000 7f54c3dcc640 1 -- 10.20.193.49:0/3837045781 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f548c079140 msgr2=0x7f548c07b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:28.802 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.799+0000 7f54c3dcc640 1 --2- 10.20.193.49:0/3837045781 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f548c079140 0x7f548c07b600 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f54bc0723c0 tx=0x7f54ac033000 comp rx=0 tx=0).stop 2026-02-17T11:14:28.802 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.799+0000 7f54c3dcc640 10 monclient: shutdown 2026-02-17T11:14:28.803 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.799+0000 7f54c3dcc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:14:28.803 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.799+0000 7f54c3dcc640 1 -- 10.20.193.49:0/3837045781 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f54bc0c48c0 msgr2=0x7f54bc1f6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:28.803 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.799+0000 7f54c3dcc640 1 --2- 10.20.193.49:0/3837045781 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f54bc0c48c0 0x7f54bc1f6c80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f54b000ebe0 tx=0x7f54b000c520 comp rx=0 tx=0).stop 2026-02-17T11:14:28.803 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.800+0000 7f54c3dcc640 1 -- 10.20.193.49:0/3837045781 shutdown_connections 2026-02-17T11:14:28.803 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.800+0000 7f54c3dcc640 1 --2- 10.20.193.49:0/3837045781 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f548c079140 0x7f548c07b600 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:28.803 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.800+0000 7f54c3dcc640 1 --2- 10.20.193.49:0/3837045781 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f54bc0c7170 0x7f54bc1f4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:28.803 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.800+0000 7f54c3dcc640 1 --2- 10.20.193.49:0/3837045781 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f54bc0c48c0 0x7f54bc1f6c80 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:28.803 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.800+0000 7f54c3dcc640 1 --2- 10.20.193.49:0/3837045781 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f54bc074ef0 0x7f54bc0c0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:28.803 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.800+0000 7f54c3dcc640 1 -- 10.20.193.49:0/3837045781 >> 10.20.193.49:0/3837045781 conn(0x7f54bc0c9f40 msgr2=0x7f54bc14ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:14:28.803 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.800+0000 7f54c3dcc640 1 -- 10.20.193.49:0/3837045781 shutdown_connections 2026-02-17T11:14:28.803 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.800+0000 7f54c3dcc640 1 -- 10.20.193.49:0/3837045781 wait complete. 2026-02-17T11:14:28.803 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:28.800+0000 7f54c3dcc640 1 librados: shutdown 2026-02-17T11:14:31.810 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:14:31.877 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.876+0000 7f166bbd3640 10 monclient: get_monmap_and_config 2026-02-17T11:14:31.878 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.876+0000 7f166bbd3640 10 monclient: build_initial_monmap 2026-02-17T11:14:31.878 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.876+0000 7f166bbd3640 10 monclient: monmap: 2026-02-17T11:14:31.878 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:14:31.878 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:31.878 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:14:31.876633+0000 2026-02-17T11:14:31.878 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:14:31.876633+0000 2026-02-17T11:14:31.878 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:14:31.878 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:31.878 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:14:31.878 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:14:31.878 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:14:31.879 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:14:31.879 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:14:31.879 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:14:31.879 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:31.882 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.876+0000 7f166bbd3640 1 Processor -- start 2026-02-17T11:14:31.882 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.876+0000 7f166bbd3640 1 -- start start 2026-02-17T11:14:31.882 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.876+0000 7f166bbd3640 10 monclient: init 2026-02-17T11:14:31.882 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.877+0000 7f166bbd3640 10 monclient: _reopen_session rank -1 2026-02-17T11:14:31.882 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.877+0000 7f166bbd3640 10 monclient: _add_conns ranks=[3,5,2,4,1,0] 2026-02-17T11:14:31.882 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.877+0000 7f166bbd3640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f1664152820 0x7f16641593f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:31.882 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.877+0000 7f166bbd3640 10 monclient(hunting): picked mon.noname-a con 0x7f1664152820 addr v2:10.20.193.49:3300/0 2026-02-17T11:14:31.882 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.877+0000 7f166bbd3640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f1664152c00 0x7f16640c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:31.882 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.877+0000 7f166bbd3640 10 monclient(hunting): picked mon.noname-c con 0x7f1664152c00 addr v2:10.20.193.157:3300/0 2026-02-17T11:14:31.883 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.877+0000 7f166bbd3640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f16640738f0 addr v1:10.20.193.157:6789/0 2026-02-17T11:14:31.883 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.877+0000 7f166bbd3640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1664073e90 con 0x7f16640738f0 2026-02-17T11:14:31.883 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.877+0000 7f166bbd3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:31.883 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.877+0000 7f166bbd3640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f1664159930 con 0x7f1664152820 2026-02-17T11:14:31.883 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.877+0000 7f166bbd3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:31.883 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.877+0000 7f166bbd3640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f1664074170 con 0x7f1664152c00 2026-02-17T11:14:31.883 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.877+0000 7f166bbd3640 10 monclient(hunting): _renew_subs 2026-02-17T11:14:31.883 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.877+0000 7f166bbd3640 10 monclient(hunting): authenticate will time out at 1348.540215s 2026-02-17T11:14:31.883 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.877+0000 7f1669948640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f1664152820 0x7f16641593f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:31.883 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.877+0000 7f166a149640 1 --1- >> v1:10.20.193.157:6789/0 conn(0x7f16640738f0 0x7f16640c5ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.157:6789/0 says I am v1:10.20.193.49:50444/0 (socket says 10.20.193.49:50444) 2026-02-17T11:14:31.883 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.877+0000 7f166a149640 1 -- 10.20.193.49:0/1594104481 learned_addr learned my addr 10.20.193.49:0/1594104481 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:14:31.883 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.877+0000 7f1669948640 10 monclient(hunting): get_auth_request con 0x7f1664152820 auth_method 0 2026-02-17T11:14:31.884 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.877+0000 7f1669948640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:31.884 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.877+0000 7f1669948640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:31.884 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.877+0000 7f1669948640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:31.884 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.878+0000 7f1669147640 1 --2- 10.20.193.49:0/1594104481 >> v2:10.20.193.157:3300/0 conn(0x7f1664152c00 0x7f16640c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:31.884 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.878+0000 7f1669948640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:31.884 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.878+0000 7f1669948640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:31.884 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.878+0000 7f1669948640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:31.884 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.878+0000 7f1669147640 10 monclient(hunting): get_auth_request con 0x7f1664152c00 auth_method 0 2026-02-17T11:14:31.884 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.878+0000 7f1669147640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:31.884 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.878+0000 7f1669147640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:31.884 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.878+0000 7f1669147640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:31.884 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.879+0000 7f1669948640 10 monclient(hunting): handle_auth_done global_id 5022 payload 274 2026-02-17T11:14:31.884 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.879+0000 7f1669948640 1 -- 10.20.193.49:0/1594104481 >> v2:10.20.193.157:3300/0 conn(0x7f1664152c00 msgr2=0x7f16640c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:14:31.885 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.879+0000 7f1669948640 1 --2- 10.20.193.49:0/1594104481 >> v2:10.20.193.157:3300/0 conn(0x7f1664152c00 0x7f16640c7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:31.885 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.879+0000 7f1669948640 1 -- 10.20.193.49:0/1594104481 >> v1:10.20.193.157:6789/0 conn(0x7f16640738f0 legacy=0x7f16640c5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:31.885 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.879+0000 7f1669948640 10 monclient: _finish_hunting 0 2026-02-17T11:14:31.885 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.879+0000 7f1669948640 1 monclient: found mon.noname-a 2026-02-17T11:14:31.885 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.879+0000 7f1669948640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:14:31.885 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.879+0000 7f1669948640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:14:31.885 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.879+0000 7f1669948640 1 -- 10.20.193.49:0/1594104481 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1664074450 con 0x7f1664152820 2026-02-17T11:14:31.885 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.880+0000 7f1669948640 1 --2- 10.20.193.49:0/1594104481 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1664152820 0x7f16641593f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f16640cb010 tx=0x7f165402eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=666e470b8a3d1d23 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:14:31.891 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.882+0000 7f1668946640 1 -- 10.20.193.49:0/1594104481 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f165403c070 con 0x7f1664152820 2026-02-17T11:14:31.891 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.882+0000 7f1668946640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:31.891 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.882+0000 7f1668946640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:14:31.891 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.882+0000 7f1668946640 10 monclient: dump: 2026-02-17T11:14:31.892 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:31.892 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:31.892 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:31.892 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:31.892 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:31.892 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:31.892 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:31.892 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:31.892 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:31.892 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:31.892 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.882+0000 7f1668946640 10 monclient: _finish_auth 0 2026-02-17T11:14:31.893 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.882+0000 7f1668946640 10 monclient: _check_auth_tickets 2026-02-17T11:14:31.893 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.882+0000 7f1668946640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:14:31.893 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.882+0000 7f166bbd3640 5 monclient: authenticate success, global_id 5022 2026-02-17T11:14:31.893 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.882+0000 7f1668946640 1 -- 10.20.193.49:0/1594104481 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f165402fb80 con 0x7f1664152820 2026-02-17T11:14:31.893 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.882+0000 7f166bbd3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:14:31.893 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.882+0000 7f1668946640 10 monclient: handle_config config(0 keys) 2026-02-17T11:14:31.893 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.882+0000 7f166bbd3640 10 monclient: get_monmap_and_config success 2026-02-17T11:14:31.893 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.882+0000 7f1668946640 1 -- 10.20.193.49:0/1594104481 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1654037440 con 0x7f1664152820 2026-02-17T11:14:31.893 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.882+0000 7f166bbd3640 4 set_mon_vals no callback set 2026-02-17T11:14:31.893 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.882+0000 7f1668946640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:31.893 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.882+0000 7f1668946640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:14:31.893 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.882+0000 7f1668946640 10 monclient: dump: 2026-02-17T11:14:31.894 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:31.894 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:31.894 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:31.894 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:31.894 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:31.894 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:31.894 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:31.894 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:31.894 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:31.894 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:31.894 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.882+0000 7f166bbd3640 10 monclient: shutdown 2026-02-17T11:14:31.894 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.882+0000 7f166bbd3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:14:31.895 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.882+0000 7f166bbd3640 1 -- 10.20.193.49:0/1594104481 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1664152820 msgr2=0x7f16641593f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:31.895 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.882+0000 7f166bbd3640 1 --2- 10.20.193.49:0/1594104481 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1664152820 0x7f16641593f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f16640cb010 tx=0x7f165402eeb0 comp rx=0 tx=0).stop 2026-02-17T11:14:31.895 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.882+0000 7f166bbd3640 1 -- 10.20.193.49:0/1594104481 shutdown_connections 2026-02-17T11:14:31.895 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.882+0000 7f166bbd3640 1 --2- 10.20.193.49:0/1594104481 >> v2:10.20.193.157:3300/0 conn(0x7f1664152c00 0x7f16640c7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:31.895 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.882+0000 7f166bbd3640 1 --2- 10.20.193.49:0/1594104481 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1664152820 0x7f16641593f0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:31.895 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.882+0000 7f166bbd3640 1 -- 10.20.193.49:0/1594104481 >> 10.20.193.49:0/1594104481 conn(0x7f16640c9f40 msgr2=0x7f16640ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:14:31.895 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.882+0000 7f166bbd3640 1 -- 10.20.193.49:0/1594104481 shutdown_connections 2026-02-17T11:14:31.895 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.882+0000 7f166bbd3640 1 -- 10.20.193.49:0/1594104481 wait complete. 2026-02-17T11:14:31.895 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.883+0000 7f166bbd3640 10 monclient: build_initial_monmap 2026-02-17T11:14:31.895 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.883+0000 7f166bbd3640 10 monclient: monmap: 2026-02-17T11:14:31.895 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:14:31.895 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:14:31.896 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:14:31.896 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:14:31.896 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:14:31.896 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:31.896 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:14:31.896 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:14:31.896 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:14:31.896 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:31.896 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.883+0000 7f166bbd3640 1 librados: starting msgr at 2026-02-17T11:14:31.896 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.883+0000 7f166bbd3640 1 librados: starting objecter 2026-02-17T11:14:31.896 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.883+0000 7f166bbd3640 1 Processor -- start 2026-02-17T11:14:31.896 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.883+0000 7f166bbd3640 1 -- start start 2026-02-17T11:14:31.896 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.883+0000 7f166bbd3640 1 librados: setting wanted keys 2026-02-17T11:14:31.897 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.883+0000 7f166bbd3640 1 librados: calling monclient init 2026-02-17T11:14:31.897 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.883+0000 7f166bbd3640 10 monclient: init 2026-02-17T11:14:31.897 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.883+0000 7f166bbd3640 10 monclient: _reopen_session rank -1 2026-02-17T11:14:31.897 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.883+0000 7f166bbd3640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:14:31.897 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.883+0000 7f166bbd3640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f16640738f0 0x7f166406ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:31.897 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.883+0000 7f166bbd3640 10 monclient(hunting): picked mon.noname-b con 0x7f16640738f0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:14:31.897 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.883+0000 7f166bbd3640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f1664152820 0x7f16640bfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:31.897 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.883+0000 7f166bbd3640 10 monclient(hunting): picked mon.noname-c con 0x7f1664152820 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:14:31.897 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.883+0000 7f166bbd3640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1664152c00 0x7f1664150f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:31.897 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.883+0000 7f166bbd3640 10 monclient(hunting): picked mon.noname-a con 0x7f1664152c00 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:14:31.897 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.883+0000 7f166bbd3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:31.897 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.883+0000 7f166bbd3640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1664074cf0 con 0x7f1664152c00 2026-02-17T11:14:31.898 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.883+0000 7f166bbd3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:31.898 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.883+0000 7f166bbd3640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1664074a10 con 0x7f16640738f0 2026-02-17T11:14:31.898 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.883+0000 7f166bbd3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:31.898 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.883+0000 7f166bbd3640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f16640c8380 con 0x7f1664152820 2026-02-17T11:14:31.898 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.883+0000 7f166bbd3640 10 monclient(hunting): _renew_subs 2026-02-17T11:14:31.898 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.883+0000 7f166bbd3640 10 monclient(hunting): authenticate will time out at 1348.546782s 2026-02-17T11:14:31.898 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.884+0000 7f1669147640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f1664152820 0x7f16640bfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:31.898 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.884+0000 7f1669948640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f16640738f0 0x7f166406ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:31.898 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.884+0000 7f166a149640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1664152c00 0x7f1664150f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:31.898 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.884+0000 7f1669948640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f16640738f0 0x7f166406ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:38516/0 (socket says 10.20.193.49:38516) 2026-02-17T11:14:31.898 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.884+0000 7f1669948640 1 -- 10.20.193.49:0/2211883408 learned_addr learned my addr 10.20.193.49:0/2211883408 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:14:31.898 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.884+0000 7f1669948640 10 monclient(hunting): get_auth_request con 0x7f16640738f0 auth_method 0 2026-02-17T11:14:31.899 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.884+0000 7f1669948640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:31.899 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.884+0000 7f1669948640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:31.899 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.884+0000 7f1669948640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:31.899 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.884+0000 7f1669147640 10 monclient(hunting): get_auth_request con 0x7f1664152820 auth_method 0 2026-02-17T11:14:31.899 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.884+0000 7f1669147640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:31.899 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.884+0000 7f1669147640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:31.899 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.884+0000 7f1669147640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:31.899 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.884+0000 7f166a149640 10 monclient(hunting): get_auth_request con 0x7f1664152c00 auth_method 0 2026-02-17T11:14:31.899 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.884+0000 7f166a149640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:31.899 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.884+0000 7f166a149640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:31.899 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.884+0000 7f166a149640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:31.899 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.884+0000 7f166a149640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:31.899 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.884+0000 7f166a149640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:31.900 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.884+0000 7f166a149640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:31.900 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.884+0000 7f1669948640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:31.900 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.884+0000 7f1669948640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:31.900 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.884+0000 7f1669948640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:31.900 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.884+0000 7f1669147640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:31.900 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.884+0000 7f1669147640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:31.900 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.884+0000 7f1669147640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:31.900 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.886+0000 7f166a149640 10 monclient(hunting): handle_auth_done global_id 5025 payload 824 2026-02-17T11:14:31.900 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.886+0000 7f166a149640 1 -- 10.20.193.49:0/2211883408 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f1664152820 msgr2=0x7f16640bfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:31.900 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.886+0000 7f166a149640 1 --2- 10.20.193.49:0/2211883408 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f1664152820 0x7f16640bfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:31.900 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.886+0000 7f166a149640 1 -- 10.20.193.49:0/2211883408 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f16640738f0 msgr2=0x7f166406ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:31.900 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.886+0000 7f166a149640 1 --2- 10.20.193.49:0/2211883408 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f16640738f0 0x7f166406ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:31.900 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.886+0000 7f166a149640 10 monclient: _finish_hunting 0 2026-02-17T11:14:31.901 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.886+0000 7f166a149640 1 monclient: found mon.noname-a 2026-02-17T11:14:31.901 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.886+0000 7f166a149640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:14:31.901 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.886+0000 7f166a149640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:14:31.901 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.886+0000 7f166a149640 1 -- 10.20.193.49:0/2211883408 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16641f4620 con 0x7f1664152c00 2026-02-17T11:14:31.901 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.886+0000 7f1669948640 1 --2- 10.20.193.49:0/2211883408 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f16640738f0 0x7f166406ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:14:31.901 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.887+0000 7f166a149640 1 --2- 10.20.193.49:0/2211883408 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1664152c00 0x7f1664150f80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f166000c9f0 tx=0x7f166000cec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:14:31.901 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.887+0000 7f16527fc640 10 client.?.objecter ms_handle_connect 0x7f1664152c00 2026-02-17T11:14:31.901 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.887+0000 7f16527fc640 10 client.?.objecter resend_mon_ops 2026-02-17T11:14:31.901 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.889+0000 7f16527fc640 1 -- 10.20.193.49:0/2211883408 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1660017070 con 0x7f1664152c00 2026-02-17T11:14:31.901 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.889+0000 7f16527fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:31.901 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.889+0000 7f16527fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:14:31.901 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.889+0000 7f16527fc640 10 monclient: dump: 2026-02-17T11:14:31.901 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:31.902 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:31.902 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:31.902 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:31.902 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:31.902 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:31.902 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:31.902 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:31.902 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:31.902 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:31.902 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.889+0000 7f16527fc640 10 monclient: _finish_auth 0 2026-02-17T11:14:31.902 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.889+0000 7f16527fc640 10 monclient: _check_auth_tickets 2026-02-17T11:14:31.902 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.889+0000 7f16527fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:14:31.903 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.889+0000 7f16527fc640 1 -- 10.20.193.49:0/2211883408 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f166000ab70 con 0x7f1664152c00 2026-02-17T11:14:31.903 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.889+0000 7f16527fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:14:31.903 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.889+0000 7f16527fc640 1 -- 10.20.193.49:0/2211883408 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1660012400 con 0x7f1664152c00 2026-02-17T11:14:31.903 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.889+0000 7f16527fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:31.903 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.889+0000 7f16527fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:14:31.903 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.889+0000 7f1653fff640 4 set_mon_vals no callback set 2026-02-17T11:14:31.903 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.889+0000 7f16527fc640 10 monclient: dump: 2026-02-17T11:14:31.903 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:31.903 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:31.903 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:31.903 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:31.903 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:31.903 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:31.904 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:31.904 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:31.904 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:31.904 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:31.904 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.889+0000 7f166bbd3640 5 monclient: authenticate success, global_id 5025 2026-02-17T11:14:31.904 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.889+0000 7f166bbd3640 10 monclient: _renew_subs 2026-02-17T11:14:31.904 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.889+0000 7f166bbd3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:14:31.904 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.889+0000 7f166bbd3640 1 -- 10.20.193.49:0/2211883408 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16641501e0 con 0x7f1664152c00 2026-02-17T11:14:31.904 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.889+0000 7f166bbd3640 10 client.5025.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:14:31.904 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.889+0000 7f166bbd3640 10 monclient: _renew_subs 2026-02-17T11:14:31.904 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.889+0000 7f166bbd3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:14:31.904 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.889+0000 7f166bbd3640 1 -- 10.20.193.49:0/2211883408 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16641507a0 con 0x7f1664152c00 2026-02-17T11:14:31.905 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.889+0000 7f166bbd3640 1 librados: init done 2026-02-17T11:14:31.905 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.889+0000 7f166bbd3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:14:31.905 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.889+0000 7f166bbd3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:14:31.905 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.889+0000 7f166bbd3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:14:31.905 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.889+0000 7f166bbd3640 1 -- 10.20.193.49:0/2211883408 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16641593f0 con 0x7f1664152c00 2026-02-17T11:14:31.997 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.995+0000 7f16527fc640 1 -- 10.20.193.49:0/2211883408 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f166001b3b0 con 0x7f1664152c00 2026-02-17T11:14:31.998 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.996+0000 7f16527fc640 1 --2- 10.20.193.49:0/2211883408 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f1634079190 0x7f163407b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:31.998 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.996+0000 7f1669948640 1 --2- 10.20.193.49:0/2211883408 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f1634079190 0x7f163407b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:31.998 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.996+0000 7f1669948640 10 monclient: get_auth_request con 0x7f1634079190 auth_method 0 2026-02-17T11:14:31.998 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.997+0000 7f1669948640 1 --2- 10.20.193.49:0/2211883408 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f1634079190 0x7f163407b650 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f165402eef0 tx=0x7f1654033000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:14:31.999 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:31.997+0000 7f16527fc640 10 client.5025.objecter ms_handle_connect 0x7f1634079190 2026-02-17T11:14:32.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:32.004+0000 7f16527fc640 1 -- 10.20.193.49:0/2211883408 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f166005dc80 con 0x7f1664152c00 2026-02-17T11:14:32.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:32.004+0000 7f16527fc640 10 client.5025.objecter ms_dispatch2 0x7f1664000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:14:32.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:32.004+0000 7f16527fc640 3 client.5025.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:14:32.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:32.004+0000 7f16527fc640 3 client.5025.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:14:32.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:32.004+0000 7f16527fc640 20 client.5025.objecter dump_active .. 0 homeless 2026-02-17T11:14:32.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:32.004+0000 7f16527fc640 1 -- 10.20.193.49:0/2211883408 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f1660022080 con 0x7f1664152c00 2026-02-17T11:14:32.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:32.004+0000 7f16527fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:14:32.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:32.004+0000 7f16527fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:14:32.053 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:06:17.535 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:14:32.083 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:06:17.564 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:14:32.090 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:06:17.572 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:14:32.109 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:06:17.585 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:14:32.111 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:06:17.586 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:14:32.111 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:06:17.553 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:14:32.112 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:32.111+0000 7f166bbd3640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:14:32.112 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:32.111+0000 7f166bbd3640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:14:32.113 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:32.111+0000 7f166bbd3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:14:32.113 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:32.111+0000 7f166bbd3640 1 -- 10.20.193.49:0/2211883408 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f166414bf40 con 0x7f1664152c00 2026-02-17T11:14:32.113 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:06:17.554 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:14:32.117 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:32.115+0000 7f16527fc640 1 -- 10.20.193.49:0/2211883408 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f1660061c40 con 0x7f1664152c00 2026-02-17T11:14:32.117 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:32.115+0000 7f16527fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:14:32.117 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:32.115+0000 7f16527fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:14:32.117 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:14:32.117 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:14:32.119 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:32.117+0000 7f166bbd3640 10 librados: watch_flush enter 2026-02-17T11:14:32.120 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:32.117+0000 7f166bbd3640 10 librados: watch_flush exit 2026-02-17T11:14:32.120 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:32.117+0000 7f166bbd3640 20 client.5025.objecter shutdown clearing up homeless session... 2026-02-17T11:14:32.120 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:32.117+0000 7f166bbd3640 10 client.5025.objecter successfully canceled tick 2026-02-17T11:14:32.120 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:32.117+0000 7f166bbd3640 1 -- 10.20.193.49:0/2211883408 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f1634079190 msgr2=0x7f163407b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:32.120 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:32.117+0000 7f166bbd3640 1 --2- 10.20.193.49:0/2211883408 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f1634079190 0x7f163407b650 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f165402eef0 tx=0x7f1654033000 comp rx=0 tx=0).stop 2026-02-17T11:14:32.120 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:32.117+0000 7f166bbd3640 10 monclient: shutdown 2026-02-17T11:14:32.120 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:32.117+0000 7f166bbd3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:14:32.120 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:32.117+0000 7f166bbd3640 1 -- 10.20.193.49:0/2211883408 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1664152c00 msgr2=0x7f1664150f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:32.120 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:32.117+0000 7f166bbd3640 1 --2- 10.20.193.49:0/2211883408 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1664152c00 0x7f1664150f80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f166000c9f0 tx=0x7f166000cec0 comp rx=0 tx=0).stop 2026-02-17T11:14:32.120 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:32.117+0000 7f166bbd3640 1 -- 10.20.193.49:0/2211883408 shutdown_connections 2026-02-17T11:14:32.120 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:32.117+0000 7f166bbd3640 1 --2- 10.20.193.49:0/2211883408 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f1634079190 0x7f163407b650 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:32.121 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:32.117+0000 7f166bbd3640 1 --2- 10.20.193.49:0/2211883408 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1664152c00 0x7f1664150f80 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:32.121 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:32.117+0000 7f166bbd3640 1 --2- 10.20.193.49:0/2211883408 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f1664152820 0x7f16640bfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:32.121 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:32.117+0000 7f166bbd3640 1 --2- 10.20.193.49:0/2211883408 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f16640738f0 0x7f166406ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:32.121 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:32.117+0000 7f166bbd3640 1 -- 10.20.193.49:0/2211883408 >> 10.20.193.49:0/2211883408 conn(0x7f16640c9f40 msgr2=0x7f166414d290 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:14:32.121 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:32.117+0000 7f166bbd3640 1 -- 10.20.193.49:0/2211883408 shutdown_connections 2026-02-17T11:14:32.121 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:32.117+0000 7f166bbd3640 1 -- 10.20.193.49:0/2211883408 wait complete. 2026-02-17T11:14:32.121 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:32.117+0000 7f166bbd3640 1 librados: shutdown 2026-02-17T11:14:32.122 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:06:17.562 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:14:32.122 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:06:17.594 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:14:35.128 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:14:35.197 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.195+0000 7fb8eeac7640 10 monclient: get_monmap_and_config 2026-02-17T11:14:35.197 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.195+0000 7fb8eeac7640 10 monclient: build_initial_monmap 2026-02-17T11:14:35.198 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.195+0000 7fb8eeac7640 10 monclient: monmap: 2026-02-17T11:14:35.198 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:14:35.198 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:35.198 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:14:35.196559+0000 2026-02-17T11:14:35.198 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:14:35.196559+0000 2026-02-17T11:14:35.198 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:14:35.198 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:35.198 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:14:35.198 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:14:35.198 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:14:35.198 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:14:35.198 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:14:35.198 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:14:35.198 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:35.198 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.195+0000 7fb8eeac7640 1 Processor -- start 2026-02-17T11:14:35.198 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.195+0000 7fb8eeac7640 1 -- start start 2026-02-17T11:14:35.198 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.195+0000 7fb8eeac7640 10 monclient: init 2026-02-17T11:14:35.199 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.195+0000 7fb8eeac7640 10 monclient: _reopen_session rank -1 2026-02-17T11:14:35.199 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.195+0000 7fb8eeac7640 10 monclient: _add_conns ranks=[3,4,2,5,1,0] 2026-02-17T11:14:35.199 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.195+0000 7fb8eeac7640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fb8e815d370 0x7fb8e815d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:35.199 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.195+0000 7fb8eeac7640 10 monclient(hunting): picked mon.noname-a con 0x7fb8e815d370 addr v2:10.20.193.49:3300/0 2026-02-17T11:14:35.199 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.195+0000 7fb8eeac7640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7fb8e80c7e20 0x7fb8e80c74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:35.199 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.195+0000 7fb8eeac7640 10 monclient(hunting): picked mon.noname-b con 0x7fb8e80c7e20 addr v2:10.20.193.97:3300/0 2026-02-17T11:14:35.199 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.195+0000 7fb8eeac7640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fb8e815b000 addr v1:10.20.193.157:6789/0 2026-02-17T11:14:35.199 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.195+0000 7fb8eeac7640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8e80c8350 con 0x7fb8e815b000 2026-02-17T11:14:35.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.195+0000 7fb8eeac7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:35.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.195+0000 7fb8eeac7640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7fb8e80c9240 con 0x7fb8e815d370 2026-02-17T11:14:35.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.195+0000 7fb8eeac7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:35.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.196+0000 7fb8eeac7640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7fb8e80c8630 con 0x7fb8e80c7e20 2026-02-17T11:14:35.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.196+0000 7fb8eeac7640 10 monclient(hunting): _renew_subs 2026-02-17T11:14:35.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.196+0000 7fb8eeac7640 10 monclient(hunting): authenticate will time out at 1351.860006s 2026-02-17T11:14:35.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.196+0000 7fb8ec83c640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fb8e815d370 0x7fb8e815d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:35.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.196+0000 7fb8dffff640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7fb8e80c7e20 0x7fb8e80c74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:35.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.196+0000 7fb8ed03d640 1 --1- >> v1:10.20.193.157:6789/0 conn(0x7fb8e815b000 0x7fb8e80c52b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.157:6789/0 says I am v1:10.20.193.49:50450/0 (socket says 10.20.193.49:50450) 2026-02-17T11:14:35.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.196+0000 7fb8ed03d640 1 -- 10.20.193.49:0/2764429605 learned_addr learned my addr 10.20.193.49:0/2764429605 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:14:35.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.196+0000 7fb8ec83c640 10 monclient(hunting): get_auth_request con 0x7fb8e815d370 auth_method 0 2026-02-17T11:14:35.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.196+0000 7fb8ec83c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:35.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.196+0000 7fb8ec83c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:35.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.196+0000 7fb8ec83c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:35.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.196+0000 7fb8dffff640 10 monclient(hunting): get_auth_request con 0x7fb8e80c7e20 auth_method 0 2026-02-17T11:14:35.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.196+0000 7fb8dffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:35.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.196+0000 7fb8dffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:35.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.196+0000 7fb8dffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:35.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.196+0000 7fb8ec83c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:35.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.196+0000 7fb8ec83c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:35.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.196+0000 7fb8ec83c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:35.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.197+0000 7fb8dffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:35.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.197+0000 7fb8dffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:35.200 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.197+0000 7fb8dffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:35.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.197+0000 7fb8ec83c640 10 monclient(hunting): handle_auth_done global_id 5028 payload 274 2026-02-17T11:14:35.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.197+0000 7fb8ec83c640 1 -- 10.20.193.49:0/2764429605 >> v2:10.20.193.97:3300/0 conn(0x7fb8e80c7e20 msgr2=0x7fb8e80c74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:14:35.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.197+0000 7fb8ec83c640 1 --2- 10.20.193.49:0/2764429605 >> v2:10.20.193.97:3300/0 conn(0x7fb8e80c7e20 0x7fb8e80c74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:35.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.197+0000 7fb8ec83c640 1 -- 10.20.193.49:0/2764429605 >> v1:10.20.193.157:6789/0 conn(0x7fb8e815b000 legacy=0x7fb8e80c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:35.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.197+0000 7fb8ec83c640 10 monclient: _finish_hunting 0 2026-02-17T11:14:35.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.197+0000 7fb8ec83c640 1 monclient: found mon.noname-a 2026-02-17T11:14:35.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.197+0000 7fb8ec83c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:14:35.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.197+0000 7fb8ec83c640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:14:35.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.197+0000 7fb8ec83c640 1 -- 10.20.193.49:0/2764429605 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8e80c8910 con 0x7fb8e815d370 2026-02-17T11:14:35.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.198+0000 7fb8ec83c640 1 --2- 10.20.193.49:0/2764429605 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb8e815d370 0x7fb8e815d750 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb8e815d060 tx=0x7fb8d802ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=311b48e628317a27 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:14:35.203 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.200+0000 7fb8df7fe640 1 -- 10.20.193.49:0/2764429605 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8d803c070 con 0x7fb8e815d370 2026-02-17T11:14:35.203 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.200+0000 7fb8df7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:35.203 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.200+0000 7fb8df7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:14:35.203 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.200+0000 7fb8df7fe640 10 monclient: dump: 2026-02-17T11:14:35.203 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:35.203 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:35.203 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:35.203 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:35.203 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:35.204 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:35.204 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:35.204 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:35.204 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:35.204 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:35.204 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.200+0000 7fb8df7fe640 10 monclient: _finish_auth 0 2026-02-17T11:14:35.204 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.200+0000 7fb8df7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:14:35.204 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.200+0000 7fb8df7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:14:35.204 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.200+0000 7fb8df7fe640 1 -- 10.20.193.49:0/2764429605 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8d802f970 con 0x7fb8e815d370 2026-02-17T11:14:35.204 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.200+0000 7fb8df7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:14:35.204 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.200+0000 7fb8df7fe640 1 -- 10.20.193.49:0/2764429605 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8d802fd40 con 0x7fb8e815d370 2026-02-17T11:14:35.204 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.200+0000 7fb8eeac7640 5 monclient: authenticate success, global_id 5028 2026-02-17T11:14:35.204 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.200+0000 7fb8eeac7640 10 monclient: get_monmap_and_config success 2026-02-17T11:14:35.204 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.200+0000 7fb8eeac7640 4 set_mon_vals no callback set 2026-02-17T11:14:35.204 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.200+0000 7fb8df7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:35.204 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.200+0000 7fb8df7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:14:35.204 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.200+0000 7fb8df7fe640 10 monclient: dump: 2026-02-17T11:14:35.204 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:35.204 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:35.204 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:35.204 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:35.204 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:35.205 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:35.205 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:35.205 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:35.205 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:35.205 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:35.205 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.201+0000 7fb8eeac7640 10 monclient: shutdown 2026-02-17T11:14:35.205 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.201+0000 7fb8eeac7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:14:35.205 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.201+0000 7fb8eeac7640 1 -- 10.20.193.49:0/2764429605 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb8e815d370 msgr2=0x7fb8e815d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:35.205 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.201+0000 7fb8eeac7640 1 --2- 10.20.193.49:0/2764429605 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb8e815d370 0x7fb8e815d750 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb8e815d060 tx=0x7fb8d802ed70 comp rx=0 tx=0).stop 2026-02-17T11:14:35.205 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.201+0000 7fb8eeac7640 1 -- 10.20.193.49:0/2764429605 shutdown_connections 2026-02-17T11:14:35.205 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.201+0000 7fb8eeac7640 1 --2- 10.20.193.49:0/2764429605 >> v2:10.20.193.97:3300/0 conn(0x7fb8e80c7e20 0x7fb8e80c74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:35.205 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.201+0000 7fb8eeac7640 1 --2- 10.20.193.49:0/2764429605 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb8e815d370 0x7fb8e815d750 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:35.205 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.201+0000 7fb8eeac7640 1 -- 10.20.193.49:0/2764429605 >> 10.20.193.49:0/2764429605 conn(0x7fb8e80c9f20 msgr2=0x7fb8e80ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:14:35.205 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.201+0000 7fb8eeac7640 1 -- 10.20.193.49:0/2764429605 shutdown_connections 2026-02-17T11:14:35.205 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.201+0000 7fb8eeac7640 1 -- 10.20.193.49:0/2764429605 wait complete. 2026-02-17T11:14:35.207 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.201+0000 7fb8eeac7640 10 monclient: build_initial_monmap 2026-02-17T11:14:35.207 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.201+0000 7fb8eeac7640 10 monclient: monmap: 2026-02-17T11:14:35.207 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:14:35.207 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:14:35.207 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:14:35.207 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:14:35.207 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:14:35.207 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:35.207 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:14:35.207 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:14:35.207 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:14:35.207 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:35.207 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.201+0000 7fb8eeac7640 1 librados: starting msgr at 2026-02-17T11:14:35.207 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.201+0000 7fb8eeac7640 1 librados: starting objecter 2026-02-17T11:14:35.207 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.201+0000 7fb8eeac7640 1 Processor -- start 2026-02-17T11:14:35.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.201+0000 7fb8eeac7640 1 -- start start 2026-02-17T11:14:35.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.201+0000 7fb8eeac7640 1 librados: setting wanted keys 2026-02-17T11:14:35.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.201+0000 7fb8eeac7640 1 librados: calling monclient init 2026-02-17T11:14:35.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.201+0000 7fb8eeac7640 10 monclient: init 2026-02-17T11:14:35.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.202+0000 7fb8eeac7640 10 monclient: _reopen_session rank -1 2026-02-17T11:14:35.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.202+0000 7fb8eeac7640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:14:35.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.202+0000 7fb8eeac7640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb8e80c7e20 0x7fb8e80726d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:35.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.202+0000 7fb8eeac7640 10 monclient(hunting): picked mon.noname-a con 0x7fb8e80c7e20 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:14:35.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.202+0000 7fb8eeac7640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb8e815b000 0x7fb8e8144860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:35.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.202+0000 7fb8eeac7640 10 monclient(hunting): picked mon.noname-b con 0x7fb8e815b000 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:14:35.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.202+0000 7fb8eeac7640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb8e815d370 0x7fb8e814c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:35.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.202+0000 7fb8eeac7640 10 monclient(hunting): picked mon.noname-c con 0x7fb8e815d370 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:14:35.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.202+0000 7fb8eeac7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:35.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.202+0000 7fb8eeac7640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e80c96d0 con 0x7fb8e80c7e20 2026-02-17T11:14:35.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.202+0000 7fb8eeac7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:35.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.202+0000 7fb8eeac7640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e80c8ed0 con 0x7fb8e815b000 2026-02-17T11:14:35.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.202+0000 7fb8eeac7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:35.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.202+0000 7fb8eeac7640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e80cc450 con 0x7fb8e815d370 2026-02-17T11:14:35.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.202+0000 7fb8eeac7640 10 monclient(hunting): _renew_subs 2026-02-17T11:14:35.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.202+0000 7fb8eeac7640 10 monclient(hunting): authenticate will time out at 1351.866215s 2026-02-17T11:14:35.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.202+0000 7fb8ec83c640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb8e80c7e20 0x7fb8e80726d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:35.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.202+0000 7fb8ec83c640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb8e80c7e20 0x7fb8e80726d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:48804/0 (socket says 10.20.193.49:48804) 2026-02-17T11:14:35.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.202+0000 7fb8ec83c640 1 -- 10.20.193.49:0/653370992 learned_addr learned my addr 10.20.193.49:0/653370992 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:14:35.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.202+0000 7fb8ec83c640 10 monclient(hunting): get_auth_request con 0x7fb8e80c7e20 auth_method 0 2026-02-17T11:14:35.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.202+0000 7fb8ec83c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:35.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.202+0000 7fb8ec83c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:35.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.202+0000 7fb8ec83c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:35.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.202+0000 7fb8dffff640 1 --2- 10.20.193.49:0/653370992 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb8e815b000 0x7fb8e8144860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:35.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.202+0000 7fb8ed03d640 1 --2- 10.20.193.49:0/653370992 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb8e815d370 0x7fb8e814c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:35.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.202+0000 7fb8dffff640 10 monclient(hunting): get_auth_request con 0x7fb8e815b000 auth_method 0 2026-02-17T11:14:35.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.202+0000 7fb8dffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:35.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.202+0000 7fb8dffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:35.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.202+0000 7fb8dffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:35.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.202+0000 7fb8ec83c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:35.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.202+0000 7fb8ec83c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:35.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.202+0000 7fb8ec83c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:35.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.202+0000 7fb8ed03d640 10 monclient(hunting): get_auth_request con 0x7fb8e815d370 auth_method 0 2026-02-17T11:14:35.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.202+0000 7fb8ed03d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:35.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.202+0000 7fb8ed03d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:35.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.202+0000 7fb8ed03d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:35.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.203+0000 7fb8dffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:35.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.203+0000 7fb8dffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:35.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.203+0000 7fb8dffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:35.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.203+0000 7fb8ed03d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:35.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.203+0000 7fb8ed03d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:35.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.203+0000 7fb8ed03d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:35.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.204+0000 7fb8ec83c640 10 monclient(hunting): handle_auth_done global_id 5031 payload 824 2026-02-17T11:14:35.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.204+0000 7fb8ec83c640 1 -- 10.20.193.49:0/653370992 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb8e815d370 msgr2=0x7fb8e814c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:35.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.204+0000 7fb8ec83c640 1 --2- 10.20.193.49:0/653370992 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb8e815d370 0x7fb8e814c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:35.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.204+0000 7fb8ec83c640 1 -- 10.20.193.49:0/653370992 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb8e815b000 msgr2=0x7fb8e8144860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:35.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.204+0000 7fb8ec83c640 1 --2- 10.20.193.49:0/653370992 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb8e815b000 0x7fb8e8144860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:35.210 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.204+0000 7fb8ec83c640 10 monclient: _finish_hunting 0 2026-02-17T11:14:35.210 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.204+0000 7fb8ec83c640 1 monclient: found mon.noname-a 2026-02-17T11:14:35.210 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.204+0000 7fb8ec83c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:14:35.210 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.204+0000 7fb8ec83c640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:14:35.210 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.204+0000 7fb8ec83c640 1 -- 10.20.193.49:0/653370992 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8e80cc730 con 0x7fb8e80c7e20 2026-02-17T11:14:35.210 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.205+0000 7fb8ec83c640 1 --2- 10.20.193.49:0/653370992 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb8e80c7e20 0x7fb8e80726d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb8d803a040 tx=0x7fb8d80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:14:35.210 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.205+0000 7fb8dd7fa640 10 client.?.objecter ms_handle_connect 0x7fb8e80c7e20 2026-02-17T11:14:35.210 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.205+0000 7fb8dd7fa640 10 client.?.objecter resend_mon_ops 2026-02-17T11:14:35.211 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.206+0000 7fb8dd7fa640 1 -- 10.20.193.49:0/653370992 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8d8047070 con 0x7fb8e80c7e20 2026-02-17T11:14:35.211 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.206+0000 7fb8dd7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:35.211 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.206+0000 7fb8dd7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:14:35.211 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.206+0000 7fb8dd7fa640 10 monclient: dump: 2026-02-17T11:14:35.211 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:35.211 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:35.211 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:35.211 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:35.211 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:35.211 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:35.211 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:35.211 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:35.211 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:35.211 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:35.211 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.206+0000 7fb8dd7fa640 10 monclient: _finish_auth 0 2026-02-17T11:14:35.212 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.206+0000 7fb8dd7fa640 10 monclient: _check_auth_tickets 2026-02-17T11:14:35.212 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.206+0000 7fb8dd7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:14:35.212 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.206+0000 7fb8dd7fa640 1 -- 10.20.193.49:0/653370992 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8d8037d10 con 0x7fb8e80c7e20 2026-02-17T11:14:35.212 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.206+0000 7fb8dd7fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:14:35.212 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.206+0000 7fb8dd7fa640 1 -- 10.20.193.49:0/653370992 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8d803c040 con 0x7fb8e80c7e20 2026-02-17T11:14:35.212 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.206+0000 7fb8eeac7640 5 monclient: authenticate success, global_id 5031 2026-02-17T11:14:35.212 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.206+0000 7fb8eeac7640 10 monclient: _renew_subs 2026-02-17T11:14:35.212 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.206+0000 7fb8deffd640 4 set_mon_vals no callback set 2026-02-17T11:14:35.212 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.206+0000 7fb8eeac7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:14:35.212 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.206+0000 7fb8eeac7640 1 -- 10.20.193.49:0/653370992 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8e80cca10 con 0x7fb8e80c7e20 2026-02-17T11:14:35.212 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.206+0000 7fb8dd7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:35.212 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.206+0000 7fb8dd7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:14:35.212 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.206+0000 7fb8dd7fa640 10 monclient: dump: 2026-02-17T11:14:35.212 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:35.212 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:35.212 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:35.212 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:35.212 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:35.212 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:35.212 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:35.212 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:35.212 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:35.212 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:35.212 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.206+0000 7fb8eeac7640 10 client.5031.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:14:35.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.206+0000 7fb8eeac7640 10 monclient: _renew_subs 2026-02-17T11:14:35.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.206+0000 7fb8eeac7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:14:35.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.206+0000 7fb8eeac7640 1 -- 10.20.193.49:0/653370992 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8e80ccfd0 con 0x7fb8e80c7e20 2026-02-17T11:14:35.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.206+0000 7fb8eeac7640 1 librados: init done 2026-02-17T11:14:35.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.207+0000 7fb8eeac7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:14:35.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.207+0000 7fb8eeac7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:14:35.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.207+0000 7fb8eeac7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:14:35.213 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.207+0000 7fb8eeac7640 1 -- 10.20.193.49:0/653370992 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8e815c610 con 0x7fb8e80c7e20 2026-02-17T11:14:35.221 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.218+0000 7fb8dd7fa640 1 -- 10.20.193.49:0/653370992 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7fb8d8004270 con 0x7fb8e80c7e20 2026-02-17T11:14:35.221 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.219+0000 7fb8dd7fa640 1 --2- 10.20.193.49:0/653370992 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb8b8079190 0x7fb8b807b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:35.221 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.219+0000 7fb8dffff640 1 --2- 10.20.193.49:0/653370992 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb8b8079190 0x7fb8b807b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:35.221 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.219+0000 7fb8dffff640 10 monclient: get_auth_request con 0x7fb8b8079190 auth_method 0 2026-02-17T11:14:35.222 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.219+0000 7fb8dffff640 1 --2- 10.20.193.49:0/653370992 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb8b8079190 0x7fb8b807b650 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb8e80711a0 tx=0x7fb8d0009290 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:14:35.222 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.219+0000 7fb8dd7fa640 10 client.5031.objecter ms_handle_connect 0x7fb8b8079190 2026-02-17T11:14:35.222 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.220+0000 7fb8dd7fa640 1 -- 10.20.193.49:0/653370992 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7fb8d8004590 con 0x7fb8e80c7e20 2026-02-17T11:14:35.222 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.220+0000 7fb8dd7fa640 10 client.5031.objecter ms_dispatch2 0x7fb8e8000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:14:35.222 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.220+0000 7fb8dd7fa640 3 client.5031.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:14:35.222 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.220+0000 7fb8dd7fa640 3 client.5031.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:14:35.222 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.220+0000 7fb8dd7fa640 20 client.5031.objecter dump_active .. 0 homeless 2026-02-17T11:14:35.321 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.318+0000 7fb8dd7fa640 1 -- 10.20.193.49:0/653370992 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb8d8051080 con 0x7fb8e80c7e20 2026-02-17T11:14:35.321 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.318+0000 7fb8dd7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:14:35.321 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.318+0000 7fb8dd7fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:14:35.420 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.418+0000 7fb8eeac7640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:14:35.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.418+0000 7fb8eeac7640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:14:35.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.418+0000 7fb8eeac7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:14:35.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.418+0000 7fb8eeac7640 1 -- 10.20.193.49:0/653370992 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb8e80c6390 con 0x7fb8e80c7e20 2026-02-17T11:14:35.424 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.421+0000 7fb8dd7fa640 1 -- 10.20.193.49:0/653370992 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fb8d8086710 con 0x7fb8e80c7e20 2026-02-17T11:14:35.424 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.421+0000 7fb8dd7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:14:35.424 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.421+0000 7fb8dd7fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:14:35.424 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:14:35.424 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:14:35.425 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.422+0000 7fb8eeac7640 10 librados: watch_flush enter 2026-02-17T11:14:35.425 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.422+0000 7fb8eeac7640 10 librados: watch_flush exit 2026-02-17T11:14:35.425 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.422+0000 7fb8eeac7640 20 client.5031.objecter shutdown clearing up homeless session... 2026-02-17T11:14:35.426 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.422+0000 7fb8eeac7640 10 client.5031.objecter successfully canceled tick 2026-02-17T11:14:35.426 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.422+0000 7fb8eeac7640 1 -- 10.20.193.49:0/653370992 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb8b8079190 msgr2=0x7fb8b807b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:35.426 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.422+0000 7fb8eeac7640 1 --2- 10.20.193.49:0/653370992 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb8b8079190 0x7fb8b807b650 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb8e80711a0 tx=0x7fb8d0009290 comp rx=0 tx=0).stop 2026-02-17T11:14:35.426 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.422+0000 7fb8eeac7640 10 monclient: shutdown 2026-02-17T11:14:35.426 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.422+0000 7fb8eeac7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:14:35.426 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.422+0000 7fb8eeac7640 1 -- 10.20.193.49:0/653370992 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb8e80c7e20 msgr2=0x7fb8e80726d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:35.426 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.422+0000 7fb8eeac7640 1 --2- 10.20.193.49:0/653370992 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb8e80c7e20 0x7fb8e80726d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb8d803a040 tx=0x7fb8d80047c0 comp rx=0 tx=0).stop 2026-02-17T11:14:35.426 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.423+0000 7fb8eeac7640 1 -- 10.20.193.49:0/653370992 shutdown_connections 2026-02-17T11:14:35.426 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.423+0000 7fb8eeac7640 1 --2- 10.20.193.49:0/653370992 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb8b8079190 0x7fb8b807b650 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:35.426 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.423+0000 7fb8eeac7640 1 --2- 10.20.193.49:0/653370992 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb8e815d370 0x7fb8e814c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:35.426 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.423+0000 7fb8eeac7640 1 --2- 10.20.193.49:0/653370992 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb8e815b000 0x7fb8e8144860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:35.426 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.423+0000 7fb8eeac7640 1 --2- 10.20.193.49:0/653370992 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb8e80c7e20 0x7fb8e80726d0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:35.426 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.423+0000 7fb8eeac7640 1 -- 10.20.193.49:0/653370992 >> 10.20.193.49:0/653370992 conn(0x7fb8e80c9f20 msgr2=0x7fb8e80ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:14:35.426 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.423+0000 7fb8eeac7640 1 -- 10.20.193.49:0/653370992 shutdown_connections 2026-02-17T11:14:35.426 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.423+0000 7fb8eeac7640 1 -- 10.20.193.49:0/653370992 wait complete. 2026-02-17T11:14:35.426 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:35.423+0000 7fb8eeac7640 1 librados: shutdown 2026-02-17T11:14:38.434 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:14:38.500 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.498+0000 7f0217922640 10 monclient: get_monmap_and_config 2026-02-17T11:14:38.500 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.498+0000 7f0217922640 10 monclient: build_initial_monmap 2026-02-17T11:14:38.501 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.498+0000 7f0217922640 10 monclient: monmap: 2026-02-17T11:14:38.501 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:14:38.501 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:38.501 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:14:38.499814+0000 2026-02-17T11:14:38.501 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:14:38.499814+0000 2026-02-17T11:14:38.501 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:14:38.501 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:38.501 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:14:38.501 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:14:38.501 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:14:38.501 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:14:38.501 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:14:38.501 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:14:38.501 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:38.503 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.498+0000 7f0217922640 1 Processor -- start 2026-02-17T11:14:38.503 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.498+0000 7f0217922640 1 -- start start 2026-02-17T11:14:38.503 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.498+0000 7f0217922640 10 monclient: init 2026-02-17T11:14:38.503 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.499+0000 7f0217922640 10 monclient: _reopen_session rank -1 2026-02-17T11:14:38.503 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.499+0000 7f0217922640 10 monclient: _add_conns ranks=[0,1,4,2,5,3] 2026-02-17T11:14:38.503 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.499+0000 7f0217922640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f0210152700 addr v1:10.20.193.49:6789/0 2026-02-17T11:14:38.503 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.499+0000 7f0217922640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f021015ef80 addr v1:10.20.193.97:6789/0 2026-02-17T11:14:38.503 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.499+0000 7f0217922640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f0210152ae0 0x7f02100c9e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:38.503 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.499+0000 7f0217922640 10 monclient(hunting): picked mon.noname-b con 0x7f0210152ae0 addr v2:10.20.193.97:3300/0 2026-02-17T11:14:38.503 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.499+0000 7f0217922640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f021015d4f0 con 0x7f0210152700 2026-02-17T11:14:38.503 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.499+0000 7f0217922640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f021015d7d0 con 0x7f021015ef80 2026-02-17T11:14:38.503 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.499+0000 7f0217922640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:38.503 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.499+0000 7f0217922640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f021015dab0 con 0x7f0210152ae0 2026-02-17T11:14:38.504 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.499+0000 7f0217922640 10 monclient(hunting): _renew_subs 2026-02-17T11:14:38.504 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.499+0000 7f0217922640 10 monclient(hunting): authenticate will time out at 1355.163585s 2026-02-17T11:14:38.504 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.500+0000 7f0215e98640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f0210152ae0 0x7f02100c9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:38.504 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.500+0000 7f0214e96640 1 --1- >> v1:10.20.193.97:6789/0 conn(0x7f021015ef80 0x7f02100c9730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.97:6789/0 says I am v1:10.20.193.49:40144/0 (socket says 10.20.193.49:40144) 2026-02-17T11:14:38.504 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.500+0000 7f0214e96640 1 -- 10.20.193.49:0/1239797283 learned_addr learned my addr 10.20.193.49:0/1239797283 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:14:38.504 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.500+0000 7f0215e98640 10 monclient(hunting): get_auth_request con 0x7f0210152ae0 auth_method 0 2026-02-17T11:14:38.504 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.500+0000 7f0215e98640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:38.504 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.500+0000 7f0215e98640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:38.504 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.500+0000 7f0215e98640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:38.504 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.500+0000 7f0215e98640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:38.504 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.500+0000 7f0215e98640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:38.504 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.500+0000 7f0215e98640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:38.505 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.501+0000 7f0215e98640 10 monclient(hunting): handle_auth_done global_id 5008 payload 274 2026-02-17T11:14:38.505 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.501+0000 7f0215e98640 1 -- 10.20.193.49:0/1239797283 >> v1:10.20.193.97:6789/0 conn(0x7f021015ef80 legacy=0x7f02100c9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:38.505 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.501+0000 7f0215e98640 1 -- 10.20.193.49:0/1239797283 >> v1:10.20.193.49:6789/0 conn(0x7f0210152700 legacy=0x7f021015e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:14:38.505 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.501+0000 7f0215e98640 10 monclient: _finish_hunting 0 2026-02-17T11:14:38.505 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.501+0000 7f0215e98640 1 monclient: found mon.noname-b 2026-02-17T11:14:38.505 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.501+0000 7f0215e98640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:14:38.505 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.501+0000 7f0215e98640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:14:38.505 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.501+0000 7f0215e98640 1 -- 10.20.193.49:0/1239797283 --> v2:10.20.193.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f021015dd90 con 0x7f0210152ae0 2026-02-17T11:14:38.506 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.504+0000 7f0215e98640 1 --2- 10.20.193.49:0/1239797283 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f0210152ae0 0x7f02100c9e40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f020c009d90 tx=0x7f020c02f1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe07426e251b9626 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:14:38.509 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.506+0000 7f01fffff640 1 -- 10.20.193.49:0/1239797283 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f020c03c070 con 0x7f0210152ae0 2026-02-17T11:14:38.509 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.506+0000 7f01fffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:38.509 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.506+0000 7f01fffff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:14:38.509 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.506+0000 7f01fffff640 10 monclient: dump: 2026-02-17T11:14:38.509 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:38.509 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:38.509 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:38.509 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:38.509 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:38.509 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:38.509 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:38.509 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:38.509 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:38.509 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:38.509 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.506+0000 7f01fffff640 10 monclient: _finish_auth 0 2026-02-17T11:14:38.510 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.506+0000 7f01fffff640 10 monclient: _check_auth_tickets 2026-02-17T11:14:38.510 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.506+0000 7f01fffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:14:38.510 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.506+0000 7f01fffff640 1 -- 10.20.193.49:0/1239797283 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f020c037440 con 0x7f0210152ae0 2026-02-17T11:14:38.510 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.506+0000 7f0217922640 5 monclient: authenticate success, global_id 5008 2026-02-17T11:14:38.510 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.506+0000 7f0217922640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:14:38.510 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.506+0000 7f01fffff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:14:38.510 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.506+0000 7f01fffff640 1 -- 10.20.193.49:0/1239797283 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f020c037810 con 0x7f0210152ae0 2026-02-17T11:14:38.510 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.506+0000 7f0217922640 10 monclient: get_monmap_and_config success 2026-02-17T11:14:38.510 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.506+0000 7f0217922640 4 set_mon_vals no callback set 2026-02-17T11:14:38.510 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.506+0000 7f01fffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:38.510 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.506+0000 7f01fffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:14:38.510 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.506+0000 7f01fffff640 10 monclient: dump: 2026-02-17T11:14:38.510 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:38.510 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:38.510 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:38.511 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:38.511 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:38.511 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:38.511 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:38.511 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:38.511 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:38.511 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:38.511 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.506+0000 7f0217922640 10 monclient: shutdown 2026-02-17T11:14:38.511 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.506+0000 7f0217922640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:14:38.511 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.506+0000 7f0217922640 1 -- 10.20.193.49:0/1239797283 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f0210152ae0 msgr2=0x7f02100c9e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:38.511 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.506+0000 7f0217922640 1 --2- 10.20.193.49:0/1239797283 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f0210152ae0 0x7f02100c9e40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f020c009d90 tx=0x7f020c02f1e0 comp rx=0 tx=0).stop 2026-02-17T11:14:38.511 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.506+0000 7f0217922640 1 -- 10.20.193.49:0/1239797283 shutdown_connections 2026-02-17T11:14:38.511 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.506+0000 7f0217922640 1 --2- 10.20.193.49:0/1239797283 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f0210152ae0 0x7f02100c9e40 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:38.511 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.506+0000 7f0217922640 1 -- 10.20.193.49:0/1239797283 >> 10.20.193.49:0/1239797283 conn(0x7f0210073030 msgr2=0x7f0210073440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:14:38.511 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.506+0000 7f0217922640 1 -- 10.20.193.49:0/1239797283 shutdown_connections 2026-02-17T11:14:38.511 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.506+0000 7f0217922640 1 -- 10.20.193.49:0/1239797283 wait complete. 2026-02-17T11:14:38.511 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.506+0000 7f0217922640 10 monclient: build_initial_monmap 2026-02-17T11:14:38.511 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.506+0000 7f0217922640 10 monclient: monmap: 2026-02-17T11:14:38.511 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:14:38.511 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:14:38.511 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:14:38.512 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:14:38.512 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:14:38.512 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:38.512 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:14:38.512 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:14:38.512 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:14:38.512 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:38.515 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.507+0000 7f0217922640 1 librados: starting msgr at 2026-02-17T11:14:38.515 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.507+0000 7f0217922640 1 librados: starting objecter 2026-02-17T11:14:38.515 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.507+0000 7f0217922640 1 Processor -- start 2026-02-17T11:14:38.515 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.507+0000 7f0217922640 1 -- start start 2026-02-17T11:14:38.515 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.507+0000 7f0217922640 1 librados: setting wanted keys 2026-02-17T11:14:38.515 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.507+0000 7f0217922640 1 librados: calling monclient init 2026-02-17T11:14:38.515 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.507+0000 7f0217922640 10 monclient: init 2026-02-17T11:14:38.515 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.507+0000 7f0217922640 10 monclient: _reopen_session rank -1 2026-02-17T11:14:38.515 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.507+0000 7f0217922640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:14:38.515 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.507+0000 7f0217922640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f0210152700 0x7f02100ce0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:38.515 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.507+0000 7f0217922640 10 monclient(hunting): picked mon.noname-b con 0x7f0210152700 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:14:38.515 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.507+0000 7f0217922640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0210152ae0 0x7f0210146230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:38.515 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.507+0000 7f0217922640 10 monclient(hunting): picked mon.noname-a con 0x7f0210152ae0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:14:38.515 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.507+0000 7f0217922640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f021015ef80 0x7f02100d1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:38.516 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.507+0000 7f0217922640 10 monclient(hunting): picked mon.noname-c con 0x7f021015ef80 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:14:38.516 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.507+0000 7f0217922640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:38.516 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.507+0000 7f0217922640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f02100ca380 con 0x7f0210152ae0 2026-02-17T11:14:38.516 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.507+0000 7f0217922640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:38.516 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.507+0000 7f0217922640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f021015e350 con 0x7f0210152700 2026-02-17T11:14:38.516 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.507+0000 7f0217922640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:38.516 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.507+0000 7f0217922640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f0210166850 con 0x7f021015ef80 2026-02-17T11:14:38.516 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.507+0000 7f0217922640 10 monclient(hunting): _renew_subs 2026-02-17T11:14:38.516 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.507+0000 7f0217922640 10 monclient(hunting): authenticate will time out at 1355.171516s 2026-02-17T11:14:38.516 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.507+0000 7f0215697640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f0210152700 0x7f02100ce0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:38.516 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.507+0000 7f0214e96640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0210152ae0 0x7f0210146230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:38.516 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.507+0000 7f0215697640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f0210152700 0x7f02100ce0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:41454/0 (socket says 10.20.193.49:41454) 2026-02-17T11:14:38.516 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.507+0000 7f0215697640 1 -- 10.20.193.49:0/3698259913 learned_addr learned my addr 10.20.193.49:0/3698259913 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:14:38.516 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.507+0000 7f0215697640 10 monclient(hunting): get_auth_request con 0x7f0210152700 auth_method 0 2026-02-17T11:14:38.516 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.507+0000 7f0215697640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:38.516 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.507+0000 7f0215697640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:38.516 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.507+0000 7f0215697640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:38.516 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.507+0000 7f0215e98640 1 --2- 10.20.193.49:0/3698259913 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f021015ef80 0x7f02100d1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:38.516 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.507+0000 7f0214e96640 10 monclient(hunting): get_auth_request con 0x7f0210152ae0 auth_method 0 2026-02-17T11:14:38.516 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.507+0000 7f0214e96640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:38.516 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.507+0000 7f0214e96640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:38.516 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.507+0000 7f0214e96640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:38.516 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.508+0000 7f0215697640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:38.516 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.508+0000 7f0215697640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:38.517 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.508+0000 7f0215697640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:38.517 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.508+0000 7f0215e98640 10 monclient(hunting): get_auth_request con 0x7f021015ef80 auth_method 0 2026-02-17T11:14:38.517 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.508+0000 7f0215e98640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:38.517 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.508+0000 7f0215e98640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:38.517 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.508+0000 7f0215e98640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:38.517 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.508+0000 7f0214e96640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:38.517 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.508+0000 7f0214e96640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:38.517 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.508+0000 7f0214e96640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:38.517 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.508+0000 7f0215e98640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:38.517 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.508+0000 7f0215e98640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:38.517 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.508+0000 7f0215e98640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:38.517 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.509+0000 7f0215697640 10 monclient(hunting): handle_auth_done global_id 5014 payload 824 2026-02-17T11:14:38.517 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.509+0000 7f0215697640 1 -- 10.20.193.49:0/3698259913 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f021015ef80 msgr2=0x7f02100d1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:38.517 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.509+0000 7f0215697640 1 --2- 10.20.193.49:0/3698259913 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f021015ef80 0x7f02100d1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:38.517 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.509+0000 7f0215697640 1 -- 10.20.193.49:0/3698259913 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0210152ae0 msgr2=0x7f0210146230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:38.517 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.509+0000 7f0215697640 1 --2- 10.20.193.49:0/3698259913 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0210152ae0 0x7f0210146230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:38.517 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.509+0000 7f0215697640 10 monclient: _finish_hunting 0 2026-02-17T11:14:38.517 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.509+0000 7f0215697640 1 monclient: found mon.noname-b 2026-02-17T11:14:38.517 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.509+0000 7f0215697640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:14:38.517 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.509+0000 7f0215697640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:14:38.517 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.509+0000 7f0215697640 1 -- 10.20.193.49:0/3698259913 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02100cb960 con 0x7f0210152700 2026-02-17T11:14:38.517 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.510+0000 7f0215697640 1 --2- 10.20.193.49:0/3698259913 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f0210152700 0x7f02100ce0c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f020000b4d0 tx=0x7f020000b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:14:38.517 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.510+0000 7f01fdffb640 10 client.?.objecter ms_handle_connect 0x7f0210152700 2026-02-17T11:14:38.518 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.510+0000 7f01fdffb640 10 client.?.objecter resend_mon_ops 2026-02-17T11:14:38.518 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.512+0000 7f01fdffb640 1 -- 10.20.193.49:0/3698259913 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0200004480 con 0x7f0210152700 2026-02-17T11:14:38.518 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.512+0000 7f01fdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:38.518 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.512+0000 7f01fdffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:14:38.518 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.512+0000 7f01fdffb640 10 monclient: dump: 2026-02-17T11:14:38.518 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:38.518 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:38.518 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:38.518 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:38.518 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:38.518 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:38.518 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:38.518 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:38.518 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:38.518 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:38.518 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.512+0000 7f01fdffb640 10 monclient: _finish_auth 0 2026-02-17T11:14:38.518 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.512+0000 7f01fdffb640 10 monclient: _check_auth_tickets 2026-02-17T11:14:38.518 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.512+0000 7f01fdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:14:38.518 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.512+0000 7f01fdffb640 1 -- 10.20.193.49:0/3698259913 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0200015070 con 0x7f0210152700 2026-02-17T11:14:38.518 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.512+0000 7f0217922640 5 monclient: authenticate success, global_id 5014 2026-02-17T11:14:38.518 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.512+0000 7f0217922640 10 monclient: _renew_subs 2026-02-17T11:14:38.518 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.512+0000 7f0217922640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:14:38.518 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.512+0000 7f0217922640 1 -- 10.20.193.49:0/3698259913 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02100d05c0 con 0x7f0210152700 2026-02-17T11:14:38.519 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.512+0000 7f01fdffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:14:38.519 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.512+0000 7f01fdffb640 1 -- 10.20.193.49:0/3698259913 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0200002920 con 0x7f0210152700 2026-02-17T11:14:38.519 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.512+0000 7f01fdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:38.519 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.512+0000 7f01fdffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:14:38.519 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.512+0000 7f01fdffb640 10 monclient: dump: 2026-02-17T11:14:38.519 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:38.519 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:38.519 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:38.519 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:38.519 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:38.519 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:38.519 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:38.519 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:38.519 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:38.519 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:38.519 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.512+0000 7f01ff7fe640 4 set_mon_vals no callback set 2026-02-17T11:14:38.519 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.512+0000 7f0217922640 10 client.5014.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:14:38.519 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.512+0000 7f0217922640 10 monclient: _renew_subs 2026-02-17T11:14:38.519 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.512+0000 7f0217922640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:14:38.519 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.512+0000 7f0217922640 1 -- 10.20.193.49:0/3698259913 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02100d0eb0 con 0x7f0210152700 2026-02-17T11:14:38.519 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.512+0000 7f0217922640 1 librados: init done 2026-02-17T11:14:38.519 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.512+0000 7f0217922640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:14:38.519 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.512+0000 7f0217922640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:14:38.520 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.512+0000 7f0217922640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:14:38.520 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.512+0000 7f0217922640 1 -- 10.20.193.49:0/3698259913 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f021015e870 con 0x7f0210152700 2026-02-17T11:14:38.526 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.523+0000 7f01fdffb640 1 -- 10.20.193.49:0/3698259913 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f0200010480 con 0x7f0210152700 2026-02-17T11:14:38.526 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.524+0000 7f01fdffb640 1 --2- 10.20.193.49:0/3698259913 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f01e0079190 0x7f01e007b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:38.526 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.524+0000 7f0214e96640 1 --2- 10.20.193.49:0/3698259913 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f01e0079190 0x7f01e007b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:38.527 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.524+0000 7f0214e96640 10 monclient: get_auth_request con 0x7f01e0079190 auth_method 0 2026-02-17T11:14:38.527 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.525+0000 7f0214e96640 1 --2- 10.20.193.49:0/3698259913 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f01e0079190 0x7f01e007b650 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f02101562f0 tx=0x7f0204009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:14:38.527 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.525+0000 7f01fdffb640 10 client.5014.objecter ms_handle_connect 0x7f01e0079190 2026-02-17T11:14:38.527 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.525+0000 7f01fdffb640 1 -- 10.20.193.49:0/3698259913 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f020005e3a0 con 0x7f0210152700 2026-02-17T11:14:38.527 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.525+0000 7f01fdffb640 10 client.5014.objecter ms_dispatch2 0x7f0210000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:14:38.527 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.525+0000 7f01fdffb640 3 client.5014.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:14:38.528 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.525+0000 7f01fdffb640 3 client.5014.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:14:38.528 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.525+0000 7f01fdffb640 20 client.5014.objecter dump_active .. 0 homeless 2026-02-17T11:14:38.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.625+0000 7f01fdffb640 1 -- 10.20.193.49:0/3698259913 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f0200062360 con 0x7f0210152700 2026-02-17T11:14:38.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.625+0000 7f01fdffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:14:38.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.625+0000 7f01fdffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:14:38.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.725+0000 7f0217922640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:14:38.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.725+0000 7f0217922640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:14:38.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.725+0000 7f0217922640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:14:38.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.725+0000 7f0217922640 1 -- 10.20.193.49:0/3698259913 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f021014cc20 con 0x7f0210152700 2026-02-17T11:14:38.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.728+0000 7f01fdffb640 1 -- 10.20.193.49:0/3698259913 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f0200066660 con 0x7f0210152700 2026-02-17T11:14:38.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.728+0000 7f01fdffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:14:38.731 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.728+0000 7f01fdffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:14:38.731 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:14:38.731 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:14:38.733 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.729+0000 7f0217922640 10 librados: watch_flush enter 2026-02-17T11:14:38.733 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.729+0000 7f0217922640 10 librados: watch_flush exit 2026-02-17T11:14:38.733 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.729+0000 7f0217922640 20 client.5014.objecter shutdown clearing up homeless session... 2026-02-17T11:14:38.733 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.729+0000 7f0217922640 10 client.5014.objecter successfully canceled tick 2026-02-17T11:14:38.733 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.729+0000 7f0217922640 1 -- 10.20.193.49:0/3698259913 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f01e0079190 msgr2=0x7f01e007b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:38.733 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.729+0000 7f0217922640 1 --2- 10.20.193.49:0/3698259913 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f01e0079190 0x7f01e007b650 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f02101562f0 tx=0x7f0204009040 comp rx=0 tx=0).stop 2026-02-17T11:14:38.733 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.729+0000 7f0217922640 10 monclient: shutdown 2026-02-17T11:14:38.733 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.729+0000 7f0217922640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:14:38.733 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.729+0000 7f0217922640 1 -- 10.20.193.49:0/3698259913 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f0210152700 msgr2=0x7f02100ce0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:38.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.729+0000 7f0217922640 1 --2- 10.20.193.49:0/3698259913 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f0210152700 0x7f02100ce0c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f020000b4d0 tx=0x7f020000b9a0 comp rx=0 tx=0).stop 2026-02-17T11:14:38.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.729+0000 7f0217922640 1 -- 10.20.193.49:0/3698259913 shutdown_connections 2026-02-17T11:14:38.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.729+0000 7f0217922640 1 --2- 10.20.193.49:0/3698259913 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f01e0079190 0x7f01e007b650 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:38.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.729+0000 7f0217922640 1 --2- 10.20.193.49:0/3698259913 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f021015ef80 0x7f02100d1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:38.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.729+0000 7f0217922640 1 --2- 10.20.193.49:0/3698259913 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0210152ae0 0x7f0210146230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:38.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.729+0000 7f0217922640 1 --2- 10.20.193.49:0/3698259913 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f0210152700 0x7f02100ce0c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:38.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.729+0000 7f0217922640 1 -- 10.20.193.49:0/3698259913 >> 10.20.193.49:0/3698259913 conn(0x7f0210073030 msgr2=0x7f0210151340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:14:38.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.729+0000 7f0217922640 1 -- 10.20.193.49:0/3698259913 shutdown_connections 2026-02-17T11:14:38.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.729+0000 7f0217922640 1 -- 10.20.193.49:0/3698259913 wait complete. 2026-02-17T11:14:38.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:38.729+0000 7f0217922640 1 librados: shutdown 2026-02-17T11:14:41.741 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:14:41.810 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.808+0000 7fbe91133640 10 monclient: get_monmap_and_config 2026-02-17T11:14:41.811 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.808+0000 7fbe91133640 10 monclient: build_initial_monmap 2026-02-17T11:14:41.811 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.808+0000 7fbe91133640 10 monclient: monmap: 2026-02-17T11:14:41.811 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:14:41.811 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:41.811 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:14:41.809813+0000 2026-02-17T11:14:41.811 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:14:41.809813+0000 2026-02-17T11:14:41.811 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:14:41.811 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:41.811 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:14:41.812 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:14:41.812 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:14:41.812 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:14:41.812 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:14:41.812 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:14:41.812 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:41.815 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.808+0000 7fbe91133640 1 Processor -- start 2026-02-17T11:14:41.815 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.808+0000 7fbe91133640 1 -- start start 2026-02-17T11:14:41.815 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.808+0000 7fbe91133640 10 monclient: init 2026-02-17T11:14:41.815 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.809+0000 7fbe91133640 10 monclient: _reopen_session rank -1 2026-02-17T11:14:41.815 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.809+0000 7fbe91133640 10 monclient: _add_conns ranks=[2,1,0,5,4,3] 2026-02-17T11:14:41.815 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.809+0000 7fbe91133640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fbe8c152820 addr v1:10.20.193.157:6789/0 2026-02-17T11:14:41.815 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.809+0000 7fbe91133640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fbe8c152c00 addr v1:10.20.193.97:6789/0 2026-02-17T11:14:41.815 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.809+0000 7fbe91133640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fbe8c0c63f0 addr v1:10.20.193.49:6789/0 2026-02-17T11:14:41.815 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.809+0000 7fbe91133640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe8c073e90 con 0x7fbe8c0c63f0 2026-02-17T11:14:41.816 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.809+0000 7fbe91133640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe8c074170 con 0x7fbe8c152c00 2026-02-17T11:14:41.816 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.809+0000 7fbe91133640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe8c074450 con 0x7fbe8c152820 2026-02-17T11:14:41.816 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.809+0000 7fbe91133640 10 monclient(hunting): _renew_subs 2026-02-17T11:14:41.816 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.809+0000 7fbe91133640 10 monclient(hunting): authenticate will time out at 1358.473607s 2026-02-17T11:14:41.816 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.810+0000 7fbe8a575640 1 --1- >> v1:10.20.193.97:6789/0 conn(0x7fbe8c152c00 0x7fbe8c0c5ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.97:6789/0 says I am v1:10.20.193.49:40154/0 (socket says 10.20.193.49:40154) 2026-02-17T11:14:41.816 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.810+0000 7fbe8ad76640 1 --1- >> v1:10.20.193.157:6789/0 conn(0x7fbe8c152820 0x7fbe8c0c7e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.157:6789/0 says I am v1:10.20.193.49:36118/0 (socket says 10.20.193.49:36118) 2026-02-17T11:14:41.816 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.810+0000 7fbe8a575640 1 -- 10.20.193.49:0/3701603650 learned_addr learned my addr 10.20.193.49:0/3701603650 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:14:41.816 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.811+0000 7fbe89d74640 1 -- 10.20.193.49:0/3701603650 <== mon.2 v1:10.20.193.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 780655494 0 0) 0x7fbe8c074450 con 0x7fbe8c152820 2026-02-17T11:14:41.816 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.811+0000 7fbe89d74640 10 monclient(hunting): _negotiate 2026-02-17T11:14:41.816 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.811+0000 7fbe89d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:41.817 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.811+0000 7fbe89d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:41.817 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.811+0000 7fbe89d74640 10 monclient(hunting): my global_id is 5057 2026-02-17T11:14:41.817 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.811+0000 7fbe89d74640 1 -- 10.20.193.49:0/3701603650 --> v1:10.20.193.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe78003620 con 0x7fbe8c152820 2026-02-17T11:14:41.817 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.811+0000 7fbe89d74640 1 -- 10.20.193.49:0/3701603650 <== mon.1 v1:10.20.193.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3777548039 0 0) 0x7fbe8c074170 con 0x7fbe8c152c00 2026-02-17T11:14:41.817 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.811+0000 7fbe89d74640 10 monclient(hunting): _negotiate 2026-02-17T11:14:41.817 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.811+0000 7fbe89d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:41.817 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.811+0000 7fbe89d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:41.817 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.811+0000 7fbe89d74640 10 monclient(hunting): my global_id is 5017 2026-02-17T11:14:41.817 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.811+0000 7fbe89d74640 1 -- 10.20.193.49:0/3701603650 --> v1:10.20.193.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe8c074450 con 0x7fbe8c152c00 2026-02-17T11:14:41.817 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.811+0000 7fbe89d74640 1 -- 10.20.193.49:0/3701603650 <== mon.0 v1:10.20.193.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1434254967 0 0) 0x7fbe8c073e90 con 0x7fbe8c0c63f0 2026-02-17T11:14:41.817 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.811+0000 7fbe89d74640 10 monclient(hunting): _negotiate 2026-02-17T11:14:41.817 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.811+0000 7fbe89d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:41.818 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.811+0000 7fbe89d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:41.818 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.811+0000 7fbe89d74640 10 monclient(hunting): my global_id is 5037 2026-02-17T11:14:41.818 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.811+0000 7fbe89d74640 1 -- 10.20.193.49:0/3701603650 --> v1:10.20.193.49:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe8c074170 con 0x7fbe8c0c63f0 2026-02-17T11:14:41.828 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.813+0000 7fbe89d74640 1 -- 10.20.193.49:0/3701603650 <== mon.2 v1:10.20.193.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3580524297 0 0) 0x7fbe78003620 con 0x7fbe8c152820 2026-02-17T11:14:41.829 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.813+0000 7fbe89d74640 1 -- 10.20.193.49:0/3701603650 >> v1:10.20.193.97:6789/0 conn(0x7fbe8c152c00 legacy=0x7fbe8c0c5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:41.829 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.813+0000 7fbe89d74640 1 -- 10.20.193.49:0/3701603650 >> v1:10.20.193.49:6789/0 conn(0x7fbe8c0c63f0 legacy=0x7fbe8c0726d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:41.829 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.813+0000 7fbe89d74640 10 monclient: _finish_hunting 0 2026-02-17T11:14:41.829 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.813+0000 7fbe89d74640 1 monclient: found mon.noname-c-legacy 2026-02-17T11:14:41.829 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.813+0000 7fbe89d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:14:41.829 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.813+0000 7fbe89d74640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:10.20.193.157:6789/0 2026-02-17T11:14:41.829 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.813+0000 7fbe89d74640 1 -- 10.20.193.49:0/3701603650 --> v1:10.20.193.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe8c074730 con 0x7fbe8c152820 2026-02-17T11:14:41.829 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.813+0000 7fbe89d74640 10 monclient: _finish_auth 0 2026-02-17T11:14:41.829 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.813+0000 7fbe89d74640 10 monclient: _check_auth_tickets 2026-02-17T11:14:41.829 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.813+0000 7fbe89d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:14:41.830 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.813+0000 7fbe89d74640 1 -- 10.20.193.49:0/3701603650 <== mon.2 v1:10.20.193.157:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2462710995 0 0) 0x7fbe80002f00 con 0x7fbe8c152820 2026-02-17T11:14:41.830 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.813+0000 7fbe89d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:41.830 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.813+0000 7fbe89d74640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2026-02-17T11:14:41.830 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.813+0000 7fbe89d74640 10 monclient: dump: 2026-02-17T11:14:41.830 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:41.830 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:41.830 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:41.830 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:41.830 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:41.830 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:41.830 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:41.830 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:41.831 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:41.831 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:41.831 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.813+0000 7fbe89d74640 1 monclient: mon.c has (v2) addrs [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] but i'm connected to v1:10.20.193.157:6789/0, reconnecting 2026-02-17T11:14:41.831 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.813+0000 7fbe89d74640 10 monclient: _reopen_session rank -1 2026-02-17T11:14:41.831 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.813+0000 7fbe89d74640 1 -- 10.20.193.49:0/3701603650 >> v1:10.20.193.157:6789/0 conn(0x7fbe8c152820 legacy=0x7fbe8c0c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:41.831 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.813+0000 7fbe89d74640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:14:41.831 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.813+0000 7fbe89d74640 1 --2- 10.20.193.49:0/3701603650 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbe78004000 0x7fbe78004900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:41.831 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.813+0000 7fbe89d74640 10 monclient(hunting): picked mon.a con 0x7fbe78004000 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:14:41.831 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.813+0000 7fbe89d74640 1 --2- 10.20.193.49:0/3701603650 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fbe78004e40 0x7fbe780052c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:41.831 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.813+0000 7fbe89d74640 10 monclient(hunting): picked mon.c con 0x7fbe78004e40 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:14:41.831 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.813+0000 7fbe89d74640 1 --2- 10.20.193.49:0/3701603650 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fbe7800bd40 0x7fbe7800e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:41.832 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.813+0000 7fbe89d74640 10 monclient(hunting): picked mon.b con 0x7fbe7800bd40 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:14:41.832 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.813+0000 7fbe89d74640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:41.832 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.813+0000 7fbe89d74640 1 -- 10.20.193.49:0/3701603650 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fbe7800e750 con 0x7fbe78004000 2026-02-17T11:14:41.832 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.813+0000 7fbe89d74640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:41.832 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.813+0000 7fbe89d74640 1 -- 10.20.193.49:0/3701603650 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fbe7800e900 con 0x7fbe7800bd40 2026-02-17T11:14:41.832 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.813+0000 7fbe89d74640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:41.832 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.813+0000 7fbe89d74640 1 -- 10.20.193.49:0/3701603650 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fbe7800eb00 con 0x7fbe78004e40 2026-02-17T11:14:41.832 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.813+0000 7fbe89d74640 10 monclient(hunting): _renew_subs 2026-02-17T11:14:41.832 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.813+0000 7fbe89d74640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:14:41.832 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.814+0000 7fbe8ad76640 1 --2- 10.20.193.49:0/3701603650 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbe78004000 0x7fbe78004900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:41.832 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.814+0000 7fbe8b577640 1 --2- 10.20.193.49:0/3701603650 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fbe7800bd40 0x7fbe7800e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:41.832 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.814+0000 7fbe8ad76640 10 monclient(hunting): get_auth_request con 0x7fbe78004000 auth_method 0 2026-02-17T11:14:41.832 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.814+0000 7fbe8ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:41.833 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.814+0000 7fbe8ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:41.833 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.814+0000 7fbe8ad76640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:14:41.833 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.814+0000 7fbe8b577640 10 monclient(hunting): get_auth_request con 0x7fbe7800bd40 auth_method 0 2026-02-17T11:14:41.833 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.814+0000 7fbe8b577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:41.833 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.814+0000 7fbe8b577640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:41.833 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.814+0000 7fbe8b577640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:14:41.833 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.814+0000 7fbe8a575640 1 --2- 10.20.193.49:0/3701603650 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fbe78004e40 0x7fbe780052c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:41.833 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.814+0000 7fbe8a575640 10 monclient(hunting): get_auth_request con 0x7fbe78004e40 auth_method 0 2026-02-17T11:14:41.833 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.814+0000 7fbe8a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:41.833 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.814+0000 7fbe8a575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:41.833 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.814+0000 7fbe8a575640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:14:41.834 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.814+0000 7fbe8ad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:41.834 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.814+0000 7fbe8ad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:41.834 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.814+0000 7fbe8ad76640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:14:41.834 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.814+0000 7fbe8b577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:41.834 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.814+0000 7fbe8b577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:41.834 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.814+0000 7fbe8b577640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:14:41.834 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.815+0000 7fbe8a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:41.834 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.815+0000 7fbe8a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:41.834 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.815+0000 7fbe8a575640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:14:41.834 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.815+0000 7fbe8ad76640 10 monclient(hunting): handle_auth_done global_id 5057 payload 293 2026-02-17T11:14:41.834 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.815+0000 7fbe8ad76640 1 -- 10.20.193.49:0/3701603650 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fbe78004e40 msgr2=0x7fbe780052c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:14:41.834 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.815+0000 7fbe8ad76640 1 --2- 10.20.193.49:0/3701603650 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fbe78004e40 0x7fbe780052c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:41.835 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.815+0000 7fbe8ad76640 1 -- 10.20.193.49:0/3701603650 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fbe7800bd40 msgr2=0x7fbe7800e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:14:41.835 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.815+0000 7fbe8ad76640 1 --2- 10.20.193.49:0/3701603650 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fbe7800bd40 0x7fbe7800e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:41.835 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.815+0000 7fbe8ad76640 10 monclient: _finish_hunting 0 2026-02-17T11:14:41.835 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.815+0000 7fbe8ad76640 1 monclient: found mon.a 2026-02-17T11:14:41.835 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.815+0000 7fbe8ad76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:14:41.835 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.815+0000 7fbe8ad76640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:14:41.835 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.815+0000 7fbe8b577640 1 -- 10.20.193.49:0/3701603650 reap_dead start 2026-02-17T11:14:41.835 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.815+0000 7fbe8ad76640 1 -- 10.20.193.49:0/3701603650 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe78003620 con 0x7fbe78004000 2026-02-17T11:14:41.835 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.815+0000 7fbe8ad76640 10 monclient: _finish_auth 0 2026-02-17T11:14:41.835 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.815+0000 7fbe8ad76640 10 monclient: _check_auth_tickets 2026-02-17T11:14:41.835 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.815+0000 7fbe8ad76640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:14:41.836 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.815+0000 7fbe91133640 5 monclient: authenticate success, global_id 5057 2026-02-17T11:14:41.836 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.815+0000 7fbe91133640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:14:41.836 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.817+0000 7fbe8ad76640 1 --2- 10.20.193.49:0/3701603650 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbe78004000 0x7fbe78004900 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fbe8000c110 tx=0x7fbe8002f450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6f8cf0775e01baa server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:14:41.836 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.818+0000 7fbe89d74640 1 -- 10.20.193.49:0/3701603650 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe80007c40 con 0x7fbe78004000 2026-02-17T11:14:41.836 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.818+0000 7fbe89d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:41.836 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.818+0000 7fbe89d74640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:14:41.836 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.818+0000 7fbe89d74640 10 monclient: dump: 2026-02-17T11:14:41.836 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:41.836 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:41.836 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:41.836 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:41.836 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:41.837 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:41.837 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:41.837 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:41.837 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:41.837 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:41.837 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.818+0000 7fbe91133640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:14:41.837 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.818+0000 7fbe89d74640 1 -- 10.20.193.49:0/3701603650 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe80033030 con 0x7fbe78004000 2026-02-17T11:14:41.837 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.818+0000 7fbe89d74640 10 monclient: handle_config config(0 keys) 2026-02-17T11:14:41.837 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.818+0000 7fbe89d74640 1 -- 10.20.193.49:0/3701603650 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe80005b50 con 0x7fbe78004000 2026-02-17T11:14:41.837 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.818+0000 7fbe89d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:41.837 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.818+0000 7fbe89d74640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:14:41.838 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.818+0000 7fbe89d74640 10 monclient: dump: 2026-02-17T11:14:41.838 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:41.838 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:41.838 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:41.838 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:41.838 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:41.838 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:41.838 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:41.838 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:41.838 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:41.838 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:41.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.818+0000 7fbe91133640 10 monclient: get_monmap_and_config success 2026-02-17T11:14:41.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.818+0000 7fbe91133640 4 set_mon_vals no callback set 2026-02-17T11:14:41.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.819+0000 7fbe91133640 10 monclient: shutdown 2026-02-17T11:14:41.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.819+0000 7fbe91133640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:14:41.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.819+0000 7fbe91133640 1 -- 10.20.193.49:0/3701603650 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbe78004000 msgr2=0x7fbe78004900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:41.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.819+0000 7fbe91133640 1 --2- 10.20.193.49:0/3701603650 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbe78004000 0x7fbe78004900 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fbe8000c110 tx=0x7fbe8002f450 comp rx=0 tx=0).stop 2026-02-17T11:14:41.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.819+0000 7fbe91133640 1 -- 10.20.193.49:0/3701603650 shutdown_connections 2026-02-17T11:14:41.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.819+0000 7fbe91133640 1 --2- 10.20.193.49:0/3701603650 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbe78004000 0x7fbe78004900 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:41.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.819+0000 7fbe91133640 1 -- 10.20.193.49:0/3701603650 >> 10.20.193.49:0/3701603650 conn(0x7fbe8c0c9f40 msgr2=0x7fbe8c0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:14:41.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.819+0000 7fbe91133640 1 -- 10.20.193.49:0/3701603650 shutdown_connections 2026-02-17T11:14:41.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.819+0000 7fbe91133640 1 -- 10.20.193.49:0/3701603650 wait complete. 2026-02-17T11:14:41.840 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.819+0000 7fbe91133640 10 monclient: build_initial_monmap 2026-02-17T11:14:41.840 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.819+0000 7fbe91133640 10 monclient: monmap: 2026-02-17T11:14:41.840 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:14:41.840 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:14:41.840 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:14:41.840 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:14:41.840 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:14:41.840 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:41.840 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:14:41.840 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:14:41.840 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:14:41.841 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:41.841 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.820+0000 7fbe91133640 1 librados: starting msgr at 2026-02-17T11:14:41.841 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.820+0000 7fbe91133640 1 librados: starting objecter 2026-02-17T11:14:41.841 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.820+0000 7fbe91133640 1 Processor -- start 2026-02-17T11:14:41.841 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.820+0000 7fbe91133640 1 -- start start 2026-02-17T11:14:41.841 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.820+0000 7fbe91133640 1 librados: setting wanted keys 2026-02-17T11:14:41.841 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.820+0000 7fbe91133640 1 librados: calling monclient init 2026-02-17T11:14:41.841 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.820+0000 7fbe91133640 10 monclient: init 2026-02-17T11:14:41.841 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.820+0000 7fbe91133640 10 monclient: _reopen_session rank -1 2026-02-17T11:14:41.841 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.820+0000 7fbe91133640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:14:41.841 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.820+0000 7fbe91133640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fbe78004000 0x7fbe8c0bf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:41.841 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.820+0000 7fbe91133640 10 monclient(hunting): picked mon.noname-c con 0x7fbe78004000 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:14:41.841 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.820+0000 7fbe91133640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbe8c1e6910 0x7fbe8c1f7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:41.842 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.820+0000 7fbe91133640 10 monclient(hunting): picked mon.noname-a con 0x7fbe8c1e6910 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:14:41.842 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.820+0000 7fbe91133640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fbe8c151730 0x7fbe8c14b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:41.842 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.820+0000 7fbe91133640 10 monclient(hunting): picked mon.noname-b con 0x7fbe8c151730 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:14:41.842 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.820+0000 7fbe91133640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:41.842 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.820+0000 7fbe91133640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fbe8c0738f0 con 0x7fbe8c1e6910 2026-02-17T11:14:41.842 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.820+0000 7fbe91133640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:41.842 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.820+0000 7fbe91133640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fbe8c074cf0 con 0x7fbe8c151730 2026-02-17T11:14:41.842 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.820+0000 7fbe91133640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:41.842 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.820+0000 7fbe91133640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fbe8c073a70 con 0x7fbe78004000 2026-02-17T11:14:41.842 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.820+0000 7fbe91133640 10 monclient(hunting): _renew_subs 2026-02-17T11:14:41.842 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.820+0000 7fbe91133640 10 monclient(hunting): authenticate will time out at 1358.484593s 2026-02-17T11:14:41.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.820+0000 7fbe8a575640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbe8c1e6910 0x7fbe8c1f7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:41.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.821+0000 7fbe8a575640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbe8c1e6910 0x7fbe8c1f7870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:49230/0 (socket says 10.20.193.49:49230) 2026-02-17T11:14:41.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.821+0000 7fbe8a575640 1 -- 10.20.193.49:0/1599580112 learned_addr learned my addr 10.20.193.49:0/1599580112 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:14:41.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.821+0000 7fbe8a575640 10 monclient(hunting): get_auth_request con 0x7fbe8c1e6910 auth_method 0 2026-02-17T11:14:41.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.821+0000 7fbe8a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:41.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.821+0000 7fbe8a575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:41.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.821+0000 7fbe8a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:41.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.821+0000 7fbe8ad76640 1 --2- 10.20.193.49:0/1599580112 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fbe78004000 0x7fbe8c0bf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:41.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.821+0000 7fbe8b577640 1 --2- 10.20.193.49:0/1599580112 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fbe8c151730 0x7fbe8c14b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:41.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.821+0000 7fbe8ad76640 10 monclient(hunting): get_auth_request con 0x7fbe78004000 auth_method 0 2026-02-17T11:14:41.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.821+0000 7fbe8ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:41.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.821+0000 7fbe8ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:41.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.821+0000 7fbe8ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:41.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.821+0000 7fbe8b577640 10 monclient(hunting): get_auth_request con 0x7fbe8c151730 auth_method 0 2026-02-17T11:14:41.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.821+0000 7fbe8b577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:41.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.821+0000 7fbe8b577640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:41.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.821+0000 7fbe8b577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:41.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.821+0000 7fbe8a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:41.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.821+0000 7fbe8a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:41.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.821+0000 7fbe8a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:41.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.821+0000 7fbe8ad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:41.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.821+0000 7fbe8ad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:41.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.821+0000 7fbe8ad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:41.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.821+0000 7fbe8b577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:41.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.821+0000 7fbe8b577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:41.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.821+0000 7fbe8b577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:41.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.822+0000 7fbe8ad76640 10 monclient(hunting): handle_auth_done global_id 5060 payload 824 2026-02-17T11:14:41.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.822+0000 7fbe8ad76640 1 -- 10.20.193.49:0/1599580112 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fbe8c151730 msgr2=0x7fbe8c14b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:41.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.822+0000 7fbe8ad76640 1 --2- 10.20.193.49:0/1599580112 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fbe8c151730 0x7fbe8c14b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:41.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.822+0000 7fbe8ad76640 1 -- 10.20.193.49:0/1599580112 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbe8c1e6910 msgr2=0x7fbe8c1f7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:41.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.822+0000 7fbe8ad76640 1 --2- 10.20.193.49:0/1599580112 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbe8c1e6910 0x7fbe8c1f7870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:41.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.822+0000 7fbe8ad76640 10 monclient: _finish_hunting 0 2026-02-17T11:14:41.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.822+0000 7fbe8ad76640 1 monclient: found mon.noname-c 2026-02-17T11:14:41.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.822+0000 7fbe8ad76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:14:41.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.822+0000 7fbe8ad76640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:14:41.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.822+0000 7fbe8ad76640 1 -- 10.20.193.49:0/1599580112 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe8c1e5b70 con 0x7fbe78004000 2026-02-17T11:14:41.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.822+0000 7fbe8b577640 1 --2- 10.20.193.49:0/1599580112 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fbe8c151730 0x7fbe8c14b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:14:41.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.823+0000 7fbe8ad76640 1 --2- 10.20.193.49:0/1599580112 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fbe78004000 0x7fbe8c0bf0d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbe80033000 tx=0x7fbe8c074340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:14:41.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.823+0000 7fbe6b7fe640 10 client.?.objecter ms_handle_connect 0x7fbe78004000 2026-02-17T11:14:41.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.823+0000 7fbe6b7fe640 10 client.?.objecter resend_mon_ops 2026-02-17T11:14:41.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.824+0000 7fbe6b7fe640 1 -- 10.20.193.49:0/1599580112 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe80003370 con 0x7fbe78004000 2026-02-17T11:14:41.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.824+0000 7fbe6b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:41.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.824+0000 7fbe6b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:14:41.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.824+0000 7fbe6b7fe640 10 monclient: dump: 2026-02-17T11:14:41.846 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:41.846 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:41.846 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:41.846 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:41.846 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:41.846 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:41.846 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:41.847 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:41.847 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:41.847 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:41.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.824+0000 7fbe6b7fe640 10 monclient: _finish_auth 0 2026-02-17T11:14:41.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.824+0000 7fbe6b7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:14:41.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.824+0000 7fbe6b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:14:41.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.824+0000 7fbe91133640 5 monclient: authenticate success, global_id 5060 2026-02-17T11:14:41.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.824+0000 7fbe91133640 10 monclient: _renew_subs 2026-02-17T11:14:41.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.824+0000 7fbe91133640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:14:41.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.824+0000 7fbe91133640 1 -- 10.20.193.49:0/1599580112 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe8c1f4650 con 0x7fbe78004000 2026-02-17T11:14:41.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.824+0000 7fbe91133640 10 client.5060.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:14:41.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.824+0000 7fbe91133640 10 monclient: _renew_subs 2026-02-17T11:14:41.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.824+0000 7fbe91133640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:14:41.848 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.824+0000 7fbe91133640 1 -- 10.20.193.49:0/1599580112 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe8c1e6110 con 0x7fbe78004000 2026-02-17T11:14:41.848 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.824+0000 7fbe91133640 1 librados: init done 2026-02-17T11:14:41.848 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.825+0000 7fbe91133640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:14:41.848 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.825+0000 7fbe91133640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:14:41.848 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.825+0000 7fbe91133640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:14:41.848 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.825+0000 7fbe91133640 1 -- 10.20.193.49:0/1599580112 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe8c1593f0 con 0x7fbe78004000 2026-02-17T11:14:41.848 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.825+0000 7fbe6b7fe640 1 -- 10.20.193.49:0/1599580112 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe80007070 con 0x7fbe78004000 2026-02-17T11:14:41.848 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.825+0000 7fbe6b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:14:41.848 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.825+0000 7fbe6b7fe640 1 -- 10.20.193.49:0/1599580112 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe80007420 con 0x7fbe78004000 2026-02-17T11:14:41.848 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.825+0000 7fbe6b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:41.848 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.825+0000 7fbe6b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:14:41.848 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.825+0000 7fbe6b7fe640 10 monclient: dump: 2026-02-17T11:14:41.848 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:41.849 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:41.849 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:41.849 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:41.849 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:41.849 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:41.849 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:41.849 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:41.849 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:41.849 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:41.849 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.825+0000 7fbe89573640 4 set_mon_vals no callback set 2026-02-17T11:14:41.934 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.931+0000 7fbe6b7fe640 1 -- 10.20.193.49:0/1599580112 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7fbe800075c0 con 0x7fbe78004000 2026-02-17T11:14:41.935 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.932+0000 7fbe6b7fe640 1 --2- 10.20.193.49:0/1599580112 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fbe58079170 0x7fbe5807b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:41.935 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.932+0000 7fbe8a575640 1 --2- 10.20.193.49:0/1599580112 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fbe58079170 0x7fbe5807b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:41.935 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.932+0000 7fbe8a575640 10 monclient: get_auth_request con 0x7fbe58079170 auth_method 0 2026-02-17T11:14:41.936 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.932+0000 7fbe6b7fe640 10 client.5060.objecter ms_handle_connect 0x7fbe58079170 2026-02-17T11:14:41.936 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.932+0000 7fbe8a575640 1 --2- 10.20.193.49:0/1599580112 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fbe58079170 0x7fbe5807b630 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c0c9c00 tx=0x7fbe74007e90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:14:41.936 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.933+0000 7fbe6b7fe640 1 -- 10.20.193.49:0/1599580112 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7fbe80082030 con 0x7fbe78004000 2026-02-17T11:14:41.937 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.933+0000 7fbe6b7fe640 10 client.5060.objecter ms_dispatch2 0x7fbe8c000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:14:41.937 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.933+0000 7fbe6b7fe640 3 client.5060.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:14:41.937 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.933+0000 7fbe6b7fe640 3 client.5060.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:14:41.937 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.933+0000 7fbe6b7fe640 20 client.5060.objecter dump_active .. 0 homeless 2026-02-17T11:14:41.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.940+0000 7fbe6b7fe640 1 -- 10.20.193.49:0/1599580112 <== mon.2 v2:10.20.193.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fbe80048030 con 0x7fbe78004000 2026-02-17T11:14:41.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.940+0000 7fbe6b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:14:41.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:41.940+0000 7fbe6b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:14:42.040 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:42.037+0000 7fbe91133640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:14:42.040 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:42.037+0000 7fbe91133640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:14:42.040 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:42.037+0000 7fbe91133640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:14:42.040 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:42.037+0000 7fbe91133640 1 -- 10.20.193.49:0/1599580112 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fbe8c1e6cf0 con 0x7fbe78004000 2026-02-17T11:14:42.043 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:42.041+0000 7fbe6b7fe640 1 -- 10.20.193.49:0/1599580112 <== mon.2 v2:10.20.193.157:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fbe800866f0 con 0x7fbe78004000 2026-02-17T11:14:42.043 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:42.041+0000 7fbe6b7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:14:42.043 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:42.041+0000 7fbe6b7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:14:42.043 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:14:42.043 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:14:42.044 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:42.042+0000 7fbe91133640 10 librados: watch_flush enter 2026-02-17T11:14:42.044 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:42.042+0000 7fbe91133640 10 librados: watch_flush exit 2026-02-17T11:14:42.044 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:42.042+0000 7fbe91133640 20 client.5060.objecter shutdown clearing up homeless session... 2026-02-17T11:14:42.045 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:42.042+0000 7fbe91133640 10 client.5060.objecter successfully canceled tick 2026-02-17T11:14:42.045 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:42.042+0000 7fbe91133640 1 -- 10.20.193.49:0/1599580112 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fbe58079170 msgr2=0x7fbe5807b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:42.045 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:42.042+0000 7fbe91133640 1 --2- 10.20.193.49:0/1599580112 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fbe58079170 0x7fbe5807b630 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c0c9c00 tx=0x7fbe74007e90 comp rx=0 tx=0).stop 2026-02-17T11:14:42.045 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:42.042+0000 7fbe91133640 10 monclient: shutdown 2026-02-17T11:14:42.045 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:42.042+0000 7fbe91133640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:14:42.045 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:42.042+0000 7fbe91133640 1 -- 10.20.193.49:0/1599580112 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fbe78004000 msgr2=0x7fbe8c0bf0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:42.045 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:42.042+0000 7fbe91133640 1 --2- 10.20.193.49:0/1599580112 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fbe78004000 0x7fbe8c0bf0d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbe80033000 tx=0x7fbe8c074340 comp rx=0 tx=0).stop 2026-02-17T11:14:42.045 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:42.042+0000 7fbe91133640 1 -- 10.20.193.49:0/1599580112 shutdown_connections 2026-02-17T11:14:42.045 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:42.042+0000 7fbe91133640 1 --2- 10.20.193.49:0/1599580112 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fbe58079170 0x7fbe5807b630 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:42.045 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:42.042+0000 7fbe91133640 1 --2- 10.20.193.49:0/1599580112 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fbe8c151730 0x7fbe8c14b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:42.045 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:42.042+0000 7fbe91133640 1 --2- 10.20.193.49:0/1599580112 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbe8c1e6910 0x7fbe8c1f7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:42.045 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:42.042+0000 7fbe91133640 1 --2- 10.20.193.49:0/1599580112 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fbe78004000 0x7fbe8c0bf0d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:42.045 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:42.042+0000 7fbe91133640 1 -- 10.20.193.49:0/1599580112 >> 10.20.193.49:0/1599580112 conn(0x7fbe8c0c9f40 msgr2=0x7fbe8c14d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:14:42.045 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:42.042+0000 7fbe91133640 1 -- 10.20.193.49:0/1599580112 shutdown_connections 2026-02-17T11:14:42.045 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:42.042+0000 7fbe91133640 1 -- 10.20.193.49:0/1599580112 wait complete. 2026-02-17T11:14:42.045 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:42.042+0000 7fbe91133640 1 librados: shutdown 2026-02-17T11:14:45.053 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:14:45.127 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.120+0000 7fc6cf0d3640 10 monclient: get_monmap_and_config 2026-02-17T11:14:45.127 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.120+0000 7fc6cf0d3640 10 monclient: build_initial_monmap 2026-02-17T11:14:45.128 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.120+0000 7fc6cf0d3640 10 monclient: monmap: 2026-02-17T11:14:45.128 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:14:45.128 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:45.128 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:14:45.121931+0000 2026-02-17T11:14:45.128 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:14:45.121931+0000 2026-02-17T11:14:45.129 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:14:45.129 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:45.129 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:14:45.129 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:14:45.129 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:14:45.129 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:14:45.129 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:14:45.129 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:14:45.129 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:45.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.120+0000 7fc6cf0d3640 1 Processor -- start 2026-02-17T11:14:45.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.120+0000 7fc6cf0d3640 1 -- start start 2026-02-17T11:14:45.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.120+0000 7fc6cf0d3640 10 monclient: init 2026-02-17T11:14:45.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.121+0000 7fc6cf0d3640 10 monclient: _reopen_session rank -1 2026-02-17T11:14:45.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.121+0000 7fc6cf0d3640 10 monclient: _add_conns ranks=[5,3,2,0,4,1] 2026-02-17T11:14:45.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.121+0000 7fc6cf0d3640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7fc6c8155b60 0x7fc6c8155f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:45.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.121+0000 7fc6cf0d3640 10 monclient(hunting): picked mon.noname-c con 0x7fc6c8155b60 addr v2:10.20.193.157:3300/0 2026-02-17T11:14:45.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.121+0000 7fc6cf0d3640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fc6c815fdf0 0x7fc6c815d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:45.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.121+0000 7fc6cf0d3640 10 monclient(hunting): picked mon.noname-a con 0x7fc6c815fdf0 addr v2:10.20.193.49:3300/0 2026-02-17T11:14:45.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.121+0000 7fc6cf0d3640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fc6c80ccc50 addr v1:10.20.193.157:6789/0 2026-02-17T11:14:45.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.121+0000 7fc6cf0d3640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6c8160270 con 0x7fc6c80ccc50 2026-02-17T11:14:45.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.121+0000 7fc6cf0d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:45.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.121+0000 7fc6cf0d3640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7fc6c806c930 con 0x7fc6c815fdf0 2026-02-17T11:14:45.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.121+0000 7fc6cf0d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:45.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.121+0000 7fc6cf0d3640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7fc6c806cc10 con 0x7fc6c8155b60 2026-02-17T11:14:45.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.121+0000 7fc6cf0d3640 10 monclient(hunting): _renew_subs 2026-02-17T11:14:45.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.121+0000 7fc6cf0d3640 10 monclient(hunting): authenticate will time out at 1361.785538s 2026-02-17T11:14:45.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.121+0000 7fc6bffff640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fc6c815fdf0 0x7fc6c815d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:45.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.122+0000 7fc6bffff640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fc6c815fdf0 0x7fc6c815d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:49234/0 (socket says 10.20.193.49:49234) 2026-02-17T11:14:45.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.122+0000 7fc6bffff640 1 -- 10.20.193.49:0/1251512164 learned_addr learned my addr 10.20.193.49:0/1251512164 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:14:45.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.122+0000 7fc6bffff640 10 monclient(hunting): get_auth_request con 0x7fc6c815fdf0 auth_method 0 2026-02-17T11:14:45.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.122+0000 7fc6bffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:45.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.122+0000 7fc6bffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:45.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.122+0000 7fc6bffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:45.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.122+0000 7fc6bffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:45.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.122+0000 7fc6bffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:45.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.122+0000 7fc6bffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:45.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.123+0000 7fc6cce48640 1 --2- 10.20.193.49:0/1251512164 >> v2:10.20.193.157:3300/0 conn(0x7fc6c8155b60 0x7fc6c8155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:45.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.123+0000 7fc6bffff640 10 monclient(hunting): handle_auth_done global_id 5043 payload 274 2026-02-17T11:14:45.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.123+0000 7fc6bffff640 1 -- 10.20.193.49:0/1251512164 >> v2:10.20.193.157:3300/0 conn(0x7fc6c8155b60 msgr2=0x7fc6c8155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:14:45.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.123+0000 7fc6bffff640 1 --2- 10.20.193.49:0/1251512164 >> v2:10.20.193.157:3300/0 conn(0x7fc6c8155b60 0x7fc6c8155f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:45.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.123+0000 7fc6bffff640 1 -- 10.20.193.49:0/1251512164 >> v1:10.20.193.157:6789/0 conn(0x7fc6c80ccc50 legacy=0x7fc6c80cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:14:45.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.123+0000 7fc6bffff640 10 monclient: _finish_hunting 0 2026-02-17T11:14:45.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.123+0000 7fc6bffff640 1 monclient: found mon.noname-a 2026-02-17T11:14:45.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.123+0000 7fc6bffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:14:45.133 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.123+0000 7fc6bffff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:14:45.133 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.123+0000 7fc6bffff640 1 -- 10.20.193.49:0/1251512164 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6c806cef0 con 0x7fc6c815fdf0 2026-02-17T11:14:45.140 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.126+0000 7fc6bffff640 1 --2- 10.20.193.49:0/1251512164 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc6c815fdf0 0x7fc6c815d2e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8076d10 tx=0x7fc6b002eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=190425cdda8bb2dc server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:14:45.140 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.128+0000 7fc6bf7fe640 1 -- 10.20.193.49:0/1251512164 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b003c070 con 0x7fc6c815fdf0 2026-02-17T11:14:45.140 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.128+0000 7fc6bf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:45.140 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.128+0000 7fc6bf7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:14:45.140 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.128+0000 7fc6bf7fe640 10 monclient: dump: 2026-02-17T11:14:45.141 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:45.141 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:45.141 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:45.141 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:45.141 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:45.141 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:45.141 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:45.141 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:45.141 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:45.141 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:45.142 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.128+0000 7fc6bf7fe640 10 monclient: _finish_auth 0 2026-02-17T11:14:45.142 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.128+0000 7fc6bf7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:14:45.142 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.128+0000 7fc6bf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:14:45.142 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.128+0000 7fc6bf7fe640 1 -- 10.20.193.49:0/1251512164 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6b002fb40 con 0x7fc6c815fdf0 2026-02-17T11:14:45.142 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.128+0000 7fc6bf7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:14:45.142 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.128+0000 7fc6bf7fe640 1 -- 10.20.193.49:0/1251512164 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b0037440 con 0x7fc6c815fdf0 2026-02-17T11:14:45.142 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.128+0000 7fc6cf0d3640 5 monclient: authenticate success, global_id 5043 2026-02-17T11:14:45.142 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.128+0000 7fc6cf0d3640 10 monclient: get_monmap_and_config success 2026-02-17T11:14:45.142 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.128+0000 7fc6cf0d3640 4 set_mon_vals no callback set 2026-02-17T11:14:45.142 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.128+0000 7fc6bf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:45.142 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.128+0000 7fc6bf7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:14:45.142 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.128+0000 7fc6bf7fe640 10 monclient: dump: 2026-02-17T11:14:45.142 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:45.143 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:45.143 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:45.143 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:45.143 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:45.143 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:45.143 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:45.143 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:45.143 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:45.143 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:45.143 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.129+0000 7fc6cf0d3640 10 monclient: shutdown 2026-02-17T11:14:45.143 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.129+0000 7fc6cf0d3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:14:45.144 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.129+0000 7fc6cf0d3640 1 -- 10.20.193.49:0/1251512164 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc6c815fdf0 msgr2=0x7fc6c815d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:45.144 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.129+0000 7fc6cf0d3640 1 --2- 10.20.193.49:0/1251512164 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc6c815fdf0 0x7fc6c815d2e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8076d10 tx=0x7fc6b002eed0 comp rx=0 tx=0).stop 2026-02-17T11:14:45.144 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.129+0000 7fc6cf0d3640 1 -- 10.20.193.49:0/1251512164 shutdown_connections 2026-02-17T11:14:45.144 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.129+0000 7fc6cf0d3640 1 --2- 10.20.193.49:0/1251512164 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc6c815fdf0 0x7fc6c815d2e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:45.144 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.129+0000 7fc6cf0d3640 1 --2- 10.20.193.49:0/1251512164 >> v2:10.20.193.157:3300/0 conn(0x7fc6c8155b60 0x7fc6c8155f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:45.144 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.129+0000 7fc6cf0d3640 1 -- 10.20.193.49:0/1251512164 >> 10.20.193.49:0/1251512164 conn(0x7fc6c80cc130 msgr2=0x7fc6c80cc540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:14:45.144 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.129+0000 7fc6cf0d3640 1 -- 10.20.193.49:0/1251512164 shutdown_connections 2026-02-17T11:14:45.144 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.129+0000 7fc6cf0d3640 1 -- 10.20.193.49:0/1251512164 wait complete. 2026-02-17T11:14:45.144 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.129+0000 7fc6cf0d3640 10 monclient: build_initial_monmap 2026-02-17T11:14:45.144 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.129+0000 7fc6cf0d3640 10 monclient: monmap: 2026-02-17T11:14:45.144 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:14:45.144 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:14:45.145 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:14:45.145 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:14:45.145 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:14:45.145 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:45.145 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:14:45.145 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:14:45.145 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:14:45.145 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:45.145 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.130+0000 7fc6cf0d3640 1 librados: starting msgr at 2026-02-17T11:14:45.145 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.130+0000 7fc6cf0d3640 1 librados: starting objecter 2026-02-17T11:14:45.145 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.130+0000 7fc6cf0d3640 1 Processor -- start 2026-02-17T11:14:45.145 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.130+0000 7fc6cf0d3640 1 -- start start 2026-02-17T11:14:45.145 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.130+0000 7fc6cf0d3640 1 librados: setting wanted keys 2026-02-17T11:14:45.146 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.130+0000 7fc6cf0d3640 1 librados: calling monclient init 2026-02-17T11:14:45.146 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.130+0000 7fc6cf0d3640 10 monclient: init 2026-02-17T11:14:45.146 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.130+0000 7fc6cf0d3640 10 monclient: _reopen_session rank -1 2026-02-17T11:14:45.146 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.130+0000 7fc6cf0d3640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:14:45.146 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.130+0000 7fc6cf0d3640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc6c80ccc50 0x7fc6c81e9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:45.146 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.130+0000 7fc6cf0d3640 10 monclient(hunting): picked mon.noname-c con 0x7fc6c80ccc50 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:14:45.146 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.130+0000 7fc6cf0d3640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc6c8155b60 0x7fc6c81f7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:45.146 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.130+0000 7fc6cf0d3640 10 monclient(hunting): picked mon.noname-a con 0x7fc6c8155b60 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:14:45.146 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.130+0000 7fc6cf0d3640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc6c815fdf0 0x7fc6c81e85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:45.146 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.130+0000 7fc6cf0d3640 10 monclient(hunting): picked mon.noname-b con 0x7fc6c815fdf0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:14:45.146 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.130+0000 7fc6cf0d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:45.146 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.130+0000 7fc6cf0d3640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c8072ac0 con 0x7fc6c8155b60 2026-02-17T11:14:45.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.130+0000 7fc6cf0d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:45.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.130+0000 7fc6cf0d3640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c806d4b0 con 0x7fc6c815fdf0 2026-02-17T11:14:45.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.130+0000 7fc6cf0d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:45.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.130+0000 7fc6cf0d3640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c8073080 con 0x7fc6c80ccc50 2026-02-17T11:14:45.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.130+0000 7fc6cf0d3640 10 monclient(hunting): _renew_subs 2026-02-17T11:14:45.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.130+0000 7fc6cf0d3640 10 monclient(hunting): authenticate will time out at 1361.794838s 2026-02-17T11:14:45.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.131+0000 7fc6bffff640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc6c8155b60 0x7fc6c81f7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:45.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.131+0000 7fc6cce48640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc6c80ccc50 0x7fc6c81e9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:45.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.131+0000 7fc6bffff640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc6c8155b60 0x7fc6c81f7310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:49244/0 (socket says 10.20.193.49:49244) 2026-02-17T11:14:45.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.131+0000 7fc6bffff640 1 -- 10.20.193.49:0/2383224450 learned_addr learned my addr 10.20.193.49:0/2383224450 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:14:45.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.131+0000 7fc6bffff640 10 monclient(hunting): get_auth_request con 0x7fc6c8155b60 auth_method 0 2026-02-17T11:14:45.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.131+0000 7fc6bffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:45.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.131+0000 7fc6bffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:45.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.131+0000 7fc6bffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:45.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.131+0000 7fc6cd649640 1 --2- 10.20.193.49:0/2383224450 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc6c815fdf0 0x7fc6c81e85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:45.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.131+0000 7fc6cce48640 10 monclient(hunting): get_auth_request con 0x7fc6c80ccc50 auth_method 0 2026-02-17T11:14:45.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.131+0000 7fc6cce48640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:45.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.131+0000 7fc6cce48640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:45.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.131+0000 7fc6cce48640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:45.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.131+0000 7fc6bffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:45.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.131+0000 7fc6bffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:45.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.131+0000 7fc6bffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:45.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.131+0000 7fc6cd649640 10 monclient(hunting): get_auth_request con 0x7fc6c815fdf0 auth_method 0 2026-02-17T11:14:45.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.131+0000 7fc6cd649640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:45.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.131+0000 7fc6cd649640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:45.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.131+0000 7fc6cd649640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:45.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.131+0000 7fc6cce48640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:45.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.131+0000 7fc6cce48640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:45.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.131+0000 7fc6cce48640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:45.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.132+0000 7fc6cd649640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:45.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.132+0000 7fc6cd649640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:45.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.132+0000 7fc6cd649640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:45.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.133+0000 7fc6bffff640 10 monclient(hunting): handle_auth_done global_id 5046 payload 824 2026-02-17T11:14:45.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.133+0000 7fc6bffff640 1 -- 10.20.193.49:0/2383224450 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc6c80ccc50 msgr2=0x7fc6c81e9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:45.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.133+0000 7fc6bffff640 1 --2- 10.20.193.49:0/2383224450 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc6c80ccc50 0x7fc6c81e9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:45.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.133+0000 7fc6bffff640 1 -- 10.20.193.49:0/2383224450 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc6c815fdf0 msgr2=0x7fc6c81e85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:45.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.133+0000 7fc6bffff640 1 --2- 10.20.193.49:0/2383224450 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc6c815fdf0 0x7fc6c81e85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:45.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.133+0000 7fc6bffff640 10 monclient: _finish_hunting 0 2026-02-17T11:14:45.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.133+0000 7fc6bffff640 1 monclient: found mon.noname-a 2026-02-17T11:14:45.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.133+0000 7fc6bffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:14:45.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.133+0000 7fc6bffff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:14:45.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.133+0000 7fc6bffff640 1 -- 10.20.193.49:0/2383224450 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6c81e7530 con 0x7fc6c8155b60 2026-02-17T11:14:45.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.134+0000 7fc6bffff640 1 --2- 10.20.193.49:0/2383224450 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc6c8155b60 0x7fc6c81f7310 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0009a70 tx=0x7fc6b00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:14:45.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.134+0000 7fc6bd7fa640 10 client.?.objecter ms_handle_connect 0x7fc6c8155b60 2026-02-17T11:14:45.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.134+0000 7fc6bd7fa640 10 client.?.objecter resend_mon_ops 2026-02-17T11:14:45.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.135+0000 7fc6bd7fa640 1 -- 10.20.193.49:0/2383224450 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b0044020 con 0x7fc6c8155b60 2026-02-17T11:14:45.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.135+0000 7fc6bd7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:45.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.135+0000 7fc6bd7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:14:45.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.135+0000 7fc6bd7fa640 10 monclient: dump: 2026-02-17T11:14:45.150 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:45.151 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:45.151 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:45.151 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:45.151 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:45.151 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:45.151 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:45.151 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:45.151 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:45.152 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:45.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.135+0000 7fc6bd7fa640 10 monclient: _finish_auth 0 2026-02-17T11:14:45.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.135+0000 7fc6bd7fa640 10 monclient: _check_auth_tickets 2026-02-17T11:14:45.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.135+0000 7fc6bd7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:14:45.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.135+0000 7fc6bd7fa640 1 -- 10.20.193.49:0/2383224450 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6b0040710 con 0x7fc6c8155b60 2026-02-17T11:14:45.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.135+0000 7fc6bd7fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:14:45.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.135+0000 7fc6bd7fa640 1 -- 10.20.193.49:0/2383224450 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b003c040 con 0x7fc6c8155b60 2026-02-17T11:14:45.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.135+0000 7fc6bd7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:45.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.135+0000 7fc6bd7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:14:45.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.135+0000 7fc6bd7fa640 10 monclient: dump: 2026-02-17T11:14:45.152 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:45.152 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:45.153 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:45.153 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:45.153 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:45.153 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:45.153 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:45.153 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:45.153 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:45.153 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:45.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.135+0000 7fc6beffd640 4 set_mon_vals no callback set 2026-02-17T11:14:45.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.135+0000 7fc6cf0d3640 5 monclient: authenticate success, global_id 5046 2026-02-17T11:14:45.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.135+0000 7fc6cf0d3640 10 monclient: _renew_subs 2026-02-17T11:14:45.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.135+0000 7fc6cf0d3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:14:45.153 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.135+0000 7fc6cf0d3640 1 -- 10.20.193.49:0/2383224450 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6c81e7810 con 0x7fc6c8155b60 2026-02-17T11:14:45.154 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.135+0000 7fc6cf0d3640 10 client.5046.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:14:45.154 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.135+0000 7fc6cf0d3640 10 monclient: _renew_subs 2026-02-17T11:14:45.154 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.135+0000 7fc6cf0d3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:14:45.154 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.135+0000 7fc6cf0d3640 1 -- 10.20.193.49:0/2383224450 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6c81e7dd0 con 0x7fc6c8155b60 2026-02-17T11:14:45.154 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.135+0000 7fc6cf0d3640 1 librados: init done 2026-02-17T11:14:45.154 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.136+0000 7fc6cf0d3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:14:45.154 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.136+0000 7fc6cf0d3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:14:45.154 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.136+0000 7fc6cf0d3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:14:45.154 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.136+0000 7fc6cf0d3640 1 -- 10.20.193.49:0/2383224450 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6c80d0500 con 0x7fc6c8155b60 2026-02-17T11:14:45.156 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.147+0000 7fc6bd7fa640 1 -- 10.20.193.49:0/2383224450 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7fc6b003f070 con 0x7fc6c8155b60 2026-02-17T11:14:45.156 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.148+0000 7fc6bd7fa640 1 --2- 10.20.193.49:0/2383224450 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fc698079140 0x7fc69807b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:45.156 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.148+0000 7fc6cce48640 1 --2- 10.20.193.49:0/2383224450 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fc698079140 0x7fc69807b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:45.156 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.148+0000 7fc6cce48640 10 monclient: get_auth_request con 0x7fc698079140 auth_method 0 2026-02-17T11:14:45.156 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.148+0000 7fc6cce48640 1 --2- 10.20.193.49:0/2383224450 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fc698079140 0x7fc69807b600 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc6b8006fd0 tx=0x7fc6b8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:14:45.156 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.148+0000 7fc6bd7fa640 10 client.5046.objecter ms_handle_connect 0x7fc698079140 2026-02-17T11:14:45.156 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.149+0000 7fc6bd7fa640 1 -- 10.20.193.49:0/2383224450 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7fc6b002fae0 con 0x7fc6c8155b60 2026-02-17T11:14:45.156 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.149+0000 7fc6bd7fa640 10 client.5046.objecter ms_dispatch2 0x7fc6c8000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:14:45.156 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.149+0000 7fc6bd7fa640 3 client.5046.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:14:45.156 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.149+0000 7fc6bd7fa640 3 client.5046.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:14:45.156 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.149+0000 7fc6bd7fa640 20 client.5046.objecter dump_active .. 0 homeless 2026-02-17T11:14:45.254 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.251+0000 7fc6bd7fa640 1 -- 10.20.193.49:0/2383224450 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc6b004e030 con 0x7fc6c8155b60 2026-02-17T11:14:45.254 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.251+0000 7fc6bd7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:14:45.254 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.251+0000 7fc6bd7fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:14:45.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.350+0000 7fc6cf0d3640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:14:45.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.350+0000 7fc6cf0d3640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:14:45.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.350+0000 7fc6cf0d3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:14:45.353 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.350+0000 7fc6cf0d3640 1 -- 10.20.193.49:0/2383224450 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc6c806f3c0 con 0x7fc6c8155b60 2026-02-17T11:14:45.355 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.352+0000 7fc6bd7fa640 1 -- 10.20.193.49:0/2383224450 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fc6b0086ee0 con 0x7fc6c8155b60 2026-02-17T11:14:45.355 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.353+0000 7fc6bd7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:14:45.355 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.353+0000 7fc6bd7fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:14:45.356 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:14:45.356 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:14:45.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.354+0000 7fc6cf0d3640 10 librados: watch_flush enter 2026-02-17T11:14:45.358 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.354+0000 7fc6cf0d3640 10 librados: watch_flush exit 2026-02-17T11:14:45.358 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.354+0000 7fc6cf0d3640 20 client.5046.objecter shutdown clearing up homeless session... 2026-02-17T11:14:45.358 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.354+0000 7fc6cf0d3640 10 client.5046.objecter successfully canceled tick 2026-02-17T11:14:45.358 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.354+0000 7fc6cf0d3640 1 -- 10.20.193.49:0/2383224450 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fc698079140 msgr2=0x7fc69807b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:45.358 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.354+0000 7fc6cf0d3640 1 --2- 10.20.193.49:0/2383224450 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fc698079140 0x7fc69807b600 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc6b8006fd0 tx=0x7fc6b8008040 comp rx=0 tx=0).stop 2026-02-17T11:14:45.358 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.354+0000 7fc6cf0d3640 10 monclient: shutdown 2026-02-17T11:14:45.358 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.354+0000 7fc6cf0d3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:14:45.358 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.354+0000 7fc6cf0d3640 1 -- 10.20.193.49:0/2383224450 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc6c8155b60 msgr2=0x7fc6c81f7310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:45.358 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.354+0000 7fc6cf0d3640 1 --2- 10.20.193.49:0/2383224450 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc6c8155b60 0x7fc6c81f7310 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0009a70 tx=0x7fc6b00047c0 comp rx=0 tx=0).stop 2026-02-17T11:14:45.358 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.354+0000 7fc6cf0d3640 1 -- 10.20.193.49:0/2383224450 shutdown_connections 2026-02-17T11:14:45.358 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.354+0000 7fc6cf0d3640 1 --2- 10.20.193.49:0/2383224450 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fc698079140 0x7fc69807b600 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:45.359 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.354+0000 7fc6cf0d3640 1 --2- 10.20.193.49:0/2383224450 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc6c815fdf0 0x7fc6c81e85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:45.359 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.354+0000 7fc6cf0d3640 1 --2- 10.20.193.49:0/2383224450 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc6c8155b60 0x7fc6c81f7310 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:45.359 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.354+0000 7fc6cf0d3640 1 --2- 10.20.193.49:0/2383224450 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc6c80ccc50 0x7fc6c81e9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:45.359 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.354+0000 7fc6cf0d3640 1 -- 10.20.193.49:0/2383224450 >> 10.20.193.49:0/2383224450 conn(0x7fc6c80cc130 msgr2=0x7fc6c80cb4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:14:45.359 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.354+0000 7fc6cf0d3640 1 -- 10.20.193.49:0/2383224450 shutdown_connections 2026-02-17T11:14:45.359 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.354+0000 7fc6cf0d3640 1 -- 10.20.193.49:0/2383224450 wait complete. 2026-02-17T11:14:45.359 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:45.354+0000 7fc6cf0d3640 1 librados: shutdown 2026-02-17T11:14:48.367 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:14:48.436 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.433+0000 7f10147d3640 10 monclient: get_monmap_and_config 2026-02-17T11:14:48.436 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.433+0000 7f10147d3640 10 monclient: build_initial_monmap 2026-02-17T11:14:48.436 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.433+0000 7f10147d3640 10 monclient: monmap: 2026-02-17T11:14:48.436 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:14:48.436 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:48.436 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:14:48.434806+0000 2026-02-17T11:14:48.437 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:14:48.434806+0000 2026-02-17T11:14:48.437 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:14:48.437 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:48.437 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:14:48.437 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:14:48.437 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:14:48.437 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:14:48.437 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:14:48.437 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:14:48.437 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:48.437 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.433+0000 7f10147d3640 1 Processor -- start 2026-02-17T11:14:48.437 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.433+0000 7f10147d3640 1 -- start start 2026-02-17T11:14:48.438 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.433+0000 7f10147d3640 10 monclient: init 2026-02-17T11:14:48.439 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.434+0000 7f10147d3640 10 monclient: _reopen_session rank -1 2026-02-17T11:14:48.439 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.434+0000 7f10147d3640 10 monclient: _add_conns ranks=[1,2,0,4,5,3] 2026-02-17T11:14:48.440 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.434+0000 7f10147d3640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f100c15f570 addr v1:10.20.193.97:6789/0 2026-02-17T11:14:48.440 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.434+0000 7f10147d3640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f100c15f950 addr v1:10.20.193.157:6789/0 2026-02-17T11:14:48.440 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.434+0000 7f10147d3640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f100c155e80 addr v1:10.20.193.49:6789/0 2026-02-17T11:14:48.440 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.434+0000 7f10147d3640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f100c0bee70 con 0x7f100c155e80 2026-02-17T11:14:48.440 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.434+0000 7f10147d3640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f100c0bf150 con 0x7f100c15f570 2026-02-17T11:14:48.440 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.434+0000 7f10147d3640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f100c0bf430 con 0x7f100c15f950 2026-02-17T11:14:48.440 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.434+0000 7f10147d3640 10 monclient(hunting): _renew_subs 2026-02-17T11:14:48.440 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.434+0000 7f10147d3640 10 monclient(hunting): authenticate will time out at 1365.098269s 2026-02-17T11:14:48.440 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.434+0000 7f1012548640 1 --1- >> v1:10.20.193.97:6789/0 conn(0x7f100c15f570 0x7f100c15d200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.97:6789/0 says I am v1:10.20.193.49:49668/0 (socket says 10.20.193.49:49668) 2026-02-17T11:14:48.440 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.434+0000 7f1012548640 1 -- 10.20.193.49:0/4203151276 learned_addr learned my addr 10.20.193.49:0/4203151276 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:14:48.440 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.436+0000 7f1011546640 1 -- 10.20.193.49:0/4203151276 <== mon.1 v1:10.20.193.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1998097765 0 0) 0x7f100c0bf150 con 0x7f100c15f570 2026-02-17T11:14:48.441 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.436+0000 7f1011546640 10 monclient(hunting): _negotiate 2026-02-17T11:14:48.441 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.436+0000 7f1011546640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:48.441 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.436+0000 7f1011546640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:48.441 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.436+0000 7f1011546640 10 monclient(hunting): my global_id is 5026 2026-02-17T11:14:48.441 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.436+0000 7f1011546640 1 -- 10.20.193.49:0/4203151276 --> v1:10.20.193.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ff4003620 con 0x7f100c15f570 2026-02-17T11:14:48.441 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.436+0000 7f1011546640 1 -- 10.20.193.49:0/4203151276 <== mon.2 v1:10.20.193.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1524667572 0 0) 0x7f100c0bf430 con 0x7f100c15f950 2026-02-17T11:14:48.441 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.436+0000 7f1011546640 10 monclient(hunting): _negotiate 2026-02-17T11:14:48.441 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.436+0000 7f1011546640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:48.441 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.436+0000 7f1011546640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:48.441 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.436+0000 7f1011546640 10 monclient(hunting): my global_id is 5066 2026-02-17T11:14:48.441 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.436+0000 7f1011546640 1 -- 10.20.193.49:0/4203151276 --> v1:10.20.193.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f100c0bf150 con 0x7f100c15f950 2026-02-17T11:14:48.449 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.437+0000 7f1011546640 1 -- 10.20.193.49:0/4203151276 <== mon.1 v1:10.20.193.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4078011249 0 0) 0x7f0ff4003620 con 0x7f100c15f570 2026-02-17T11:14:48.449 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.437+0000 7f1011546640 1 -- 10.20.193.49:0/4203151276 >> v1:10.20.193.157:6789/0 conn(0x7f100c15f950 legacy=0x7f100c155770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:48.449 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.437+0000 7f1011546640 1 -- 10.20.193.49:0/4203151276 >> v1:10.20.193.49:6789/0 conn(0x7f100c155e80 legacy=0x7f100c0c8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:48.449 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.437+0000 7f1011546640 10 monclient: _finish_hunting 0 2026-02-17T11:14:48.449 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.437+0000 7f1011546640 1 monclient: found mon.noname-b-legacy 2026-02-17T11:14:48.449 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.437+0000 7f1011546640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:14:48.449 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.437+0000 7f1011546640 10 monclient: _send_mon_message to mon.noname-b-legacy at v1:10.20.193.97:6789/0 2026-02-17T11:14:48.449 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.437+0000 7f1011546640 1 -- 10.20.193.49:0/4203151276 --> v1:10.20.193.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f100c0bf710 con 0x7f100c15f570 2026-02-17T11:14:48.449 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.437+0000 7f1011546640 10 monclient: _finish_auth 0 2026-02-17T11:14:48.449 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.437+0000 7f1011546640 10 monclient: _check_auth_tickets 2026-02-17T11:14:48.450 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.437+0000 7f1011546640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:14:48.450 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.437+0000 7f1011546640 1 -- 10.20.193.49:0/4203151276 <== mon.1 v1:10.20.193.97:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2462710995 0 0) 0x7f0ffc002f00 con 0x7f100c15f570 2026-02-17T11:14:48.450 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.437+0000 7f1011546640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:48.450 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.437+0000 7f1011546640 10 monclient: got monmap 1 from mon.noname-b-legacy (according to old e1) 2026-02-17T11:14:48.450 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.437+0000 7f1011546640 10 monclient: dump: 2026-02-17T11:14:48.450 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:48.450 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:48.450 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:48.450 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:48.450 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:48.450 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:48.450 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:48.451 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:48.451 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:48.451 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:48.451 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.437+0000 7f1011546640 1 monclient: mon.b has (v2) addrs [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] but i'm connected to v1:10.20.193.97:6789/0, reconnecting 2026-02-17T11:14:48.451 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.437+0000 7f1011546640 10 monclient: _reopen_session rank -1 2026-02-17T11:14:48.451 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.437+0000 7f1011546640 1 -- 10.20.193.49:0/4203151276 >> v1:10.20.193.97:6789/0 conn(0x7f100c15f570 legacy=0x7f100c15d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:48.451 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.437+0000 7f1011546640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:14:48.451 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.437+0000 7f1011546640 1 --2- 10.20.193.49:0/4203151276 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f0ff4003db0 0x7f0ff40041b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:48.451 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.437+0000 7f1011546640 10 monclient(hunting): picked mon.b con 0x7f0ff4003db0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:14:48.451 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.437+0000 7f1011546640 1 --2- 10.20.193.49:0/4203151276 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0ff4004900 0x7f0ff4004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:48.451 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.437+0000 7f1011546640 10 monclient(hunting): picked mon.a con 0x7f0ff4004900 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:14:48.452 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.437+0000 7f1011546640 1 --2- 10.20.193.49:0/4203151276 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f0ff4009ab0 0x7f0ff400bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:48.452 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.437+0000 7f1011546640 10 monclient(hunting): picked mon.c con 0x7f0ff4009ab0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:14:48.452 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.437+0000 7f1011546640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:48.452 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.437+0000 7f1011546640 1 -- 10.20.193.49:0/4203151276 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0ff400c4c0 con 0x7f0ff4004900 2026-02-17T11:14:48.452 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.437+0000 7f1011546640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:48.452 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.437+0000 7f1011546640 1 -- 10.20.193.49:0/4203151276 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f0ff400c670 con 0x7f0ff4003db0 2026-02-17T11:14:48.452 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.437+0000 7f1011546640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:48.452 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.437+0000 7f1011546640 1 -- 10.20.193.49:0/4203151276 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f0ff400c870 con 0x7f0ff4009ab0 2026-02-17T11:14:48.452 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.437+0000 7f1011546640 10 monclient(hunting): _renew_subs 2026-02-17T11:14:48.452 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.437+0000 7f1011546640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:14:48.452 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.438+0000 7f1012d49640 1 --2- 10.20.193.49:0/4203151276 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f0ff4009ab0 0x7f0ff400bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:48.452 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.439+0000 7f1012548640 1 --2- 10.20.193.49:0/4203151276 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f0ff4003db0 0x7f0ff40041b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:48.453 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.439+0000 7f1012548640 10 monclient(hunting): get_auth_request con 0x7f0ff4003db0 auth_method 0 2026-02-17T11:14:48.453 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.439+0000 7f1012548640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:48.453 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.439+0000 7f1012548640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:48.453 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.439+0000 7f1012548640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:14:48.453 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.439+0000 7f1012d49640 10 monclient(hunting): get_auth_request con 0x7f0ff4009ab0 auth_method 0 2026-02-17T11:14:48.453 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.439+0000 7f1012d49640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:48.453 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.439+0000 7f1012d49640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:48.453 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.439+0000 7f1012d49640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:14:48.453 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.439+0000 7f1011d47640 1 --2- 10.20.193.49:0/4203151276 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0ff4004900 0x7f0ff4004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:48.453 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.439+0000 7f1012548640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:48.453 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.439+0000 7f1012548640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:48.453 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.439+0000 7f1012548640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:14:48.453 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.439+0000 7f1011d47640 10 monclient(hunting): get_auth_request con 0x7f0ff4004900 auth_method 0 2026-02-17T11:14:48.454 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.439+0000 7f1011d47640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:48.454 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.439+0000 7f1011d47640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:48.454 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.439+0000 7f1011d47640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:14:48.454 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.439+0000 7f1012d49640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:48.454 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.439+0000 7f1012d49640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:48.454 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.439+0000 7f1012d49640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:14:48.454 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.439+0000 7f1011d47640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:48.454 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.439+0000 7f1011d47640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:48.454 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.439+0000 7f1011d47640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:14:48.454 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.440+0000 7f1012548640 10 monclient(hunting): handle_auth_done global_id 5026 payload 293 2026-02-17T11:14:48.454 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.440+0000 7f1012548640 1 -- 10.20.193.49:0/4203151276 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f0ff4009ab0 msgr2=0x7f0ff400bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:14:48.454 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.440+0000 7f1012548640 1 --2- 10.20.193.49:0/4203151276 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f0ff4009ab0 0x7f0ff400bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:48.455 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.440+0000 7f1012548640 1 -- 10.20.193.49:0/4203151276 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0ff4004900 msgr2=0x7f0ff4004d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:14:48.455 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.440+0000 7f1012548640 1 --2- 10.20.193.49:0/4203151276 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0ff4004900 0x7f0ff4004d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:48.455 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.440+0000 7f1012548640 10 monclient: _finish_hunting 0 2026-02-17T11:14:48.455 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.440+0000 7f1012548640 1 monclient: found mon.b 2026-02-17T11:14:48.455 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.440+0000 7f1012548640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:14:48.455 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.440+0000 7f1012d49640 1 -- 10.20.193.49:0/4203151276 reap_dead start 2026-02-17T11:14:48.455 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.440+0000 7f1012548640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:14:48.455 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.440+0000 7f1012548640 1 -- 10.20.193.49:0/4203151276 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ff4003620 con 0x7f0ff4003db0 2026-02-17T11:14:48.455 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.440+0000 7f1012548640 10 monclient: _finish_auth 0 2026-02-17T11:14:48.455 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.440+0000 7f1012548640 10 monclient: _check_auth_tickets 2026-02-17T11:14:48.455 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.440+0000 7f1012548640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:14:48.455 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.440+0000 7f10147d3640 5 monclient: authenticate success, global_id 5026 2026-02-17T11:14:48.455 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.440+0000 7f10147d3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:14:48.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.441+0000 7f1012548640 1 --2- 10.20.193.49:0/4203151276 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f0ff4003db0 0x7f0ff40041b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc00c320 tx=0x7f0ffc02f590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14103a8f1aa87091 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:14:48.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.442+0000 7f1011546640 1 -- 10.20.193.49:0/4203151276 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc007da0 con 0x7f0ff4003db0 2026-02-17T11:14:48.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.442+0000 7f1011546640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:48.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.442+0000 7f1011546640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:14:48.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.442+0000 7f1011546640 10 monclient: dump: 2026-02-17T11:14:48.456 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:48.456 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:48.456 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:48.456 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:48.456 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:48.456 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:48.456 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:48.456 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:48.457 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:48.457 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:48.457 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.442+0000 7f10147d3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:14:48.457 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.443+0000 7f1011546640 1 -- 10.20.193.49:0/4203151276 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ffc005bf0 con 0x7f0ff4003db0 2026-02-17T11:14:48.457 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.443+0000 7f1011546640 10 monclient: handle_config config(0 keys) 2026-02-17T11:14:48.457 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.443+0000 7f1011546640 1 -- 10.20.193.49:0/4203151276 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc007070 con 0x7f0ff4003db0 2026-02-17T11:14:48.457 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.443+0000 7f10147d3640 10 monclient: get_monmap_and_config success 2026-02-17T11:14:48.457 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.443+0000 7f10147d3640 4 set_mon_vals no callback set 2026-02-17T11:14:48.457 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.443+0000 7f1011546640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:48.457 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.443+0000 7f1011546640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:14:48.457 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.443+0000 7f1011546640 10 monclient: dump: 2026-02-17T11:14:48.457 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:48.458 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:48.458 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:48.458 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:48.458 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:48.458 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:48.458 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:48.458 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:48.458 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:48.458 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:48.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.443+0000 7f10147d3640 10 monclient: shutdown 2026-02-17T11:14:48.459 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.443+0000 7f10147d3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:14:48.459 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.443+0000 7f10147d3640 1 -- 10.20.193.49:0/4203151276 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f0ff4003db0 msgr2=0x7f0ff40041b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:48.459 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.443+0000 7f10147d3640 1 --2- 10.20.193.49:0/4203151276 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f0ff4003db0 0x7f0ff40041b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc00c320 tx=0x7f0ffc02f590 comp rx=0 tx=0).stop 2026-02-17T11:14:48.459 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.443+0000 7f10147d3640 1 -- 10.20.193.49:0/4203151276 shutdown_connections 2026-02-17T11:14:48.459 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.443+0000 7f10147d3640 1 --2- 10.20.193.49:0/4203151276 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f0ff4003db0 0x7f0ff40041b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:48.459 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.443+0000 7f10147d3640 1 -- 10.20.193.49:0/4203151276 >> 10.20.193.49:0/4203151276 conn(0x7f100c0c9f40 msgr2=0x7f100c0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:14:48.459 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.443+0000 7f10147d3640 1 -- 10.20.193.49:0/4203151276 shutdown_connections 2026-02-17T11:14:48.459 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.443+0000 7f10147d3640 1 -- 10.20.193.49:0/4203151276 wait complete. 2026-02-17T11:14:48.459 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.443+0000 7f10147d3640 10 monclient: build_initial_monmap 2026-02-17T11:14:48.459 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.443+0000 7f10147d3640 10 monclient: monmap: 2026-02-17T11:14:48.459 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:14:48.459 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:14:48.460 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:14:48.460 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:14:48.460 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:14:48.460 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:48.460 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:14:48.460 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:14:48.460 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:14:48.460 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:48.460 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.443+0000 7f10147d3640 1 librados: starting msgr at 2026-02-17T11:14:48.460 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.443+0000 7f10147d3640 1 librados: starting objecter 2026-02-17T11:14:48.460 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.444+0000 7f10147d3640 1 Processor -- start 2026-02-17T11:14:48.460 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.444+0000 7f10147d3640 1 -- start start 2026-02-17T11:14:48.460 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.444+0000 7f10147d3640 1 librados: setting wanted keys 2026-02-17T11:14:48.461 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.444+0000 7f10147d3640 1 librados: calling monclient init 2026-02-17T11:14:48.461 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.444+0000 7f10147d3640 10 monclient: init 2026-02-17T11:14:48.461 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.444+0000 7f10147d3640 10 monclient: _reopen_session rank -1 2026-02-17T11:14:48.461 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.444+0000 7f10147d3640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:14:48.461 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.444+0000 7f10147d3640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f0ff4003db0 0x7f100c143ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:48.461 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.444+0000 7f10147d3640 10 monclient(hunting): picked mon.noname-c con 0x7f0ff4003db0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:14:48.461 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.444+0000 7f10147d3640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f100c1444c0 0x7f100c1f4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:48.461 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.444+0000 7f10147d3640 10 monclient(hunting): picked mon.noname-b con 0x7f100c1444c0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:14:48.461 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.444+0000 7f10147d3640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f100c158de0 0x7f100c15cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:48.461 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.444+0000 7f10147d3640 10 monclient(hunting): picked mon.noname-a con 0x7f100c158de0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:14:48.461 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.444+0000 7f10147d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:48.462 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.444+0000 7f10147d3640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f100c0c01f0 con 0x7f100c158de0 2026-02-17T11:14:48.462 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.444+0000 7f10147d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:48.462 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.444+0000 7f10147d3640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f100c0bfd60 con 0x7f100c1444c0 2026-02-17T11:14:48.462 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.444+0000 7f10147d3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:48.462 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.444+0000 7f10147d3640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f100c0be810 con 0x7f0ff4003db0 2026-02-17T11:14:48.462 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.444+0000 7f10147d3640 10 monclient(hunting): _renew_subs 2026-02-17T11:14:48.462 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.444+0000 7f10147d3640 10 monclient(hunting): authenticate will time out at 1365.108456s 2026-02-17T11:14:48.462 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.444+0000 7f1012d49640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f100c158de0 0x7f100c15cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:48.462 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.444+0000 7f1011d47640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f100c1444c0 0x7f100c1f4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:48.462 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.444+0000 7f1012d49640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f100c158de0 0x7f100c15cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:34506/0 (socket says 10.20.193.49:34506) 2026-02-17T11:14:48.462 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.444+0000 7f1012d49640 1 -- 10.20.193.49:0/2779897656 learned_addr learned my addr 10.20.193.49:0/2779897656 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:14:48.462 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.444+0000 7f1012d49640 10 monclient(hunting): get_auth_request con 0x7f100c158de0 auth_method 0 2026-02-17T11:14:48.463 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.444+0000 7f1012d49640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:48.463 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.444+0000 7f1012d49640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:48.463 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.444+0000 7f1012d49640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:48.463 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.444+0000 7f1011d47640 10 monclient(hunting): get_auth_request con 0x7f100c1444c0 auth_method 0 2026-02-17T11:14:48.463 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.444+0000 7f1011d47640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:48.463 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.444+0000 7f1011d47640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:48.463 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.444+0000 7f1011d47640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:48.463 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.444+0000 7f1012548640 1 --2- 10.20.193.49:0/2779897656 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f0ff4003db0 0x7f100c143ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:48.463 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.444+0000 7f1012548640 10 monclient(hunting): get_auth_request con 0x7f0ff4003db0 auth_method 0 2026-02-17T11:14:48.463 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.444+0000 7f1012548640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:48.463 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.444+0000 7f1012548640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:48.463 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.444+0000 7f1012548640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:48.463 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.445+0000 7f1011d47640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:48.464 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.445+0000 7f1011d47640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:48.464 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.445+0000 7f1011d47640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:48.464 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.445+0000 7f1012d49640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:48.464 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.445+0000 7f1012d49640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:48.464 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.445+0000 7f1012d49640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:48.464 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.445+0000 7f1012548640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:48.464 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.445+0000 7f1012548640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:48.464 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.445+0000 7f1012548640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:48.464 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.446+0000 7f1011d47640 10 monclient(hunting): handle_auth_done global_id 5029 payload 824 2026-02-17T11:14:48.464 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.446+0000 7f1011d47640 1 -- 10.20.193.49:0/2779897656 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f0ff4003db0 msgr2=0x7f100c143ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:48.464 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.446+0000 7f1011d47640 1 --2- 10.20.193.49:0/2779897656 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f0ff4003db0 0x7f100c143ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:48.464 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.446+0000 7f1011d47640 1 -- 10.20.193.49:0/2779897656 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f100c158de0 msgr2=0x7f100c15cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:48.464 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.446+0000 7f1011d47640 1 --2- 10.20.193.49:0/2779897656 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f100c158de0 0x7f100c15cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:48.465 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.446+0000 7f1011d47640 10 monclient: _finish_hunting 0 2026-02-17T11:14:48.465 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.446+0000 7f1011d47640 1 monclient: found mon.noname-b 2026-02-17T11:14:48.465 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.446+0000 7f1011d47640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:14:48.465 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.446+0000 7f1011d47640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:14:48.465 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.446+0000 7f1011d47640 1 -- 10.20.193.49:0/2779897656 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f100c06f320 con 0x7f100c1444c0 2026-02-17T11:14:48.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.447+0000 7f1011d47640 1 --2- 10.20.193.49:0/2779897656 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f100c1444c0 0x7f100c1f4720 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f100c06a6b0 tx=0x7f100000ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:14:48.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.447+0000 7f0ff2ffd640 10 client.?.objecter ms_handle_connect 0x7f100c1444c0 2026-02-17T11:14:48.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.447+0000 7f0ff2ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:14:48.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.448+0000 7f0ff2ffd640 1 -- 10.20.193.49:0/2779897656 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f100000c9f0 con 0x7f100c1444c0 2026-02-17T11:14:48.469 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.448+0000 7f0ff2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:48.469 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.448+0000 7f0ff2ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:14:48.469 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.448+0000 7f0ff2ffd640 10 monclient: dump: 2026-02-17T11:14:48.469 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:48.469 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:48.469 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:48.469 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:48.469 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:48.469 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:48.470 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:48.470 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:48.470 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:48.470 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:48.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.448+0000 7f0ff2ffd640 10 monclient: _finish_auth 0 2026-02-17T11:14:48.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.448+0000 7f0ff2ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:14:48.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.448+0000 7f0ff2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:14:48.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.448+0000 7f10147d3640 5 monclient: authenticate success, global_id 5029 2026-02-17T11:14:48.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.448+0000 7f10147d3640 10 monclient: _renew_subs 2026-02-17T11:14:48.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.448+0000 7f10147d3640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:14:48.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.448+0000 7f10147d3640 1 -- 10.20.193.49:0/2779897656 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f100c06eda0 con 0x7f100c1444c0 2026-02-17T11:14:48.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.448+0000 7f10147d3640 10 client.5029.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:14:48.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.448+0000 7f10147d3640 10 monclient: _renew_subs 2026-02-17T11:14:48.471 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.448+0000 7f10147d3640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:14:48.471 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.448+0000 7f10147d3640 1 -- 10.20.193.49:0/2779897656 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f100c06d3b0 con 0x7f100c1444c0 2026-02-17T11:14:48.471 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.448+0000 7f10147d3640 1 librados: init done 2026-02-17T11:14:48.471 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.448+0000 7f0ff2ffd640 1 -- 10.20.193.49:0/2779897656 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f100000cb90 con 0x7f100c1444c0 2026-02-17T11:14:48.471 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.448+0000 7f0ff2ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:14:48.471 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.448+0000 7f0ff2ffd640 1 -- 10.20.193.49:0/2779897656 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f100000cd40 con 0x7f100c1444c0 2026-02-17T11:14:48.471 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.448+0000 7f0ff2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:48.471 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.448+0000 7f0ff2ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:14:48.471 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.448+0000 7f0ff2ffd640 10 monclient: dump: 2026-02-17T11:14:48.471 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:48.471 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:48.471 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:48.472 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:48.472 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:48.472 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:48.472 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:48.472 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:48.472 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:48.472 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:48.472 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.448+0000 7f0ff3fff640 4 set_mon_vals no callback set 2026-02-17T11:14:48.472 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.448+0000 7f10147d3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:14:48.472 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.449+0000 7f10147d3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:14:48.472 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.449+0000 7f10147d3640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:14:48.473 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.449+0000 7f10147d3640 1 -- 10.20.193.49:0/2779897656 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f100c155770 con 0x7f100c1444c0 2026-02-17T11:14:48.473 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.461+0000 7f0ff2ffd640 1 -- 10.20.193.49:0/2779897656 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f10000068d0 con 0x7f100c1444c0 2026-02-17T11:14:48.473 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.462+0000 7f0ff2ffd640 1 --2- 10.20.193.49:0/2779897656 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0fdc079140 0x7f0fdc07b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:48.473 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.462+0000 7f1012548640 1 --2- 10.20.193.49:0/2779897656 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0fdc079140 0x7f0fdc07b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:48.473 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.462+0000 7f1012548640 10 monclient: get_auth_request con 0x7f0fdc079140 auth_method 0 2026-02-17T11:14:48.473 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.462+0000 7f1012548640 1 --2- 10.20.193.49:0/2779897656 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0fdc079140 0x7f0fdc07b600 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc036000 tx=0x7f0ffc009070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:14:48.473 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.462+0000 7f0ff2ffd640 10 client.5029.objecter ms_handle_connect 0x7f0fdc079140 2026-02-17T11:14:48.473 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.462+0000 7f0ff2ffd640 1 -- 10.20.193.49:0/2779897656 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f100005e600 con 0x7f100c1444c0 2026-02-17T11:14:48.473 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.462+0000 7f0ff2ffd640 10 client.5029.objecter ms_dispatch2 0x7f100c000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:14:48.473 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.462+0000 7f0ff2ffd640 3 client.5029.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:14:48.473 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.462+0000 7f0ff2ffd640 3 client.5029.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:14:48.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.462+0000 7f0ff2ffd640 20 client.5029.objecter dump_active .. 0 homeless 2026-02-17T11:14:48.565 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.564+0000 7f0ff2ffd640 1 -- 10.20.193.49:0/2779897656 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f10000625c0 con 0x7f100c1444c0 2026-02-17T11:14:48.566 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.564+0000 7f0ff2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:14:48.566 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.564+0000 7f0ff2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:14:48.663 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.660+0000 7f10147d3640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:14:48.664 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.660+0000 7f10147d3640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:14:48.664 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.660+0000 7f10147d3640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:14:48.664 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.660+0000 7f10147d3640 1 -- 10.20.193.49:0/2779897656 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f100c0c0740 con 0x7f100c1444c0 2026-02-17T11:14:48.665 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.663+0000 7f0ff2ffd640 1 -- 10.20.193.49:0/2779897656 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f10000668c0 con 0x7f100c1444c0 2026-02-17T11:14:48.665 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.663+0000 7f0ff2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:14:48.665 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.663+0000 7f0ff2ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:14:48.666 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:14:48.666 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:14:48.668 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.664+0000 7f10147d3640 10 librados: watch_flush enter 2026-02-17T11:14:48.668 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.664+0000 7f10147d3640 10 librados: watch_flush exit 2026-02-17T11:14:48.668 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.664+0000 7f10147d3640 20 client.5029.objecter shutdown clearing up homeless session... 2026-02-17T11:14:48.668 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.664+0000 7f10147d3640 10 client.5029.objecter successfully canceled tick 2026-02-17T11:14:48.668 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.664+0000 7f10147d3640 1 -- 10.20.193.49:0/2779897656 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0fdc079140 msgr2=0x7f0fdc07b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:48.668 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.664+0000 7f10147d3640 1 --2- 10.20.193.49:0/2779897656 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0fdc079140 0x7f0fdc07b600 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc036000 tx=0x7f0ffc009070 comp rx=0 tx=0).stop 2026-02-17T11:14:48.668 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.664+0000 7f10147d3640 10 monclient: shutdown 2026-02-17T11:14:48.668 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.664+0000 7f10147d3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:14:48.668 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.664+0000 7f10147d3640 1 -- 10.20.193.49:0/2779897656 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f100c1444c0 msgr2=0x7f100c1f4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:48.668 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.664+0000 7f10147d3640 1 --2- 10.20.193.49:0/2779897656 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f100c1444c0 0x7f100c1f4720 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f100c06a6b0 tx=0x7f100000ef10 comp rx=0 tx=0).stop 2026-02-17T11:14:48.669 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.664+0000 7f10147d3640 1 -- 10.20.193.49:0/2779897656 shutdown_connections 2026-02-17T11:14:48.669 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.664+0000 7f10147d3640 1 --2- 10.20.193.49:0/2779897656 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0fdc079140 0x7f0fdc07b600 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:48.669 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.664+0000 7f10147d3640 1 --2- 10.20.193.49:0/2779897656 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f100c158de0 0x7f100c15cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:48.669 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.664+0000 7f10147d3640 1 --2- 10.20.193.49:0/2779897656 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f100c1444c0 0x7f100c1f4720 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:48.669 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.664+0000 7f10147d3640 1 --2- 10.20.193.49:0/2779897656 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f0ff4003db0 0x7f100c143ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:48.669 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.664+0000 7f10147d3640 1 -- 10.20.193.49:0/2779897656 >> 10.20.193.49:0/2779897656 conn(0x7f100c0c9f40 msgr2=0x7f100c151aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:14:48.669 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.664+0000 7f10147d3640 1 -- 10.20.193.49:0/2779897656 shutdown_connections 2026-02-17T11:14:48.669 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.664+0000 7f10147d3640 1 -- 10.20.193.49:0/2779897656 wait complete. 2026-02-17T11:14:48.669 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:48.664+0000 7f10147d3640 1 librados: shutdown 2026-02-17T11:14:51.676 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:14:51.750 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.744+0000 7f7535b79640 10 monclient: get_monmap_and_config 2026-02-17T11:14:51.750 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.744+0000 7f7535b79640 10 monclient: build_initial_monmap 2026-02-17T11:14:51.750 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.744+0000 7f7535b79640 10 monclient: monmap: 2026-02-17T11:14:51.750 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:14:51.750 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:51.750 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:14:51.745252+0000 2026-02-17T11:14:51.751 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:14:51.745252+0000 2026-02-17T11:14:51.751 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:14:51.751 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:51.751 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:14:51.751 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:14:51.751 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:14:51.751 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:14:51.751 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:14:51.751 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:14:51.751 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:51.751 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.745+0000 7f7535b79640 1 Processor -- start 2026-02-17T11:14:51.751 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.745+0000 7f7535b79640 1 -- start start 2026-02-17T11:14:51.752 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.745+0000 7f7535b79640 10 monclient: init 2026-02-17T11:14:51.752 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.745+0000 7f7535b79640 10 monclient: _reopen_session rank -1 2026-02-17T11:14:51.752 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.745+0000 7f7535b79640 10 monclient: _add_conns ranks=[3,2,4,5,1,0] 2026-02-17T11:14:51.752 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.745+0000 7f7535b79640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f753015d370 0x7f753015d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:51.752 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.745+0000 7f7535b79640 10 monclient(hunting): picked mon.noname-a con 0x7f753015d370 addr v2:10.20.193.49:3300/0 2026-02-17T11:14:51.752 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.745+0000 7f7535b79640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f75300c7e20 addr v1:10.20.193.157:6789/0 2026-02-17T11:14:51.752 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.745+0000 7f7535b79640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f75300c74c0 0x7f75300c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:51.752 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.745+0000 7f7535b79640 10 monclient(hunting): picked mon.noname-b con 0x7f75300c74c0 addr v2:10.20.193.97:3300/0 2026-02-17T11:14:51.752 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.745+0000 7f7535b79640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75300c8350 con 0x7f75300c7e20 2026-02-17T11:14:51.752 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.745+0000 7f7535b79640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:51.753 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.745+0000 7f7535b79640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f753015b710 con 0x7f753015d370 2026-02-17T11:14:51.753 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.745+0000 7f7535b79640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:51.753 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.745+0000 7f7535b79640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f75300c9240 con 0x7f75300c74c0 2026-02-17T11:14:51.753 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.745+0000 7f7535b79640 10 monclient(hunting): _renew_subs 2026-02-17T11:14:51.753 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.745+0000 7f7535b79640 10 monclient(hunting): authenticate will time out at 1368.408711s 2026-02-17T11:14:51.753 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.746+0000 7f752effd640 1 --1- >> v1:10.20.193.157:6789/0 conn(0x7f75300c7e20 0x7f753015b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.157:6789/0 says I am v1:10.20.193.49:55356/0 (socket says 10.20.193.49:55356) 2026-02-17T11:14:51.753 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.746+0000 7f752effd640 1 -- 10.20.193.49:0/4197705539 learned_addr learned my addr 10.20.193.49:0/4197705539 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:14:51.753 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.746+0000 7f752ffff640 1 --2- 10.20.193.49:0/4197705539 >> v2:10.20.193.97:3300/0 conn(0x7f75300c74c0 0x7f75300c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:51.753 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.746+0000 7f752ffff640 10 monclient(hunting): get_auth_request con 0x7f75300c74c0 auth_method 0 2026-02-17T11:14:51.753 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.746+0000 7f752ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:51.753 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.746+0000 7f752ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:51.754 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.746+0000 7f752ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:51.754 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.746+0000 7f752ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:51.754 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.746+0000 7f752ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:51.754 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.746+0000 7f752ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:51.754 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.746+0000 7f752f7fe640 1 --2- 10.20.193.49:0/4197705539 >> v2:10.20.193.49:3300/0 conn(0x7f753015d370 0x7f753015d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:51.754 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.747+0000 7f752f7fe640 10 monclient(hunting): get_auth_request con 0x7f753015d370 auth_method 0 2026-02-17T11:14:51.754 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.747+0000 7f752f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:51.754 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.747+0000 7f752f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:51.754 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.747+0000 7f752f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:51.754 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.747+0000 7f752e7fc640 1 -- 10.20.193.49:0/4197705539 <== mon.2 v1:10.20.193.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1071336462 0 0) 0x7f75300c8350 con 0x7f75300c7e20 2026-02-17T11:14:51.754 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.747+0000 7f752e7fc640 10 monclient(hunting): _negotiate 2026-02-17T11:14:51.755 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.747+0000 7f752e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:51.755 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.747+0000 7f752e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:51.755 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.747+0000 7f752e7fc640 10 monclient(hunting): my global_id is 5072 2026-02-17T11:14:51.755 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.747+0000 7f752e7fc640 1 -- 10.20.193.49:0/4197705539 --> v1:10.20.193.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7514003620 con 0x7f75300c7e20 2026-02-17T11:14:51.755 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.747+0000 7f752f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:51.755 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.747+0000 7f752f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:51.755 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.747+0000 7f752f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:51.755 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.748+0000 7f752ffff640 10 monclient(hunting): handle_auth_done global_id 5032 payload 274 2026-02-17T11:14:51.755 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.748+0000 7f752ffff640 1 -- 10.20.193.49:0/4197705539 >> v2:10.20.193.49:3300/0 conn(0x7f753015d370 msgr2=0x7f753015d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:14:51.755 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.748+0000 7f752ffff640 1 --2- 10.20.193.49:0/4197705539 >> v2:10.20.193.49:3300/0 conn(0x7f753015d370 0x7f753015d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:51.755 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.748+0000 7f752ffff640 1 -- 10.20.193.49:0/4197705539 >> v1:10.20.193.157:6789/0 conn(0x7f75300c7e20 legacy=0x7f753015b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:51.755 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.748+0000 7f752ffff640 10 monclient: _finish_hunting 0 2026-02-17T11:14:51.756 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.748+0000 7f752ffff640 1 monclient: found mon.noname-b 2026-02-17T11:14:51.756 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.748+0000 7f752ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:14:51.756 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.748+0000 7f752ffff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:14:51.756 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.748+0000 7f752ffff640 1 -- 10.20.193.49:0/4197705539 --> v2:10.20.193.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75300c8630 con 0x7f75300c74c0 2026-02-17T11:14:51.763 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.749+0000 7f752ffff640 1 --2- 10.20.193.49:0/4197705539 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f75300c74c0 0x7f75300c52b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f753015dcf0 tx=0x7f752402f1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12c6e657355db0b5 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:14:51.763 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.751+0000 7f752e7fc640 1 -- 10.20.193.49:0/4197705539 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f752403c070 con 0x7f75300c74c0 2026-02-17T11:14:51.763 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.751+0000 7f752e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:51.763 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.751+0000 7f752e7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:14:51.763 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.751+0000 7f752e7fc640 10 monclient: dump: 2026-02-17T11:14:51.763 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:51.764 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:51.764 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:51.764 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:51.764 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:51.764 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:51.764 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:51.764 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:51.764 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:51.764 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:51.764 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.751+0000 7f752e7fc640 10 monclient: _finish_auth 0 2026-02-17T11:14:51.764 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.751+0000 7f752e7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:14:51.764 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.751+0000 7f752e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:14:51.765 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.751+0000 7f752e7fc640 1 -- 10.20.193.49:0/4197705539 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7524037440 con 0x7f75300c74c0 2026-02-17T11:14:51.765 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.751+0000 7f752e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:14:51.765 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.751+0000 7f752e7fc640 1 -- 10.20.193.49:0/4197705539 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7524037810 con 0x7f75300c74c0 2026-02-17T11:14:51.765 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.751+0000 7f7535b79640 5 monclient: authenticate success, global_id 5032 2026-02-17T11:14:51.765 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.751+0000 7f7535b79640 10 monclient: get_monmap_and_config success 2026-02-17T11:14:51.765 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.751+0000 7f7535b79640 4 set_mon_vals no callback set 2026-02-17T11:14:51.765 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.751+0000 7f752e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:51.765 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.751+0000 7f752e7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:14:51.765 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.751+0000 7f752e7fc640 10 monclient: dump: 2026-02-17T11:14:51.765 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:51.765 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:51.766 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:51.766 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:51.766 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:51.766 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:51.766 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:51.766 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:51.766 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:51.766 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:51.766 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.751+0000 7f7535b79640 10 monclient: shutdown 2026-02-17T11:14:51.766 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.751+0000 7f7535b79640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:14:51.766 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.751+0000 7f7535b79640 1 -- 10.20.193.49:0/4197705539 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f75300c74c0 msgr2=0x7f75300c52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:51.766 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.751+0000 7f7535b79640 1 --2- 10.20.193.49:0/4197705539 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f75300c74c0 0x7f75300c52b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f753015dcf0 tx=0x7f752402f1c0 comp rx=0 tx=0).stop 2026-02-17T11:14:51.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.751+0000 7f7535b79640 1 -- 10.20.193.49:0/4197705539 shutdown_connections 2026-02-17T11:14:51.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.751+0000 7f7535b79640 1 --2- 10.20.193.49:0/4197705539 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f75300c74c0 0x7f75300c52b0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:51.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.751+0000 7f7535b79640 1 --2- 10.20.193.49:0/4197705539 >> v2:10.20.193.49:3300/0 conn(0x7f753015d370 0x7f753015d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:51.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.751+0000 7f7535b79640 1 -- 10.20.193.49:0/4197705539 >> 10.20.193.49:0/4197705539 conn(0x7f75300c9f20 msgr2=0x7f75300ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:14:51.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.752+0000 7f7535b79640 1 -- 10.20.193.49:0/4197705539 shutdown_connections 2026-02-17T11:14:51.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.752+0000 7f7535b79640 1 -- 10.20.193.49:0/4197705539 wait complete. 2026-02-17T11:14:51.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.752+0000 7f7535b79640 10 monclient: build_initial_monmap 2026-02-17T11:14:51.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.752+0000 7f7535b79640 10 monclient: monmap: 2026-02-17T11:14:51.767 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:14:51.767 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:14:51.767 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:14:51.767 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:14:51.768 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:14:51.768 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:51.768 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:14:51.768 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:14:51.768 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:14:51.768 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:51.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.752+0000 7f7535b79640 1 librados: starting msgr at 2026-02-17T11:14:51.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.752+0000 7f7535b79640 1 librados: starting objecter 2026-02-17T11:14:51.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.752+0000 7f7535b79640 1 Processor -- start 2026-02-17T11:14:51.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.752+0000 7f7535b79640 1 -- start start 2026-02-17T11:14:51.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.752+0000 7f7535b79640 1 librados: setting wanted keys 2026-02-17T11:14:51.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.752+0000 7f7535b79640 1 librados: calling monclient init 2026-02-17T11:14:51.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.752+0000 7f7535b79640 10 monclient: init 2026-02-17T11:14:51.769 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.753+0000 7f7535b79640 10 monclient: _reopen_session rank -1 2026-02-17T11:14:51.769 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.753+0000 7f7535b79640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:14:51.769 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.753+0000 7f7535b79640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f75300c74c0 0x7f753006da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:51.769 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.753+0000 7f7535b79640 10 monclient(hunting): picked mon.noname-b con 0x7f75300c74c0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:14:51.769 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.753+0000 7f7535b79640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f75300c7e20 0x7f7530155540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:51.769 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.753+0000 7f7535b79640 10 monclient(hunting): picked mon.noname-a con 0x7f75300c7e20 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:14:51.769 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.753+0000 7f7535b79640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f753015d370 0x7f75301f6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:51.769 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.753+0000 7f7535b79640 10 monclient(hunting): picked mon.noname-c con 0x7f753015d370 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:14:51.769 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.753+0000 7f7535b79640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:51.769 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.753+0000 7f7535b79640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f75300c8ed0 con 0x7f75300c7e20 2026-02-17T11:14:51.769 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.753+0000 7f7535b79640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:51.769 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.753+0000 7f7535b79640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f75300c8bf0 con 0x7f75300c74c0 2026-02-17T11:14:51.769 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.753+0000 7f7535b79640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:51.770 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.753+0000 7f7535b79640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f75300c96d0 con 0x7f753015d370 2026-02-17T11:14:51.770 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.753+0000 7f7535b79640 10 monclient(hunting): _renew_subs 2026-02-17T11:14:51.770 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.753+0000 7f7535b79640 10 monclient(hunting): authenticate will time out at 1368.416398s 2026-02-17T11:14:51.770 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.753+0000 7f752f7fe640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f75300c74c0 0x7f753006da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:51.770 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.753+0000 7f752ffff640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f753015d370 0x7f75301f6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:51.770 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.753+0000 7f752ffff640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f753015d370 0x7f75301f6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:41088/0 (socket says 10.20.193.49:41088) 2026-02-17T11:14:51.770 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.753+0000 7f752ffff640 1 -- 10.20.193.49:0/3765441009 learned_addr learned my addr 10.20.193.49:0/3765441009 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:14:51.770 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.753+0000 7f752ffff640 10 monclient(hunting): get_auth_request con 0x7f753015d370 auth_method 0 2026-02-17T11:14:51.770 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.753+0000 7f752ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:51.770 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.753+0000 7f752ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:51.770 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.753+0000 7f752ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:51.771 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.753+0000 7f752f7fe640 10 monclient(hunting): get_auth_request con 0x7f75300c74c0 auth_method 0 2026-02-17T11:14:51.771 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.753+0000 7f752f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:51.771 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.753+0000 7f752f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:51.771 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.753+0000 7f752f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:51.771 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.754+0000 7f752ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:51.771 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.754+0000 7f752ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:51.771 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.754+0000 7f752ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:51.771 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.754+0000 7f752f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:51.771 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.754+0000 7f752f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:51.771 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.754+0000 7f752f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:51.771 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.754+0000 7f752effd640 1 --2- 10.20.193.49:0/3765441009 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f75300c7e20 0x7f7530155540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:51.771 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.754+0000 7f752effd640 10 monclient(hunting): get_auth_request con 0x7f75300c7e20 auth_method 0 2026-02-17T11:14:51.771 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.754+0000 7f752effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:51.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.754+0000 7f752effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:51.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.754+0000 7f752effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:51.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.755+0000 7f752effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:51.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.755+0000 7f752effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:51.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.755+0000 7f752effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:51.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.755+0000 7f752ffff640 10 monclient(hunting): handle_auth_done global_id 5075 payload 824 2026-02-17T11:14:51.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.755+0000 7f752ffff640 1 -- 10.20.193.49:0/3765441009 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f75300c74c0 msgr2=0x7f753006da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:51.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.755+0000 7f752ffff640 1 --2- 10.20.193.49:0/3765441009 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f75300c74c0 0x7f753006da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:51.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.755+0000 7f752ffff640 1 -- 10.20.193.49:0/3765441009 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f75300c7e20 msgr2=0x7f7530155540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:51.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.755+0000 7f752ffff640 1 --2- 10.20.193.49:0/3765441009 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f75300c7e20 0x7f7530155540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:51.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.755+0000 7f752ffff640 10 monclient: _finish_hunting 0 2026-02-17T11:14:51.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.755+0000 7f752ffff640 1 monclient: found mon.noname-c 2026-02-17T11:14:51.773 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.755+0000 7f752ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:14:51.773 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.755+0000 7f752ffff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:14:51.773 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.755+0000 7f752ffff640 1 -- 10.20.193.49:0/3765441009 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f753006e140 con 0x7f753015d370 2026-02-17T11:14:51.773 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.756+0000 7f752ffff640 1 --2- 10.20.193.49:0/3765441009 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f753015d370 0x7f75301f6c50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f752402f6f0 tx=0x7f7524004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:14:51.773 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.756+0000 7f750bfff640 10 client.?.objecter ms_handle_connect 0x7f753015d370 2026-02-17T11:14:51.773 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.756+0000 7f750bfff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:14:51.773 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.757+0000 7f750bfff640 1 -- 10.20.193.49:0/3765441009 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f752403c050 con 0x7f753015d370 2026-02-17T11:14:51.773 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.757+0000 7f750bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:51.773 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.757+0000 7f750bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:14:51.773 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.757+0000 7f750bfff640 10 monclient: dump: 2026-02-17T11:14:51.773 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:51.773 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:51.773 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:51.774 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:51.774 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:51.774 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:51.774 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:51.774 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:51.774 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:51.774 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:51.774 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.757+0000 7f750bfff640 10 monclient: _finish_auth 0 2026-02-17T11:14:51.774 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.757+0000 7f750bfff640 10 monclient: _check_auth_tickets 2026-02-17T11:14:51.774 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.757+0000 7f750bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:14:51.774 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.757+0000 7f7535b79640 5 monclient: authenticate success, global_id 5075 2026-02-17T11:14:51.774 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.757+0000 7f7535b79640 10 monclient: _renew_subs 2026-02-17T11:14:51.774 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.757+0000 7f7535b79640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:14:51.775 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.757+0000 7f7535b79640 1 -- 10.20.193.49:0/3765441009 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f753006e420 con 0x7f753015d370 2026-02-17T11:14:51.775 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.757+0000 7f7535b79640 10 client.5075.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:14:51.775 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.757+0000 7f7535b79640 10 monclient: _renew_subs 2026-02-17T11:14:51.775 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.757+0000 7f7535b79640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:14:51.775 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.757+0000 7f7535b79640 1 -- 10.20.193.49:0/3765441009 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f753006e9e0 con 0x7f753015d370 2026-02-17T11:14:51.775 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.757+0000 7f7535b79640 1 librados: init done 2026-02-17T11:14:51.775 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.758+0000 7f7535b79640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:14:51.775 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.758+0000 7f7535b79640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:14:51.775 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.758+0000 7f7535b79640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:14:51.775 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.758+0000 7f7535b79640 1 -- 10.20.193.49:0/3765441009 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f753015d750 con 0x7f753015d370 2026-02-17T11:14:51.775 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.758+0000 7f750bfff640 1 -- 10.20.193.49:0/3765441009 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7524048070 con 0x7f753015d370 2026-02-17T11:14:51.775 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.758+0000 7f750bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:14:51.775 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.758+0000 7f750bfff640 1 -- 10.20.193.49:0/3765441009 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7524041a10 con 0x7f753015d370 2026-02-17T11:14:51.776 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.758+0000 7f750bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:51.776 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.758+0000 7f750bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:14:51.776 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.758+0000 7f752dffb640 4 set_mon_vals no callback set 2026-02-17T11:14:51.776 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.758+0000 7f750bfff640 10 monclient: dump: 2026-02-17T11:14:51.776 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:51.776 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:51.776 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:51.776 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:51.776 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:51.776 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:51.776 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:51.777 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:51.777 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:51.777 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:51.867 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.866+0000 7f750bfff640 1 -- 10.20.193.49:0/3765441009 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f7524041bb0 con 0x7f753015d370 2026-02-17T11:14:51.868 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.866+0000 7f750bfff640 1 --2- 10.20.193.49:0/3765441009 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f7500079140 0x7f750007b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:51.869 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.867+0000 7f752f7fe640 1 --2- 10.20.193.49:0/3765441009 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f7500079140 0x7f750007b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:51.869 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.867+0000 7f752f7fe640 10 monclient: get_auth_request con 0x7f7500079140 auth_method 0 2026-02-17T11:14:51.869 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.867+0000 7f752f7fe640 1 --2- 10.20.193.49:0/3765441009 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f7500079140 0x7f750007b600 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f753014da30 tx=0x7f751c009290 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:14:51.869 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.867+0000 7f750bfff640 10 client.5075.objecter ms_handle_connect 0x7f7500079140 2026-02-17T11:14:51.872 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.871+0000 7f750bfff640 1 -- 10.20.193.49:0/3765441009 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f75240be020 con 0x7f753015d370 2026-02-17T11:14:51.872 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.871+0000 7f750bfff640 10 client.5075.objecter ms_dispatch2 0x7f7530000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:14:51.872 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.871+0000 7f750bfff640 3 client.5075.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:14:51.873 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.871+0000 7f750bfff640 3 client.5075.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:14:51.873 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.871+0000 7f750bfff640 20 client.5075.objecter dump_active .. 0 homeless 2026-02-17T11:14:51.879 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.877+0000 7f750bfff640 1 -- 10.20.193.49:0/3765441009 <== mon.2 v2:10.20.193.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f75240885d0 con 0x7f753015d370 2026-02-17T11:14:51.879 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.877+0000 7f750bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:14:51.879 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.877+0000 7f750bfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:14:51.985 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.983+0000 7f7535b79640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:14:51.985 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.983+0000 7f7535b79640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:14:51.985 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.983+0000 7f7535b79640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:14:51.985 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.983+0000 7f7535b79640 1 -- 10.20.193.49:0/3765441009 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7530150690 con 0x7f753015d370 2026-02-17T11:14:51.987 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.985+0000 7f750bfff640 1 -- 10.20.193.49:0/3765441009 <== mon.2 v2:10.20.193.157:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f752408c8d0 con 0x7f753015d370 2026-02-17T11:14:51.987 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.985+0000 7f750bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:14:51.987 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.985+0000 7f750bfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:14:51.987 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:14:51.987 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:14:51.989 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.987+0000 7f7535b79640 10 librados: watch_flush enter 2026-02-17T11:14:51.989 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.987+0000 7f7535b79640 10 librados: watch_flush exit 2026-02-17T11:14:51.989 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.987+0000 7f7535b79640 20 client.5075.objecter shutdown clearing up homeless session... 2026-02-17T11:14:51.989 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.987+0000 7f7535b79640 10 client.5075.objecter successfully canceled tick 2026-02-17T11:14:51.990 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.987+0000 7f7535b79640 1 -- 10.20.193.49:0/3765441009 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f7500079140 msgr2=0x7f750007b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:51.990 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.987+0000 7f7535b79640 1 --2- 10.20.193.49:0/3765441009 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f7500079140 0x7f750007b600 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f753014da30 tx=0x7f751c009290 comp rx=0 tx=0).stop 2026-02-17T11:14:51.990 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.987+0000 7f7535b79640 10 monclient: shutdown 2026-02-17T11:14:51.990 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.987+0000 7f7535b79640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:14:51.990 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.987+0000 7f7535b79640 1 -- 10.20.193.49:0/3765441009 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f753015d370 msgr2=0x7f75301f6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:51.990 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.987+0000 7f7535b79640 1 --2- 10.20.193.49:0/3765441009 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f753015d370 0x7f75301f6c50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f752402f6f0 tx=0x7f7524004b40 comp rx=0 tx=0).stop 2026-02-17T11:14:51.990 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.987+0000 7f7535b79640 1 -- 10.20.193.49:0/3765441009 shutdown_connections 2026-02-17T11:14:51.990 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.987+0000 7f7535b79640 1 --2- 10.20.193.49:0/3765441009 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f7500079140 0x7f750007b600 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:51.990 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.987+0000 7f7535b79640 1 --2- 10.20.193.49:0/3765441009 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f753015d370 0x7f75301f6c50 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:51.990 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.987+0000 7f7535b79640 1 --2- 10.20.193.49:0/3765441009 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f75300c7e20 0x7f7530155540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:51.990 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.987+0000 7f7535b79640 1 --2- 10.20.193.49:0/3765441009 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f75300c74c0 0x7f753006da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:51.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.987+0000 7f7535b79640 1 -- 10.20.193.49:0/3765441009 >> 10.20.193.49:0/3765441009 conn(0x7f75300c9f20 msgr2=0x7f753015dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:14:51.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.987+0000 7f7535b79640 1 -- 10.20.193.49:0/3765441009 shutdown_connections 2026-02-17T11:14:51.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.987+0000 7f7535b79640 1 -- 10.20.193.49:0/3765441009 wait complete. 2026-02-17T11:14:51.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:51.987+0000 7f7535b79640 1 librados: shutdown 2026-02-17T11:14:52.081 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:06:37.562 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:14:52.109 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:06:37.590 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:14:52.109 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:06:37.584 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:14:52.111 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:06:37.586 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:14:52.117 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:06:37.598 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:14:52.118 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:06:37.593 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:14:52.137 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:06:37.579 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:14:52.138 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:06:37.580 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:14:52.146 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:06:37.588 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:14:54.998 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:14:55.065 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.064+0000 7faab9990640 10 monclient: get_monmap_and_config 2026-02-17T11:14:55.066 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.064+0000 7faab9990640 10 monclient: build_initial_monmap 2026-02-17T11:14:55.066 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.064+0000 7faab9990640 10 monclient: monmap: 2026-02-17T11:14:55.066 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:14:55.066 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:55.066 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:14:55.064965+0000 2026-02-17T11:14:55.066 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:14:55.064965+0000 2026-02-17T11:14:55.066 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:14:55.066 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:55.066 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:14:55.067 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:14:55.067 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:14:55.067 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:14:55.067 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:14:55.067 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:14:55.067 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:55.070 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.064+0000 7faab9990640 1 Processor -- start 2026-02-17T11:14:55.070 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.064+0000 7faab9990640 1 -- start start 2026-02-17T11:14:55.070 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.064+0000 7faab9990640 10 monclient: init 2026-02-17T11:14:55.070 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.065+0000 7faab9990640 10 monclient: _reopen_session rank -1 2026-02-17T11:14:55.070 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.065+0000 7faab9990640 10 monclient: _add_conns ranks=[5,3,1,0,2,4] 2026-02-17T11:14:55.070 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.065+0000 7faab9990640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7faab40c7170 0x7faab40c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:55.071 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.065+0000 7faab9990640 10 monclient(hunting): picked mon.noname-c con 0x7faab40c7170 addr v2:10.20.193.157:3300/0 2026-02-17T11:14:55.071 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.065+0000 7faab9990640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7faab40c48c0 0x7faab40749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:55.071 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.065+0000 7faab9990640 10 monclient(hunting): picked mon.noname-a con 0x7faab40c48c0 addr v2:10.20.193.49:3300/0 2026-02-17T11:14:55.071 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.065+0000 7faab9990640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7faab4074ef0 addr v1:10.20.193.97:6789/0 2026-02-17T11:14:55.071 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.065+0000 7faab9990640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faab415a9a0 con 0x7faab4074ef0 2026-02-17T11:14:55.071 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.065+0000 7faab9990640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:55.071 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.065+0000 7faab9990640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7faab40c8530 con 0x7faab40c48c0 2026-02-17T11:14:55.071 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.065+0000 7faab9990640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:55.071 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.065+0000 7faab9990640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7faab40c5270 con 0x7faab40c7170 2026-02-17T11:14:55.071 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.065+0000 7faab9990640 10 monclient(hunting): _renew_subs 2026-02-17T11:14:55.071 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.065+0000 7faab9990640 10 monclient(hunting): authenticate will time out at 1371.728504s 2026-02-17T11:14:55.072 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.065+0000 7faab37fe640 1 --1- >> v1:10.20.193.97:6789/0 conn(0x7faab4074ef0 0x7faab40c89c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.97:6789/0 says I am v1:10.20.193.49:49676/0 (socket says 10.20.193.49:49676) 2026-02-17T11:14:55.072 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.065+0000 7faab37fe640 1 -- 10.20.193.49:0/2428188858 learned_addr learned my addr 10.20.193.49:0/2428188858 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:14:55.072 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.065+0000 7faab27fc640 1 --2- 10.20.193.49:0/2428188858 >> v2:10.20.193.49:3300/0 conn(0x7faab40c48c0 0x7faab40749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:55.072 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.066+0000 7faab2ffd640 1 --2- 10.20.193.49:0/2428188858 >> v2:10.20.193.157:3300/0 conn(0x7faab40c7170 0x7faab40c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:55.072 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.066+0000 7faab27fc640 10 monclient(hunting): get_auth_request con 0x7faab40c48c0 auth_method 0 2026-02-17T11:14:55.072 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.066+0000 7faab27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:55.072 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.066+0000 7faab27fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:55.072 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.066+0000 7faab27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:55.072 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.066+0000 7faab2ffd640 10 monclient(hunting): get_auth_request con 0x7faab40c7170 auth_method 0 2026-02-17T11:14:55.072 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.066+0000 7faab2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:55.072 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.066+0000 7faab2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:55.072 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.066+0000 7faab2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:55.073 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.066+0000 7faab27fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:55.073 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.066+0000 7faab27fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:55.073 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.066+0000 7faab27fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:55.073 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.066+0000 7faab2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:55.073 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.066+0000 7faab2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:55.073 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.066+0000 7faab2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:55.073 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.067+0000 7faab1ffb640 1 -- 10.20.193.49:0/2428188858 <== mon.1 v1:10.20.193.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2341441086 0 0) 0x7faab415a9a0 con 0x7faab4074ef0 2026-02-17T11:14:55.073 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.067+0000 7faab1ffb640 10 monclient(hunting): _negotiate 2026-02-17T11:14:55.073 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.067+0000 7faab1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:55.073 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.067+0000 7faab1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:55.073 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.067+0000 7faab1ffb640 10 monclient(hunting): my global_id is 5038 2026-02-17T11:14:55.074 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.067+0000 7faab1ffb640 1 -- 10.20.193.49:0/2428188858 --> v1:10.20.193.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faaa0003620 con 0x7faab4074ef0 2026-02-17T11:14:55.074 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.067+0000 7faab27fc640 10 monclient(hunting): handle_auth_done global_id 5061 payload 274 2026-02-17T11:14:55.074 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.067+0000 7faab27fc640 1 -- 10.20.193.49:0/2428188858 >> v2:10.20.193.157:3300/0 conn(0x7faab40c7170 msgr2=0x7faab40c7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:14:55.074 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.067+0000 7faab27fc640 1 --2- 10.20.193.49:0/2428188858 >> v2:10.20.193.157:3300/0 conn(0x7faab40c7170 0x7faab40c7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:55.074 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.067+0000 7faab27fc640 1 -- 10.20.193.49:0/2428188858 >> v1:10.20.193.97:6789/0 conn(0x7faab4074ef0 legacy=0x7faab40c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:55.074 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.067+0000 7faab27fc640 10 monclient: _finish_hunting 0 2026-02-17T11:14:55.074 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.067+0000 7faab27fc640 1 monclient: found mon.noname-a 2026-02-17T11:14:55.074 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.067+0000 7faab27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:14:55.074 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.067+0000 7faab27fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:14:55.075 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.067+0000 7faab27fc640 1 -- 10.20.193.49:0/2428188858 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faab40c5550 con 0x7faab40c48c0 2026-02-17T11:14:55.075 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.068+0000 7faab27fc640 1 --2- 10.20.193.49:0/2428188858 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7faab40c48c0 0x7faab40749b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7faab40723c0 tx=0x7faa9c02ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2b37ef4e1dd8ad9 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:14:55.081 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.070+0000 7faab1ffb640 1 -- 10.20.193.49:0/2428188858 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa9c03c070 con 0x7faab40c48c0 2026-02-17T11:14:55.081 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.070+0000 7faab1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:55.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.070+0000 7faab1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:14:55.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.070+0000 7faab1ffb640 10 monclient: dump: 2026-02-17T11:14:55.082 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:55.082 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:55.082 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:55.082 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:55.082 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:55.082 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:55.082 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:55.082 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:55.082 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:55.083 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:55.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.070+0000 7faab1ffb640 10 monclient: _finish_auth 0 2026-02-17T11:14:55.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.070+0000 7faab1ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:14:55.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.070+0000 7faab1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:14:55.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.070+0000 7faab1ffb640 1 -- 10.20.193.49:0/2428188858 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa9c02faf0 con 0x7faab40c48c0 2026-02-17T11:14:55.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.070+0000 7faab1ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:14:55.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.070+0000 7faab9990640 5 monclient: authenticate success, global_id 5061 2026-02-17T11:14:55.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.070+0000 7faab1ffb640 1 -- 10.20.193.49:0/2428188858 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa9c037440 con 0x7faab40c48c0 2026-02-17T11:14:55.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.070+0000 7faab9990640 10 monclient: get_monmap_and_config success 2026-02-17T11:14:55.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.070+0000 7faab9990640 4 set_mon_vals no callback set 2026-02-17T11:14:55.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.070+0000 7faab1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:55.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.070+0000 7faab1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:14:55.084 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.070+0000 7faab1ffb640 10 monclient: dump: 2026-02-17T11:14:55.084 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:55.084 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:55.084 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:55.084 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:55.084 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:55.084 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:55.084 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:55.084 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:55.084 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:55.084 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:55.084 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.070+0000 7faab9990640 10 monclient: shutdown 2026-02-17T11:14:55.085 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.070+0000 7faab9990640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:14:55.085 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.070+0000 7faab9990640 1 -- 10.20.193.49:0/2428188858 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7faab40c48c0 msgr2=0x7faab40749b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:55.085 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.070+0000 7faab9990640 1 --2- 10.20.193.49:0/2428188858 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7faab40c48c0 0x7faab40749b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7faab40723c0 tx=0x7faa9c02ede0 comp rx=0 tx=0).stop 2026-02-17T11:14:55.085 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.070+0000 7faab9990640 1 -- 10.20.193.49:0/2428188858 shutdown_connections 2026-02-17T11:14:55.085 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.070+0000 7faab9990640 1 --2- 10.20.193.49:0/2428188858 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7faab40c48c0 0x7faab40749b0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:55.085 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.070+0000 7faab9990640 1 --2- 10.20.193.49:0/2428188858 >> v2:10.20.193.157:3300/0 conn(0x7faab40c7170 0x7faab40c7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:55.085 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.070+0000 7faab9990640 1 -- 10.20.193.49:0/2428188858 >> 10.20.193.49:0/2428188858 conn(0x7faab40c9f40 msgr2=0x7faab40ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:14:55.085 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.070+0000 7faab9990640 1 -- 10.20.193.49:0/2428188858 shutdown_connections 2026-02-17T11:14:55.085 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.070+0000 7faab9990640 1 -- 10.20.193.49:0/2428188858 wait complete. 2026-02-17T11:14:55.085 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.071+0000 7faab9990640 10 monclient: build_initial_monmap 2026-02-17T11:14:55.085 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.071+0000 7faab9990640 10 monclient: monmap: 2026-02-17T11:14:55.085 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:14:55.086 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:14:55.086 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:14:55.086 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:14:55.086 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:14:55.086 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:55.086 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:14:55.086 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:14:55.086 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:14:55.086 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:55.086 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.071+0000 7faab9990640 1 librados: starting msgr at 2026-02-17T11:14:55.086 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.071+0000 7faab9990640 1 librados: starting objecter 2026-02-17T11:14:55.086 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.071+0000 7faab9990640 1 Processor -- start 2026-02-17T11:14:55.086 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.071+0000 7faab9990640 1 -- start start 2026-02-17T11:14:55.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.071+0000 7faab9990640 1 librados: setting wanted keys 2026-02-17T11:14:55.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.071+0000 7faab9990640 1 librados: calling monclient init 2026-02-17T11:14:55.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.071+0000 7faab9990640 10 monclient: init 2026-02-17T11:14:55.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.071+0000 7faab9990640 10 monclient: _reopen_session rank -1 2026-02-17T11:14:55.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.071+0000 7faab9990640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:14:55.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.071+0000 7faab9990640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7faab4074ef0 0x7faab40c2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:55.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.071+0000 7faab9990640 10 monclient(hunting): picked mon.noname-a con 0x7faab4074ef0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:14:55.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.071+0000 7faab9990640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7faab40c48c0 0x7faab40c3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:55.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.071+0000 7faab9990640 10 monclient(hunting): picked mon.noname-b con 0x7faab40c48c0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:14:55.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.071+0000 7faab9990640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7faab40c7170 0x7faab40bfcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:55.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.071+0000 7faab9990640 10 monclient(hunting): picked mon.noname-c con 0x7faab40c7170 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:14:55.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.071+0000 7faab9990640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:55.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.071+0000 7faab9990640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7faab40c81c0 con 0x7faab4074ef0 2026-02-17T11:14:55.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.071+0000 7faab9990640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:55.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.071+0000 7faab9990640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7faab40c7ee0 con 0x7faab40c48c0 2026-02-17T11:14:55.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.071+0000 7faab9990640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:55.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.071+0000 7faab9990640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7faab40c90d0 con 0x7faab40c7170 2026-02-17T11:14:55.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.071+0000 7faab9990640 10 monclient(hunting): _renew_subs 2026-02-17T11:14:55.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.071+0000 7faab9990640 10 monclient(hunting): authenticate will time out at 1371.734954s 2026-02-17T11:14:55.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.072+0000 7faab27fc640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7faab40c48c0 0x7faab40c3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:55.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.072+0000 7faab2ffd640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7faab4074ef0 0x7faab40c2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:55.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.072+0000 7faab27fc640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7faab40c48c0 0x7faab40c3270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:42716/0 (socket says 10.20.193.49:42716) 2026-02-17T11:14:55.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.072+0000 7faab27fc640 1 -- 10.20.193.49:0/2384227680 learned_addr learned my addr 10.20.193.49:0/2384227680 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:14:55.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.072+0000 7faab2ffd640 10 monclient(hunting): get_auth_request con 0x7faab4074ef0 auth_method 0 2026-02-17T11:14:55.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.072+0000 7faab2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:55.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.072+0000 7faab2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:55.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.072+0000 7faab2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:55.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.072+0000 7faab27fc640 10 monclient(hunting): get_auth_request con 0x7faab40c48c0 auth_method 0 2026-02-17T11:14:55.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.072+0000 7faab27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:55.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.072+0000 7faab27fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:55.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.072+0000 7faab27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:55.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.072+0000 7faab37fe640 1 --2- 10.20.193.49:0/2384227680 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7faab40c7170 0x7faab40bfcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:55.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.072+0000 7faab2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:55.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.072+0000 7faab2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:55.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.072+0000 7faab2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:55.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.072+0000 7faab27fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:55.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.072+0000 7faab27fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:55.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.072+0000 7faab27fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:55.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.072+0000 7faab37fe640 10 monclient(hunting): get_auth_request con 0x7faab40c7170 auth_method 0 2026-02-17T11:14:55.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.072+0000 7faab37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:55.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.072+0000 7faab37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:55.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.072+0000 7faab37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:55.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.073+0000 7faab37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:55.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.073+0000 7faab37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:55.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.073+0000 7faab37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:55.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.074+0000 7faab2ffd640 10 monclient(hunting): handle_auth_done global_id 5064 payload 824 2026-02-17T11:14:55.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.074+0000 7faab2ffd640 1 -- 10.20.193.49:0/2384227680 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7faab40c7170 msgr2=0x7faab40bfcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:55.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.074+0000 7faab2ffd640 1 --2- 10.20.193.49:0/2384227680 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7faab40c7170 0x7faab40bfcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:55.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.074+0000 7faab2ffd640 1 -- 10.20.193.49:0/2384227680 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7faab40c48c0 msgr2=0x7faab40c3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:55.091 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.074+0000 7faab2ffd640 1 --2- 10.20.193.49:0/2384227680 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7faab40c48c0 0x7faab40c3270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:55.091 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.074+0000 7faab2ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:14:55.091 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.074+0000 7faab2ffd640 1 monclient: found mon.noname-a 2026-02-17T11:14:55.091 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.074+0000 7faab2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:14:55.091 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.074+0000 7faab2ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:14:55.091 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.074+0000 7faab2ffd640 1 -- 10.20.193.49:0/2384227680 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faab41f3790 con 0x7faab4074ef0 2026-02-17T11:14:55.091 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.074+0000 7faab27fc640 1 --2- 10.20.193.49:0/2384227680 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7faab40c48c0 0x7faab40c3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:14:55.091 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.075+0000 7faab2ffd640 1 --2- 10.20.193.49:0/2384227680 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7faab4074ef0 0x7faab40c2d30 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7faaa800e870 tx=0x7faaa800ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:14:55.091 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.075+0000 7faa8bfff640 10 client.?.objecter ms_handle_connect 0x7faab4074ef0 2026-02-17T11:14:55.091 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.075+0000 7faa8bfff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:14:55.091 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.076+0000 7faa8bfff640 1 -- 10.20.193.49:0/2384227680 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa8017070 con 0x7faab4074ef0 2026-02-17T11:14:55.091 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.076+0000 7faa8bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:55.091 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.076+0000 7faa8bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:14:55.092 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.076+0000 7faa8bfff640 10 monclient: dump: 2026-02-17T11:14:55.092 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:55.092 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:55.092 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:55.092 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:55.092 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:55.092 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:55.092 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:55.092 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:55.092 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:55.092 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:55.092 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.076+0000 7faa8bfff640 10 monclient: _finish_auth 0 2026-02-17T11:14:55.093 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.076+0000 7faa8bfff640 10 monclient: _check_auth_tickets 2026-02-17T11:14:55.093 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.076+0000 7faa8bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:14:55.093 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.076+0000 7faa8bfff640 1 -- 10.20.193.49:0/2384227680 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faaa800c940 con 0x7faab4074ef0 2026-02-17T11:14:55.093 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.076+0000 7faa8bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:14:55.093 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.076+0000 7faa8bfff640 1 -- 10.20.193.49:0/2384227680 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa800cd10 con 0x7faab4074ef0 2026-02-17T11:14:55.093 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.076+0000 7faab9990640 5 monclient: authenticate success, global_id 5064 2026-02-17T11:14:55.093 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.076+0000 7faa8bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:55.093 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.076+0000 7faab17fa640 4 set_mon_vals no callback set 2026-02-17T11:14:55.093 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.076+0000 7faa8bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:14:55.093 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.076+0000 7faa8bfff640 10 monclient: dump: 2026-02-17T11:14:55.093 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:55.093 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:55.093 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:55.094 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:55.094 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:55.094 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:55.094 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:55.094 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:55.094 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:55.094 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:55.094 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.076+0000 7faab9990640 10 monclient: _renew_subs 2026-02-17T11:14:55.094 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.076+0000 7faab9990640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:14:55.094 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.076+0000 7faab9990640 1 -- 10.20.193.49:0/2384227680 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faab41f3a70 con 0x7faab4074ef0 2026-02-17T11:14:55.094 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.076+0000 7faab9990640 10 client.5064.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:14:55.094 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.076+0000 7faab9990640 10 monclient: _renew_subs 2026-02-17T11:14:55.095 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.076+0000 7faab9990640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:14:55.095 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.077+0000 7faab9990640 1 -- 10.20.193.49:0/2384227680 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faab41f4030 con 0x7faab4074ef0 2026-02-17T11:14:55.095 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.077+0000 7faab9990640 1 librados: init done 2026-02-17T11:14:55.095 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.077+0000 7faab9990640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:14:55.095 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.077+0000 7faab9990640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:14:55.095 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.077+0000 7faab9990640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:14:55.095 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.077+0000 7faab9990640 1 -- 10.20.193.49:0/2384227680 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faab40c4d10 con 0x7faab4074ef0 2026-02-17T11:14:55.096 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.088+0000 7faa8bfff640 1 -- 10.20.193.49:0/2384227680 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7faaa8013470 con 0x7faab4074ef0 2026-02-17T11:14:55.096 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.088+0000 7faa8bfff640 1 --2- 10.20.193.49:0/2384227680 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7faa84079190 0x7faa8407b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:55.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.089+0000 7faab27fc640 1 --2- 10.20.193.49:0/2384227680 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7faa84079190 0x7faa8407b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:55.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.089+0000 7faab27fc640 10 monclient: get_auth_request con 0x7faa84079190 auth_method 0 2026-02-17T11:14:55.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.089+0000 7faab27fc640 1 --2- 10.20.193.49:0/2384227680 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7faa84079190 0x7faa8407b650 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7faa9c02ee20 tx=0x7faa9c033000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:14:55.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.089+0000 7faa8bfff640 10 client.5064.objecter ms_handle_connect 0x7faa84079190 2026-02-17T11:14:55.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.090+0000 7faa8bfff640 1 -- 10.20.193.49:0/2384227680 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7faaa805e4a0 con 0x7faab4074ef0 2026-02-17T11:14:55.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.090+0000 7faa8bfff640 10 client.5064.objecter ms_dispatch2 0x7faab4000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:14:55.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.090+0000 7faa8bfff640 3 client.5064.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:14:55.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.090+0000 7faa8bfff640 3 client.5064.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:14:55.097 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.090+0000 7faa8bfff640 20 client.5064.objecter dump_active .. 0 homeless 2026-02-17T11:14:55.191 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.190+0000 7faa8bfff640 1 -- 10.20.193.49:0/2384227680 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7faaa8062460 con 0x7faab4074ef0 2026-02-17T11:14:55.191 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.190+0000 7faa8bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:14:55.191 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.190+0000 7faa8bfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:14:55.291 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.289+0000 7faab9990640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:14:55.292 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.289+0000 7faab9990640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:14:55.292 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.289+0000 7faab9990640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:14:55.292 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.289+0000 7faab9990640 1 -- 10.20.193.49:0/2384227680 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7faab41590f0 con 0x7faab4074ef0 2026-02-17T11:14:55.294 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.292+0000 7faa8bfff640 1 -- 10.20.193.49:0/2384227680 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7faaa8066760 con 0x7faab4074ef0 2026-02-17T11:14:55.294 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.292+0000 7faa8bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:14:55.294 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.292+0000 7faa8bfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:14:55.295 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:14:55.295 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:14:55.297 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.294+0000 7faab9990640 10 librados: watch_flush enter 2026-02-17T11:14:55.297 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.294+0000 7faab9990640 10 librados: watch_flush exit 2026-02-17T11:14:55.297 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.294+0000 7faab9990640 20 client.5064.objecter shutdown clearing up homeless session... 2026-02-17T11:14:55.297 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.294+0000 7faab9990640 10 client.5064.objecter successfully canceled tick 2026-02-17T11:14:55.297 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.294+0000 7faab9990640 1 -- 10.20.193.49:0/2384227680 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7faa84079190 msgr2=0x7faa8407b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:55.297 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.294+0000 7faab9990640 1 --2- 10.20.193.49:0/2384227680 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7faa84079190 0x7faa8407b650 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7faa9c02ee20 tx=0x7faa9c033000 comp rx=0 tx=0).stop 2026-02-17T11:14:55.297 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.294+0000 7faab9990640 10 monclient: shutdown 2026-02-17T11:14:55.297 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.294+0000 7faab9990640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:14:55.297 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.294+0000 7faab9990640 1 -- 10.20.193.49:0/2384227680 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7faab4074ef0 msgr2=0x7faab40c2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:55.297 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.294+0000 7faab9990640 1 --2- 10.20.193.49:0/2384227680 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7faab4074ef0 0x7faab40c2d30 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7faaa800e870 tx=0x7faaa800ed40 comp rx=0 tx=0).stop 2026-02-17T11:14:55.298 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.294+0000 7faab9990640 1 -- 10.20.193.49:0/2384227680 shutdown_connections 2026-02-17T11:14:55.298 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.294+0000 7faab9990640 1 --2- 10.20.193.49:0/2384227680 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7faa84079190 0x7faa8407b650 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:55.298 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.294+0000 7faab9990640 1 --2- 10.20.193.49:0/2384227680 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7faab40c7170 0x7faab40bfcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:55.298 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.294+0000 7faab9990640 1 --2- 10.20.193.49:0/2384227680 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7faab40c48c0 0x7faab40c3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:55.298 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.294+0000 7faab9990640 1 --2- 10.20.193.49:0/2384227680 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7faab4074ef0 0x7faab40c2d30 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:55.298 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.294+0000 7faab9990640 1 -- 10.20.193.49:0/2384227680 >> 10.20.193.49:0/2384227680 conn(0x7faab40c9f40 msgr2=0x7faab40ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:14:55.298 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.294+0000 7faab9990640 1 -- 10.20.193.49:0/2384227680 shutdown_connections 2026-02-17T11:14:55.298 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.294+0000 7faab9990640 1 -- 10.20.193.49:0/2384227680 wait complete. 2026-02-17T11:14:55.298 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:55.294+0000 7faab9990640 1 librados: shutdown 2026-02-17T11:14:58.305 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:14:58.371 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.369+0000 7f0d2e7a0640 10 monclient: get_monmap_and_config 2026-02-17T11:14:58.371 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.369+0000 7f0d2e7a0640 10 monclient: build_initial_monmap 2026-02-17T11:14:58.371 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.369+0000 7f0d2e7a0640 10 monclient: monmap: 2026-02-17T11:14:58.371 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:14:58.371 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:58.371 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:14:58.370215+0000 2026-02-17T11:14:58.371 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:14:58.370215+0000 2026-02-17T11:14:58.371 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:14:58.371 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:58.371 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:14:58.371 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:14:58.371 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:14:58.371 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:14:58.371 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:14:58.371 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:14:58.371 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:58.372 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.370+0000 7f0d2e7a0640 1 Processor -- start 2026-02-17T11:14:58.372 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.370+0000 7f0d2e7a0640 1 -- start start 2026-02-17T11:14:58.372 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.370+0000 7f0d2e7a0640 10 monclient: init 2026-02-17T11:14:58.372 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.370+0000 7f0d2e7a0640 10 monclient: _reopen_session rank -1 2026-02-17T11:14:58.372 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.370+0000 7f0d2e7a0640 10 monclient: _add_conns ranks=[3,1,4,0,2,5] 2026-02-17T11:14:58.372 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.370+0000 7f0d2e7a0640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f0d2815d370 0x7f0d2815d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:58.372 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.370+0000 7f0d2e7a0640 10 monclient(hunting): picked mon.noname-a con 0x7f0d2815d370 addr v2:10.20.193.49:3300/0 2026-02-17T11:14:58.372 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.370+0000 7f0d2e7a0640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f0d280c7e20 addr v1:10.20.193.97:6789/0 2026-02-17T11:14:58.372 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.370+0000 7f0d2e7a0640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f0d280c74c0 0x7f0d280c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:58.372 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.370+0000 7f0d2e7a0640 10 monclient(hunting): picked mon.noname-b con 0x7f0d280c74c0 addr v2:10.20.193.97:3300/0 2026-02-17T11:14:58.372 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.370+0000 7f0d2e7a0640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d280c8350 con 0x7f0d280c7e20 2026-02-17T11:14:58.372 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.370+0000 7f0d2e7a0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:58.372 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.370+0000 7f0d2e7a0640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f0d2815b710 con 0x7f0d2815d370 2026-02-17T11:14:58.372 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.370+0000 7f0d2e7a0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:58.372 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.370+0000 7f0d2e7a0640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f0d280c9240 con 0x7f0d280c74c0 2026-02-17T11:14:58.372 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.370+0000 7f0d2e7a0640 10 monclient(hunting): _renew_subs 2026-02-17T11:14:58.372 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.370+0000 7f0d2e7a0640 10 monclient(hunting): authenticate will time out at 1375.033754s 2026-02-17T11:14:58.372 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.371+0000 7f0d27fff640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f0d2815d370 0x7f0d2815d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:58.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.371+0000 7f0d27fff640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f0d2815d370 0x7f0d2815d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:35496/0 (socket says 10.20.193.49:35496) 2026-02-17T11:14:58.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.371+0000 7f0d27fff640 1 -- 10.20.193.49:0/4158045487 learned_addr learned my addr 10.20.193.49:0/4158045487 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:14:58.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.371+0000 7f0d27fff640 10 monclient(hunting): get_auth_request con 0x7f0d2815d370 auth_method 0 2026-02-17T11:14:58.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.371+0000 7f0d27fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:58.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.371+0000 7f0d27fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:58.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.371+0000 7f0d27fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:58.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.371+0000 7f0d27fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:58.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.371+0000 7f0d27fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:58.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.371+0000 7f0d27fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:58.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.372+0000 7f0d27fff640 10 monclient(hunting): handle_auth_done global_id 5067 payload 274 2026-02-17T11:14:58.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.372+0000 7f0d27fff640 1 -- 10.20.193.49:0/4158045487 >> v2:10.20.193.97:3300/0 conn(0x7f0d280c74c0 msgr2=0x7f0d280c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:14:58.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.372+0000 7f0d27fff640 1 --2- 10.20.193.49:0/4158045487 >> v2:10.20.193.97:3300/0 conn(0x7f0d280c74c0 0x7f0d280c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:58.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.372+0000 7f0d27fff640 1 -- 10.20.193.49:0/4158045487 >> v1:10.20.193.97:6789/0 conn(0x7f0d280c7e20 legacy=0x7f0d2815b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:14:58.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.372+0000 7f0d27fff640 10 monclient: _finish_hunting 0 2026-02-17T11:14:58.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.372+0000 7f0d27fff640 1 monclient: found mon.noname-a 2026-02-17T11:14:58.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.372+0000 7f0d27fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:14:58.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.372+0000 7f0d27fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:14:58.374 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.372+0000 7f0d27fff640 1 -- 10.20.193.49:0/4158045487 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d280c8630 con 0x7f0d2815d370 2026-02-17T11:14:58.374 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.373+0000 7f0d27fff640 1 --2- 10.20.193.49:0/4158045487 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0d2815d370 0x7f0d2815d750 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0d2815dcf0 tx=0x7f0d1402eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=395fc234960fbed3 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:14:58.376 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.375+0000 7f0d26ffd640 1 -- 10.20.193.49:0/4158045487 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d1403c070 con 0x7f0d2815d370 2026-02-17T11:14:58.376 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.375+0000 7f0d26ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:58.376 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.375+0000 7f0d26ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:14:58.376 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.375+0000 7f0d26ffd640 10 monclient: dump: 2026-02-17T11:14:58.376 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:58.376 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:58.376 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:58.377 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:58.377 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:58.377 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:58.377 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:58.377 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:58.377 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:58.377 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:58.377 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.375+0000 7f0d26ffd640 10 monclient: _finish_auth 0 2026-02-17T11:14:58.377 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.375+0000 7f0d26ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:14:58.377 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.375+0000 7f0d26ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:14:58.377 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.375+0000 7f0d26ffd640 1 -- 10.20.193.49:0/4158045487 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d1402fb40 con 0x7f0d2815d370 2026-02-17T11:14:58.377 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.375+0000 7f0d2e7a0640 5 monclient: authenticate success, global_id 5067 2026-02-17T11:14:58.377 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.375+0000 7f0d2e7a0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:14:58.377 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.375+0000 7f0d26ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:14:58.377 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.375+0000 7f0d26ffd640 1 -- 10.20.193.49:0/4158045487 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d14037440 con 0x7f0d2815d370 2026-02-17T11:14:58.377 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.375+0000 7f0d26ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:58.377 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.375+0000 7f0d26ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:14:58.377 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.375+0000 7f0d26ffd640 10 monclient: dump: 2026-02-17T11:14:58.377 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:58.377 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:58.377 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:58.377 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:58.377 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:58.377 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:58.377 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:58.377 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:58.377 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:58.377 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:58.377 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.375+0000 7f0d2e7a0640 10 monclient: get_monmap_and_config success 2026-02-17T11:14:58.377 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.375+0000 7f0d2e7a0640 4 set_mon_vals no callback set 2026-02-17T11:14:58.377 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.375+0000 7f0d2e7a0640 10 monclient: shutdown 2026-02-17T11:14:58.378 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.375+0000 7f0d2e7a0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:14:58.378 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.375+0000 7f0d2e7a0640 1 -- 10.20.193.49:0/4158045487 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0d2815d370 msgr2=0x7f0d2815d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:58.378 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.375+0000 7f0d2e7a0640 1 --2- 10.20.193.49:0/4158045487 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0d2815d370 0x7f0d2815d750 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0d2815dcf0 tx=0x7f0d1402eed0 comp rx=0 tx=0).stop 2026-02-17T11:14:58.378 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.375+0000 7f0d2e7a0640 1 -- 10.20.193.49:0/4158045487 shutdown_connections 2026-02-17T11:14:58.378 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.375+0000 7f0d2e7a0640 1 --2- 10.20.193.49:0/4158045487 >> v2:10.20.193.97:3300/0 conn(0x7f0d280c74c0 0x7f0d280c52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:58.378 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.375+0000 7f0d2e7a0640 1 --2- 10.20.193.49:0/4158045487 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0d2815d370 0x7f0d2815d750 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:58.378 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.375+0000 7f0d2e7a0640 1 -- 10.20.193.49:0/4158045487 >> 10.20.193.49:0/4158045487 conn(0x7f0d280c9f20 msgr2=0x7f0d280ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:14:58.378 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.375+0000 7f0d2e7a0640 1 -- 10.20.193.49:0/4158045487 shutdown_connections 2026-02-17T11:14:58.378 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.375+0000 7f0d2e7a0640 1 -- 10.20.193.49:0/4158045487 wait complete. 2026-02-17T11:14:58.379 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.376+0000 7f0d2e7a0640 10 monclient: build_initial_monmap 2026-02-17T11:14:58.379 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.376+0000 7f0d2e7a0640 10 monclient: monmap: 2026-02-17T11:14:58.379 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:14:58.379 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:14:58.379 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:14:58.379 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:14:58.379 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:14:58.379 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:58.379 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:14:58.379 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:14:58.379 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:14:58.379 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:58.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.376+0000 7f0d2e7a0640 1 librados: starting msgr at 2026-02-17T11:14:58.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.376+0000 7f0d2e7a0640 1 librados: starting objecter 2026-02-17T11:14:58.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.376+0000 7f0d2e7a0640 1 Processor -- start 2026-02-17T11:14:58.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.376+0000 7f0d2e7a0640 1 -- start start 2026-02-17T11:14:58.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.376+0000 7f0d2e7a0640 1 librados: setting wanted keys 2026-02-17T11:14:58.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.376+0000 7f0d2e7a0640 1 librados: calling monclient init 2026-02-17T11:14:58.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.376+0000 7f0d2e7a0640 10 monclient: init 2026-02-17T11:14:58.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.376+0000 7f0d2e7a0640 10 monclient: _reopen_session rank -1 2026-02-17T11:14:58.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.376+0000 7f0d2e7a0640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:14:58.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.376+0000 7f0d2e7a0640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f0d280c74c0 0x7f0d280cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:58.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.376+0000 7f0d2e7a0640 10 monclient(hunting): picked mon.noname-b con 0x7f0d280c74c0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:14:58.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.376+0000 7f0d2e7a0640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f0d280c7e20 0x7f0d280cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:58.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.376+0000 7f0d2e7a0640 10 monclient(hunting): picked mon.noname-c con 0x7f0d280c7e20 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:14:58.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.376+0000 7f0d2e7a0640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0d2815d370 0x7f0d2814c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:58.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.376+0000 7f0d2e7a0640 10 monclient(hunting): picked mon.noname-a con 0x7f0d2815d370 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:14:58.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.376+0000 7f0d2e7a0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:58.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.376+0000 7f0d2e7a0640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0d280c8ed0 con 0x7f0d2815d370 2026-02-17T11:14:58.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.376+0000 7f0d2e7a0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:58.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.376+0000 7f0d2e7a0640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f0d280c8bf0 con 0x7f0d280c74c0 2026-02-17T11:14:58.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.376+0000 7f0d2e7a0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:14:58.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.376+0000 7f0d2e7a0640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f0d280c96d0 con 0x7f0d280c7e20 2026-02-17T11:14:58.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.376+0000 7f0d2e7a0640 10 monclient(hunting): _renew_subs 2026-02-17T11:14:58.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.376+0000 7f0d2e7a0640 10 monclient(hunting): authenticate will time out at 1375.039785s 2026-02-17T11:14:58.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.377+0000 7f0d27fff640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f0d280c74c0 0x7f0d280cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:58.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.377+0000 7f0d27fff640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f0d280c74c0 0x7f0d280cb7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:53522/0 (socket says 10.20.193.49:53522) 2026-02-17T11:14:58.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.377+0000 7f0d27fff640 1 -- 10.20.193.49:0/1610442963 learned_addr learned my addr 10.20.193.49:0/1610442963 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:14:58.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.377+0000 7f0d27fff640 10 monclient(hunting): get_auth_request con 0x7f0d280c74c0 auth_method 0 2026-02-17T11:14:58.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.377+0000 7f0d27fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:58.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.377+0000 7f0d27fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:58.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.377+0000 7f0d27fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:58.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.377+0000 7f0d277fe640 1 --2- 10.20.193.49:0/1610442963 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f0d280c7e20 0x7f0d280cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:58.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.377+0000 7f0d27fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:58.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.377+0000 7f0d27fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:58.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.377+0000 7f0d27fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:58.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.377+0000 7f0d277fe640 10 monclient(hunting): get_auth_request con 0x7f0d280c7e20 auth_method 0 2026-02-17T11:14:58.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.377+0000 7f0d277fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:14:58.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.377+0000 7f0d277fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:14:58.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.377+0000 7f0d277fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:14:58.381 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.377+0000 7f0d277fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:14:58.381 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.377+0000 7f0d277fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:14:58.381 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.377+0000 7f0d277fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:14:58.381 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.378+0000 7f0d27fff640 10 monclient(hunting): handle_auth_done global_id 5044 payload 824 2026-02-17T11:14:58.381 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.378+0000 7f0d27fff640 1 -- 10.20.193.49:0/1610442963 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f0d280c7e20 msgr2=0x7f0d280cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:58.381 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.378+0000 7f0d27fff640 1 --2- 10.20.193.49:0/1610442963 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f0d280c7e20 0x7f0d280cbd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:58.381 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.378+0000 7f0d27fff640 1 -- 10.20.193.49:0/1610442963 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0d2815d370 msgr2=0x7f0d2814c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:58.381 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.378+0000 7f0d27fff640 1 --2- 10.20.193.49:0/1610442963 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0d2815d370 0x7f0d2814c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:58.381 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.378+0000 7f0d27fff640 10 monclient: _finish_hunting 0 2026-02-17T11:14:58.381 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.378+0000 7f0d27fff640 1 monclient: found mon.noname-b 2026-02-17T11:14:58.381 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.378+0000 7f0d27fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:14:58.381 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.378+0000 7f0d27fff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:14:58.381 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.378+0000 7f0d27fff640 1 -- 10.20.193.49:0/1610442963 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d280cc3e0 con 0x7f0d280c74c0 2026-02-17T11:14:58.381 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.380+0000 7f0d27fff640 1 --2- 10.20.193.49:0/1610442963 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f0d280c74c0 0x7f0d280cb7d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0d14009a70 tx=0x7f0d140047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:14:58.381 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.380+0000 7f0d24ff9640 10 client.?.objecter ms_handle_connect 0x7f0d280c74c0 2026-02-17T11:14:58.381 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.380+0000 7f0d24ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T11:14:58.384 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.381+0000 7f0d24ff9640 1 -- 10.20.193.49:0/1610442963 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d14044070 con 0x7f0d280c74c0 2026-02-17T11:14:58.384 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.381+0000 7f0d24ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:58.385 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.381+0000 7f0d24ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:14:58.385 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.381+0000 7f0d24ff9640 10 monclient: dump: 2026-02-17T11:14:58.385 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:58.385 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:58.385 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:58.385 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:58.385 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:58.385 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:58.385 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:58.386 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:58.386 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:58.386 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:58.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.381+0000 7f0d24ff9640 10 monclient: _finish_auth 0 2026-02-17T11:14:58.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.381+0000 7f0d24ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:14:58.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.381+0000 7f0d24ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:14:58.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.381+0000 7f0d24ff9640 1 -- 10.20.193.49:0/1610442963 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d14040630 con 0x7f0d280c74c0 2026-02-17T11:14:58.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.381+0000 7f0d2e7a0640 5 monclient: authenticate success, global_id 5044 2026-02-17T11:14:58.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.381+0000 7f0d2e7a0640 10 monclient: _renew_subs 2026-02-17T11:14:58.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.381+0000 7f0d2e7a0640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:14:58.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.381+0000 7f0d2e7a0640 1 -- 10.20.193.49:0/1610442963 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d280cc6c0 con 0x7f0d280c74c0 2026-02-17T11:14:58.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.381+0000 7f0d24ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:14:58.387 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.381+0000 7f0d24ff9640 1 -- 10.20.193.49:0/1610442963 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d1403c040 con 0x7f0d280c74c0 2026-02-17T11:14:58.387 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.381+0000 7f0d24ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:14:58.387 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.381+0000 7f0d24ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:14:58.387 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.381+0000 7f0d24ff9640 10 monclient: dump: 2026-02-17T11:14:58.387 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:14:58.387 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:14:58.387 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:58.387 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:14:58.387 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:14:58.387 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:14:58.387 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:14:58.387 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:14:58.387 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:14:58.387 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:14:58.388 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.381+0000 7f0d267fc640 4 set_mon_vals no callback set 2026-02-17T11:14:58.388 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.381+0000 7f0d2e7a0640 10 client.5044.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:14:58.388 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.381+0000 7f0d2e7a0640 10 monclient: _renew_subs 2026-02-17T11:14:58.388 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.381+0000 7f0d2e7a0640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:14:58.388 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.381+0000 7f0d2e7a0640 1 -- 10.20.193.49:0/1610442963 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d280ccc80 con 0x7f0d280c74c0 2026-02-17T11:14:58.388 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.381+0000 7f0d2e7a0640 1 librados: init done 2026-02-17T11:14:58.388 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.382+0000 7f0d2e7a0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:14:58.388 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.382+0000 7f0d2e7a0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:14:58.388 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.382+0000 7f0d2e7a0640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:14:58.388 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.382+0000 7f0d2e7a0640 1 -- 10.20.193.49:0/1610442963 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d2815d750 con 0x7f0d280c74c0 2026-02-17T11:14:58.487 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.486+0000 7f0d24ff9640 1 -- 10.20.193.49:0/1610442963 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f0d1403f050 con 0x7f0d280c74c0 2026-02-17T11:14:58.488 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.486+0000 7f0d24ff9640 1 --2- 10.20.193.49:0/1610442963 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0cf8079140 0x7f0cf807b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:14:58.488 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.487+0000 7f0d277fe640 1 --2- 10.20.193.49:0/1610442963 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0cf8079140 0x7f0cf807b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:14:58.488 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.487+0000 7f0d277fe640 10 monclient: get_auth_request con 0x7f0cf8079140 auth_method 0 2026-02-17T11:14:58.489 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.487+0000 7f0d277fe640 1 --2- 10.20.193.49:0/1610442963 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0cf8079140 0x7f0cf807b600 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0d281f4930 tx=0x7f0d180091c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:14:58.489 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.487+0000 7f0d24ff9640 10 client.5044.objecter ms_handle_connect 0x7f0cf8079140 2026-02-17T11:14:58.489 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.488+0000 7f0d24ff9640 1 -- 10.20.193.49:0/1610442963 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f0d14083190 con 0x7f0d280c74c0 2026-02-17T11:14:58.490 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.488+0000 7f0d24ff9640 10 client.5044.objecter ms_dispatch2 0x7f0d28000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:14:58.490 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.488+0000 7f0d24ff9640 3 client.5044.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:14:58.490 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.488+0000 7f0d24ff9640 3 client.5044.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:14:58.490 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.488+0000 7f0d24ff9640 20 client.5044.objecter dump_active .. 0 homeless 2026-02-17T11:14:58.495 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.494+0000 7f0d24ff9640 1 -- 10.20.193.49:0/1610442963 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f0d14087150 con 0x7f0d280c74c0 2026-02-17T11:14:58.495 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.494+0000 7f0d24ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:14:58.495 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.494+0000 7f0d24ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:14:58.594 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.592+0000 7f0d2e7a0640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:14:58.594 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.592+0000 7f0d2e7a0640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:14:58.594 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.592+0000 7f0d2e7a0640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:14:58.594 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.592+0000 7f0d2e7a0640 1 -- 10.20.193.49:0/1610442963 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f0d28071130 con 0x7f0d280c74c0 2026-02-17T11:14:58.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.595+0000 7f0d24ff9640 1 -- 10.20.193.49:0/1610442963 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f0d1408b450 con 0x7f0d280c74c0 2026-02-17T11:14:58.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.595+0000 7f0d24ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:14:58.597 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.595+0000 7f0d24ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:14:58.597 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:14:58.597 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:14:58.599 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.596+0000 7f0d2e7a0640 10 librados: watch_flush enter 2026-02-17T11:14:58.599 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.596+0000 7f0d2e7a0640 10 librados: watch_flush exit 2026-02-17T11:14:58.599 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.596+0000 7f0d2e7a0640 20 client.5044.objecter shutdown clearing up homeless session... 2026-02-17T11:14:58.599 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.596+0000 7f0d2e7a0640 10 client.5044.objecter successfully canceled tick 2026-02-17T11:14:58.599 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.596+0000 7f0d2e7a0640 1 -- 10.20.193.49:0/1610442963 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0cf8079140 msgr2=0x7f0cf807b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:58.599 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.596+0000 7f0d2e7a0640 1 --2- 10.20.193.49:0/1610442963 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0cf8079140 0x7f0cf807b600 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0d281f4930 tx=0x7f0d180091c0 comp rx=0 tx=0).stop 2026-02-17T11:14:58.599 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.596+0000 7f0d2e7a0640 10 monclient: shutdown 2026-02-17T11:14:58.599 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.596+0000 7f0d2e7a0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:14:58.600 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.596+0000 7f0d2e7a0640 1 -- 10.20.193.49:0/1610442963 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f0d280c74c0 msgr2=0x7f0d280cb7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:14:58.600 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.596+0000 7f0d2e7a0640 1 --2- 10.20.193.49:0/1610442963 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f0d280c74c0 0x7f0d280cb7d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0d14009a70 tx=0x7f0d140047c0 comp rx=0 tx=0).stop 2026-02-17T11:14:58.600 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.596+0000 7f0d2e7a0640 1 -- 10.20.193.49:0/1610442963 shutdown_connections 2026-02-17T11:14:58.600 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.596+0000 7f0d2e7a0640 1 --2- 10.20.193.49:0/1610442963 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0cf8079140 0x7f0cf807b600 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:58.600 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.596+0000 7f0d2e7a0640 1 --2- 10.20.193.49:0/1610442963 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0d2815d370 0x7f0d2814c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:58.600 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.596+0000 7f0d2e7a0640 1 --2- 10.20.193.49:0/1610442963 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f0d280c7e20 0x7f0d280cbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:58.600 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.596+0000 7f0d2e7a0640 1 --2- 10.20.193.49:0/1610442963 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f0d280c74c0 0x7f0d280cb7d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:14:58.600 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.596+0000 7f0d2e7a0640 1 -- 10.20.193.49:0/1610442963 >> 10.20.193.49:0/1610442963 conn(0x7f0d280c9f20 msgr2=0x7f0d2815dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:14:58.600 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.597+0000 7f0d2e7a0640 1 -- 10.20.193.49:0/1610442963 shutdown_connections 2026-02-17T11:14:58.600 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.597+0000 7f0d2e7a0640 1 -- 10.20.193.49:0/1610442963 wait complete. 2026-02-17T11:14:58.600 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:14:58.597+0000 7f0d2e7a0640 1 librados: shutdown 2026-02-17T11:15:01.607 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:15:01.675 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.673+0000 7fb5800e8640 10 monclient: get_monmap_and_config 2026-02-17T11:15:01.675 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.673+0000 7fb5800e8640 10 monclient: build_initial_monmap 2026-02-17T11:15:01.675 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.673+0000 7fb5800e8640 10 monclient: monmap: 2026-02-17T11:15:01.676 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:01.676 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:01.676 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:15:01.673992+0000 2026-02-17T11:15:01.676 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:15:01.673992+0000 2026-02-17T11:15:01.676 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:01.676 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:01.676 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:15:01.676 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:15:01.676 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:15:01.676 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:15:01.676 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:15:01.676 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:15:01.677 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:01.677 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.673+0000 7fb5800e8640 1 Processor -- start 2026-02-17T11:15:01.677 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.674+0000 7fb5800e8640 1 -- start start 2026-02-17T11:15:01.677 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.674+0000 7fb5800e8640 10 monclient: init 2026-02-17T11:15:01.679 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.674+0000 7fb5800e8640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:01.679 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.674+0000 7fb5800e8640 10 monclient: _add_conns ranks=[1,4,2,3,0,5] 2026-02-17T11:15:01.679 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.674+0000 7fb5800e8640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fb578152680 addr v1:10.20.193.97:6789/0 2026-02-17T11:15:01.679 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.674+0000 7fb5800e8640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7fb578152a60 0x7fb5780c9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:01.679 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.674+0000 7fb5800e8640 10 monclient(hunting): picked mon.noname-b con 0x7fb578152a60 addr v2:10.20.193.97:3300/0 2026-02-17T11:15:01.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.674+0000 7fb5800e8640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fb578073720 addr v1:10.20.193.157:6789/0 2026-02-17T11:15:01.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.674+0000 7fb5800e8640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5780c8640 con 0x7fb578152680 2026-02-17T11:15:01.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.674+0000 7fb5800e8640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5780c88b0 con 0x7fb578073720 2026-02-17T11:15:01.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.674+0000 7fb5800e8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:01.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.674+0000 7fb5800e8640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7fb578076940 con 0x7fb578152a60 2026-02-17T11:15:01.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.674+0000 7fb5800e8640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:01.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.674+0000 7fb5800e8640 10 monclient(hunting): authenticate will time out at 1378.337565s 2026-02-17T11:15:01.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.674+0000 7fb57e65e640 1 --1- >> v1:10.20.193.157:6789/0 conn(0x7fb578073720 0x7fb57815f3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.157:6789/0 says I am v1:10.20.193.49:43414/0 (socket says 10.20.193.49:43414) 2026-02-17T11:15:01.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.674+0000 7fb57e65e640 1 -- 10.20.193.49:0/1093149177 learned_addr learned my addr 10.20.193.49:0/1093149177 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:15:01.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.674+0000 7fb57d65c640 1 --2- 10.20.193.49:0/1093149177 >> v2:10.20.193.97:3300/0 conn(0x7fb578152a60 0x7fb5780c9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:01.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.675+0000 7fb57d65c640 10 monclient(hunting): get_auth_request con 0x7fb578152a60 auth_method 0 2026-02-17T11:15:01.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.675+0000 7fb57d65c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:01.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.675+0000 7fb57d65c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:01.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.675+0000 7fb57d65c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:01.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.675+0000 7fb57d65c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:01.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.675+0000 7fb57d65c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:01.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.675+0000 7fb57d65c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:01.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.676+0000 7fb57ce5b640 1 -- 10.20.193.49:0/1093149177 <== mon.2 v1:10.20.193.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 615272407 0 0) 0x7fb5780c88b0 con 0x7fb578073720 2026-02-17T11:15:01.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.676+0000 7fb57ce5b640 10 monclient(hunting): _negotiate 2026-02-17T11:15:01.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.676+0000 7fb57ce5b640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:01.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.676+0000 7fb57ce5b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:01.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.676+0000 7fb57ce5b640 10 monclient(hunting): my global_id is 5087 2026-02-17T11:15:01.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.676+0000 7fb57ce5b640 1 -- 10.20.193.49:0/1093149177 --> v1:10.20.193.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb560003620 con 0x7fb578073720 2026-02-17T11:15:01.681 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.676+0000 7fb57d65c640 10 monclient(hunting): handle_auth_done global_id 5047 payload 274 2026-02-17T11:15:01.682 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.676+0000 7fb57d65c640 1 -- 10.20.193.49:0/1093149177 >> v1:10.20.193.157:6789/0 conn(0x7fb578073720 legacy=0x7fb57815f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:01.682 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.676+0000 7fb57d65c640 1 -- 10.20.193.49:0/1093149177 >> v1:10.20.193.97:6789/0 conn(0x7fb578152680 legacy=0x7fb578076230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:01.682 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.676+0000 7fb57d65c640 10 monclient: _finish_hunting 0 2026-02-17T11:15:01.682 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.676+0000 7fb57d65c640 1 monclient: found mon.noname-b 2026-02-17T11:15:01.682 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.676+0000 7fb57d65c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:01.682 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.676+0000 7fb57d65c640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:15:01.682 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.676+0000 7fb57d65c640 1 -- 10.20.193.49:0/1093149177 --> v2:10.20.193.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5780c8b90 con 0x7fb578152a60 2026-02-17T11:15:01.689 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.678+0000 7fb57d65c640 1 --2- 10.20.193.49:0/1093149177 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb578152a60 0x7fb5780c9950 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb56c0098a0 tx=0x7fb56c02ef00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5a3291ddf36b21e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:01.689 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.680+0000 7fb57ce5b640 1 -- 10.20.193.49:0/1093149177 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb56c03c070 con 0x7fb578152a60 2026-02-17T11:15:01.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.680+0000 7fb57ce5b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:01.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.680+0000 7fb57ce5b640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:15:01.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.680+0000 7fb57ce5b640 10 monclient: dump: 2026-02-17T11:15:01.690 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:01.690 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:01.690 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:01.690 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:01.690 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:01.690 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:01.690 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:01.690 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:01.691 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:01.691 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:01.691 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.680+0000 7fb57ce5b640 10 monclient: _finish_auth 0 2026-02-17T11:15:01.691 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.680+0000 7fb57ce5b640 10 monclient: _check_auth_tickets 2026-02-17T11:15:01.691 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.680+0000 7fb57ce5b640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:01.691 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.680+0000 7fb57ce5b640 1 -- 10.20.193.49:0/1093149177 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb56c02fc10 con 0x7fb578152a60 2026-02-17T11:15:01.691 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.680+0000 7fb5800e8640 5 monclient: authenticate success, global_id 5047 2026-02-17T11:15:01.691 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.680+0000 7fb5800e8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:15:01.691 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.680+0000 7fb57ce5b640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:01.691 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.680+0000 7fb57ce5b640 1 -- 10.20.193.49:0/1093149177 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb56c037440 con 0x7fb578152a60 2026-02-17T11:15:01.691 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.680+0000 7fb5800e8640 10 monclient: get_monmap_and_config success 2026-02-17T11:15:01.692 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.680+0000 7fb57ce5b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:01.692 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.680+0000 7fb5800e8640 4 set_mon_vals no callback set 2026-02-17T11:15:01.692 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.680+0000 7fb57ce5b640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:15:01.692 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.680+0000 7fb57ce5b640 10 monclient: dump: 2026-02-17T11:15:01.692 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:01.692 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:01.692 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:01.692 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:01.692 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:01.692 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:01.692 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:01.692 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:01.692 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:01.693 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:01.693 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.680+0000 7fb5800e8640 10 monclient: shutdown 2026-02-17T11:15:01.693 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.680+0000 7fb5800e8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:01.693 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.680+0000 7fb5800e8640 1 -- 10.20.193.49:0/1093149177 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb578152a60 msgr2=0x7fb5780c9950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:01.693 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.680+0000 7fb5800e8640 1 --2- 10.20.193.49:0/1093149177 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb578152a60 0x7fb5780c9950 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb56c0098a0 tx=0x7fb56c02ef00 comp rx=0 tx=0).stop 2026-02-17T11:15:01.693 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.680+0000 7fb5800e8640 1 -- 10.20.193.49:0/1093149177 shutdown_connections 2026-02-17T11:15:01.693 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.680+0000 7fb5800e8640 1 --2- 10.20.193.49:0/1093149177 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb578152a60 0x7fb5780c9950 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:01.693 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.680+0000 7fb5800e8640 1 -- 10.20.193.49:0/1093149177 >> 10.20.193.49:0/1093149177 conn(0x7fb5780ca740 msgr2=0x7fb5780cab50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:01.693 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.680+0000 7fb5800e8640 1 -- 10.20.193.49:0/1093149177 shutdown_connections 2026-02-17T11:15:01.693 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.680+0000 7fb5800e8640 1 -- 10.20.193.49:0/1093149177 wait complete. 2026-02-17T11:15:01.693 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.681+0000 7fb5800e8640 10 monclient: build_initial_monmap 2026-02-17T11:15:01.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.681+0000 7fb5800e8640 10 monclient: monmap: 2026-02-17T11:15:01.694 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:01.694 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:15:01.694 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:15:01.694 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:15:01.694 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:01.694 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:01.694 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:15:01.694 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:15:01.694 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:15:01.694 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:01.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.681+0000 7fb5800e8640 1 librados: starting msgr at 2026-02-17T11:15:01.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.681+0000 7fb5800e8640 1 librados: starting objecter 2026-02-17T11:15:01.695 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.681+0000 7fb5800e8640 1 Processor -- start 2026-02-17T11:15:01.695 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.681+0000 7fb5800e8640 1 -- start start 2026-02-17T11:15:01.695 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.681+0000 7fb5800e8640 1 librados: setting wanted keys 2026-02-17T11:15:01.695 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.681+0000 7fb5800e8640 1 librados: calling monclient init 2026-02-17T11:15:01.695 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.681+0000 7fb5800e8640 10 monclient: init 2026-02-17T11:15:01.695 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.681+0000 7fb5800e8640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:01.695 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.681+0000 7fb5800e8640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:15:01.695 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.682+0000 7fb5800e8640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb578073720 0x7fb57806b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:01.695 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.682+0000 7fb5800e8640 10 monclient(hunting): picked mon.noname-c con 0x7fb578073720 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:15:01.695 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.682+0000 7fb5800e8640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb578152680 0x7fb5781f5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:01.695 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.682+0000 7fb5800e8640 10 monclient(hunting): picked mon.noname-a con 0x7fb578152680 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:15:01.696 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.682+0000 7fb5800e8640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb578152a60 0x7fb5781f60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:01.696 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.682+0000 7fb5800e8640 10 monclient(hunting): picked mon.noname-b con 0x7fb578152a60 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:15:01.696 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.682+0000 7fb5800e8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:01.696 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.682+0000 7fb5800e8640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb5780c9430 con 0x7fb578152680 2026-02-17T11:15:01.696 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.682+0000 7fb5800e8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:01.696 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.682+0000 7fb5800e8640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb5780c9150 con 0x7fb578152a60 2026-02-17T11:15:01.696 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.682+0000 7fb5800e8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:01.696 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.682+0000 7fb5800e8640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb57815d2c0 con 0x7fb578073720 2026-02-17T11:15:01.696 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.682+0000 7fb5800e8640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:01.696 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.682+0000 7fb5800e8640 10 monclient(hunting): authenticate will time out at 1378.345042s 2026-02-17T11:15:01.696 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.682+0000 7fb57e65e640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb578152a60 0x7fb5781f60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:01.696 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.682+0000 7fb57e65e640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb578152a60 0x7fb5781f60b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:53540/0 (socket says 10.20.193.49:53540) 2026-02-17T11:15:01.696 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.682+0000 7fb57e65e640 1 -- 10.20.193.49:0/2874868764 learned_addr learned my addr 10.20.193.49:0/2874868764 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:01.697 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.682+0000 7fb57e65e640 10 monclient(hunting): get_auth_request con 0x7fb578152a60 auth_method 0 2026-02-17T11:15:01.697 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.682+0000 7fb57e65e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:01.697 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.682+0000 7fb57e65e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:01.697 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.682+0000 7fb57e65e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:01.697 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.682+0000 7fb57d65c640 1 --2- 10.20.193.49:0/2874868764 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb578152680 0x7fb5781f5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:01.697 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.682+0000 7fb57de5d640 1 --2- 10.20.193.49:0/2874868764 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb578073720 0x7fb57806b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:01.697 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.682+0000 7fb57e65e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:01.697 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.682+0000 7fb57e65e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:01.697 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.682+0000 7fb57e65e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:01.697 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.682+0000 7fb57d65c640 10 monclient(hunting): get_auth_request con 0x7fb578152680 auth_method 0 2026-02-17T11:15:01.697 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.682+0000 7fb57d65c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:01.697 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.682+0000 7fb57d65c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:01.698 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.682+0000 7fb57d65c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:01.698 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.682+0000 7fb57de5d640 10 monclient(hunting): get_auth_request con 0x7fb578073720 auth_method 0 2026-02-17T11:15:01.698 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.682+0000 7fb57de5d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:01.698 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.682+0000 7fb57de5d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:01.698 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.682+0000 7fb57de5d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:01.698 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.683+0000 7fb57de5d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:01.698 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.683+0000 7fb57de5d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:01.698 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.683+0000 7fb57de5d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:01.698 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.683+0000 7fb57d65c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:01.698 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.683+0000 7fb57d65c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:01.698 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.683+0000 7fb57d65c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:01.698 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.683+0000 7fb57e65e640 10 monclient(hunting): handle_auth_done global_id 5050 payload 824 2026-02-17T11:15:01.699 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.684+0000 7fb57e65e640 1 -- 10.20.193.49:0/2874868764 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb578073720 msgr2=0x7fb57806b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:01.699 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.684+0000 7fb57e65e640 1 --2- 10.20.193.49:0/2874868764 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb578073720 0x7fb57806b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:01.699 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.684+0000 7fb57e65e640 1 -- 10.20.193.49:0/2874868764 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb578152680 msgr2=0x7fb5781f5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:01.699 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.684+0000 7fb57e65e640 1 --2- 10.20.193.49:0/2874868764 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb578152680 0x7fb5781f5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:01.699 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.684+0000 7fb57e65e640 10 monclient: _finish_hunting 0 2026-02-17T11:15:01.699 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.684+0000 7fb57e65e640 1 monclient: found mon.noname-b 2026-02-17T11:15:01.699 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.684+0000 7fb57e65e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:01.699 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.684+0000 7fb57e65e640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:15:01.699 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.684+0000 7fb57e65e640 1 -- 10.20.193.49:0/2874868764 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5780c76b0 con 0x7fb578152a60 2026-02-17T11:15:01.699 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.685+0000 7fb57e65e640 1 --2- 10.20.193.49:0/2874868764 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb578152a60 0x7fb5781f60b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb57400caa0 tx=0x7fb57400cf70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:01.699 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.685+0000 7fb5667fc640 10 client.?.objecter ms_handle_connect 0x7fb578152a60 2026-02-17T11:15:01.699 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.685+0000 7fb5667fc640 10 client.?.objecter resend_mon_ops 2026-02-17T11:15:01.700 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.685+0000 7fb5667fc640 1 -- 10.20.193.49:0/2874868764 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb57400ac40 con 0x7fb578152a60 2026-02-17T11:15:01.700 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.685+0000 7fb5667fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:01.700 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.685+0000 7fb5667fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:15:01.700 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.685+0000 7fb5667fc640 10 monclient: dump: 2026-02-17T11:15:01.700 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:01.700 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:01.700 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:01.700 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:01.700 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:01.700 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:01.700 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:01.700 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:01.700 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:01.701 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:01.701 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.685+0000 7fb5667fc640 10 monclient: _finish_auth 0 2026-02-17T11:15:01.701 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.685+0000 7fb5667fc640 10 monclient: _check_auth_tickets 2026-02-17T11:15:01.701 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.685+0000 7fb5667fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:01.701 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.685+0000 7fb5800e8640 5 monclient: authenticate success, global_id 5050 2026-02-17T11:15:01.701 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.685+0000 7fb5800e8640 10 monclient: _renew_subs 2026-02-17T11:15:01.701 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.685+0000 7fb5800e8640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:15:01.701 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.685+0000 7fb5800e8640 1 -- 10.20.193.49:0/2874868764 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5780c7990 con 0x7fb578152a60 2026-02-17T11:15:01.701 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.686+0000 7fb5800e8640 10 client.5050.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:01.701 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.686+0000 7fb5800e8640 10 monclient: _renew_subs 2026-02-17T11:15:01.701 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.686+0000 7fb5800e8640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:15:01.701 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.686+0000 7fb5800e8640 1 -- 10.20.193.49:0/2874868764 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5780c7f50 con 0x7fb578152a60 2026-02-17T11:15:01.702 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.686+0000 7fb5800e8640 1 librados: init done 2026-02-17T11:15:01.702 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.686+0000 7fb5800e8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:01.702 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.686+0000 7fb5800e8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:01.702 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.686+0000 7fb5800e8640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:15:01.702 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.686+0000 7fb5800e8640 1 -- 10.20.193.49:0/2874868764 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb578076c10 con 0x7fb578152a60 2026-02-17T11:15:01.702 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.686+0000 7fb5667fc640 1 -- 10.20.193.49:0/2874868764 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb57400ade0 con 0x7fb578152a60 2026-02-17T11:15:01.702 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.686+0000 7fb5667fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:01.702 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.686+0000 7fb5667fc640 1 -- 10.20.193.49:0/2874868764 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb574003370 con 0x7fb578152a60 2026-02-17T11:15:01.702 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.686+0000 7fb5667fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:01.702 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.686+0000 7fb5667fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:15:01.702 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.686+0000 7fb567fff640 4 set_mon_vals no callback set 2026-02-17T11:15:01.702 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.686+0000 7fb5667fc640 10 monclient: dump: 2026-02-17T11:15:01.703 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:01.703 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:01.703 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:01.703 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:01.703 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:01.703 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:01.703 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:01.703 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:01.703 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:01.703 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:01.793 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.792+0000 7fb5667fc640 1 -- 10.20.193.49:0/2874868764 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7fb5740256f0 con 0x7fb578152a60 2026-02-17T11:15:01.794 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.793+0000 7fb5667fc640 1 --2- 10.20.193.49:0/2874868764 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb548079140 0x7fb54807b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:01.794 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.793+0000 7fb57de5d640 1 --2- 10.20.193.49:0/2874868764 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb548079140 0x7fb54807b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:01.794 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.793+0000 7fb57de5d640 10 monclient: get_auth_request con 0x7fb548079140 auth_method 0 2026-02-17T11:15:01.794 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.793+0000 7fb57de5d640 1 --2- 10.20.193.49:0/2874868764 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb548079140 0x7fb54807b600 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb568002770 tx=0x7fb568007ef0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:01.795 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.793+0000 7fb5667fc640 10 client.5050.objecter ms_handle_connect 0x7fb548079140 2026-02-17T11:15:01.796 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.794+0000 7fb5667fc640 1 -- 10.20.193.49:0/2874868764 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7fb57405eb40 con 0x7fb578152a60 2026-02-17T11:15:01.796 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.794+0000 7fb5667fc640 10 client.5050.objecter ms_dispatch2 0x7fb578000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:15:01.796 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.794+0000 7fb5667fc640 3 client.5050.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:15:01.796 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.794+0000 7fb5667fc640 3 client.5050.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:15:01.796 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.795+0000 7fb5667fc640 20 client.5050.objecter dump_active .. 0 homeless 2026-02-17T11:15:01.802 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.801+0000 7fb5667fc640 1 -- 10.20.193.49:0/2874868764 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb574062b00 con 0x7fb578152a60 2026-02-17T11:15:01.802 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.801+0000 7fb5667fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:01.802 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.801+0000 7fb5667fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:15:01.902 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.900+0000 7fb5800e8640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:15:01.903 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.900+0000 7fb5800e8640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:15:01.903 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.900+0000 7fb5800e8640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:15:01.903 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.900+0000 7fb5800e8640 1 -- 10.20.193.49:0/2874868764 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb5780c8310 con 0x7fb578152a60 2026-02-17T11:15:01.904 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.903+0000 7fb5667fc640 1 -- 10.20.193.49:0/2874868764 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fb5780c8310 con 0x7fb578152a60 2026-02-17T11:15:01.904 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.903+0000 7fb5667fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:15:01.904 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.903+0000 7fb5667fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:15:01.905 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:15:01.905 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:15:01.907 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.904+0000 7fb5800e8640 10 librados: watch_flush enter 2026-02-17T11:15:01.907 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.904+0000 7fb5800e8640 10 librados: watch_flush exit 2026-02-17T11:15:01.907 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.904+0000 7fb5800e8640 20 client.5050.objecter shutdown clearing up homeless session... 2026-02-17T11:15:01.907 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.904+0000 7fb5800e8640 10 client.5050.objecter successfully canceled tick 2026-02-17T11:15:01.907 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.904+0000 7fb5800e8640 1 -- 10.20.193.49:0/2874868764 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb548079140 msgr2=0x7fb54807b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:01.907 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.904+0000 7fb5800e8640 1 --2- 10.20.193.49:0/2874868764 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb548079140 0x7fb54807b600 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb568002770 tx=0x7fb568007ef0 comp rx=0 tx=0).stop 2026-02-17T11:15:01.907 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.904+0000 7fb5800e8640 10 monclient: shutdown 2026-02-17T11:15:01.907 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.904+0000 7fb5800e8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:01.908 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.904+0000 7fb5800e8640 1 -- 10.20.193.49:0/2874868764 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb578152a60 msgr2=0x7fb5781f60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:01.908 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.904+0000 7fb5800e8640 1 --2- 10.20.193.49:0/2874868764 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb578152a60 0x7fb5781f60b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb57400caa0 tx=0x7fb57400cf70 comp rx=0 tx=0).stop 2026-02-17T11:15:01.908 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.904+0000 7fb5800e8640 1 -- 10.20.193.49:0/2874868764 shutdown_connections 2026-02-17T11:15:01.908 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.904+0000 7fb5800e8640 1 --2- 10.20.193.49:0/2874868764 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb548079140 0x7fb54807b600 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:01.908 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.904+0000 7fb5800e8640 1 --2- 10.20.193.49:0/2874868764 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb578152a60 0x7fb5781f60b0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:01.908 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.904+0000 7fb5800e8640 1 --2- 10.20.193.49:0/2874868764 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb578152680 0x7fb5781f5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:01.908 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.904+0000 7fb5800e8640 1 --2- 10.20.193.49:0/2874868764 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb578073720 0x7fb57806b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:01.908 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.904+0000 7fb5800e8640 1 -- 10.20.193.49:0/2874868764 >> 10.20.193.49:0/2874868764 conn(0x7fb5780ca740 msgr2=0x7fb5780cab20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:01.908 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.904+0000 7fb5800e8640 1 -- 10.20.193.49:0/2874868764 shutdown_connections 2026-02-17T11:15:01.908 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.904+0000 7fb5800e8640 1 -- 10.20.193.49:0/2874868764 wait complete. 2026-02-17T11:15:01.908 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:01.904+0000 7fb5800e8640 1 librados: shutdown 2026-02-17T11:15:04.915 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:15:04.985 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.979+0000 7f5e536b0640 10 monclient: get_monmap_and_config 2026-02-17T11:15:04.986 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.979+0000 7f5e536b0640 10 monclient: build_initial_monmap 2026-02-17T11:15:04.986 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.979+0000 7f5e536b0640 10 monclient: monmap: 2026-02-17T11:15:04.986 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:04.986 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:04.987 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:15:04.980860+0000 2026-02-17T11:15:04.987 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:15:04.980860+0000 2026-02-17T11:15:04.987 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:04.987 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:04.987 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:15:04.987 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:15:04.988 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:15:04.988 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:15:04.988 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:15:04.988 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:15:04.988 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:04.988 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.979+0000 7f5e536b0640 1 Processor -- start 2026-02-17T11:15:04.989 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.979+0000 7f5e536b0640 1 -- start start 2026-02-17T11:15:04.989 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.979+0000 7f5e536b0640 10 monclient: init 2026-02-17T11:15:04.989 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.980+0000 7f5e536b0640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:04.989 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.980+0000 7f5e536b0640 10 monclient: _add_conns ranks=[4,1,2,3,0,5] 2026-02-17T11:15:04.989 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.980+0000 7f5e536b0640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f5e4c152820 0x7f5e4c1593f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:04.989 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.980+0000 7f5e536b0640 10 monclient(hunting): picked mon.noname-b con 0x7f5e4c152820 addr v2:10.20.193.97:3300/0 2026-02-17T11:15:04.990 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.980+0000 7f5e536b0640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f5e4c152c00 addr v1:10.20.193.97:6789/0 2026-02-17T11:15:04.990 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.980+0000 7f5e536b0640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f5e4c0738f0 addr v1:10.20.193.157:6789/0 2026-02-17T11:15:04.990 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.980+0000 7f5e536b0640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e4c073e90 con 0x7f5e4c152c00 2026-02-17T11:15:04.990 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.980+0000 7f5e536b0640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e4c074170 con 0x7f5e4c0738f0 2026-02-17T11:15:04.990 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.980+0000 7f5e536b0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:04.990 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.980+0000 7f5e536b0640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f5e4c159930 con 0x7f5e4c152820 2026-02-17T11:15:04.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.980+0000 7f5e536b0640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:04.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.980+0000 7f5e536b0640 10 monclient(hunting): authenticate will time out at 1381.644426s 2026-02-17T11:15:04.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.980+0000 7f5e51425640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f5e4c152820 0x7f5e4c1593f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:04.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.981+0000 7f5e51c26640 1 --1- >> v1:10.20.193.157:6789/0 conn(0x7f5e4c0738f0 0x7f5e4c0c5ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.157:6789/0 says I am v1:10.20.193.49:43428/0 (socket says 10.20.193.49:43428) 2026-02-17T11:15:04.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.981+0000 7f5e51c26640 1 -- 10.20.193.49:0/3384783935 learned_addr learned my addr 10.20.193.49:0/3384783935 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:15:04.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.981+0000 7f5e51425640 10 monclient(hunting): get_auth_request con 0x7f5e4c152820 auth_method 0 2026-02-17T11:15:04.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.981+0000 7f5e51425640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:04.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.981+0000 7f5e51425640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:04.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.981+0000 7f5e51425640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:04.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.981+0000 7f5e51425640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:04.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.981+0000 7f5e51425640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:04.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.981+0000 7f5e51425640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:04.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.982+0000 7f5e3bfff640 1 -- 10.20.193.49:0/3384783935 <== mon.2 v1:10.20.193.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3444927400 0 0) 0x7f5e4c074170 con 0x7f5e4c0738f0 2026-02-17T11:15:04.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.982+0000 7f5e3bfff640 10 monclient(hunting): _negotiate 2026-02-17T11:15:04.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.982+0000 7f5e3bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:04.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.982+0000 7f5e3bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:04.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.982+0000 7f5e3bfff640 10 monclient(hunting): my global_id is 5093 2026-02-17T11:15:04.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.982+0000 7f5e3bfff640 1 -- 10.20.193.49:0/3384783935 --> v1:10.20.193.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e34003620 con 0x7f5e4c0738f0 2026-02-17T11:15:04.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.982+0000 7f5e3bfff640 1 -- 10.20.193.49:0/3384783935 <== mon.1 v1:10.20.193.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1141162829 0 0) 0x7f5e4c073e90 con 0x7f5e4c152c00 2026-02-17T11:15:04.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.982+0000 7f5e3bfff640 10 monclient(hunting): _negotiate 2026-02-17T11:15:04.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.982+0000 7f5e3bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:04.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.982+0000 7f5e3bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:04.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.982+0000 7f5e3bfff640 10 monclient(hunting): my global_id is 5056 2026-02-17T11:15:04.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.982+0000 7f5e3bfff640 1 -- 10.20.193.49:0/3384783935 --> v1:10.20.193.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e4c074170 con 0x7f5e4c152c00 2026-02-17T11:15:05.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.984+0000 7f5e51425640 10 monclient(hunting): handle_auth_done global_id 5053 payload 274 2026-02-17T11:15:05.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.984+0000 7f5e51425640 1 -- 10.20.193.49:0/3384783935 >> v1:10.20.193.157:6789/0 conn(0x7f5e4c0738f0 legacy=0x7f5e4c0c5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:05.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.984+0000 7f5e51425640 1 -- 10.20.193.49:0/3384783935 >> v1:10.20.193.97:6789/0 conn(0x7f5e4c152c00 legacy=0x7f5e4c0c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:05.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.984+0000 7f5e51425640 10 monclient: _finish_hunting 0 2026-02-17T11:15:05.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.984+0000 7f5e51425640 1 monclient: found mon.noname-b 2026-02-17T11:15:05.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.984+0000 7f5e51425640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:05.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.984+0000 7f5e51425640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:15:05.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.984+0000 7f5e51425640 1 -- 10.20.193.49:0/3384783935 --> v2:10.20.193.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e4c074450 con 0x7f5e4c152820 2026-02-17T11:15:05.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.985+0000 7f5e51425640 1 --2- 10.20.193.49:0/3384783935 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5e4c152820 0x7f5e4c1593f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c0098a0 tx=0x7f5e3c02ef00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af1aed2ce52956d0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:05.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.987+0000 7f5e3bfff640 1 -- 10.20.193.49:0/3384783935 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c03c070 con 0x7f5e4c152820 2026-02-17T11:15:05.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.987+0000 7f5e3bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:05.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.987+0000 7f5e3bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:15:05.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.987+0000 7f5e3bfff640 10 monclient: dump: 2026-02-17T11:15:05.004 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:05.004 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:05.004 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:05.005 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:05.005 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:05.005 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:05.005 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:05.005 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:05.005 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:05.005 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:05.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.987+0000 7f5e3bfff640 10 monclient: _finish_auth 0 2026-02-17T11:15:05.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.987+0000 7f5e3bfff640 10 monclient: _check_auth_tickets 2026-02-17T11:15:05.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.987+0000 7f5e3bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:05.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.987+0000 7f5e3bfff640 1 -- 10.20.193.49:0/3384783935 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e3c02fc10 con 0x7f5e4c152820 2026-02-17T11:15:05.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.987+0000 7f5e536b0640 5 monclient: authenticate success, global_id 5053 2026-02-17T11:15:05.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.987+0000 7f5e536b0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:15:05.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.987+0000 7f5e3bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:05.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.987+0000 7f5e3bfff640 1 -- 10.20.193.49:0/3384783935 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c037440 con 0x7f5e4c152820 2026-02-17T11:15:05.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.987+0000 7f5e536b0640 10 monclient: get_monmap_and_config success 2026-02-17T11:15:05.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.987+0000 7f5e536b0640 4 set_mon_vals no callback set 2026-02-17T11:15:05.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.987+0000 7f5e3bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:05.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.987+0000 7f5e3bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:15:05.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.987+0000 7f5e3bfff640 10 monclient: dump: 2026-02-17T11:15:05.006 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:05.006 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:05.006 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:05.007 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:05.007 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:05.007 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:05.007 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:05.007 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:05.007 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:05.007 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:05.007 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.988+0000 7f5e536b0640 10 monclient: shutdown 2026-02-17T11:15:05.007 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.988+0000 7f5e536b0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:05.007 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.988+0000 7f5e536b0640 1 -- 10.20.193.49:0/3384783935 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5e4c152820 msgr2=0x7f5e4c1593f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:05.007 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.988+0000 7f5e536b0640 1 --2- 10.20.193.49:0/3384783935 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5e4c152820 0x7f5e4c1593f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c0098a0 tx=0x7f5e3c02ef00 comp rx=0 tx=0).stop 2026-02-17T11:15:05.007 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.988+0000 7f5e536b0640 1 -- 10.20.193.49:0/3384783935 shutdown_connections 2026-02-17T11:15:05.008 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.988+0000 7f5e536b0640 1 --2- 10.20.193.49:0/3384783935 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5e4c152820 0x7f5e4c1593f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:05.008 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.988+0000 7f5e536b0640 1 -- 10.20.193.49:0/3384783935 >> 10.20.193.49:0/3384783935 conn(0x7f5e4c0c9f40 msgr2=0x7f5e4c0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:05.008 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.988+0000 7f5e536b0640 1 -- 10.20.193.49:0/3384783935 shutdown_connections 2026-02-17T11:15:05.008 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.988+0000 7f5e536b0640 1 -- 10.20.193.49:0/3384783935 wait complete. 2026-02-17T11:15:05.008 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.988+0000 7f5e536b0640 10 monclient: build_initial_monmap 2026-02-17T11:15:05.008 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.988+0000 7f5e536b0640 10 monclient: monmap: 2026-02-17T11:15:05.008 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:05.008 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:15:05.008 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:15:05.008 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:15:05.008 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:05.008 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:05.009 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:15:05.009 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:15:05.009 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:15:05.009 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:05.009 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.988+0000 7f5e536b0640 1 librados: starting msgr at 2026-02-17T11:15:05.009 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.988+0000 7f5e536b0640 1 librados: starting objecter 2026-02-17T11:15:05.009 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.988+0000 7f5e536b0640 1 Processor -- start 2026-02-17T11:15:05.009 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.989+0000 7f5e536b0640 1 -- start start 2026-02-17T11:15:05.009 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.989+0000 7f5e536b0640 1 librados: setting wanted keys 2026-02-17T11:15:05.009 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.989+0000 7f5e536b0640 1 librados: calling monclient init 2026-02-17T11:15:05.009 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.989+0000 7f5e536b0640 10 monclient: init 2026-02-17T11:15:05.009 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.989+0000 7f5e536b0640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:05.010 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.989+0000 7f5e536b0640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:15:05.010 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.989+0000 7f5e536b0640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5e4c0738f0 0x7f5e4c06e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:05.010 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.989+0000 7f5e536b0640 10 monclient(hunting): picked mon.noname-b con 0x7f5e4c0738f0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:15:05.010 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.989+0000 7f5e536b0640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5e4c152820 0x7f5e4c1ed420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:05.010 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.989+0000 7f5e536b0640 10 monclient(hunting): picked mon.noname-c con 0x7f5e4c152820 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:15:05.010 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.989+0000 7f5e536b0640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5e4c152c00 0x7f5e4c1ed960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:05.010 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.989+0000 7f5e536b0640 10 monclient(hunting): picked mon.noname-a con 0x7f5e4c152c00 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:15:05.010 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.989+0000 7f5e536b0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:05.010 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.989+0000 7f5e536b0640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5e4c074cf0 con 0x7f5e4c152c00 2026-02-17T11:15:05.010 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.989+0000 7f5e536b0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:05.010 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.989+0000 7f5e536b0640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f5e4c074a10 con 0x7f5e4c0738f0 2026-02-17T11:15:05.010 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.989+0000 7f5e536b0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:05.011 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.989+0000 7f5e536b0640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f5e4c0c63f0 con 0x7f5e4c152820 2026-02-17T11:15:05.011 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.989+0000 7f5e536b0640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:05.011 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.989+0000 7f5e536b0640 10 monclient(hunting): authenticate will time out at 1381.653426s 2026-02-17T11:15:05.011 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.989+0000 7f5e51425640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5e4c0738f0 0x7f5e4c06e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:05.011 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.989+0000 7f5e51c26640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5e4c152c00 0x7f5e4c1ed960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:05.011 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.989+0000 7f5e50c24640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5e4c152820 0x7f5e4c1ed420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:05.011 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.989+0000 7f5e51425640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5e4c0738f0 0x7f5e4c06e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:53554/0 (socket says 10.20.193.49:53554) 2026-02-17T11:15:05.011 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.989+0000 7f5e51425640 1 -- 10.20.193.49:0/3171855144 learned_addr learned my addr 10.20.193.49:0/3171855144 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:05.011 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.989+0000 7f5e51425640 10 monclient(hunting): get_auth_request con 0x7f5e4c0738f0 auth_method 0 2026-02-17T11:15:05.011 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.989+0000 7f5e51425640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:05.011 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.989+0000 7f5e51425640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:05.011 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.989+0000 7f5e51425640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:05.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.990+0000 7f5e51c26640 10 monclient(hunting): get_auth_request con 0x7f5e4c152c00 auth_method 0 2026-02-17T11:15:05.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.990+0000 7f5e51c26640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:05.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.990+0000 7f5e51c26640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:05.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.990+0000 7f5e51c26640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:05.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.990+0000 7f5e50c24640 10 monclient(hunting): get_auth_request con 0x7f5e4c152820 auth_method 0 2026-02-17T11:15:05.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.990+0000 7f5e50c24640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:05.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.990+0000 7f5e50c24640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:05.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.990+0000 7f5e50c24640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:05.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.990+0000 7f5e51425640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:05.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.990+0000 7f5e51425640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:05.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.990+0000 7f5e51425640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:05.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.990+0000 7f5e50c24640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:05.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.990+0000 7f5e50c24640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:05.013 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.990+0000 7f5e50c24640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:05.013 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.990+0000 7f5e51c26640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:05.013 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.990+0000 7f5e51c26640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:05.013 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.990+0000 7f5e51c26640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:05.013 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.991+0000 7f5e51425640 10 monclient(hunting): handle_auth_done global_id 5059 payload 824 2026-02-17T11:15:05.013 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.991+0000 7f5e51425640 1 -- 10.20.193.49:0/3171855144 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5e4c152820 msgr2=0x7f5e4c1ed420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:05.013 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.991+0000 7f5e51425640 1 --2- 10.20.193.49:0/3171855144 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5e4c152820 0x7f5e4c1ed420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:05.013 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.991+0000 7f5e51425640 1 -- 10.20.193.49:0/3171855144 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5e4c152c00 msgr2=0x7f5e4c1ed960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:05.013 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.991+0000 7f5e51425640 1 --2- 10.20.193.49:0/3171855144 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5e4c152c00 0x7f5e4c1ed960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:05.013 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.991+0000 7f5e51425640 10 monclient: _finish_hunting 0 2026-02-17T11:15:05.013 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.991+0000 7f5e51425640 1 monclient: found mon.noname-b 2026-02-17T11:15:05.013 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.991+0000 7f5e51425640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:05.013 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.991+0000 7f5e51425640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:15:05.014 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.991+0000 7f5e51425640 1 -- 10.20.193.49:0/3171855144 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e4c14dd90 con 0x7f5e4c0738f0 2026-02-17T11:15:05.014 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.992+0000 7f5e51425640 1 --2- 10.20.193.49:0/3171855144 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5e4c0738f0 0x7f5e4c06e6f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c016ed0 tx=0x7f5e3c0047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:05.014 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.992+0000 7f5e39ffb640 10 client.?.objecter ms_handle_connect 0x7f5e4c0738f0 2026-02-17T11:15:05.014 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.992+0000 7f5e39ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T11:15:05.014 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.994+0000 7f5e39ffb640 1 -- 10.20.193.49:0/3171855144 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c03c040 con 0x7f5e4c0738f0 2026-02-17T11:15:05.014 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.994+0000 7f5e39ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:05.014 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.994+0000 7f5e39ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:15:05.014 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.994+0000 7f5e39ffb640 10 monclient: dump: 2026-02-17T11:15:05.014 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:05.014 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:05.014 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:05.014 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:05.015 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:05.015 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:05.015 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:05.015 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:05.015 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:05.015 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:05.015 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.994+0000 7f5e39ffb640 10 monclient: _finish_auth 0 2026-02-17T11:15:05.015 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.994+0000 7f5e39ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:15:05.015 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.994+0000 7f5e39ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:05.015 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.994+0000 7f5e39ffb640 1 -- 10.20.193.49:0/3171855144 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e3c02fa10 con 0x7f5e4c0738f0 2026-02-17T11:15:05.015 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.994+0000 7f5e39ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:05.016 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.994+0000 7f5e39ffb640 1 -- 10.20.193.49:0/3171855144 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c042650 con 0x7f5e4c0738f0 2026-02-17T11:15:05.016 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.994+0000 7f5e39ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:05.016 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.994+0000 7f5e39ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:15:05.016 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.994+0000 7f5e39ffb640 10 monclient: dump: 2026-02-17T11:15:05.016 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:05.016 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:05.016 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:05.016 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:05.016 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:05.016 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:05.016 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:05.016 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:05.017 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:05.017 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:05.017 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.994+0000 7f5e3b7fe640 4 set_mon_vals no callback set 2026-02-17T11:15:05.017 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.994+0000 7f5e536b0640 5 monclient: authenticate success, global_id 5059 2026-02-17T11:15:05.017 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.994+0000 7f5e536b0640 10 monclient: _renew_subs 2026-02-17T11:15:05.017 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.994+0000 7f5e536b0640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:15:05.017 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.994+0000 7f5e536b0640 1 -- 10.20.193.49:0/3171855144 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e4c14e070 con 0x7f5e4c0738f0 2026-02-17T11:15:05.017 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.994+0000 7f5e536b0640 10 client.5059.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:05.017 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.994+0000 7f5e536b0640 10 monclient: _renew_subs 2026-02-17T11:15:05.017 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.994+0000 7f5e536b0640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:15:05.017 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.994+0000 7f5e536b0640 1 -- 10.20.193.49:0/3171855144 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e4c14e630 con 0x7f5e4c0738f0 2026-02-17T11:15:05.017 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.994+0000 7f5e536b0640 1 librados: init done 2026-02-17T11:15:05.018 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.994+0000 7f5e536b0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:05.018 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.994+0000 7f5e536b0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:05.018 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.994+0000 7f5e536b0640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:15:05.018 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:04.994+0000 7f5e536b0640 1 -- 10.20.193.49:0/3171855144 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e4c1593f0 con 0x7f5e4c0738f0 2026-02-17T11:15:05.019 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:05.005+0000 7f5e39ffb640 1 -- 10.20.193.49:0/3171855144 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f5e3c0427f0 con 0x7f5e4c0738f0 2026-02-17T11:15:05.019 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:05.006+0000 7f5e39ffb640 1 --2- 10.20.193.49:0/3171855144 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5e1c079190 0x7f5e1c07b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:05.019 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:05.006+0000 7f5e50c24640 1 --2- 10.20.193.49:0/3171855144 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5e1c079190 0x7f5e1c07b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:05.019 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:05.006+0000 7f5e50c24640 10 monclient: get_auth_request con 0x7f5e1c079190 auth_method 0 2026-02-17T11:15:05.019 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:05.006+0000 7f5e50c24640 1 --2- 10.20.193.49:0/3171855144 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5e1c079190 0x7f5e1c07b650 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5e40003fd0 tx=0x7f5e40002a40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:05.019 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:05.006+0000 7f5e39ffb640 10 client.5059.objecter ms_handle_connect 0x7f5e1c079190 2026-02-17T11:15:05.020 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:05.007+0000 7f5e39ffb640 1 -- 10.20.193.49:0/3171855144 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f5e3c02fbc0 con 0x7f5e4c0738f0 2026-02-17T11:15:05.020 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:05.007+0000 7f5e39ffb640 10 client.5059.objecter ms_dispatch2 0x7f5e4c000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:15:05.020 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:05.007+0000 7f5e39ffb640 3 client.5059.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:15:05.020 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:05.007+0000 7f5e39ffb640 3 client.5059.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:15:05.020 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:05.007+0000 7f5e39ffb640 20 client.5059.objecter dump_active .. 0 homeless 2026-02-17T11:15:05.109 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:05.107+0000 7f5e39ffb640 1 -- 10.20.193.49:0/3171855144 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f5e3c087640 con 0x7f5e4c0738f0 2026-02-17T11:15:05.109 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:05.107+0000 7f5e39ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:05.109 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:05.107+0000 7f5e39ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:15:05.212 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:05.209+0000 7f5e536b0640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:15:05.212 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:05.209+0000 7f5e536b0640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:15:05.212 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:05.209+0000 7f5e536b0640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:15:05.212 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:05.209+0000 7f5e536b0640 1 -- 10.20.193.49:0/3171855144 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f5e4c14aa10 con 0x7f5e4c0738f0 2026-02-17T11:15:05.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:05.212+0000 7f5e39ffb640 1 -- 10.20.193.49:0/3171855144 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f5e3c08b940 con 0x7f5e4c0738f0 2026-02-17T11:15:05.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:05.212+0000 7f5e39ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:15:05.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:05.212+0000 7f5e39ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:15:05.215 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:15:05.215 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:15:05.217 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:05.213+0000 7f5e536b0640 10 librados: watch_flush enter 2026-02-17T11:15:05.217 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:05.213+0000 7f5e536b0640 10 librados: watch_flush exit 2026-02-17T11:15:05.217 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:05.213+0000 7f5e536b0640 20 client.5059.objecter shutdown clearing up homeless session... 2026-02-17T11:15:05.217 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:05.213+0000 7f5e536b0640 10 client.5059.objecter successfully canceled tick 2026-02-17T11:15:05.217 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:05.213+0000 7f5e536b0640 1 -- 10.20.193.49:0/3171855144 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5e1c079190 msgr2=0x7f5e1c07b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:05.217 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:05.213+0000 7f5e536b0640 1 --2- 10.20.193.49:0/3171855144 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5e1c079190 0x7f5e1c07b650 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5e40003fd0 tx=0x7f5e40002a40 comp rx=0 tx=0).stop 2026-02-17T11:15:05.217 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:05.213+0000 7f5e536b0640 10 monclient: shutdown 2026-02-17T11:15:05.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:05.213+0000 7f5e536b0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:05.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:05.213+0000 7f5e536b0640 1 -- 10.20.193.49:0/3171855144 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5e4c0738f0 msgr2=0x7f5e4c06e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:05.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:05.213+0000 7f5e536b0640 1 --2- 10.20.193.49:0/3171855144 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5e4c0738f0 0x7f5e4c06e6f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c016ed0 tx=0x7f5e3c0047c0 comp rx=0 tx=0).stop 2026-02-17T11:15:05.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:05.213+0000 7f5e536b0640 1 -- 10.20.193.49:0/3171855144 shutdown_connections 2026-02-17T11:15:05.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:05.213+0000 7f5e536b0640 1 --2- 10.20.193.49:0/3171855144 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5e1c079190 0x7f5e1c07b650 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:05.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:05.213+0000 7f5e536b0640 1 --2- 10.20.193.49:0/3171855144 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5e4c152c00 0x7f5e4c1ed960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:05.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:05.213+0000 7f5e536b0640 1 --2- 10.20.193.49:0/3171855144 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5e4c152820 0x7f5e4c1ed420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:05.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:05.213+0000 7f5e536b0640 1 --2- 10.20.193.49:0/3171855144 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5e4c0738f0 0x7f5e4c06e6f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:05.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:05.213+0000 7f5e536b0640 1 -- 10.20.193.49:0/3171855144 >> 10.20.193.49:0/3171855144 conn(0x7f5e4c0c9f40 msgr2=0x7f5e4c06b600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:05.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:05.213+0000 7f5e536b0640 1 -- 10.20.193.49:0/3171855144 shutdown_connections 2026-02-17T11:15:05.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:05.213+0000 7f5e536b0640 1 -- 10.20.193.49:0/3171855144 wait complete. 2026-02-17T11:15:05.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:05.213+0000 7f5e536b0640 1 librados: shutdown 2026-02-17T11:15:08.225 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:15:08.295 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.292+0000 7f47c0876640 10 monclient: get_monmap_and_config 2026-02-17T11:15:08.295 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.292+0000 7f47c0876640 10 monclient: build_initial_monmap 2026-02-17T11:15:08.295 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.292+0000 7f47c0876640 10 monclient: monmap: 2026-02-17T11:15:08.295 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:08.295 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:08.295 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:15:08.293717+0000 2026-02-17T11:15:08.295 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:15:08.293717+0000 2026-02-17T11:15:08.296 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:08.296 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:08.296 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:15:08.296 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:15:08.296 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:15:08.296 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:15:08.296 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:15:08.296 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:15:08.296 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:08.296 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.292+0000 7f47c0876640 1 Processor -- start 2026-02-17T11:15:08.296 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.292+0000 7f47c0876640 1 -- start start 2026-02-17T11:15:08.296 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.292+0000 7f47c0876640 10 monclient: init 2026-02-17T11:15:08.299 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.293+0000 7f47c0876640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:08.299 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.293+0000 7f47c0876640 10 monclient: _add_conns ranks=[0,3,1,4,2,5] 2026-02-17T11:15:08.299 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.293+0000 7f47c0876640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f47b80c7170 addr v1:10.20.193.49:6789/0 2026-02-17T11:15:08.299 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.293+0000 7f47c0876640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f47b80c7550 0x7f47b80749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:08.299 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.293+0000 7f47c0876640 10 monclient(hunting): picked mon.noname-a con 0x7f47b80c7550 addr v2:10.20.193.49:3300/0 2026-02-17T11:15:08.299 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.293+0000 7f47c0876640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f47b8074ef0 addr v1:10.20.193.97:6789/0 2026-02-17T11:15:08.299 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.293+0000 7f47c0876640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47b80c4fd0 con 0x7f47b80c7170 2026-02-17T11:15:08.299 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.293+0000 7f47c0876640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47b815a9a0 con 0x7f47b8074ef0 2026-02-17T11:15:08.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.293+0000 7f47c0876640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:08.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.293+0000 7f47c0876640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f47b80c8530 con 0x7f47b80c7550 2026-02-17T11:15:08.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.293+0000 7f47c0876640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:08.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.293+0000 7f47c0876640 10 monclient(hunting): authenticate will time out at 1384.957185s 2026-02-17T11:15:08.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.293+0000 7f47bddea640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f47b80c7550 0x7f47b80749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:08.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.293+0000 7f47bedec640 1 --1- >> v1:10.20.193.97:6789/0 conn(0x7f47b8074ef0 0x7f47b80c89c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.97:6789/0 says I am v1:10.20.193.49:38678/0 (socket says 10.20.193.49:38678) 2026-02-17T11:15:08.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.293+0000 7f47bedec640 1 -- 10.20.193.49:0/3986763111 learned_addr learned my addr 10.20.193.49:0/3986763111 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:15:08.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.293+0000 7f47bddea640 10 monclient(hunting): get_auth_request con 0x7f47b80c7550 auth_method 0 2026-02-17T11:15:08.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.293+0000 7f47bddea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:08.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.293+0000 7f47bddea640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:08.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.293+0000 7f47bddea640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:08.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.294+0000 7f47bddea640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:08.301 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.294+0000 7f47bddea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:08.301 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.294+0000 7f47bddea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:08.301 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.295+0000 7f47bd5e9640 1 -- 10.20.193.49:0/3986763111 <== mon.1 v1:10.20.193.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1438684272 0 0) 0x7f47b815a9a0 con 0x7f47b8074ef0 2026-02-17T11:15:08.301 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.295+0000 7f47bd5e9640 10 monclient(hunting): _negotiate 2026-02-17T11:15:08.301 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.295+0000 7f47bd5e9640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:08.301 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.295+0000 7f47bd5e9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:08.301 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.295+0000 7f47bd5e9640 10 monclient(hunting): my global_id is 5062 2026-02-17T11:15:08.301 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.295+0000 7f47bd5e9640 1 -- 10.20.193.49:0/3986763111 --> v1:10.20.193.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47a8003620 con 0x7f47b8074ef0 2026-02-17T11:15:08.301 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.295+0000 7f47bddea640 10 monclient(hunting): handle_auth_done global_id 5076 payload 274 2026-02-17T11:15:08.301 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.295+0000 7f47bddea640 1 -- 10.20.193.49:0/3986763111 >> v1:10.20.193.97:6789/0 conn(0x7f47b8074ef0 legacy=0x7f47b80c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:08.301 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.295+0000 7f47bddea640 1 -- 10.20.193.49:0/3986763111 >> v1:10.20.193.49:6789/0 conn(0x7f47b80c7170 legacy=0x7f47b80c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:15:08.301 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.295+0000 7f47bddea640 10 monclient: _finish_hunting 0 2026-02-17T11:15:08.301 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.295+0000 7f47bddea640 1 monclient: found mon.noname-a 2026-02-17T11:15:08.302 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.295+0000 7f47bddea640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:08.302 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.295+0000 7f47bddea640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:15:08.302 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.295+0000 7f47bddea640 1 -- 10.20.193.49:0/3986763111 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47b80c5270 con 0x7f47b80c7550 2026-02-17T11:15:08.302 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.296+0000 7f47bddea640 1 --2- 10.20.193.49:0/3986763111 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f47b80c7550 0x7f47b80749b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f47b80c84a0 tx=0x7f47a402ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfab6243bad65784 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:08.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.298+0000 7f47bd5e9640 1 -- 10.20.193.49:0/3986763111 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a403c070 con 0x7f47b80c7550 2026-02-17T11:15:08.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.298+0000 7f47bd5e9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:08.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.298+0000 7f47bd5e9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:15:08.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.298+0000 7f47bd5e9640 10 monclient: dump: 2026-02-17T11:15:08.309 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:08.309 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:08.309 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:08.309 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:08.309 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:08.309 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:08.309 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:08.309 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:08.309 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:08.309 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:08.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.298+0000 7f47bd5e9640 10 monclient: _finish_auth 0 2026-02-17T11:15:08.310 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.298+0000 7f47bd5e9640 10 monclient: _check_auth_tickets 2026-02-17T11:15:08.310 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.298+0000 7f47bd5e9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:08.310 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.298+0000 7f47bd5e9640 1 -- 10.20.193.49:0/3986763111 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47a402faa0 con 0x7f47b80c7550 2026-02-17T11:15:08.310 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.298+0000 7f47c0876640 5 monclient: authenticate success, global_id 5076 2026-02-17T11:15:08.310 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.298+0000 7f47c0876640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:15:08.310 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.298+0000 7f47bd5e9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:08.310 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.298+0000 7f47bd5e9640 1 -- 10.20.193.49:0/3986763111 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a4037440 con 0x7f47b80c7550 2026-02-17T11:15:08.310 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.298+0000 7f47c0876640 10 monclient: get_monmap_and_config success 2026-02-17T11:15:08.310 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.298+0000 7f47c0876640 4 set_mon_vals no callback set 2026-02-17T11:15:08.310 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.298+0000 7f47bd5e9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:08.310 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.298+0000 7f47bd5e9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:15:08.310 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.298+0000 7f47bd5e9640 10 monclient: dump: 2026-02-17T11:15:08.311 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:08.311 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:08.311 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:08.311 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:08.311 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:08.311 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:08.311 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:08.311 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:08.311 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:08.311 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:08.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.299+0000 7f47c0876640 10 monclient: shutdown 2026-02-17T11:15:08.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.299+0000 7f47c0876640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:08.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.299+0000 7f47c0876640 1 -- 10.20.193.49:0/3986763111 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f47b80c7550 msgr2=0x7f47b80749b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:08.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.299+0000 7f47c0876640 1 --2- 10.20.193.49:0/3986763111 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f47b80c7550 0x7f47b80749b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f47b80c84a0 tx=0x7f47a402ede0 comp rx=0 tx=0).stop 2026-02-17T11:15:08.312 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.299+0000 7f47c0876640 1 -- 10.20.193.49:0/3986763111 shutdown_connections 2026-02-17T11:15:08.312 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.299+0000 7f47c0876640 1 --2- 10.20.193.49:0/3986763111 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f47b80c7550 0x7f47b80749b0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:08.312 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.299+0000 7f47c0876640 1 -- 10.20.193.49:0/3986763111 >> 10.20.193.49:0/3986763111 conn(0x7f47b80c9f40 msgr2=0x7f47b80ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:08.312 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.299+0000 7f47c0876640 1 -- 10.20.193.49:0/3986763111 shutdown_connections 2026-02-17T11:15:08.312 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.299+0000 7f47c0876640 1 -- 10.20.193.49:0/3986763111 wait complete. 2026-02-17T11:15:08.312 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.299+0000 7f47c0876640 10 monclient: build_initial_monmap 2026-02-17T11:15:08.312 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.299+0000 7f47c0876640 10 monclient: monmap: 2026-02-17T11:15:08.312 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:08.312 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:15:08.312 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:15:08.312 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:15:08.312 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:08.312 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:08.312 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:15:08.313 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:15:08.313 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:15:08.313 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:08.313 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.299+0000 7f47c0876640 1 librados: starting msgr at 2026-02-17T11:15:08.313 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.299+0000 7f47c0876640 1 librados: starting objecter 2026-02-17T11:15:08.313 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.299+0000 7f47c0876640 1 Processor -- start 2026-02-17T11:15:08.313 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.299+0000 7f47c0876640 1 -- start start 2026-02-17T11:15:08.313 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.299+0000 7f47c0876640 1 librados: setting wanted keys 2026-02-17T11:15:08.313 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.299+0000 7f47c0876640 1 librados: calling monclient init 2026-02-17T11:15:08.313 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.299+0000 7f47c0876640 10 monclient: init 2026-02-17T11:15:08.313 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.300+0000 7f47c0876640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:08.313 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.300+0000 7f47c0876640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:15:08.313 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.300+0000 7f47c0876640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f47b8074ef0 0x7f47b81f3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:08.313 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.300+0000 7f47c0876640 10 monclient(hunting): picked mon.noname-a con 0x7f47b8074ef0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:15:08.314 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.300+0000 7f47c0876640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f47b80c7170 0x7f47b814c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:08.314 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.300+0000 7f47c0876640 10 monclient(hunting): picked mon.noname-b con 0x7f47b80c7170 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:15:08.314 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.300+0000 7f47c0876640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f47b80c7550 0x7f47b81f0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:08.314 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.300+0000 7f47c0876640 10 monclient(hunting): picked mon.noname-c con 0x7f47b80c7550 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:15:08.314 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.300+0000 7f47c0876640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:08.314 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.300+0000 7f47c0876640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f47b80c7ee0 con 0x7f47b8074ef0 2026-02-17T11:15:08.314 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.300+0000 7f47c0876640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:08.314 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.300+0000 7f47c0876640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f47b80c5830 con 0x7f47b80c7170 2026-02-17T11:15:08.314 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.300+0000 7f47c0876640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:08.314 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.300+0000 7f47c0876640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f47b80c81c0 con 0x7f47b80c7550 2026-02-17T11:15:08.314 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.300+0000 7f47c0876640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:08.314 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.300+0000 7f47c0876640 10 monclient(hunting): authenticate will time out at 1384.964359s 2026-02-17T11:15:08.314 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.300+0000 7f47bddea640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f47b80c7170 0x7f47b814c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:08.314 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.300+0000 7f47be5eb640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f47b8074ef0 0x7f47b81f3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:08.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.300+0000 7f47be5eb640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f47b8074ef0 0x7f47b81f3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:49230/0 (socket says 10.20.193.49:49230) 2026-02-17T11:15:08.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.300+0000 7f47be5eb640 1 -- 10.20.193.49:0/3679049150 learned_addr learned my addr 10.20.193.49:0/3679049150 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:08.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.300+0000 7f47be5eb640 10 monclient(hunting): get_auth_request con 0x7f47b8074ef0 auth_method 0 2026-02-17T11:15:08.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.300+0000 7f47be5eb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:08.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.300+0000 7f47be5eb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:08.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.300+0000 7f47be5eb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:08.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.300+0000 7f47bddea640 10 monclient(hunting): get_auth_request con 0x7f47b80c7170 auth_method 0 2026-02-17T11:15:08.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.300+0000 7f47bddea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:08.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.300+0000 7f47bddea640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:08.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.300+0000 7f47bddea640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:08.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.300+0000 7f47bedec640 1 --2- 10.20.193.49:0/3679049150 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f47b80c7550 0x7f47b81f0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:08.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.301+0000 7f47be5eb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:08.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.301+0000 7f47be5eb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:08.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.301+0000 7f47be5eb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:08.315 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.301+0000 7f47bedec640 10 monclient(hunting): get_auth_request con 0x7f47b80c7550 auth_method 0 2026-02-17T11:15:08.316 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.301+0000 7f47bedec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:08.316 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.301+0000 7f47bedec640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:08.316 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.301+0000 7f47bedec640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:08.316 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.301+0000 7f47bddea640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:08.316 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.301+0000 7f47bddea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:08.316 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.301+0000 7f47bddea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:08.316 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.301+0000 7f47bedec640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:08.316 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.301+0000 7f47bedec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:08.316 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.301+0000 7f47bedec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:08.316 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.302+0000 7f47be5eb640 10 monclient(hunting): handle_auth_done global_id 5079 payload 824 2026-02-17T11:15:08.316 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.302+0000 7f47be5eb640 1 -- 10.20.193.49:0/3679049150 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f47b80c7550 msgr2=0x7f47b81f0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:08.316 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.302+0000 7f47be5eb640 1 --2- 10.20.193.49:0/3679049150 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f47b80c7550 0x7f47b81f0fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:08.316 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.302+0000 7f47be5eb640 1 -- 10.20.193.49:0/3679049150 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f47b80c7170 msgr2=0x7f47b814c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:08.316 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.302+0000 7f47be5eb640 1 --2- 10.20.193.49:0/3679049150 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f47b80c7170 0x7f47b814c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:08.316 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.302+0000 7f47be5eb640 10 monclient: _finish_hunting 0 2026-02-17T11:15:08.316 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.302+0000 7f47be5eb640 1 monclient: found mon.noname-a 2026-02-17T11:15:08.317 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.302+0000 7f47be5eb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:08.317 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.302+0000 7f47be5eb640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:15:08.317 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.302+0000 7f47be5eb640 1 -- 10.20.193.49:0/3679049150 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47b81f5160 con 0x7f47b8074ef0 2026-02-17T11:15:08.317 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.303+0000 7f47be5eb640 1 --2- 10.20.193.49:0/3679049150 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f47b8074ef0 0x7f47b81f3ac0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f47b000c5d0 tx=0x7f47b000caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:08.317 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.303+0000 7f47a2ffd640 10 client.?.objecter ms_handle_connect 0x7f47b8074ef0 2026-02-17T11:15:08.317 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.303+0000 7f47a2ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:15:08.317 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.305+0000 7f47a2ffd640 1 -- 10.20.193.49:0/3679049150 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b0016020 con 0x7f47b8074ef0 2026-02-17T11:15:08.317 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.305+0000 7f47a2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:08.317 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.305+0000 7f47a2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:15:08.317 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.305+0000 7f47a2ffd640 10 monclient: dump: 2026-02-17T11:15:08.317 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:08.317 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:08.317 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:08.317 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:08.317 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:08.318 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:08.318 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:08.318 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:08.318 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:08.318 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:08.318 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.305+0000 7f47a2ffd640 10 monclient: _finish_auth 0 2026-02-17T11:15:08.318 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.305+0000 7f47a2ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:15:08.318 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.305+0000 7f47a2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:08.318 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.305+0000 7f47c0876640 5 monclient: authenticate success, global_id 5079 2026-02-17T11:15:08.318 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.305+0000 7f47a2ffd640 1 -- 10.20.193.49:0/3679049150 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47b0012850 con 0x7f47b8074ef0 2026-02-17T11:15:08.318 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.305+0000 7f47a2ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:08.318 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.305+0000 7f47a2ffd640 1 -- 10.20.193.49:0/3679049150 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b0012c40 con 0x7f47b8074ef0 2026-02-17T11:15:08.318 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.305+0000 7f47a2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:08.318 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.305+0000 7f47a2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:15:08.318 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.305+0000 7f47a2ffd640 10 monclient: dump: 2026-02-17T11:15:08.318 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:08.319 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:08.319 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:08.319 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:08.319 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:08.319 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:08.319 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:08.319 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:08.319 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:08.319 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:08.319 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.305+0000 7f47bcde8640 4 set_mon_vals no callback set 2026-02-17T11:15:08.319 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.305+0000 7f47c0876640 10 monclient: _renew_subs 2026-02-17T11:15:08.319 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.305+0000 7f47c0876640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:08.319 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.305+0000 7f47c0876640 1 -- 10.20.193.49:0/3679049150 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47b81f5440 con 0x7f47b8074ef0 2026-02-17T11:15:08.319 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.305+0000 7f47c0876640 10 client.5079.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:08.319 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.305+0000 7f47c0876640 10 monclient: _renew_subs 2026-02-17T11:15:08.319 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.305+0000 7f47c0876640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:08.319 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.305+0000 7f47c0876640 1 -- 10.20.193.49:0/3679049150 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47b81f5a00 con 0x7f47b8074ef0 2026-02-17T11:15:08.319 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.305+0000 7f47c0876640 1 librados: init done 2026-02-17T11:15:08.320 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.305+0000 7f47c0876640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:08.320 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.305+0000 7f47c0876640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:08.320 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.305+0000 7f47c0876640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:08.320 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.305+0000 7f47c0876640 1 -- 10.20.193.49:0/3679049150 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47b815a9a0 con 0x7f47b8074ef0 2026-02-17T11:15:08.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.414+0000 7f47a2ffd640 1 -- 10.20.193.49:0/3679049150 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f47b00068d0 con 0x7f47b8074ef0 2026-02-17T11:15:08.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.415+0000 7f47a2ffd640 1 --2- 10.20.193.49:0/3679049150 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f4788079140 0x7f478807b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:08.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.415+0000 7f47bddea640 1 --2- 10.20.193.49:0/3679049150 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f4788079140 0x7f478807b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:08.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.415+0000 7f47bddea640 10 monclient: get_auth_request con 0x7f4788079140 auth_method 0 2026-02-17T11:15:08.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.416+0000 7f47bddea640 1 --2- 10.20.193.49:0/3679049150 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f4788079140 0x7f478807b600 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f47a4039000 tx=0x7f47a4033000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:08.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.416+0000 7f47a2ffd640 10 client.5079.objecter ms_handle_connect 0x7f4788079140 2026-02-17T11:15:08.426 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.423+0000 7f47a2ffd640 1 -- 10.20.193.49:0/3679049150 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f47b0012de0 con 0x7f47b8074ef0 2026-02-17T11:15:08.426 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.423+0000 7f47a2ffd640 10 client.5079.objecter ms_dispatch2 0x7f47b8000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:15:08.426 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.423+0000 7f47a2ffd640 3 client.5079.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:15:08.426 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.423+0000 7f47a2ffd640 3 client.5079.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:15:08.426 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.424+0000 7f47a2ffd640 20 client.5079.objecter dump_active .. 0 homeless 2026-02-17T11:15:08.426 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.424+0000 7f47a2ffd640 1 -- 10.20.193.49:0/3679049150 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f47b0020030 con 0x7f47b8074ef0 2026-02-17T11:15:08.426 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.424+0000 7f47a2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:08.426 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.424+0000 7f47a2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:15:08.524 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.522+0000 7f47c0876640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:15:08.524 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.522+0000 7f47c0876640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:15:08.525 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.522+0000 7f47c0876640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:08.525 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.522+0000 7f47c0876640 1 -- 10.20.193.49:0/3679049150 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f47b80c4b40 con 0x7f47b8074ef0 2026-02-17T11:15:08.526 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.524+0000 7f47a2ffd640 1 -- 10.20.193.49:0/3679049150 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f47b0062010 con 0x7f47b8074ef0 2026-02-17T11:15:08.526 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.524+0000 7f47a2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:15:08.526 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.524+0000 7f47a2ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:15:08.527 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:15:08.527 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:15:08.528 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.525+0000 7f47c0876640 10 librados: watch_flush enter 2026-02-17T11:15:08.528 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.525+0000 7f47c0876640 10 librados: watch_flush exit 2026-02-17T11:15:08.528 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.525+0000 7f47c0876640 20 client.5079.objecter shutdown clearing up homeless session... 2026-02-17T11:15:08.528 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.525+0000 7f47c0876640 10 client.5079.objecter successfully canceled tick 2026-02-17T11:15:08.529 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.525+0000 7f47c0876640 1 -- 10.20.193.49:0/3679049150 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f4788079140 msgr2=0x7f478807b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:08.529 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.525+0000 7f47c0876640 1 --2- 10.20.193.49:0/3679049150 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f4788079140 0x7f478807b600 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f47a4039000 tx=0x7f47a4033000 comp rx=0 tx=0).stop 2026-02-17T11:15:08.529 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.525+0000 7f47c0876640 10 monclient: shutdown 2026-02-17T11:15:08.529 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.525+0000 7f47c0876640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:08.529 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.525+0000 7f47c0876640 1 -- 10.20.193.49:0/3679049150 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f47b8074ef0 msgr2=0x7f47b81f3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:08.529 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.525+0000 7f47c0876640 1 --2- 10.20.193.49:0/3679049150 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f47b8074ef0 0x7f47b81f3ac0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f47b000c5d0 tx=0x7f47b000caa0 comp rx=0 tx=0).stop 2026-02-17T11:15:08.529 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.525+0000 7f47c0876640 1 -- 10.20.193.49:0/3679049150 shutdown_connections 2026-02-17T11:15:08.529 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.525+0000 7f47c0876640 1 --2- 10.20.193.49:0/3679049150 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f4788079140 0x7f478807b600 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:08.529 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.525+0000 7f47c0876640 1 --2- 10.20.193.49:0/3679049150 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f47b80c7550 0x7f47b81f0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:08.529 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.525+0000 7f47c0876640 1 --2- 10.20.193.49:0/3679049150 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f47b80c7170 0x7f47b814c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:08.529 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.525+0000 7f47c0876640 1 --2- 10.20.193.49:0/3679049150 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f47b8074ef0 0x7f47b81f3ac0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:08.529 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.525+0000 7f47c0876640 1 -- 10.20.193.49:0/3679049150 >> 10.20.193.49:0/3679049150 conn(0x7f47b80c9f40 msgr2=0x7f47b80cb2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:08.529 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.525+0000 7f47c0876640 1 -- 10.20.193.49:0/3679049150 shutdown_connections 2026-02-17T11:15:08.529 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.525+0000 7f47c0876640 1 -- 10.20.193.49:0/3679049150 wait complete. 2026-02-17T11:15:08.530 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:08.525+0000 7f47c0876640 1 librados: shutdown 2026-02-17T11:15:11.537 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:15:11.606 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.603+0000 7f4460b96640 10 monclient: get_monmap_and_config 2026-02-17T11:15:11.606 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.603+0000 7f4460b96640 10 monclient: build_initial_monmap 2026-02-17T11:15:11.606 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.603+0000 7f4460b96640 10 monclient: monmap: 2026-02-17T11:15:11.606 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:11.607 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:11.607 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:15:11.605024+0000 2026-02-17T11:15:11.607 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:15:11.605024+0000 2026-02-17T11:15:11.607 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:11.607 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:11.607 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:15:11.607 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:15:11.607 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:15:11.607 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:15:11.607 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:15:11.607 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:15:11.607 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:11.608 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.603+0000 7f4460b96640 1 Processor -- start 2026-02-17T11:15:11.608 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.603+0000 7f4460b96640 1 -- start start 2026-02-17T11:15:11.608 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.603+0000 7f4460b96640 10 monclient: init 2026-02-17T11:15:11.610 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.604+0000 7f4460b96640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:11.611 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.604+0000 7f4460b96640 10 monclient: _add_conns ranks=[3,5,2,4,1,0] 2026-02-17T11:15:11.611 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.604+0000 7f4460b96640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f445c0c7170 0x7f445c0c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:11.611 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.604+0000 7f4460b96640 10 monclient(hunting): picked mon.noname-a con 0x7f445c0c7170 addr v2:10.20.193.49:3300/0 2026-02-17T11:15:11.611 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.604+0000 7f4460b96640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f445c0c48c0 0x7f445c0749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:11.611 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.604+0000 7f4460b96640 10 monclient(hunting): picked mon.noname-c con 0x7f445c0c48c0 addr v2:10.20.193.157:3300/0 2026-02-17T11:15:11.611 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.604+0000 7f4460b96640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f445c074ef0 addr v1:10.20.193.157:6789/0 2026-02-17T11:15:11.611 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.604+0000 7f4460b96640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f445c15a9a0 con 0x7f445c074ef0 2026-02-17T11:15:11.611 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.604+0000 7f4460b96640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:11.611 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.604+0000 7f4460b96640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f445c0c8530 con 0x7f445c0c7170 2026-02-17T11:15:11.611 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.604+0000 7f4460b96640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:11.611 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.604+0000 7f4460b96640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f445c0c5270 con 0x7f445c0c48c0 2026-02-17T11:15:11.612 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.604+0000 7f4460b96640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:11.612 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.604+0000 7f4460b96640 10 monclient(hunting): authenticate will time out at 1388.268462s 2026-02-17T11:15:11.612 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.604+0000 7f445a575640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f445c0c7170 0x7f445c0c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:11.612 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.604+0000 7f4459d74640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f445c0c48c0 0x7f445c0749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:11.612 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.605+0000 7f445a575640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f445c0c7170 0x7f445c0c7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:49236/0 (socket says 10.20.193.49:49236) 2026-02-17T11:15:11.612 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.605+0000 7f445a575640 1 -- 10.20.193.49:0/2406936917 learned_addr learned my addr 10.20.193.49:0/2406936917 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:11.612 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.605+0000 7f445a575640 10 monclient(hunting): get_auth_request con 0x7f445c0c7170 auth_method 0 2026-02-17T11:15:11.612 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.605+0000 7f445a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:11.612 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.605+0000 7f445a575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:11.612 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.605+0000 7f445a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:11.612 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.605+0000 7f4459d74640 10 monclient(hunting): get_auth_request con 0x7f445c0c48c0 auth_method 0 2026-02-17T11:15:11.612 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.605+0000 7f4459d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:11.613 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.605+0000 7f4459d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:11.613 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.605+0000 7f4459d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:11.613 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.605+0000 7f445a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:11.613 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.605+0000 7f445a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:11.613 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.605+0000 7f445a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:11.613 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.605+0000 7f4459d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:11.613 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.605+0000 7f4459d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:11.613 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.605+0000 7f4459d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:11.613 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.606+0000 7f445a575640 10 monclient(hunting): handle_auth_done global_id 5082 payload 274 2026-02-17T11:15:11.613 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.606+0000 7f445a575640 1 -- 10.20.193.49:0/2406936917 >> v2:10.20.193.157:3300/0 conn(0x7f445c0c48c0 msgr2=0x7f445c0749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:15:11.613 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.606+0000 7f445a575640 1 --2- 10.20.193.49:0/2406936917 >> v2:10.20.193.157:3300/0 conn(0x7f445c0c48c0 0x7f445c0749b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:11.613 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.606+0000 7f445a575640 1 -- 10.20.193.49:0/2406936917 >> v1:10.20.193.157:6789/0 conn(0x7f445c074ef0 legacy=0x7f445c0c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:15:11.613 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.606+0000 7f445a575640 10 monclient: _finish_hunting 0 2026-02-17T11:15:11.614 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.606+0000 7f445a575640 1 monclient: found mon.noname-a 2026-02-17T11:15:11.614 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.606+0000 7f445a575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:11.614 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.606+0000 7f445a575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:15:11.614 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.606+0000 7f445a575640 1 -- 10.20.193.49:0/2406936917 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f445c0c5550 con 0x7f445c0c7170 2026-02-17T11:15:11.614 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.607+0000 7f445a575640 1 --2- 10.20.193.49:0/2406936917 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f445c0c7170 0x7f445c0c7550 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f445c0c7a90 tx=0x7f445002eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74bc3b4b10c244aa server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:11.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.609+0000 7f4459573640 1 -- 10.20.193.49:0/2406936917 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f445003c070 con 0x7f445c0c7170 2026-02-17T11:15:11.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.609+0000 7f4459573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:11.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.609+0000 7f4459573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:15:11.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.609+0000 7f4459573640 10 monclient: dump: 2026-02-17T11:15:11.620 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:11.620 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:11.620 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:11.620 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:11.620 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:11.621 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:11.621 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:11.621 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:11.621 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:11.621 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:11.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.609+0000 7f4459573640 10 monclient: _finish_auth 0 2026-02-17T11:15:11.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.609+0000 7f4459573640 10 monclient: _check_auth_tickets 2026-02-17T11:15:11.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.609+0000 7f4459573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:11.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.609+0000 7f4459573640 1 -- 10.20.193.49:0/2406936917 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f445002fb40 con 0x7f445c0c7170 2026-02-17T11:15:11.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.609+0000 7f4459573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:11.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.609+0000 7f4459573640 1 -- 10.20.193.49:0/2406936917 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4450037440 con 0x7f445c0c7170 2026-02-17T11:15:11.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.609+0000 7f4460b96640 5 monclient: authenticate success, global_id 5082 2026-02-17T11:15:11.622 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.609+0000 7f4460b96640 10 monclient: get_monmap_and_config success 2026-02-17T11:15:11.622 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.609+0000 7f4460b96640 4 set_mon_vals no callback set 2026-02-17T11:15:11.622 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.609+0000 7f4459573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:11.622 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.609+0000 7f4459573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:15:11.622 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.609+0000 7f4459573640 10 monclient: dump: 2026-02-17T11:15:11.622 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:11.622 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:11.622 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:11.622 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:11.622 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:11.622 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:11.622 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:11.623 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:11.623 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:11.623 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:11.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.609+0000 7f4460b96640 10 monclient: shutdown 2026-02-17T11:15:11.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.609+0000 7f4460b96640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:11.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.609+0000 7f4460b96640 1 -- 10.20.193.49:0/2406936917 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f445c0c7170 msgr2=0x7f445c0c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:11.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.609+0000 7f4460b96640 1 --2- 10.20.193.49:0/2406936917 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f445c0c7170 0x7f445c0c7550 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f445c0c7a90 tx=0x7f445002eed0 comp rx=0 tx=0).stop 2026-02-17T11:15:11.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.609+0000 7f4460b96640 1 -- 10.20.193.49:0/2406936917 shutdown_connections 2026-02-17T11:15:11.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.609+0000 7f4460b96640 1 --2- 10.20.193.49:0/2406936917 >> v2:10.20.193.157:3300/0 conn(0x7f445c0c48c0 0x7f445c0749b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:11.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.609+0000 7f4460b96640 1 --2- 10.20.193.49:0/2406936917 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f445c0c7170 0x7f445c0c7550 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:11.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.609+0000 7f4460b96640 1 -- 10.20.193.49:0/2406936917 >> 10.20.193.49:0/2406936917 conn(0x7f445c0c9f40 msgr2=0x7f445c0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:11.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.609+0000 7f4460b96640 1 -- 10.20.193.49:0/2406936917 shutdown_connections 2026-02-17T11:15:11.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.609+0000 7f4460b96640 1 -- 10.20.193.49:0/2406936917 wait complete. 2026-02-17T11:15:11.624 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.610+0000 7f4460b96640 10 monclient: build_initial_monmap 2026-02-17T11:15:11.624 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.610+0000 7f4460b96640 10 monclient: monmap: 2026-02-17T11:15:11.624 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:11.624 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:15:11.624 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:15:11.624 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:15:11.624 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:11.624 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:11.624 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:15:11.624 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:15:11.624 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:15:11.624 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:11.625 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.610+0000 7f4460b96640 1 librados: starting msgr at 2026-02-17T11:15:11.625 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.610+0000 7f4460b96640 1 librados: starting objecter 2026-02-17T11:15:11.625 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.610+0000 7f4460b96640 1 Processor -- start 2026-02-17T11:15:11.625 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.610+0000 7f4460b96640 1 -- start start 2026-02-17T11:15:11.625 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.610+0000 7f4460b96640 1 librados: setting wanted keys 2026-02-17T11:15:11.625 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.610+0000 7f4460b96640 1 librados: calling monclient init 2026-02-17T11:15:11.625 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.610+0000 7f4460b96640 10 monclient: init 2026-02-17T11:15:11.625 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.610+0000 7f4460b96640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:11.625 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.610+0000 7f4460b96640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:15:11.625 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.610+0000 7f4460b96640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f445c074ef0 0x7f445c0cc560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:11.625 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.610+0000 7f4460b96640 10 monclient(hunting): picked mon.noname-b con 0x7f445c074ef0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:15:11.625 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.610+0000 7f4460b96640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f445c0c48c0 0x7f445c1f2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:11.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.610+0000 7f4460b96640 10 monclient(hunting): picked mon.noname-a con 0x7f445c0c48c0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:15:11.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.610+0000 7f4460b96640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f445c0c7170 0x7f445c15d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:11.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.610+0000 7f4460b96640 10 monclient(hunting): picked mon.noname-c con 0x7f445c0c7170 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:15:11.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.610+0000 7f4460b96640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:11.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.610+0000 7f4460b96640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f445c0c81c0 con 0x7f445c0c48c0 2026-02-17T11:15:11.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.610+0000 7f4460b96640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:11.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.610+0000 7f4460b96640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f445c0c7ee0 con 0x7f445c074ef0 2026-02-17T11:15:11.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.610+0000 7f4460b96640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:11.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.610+0000 7f4460b96640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f445c0c90d0 con 0x7f445c0c7170 2026-02-17T11:15:11.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.610+0000 7f4460b96640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:11.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.610+0000 7f4460b96640 10 monclient(hunting): authenticate will time out at 1388.274947s 2026-02-17T11:15:11.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.611+0000 7f4459d74640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f445c0c48c0 0x7f445c1f2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:11.626 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.611+0000 7f445ad76640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f445c0c7170 0x7f445c15d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:11.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.611+0000 7f4459d74640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f445c0c48c0 0x7f445c1f2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:49238/0 (socket says 10.20.193.49:49238) 2026-02-17T11:15:11.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.611+0000 7f4459d74640 1 -- 10.20.193.49:0/823920107 learned_addr learned my addr 10.20.193.49:0/823920107 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:11.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.611+0000 7f4459d74640 10 monclient(hunting): get_auth_request con 0x7f445c0c48c0 auth_method 0 2026-02-17T11:15:11.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.611+0000 7f4459d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:11.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.611+0000 7f4459d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:11.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.611+0000 7f4459d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:11.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.611+0000 7f445a575640 1 --2- 10.20.193.49:0/823920107 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f445c074ef0 0x7f445c0cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:11.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.611+0000 7f4459d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:11.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.611+0000 7f4459d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:11.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.611+0000 7f4459d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:11.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.611+0000 7f445ad76640 10 monclient(hunting): get_auth_request con 0x7f445c0c7170 auth_method 0 2026-02-17T11:15:11.627 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.611+0000 7f445ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:11.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.611+0000 7f445ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:11.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.611+0000 7f445ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:11.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.611+0000 7f445a575640 10 monclient(hunting): get_auth_request con 0x7f445c074ef0 auth_method 0 2026-02-17T11:15:11.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.611+0000 7f445a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:11.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.611+0000 7f445a575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:11.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.611+0000 7f445a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:11.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.611+0000 7f445ad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:11.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.611+0000 7f445ad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:11.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.611+0000 7f445ad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:11.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.612+0000 7f445a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:11.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.612+0000 7f445a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:11.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.612+0000 7f445a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:11.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.612+0000 7f4459d74640 10 monclient(hunting): handle_auth_done global_id 5085 payload 824 2026-02-17T11:15:11.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.612+0000 7f4459d74640 1 -- 10.20.193.49:0/823920107 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f445c0c7170 msgr2=0x7f445c15d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:11.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.613+0000 7f4459d74640 1 --2- 10.20.193.49:0/823920107 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f445c0c7170 0x7f445c15d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:11.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.613+0000 7f4459d74640 1 -- 10.20.193.49:0/823920107 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f445c074ef0 msgr2=0x7f445c0cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:11.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.613+0000 7f4459d74640 1 --2- 10.20.193.49:0/823920107 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f445c074ef0 0x7f445c0cc560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:11.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.613+0000 7f4459d74640 10 monclient: _finish_hunting 0 2026-02-17T11:15:11.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.613+0000 7f4459d74640 1 monclient: found mon.noname-a 2026-02-17T11:15:11.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.613+0000 7f4459d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:11.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.613+0000 7f4459d74640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:15:11.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.613+0000 7f4459d74640 1 -- 10.20.193.49:0/823920107 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f445c0c2690 con 0x7f445c0c48c0 2026-02-17T11:15:11.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.614+0000 7f4459d74640 1 --2- 10.20.193.49:0/823920107 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f445c0c48c0 0x7f445c1f2620 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f444400ebe0 tx=0x7f444400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:11.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.614+0000 7f4442ffd640 10 client.?.objecter ms_handle_connect 0x7f445c0c48c0 2026-02-17T11:15:11.629 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.614+0000 7f4442ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:15:11.630 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.615+0000 7f4442ffd640 1 -- 10.20.193.49:0/823920107 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4444017070 con 0x7f445c0c48c0 2026-02-17T11:15:11.630 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.615+0000 7f4442ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:11.630 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.615+0000 7f4442ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:15:11.630 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.615+0000 7f4442ffd640 10 monclient: dump: 2026-02-17T11:15:11.630 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:11.630 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:11.630 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:11.630 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:11.630 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:11.630 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:11.630 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:11.630 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:11.631 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:11.631 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:11.631 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.615+0000 7f4442ffd640 10 monclient: _finish_auth 0 2026-02-17T11:15:11.631 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.615+0000 7f4442ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:15:11.631 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.615+0000 7f4442ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:11.631 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.615+0000 7f4442ffd640 1 -- 10.20.193.49:0/823920107 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f444400cc40 con 0x7f445c0c48c0 2026-02-17T11:15:11.631 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.615+0000 7f4442ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:11.631 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.615+0000 7f4442ffd640 1 -- 10.20.193.49:0/823920107 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4444013470 con 0x7f445c0c48c0 2026-02-17T11:15:11.631 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.615+0000 7f4460b96640 5 monclient: authenticate success, global_id 5085 2026-02-17T11:15:11.631 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.615+0000 7f4442ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:11.631 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.615+0000 7f4458d72640 4 set_mon_vals no callback set 2026-02-17T11:15:11.631 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.615+0000 7f4442ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:15:11.631 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.615+0000 7f4442ffd640 10 monclient: dump: 2026-02-17T11:15:11.632 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:11.632 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:11.632 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:11.632 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:11.632 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:11.632 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:11.632 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:11.632 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:11.632 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:11.632 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:11.632 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.615+0000 7f4460b96640 10 monclient: _renew_subs 2026-02-17T11:15:11.632 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.615+0000 7f4460b96640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:11.632 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.615+0000 7f4460b96640 1 -- 10.20.193.49:0/823920107 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f445c0c2970 con 0x7f445c0c48c0 2026-02-17T11:15:11.633 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.615+0000 7f4460b96640 10 client.5085.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:11.633 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.615+0000 7f4460b96640 10 monclient: _renew_subs 2026-02-17T11:15:11.633 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.615+0000 7f4460b96640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:11.633 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.615+0000 7f4460b96640 1 -- 10.20.193.49:0/823920107 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f445c0c2f30 con 0x7f445c0c48c0 2026-02-17T11:15:11.633 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.615+0000 7f4460b96640 1 librados: init done 2026-02-17T11:15:11.633 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.616+0000 7f4460b96640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:11.633 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.616+0000 7f4460b96640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:11.633 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.616+0000 7f4460b96640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:11.633 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.616+0000 7f4460b96640 1 -- 10.20.193.49:0/823920107 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f445c14f7d0 con 0x7f445c0c48c0 2026-02-17T11:15:11.635 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.628+0000 7f4442ffd640 1 -- 10.20.193.49:0/823920107 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f4444013610 con 0x7f445c0c48c0 2026-02-17T11:15:11.635 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.628+0000 7f4442ffd640 1 --2- 10.20.193.49:0/823920107 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f4428079140 0x7f442807b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:11.635 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.628+0000 7f445a575640 1 --2- 10.20.193.49:0/823920107 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f4428079140 0x7f442807b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:11.635 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.628+0000 7f445a575640 10 monclient: get_auth_request con 0x7f4428079140 auth_method 0 2026-02-17T11:15:11.635 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.629+0000 7f445a575640 1 --2- 10.20.193.49:0/823920107 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f4428079140 0x7f442807b600 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f445c0c6e90 tx=0x7f4450033000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:11.635 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.629+0000 7f4442ffd640 10 client.5085.objecter ms_handle_connect 0x7f4428079140 2026-02-17T11:15:11.635 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.630+0000 7f4442ffd640 1 -- 10.20.193.49:0/823920107 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f444405e7c0 con 0x7f445c0c48c0 2026-02-17T11:15:11.635 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.630+0000 7f4442ffd640 10 client.5085.objecter ms_dispatch2 0x7f445c000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:15:11.635 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.630+0000 7f4442ffd640 3 client.5085.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:15:11.635 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.630+0000 7f4442ffd640 3 client.5085.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:15:11.636 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.630+0000 7f4442ffd640 20 client.5085.objecter dump_active .. 0 homeless 2026-02-17T11:15:11.731 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.729+0000 7f4442ffd640 1 -- 10.20.193.49:0/823920107 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f445c14f7d0 con 0x7f445c0c48c0 2026-02-17T11:15:11.731 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.729+0000 7f4442ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:11.732 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.729+0000 7f4442ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:15:11.833 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.830+0000 7f4460b96640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:15:11.834 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.830+0000 7f4460b96640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:15:11.834 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.830+0000 7f4460b96640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:11.834 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.830+0000 7f4460b96640 1 -- 10.20.193.49:0/823920107 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f445c0c4d10 con 0x7f445c0c48c0 2026-02-17T11:15:11.836 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.833+0000 7f4442ffd640 1 -- 10.20.193.49:0/823920107 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f4444062780 con 0x7f445c0c48c0 2026-02-17T11:15:11.836 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.834+0000 7f4442ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:15:11.836 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.834+0000 7f4442ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:15:11.837 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:15:11.837 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:15:11.838 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.835+0000 7f4460b96640 10 librados: watch_flush enter 2026-02-17T11:15:11.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.835+0000 7f4460b96640 10 librados: watch_flush exit 2026-02-17T11:15:11.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.835+0000 7f4460b96640 20 client.5085.objecter shutdown clearing up homeless session... 2026-02-17T11:15:11.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.835+0000 7f4460b96640 10 client.5085.objecter successfully canceled tick 2026-02-17T11:15:11.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.835+0000 7f4460b96640 1 -- 10.20.193.49:0/823920107 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f4428079140 msgr2=0x7f442807b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:11.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.835+0000 7f4460b96640 1 --2- 10.20.193.49:0/823920107 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f4428079140 0x7f442807b600 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f445c0c6e90 tx=0x7f4450033000 comp rx=0 tx=0).stop 2026-02-17T11:15:11.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.835+0000 7f4460b96640 10 monclient: shutdown 2026-02-17T11:15:11.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.835+0000 7f4460b96640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:11.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.835+0000 7f4460b96640 1 -- 10.20.193.49:0/823920107 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f445c0c48c0 msgr2=0x7f445c1f2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:11.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.835+0000 7f4460b96640 1 --2- 10.20.193.49:0/823920107 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f445c0c48c0 0x7f445c1f2620 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f444400ebe0 tx=0x7f444400c520 comp rx=0 tx=0).stop 2026-02-17T11:15:11.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.835+0000 7f4460b96640 1 -- 10.20.193.49:0/823920107 shutdown_connections 2026-02-17T11:15:11.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.835+0000 7f4460b96640 1 --2- 10.20.193.49:0/823920107 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f4428079140 0x7f442807b600 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:11.840 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.835+0000 7f4460b96640 1 --2- 10.20.193.49:0/823920107 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f445c0c7170 0x7f445c15d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:11.840 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.835+0000 7f4460b96640 1 --2- 10.20.193.49:0/823920107 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f445c0c48c0 0x7f445c1f2620 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:11.840 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.835+0000 7f4460b96640 1 --2- 10.20.193.49:0/823920107 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f445c074ef0 0x7f445c0cc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:11.840 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.835+0000 7f4460b96640 1 -- 10.20.193.49:0/823920107 >> 10.20.193.49:0/823920107 conn(0x7f445c0c9f40 msgr2=0x7f445c14f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:11.840 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.835+0000 7f4460b96640 1 -- 10.20.193.49:0/823920107 shutdown_connections 2026-02-17T11:15:11.840 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.835+0000 7f4460b96640 1 -- 10.20.193.49:0/823920107 wait complete. 2026-02-17T11:15:11.840 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:11.835+0000 7f4460b96640 1 librados: shutdown 2026-02-17T11:15:12.109 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:06:57.590 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:15:12.137 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:06:57.618 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:15:12.137 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:06:57.612 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:15:12.139 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:06:57.614 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:15:12.145 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:06:57.627 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:15:12.147 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:06:57.622 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:15:12.165 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:06:57.607 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:15:12.166 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:06:57.608 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:15:12.174 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:06:57.616 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:15:14.847 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:15:14.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.910+0000 7f9997d2c640 10 monclient: get_monmap_and_config 2026-02-17T11:15:14.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.910+0000 7f9997d2c640 10 monclient: build_initial_monmap 2026-02-17T11:15:14.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.910+0000 7f9997d2c640 10 monclient: monmap: 2026-02-17T11:15:14.914 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:14.914 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:14.914 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:15:14.912109+0000 2026-02-17T11:15:14.914 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:15:14.912109+0000 2026-02-17T11:15:14.914 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:14.914 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:14.914 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:15:14.914 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:15:14.914 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:15:14.914 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:15:14.914 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:15:14.914 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:15:14.915 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:14.915 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.911+0000 7f9997d2c640 1 Processor -- start 2026-02-17T11:15:14.915 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.911+0000 7f9997d2c640 1 -- start start 2026-02-17T11:15:14.915 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.911+0000 7f9997d2c640 10 monclient: init 2026-02-17T11:15:14.923 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.911+0000 7f9997d2c640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:14.923 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.911+0000 7f9997d2c640 10 monclient: _add_conns ranks=[3,1,5,0,4,2] 2026-02-17T11:15:14.923 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.911+0000 7f9997d2c640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f999015d370 0x7f999015d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:14.924 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.911+0000 7f9997d2c640 10 monclient(hunting): picked mon.noname-a con 0x7f999015d370 addr v2:10.20.193.49:3300/0 2026-02-17T11:15:14.924 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.911+0000 7f9997d2c640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f99900c7e20 addr v1:10.20.193.97:6789/0 2026-02-17T11:15:14.924 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.911+0000 7f9997d2c640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f99900c74c0 0x7f99900c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:14.924 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.911+0000 7f9997d2c640 10 monclient(hunting): picked mon.noname-c con 0x7f99900c74c0 addr v2:10.20.193.157:3300/0 2026-02-17T11:15:14.924 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.911+0000 7f9997d2c640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99900c8350 con 0x7f99900c7e20 2026-02-17T11:15:14.924 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.911+0000 7f9997d2c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:14.924 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.911+0000 7f9997d2c640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f999015b710 con 0x7f999015d370 2026-02-17T11:15:14.924 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.911+0000 7f9997d2c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:14.924 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.911+0000 7f9997d2c640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f99900c9240 con 0x7f99900c74c0 2026-02-17T11:15:14.924 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.911+0000 7f9997d2c640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:14.924 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.911+0000 7f9997d2c640 10 monclient(hunting): authenticate will time out at 1391.575578s 2026-02-17T11:15:14.925 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.912+0000 7f99962a2640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f99900c74c0 0x7f99900c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:14.925 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.912+0000 7f9995aa1640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f999015d370 0x7f999015d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:14.925 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.912+0000 7f99952a0640 1 --1- >> v1:10.20.193.97:6789/0 conn(0x7f99900c7e20 0x7f999015b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.97:6789/0 says I am v1:10.20.193.49:38692/0 (socket says 10.20.193.49:38692) 2026-02-17T11:15:14.925 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.912+0000 7f99952a0640 1 -- 10.20.193.49:0/2159526758 learned_addr learned my addr 10.20.193.49:0/2159526758 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:15:14.925 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.912+0000 7f99962a2640 10 monclient(hunting): get_auth_request con 0x7f99900c74c0 auth_method 0 2026-02-17T11:15:14.925 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.912+0000 7f99962a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:14.925 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.912+0000 7f99962a2640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:14.925 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.912+0000 7f99962a2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:14.925 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.912+0000 7f9995aa1640 10 monclient(hunting): get_auth_request con 0x7f999015d370 auth_method 0 2026-02-17T11:15:14.926 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.912+0000 7f9995aa1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:14.926 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.912+0000 7f9995aa1640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:14.926 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.912+0000 7f9995aa1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:14.926 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.912+0000 7f99962a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:14.926 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.912+0000 7f99962a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:14.926 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.912+0000 7f99962a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:14.926 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.912+0000 7f9995aa1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:14.926 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.912+0000 7f9995aa1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:14.926 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.912+0000 7f9995aa1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:14.926 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.913+0000 7f99962a2640 10 monclient(hunting): handle_auth_done global_id 5108 payload 274 2026-02-17T11:15:14.926 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.913+0000 7f99962a2640 1 -- 10.20.193.49:0/2159526758 >> v2:10.20.193.49:3300/0 conn(0x7f999015d370 msgr2=0x7f999015d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:15:14.926 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.913+0000 7f99962a2640 1 --2- 10.20.193.49:0/2159526758 >> v2:10.20.193.49:3300/0 conn(0x7f999015d370 0x7f999015d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:14.927 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.913+0000 7f99962a2640 1 -- 10.20.193.49:0/2159526758 >> v1:10.20.193.97:6789/0 conn(0x7f99900c7e20 legacy=0x7f999015b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:14.927 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.913+0000 7f99962a2640 10 monclient: _finish_hunting 0 2026-02-17T11:15:14.927 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.913+0000 7f99962a2640 1 monclient: found mon.noname-c 2026-02-17T11:15:14.927 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.913+0000 7f99962a2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:14.927 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.913+0000 7f99962a2640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:15:14.927 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.913+0000 7f99962a2640 1 -- 10.20.193.49:0/2159526758 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99900c8630 con 0x7f99900c74c0 2026-02-17T11:15:14.927 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.914+0000 7f99962a2640 1 --2- 10.20.193.49:0/2159526758 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f99900c74c0 0x7f99900c52b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f999015dcf0 tx=0x7f998c02f1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5f567ba8d08296d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:14.927 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.916+0000 7f9994a9f640 1 -- 10.20.193.49:0/2159526758 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f998c03c070 con 0x7f99900c74c0 2026-02-17T11:15:14.927 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.916+0000 7f9994a9f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:14.927 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.916+0000 7f9994a9f640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:15:14.927 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.916+0000 7f9994a9f640 10 monclient: dump: 2026-02-17T11:15:14.927 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:14.928 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:14.928 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:14.928 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:14.928 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:14.928 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:14.928 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:14.928 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:14.928 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:14.928 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:14.928 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.916+0000 7f9994a9f640 10 monclient: _finish_auth 0 2026-02-17T11:15:14.928 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.916+0000 7f9994a9f640 10 monclient: _check_auth_tickets 2026-02-17T11:15:14.928 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.916+0000 7f9994a9f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:14.928 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.916+0000 7f9994a9f640 1 -- 10.20.193.49:0/2159526758 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f998c037440 con 0x7f99900c74c0 2026-02-17T11:15:14.929 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.916+0000 7f9994a9f640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:14.929 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.916+0000 7f9994a9f640 1 -- 10.20.193.49:0/2159526758 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f998c037810 con 0x7f99900c74c0 2026-02-17T11:15:14.929 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.916+0000 7f9994a9f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:14.929 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.916+0000 7f9994a9f640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:15:14.929 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.916+0000 7f9994a9f640 10 monclient: dump: 2026-02-17T11:15:14.929 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:14.929 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:14.929 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:14.929 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:14.929 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:14.929 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:14.929 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:14.930 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:14.930 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:14.930 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:14.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.916+0000 7f9997d2c640 5 monclient: authenticate success, global_id 5108 2026-02-17T11:15:14.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.916+0000 7f9997d2c640 10 monclient: get_monmap_and_config success 2026-02-17T11:15:14.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.916+0000 7f9997d2c640 4 set_mon_vals no callback set 2026-02-17T11:15:14.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.916+0000 7f9997d2c640 10 monclient: shutdown 2026-02-17T11:15:14.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.916+0000 7f9997d2c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:14.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.916+0000 7f9997d2c640 1 -- 10.20.193.49:0/2159526758 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f99900c74c0 msgr2=0x7f99900c52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:14.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.916+0000 7f9997d2c640 1 --2- 10.20.193.49:0/2159526758 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f99900c74c0 0x7f99900c52b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f999015dcf0 tx=0x7f998c02f1c0 comp rx=0 tx=0).stop 2026-02-17T11:15:14.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.916+0000 7f9997d2c640 1 -- 10.20.193.49:0/2159526758 shutdown_connections 2026-02-17T11:15:14.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.916+0000 7f9997d2c640 1 --2- 10.20.193.49:0/2159526758 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f99900c74c0 0x7f99900c52b0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:14.931 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.916+0000 7f9997d2c640 1 --2- 10.20.193.49:0/2159526758 >> v2:10.20.193.49:3300/0 conn(0x7f999015d370 0x7f999015d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:14.931 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.916+0000 7f9997d2c640 1 -- 10.20.193.49:0/2159526758 >> 10.20.193.49:0/2159526758 conn(0x7f99900c9f20 msgr2=0x7f99900ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:14.931 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.916+0000 7f9997d2c640 1 -- 10.20.193.49:0/2159526758 shutdown_connections 2026-02-17T11:15:14.931 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.916+0000 7f9997d2c640 1 -- 10.20.193.49:0/2159526758 wait complete. 2026-02-17T11:15:14.931 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.917+0000 7f9997d2c640 10 monclient: build_initial_monmap 2026-02-17T11:15:14.931 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.917+0000 7f9997d2c640 10 monclient: monmap: 2026-02-17T11:15:14.931 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:14.931 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:15:14.931 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:15:14.931 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:15:14.931 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:14.931 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:14.932 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:15:14.932 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:15:14.932 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:15:14.932 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:14.932 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.917+0000 7f9997d2c640 1 librados: starting msgr at 2026-02-17T11:15:14.932 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.917+0000 7f9997d2c640 1 librados: starting objecter 2026-02-17T11:15:14.932 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.917+0000 7f9997d2c640 1 Processor -- start 2026-02-17T11:15:14.932 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.917+0000 7f9997d2c640 1 -- start start 2026-02-17T11:15:14.932 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.917+0000 7f9997d2c640 1 librados: setting wanted keys 2026-02-17T11:15:14.932 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.917+0000 7f9997d2c640 1 librados: calling monclient init 2026-02-17T11:15:14.932 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.917+0000 7f9997d2c640 10 monclient: init 2026-02-17T11:15:14.932 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.917+0000 7f9997d2c640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:14.932 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.917+0000 7f9997d2c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:15:14.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.917+0000 7f9997d2c640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f99900c74c0 0x7f99901f4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:14.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.917+0000 7f9997d2c640 10 monclient(hunting): picked mon.noname-a con 0x7f99900c74c0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:15:14.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.917+0000 7f9997d2c640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f99900c7e20 0x7f9990073ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:14.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.917+0000 7f9997d2c640 10 monclient(hunting): picked mon.noname-b con 0x7f99900c7e20 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:15:14.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.917+0000 7f9997d2c640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f999015d370 0x7f9990144bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:14.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.917+0000 7f9997d2c640 10 monclient(hunting): picked mon.noname-c con 0x7f999015d370 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:15:14.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.917+0000 7f9997d2c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:14.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.917+0000 7f9997d2c640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f99900c8ed0 con 0x7f99900c74c0 2026-02-17T11:15:14.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.917+0000 7f9997d2c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:14.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.917+0000 7f9997d2c640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f99900c8bf0 con 0x7f99900c7e20 2026-02-17T11:15:14.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.917+0000 7f9997d2c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:14.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.917+0000 7f9997d2c640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f99900c96d0 con 0x7f999015d370 2026-02-17T11:15:14.933 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.917+0000 7f9997d2c640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:14.934 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.917+0000 7f9997d2c640 10 monclient(hunting): authenticate will time out at 1391.581777s 2026-02-17T11:15:14.934 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.918+0000 7f9995aa1640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f99900c74c0 0x7f99901f4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:14.934 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.918+0000 7f99962a2640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f999015d370 0x7f9990144bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:14.934 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.918+0000 7f99952a0640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f99900c7e20 0x7f9990073ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:14.934 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.918+0000 7f99962a2640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f999015d370 0x7f9990144bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:38354/0 (socket says 10.20.193.49:38354) 2026-02-17T11:15:14.934 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.918+0000 7f99962a2640 1 -- 10.20.193.49:0/453832729 learned_addr learned my addr 10.20.193.49:0/453832729 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:14.934 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.918+0000 7f99962a2640 10 monclient(hunting): get_auth_request con 0x7f999015d370 auth_method 0 2026-02-17T11:15:14.934 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.918+0000 7f99962a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:14.934 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.918+0000 7f99962a2640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:14.934 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.918+0000 7f99962a2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:14.934 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.918+0000 7f9995aa1640 10 monclient(hunting): get_auth_request con 0x7f99900c74c0 auth_method 0 2026-02-17T11:15:14.934 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.918+0000 7f9995aa1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:14.935 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.918+0000 7f9995aa1640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:14.935 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.918+0000 7f9995aa1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:14.935 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.918+0000 7f99952a0640 10 monclient(hunting): get_auth_request con 0x7f99900c7e20 auth_method 0 2026-02-17T11:15:14.935 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.918+0000 7f99952a0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:14.935 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.918+0000 7f99952a0640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:14.935 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.918+0000 7f99952a0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:14.935 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.918+0000 7f99962a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:14.935 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.918+0000 7f99962a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:14.935 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.918+0000 7f99962a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:14.935 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.918+0000 7f9995aa1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:14.935 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.918+0000 7f9995aa1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:14.935 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.918+0000 7f9995aa1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:14.935 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.918+0000 7f99952a0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:14.936 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.918+0000 7f99952a0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:14.936 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.918+0000 7f99952a0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:14.936 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.919+0000 7f99962a2640 10 monclient(hunting): handle_auth_done global_id 5111 payload 824 2026-02-17T11:15:14.936 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.919+0000 7f99962a2640 1 -- 10.20.193.49:0/453832729 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f99900c7e20 msgr2=0x7f9990073ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:14.936 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.919+0000 7f99962a2640 1 --2- 10.20.193.49:0/453832729 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f99900c7e20 0x7f9990073ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:14.936 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.919+0000 7f99962a2640 1 -- 10.20.193.49:0/453832729 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f99900c74c0 msgr2=0x7f99901f4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:14.936 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.919+0000 7f99962a2640 1 --2- 10.20.193.49:0/453832729 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f99900c74c0 0x7f99901f4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:14.936 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.919+0000 7f99962a2640 10 monclient: _finish_hunting 0 2026-02-17T11:15:14.936 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.919+0000 7f99962a2640 1 monclient: found mon.noname-c 2026-02-17T11:15:14.936 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.919+0000 7f99962a2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:14.937 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.919+0000 7f99962a2640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:15:14.937 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.919+0000 7f99962a2640 1 -- 10.20.193.49:0/453832729 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99901f24c0 con 0x7f999015d370 2026-02-17T11:15:14.937 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.920+0000 7f99962a2640 1 --2- 10.20.193.49:0/453832729 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f999015d370 0x7f9990144bb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f998c03a040 tx=0x7f998c004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:14.937 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.920+0000 7f997e7fc640 10 client.?.objecter ms_handle_connect 0x7f999015d370 2026-02-17T11:15:14.937 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.920+0000 7f997e7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T11:15:14.940 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.922+0000 7f997e7fc640 1 -- 10.20.193.49:0/453832729 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f998c03c050 con 0x7f999015d370 2026-02-17T11:15:14.941 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.922+0000 7f997e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:14.941 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.922+0000 7f997e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:15:14.941 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.922+0000 7f997e7fc640 10 monclient: dump: 2026-02-17T11:15:14.941 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:14.941 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:14.941 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:14.941 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:14.941 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:14.941 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:14.941 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:14.941 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:14.941 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:14.942 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:14.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.922+0000 7f997e7fc640 10 monclient: _finish_auth 0 2026-02-17T11:15:14.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.922+0000 7f997e7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:15:14.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.922+0000 7f997e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:14.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.922+0000 7f9997d2c640 5 monclient: authenticate success, global_id 5111 2026-02-17T11:15:14.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.922+0000 7f9997d2c640 10 monclient: _renew_subs 2026-02-17T11:15:14.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.922+0000 7f9997d2c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:15:14.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.922+0000 7f9997d2c640 1 -- 10.20.193.49:0/453832729 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9990072920 con 0x7f999015d370 2026-02-17T11:15:14.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.922+0000 7f9997d2c640 10 client.5111.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:14.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.922+0000 7f9997d2c640 10 monclient: _renew_subs 2026-02-17T11:15:14.942 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.922+0000 7f9997d2c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:15:14.943 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.922+0000 7f9997d2c640 1 -- 10.20.193.49:0/453832729 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9990072ee0 con 0x7f999015d370 2026-02-17T11:15:14.943 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.922+0000 7f9997d2c640 1 librados: init done 2026-02-17T11:15:14.943 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.922+0000 7f997e7fc640 1 -- 10.20.193.49:0/453832729 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f998c048070 con 0x7f999015d370 2026-02-17T11:15:14.943 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.922+0000 7f997e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:14.943 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.922+0000 7f997e7fc640 1 -- 10.20.193.49:0/453832729 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f998c035a50 con 0x7f999015d370 2026-02-17T11:15:14.943 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.922+0000 7f997e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:14.943 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.922+0000 7f997e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:15:14.943 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.922+0000 7f997e7fc640 10 monclient: dump: 2026-02-17T11:15:14.943 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:14.943 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:14.943 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:14.943 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:14.943 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:14.944 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:14.944 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:14.944 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:14.944 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:14.944 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:14.944 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.922+0000 7f997ffff640 4 set_mon_vals no callback set 2026-02-17T11:15:14.944 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.922+0000 7f9997d2c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:14.944 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.922+0000 7f9997d2c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:14.944 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.922+0000 7f9997d2c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:15:14.944 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.922+0000 7f9997d2c640 1 -- 10.20.193.49:0/453832729 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f999015d750 con 0x7f999015d370 2026-02-17T11:15:14.944 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.933+0000 7f997e7fc640 1 -- 10.20.193.49:0/453832729 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f998c035bf0 con 0x7f999015d370 2026-02-17T11:15:14.944 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.934+0000 7f997e7fc640 1 --2- 10.20.193.49:0/453832729 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f9960079170 0x7f996007b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:14.945 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.934+0000 7f9995aa1640 1 --2- 10.20.193.49:0/453832729 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f9960079170 0x7f996007b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:14.945 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.934+0000 7f9995aa1640 10 monclient: get_auth_request con 0x7f9960079170 auth_method 0 2026-02-17T11:15:14.945 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.935+0000 7f9995aa1640 1 --2- 10.20.193.49:0/453832729 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f9960079170 0x7f996007b630 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9980009c40 tx=0x7f9980009290 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:14.945 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.935+0000 7f997e7fc640 10 client.5111.objecter ms_handle_connect 0x7f9960079170 2026-02-17T11:15:14.945 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.936+0000 7f997e7fc640 1 -- 10.20.193.49:0/453832729 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f998c0be100 con 0x7f999015d370 2026-02-17T11:15:14.945 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.936+0000 7f997e7fc640 10 client.5111.objecter ms_dispatch2 0x7f9990000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:15:14.945 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.936+0000 7f997e7fc640 3 client.5111.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:15:14.945 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.936+0000 7f997e7fc640 3 client.5111.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:15:14.945 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:14.936+0000 7f997e7fc640 20 client.5111.objecter dump_active .. 0 homeless 2026-02-17T11:15:15.038 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:15.036+0000 7f997e7fc640 1 -- 10.20.193.49:0/453832729 <== mon.2 v2:10.20.193.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f998c0886e0 con 0x7f999015d370 2026-02-17T11:15:15.038 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:15.036+0000 7f997e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:15.038 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:15.036+0000 7f997e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:15:15.141 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:15.139+0000 7f9997d2c640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:15:15.141 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:15.139+0000 7f9997d2c640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:15:15.141 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:15.139+0000 7f9997d2c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:15:15.141 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:15.139+0000 7f9997d2c640 1 -- 10.20.193.49:0/453832729 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f999006ff00 con 0x7f999015d370 2026-02-17T11:15:15.143 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:15.141+0000 7f997e7fc640 1 -- 10.20.193.49:0/453832729 <== mon.2 v2:10.20.193.157:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f998c08c9e0 con 0x7f999015d370 2026-02-17T11:15:15.143 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:15.141+0000 7f997e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:15:15.143 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:15.141+0000 7f997e7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:15:15.143 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:15:15.143 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:15:15.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:15.143+0000 7f9997d2c640 10 librados: watch_flush enter 2026-02-17T11:15:15.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:15.143+0000 7f9997d2c640 10 librados: watch_flush exit 2026-02-17T11:15:15.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:15.143+0000 7f9997d2c640 20 client.5111.objecter shutdown clearing up homeless session... 2026-02-17T11:15:15.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:15.143+0000 7f9997d2c640 10 client.5111.objecter successfully canceled tick 2026-02-17T11:15:15.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:15.143+0000 7f9997d2c640 1 -- 10.20.193.49:0/453832729 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f9960079170 msgr2=0x7f996007b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:15.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:15.143+0000 7f9997d2c640 1 --2- 10.20.193.49:0/453832729 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f9960079170 0x7f996007b630 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9980009c40 tx=0x7f9980009290 comp rx=0 tx=0).stop 2026-02-17T11:15:15.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:15.143+0000 7f9997d2c640 10 monclient: shutdown 2026-02-17T11:15:15.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:15.143+0000 7f9997d2c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:15.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:15.143+0000 7f9997d2c640 1 -- 10.20.193.49:0/453832729 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f999015d370 msgr2=0x7f9990144bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:15.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:15.143+0000 7f9997d2c640 1 --2- 10.20.193.49:0/453832729 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f999015d370 0x7f9990144bb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f998c03a040 tx=0x7f998c004b40 comp rx=0 tx=0).stop 2026-02-17T11:15:15.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:15.143+0000 7f9997d2c640 1 -- 10.20.193.49:0/453832729 shutdown_connections 2026-02-17T11:15:15.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:15.143+0000 7f9997d2c640 1 --2- 10.20.193.49:0/453832729 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f9960079170 0x7f996007b630 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:15.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:15.143+0000 7f9997d2c640 1 --2- 10.20.193.49:0/453832729 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f999015d370 0x7f9990144bb0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:15.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:15.143+0000 7f9997d2c640 1 --2- 10.20.193.49:0/453832729 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f99900c7e20 0x7f9990073ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:15.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:15.143+0000 7f9997d2c640 1 --2- 10.20.193.49:0/453832729 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f99900c74c0 0x7f99901f4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:15.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:15.143+0000 7f9997d2c640 1 -- 10.20.193.49:0/453832729 >> 10.20.193.49:0/453832729 conn(0x7f99900c9f20 msgr2=0x7f99900ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:15.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:15.143+0000 7f9997d2c640 1 -- 10.20.193.49:0/453832729 shutdown_connections 2026-02-17T11:15:15.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:15.143+0000 7f9997d2c640 1 -- 10.20.193.49:0/453832729 wait complete. 2026-02-17T11:15:15.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:15.143+0000 7f9997d2c640 1 librados: shutdown 2026-02-17T11:15:18.155 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:15:18.223 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.220+0000 7f50fa2a7640 10 monclient: get_monmap_and_config 2026-02-17T11:15:18.224 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.220+0000 7f50fa2a7640 10 monclient: build_initial_monmap 2026-02-17T11:15:18.224 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.220+0000 7f50fa2a7640 10 monclient: monmap: 2026-02-17T11:15:18.224 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:18.224 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:18.224 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:15:18.222470+0000 2026-02-17T11:15:18.224 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:15:18.222470+0000 2026-02-17T11:15:18.224 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:18.224 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:18.224 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:15:18.224 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:15:18.225 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:15:18.225 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:15:18.225 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:15:18.225 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:15:18.225 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:18.225 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.221+0000 7f50fa2a7640 1 Processor -- start 2026-02-17T11:15:18.225 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.221+0000 7f50fa2a7640 1 -- start start 2026-02-17T11:15:18.225 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.221+0000 7f50fa2a7640 10 monclient: init 2026-02-17T11:15:18.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.221+0000 7f50fa2a7640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:18.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.221+0000 7f50fa2a7640 10 monclient: _add_conns ranks=[4,3,2,5,1,0] 2026-02-17T11:15:18.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.221+0000 7f50fa2a7640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f50f40c7170 0x7f50f40c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:18.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.221+0000 7f50fa2a7640 10 monclient(hunting): picked mon.noname-b con 0x7f50f40c7170 addr v2:10.20.193.97:3300/0 2026-02-17T11:15:18.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.221+0000 7f50fa2a7640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f50f40c48c0 0x7f50f40749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:18.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.221+0000 7f50fa2a7640 10 monclient(hunting): picked mon.noname-a con 0x7f50f40c48c0 addr v2:10.20.193.49:3300/0 2026-02-17T11:15:18.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.221+0000 7f50fa2a7640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f50f4074ef0 addr v1:10.20.193.157:6789/0 2026-02-17T11:15:18.229 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.221+0000 7f50fa2a7640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50f415a9a0 con 0x7f50f4074ef0 2026-02-17T11:15:18.229 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.221+0000 7f50fa2a7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:18.229 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.221+0000 7f50fa2a7640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f50f40c8530 con 0x7f50f40c48c0 2026-02-17T11:15:18.229 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.221+0000 7f50fa2a7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:18.229 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.221+0000 7f50fa2a7640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f50f40c5270 con 0x7f50f40c7170 2026-02-17T11:15:18.229 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.221+0000 7f50fa2a7640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:18.229 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.221+0000 7f50fa2a7640 10 monclient(hunting): authenticate will time out at 1394.885927s 2026-02-17T11:15:18.229 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.222+0000 7f50f37fe640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f50f40c48c0 0x7f50f40749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:18.229 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.222+0000 7f50f3fff640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f50f40c7170 0x7f50f40c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:18.229 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.222+0000 7f50f881d640 1 --1- >> v1:10.20.193.157:6789/0 conn(0x7f50f4074ef0 0x7f50f40c89c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.157:6789/0 says I am v1:10.20.193.49:35196/0 (socket says 10.20.193.49:35196) 2026-02-17T11:15:18.229 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.222+0000 7f50f881d640 1 -- 10.20.193.49:0/3158853950 learned_addr learned my addr 10.20.193.49:0/3158853950 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:15:18.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.222+0000 7f50f3fff640 10 monclient(hunting): get_auth_request con 0x7f50f40c7170 auth_method 0 2026-02-17T11:15:18.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.222+0000 7f50f3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:18.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.222+0000 7f50f3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:18.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.222+0000 7f50f3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:18.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.222+0000 7f50f37fe640 10 monclient(hunting): get_auth_request con 0x7f50f40c48c0 auth_method 0 2026-02-17T11:15:18.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.222+0000 7f50f37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:18.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.222+0000 7f50f37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:18.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.222+0000 7f50f37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:18.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.223+0000 7f50f3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:18.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.223+0000 7f50f3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:18.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.223+0000 7f50f3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:18.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.223+0000 7f50f37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:18.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.223+0000 7f50f37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:18.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.223+0000 7f50f37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:18.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.223+0000 7f50f37fe640 10 monclient(hunting): handle_auth_done global_id 5094 payload 274 2026-02-17T11:15:18.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.223+0000 7f50f37fe640 1 -- 10.20.193.49:0/3158853950 >> v2:10.20.193.97:3300/0 conn(0x7f50f40c7170 msgr2=0x7f50f40c7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:15:18.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.223+0000 7f50f37fe640 1 --2- 10.20.193.49:0/3158853950 >> v2:10.20.193.97:3300/0 conn(0x7f50f40c7170 0x7f50f40c7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:18.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.223+0000 7f50f37fe640 1 -- 10.20.193.49:0/3158853950 >> v1:10.20.193.157:6789/0 conn(0x7f50f4074ef0 legacy=0x7f50f40c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:18.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.223+0000 7f50f37fe640 10 monclient: _finish_hunting 0 2026-02-17T11:15:18.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.223+0000 7f50f37fe640 1 monclient: found mon.noname-a 2026-02-17T11:15:18.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.223+0000 7f50f37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:18.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.223+0000 7f50f37fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:15:18.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.223+0000 7f50f37fe640 1 -- 10.20.193.49:0/3158853950 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50f40c5550 con 0x7f50f40c48c0 2026-02-17T11:15:18.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.224+0000 7f50f37fe640 1 --2- 10.20.193.49:0/3158853950 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f50f40c48c0 0x7f50f40749b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f50f40723c0 tx=0x7f50e402ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baf6e36861bf02ad server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:18.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.226+0000 7f50f2ffd640 1 -- 10.20.193.49:0/3158853950 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e403c070 con 0x7f50f40c48c0 2026-02-17T11:15:18.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.226+0000 7f50f2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:18.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.226+0000 7f50f2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:15:18.238 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.226+0000 7f50f2ffd640 10 monclient: dump: 2026-02-17T11:15:18.239 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:18.239 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:18.239 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:18.239 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:18.239 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:18.239 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:18.239 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:18.239 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:18.239 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:18.239 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:18.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.226+0000 7f50f2ffd640 10 monclient: _finish_auth 0 2026-02-17T11:15:18.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.226+0000 7f50f2ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:15:18.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.226+0000 7f50f2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:18.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.226+0000 7f50f2ffd640 1 -- 10.20.193.49:0/3158853950 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50e402faf0 con 0x7f50f40c48c0 2026-02-17T11:15:18.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.226+0000 7f50f2ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:18.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.226+0000 7f50fa2a7640 5 monclient: authenticate success, global_id 5094 2026-02-17T11:15:18.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.226+0000 7f50f2ffd640 1 -- 10.20.193.49:0/3158853950 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e4037440 con 0x7f50f40c48c0 2026-02-17T11:15:18.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.226+0000 7f50f2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:18.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.226+0000 7f50f2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:15:18.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.226+0000 7f50f2ffd640 10 monclient: dump: 2026-02-17T11:15:18.240 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:18.240 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:18.240 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:18.241 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:18.241 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:18.241 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:18.241 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:18.241 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:18.241 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:18.241 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:18.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.226+0000 7f50fa2a7640 10 monclient: get_monmap_and_config success 2026-02-17T11:15:18.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.226+0000 7f50fa2a7640 4 set_mon_vals no callback set 2026-02-17T11:15:18.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.226+0000 7f50fa2a7640 10 monclient: shutdown 2026-02-17T11:15:18.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.226+0000 7f50fa2a7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:18.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.226+0000 7f50fa2a7640 1 -- 10.20.193.49:0/3158853950 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f50f40c48c0 msgr2=0x7f50f40749b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:18.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.226+0000 7f50fa2a7640 1 --2- 10.20.193.49:0/3158853950 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f50f40c48c0 0x7f50f40749b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f50f40723c0 tx=0x7f50e402ede0 comp rx=0 tx=0).stop 2026-02-17T11:15:18.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.226+0000 7f50fa2a7640 1 -- 10.20.193.49:0/3158853950 shutdown_connections 2026-02-17T11:15:18.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.226+0000 7f50fa2a7640 1 --2- 10.20.193.49:0/3158853950 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f50f40c48c0 0x7f50f40749b0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:18.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.226+0000 7f50fa2a7640 1 --2- 10.20.193.49:0/3158853950 >> v2:10.20.193.97:3300/0 conn(0x7f50f40c7170 0x7f50f40c7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:18.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.226+0000 7f50fa2a7640 1 -- 10.20.193.49:0/3158853950 >> 10.20.193.49:0/3158853950 conn(0x7f50f40c9f40 msgr2=0x7f50f40ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:18.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.226+0000 7f50fa2a7640 1 -- 10.20.193.49:0/3158853950 shutdown_connections 2026-02-17T11:15:18.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.227+0000 7f50fa2a7640 1 -- 10.20.193.49:0/3158853950 wait complete. 2026-02-17T11:15:18.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.227+0000 7f50fa2a7640 10 monclient: build_initial_monmap 2026-02-17T11:15:18.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.227+0000 7f50fa2a7640 10 monclient: monmap: 2026-02-17T11:15:18.242 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:18.242 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:15:18.243 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:15:18.243 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:15:18.243 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:18.243 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:18.243 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:15:18.243 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:15:18.243 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:15:18.243 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:18.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.227+0000 7f50fa2a7640 1 librados: starting msgr at 2026-02-17T11:15:18.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.227+0000 7f50fa2a7640 1 librados: starting objecter 2026-02-17T11:15:18.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.227+0000 7f50fa2a7640 1 Processor -- start 2026-02-17T11:15:18.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.227+0000 7f50fa2a7640 1 -- start start 2026-02-17T11:15:18.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.227+0000 7f50fa2a7640 1 librados: setting wanted keys 2026-02-17T11:15:18.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.227+0000 7f50fa2a7640 1 librados: calling monclient init 2026-02-17T11:15:18.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.227+0000 7f50fa2a7640 10 monclient: init 2026-02-17T11:15:18.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.228+0000 7f50fa2a7640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:18.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.228+0000 7f50fa2a7640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:15:18.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.228+0000 7f50fa2a7640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f50f4074ef0 0x7f50f414ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:18.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.228+0000 7f50fa2a7640 10 monclient(hunting): picked mon.noname-a con 0x7f50f4074ef0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:15:18.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.228+0000 7f50fa2a7640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f50f40c48c0 0x7f50f41f2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:18.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.228+0000 7f50fa2a7640 10 monclient(hunting): picked mon.noname-c con 0x7f50f40c48c0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:15:18.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.228+0000 7f50fa2a7640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f50f40c7170 0x7f50f41f2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:18.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.228+0000 7f50fa2a7640 10 monclient(hunting): picked mon.noname-b con 0x7f50f40c7170 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:15:18.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.228+0000 7f50fa2a7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:18.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.228+0000 7f50fa2a7640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f50f40c81c0 con 0x7f50f4074ef0 2026-02-17T11:15:18.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.228+0000 7f50fa2a7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:18.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.228+0000 7f50fa2a7640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f50f40c7ee0 con 0x7f50f40c7170 2026-02-17T11:15:18.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.228+0000 7f50fa2a7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:18.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.228+0000 7f50fa2a7640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f50f40c90d0 con 0x7f50f40c48c0 2026-02-17T11:15:18.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.228+0000 7f50fa2a7640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:18.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.228+0000 7f50fa2a7640 10 monclient(hunting): authenticate will time out at 1394.892103s 2026-02-17T11:15:18.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.228+0000 7f50f3fff640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f50f4074ef0 0x7f50f414ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:18.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.228+0000 7f50f3fff640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f50f4074ef0 0x7f50f414ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:48058/0 (socket says 10.20.193.49:48058) 2026-02-17T11:15:18.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.228+0000 7f50f3fff640 1 -- 10.20.193.49:0/3461659467 learned_addr learned my addr 10.20.193.49:0/3461659467 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:18.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.228+0000 7f50f3fff640 10 monclient(hunting): get_auth_request con 0x7f50f4074ef0 auth_method 0 2026-02-17T11:15:18.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.228+0000 7f50f3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:18.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.228+0000 7f50f3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:18.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.228+0000 7f50f3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:18.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.228+0000 7f50f881d640 1 --2- 10.20.193.49:0/3461659467 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f50f40c7170 0x7f50f41f2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:18.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.228+0000 7f50f37fe640 1 --2- 10.20.193.49:0/3461659467 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f50f40c48c0 0x7f50f41f2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:18.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.228+0000 7f50f881d640 10 monclient(hunting): get_auth_request con 0x7f50f40c7170 auth_method 0 2026-02-17T11:15:18.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.228+0000 7f50f881d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:18.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.228+0000 7f50f881d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:18.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.228+0000 7f50f881d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:18.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.228+0000 7f50f3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:18.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.228+0000 7f50f3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:18.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.228+0000 7f50f3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:18.247 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.228+0000 7f50f37fe640 10 monclient(hunting): get_auth_request con 0x7f50f40c48c0 auth_method 0 2026-02-17T11:15:18.247 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.228+0000 7f50f37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:18.247 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.228+0000 7f50f37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:18.247 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.228+0000 7f50f37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:18.247 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.229+0000 7f50f881d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:18.247 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.229+0000 7f50f881d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:18.247 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.229+0000 7f50f881d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:18.247 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.229+0000 7f50f37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:18.247 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.229+0000 7f50f37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:18.247 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.229+0000 7f50f37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:18.247 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.229+0000 7f50f3fff640 10 monclient(hunting): handle_auth_done global_id 5097 payload 824 2026-02-17T11:15:18.247 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.229+0000 7f50f3fff640 1 -- 10.20.193.49:0/3461659467 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f50f40c48c0 msgr2=0x7f50f41f2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:18.248 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.229+0000 7f50f3fff640 1 --2- 10.20.193.49:0/3461659467 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f50f40c48c0 0x7f50f41f2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:18.248 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.229+0000 7f50f3fff640 1 -- 10.20.193.49:0/3461659467 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f50f40c7170 msgr2=0x7f50f41f2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:18.248 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.229+0000 7f50f3fff640 1 --2- 10.20.193.49:0/3461659467 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f50f40c7170 0x7f50f41f2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:18.248 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.229+0000 7f50f3fff640 10 monclient: _finish_hunting 0 2026-02-17T11:15:18.248 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.229+0000 7f50f3fff640 1 monclient: found mon.noname-a 2026-02-17T11:15:18.248 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.229+0000 7f50f3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:18.248 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.229+0000 7f50f3fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:15:18.248 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.229+0000 7f50f3fff640 1 -- 10.20.193.49:0/3461659467 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50f41f16c0 con 0x7f50f4074ef0 2026-02-17T11:15:18.248 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.230+0000 7f50f3fff640 1 --2- 10.20.193.49:0/3461659467 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f50f4074ef0 0x7f50f414ad80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f50e000e890 tx=0x7f50e000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:18.248 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.230+0000 7f50f0ff9640 10 client.?.objecter ms_handle_connect 0x7f50f4074ef0 2026-02-17T11:15:18.248 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.230+0000 7f50f0ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T11:15:18.248 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.232+0000 7f50f0ff9640 1 -- 10.20.193.49:0/3461659467 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e0017070 con 0x7f50f4074ef0 2026-02-17T11:15:18.248 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.232+0000 7f50f0ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:18.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.232+0000 7f50f0ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:15:18.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.232+0000 7f50f0ff9640 10 monclient: dump: 2026-02-17T11:15:18.249 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:18.249 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:18.249 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:18.249 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:18.249 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:18.249 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:18.249 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:18.249 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:18.249 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:18.249 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:18.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.232+0000 7f50f0ff9640 10 monclient: _finish_auth 0 2026-02-17T11:15:18.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.232+0000 7f50f0ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:15:18.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.232+0000 7f50f0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:18.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.232+0000 7f50f0ff9640 1 -- 10.20.193.49:0/3461659467 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50e000c940 con 0x7f50f4074ef0 2026-02-17T11:15:18.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.232+0000 7f50f0ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:18.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.232+0000 7f50f0ff9640 1 -- 10.20.193.49:0/3461659467 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e000cd30 con 0x7f50f4074ef0 2026-02-17T11:15:18.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.232+0000 7f50f0ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:18.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.232+0000 7f50f0ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:15:18.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.232+0000 7f50f27fc640 4 set_mon_vals no callback set 2026-02-17T11:15:18.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.232+0000 7f50f0ff9640 10 monclient: dump: 2026-02-17T11:15:18.250 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:18.250 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:18.250 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:18.251 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:18.251 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:18.251 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:18.251 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:18.251 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:18.251 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:18.251 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:18.251 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.232+0000 7f50fa2a7640 5 monclient: authenticate success, global_id 5097 2026-02-17T11:15:18.251 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.232+0000 7f50fa2a7640 10 monclient: _renew_subs 2026-02-17T11:15:18.251 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.232+0000 7f50fa2a7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:18.251 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.232+0000 7f50fa2a7640 1 -- 10.20.193.49:0/3461659467 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50f41f19a0 con 0x7f50f4074ef0 2026-02-17T11:15:18.251 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.232+0000 7f50fa2a7640 10 client.5097.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:18.251 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.232+0000 7f50fa2a7640 10 monclient: _renew_subs 2026-02-17T11:15:18.252 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.232+0000 7f50fa2a7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:18.252 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.232+0000 7f50fa2a7640 1 -- 10.20.193.49:0/3461659467 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50f41f1f60 con 0x7f50f4074ef0 2026-02-17T11:15:18.252 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.232+0000 7f50fa2a7640 1 librados: init done 2026-02-17T11:15:18.252 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.233+0000 7f50fa2a7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:18.252 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.233+0000 7f50fa2a7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:18.252 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.233+0000 7f50fa2a7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:18.252 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.233+0000 7f50fa2a7640 1 -- 10.20.193.49:0/3461659467 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50f40c4d10 con 0x7f50f4074ef0 2026-02-17T11:15:18.254 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.244+0000 7f50f0ff9640 1 -- 10.20.193.49:0/3461659467 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f50e0013470 con 0x7f50f4074ef0 2026-02-17T11:15:18.254 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.245+0000 7f50f0ff9640 1 --2- 10.20.193.49:0/3461659467 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f50c4079190 0x7f50c407b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:18.254 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.245+0000 7f50f37fe640 1 --2- 10.20.193.49:0/3461659467 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f50c4079190 0x7f50c407b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:18.254 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.245+0000 7f50f37fe640 10 monclient: get_auth_request con 0x7f50c4079190 auth_method 0 2026-02-17T11:15:18.254 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.246+0000 7f50f0ff9640 1 -- 10.20.193.49:0/3461659467 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f50e005e540 con 0x7f50f4074ef0 2026-02-17T11:15:18.254 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.246+0000 7f50f0ff9640 10 client.5097.objecter ms_dispatch2 0x7f50f4000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:15:18.254 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.246+0000 7f50f0ff9640 3 client.5097.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:15:18.254 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.246+0000 7f50f0ff9640 3 client.5097.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:15:18.254 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.246+0000 7f50f0ff9640 20 client.5097.objecter dump_active .. 0 homeless 2026-02-17T11:15:18.255 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.246+0000 7f50f0ff9640 10 client.5097.objecter ms_handle_connect 0x7f50c4079190 2026-02-17T11:15:18.255 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.246+0000 7f50f37fe640 1 --2- 10.20.193.49:0/3461659467 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f50c4079190 0x7f50c407b650 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f50e4039000 tx=0x7f50e4033000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:18.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.345+0000 7f50f0ff9640 1 -- 10.20.193.49:0/3461659467 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f50e0062500 con 0x7f50f4074ef0 2026-02-17T11:15:18.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.345+0000 7f50f0ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:18.348 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.345+0000 7f50f0ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:15:18.447 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.444+0000 7f50fa2a7640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:15:18.447 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.444+0000 7f50fa2a7640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:15:18.447 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.444+0000 7f50fa2a7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:18.447 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.444+0000 7f50fa2a7640 1 -- 10.20.193.49:0/3461659467 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f50f415dd40 con 0x7f50f4074ef0 2026-02-17T11:15:18.449 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.447+0000 7f50f0ff9640 1 -- 10.20.193.49:0/3461659467 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f50e0066800 con 0x7f50f4074ef0 2026-02-17T11:15:18.449 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.447+0000 7f50f0ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:15:18.450 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.447+0000 7f50f0ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:15:18.450 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:15:18.450 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:15:18.452 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.448+0000 7f50fa2a7640 10 librados: watch_flush enter 2026-02-17T11:15:18.452 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.448+0000 7f50fa2a7640 10 librados: watch_flush exit 2026-02-17T11:15:18.452 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.448+0000 7f50fa2a7640 20 client.5097.objecter shutdown clearing up homeless session... 2026-02-17T11:15:18.452 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.448+0000 7f50fa2a7640 10 client.5097.objecter successfully canceled tick 2026-02-17T11:15:18.452 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.448+0000 7f50fa2a7640 1 -- 10.20.193.49:0/3461659467 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f50c4079190 msgr2=0x7f50c407b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:18.452 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.448+0000 7f50fa2a7640 1 --2- 10.20.193.49:0/3461659467 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f50c4079190 0x7f50c407b650 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f50e4039000 tx=0x7f50e4033000 comp rx=0 tx=0).stop 2026-02-17T11:15:18.452 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.448+0000 7f50fa2a7640 10 monclient: shutdown 2026-02-17T11:15:18.452 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.448+0000 7f50fa2a7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:18.452 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.448+0000 7f50fa2a7640 1 -- 10.20.193.49:0/3461659467 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f50f4074ef0 msgr2=0x7f50f414ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:18.452 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.448+0000 7f50fa2a7640 1 --2- 10.20.193.49:0/3461659467 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f50f4074ef0 0x7f50f414ad80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f50e000e890 tx=0x7f50e000ed60 comp rx=0 tx=0).stop 2026-02-17T11:15:18.453 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.448+0000 7f50fa2a7640 1 -- 10.20.193.49:0/3461659467 shutdown_connections 2026-02-17T11:15:18.453 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.448+0000 7f50fa2a7640 1 --2- 10.20.193.49:0/3461659467 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f50c4079190 0x7f50c407b650 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:18.453 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.448+0000 7f50fa2a7640 1 --2- 10.20.193.49:0/3461659467 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f50f40c7170 0x7f50f41f2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:18.453 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.448+0000 7f50fa2a7640 1 --2- 10.20.193.49:0/3461659467 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f50f40c48c0 0x7f50f41f2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:18.453 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.448+0000 7f50fa2a7640 1 --2- 10.20.193.49:0/3461659467 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f50f4074ef0 0x7f50f414ad80 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:18.453 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.448+0000 7f50fa2a7640 1 -- 10.20.193.49:0/3461659467 >> 10.20.193.49:0/3461659467 conn(0x7f50f40c9f40 msgr2=0x7f50f40cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:18.453 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.448+0000 7f50fa2a7640 1 -- 10.20.193.49:0/3461659467 shutdown_connections 2026-02-17T11:15:18.453 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.448+0000 7f50fa2a7640 1 -- 10.20.193.49:0/3461659467 wait complete. 2026-02-17T11:15:18.453 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:18.448+0000 7f50fa2a7640 1 librados: shutdown 2026-02-17T11:15:21.460 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:15:21.528 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.526+0000 7f8cef624640 10 monclient: get_monmap_and_config 2026-02-17T11:15:21.528 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.526+0000 7f8cef624640 10 monclient: build_initial_monmap 2026-02-17T11:15:21.528 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.526+0000 7f8cef624640 10 monclient: monmap: 2026-02-17T11:15:21.528 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:21.528 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:21.528 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:15:21.527450+0000 2026-02-17T11:15:21.528 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:15:21.527450+0000 2026-02-17T11:15:21.528 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:21.528 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:21.528 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:15:21.528 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:15:21.528 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:15:21.528 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:15:21.528 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:15:21.529 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:15:21.529 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:21.530 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.527+0000 7f8cef624640 1 Processor -- start 2026-02-17T11:15:21.530 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.527+0000 7f8cef624640 1 -- start start 2026-02-17T11:15:21.530 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.527+0000 7f8cef624640 10 monclient: init 2026-02-17T11:15:21.530 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.527+0000 7f8cef624640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:21.530 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.527+0000 7f8cef624640 10 monclient: _add_conns ranks=[3,2,4,1,5,0] 2026-02-17T11:15:21.530 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.527+0000 7f8cef624640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f8ce815d370 0x7f8ce815d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:21.530 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.528+0000 7f8cef624640 10 monclient(hunting): picked mon.noname-a con 0x7f8ce815d370 addr v2:10.20.193.49:3300/0 2026-02-17T11:15:21.530 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.528+0000 7f8cef624640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f8ce80c7e20 addr v1:10.20.193.157:6789/0 2026-02-17T11:15:21.530 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.528+0000 7f8cef624640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f8ce80c74c0 0x7f8ce80c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:21.530 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.528+0000 7f8cef624640 10 monclient(hunting): picked mon.noname-b con 0x7f8ce80c74c0 addr v2:10.20.193.97:3300/0 2026-02-17T11:15:21.530 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.528+0000 7f8cef624640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ce80c8350 con 0x7f8ce80c7e20 2026-02-17T11:15:21.530 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.528+0000 7f8cef624640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:21.530 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.528+0000 7f8cef624640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f8ce815b710 con 0x7f8ce815d370 2026-02-17T11:15:21.530 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.528+0000 7f8cef624640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:21.530 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.528+0000 7f8cef624640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f8ce80c9240 con 0x7f8ce80c74c0 2026-02-17T11:15:21.530 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.528+0000 7f8cef624640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:21.530 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.528+0000 7f8cef624640 10 monclient(hunting): authenticate will time out at 1398.191042s 2026-02-17T11:15:21.530 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.528+0000 7f8ced399640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f8ce815d370 0x7f8ce815d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:21.530 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.528+0000 7f8cedb9a640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f8ce80c74c0 0x7f8ce80c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:21.530 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.528+0000 7f8cecb98640 1 --1- >> v1:10.20.193.157:6789/0 conn(0x7f8ce80c7e20 0x7f8ce815b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.157:6789/0 says I am v1:10.20.193.49:35212/0 (socket says 10.20.193.49:35212) 2026-02-17T11:15:21.530 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.528+0000 7f8cecb98640 1 -- 10.20.193.49:0/284943901 learned_addr learned my addr 10.20.193.49:0/284943901 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:15:21.530 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.528+0000 7f8ced399640 10 monclient(hunting): get_auth_request con 0x7f8ce815d370 auth_method 0 2026-02-17T11:15:21.530 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.528+0000 7f8ced399640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:21.531 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.528+0000 7f8ced399640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:21.531 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.528+0000 7f8ced399640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:21.531 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.528+0000 7f8cedb9a640 10 monclient(hunting): get_auth_request con 0x7f8ce80c74c0 auth_method 0 2026-02-17T11:15:21.531 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.528+0000 7f8cedb9a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:21.531 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.528+0000 7f8cedb9a640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:21.531 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.528+0000 7f8cedb9a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:21.531 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.528+0000 7f8ced399640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:21.531 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.528+0000 7f8ced399640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:21.531 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.528+0000 7f8ced399640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:21.531 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.529+0000 7f8cedb9a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:21.531 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.529+0000 7f8cedb9a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:21.532 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.529+0000 7f8cedb9a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:21.532 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.529+0000 7f8ced399640 10 monclient(hunting): handle_auth_done global_id 5100 payload 274 2026-02-17T11:15:21.532 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.529+0000 7f8ced399640 1 -- 10.20.193.49:0/284943901 >> v2:10.20.193.97:3300/0 conn(0x7f8ce80c74c0 msgr2=0x7f8ce80c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:15:21.532 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.529+0000 7f8ced399640 1 --2- 10.20.193.49:0/284943901 >> v2:10.20.193.97:3300/0 conn(0x7f8ce80c74c0 0x7f8ce80c52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:21.532 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.529+0000 7f8ced399640 1 -- 10.20.193.49:0/284943901 >> v1:10.20.193.157:6789/0 conn(0x7f8ce80c7e20 legacy=0x7f8ce815b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:21.532 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.529+0000 7f8ced399640 10 monclient: _finish_hunting 0 2026-02-17T11:15:21.532 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.529+0000 7f8ced399640 1 monclient: found mon.noname-a 2026-02-17T11:15:21.532 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.529+0000 7f8ced399640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:21.532 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.529+0000 7f8ced399640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:15:21.532 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.529+0000 7f8ced399640 1 -- 10.20.193.49:0/284943901 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ce80c8630 con 0x7f8ce815d370 2026-02-17T11:15:21.532 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.530+0000 7f8ced399640 1 --2- 10.20.193.49:0/284943901 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f8ce815d370 0x7f8ce815d750 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f8ce815dcf0 tx=0x7f8cd802ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4a270605678a3df server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:21.533 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.531+0000 7f8cd7fff640 1 -- 10.20.193.49:0/284943901 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd803c070 con 0x7f8ce815d370 2026-02-17T11:15:21.533 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.531+0000 7f8cd7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:21.533 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.531+0000 7f8cd7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:15:21.533 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.531+0000 7f8cd7fff640 10 monclient: dump: 2026-02-17T11:15:21.533 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:21.533 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:21.533 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:21.533 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:21.533 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:21.533 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:21.533 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:21.533 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:21.533 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:21.533 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:21.533 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.531+0000 7f8cd7fff640 10 monclient: _finish_auth 0 2026-02-17T11:15:21.533 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.531+0000 7f8cd7fff640 10 monclient: _check_auth_tickets 2026-02-17T11:15:21.533 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.531+0000 7f8cd7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:21.533 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.531+0000 7f8cef624640 5 monclient: authenticate success, global_id 5100 2026-02-17T11:15:21.533 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.531+0000 7f8cef624640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:15:21.534 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.532+0000 7f8cd7fff640 1 -- 10.20.193.49:0/284943901 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cd802faf0 con 0x7f8ce815d370 2026-02-17T11:15:21.534 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.532+0000 7f8cd7fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:21.534 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.532+0000 7f8cd7fff640 1 -- 10.20.193.49:0/284943901 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd8037440 con 0x7f8ce815d370 2026-02-17T11:15:21.534 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.532+0000 7f8cd7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:21.534 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.532+0000 7f8cd7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:15:21.534 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.532+0000 7f8cd7fff640 10 monclient: dump: 2026-02-17T11:15:21.534 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:21.534 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:21.534 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:21.534 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:21.534 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:21.534 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:21.535 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:21.535 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:21.535 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:21.535 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:21.535 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.532+0000 7f8cef624640 10 monclient: get_monmap_and_config success 2026-02-17T11:15:21.535 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.532+0000 7f8cef624640 4 set_mon_vals no callback set 2026-02-17T11:15:21.535 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.532+0000 7f8cef624640 10 monclient: shutdown 2026-02-17T11:15:21.535 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.532+0000 7f8cef624640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:21.535 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.532+0000 7f8cef624640 1 -- 10.20.193.49:0/284943901 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f8ce815d370 msgr2=0x7f8ce815d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:21.535 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.532+0000 7f8cef624640 1 --2- 10.20.193.49:0/284943901 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f8ce815d370 0x7f8ce815d750 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f8ce815dcf0 tx=0x7f8cd802ede0 comp rx=0 tx=0).stop 2026-02-17T11:15:21.535 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.533+0000 7f8cef624640 1 -- 10.20.193.49:0/284943901 shutdown_connections 2026-02-17T11:15:21.535 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.533+0000 7f8cef624640 1 --2- 10.20.193.49:0/284943901 >> v2:10.20.193.97:3300/0 conn(0x7f8ce80c74c0 0x7f8ce80c52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:21.535 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.533+0000 7f8cef624640 1 --2- 10.20.193.49:0/284943901 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f8ce815d370 0x7f8ce815d750 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:21.535 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.533+0000 7f8cef624640 1 -- 10.20.193.49:0/284943901 >> 10.20.193.49:0/284943901 conn(0x7f8ce80c9f20 msgr2=0x7f8ce80ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:21.535 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.533+0000 7f8cef624640 1 -- 10.20.193.49:0/284943901 shutdown_connections 2026-02-17T11:15:21.535 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.533+0000 7f8cef624640 1 -- 10.20.193.49:0/284943901 wait complete. 2026-02-17T11:15:21.536 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.533+0000 7f8cef624640 10 monclient: build_initial_monmap 2026-02-17T11:15:21.537 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.533+0000 7f8cef624640 10 monclient: monmap: 2026-02-17T11:15:21.537 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:21.537 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:15:21.537 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:15:21.537 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:15:21.537 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:21.537 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:21.537 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:15:21.537 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:15:21.537 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:15:21.537 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:21.537 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.533+0000 7f8cef624640 1 librados: starting msgr at 2026-02-17T11:15:21.537 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.533+0000 7f8cef624640 1 librados: starting objecter 2026-02-17T11:15:21.537 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.533+0000 7f8cef624640 1 Processor -- start 2026-02-17T11:15:21.537 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.533+0000 7f8cef624640 1 -- start start 2026-02-17T11:15:21.537 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.533+0000 7f8cef624640 1 librados: setting wanted keys 2026-02-17T11:15:21.537 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.533+0000 7f8cef624640 1 librados: calling monclient init 2026-02-17T11:15:21.537 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.533+0000 7f8cef624640 10 monclient: init 2026-02-17T11:15:21.537 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.534+0000 7f8cef624640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:21.537 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.534+0000 7f8cef624640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:15:21.537 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.534+0000 7f8cef624640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f8ce80c74c0 0x7f8ce806e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:21.537 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.534+0000 7f8cef624640 10 monclient(hunting): picked mon.noname-c con 0x7f8ce80c74c0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:15:21.537 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.534+0000 7f8cef624640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f8ce80c7e20 0x7f8ce8070970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:21.537 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.534+0000 7f8cef624640 10 monclient(hunting): picked mon.noname-a con 0x7f8ce80c7e20 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:15:21.537 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.534+0000 7f8cef624640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f8ce815d370 0x7f8ce80c3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:21.537 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.534+0000 7f8cef624640 10 monclient(hunting): picked mon.noname-b con 0x7f8ce815d370 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:15:21.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.534+0000 7f8cef624640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:21.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.534+0000 7f8cef624640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce80c8ed0 con 0x7f8ce80c7e20 2026-02-17T11:15:21.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.534+0000 7f8cef624640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:21.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.534+0000 7f8cef624640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce80c8bf0 con 0x7f8ce815d370 2026-02-17T11:15:21.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.534+0000 7f8cef624640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:21.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.534+0000 7f8cef624640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce80c96d0 con 0x7f8ce80c74c0 2026-02-17T11:15:21.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.534+0000 7f8cef624640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:21.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.534+0000 7f8cef624640 10 monclient(hunting): authenticate will time out at 1398.197234s 2026-02-17T11:15:21.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.534+0000 7f8cecb98640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f8ce80c7e20 0x7f8ce8070970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:21.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.534+0000 7f8cedb9a640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f8ce815d370 0x7f8ce80c3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:21.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.534+0000 7f8ced399640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f8ce80c74c0 0x7f8ce806e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:21.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.534+0000 7f8cecb98640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f8ce80c7e20 0x7f8ce8070970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:48088/0 (socket says 10.20.193.49:48088) 2026-02-17T11:15:21.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.534+0000 7f8cecb98640 1 -- 10.20.193.49:0/1216681412 learned_addr learned my addr 10.20.193.49:0/1216681412 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:21.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.534+0000 7f8cecb98640 10 monclient(hunting): get_auth_request con 0x7f8ce80c7e20 auth_method 0 2026-02-17T11:15:21.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.534+0000 7f8cecb98640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:21.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.534+0000 7f8cecb98640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:21.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.534+0000 7f8cecb98640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:21.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.534+0000 7f8cedb9a640 10 monclient(hunting): get_auth_request con 0x7f8ce815d370 auth_method 0 2026-02-17T11:15:21.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.534+0000 7f8cedb9a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:21.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.534+0000 7f8cedb9a640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:21.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.534+0000 7f8cedb9a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:21.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.534+0000 7f8ced399640 10 monclient(hunting): get_auth_request con 0x7f8ce80c74c0 auth_method 0 2026-02-17T11:15:21.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.534+0000 7f8ced399640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:21.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.534+0000 7f8ced399640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:21.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.534+0000 7f8ced399640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:21.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.534+0000 7f8cecb98640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:21.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.534+0000 7f8cecb98640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:21.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.534+0000 7f8cecb98640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:21.539 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.535+0000 7f8cedb9a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:21.539 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.535+0000 7f8cedb9a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:21.539 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.535+0000 7f8cedb9a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:21.539 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.535+0000 7f8ced399640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:21.539 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.535+0000 7f8ced399640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:21.539 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.535+0000 7f8ced399640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:21.540 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.536+0000 7f8cedb9a640 10 monclient(hunting): handle_auth_done global_id 5086 payload 824 2026-02-17T11:15:21.540 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.536+0000 7f8cedb9a640 1 -- 10.20.193.49:0/1216681412 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f8ce80c74c0 msgr2=0x7f8ce806e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:21.540 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.536+0000 7f8cedb9a640 1 --2- 10.20.193.49:0/1216681412 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f8ce80c74c0 0x7f8ce806e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:21.540 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.536+0000 7f8cedb9a640 1 -- 10.20.193.49:0/1216681412 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f8ce80c7e20 msgr2=0x7f8ce8070970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:21.540 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.536+0000 7f8cedb9a640 1 --2- 10.20.193.49:0/1216681412 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f8ce80c7e20 0x7f8ce8070970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:21.540 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.536+0000 7f8cedb9a640 10 monclient: _finish_hunting 0 2026-02-17T11:15:21.540 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.536+0000 7f8cedb9a640 1 monclient: found mon.noname-b 2026-02-17T11:15:21.540 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.536+0000 7f8cedb9a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:21.540 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.536+0000 7f8cedb9a640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:15:21.540 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.536+0000 7f8cedb9a640 1 -- 10.20.193.49:0/1216681412 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ce806d690 con 0x7f8ce815d370 2026-02-17T11:15:21.540 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.537+0000 7f8cedb9a640 1 --2- 10.20.193.49:0/1216681412 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f8ce815d370 0x7f8ce80c3a90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8ce400eba0 tx=0x7f8ce400c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:21.540 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.537+0000 7f8cd5ffb640 10 client.?.objecter ms_handle_connect 0x7f8ce815d370 2026-02-17T11:15:21.540 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.537+0000 7f8cd5ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T11:15:21.540 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.538+0000 7f8cd5ffb640 1 -- 10.20.193.49:0/1216681412 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce4018020 con 0x7f8ce815d370 2026-02-17T11:15:21.540 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.538+0000 7f8cd5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:21.540 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.538+0000 7f8cd5ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:15:21.540 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.538+0000 7f8cd5ffb640 10 monclient: dump: 2026-02-17T11:15:21.540 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:21.540 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:21.540 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:21.540 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:21.541 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:21.541 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:21.541 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:21.541 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:21.541 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:21.541 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:21.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.538+0000 7f8cd5ffb640 10 monclient: _finish_auth 0 2026-02-17T11:15:21.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.538+0000 7f8cd5ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:15:21.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.538+0000 7f8cd5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:21.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.538+0000 7f8cef624640 5 monclient: authenticate success, global_id 5086 2026-02-17T11:15:21.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.538+0000 7f8cef624640 10 monclient: _renew_subs 2026-02-17T11:15:21.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.538+0000 7f8cef624640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:15:21.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.538+0000 7f8cef624640 1 -- 10.20.193.49:0/1216681412 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ce806d930 con 0x7f8ce815d370 2026-02-17T11:15:21.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.538+0000 7f8cef624640 10 client.5086.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:21.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.538+0000 7f8cef624640 10 monclient: _renew_subs 2026-02-17T11:15:21.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.538+0000 7f8cef624640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:15:21.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.538+0000 7f8cef624640 1 -- 10.20.193.49:0/1216681412 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ce806def0 con 0x7f8ce815d370 2026-02-17T11:15:21.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.538+0000 7f8cef624640 1 librados: init done 2026-02-17T11:15:21.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.538+0000 7f8cd5ffb640 1 -- 10.20.193.49:0/1216681412 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ce400cd30 con 0x7f8ce815d370 2026-02-17T11:15:21.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.538+0000 7f8cd5ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:21.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.538+0000 7f8cd5ffb640 1 -- 10.20.193.49:0/1216681412 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce4014680 con 0x7f8ce815d370 2026-02-17T11:15:21.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.538+0000 7f8cd5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:21.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.538+0000 7f8cd5ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:15:21.541 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.538+0000 7f8cd5ffb640 10 monclient: dump: 2026-02-17T11:15:21.541 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:21.541 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:21.541 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:21.542 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:21.542 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:21.542 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:21.542 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:21.542 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:21.542 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:21.542 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:21.542 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.538+0000 7f8cd77fe640 4 set_mon_vals no callback set 2026-02-17T11:15:21.542 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.538+0000 7f8cef624640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:21.542 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.539+0000 7f8cef624640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:21.542 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.539+0000 7f8cef624640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:15:21.542 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.539+0000 7f8cef624640 1 -- 10.20.193.49:0/1216681412 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ce815d750 con 0x7f8ce815d370 2026-02-17T11:15:21.551 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.550+0000 7f8cd5ffb640 1 -- 10.20.193.49:0/1216681412 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f8ce4014820 con 0x7f8ce815d370 2026-02-17T11:15:21.551 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.550+0000 7f8cd5ffb640 1 --2- 10.20.193.49:0/1216681412 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f8cb8079140 0x7f8cb807b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:21.552 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.551+0000 7f8ced399640 1 --2- 10.20.193.49:0/1216681412 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f8cb8079140 0x7f8cb807b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:21.552 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.551+0000 7f8ced399640 10 monclient: get_auth_request con 0x7f8cb8079140 auth_method 0 2026-02-17T11:15:21.552 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.551+0000 7f8cd5ffb640 1 -- 10.20.193.49:0/1216681412 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f8ce405efb0 con 0x7f8ce815d370 2026-02-17T11:15:21.552 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.551+0000 7f8cd5ffb640 10 client.5086.objecter ms_dispatch2 0x7f8ce8000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:15:21.552 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.551+0000 7f8cd5ffb640 3 client.5086.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:15:21.552 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.551+0000 7f8cd5ffb640 3 client.5086.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:15:21.552 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.551+0000 7f8cd5ffb640 20 client.5086.objecter dump_active .. 0 homeless 2026-02-17T11:15:21.552 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.551+0000 7f8cd5ffb640 10 client.5086.objecter ms_handle_connect 0x7f8cb8079140 2026-02-17T11:15:21.552 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.551+0000 7f8ced399640 1 --2- 10.20.193.49:0/1216681412 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f8cb8079140 0x7f8cb807b600 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8cd8039000 tx=0x7f8cd8033000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:21.651 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.650+0000 7f8cd5ffb640 1 -- 10.20.193.49:0/1216681412 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f8ce4022030 con 0x7f8ce815d370 2026-02-17T11:15:21.652 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.650+0000 7f8cd5ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:21.652 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.650+0000 7f8cd5ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:15:21.751 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.750+0000 7f8cef624640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:15:21.752 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.750+0000 7f8cef624640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:15:21.752 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.750+0000 7f8cef624640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:15:21.752 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.750+0000 7f8cef624640 1 -- 10.20.193.49:0/1216681412 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f8ce8157530 con 0x7f8ce815d370 2026-02-17T11:15:21.754 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.753+0000 7f8cd5ffb640 1 -- 10.20.193.49:0/1216681412 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f8ce4010040 con 0x7f8ce815d370 2026-02-17T11:15:21.754 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.753+0000 7f8cd5ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:15:21.754 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.753+0000 7f8cd5ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:15:21.754 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:15:21.754 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:15:21.755 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.754+0000 7f8cef624640 10 librados: watch_flush enter 2026-02-17T11:15:21.756 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.754+0000 7f8cef624640 10 librados: watch_flush exit 2026-02-17T11:15:21.756 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.754+0000 7f8cef624640 20 client.5086.objecter shutdown clearing up homeless session... 2026-02-17T11:15:21.756 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.754+0000 7f8cef624640 10 client.5086.objecter successfully canceled tick 2026-02-17T11:15:21.756 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.754+0000 7f8cef624640 1 -- 10.20.193.49:0/1216681412 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f8cb8079140 msgr2=0x7f8cb807b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:21.756 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.754+0000 7f8cef624640 1 --2- 10.20.193.49:0/1216681412 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f8cb8079140 0x7f8cb807b600 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8cd8039000 tx=0x7f8cd8033000 comp rx=0 tx=0).stop 2026-02-17T11:15:21.756 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.754+0000 7f8cef624640 10 monclient: shutdown 2026-02-17T11:15:21.756 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.754+0000 7f8cef624640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:21.756 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.754+0000 7f8cef624640 1 -- 10.20.193.49:0/1216681412 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f8ce815d370 msgr2=0x7f8ce80c3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:21.756 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.754+0000 7f8cef624640 1 --2- 10.20.193.49:0/1216681412 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f8ce815d370 0x7f8ce80c3a90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8ce400eba0 tx=0x7f8ce400c490 comp rx=0 tx=0).stop 2026-02-17T11:15:21.756 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.754+0000 7f8cef624640 1 -- 10.20.193.49:0/1216681412 shutdown_connections 2026-02-17T11:15:21.756 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.754+0000 7f8cef624640 1 --2- 10.20.193.49:0/1216681412 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f8cb8079140 0x7f8cb807b600 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:21.756 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.754+0000 7f8cef624640 1 --2- 10.20.193.49:0/1216681412 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f8ce815d370 0x7f8ce80c3a90 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:21.756 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.754+0000 7f8cef624640 1 --2- 10.20.193.49:0/1216681412 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f8ce80c7e20 0x7f8ce8070970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:21.756 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.754+0000 7f8cef624640 1 --2- 10.20.193.49:0/1216681412 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f8ce80c74c0 0x7f8ce806e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:21.756 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.754+0000 7f8cef624640 1 -- 10.20.193.49:0/1216681412 >> 10.20.193.49:0/1216681412 conn(0x7f8ce80c9f20 msgr2=0x7f8ce815dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:21.756 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.754+0000 7f8cef624640 1 -- 10.20.193.49:0/1216681412 shutdown_connections 2026-02-17T11:15:21.756 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.754+0000 7f8cef624640 1 -- 10.20.193.49:0/1216681412 wait complete. 2026-02-17T11:15:21.756 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:21.754+0000 7f8cef624640 1 librados: shutdown 2026-02-17T11:15:24.764 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:15:24.831 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.829+0000 7f1d49bd3640 10 monclient: get_monmap_and_config 2026-02-17T11:15:24.831 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.829+0000 7f1d49bd3640 10 monclient: build_initial_monmap 2026-02-17T11:15:24.831 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.829+0000 7f1d49bd3640 10 monclient: monmap: 2026-02-17T11:15:24.832 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:24.832 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:24.832 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:15:24.830111+0000 2026-02-17T11:15:24.832 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:15:24.830111+0000 2026-02-17T11:15:24.832 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:24.832 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:24.832 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:15:24.832 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:15:24.832 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:15:24.832 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:15:24.832 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:15:24.833 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:15:24.833 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:24.833 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.829+0000 7f1d49bd3640 1 Processor -- start 2026-02-17T11:15:24.833 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.830+0000 7f1d49bd3640 1 -- start start 2026-02-17T11:15:24.833 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.830+0000 7f1d49bd3640 10 monclient: init 2026-02-17T11:15:24.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.830+0000 7f1d49bd3640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:24.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.830+0000 7f1d49bd3640 10 monclient: _add_conns ranks=[1,0,2,4,3,5] 2026-02-17T11:15:24.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.830+0000 7f1d49bd3640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f1d440c7170 addr v1:10.20.193.97:6789/0 2026-02-17T11:15:24.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.830+0000 7f1d49bd3640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f1d440c7550 addr v1:10.20.193.49:6789/0 2026-02-17T11:15:24.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.830+0000 7f1d49bd3640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f1d440c89c0 addr v1:10.20.193.157:6789/0 2026-02-17T11:15:24.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.830+0000 7f1d49bd3640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d440c4fd0 con 0x7f1d440c7550 2026-02-17T11:15:24.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.830+0000 7f1d49bd3640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d4415a9a0 con 0x7f1d440c7170 2026-02-17T11:15:24.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.830+0000 7f1d49bd3640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d440c5270 con 0x7f1d440c89c0 2026-02-17T11:15:24.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.830+0000 7f1d49bd3640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:24.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.830+0000 7f1d49bd3640 10 monclient(hunting): authenticate will time out at 1401.493561s 2026-02-17T11:15:24.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.830+0000 7f1d437fe640 1 --1- >> v1:10.20.193.97:6789/0 conn(0x7f1d440c7170 0x7f1d440c48c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.97:6789/0 says I am v1:10.20.193.49:60904/0 (socket says 10.20.193.49:60904) 2026-02-17T11:15:24.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.830+0000 7f1d437fe640 1 -- 10.20.193.49:0/4006568080 learned_addr learned my addr 10.20.193.49:0/4006568080 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:15:24.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.832+0000 7f1d427fc640 1 -- 10.20.193.49:0/4006568080 <== mon.0 v1:10.20.193.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3875499929 0 0) 0x7f1d440c4fd0 con 0x7f1d440c7550 2026-02-17T11:15:24.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.832+0000 7f1d427fc640 10 monclient(hunting): _negotiate 2026-02-17T11:15:24.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.832+0000 7f1d427fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:24.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.832+0000 7f1d427fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:24.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.832+0000 7f1d427fc640 10 monclient(hunting): my global_id is 5106 2026-02-17T11:15:24.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.832+0000 7f1d427fc640 1 -- 10.20.193.49:0/4006568080 --> v1:10.20.193.49:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d28003620 con 0x7f1d440c7550 2026-02-17T11:15:24.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.832+0000 7f1d427fc640 1 -- 10.20.193.49:0/4006568080 <== mon.2 v1:10.20.193.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 858183740 0 0) 0x7f1d440c5270 con 0x7f1d440c89c0 2026-02-17T11:15:24.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.832+0000 7f1d427fc640 10 monclient(hunting): _negotiate 2026-02-17T11:15:24.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.832+0000 7f1d427fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:24.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.832+0000 7f1d427fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:24.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.832+0000 7f1d427fc640 10 monclient(hunting): my global_id is 5126 2026-02-17T11:15:24.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.832+0000 7f1d427fc640 1 -- 10.20.193.49:0/4006568080 --> v1:10.20.193.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d440c4fd0 con 0x7f1d440c89c0 2026-02-17T11:15:24.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.832+0000 7f1d427fc640 1 -- 10.20.193.49:0/4006568080 <== mon.1 v1:10.20.193.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1756338067 0 0) 0x7f1d4415a9a0 con 0x7f1d440c7170 2026-02-17T11:15:24.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.832+0000 7f1d427fc640 10 monclient(hunting): _negotiate 2026-02-17T11:15:24.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.832+0000 7f1d427fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:24.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.832+0000 7f1d427fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:24.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.832+0000 7f1d427fc640 10 monclient(hunting): my global_id is 5089 2026-02-17T11:15:24.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.832+0000 7f1d427fc640 1 -- 10.20.193.49:0/4006568080 --> v1:10.20.193.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d440c5270 con 0x7f1d440c7170 2026-02-17T11:15:24.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.833+0000 7f1d427fc640 1 -- 10.20.193.49:0/4006568080 <== mon.0 v1:10.20.193.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 420490825 0 0) 0x7f1d28003620 con 0x7f1d440c7550 2026-02-17T11:15:24.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.833+0000 7f1d427fc640 1 -- 10.20.193.49:0/4006568080 >> v1:10.20.193.157:6789/0 conn(0x7f1d440c89c0 legacy=0x7f1d441646d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:24.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.833+0000 7f1d427fc640 1 -- 10.20.193.49:0/4006568080 >> v1:10.20.193.97:6789/0 conn(0x7f1d440c7170 legacy=0x7f1d440c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:24.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.833+0000 7f1d427fc640 10 monclient: _finish_hunting 0 2026-02-17T11:15:24.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.833+0000 7f1d427fc640 1 monclient: found mon.noname-a-legacy 2026-02-17T11:15:24.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.833+0000 7f1d427fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:24.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.833+0000 7f1d427fc640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.49:6789/0 2026-02-17T11:15:24.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.833+0000 7f1d427fc640 1 -- 10.20.193.49:0/4006568080 --> v1:10.20.193.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d440c5550 con 0x7f1d440c7550 2026-02-17T11:15:24.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.833+0000 7f1d427fc640 10 monclient: _finish_auth 0 2026-02-17T11:15:24.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.833+0000 7f1d427fc640 10 monclient: _check_auth_tickets 2026-02-17T11:15:24.848 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.833+0000 7f1d427fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:24.848 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.833+0000 7f1d427fc640 1 -- 10.20.193.49:0/4006568080 <== mon.0 v1:10.20.193.49:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2462710995 0 0) 0x7f1d34002f00 con 0x7f1d440c7550 2026-02-17T11:15:24.848 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.833+0000 7f1d427fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:24.848 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.833+0000 7f1d427fc640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T11:15:24.848 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.833+0000 7f1d427fc640 10 monclient: dump: 2026-02-17T11:15:24.848 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:24.848 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:24.848 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:24.848 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:24.848 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:24.848 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:24.848 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:24.849 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:24.849 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:24.849 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:24.849 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.833+0000 7f1d427fc640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] but i'm connected to v1:10.20.193.49:6789/0, reconnecting 2026-02-17T11:15:24.849 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.833+0000 7f1d427fc640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:24.849 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.833+0000 7f1d427fc640 1 -- 10.20.193.49:0/4006568080 >> v1:10.20.193.49:6789/0 conn(0x7f1d440c7550 legacy=0x7f1d440749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:24.849 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.833+0000 7f1d427fc640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:15:24.849 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.833+0000 7f1d427fc640 1 --2- 10.20.193.49:0/4006568080 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1d28003fe0 0x7f1d28004900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:24.849 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.833+0000 7f1d427fc640 10 monclient(hunting): picked mon.a con 0x7f1d28003fe0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:15:24.849 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.833+0000 7f1d427fc640 1 --2- 10.20.193.49:0/4006568080 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f1d28004e40 0x7f1d280052c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:24.849 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.833+0000 7f1d427fc640 10 monclient(hunting): picked mon.b con 0x7f1d28004e40 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:15:24.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.833+0000 7f1d427fc640 1 --2- 10.20.193.49:0/4006568080 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f1d28009ab0 0x7f1d2800bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:24.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.834+0000 7f1d427fc640 10 monclient(hunting): picked mon.c con 0x7f1d28009ab0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:15:24.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.834+0000 7f1d427fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:24.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.834+0000 7f1d427fc640 1 -- 10.20.193.49:0/4006568080 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1d2800c570 con 0x7f1d28003fe0 2026-02-17T11:15:24.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.834+0000 7f1d427fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:24.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.834+0000 7f1d427fc640 1 -- 10.20.193.49:0/4006568080 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1d2800c6f0 con 0x7f1d28004e40 2026-02-17T11:15:24.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.834+0000 7f1d427fc640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:24.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.834+0000 7f1d427fc640 1 -- 10.20.193.49:0/4006568080 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f1d2800c8f0 con 0x7f1d28009ab0 2026-02-17T11:15:24.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.834+0000 7f1d427fc640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:24.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.834+0000 7f1d427fc640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:15:24.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.834+0000 7f1d43fff640 1 --2- 10.20.193.49:0/4006568080 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f1d28009ab0 0x7f1d2800bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:24.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.834+0000 7f1d42ffd640 1 --2- 10.20.193.49:0/4006568080 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f1d28004e40 0x7f1d280052c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:24.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.835+0000 7f1d42ffd640 10 monclient(hunting): get_auth_request con 0x7f1d28004e40 auth_method 0 2026-02-17T11:15:24.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.835+0000 7f1d42ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:24.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.835+0000 7f1d42ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:24.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.835+0000 7f1d42ffd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:15:24.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.835+0000 7f1d43fff640 10 monclient(hunting): get_auth_request con 0x7f1d28009ab0 auth_method 0 2026-02-17T11:15:24.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.835+0000 7f1d43fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:24.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.835+0000 7f1d43fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:24.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.835+0000 7f1d43fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:15:24.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.835+0000 7f1d42ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:24.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.835+0000 7f1d42ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:24.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.835+0000 7f1d42ffd640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:15:24.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.835+0000 7f1d437fe640 1 --2- 10.20.193.49:0/4006568080 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1d28003fe0 0x7f1d28004900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:24.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.835+0000 7f1d43fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:24.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.835+0000 7f1d43fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:24.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.835+0000 7f1d43fff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:15:24.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.835+0000 7f1d437fe640 10 monclient(hunting): get_auth_request con 0x7f1d28003fe0 auth_method 0 2026-02-17T11:15:24.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.835+0000 7f1d437fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:24.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.835+0000 7f1d437fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:24.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.835+0000 7f1d437fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:15:24.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.835+0000 7f1d437fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:24.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.835+0000 7f1d437fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:24.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.835+0000 7f1d437fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:15:24.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.836+0000 7f1d42ffd640 10 monclient(hunting): handle_auth_done global_id 5106 payload 293 2026-02-17T11:15:24.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.836+0000 7f1d42ffd640 1 -- 10.20.193.49:0/4006568080 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f1d28009ab0 msgr2=0x7f1d2800bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:15:24.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.836+0000 7f1d42ffd640 1 --2- 10.20.193.49:0/4006568080 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f1d28009ab0 0x7f1d2800bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:24.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.836+0000 7f1d42ffd640 1 -- 10.20.193.49:0/4006568080 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1d28003fe0 msgr2=0x7f1d28004900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:15:24.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.836+0000 7f1d42ffd640 1 --2- 10.20.193.49:0/4006568080 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1d28003fe0 0x7f1d28004900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:24.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.836+0000 7f1d42ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:15:24.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.836+0000 7f1d42ffd640 1 monclient: found mon.b 2026-02-17T11:15:24.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.836+0000 7f1d43fff640 1 -- 10.20.193.49:0/4006568080 reap_dead start 2026-02-17T11:15:24.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.836+0000 7f1d42ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:24.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.836+0000 7f1d42ffd640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:15:24.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.836+0000 7f1d42ffd640 1 -- 10.20.193.49:0/4006568080 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d28003620 con 0x7f1d28004e40 2026-02-17T11:15:24.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.836+0000 7f1d42ffd640 10 monclient: _finish_auth 0 2026-02-17T11:15:24.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.836+0000 7f1d42ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:15:24.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.836+0000 7f1d42ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:24.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.836+0000 7f1d49bd3640 5 monclient: authenticate success, global_id 5106 2026-02-17T11:15:24.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.836+0000 7f1d49bd3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:15:24.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.837+0000 7f1d42ffd640 1 --2- 10.20.193.49:0/4006568080 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f1d28004e40 0x7f1d280052c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1d3400c110 tx=0x7f1d3402f3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd1101bb5ad041d3 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:24.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.838+0000 7f1d427fc640 1 -- 10.20.193.49:0/4006568080 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d3403c070 con 0x7f1d28004e40 2026-02-17T11:15:24.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.838+0000 7f1d427fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:24.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.838+0000 7f1d427fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:15:24.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.838+0000 7f1d427fc640 10 monclient: dump: 2026-02-17T11:15:24.854 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:24.854 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:24.854 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:24.854 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:24.854 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:24.854 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:24.855 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:24.855 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:24.855 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:24.855 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:24.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.838+0000 7f1d49bd3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:15:24.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.839+0000 7f1d427fc640 1 -- 10.20.193.49:0/4006568080 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d34037440 con 0x7f1d28004e40 2026-02-17T11:15:24.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.839+0000 7f1d427fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:24.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.839+0000 7f1d427fc640 1 -- 10.20.193.49:0/4006568080 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d34007c30 con 0x7f1d28004e40 2026-02-17T11:15:24.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.839+0000 7f1d427fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:24.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.839+0000 7f1d427fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:15:24.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.839+0000 7f1d427fc640 10 monclient: dump: 2026-02-17T11:15:24.855 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:24.856 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:24.856 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:24.856 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:24.856 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:24.856 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:24.856 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:24.856 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:24.856 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:24.856 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:24.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.839+0000 7f1d49bd3640 10 monclient: get_monmap_and_config success 2026-02-17T11:15:24.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.839+0000 7f1d49bd3640 4 set_mon_vals no callback set 2026-02-17T11:15:24.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.839+0000 7f1d49bd3640 10 monclient: shutdown 2026-02-17T11:15:24.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.839+0000 7f1d49bd3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:24.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.839+0000 7f1d49bd3640 1 -- 10.20.193.49:0/4006568080 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f1d28004e40 msgr2=0x7f1d280052c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:24.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.839+0000 7f1d49bd3640 1 --2- 10.20.193.49:0/4006568080 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f1d28004e40 0x7f1d280052c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1d3400c110 tx=0x7f1d3402f3e0 comp rx=0 tx=0).stop 2026-02-17T11:15:24.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.839+0000 7f1d49bd3640 1 -- 10.20.193.49:0/4006568080 shutdown_connections 2026-02-17T11:15:24.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.839+0000 7f1d49bd3640 1 --2- 10.20.193.49:0/4006568080 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f1d28004e40 0x7f1d280052c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:24.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.839+0000 7f1d49bd3640 1 -- 10.20.193.49:0/4006568080 >> 10.20.193.49:0/4006568080 conn(0x7f1d440c9f40 msgr2=0x7f1d440ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:24.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.839+0000 7f1d49bd3640 1 -- 10.20.193.49:0/4006568080 shutdown_connections 2026-02-17T11:15:24.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.839+0000 7f1d49bd3640 1 -- 10.20.193.49:0/4006568080 wait complete. 2026-02-17T11:15:24.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.840+0000 7f1d49bd3640 10 monclient: build_initial_monmap 2026-02-17T11:15:24.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.840+0000 7f1d49bd3640 10 monclient: monmap: 2026-02-17T11:15:24.858 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:24.858 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:15:24.858 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:15:24.858 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:15:24.859 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:24.859 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:24.859 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:15:24.859 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:15:24.859 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:15:24.859 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:24.860 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.840+0000 7f1d49bd3640 1 librados: starting msgr at 2026-02-17T11:15:24.860 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.840+0000 7f1d49bd3640 1 librados: starting objecter 2026-02-17T11:15:24.860 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.840+0000 7f1d49bd3640 1 Processor -- start 2026-02-17T11:15:24.860 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.840+0000 7f1d49bd3640 1 -- start start 2026-02-17T11:15:24.860 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.840+0000 7f1d49bd3640 1 librados: setting wanted keys 2026-02-17T11:15:24.860 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.840+0000 7f1d49bd3640 1 librados: calling monclient init 2026-02-17T11:15:24.860 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.840+0000 7f1d49bd3640 10 monclient: init 2026-02-17T11:15:24.860 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.840+0000 7f1d49bd3640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:24.860 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.840+0000 7f1d49bd3640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:15:24.860 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.840+0000 7f1d49bd3640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f1d28004e40 0x7f1d441f4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:24.860 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.840+0000 7f1d49bd3640 10 monclient(hunting): picked mon.noname-c con 0x7f1d28004e40 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:15:24.861 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.840+0000 7f1d49bd3640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f1d440c1220 0x7f1d44156140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:24.861 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.840+0000 7f1d49bd3640 10 monclient(hunting): picked mon.noname-b con 0x7f1d440c1220 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:15:24.861 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.840+0000 7f1d49bd3640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1d440c16a0 0x7f1d44156680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:24.861 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.840+0000 7f1d49bd3640 10 monclient(hunting): picked mon.noname-a con 0x7f1d440c16a0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:15:24.861 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.840+0000 7f1d49bd3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:24.861 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.840+0000 7f1d49bd3640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1d440c7ee0 con 0x7f1d440c16a0 2026-02-17T11:15:24.861 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.840+0000 7f1d49bd3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:24.861 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.840+0000 7f1d49bd3640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1d440c8530 con 0x7f1d440c1220 2026-02-17T11:15:24.861 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.840+0000 7f1d49bd3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:24.861 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.840+0000 7f1d49bd3640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f1d440c81c0 con 0x7f1d28004e40 2026-02-17T11:15:24.861 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.840+0000 7f1d49bd3640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:24.861 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.840+0000 7f1d49bd3640 10 monclient(hunting): authenticate will time out at 1401.503711s 2026-02-17T11:15:24.862 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.841+0000 7f1d437fe640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f1d28004e40 0x7f1d441f4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:24.862 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.841+0000 7f1d43fff640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1d440c16a0 0x7f1d44156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:24.862 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.841+0000 7f1d42ffd640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f1d440c1220 0x7f1d44156140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:24.862 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.841+0000 7f1d437fe640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f1d28004e40 0x7f1d441f4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:49204/0 (socket says 10.20.193.49:49204) 2026-02-17T11:15:24.862 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.841+0000 7f1d42ffd640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f1d440c1220 0x7f1d44156140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:39406/0 (socket says 10.20.193.49:39406) 2026-02-17T11:15:24.862 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.841+0000 7f1d437fe640 1 -- 10.20.193.49:0/1970255685 learned_addr learned my addr 10.20.193.49:0/1970255685 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:24.862 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.841+0000 7f1d437fe640 10 monclient(hunting): get_auth_request con 0x7f1d28004e40 auth_method 0 2026-02-17T11:15:24.862 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.841+0000 7f1d437fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:24.862 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.841+0000 7f1d437fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:24.862 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.841+0000 7f1d437fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:24.863 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.841+0000 7f1d42ffd640 10 monclient(hunting): get_auth_request con 0x7f1d440c1220 auth_method 0 2026-02-17T11:15:24.863 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.841+0000 7f1d42ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:24.863 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.841+0000 7f1d42ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:24.863 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.841+0000 7f1d42ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:24.863 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.841+0000 7f1d43fff640 10 monclient(hunting): get_auth_request con 0x7f1d440c16a0 auth_method 0 2026-02-17T11:15:24.863 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.841+0000 7f1d43fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:24.863 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.841+0000 7f1d43fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:24.863 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.841+0000 7f1d43fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:24.863 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.841+0000 7f1d437fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:24.863 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.841+0000 7f1d437fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:24.863 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.841+0000 7f1d437fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:24.864 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.841+0000 7f1d42ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:24.864 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.841+0000 7f1d42ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:24.864 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.841+0000 7f1d42ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:24.864 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.841+0000 7f1d43fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:24.864 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.841+0000 7f1d43fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:24.864 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.841+0000 7f1d43fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:24.864 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.842+0000 7f1d42ffd640 10 monclient(hunting): handle_auth_done global_id 5092 payload 824 2026-02-17T11:15:24.864 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.842+0000 7f1d42ffd640 1 -- 10.20.193.49:0/1970255685 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f1d28004e40 msgr2=0x7f1d441f4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:24.864 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.842+0000 7f1d42ffd640 1 --2- 10.20.193.49:0/1970255685 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f1d28004e40 0x7f1d441f4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:24.864 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.842+0000 7f1d42ffd640 1 -- 10.20.193.49:0/1970255685 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1d440c16a0 msgr2=0x7f1d44156680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:24.864 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.842+0000 7f1d42ffd640 1 --2- 10.20.193.49:0/1970255685 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1d440c16a0 0x7f1d44156680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:24.865 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.842+0000 7f1d42ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:15:24.865 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.842+0000 7f1d42ffd640 1 monclient: found mon.noname-b 2026-02-17T11:15:24.865 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.842+0000 7f1d42ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:24.865 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.842+0000 7f1d42ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:15:24.865 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.842+0000 7f1d42ffd640 1 -- 10.20.193.49:0/1970255685 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d440c3ed0 con 0x7f1d440c1220 2026-02-17T11:15:24.867 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.843+0000 7f1d42ffd640 1 --2- 10.20.193.49:0/1970255685 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f1d440c1220 0x7f1d44156140 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1d2800c8c0 tx=0x7f1d440c5720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:24.867 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.843+0000 7f1d1ffff640 10 client.?.objecter ms_handle_connect 0x7f1d440c1220 2026-02-17T11:15:24.867 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.843+0000 7f1d1ffff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:15:24.867 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.845+0000 7f1d1ffff640 1 -- 10.20.193.49:0/1970255685 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d34044070 con 0x7f1d440c1220 2026-02-17T11:15:24.868 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.845+0000 7f1d1ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:24.868 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.845+0000 7f1d1ffff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:15:24.868 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.845+0000 7f1d1ffff640 10 monclient: dump: 2026-02-17T11:15:24.868 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:24.868 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:24.868 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:24.868 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:24.868 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:24.868 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:24.868 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:24.868 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:24.868 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:24.868 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:24.868 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.845+0000 7f1d1ffff640 10 monclient: _finish_auth 0 2026-02-17T11:15:24.868 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.845+0000 7f1d1ffff640 10 monclient: _check_auth_tickets 2026-02-17T11:15:24.868 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.845+0000 7f1d1ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:24.868 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.845+0000 7f1d49bd3640 5 monclient: authenticate success, global_id 5092 2026-02-17T11:15:24.869 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.845+0000 7f1d49bd3640 10 monclient: _renew_subs 2026-02-17T11:15:24.869 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.845+0000 7f1d49bd3640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:15:24.869 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.845+0000 7f1d49bd3640 1 -- 10.20.193.49:0/1970255685 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d440c41b0 con 0x7f1d440c1220 2026-02-17T11:15:24.869 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.845+0000 7f1d49bd3640 10 client.5092.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:24.869 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.845+0000 7f1d49bd3640 10 monclient: _renew_subs 2026-02-17T11:15:24.869 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.845+0000 7f1d49bd3640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:15:24.869 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.845+0000 7f1d49bd3640 1 -- 10.20.193.49:0/1970255685 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d44155940 con 0x7f1d440c1220 2026-02-17T11:15:24.869 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.845+0000 7f1d49bd3640 1 librados: init done 2026-02-17T11:15:24.869 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.845+0000 7f1d1ffff640 1 -- 10.20.193.49:0/1970255685 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d34007c30 con 0x7f1d440c1220 2026-02-17T11:15:24.869 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.845+0000 7f1d1ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:24.869 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.845+0000 7f1d1ffff640 1 -- 10.20.193.49:0/1970255685 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d3404e060 con 0x7f1d440c1220 2026-02-17T11:15:24.869 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.845+0000 7f1d1ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:24.869 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.845+0000 7f1d1ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:15:24.869 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.845+0000 7f1d41ffb640 4 set_mon_vals no callback set 2026-02-17T11:15:24.869 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.845+0000 7f1d1ffff640 10 monclient: dump: 2026-02-17T11:15:24.869 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:24.869 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:24.869 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:24.870 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:24.870 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:24.870 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:24.870 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:24.870 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:24.870 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:24.870 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:24.870 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.845+0000 7f1d49bd3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:24.870 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.845+0000 7f1d49bd3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:24.870 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.845+0000 7f1d49bd3640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:15:24.870 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.845+0000 7f1d49bd3640 1 -- 10.20.193.49:0/1970255685 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d440c61c0 con 0x7f1d440c1220 2026-02-17T11:15:24.870 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.857+0000 7f1d1ffff640 1 -- 10.20.193.49:0/1970255685 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f1d3403f050 con 0x7f1d440c1220 2026-02-17T11:15:24.870 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.858+0000 7f1d1ffff640 1 --2- 10.20.193.49:0/1970255685 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f1d14079170 0x7f1d1407b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:24.870 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.858+0000 7f1d437fe640 1 --2- 10.20.193.49:0/1970255685 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f1d14079170 0x7f1d1407b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:24.870 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.858+0000 7f1d437fe640 10 monclient: get_auth_request con 0x7f1d14079170 auth_method 0 2026-02-17T11:15:24.870 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.859+0000 7f1d1ffff640 10 client.5092.objecter ms_handle_connect 0x7f1d14079170 2026-02-17T11:15:24.870 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.859+0000 7f1d437fe640 1 --2- 10.20.193.49:0/1970255685 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f1d14079170 0x7f1d1407b630 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1d30002e00 tx=0x7f1d300049d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:24.870 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.859+0000 7f1d1ffff640 1 -- 10.20.193.49:0/1970255685 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f1d34003d20 con 0x7f1d440c1220 2026-02-17T11:15:24.870 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.859+0000 7f1d1ffff640 10 client.5092.objecter ms_dispatch2 0x7f1d44000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:15:24.871 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.859+0000 7f1d1ffff640 3 client.5092.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:15:24.871 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.859+0000 7f1d1ffff640 3 client.5092.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:15:24.871 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.859+0000 7f1d1ffff640 20 client.5092.objecter dump_active .. 0 homeless 2026-02-17T11:15:24.960 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.959+0000 7f1d1ffff640 1 -- 10.20.193.49:0/1970255685 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f1d440c61c0 con 0x7f1d440c1220 2026-02-17T11:15:24.961 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.959+0000 7f1d1ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:24.961 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:24.959+0000 7f1d1ffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:15:25.064 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:25.063+0000 7f1d49bd3640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:15:25.064 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:25.063+0000 7f1d49bd3640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:15:25.065 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:25.063+0000 7f1d49bd3640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:15:25.065 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:25.063+0000 7f1d49bd3640 1 -- 10.20.193.49:0/1970255685 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f1d440c8e70 con 0x7f1d440c1220 2026-02-17T11:15:25.067 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:25.066+0000 7f1d1ffff640 1 -- 10.20.193.49:0/1970255685 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f1d34086d80 con 0x7f1d440c1220 2026-02-17T11:15:25.068 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:25.066+0000 7f1d1ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:15:25.068 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:25.066+0000 7f1d1ffff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:15:25.068 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:15:25.068 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:15:25.070 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:25.067+0000 7f1d49bd3640 10 librados: watch_flush enter 2026-02-17T11:15:25.070 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:25.067+0000 7f1d49bd3640 10 librados: watch_flush exit 2026-02-17T11:15:25.070 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:25.067+0000 7f1d49bd3640 20 client.5092.objecter shutdown clearing up homeless session... 2026-02-17T11:15:25.070 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:25.067+0000 7f1d49bd3640 10 client.5092.objecter successfully canceled tick 2026-02-17T11:15:25.070 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:25.067+0000 7f1d49bd3640 1 -- 10.20.193.49:0/1970255685 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f1d14079170 msgr2=0x7f1d1407b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:25.070 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:25.067+0000 7f1d49bd3640 1 --2- 10.20.193.49:0/1970255685 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f1d14079170 0x7f1d1407b630 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1d30002e00 tx=0x7f1d300049d0 comp rx=0 tx=0).stop 2026-02-17T11:15:25.070 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:25.067+0000 7f1d49bd3640 10 monclient: shutdown 2026-02-17T11:15:25.070 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:25.067+0000 7f1d49bd3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:25.071 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:25.067+0000 7f1d49bd3640 1 -- 10.20.193.49:0/1970255685 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f1d440c1220 msgr2=0x7f1d44156140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:25.071 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:25.067+0000 7f1d49bd3640 1 --2- 10.20.193.49:0/1970255685 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f1d440c1220 0x7f1d44156140 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1d2800c8c0 tx=0x7f1d440c5720 comp rx=0 tx=0).stop 2026-02-17T11:15:25.071 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:25.067+0000 7f1d49bd3640 1 -- 10.20.193.49:0/1970255685 shutdown_connections 2026-02-17T11:15:25.071 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:25.067+0000 7f1d49bd3640 1 --2- 10.20.193.49:0/1970255685 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f1d14079170 0x7f1d1407b630 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:25.071 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:25.067+0000 7f1d49bd3640 1 --2- 10.20.193.49:0/1970255685 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1d440c16a0 0x7f1d44156680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:25.071 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:25.067+0000 7f1d49bd3640 1 --2- 10.20.193.49:0/1970255685 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f1d440c1220 0x7f1d44156140 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:25.071 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:25.068+0000 7f1d49bd3640 1 --2- 10.20.193.49:0/1970255685 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f1d28004e40 0x7f1d441f4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:25.071 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:25.068+0000 7f1d49bd3640 1 -- 10.20.193.49:0/1970255685 >> 10.20.193.49:0/1970255685 conn(0x7f1d440c9f40 msgr2=0x7f1d440ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:25.071 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:25.068+0000 7f1d49bd3640 1 -- 10.20.193.49:0/1970255685 shutdown_connections 2026-02-17T11:15:25.071 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:25.068+0000 7f1d49bd3640 1 -- 10.20.193.49:0/1970255685 wait complete. 2026-02-17T11:15:25.071 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:25.068+0000 7f1d49bd3640 1 librados: shutdown 2026-02-17T11:15:28.079 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:15:28.145 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.143+0000 7f6b9468f640 10 monclient: get_monmap_and_config 2026-02-17T11:15:28.145 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.143+0000 7f6b9468f640 10 monclient: build_initial_monmap 2026-02-17T11:15:28.145 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.143+0000 7f6b9468f640 10 monclient: monmap: 2026-02-17T11:15:28.145 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:28.145 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:28.145 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:15:28.144254+0000 2026-02-17T11:15:28.145 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:15:28.144254+0000 2026-02-17T11:15:28.146 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:28.146 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:28.146 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:15:28.146 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:15:28.146 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:15:28.146 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:15:28.146 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:15:28.146 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:15:28.146 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:28.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.144+0000 7f6b9468f640 1 Processor -- start 2026-02-17T11:15:28.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.144+0000 7f6b9468f640 1 -- start start 2026-02-17T11:15:28.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.144+0000 7f6b9468f640 10 monclient: init 2026-02-17T11:15:28.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.144+0000 7f6b9468f640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:28.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.144+0000 7f6b9468f640 10 monclient: _add_conns ranks=[2,5,1,3,4,0] 2026-02-17T11:15:28.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.144+0000 7f6b9468f640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f6b8c0d1b60 addr v1:10.20.193.157:6789/0 2026-02-17T11:15:28.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.144+0000 7f6b9468f640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f6b8c0d1f40 0x7f6b8c15c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:28.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.144+0000 7f6b9468f640 10 monclient(hunting): picked mon.noname-c con 0x7f6b8c0d1f40 addr v2:10.20.193.157:3300/0 2026-02-17T11:15:28.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.144+0000 7f6b9468f640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f6b8c15d950 addr v1:10.20.193.97:6789/0 2026-02-17T11:15:28.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.144+0000 7f6b9468f640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b8c0c98e0 con 0x7f6b8c15d950 2026-02-17T11:15:28.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.144+0000 7f6b9468f640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b8c0c9bc0 con 0x7f6b8c0d1b60 2026-02-17T11:15:28.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.144+0000 7f6b9468f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:28.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.144+0000 7f6b9468f640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f6b8c15cd80 con 0x7f6b8c0d1f40 2026-02-17T11:15:28.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.144+0000 7f6b9468f640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:28.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.144+0000 7f6b9468f640 10 monclient(hunting): authenticate will time out at 1404.807793s 2026-02-17T11:15:28.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.145+0000 7f6b91c03640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f6b8c0d1f40 0x7f6b8c15c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:28.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.145+0000 7f6b92c05640 1 --1- >> v1:10.20.193.97:6789/0 conn(0x7f6b8c15d950 0x7f6b8c15dd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.97:6789/0 says I am v1:10.20.193.49:39052/0 (socket says 10.20.193.49:39052) 2026-02-17T11:15:28.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.145+0000 7f6b92c05640 1 -- 10.20.193.49:0/670258297 learned_addr learned my addr 10.20.193.49:0/670258297 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:15:28.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.145+0000 7f6b91c03640 10 monclient(hunting): get_auth_request con 0x7f6b8c0d1f40 auth_method 0 2026-02-17T11:15:28.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.145+0000 7f6b91c03640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:28.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.145+0000 7f6b91c03640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:28.151 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.145+0000 7f6b91c03640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:28.151 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.146+0000 7f6b91c03640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:28.151 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.146+0000 7f6b91c03640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:28.151 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.146+0000 7f6b91c03640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:28.151 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.146+0000 7f6b91402640 1 -- 10.20.193.49:0/670258297 <== mon.1 v1:10.20.193.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 942834492 0 0) 0x7f6b8c0c98e0 con 0x7f6b8c15d950 2026-02-17T11:15:28.151 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.146+0000 7f6b91402640 10 monclient(hunting): _negotiate 2026-02-17T11:15:28.151 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.146+0000 7f6b91402640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:28.151 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.146+0000 7f6b91402640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:28.151 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.146+0000 7f6b91402640 10 monclient(hunting): my global_id is 5095 2026-02-17T11:15:28.151 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.146+0000 7f6b91402640 1 -- 10.20.193.49:0/670258297 --> v1:10.20.193.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b74003620 con 0x7f6b8c15d950 2026-02-17T11:15:28.151 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.146+0000 7f6b91c03640 10 monclient(hunting): handle_auth_done global_id 5132 payload 274 2026-02-17T11:15:28.151 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.147+0000 7f6b91c03640 1 -- 10.20.193.49:0/670258297 >> v1:10.20.193.157:6789/0 conn(0x7f6b8c0d1b60 legacy=0x7f6b8c0c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:28.151 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.147+0000 7f6b91c03640 1 -- 10.20.193.49:0/670258297 >> v1:10.20.193.97:6789/0 conn(0x7f6b8c15d950 legacy=0x7f6b8c15dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:28.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.147+0000 7f6b91c03640 10 monclient: _finish_hunting 0 2026-02-17T11:15:28.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.147+0000 7f6b91c03640 1 monclient: found mon.noname-c 2026-02-17T11:15:28.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.147+0000 7f6b91c03640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:28.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.147+0000 7f6b91c03640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:15:28.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.147+0000 7f6b91c03640 1 -- 10.20.193.49:0/670258297 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b8c0c9ea0 con 0x7f6b8c0d1f40 2026-02-17T11:15:28.157 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.149+0000 7f6b91c03640 1 --2- 10.20.193.49:0/670258297 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f6b8c0d1f40 0x7f6b8c15c840 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6b800098a0 tx=0x7f6b8002ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=543757e4a9fab288 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:28.157 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.150+0000 7f6b91402640 1 -- 10.20.193.49:0/670258297 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8003c070 con 0x7f6b8c0d1f40 2026-02-17T11:15:28.157 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.150+0000 7f6b91402640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:28.157 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.150+0000 7f6b91402640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:15:28.157 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.150+0000 7f6b91402640 10 monclient: dump: 2026-02-17T11:15:28.158 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:28.158 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:28.158 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:28.158 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:28.158 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:28.158 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:28.158 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:28.158 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:28.158 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:28.158 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:28.158 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.150+0000 7f6b91402640 10 monclient: _finish_auth 0 2026-02-17T11:15:28.158 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.150+0000 7f6b91402640 10 monclient: _check_auth_tickets 2026-02-17T11:15:28.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.150+0000 7f6b91402640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:28.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.150+0000 7f6b91402640 1 -- 10.20.193.49:0/670258297 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b8002fb70 con 0x7f6b8c0d1f40 2026-02-17T11:15:28.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.150+0000 7f6b91402640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:28.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.150+0000 7f6b9468f640 5 monclient: authenticate success, global_id 5132 2026-02-17T11:15:28.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.150+0000 7f6b91402640 1 -- 10.20.193.49:0/670258297 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b80037440 con 0x7f6b8c0d1f40 2026-02-17T11:15:28.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.150+0000 7f6b9468f640 10 monclient: get_monmap_and_config success 2026-02-17T11:15:28.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.150+0000 7f6b91402640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:28.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.150+0000 7f6b9468f640 4 set_mon_vals no callback set 2026-02-17T11:15:28.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.150+0000 7f6b91402640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:15:28.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.150+0000 7f6b91402640 10 monclient: dump: 2026-02-17T11:15:28.159 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:28.159 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:28.160 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:28.160 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:28.160 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:28.160 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:28.160 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:28.160 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:28.160 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:28.160 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:28.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.150+0000 7f6b9468f640 10 monclient: shutdown 2026-02-17T11:15:28.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.150+0000 7f6b9468f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:28.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.150+0000 7f6b9468f640 1 -- 10.20.193.49:0/670258297 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f6b8c0d1f40 msgr2=0x7f6b8c15c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:28.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.150+0000 7f6b9468f640 1 --2- 10.20.193.49:0/670258297 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f6b8c0d1f40 0x7f6b8c15c840 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6b800098a0 tx=0x7f6b8002ee60 comp rx=0 tx=0).stop 2026-02-17T11:15:28.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.150+0000 7f6b9468f640 1 -- 10.20.193.49:0/670258297 shutdown_connections 2026-02-17T11:15:28.161 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.150+0000 7f6b9468f640 1 --2- 10.20.193.49:0/670258297 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f6b8c0d1f40 0x7f6b8c15c840 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:28.161 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.150+0000 7f6b9468f640 1 -- 10.20.193.49:0/670258297 >> 10.20.193.49:0/670258297 conn(0x7f6b8c06d9b0 msgr2=0x7f6b8c06ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:28.161 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.150+0000 7f6b9468f640 1 -- 10.20.193.49:0/670258297 shutdown_connections 2026-02-17T11:15:28.161 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.150+0000 7f6b9468f640 1 -- 10.20.193.49:0/670258297 wait complete. 2026-02-17T11:15:28.161 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.151+0000 7f6b9468f640 10 monclient: build_initial_monmap 2026-02-17T11:15:28.161 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.151+0000 7f6b9468f640 10 monclient: monmap: 2026-02-17T11:15:28.161 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:28.161 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:15:28.161 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:15:28.161 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:15:28.161 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:28.161 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:28.162 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:15:28.162 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:15:28.162 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:15:28.162 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:28.162 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.151+0000 7f6b9468f640 1 librados: starting msgr at 2026-02-17T11:15:28.162 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.151+0000 7f6b9468f640 1 librados: starting objecter 2026-02-17T11:15:28.162 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.151+0000 7f6b9468f640 1 Processor -- start 2026-02-17T11:15:28.162 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.151+0000 7f6b9468f640 1 -- start start 2026-02-17T11:15:28.162 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.151+0000 7f6b9468f640 1 librados: setting wanted keys 2026-02-17T11:15:28.162 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.151+0000 7f6b9468f640 1 librados: calling monclient init 2026-02-17T11:15:28.162 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.151+0000 7f6b9468f640 10 monclient: init 2026-02-17T11:15:28.162 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.152+0000 7f6b9468f640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:28.162 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.152+0000 7f6b9468f640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:15:28.163 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.152+0000 7f6b9468f640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f6b8c0d1b60 0x7f6b8c144ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:28.163 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.152+0000 7f6b9468f640 10 monclient(hunting): picked mon.noname-b con 0x7f6b8c0d1b60 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:15:28.163 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.152+0000 7f6b9468f640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f6b8c0d1f40 0x7f6b8c1f5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:28.163 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.152+0000 7f6b9468f640 10 monclient(hunting): picked mon.noname-a con 0x7f6b8c0d1f40 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:15:28.163 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.152+0000 7f6b9468f640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f6b8c15d950 0x7f6b8c1f55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:28.163 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.152+0000 7f6b9468f640 10 monclient(hunting): picked mon.noname-c con 0x7f6b8c15d950 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:15:28.163 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.152+0000 7f6b9468f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:28.163 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.152+0000 7f6b9468f640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6b8c15d4c0 con 0x7f6b8c0d1f40 2026-02-17T11:15:28.163 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.152+0000 7f6b9468f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:28.163 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.152+0000 7f6b9468f640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6b8c0ca460 con 0x7f6b8c0d1b60 2026-02-17T11:15:28.163 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.152+0000 7f6b9468f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:28.163 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.152+0000 7f6b9468f640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f6b8c06e7b0 con 0x7f6b8c15d950 2026-02-17T11:15:28.163 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.152+0000 7f6b9468f640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:28.164 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.152+0000 7f6b9468f640 10 monclient(hunting): authenticate will time out at 1404.815249s 2026-02-17T11:15:28.164 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.152+0000 7f6b92c05640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f6b8c15d950 0x7f6b8c1f55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:28.164 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.152+0000 7f6b91c03640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f6b8c0d1f40 0x7f6b8c1f5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:28.164 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.152+0000 7f6b92c05640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f6b8c15d950 0x7f6b8c1f55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:54062/0 (socket says 10.20.193.49:54062) 2026-02-17T11:15:28.164 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.152+0000 7f6b92c05640 1 -- 10.20.193.49:0/1478146133 learned_addr learned my addr 10.20.193.49:0/1478146133 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:28.164 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.152+0000 7f6b92c05640 10 monclient(hunting): get_auth_request con 0x7f6b8c15d950 auth_method 0 2026-02-17T11:15:28.164 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.152+0000 7f6b92c05640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:28.164 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.152+0000 7f6b92c05640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:28.164 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.152+0000 7f6b92c05640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:28.164 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.152+0000 7f6b92404640 1 --2- 10.20.193.49:0/1478146133 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f6b8c0d1b60 0x7f6b8c144ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:28.164 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.152+0000 7f6b91c03640 10 monclient(hunting): get_auth_request con 0x7f6b8c0d1f40 auth_method 0 2026-02-17T11:15:28.165 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.152+0000 7f6b91c03640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:28.165 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.152+0000 7f6b91c03640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:28.165 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.152+0000 7f6b91c03640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:28.165 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.152+0000 7f6b92c05640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:28.165 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.152+0000 7f6b92c05640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:28.165 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.152+0000 7f6b92c05640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:28.165 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.153+0000 7f6b92404640 10 monclient(hunting): get_auth_request con 0x7f6b8c0d1b60 auth_method 0 2026-02-17T11:15:28.165 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.153+0000 7f6b92404640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:28.165 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.153+0000 7f6b92404640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:28.165 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.153+0000 7f6b92404640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:28.165 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.153+0000 7f6b91c03640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:28.165 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.153+0000 7f6b91c03640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:28.165 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.153+0000 7f6b91c03640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:28.166 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.153+0000 7f6b92404640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:28.166 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.153+0000 7f6b92404640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:28.166 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.153+0000 7f6b92404640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:28.166 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.154+0000 7f6b92c05640 10 monclient(hunting): handle_auth_done global_id 5138 payload 824 2026-02-17T11:15:28.166 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.154+0000 7f6b92c05640 1 -- 10.20.193.49:0/1478146133 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f6b8c0d1b60 msgr2=0x7f6b8c144ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:28.166 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.154+0000 7f6b92c05640 1 --2- 10.20.193.49:0/1478146133 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f6b8c0d1b60 0x7f6b8c144ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:28.166 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.154+0000 7f6b92c05640 1 -- 10.20.193.49:0/1478146133 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f6b8c0d1f40 msgr2=0x7f6b8c1f5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:28.166 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.154+0000 7f6b92c05640 1 --2- 10.20.193.49:0/1478146133 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f6b8c0d1f40 0x7f6b8c1f5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:28.166 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.154+0000 7f6b92c05640 10 monclient: _finish_hunting 0 2026-02-17T11:15:28.166 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.154+0000 7f6b92c05640 1 monclient: found mon.noname-c 2026-02-17T11:15:28.166 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.154+0000 7f6b92c05640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:28.166 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.154+0000 7f6b92c05640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:15:28.166 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.154+0000 7f6b92c05640 1 -- 10.20.193.49:0/1478146133 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b8c1f4a90 con 0x7f6b8c15d950 2026-02-17T11:15:28.167 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.155+0000 7f6b92c05640 1 --2- 10.20.193.49:0/1478146133 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f6b8c15d950 0x7f6b8c1f55d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6b8800cb40 tx=0x7f6b8800a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:28.167 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.155+0000 7f6b72ffd640 10 client.?.objecter ms_handle_connect 0x7f6b8c15d950 2026-02-17T11:15:28.167 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.155+0000 7f6b72ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:15:28.168 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.157+0000 7f6b72ffd640 1 -- 10.20.193.49:0/1478146133 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8800ad50 con 0x7f6b8c15d950 2026-02-17T11:15:28.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.157+0000 7f6b72ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:28.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.157+0000 7f6b72ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:15:28.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.157+0000 7f6b72ffd640 10 monclient: dump: 2026-02-17T11:15:28.169 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:28.169 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:28.169 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:28.169 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:28.169 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:28.169 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:28.169 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:28.169 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:28.169 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:28.170 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:28.170 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.157+0000 7f6b72ffd640 10 monclient: _finish_auth 0 2026-02-17T11:15:28.170 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.157+0000 7f6b72ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:15:28.170 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.157+0000 7f6b72ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:28.170 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.157+0000 7f6b72ffd640 1 -- 10.20.193.49:0/1478146133 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b88012400 con 0x7f6b8c15d950 2026-02-17T11:15:28.170 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.157+0000 7f6b72ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:28.170 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.157+0000 7f6b72ffd640 1 -- 10.20.193.49:0/1478146133 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b880127f0 con 0x7f6b8c15d950 2026-02-17T11:15:28.170 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.157+0000 7f6b72ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:28.170 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.157+0000 7f6b72ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:15:28.170 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.157+0000 7f6b72ffd640 10 monclient: dump: 2026-02-17T11:15:28.170 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:28.170 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:28.171 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:28.171 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:28.171 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:28.171 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:28.171 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:28.171 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:28.171 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:28.171 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:28.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.157+0000 7f6b90c01640 4 set_mon_vals no callback set 2026-02-17T11:15:28.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.157+0000 7f6b9468f640 5 monclient: authenticate success, global_id 5138 2026-02-17T11:15:28.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.157+0000 7f6b9468f640 10 monclient: _renew_subs 2026-02-17T11:15:28.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.157+0000 7f6b9468f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:15:28.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.157+0000 7f6b9468f640 1 -- 10.20.193.49:0/1478146133 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b8c15b070 con 0x7f6b8c15d950 2026-02-17T11:15:28.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.157+0000 7f6b9468f640 10 client.5138.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:28.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.157+0000 7f6b9468f640 10 monclient: _renew_subs 2026-02-17T11:15:28.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.157+0000 7f6b9468f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:15:28.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.157+0000 7f6b9468f640 1 -- 10.20.193.49:0/1478146133 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b8c15b630 con 0x7f6b8c15d950 2026-02-17T11:15:28.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.157+0000 7f6b9468f640 1 librados: init done 2026-02-17T11:15:28.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.157+0000 7f6b9468f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:28.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.157+0000 7f6b9468f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:28.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.157+0000 7f6b9468f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:15:28.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.157+0000 7f6b9468f640 1 -- 10.20.193.49:0/1478146133 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b8c15c840 con 0x7f6b8c15d950 2026-02-17T11:15:28.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.169+0000 7f6b72ffd640 1 -- 10.20.193.49:0/1478146133 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f6b88012990 con 0x7f6b8c15d950 2026-02-17T11:15:28.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.169+0000 7f6b72ffd640 1 --2- 10.20.193.49:0/1478146133 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f6b5c079190 0x7f6b5c07b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:28.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.169+0000 7f6b92404640 1 --2- 10.20.193.49:0/1478146133 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f6b5c079190 0x7f6b5c07b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:28.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.169+0000 7f6b92404640 10 monclient: get_auth_request con 0x7f6b5c079190 auth_method 0 2026-02-17T11:15:28.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.170+0000 7f6b72ffd640 10 client.5138.objecter ms_handle_connect 0x7f6b5c079190 2026-02-17T11:15:28.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.170+0000 7f6b92404640 1 --2- 10.20.193.49:0/1478146133 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f6b5c079190 0x7f6b5c07b650 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c002410 tx=0x7f6b7c007ef0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:28.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.171+0000 7f6b72ffd640 1 -- 10.20.193.49:0/1478146133 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f6b8805ead0 con 0x7f6b8c15d950 2026-02-17T11:15:28.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.171+0000 7f6b72ffd640 10 client.5138.objecter ms_dispatch2 0x7f6b8c000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:15:28.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.171+0000 7f6b72ffd640 3 client.5138.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:15:28.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.171+0000 7f6b72ffd640 3 client.5138.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:15:28.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.171+0000 7f6b72ffd640 20 client.5138.objecter dump_active .. 0 homeless 2026-02-17T11:15:28.275 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.273+0000 7f6b72ffd640 1 -- 10.20.193.49:0/1478146133 <== mon.2 v2:10.20.193.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f6b88062a90 con 0x7f6b8c15d950 2026-02-17T11:15:28.275 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.273+0000 7f6b72ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:28.275 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.273+0000 7f6b72ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:15:28.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.371+0000 7f6b9468f640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:15:28.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.371+0000 7f6b9468f640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:15:28.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.371+0000 7f6b9468f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:15:28.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.371+0000 7f6b9468f640 1 -- 10.20.193.49:0/1478146133 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f6b8c0cb140 con 0x7f6b8c15d950 2026-02-17T11:15:28.376 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.374+0000 7f6b72ffd640 1 -- 10.20.193.49:0/1478146133 <== mon.2 v2:10.20.193.157:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f6b88066d90 con 0x7f6b8c15d950 2026-02-17T11:15:28.376 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.374+0000 7f6b72ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:15:28.376 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.374+0000 7f6b72ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:15:28.376 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:15:28.376 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:15:28.378 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.376+0000 7f6b9468f640 10 librados: watch_flush enter 2026-02-17T11:15:28.378 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.376+0000 7f6b9468f640 10 librados: watch_flush exit 2026-02-17T11:15:28.378 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.376+0000 7f6b9468f640 20 client.5138.objecter shutdown clearing up homeless session... 2026-02-17T11:15:28.378 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.376+0000 7f6b9468f640 10 client.5138.objecter successfully canceled tick 2026-02-17T11:15:28.379 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.376+0000 7f6b9468f640 1 -- 10.20.193.49:0/1478146133 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f6b5c079190 msgr2=0x7f6b5c07b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:28.379 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.376+0000 7f6b9468f640 1 --2- 10.20.193.49:0/1478146133 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f6b5c079190 0x7f6b5c07b650 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c002410 tx=0x7f6b7c007ef0 comp rx=0 tx=0).stop 2026-02-17T11:15:28.379 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.376+0000 7f6b9468f640 10 monclient: shutdown 2026-02-17T11:15:28.379 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.376+0000 7f6b9468f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:28.379 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.376+0000 7f6b9468f640 1 -- 10.20.193.49:0/1478146133 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f6b8c15d950 msgr2=0x7f6b8c1f55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:28.379 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.376+0000 7f6b9468f640 1 --2- 10.20.193.49:0/1478146133 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f6b8c15d950 0x7f6b8c1f55d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6b8800cb40 tx=0x7f6b8800a430 comp rx=0 tx=0).stop 2026-02-17T11:15:28.379 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.376+0000 7f6b9468f640 1 -- 10.20.193.49:0/1478146133 shutdown_connections 2026-02-17T11:15:28.379 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.376+0000 7f6b9468f640 1 --2- 10.20.193.49:0/1478146133 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f6b5c079190 0x7f6b5c07b650 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:28.379 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.376+0000 7f6b9468f640 1 --2- 10.20.193.49:0/1478146133 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f6b8c15d950 0x7f6b8c1f55d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:28.379 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.376+0000 7f6b9468f640 1 --2- 10.20.193.49:0/1478146133 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f6b8c0d1f40 0x7f6b8c1f5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:28.379 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.376+0000 7f6b9468f640 1 --2- 10.20.193.49:0/1478146133 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f6b8c0d1b60 0x7f6b8c144ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:28.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.376+0000 7f6b9468f640 1 -- 10.20.193.49:0/1478146133 >> 10.20.193.49:0/1478146133 conn(0x7f6b8c06d9b0 msgr2=0x7f6b8c0d0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:28.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.376+0000 7f6b9468f640 1 -- 10.20.193.49:0/1478146133 shutdown_connections 2026-02-17T11:15:28.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.376+0000 7f6b9468f640 1 -- 10.20.193.49:0/1478146133 wait complete. 2026-02-17T11:15:28.380 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:28.376+0000 7f6b9468f640 1 librados: shutdown 2026-02-17T11:15:31.387 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:15:31.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.454+0000 7f0c07a5b640 10 monclient: get_monmap_and_config 2026-02-17T11:15:31.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.454+0000 7f0c07a5b640 10 monclient: build_initial_monmap 2026-02-17T11:15:31.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.454+0000 7f0c07a5b640 10 monclient: monmap: 2026-02-17T11:15:31.456 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:31.456 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:31.457 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:15:31.455455+0000 2026-02-17T11:15:31.457 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:15:31.455455+0000 2026-02-17T11:15:31.457 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:31.457 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:31.457 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:15:31.457 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:15:31.457 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:15:31.457 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:15:31.457 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:15:31.457 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:15:31.457 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:31.460 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.455+0000 7f0c07a5b640 1 Processor -- start 2026-02-17T11:15:31.460 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.455+0000 7f0c07a5b640 1 -- start start 2026-02-17T11:15:31.460 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.455+0000 7f0c07a5b640 10 monclient: init 2026-02-17T11:15:31.460 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.455+0000 7f0c07a5b640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:31.461 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.455+0000 7f0c07a5b640 10 monclient: _add_conns ranks=[0,1,3,4,2,5] 2026-02-17T11:15:31.461 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.455+0000 7f0c07a5b640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f0c0015d370 addr v1:10.20.193.49:6789/0 2026-02-17T11:15:31.461 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.455+0000 7f0c07a5b640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f0c000c7e20 addr v1:10.20.193.97:6789/0 2026-02-17T11:15:31.461 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.455+0000 7f0c07a5b640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f0c000c59c0 0x7f0c0015d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:31.461 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.455+0000 7f0c07a5b640 10 monclient(hunting): picked mon.noname-a con 0x7f0c000c59c0 addr v2:10.20.193.49:3300/0 2026-02-17T11:15:31.461 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.455+0000 7f0c07a5b640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c000c8350 con 0x7f0c0015d370 2026-02-17T11:15:31.461 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.456+0000 7f0c07a5b640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c000c8630 con 0x7f0c000c7e20 2026-02-17T11:15:31.461 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.456+0000 7f0c07a5b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:31.461 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.456+0000 7f0c07a5b640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f0c0015b710 con 0x7f0c000c59c0 2026-02-17T11:15:31.461 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.456+0000 7f0c07a5b640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:31.461 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.456+0000 7f0c07a5b640 10 monclient(hunting): authenticate will time out at 1408.119009s 2026-02-17T11:15:31.461 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.456+0000 7f0c05fd1640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f0c000c59c0 0x7f0c0015d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:31.462 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.456+0000 7f0c04fcf640 1 --1- >> v1:10.20.193.97:6789/0 conn(0x7f0c000c7e20 0x7f0c000c52b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.97:6789/0 says I am v1:10.20.193.49:39062/0 (socket says 10.20.193.49:39062) 2026-02-17T11:15:31.462 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.456+0000 7f0c04fcf640 1 -- 10.20.193.49:0/4149137578 learned_addr learned my addr 10.20.193.49:0/4149137578 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:15:31.462 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.456+0000 7f0c05fd1640 10 monclient(hunting): get_auth_request con 0x7f0c000c59c0 auth_method 0 2026-02-17T11:15:31.462 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.456+0000 7f0c05fd1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:31.462 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.456+0000 7f0c05fd1640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:31.462 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.456+0000 7f0c05fd1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:31.462 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.457+0000 7f0c05fd1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:31.462 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.457+0000 7f0c05fd1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:31.462 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.457+0000 7f0c05fd1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:31.462 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.457+0000 7f0beffff640 1 -- 10.20.193.49:0/4149137578 <== mon.1 v1:10.20.193.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2719579458 0 0) 0x7f0c000c8630 con 0x7f0c000c7e20 2026-02-17T11:15:31.462 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.457+0000 7f0beffff640 10 monclient(hunting): _negotiate 2026-02-17T11:15:31.462 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.457+0000 7f0beffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:31.463 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.457+0000 7f0beffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:31.463 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.457+0000 7f0beffff640 10 monclient(hunting): my global_id is 5101 2026-02-17T11:15:31.463 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.457+0000 7f0beffff640 1 -- 10.20.193.49:0/4149137578 --> v1:10.20.193.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0be8003620 con 0x7f0c000c7e20 2026-02-17T11:15:31.463 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.458+0000 7f0c05fd1640 10 monclient(hunting): handle_auth_done global_id 5115 payload 274 2026-02-17T11:15:31.463 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.458+0000 7f0c05fd1640 1 -- 10.20.193.49:0/4149137578 >> v1:10.20.193.97:6789/0 conn(0x7f0c000c7e20 legacy=0x7f0c000c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:31.463 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.458+0000 7f0c05fd1640 1 -- 10.20.193.49:0/4149137578 >> v1:10.20.193.49:6789/0 conn(0x7f0c0015d370 legacy=0x7f0c0015b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:31.463 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.458+0000 7f0c05fd1640 10 monclient: _finish_hunting 0 2026-02-17T11:15:31.463 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.458+0000 7f0c05fd1640 1 monclient: found mon.noname-a 2026-02-17T11:15:31.463 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.458+0000 7f0c05fd1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:31.463 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.458+0000 7f0c05fd1640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:15:31.463 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.458+0000 7f0c05fd1640 1 -- 10.20.193.49:0/4149137578 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c000c8910 con 0x7f0c000c59c0 2026-02-17T11:15:31.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.460+0000 7f0c05fd1640 1 --2- 10.20.193.49:0/4149137578 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0c000c59c0 0x7f0c0015d750 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc009d90 tx=0x7f0bfc02f230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fb9147bc0fd7d2a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:31.469 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.462+0000 7f0beffff640 1 -- 10.20.193.49:0/4149137578 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bfc03c070 con 0x7f0c000c59c0 2026-02-17T11:15:31.469 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.462+0000 7f0beffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:31.469 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.462+0000 7f0beffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:15:31.469 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.462+0000 7f0beffff640 10 monclient: dump: 2026-02-17T11:15:31.469 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:31.469 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:31.469 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:31.469 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:31.469 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:31.469 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:31.469 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:31.470 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:31.470 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:31.470 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:31.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.462+0000 7f0beffff640 10 monclient: _finish_auth 0 2026-02-17T11:15:31.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.462+0000 7f0beffff640 10 monclient: _check_auth_tickets 2026-02-17T11:15:31.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.462+0000 7f0beffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:31.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.462+0000 7f0beffff640 1 -- 10.20.193.49:0/4149137578 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bfc037440 con 0x7f0c000c59c0 2026-02-17T11:15:31.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.462+0000 7f0c07a5b640 5 monclient: authenticate success, global_id 5115 2026-02-17T11:15:31.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.462+0000 7f0c07a5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:15:31.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.462+0000 7f0beffff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:31.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.462+0000 7f0beffff640 1 -- 10.20.193.49:0/4149137578 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bfc037810 con 0x7f0c000c59c0 2026-02-17T11:15:31.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.462+0000 7f0beffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:31.471 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.462+0000 7f0beffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:15:31.471 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.462+0000 7f0beffff640 10 monclient: dump: 2026-02-17T11:15:31.471 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:31.471 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:31.471 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:31.471 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:31.471 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:31.471 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:31.471 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:31.471 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:31.471 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:31.471 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:31.471 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.462+0000 7f0c07a5b640 10 monclient: get_monmap_and_config success 2026-02-17T11:15:31.472 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.462+0000 7f0c07a5b640 4 set_mon_vals no callback set 2026-02-17T11:15:31.472 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.462+0000 7f0c07a5b640 10 monclient: shutdown 2026-02-17T11:15:31.472 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.462+0000 7f0c07a5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:31.472 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.462+0000 7f0c07a5b640 1 -- 10.20.193.49:0/4149137578 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0c000c59c0 msgr2=0x7f0c0015d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:31.472 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.462+0000 7f0c07a5b640 1 --2- 10.20.193.49:0/4149137578 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0c000c59c0 0x7f0c0015d750 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc009d90 tx=0x7f0bfc02f230 comp rx=0 tx=0).stop 2026-02-17T11:15:31.472 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.462+0000 7f0c07a5b640 1 -- 10.20.193.49:0/4149137578 shutdown_connections 2026-02-17T11:15:31.472 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.462+0000 7f0c07a5b640 1 --2- 10.20.193.49:0/4149137578 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0c000c59c0 0x7f0c0015d750 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:31.472 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.462+0000 7f0c07a5b640 1 -- 10.20.193.49:0/4149137578 >> 10.20.193.49:0/4149137578 conn(0x7f0c000c9f20 msgr2=0x7f0c000ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:31.472 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.462+0000 7f0c07a5b640 1 -- 10.20.193.49:0/4149137578 shutdown_connections 2026-02-17T11:15:31.472 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.462+0000 7f0c07a5b640 1 -- 10.20.193.49:0/4149137578 wait complete. 2026-02-17T11:15:31.472 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.463+0000 7f0c07a5b640 10 monclient: build_initial_monmap 2026-02-17T11:15:31.472 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.463+0000 7f0c07a5b640 10 monclient: monmap: 2026-02-17T11:15:31.473 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:31.473 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:15:31.473 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:15:31.473 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:15:31.473 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:31.473 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:31.473 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:15:31.473 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:15:31.473 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:15:31.473 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:31.473 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.463+0000 7f0c07a5b640 1 librados: starting msgr at 2026-02-17T11:15:31.473 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.463+0000 7f0c07a5b640 1 librados: starting objecter 2026-02-17T11:15:31.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.463+0000 7f0c07a5b640 1 Processor -- start 2026-02-17T11:15:31.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.463+0000 7f0c07a5b640 1 -- start start 2026-02-17T11:15:31.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.463+0000 7f0c07a5b640 1 librados: setting wanted keys 2026-02-17T11:15:31.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.463+0000 7f0c07a5b640 1 librados: calling monclient init 2026-02-17T11:15:31.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.463+0000 7f0c07a5b640 10 monclient: init 2026-02-17T11:15:31.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.463+0000 7f0c07a5b640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:31.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.463+0000 7f0c07a5b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:15:31.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.463+0000 7f0c07a5b640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f0c000c59c0 0x7f0c00143850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:31.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.463+0000 7f0c07a5b640 10 monclient(hunting): picked mon.noname-c con 0x7f0c000c59c0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:15:31.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.463+0000 7f0c07a5b640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0c000c7e20 0x7f0c001f2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:31.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.463+0000 7f0c07a5b640 10 monclient(hunting): picked mon.noname-a con 0x7f0c000c7e20 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:15:31.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.463+0000 7f0c07a5b640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f0c0015d370 0x7f0c00074040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:31.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.463+0000 7f0c07a5b640 10 monclient(hunting): picked mon.noname-b con 0x7f0c0015d370 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:15:31.475 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.463+0000 7f0c07a5b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:31.475 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.463+0000 7f0c07a5b640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0c000c8ed0 con 0x7f0c000c7e20 2026-02-17T11:15:31.475 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.463+0000 7f0c07a5b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:31.475 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.463+0000 7f0c07a5b640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f0c000c9240 con 0x7f0c0015d370 2026-02-17T11:15:31.475 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.463+0000 7f0c07a5b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:31.475 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.463+0000 7f0c07a5b640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f0c000c96d0 con 0x7f0c000c59c0 2026-02-17T11:15:31.475 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.463+0000 7f0c07a5b640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:31.475 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.463+0000 7f0c07a5b640 10 monclient(hunting): authenticate will time out at 1408.126717s 2026-02-17T11:15:31.475 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.463+0000 7f0c04fcf640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0c000c7e20 0x7f0c001f2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:31.475 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.464+0000 7f0c05fd1640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f0c0015d370 0x7f0c00074040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:31.475 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.464+0000 7f0c04fcf640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0c000c7e20 0x7f0c001f2cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:57314/0 (socket says 10.20.193.49:57314) 2026-02-17T11:15:31.475 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.464+0000 7f0c04fcf640 1 -- 10.20.193.49:0/883404402 learned_addr learned my addr 10.20.193.49:0/883404402 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:31.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.464+0000 7f0c04fcf640 10 monclient(hunting): get_auth_request con 0x7f0c000c7e20 auth_method 0 2026-02-17T11:15:31.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.464+0000 7f0c04fcf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:31.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.464+0000 7f0c04fcf640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:31.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.464+0000 7f0c04fcf640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:31.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.464+0000 7f0c057d0640 1 --2- 10.20.193.49:0/883404402 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f0c000c59c0 0x7f0c00143850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:31.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.464+0000 7f0c05fd1640 10 monclient(hunting): get_auth_request con 0x7f0c0015d370 auth_method 0 2026-02-17T11:15:31.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.464+0000 7f0c05fd1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:31.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.464+0000 7f0c05fd1640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:31.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.464+0000 7f0c05fd1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:31.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.464+0000 7f0c04fcf640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:31.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.464+0000 7f0c04fcf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:31.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.464+0000 7f0c04fcf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:31.477 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.464+0000 7f0c057d0640 10 monclient(hunting): get_auth_request con 0x7f0c000c59c0 auth_method 0 2026-02-17T11:15:31.477 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.464+0000 7f0c057d0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:31.477 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.464+0000 7f0c057d0640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:31.477 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.464+0000 7f0c057d0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:31.477 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.464+0000 7f0c05fd1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:31.477 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.464+0000 7f0c05fd1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:31.477 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.464+0000 7f0c05fd1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:31.477 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.464+0000 7f0c057d0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:31.477 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.464+0000 7f0c057d0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:31.477 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.464+0000 7f0c057d0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:31.477 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.465+0000 7f0c04fcf640 10 monclient(hunting): handle_auth_done global_id 5121 payload 824 2026-02-17T11:15:31.477 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.465+0000 7f0c04fcf640 1 -- 10.20.193.49:0/883404402 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f0c000c59c0 msgr2=0x7f0c00143850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:31.477 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.465+0000 7f0c04fcf640 1 --2- 10.20.193.49:0/883404402 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f0c000c59c0 0x7f0c00143850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:31.478 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.465+0000 7f0c04fcf640 1 -- 10.20.193.49:0/883404402 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f0c0015d370 msgr2=0x7f0c00074040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:31.478 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.465+0000 7f0c04fcf640 1 --2- 10.20.193.49:0/883404402 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f0c0015d370 0x7f0c00074040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:31.478 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.465+0000 7f0c04fcf640 10 monclient: _finish_hunting 0 2026-02-17T11:15:31.478 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.465+0000 7f0c04fcf640 1 monclient: found mon.noname-a 2026-02-17T11:15:31.478 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.465+0000 7f0c04fcf640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:31.478 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.465+0000 7f0c04fcf640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:15:31.478 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.465+0000 7f0c04fcf640 1 -- 10.20.193.49:0/883404402 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c000cb860 con 0x7f0c000c7e20 2026-02-17T11:15:31.478 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.466+0000 7f0c04fcf640 1 --2- 10.20.193.49:0/883404402 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0c000c7e20 0x7f0c001f2cc0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f0bf400c700 tx=0x7f0bf400cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:31.478 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.466+0000 7f0bedffb640 10 client.?.objecter ms_handle_connect 0x7f0c000c7e20 2026-02-17T11:15:31.478 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.466+0000 7f0bedffb640 10 client.?.objecter resend_mon_ops 2026-02-17T11:15:31.480 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.468+0000 7f0bedffb640 1 -- 10.20.193.49:0/883404402 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf4017070 con 0x7f0c000c7e20 2026-02-17T11:15:31.480 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.468+0000 7f0bedffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:31.481 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.468+0000 7f0bedffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:15:31.481 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.468+0000 7f0bedffb640 10 monclient: dump: 2026-02-17T11:15:31.481 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:31.481 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:31.481 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:31.481 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:31.481 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:31.481 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:31.481 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:31.481 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:31.481 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:31.482 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:31.482 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.468+0000 7f0bedffb640 10 monclient: _finish_auth 0 2026-02-17T11:15:31.482 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.468+0000 7f0bedffb640 10 monclient: _check_auth_tickets 2026-02-17T11:15:31.482 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.468+0000 7f0bedffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:31.482 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.468+0000 7f0bedffb640 1 -- 10.20.193.49:0/883404402 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bf4005bf0 con 0x7f0c000c7e20 2026-02-17T11:15:31.482 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.468+0000 7f0bedffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:31.482 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.468+0000 7f0bedffb640 1 -- 10.20.193.49:0/883404402 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf4007070 con 0x7f0c000c7e20 2026-02-17T11:15:31.482 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.468+0000 7f0c07a5b640 5 monclient: authenticate success, global_id 5121 2026-02-17T11:15:31.482 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.468+0000 7f0bef7fe640 4 set_mon_vals no callback set 2026-02-17T11:15:31.482 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.468+0000 7f0c07a5b640 10 monclient: _renew_subs 2026-02-17T11:15:31.482 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.468+0000 7f0c07a5b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:31.482 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.468+0000 7f0c07a5b640 1 -- 10.20.193.49:0/883404402 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c000cbb40 con 0x7f0c000c7e20 2026-02-17T11:15:31.482 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.468+0000 7f0bedffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:31.483 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.468+0000 7f0bedffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:15:31.483 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.468+0000 7f0bedffb640 10 monclient: dump: 2026-02-17T11:15:31.483 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:31.483 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:31.483 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:31.483 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:31.483 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:31.483 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:31.483 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:31.483 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:31.483 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:31.483 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:31.484 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.468+0000 7f0c07a5b640 10 client.5121.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:31.484 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.468+0000 7f0c07a5b640 10 monclient: _renew_subs 2026-02-17T11:15:31.484 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.468+0000 7f0c07a5b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:31.484 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.468+0000 7f0c07a5b640 1 -- 10.20.193.49:0/883404402 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c000cc100 con 0x7f0c000c7e20 2026-02-17T11:15:31.484 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.468+0000 7f0c07a5b640 1 librados: init done 2026-02-17T11:15:31.484 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.469+0000 7f0c07a5b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:31.484 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.469+0000 7f0c07a5b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:31.484 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.469+0000 7f0c07a5b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:31.484 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.469+0000 7f0c07a5b640 1 -- 10.20.193.49:0/883404402 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c0015d750 con 0x7f0c000c7e20 2026-02-17T11:15:31.576 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.574+0000 7f0bedffb640 1 -- 10.20.193.49:0/883404402 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f0bf4007210 con 0x7f0c000c7e20 2026-02-17T11:15:31.576 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.575+0000 7f0bedffb640 1 --2- 10.20.193.49:0/883404402 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0bd0079140 0x7f0bd007b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:31.576 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.575+0000 7f0c057d0640 1 --2- 10.20.193.49:0/883404402 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0bd0079140 0x7f0bd007b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:31.577 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.575+0000 7f0c057d0640 10 monclient: get_auth_request con 0x7f0bd0079140 auth_method 0 2026-02-17T11:15:31.577 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.575+0000 7f0c057d0640 1 --2- 10.20.193.49:0/883404402 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0bd0079140 0x7f0bd007b600 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0bf0002410 tx=0x7f0bf0007ef0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:31.577 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.575+0000 7f0bedffb640 10 client.5121.objecter ms_handle_connect 0x7f0bd0079140 2026-02-17T11:15:31.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.582+0000 7f0bedffb640 1 -- 10.20.193.49:0/883404402 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f0bf405d700 con 0x7f0c000c7e20 2026-02-17T11:15:31.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.582+0000 7f0bedffb640 10 client.5121.objecter ms_dispatch2 0x7f0c00000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:15:31.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.582+0000 7f0bedffb640 3 client.5121.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:15:31.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.582+0000 7f0bedffb640 3 client.5121.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:15:31.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.582+0000 7f0bedffb640 20 client.5121.objecter dump_active .. 0 homeless 2026-02-17T11:15:31.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.582+0000 7f0bedffb640 1 -- 10.20.193.49:0/883404402 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f0bf4021020 con 0x7f0c000c7e20 2026-02-17T11:15:31.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.582+0000 7f0bedffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:31.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.582+0000 7f0bedffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:15:31.688 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.687+0000 7f0c07a5b640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:15:31.689 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.687+0000 7f0c07a5b640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:15:31.689 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.687+0000 7f0c07a5b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:31.689 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.687+0000 7f0c07a5b640 1 -- 10.20.193.49:0/883404402 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f0c00151dd0 con 0x7f0c000c7e20 2026-02-17T11:15:31.691 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.690+0000 7f0bedffb640 1 -- 10.20.193.49:0/883404402 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f0bf40616c0 con 0x7f0c000c7e20 2026-02-17T11:15:31.691 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.690+0000 7f0bedffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:15:31.692 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.690+0000 7f0bedffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:15:31.692 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:15:31.692 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:15:31.693 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.691+0000 7f0c07a5b640 10 librados: watch_flush enter 2026-02-17T11:15:31.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.691+0000 7f0c07a5b640 10 librados: watch_flush exit 2026-02-17T11:15:31.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.691+0000 7f0c07a5b640 20 client.5121.objecter shutdown clearing up homeless session... 2026-02-17T11:15:31.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.691+0000 7f0c07a5b640 10 client.5121.objecter successfully canceled tick 2026-02-17T11:15:31.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.691+0000 7f0c07a5b640 1 -- 10.20.193.49:0/883404402 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0bd0079140 msgr2=0x7f0bd007b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:31.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.691+0000 7f0c07a5b640 1 --2- 10.20.193.49:0/883404402 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0bd0079140 0x7f0bd007b600 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0bf0002410 tx=0x7f0bf0007ef0 comp rx=0 tx=0).stop 2026-02-17T11:15:31.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.691+0000 7f0c07a5b640 10 monclient: shutdown 2026-02-17T11:15:31.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.691+0000 7f0c07a5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:31.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.691+0000 7f0c07a5b640 1 -- 10.20.193.49:0/883404402 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0c000c7e20 msgr2=0x7f0c001f2cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:31.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.691+0000 7f0c07a5b640 1 --2- 10.20.193.49:0/883404402 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0c000c7e20 0x7f0c001f2cc0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f0bf400c700 tx=0x7f0bf400cbd0 comp rx=0 tx=0).stop 2026-02-17T11:15:31.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.691+0000 7f0c07a5b640 1 -- 10.20.193.49:0/883404402 shutdown_connections 2026-02-17T11:15:31.695 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.691+0000 7f0c07a5b640 1 --2- 10.20.193.49:0/883404402 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0bd0079140 0x7f0bd007b600 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:31.695 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.691+0000 7f0c07a5b640 1 --2- 10.20.193.49:0/883404402 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f0c0015d370 0x7f0c00074040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:31.695 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.691+0000 7f0c07a5b640 1 --2- 10.20.193.49:0/883404402 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f0c000c7e20 0x7f0c001f2cc0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:31.695 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.691+0000 7f0c07a5b640 1 --2- 10.20.193.49:0/883404402 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f0c000c59c0 0x7f0c00143850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:31.695 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.691+0000 7f0c07a5b640 1 -- 10.20.193.49:0/883404402 >> 10.20.193.49:0/883404402 conn(0x7f0c000c9f20 msgr2=0x7f0c0015dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:31.695 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.691+0000 7f0c07a5b640 1 -- 10.20.193.49:0/883404402 shutdown_connections 2026-02-17T11:15:31.695 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.691+0000 7f0c07a5b640 1 -- 10.20.193.49:0/883404402 wait complete. 2026-02-17T11:15:31.695 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:31.691+0000 7f0c07a5b640 1 librados: shutdown 2026-02-17T11:15:32.134 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:07:17.616 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:15:32.161 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:07:17.642 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:15:32.164 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:07:17.639 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:15:32.166 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:07:17.641 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:15:32.169 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:07:17.651 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:15:32.174 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:07:17.649 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:15:32.187 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:07:17.629 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:15:32.190 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:07:17.632 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:15:32.197 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:07:17.639 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:15:34.703 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:15:34.776 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.772+0000 7faae4f61640 10 monclient: get_monmap_and_config 2026-02-17T11:15:34.777 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.772+0000 7faae4f61640 10 monclient: build_initial_monmap 2026-02-17T11:15:34.777 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.772+0000 7faae4f61640 10 monclient: monmap: 2026-02-17T11:15:34.777 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:34.777 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:34.777 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:15:34.773613+0000 2026-02-17T11:15:34.777 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:15:34.773613+0000 2026-02-17T11:15:34.777 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:34.777 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:34.777 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:15:34.777 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:15:34.778 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:15:34.778 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:15:34.778 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:15:34.778 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:15:34.778 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:34.778 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.772+0000 7faae4f61640 1 Processor -- start 2026-02-17T11:15:34.778 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.772+0000 7faae4f61640 1 -- start start 2026-02-17T11:15:34.778 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.772+0000 7faae4f61640 10 monclient: init 2026-02-17T11:15:34.778 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.773+0000 7faae4f61640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:34.778 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.773+0000 7faae4f61640 10 monclient: _add_conns ranks=[2,5,3,0,1,4] 2026-02-17T11:15:34.778 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.773+0000 7faae4f61640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7faae015d370 addr v1:10.20.193.157:6789/0 2026-02-17T11:15:34.778 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.773+0000 7faae4f61640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7faae00c7e20 0x7faae015d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:34.779 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.773+0000 7faae4f61640 10 monclient(hunting): picked mon.noname-c con 0x7faae00c7e20 addr v2:10.20.193.157:3300/0 2026-02-17T11:15:34.779 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.773+0000 7faae4f61640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7faae00c74c0 0x7faae00c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:34.779 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.773+0000 7faae4f61640 10 monclient(hunting): picked mon.noname-a con 0x7faae00c74c0 addr v2:10.20.193.49:3300/0 2026-02-17T11:15:34.779 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.773+0000 7faae4f61640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faae00c8350 con 0x7faae015d370 2026-02-17T11:15:34.779 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.773+0000 7faae4f61640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:34.779 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.773+0000 7faae4f61640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7faae015b710 con 0x7faae00c74c0 2026-02-17T11:15:34.779 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.773+0000 7faae4f61640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:34.779 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.773+0000 7faae4f61640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7faae00c9240 con 0x7faae00c7e20 2026-02-17T11:15:34.779 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.773+0000 7faae4f61640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:34.779 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.773+0000 7faae4f61640 10 monclient(hunting): authenticate will time out at 1411.437068s 2026-02-17T11:15:34.779 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.773+0000 7faaded76640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7faae00c74c0 0x7faae00c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:34.779 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.773+0000 7faade575640 1 --1- >> v1:10.20.193.157:6789/0 conn(0x7faae015d370 0x7faae015b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.157:6789/0 says I am v1:10.20.193.49:50426/0 (socket says 10.20.193.49:50426) 2026-02-17T11:15:34.780 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.773+0000 7faade575640 1 -- 10.20.193.49:0/3773300475 learned_addr learned my addr 10.20.193.49:0/3773300475 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:15:34.780 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.773+0000 7faaded76640 10 monclient(hunting): get_auth_request con 0x7faae00c74c0 auth_method 0 2026-02-17T11:15:34.780 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.773+0000 7faaded76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:34.780 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.773+0000 7faaded76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:34.780 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.773+0000 7faaded76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:34.780 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.773+0000 7faaddd74640 1 --2- 10.20.193.49:0/3773300475 >> v2:10.20.193.157:3300/0 conn(0x7faae00c7e20 0x7faae015d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:34.780 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.774+0000 7faaded76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:34.780 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.774+0000 7faaded76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:34.780 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.774+0000 7faaded76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:34.780 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.774+0000 7faaddd74640 10 monclient(hunting): get_auth_request con 0x7faae00c7e20 auth_method 0 2026-02-17T11:15:34.780 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.774+0000 7faaddd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:34.780 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.774+0000 7faaddd74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:34.780 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.774+0000 7faaddd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:34.788 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.774+0000 7faaded76640 10 monclient(hunting): handle_auth_done global_id 5124 payload 274 2026-02-17T11:15:34.788 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.774+0000 7faaded76640 1 -- 10.20.193.49:0/3773300475 >> v2:10.20.193.157:3300/0 conn(0x7faae00c7e20 msgr2=0x7faae015d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:15:34.788 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.774+0000 7faaded76640 1 --2- 10.20.193.49:0/3773300475 >> v2:10.20.193.157:3300/0 conn(0x7faae00c7e20 0x7faae015d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:34.788 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.774+0000 7faaded76640 1 -- 10.20.193.49:0/3773300475 >> v1:10.20.193.157:6789/0 conn(0x7faae015d370 legacy=0x7faae015b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:34.788 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.774+0000 7faaded76640 10 monclient: _finish_hunting 0 2026-02-17T11:15:34.788 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.774+0000 7faaded76640 1 monclient: found mon.noname-a 2026-02-17T11:15:34.788 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.774+0000 7faaded76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:34.788 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.774+0000 7faaded76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:15:34.788 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.774+0000 7faaded76640 1 -- 10.20.193.49:0/3773300475 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faae00c8630 con 0x7faae00c74c0 2026-02-17T11:15:34.788 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.775+0000 7faaded76640 1 --2- 10.20.193.49:0/3773300475 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7faae00c74c0 0x7faae00c52b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7faae015d060 tx=0x7faad002f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b04af0014e7e2f4 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:34.788 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.777+0000 7faadd573640 1 -- 10.20.193.49:0/3773300475 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad003c070 con 0x7faae00c74c0 2026-02-17T11:15:34.788 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.777+0000 7faadd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:34.788 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.777+0000 7faadd573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:15:34.788 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.777+0000 7faadd573640 10 monclient: dump: 2026-02-17T11:15:34.788 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:34.788 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:34.788 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:34.788 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:34.788 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:34.788 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:34.788 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:34.788 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:34.788 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:34.788 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:34.789 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.777+0000 7faadd573640 10 monclient: _finish_auth 0 2026-02-17T11:15:34.789 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.777+0000 7faadd573640 10 monclient: _check_auth_tickets 2026-02-17T11:15:34.789 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.777+0000 7faadd573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:34.789 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.777+0000 7faadd573640 1 -- 10.20.193.49:0/3773300475 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faad0037440 con 0x7faae00c74c0 2026-02-17T11:15:34.789 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.777+0000 7faae4f61640 5 monclient: authenticate success, global_id 5124 2026-02-17T11:15:34.789 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.777+0000 7faae4f61640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:15:34.789 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.777+0000 7faadd573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:34.789 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.777+0000 7faadd573640 1 -- 10.20.193.49:0/3773300475 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad0037810 con 0x7faae00c74c0 2026-02-17T11:15:34.789 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.777+0000 7faadd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:34.789 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.777+0000 7faadd573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:15:34.789 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.777+0000 7faadd573640 10 monclient: dump: 2026-02-17T11:15:34.789 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:34.789 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:34.789 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:34.789 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:34.789 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:34.789 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:34.789 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:34.789 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:34.789 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:34.789 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:34.789 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.777+0000 7faae4f61640 10 monclient: get_monmap_and_config success 2026-02-17T11:15:34.789 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.777+0000 7faae4f61640 4 set_mon_vals no callback set 2026-02-17T11:15:34.789 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.778+0000 7faae4f61640 10 monclient: shutdown 2026-02-17T11:15:34.789 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.778+0000 7faae4f61640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:34.789 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.778+0000 7faae4f61640 1 -- 10.20.193.49:0/3773300475 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7faae00c74c0 msgr2=0x7faae00c52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:34.789 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.778+0000 7faae4f61640 1 --2- 10.20.193.49:0/3773300475 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7faae00c74c0 0x7faae00c52b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7faae015d060 tx=0x7faad002f1c0 comp rx=0 tx=0).stop 2026-02-17T11:15:34.789 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.778+0000 7faae4f61640 1 -- 10.20.193.49:0/3773300475 shutdown_connections 2026-02-17T11:15:34.789 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.778+0000 7faae4f61640 1 --2- 10.20.193.49:0/3773300475 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7faae00c74c0 0x7faae00c52b0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:34.789 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.778+0000 7faae4f61640 1 --2- 10.20.193.49:0/3773300475 >> v2:10.20.193.157:3300/0 conn(0x7faae00c7e20 0x7faae015d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:34.789 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.778+0000 7faae4f61640 1 -- 10.20.193.49:0/3773300475 >> 10.20.193.49:0/3773300475 conn(0x7faae00c9f20 msgr2=0x7faae00ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:34.789 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.778+0000 7faae4f61640 1 -- 10.20.193.49:0/3773300475 shutdown_connections 2026-02-17T11:15:34.789 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.778+0000 7faae4f61640 1 -- 10.20.193.49:0/3773300475 wait complete. 2026-02-17T11:15:34.789 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.778+0000 7faae4f61640 10 monclient: build_initial_monmap 2026-02-17T11:15:34.789 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.778+0000 7faae4f61640 10 monclient: monmap: 2026-02-17T11:15:34.789 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:34.789 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:15:34.789 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:15:34.789 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:15:34.789 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:34.789 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:34.789 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:15:34.790 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:15:34.790 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:15:34.790 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:34.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.778+0000 7faae4f61640 1 librados: starting msgr at 2026-02-17T11:15:34.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.778+0000 7faae4f61640 1 librados: starting objecter 2026-02-17T11:15:34.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.778+0000 7faae4f61640 1 Processor -- start 2026-02-17T11:15:34.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.778+0000 7faae4f61640 1 -- start start 2026-02-17T11:15:34.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.778+0000 7faae4f61640 1 librados: setting wanted keys 2026-02-17T11:15:34.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.778+0000 7faae4f61640 1 librados: calling monclient init 2026-02-17T11:15:34.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.778+0000 7faae4f61640 10 monclient: init 2026-02-17T11:15:34.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.779+0000 7faae4f61640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:34.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.779+0000 7faae4f61640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:15:34.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.779+0000 7faae4f61640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7faae00c74c0 0x7faae0154400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:34.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.779+0000 7faae4f61640 10 monclient(hunting): picked mon.noname-c con 0x7faae00c74c0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:15:34.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.779+0000 7faae4f61640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7faae00c7e20 0x7faae01f24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:34.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.779+0000 7faae4f61640 10 monclient(hunting): picked mon.noname-b con 0x7faae00c7e20 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:15:34.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.779+0000 7faae4f61640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7faae015d370 0x7faae01f4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:34.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.779+0000 7faae4f61640 10 monclient(hunting): picked mon.noname-a con 0x7faae015d370 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:15:34.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.779+0000 7faae4f61640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:34.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.779+0000 7faae4f61640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7faae00c8ed0 con 0x7faae015d370 2026-02-17T11:15:34.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.779+0000 7faae4f61640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:34.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.779+0000 7faae4f61640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7faae00c8bf0 con 0x7faae00c7e20 2026-02-17T11:15:34.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.779+0000 7faae4f61640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:34.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.779+0000 7faae4f61640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7faae00c96d0 con 0x7faae00c74c0 2026-02-17T11:15:34.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.779+0000 7faae4f61640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:34.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.779+0000 7faae4f61640 10 monclient(hunting): authenticate will time out at 1411.443354s 2026-02-17T11:15:34.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.779+0000 7faaded76640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7faae015d370 0x7faae01f4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:34.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.779+0000 7faaded76640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7faae015d370 0x7faae01f4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:57340/0 (socket says 10.20.193.49:57340) 2026-02-17T11:15:34.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.779+0000 7faaded76640 1 -- 10.20.193.49:0/228072095 learned_addr learned my addr 10.20.193.49:0/228072095 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:34.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.779+0000 7faaded76640 10 monclient(hunting): get_auth_request con 0x7faae015d370 auth_method 0 2026-02-17T11:15:34.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.779+0000 7faaded76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:34.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.779+0000 7faaded76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:34.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.779+0000 7faaded76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:34.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.779+0000 7faade575640 1 --2- 10.20.193.49:0/228072095 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7faae00c74c0 0x7faae0154400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:34.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.779+0000 7faaddd74640 1 --2- 10.20.193.49:0/228072095 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7faae00c7e20 0x7faae01f24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:34.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.779+0000 7faade575640 10 monclient(hunting): get_auth_request con 0x7faae00c74c0 auth_method 0 2026-02-17T11:15:34.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.779+0000 7faade575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:34.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.779+0000 7faade575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:34.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.779+0000 7faade575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:34.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.779+0000 7faaded76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:34.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.779+0000 7faaded76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:34.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.779+0000 7faaded76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:34.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.780+0000 7faaddd74640 10 monclient(hunting): get_auth_request con 0x7faae00c7e20 auth_method 0 2026-02-17T11:15:34.790 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.780+0000 7faaddd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:34.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.780+0000 7faaddd74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:34.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.780+0000 7faaddd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:34.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.780+0000 7faade575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:34.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.780+0000 7faade575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:34.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.780+0000 7faade575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:34.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.780+0000 7faaddd74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:34.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.780+0000 7faaddd74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:34.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.780+0000 7faaddd74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:34.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.781+0000 7faaded76640 10 monclient(hunting): handle_auth_done global_id 5127 payload 824 2026-02-17T11:15:34.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.781+0000 7faaded76640 1 -- 10.20.193.49:0/228072095 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7faae00c74c0 msgr2=0x7faae0154400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:34.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.781+0000 7faaded76640 1 --2- 10.20.193.49:0/228072095 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7faae00c74c0 0x7faae0154400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:34.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.781+0000 7faaded76640 1 -- 10.20.193.49:0/228072095 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7faae00c7e20 msgr2=0x7faae01f24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:34.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.781+0000 7faaded76640 1 --2- 10.20.193.49:0/228072095 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7faae00c7e20 0x7faae01f24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:34.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.781+0000 7faaded76640 10 monclient: _finish_hunting 0 2026-02-17T11:15:34.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.781+0000 7faaded76640 1 monclient: found mon.noname-a 2026-02-17T11:15:34.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.781+0000 7faaded76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:34.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.781+0000 7faaded76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:15:34.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.781+0000 7faaded76640 1 -- 10.20.193.49:0/228072095 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faae0154940 con 0x7faae015d370 2026-02-17T11:15:34.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.782+0000 7faaded76640 1 --2- 10.20.193.49:0/228072095 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7faae015d370 0x7faae01f4840 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7faad002f6f0 tx=0x7faad0004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:34.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.782+0000 7faac6ffd640 10 client.?.objecter ms_handle_connect 0x7faae015d370 2026-02-17T11:15:34.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.782+0000 7faac6ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:15:34.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.783+0000 7faac6ffd640 1 -- 10.20.193.49:0/228072095 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad003c050 con 0x7faae015d370 2026-02-17T11:15:34.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.783+0000 7faac6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:34.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.783+0000 7faac6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:15:34.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.783+0000 7faac6ffd640 10 monclient: dump: 2026-02-17T11:15:34.791 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:34.791 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:34.791 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:34.791 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:34.791 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:34.791 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:34.791 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:34.791 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:34.791 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:34.791 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:34.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.783+0000 7faac6ffd640 10 monclient: _finish_auth 0 2026-02-17T11:15:34.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.783+0000 7faac6ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:15:34.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.783+0000 7faac6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:34.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.783+0000 7faac6ffd640 1 -- 10.20.193.49:0/228072095 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faad0048070 con 0x7faae015d370 2026-02-17T11:15:34.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.783+0000 7faae4f61640 5 monclient: authenticate success, global_id 5127 2026-02-17T11:15:34.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.783+0000 7faac6ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:34.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.783+0000 7faac6ffd640 1 -- 10.20.193.49:0/228072095 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad0009450 con 0x7faae015d370 2026-02-17T11:15:34.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.783+0000 7faadcd72640 4 set_mon_vals no callback set 2026-02-17T11:15:34.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.783+0000 7faae4f61640 10 monclient: _renew_subs 2026-02-17T11:15:34.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.783+0000 7faae4f61640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:34.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.783+0000 7faae4f61640 1 -- 10.20.193.49:0/228072095 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faae0154c10 con 0x7faae015d370 2026-02-17T11:15:34.792 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.783+0000 7faac6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:34.792 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.783+0000 7faac6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:15:34.792 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.783+0000 7faac6ffd640 10 monclient: dump: 2026-02-17T11:15:34.792 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:34.792 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:34.792 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:34.792 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:34.792 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:34.792 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:34.792 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:34.792 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:34.792 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:34.792 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:34.792 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.783+0000 7faae4f61640 10 client.5127.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:34.792 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.783+0000 7faae4f61640 10 monclient: _renew_subs 2026-02-17T11:15:34.792 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.783+0000 7faae4f61640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:34.792 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.784+0000 7faae4f61640 1 -- 10.20.193.49:0/228072095 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faae01551d0 con 0x7faae015d370 2026-02-17T11:15:34.792 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.784+0000 7faae4f61640 1 librados: init done 2026-02-17T11:15:34.792 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.784+0000 7faae4f61640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:34.792 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.784+0000 7faae4f61640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:34.792 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.784+0000 7faae4f61640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:34.792 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.784+0000 7faae4f61640 1 -- 10.20.193.49:0/228072095 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faae015d750 con 0x7faae015d370 2026-02-17T11:15:34.798 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.796+0000 7faac6ffd640 1 -- 10.20.193.49:0/228072095 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7faad004d460 con 0x7faae015d370 2026-02-17T11:15:34.799 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.796+0000 7faac6ffd640 1 --2- 10.20.193.49:0/228072095 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7faaac0791c0 0x7faaac07b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:34.799 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.796+0000 7faade575640 1 --2- 10.20.193.49:0/228072095 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7faaac0791c0 0x7faaac07b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:34.799 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.796+0000 7faade575640 10 monclient: get_auth_request con 0x7faaac0791c0 auth_method 0 2026-02-17T11:15:34.800 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.797+0000 7faade575640 1 --2- 10.20.193.49:0/228072095 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7faaac0791c0 0x7faaac07b680 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7faad4002770 tx=0x7faad4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:34.800 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.797+0000 7faac6ffd640 10 client.5127.objecter ms_handle_connect 0x7faaac0791c0 2026-02-17T11:15:34.898 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.896+0000 7faac6ffd640 1 -- 10.20.193.49:0/228072095 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7faad0035d40 con 0x7faae015d370 2026-02-17T11:15:34.899 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.896+0000 7faac6ffd640 10 client.5127.objecter ms_dispatch2 0x7faae0000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:15:34.899 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.896+0000 7faac6ffd640 3 client.5127.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:15:34.899 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.896+0000 7faac6ffd640 3 client.5127.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:15:34.899 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.896+0000 7faac6ffd640 20 client.5127.objecter dump_active .. 0 homeless 2026-02-17T11:15:34.899 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.896+0000 7faac6ffd640 1 -- 10.20.193.49:0/228072095 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7faad0037e20 con 0x7faae015d370 2026-02-17T11:15:34.899 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.896+0000 7faac6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:34.899 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.896+0000 7faac6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:15:35.000 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.998+0000 7faae4f61640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:15:35.000 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.998+0000 7faae4f61640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:15:35.000 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.998+0000 7faae4f61640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:35.000 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:34.998+0000 7faae4f61640 1 -- 10.20.193.49:0/228072095 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7faae01f2a10 con 0x7faae015d370 2026-02-17T11:15:35.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:35.000+0000 7faac6ffd640 1 -- 10.20.193.49:0/228072095 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7faad00886e0 con 0x7faae015d370 2026-02-17T11:15:35.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:35.000+0000 7faac6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:15:35.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:35.000+0000 7faac6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:15:35.002 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:15:35.003 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:15:35.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:35.002+0000 7faae4f61640 10 librados: watch_flush enter 2026-02-17T11:15:35.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:35.002+0000 7faae4f61640 10 librados: watch_flush exit 2026-02-17T11:15:35.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:35.002+0000 7faae4f61640 20 client.5127.objecter shutdown clearing up homeless session... 2026-02-17T11:15:35.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:35.002+0000 7faae4f61640 10 client.5127.objecter successfully canceled tick 2026-02-17T11:15:35.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:35.002+0000 7faae4f61640 1 -- 10.20.193.49:0/228072095 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7faaac0791c0 msgr2=0x7faaac07b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:35.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:35.002+0000 7faae4f61640 1 --2- 10.20.193.49:0/228072095 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7faaac0791c0 0x7faaac07b680 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7faad4002770 tx=0x7faad4009040 comp rx=0 tx=0).stop 2026-02-17T11:15:35.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:35.002+0000 7faae4f61640 10 monclient: shutdown 2026-02-17T11:15:35.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:35.002+0000 7faae4f61640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:35.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:35.002+0000 7faae4f61640 1 -- 10.20.193.49:0/228072095 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7faae015d370 msgr2=0x7faae01f4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:35.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:35.002+0000 7faae4f61640 1 --2- 10.20.193.49:0/228072095 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7faae015d370 0x7faae01f4840 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7faad002f6f0 tx=0x7faad0004b40 comp rx=0 tx=0).stop 2026-02-17T11:15:35.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:35.002+0000 7faae4f61640 1 -- 10.20.193.49:0/228072095 shutdown_connections 2026-02-17T11:15:35.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:35.002+0000 7faae4f61640 1 --2- 10.20.193.49:0/228072095 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7faaac0791c0 0x7faaac07b680 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:35.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:35.002+0000 7faae4f61640 1 --2- 10.20.193.49:0/228072095 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7faae015d370 0x7faae01f4840 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:35.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:35.002+0000 7faae4f61640 1 --2- 10.20.193.49:0/228072095 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7faae00c7e20 0x7faae01f24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:35.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:35.002+0000 7faae4f61640 1 --2- 10.20.193.49:0/228072095 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7faae00c74c0 0x7faae0154400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:35.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:35.002+0000 7faae4f61640 1 -- 10.20.193.49:0/228072095 >> 10.20.193.49:0/228072095 conn(0x7faae00c9f20 msgr2=0x7faae015c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:35.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:35.002+0000 7faae4f61640 1 -- 10.20.193.49:0/228072095 shutdown_connections 2026-02-17T11:15:35.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:35.002+0000 7faae4f61640 1 -- 10.20.193.49:0/228072095 wait complete. 2026-02-17T11:15:35.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:35.002+0000 7faae4f61640 1 librados: shutdown 2026-02-17T11:15:38.014 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:15:38.081 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.078+0000 7fc6206b0640 10 monclient: get_monmap_and_config 2026-02-17T11:15:38.081 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.078+0000 7fc6206b0640 10 monclient: build_initial_monmap 2026-02-17T11:15:38.081 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.078+0000 7fc6206b0640 10 monclient: monmap: 2026-02-17T11:15:38.081 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:38.081 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:38.081 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:15:38.080414+0000 2026-02-17T11:15:38.081 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:15:38.080414+0000 2026-02-17T11:15:38.081 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:38.081 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:38.081 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:15:38.081 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:15:38.081 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:15:38.081 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:15:38.081 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:15:38.081 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:15:38.081 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:38.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.079+0000 7fc6206b0640 1 Processor -- start 2026-02-17T11:15:38.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.079+0000 7fc6206b0640 1 -- start start 2026-02-17T11:15:38.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.079+0000 7fc6206b0640 10 monclient: init 2026-02-17T11:15:38.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.079+0000 7fc6206b0640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:38.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.079+0000 7fc6206b0640 10 monclient: _add_conns ranks=[4,3,2,0,1,5] 2026-02-17T11:15:38.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.079+0000 7fc6206b0640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7fc6180c7170 0x7fc6180c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:38.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.079+0000 7fc6206b0640 10 monclient(hunting): picked mon.noname-b con 0x7fc6180c7170 addr v2:10.20.193.97:3300/0 2026-02-17T11:15:38.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.079+0000 7fc6206b0640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fc6180c48c0 0x7fc6180749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:38.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.079+0000 7fc6206b0640 10 monclient(hunting): picked mon.noname-a con 0x7fc6180c48c0 addr v2:10.20.193.49:3300/0 2026-02-17T11:15:38.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.079+0000 7fc6206b0640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fc618074ef0 addr v1:10.20.193.157:6789/0 2026-02-17T11:15:38.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.079+0000 7fc6206b0640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc61815a9a0 con 0x7fc618074ef0 2026-02-17T11:15:38.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.079+0000 7fc6206b0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:38.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.079+0000 7fc6206b0640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7fc6180c8530 con 0x7fc6180c48c0 2026-02-17T11:15:38.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.079+0000 7fc6206b0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:38.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.079+0000 7fc6206b0640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7fc6180c5270 con 0x7fc6180c7170 2026-02-17T11:15:38.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.079+0000 7fc6206b0640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:38.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.079+0000 7fc6206b0640 10 monclient(hunting): authenticate will time out at 1414.743867s 2026-02-17T11:15:38.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.080+0000 7fc61dc24640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fc6180c48c0 0x7fc6180749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:38.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.080+0000 7fc61ec26640 1 --1- >> v1:10.20.193.157:6789/0 conn(0x7fc618074ef0 0x7fc6180c89c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.157:6789/0 says I am v1:10.20.193.49:48926/0 (socket says 10.20.193.49:48926) 2026-02-17T11:15:38.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.080+0000 7fc61ec26640 1 -- 10.20.193.49:0/2659034289 learned_addr learned my addr 10.20.193.49:0/2659034289 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:15:38.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.080+0000 7fc61e425640 1 --2- 10.20.193.49:0/2659034289 >> v2:10.20.193.97:3300/0 conn(0x7fc6180c7170 0x7fc6180c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:38.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.080+0000 7fc61dc24640 10 monclient(hunting): get_auth_request con 0x7fc6180c48c0 auth_method 0 2026-02-17T11:15:38.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.080+0000 7fc61dc24640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:38.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.080+0000 7fc61dc24640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:38.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.080+0000 7fc61dc24640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:38.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.080+0000 7fc61e425640 10 monclient(hunting): get_auth_request con 0x7fc6180c7170 auth_method 0 2026-02-17T11:15:38.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.080+0000 7fc61e425640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:38.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.080+0000 7fc61e425640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:38.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.080+0000 7fc61e425640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:38.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.080+0000 7fc61dc24640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:38.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.080+0000 7fc61dc24640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:38.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.080+0000 7fc61dc24640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:38.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.081+0000 7fc61e425640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:38.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.081+0000 7fc61e425640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:38.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.081+0000 7fc61e425640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:38.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.081+0000 7fc61d423640 1 -- 10.20.193.49:0/2659034289 <== mon.2 v1:10.20.193.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3420761102 0 0) 0x7fc61815a9a0 con 0x7fc618074ef0 2026-02-17T11:15:38.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.081+0000 7fc61d423640 10 monclient(hunting): _negotiate 2026-02-17T11:15:38.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.081+0000 7fc61d423640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:38.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.081+0000 7fc61d423640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:38.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.081+0000 7fc61d423640 10 monclient(hunting): my global_id is 5153 2026-02-17T11:15:38.083 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.081+0000 7fc61d423640 1 -- 10.20.193.49:0/2659034289 --> v1:10.20.193.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc600003620 con 0x7fc618074ef0 2026-02-17T11:15:38.084 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.081+0000 7fc61dc24640 10 monclient(hunting): handle_auth_done global_id 5130 payload 274 2026-02-17T11:15:38.084 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.081+0000 7fc61dc24640 1 -- 10.20.193.49:0/2659034289 >> v2:10.20.193.97:3300/0 conn(0x7fc6180c7170 msgr2=0x7fc6180c7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:15:38.084 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.081+0000 7fc61dc24640 1 --2- 10.20.193.49:0/2659034289 >> v2:10.20.193.97:3300/0 conn(0x7fc6180c7170 0x7fc6180c7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:38.084 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.081+0000 7fc61dc24640 1 -- 10.20.193.49:0/2659034289 >> v1:10.20.193.157:6789/0 conn(0x7fc618074ef0 legacy=0x7fc6180c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:38.084 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.081+0000 7fc61dc24640 10 monclient: _finish_hunting 0 2026-02-17T11:15:38.084 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.081+0000 7fc61dc24640 1 monclient: found mon.noname-a 2026-02-17T11:15:38.084 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.081+0000 7fc61dc24640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:38.084 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.081+0000 7fc61dc24640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:15:38.084 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.081+0000 7fc61dc24640 1 -- 10.20.193.49:0/2659034289 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6180c5550 con 0x7fc6180c48c0 2026-02-17T11:15:38.084 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.082+0000 7fc61dc24640 1 --2- 10.20.193.49:0/2659034289 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc6180c48c0 0x7fc6180749b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc6180723c0 tx=0x7fc60c02ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e0676bc7ca335a0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:38.086 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.084+0000 7fc61d423640 1 -- 10.20.193.49:0/2659034289 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc60c03c070 con 0x7fc6180c48c0 2026-02-17T11:15:38.086 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.084+0000 7fc61d423640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:38.086 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.084+0000 7fc61d423640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:15:38.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.084+0000 7fc61d423640 10 monclient: dump: 2026-02-17T11:15:38.087 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:38.087 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:38.087 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:38.087 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:38.087 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:38.087 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:38.087 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:38.087 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:38.087 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:38.087 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:38.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.084+0000 7fc61d423640 10 monclient: _finish_auth 0 2026-02-17T11:15:38.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.084+0000 7fc61d423640 10 monclient: _check_auth_tickets 2026-02-17T11:15:38.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.084+0000 7fc61d423640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:38.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.084+0000 7fc61d423640 1 -- 10.20.193.49:0/2659034289 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc60c02faf0 con 0x7fc6180c48c0 2026-02-17T11:15:38.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.084+0000 7fc61d423640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:38.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.084+0000 7fc6206b0640 5 monclient: authenticate success, global_id 5130 2026-02-17T11:15:38.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.084+0000 7fc61d423640 1 -- 10.20.193.49:0/2659034289 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc60c037440 con 0x7fc6180c48c0 2026-02-17T11:15:38.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.084+0000 7fc6206b0640 10 monclient: get_monmap_and_config success 2026-02-17T11:15:38.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.084+0000 7fc61d423640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:38.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.084+0000 7fc6206b0640 4 set_mon_vals no callback set 2026-02-17T11:15:38.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.084+0000 7fc61d423640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:15:38.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.084+0000 7fc61d423640 10 monclient: dump: 2026-02-17T11:15:38.087 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:38.087 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:38.087 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:38.087 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:38.087 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:38.087 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:38.087 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:38.087 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:38.087 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:38.087 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:38.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.084+0000 7fc6206b0640 10 monclient: shutdown 2026-02-17T11:15:38.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.084+0000 7fc6206b0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:38.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.084+0000 7fc6206b0640 1 -- 10.20.193.49:0/2659034289 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc6180c48c0 msgr2=0x7fc6180749b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:38.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.084+0000 7fc6206b0640 1 --2- 10.20.193.49:0/2659034289 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc6180c48c0 0x7fc6180749b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc6180723c0 tx=0x7fc60c02ede0 comp rx=0 tx=0).stop 2026-02-17T11:15:38.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.084+0000 7fc6206b0640 1 -- 10.20.193.49:0/2659034289 shutdown_connections 2026-02-17T11:15:38.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.084+0000 7fc6206b0640 1 --2- 10.20.193.49:0/2659034289 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc6180c48c0 0x7fc6180749b0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:38.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.084+0000 7fc6206b0640 1 --2- 10.20.193.49:0/2659034289 >> v2:10.20.193.97:3300/0 conn(0x7fc6180c7170 0x7fc6180c7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:38.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.084+0000 7fc6206b0640 1 -- 10.20.193.49:0/2659034289 >> 10.20.193.49:0/2659034289 conn(0x7fc6180c9f40 msgr2=0x7fc6180ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:38.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.084+0000 7fc6206b0640 1 -- 10.20.193.49:0/2659034289 shutdown_connections 2026-02-17T11:15:38.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.084+0000 7fc6206b0640 1 -- 10.20.193.49:0/2659034289 wait complete. 2026-02-17T11:15:38.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.085+0000 7fc6206b0640 10 monclient: build_initial_monmap 2026-02-17T11:15:38.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.085+0000 7fc6206b0640 10 monclient: monmap: 2026-02-17T11:15:38.088 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:38.088 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:15:38.088 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:15:38.088 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:15:38.088 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:38.088 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:38.088 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:15:38.088 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:15:38.088 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:15:38.088 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:38.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.085+0000 7fc6206b0640 1 librados: starting msgr at 2026-02-17T11:15:38.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.085+0000 7fc6206b0640 1 librados: starting objecter 2026-02-17T11:15:38.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.085+0000 7fc6206b0640 1 Processor -- start 2026-02-17T11:15:38.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.085+0000 7fc6206b0640 1 -- start start 2026-02-17T11:15:38.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.085+0000 7fc6206b0640 1 librados: setting wanted keys 2026-02-17T11:15:38.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.085+0000 7fc6206b0640 1 librados: calling monclient init 2026-02-17T11:15:38.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.085+0000 7fc6206b0640 10 monclient: init 2026-02-17T11:15:38.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.086+0000 7fc6206b0640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:38.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.086+0000 7fc6206b0640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:15:38.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.086+0000 7fc6206b0640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc618074ef0 0x7fc61815b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:38.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.086+0000 7fc6206b0640 10 monclient(hunting): picked mon.noname-c con 0x7fc618074ef0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:15:38.088 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.086+0000 7fc6206b0640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc6180c48c0 0x7fc61815af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:38.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.086+0000 7fc6206b0640 10 monclient(hunting): picked mon.noname-b con 0x7fc6180c48c0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:15:38.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.086+0000 7fc6206b0640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc6180c7170 0x7fc618073890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:38.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.086+0000 7fc6206b0640 10 monclient(hunting): picked mon.noname-a con 0x7fc6180c7170 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:15:38.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.086+0000 7fc6206b0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:38.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.086+0000 7fc6206b0640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc6180c81c0 con 0x7fc6180c7170 2026-02-17T11:15:38.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.086+0000 7fc6206b0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:38.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.086+0000 7fc6206b0640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc6180c7ee0 con 0x7fc6180c48c0 2026-02-17T11:15:38.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.086+0000 7fc6206b0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:38.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.086+0000 7fc6206b0640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc6180c90d0 con 0x7fc618074ef0 2026-02-17T11:15:38.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.086+0000 7fc6206b0640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:38.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.086+0000 7fc6206b0640 10 monclient(hunting): authenticate will time out at 1414.750213s 2026-02-17T11:15:38.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.086+0000 7fc61ec26640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc6180c7170 0x7fc618073890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:38.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.086+0000 7fc61e425640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc618074ef0 0x7fc61815b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:38.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.086+0000 7fc61dc24640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc6180c48c0 0x7fc61815af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:38.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.086+0000 7fc61ec26640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc6180c7170 0x7fc618073890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:45194/0 (socket says 10.20.193.49:45194) 2026-02-17T11:15:38.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.086+0000 7fc61ec26640 1 -- 10.20.193.49:0/2911617503 learned_addr learned my addr 10.20.193.49:0/2911617503 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:38.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.086+0000 7fc61ec26640 10 monclient(hunting): get_auth_request con 0x7fc6180c7170 auth_method 0 2026-02-17T11:15:38.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.086+0000 7fc61ec26640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:38.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.086+0000 7fc61ec26640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:38.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.086+0000 7fc61ec26640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:38.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.086+0000 7fc61e425640 10 monclient(hunting): get_auth_request con 0x7fc618074ef0 auth_method 0 2026-02-17T11:15:38.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.086+0000 7fc61e425640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:38.089 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.086+0000 7fc61e425640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:38.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.086+0000 7fc61e425640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:38.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.086+0000 7fc61dc24640 10 monclient(hunting): get_auth_request con 0x7fc6180c48c0 auth_method 0 2026-02-17T11:15:38.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.086+0000 7fc61dc24640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:38.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.086+0000 7fc61dc24640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:38.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.086+0000 7fc61dc24640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:38.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.086+0000 7fc61ec26640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:38.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.086+0000 7fc61ec26640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:38.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.087+0000 7fc61ec26640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:38.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.087+0000 7fc61e425640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:38.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.087+0000 7fc61e425640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:38.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.087+0000 7fc61e425640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:38.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.087+0000 7fc61dc24640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:38.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.087+0000 7fc61dc24640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:38.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.087+0000 7fc61dc24640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:38.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.088+0000 7fc61dc24640 10 monclient(hunting): handle_auth_done global_id 5113 payload 824 2026-02-17T11:15:38.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.088+0000 7fc61dc24640 1 -- 10.20.193.49:0/2911617503 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc618074ef0 msgr2=0x7fc61815b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:38.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.088+0000 7fc61dc24640 1 --2- 10.20.193.49:0/2911617503 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc618074ef0 0x7fc61815b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:38.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.088+0000 7fc61dc24640 1 -- 10.20.193.49:0/2911617503 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc6180c7170 msgr2=0x7fc618073890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:38.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.088+0000 7fc61dc24640 1 --2- 10.20.193.49:0/2911617503 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc6180c7170 0x7fc618073890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:38.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.088+0000 7fc61dc24640 10 monclient: _finish_hunting 0 2026-02-17T11:15:38.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.088+0000 7fc61dc24640 1 monclient: found mon.noname-b 2026-02-17T11:15:38.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.088+0000 7fc61dc24640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:38.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.088+0000 7fc61dc24640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:15:38.090 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.088+0000 7fc61dc24640 1 -- 10.20.193.49:0/2911617503 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc61815c1d0 con 0x7fc6180c48c0 2026-02-17T11:15:38.091 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.089+0000 7fc61dc24640 1 --2- 10.20.193.49:0/2911617503 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc6180c48c0 0x7fc61815af30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc60c036000 tx=0x7fc60c0047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:38.091 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.089+0000 7fc5feffd640 10 client.?.objecter ms_handle_connect 0x7fc6180c48c0 2026-02-17T11:15:38.091 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.089+0000 7fc5feffd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:15:38.093 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.091+0000 7fc5feffd640 1 -- 10.20.193.49:0/2911617503 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc60c03c040 con 0x7fc6180c48c0 2026-02-17T11:15:38.093 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.091+0000 7fc5feffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:38.093 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.091+0000 7fc5feffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:15:38.093 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.091+0000 7fc5feffd640 10 monclient: dump: 2026-02-17T11:15:38.093 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:38.093 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:38.093 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:38.093 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:38.093 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:38.093 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:38.093 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:38.093 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:38.093 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:38.093 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:38.094 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.091+0000 7fc5feffd640 10 monclient: _finish_auth 0 2026-02-17T11:15:38.094 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.091+0000 7fc5feffd640 10 monclient: _check_auth_tickets 2026-02-17T11:15:38.094 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.091+0000 7fc5feffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:38.094 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.091+0000 7fc5feffd640 1 -- 10.20.193.49:0/2911617503 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc60c042450 con 0x7fc6180c48c0 2026-02-17T11:15:38.094 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.091+0000 7fc6206b0640 5 monclient: authenticate success, global_id 5113 2026-02-17T11:15:38.094 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.091+0000 7fc6206b0640 10 monclient: _renew_subs 2026-02-17T11:15:38.094 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.091+0000 7fc6206b0640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:15:38.094 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.091+0000 7fc6206b0640 1 -- 10.20.193.49:0/2911617503 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc61815c4b0 con 0x7fc6180c48c0 2026-02-17T11:15:38.094 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.091+0000 7fc5feffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:38.094 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.091+0000 7fc5feffd640 1 -- 10.20.193.49:0/2911617503 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc60c042820 con 0x7fc6180c48c0 2026-02-17T11:15:38.094 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.091+0000 7fc5feffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:38.094 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.091+0000 7fc61cc22640 4 set_mon_vals no callback set 2026-02-17T11:15:38.094 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.091+0000 7fc5feffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:15:38.094 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.091+0000 7fc5feffd640 10 monclient: dump: 2026-02-17T11:15:38.094 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:38.094 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:38.094 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:38.094 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:38.094 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:38.094 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:38.094 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:38.094 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:38.094 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:38.094 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:38.094 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.091+0000 7fc6206b0640 10 client.5113.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:38.094 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.091+0000 7fc6206b0640 10 monclient: _renew_subs 2026-02-17T11:15:38.094 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.091+0000 7fc6206b0640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:15:38.094 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.091+0000 7fc6206b0640 1 -- 10.20.193.49:0/2911617503 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc61815ca70 con 0x7fc6180c48c0 2026-02-17T11:15:38.094 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.091+0000 7fc6206b0640 1 librados: init done 2026-02-17T11:15:38.094 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.091+0000 7fc6206b0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:38.094 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.091+0000 7fc6206b0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:38.094 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.091+0000 7fc6206b0640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:15:38.094 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.091+0000 7fc6206b0640 1 -- 10.20.193.49:0/2911617503 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6180c4d10 con 0x7fc6180c48c0 2026-02-17T11:15:38.105 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.103+0000 7fc5feffd640 1 -- 10.20.193.49:0/2911617503 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7fc60c0429c0 con 0x7fc6180c48c0 2026-02-17T11:15:38.105 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.103+0000 7fc5feffd640 1 --2- 10.20.193.49:0/2911617503 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fc5e80791c0 0x7fc5e807b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:38.105 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.103+0000 7fc61e425640 1 --2- 10.20.193.49:0/2911617503 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fc5e80791c0 0x7fc5e807b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:38.105 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.103+0000 7fc61e425640 10 monclient: get_auth_request con 0x7fc5e80791c0 auth_method 0 2026-02-17T11:15:38.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.104+0000 7fc61e425640 1 --2- 10.20.193.49:0/2911617503 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fc5e80791c0 0x7fc5e807b680 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc608009ba0 tx=0x7fc608009290 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:38.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.104+0000 7fc5feffd640 10 client.5113.objecter ms_handle_connect 0x7fc5e80791c0 2026-02-17T11:15:38.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.104+0000 7fc5feffd640 1 -- 10.20.193.49:0/2911617503 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7fc60c0836b0 con 0x7fc6180c48c0 2026-02-17T11:15:38.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.104+0000 7fc5feffd640 10 client.5113.objecter ms_dispatch2 0x7fc618000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:15:38.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.104+0000 7fc5feffd640 3 client.5113.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:15:38.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.104+0000 7fc5feffd640 3 client.5113.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:15:38.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.104+0000 7fc5feffd640 20 client.5113.objecter dump_active .. 0 homeless 2026-02-17T11:15:38.206 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.204+0000 7fc5feffd640 1 -- 10.20.193.49:0/2911617503 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc60c042ce0 con 0x7fc6180c48c0 2026-02-17T11:15:38.206 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.204+0000 7fc5feffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:38.206 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.204+0000 7fc5feffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:15:38.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.301+0000 7fc6206b0640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:15:38.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.301+0000 7fc6206b0640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:15:38.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.301+0000 7fc6206b0640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:15:38.305 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.301+0000 7fc6206b0640 1 -- 10.20.193.49:0/2911617503 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc618158e10 con 0x7fc6180c48c0 2026-02-17T11:15:38.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.304+0000 7fc5feffd640 1 -- 10.20.193.49:0/2911617503 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fc60c087670 con 0x7fc6180c48c0 2026-02-17T11:15:38.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.304+0000 7fc5feffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:15:38.307 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.304+0000 7fc5feffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:15:38.307 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:15:38.307 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:15:38.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.305+0000 7fc6206b0640 10 librados: watch_flush enter 2026-02-17T11:15:38.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.305+0000 7fc6206b0640 10 librados: watch_flush exit 2026-02-17T11:15:38.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.305+0000 7fc6206b0640 20 client.5113.objecter shutdown clearing up homeless session... 2026-02-17T11:15:38.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.305+0000 7fc6206b0640 10 client.5113.objecter successfully canceled tick 2026-02-17T11:15:38.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.305+0000 7fc6206b0640 1 -- 10.20.193.49:0/2911617503 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fc5e80791c0 msgr2=0x7fc5e807b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:38.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.305+0000 7fc6206b0640 1 --2- 10.20.193.49:0/2911617503 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fc5e80791c0 0x7fc5e807b680 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc608009ba0 tx=0x7fc608009290 comp rx=0 tx=0).stop 2026-02-17T11:15:38.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.305+0000 7fc6206b0640 10 monclient: shutdown 2026-02-17T11:15:38.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.305+0000 7fc6206b0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:38.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.305+0000 7fc6206b0640 1 -- 10.20.193.49:0/2911617503 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc6180c48c0 msgr2=0x7fc61815af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:38.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.305+0000 7fc6206b0640 1 --2- 10.20.193.49:0/2911617503 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc6180c48c0 0x7fc61815af30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc60c036000 tx=0x7fc60c0047c0 comp rx=0 tx=0).stop 2026-02-17T11:15:38.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.305+0000 7fc6206b0640 1 -- 10.20.193.49:0/2911617503 shutdown_connections 2026-02-17T11:15:38.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.305+0000 7fc6206b0640 1 --2- 10.20.193.49:0/2911617503 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fc5e80791c0 0x7fc5e807b680 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:38.310 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.305+0000 7fc6206b0640 1 --2- 10.20.193.49:0/2911617503 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fc6180c7170 0x7fc618073890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:38.310 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.305+0000 7fc6206b0640 1 --2- 10.20.193.49:0/2911617503 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fc6180c48c0 0x7fc61815af30 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:38.310 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.305+0000 7fc6206b0640 1 --2- 10.20.193.49:0/2911617503 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fc618074ef0 0x7fc61815b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:38.310 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.305+0000 7fc6206b0640 1 -- 10.20.193.49:0/2911617503 >> 10.20.193.49:0/2911617503 conn(0x7fc6180c9f40 msgr2=0x7fc6180ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:38.310 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.305+0000 7fc6206b0640 1 -- 10.20.193.49:0/2911617503 shutdown_connections 2026-02-17T11:15:38.310 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.305+0000 7fc6206b0640 1 -- 10.20.193.49:0/2911617503 wait complete. 2026-02-17T11:15:38.310 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:38.305+0000 7fc6206b0640 1 librados: shutdown 2026-02-17T11:15:41.317 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:15:41.389 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.386+0000 7f5fad2f2640 10 monclient: get_monmap_and_config 2026-02-17T11:15:41.389 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.386+0000 7f5fad2f2640 10 monclient: build_initial_monmap 2026-02-17T11:15:41.390 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.386+0000 7f5fad2f2640 10 monclient: monmap: 2026-02-17T11:15:41.390 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:41.390 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:41.390 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:15:41.388061+0000 2026-02-17T11:15:41.390 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:15:41.388061+0000 2026-02-17T11:15:41.390 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:41.390 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:41.390 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:15:41.390 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:15:41.390 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:15:41.391 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:15:41.391 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:15:41.391 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:15:41.391 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:41.391 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.386+0000 7f5fad2f2640 1 Processor -- start 2026-02-17T11:15:41.391 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.387+0000 7f5fad2f2640 1 -- start start 2026-02-17T11:15:41.391 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.387+0000 7f5fad2f2640 10 monclient: init 2026-02-17T11:15:41.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.387+0000 7f5fad2f2640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:41.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.387+0000 7f5fad2f2640 10 monclient: _add_conns ranks=[5,4,2,0,1,3] 2026-02-17T11:15:41.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.387+0000 7f5fad2f2640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f5fa814f280 0x7f5fa80c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:41.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.387+0000 7f5fad2f2640 10 monclient(hunting): picked mon.noname-c con 0x7f5fa814f280 addr v2:10.20.193.157:3300/0 2026-02-17T11:15:41.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.387+0000 7f5fad2f2640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f5fa814f660 0x7f5fa80c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:41.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.387+0000 7f5fad2f2640 10 monclient(hunting): picked mon.noname-b con 0x7f5fa814f660 addr v2:10.20.193.97:3300/0 2026-02-17T11:15:41.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.387+0000 7f5fad2f2640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f5fa815abc0 addr v1:10.20.193.157:6789/0 2026-02-17T11:15:41.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.387+0000 7f5fad2f2640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fa80c7390 con 0x7f5fa815abc0 2026-02-17T11:15:41.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.387+0000 7f5fad2f2640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:41.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.387+0000 7f5fad2f2640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f5fa80c7950 con 0x7f5fa814f660 2026-02-17T11:15:41.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.387+0000 7f5fad2f2640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:41.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.387+0000 7f5fad2f2640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f5fa815a730 con 0x7f5fa814f280 2026-02-17T11:15:41.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.387+0000 7f5fad2f2640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:41.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.387+0000 7f5fad2f2640 10 monclient(hunting): authenticate will time out at 1418.051524s 2026-02-17T11:15:41.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.387+0000 7f5fa6ffd640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f5fa814f280 0x7f5fa80c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:41.396 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.388+0000 7f5fa67fc640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f5fa814f660 0x7f5fa80c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:41.396 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.388+0000 7f5fa6ffd640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f5fa814f280 0x7f5fa80c7e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:51672/0 (socket says 10.20.193.49:51672) 2026-02-17T11:15:41.396 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.388+0000 7f5fa6ffd640 1 -- 10.20.193.49:0/2018512383 learned_addr learned my addr 10.20.193.49:0/2018512383 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:41.396 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.388+0000 7f5fa6ffd640 10 monclient(hunting): get_auth_request con 0x7f5fa814f280 auth_method 0 2026-02-17T11:15:41.396 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.388+0000 7f5fa6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:41.396 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.388+0000 7f5fa6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:41.396 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.388+0000 7f5fa6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:41.396 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.388+0000 7f5fa67fc640 10 monclient(hunting): get_auth_request con 0x7f5fa814f660 auth_method 0 2026-02-17T11:15:41.396 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.388+0000 7f5fa67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:41.396 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.388+0000 7f5fa67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:41.397 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.388+0000 7f5fa67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:41.397 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.388+0000 7f5fa67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:41.397 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.388+0000 7f5fa67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:41.397 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.388+0000 7f5fa67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:41.397 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.388+0000 7f5fa6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:41.397 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.388+0000 7f5fa6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:41.397 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.388+0000 7f5fa6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:41.397 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.389+0000 7f5fa67fc640 10 monclient(hunting): handle_auth_done global_id 5116 payload 274 2026-02-17T11:15:41.397 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.389+0000 7f5fa67fc640 1 -- 10.20.193.49:0/2018512383 >> v2:10.20.193.157:3300/0 conn(0x7f5fa814f280 msgr2=0x7f5fa80c7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:15:41.397 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.389+0000 7f5fa67fc640 1 --2- 10.20.193.49:0/2018512383 >> v2:10.20.193.157:3300/0 conn(0x7f5fa814f280 0x7f5fa80c7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:41.397 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.389+0000 7f5fa67fc640 1 -- 10.20.193.49:0/2018512383 >> v1:10.20.193.157:6789/0 conn(0x7f5fa815abc0 legacy=0x7f5fa815afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:41.398 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.389+0000 7f5fa67fc640 10 monclient: _finish_hunting 0 2026-02-17T11:15:41.398 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.389+0000 7f5fa67fc640 1 monclient: found mon.noname-b 2026-02-17T11:15:41.398 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.389+0000 7f5fa67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:41.398 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.389+0000 7f5fa67fc640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:15:41.398 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.389+0000 7f5fa67fc640 1 -- 10.20.193.49:0/2018512383 --> v2:10.20.193.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fa80c7670 con 0x7f5fa814f660 2026-02-17T11:15:41.398 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.390+0000 7f5fa67fc640 1 --2- 10.20.193.49:0/2018512383 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5fa814f660 0x7f5fa80c6a00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5fa8069960 tx=0x7f5f9002eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=794497f327974b86 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:41.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.392+0000 7f5fa5ffb640 1 -- 10.20.193.49:0/2018512383 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f9003c070 con 0x7f5fa814f660 2026-02-17T11:15:41.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.392+0000 7f5fa5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:41.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.392+0000 7f5fa5ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:15:41.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.392+0000 7f5fa5ffb640 10 monclient: dump: 2026-02-17T11:15:41.406 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:41.406 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:41.406 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:41.407 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:41.407 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:41.407 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:41.407 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:41.407 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:41.407 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:41.407 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:41.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.392+0000 7f5fa5ffb640 10 monclient: _finish_auth 0 2026-02-17T11:15:41.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.392+0000 7f5fa5ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:15:41.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.392+0000 7f5fa5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:41.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.392+0000 7f5fa5ffb640 1 -- 10.20.193.49:0/2018512383 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f9002fb80 con 0x7f5fa814f660 2026-02-17T11:15:41.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.392+0000 7f5fa5ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:41.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.392+0000 7f5fa5ffb640 1 -- 10.20.193.49:0/2018512383 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f90037440 con 0x7f5fa814f660 2026-02-17T11:15:41.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.392+0000 7f5fad2f2640 5 monclient: authenticate success, global_id 5116 2026-02-17T11:15:41.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.392+0000 7f5fad2f2640 10 monclient: get_monmap_and_config success 2026-02-17T11:15:41.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.392+0000 7f5fad2f2640 4 set_mon_vals no callback set 2026-02-17T11:15:41.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.392+0000 7f5fa5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:41.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.392+0000 7f5fa5ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:15:41.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.392+0000 7f5fa5ffb640 10 monclient: dump: 2026-02-17T11:15:41.408 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:41.408 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:41.409 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:41.409 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:41.409 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:41.409 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:41.409 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:41.409 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:41.409 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:41.409 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:41.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.393+0000 7f5fad2f2640 10 monclient: shutdown 2026-02-17T11:15:41.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.393+0000 7f5fad2f2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:41.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.393+0000 7f5fad2f2640 1 -- 10.20.193.49:0/2018512383 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5fa814f660 msgr2=0x7f5fa80c6a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:41.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.393+0000 7f5fad2f2640 1 --2- 10.20.193.49:0/2018512383 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5fa814f660 0x7f5fa80c6a00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5fa8069960 tx=0x7f5f9002eeb0 comp rx=0 tx=0).stop 2026-02-17T11:15:41.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.393+0000 7f5fad2f2640 1 -- 10.20.193.49:0/2018512383 shutdown_connections 2026-02-17T11:15:41.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.393+0000 7f5fad2f2640 1 --2- 10.20.193.49:0/2018512383 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5fa814f660 0x7f5fa80c6a00 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:41.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.393+0000 7f5fad2f2640 1 --2- 10.20.193.49:0/2018512383 >> v2:10.20.193.157:3300/0 conn(0x7f5fa814f280 0x7f5fa80c7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:41.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.393+0000 7f5fad2f2640 1 -- 10.20.193.49:0/2018512383 >> 10.20.193.49:0/2018512383 conn(0x7f5fa80c9f20 msgr2=0x7f5fa80ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:41.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.393+0000 7f5fad2f2640 1 -- 10.20.193.49:0/2018512383 shutdown_connections 2026-02-17T11:15:41.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.393+0000 7f5fad2f2640 1 -- 10.20.193.49:0/2018512383 wait complete. 2026-02-17T11:15:41.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.393+0000 7f5fad2f2640 10 monclient: build_initial_monmap 2026-02-17T11:15:41.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.393+0000 7f5fad2f2640 10 monclient: monmap: 2026-02-17T11:15:41.410 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:41.410 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:15:41.410 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:15:41.411 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:15:41.411 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:41.411 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:41.411 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:15:41.411 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:15:41.411 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:15:41.411 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:41.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.393+0000 7f5fad2f2640 1 librados: starting msgr at 2026-02-17T11:15:41.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.393+0000 7f5fad2f2640 1 librados: starting objecter 2026-02-17T11:15:41.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.394+0000 7f5fad2f2640 1 Processor -- start 2026-02-17T11:15:41.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.394+0000 7f5fad2f2640 1 -- start start 2026-02-17T11:15:41.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.394+0000 7f5fad2f2640 1 librados: setting wanted keys 2026-02-17T11:15:41.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.394+0000 7f5fad2f2640 1 librados: calling monclient init 2026-02-17T11:15:41.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.394+0000 7f5fad2f2640 10 monclient: init 2026-02-17T11:15:41.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.394+0000 7f5fad2f2640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:41.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.394+0000 7f5fad2f2640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:15:41.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.394+0000 7f5fad2f2640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5fa814f280 0x7f5fa80745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:41.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.394+0000 7f5fad2f2640 10 monclient(hunting): picked mon.noname-c con 0x7f5fa814f280 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:15:41.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.394+0000 7f5fad2f2640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5fa814f660 0x7f5fa806e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:41.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.394+0000 7f5fad2f2640 10 monclient(hunting): picked mon.noname-a con 0x7f5fa814f660 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:15:41.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.394+0000 7f5fad2f2640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5fa815abc0 0x7f5fa81f3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:41.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.394+0000 7f5fad2f2640 10 monclient(hunting): picked mon.noname-b con 0x7f5fa815abc0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:15:41.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.394+0000 7f5fad2f2640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:41.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.394+0000 7f5fad2f2640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5fa80c9b70 con 0x7f5fa814f660 2026-02-17T11:15:41.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.394+0000 7f5fad2f2640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:41.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.394+0000 7f5fad2f2640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f5fa815a3c0 con 0x7f5fa815abc0 2026-02-17T11:15:41.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.394+0000 7f5fad2f2640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:41.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.394+0000 7f5fad2f2640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f5fa80c9cf0 con 0x7f5fa814f280 2026-02-17T11:15:41.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.394+0000 7f5fad2f2640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:41.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.394+0000 7f5fad2f2640 10 monclient(hunting): authenticate will time out at 1418.058469s 2026-02-17T11:15:41.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.394+0000 7f5fa77fe640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5fa815abc0 0x7f5fa81f3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:41.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.394+0000 7f5fa67fc640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5fa814f660 0x7f5fa806e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:41.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.394+0000 7f5fa77fe640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5fa815abc0 0x7f5fa81f3500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:45974/0 (socket says 10.20.193.49:45974) 2026-02-17T11:15:41.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.394+0000 7f5fa77fe640 1 -- 10.20.193.49:0/2389558393 learned_addr learned my addr 10.20.193.49:0/2389558393 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:41.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.394+0000 7f5fa77fe640 10 monclient(hunting): get_auth_request con 0x7f5fa815abc0 auth_method 0 2026-02-17T11:15:41.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.394+0000 7f5fa77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:41.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.394+0000 7f5fa77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:41.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.394+0000 7f5fa77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:41.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.394+0000 7f5fa67fc640 10 monclient(hunting): get_auth_request con 0x7f5fa814f660 auth_method 0 2026-02-17T11:15:41.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.394+0000 7f5fa67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:41.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.394+0000 7f5fa67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:41.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.394+0000 7f5fa67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:41.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.395+0000 7f5fa6ffd640 1 --2- 10.20.193.49:0/2389558393 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5fa814f280 0x7f5fa80745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:41.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.395+0000 7f5fa77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:41.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.395+0000 7f5fa77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:41.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.395+0000 7f5fa77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:41.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.395+0000 7f5fa6ffd640 10 monclient(hunting): get_auth_request con 0x7f5fa814f280 auth_method 0 2026-02-17T11:15:41.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.395+0000 7f5fa6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:41.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.395+0000 7f5fa6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:41.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.395+0000 7f5fa6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:41.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.395+0000 7f5fa67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:41.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.395+0000 7f5fa67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:41.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.395+0000 7f5fa67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:41.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.395+0000 7f5fa6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:41.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.395+0000 7f5fa6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:41.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.395+0000 7f5fa6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:41.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.396+0000 7f5fa77fe640 10 monclient(hunting): handle_auth_done global_id 5119 payload 824 2026-02-17T11:15:41.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.396+0000 7f5fa77fe640 1 -- 10.20.193.49:0/2389558393 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5fa814f280 msgr2=0x7f5fa80745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:41.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.396+0000 7f5fa77fe640 1 --2- 10.20.193.49:0/2389558393 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5fa814f280 0x7f5fa80745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:41.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.396+0000 7f5fa77fe640 1 -- 10.20.193.49:0/2389558393 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5fa814f660 msgr2=0x7f5fa806e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:41.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.396+0000 7f5fa77fe640 1 --2- 10.20.193.49:0/2389558393 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5fa814f660 0x7f5fa806e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:41.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.396+0000 7f5fa77fe640 10 monclient: _finish_hunting 0 2026-02-17T11:15:41.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.396+0000 7f5fa77fe640 1 monclient: found mon.noname-b 2026-02-17T11:15:41.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.396+0000 7f5fa77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:41.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.396+0000 7f5fa77fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:15:41.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.396+0000 7f5fa77fe640 1 -- 10.20.193.49:0/2389558393 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fa81f3f20 con 0x7f5fa815abc0 2026-02-17T11:15:41.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.397+0000 7f5fa77fe640 1 --2- 10.20.193.49:0/2389558393 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5fa815abc0 0x7f5fa81f3500 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5f9800cb40 tx=0x7f5f9800a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:41.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.397+0000 7f5f877fe640 10 client.?.objecter ms_handle_connect 0x7f5fa815abc0 2026-02-17T11:15:41.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.397+0000 7f5f877fe640 10 client.?.objecter resend_mon_ops 2026-02-17T11:15:41.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.398+0000 7f5f877fe640 1 -- 10.20.193.49:0/2389558393 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f9800ad50 con 0x7f5fa815abc0 2026-02-17T11:15:41.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.398+0000 7f5f877fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:41.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.398+0000 7f5f877fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:15:41.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.398+0000 7f5f877fe640 10 monclient: dump: 2026-02-17T11:15:41.416 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:41.416 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:41.417 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:41.417 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:41.417 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:41.417 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:41.417 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:41.417 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:41.417 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:41.417 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:41.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.398+0000 7f5f877fe640 10 monclient: _finish_auth 0 2026-02-17T11:15:41.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.398+0000 7f5f877fe640 10 monclient: _check_auth_tickets 2026-02-17T11:15:41.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.398+0000 7f5f877fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:41.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.398+0000 7f5fad2f2640 5 monclient: authenticate success, global_id 5119 2026-02-17T11:15:41.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.398+0000 7f5fad2f2640 10 monclient: _renew_subs 2026-02-17T11:15:41.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.398+0000 7f5fad2f2640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:15:41.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.398+0000 7f5fad2f2640 1 -- 10.20.193.49:0/2389558393 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fa81f4200 con 0x7f5fa815abc0 2026-02-17T11:15:41.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.398+0000 7f5fad2f2640 10 client.5119.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:41.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.398+0000 7f5fad2f2640 10 monclient: _renew_subs 2026-02-17T11:15:41.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.398+0000 7f5fad2f2640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:15:41.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.398+0000 7f5fad2f2640 1 -- 10.20.193.49:0/2389558393 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fa8141e80 con 0x7f5fa815abc0 2026-02-17T11:15:41.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.398+0000 7f5fad2f2640 1 librados: init done 2026-02-17T11:15:41.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.398+0000 7f5fad2f2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:41.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.398+0000 7f5fad2f2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:41.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.398+0000 7f5fad2f2640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:15:41.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.398+0000 7f5fad2f2640 1 -- 10.20.193.49:0/2389558393 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fa815b7a0 con 0x7f5fa815abc0 2026-02-17T11:15:41.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.399+0000 7f5f877fe640 1 -- 10.20.193.49:0/2389558393 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f98003a70 con 0x7f5fa815abc0 2026-02-17T11:15:41.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.399+0000 7f5f877fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:41.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.399+0000 7f5f877fe640 1 -- 10.20.193.49:0/2389558393 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f98003410 con 0x7f5fa815abc0 2026-02-17T11:15:41.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.399+0000 7f5f877fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:41.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.399+0000 7f5f877fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:15:41.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.399+0000 7f5f877fe640 10 monclient: dump: 2026-02-17T11:15:41.419 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:41.419 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:41.419 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:41.419 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:41.419 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:41.420 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:41.420 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:41.420 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:41.420 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:41.420 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:41.420 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.399+0000 7f5fa57fa640 4 set_mon_vals no callback set 2026-02-17T11:15:41.507 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.505+0000 7f5f877fe640 1 -- 10.20.193.49:0/2389558393 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f5f980050d0 con 0x7f5fa815abc0 2026-02-17T11:15:41.508 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.505+0000 7f5f877fe640 1 --2- 10.20.193.49:0/2389558393 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5f74079140 0x7f5f7407b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:41.508 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.506+0000 7f5fa6ffd640 1 --2- 10.20.193.49:0/2389558393 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5f74079140 0x7f5f7407b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:41.508 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.506+0000 7f5fa6ffd640 10 monclient: get_auth_request con 0x7f5f74079140 auth_method 0 2026-02-17T11:15:41.508 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.506+0000 7f5fa6ffd640 1 --2- 10.20.193.49:0/2389558393 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5f74079140 0x7f5f7407b600 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c006dc0 tx=0x7f5f9c009340 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:41.509 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.506+0000 7f5f877fe640 10 client.5119.objecter ms_handle_connect 0x7f5f74079140 2026-02-17T11:15:41.509 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.507+0000 7f5f877fe640 1 -- 10.20.193.49:0/2389558393 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f5f980982c0 con 0x7f5fa815abc0 2026-02-17T11:15:41.509 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.507+0000 7f5f877fe640 10 client.5119.objecter ms_dispatch2 0x7f5fa8000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:15:41.509 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.507+0000 7f5f877fe640 3 client.5119.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:15:41.509 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.507+0000 7f5f877fe640 3 client.5119.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:15:41.509 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.507+0000 7f5f877fe640 20 client.5119.objecter dump_active .. 0 homeless 2026-02-17T11:15:41.515 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.513+0000 7f5f877fe640 1 -- 10.20.193.49:0/2389558393 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f5f980628f0 con 0x7f5fa815abc0 2026-02-17T11:15:41.515 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.513+0000 7f5f877fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:41.515 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.513+0000 7f5f877fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:15:41.613 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.610+0000 7f5fad2f2640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T11:15:41.613 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.610+0000 7f5fad2f2640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:15:41.613 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.610+0000 7f5fad2f2640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:15:41.613 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.610+0000 7f5fad2f2640 1 -- 10.20.193.49:0/2389558393 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f5fa81447a0 con 0x7f5fa815abc0 2026-02-17T11:15:41.616 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.614+0000 7f5f877fe640 1 -- 10.20.193.49:0/2389558393 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f5f98066bf0 con 0x7f5fa815abc0 2026-02-17T11:15:41.616 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.614+0000 7f5f877fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T11:15:41.616 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.614+0000 7f5f877fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:15:41.617 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:15:41.617 INFO:teuthology.orchestra.run.trial049.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T11:15:41.618 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.615+0000 7f5fad2f2640 10 librados: watch_flush enter 2026-02-17T11:15:41.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.615+0000 7f5fad2f2640 10 librados: watch_flush exit 2026-02-17T11:15:41.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.615+0000 7f5fad2f2640 20 client.5119.objecter shutdown clearing up homeless session... 2026-02-17T11:15:41.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.615+0000 7f5fad2f2640 10 client.5119.objecter successfully canceled tick 2026-02-17T11:15:41.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.615+0000 7f5fad2f2640 1 -- 10.20.193.49:0/2389558393 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5f74079140 msgr2=0x7f5f7407b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:41.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.615+0000 7f5fad2f2640 1 --2- 10.20.193.49:0/2389558393 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5f74079140 0x7f5f7407b600 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c006dc0 tx=0x7f5f9c009340 comp rx=0 tx=0).stop 2026-02-17T11:15:41.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.615+0000 7f5fad2f2640 10 monclient: shutdown 2026-02-17T11:15:41.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.615+0000 7f5fad2f2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:41.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.615+0000 7f5fad2f2640 1 -- 10.20.193.49:0/2389558393 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5fa815abc0 msgr2=0x7f5fa81f3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:41.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.615+0000 7f5fad2f2640 1 --2- 10.20.193.49:0/2389558393 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5fa815abc0 0x7f5fa81f3500 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5f9800cb40 tx=0x7f5f9800a430 comp rx=0 tx=0).stop 2026-02-17T11:15:41.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.615+0000 7f5fad2f2640 1 -- 10.20.193.49:0/2389558393 shutdown_connections 2026-02-17T11:15:41.619 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.615+0000 7f5fad2f2640 1 --2- 10.20.193.49:0/2389558393 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5f74079140 0x7f5f7407b600 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:41.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.615+0000 7f5fad2f2640 1 --2- 10.20.193.49:0/2389558393 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5fa815abc0 0x7f5fa81f3500 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:41.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.615+0000 7f5fad2f2640 1 --2- 10.20.193.49:0/2389558393 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5fa814f660 0x7f5fa806e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:41.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.615+0000 7f5fad2f2640 1 --2- 10.20.193.49:0/2389558393 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5fa814f280 0x7f5fa80745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:41.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.615+0000 7f5fad2f2640 1 -- 10.20.193.49:0/2389558393 >> 10.20.193.49:0/2389558393 conn(0x7f5fa80c9f20 msgr2=0x7f5fa80c8450 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:41.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.615+0000 7f5fad2f2640 1 -- 10.20.193.49:0/2389558393 shutdown_connections 2026-02-17T11:15:41.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.615+0000 7f5fad2f2640 1 -- 10.20.193.49:0/2389558393 wait complete. 2026-02-17T11:15:41.620 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.615+0000 7f5fad2f2640 1 librados: shutdown 2026-02-17T11:15:41.627 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-17T11:15:41.627 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:15:41.695 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.693+0000 7f31e59f8640 10 monclient: get_monmap_and_config 2026-02-17T11:15:41.695 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.693+0000 7f31e59f8640 10 monclient: build_initial_monmap 2026-02-17T11:15:41.696 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.693+0000 7f31e59f8640 10 monclient: monmap: 2026-02-17T11:15:41.696 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:41.696 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:41.696 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:15:41.694588+0000 2026-02-17T11:15:41.696 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:15:41.694588+0000 2026-02-17T11:15:41.696 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:41.696 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:41.696 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:15:41.696 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:15:41.696 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:15:41.697 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:15:41.697 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:15:41.697 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:15:41.697 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:41.698 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.693+0000 7f31e59f8640 1 Processor -- start 2026-02-17T11:15:41.698 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.693+0000 7f31e59f8640 1 -- start start 2026-02-17T11:15:41.698 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.693+0000 7f31e59f8640 10 monclient: init 2026-02-17T11:15:41.698 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.694+0000 7f31e59f8640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:41.698 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.694+0000 7f31e59f8640 10 monclient: _add_conns ranks=[5,3,0,2,4,1] 2026-02-17T11:15:41.699 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.694+0000 7f31e59f8640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f31e014f280 0x7f31e00c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:41.699 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.694+0000 7f31e59f8640 10 monclient(hunting): picked mon.noname-c con 0x7f31e014f280 addr v2:10.20.193.157:3300/0 2026-02-17T11:15:41.699 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.694+0000 7f31e59f8640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f31e014f660 0x7f31e00c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:41.699 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.694+0000 7f31e59f8640 10 monclient(hunting): picked mon.noname-a con 0x7f31e014f660 addr v2:10.20.193.49:3300/0 2026-02-17T11:15:41.699 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.694+0000 7f31e59f8640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f31e015abc0 addr v1:10.20.193.49:6789/0 2026-02-17T11:15:41.699 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.694+0000 7f31e59f8640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31e00c7390 con 0x7f31e015abc0 2026-02-17T11:15:41.699 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.694+0000 7f31e59f8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:41.699 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.694+0000 7f31e59f8640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f31e00c7950 con 0x7f31e014f660 2026-02-17T11:15:41.699 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.694+0000 7f31e59f8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:41.699 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.694+0000 7f31e59f8640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f31e015a730 con 0x7f31e014f280 2026-02-17T11:15:41.699 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.694+0000 7f31e59f8640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:41.699 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.694+0000 7f31e59f8640 10 monclient(hunting): authenticate will time out at 1418.358108s 2026-02-17T11:15:41.700 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.698+0000 7f31de7fc640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f31e014f660 0x7f31e00c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:41.701 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.698+0000 7f31de7fc640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f31e014f660 0x7f31e00c6a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:45224/0 (socket says 10.20.193.49:45224) 2026-02-17T11:15:41.701 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.698+0000 7f31de7fc640 1 -- 10.20.193.49:0/1553677088 learned_addr learned my addr 10.20.193.49:0/1553677088 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:41.701 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.698+0000 7f31de7fc640 10 monclient(hunting): get_auth_request con 0x7f31e014f660 auth_method 0 2026-02-17T11:15:41.701 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.698+0000 7f31de7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:41.701 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.698+0000 7f31de7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:41.701 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.698+0000 7f31de7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:41.701 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.698+0000 7f31de7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:41.701 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.698+0000 7f31de7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:41.702 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.698+0000 7f31de7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:41.702 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.699+0000 7f31de7fc640 10 monclient(hunting): handle_auth_done global_id 5139 payload 274 2026-02-17T11:15:41.702 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.699+0000 7f31de7fc640 1 -- 10.20.193.49:0/1553677088 >> v2:10.20.193.157:3300/0 conn(0x7f31e014f280 msgr2=0x7f31e00c7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:15:41.702 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.699+0000 7f31de7fc640 1 --2- 10.20.193.49:0/1553677088 >> v2:10.20.193.157:3300/0 conn(0x7f31e014f280 0x7f31e00c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:41.703 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.700+0000 7f31de7fc640 1 -- 10.20.193.49:0/1553677088 >> v1:10.20.193.49:6789/0 conn(0x7f31e015abc0 legacy=0x7f31e015afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:41.703 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.700+0000 7f31de7fc640 10 monclient: _finish_hunting 0 2026-02-17T11:15:41.703 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.700+0000 7f31de7fc640 1 monclient: found mon.noname-a 2026-02-17T11:15:41.703 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.700+0000 7f31de7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:41.703 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.700+0000 7f31de7fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:15:41.703 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.700+0000 7f31de7fc640 1 -- 10.20.193.49:0/1553677088 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31e00c7670 con 0x7f31e014f660 2026-02-17T11:15:41.705 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.702+0000 7f31de7fc640 1 --2- 10.20.193.49:0/1553677088 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f31e014f660 0x7f31e00c6a00 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f31e0069960 tx=0x7f31c802ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d95e81fbb1d8f64d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:41.712 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.705+0000 7f31ddffb640 1 -- 10.20.193.49:0/1553677088 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c803c070 con 0x7f31e014f660 2026-02-17T11:15:41.712 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.705+0000 7f31ddffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:41.712 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.705+0000 7f31ddffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:15:41.712 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.705+0000 7f31ddffb640 10 monclient: dump: 2026-02-17T11:15:41.712 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:41.712 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:41.712 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:41.712 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:41.712 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:41.713 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:41.713 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:41.713 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:41.713 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:41.713 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:41.713 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.705+0000 7f31ddffb640 10 monclient: _finish_auth 0 2026-02-17T11:15:41.713 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.705+0000 7f31ddffb640 10 monclient: _check_auth_tickets 2026-02-17T11:15:41.713 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.705+0000 7f31ddffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:41.713 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.705+0000 7f31ddffb640 1 -- 10.20.193.49:0/1553677088 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31c802fc70 con 0x7f31e014f660 2026-02-17T11:15:41.713 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.705+0000 7f31e59f8640 5 monclient: authenticate success, global_id 5139 2026-02-17T11:15:41.713 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.705+0000 7f31e59f8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:15:41.713 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.705+0000 7f31ddffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:41.714 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.705+0000 7f31ddffb640 1 -- 10.20.193.49:0/1553677088 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c8037660 con 0x7f31e014f660 2026-02-17T11:15:41.714 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.705+0000 7f31e59f8640 10 monclient: get_monmap_and_config success 2026-02-17T11:15:41.714 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.705+0000 7f31e59f8640 4 set_mon_vals no callback set 2026-02-17T11:15:41.714 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.705+0000 7f31ddffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:41.714 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.705+0000 7f31ddffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:15:41.714 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.705+0000 7f31ddffb640 10 monclient: dump: 2026-02-17T11:15:41.714 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:41.714 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:41.714 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:41.714 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:41.714 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:41.714 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:41.715 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:41.715 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:41.715 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:41.715 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:41.715 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.705+0000 7f31e59f8640 10 monclient: shutdown 2026-02-17T11:15:41.715 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.705+0000 7f31e59f8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:41.715 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.705+0000 7f31e59f8640 1 -- 10.20.193.49:0/1553677088 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f31e014f660 msgr2=0x7f31e00c6a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:41.715 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.705+0000 7f31e59f8640 1 --2- 10.20.193.49:0/1553677088 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f31e014f660 0x7f31e00c6a00 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f31e0069960 tx=0x7f31c802ef60 comp rx=0 tx=0).stop 2026-02-17T11:15:41.715 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.705+0000 7f31e59f8640 1 -- 10.20.193.49:0/1553677088 shutdown_connections 2026-02-17T11:15:41.715 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.705+0000 7f31e59f8640 1 --2- 10.20.193.49:0/1553677088 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f31e014f660 0x7f31e00c6a00 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:41.715 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.705+0000 7f31e59f8640 1 --2- 10.20.193.49:0/1553677088 >> v2:10.20.193.157:3300/0 conn(0x7f31e014f280 0x7f31e00c7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:41.715 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.705+0000 7f31e59f8640 1 -- 10.20.193.49:0/1553677088 >> 10.20.193.49:0/1553677088 conn(0x7f31e00c9f20 msgr2=0x7f31e00ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:41.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.705+0000 7f31e59f8640 1 -- 10.20.193.49:0/1553677088 shutdown_connections 2026-02-17T11:15:41.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.705+0000 7f31e59f8640 1 -- 10.20.193.49:0/1553677088 wait complete. 2026-02-17T11:15:41.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.706+0000 7f31e59f8640 10 monclient: build_initial_monmap 2026-02-17T11:15:41.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.706+0000 7f31e59f8640 10 monclient: monmap: 2026-02-17T11:15:41.716 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:41.716 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:15:41.716 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:15:41.716 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:15:41.716 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:41.716 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:41.716 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:15:41.716 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:15:41.717 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:15:41.717 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:41.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.706+0000 7f31e59f8640 1 librados: starting msgr at 2026-02-17T11:15:41.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.706+0000 7f31e59f8640 1 librados: starting objecter 2026-02-17T11:15:41.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.706+0000 7f31e59f8640 1 Processor -- start 2026-02-17T11:15:41.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.706+0000 7f31e59f8640 1 -- start start 2026-02-17T11:15:41.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.706+0000 7f31e59f8640 1 librados: setting wanted keys 2026-02-17T11:15:41.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.706+0000 7f31e59f8640 1 librados: calling monclient init 2026-02-17T11:15:41.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.706+0000 7f31e59f8640 10 monclient: init 2026-02-17T11:15:41.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.706+0000 7f31e59f8640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:41.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.706+0000 7f31e59f8640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:15:41.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.706+0000 7f31e59f8640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f31e014f280 0x7f31e01f4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:41.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.706+0000 7f31e59f8640 10 monclient(hunting): picked mon.noname-b con 0x7f31e014f280 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:15:41.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.706+0000 7f31e59f8640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f31e014f660 0x7f31e01f6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:41.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.706+0000 7f31e59f8640 10 monclient(hunting): picked mon.noname-a con 0x7f31e014f660 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:15:41.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.706+0000 7f31e59f8640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f31e015abc0 0x7f31e0141a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:41.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.706+0000 7f31e59f8640 10 monclient(hunting): picked mon.noname-c con 0x7f31e015abc0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:15:41.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.706+0000 7f31e59f8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:41.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.706+0000 7f31e59f8640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f31e00c8360 con 0x7f31e014f660 2026-02-17T11:15:41.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.706+0000 7f31e59f8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:41.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.706+0000 7f31e59f8640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f31e015a3c0 con 0x7f31e014f280 2026-02-17T11:15:41.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.706+0000 7f31e59f8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:41.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.706+0000 7f31e59f8640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f31e00c84e0 con 0x7f31e015abc0 2026-02-17T11:15:41.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.706+0000 7f31e59f8640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:41.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.706+0000 7f31e59f8640 10 monclient(hunting): authenticate will time out at 1418.370703s 2026-02-17T11:15:41.719 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.706+0000 7f31de7fc640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f31e014f660 0x7f31e01f6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:41.719 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.707+0000 7f31deffd640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f31e014f280 0x7f31e01f4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:41.719 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.707+0000 7f31de7fc640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f31e014f660 0x7f31e01f6f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:45226/0 (socket says 10.20.193.49:45226) 2026-02-17T11:15:41.719 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.707+0000 7f31de7fc640 1 -- 10.20.193.49:0/234564857 learned_addr learned my addr 10.20.193.49:0/234564857 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:41.719 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.707+0000 7f31de7fc640 10 monclient(hunting): get_auth_request con 0x7f31e014f660 auth_method 0 2026-02-17T11:15:41.719 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.707+0000 7f31de7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:41.719 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.707+0000 7f31de7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:41.719 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.707+0000 7f31de7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:41.719 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.707+0000 7f31df7fe640 1 --2- 10.20.193.49:0/234564857 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f31e015abc0 0x7f31e0141a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:41.719 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.707+0000 7f31deffd640 10 monclient(hunting): get_auth_request con 0x7f31e014f280 auth_method 0 2026-02-17T11:15:41.719 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.707+0000 7f31deffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:41.719 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.707+0000 7f31deffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:41.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.707+0000 7f31deffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:41.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.707+0000 7f31df7fe640 10 monclient(hunting): get_auth_request con 0x7f31e015abc0 auth_method 0 2026-02-17T11:15:41.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.707+0000 7f31df7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:41.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.707+0000 7f31df7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:41.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.707+0000 7f31df7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:41.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.707+0000 7f31de7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:41.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.707+0000 7f31de7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:41.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.707+0000 7f31de7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:41.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.707+0000 7f31deffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:41.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.707+0000 7f31deffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:41.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.707+0000 7f31deffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:41.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.707+0000 7f31df7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:41.721 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.707+0000 7f31df7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:41.721 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.707+0000 7f31df7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:41.721 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.708+0000 7f31de7fc640 10 monclient(hunting): handle_auth_done global_id 5145 payload 824 2026-02-17T11:15:41.721 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.708+0000 7f31de7fc640 1 -- 10.20.193.49:0/234564857 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f31e015abc0 msgr2=0x7f31e0141a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:41.721 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.708+0000 7f31de7fc640 1 --2- 10.20.193.49:0/234564857 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f31e015abc0 0x7f31e0141a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:41.721 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.708+0000 7f31de7fc640 1 -- 10.20.193.49:0/234564857 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f31e014f280 msgr2=0x7f31e01f4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:41.721 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.708+0000 7f31de7fc640 1 --2- 10.20.193.49:0/234564857 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f31e014f280 0x7f31e01f4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:41.721 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.708+0000 7f31de7fc640 10 monclient: _finish_hunting 0 2026-02-17T11:15:41.721 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.708+0000 7f31de7fc640 1 monclient: found mon.noname-a 2026-02-17T11:15:41.721 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.708+0000 7f31de7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:41.721 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.708+0000 7f31de7fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:15:41.721 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.708+0000 7f31de7fc640 1 -- 10.20.193.49:0/234564857 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31e0072a50 con 0x7f31e014f660 2026-02-17T11:15:41.721 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.709+0000 7f31de7fc640 1 --2- 10.20.193.49:0/234564857 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f31e014f660 0x7f31e01f6f30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f31c802f510 tx=0x7f31c80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:41.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.709+0000 7f31b7fff640 10 client.?.objecter ms_handle_connect 0x7f31e014f660 2026-02-17T11:15:41.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.709+0000 7f31b7fff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:15:41.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.711+0000 7f31b7fff640 1 -- 10.20.193.49:0/234564857 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c8047070 con 0x7f31e014f660 2026-02-17T11:15:41.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.711+0000 7f31b7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:41.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.711+0000 7f31b7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:15:41.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.711+0000 7f31b7fff640 10 monclient: dump: 2026-02-17T11:15:41.724 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:41.724 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:41.724 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:41.724 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:41.724 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:41.725 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:41.725 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:41.725 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:41.725 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:41.725 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:41.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.711+0000 7f31b7fff640 10 monclient: _finish_auth 0 2026-02-17T11:15:41.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.711+0000 7f31b7fff640 10 monclient: _check_auth_tickets 2026-02-17T11:15:41.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.711+0000 7f31b7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:41.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.711+0000 7f31b7fff640 1 -- 10.20.193.49:0/234564857 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31c8042630 con 0x7f31e014f660 2026-02-17T11:15:41.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.711+0000 7f31e59f8640 5 monclient: authenticate success, global_id 5145 2026-02-17T11:15:41.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.711+0000 7f31e59f8640 10 monclient: _renew_subs 2026-02-17T11:15:41.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.711+0000 7f31e59f8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:41.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.711+0000 7f31e59f8640 1 -- 10.20.193.49:0/234564857 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31e0072d30 con 0x7f31e014f660 2026-02-17T11:15:41.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.711+0000 7f31b7fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:41.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.711+0000 7f31b7fff640 1 -- 10.20.193.49:0/234564857 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c803c040 con 0x7f31e014f660 2026-02-17T11:15:41.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.711+0000 7f31b7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:41.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.711+0000 7f31dd7fa640 4 set_mon_vals no callback set 2026-02-17T11:15:41.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.711+0000 7f31b7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:15:41.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.711+0000 7f31b7fff640 10 monclient: dump: 2026-02-17T11:15:41.726 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:41.726 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:41.726 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:41.726 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:41.726 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:41.726 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:41.727 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:41.727 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:41.727 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:41.727 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:41.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.711+0000 7f31e59f8640 10 client.5145.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:41.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.711+0000 7f31e59f8640 10 monclient: _renew_subs 2026-02-17T11:15:41.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.711+0000 7f31e59f8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:41.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.711+0000 7f31e59f8640 1 -- 10.20.193.49:0/234564857 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31e00732f0 con 0x7f31e014f660 2026-02-17T11:15:41.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.711+0000 7f31e59f8640 1 librados: init done 2026-02-17T11:15:41.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.711+0000 7f31e59f8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:41.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.711+0000 7f31e59f8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:41.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.711+0000 7f31e59f8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:41.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.711+0000 7f31e59f8640 1 -- 10.20.193.49:0/234564857 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31e00c9b70 con 0x7f31e014f660 2026-02-17T11:15:41.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.722+0000 7f31b7fff640 1 -- 10.20.193.49:0/234564857 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f31c803f3c0 con 0x7f31e014f660 2026-02-17T11:15:41.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.722+0000 7f31b7fff640 1 --2- 10.20.193.49:0/234564857 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f31b0079190 0x7f31b007b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:41.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.723+0000 7f31deffd640 1 --2- 10.20.193.49:0/234564857 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f31b0079190 0x7f31b007b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:41.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.723+0000 7f31deffd640 10 monclient: get_auth_request con 0x7f31b0079190 auth_method 0 2026-02-17T11:15:41.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.723+0000 7f31deffd640 1 --2- 10.20.193.49:0/234564857 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f31b0079190 0x7f31b007b650 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f31d4006fd0 tx=0x7f31d4009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:41.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.723+0000 7f31b7fff640 10 client.5145.objecter ms_handle_connect 0x7f31b0079190 2026-02-17T11:15:41.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.724+0000 7f31b7fff640 1 -- 10.20.193.49:0/234564857 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f31c8082d80 con 0x7f31e014f660 2026-02-17T11:15:41.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.724+0000 7f31b7fff640 10 client.5145.objecter ms_dispatch2 0x7f31e0000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:15:41.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.725+0000 7f31b7fff640 3 client.5145.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:15:41.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.725+0000 7f31b7fff640 3 client.5145.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:15:41.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.725+0000 7f31b7fff640 20 client.5145.objecter dump_active .. 0 homeless 2026-02-17T11:15:41.827 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.824+0000 7f31b7fff640 1 -- 10.20.193.49:0/234564857 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f31c8051080 con 0x7f31e014f660 2026-02-17T11:15:41.827 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.824+0000 7f31b7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:41.827 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.824+0000 7f31b7fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:15:41.907 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.905+0000 7f31e59f8640 1 -- 10.20.193.49:0/234564857 --> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f31e00c92b0 con 0x7f31b0079190 2026-02-17T11:15:41.910 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.907+0000 7f31b7fff640 1 -- 10.20.193.49:0/234564857 <== mgr.4106 v2:10.20.193.162:6800/2614632098 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+44534 (secure 0 0 0) 0x7f31e00c92b0 con 0x7f31b0079190 2026-02-17T11:15:41.911 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:15:41.912 INFO:teuthology.orchestra.run.trial049.stderr:dumped all 2026-02-17T11:15:41.912 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.908+0000 7f31e59f8640 10 librados: watch_flush enter 2026-02-17T11:15:41.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.908+0000 7f31e59f8640 10 librados: watch_flush exit 2026-02-17T11:15:41.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.908+0000 7f31e59f8640 20 client.5145.objecter shutdown clearing up homeless session... 2026-02-17T11:15:41.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.908+0000 7f31e59f8640 10 client.5145.objecter successfully canceled tick 2026-02-17T11:15:41.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.908+0000 7f31e59f8640 1 -- 10.20.193.49:0/234564857 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f31b0079190 msgr2=0x7f31b007b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:41.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.908+0000 7f31e59f8640 1 --2- 10.20.193.49:0/234564857 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f31b0079190 0x7f31b007b650 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f31d4006fd0 tx=0x7f31d4009190 comp rx=0 tx=0).stop 2026-02-17T11:15:41.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.908+0000 7f31e59f8640 10 monclient: shutdown 2026-02-17T11:15:41.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.908+0000 7f31e59f8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:41.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.908+0000 7f31e59f8640 1 -- 10.20.193.49:0/234564857 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f31e014f660 msgr2=0x7f31e01f6f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:41.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.908+0000 7f31e59f8640 1 --2- 10.20.193.49:0/234564857 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f31e014f660 0x7f31e01f6f30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f31c802f510 tx=0x7f31c80047c0 comp rx=0 tx=0).stop 2026-02-17T11:15:41.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.908+0000 7f31e59f8640 1 -- 10.20.193.49:0/234564857 shutdown_connections 2026-02-17T11:15:41.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.908+0000 7f31e59f8640 1 --2- 10.20.193.49:0/234564857 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f31b0079190 0x7f31b007b650 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:41.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.908+0000 7f31e59f8640 1 --2- 10.20.193.49:0/234564857 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f31e015abc0 0x7f31e0141a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:41.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.908+0000 7f31e59f8640 1 --2- 10.20.193.49:0/234564857 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f31e014f660 0x7f31e01f6f30 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:41.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.908+0000 7f31e59f8640 1 --2- 10.20.193.49:0/234564857 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f31e014f280 0x7f31e01f4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:41.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.908+0000 7f31e59f8640 1 -- 10.20.193.49:0/234564857 >> 10.20.193.49:0/234564857 conn(0x7f31e00c9f20 msgr2=0x7f31e00c6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:41.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.908+0000 7f31e59f8640 1 -- 10.20.193.49:0/234564857 shutdown_connections 2026-02-17T11:15:41.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.908+0000 7f31e59f8640 1 -- 10.20.193.49:0/234564857 wait complete. 2026-02-17T11:15:41.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.908+0000 7f31e59f8640 1 librados: shutdown 2026-02-17T11:15:41.918 INFO:teuthology.orchestra.run.trial049.stdout:{"pg_ready":true,"pg_map":{"version":231,"stamp":"2026-02-17T11:15:40.504075+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459299,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":59,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":12,"kb":1509949440,"kb_used":438104,"kb_used_data":6680,"kb_used_omap":24,"kb_used_meta":431079,"kb_avail":1509511336,"statfs":{"total":1546188226560,"available":1545739608064,"internally_reserved":0,"allocated":6840320,"data_stored":3451878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25501,"internal_metadata":441424995},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 0 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 1 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 4 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 5 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 6 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 8 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 9 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 10 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 12 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 13 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 14 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002025"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:12:45.256474+0000","last_change":"2026-02-17T11:10:34.390486+0000","last_active":"2026-02-17T11:12:45.256474+0000","last_peered":"2026-02-17T11:12:45.256474+0000","last_clean":"2026-02-17T11:12:45.256474+0000","last_became_active":"2026-02-17T11:10:31.882486+0000","last_became_peered":"2026-02-17T11:10:31.882486+0000","last_unstale":"2026-02-17T11:12:45.256474+0000","last_undegraded":"2026-02-17T11:12:45.256474+0000","last_fullsized":"2026-02-17T11:12:45.256474+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_clean_scrub_stamp":"2026-02-17T11:10:30.447281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:57:41.179473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.031448708999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,10],"acting":[15,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:12:44.155635+0000","last_change":"2026-02-17T11:10:34.082564+0000","last_active":"2026-02-17T11:12:44.155635+0000","last_peered":"2026-02-17T11:12:44.155635+0000","last_clean":"2026-02-17T11:12:44.155635+0000","last_became_active":"2026-02-17T11:10:32.011352+0000","last_became_peered":"2026-02-17T11:10:32.011352+0000","last_unstale":"2026-02-17T11:12:44.155635+0000","last_undegraded":"2026-02-17T11:12:44.155635+0000","last_fullsized":"2026-02-17T11:12:44.155635+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_clean_scrub_stamp":"2026-02-17T11:10:30.447281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:32:07.479731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030517882999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,13],"acting":[8,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:12:40.225512+0000","last_change":"2026-02-17T11:10:34.580857+0000","last_active":"2026-02-17T11:12:40.225512+0000","last_peered":"2026-02-17T11:12:40.225512+0000","last_clean":"2026-02-17T11:12:40.225512+0000","last_became_active":"2026-02-17T11:10:31.774687+0000","last_became_peered":"2026-02-17T11:10:31.774687+0000","last_unstale":"2026-02-17T11:12:40.225512+0000","last_undegraded":"2026-02-17T11:12:40.225512+0000","last_fullsized":"2026-02-17T11:12:40.225512+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_clean_scrub_stamp":"2026-02-17T11:10:30.447281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:22:12.754481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.034911202000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4],"acting":[9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:12:39.186694+0000","last_change":"2026-02-17T11:10:34.579397+0000","last_active":"2026-02-17T11:12:39.186694+0000","last_peered":"2026-02-17T11:12:39.186694+0000","last_clean":"2026-02-17T11:12:39.186694+0000","last_became_active":"2026-02-17T11:10:31.919932+0000","last_became_peered":"2026-02-17T11:10:31.919932+0000","last_unstale":"2026-02-17T11:12:39.186694+0000","last_undegraded":"2026-02-17T11:12:39.186694+0000","last_fullsized":"2026-02-17T11:12:39.186694+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_clean_scrub_stamp":"2026-02-17T11:10:30.447281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:52:51.393067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.034931859000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"33'2","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:12:40.709325+0000","last_change":"2026-02-17T11:10:33.847595+0000","last_active":"2026-02-17T11:12:40.709325+0000","last_peered":"2026-02-17T11:12:40.709325+0000","last_clean":"2026-02-17T11:12:40.709325+0000","last_became_active":"2026-02-17T11:10:31.924469+0000","last_became_peered":"2026-02-17T11:10:31.924469+0000","last_unstale":"2026-02-17T11:12:40.709325+0000","last_undegraded":"2026-02-17T11:12:40.709325+0000","last_fullsized":"2026-02-17T11:12:40.709325+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_clean_scrub_stamp":"2026-02-17T11:10:30.447281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:39:57.389842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057723655999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,12],"acting":[3,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:12:36.274433+0000","last_change":"2026-02-17T11:10:33.798221+0000","last_active":"2026-02-17T11:12:36.274433+0000","last_peered":"2026-02-17T11:12:36.274433+0000","last_clean":"2026-02-17T11:12:36.274433+0000","last_became_active":"2026-02-17T11:10:31.972595+0000","last_became_peered":"2026-02-17T11:10:31.972595+0000","last_unstale":"2026-02-17T11:12:36.274433+0000","last_undegraded":"2026-02-17T11:12:36.274433+0000","last_fullsized":"2026-02-17T11:12:36.274433+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_clean_scrub_stamp":"2026-02-17T11:10:30.447281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:29:40.302770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038208368999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:12:35.707268+0000","last_change":"2026-02-17T11:10:33.851767+0000","last_active":"2026-02-17T11:12:35.707268+0000","last_peered":"2026-02-17T11:12:35.707268+0000","last_clean":"2026-02-17T11:12:35.707268+0000","last_became_active":"2026-02-17T11:10:31.878425+0000","last_became_peered":"2026-02-17T11:10:31.878425+0000","last_unstale":"2026-02-17T11:12:35.707268+0000","last_undegraded":"2026-02-17T11:12:35.707268+0000","last_fullsized":"2026-02-17T11:12:35.707268+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_clean_scrub_stamp":"2026-02-17T11:10:30.447281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:59:50.900049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057827870000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"31'1","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:12:36.274609+0000","last_change":"2026-02-17T11:10:33.802208+0000","last_active":"2026-02-17T11:12:36.274609+0000","last_peered":"2026-02-17T11:12:36.274609+0000","last_clean":"2026-02-17T11:12:36.274609+0000","last_became_active":"2026-02-17T11:10:31.780197+0000","last_became_peered":"2026-02-17T11:10:31.780197+0000","last_unstale":"2026-02-17T11:12:36.274609+0000","last_undegraded":"2026-02-17T11:12:36.274609+0000","last_fullsized":"2026-02-17T11:12:36.274609+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_clean_scrub_stamp":"2026-02-17T11:10:30.447281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:23:13.359463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.029469485,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,15],"acting":[14,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"1.0","version":"26'32","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:12:31.756690+0000","last_change":"2026-02-17T11:10:28.869213+0000","last_active":"2026-02-17T11:12:31.756690+0000","last_peered":"2026-02-17T11:12:31.756690+0000","last_clean":"2026-02-17T11:12:31.756690+0000","last_became_active":"2026-02-17T11:10:28.524896+0000","last_became_peered":"2026-02-17T11:10:28.524896+0000","last_unstale":"2026-02-17T11:12:31.756690+0000","last_undegraded":"2026-02-17T11:12:31.756690+0000","last_fullsized":"2026-02-17T11:12:31.756690+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:10:20.960810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:10:20.960810+0000","last_clean_scrub_stamp":"2026-02-17T11:10:20.960810+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:21:38.378078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":10,"up_from":27,"seq":115964117061,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[0,1,2,5,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 10 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":6,"up_from":27,"seq":115964117059,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":778240,"data_stored":563850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,5,7,8,9,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 6 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":12,"up_from":26,"seq":111669149763,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":166029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,7,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 12 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":4,"up_from":21,"seq":90194313283,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3,5,8,9,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 4 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":8,"up_from":21,"seq":90194313282,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5,7,9,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 8 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":1,"up_from":22,"seq":94489280579,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27332,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27589065},"hb_peers":[0,2,7,8,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 1 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":14,"up_from":23,"seq":98784247874,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3,4,5,7,8,9,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 14 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":2,"up_from":22,"seq":94489280579,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27332,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,5,7,8,9,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":15,"up_from":22,"seq":94489280579,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,2,4,5,7,8,9,10,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280578,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":778240,"data_stored":563850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[4,6,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 5 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":9,"up_from":22,"seq":94489280579,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1598,"internal_metadata":27589058},"hb_peers":[2,4,5,7,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 9 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":13,"up_from":22,"seq":94489280579,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[4,5,6,7,8,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 13 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":0,"up_from":26,"seq":111669149765,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[1,2,3,4,5,7,8,9,11,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 0 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":7,"up_from":25,"seq":107374182467,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27332,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27589067},"hb_peers":[0,4,5,6,8,9,10,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149764,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":166029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[2,4,5,6,8,9,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":11,"up_from":26,"seq":111669149764,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27332,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27589061},"hb_peers":[0,2,3,4,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:15:41.920 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:15:41.987 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.984+0000 7feef531b640 10 monclient: get_monmap_and_config 2026-02-17T11:15:41.987 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.985+0000 7feef531b640 10 monclient: build_initial_monmap 2026-02-17T11:15:41.987 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.985+0000 7feef531b640 10 monclient: monmap: 2026-02-17T11:15:41.987 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:41.988 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:41.988 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:15:41.986527+0000 2026-02-17T11:15:41.988 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:15:41.986527+0000 2026-02-17T11:15:41.988 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:41.988 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:41.988 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:15:41.988 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:15:41.988 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:15:41.988 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:15:41.988 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:15:41.988 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:15:41.989 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:41.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.985+0000 7feef531b640 1 Processor -- start 2026-02-17T11:15:41.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.985+0000 7feef531b640 1 -- start start 2026-02-17T11:15:41.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.985+0000 7feef531b640 10 monclient: init 2026-02-17T11:15:41.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.986+0000 7feef531b640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:41.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.986+0000 7feef531b640 10 monclient: _add_conns ranks=[0,1,5,2,4,3] 2026-02-17T11:15:41.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.986+0000 7feef531b640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7feef0152700 addr v1:10.20.193.49:6789/0 2026-02-17T11:15:41.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.986+0000 7feef531b640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7feef015ef80 addr v1:10.20.193.97:6789/0 2026-02-17T11:15:41.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.986+0000 7feef531b640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7feef0152ae0 0x7feef00c9e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:41.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.986+0000 7feef531b640 10 monclient(hunting): picked mon.noname-c con 0x7feef0152ae0 addr v2:10.20.193.157:3300/0 2026-02-17T11:15:41.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.986+0000 7feef531b640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feef015d4f0 con 0x7feef0152700 2026-02-17T11:15:41.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.986+0000 7feef531b640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feef015d7d0 con 0x7feef015ef80 2026-02-17T11:15:41.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.986+0000 7feef531b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:41.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.986+0000 7feef531b640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7feef015dab0 con 0x7feef0152ae0 2026-02-17T11:15:41.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.986+0000 7feef531b640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:41.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.986+0000 7feef531b640 10 monclient(hunting): authenticate will time out at 1418.650085s 2026-02-17T11:15:41.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.986+0000 7feeeeffd640 1 --1- >> v1:10.20.193.49:6789/0 conn(0x7feef0152700 0x7feef015e870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.49:6789/0 says I am v1:10.20.193.49:46106/0 (socket says 10.20.193.49:46106) 2026-02-17T11:15:41.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.986+0000 7feeeeffd640 1 -- 10.20.193.49:0/352615302 learned_addr learned my addr 10.20.193.49:0/352615302 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:15:41.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.986+0000 7feeef7fe640 1 --2- 10.20.193.49:0/352615302 >> v2:10.20.193.157:3300/0 conn(0x7feef0152ae0 0x7feef00c9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:41.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.986+0000 7feeef7fe640 10 monclient(hunting): get_auth_request con 0x7feef0152ae0 auth_method 0 2026-02-17T11:15:41.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.986+0000 7feeef7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:41.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.986+0000 7feeef7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:41.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.986+0000 7feeef7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:41.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.987+0000 7feeef7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:41.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.987+0000 7feeef7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:41.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.987+0000 7feeef7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:41.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.987+0000 7feeedffb640 1 -- 10.20.193.49:0/352615302 <== mon.0 v1:10.20.193.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1272141616 0 0) 0x7feef015d4f0 con 0x7feef0152700 2026-02-17T11:15:41.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.987+0000 7feeedffb640 10 monclient(hunting): _negotiate 2026-02-17T11:15:41.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.987+0000 7feeedffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:41.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.987+0000 7feeedffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:41.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.987+0000 7feeedffb640 10 monclient(hunting): my global_id is 5148 2026-02-17T11:15:41.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.987+0000 7feeedffb640 1 -- 10.20.193.49:0/352615302 --> v1:10.20.193.49:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feedc003620 con 0x7feef0152700 2026-02-17T11:15:41.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.988+0000 7feeef7fe640 10 monclient(hunting): handle_auth_done global_id 5171 payload 274 2026-02-17T11:15:41.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.988+0000 7feeef7fe640 1 -- 10.20.193.49:0/352615302 >> v1:10.20.193.97:6789/0 conn(0x7feef015ef80 legacy=0x7feef00c9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:41.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.988+0000 7feeef7fe640 1 -- 10.20.193.49:0/352615302 >> v1:10.20.193.49:6789/0 conn(0x7feef0152700 legacy=0x7feef015e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:41.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.988+0000 7feeef7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:15:41.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.988+0000 7feeef7fe640 1 monclient: found mon.noname-c 2026-02-17T11:15:41.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.988+0000 7feeef7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:41.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.988+0000 7feeef7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:15:41.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.988+0000 7feeef7fe640 1 -- 10.20.193.49:0/352615302 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feef015dd90 con 0x7feef0152ae0 2026-02-17T11:15:41.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.989+0000 7feeef7fe640 1 --2- 10.20.193.49:0/352615302 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7feef0152ae0 0x7feef00c9e40 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7feee0009d90 tx=0x7feee002f230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=269941e215045c38 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:42.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.990+0000 7feeedffb640 1 -- 10.20.193.49:0/352615302 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee003c070 con 0x7feef0152ae0 2026-02-17T11:15:42.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.990+0000 7feeedffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:42.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.990+0000 7feeedffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:15:42.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.990+0000 7feeedffb640 10 monclient: dump: 2026-02-17T11:15:42.001 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:42.002 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:42.002 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:42.002 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:42.002 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:42.002 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:42.002 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:42.002 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:42.002 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:42.002 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:42.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.991+0000 7feeedffb640 10 monclient: _finish_auth 0 2026-02-17T11:15:42.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.991+0000 7feeedffb640 10 monclient: _check_auth_tickets 2026-02-17T11:15:42.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.991+0000 7feeedffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:42.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.991+0000 7feeedffb640 1 -- 10.20.193.49:0/352615302 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feee0037440 con 0x7feef0152ae0 2026-02-17T11:15:42.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.991+0000 7feef531b640 5 monclient: authenticate success, global_id 5171 2026-02-17T11:15:42.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.991+0000 7feef531b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:15:42.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.991+0000 7feeedffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:42.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.991+0000 7feeedffb640 1 -- 10.20.193.49:0/352615302 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee0037810 con 0x7feef0152ae0 2026-02-17T11:15:42.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.991+0000 7feeedffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:42.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.991+0000 7feeedffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:15:42.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.991+0000 7feeedffb640 10 monclient: dump: 2026-02-17T11:15:42.003 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:42.003 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:42.003 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:42.003 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:42.004 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:42.004 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:42.004 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:42.004 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:42.004 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:42.004 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:42.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.991+0000 7feef531b640 10 monclient: get_monmap_and_config success 2026-02-17T11:15:42.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.991+0000 7feef531b640 4 set_mon_vals no callback set 2026-02-17T11:15:42.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.991+0000 7feef531b640 10 monclient: shutdown 2026-02-17T11:15:42.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.991+0000 7feef531b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:42.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.991+0000 7feef531b640 1 -- 10.20.193.49:0/352615302 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7feef0152ae0 msgr2=0x7feef00c9e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:42.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.991+0000 7feef531b640 1 --2- 10.20.193.49:0/352615302 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7feef0152ae0 0x7feef00c9e40 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7feee0009d90 tx=0x7feee002f230 comp rx=0 tx=0).stop 2026-02-17T11:15:42.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.991+0000 7feef531b640 1 -- 10.20.193.49:0/352615302 shutdown_connections 2026-02-17T11:15:42.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.991+0000 7feef531b640 1 --2- 10.20.193.49:0/352615302 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7feef0152ae0 0x7feef00c9e40 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:42.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.991+0000 7feef531b640 1 -- 10.20.193.49:0/352615302 >> 10.20.193.49:0/352615302 conn(0x7feef0073030 msgr2=0x7feef0073440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:42.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.991+0000 7feef531b640 1 -- 10.20.193.49:0/352615302 shutdown_connections 2026-02-17T11:15:42.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.991+0000 7feef531b640 1 -- 10.20.193.49:0/352615302 wait complete. 2026-02-17T11:15:42.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.992+0000 7feef531b640 10 monclient: build_initial_monmap 2026-02-17T11:15:42.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.992+0000 7feef531b640 10 monclient: monmap: 2026-02-17T11:15:42.005 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:42.005 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:15:42.005 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:15:42.005 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:15:42.005 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:42.006 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:42.006 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:15:42.006 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:15:42.006 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:15:42.006 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:42.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.992+0000 7feef531b640 1 librados: starting msgr at 2026-02-17T11:15:42.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.992+0000 7feef531b640 1 librados: starting objecter 2026-02-17T11:15:42.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.992+0000 7feef531b640 1 Processor -- start 2026-02-17T11:15:42.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.992+0000 7feef531b640 1 -- start start 2026-02-17T11:15:42.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.992+0000 7feef531b640 1 librados: setting wanted keys 2026-02-17T11:15:42.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.992+0000 7feef531b640 1 librados: calling monclient init 2026-02-17T11:15:42.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.992+0000 7feef531b640 10 monclient: init 2026-02-17T11:15:42.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.992+0000 7feef531b640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:42.007 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.992+0000 7feef531b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:15:42.007 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.992+0000 7feef531b640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7feef0152700 0x7feef0151b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:42.007 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.992+0000 7feef531b640 10 monclient(hunting): picked mon.noname-a con 0x7feef0152700 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:15:42.007 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.992+0000 7feef531b640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7feef0152ae0 0x7feef01f6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:42.007 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.992+0000 7feef531b640 10 monclient(hunting): picked mon.noname-b con 0x7feef0152ae0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:15:42.007 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.992+0000 7feef531b640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7feef015ef80 0x7feef0158950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:42.007 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.992+0000 7feef531b640 10 monclient(hunting): picked mon.noname-c con 0x7feef015ef80 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:15:42.007 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.992+0000 7feef531b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:42.007 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.992+0000 7feef531b640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7feef00ca380 con 0x7feef0152700 2026-02-17T11:15:42.007 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.992+0000 7feef531b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:42.007 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.992+0000 7feef531b640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7feef015e350 con 0x7feef0152ae0 2026-02-17T11:15:42.007 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.992+0000 7feef531b640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:42.008 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.992+0000 7feef531b640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7feef0166850 con 0x7feef015ef80 2026-02-17T11:15:42.008 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.992+0000 7feef531b640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:42.008 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.992+0000 7feef531b640 10 monclient(hunting): authenticate will time out at 1418.656746s 2026-02-17T11:15:42.008 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.993+0000 7feeeeffd640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7feef0152700 0x7feef0151b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:42.008 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.993+0000 7feeef7fe640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7feef015ef80 0x7feef0158950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:42.008 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.993+0000 7feeeeffd640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7feef0152700 0x7feef0151b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:45238/0 (socket says 10.20.193.49:45238) 2026-02-17T11:15:42.008 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.993+0000 7feeeeffd640 1 -- 10.20.193.49:0/2363482570 learned_addr learned my addr 10.20.193.49:0/2363482570 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:42.008 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.993+0000 7feeeeffd640 10 monclient(hunting): get_auth_request con 0x7feef0152700 auth_method 0 2026-02-17T11:15:42.008 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.993+0000 7feeeeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:42.008 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.993+0000 7feeeeffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:42.008 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.993+0000 7feeeeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:42.008 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.993+0000 7feeee7fc640 1 --2- 10.20.193.49:0/2363482570 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7feef0152ae0 0x7feef01f6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:42.009 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.993+0000 7feeeeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:42.009 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.993+0000 7feeeeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:42.009 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.993+0000 7feeeeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:42.009 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.993+0000 7feeef7fe640 10 monclient(hunting): get_auth_request con 0x7feef015ef80 auth_method 0 2026-02-17T11:15:42.009 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.993+0000 7feeef7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:42.009 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.993+0000 7feeef7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:42.009 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.993+0000 7feeef7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:42.009 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.993+0000 7feeee7fc640 10 monclient(hunting): get_auth_request con 0x7feef0152ae0 auth_method 0 2026-02-17T11:15:42.009 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.993+0000 7feeee7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:42.009 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.993+0000 7feeee7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:42.009 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.993+0000 7feeee7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:42.009 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.993+0000 7feeef7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:42.010 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.993+0000 7feeef7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:42.010 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.993+0000 7feeef7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:42.010 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.993+0000 7feeee7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:42.010 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.993+0000 7feeee7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:42.010 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.993+0000 7feeee7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:42.010 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.994+0000 7feeeeffd640 10 monclient(hunting): handle_auth_done global_id 5151 payload 824 2026-02-17T11:15:42.010 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.994+0000 7feeeeffd640 1 -- 10.20.193.49:0/2363482570 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7feef015ef80 msgr2=0x7feef0158950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:42.010 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.994+0000 7feeeeffd640 1 --2- 10.20.193.49:0/2363482570 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7feef015ef80 0x7feef0158950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:42.010 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.994+0000 7feeeeffd640 1 -- 10.20.193.49:0/2363482570 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7feef0152ae0 msgr2=0x7feef01f6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:42.010 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.994+0000 7feeeeffd640 1 --2- 10.20.193.49:0/2363482570 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7feef0152ae0 0x7feef01f6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:42.010 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.994+0000 7feeeeffd640 10 monclient: _finish_hunting 0 2026-02-17T11:15:42.010 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.994+0000 7feeeeffd640 1 monclient: found mon.noname-a 2026-02-17T11:15:42.010 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.994+0000 7feeeeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:42.011 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.994+0000 7feeeeffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:15:42.011 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.994+0000 7feeeeffd640 1 -- 10.20.193.49:0/2363482570 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feef00ce910 con 0x7feef0152700 2026-02-17T11:15:42.011 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.995+0000 7feeeeffd640 1 --2- 10.20.193.49:0/2363482570 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7feef0152700 0x7feef0151b70 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7feee400c4d0 tx=0x7feee400c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:42.011 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.995+0000 7feecf7fe640 10 client.?.objecter ms_handle_connect 0x7feef0152700 2026-02-17T11:15:42.011 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.995+0000 7feecf7fe640 10 client.?.objecter resend_mon_ops 2026-02-17T11:15:42.011 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.997+0000 7feecf7fe640 1 -- 10.20.193.49:0/2363482570 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee4017070 con 0x7feef0152700 2026-02-17T11:15:42.011 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.997+0000 7feecf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:42.011 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.997+0000 7feecf7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:15:42.011 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.997+0000 7feecf7fe640 10 monclient: dump: 2026-02-17T11:15:42.011 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:42.011 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:42.011 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:42.012 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:42.012 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:42.012 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:42.012 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:42.012 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:42.012 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:42.012 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:42.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.997+0000 7feecf7fe640 10 monclient: _finish_auth 0 2026-02-17T11:15:42.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.997+0000 7feecf7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:15:42.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.997+0000 7feecf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:42.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.997+0000 7feecf7fe640 1 -- 10.20.193.49:0/2363482570 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feee4005e00 con 0x7feef0152700 2026-02-17T11:15:42.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.997+0000 7feecf7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:42.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.997+0000 7feecf7fe640 1 -- 10.20.193.49:0/2363482570 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee40072b0 con 0x7feef0152700 2026-02-17T11:15:42.013 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.997+0000 7feef531b640 5 monclient: authenticate success, global_id 5151 2026-02-17T11:15:42.013 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.997+0000 7feef531b640 10 monclient: _renew_subs 2026-02-17T11:15:42.013 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.997+0000 7feef531b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:42.013 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.997+0000 7feef531b640 1 -- 10.20.193.49:0/2363482570 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feef0157b90 con 0x7feef0152700 2026-02-17T11:15:42.013 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.997+0000 7feeed7fa640 4 set_mon_vals no callback set 2026-02-17T11:15:42.013 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.997+0000 7feecf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:42.013 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.997+0000 7feecf7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:15:42.013 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.997+0000 7feecf7fe640 10 monclient: dump: 2026-02-17T11:15:42.013 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:42.013 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:42.013 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:42.013 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:42.013 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:42.014 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:42.014 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:42.014 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:42.014 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:42.014 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:42.014 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.997+0000 7feef531b640 10 client.5151.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:42.014 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.997+0000 7feef531b640 10 monclient: _renew_subs 2026-02-17T11:15:42.014 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.997+0000 7feef531b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:42.014 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.997+0000 7feef531b640 1 -- 10.20.193.49:0/2363482570 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feef0158150 con 0x7feef0152700 2026-02-17T11:15:42.014 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.997+0000 7feef531b640 1 librados: init done 2026-02-17T11:15:42.014 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.998+0000 7feef531b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:42.014 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.998+0000 7feef531b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:42.015 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.998+0000 7feef531b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:42.015 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:41.998+0000 7feef531b640 1 -- 10.20.193.49:0/2363482570 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feef006a240 con 0x7feef0152700 2026-02-17T11:15:42.016 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.009+0000 7feecf7fe640 1 -- 10.20.193.49:0/2363482570 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7feee4007450 con 0x7feef0152700 2026-02-17T11:15:42.016 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.009+0000 7feecf7fe640 1 --2- 10.20.193.49:0/2363482570 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7feebc079190 0x7feebc07b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:42.016 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.010+0000 7feeee7fc640 1 --2- 10.20.193.49:0/2363482570 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7feebc079190 0x7feebc07b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:42.016 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.010+0000 7feeee7fc640 10 monclient: get_auth_request con 0x7feebc079190 auth_method 0 2026-02-17T11:15:42.016 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.010+0000 7feecf7fe640 10 client.5151.objecter ms_handle_connect 0x7feebc079190 2026-02-17T11:15:42.016 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.010+0000 7feeee7fc640 1 --2- 10.20.193.49:0/2363482570 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7feebc079190 0x7feebc07b650 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7feed8002410 tx=0x7feed8007ef0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:42.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.111+0000 7feecf7fe640 1 -- 10.20.193.49:0/2363482570 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7feee4007770 con 0x7feef0152700 2026-02-17T11:15:42.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.111+0000 7feecf7fe640 10 client.5151.objecter ms_dispatch2 0x7feef0000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:15:42.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.111+0000 7feecf7fe640 3 client.5151.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:15:42.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.111+0000 7feecf7fe640 3 client.5151.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:15:42.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.111+0000 7feecf7fe640 20 client.5151.objecter dump_active .. 0 homeless 2026-02-17T11:15:42.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.111+0000 7feecf7fe640 1 -- 10.20.193.49:0/2363482570 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7feef006a240 con 0x7feef0152700 2026-02-17T11:15:42.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.111+0000 7feecf7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:42.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.111+0000 7feecf7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:15:42.197 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.194+0000 7feef531b640 1 -- 10.20.193.49:0/2363482570 --> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7feef015e870 con 0x7feebc079190 2026-02-17T11:15:42.198 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.196+0000 7feecf7fe640 1 -- 10.20.193.49:0/2363482570 <== mgr.4106 v2:10.20.193.162:6800/2614632098 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+44534 (secure 0 0 0) 0x7feef015e870 con 0x7feebc079190 2026-02-17T11:15:42.199 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:15:42.201 INFO:teuthology.orchestra.run.trial049.stderr:dumped all 2026-02-17T11:15:42.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.197+0000 7feef531b640 10 librados: watch_flush enter 2026-02-17T11:15:42.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.197+0000 7feef531b640 10 librados: watch_flush exit 2026-02-17T11:15:42.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.197+0000 7feef531b640 20 client.5151.objecter shutdown clearing up homeless session... 2026-02-17T11:15:42.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.197+0000 7feef531b640 10 client.5151.objecter successfully canceled tick 2026-02-17T11:15:42.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.197+0000 7feef531b640 1 -- 10.20.193.49:0/2363482570 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7feebc079190 msgr2=0x7feebc07b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:42.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.197+0000 7feef531b640 1 --2- 10.20.193.49:0/2363482570 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7feebc079190 0x7feebc07b650 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7feed8002410 tx=0x7feed8007ef0 comp rx=0 tx=0).stop 2026-02-17T11:15:42.201 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.197+0000 7feef531b640 10 monclient: shutdown 2026-02-17T11:15:42.202 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.197+0000 7feef531b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:42.202 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.197+0000 7feef531b640 1 -- 10.20.193.49:0/2363482570 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7feef0152700 msgr2=0x7feef0151b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:42.202 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.197+0000 7feef531b640 1 --2- 10.20.193.49:0/2363482570 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7feef0152700 0x7feef0151b70 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7feee400c4d0 tx=0x7feee400c9a0 comp rx=0 tx=0).stop 2026-02-17T11:15:42.202 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.197+0000 7feef531b640 1 -- 10.20.193.49:0/2363482570 shutdown_connections 2026-02-17T11:15:42.202 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.197+0000 7feef531b640 1 --2- 10.20.193.49:0/2363482570 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7feebc079190 0x7feebc07b650 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:42.202 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.197+0000 7feef531b640 1 --2- 10.20.193.49:0/2363482570 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7feef015ef80 0x7feef0158950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:42.202 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.197+0000 7feef531b640 1 --2- 10.20.193.49:0/2363482570 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7feef0152ae0 0x7feef01f6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:42.202 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.197+0000 7feef531b640 1 --2- 10.20.193.49:0/2363482570 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7feef0152700 0x7feef0151b70 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:42.202 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.197+0000 7feef531b640 1 -- 10.20.193.49:0/2363482570 >> 10.20.193.49:0/2363482570 conn(0x7feef0073030 msgr2=0x7feef00c96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:42.202 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.197+0000 7feef531b640 1 -- 10.20.193.49:0/2363482570 shutdown_connections 2026-02-17T11:15:42.202 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.197+0000 7feef531b640 1 -- 10.20.193.49:0/2363482570 wait complete. 2026-02-17T11:15:42.202 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.197+0000 7feef531b640 1 librados: shutdown 2026-02-17T11:15:42.208 INFO:teuthology.orchestra.run.trial049.stdout:{"pg_ready":true,"pg_map":{"version":231,"stamp":"2026-02-17T11:15:40.504075+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459299,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":59,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":12,"kb":1509949440,"kb_used":438104,"kb_used_data":6680,"kb_used_omap":24,"kb_used_meta":431079,"kb_avail":1509511336,"statfs":{"total":1546188226560,"available":1545739608064,"internally_reserved":0,"allocated":6840320,"data_stored":3451878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25501,"internal_metadata":441424995},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 0 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 1 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 4 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 5 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 6 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 8 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 9 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 10 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 12 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 13 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 14 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002025"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:12:45.256474+0000","last_change":"2026-02-17T11:10:34.390486+0000","last_active":"2026-02-17T11:12:45.256474+0000","last_peered":"2026-02-17T11:12:45.256474+0000","last_clean":"2026-02-17T11:12:45.256474+0000","last_became_active":"2026-02-17T11:10:31.882486+0000","last_became_peered":"2026-02-17T11:10:31.882486+0000","last_unstale":"2026-02-17T11:12:45.256474+0000","last_undegraded":"2026-02-17T11:12:45.256474+0000","last_fullsized":"2026-02-17T11:12:45.256474+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_clean_scrub_stamp":"2026-02-17T11:10:30.447281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:57:41.179473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.031448708999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,10],"acting":[15,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:12:44.155635+0000","last_change":"2026-02-17T11:10:34.082564+0000","last_active":"2026-02-17T11:12:44.155635+0000","last_peered":"2026-02-17T11:12:44.155635+0000","last_clean":"2026-02-17T11:12:44.155635+0000","last_became_active":"2026-02-17T11:10:32.011352+0000","last_became_peered":"2026-02-17T11:10:32.011352+0000","last_unstale":"2026-02-17T11:12:44.155635+0000","last_undegraded":"2026-02-17T11:12:44.155635+0000","last_fullsized":"2026-02-17T11:12:44.155635+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_clean_scrub_stamp":"2026-02-17T11:10:30.447281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:32:07.479731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030517882999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,13],"acting":[8,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:12:40.225512+0000","last_change":"2026-02-17T11:10:34.580857+0000","last_active":"2026-02-17T11:12:40.225512+0000","last_peered":"2026-02-17T11:12:40.225512+0000","last_clean":"2026-02-17T11:12:40.225512+0000","last_became_active":"2026-02-17T11:10:31.774687+0000","last_became_peered":"2026-02-17T11:10:31.774687+0000","last_unstale":"2026-02-17T11:12:40.225512+0000","last_undegraded":"2026-02-17T11:12:40.225512+0000","last_fullsized":"2026-02-17T11:12:40.225512+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_clean_scrub_stamp":"2026-02-17T11:10:30.447281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:22:12.754481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.034911202000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4],"acting":[9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:12:39.186694+0000","last_change":"2026-02-17T11:10:34.579397+0000","last_active":"2026-02-17T11:12:39.186694+0000","last_peered":"2026-02-17T11:12:39.186694+0000","last_clean":"2026-02-17T11:12:39.186694+0000","last_became_active":"2026-02-17T11:10:31.919932+0000","last_became_peered":"2026-02-17T11:10:31.919932+0000","last_unstale":"2026-02-17T11:12:39.186694+0000","last_undegraded":"2026-02-17T11:12:39.186694+0000","last_fullsized":"2026-02-17T11:12:39.186694+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_clean_scrub_stamp":"2026-02-17T11:10:30.447281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:52:51.393067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.034931859000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"33'2","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:12:40.709325+0000","last_change":"2026-02-17T11:10:33.847595+0000","last_active":"2026-02-17T11:12:40.709325+0000","last_peered":"2026-02-17T11:12:40.709325+0000","last_clean":"2026-02-17T11:12:40.709325+0000","last_became_active":"2026-02-17T11:10:31.924469+0000","last_became_peered":"2026-02-17T11:10:31.924469+0000","last_unstale":"2026-02-17T11:12:40.709325+0000","last_undegraded":"2026-02-17T11:12:40.709325+0000","last_fullsized":"2026-02-17T11:12:40.709325+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_clean_scrub_stamp":"2026-02-17T11:10:30.447281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:39:57.389842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057723655999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,12],"acting":[3,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:12:36.274433+0000","last_change":"2026-02-17T11:10:33.798221+0000","last_active":"2026-02-17T11:12:36.274433+0000","last_peered":"2026-02-17T11:12:36.274433+0000","last_clean":"2026-02-17T11:12:36.274433+0000","last_became_active":"2026-02-17T11:10:31.972595+0000","last_became_peered":"2026-02-17T11:10:31.972595+0000","last_unstale":"2026-02-17T11:12:36.274433+0000","last_undegraded":"2026-02-17T11:12:36.274433+0000","last_fullsized":"2026-02-17T11:12:36.274433+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_clean_scrub_stamp":"2026-02-17T11:10:30.447281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:29:40.302770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038208368999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:12:35.707268+0000","last_change":"2026-02-17T11:10:33.851767+0000","last_active":"2026-02-17T11:12:35.707268+0000","last_peered":"2026-02-17T11:12:35.707268+0000","last_clean":"2026-02-17T11:12:35.707268+0000","last_became_active":"2026-02-17T11:10:31.878425+0000","last_became_peered":"2026-02-17T11:10:31.878425+0000","last_unstale":"2026-02-17T11:12:35.707268+0000","last_undegraded":"2026-02-17T11:12:35.707268+0000","last_fullsized":"2026-02-17T11:12:35.707268+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_clean_scrub_stamp":"2026-02-17T11:10:30.447281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:59:50.900049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057827870000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"31'1","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:12:36.274609+0000","last_change":"2026-02-17T11:10:33.802208+0000","last_active":"2026-02-17T11:12:36.274609+0000","last_peered":"2026-02-17T11:12:36.274609+0000","last_clean":"2026-02-17T11:12:36.274609+0000","last_became_active":"2026-02-17T11:10:31.780197+0000","last_became_peered":"2026-02-17T11:10:31.780197+0000","last_unstale":"2026-02-17T11:12:36.274609+0000","last_undegraded":"2026-02-17T11:12:36.274609+0000","last_fullsized":"2026-02-17T11:12:36.274609+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_clean_scrub_stamp":"2026-02-17T11:10:30.447281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:23:13.359463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.029469485,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,15],"acting":[14,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"1.0","version":"26'32","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:12:31.756690+0000","last_change":"2026-02-17T11:10:28.869213+0000","last_active":"2026-02-17T11:12:31.756690+0000","last_peered":"2026-02-17T11:12:31.756690+0000","last_clean":"2026-02-17T11:12:31.756690+0000","last_became_active":"2026-02-17T11:10:28.524896+0000","last_became_peered":"2026-02-17T11:10:28.524896+0000","last_unstale":"2026-02-17T11:12:31.756690+0000","last_undegraded":"2026-02-17T11:12:31.756690+0000","last_fullsized":"2026-02-17T11:12:31.756690+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:10:20.960810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:10:20.960810+0000","last_clean_scrub_stamp":"2026-02-17T11:10:20.960810+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:21:38.378078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":10,"up_from":27,"seq":115964117061,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[0,1,2,5,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 10 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":6,"up_from":27,"seq":115964117059,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":778240,"data_stored":563850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,5,7,8,9,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 6 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":12,"up_from":26,"seq":111669149763,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":166029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,7,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 12 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":4,"up_from":21,"seq":90194313283,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3,5,8,9,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 4 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":8,"up_from":21,"seq":90194313282,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5,7,9,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 8 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":1,"up_from":22,"seq":94489280579,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27332,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27589065},"hb_peers":[0,2,7,8,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 1 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":14,"up_from":23,"seq":98784247874,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3,4,5,7,8,9,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 14 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":2,"up_from":22,"seq":94489280579,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27332,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,5,7,8,9,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":15,"up_from":22,"seq":94489280579,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,2,4,5,7,8,9,10,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280578,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":778240,"data_stored":563850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[4,6,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 5 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":9,"up_from":22,"seq":94489280579,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1598,"internal_metadata":27589058},"hb_peers":[2,4,5,7,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 9 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":13,"up_from":22,"seq":94489280579,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[4,5,6,7,8,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 13 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":0,"up_from":26,"seq":111669149765,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[1,2,3,4,5,7,8,9,11,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 0 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":7,"up_from":25,"seq":107374182467,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27332,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27589067},"hb_peers":[0,4,5,6,8,9,10,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149764,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":166029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[2,4,5,6,8,9,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":11,"up_from":26,"seq":111669149764,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27332,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27589061},"hb_peers":[0,2,3,4,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:15:42.210 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-17T11:15:42.210 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:15:42.279 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.276+0000 7f79afbe6640 10 monclient: get_monmap_and_config 2026-02-17T11:15:42.279 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.276+0000 7f79afbe6640 10 monclient: build_initial_monmap 2026-02-17T11:15:42.279 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.276+0000 7f79afbe6640 10 monclient: monmap: 2026-02-17T11:15:42.279 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:42.279 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:42.279 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:15:42.277763+0000 2026-02-17T11:15:42.280 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:15:42.277763+0000 2026-02-17T11:15:42.280 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:42.280 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:42.280 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:15:42.280 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:15:42.280 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:15:42.280 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:15:42.280 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:15:42.280 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:15:42.280 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:42.280 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.276+0000 7f79afbe6640 1 Processor -- start 2026-02-17T11:15:42.280 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.276+0000 7f79afbe6640 1 -- start start 2026-02-17T11:15:42.281 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.276+0000 7f79afbe6640 10 monclient: init 2026-02-17T11:15:42.284 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.277+0000 7f79afbe6640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:42.284 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.277+0000 7f79afbe6640 10 monclient: _add_conns ranks=[0,5,3,4,2,1] 2026-02-17T11:15:42.284 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.277+0000 7f79afbe6640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f79a815d370 addr v1:10.20.193.49:6789/0 2026-02-17T11:15:42.284 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.277+0000 7f79afbe6640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f79a80c7e20 0x7f79a815d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:42.284 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.277+0000 7f79afbe6640 10 monclient(hunting): picked mon.noname-c con 0x7f79a80c7e20 addr v2:10.20.193.157:3300/0 2026-02-17T11:15:42.284 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.277+0000 7f79afbe6640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f79a80c74c0 0x7f79a80c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:42.284 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.277+0000 7f79afbe6640 10 monclient(hunting): picked mon.noname-a con 0x7f79a80c74c0 addr v2:10.20.193.49:3300/0 2026-02-17T11:15:42.284 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.277+0000 7f79afbe6640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79a80c8350 con 0x7f79a815d370 2026-02-17T11:15:42.284 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.277+0000 7f79afbe6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:42.285 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.277+0000 7f79afbe6640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f79a815b710 con 0x7f79a80c74c0 2026-02-17T11:15:42.285 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.277+0000 7f79afbe6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:42.285 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.277+0000 7f79afbe6640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f79a80c9240 con 0x7f79a80c7e20 2026-02-17T11:15:42.285 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.277+0000 7f79afbe6640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:42.285 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.277+0000 7f79afbe6640 10 monclient(hunting): authenticate will time out at 1418.941379s 2026-02-17T11:15:42.285 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.277+0000 7f79ae15c640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f79a80c74c0 0x7f79a80c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:42.285 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.277+0000 7f79ad15a640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f79a80c7e20 0x7f79a815d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:42.285 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.278+0000 7f79ae15c640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f79a80c74c0 0x7f79a80c52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:45248/0 (socket says 10.20.193.49:45248) 2026-02-17T11:15:42.285 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.278+0000 7f79ae15c640 1 -- 10.20.193.49:0/4161401642 learned_addr learned my addr 10.20.193.49:0/4161401642 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:42.285 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.278+0000 7f79ae15c640 10 monclient(hunting): get_auth_request con 0x7f79a80c74c0 auth_method 0 2026-02-17T11:15:42.285 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.278+0000 7f79ae15c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:42.286 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.278+0000 7f79ae15c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:42.286 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.278+0000 7f79ae15c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:42.286 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.278+0000 7f79ad15a640 10 monclient(hunting): get_auth_request con 0x7f79a80c7e20 auth_method 0 2026-02-17T11:15:42.286 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.278+0000 7f79ad15a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:42.286 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.278+0000 7f79ad15a640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:42.286 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.278+0000 7f79ad15a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:42.286 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.278+0000 7f79ad15a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:42.286 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.278+0000 7f79ad15a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:42.286 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.278+0000 7f79ad15a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:42.286 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.278+0000 7f79ae15c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:42.286 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.278+0000 7f79ae15c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:42.286 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.278+0000 7f79ae15c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:42.286 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.279+0000 7f79ad15a640 10 monclient(hunting): handle_auth_done global_id 5177 payload 274 2026-02-17T11:15:42.287 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.279+0000 7f79ad15a640 1 -- 10.20.193.49:0/4161401642 >> v2:10.20.193.49:3300/0 conn(0x7f79a80c74c0 msgr2=0x7f79a80c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:15:42.287 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.279+0000 7f79ad15a640 1 --2- 10.20.193.49:0/4161401642 >> v2:10.20.193.49:3300/0 conn(0x7f79a80c74c0 0x7f79a80c52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:42.287 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.279+0000 7f79ad15a640 1 -- 10.20.193.49:0/4161401642 >> v1:10.20.193.49:6789/0 conn(0x7f79a815d370 legacy=0x7f79a815b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:42.287 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.279+0000 7f79ad15a640 10 monclient: _finish_hunting 0 2026-02-17T11:15:42.287 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.279+0000 7f79ad15a640 1 monclient: found mon.noname-c 2026-02-17T11:15:42.287 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.279+0000 7f79ad15a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:42.287 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.279+0000 7f79ad15a640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:15:42.287 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.279+0000 7f79ad15a640 1 -- 10.20.193.49:0/4161401642 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79a80c8630 con 0x7f79a80c7e20 2026-02-17T11:15:42.287 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.280+0000 7f79ad15a640 1 --2- 10.20.193.49:0/4161401642 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f79a80c7e20 0x7f79a815d750 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f79a815d060 tx=0x7f799c02ede0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef2c1f9936f034b1 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:42.287 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.281+0000 7f79ac959640 1 -- 10.20.193.49:0/4161401642 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f799c03c070 con 0x7f79a80c7e20 2026-02-17T11:15:42.287 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.281+0000 7f79ac959640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:42.287 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.281+0000 7f79ac959640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:15:42.288 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.281+0000 7f79ac959640 10 monclient: dump: 2026-02-17T11:15:42.288 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:42.288 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:42.288 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:42.288 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:42.288 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:42.288 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:42.288 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:42.288 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:42.288 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:42.288 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:42.288 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.281+0000 7f79ac959640 10 monclient: _finish_auth 0 2026-02-17T11:15:42.289 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.281+0000 7f79ac959640 10 monclient: _check_auth_tickets 2026-02-17T11:15:42.289 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.281+0000 7f79ac959640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:42.289 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.281+0000 7f79afbe6640 5 monclient: authenticate success, global_id 5177 2026-02-17T11:15:42.289 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.281+0000 7f79afbe6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:15:42.295 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.282+0000 7f79ac959640 1 -- 10.20.193.49:0/4161401642 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f799c02faf0 con 0x7f79a80c7e20 2026-02-17T11:15:42.295 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.282+0000 7f79ac959640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:42.295 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.282+0000 7f79ac959640 1 -- 10.20.193.49:0/4161401642 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f799c037440 con 0x7f79a80c7e20 2026-02-17T11:15:42.295 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.282+0000 7f79ac959640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:42.295 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.282+0000 7f79ac959640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:15:42.295 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.282+0000 7f79ac959640 10 monclient: dump: 2026-02-17T11:15:42.295 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:42.296 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:42.296 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:42.296 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:42.296 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:42.296 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:42.296 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:42.296 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:42.296 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:42.296 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:42.296 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.282+0000 7f79afbe6640 10 monclient: get_monmap_and_config success 2026-02-17T11:15:42.296 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.282+0000 7f79afbe6640 4 set_mon_vals no callback set 2026-02-17T11:15:42.296 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.282+0000 7f79afbe6640 10 monclient: shutdown 2026-02-17T11:15:42.297 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.282+0000 7f79afbe6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:42.297 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.282+0000 7f79afbe6640 1 -- 10.20.193.49:0/4161401642 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f79a80c7e20 msgr2=0x7f79a815d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:42.297 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.282+0000 7f79afbe6640 1 --2- 10.20.193.49:0/4161401642 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f79a80c7e20 0x7f79a815d750 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f79a815d060 tx=0x7f799c02ede0 comp rx=0 tx=0).stop 2026-02-17T11:15:42.297 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.282+0000 7f79afbe6640 1 -- 10.20.193.49:0/4161401642 shutdown_connections 2026-02-17T11:15:42.297 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.282+0000 7f79afbe6640 1 --2- 10.20.193.49:0/4161401642 >> v2:10.20.193.49:3300/0 conn(0x7f79a80c74c0 0x7f79a80c52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:42.297 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.282+0000 7f79afbe6640 1 --2- 10.20.193.49:0/4161401642 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f79a80c7e20 0x7f79a815d750 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:42.297 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.282+0000 7f79afbe6640 1 -- 10.20.193.49:0/4161401642 >> 10.20.193.49:0/4161401642 conn(0x7f79a80c9f20 msgr2=0x7f79a80ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:42.297 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.282+0000 7f79afbe6640 1 -- 10.20.193.49:0/4161401642 shutdown_connections 2026-02-17T11:15:42.297 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.282+0000 7f79afbe6640 1 -- 10.20.193.49:0/4161401642 wait complete. 2026-02-17T11:15:42.297 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.283+0000 7f79afbe6640 10 monclient: build_initial_monmap 2026-02-17T11:15:42.297 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.283+0000 7f79afbe6640 10 monclient: monmap: 2026-02-17T11:15:42.297 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:42.298 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:15:42.298 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:15:42.298 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:15:42.298 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:42.298 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:42.298 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:15:42.298 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:15:42.298 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:15:42.298 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:42.298 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.283+0000 7f79afbe6640 1 librados: starting msgr at 2026-02-17T11:15:42.298 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.283+0000 7f79afbe6640 1 librados: starting objecter 2026-02-17T11:15:42.298 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.283+0000 7f79afbe6640 1 Processor -- start 2026-02-17T11:15:42.299 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.283+0000 7f79afbe6640 1 -- start start 2026-02-17T11:15:42.299 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.283+0000 7f79afbe6640 1 librados: setting wanted keys 2026-02-17T11:15:42.299 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.283+0000 7f79afbe6640 1 librados: calling monclient init 2026-02-17T11:15:42.299 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.283+0000 7f79afbe6640 10 monclient: init 2026-02-17T11:15:42.299 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.283+0000 7f79afbe6640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:42.299 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.283+0000 7f79afbe6640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:15:42.299 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.283+0000 7f79afbe6640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f79a80c74c0 0x7f79a806efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:42.299 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.283+0000 7f79afbe6640 10 monclient(hunting): picked mon.noname-b con 0x7f79a80c74c0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:15:42.299 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.283+0000 7f79afbe6640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f79a80c7e20 0x7f79a8157e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:42.299 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.283+0000 7f79afbe6640 10 monclient(hunting): picked mon.noname-c con 0x7f79a80c7e20 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:15:42.299 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.283+0000 7f79afbe6640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f79a815d370 0x7f79a81f69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:42.299 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.283+0000 7f79afbe6640 10 monclient(hunting): picked mon.noname-a con 0x7f79a815d370 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:15:42.299 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.283+0000 7f79afbe6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:42.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.283+0000 7f79afbe6640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f79a80c8ed0 con 0x7f79a815d370 2026-02-17T11:15:42.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.283+0000 7f79afbe6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:42.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.283+0000 7f79afbe6640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f79a80c8bf0 con 0x7f79a80c74c0 2026-02-17T11:15:42.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.283+0000 7f79afbe6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:42.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.283+0000 7f79afbe6640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f79a80c96d0 con 0x7f79a80c7e20 2026-02-17T11:15:42.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.283+0000 7f79afbe6640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:42.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.283+0000 7f79afbe6640 10 monclient(hunting): authenticate will time out at 1418.947728s 2026-02-17T11:15:42.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.284+0000 7f79ae15c640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f79a815d370 0x7f79a81f69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:42.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.284+0000 7f79ad15a640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f79a80c7e20 0x7f79a8157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:42.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.284+0000 7f79ad95b640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f79a80c74c0 0x7f79a806efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:42.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.284+0000 7f79ae15c640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f79a815d370 0x7f79a81f69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:45260/0 (socket says 10.20.193.49:45260) 2026-02-17T11:15:42.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.284+0000 7f79ae15c640 1 -- 10.20.193.49:0/851831960 learned_addr learned my addr 10.20.193.49:0/851831960 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:42.301 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.284+0000 7f79ae15c640 10 monclient(hunting): get_auth_request con 0x7f79a815d370 auth_method 0 2026-02-17T11:15:42.301 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.284+0000 7f79ae15c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:42.301 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.284+0000 7f79ae15c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:42.301 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.284+0000 7f79ae15c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:42.301 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.284+0000 7f79ad15a640 10 monclient(hunting): get_auth_request con 0x7f79a80c7e20 auth_method 0 2026-02-17T11:15:42.301 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.284+0000 7f79ad15a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:42.301 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.284+0000 7f79ad15a640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:42.301 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.284+0000 7f79ad15a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:42.301 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.284+0000 7f79ad95b640 10 monclient(hunting): get_auth_request con 0x7f79a80c74c0 auth_method 0 2026-02-17T11:15:42.301 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.284+0000 7f79ad95b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:42.301 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.284+0000 7f79ad95b640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:42.301 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.284+0000 7f79ad95b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:42.302 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.284+0000 7f79ad15a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:42.302 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.284+0000 7f79ad15a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:42.302 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.284+0000 7f79ad15a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:42.302 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.284+0000 7f79ae15c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:42.302 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.284+0000 7f79ae15c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:42.302 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.284+0000 7f79ae15c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:42.302 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.284+0000 7f79ad95b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:42.302 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.284+0000 7f79ad95b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:42.302 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.284+0000 7f79ad95b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:42.302 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.285+0000 7f79ad15a640 10 monclient(hunting): handle_auth_done global_id 5180 payload 824 2026-02-17T11:15:42.302 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.285+0000 7f79ad15a640 1 -- 10.20.193.49:0/851831960 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f79a80c74c0 msgr2=0x7f79a806efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:42.302 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.285+0000 7f79ad15a640 1 --2- 10.20.193.49:0/851831960 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f79a80c74c0 0x7f79a806efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:42.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.285+0000 7f79ad15a640 1 -- 10.20.193.49:0/851831960 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f79a815d370 msgr2=0x7f79a81f69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:42.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.285+0000 7f79ad15a640 1 --2- 10.20.193.49:0/851831960 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f79a815d370 0x7f79a81f69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:42.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.285+0000 7f79ad15a640 10 monclient: _finish_hunting 0 2026-02-17T11:15:42.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.285+0000 7f79ad15a640 1 monclient: found mon.noname-c 2026-02-17T11:15:42.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.285+0000 7f79ad15a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:42.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.285+0000 7f79ad15a640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:15:42.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.285+0000 7f79ad15a640 1 -- 10.20.193.49:0/851831960 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79a806d720 con 0x7f79a80c7e20 2026-02-17T11:15:42.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.286+0000 7f79ad15a640 1 --2- 10.20.193.49:0/851831960 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f79a80c7e20 0x7f79a8157e20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f79a80c93c0 tx=0x7f799c0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:42.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.286+0000 7f79967fc640 10 client.?.objecter ms_handle_connect 0x7f79a80c7e20 2026-02-17T11:15:42.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.286+0000 7f79967fc640 10 client.?.objecter resend_mon_ops 2026-02-17T11:15:42.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.288+0000 7f79967fc640 1 -- 10.20.193.49:0/851831960 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f799c03c040 con 0x7f79a80c7e20 2026-02-17T11:15:42.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.288+0000 7f79967fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:42.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.288+0000 7f79967fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:15:42.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.288+0000 7f79967fc640 10 monclient: dump: 2026-02-17T11:15:42.304 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:42.304 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:42.304 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:42.304 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:42.304 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:42.304 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:42.304 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:42.304 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:42.304 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:42.304 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:42.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.288+0000 7f79967fc640 10 monclient: _finish_auth 0 2026-02-17T11:15:42.305 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.288+0000 7f79967fc640 10 monclient: _check_auth_tickets 2026-02-17T11:15:42.305 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.288+0000 7f79967fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:42.305 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.288+0000 7f79967fc640 1 -- 10.20.193.49:0/851831960 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f799c042450 con 0x7f79a80c7e20 2026-02-17T11:15:42.305 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.288+0000 7f79967fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:42.305 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.288+0000 7f79967fc640 1 -- 10.20.193.49:0/851831960 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f799c042820 con 0x7f79a80c7e20 2026-02-17T11:15:42.305 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.288+0000 7f79967fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:42.305 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.288+0000 7f79967fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:15:42.305 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.288+0000 7f79967fc640 10 monclient: dump: 2026-02-17T11:15:42.305 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:42.305 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:42.305 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:42.305 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:42.306 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:42.306 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:42.306 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:42.306 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:42.306 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:42.306 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:42.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.288+0000 7f7997fff640 4 set_mon_vals no callback set 2026-02-17T11:15:42.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.288+0000 7f79afbe6640 5 monclient: authenticate success, global_id 5180 2026-02-17T11:15:42.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.288+0000 7f79afbe6640 10 monclient: _renew_subs 2026-02-17T11:15:42.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.288+0000 7f79afbe6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:15:42.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.288+0000 7f79afbe6640 1 -- 10.20.193.49:0/851831960 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79a806da00 con 0x7f79a80c7e20 2026-02-17T11:15:42.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.288+0000 7f79afbe6640 10 client.5180.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:42.307 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.288+0000 7f79afbe6640 10 monclient: _renew_subs 2026-02-17T11:15:42.307 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.288+0000 7f79afbe6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:15:42.307 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.288+0000 7f79afbe6640 1 -- 10.20.193.49:0/851831960 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79a806dfc0 con 0x7f79a80c7e20 2026-02-17T11:15:42.307 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.288+0000 7f79afbe6640 1 librados: init done 2026-02-17T11:15:42.307 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.289+0000 7f79afbe6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:42.307 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.289+0000 7f79afbe6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:42.307 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.289+0000 7f79afbe6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:15:42.307 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.289+0000 7f79afbe6640 1 -- 10.20.193.49:0/851831960 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79a815d750 con 0x7f79a80c7e20 2026-02-17T11:15:42.400 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.397+0000 7f79967fc640 1 -- 10.20.193.49:0/851831960 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f799c0429c0 con 0x7f79a80c7e20 2026-02-17T11:15:42.400 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.398+0000 7f79967fc640 1 --2- 10.20.193.49:0/851831960 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f7978079140 0x7f797807b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:42.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.398+0000 7f79ad95b640 1 --2- 10.20.193.49:0/851831960 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f7978079140 0x7f797807b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:42.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.398+0000 7f79ad95b640 10 monclient: get_auth_request con 0x7f7978079140 auth_method 0 2026-02-17T11:15:42.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.399+0000 7f79ad95b640 1 --2- 10.20.193.49:0/851831960 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f7978079140 0x7f797807b600 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f79980051f0 tx=0x7f7998007f30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:42.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.399+0000 7f79967fc640 10 client.5180.objecter ms_handle_connect 0x7f7978079140 2026-02-17T11:15:42.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.400+0000 7f79967fc640 1 -- 10.20.193.49:0/851831960 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f799c02fa30 con 0x7f79a80c7e20 2026-02-17T11:15:42.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.400+0000 7f79967fc640 10 client.5180.objecter ms_dispatch2 0x7f79a8000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:15:42.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.400+0000 7f79967fc640 3 client.5180.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:15:42.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.400+0000 7f79967fc640 3 client.5180.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:15:42.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.400+0000 7f79967fc640 20 client.5180.objecter dump_active .. 0 homeless 2026-02-17T11:15:42.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.409+0000 7f79967fc640 1 -- 10.20.193.49:0/851831960 <== mon.2 v2:10.20.193.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f799c0876e0 con 0x7f79a80c7e20 2026-02-17T11:15:42.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.409+0000 7f79967fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:42.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.409+0000 7f79967fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:15:42.493 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.490+0000 7f79afbe6640 1 -- 10.20.193.49:0/851831960 --> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f79a815a820 con 0x7f7978079140 2026-02-17T11:15:42.494 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.492+0000 7f79967fc640 1 -- 10.20.193.49:0/851831960 <== mgr.4106 v2:10.20.193.162:6800/2614632098 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+44534 (secure 0 0 0) 0x7f79a815a820 con 0x7f7978079140 2026-02-17T11:15:42.495 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:15:42.496 INFO:teuthology.orchestra.run.trial049.stderr:dumped all 2026-02-17T11:15:42.496 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.492+0000 7f79afbe6640 10 librados: watch_flush enter 2026-02-17T11:15:42.496 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.492+0000 7f79afbe6640 10 librados: watch_flush exit 2026-02-17T11:15:42.496 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.492+0000 7f79afbe6640 20 client.5180.objecter shutdown clearing up homeless session... 2026-02-17T11:15:42.497 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.492+0000 7f79afbe6640 10 client.5180.objecter successfully canceled tick 2026-02-17T11:15:42.497 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.492+0000 7f79afbe6640 1 -- 10.20.193.49:0/851831960 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f7978079140 msgr2=0x7f797807b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:42.497 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.492+0000 7f79afbe6640 1 --2- 10.20.193.49:0/851831960 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f7978079140 0x7f797807b600 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f79980051f0 tx=0x7f7998007f30 comp rx=0 tx=0).stop 2026-02-17T11:15:42.497 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.492+0000 7f79afbe6640 10 monclient: shutdown 2026-02-17T11:15:42.497 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.492+0000 7f79afbe6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:42.497 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.492+0000 7f79afbe6640 1 -- 10.20.193.49:0/851831960 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f79a80c7e20 msgr2=0x7f79a8157e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:42.497 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.492+0000 7f79afbe6640 1 --2- 10.20.193.49:0/851831960 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f79a80c7e20 0x7f79a8157e20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f79a80c93c0 tx=0x7f799c0047c0 comp rx=0 tx=0).stop 2026-02-17T11:15:42.497 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.492+0000 7f79afbe6640 1 -- 10.20.193.49:0/851831960 shutdown_connections 2026-02-17T11:15:42.497 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.492+0000 7f79afbe6640 1 --2- 10.20.193.49:0/851831960 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f7978079140 0x7f797807b600 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:42.497 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.492+0000 7f79afbe6640 1 --2- 10.20.193.49:0/851831960 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f79a815d370 0x7f79a81f69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:42.497 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.492+0000 7f79afbe6640 1 --2- 10.20.193.49:0/851831960 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f79a80c7e20 0x7f79a8157e20 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:42.498 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.492+0000 7f79afbe6640 1 --2- 10.20.193.49:0/851831960 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f79a80c74c0 0x7f79a806efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:42.498 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.492+0000 7f79afbe6640 1 -- 10.20.193.49:0/851831960 >> 10.20.193.49:0/851831960 conn(0x7f79a80c9f20 msgr2=0x7f79a8151320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:42.498 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.492+0000 7f79afbe6640 1 -- 10.20.193.49:0/851831960 shutdown_connections 2026-02-17T11:15:42.498 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.492+0000 7f79afbe6640 1 -- 10.20.193.49:0/851831960 wait complete. 2026-02-17T11:15:42.498 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.492+0000 7f79afbe6640 1 librados: shutdown 2026-02-17T11:15:42.503 INFO:teuthology.orchestra.run.trial049.stdout:{"pg_ready":true,"pg_map":{"version":231,"stamp":"2026-02-17T11:15:40.504075+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459299,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":59,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":12,"kb":1509949440,"kb_used":438104,"kb_used_data":6680,"kb_used_omap":24,"kb_used_meta":431079,"kb_avail":1509511336,"statfs":{"total":1546188226560,"available":1545739608064,"internally_reserved":0,"allocated":6840320,"data_stored":3451878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25501,"internal_metadata":441424995},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 0 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 1 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 4 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 5 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 6 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 8 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 9 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 10 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 12 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 13 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 14 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002025"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:12:45.256474+0000","last_change":"2026-02-17T11:10:34.390486+0000","last_active":"2026-02-17T11:12:45.256474+0000","last_peered":"2026-02-17T11:12:45.256474+0000","last_clean":"2026-02-17T11:12:45.256474+0000","last_became_active":"2026-02-17T11:10:31.882486+0000","last_became_peered":"2026-02-17T11:10:31.882486+0000","last_unstale":"2026-02-17T11:12:45.256474+0000","last_undegraded":"2026-02-17T11:12:45.256474+0000","last_fullsized":"2026-02-17T11:12:45.256474+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_clean_scrub_stamp":"2026-02-17T11:10:30.447281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:57:41.179473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.031448708999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,10],"acting":[15,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:12:44.155635+0000","last_change":"2026-02-17T11:10:34.082564+0000","last_active":"2026-02-17T11:12:44.155635+0000","last_peered":"2026-02-17T11:12:44.155635+0000","last_clean":"2026-02-17T11:12:44.155635+0000","last_became_active":"2026-02-17T11:10:32.011352+0000","last_became_peered":"2026-02-17T11:10:32.011352+0000","last_unstale":"2026-02-17T11:12:44.155635+0000","last_undegraded":"2026-02-17T11:12:44.155635+0000","last_fullsized":"2026-02-17T11:12:44.155635+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_clean_scrub_stamp":"2026-02-17T11:10:30.447281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:32:07.479731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030517882999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,13],"acting":[8,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:12:40.225512+0000","last_change":"2026-02-17T11:10:34.580857+0000","last_active":"2026-02-17T11:12:40.225512+0000","last_peered":"2026-02-17T11:12:40.225512+0000","last_clean":"2026-02-17T11:12:40.225512+0000","last_became_active":"2026-02-17T11:10:31.774687+0000","last_became_peered":"2026-02-17T11:10:31.774687+0000","last_unstale":"2026-02-17T11:12:40.225512+0000","last_undegraded":"2026-02-17T11:12:40.225512+0000","last_fullsized":"2026-02-17T11:12:40.225512+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_clean_scrub_stamp":"2026-02-17T11:10:30.447281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:22:12.754481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.034911202000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4],"acting":[9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:12:39.186694+0000","last_change":"2026-02-17T11:10:34.579397+0000","last_active":"2026-02-17T11:12:39.186694+0000","last_peered":"2026-02-17T11:12:39.186694+0000","last_clean":"2026-02-17T11:12:39.186694+0000","last_became_active":"2026-02-17T11:10:31.919932+0000","last_became_peered":"2026-02-17T11:10:31.919932+0000","last_unstale":"2026-02-17T11:12:39.186694+0000","last_undegraded":"2026-02-17T11:12:39.186694+0000","last_fullsized":"2026-02-17T11:12:39.186694+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_clean_scrub_stamp":"2026-02-17T11:10:30.447281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:52:51.393067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.034931859000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"33'2","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:12:40.709325+0000","last_change":"2026-02-17T11:10:33.847595+0000","last_active":"2026-02-17T11:12:40.709325+0000","last_peered":"2026-02-17T11:12:40.709325+0000","last_clean":"2026-02-17T11:12:40.709325+0000","last_became_active":"2026-02-17T11:10:31.924469+0000","last_became_peered":"2026-02-17T11:10:31.924469+0000","last_unstale":"2026-02-17T11:12:40.709325+0000","last_undegraded":"2026-02-17T11:12:40.709325+0000","last_fullsized":"2026-02-17T11:12:40.709325+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_clean_scrub_stamp":"2026-02-17T11:10:30.447281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:39:57.389842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057723655999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,12],"acting":[3,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:12:36.274433+0000","last_change":"2026-02-17T11:10:33.798221+0000","last_active":"2026-02-17T11:12:36.274433+0000","last_peered":"2026-02-17T11:12:36.274433+0000","last_clean":"2026-02-17T11:12:36.274433+0000","last_became_active":"2026-02-17T11:10:31.972595+0000","last_became_peered":"2026-02-17T11:10:31.972595+0000","last_unstale":"2026-02-17T11:12:36.274433+0000","last_undegraded":"2026-02-17T11:12:36.274433+0000","last_fullsized":"2026-02-17T11:12:36.274433+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_clean_scrub_stamp":"2026-02-17T11:10:30.447281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:29:40.302770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038208368999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:12:35.707268+0000","last_change":"2026-02-17T11:10:33.851767+0000","last_active":"2026-02-17T11:12:35.707268+0000","last_peered":"2026-02-17T11:12:35.707268+0000","last_clean":"2026-02-17T11:12:35.707268+0000","last_became_active":"2026-02-17T11:10:31.878425+0000","last_became_peered":"2026-02-17T11:10:31.878425+0000","last_unstale":"2026-02-17T11:12:35.707268+0000","last_undegraded":"2026-02-17T11:12:35.707268+0000","last_fullsized":"2026-02-17T11:12:35.707268+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_clean_scrub_stamp":"2026-02-17T11:10:30.447281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:59:50.900049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057827870000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"31'1","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:12:36.274609+0000","last_change":"2026-02-17T11:10:33.802208+0000","last_active":"2026-02-17T11:12:36.274609+0000","last_peered":"2026-02-17T11:12:36.274609+0000","last_clean":"2026-02-17T11:12:36.274609+0000","last_became_active":"2026-02-17T11:10:31.780197+0000","last_became_peered":"2026-02-17T11:10:31.780197+0000","last_unstale":"2026-02-17T11:12:36.274609+0000","last_undegraded":"2026-02-17T11:12:36.274609+0000","last_fullsized":"2026-02-17T11:12:36.274609+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_clean_scrub_stamp":"2026-02-17T11:10:30.447281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:23:13.359463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.029469485,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,15],"acting":[14,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"1.0","version":"26'32","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:12:31.756690+0000","last_change":"2026-02-17T11:10:28.869213+0000","last_active":"2026-02-17T11:12:31.756690+0000","last_peered":"2026-02-17T11:12:31.756690+0000","last_clean":"2026-02-17T11:12:31.756690+0000","last_became_active":"2026-02-17T11:10:28.524896+0000","last_became_peered":"2026-02-17T11:10:28.524896+0000","last_unstale":"2026-02-17T11:12:31.756690+0000","last_undegraded":"2026-02-17T11:12:31.756690+0000","last_fullsized":"2026-02-17T11:12:31.756690+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:10:20.960810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:10:20.960810+0000","last_clean_scrub_stamp":"2026-02-17T11:10:20.960810+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:21:38.378078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":10,"up_from":27,"seq":115964117061,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[0,1,2,5,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 10 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":6,"up_from":27,"seq":115964117059,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":778240,"data_stored":563850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,5,7,8,9,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 6 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":12,"up_from":26,"seq":111669149763,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":166029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,7,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 12 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":4,"up_from":21,"seq":90194313283,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3,5,8,9,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 4 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":8,"up_from":21,"seq":90194313282,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5,7,9,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 8 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":1,"up_from":22,"seq":94489280579,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27332,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27589065},"hb_peers":[0,2,7,8,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 1 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":14,"up_from":23,"seq":98784247874,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3,4,5,7,8,9,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 14 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":2,"up_from":22,"seq":94489280579,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27332,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,5,7,8,9,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":15,"up_from":22,"seq":94489280579,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,2,4,5,7,8,9,10,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280578,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":778240,"data_stored":563850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[4,6,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 5 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":9,"up_from":22,"seq":94489280579,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1598,"internal_metadata":27589058},"hb_peers":[2,4,5,7,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 9 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":13,"up_from":22,"seq":94489280579,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[4,5,6,7,8,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 13 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":0,"up_from":26,"seq":111669149765,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[1,2,3,4,5,7,8,9,11,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 0 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":7,"up_from":25,"seq":107374182467,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27332,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27589067},"hb_peers":[0,4,5,6,8,9,10,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149764,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":166029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[2,4,5,6,8,9,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":11,"up_from":26,"seq":111669149764,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27332,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27589061},"hb_peers":[0,2,3,4,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:15:42.505 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:15:42.571 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.568+0000 7f832ed3e640 10 monclient: get_monmap_and_config 2026-02-17T11:15:42.571 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.568+0000 7f832ed3e640 10 monclient: build_initial_monmap 2026-02-17T11:15:42.571 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.568+0000 7f832ed3e640 10 monclient: monmap: 2026-02-17T11:15:42.572 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:42.572 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:42.572 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:15:42.570393+0000 2026-02-17T11:15:42.572 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:15:42.570393+0000 2026-02-17T11:15:42.572 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:42.572 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:42.572 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:15:42.572 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:15:42.572 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:15:42.572 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:15:42.572 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:15:42.572 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:15:42.573 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:42.575 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.569+0000 7f832ed3e640 1 Processor -- start 2026-02-17T11:15:42.576 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.569+0000 7f832ed3e640 1 -- start start 2026-02-17T11:15:42.576 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.569+0000 7f832ed3e640 10 monclient: init 2026-02-17T11:15:42.576 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.570+0000 7f832ed3e640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:42.576 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.570+0000 7f832ed3e640 10 monclient: _add_conns ranks=[2,4,1,5,3,0] 2026-02-17T11:15:42.576 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.570+0000 7f832ed3e640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f832814f280 addr v1:10.20.193.157:6789/0 2026-02-17T11:15:42.576 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.570+0000 7f832ed3e640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f832814f660 0x7f83280c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:42.576 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.570+0000 7f832ed3e640 10 monclient(hunting): picked mon.noname-b con 0x7f832814f660 addr v2:10.20.193.97:3300/0 2026-02-17T11:15:42.576 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.570+0000 7f832ed3e640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f832815abc0 addr v1:10.20.193.97:6789/0 2026-02-17T11:15:42.576 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.570+0000 7f832ed3e640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83280c7390 con 0x7f832815abc0 2026-02-17T11:15:42.576 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.570+0000 7f832ed3e640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83280c7670 con 0x7f832814f280 2026-02-17T11:15:42.577 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.570+0000 7f832ed3e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:42.577 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.570+0000 7f832ed3e640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f83280c7950 con 0x7f832814f660 2026-02-17T11:15:42.577 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.570+0000 7f832ed3e640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:42.577 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.570+0000 7f832ed3e640 10 monclient(hunting): authenticate will time out at 1419.234228s 2026-02-17T11:15:42.577 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.570+0000 7f831ffff640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f832814f660 0x7f83280c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:42.577 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.570+0000 7f832cab3640 1 --1- >> v1:10.20.193.157:6789/0 conn(0x7f832814f280 0x7f83280c7e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.157:6789/0 says I am v1:10.20.193.49:48938/0 (socket says 10.20.193.49:48938) 2026-02-17T11:15:42.577 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.570+0000 7f832cab3640 1 -- 10.20.193.49:0/1141889304 learned_addr learned my addr 10.20.193.49:0/1141889304 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:15:42.577 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.570+0000 7f831ffff640 10 monclient(hunting): get_auth_request con 0x7f832814f660 auth_method 0 2026-02-17T11:15:42.577 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.570+0000 7f831ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:42.577 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.570+0000 7f831ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:42.577 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.570+0000 7f831ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:42.577 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.571+0000 7f831ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:42.578 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.571+0000 7f831ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:42.578 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.571+0000 7f831ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:42.578 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.571+0000 7f831f7fe640 1 -- 10.20.193.49:0/1141889304 <== mon.2 v1:10.20.193.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1964292849 0 0) 0x7f83280c7670 con 0x7f832814f280 2026-02-17T11:15:42.578 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.571+0000 7f831f7fe640 10 monclient(hunting): _negotiate 2026-02-17T11:15:42.578 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.571+0000 7f831f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:42.578 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.571+0000 7f831f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:42.578 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.571+0000 7f831f7fe640 10 monclient(hunting): my global_id is 5183 2026-02-17T11:15:42.578 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.571+0000 7f831f7fe640 1 -- 10.20.193.49:0/1141889304 --> v1:10.20.193.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8314003620 con 0x7f832814f280 2026-02-17T11:15:42.578 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.572+0000 7f831ffff640 10 monclient(hunting): handle_auth_done global_id 5134 payload 274 2026-02-17T11:15:42.578 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.572+0000 7f831ffff640 1 -- 10.20.193.49:0/1141889304 >> v1:10.20.193.157:6789/0 conn(0x7f832814f280 legacy=0x7f83280c7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:42.578 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.572+0000 7f831ffff640 1 -- 10.20.193.49:0/1141889304 >> v1:10.20.193.97:6789/0 conn(0x7f832815abc0 legacy=0x7f832815afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:42.578 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.572+0000 7f831ffff640 10 monclient: _finish_hunting 0 2026-02-17T11:15:42.579 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.572+0000 7f831ffff640 1 monclient: found mon.noname-b 2026-02-17T11:15:42.579 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.572+0000 7f831ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:42.579 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.572+0000 7f831ffff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:15:42.579 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.572+0000 7f831ffff640 1 -- 10.20.193.49:0/1141889304 --> v2:10.20.193.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f832815a0e0 con 0x7f832814f660 2026-02-17T11:15:42.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.574+0000 7f831ffff640 1 --2- 10.20.193.49:0/1141889304 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f832814f660 0x7f83280c6a00 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f83100098a0 tx=0x7f831002ef00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56957e7806ef5619 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:42.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.576+0000 7f831f7fe640 1 -- 10.20.193.49:0/1141889304 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f831003c070 con 0x7f832814f660 2026-02-17T11:15:42.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.576+0000 7f831f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:42.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.576+0000 7f831f7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:15:42.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.576+0000 7f831f7fe640 10 monclient: dump: 2026-02-17T11:15:42.585 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:42.585 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:42.585 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:42.585 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:42.585 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:42.585 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:42.585 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:42.585 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:42.586 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:42.586 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:42.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.576+0000 7f831f7fe640 10 monclient: _finish_auth 0 2026-02-17T11:15:42.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.576+0000 7f831f7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:15:42.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.576+0000 7f831f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:42.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.576+0000 7f831f7fe640 1 -- 10.20.193.49:0/1141889304 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f831002fc10 con 0x7f832814f660 2026-02-17T11:15:42.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.576+0000 7f831f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:42.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.576+0000 7f832ed3e640 5 monclient: authenticate success, global_id 5134 2026-02-17T11:15:42.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.576+0000 7f831f7fe640 1 -- 10.20.193.49:0/1141889304 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8310037440 con 0x7f832814f660 2026-02-17T11:15:42.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.576+0000 7f831f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:42.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.576+0000 7f831f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:15:42.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.576+0000 7f831f7fe640 10 monclient: dump: 2026-02-17T11:15:42.587 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:42.588 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:42.588 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:42.588 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:42.588 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:42.588 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:42.588 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:42.588 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:42.589 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:42.589 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:42.589 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.576+0000 7f832ed3e640 10 monclient: get_monmap_and_config success 2026-02-17T11:15:42.589 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.576+0000 7f832ed3e640 4 set_mon_vals no callback set 2026-02-17T11:15:42.589 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.576+0000 7f832ed3e640 10 monclient: shutdown 2026-02-17T11:15:42.589 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.576+0000 7f832ed3e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:42.590 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.576+0000 7f832ed3e640 1 -- 10.20.193.49:0/1141889304 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f832814f660 msgr2=0x7f83280c6a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:42.590 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.576+0000 7f832ed3e640 1 --2- 10.20.193.49:0/1141889304 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f832814f660 0x7f83280c6a00 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f83100098a0 tx=0x7f831002ef00 comp rx=0 tx=0).stop 2026-02-17T11:15:42.590 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.576+0000 7f832ed3e640 1 -- 10.20.193.49:0/1141889304 shutdown_connections 2026-02-17T11:15:42.590 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.576+0000 7f832ed3e640 1 --2- 10.20.193.49:0/1141889304 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f832814f660 0x7f83280c6a00 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:42.590 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.576+0000 7f832ed3e640 1 -- 10.20.193.49:0/1141889304 >> 10.20.193.49:0/1141889304 conn(0x7f83280c9f20 msgr2=0x7f83280ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:42.590 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.576+0000 7f832ed3e640 1 -- 10.20.193.49:0/1141889304 shutdown_connections 2026-02-17T11:15:42.590 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.576+0000 7f832ed3e640 1 -- 10.20.193.49:0/1141889304 wait complete. 2026-02-17T11:15:42.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.577+0000 7f832ed3e640 10 monclient: build_initial_monmap 2026-02-17T11:15:42.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.577+0000 7f832ed3e640 10 monclient: monmap: 2026-02-17T11:15:42.591 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:42.591 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:15:42.591 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:15:42.591 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:15:42.592 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:42.592 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:42.592 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:15:42.592 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:15:42.592 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:15:42.592 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:42.593 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.577+0000 7f832ed3e640 1 librados: starting msgr at 2026-02-17T11:15:42.593 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.577+0000 7f832ed3e640 1 librados: starting objecter 2026-02-17T11:15:42.593 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.577+0000 7f832ed3e640 1 Processor -- start 2026-02-17T11:15:42.593 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.577+0000 7f832ed3e640 1 -- start start 2026-02-17T11:15:42.593 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.577+0000 7f832ed3e640 1 librados: setting wanted keys 2026-02-17T11:15:42.593 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.577+0000 7f832ed3e640 1 librados: calling monclient init 2026-02-17T11:15:42.593 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.577+0000 7f832ed3e640 10 monclient: init 2026-02-17T11:15:42.594 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.577+0000 7f832ed3e640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:42.594 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.577+0000 7f832ed3e640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:15:42.594 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.577+0000 7f832ed3e640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f832814f280 0x7f8328144670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:42.594 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.578+0000 7f832ed3e640 10 monclient(hunting): picked mon.noname-a con 0x7f832814f280 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:15:42.594 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.578+0000 7f832ed3e640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f832814f660 0x7f83281f4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:42.594 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.578+0000 7f832ed3e640 10 monclient(hunting): picked mon.noname-b con 0x7f832814f660 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:15:42.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.578+0000 7f832ed3e640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f832815abc0 0x7f8328073b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:42.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.578+0000 7f832ed3e640 10 monclient(hunting): picked mon.noname-c con 0x7f832815abc0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:15:42.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.578+0000 7f832ed3e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:42.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.578+0000 7f832ed3e640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f83280c9b70 con 0x7f832814f280 2026-02-17T11:15:42.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.578+0000 7f832ed3e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:42.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.578+0000 7f832ed3e640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f832815a730 con 0x7f832814f660 2026-02-17T11:15:42.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.578+0000 7f832ed3e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:42.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.578+0000 7f832ed3e640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f83280c9cf0 con 0x7f832815abc0 2026-02-17T11:15:42.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.578+0000 7f832ed3e640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:42.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.578+0000 7f832ed3e640 10 monclient(hunting): authenticate will time out at 1419.242034s 2026-02-17T11:15:42.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.578+0000 7f832cab3640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f832814f280 0x7f8328144670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:42.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.578+0000 7f831ffff640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f832814f660 0x7f83281f4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:42.597 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.578+0000 7f832d2b4640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f832815abc0 0x7f8328073b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:42.597 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.578+0000 7f832cab3640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f832814f280 0x7f8328144670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:45276/0 (socket says 10.20.193.49:45276) 2026-02-17T11:15:42.597 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.578+0000 7f832cab3640 1 -- 10.20.193.49:0/2280939159 learned_addr learned my addr 10.20.193.49:0/2280939159 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:42.597 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.578+0000 7f832cab3640 10 monclient(hunting): get_auth_request con 0x7f832814f280 auth_method 0 2026-02-17T11:15:42.597 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.578+0000 7f832cab3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:42.597 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.578+0000 7f832cab3640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:42.597 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.578+0000 7f832cab3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:42.598 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.578+0000 7f831ffff640 10 monclient(hunting): get_auth_request con 0x7f832814f660 auth_method 0 2026-02-17T11:15:42.598 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.578+0000 7f831ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:42.598 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.578+0000 7f831ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:42.598 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.578+0000 7f831ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:42.598 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.578+0000 7f832d2b4640 10 monclient(hunting): get_auth_request con 0x7f832815abc0 auth_method 0 2026-02-17T11:15:42.598 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.578+0000 7f832d2b4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:42.599 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.578+0000 7f832d2b4640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:42.599 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.578+0000 7f832d2b4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:42.599 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.578+0000 7f831ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:42.599 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.578+0000 7f831ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:42.599 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.578+0000 7f831ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:42.599 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.578+0000 7f832cab3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:42.599 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.578+0000 7f832cab3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:42.600 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.578+0000 7f832cab3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:42.600 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.578+0000 7f832d2b4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:42.600 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.578+0000 7f832d2b4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:42.600 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.579+0000 7f832d2b4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:42.600 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.580+0000 7f831ffff640 10 monclient(hunting): handle_auth_done global_id 5140 payload 824 2026-02-17T11:15:42.600 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.580+0000 7f831ffff640 1 -- 10.20.193.49:0/2280939159 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f832815abc0 msgr2=0x7f8328073b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:42.601 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.580+0000 7f831ffff640 1 --2- 10.20.193.49:0/2280939159 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f832815abc0 0x7f8328073b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:42.601 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.580+0000 7f831ffff640 1 -- 10.20.193.49:0/2280939159 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f832814f280 msgr2=0x7f8328144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:42.601 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.580+0000 7f831ffff640 1 --2- 10.20.193.49:0/2280939159 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f832814f280 0x7f8328144670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:42.601 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.580+0000 7f831ffff640 10 monclient: _finish_hunting 0 2026-02-17T11:15:42.601 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.580+0000 7f831ffff640 1 monclient: found mon.noname-b 2026-02-17T11:15:42.601 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.580+0000 7f831ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:42.602 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.580+0000 7f831ffff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:15:42.602 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.580+0000 7f831ffff640 1 -- 10.20.193.49:0/2280939159 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8328072800 con 0x7f832814f660 2026-02-17T11:15:42.602 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.581+0000 7f831ffff640 1 --2- 10.20.193.49:0/2280939159 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f832814f660 0x7f83281f4340 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8328153050 tx=0x7f83100047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:42.602 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.581+0000 7f831d7fa640 10 client.?.objecter ms_handle_connect 0x7f832814f660 2026-02-17T11:15:42.602 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.581+0000 7f831d7fa640 10 client.?.objecter resend_mon_ops 2026-02-17T11:15:42.606 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.582+0000 7f831d7fa640 1 -- 10.20.193.49:0/2280939159 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f831003c040 con 0x7f832814f660 2026-02-17T11:15:42.606 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.582+0000 7f831d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:42.606 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.582+0000 7f831d7fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:15:42.606 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.582+0000 7f831d7fa640 10 monclient: dump: 2026-02-17T11:15:42.606 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:42.606 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:42.606 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:42.607 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:42.607 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:42.607 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:42.607 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:42.607 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:42.607 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:42.607 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:42.607 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.582+0000 7f831d7fa640 10 monclient: _finish_auth 0 2026-02-17T11:15:42.608 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.582+0000 7f831d7fa640 10 monclient: _check_auth_tickets 2026-02-17T11:15:42.608 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.582+0000 7f831d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:42.608 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.582+0000 7f831d7fa640 1 -- 10.20.193.49:0/2280939159 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8310042630 con 0x7f832814f660 2026-02-17T11:15:42.608 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.582+0000 7f831d7fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:42.608 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.582+0000 7f831d7fa640 1 -- 10.20.193.49:0/2280939159 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8310042a20 con 0x7f832814f660 2026-02-17T11:15:42.608 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.582+0000 7f831d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:42.608 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.582+0000 7f831d7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:15:42.608 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.582+0000 7f831d7fa640 10 monclient: dump: 2026-02-17T11:15:42.609 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:42.609 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:42.609 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:42.609 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:42.609 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:42.609 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:42.609 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:42.610 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:42.610 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:42.610 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:42.610 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.582+0000 7f831effd640 4 set_mon_vals no callback set 2026-02-17T11:15:42.610 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.582+0000 7f832ed3e640 5 monclient: authenticate success, global_id 5140 2026-02-17T11:15:42.610 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.582+0000 7f832ed3e640 10 monclient: _renew_subs 2026-02-17T11:15:42.610 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.582+0000 7f832ed3e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:15:42.610 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.582+0000 7f832ed3e640 1 -- 10.20.193.49:0/2280939159 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8328072ae0 con 0x7f832814f660 2026-02-17T11:15:42.611 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.582+0000 7f832ed3e640 10 client.5140.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:42.611 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.582+0000 7f832ed3e640 10 monclient: _renew_subs 2026-02-17T11:15:42.611 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.582+0000 7f832ed3e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:15:42.611 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.582+0000 7f832ed3e640 1 -- 10.20.193.49:0/2280939159 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83280730a0 con 0x7f832814f660 2026-02-17T11:15:42.611 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.582+0000 7f832ed3e640 1 librados: init done 2026-02-17T11:15:42.611 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.583+0000 7f832ed3e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:42.611 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.583+0000 7f832ed3e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:42.611 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.583+0000 7f832ed3e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:15:42.612 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.583+0000 7f832ed3e640 1 -- 10.20.193.49:0/2280939159 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83280c7710 con 0x7f832814f660 2026-02-17T11:15:42.612 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.595+0000 7f831d7fa640 1 -- 10.20.193.49:0/2280939159 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f831004b450 con 0x7f832814f660 2026-02-17T11:15:42.612 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.595+0000 7f831d7fa640 1 --2- 10.20.193.49:0/2280939159 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f82f8079190 0x7f82f807b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:42.612 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.595+0000 7f832cab3640 1 --2- 10.20.193.49:0/2280939159 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f82f8079190 0x7f82f807b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:42.612 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.595+0000 7f832cab3640 10 monclient: get_auth_request con 0x7f82f8079190 auth_method 0 2026-02-17T11:15:42.612 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.596+0000 7f832cab3640 1 --2- 10.20.193.49:0/2280939159 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f82f8079190 0x7f82f807b650 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8318005980 tx=0x7f8318009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:42.612 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.596+0000 7f831d7fa640 10 client.5140.objecter ms_handle_connect 0x7f82f8079190 2026-02-17T11:15:42.650 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.648+0000 7f831d7fa640 1 -- 10.20.193.49:0/2280939159 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f831002fb50 con 0x7f832814f660 2026-02-17T11:15:42.650 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.648+0000 7f831d7fa640 10 client.5140.objecter ms_dispatch2 0x7f8328000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:15:42.650 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.648+0000 7f831d7fa640 3 client.5140.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:15:42.650 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.648+0000 7f831d7fa640 3 client.5140.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:15:42.650 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.648+0000 7f831d7fa640 20 client.5140.objecter dump_active .. 0 homeless 2026-02-17T11:15:42.703 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.701+0000 7f831d7fa640 1 -- 10.20.193.49:0/2280939159 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f83280c7710 con 0x7f832814f660 2026-02-17T11:15:42.704 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.701+0000 7f831d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:42.704 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.701+0000 7f831d7fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:15:42.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.788+0000 7f832ed3e640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:15:42.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.788+0000 7f832ed3e640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:15:42.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.788+0000 7f832ed3e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:15:42.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.788+0000 7f832ed3e640 1 -- 10.20.193.49:0/2280939159 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f832815afe0 con 0x7f832814f660 2026-02-17T11:15:42.820 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.818+0000 7f831d7fa640 1 -- 10.20.193.49:0/2280939159 <== mon.1 v2:10.20.193.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+24677 (secure 0 0 0) 0x7f83100869c0 con 0x7f832814f660 2026-02-17T11:15:42.821 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.818+0000 7f831d7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T11:15:42.821 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.818+0000 7f831d7fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:15:42.821 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:15:42.821 INFO:teuthology.orchestra.run.trial049.stdout:{"epoch":34,"fsid":"2799a57b-9ea3-46ae-8e91-1fe004a3651d","created":"2026-02-17T11:08:37.595499+0000","modified":"2026-02-17T11:10:41.640641+0000","last_up_change":"2026-02-17T11:10:25.779416+0000","last_in_change":"2026-02-17T11:08:43.985163+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T11:10:20.646344+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-17T11:10:29.823842+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":33,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":3.9900000095367432,"score_stable":3.9900000095367432,"optimal_score":0.68999999761581421,"raw_score_acting":2.75,"raw_score_stable":2.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"30bc819e-140a-433e-b860-eaa88e282a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6824","nonce":3898931472},{"type":"v1","addr":"10.20.193.49:6825","nonce":3898931472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6826","nonce":3898931472},{"type":"v1","addr":"10.20.193.49:6827","nonce":3898931472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6830","nonce":3898931472},{"type":"v1","addr":"10.20.193.49:6831","nonce":3898931472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6828","nonce":3898931472},{"type":"v1","addr":"10.20.193.49:6829","nonce":3898931472}]},"public_addr":"10.20.193.49:6825/3898931472","cluster_addr":"10.20.193.49:6827/3898931472","heartbeat_back_addr":"10.20.193.49:6831/3898931472","heartbeat_front_addr":"10.20.193.49:6829/3898931472","state":["exists","up"]},{"osd":1,"uuid":"2f7f1f11-f256-4094-82a9-5d21882e6e0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6816","nonce":4259563897},{"type":"v1","addr":"10.20.193.97:6817","nonce":4259563897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6818","nonce":4259563897},{"type":"v1","addr":"10.20.193.97:6819","nonce":4259563897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6822","nonce":4259563897},{"type":"v1","addr":"10.20.193.97:6823","nonce":4259563897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6820","nonce":4259563897},{"type":"v1","addr":"10.20.193.97:6821","nonce":4259563897}]},"public_addr":"10.20.193.97:6817/4259563897","cluster_addr":"10.20.193.97:6819/4259563897","heartbeat_back_addr":"10.20.193.97:6823/4259563897","heartbeat_front_addr":"10.20.193.97:6821/4259563897","state":["exists","up"]},{"osd":2,"uuid":"26bd1274-fe52-42cb-876b-df9920880f95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6816","nonce":1377516118},{"type":"v1","addr":"10.20.193.157:6817","nonce":1377516118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6818","nonce":1377516118},{"type":"v1","addr":"10.20.193.157:6819","nonce":1377516118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6822","nonce":1377516118},{"type":"v1","addr":"10.20.193.157:6823","nonce":1377516118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6820","nonce":1377516118},{"type":"v1","addr":"10.20.193.157:6821","nonce":1377516118}]},"public_addr":"10.20.193.157:6817/1377516118","cluster_addr":"10.20.193.157:6819/1377516118","heartbeat_back_addr":"10.20.193.157:6823/1377516118","heartbeat_front_addr":"10.20.193.157:6821/1377516118","state":["exists","up"]},{"osd":3,"uuid":"c78a5263-3b0d-4b22-a848-bcd6a1e4f6b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6818","nonce":1543573918},{"type":"v1","addr":"10.20.193.162:6820","nonce":1543573918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6822","nonce":1543573918},{"type":"v1","addr":"10.20.193.162:6824","nonce":1543573918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6830","nonce":1543573918},{"type":"v1","addr":"10.20.193.162:6832","nonce":1543573918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6826","nonce":1543573918},{"type":"v1","addr":"10.20.193.162:6828","nonce":1543573918}]},"public_addr":"10.20.193.162:6820/1543573918","cluster_addr":"10.20.193.162:6824/1543573918","heartbeat_back_addr":"10.20.193.162:6832/1543573918","heartbeat_front_addr":"10.20.193.162:6828/1543573918","state":["exists","up"]},{"osd":4,"uuid":"f0fdfadd-2f39-4ad8-ac88-cb588c5e8ee0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6808","nonce":2238942007},{"type":"v1","addr":"10.20.193.49:6809","nonce":2238942007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6810","nonce":2238942007},{"type":"v1","addr":"10.20.193.49:6811","nonce":2238942007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6816","nonce":2238942007},{"type":"v1","addr":"10.20.193.49:6817","nonce":2238942007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6813","nonce":2238942007},{"type":"v1","addr":"10.20.193.49:6815","nonce":2238942007}]},"public_addr":"10.20.193.49:6809/2238942007","cluster_addr":"10.20.193.49:6811/2238942007","heartbeat_back_addr":"10.20.193.49:6817/2238942007","heartbeat_front_addr":"10.20.193.49:6815/2238942007","state":["exists","up"]},{"osd":5,"uuid":"65872639-d6c0-482d-95d1-1d9f250781c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6800","nonce":3226749558},{"type":"v1","addr":"10.20.193.97:6801","nonce":3226749558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6802","nonce":3226749558},{"type":"v1","addr":"10.20.193.97:6803","nonce":3226749558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6806","nonce":3226749558},{"type":"v1","addr":"10.20.193.97:6807","nonce":3226749558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6804","nonce":3226749558},{"type":"v1","addr":"10.20.193.97:6805","nonce":3226749558}]},"public_addr":"10.20.193.97:6801/3226749558","cluster_addr":"10.20.193.97:6803/3226749558","heartbeat_back_addr":"10.20.193.97:6807/3226749558","heartbeat_front_addr":"10.20.193.97:6805/3226749558","state":["exists","up"]},{"osd":6,"uuid":"43091d3e-638d-4462-867b-cade02a315e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6800","nonce":815989681},{"type":"v1","addr":"10.20.193.157:6801","nonce":815989681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6802","nonce":815989681},{"type":"v1","addr":"10.20.193.157:6803","nonce":815989681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6806","nonce":815989681},{"type":"v1","addr":"10.20.193.157:6807","nonce":815989681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6804","nonce":815989681},{"type":"v1","addr":"10.20.193.157:6805","nonce":815989681}]},"public_addr":"10.20.193.157:6801/815989681","cluster_addr":"10.20.193.157:6803/815989681","heartbeat_back_addr":"10.20.193.157:6807/815989681","heartbeat_front_addr":"10.20.193.157:6805/815989681","state":["exists","up"]},{"osd":7,"uuid":"890ae4d6-33c9-4515-a896-a689647330dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6806","nonce":2715110678},{"type":"v1","addr":"10.20.193.162:6808","nonce":2715110678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6812","nonce":2715110678},{"type":"v1","addr":"10.20.193.162:6813","nonce":2715110678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6816","nonce":2715110678},{"type":"v1","addr":"10.20.193.162:6817","nonce":2715110678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6814","nonce":2715110678},{"type":"v1","addr":"10.20.193.162:6815","nonce":2715110678}]},"public_addr":"10.20.193.162:6808/2715110678","cluster_addr":"10.20.193.162:6813/2715110678","heartbeat_back_addr":"10.20.193.162:6817/2715110678","heartbeat_front_addr":"10.20.193.162:6815/2715110678","state":["exists","up"]},{"osd":8,"uuid":"f04abc9b-ed75-4582-b47d-07a9890f52bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6800","nonce":1386770137},{"type":"v1","addr":"10.20.193.49:6801","nonce":1386770137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6802","nonce":1386770137},{"type":"v1","addr":"10.20.193.49:6803","nonce":1386770137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6806","nonce":1386770137},{"type":"v1","addr":"10.20.193.49:6807","nonce":1386770137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6804","nonce":1386770137},{"type":"v1","addr":"10.20.193.49:6805","nonce":1386770137}]},"public_addr":"10.20.193.49:6801/1386770137","cluster_addr":"10.20.193.49:6803/1386770137","heartbeat_back_addr":"10.20.193.49:6807/1386770137","heartbeat_front_addr":"10.20.193.49:6805/1386770137","state":["exists","up"]},{"osd":9,"uuid":"7dfbb00a-6b89-4de3-9f30-6aadd91b4408","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6808","nonce":676086260},{"type":"v1","addr":"10.20.193.97:6809","nonce":676086260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6810","nonce":676086260},{"type":"v1","addr":"10.20.193.97:6811","nonce":676086260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6814","nonce":676086260},{"type":"v1","addr":"10.20.193.97:6815","nonce":676086260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6812","nonce":676086260},{"type":"v1","addr":"10.20.193.97:6813","nonce":676086260}]},"public_addr":"10.20.193.97:6809/676086260","cluster_addr":"10.20.193.97:6811/676086260","heartbeat_back_addr":"10.20.193.97:6815/676086260","heartbeat_front_addr":"10.20.193.97:6813/676086260","state":["exists","up"]},{"osd":10,"uuid":"e497a4fd-a944-489b-9cb3-30f5acaeb53e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6808","nonce":3711386099},{"type":"v1","addr":"10.20.193.157:6809","nonce":3711386099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6810","nonce":3711386099},{"type":"v1","addr":"10.20.193.157:6811","nonce":3711386099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6814","nonce":3711386099},{"type":"v1","addr":"10.20.193.157:6815","nonce":3711386099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6812","nonce":3711386099},{"type":"v1","addr":"10.20.193.157:6813","nonce":3711386099}]},"public_addr":"10.20.193.157:6809/3711386099","cluster_addr":"10.20.193.157:6811/3711386099","heartbeat_back_addr":"10.20.193.157:6815/3711386099","heartbeat_front_addr":"10.20.193.157:6813/3711386099","state":["exists","up"]},{"osd":11,"uuid":"7371d50f-36f9-477d-8d4d-853f481dd6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6802","nonce":3400543064},{"type":"v1","addr":"10.20.193.162:6803","nonce":3400543064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6804","nonce":3400543064},{"type":"v1","addr":"10.20.193.162:6805","nonce":3400543064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6810","nonce":3400543064},{"type":"v1","addr":"10.20.193.162:6811","nonce":3400543064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6807","nonce":3400543064},{"type":"v1","addr":"10.20.193.162:6809","nonce":3400543064}]},"public_addr":"10.20.193.162:6803/3400543064","cluster_addr":"10.20.193.162:6805/3400543064","heartbeat_back_addr":"10.20.193.162:6811/3400543064","heartbeat_front_addr":"10.20.193.162:6809/3400543064","state":["exists","up"]},{"osd":12,"uuid":"3cf4fded-49db-4d95-956b-77acc868a3ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6812","nonce":4012737431},{"type":"v1","addr":"10.20.193.49:6814","nonce":4012737431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6818","nonce":4012737431},{"type":"v1","addr":"10.20.193.49:6819","nonce":4012737431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6822","nonce":4012737431},{"type":"v1","addr":"10.20.193.49:6823","nonce":4012737431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6820","nonce":4012737431},{"type":"v1","addr":"10.20.193.49:6821","nonce":4012737431}]},"public_addr":"10.20.193.49:6814/4012737431","cluster_addr":"10.20.193.49:6819/4012737431","heartbeat_back_addr":"10.20.193.49:6823/4012737431","heartbeat_front_addr":"10.20.193.49:6821/4012737431","state":["exists","up"]},{"osd":13,"uuid":"7dc53473-594f-4cfb-8444-eab205e2e0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6824","nonce":409145483},{"type":"v1","addr":"10.20.193.97:6825","nonce":409145483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6826","nonce":409145483},{"type":"v1","addr":"10.20.193.97:6827","nonce":409145483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6830","nonce":409145483},{"type":"v1","addr":"10.20.193.97:6831","nonce":409145483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.97:6828","nonce":409145483},{"type":"v1","addr":"10.20.193.97:6829","nonce":409145483}]},"public_addr":"10.20.193.97:6825/409145483","cluster_addr":"10.20.193.97:6827/409145483","heartbeat_back_addr":"10.20.193.97:6831/409145483","heartbeat_front_addr":"10.20.193.97:6829/409145483","state":["exists","up"]},{"osd":14,"uuid":"e8ab3e8f-29a8-4c79-bf86-d29543aac56a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6824","nonce":404726964},{"type":"v1","addr":"10.20.193.157:6825","nonce":404726964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6826","nonce":404726964},{"type":"v1","addr":"10.20.193.157:6827","nonce":404726964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6830","nonce":404726964},{"type":"v1","addr":"10.20.193.157:6831","nonce":404726964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6828","nonce":404726964},{"type":"v1","addr":"10.20.193.157:6829","nonce":404726964}]},"public_addr":"10.20.193.157:6825/404726964","cluster_addr":"10.20.193.157:6827/404726964","heartbeat_back_addr":"10.20.193.157:6831/404726964","heartbeat_front_addr":"10.20.193.157:6829/404726964","state":["exists","up"]},{"osd":15,"uuid":"300a4696-aa54-4b47-b9f3-87dec719bcfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6819","nonce":3057705174},{"type":"v1","addr":"10.20.193.162:6821","nonce":3057705174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6823","nonce":3057705174},{"type":"v1","addr":"10.20.193.162:6825","nonce":3057705174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6831","nonce":3057705174},{"type":"v1","addr":"10.20.193.162:6833","nonce":3057705174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6827","nonce":3057705174},{"type":"v1","addr":"10.20.193.162:6829","nonce":3057705174}]},"public_addr":"10.20.193.162:6821/3057705174","cluster_addr":"10.20.193.162:6825/3057705174","heartbeat_back_addr":"10.20.193.162:6833/3057705174","heartbeat_front_addr":"10.20.193.162:6829/3057705174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:18.201964+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:17.998817+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:18.526566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:18.016485+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:17.449438+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:18.134204+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:19.177012+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:17.496419+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:17.321828+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:18.265266+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:19.587499+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:17.978701+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:18.041032+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:18.477125+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:19.577746+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:10:18.096729+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:15:42.822 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.819+0000 7f832ed3e640 10 librados: watch_flush enter 2026-02-17T11:15:42.822 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.819+0000 7f832ed3e640 10 librados: watch_flush exit 2026-02-17T11:15:42.822 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.819+0000 7f832ed3e640 20 client.5140.objecter shutdown clearing up homeless session... 2026-02-17T11:15:42.822 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.819+0000 7f832ed3e640 10 client.5140.objecter successfully canceled tick 2026-02-17T11:15:42.822 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.819+0000 7f832ed3e640 1 -- 10.20.193.49:0/2280939159 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f82f8079190 msgr2=0x7f82f807b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:42.822 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.819+0000 7f832ed3e640 1 --2- 10.20.193.49:0/2280939159 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f82f8079190 0x7f82f807b650 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8318005980 tx=0x7f8318009040 comp rx=0 tx=0).stop 2026-02-17T11:15:42.822 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.819+0000 7f832ed3e640 10 monclient: shutdown 2026-02-17T11:15:42.822 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.819+0000 7f832ed3e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:42.822 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.819+0000 7f832ed3e640 1 -- 10.20.193.49:0/2280939159 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f832814f660 msgr2=0x7f83281f4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:42.822 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.819+0000 7f832ed3e640 1 --2- 10.20.193.49:0/2280939159 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f832814f660 0x7f83281f4340 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8328153050 tx=0x7f83100047c0 comp rx=0 tx=0).stop 2026-02-17T11:15:42.822 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.820+0000 7f832ed3e640 1 -- 10.20.193.49:0/2280939159 shutdown_connections 2026-02-17T11:15:42.822 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.820+0000 7f832ed3e640 1 --2- 10.20.193.49:0/2280939159 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f82f8079190 0x7f82f807b650 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:42.822 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.820+0000 7f832ed3e640 1 --2- 10.20.193.49:0/2280939159 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f832815abc0 0x7f8328073b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:42.822 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.820+0000 7f832ed3e640 1 --2- 10.20.193.49:0/2280939159 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f832814f660 0x7f83281f4340 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:42.822 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.820+0000 7f832ed3e640 1 --2- 10.20.193.49:0/2280939159 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f832814f280 0x7f8328144670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:42.822 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.820+0000 7f832ed3e640 1 -- 10.20.193.49:0/2280939159 >> 10.20.193.49:0/2280939159 conn(0x7f83280c9f20 msgr2=0x7f8328149b50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:42.822 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.820+0000 7f832ed3e640 1 -- 10.20.193.49:0/2280939159 shutdown_connections 2026-02-17T11:15:42.822 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.820+0000 7f832ed3e640 1 -- 10.20.193.49:0/2280939159 wait complete. 2026-02-17T11:15:42.822 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:42.820+0000 7f832ed3e640 1 librados: shutdown 2026-02-17T11:15:43.832 INFO:tasks.ceph:Scrubbing osd.0 2026-02-17T11:15:43.832 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-02-17T11:15:43.901 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.899+0000 7fae7ff53640 10 monclient: get_monmap_and_config 2026-02-17T11:15:43.901 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.899+0000 7fae7ff53640 10 monclient: build_initial_monmap 2026-02-17T11:15:43.901 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.899+0000 7fae7ff53640 10 monclient: monmap: 2026-02-17T11:15:43.901 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:43.901 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:43.902 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:15:43.900836+0000 2026-02-17T11:15:43.902 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:15:43.900836+0000 2026-02-17T11:15:43.902 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:43.902 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:43.902 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:15:43.902 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:15:43.902 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:15:43.902 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:15:43.902 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:15:43.902 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:15:43.902 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:43.903 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.899+0000 7fae7ff53640 1 Processor -- start 2026-02-17T11:15:43.903 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.899+0000 7fae7ff53640 1 -- start start 2026-02-17T11:15:43.903 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.899+0000 7fae7ff53640 10 monclient: init 2026-02-17T11:15:43.903 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.900+0000 7fae7ff53640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:43.903 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.900+0000 7fae7ff53640 10 monclient: _add_conns ranks=[0,5,1,2,3,4] 2026-02-17T11:15:43.904 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.900+0000 7fae7ff53640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fae7815d3c0 addr v1:10.20.193.49:6789/0 2026-02-17T11:15:43.904 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.900+0000 7fae7ff53640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7fae780c94c0 0x7fae7815d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:43.904 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.900+0000 7fae7ff53640 10 monclient(hunting): picked mon.noname-c con 0x7fae780c94c0 addr v2:10.20.193.157:3300/0 2026-02-17T11:15:43.904 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.900+0000 7fae7ff53640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fae7815b050 addr v1:10.20.193.97:6789/0 2026-02-17T11:15:43.904 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.900+0000 7fae7ff53640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae7815b4e0 con 0x7fae7815d3c0 2026-02-17T11:15:43.904 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.900+0000 7fae7ff53640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae780c7e60 con 0x7fae7815b050 2026-02-17T11:15:43.904 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.900+0000 7fae7ff53640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:43.904 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.900+0000 7fae7ff53640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7fae780c8140 con 0x7fae780c94c0 2026-02-17T11:15:43.904 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.900+0000 7fae7ff53640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:43.904 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.900+0000 7fae7ff53640 10 monclient(hunting): authenticate will time out at 1420.564327s 2026-02-17T11:15:43.904 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.900+0000 7fae7dcc8640 1 --1- >> v1:10.20.193.49:6789/0 conn(0x7fae7815d3c0 0x7fae780c7300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.49:6789/0 says I am v1:10.20.193.49:46122/0 (socket says 10.20.193.49:46122) 2026-02-17T11:15:43.904 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.900+0000 7fae7dcc8640 1 -- 10.20.193.49:0/1831900952 learned_addr learned my addr 10.20.193.49:0/1831900952 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:15:43.904 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.900+0000 7fae7d4c7640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7fae780c94c0 0x7fae7815d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:43.904 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.900+0000 7fae7d4c7640 10 monclient(hunting): get_auth_request con 0x7fae780c94c0 auth_method 0 2026-02-17T11:15:43.904 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.900+0000 7fae7d4c7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:43.904 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.900+0000 7fae7d4c7640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:43.904 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.900+0000 7fae7d4c7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:43.904 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.901+0000 7fae7d4c7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:43.904 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.901+0000 7fae7d4c7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:43.904 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.901+0000 7fae7d4c7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:43.905 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.901+0000 7fae7ccc6640 1 -- 10.20.193.49:0/1831900952 <== mon.0 v1:10.20.193.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2540946777 0 0) 0x7fae7815b4e0 con 0x7fae7815d3c0 2026-02-17T11:15:43.906 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.901+0000 7fae7ccc6640 10 monclient(hunting): _negotiate 2026-02-17T11:15:43.906 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.901+0000 7fae7ccc6640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:43.906 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.901+0000 7fae7ccc6640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:43.906 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.901+0000 7fae7ccc6640 10 monclient(hunting): my global_id is 5166 2026-02-17T11:15:43.906 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.901+0000 7fae7ccc6640 1 -- 10.20.193.49:0/1831900952 --> v1:10.20.193.49:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae60003620 con 0x7fae7815d3c0 2026-02-17T11:15:43.906 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.902+0000 7fae7ccc6640 1 -- 10.20.193.49:0/1831900952 <== mon.1 v1:10.20.193.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1884324533 0 0) 0x7fae780c7e60 con 0x7fae7815b050 2026-02-17T11:15:43.906 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.902+0000 7fae7ccc6640 10 monclient(hunting): _negotiate 2026-02-17T11:15:43.906 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.902+0000 7fae7ccc6640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:43.906 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.902+0000 7fae7ccc6640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:43.906 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.902+0000 7fae7ccc6640 10 monclient(hunting): my global_id is 5143 2026-02-17T11:15:43.906 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.902+0000 7fae7ccc6640 1 -- 10.20.193.49:0/1831900952 --> v1:10.20.193.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae7815b4e0 con 0x7fae7815b050 2026-02-17T11:15:43.906 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.902+0000 7fae7d4c7640 10 monclient(hunting): handle_auth_done global_id 5189 payload 274 2026-02-17T11:15:43.906 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.902+0000 7fae7d4c7640 1 -- 10.20.193.49:0/1831900952 >> v1:10.20.193.97:6789/0 conn(0x7fae7815b050 legacy=0x7fae780c52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:43.906 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.902+0000 7fae7d4c7640 1 -- 10.20.193.49:0/1831900952 >> v1:10.20.193.49:6789/0 conn(0x7fae7815d3c0 legacy=0x7fae780c7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:43.906 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.902+0000 7fae7d4c7640 10 monclient: _finish_hunting 0 2026-02-17T11:15:43.906 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.902+0000 7fae7d4c7640 1 monclient: found mon.noname-c 2026-02-17T11:15:43.906 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.902+0000 7fae7d4c7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:43.906 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.902+0000 7fae7d4c7640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:15:43.906 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.902+0000 7fae7d4c7640 1 -- 10.20.193.49:0/1831900952 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae780c8420 con 0x7fae780c94c0 2026-02-17T11:15:43.906 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.903+0000 7fae7d4c7640 1 --2- 10.20.193.49:0/1831900952 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fae780c94c0 0x7fae7815d7a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fae6c0098a0 tx=0x7fae6c02ef90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b61c96a1458f8a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:43.908 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.905+0000 7fae7ccc6640 1 -- 10.20.193.49:0/1831900952 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae6c03c070 con 0x7fae780c94c0 2026-02-17T11:15:43.908 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.905+0000 7fae7ccc6640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:43.908 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.905+0000 7fae7ccc6640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:15:43.908 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.905+0000 7fae7ccc6640 10 monclient: dump: 2026-02-17T11:15:43.908 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:43.908 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:43.908 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:43.908 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:43.908 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:43.908 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:43.908 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:43.909 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:43.909 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:43.909 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:43.909 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.905+0000 7fae7ccc6640 10 monclient: _finish_auth 0 2026-02-17T11:15:43.909 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.905+0000 7fae7ccc6640 10 monclient: _check_auth_tickets 2026-02-17T11:15:43.909 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.905+0000 7fae7ccc6640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:43.909 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.905+0000 7fae7ccc6640 1 -- 10.20.193.49:0/1831900952 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae6c02fca0 con 0x7fae780c94c0 2026-02-17T11:15:43.909 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.905+0000 7fae7ccc6640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:43.909 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.905+0000 7fae7ccc6640 1 -- 10.20.193.49:0/1831900952 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae6c037660 con 0x7fae780c94c0 2026-02-17T11:15:43.909 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.905+0000 7fae7ccc6640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:43.909 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.905+0000 7fae7ccc6640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:15:43.909 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.905+0000 7fae7ccc6640 10 monclient: dump: 2026-02-17T11:15:43.909 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:43.909 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:43.909 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:43.909 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:43.909 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:43.909 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:43.909 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:43.909 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:43.909 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:43.909 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:43.910 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.905+0000 7fae7ff53640 5 monclient: authenticate success, global_id 5189 2026-02-17T11:15:43.910 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.905+0000 7fae7ff53640 10 monclient: get_monmap_and_config success 2026-02-17T11:15:43.910 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.905+0000 7fae7ff53640 4 set_mon_vals no callback set 2026-02-17T11:15:43.910 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.905+0000 7fae7ff53640 10 monclient: shutdown 2026-02-17T11:15:43.910 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.905+0000 7fae7ff53640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:43.910 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.905+0000 7fae7ff53640 1 -- 10.20.193.49:0/1831900952 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fae780c94c0 msgr2=0x7fae7815d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:43.910 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.905+0000 7fae7ff53640 1 --2- 10.20.193.49:0/1831900952 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fae780c94c0 0x7fae7815d7a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fae6c0098a0 tx=0x7fae6c02ef90 comp rx=0 tx=0).stop 2026-02-17T11:15:43.910 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.905+0000 7fae7ff53640 1 -- 10.20.193.49:0/1831900952 shutdown_connections 2026-02-17T11:15:43.910 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.905+0000 7fae7ff53640 1 --2- 10.20.193.49:0/1831900952 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fae780c94c0 0x7fae7815d7a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:43.910 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.905+0000 7fae7ff53640 1 -- 10.20.193.49:0/1831900952 >> 10.20.193.49:0/1831900952 conn(0x7fae780c9f60 msgr2=0x7fae780ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:43.910 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.905+0000 7fae7ff53640 1 -- 10.20.193.49:0/1831900952 shutdown_connections 2026-02-17T11:15:43.910 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.905+0000 7fae7ff53640 1 -- 10.20.193.49:0/1831900952 wait complete. 2026-02-17T11:15:43.910 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.905+0000 7fae7ff53640 10 monclient: build_initial_monmap 2026-02-17T11:15:43.910 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.905+0000 7fae7ff53640 10 monclient: monmap: 2026-02-17T11:15:43.910 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:43.910 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:15:43.910 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:15:43.910 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:15:43.910 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:43.910 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:43.910 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:15:43.910 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:15:43.910 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:15:43.911 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:43.911 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.906+0000 7fae7ff53640 1 librados: starting msgr at 2026-02-17T11:15:43.911 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.906+0000 7fae7ff53640 1 librados: starting objecter 2026-02-17T11:15:43.911 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.906+0000 7fae7ff53640 1 Processor -- start 2026-02-17T11:15:43.911 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.906+0000 7fae7ff53640 1 -- start start 2026-02-17T11:15:43.911 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.906+0000 7fae7ff53640 1 librados: setting wanted keys 2026-02-17T11:15:43.911 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.906+0000 7fae7ff53640 1 librados: calling monclient init 2026-02-17T11:15:43.911 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.906+0000 7fae7ff53640 10 monclient: init 2026-02-17T11:15:43.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.906+0000 7fae7ff53640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:43.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.906+0000 7fae7ff53640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:15:43.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.906+0000 7fae7ff53640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fae780c94c0 0x7fae78159fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:43.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.906+0000 7fae7ff53640 10 monclient(hunting): picked mon.noname-c con 0x7fae780c94c0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:15:43.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.906+0000 7fae7ff53640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fae7815b050 0x7fae781f27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:43.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.906+0000 7fae7ff53640 10 monclient(hunting): picked mon.noname-a con 0x7fae7815b050 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:15:43.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.906+0000 7fae7ff53640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fae7815d3c0 0x7fae781f2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:43.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.906+0000 7fae7ff53640 10 monclient(hunting): picked mon.noname-b con 0x7fae7815d3c0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:15:43.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.906+0000 7fae7ff53640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:43.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.906+0000 7fae7ff53640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fae780c8cc0 con 0x7fae7815b050 2026-02-17T11:15:43.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.906+0000 7fae7ff53640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:43.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.906+0000 7fae7ff53640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fae780c89e0 con 0x7fae7815d3c0 2026-02-17T11:15:43.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.906+0000 7fae7ff53640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:43.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.906+0000 7fae7ff53640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fae780c8fa0 con 0x7fae780c94c0 2026-02-17T11:15:43.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.906+0000 7fae7ff53640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:43.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.906+0000 7fae7ff53640 10 monclient(hunting): authenticate will time out at 1420.570819s 2026-02-17T11:15:43.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.907+0000 7fae7d4c7640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fae7815b050 0x7fae781f27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:43.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.907+0000 7fae7dcc8640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fae780c94c0 0x7fae78159fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:43.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.907+0000 7fae7e4c9640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fae7815d3c0 0x7fae781f2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:43.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.907+0000 7fae7d4c7640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fae7815b050 0x7fae781f27e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:45282/0 (socket says 10.20.193.49:45282) 2026-02-17T11:15:43.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.907+0000 7fae7d4c7640 1 -- 10.20.193.49:0/3289335425 learned_addr learned my addr 10.20.193.49:0/3289335425 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:43.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.907+0000 7fae7d4c7640 10 monclient(hunting): get_auth_request con 0x7fae7815b050 auth_method 0 2026-02-17T11:15:43.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.907+0000 7fae7d4c7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:43.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.907+0000 7fae7d4c7640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:43.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.907+0000 7fae7d4c7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:43.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.907+0000 7fae7dcc8640 10 monclient(hunting): get_auth_request con 0x7fae780c94c0 auth_method 0 2026-02-17T11:15:43.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.907+0000 7fae7dcc8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:43.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.907+0000 7fae7dcc8640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:43.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.907+0000 7fae7dcc8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:43.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.907+0000 7fae7e4c9640 10 monclient(hunting): get_auth_request con 0x7fae7815d3c0 auth_method 0 2026-02-17T11:15:43.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.907+0000 7fae7e4c9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:43.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.907+0000 7fae7e4c9640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:43.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.907+0000 7fae7e4c9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:43.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.907+0000 7fae7d4c7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:43.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.907+0000 7fae7d4c7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:43.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.907+0000 7fae7d4c7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:43.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.907+0000 7fae7dcc8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:43.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.907+0000 7fae7dcc8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:43.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.907+0000 7fae7dcc8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:43.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.907+0000 7fae7e4c9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:43.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.907+0000 7fae7e4c9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:43.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.907+0000 7fae7e4c9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:43.915 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.908+0000 7fae7d4c7640 10 monclient(hunting): handle_auth_done global_id 5169 payload 824 2026-02-17T11:15:43.915 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.908+0000 7fae7d4c7640 1 -- 10.20.193.49:0/3289335425 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fae780c94c0 msgr2=0x7fae78159fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:43.915 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.908+0000 7fae7d4c7640 1 --2- 10.20.193.49:0/3289335425 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fae780c94c0 0x7fae78159fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:43.915 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.908+0000 7fae7d4c7640 1 -- 10.20.193.49:0/3289335425 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fae7815d3c0 msgr2=0x7fae781f2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:43.915 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.908+0000 7fae7d4c7640 1 --2- 10.20.193.49:0/3289335425 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fae7815d3c0 0x7fae781f2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:43.915 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.908+0000 7fae7d4c7640 10 monclient: _finish_hunting 0 2026-02-17T11:15:43.915 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.908+0000 7fae7d4c7640 1 monclient: found mon.noname-a 2026-02-17T11:15:43.915 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.908+0000 7fae7d4c7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:43.915 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.908+0000 7fae7d4c7640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:15:43.915 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.908+0000 7fae7d4c7640 1 -- 10.20.193.49:0/3289335425 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae781467b0 con 0x7fae7815b050 2026-02-17T11:15:43.915 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.909+0000 7fae7d4c7640 1 --2- 10.20.193.49:0/3289335425 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fae7815b050 0x7fae781f27e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fae6c03a040 tx=0x7fae6c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:43.915 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.909+0000 7fae667fc640 10 client.?.objecter ms_handle_connect 0x7fae7815b050 2026-02-17T11:15:43.915 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.909+0000 7fae667fc640 10 client.?.objecter resend_mon_ops 2026-02-17T11:15:43.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.911+0000 7fae667fc640 1 -- 10.20.193.49:0/3289335425 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae6c046020 con 0x7fae7815b050 2026-02-17T11:15:43.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.911+0000 7fae667fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:43.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.911+0000 7fae667fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:15:43.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.911+0000 7fae667fc640 10 monclient: dump: 2026-02-17T11:15:43.916 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:43.916 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:43.916 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:43.916 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:43.916 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:43.916 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:43.916 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:43.916 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:43.916 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:43.916 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:43.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.911+0000 7fae667fc640 10 monclient: _finish_auth 0 2026-02-17T11:15:43.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.911+0000 7fae667fc640 10 monclient: _check_auth_tickets 2026-02-17T11:15:43.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.911+0000 7fae667fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:43.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.911+0000 7fae667fc640 1 -- 10.20.193.49:0/3289335425 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae6c02fe50 con 0x7fae7815b050 2026-02-17T11:15:43.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.911+0000 7fae667fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:43.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.911+0000 7fae667fc640 1 -- 10.20.193.49:0/3289335425 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae6c03c040 con 0x7fae7815b050 2026-02-17T11:15:43.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.911+0000 7fae667fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:43.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.911+0000 7fae667fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:15:43.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.911+0000 7fae667fc640 10 monclient: dump: 2026-02-17T11:15:43.917 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:43.917 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:43.917 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:43.917 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:43.917 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:43.917 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:43.917 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:43.917 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:43.917 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:43.917 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:43.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.911+0000 7fae67fff640 4 set_mon_vals no callback set 2026-02-17T11:15:43.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.911+0000 7fae7ff53640 5 monclient: authenticate success, global_id 5169 2026-02-17T11:15:43.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.911+0000 7fae7ff53640 10 monclient: _renew_subs 2026-02-17T11:15:43.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.911+0000 7fae7ff53640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:43.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.911+0000 7fae7ff53640 1 -- 10.20.193.49:0/3289335425 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae78146a50 con 0x7fae7815b050 2026-02-17T11:15:43.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.911+0000 7fae7ff53640 10 client.5169.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:43.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.911+0000 7fae7ff53640 10 monclient: _renew_subs 2026-02-17T11:15:43.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.911+0000 7fae7ff53640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:43.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.911+0000 7fae7ff53640 1 -- 10.20.193.49:0/3289335425 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae78147010 con 0x7fae7815b050 2026-02-17T11:15:43.918 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.911+0000 7fae7ff53640 1 librados: init done 2026-02-17T11:15:43.918 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.912+0000 7fae7ff53640 10 client.5169.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:43.918 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.912+0000 7fae7ff53640 15 client.5169.objecter _session_command_op_assign -1 1 2026-02-17T11:15:43.918 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.912+0000 7fae7ff53640 20 client.5169.objecter _get_session osd=-1 returning homeless 2026-02-17T11:15:43.918 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.912+0000 7fae7ff53640 10 client.5169.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:43.918 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.912+0000 7fae7ff53640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:43.918 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.912+0000 7fae7ff53640 1 -- 10.20.193.49:0/3289335425 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fae781478b0 con 0x7fae7815b050 2026-02-17T11:15:43.925 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.923+0000 7fae667fc640 1 -- 10.20.193.49:0/3289335425 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7fae6c04a3b0 con 0x7fae7815b050 2026-02-17T11:15:43.925 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.923+0000 7fae667fc640 1 --2- 10.20.193.49:0/3289335425 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fae48079140 0x7fae4807b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:43.926 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.923+0000 7fae7dcc8640 1 --2- 10.20.193.49:0/3289335425 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fae48079140 0x7fae4807b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:43.926 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.923+0000 7fae7dcc8640 10 monclient: get_auth_request con 0x7fae48079140 auth_method 0 2026-02-17T11:15:43.926 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.924+0000 7fae7dcc8640 1 --2- 10.20.193.49:0/3289335425 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fae48079140 0x7fae4807b600 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fae68005980 tx=0x7fae68009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:43.926 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.924+0000 7fae667fc640 10 client.5169.objecter ms_handle_connect 0x7fae48079140 2026-02-17T11:15:43.928 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.925+0000 7fae667fc640 1 -- 10.20.193.49:0/3289335425 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7fae6c0bc600 con 0x7fae7815b050 2026-02-17T11:15:43.928 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.925+0000 7fae667fc640 10 client.5169.objecter ms_dispatch2 0x7fae78000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:15:43.928 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.925+0000 7fae667fc640 3 client.5169.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:15:43.928 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.925+0000 7fae667fc640 3 client.5169.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:15:43.928 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.925+0000 7fae667fc640 10 client.5169.objecter checking command 1 2026-02-17T11:15:43.928 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.925+0000 7fae667fc640 1 --2- 10.20.193.49:0/3289335425 >> [v2:10.20.193.49:6824/3898931472,v1:10.20.193.49:6825/3898931472] conn(0x7fae48081620 0x7fae48083a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:43.928 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.925+0000 7fae667fc640 20 client.5169.objecter _get_session s=0x7fae48080f50 osd=0 3 2026-02-17T11:15:43.928 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.925+0000 7fae667fc640 20 client.5169.objecter put_session s=0x7fae48080f50 osd=0 3 2026-02-17T11:15:43.928 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.925+0000 7fae667fc640 15 client.5169.objecter _session_command_op_remove -1 1 2026-02-17T11:15:43.928 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.925+0000 7fae667fc640 20 client.5169.objecter _get_session s=0x7fae48080f50 osd=0 3 2026-02-17T11:15:43.928 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.925+0000 7fae667fc640 20 client.5169.objecter get_session s=0x7fae48080f50 osd=0 3 2026-02-17T11:15:43.928 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.925+0000 7fae667fc640 15 client.5169.objecter _session_command_op_assign 0 1 2026-02-17T11:15:43.928 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.925+0000 7fae667fc640 20 client.5169.objecter put_session s=0x7fae48080f50 osd=0 4 2026-02-17T11:15:43.929 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.925+0000 7fae667fc640 10 client.5169.objecter _send_command 1 2026-02-17T11:15:43.929 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.925+0000 7fae667fc640 1 -- 10.20.193.49:0/3289335425 --> [v2:10.20.193.49:6824/3898931472,v1:10.20.193.49:6825/3898931472] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fae6c0068f0 con 0x7fae48081620 2026-02-17T11:15:43.929 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.925+0000 7fae667fc640 20 client.5169.objecter dump_active .. 0 homeless 2026-02-17T11:15:43.929 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.926+0000 7fae7e4c9640 1 --2- 10.20.193.49:0/3289335425 >> [v2:10.20.193.49:6824/3898931472,v1:10.20.193.49:6825/3898931472] conn(0x7fae48081620 0x7fae48083a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:43.929 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.926+0000 7fae7e4c9640 10 monclient: get_auth_request con 0x7fae48081620 auth_method 0 2026-02-17T11:15:43.929 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.926+0000 7fae667fc640 1 -- 10.20.193.49:0/3289335425 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fae6c083140 con 0x7fae7815b050 2026-02-17T11:15:43.929 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.926+0000 7fae667fc640 10 monclient: handle_get_version_reply finishing 1 version 34 2026-02-17T11:15:43.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.927+0000 7fae7e4c9640 1 --2- 10.20.193.49:0/3289335425 >> [v2:10.20.193.49:6824/3898931472,v1:10.20.193.49:6825/3898931472] conn(0x7fae48081620 0x7fae48083a40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:43.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.927+0000 7fae667fc640 10 client.5169.objecter ms_handle_connect 0x7fae48081620 2026-02-17T11:15:43.940 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.938+0000 7fae667fc640 1 -- 10.20.193.49:0/3289335425 <== osd.0 v2:10.20.193.49:6824/3898931472 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fae6c0068f0 con 0x7fae48081620 2026-02-17T11:15:43.940 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.938+0000 7fae667fc640 10 client.5169.objecter ms_dispatch2 0x7fae78000b90 command_reply(tid 1: 0 ) 2026-02-17T11:15:43.941 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.938+0000 7fae667fc640 10 client.5169.objecter _finish_command 1 = system:0 2026-02-17T11:15:43.941 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.938+0000 7fae667fc640 20 client.5169.objecter put_session s=0x7fae48080f50 osd=0 4 2026-02-17T11:15:43.941 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.938+0000 7fae667fc640 15 client.5169.objecter _session_command_op_remove 0 1 2026-02-17T11:15:43.947 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.945+0000 7fae7ff53640 10 client.5169.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T11:15:43.947 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.945+0000 7fae7ff53640 15 client.5169.objecter _session_command_op_assign -1 2 2026-02-17T11:15:43.947 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.945+0000 7fae7ff53640 20 client.5169.objecter _get_session s=0x7fae48080f50 osd=0 3 2026-02-17T11:15:43.947 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.945+0000 7fae7ff53640 20 client.5169.objecter put_session s=0x7fae48080f50 osd=0 3 2026-02-17T11:15:43.947 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.945+0000 7fae7ff53640 20 client.5169.objecter _get_session s=0x7fae48080f50 osd=0 3 2026-02-17T11:15:43.947 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.945+0000 7fae7ff53640 15 client.5169.objecter _session_command_op_remove -1 2 2026-02-17T11:15:43.947 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.945+0000 7fae7ff53640 20 client.5169.objecter get_session s=0x7fae48080f50 osd=0 3 2026-02-17T11:15:43.947 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.945+0000 7fae7ff53640 15 client.5169.objecter _session_command_op_assign 0 2 2026-02-17T11:15:43.947 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.945+0000 7fae7ff53640 20 client.5169.objecter put_session s=0x7fae48080f50 osd=0 4 2026-02-17T11:15:43.947 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.945+0000 7fae7ff53640 10 client.5169.objecter _send_command 2 2026-02-17T11:15:43.947 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.945+0000 7fae7ff53640 1 -- 10.20.193.49:0/3289335425 --> [v2:10.20.193.49:6824/3898931472,v1:10.20.193.49:6825/3898931472] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fae7815d7a0 con 0x7fae48081620 2026-02-17T11:15:43.955 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.953+0000 7fae667fc640 1 -- 10.20.193.49:0/3289335425 <== osd.0 v2:10.20.193.49:6824/3898931472 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fae7815d7a0 con 0x7fae48081620 2026-02-17T11:15:43.955 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.953+0000 7fae667fc640 10 client.5169.objecter ms_dispatch2 0x7fae78000b90 command_reply(tid 2: 0 ) 2026-02-17T11:15:43.955 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.953+0000 7fae667fc640 10 client.5169.objecter _finish_command 2 = system:0 2026-02-17T11:15:43.955 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.953+0000 7fae667fc640 20 client.5169.objecter put_session s=0x7fae48080f50 osd=0 4 2026-02-17T11:15:43.955 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.953+0000 7fae667fc640 15 client.5169.objecter _session_command_op_remove 0 2 2026-02-17T11:15:43.955 INFO:teuthology.orchestra.run.trial049.stdout:{ 2026-02-17T11:15:43.955 INFO:teuthology.orchestra.run.trial049.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T11:15:43.955 INFO:teuthology.orchestra.run.trial049.stdout:} 2026-02-17T11:15:43.956 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.953+0000 7fae7ff53640 10 librados: watch_flush enter 2026-02-17T11:15:43.956 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.953+0000 7fae7ff53640 10 librados: watch_flush exit 2026-02-17T11:15:43.956 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.953+0000 7fae7ff53640 10 client.5169.objecter close_session for osd.0 2026-02-17T11:15:43.956 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.953+0000 7fae7ff53640 1 -- 10.20.193.49:0/3289335425 >> [v2:10.20.193.49:6824/3898931472,v1:10.20.193.49:6825/3898931472] conn(0x7fae48081620 msgr2=0x7fae48083a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:43.956 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.953+0000 7fae7ff53640 1 --2- 10.20.193.49:0/3289335425 >> [v2:10.20.193.49:6824/3898931472,v1:10.20.193.49:6825/3898931472] conn(0x7fae48081620 0x7fae48083a40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:43.956 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.953+0000 7fae7ff53640 20 client.5169.objecter put_session s=0x7fae48080f50 osd=0 1 2026-02-17T11:15:43.956 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.953+0000 7fae7ff53640 20 client.5169.objecter shutdown clearing up homeless session... 2026-02-17T11:15:43.956 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.953+0000 7fae7ff53640 10 client.5169.objecter successfully canceled tick 2026-02-17T11:15:43.956 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.953+0000 7fae7ff53640 1 -- 10.20.193.49:0/3289335425 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fae48079140 msgr2=0x7fae4807b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:43.956 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.953+0000 7fae7ff53640 1 --2- 10.20.193.49:0/3289335425 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fae48079140 0x7fae4807b600 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fae68005980 tx=0x7fae68009040 comp rx=0 tx=0).stop 2026-02-17T11:15:43.956 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.953+0000 7fae7ff53640 10 monclient: shutdown 2026-02-17T11:15:43.956 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.953+0000 7fae7ff53640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:43.956 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.953+0000 7fae7ff53640 1 -- 10.20.193.49:0/3289335425 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fae7815b050 msgr2=0x7fae781f27e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:43.956 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.953+0000 7fae7ff53640 1 --2- 10.20.193.49:0/3289335425 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fae7815b050 0x7fae781f27e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fae6c03a040 tx=0x7fae6c0047c0 comp rx=0 tx=0).stop 2026-02-17T11:15:43.956 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.953+0000 7fae7e4c9640 1 -- 10.20.193.49:0/3289335425 reap_dead start 2026-02-17T11:15:43.956 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.953+0000 7fae7ff53640 1 -- 10.20.193.49:0/3289335425 shutdown_connections 2026-02-17T11:15:43.956 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.953+0000 7fae7ff53640 1 -- 10.20.193.49:0/3289335425 >> 10.20.193.49:0/3289335425 conn(0x7fae780c9f60 msgr2=0x7fae7814ed50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:43.956 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.953+0000 7fae7ff53640 1 -- 10.20.193.49:0/3289335425 shutdown_connections 2026-02-17T11:15:43.956 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.953+0000 7fae7ff53640 1 -- 10.20.193.49:0/3289335425 wait complete. 2026-02-17T11:15:43.956 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:43.953+0000 7fae7ff53640 1 librados: shutdown 2026-02-17T11:15:43.962 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-02-17T11:15:44.030 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.028+0000 7f8271a40640 10 monclient: get_monmap_and_config 2026-02-17T11:15:44.031 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.028+0000 7f8271a40640 10 monclient: build_initial_monmap 2026-02-17T11:15:44.031 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.028+0000 7f8271a40640 10 monclient: monmap: 2026-02-17T11:15:44.031 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:44.031 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:44.031 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:15:44.029766+0000 2026-02-17T11:15:44.031 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:15:44.029766+0000 2026-02-17T11:15:44.031 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:44.031 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:44.032 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:15:44.032 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:15:44.032 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:15:44.032 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:15:44.032 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:15:44.032 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:15:44.032 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:44.035 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.028+0000 7f8271a40640 1 Processor -- start 2026-02-17T11:15:44.035 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.028+0000 7f8271a40640 1 -- start start 2026-02-17T11:15:44.035 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.028+0000 7f8271a40640 10 monclient: init 2026-02-17T11:15:44.035 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.029+0000 7f8271a40640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:44.036 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.029+0000 7f8271a40640 10 monclient: _add_conns ranks=[2,5,3,0,1,4] 2026-02-17T11:15:44.036 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.029+0000 7f8271a40640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f826c0686b0 addr v1:10.20.193.157:6789/0 2026-02-17T11:15:44.036 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.029+0000 7f8271a40640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f826c06f700 0x7f826c068a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:44.036 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.029+0000 7f8271a40640 10 monclient(hunting): picked mon.noname-c con 0x7f826c06f700 addr v2:10.20.193.157:3300/0 2026-02-17T11:15:44.036 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.029+0000 7f8271a40640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f826c15be30 0x7f826c155ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:44.036 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.029+0000 7f8271a40640 10 monclient(hunting): picked mon.noname-a con 0x7f826c15be30 addr v2:10.20.193.49:3300/0 2026-02-17T11:15:44.036 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.029+0000 7f8271a40640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f826c15cd30 con 0x7f826c0686b0 2026-02-17T11:15:44.036 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.029+0000 7f8271a40640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:44.036 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.029+0000 7f8271a40640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f826c15c490 con 0x7f826c15be30 2026-02-17T11:15:44.036 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.029+0000 7f8271a40640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:44.036 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.029+0000 7f8271a40640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f826c15c770 con 0x7f826c06f700 2026-02-17T11:15:44.037 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.029+0000 7f8271a40640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:44.037 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.029+0000 7f8271a40640 10 monclient(hunting): authenticate will time out at 1420.693470s 2026-02-17T11:15:44.037 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.029+0000 7f826a7fc640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f826c06f700 0x7f826c068a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:44.037 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.029+0000 7f826b7fe640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f826c15be30 0x7f826c155ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:44.037 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.030+0000 7f826a7fc640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f826c06f700 0x7f826c068a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:51762/0 (socket says 10.20.193.49:51762) 2026-02-17T11:15:44.037 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.030+0000 7f826a7fc640 1 -- 10.20.193.49:0/2852489958 learned_addr learned my addr 10.20.193.49:0/2852489958 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:44.037 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.030+0000 7f826a7fc640 10 monclient(hunting): get_auth_request con 0x7f826c06f700 auth_method 0 2026-02-17T11:15:44.037 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.030+0000 7f826a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:44.037 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.030+0000 7f826a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:44.037 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.030+0000 7f826a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:44.037 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.030+0000 7f826b7fe640 10 monclient(hunting): get_auth_request con 0x7f826c15be30 auth_method 0 2026-02-17T11:15:44.037 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.030+0000 7f826b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:44.037 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.030+0000 7f826b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:44.038 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.030+0000 7f826b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:44.038 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.030+0000 7f826b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:44.038 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.030+0000 7f826b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:44.038 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.030+0000 7f826b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:44.038 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.030+0000 7f826a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:44.038 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.030+0000 7f826a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:44.038 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.030+0000 7f826a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:44.038 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.031+0000 7f826b7fe640 10 monclient(hunting): handle_auth_done global_id 5172 payload 274 2026-02-17T11:15:44.038 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.031+0000 7f826b7fe640 1 -- 10.20.193.49:0/2852489958 >> v2:10.20.193.157:3300/0 conn(0x7f826c06f700 msgr2=0x7f826c068a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:15:44.038 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.031+0000 7f826b7fe640 1 --2- 10.20.193.49:0/2852489958 >> v2:10.20.193.157:3300/0 conn(0x7f826c06f700 0x7f826c068a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:44.038 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.031+0000 7f826b7fe640 1 -- 10.20.193.49:0/2852489958 >> v1:10.20.193.157:6789/0 conn(0x7f826c0686b0 legacy=0x7f826c06eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:44.038 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.031+0000 7f826b7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:15:44.039 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.031+0000 7f826b7fe640 1 monclient: found mon.noname-a 2026-02-17T11:15:44.039 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.031+0000 7f826b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:44.039 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.031+0000 7f826b7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:15:44.039 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.031+0000 7f826b7fe640 1 -- 10.20.193.49:0/2852489958 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f826c15ca50 con 0x7f826c15be30 2026-02-17T11:15:44.039 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.032+0000 7f826b7fe640 1 --2- 10.20.193.49:0/2852489958 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f826c15be30 0x7f826c155ae0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f826c072490 tx=0x7f825c02f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52137796afd3efca server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:44.045 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.034+0000 7f8269ffb640 1 -- 10.20.193.49:0/2852489958 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f825c03c070 con 0x7f826c15be30 2026-02-17T11:15:44.046 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.034+0000 7f8269ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:44.046 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.034+0000 7f8269ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:15:44.046 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.034+0000 7f8269ffb640 10 monclient: dump: 2026-02-17T11:15:44.046 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:44.046 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:44.046 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:44.046 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:44.046 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:44.046 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:44.046 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:44.046 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:44.047 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:44.047 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:44.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.034+0000 7f8269ffb640 10 monclient: _finish_auth 0 2026-02-17T11:15:44.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.034+0000 7f8269ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:15:44.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.034+0000 7f8269ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:44.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.034+0000 7f8269ffb640 1 -- 10.20.193.49:0/2852489958 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f825c037440 con 0x7f826c15be30 2026-02-17T11:15:44.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.034+0000 7f8271a40640 5 monclient: authenticate success, global_id 5172 2026-02-17T11:15:44.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.034+0000 7f8271a40640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:15:44.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.034+0000 7f8269ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:44.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.034+0000 7f8269ffb640 1 -- 10.20.193.49:0/2852489958 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f825c037810 con 0x7f826c15be30 2026-02-17T11:15:44.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.034+0000 7f8271a40640 10 monclient: get_monmap_and_config success 2026-02-17T11:15:44.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.034+0000 7f8271a40640 4 set_mon_vals no callback set 2026-02-17T11:15:44.047 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.034+0000 7f8269ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:44.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.034+0000 7f8269ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:15:44.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.034+0000 7f8269ffb640 10 monclient: dump: 2026-02-17T11:15:44.048 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:44.048 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:44.048 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:44.048 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:44.048 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:44.048 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:44.048 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:44.048 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:44.048 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:44.048 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:44.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.034+0000 7f8271a40640 10 monclient: shutdown 2026-02-17T11:15:44.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.034+0000 7f8271a40640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:44.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.034+0000 7f8271a40640 1 -- 10.20.193.49:0/2852489958 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f826c15be30 msgr2=0x7f826c155ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:44.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.034+0000 7f8271a40640 1 --2- 10.20.193.49:0/2852489958 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f826c15be30 0x7f826c155ae0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f826c072490 tx=0x7f825c02f1c0 comp rx=0 tx=0).stop 2026-02-17T11:15:44.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.034+0000 7f8271a40640 1 -- 10.20.193.49:0/2852489958 shutdown_connections 2026-02-17T11:15:44.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.034+0000 7f8271a40640 1 --2- 10.20.193.49:0/2852489958 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f826c15be30 0x7f826c155ae0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:44.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.034+0000 7f8271a40640 1 --2- 10.20.193.49:0/2852489958 >> v2:10.20.193.157:3300/0 conn(0x7f826c06f700 0x7f826c068a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:44.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.034+0000 7f8271a40640 1 -- 10.20.193.49:0/2852489958 >> 10.20.193.49:0/2852489958 conn(0x7f826c0cb3a0 msgr2=0x7f826c0cb7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:44.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.034+0000 7f8271a40640 1 -- 10.20.193.49:0/2852489958 shutdown_connections 2026-02-17T11:15:44.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.034+0000 7f8271a40640 1 -- 10.20.193.49:0/2852489958 wait complete. 2026-02-17T11:15:44.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.035+0000 7f8271a40640 10 monclient: build_initial_monmap 2026-02-17T11:15:44.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.035+0000 7f8271a40640 10 monclient: monmap: 2026-02-17T11:15:44.049 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:44.049 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:15:44.049 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:15:44.050 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:15:44.050 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:44.050 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:44.050 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:15:44.050 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:15:44.050 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:15:44.050 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:44.050 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.035+0000 7f8271a40640 1 librados: starting msgr at 2026-02-17T11:15:44.050 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.035+0000 7f8271a40640 1 librados: starting objecter 2026-02-17T11:15:44.050 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.035+0000 7f8271a40640 1 Processor -- start 2026-02-17T11:15:44.050 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.035+0000 7f8271a40640 1 -- start start 2026-02-17T11:15:44.050 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.035+0000 7f8271a40640 1 librados: setting wanted keys 2026-02-17T11:15:44.050 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.035+0000 7f8271a40640 1 librados: calling monclient init 2026-02-17T11:15:44.050 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.035+0000 7f8271a40640 10 monclient: init 2026-02-17T11:15:44.051 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.036+0000 7f8271a40640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:44.051 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.036+0000 7f8271a40640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:15:44.051 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.036+0000 7f8271a40640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f826c0686b0 0x7f826c0c7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:44.051 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.036+0000 7f8271a40640 10 monclient(hunting): picked mon.noname-a con 0x7f826c0686b0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:15:44.051 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.036+0000 7f8271a40640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f826c06f700 0x7f826c1537e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:44.051 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.036+0000 7f8271a40640 10 monclient(hunting): picked mon.noname-b con 0x7f826c06f700 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:15:44.051 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.036+0000 7f8271a40640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f826c15be30 0x7f826c1f5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:44.051 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.036+0000 7f8271a40640 10 monclient(hunting): picked mon.noname-c con 0x7f826c15be30 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:15:44.051 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.036+0000 7f8271a40640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:44.051 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.036+0000 7f8271a40640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f826c156020 con 0x7f826c0686b0 2026-02-17T11:15:44.051 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.036+0000 7f8271a40640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:44.051 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.036+0000 7f8271a40640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f826c06ead0 con 0x7f826c06f700 2026-02-17T11:15:44.051 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.036+0000 7f8271a40640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:44.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.036+0000 7f8271a40640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f826c1561a0 con 0x7f826c15be30 2026-02-17T11:15:44.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.036+0000 7f8271a40640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:44.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.036+0000 7f8271a40640 10 monclient(hunting): authenticate will time out at 1420.700136s 2026-02-17T11:15:44.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.036+0000 7f826affd640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f826c0686b0 0x7f826c0c7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:44.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.036+0000 7f826affd640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f826c0686b0 0x7f826c0c7bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:45306/0 (socket says 10.20.193.49:45306) 2026-02-17T11:15:44.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.036+0000 7f826affd640 1 -- 10.20.193.49:0/2708999421 learned_addr learned my addr 10.20.193.49:0/2708999421 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:44.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.036+0000 7f826affd640 10 monclient(hunting): get_auth_request con 0x7f826c0686b0 auth_method 0 2026-02-17T11:15:44.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.036+0000 7f826affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:44.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.036+0000 7f826affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:44.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.036+0000 7f826affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:44.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.036+0000 7f826a7fc640 1 --2- 10.20.193.49:0/2708999421 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f826c06f700 0x7f826c1537e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:44.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.036+0000 7f826b7fe640 1 --2- 10.20.193.49:0/2708999421 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f826c15be30 0x7f826c1f5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:44.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.036+0000 7f826b7fe640 10 monclient(hunting): get_auth_request con 0x7f826c15be30 auth_method 0 2026-02-17T11:15:44.052 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.036+0000 7f826b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:44.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.036+0000 7f826b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:44.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.036+0000 7f826b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:44.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.036+0000 7f826a7fc640 10 monclient(hunting): get_auth_request con 0x7f826c06f700 auth_method 0 2026-02-17T11:15:44.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.036+0000 7f826a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:44.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.036+0000 7f826a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:44.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.036+0000 7f826a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:44.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.036+0000 7f826affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:44.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.036+0000 7f826affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:44.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.036+0000 7f826affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:44.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.037+0000 7f826b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:44.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.037+0000 7f826b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:44.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.037+0000 7f826b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:44.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.037+0000 7f826a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:44.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.037+0000 7f826a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:44.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.037+0000 7f826a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:44.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.038+0000 7f826a7fc640 10 monclient(hunting): handle_auth_done global_id 5149 payload 824 2026-02-17T11:15:44.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.038+0000 7f826a7fc640 1 -- 10.20.193.49:0/2708999421 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f826c15be30 msgr2=0x7f826c1f5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:44.054 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.038+0000 7f826a7fc640 1 --2- 10.20.193.49:0/2708999421 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f826c15be30 0x7f826c1f5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:44.054 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.038+0000 7f826a7fc640 1 -- 10.20.193.49:0/2708999421 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f826c0686b0 msgr2=0x7f826c0c7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:44.054 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.038+0000 7f826a7fc640 1 --2- 10.20.193.49:0/2708999421 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f826c0686b0 0x7f826c0c7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:44.054 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.038+0000 7f826a7fc640 10 monclient: _finish_hunting 0 2026-02-17T11:15:44.054 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.038+0000 7f826a7fc640 1 monclient: found mon.noname-b 2026-02-17T11:15:44.054 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.038+0000 7f826a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:44.054 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.038+0000 7f826a7fc640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:15:44.054 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.038+0000 7f826a7fc640 1 -- 10.20.193.49:0/2708999421 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f826c1f46a0 con 0x7f826c06f700 2026-02-17T11:15:44.054 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.039+0000 7f826a7fc640 1 --2- 10.20.193.49:0/2708999421 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f826c06f700 0x7f826c1537e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8254006dc0 tx=0x7f825400ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:44.054 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.039+0000 7f8243fff640 10 client.?.objecter ms_handle_connect 0x7f826c06f700 2026-02-17T11:15:44.054 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.039+0000 7f8243fff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:15:44.054 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.040+0000 7f8243fff640 1 -- 10.20.193.49:0/2708999421 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8254017070 con 0x7f826c06f700 2026-02-17T11:15:44.054 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.040+0000 7f8243fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:44.054 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.040+0000 7f8243fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:15:44.054 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.040+0000 7f8243fff640 10 monclient: dump: 2026-02-17T11:15:44.054 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:44.055 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:44.055 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:44.055 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:44.055 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:44.055 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:44.055 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:44.055 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:44.055 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:44.055 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:44.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.040+0000 7f8243fff640 10 monclient: _finish_auth 0 2026-02-17T11:15:44.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.040+0000 7f8243fff640 10 monclient: _check_auth_tickets 2026-02-17T11:15:44.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.040+0000 7f8243fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:44.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.040+0000 7f8271a40640 5 monclient: authenticate success, global_id 5149 2026-02-17T11:15:44.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.040+0000 7f8271a40640 10 monclient: _renew_subs 2026-02-17T11:15:44.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.040+0000 7f8271a40640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:15:44.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.040+0000 7f8271a40640 1 -- 10.20.193.49:0/2708999421 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f826c1f4fc0 con 0x7f826c06f700 2026-02-17T11:15:44.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.040+0000 7f8271a40640 10 client.5149.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:44.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.040+0000 7f8271a40640 10 monclient: _renew_subs 2026-02-17T11:15:44.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.040+0000 7f8271a40640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:15:44.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.040+0000 7f8271a40640 1 -- 10.20.193.49:0/2708999421 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f826c1f5580 con 0x7f826c06f700 2026-02-17T11:15:44.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.040+0000 7f8271a40640 1 librados: init done 2026-02-17T11:15:44.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.041+0000 7f8271a40640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:44.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.041+0000 7f8271a40640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:44.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.041+0000 7f8271a40640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:15:44.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.041+0000 7f8271a40640 1 -- 10.20.193.49:0/2708999421 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f826c068a90 con 0x7f826c06f700 2026-02-17T11:15:44.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.041+0000 7f8243fff640 1 -- 10.20.193.49:0/2708999421 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8254005a90 con 0x7f826c06f700 2026-02-17T11:15:44.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.041+0000 7f8243fff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:44.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.041+0000 7f8243fff640 1 -- 10.20.193.49:0/2708999421 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8254021060 con 0x7f826c06f700 2026-02-17T11:15:44.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.041+0000 7f8243fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:44.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.041+0000 7f8243fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:15:44.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.041+0000 7f82697fa640 4 set_mon_vals no callback set 2026-02-17T11:15:44.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.041+0000 7f8243fff640 10 monclient: dump: 2026-02-17T11:15:44.056 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:44.056 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:44.056 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:44.057 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:44.057 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:44.057 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:44.057 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:44.057 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:44.057 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:44.057 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:44.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.146+0000 7f8243fff640 1 -- 10.20.193.49:0/2708999421 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f8254024060 con 0x7f826c06f700 2026-02-17T11:15:44.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.147+0000 7f8243fff640 1 --2- 10.20.193.49:0/2708999421 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f823c079140 0x7f823c07b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:44.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.147+0000 7f826affd640 1 --2- 10.20.193.49:0/2708999421 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f823c079140 0x7f823c07b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:44.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.147+0000 7f826affd640 10 monclient: get_auth_request con 0x7f823c079140 auth_method 0 2026-02-17T11:15:44.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.148+0000 7f8243fff640 10 client.5149.objecter ms_handle_connect 0x7f823c079140 2026-02-17T11:15:44.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.148+0000 7f826affd640 1 --2- 10.20.193.49:0/2708999421 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f823c079140 0x7f823c07b600 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f82600055f0 tx=0x7f8260002990 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:44.151 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.148+0000 7f8243fff640 1 -- 10.20.193.49:0/2708999421 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f8254097dd0 con 0x7f826c06f700 2026-02-17T11:15:44.151 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.148+0000 7f8243fff640 10 client.5149.objecter ms_dispatch2 0x7f826c000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:15:44.151 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.148+0000 7f8243fff640 3 client.5149.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:15:44.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.148+0000 7f8243fff640 3 client.5149.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:15:44.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.148+0000 7f8243fff640 20 client.5149.objecter dump_active .. 0 homeless 2026-02-17T11:15:44.157 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.154+0000 7f8243fff640 1 -- 10.20.193.49:0/2708999421 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f82540622f0 con 0x7f826c06f700 2026-02-17T11:15:44.157 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.154+0000 7f8243fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:44.157 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.154+0000 7f8243fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:15:44.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.239+0000 7f8271a40640 1 -- 10.20.193.49:0/2708999421 --> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f826c06fda0 con 0x7f823c079140 2026-02-17T11:15:44.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.240+0000 7f8243fff640 1 -- 10.20.193.49:0/2708999421 <== mgr.4106 v2:10.20.193.162:6800/2614632098 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f826c06fda0 con 0x7f823c079140 2026-02-17T11:15:44.243 INFO:teuthology.orchestra.run.trial049.stderr:instructed osd(s) 0 to deep-scrub 2026-02-17T11:15:44.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.240+0000 7f8271a40640 10 librados: watch_flush enter 2026-02-17T11:15:44.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.240+0000 7f8271a40640 10 librados: watch_flush exit 2026-02-17T11:15:44.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.240+0000 7f8271a40640 20 client.5149.objecter shutdown clearing up homeless session... 2026-02-17T11:15:44.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.240+0000 7f8271a40640 10 client.5149.objecter successfully canceled tick 2026-02-17T11:15:44.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.240+0000 7f8271a40640 1 -- 10.20.193.49:0/2708999421 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f823c079140 msgr2=0x7f823c07b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:44.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.240+0000 7f8271a40640 1 --2- 10.20.193.49:0/2708999421 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f823c079140 0x7f823c07b600 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f82600055f0 tx=0x7f8260002990 comp rx=0 tx=0).stop 2026-02-17T11:15:44.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.240+0000 7f8271a40640 10 monclient: shutdown 2026-02-17T11:15:44.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.240+0000 7f8271a40640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:44.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.240+0000 7f8271a40640 1 -- 10.20.193.49:0/2708999421 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f826c06f700 msgr2=0x7f826c1537e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:44.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.240+0000 7f8271a40640 1 --2- 10.20.193.49:0/2708999421 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f826c06f700 0x7f826c1537e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8254006dc0 tx=0x7f825400ed70 comp rx=0 tx=0).stop 2026-02-17T11:15:44.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.241+0000 7f8271a40640 1 -- 10.20.193.49:0/2708999421 shutdown_connections 2026-02-17T11:15:44.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.241+0000 7f8271a40640 1 --2- 10.20.193.49:0/2708999421 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f823c079140 0x7f823c07b600 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:44.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.241+0000 7f8271a40640 1 --2- 10.20.193.49:0/2708999421 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f826c15be30 0x7f826c1f5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:44.245 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.241+0000 7f8271a40640 1 --2- 10.20.193.49:0/2708999421 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f826c06f700 0x7f826c1537e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:44.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.241+0000 7f8271a40640 1 --2- 10.20.193.49:0/2708999421 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f826c0686b0 0x7f826c0c7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:44.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.241+0000 7f8271a40640 1 -- 10.20.193.49:0/2708999421 >> 10.20.193.49:0/2708999421 conn(0x7f826c0cb3a0 msgr2=0x7f826c1547b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:44.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.241+0000 7f8271a40640 1 -- 10.20.193.49:0/2708999421 shutdown_connections 2026-02-17T11:15:44.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.241+0000 7f8271a40640 1 -- 10.20.193.49:0/2708999421 wait complete. 2026-02-17T11:15:44.246 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.241+0000 7f8271a40640 1 librados: shutdown 2026-02-17T11:15:44.251 INFO:tasks.ceph:Scrubbing osd.4 2026-02-17T11:15:44.251 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2026-02-17T11:15:44.318 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.316+0000 7ff1d0787640 10 monclient: get_monmap_and_config 2026-02-17T11:15:44.318 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.316+0000 7ff1d0787640 10 monclient: build_initial_monmap 2026-02-17T11:15:44.319 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.316+0000 7ff1d0787640 10 monclient: monmap: 2026-02-17T11:15:44.319 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:44.319 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:44.319 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:15:44.317633+0000 2026-02-17T11:15:44.319 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:15:44.317633+0000 2026-02-17T11:15:44.319 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:44.319 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:44.319 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:15:44.320 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:15:44.320 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:15:44.320 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:15:44.320 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:15:44.320 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:15:44.320 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:44.323 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.316+0000 7ff1d0787640 1 Processor -- start 2026-02-17T11:15:44.323 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.316+0000 7ff1d0787640 1 -- start start 2026-02-17T11:15:44.323 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.316+0000 7ff1d0787640 10 monclient: init 2026-02-17T11:15:44.323 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.317+0000 7ff1d0787640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:44.324 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.317+0000 7ff1d0787640 10 monclient: _add_conns ranks=[1,4,5,0,3,2] 2026-02-17T11:15:44.324 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.317+0000 7ff1d0787640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7ff1c8153930 addr v1:10.20.193.97:6789/0 2026-02-17T11:15:44.324 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.317+0000 7ff1d0787640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7ff1c8153d10 0x7ff1c80c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:44.324 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.317+0000 7ff1d0787640 10 monclient(hunting): picked mon.noname-b con 0x7ff1c8153d10 addr v2:10.20.193.97:3300/0 2026-02-17T11:15:44.324 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.317+0000 7ff1d0787640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7ff1c80c52d0 0x7ff1c80c56e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:44.324 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.317+0000 7ff1d0787640 10 monclient(hunting): picked mon.noname-c con 0x7ff1c80c52d0 addr v2:10.20.193.157:3300/0 2026-02-17T11:15:44.324 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.317+0000 7ff1d0787640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1c80c85a0 con 0x7ff1c8153930 2026-02-17T11:15:44.324 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.317+0000 7ff1d0787640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:44.324 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.317+0000 7ff1d0787640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7ff1c80c8380 con 0x7ff1c8153d10 2026-02-17T11:15:44.324 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.317+0000 7ff1d0787640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:44.325 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.317+0000 7ff1d0787640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7ff1c80c5c20 con 0x7ff1c80c52d0 2026-02-17T11:15:44.325 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.317+0000 7ff1d0787640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:44.325 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.317+0000 7ff1d0787640 10 monclient(hunting): authenticate will time out at 1420.981174s 2026-02-17T11:15:44.325 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.317+0000 7ff1cdcfb640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7ff1c8153d10 0x7ff1c80c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:44.325 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.317+0000 7ff1cecfd640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7ff1c80c52d0 0x7ff1c80c56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:44.325 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.317+0000 7ff1cdcfb640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7ff1c8153d10 0x7ff1c80c7e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:46056/0 (socket says 10.20.193.49:46056) 2026-02-17T11:15:44.325 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.317+0000 7ff1cdcfb640 1 -- 10.20.193.49:0/1455276915 learned_addr learned my addr 10.20.193.49:0/1455276915 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:44.325 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.317+0000 7ff1cdcfb640 10 monclient(hunting): get_auth_request con 0x7ff1c8153d10 auth_method 0 2026-02-17T11:15:44.325 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.317+0000 7ff1cdcfb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:44.325 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.317+0000 7ff1cdcfb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:44.326 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.318+0000 7ff1cdcfb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:44.326 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.318+0000 7ff1cecfd640 10 monclient(hunting): get_auth_request con 0x7ff1c80c52d0 auth_method 0 2026-02-17T11:15:44.326 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.318+0000 7ff1cecfd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:44.326 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.318+0000 7ff1cecfd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:44.326 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.318+0000 7ff1cecfd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:44.326 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.318+0000 7ff1cecfd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:44.326 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.318+0000 7ff1cecfd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:44.326 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.318+0000 7ff1cecfd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:44.326 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.318+0000 7ff1cdcfb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:44.327 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.318+0000 7ff1cdcfb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:44.327 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.318+0000 7ff1cdcfb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:44.327 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.319+0000 7ff1cecfd640 10 monclient(hunting): handle_auth_done global_id 5204 payload 274 2026-02-17T11:15:44.327 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.319+0000 7ff1cecfd640 1 -- 10.20.193.49:0/1455276915 >> v2:10.20.193.97:3300/0 conn(0x7ff1c8153d10 msgr2=0x7ff1c80c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:15:44.327 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.319+0000 7ff1cecfd640 1 --2- 10.20.193.49:0/1455276915 >> v2:10.20.193.97:3300/0 conn(0x7ff1c8153d10 0x7ff1c80c7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:44.327 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.319+0000 7ff1cecfd640 1 -- 10.20.193.49:0/1455276915 >> v1:10.20.193.97:6789/0 conn(0x7ff1c8153930 legacy=0x7ff1c815b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:44.327 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.319+0000 7ff1cecfd640 10 monclient: _finish_hunting 0 2026-02-17T11:15:44.327 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.319+0000 7ff1cecfd640 1 monclient: found mon.noname-c 2026-02-17T11:15:44.327 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.319+0000 7ff1cecfd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:44.327 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.319+0000 7ff1cecfd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:15:44.328 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.319+0000 7ff1cecfd640 1 -- 10.20.193.49:0/1455276915 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1c80c8880 con 0x7ff1c80c52d0 2026-02-17T11:15:44.328 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.320+0000 7ff1cecfd640 1 --2- 10.20.193.49:0/1455276915 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff1c80c52d0 0x7ff1c80c56e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff1c8157750 tx=0x7ff1c402f1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48be3904de2b5ba9 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:44.336 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.321+0000 7ff1cd4fa640 1 -- 10.20.193.49:0/1455276915 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c403c070 con 0x7ff1c80c52d0 2026-02-17T11:15:44.336 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.321+0000 7ff1cd4fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:44.336 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.321+0000 7ff1cd4fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:15:44.336 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.321+0000 7ff1cd4fa640 10 monclient: dump: 2026-02-17T11:15:44.336 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:44.336 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:44.336 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:44.336 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:44.336 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:44.337 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:44.337 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:44.337 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:44.337 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:44.337 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:44.337 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.321+0000 7ff1cd4fa640 10 monclient: _finish_auth 0 2026-02-17T11:15:44.337 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.321+0000 7ff1cd4fa640 10 monclient: _check_auth_tickets 2026-02-17T11:15:44.337 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.321+0000 7ff1cd4fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:44.337 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.321+0000 7ff1d0787640 5 monclient: authenticate success, global_id 5204 2026-02-17T11:15:44.337 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.321+0000 7ff1d0787640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:15:44.338 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.322+0000 7ff1cd4fa640 1 -- 10.20.193.49:0/1455276915 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1c4037440 con 0x7ff1c80c52d0 2026-02-17T11:15:44.338 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.322+0000 7ff1cd4fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:44.338 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.322+0000 7ff1cd4fa640 1 -- 10.20.193.49:0/1455276915 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c4037810 con 0x7ff1c80c52d0 2026-02-17T11:15:44.338 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.322+0000 7ff1cd4fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:44.338 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.322+0000 7ff1cd4fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:15:44.338 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.322+0000 7ff1cd4fa640 10 monclient: dump: 2026-02-17T11:15:44.338 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:44.338 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:44.338 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:44.338 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:44.338 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:44.339 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:44.339 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:44.339 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:44.339 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:44.339 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:44.339 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.322+0000 7ff1d0787640 10 monclient: get_monmap_and_config success 2026-02-17T11:15:44.339 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.322+0000 7ff1d0787640 4 set_mon_vals no callback set 2026-02-17T11:15:44.339 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.322+0000 7ff1d0787640 10 monclient: shutdown 2026-02-17T11:15:44.339 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.322+0000 7ff1d0787640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:44.339 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.322+0000 7ff1d0787640 1 -- 10.20.193.49:0/1455276915 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff1c80c52d0 msgr2=0x7ff1c80c56e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:44.339 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.322+0000 7ff1d0787640 1 --2- 10.20.193.49:0/1455276915 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff1c80c52d0 0x7ff1c80c56e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff1c8157750 tx=0x7ff1c402f1c0 comp rx=0 tx=0).stop 2026-02-17T11:15:44.340 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.322+0000 7ff1d0787640 1 -- 10.20.193.49:0/1455276915 shutdown_connections 2026-02-17T11:15:44.340 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.322+0000 7ff1d0787640 1 --2- 10.20.193.49:0/1455276915 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff1c80c52d0 0x7ff1c80c56e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:44.340 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.322+0000 7ff1d0787640 1 --2- 10.20.193.49:0/1455276915 >> v2:10.20.193.97:3300/0 conn(0x7ff1c8153d10 0x7ff1c80c7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:44.340 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.322+0000 7ff1d0787640 1 -- 10.20.193.49:0/1455276915 >> 10.20.193.49:0/1455276915 conn(0x7ff1c80c9f40 msgr2=0x7ff1c80ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:44.340 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.322+0000 7ff1d0787640 1 -- 10.20.193.49:0/1455276915 shutdown_connections 2026-02-17T11:15:44.340 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.322+0000 7ff1d0787640 1 -- 10.20.193.49:0/1455276915 wait complete. 2026-02-17T11:15:44.340 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.323+0000 7ff1d0787640 10 monclient: build_initial_monmap 2026-02-17T11:15:44.340 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.323+0000 7ff1d0787640 10 monclient: monmap: 2026-02-17T11:15:44.340 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:44.340 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:15:44.341 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:15:44.341 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:15:44.341 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:44.341 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:44.341 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:15:44.341 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:15:44.341 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:15:44.341 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:44.341 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.323+0000 7ff1d0787640 1 librados: starting msgr at 2026-02-17T11:15:44.341 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.323+0000 7ff1d0787640 1 librados: starting objecter 2026-02-17T11:15:44.341 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.323+0000 7ff1d0787640 1 Processor -- start 2026-02-17T11:15:44.341 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.323+0000 7ff1d0787640 1 -- start start 2026-02-17T11:15:44.342 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.323+0000 7ff1d0787640 1 librados: setting wanted keys 2026-02-17T11:15:44.342 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.323+0000 7ff1d0787640 1 librados: calling monclient init 2026-02-17T11:15:44.342 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.323+0000 7ff1d0787640 10 monclient: init 2026-02-17T11:15:44.342 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.324+0000 7ff1d0787640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:44.342 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.324+0000 7ff1d0787640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:15:44.342 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.324+0000 7ff1d0787640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ff1c80c52d0 0x7ff1c806d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:44.342 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.324+0000 7ff1d0787640 10 monclient(hunting): picked mon.noname-a con 0x7ff1c80c52d0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:15:44.342 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.324+0000 7ff1d0787640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7ff1c8153930 0x7ff1c81f6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:44.342 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.324+0000 7ff1d0787640 10 monclient(hunting): picked mon.noname-b con 0x7ff1c8153930 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:15:44.342 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.324+0000 7ff1d0787640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff1c8153d10 0x7ff1c81f4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:44.342 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.324+0000 7ff1d0787640 10 monclient(hunting): picked mon.noname-c con 0x7ff1c8153d10 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:15:44.343 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.324+0000 7ff1d0787640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:44.343 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.324+0000 7ff1d0787640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c80c8e40 con 0x7ff1c80c52d0 2026-02-17T11:15:44.343 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.324+0000 7ff1d0787640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:44.343 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.324+0000 7ff1d0787640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c80c9490 con 0x7ff1c8153930 2026-02-17T11:15:44.343 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.324+0000 7ff1d0787640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:44.343 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.324+0000 7ff1d0787640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c80c9120 con 0x7ff1c8153d10 2026-02-17T11:15:44.343 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.324+0000 7ff1d0787640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:44.343 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.324+0000 7ff1d0787640 10 monclient(hunting): authenticate will time out at 1420.988074s 2026-02-17T11:15:44.343 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.324+0000 7ff1cecfd640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff1c8153d10 0x7ff1c81f4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:44.343 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.324+0000 7ff1ce4fc640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ff1c80c52d0 0x7ff1c806d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:44.343 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.324+0000 7ff1cecfd640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff1c8153d10 0x7ff1c81f4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:51790/0 (socket says 10.20.193.49:51790) 2026-02-17T11:15:44.344 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.324+0000 7ff1cecfd640 1 -- 10.20.193.49:0/1043599017 learned_addr learned my addr 10.20.193.49:0/1043599017 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:44.344 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.324+0000 7ff1cecfd640 10 monclient(hunting): get_auth_request con 0x7ff1c8153d10 auth_method 0 2026-02-17T11:15:44.344 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.324+0000 7ff1cecfd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:44.344 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.324+0000 7ff1cecfd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:44.344 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.324+0000 7ff1cecfd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:44.344 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.324+0000 7ff1cdcfb640 1 --2- 10.20.193.49:0/1043599017 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7ff1c8153930 0x7ff1c81f6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:44.344 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.324+0000 7ff1ce4fc640 10 monclient(hunting): get_auth_request con 0x7ff1c80c52d0 auth_method 0 2026-02-17T11:15:44.344 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.324+0000 7ff1ce4fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:44.344 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.324+0000 7ff1ce4fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:44.344 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.324+0000 7ff1ce4fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:44.345 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.324+0000 7ff1cecfd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:44.345 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.324+0000 7ff1cecfd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:44.345 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.324+0000 7ff1cecfd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:44.345 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.324+0000 7ff1cdcfb640 10 monclient(hunting): get_auth_request con 0x7ff1c8153930 auth_method 0 2026-02-17T11:15:44.345 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.324+0000 7ff1cdcfb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:44.345 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.324+0000 7ff1cdcfb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:44.345 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.324+0000 7ff1cdcfb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:44.345 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.325+0000 7ff1ce4fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:44.345 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.325+0000 7ff1ce4fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:44.345 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.325+0000 7ff1ce4fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:44.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.325+0000 7ff1cdcfb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:44.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.325+0000 7ff1cdcfb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:44.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.325+0000 7ff1cdcfb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:44.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.326+0000 7ff1cecfd640 10 monclient(hunting): handle_auth_done global_id 5207 payload 824 2026-02-17T11:15:44.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.326+0000 7ff1cecfd640 1 -- 10.20.193.49:0/1043599017 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7ff1c8153930 msgr2=0x7ff1c81f6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:44.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.326+0000 7ff1cecfd640 1 --2- 10.20.193.49:0/1043599017 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7ff1c8153930 0x7ff1c81f6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:44.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.326+0000 7ff1cecfd640 1 -- 10.20.193.49:0/1043599017 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ff1c80c52d0 msgr2=0x7ff1c806d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:44.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.326+0000 7ff1cecfd640 1 --2- 10.20.193.49:0/1043599017 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ff1c80c52d0 0x7ff1c806d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:44.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.326+0000 7ff1cecfd640 10 monclient: _finish_hunting 0 2026-02-17T11:15:44.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.326+0000 7ff1cecfd640 1 monclient: found mon.noname-c 2026-02-17T11:15:44.346 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.326+0000 7ff1cecfd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:44.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.326+0000 7ff1cecfd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:15:44.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.326+0000 7ff1cecfd640 1 -- 10.20.193.49:0/1043599017 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1c806dca0 con 0x7ff1c8153d10 2026-02-17T11:15:44.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.327+0000 7ff1cecfd640 1 --2- 10.20.193.49:0/1043599017 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff1c8153d10 0x7ff1c81f4920 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff1c403a040 tx=0x7ff1c4004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:44.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.327+0000 7ff1aeffd640 10 client.?.objecter ms_handle_connect 0x7ff1c8153d10 2026-02-17T11:15:44.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.327+0000 7ff1aeffd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:15:44.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.329+0000 7ff1aeffd640 1 -- 10.20.193.49:0/1043599017 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c403c050 con 0x7ff1c8153d10 2026-02-17T11:15:44.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.329+0000 7ff1aeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:44.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.329+0000 7ff1aeffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:15:44.347 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.329+0000 7ff1aeffd640 10 monclient: dump: 2026-02-17T11:15:44.347 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:44.348 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:44.348 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:44.348 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:44.348 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:44.348 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:44.348 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:44.348 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:44.348 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:44.348 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:44.348 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.329+0000 7ff1aeffd640 10 monclient: _finish_auth 0 2026-02-17T11:15:44.348 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.329+0000 7ff1aeffd640 10 monclient: _check_auth_tickets 2026-02-17T11:15:44.349 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.329+0000 7ff1aeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:44.349 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.329+0000 7ff1aeffd640 1 -- 10.20.193.49:0/1043599017 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1c4048070 con 0x7ff1c8153d10 2026-02-17T11:15:44.349 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.329+0000 7ff1d0787640 5 monclient: authenticate success, global_id 5207 2026-02-17T11:15:44.349 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.329+0000 7ff1d0787640 10 monclient: _renew_subs 2026-02-17T11:15:44.349 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.329+0000 7ff1d0787640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:15:44.349 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.329+0000 7ff1d0787640 1 -- 10.20.193.49:0/1043599017 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1c806df80 con 0x7ff1c8153d10 2026-02-17T11:15:44.349 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.329+0000 7ff1aeffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:44.349 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.329+0000 7ff1aeffd640 1 -- 10.20.193.49:0/1043599017 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c4035a90 con 0x7ff1c8153d10 2026-02-17T11:15:44.349 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.329+0000 7ff1aeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:44.349 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.329+0000 7ff1aeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:15:44.349 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.329+0000 7ff1aeffd640 10 monclient: dump: 2026-02-17T11:15:44.349 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:44.350 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:44.350 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:44.350 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:44.350 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:44.350 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:44.350 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:44.350 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:44.350 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:44.350 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:44.350 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.329+0000 7ff1cccf9640 4 set_mon_vals no callback set 2026-02-17T11:15:44.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.329+0000 7ff1d0787640 10 client.5207.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:44.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.329+0000 7ff1d0787640 10 monclient: _renew_subs 2026-02-17T11:15:44.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.329+0000 7ff1d0787640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:15:44.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.329+0000 7ff1d0787640 1 -- 10.20.193.49:0/1043599017 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1c806e540 con 0x7ff1c8153d10 2026-02-17T11:15:44.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.329+0000 7ff1d0787640 1 librados: init done 2026-02-17T11:15:44.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.329+0000 7ff1d0787640 10 client.5207.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:44.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.329+0000 7ff1d0787640 15 client.5207.objecter _session_command_op_assign -1 1 2026-02-17T11:15:44.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.329+0000 7ff1d0787640 20 client.5207.objecter _get_session osd=-1 returning homeless 2026-02-17T11:15:44.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.329+0000 7ff1d0787640 10 client.5207.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:44.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.329+0000 7ff1d0787640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:15:44.351 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.329+0000 7ff1d0787640 1 -- 10.20.193.49:0/1043599017 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff1c8152070 con 0x7ff1c8153d10 2026-02-17T11:15:44.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.341+0000 7ff1aeffd640 1 -- 10.20.193.49:0/1043599017 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7ff1c4035c30 con 0x7ff1c8153d10 2026-02-17T11:15:44.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.342+0000 7ff1aeffd640 1 --2- 10.20.193.49:0/1043599017 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ff198079190 0x7ff19807b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:44.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.342+0000 7ff1ce4fc640 1 --2- 10.20.193.49:0/1043599017 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ff198079190 0x7ff19807b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:44.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.342+0000 7ff1ce4fc640 10 monclient: get_auth_request con 0x7ff198079190 auth_method 0 2026-02-17T11:15:44.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.343+0000 7ff1ce4fc640 1 --2- 10.20.193.49:0/1043599017 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ff198079190 0x7ff19807b650 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff1b80051f0 tx=0x7ff1b8007f30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:44.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.343+0000 7ff1aeffd640 10 client.5207.objecter ms_handle_connect 0x7ff198079190 2026-02-17T11:15:44.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.343+0000 7ff1aeffd640 1 -- 10.20.193.49:0/1043599017 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7ff1c4084690 con 0x7ff1c8153d10 2026-02-17T11:15:44.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.343+0000 7ff1aeffd640 10 client.5207.objecter ms_dispatch2 0x7ff1c8000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:15:44.354 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.343+0000 7ff1aeffd640 3 client.5207.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:15:44.355 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.343+0000 7ff1aeffd640 3 client.5207.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:15:44.355 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.343+0000 7ff1aeffd640 10 client.5207.objecter checking command 1 2026-02-17T11:15:44.355 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.343+0000 7ff1aeffd640 1 --2- 10.20.193.49:0/1043599017 >> [v2:10.20.193.49:6808/2238942007,v1:10.20.193.49:6809/2238942007] conn(0x7ff198081670 0x7ff198083a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:44.355 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.343+0000 7ff1aeffd640 20 client.5207.objecter _get_session s=0x7ff198080fa0 osd=4 3 2026-02-17T11:15:44.355 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.343+0000 7ff1aeffd640 20 client.5207.objecter put_session s=0x7ff198080fa0 osd=4 3 2026-02-17T11:15:44.355 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.343+0000 7ff1aeffd640 15 client.5207.objecter _session_command_op_remove -1 1 2026-02-17T11:15:44.355 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.343+0000 7ff1aeffd640 20 client.5207.objecter _get_session s=0x7ff198080fa0 osd=4 3 2026-02-17T11:15:44.355 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.343+0000 7ff1aeffd640 20 client.5207.objecter get_session s=0x7ff198080fa0 osd=4 3 2026-02-17T11:15:44.355 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.343+0000 7ff1aeffd640 15 client.5207.objecter _session_command_op_assign 4 1 2026-02-17T11:15:44.355 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.343+0000 7ff1aeffd640 20 client.5207.objecter put_session s=0x7ff198080fa0 osd=4 4 2026-02-17T11:15:44.355 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.343+0000 7ff1aeffd640 10 client.5207.objecter _send_command 1 2026-02-17T11:15:44.355 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.343+0000 7ff1aeffd640 1 -- 10.20.193.49:0/1043599017 --> [v2:10.20.193.49:6808/2238942007,v1:10.20.193.49:6809/2238942007] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff1c4037440 con 0x7ff198081670 2026-02-17T11:15:44.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.343+0000 7ff1aeffd640 20 client.5207.objecter dump_active .. 0 homeless 2026-02-17T11:15:44.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.343+0000 7ff1aeffd640 1 -- 10.20.193.49:0/1043599017 <== mon.2 v2:10.20.193.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ff1c4084a50 con 0x7ff1c8153d10 2026-02-17T11:15:44.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.343+0000 7ff1aeffd640 10 monclient: handle_get_version_reply finishing 1 version 34 2026-02-17T11:15:44.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.344+0000 7ff1cdcfb640 1 --2- 10.20.193.49:0/1043599017 >> [v2:10.20.193.49:6808/2238942007,v1:10.20.193.49:6809/2238942007] conn(0x7ff198081670 0x7ff198083a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:44.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.344+0000 7ff1cdcfb640 10 monclient: get_auth_request con 0x7ff198081670 auth_method 0 2026-02-17T11:15:44.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.345+0000 7ff1cdcfb640 1 --2- 10.20.193.49:0/1043599017 >> [v2:10.20.193.49:6808/2238942007,v1:10.20.193.49:6809/2238942007] conn(0x7ff198081670 0x7ff198083a90 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:44.356 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.345+0000 7ff1aeffd640 10 client.5207.objecter ms_handle_connect 0x7ff198081670 2026-02-17T11:15:44.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.355+0000 7ff1aeffd640 1 -- 10.20.193.49:0/1043599017 <== osd.4 v2:10.20.193.49:6808/2238942007 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7ff1c4037440 con 0x7ff198081670 2026-02-17T11:15:44.357 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.355+0000 7ff1aeffd640 10 client.5207.objecter ms_dispatch2 0x7ff1c8000b90 command_reply(tid 1: 0 ) 2026-02-17T11:15:44.358 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.355+0000 7ff1aeffd640 10 client.5207.objecter _finish_command 1 = system:0 2026-02-17T11:15:44.358 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.355+0000 7ff1aeffd640 20 client.5207.objecter put_session s=0x7ff198080fa0 osd=4 4 2026-02-17T11:15:44.358 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.355+0000 7ff1aeffd640 15 client.5207.objecter _session_command_op_remove 4 1 2026-02-17T11:15:44.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.361+0000 7ff1d0787640 10 client.5207.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T11:15:44.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.361+0000 7ff1d0787640 15 client.5207.objecter _session_command_op_assign -1 2 2026-02-17T11:15:44.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.361+0000 7ff1d0787640 20 client.5207.objecter _get_session s=0x7ff198080fa0 osd=4 3 2026-02-17T11:15:44.363 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.361+0000 7ff1d0787640 20 client.5207.objecter put_session s=0x7ff198080fa0 osd=4 3 2026-02-17T11:15:44.364 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.361+0000 7ff1d0787640 20 client.5207.objecter _get_session s=0x7ff198080fa0 osd=4 3 2026-02-17T11:15:44.364 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.361+0000 7ff1d0787640 15 client.5207.objecter _session_command_op_remove -1 2 2026-02-17T11:15:44.364 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.361+0000 7ff1d0787640 20 client.5207.objecter get_session s=0x7ff198080fa0 osd=4 3 2026-02-17T11:15:44.364 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.361+0000 7ff1d0787640 15 client.5207.objecter _session_command_op_assign 4 2 2026-02-17T11:15:44.364 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.361+0000 7ff1d0787640 20 client.5207.objecter put_session s=0x7ff198080fa0 osd=4 4 2026-02-17T11:15:44.364 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.361+0000 7ff1d0787640 10 client.5207.objecter _send_command 2 2026-02-17T11:15:44.364 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.361+0000 7ff1d0787640 1 -- 10.20.193.49:0/1043599017 --> [v2:10.20.193.49:6808/2238942007,v1:10.20.193.49:6809/2238942007] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff1c80c7b10 con 0x7ff198081670 2026-02-17T11:15:44.370 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.368+0000 7ff1aeffd640 1 -- 10.20.193.49:0/1043599017 <== osd.4 v2:10.20.193.49:6808/2238942007 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff1c80c7b10 con 0x7ff198081670 2026-02-17T11:15:44.371 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.368+0000 7ff1aeffd640 10 client.5207.objecter ms_dispatch2 0x7ff1c8000b90 command_reply(tid 2: 0 ) 2026-02-17T11:15:44.371 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.368+0000 7ff1aeffd640 10 client.5207.objecter _finish_command 2 = system:0 2026-02-17T11:15:44.371 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.368+0000 7ff1aeffd640 20 client.5207.objecter put_session s=0x7ff198080fa0 osd=4 4 2026-02-17T11:15:44.371 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.368+0000 7ff1aeffd640 15 client.5207.objecter _session_command_op_remove 4 2 2026-02-17T11:15:44.371 INFO:teuthology.orchestra.run.trial049.stdout:{ 2026-02-17T11:15:44.371 INFO:teuthology.orchestra.run.trial049.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T11:15:44.372 INFO:teuthology.orchestra.run.trial049.stdout:} 2026-02-17T11:15:44.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.368+0000 7ff1d0787640 10 librados: watch_flush enter 2026-02-17T11:15:44.373 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.368+0000 7ff1d0787640 10 librados: watch_flush exit 2026-02-17T11:15:44.374 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.368+0000 7ff1d0787640 10 client.5207.objecter close_session for osd.4 2026-02-17T11:15:44.374 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.368+0000 7ff1d0787640 1 -- 10.20.193.49:0/1043599017 >> [v2:10.20.193.49:6808/2238942007,v1:10.20.193.49:6809/2238942007] conn(0x7ff198081670 msgr2=0x7ff198083a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:44.374 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.368+0000 7ff1d0787640 1 --2- 10.20.193.49:0/1043599017 >> [v2:10.20.193.49:6808/2238942007,v1:10.20.193.49:6809/2238942007] conn(0x7ff198081670 0x7ff198083a90 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:44.374 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.368+0000 7ff1d0787640 20 client.5207.objecter put_session s=0x7ff198080fa0 osd=4 1 2026-02-17T11:15:44.374 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.368+0000 7ff1d0787640 20 client.5207.objecter shutdown clearing up homeless session... 2026-02-17T11:15:44.374 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.368+0000 7ff1d0787640 10 client.5207.objecter successfully canceled tick 2026-02-17T11:15:44.374 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.368+0000 7ff1d0787640 1 -- 10.20.193.49:0/1043599017 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ff198079190 msgr2=0x7ff19807b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:44.374 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.368+0000 7ff1d0787640 1 --2- 10.20.193.49:0/1043599017 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ff198079190 0x7ff19807b650 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff1b80051f0 tx=0x7ff1b8007f30 comp rx=0 tx=0).stop 2026-02-17T11:15:44.374 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.368+0000 7ff1d0787640 10 monclient: shutdown 2026-02-17T11:15:44.374 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.368+0000 7ff1d0787640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:44.375 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.368+0000 7ff1d0787640 1 -- 10.20.193.49:0/1043599017 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff1c8153d10 msgr2=0x7ff1c81f4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:44.375 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.368+0000 7ff1d0787640 1 --2- 10.20.193.49:0/1043599017 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff1c8153d10 0x7ff1c81f4920 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff1c403a040 tx=0x7ff1c4004b40 comp rx=0 tx=0).stop 2026-02-17T11:15:44.375 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.368+0000 7ff1cecfd640 1 -- 10.20.193.49:0/1043599017 reap_dead start 2026-02-17T11:15:44.375 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.368+0000 7ff1d0787640 1 -- 10.20.193.49:0/1043599017 shutdown_connections 2026-02-17T11:15:44.375 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.368+0000 7ff1d0787640 1 -- 10.20.193.49:0/1043599017 >> 10.20.193.49:0/1043599017 conn(0x7ff1c80c9f40 msgr2=0x7ff1c815aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:44.375 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.368+0000 7ff1d0787640 1 -- 10.20.193.49:0/1043599017 shutdown_connections 2026-02-17T11:15:44.375 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.368+0000 7ff1d0787640 1 -- 10.20.193.49:0/1043599017 wait complete. 2026-02-17T11:15:44.375 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.368+0000 7ff1d0787640 1 librados: shutdown 2026-02-17T11:15:44.378 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2026-02-17T11:15:44.448 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.445+0000 7f964ff22640 10 monclient: get_monmap_and_config 2026-02-17T11:15:44.448 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.445+0000 7f964ff22640 10 monclient: build_initial_monmap 2026-02-17T11:15:44.448 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.445+0000 7f964ff22640 10 monclient: monmap: 2026-02-17T11:15:44.448 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:44.449 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:44.449 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:15:44.446926+0000 2026-02-17T11:15:44.449 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:15:44.446926+0000 2026-02-17T11:15:44.449 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:44.449 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:44.449 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:15:44.449 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:15:44.449 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:15:44.449 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:15:44.450 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:15:44.450 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:15:44.450 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:44.450 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.445+0000 7f964ff22640 1 Processor -- start 2026-02-17T11:15:44.450 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.445+0000 7f964ff22640 1 -- start start 2026-02-17T11:15:44.450 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.445+0000 7f964ff22640 10 monclient: init 2026-02-17T11:15:44.453 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.446+0000 7f964ff22640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:44.453 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.446+0000 7f964ff22640 10 monclient: _add_conns ranks=[2,3,0,5,4,1] 2026-02-17T11:15:44.453 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.446+0000 7f964ff22640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f964815d370 addr v1:10.20.193.157:6789/0 2026-02-17T11:15:44.453 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.446+0000 7f964ff22640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f96480c7e20 0x7f964815d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:44.454 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.446+0000 7f964ff22640 10 monclient(hunting): picked mon.noname-a con 0x7f96480c7e20 addr v2:10.20.193.49:3300/0 2026-02-17T11:15:44.454 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.446+0000 7f964ff22640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f96480c74c0 addr v1:10.20.193.49:6789/0 2026-02-17T11:15:44.454 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.446+0000 7f964ff22640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96480c8350 con 0x7f96480c74c0 2026-02-17T11:15:44.454 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.446+0000 7f964ff22640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96480c8630 con 0x7f964815d370 2026-02-17T11:15:44.454 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.446+0000 7f964ff22640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:44.454 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.446+0000 7f964ff22640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f964815b710 con 0x7f96480c7e20 2026-02-17T11:15:44.454 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.446+0000 7f964ff22640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:44.454 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.446+0000 7f964ff22640 10 monclient(hunting): authenticate will time out at 1421.110384s 2026-02-17T11:15:44.454 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.446+0000 7f964d496640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f96480c7e20 0x7f964815d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:44.455 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.446+0000 7f964dc97640 1 --1- >> v1:10.20.193.157:6789/0 conn(0x7f964815d370 0x7f964815b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.157:6789/0 says I am v1:10.20.193.49:48954/0 (socket says 10.20.193.49:48954) 2026-02-17T11:15:44.455 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.446+0000 7f964dc97640 1 -- 10.20.193.49:0/2117077207 learned_addr learned my addr 10.20.193.49:0/2117077207 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:15:44.455 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.446+0000 7f964d496640 10 monclient(hunting): get_auth_request con 0x7f96480c7e20 auth_method 0 2026-02-17T11:15:44.455 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.446+0000 7f964d496640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:44.455 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.446+0000 7f964d496640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:44.455 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.446+0000 7f964d496640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:44.455 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.447+0000 7f964d496640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:44.455 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.447+0000 7f964d496640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:44.455 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.447+0000 7f964d496640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:44.455 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.448+0000 7f964cc95640 1 -- 10.20.193.49:0/2117077207 <== mon.2 v1:10.20.193.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3505557180 0 0) 0x7f96480c8630 con 0x7f964815d370 2026-02-17T11:15:44.455 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.448+0000 7f964cc95640 10 monclient(hunting): _negotiate 2026-02-17T11:15:44.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.448+0000 7f964cc95640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:44.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.448+0000 7f964cc95640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:44.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.448+0000 7f964cc95640 10 monclient(hunting): my global_id is 5210 2026-02-17T11:15:44.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.448+0000 7f964cc95640 1 -- 10.20.193.49:0/2117077207 --> v1:10.20.193.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9630003620 con 0x7f964815d370 2026-02-17T11:15:44.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.448+0000 7f964d496640 10 monclient(hunting): handle_auth_done global_id 5181 payload 274 2026-02-17T11:15:44.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.448+0000 7f964d496640 1 -- 10.20.193.49:0/2117077207 >> v1:10.20.193.157:6789/0 conn(0x7f964815d370 legacy=0x7f964815b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:44.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.448+0000 7f964d496640 1 -- 10.20.193.49:0/2117077207 >> v1:10.20.193.49:6789/0 conn(0x7f96480c74c0 legacy=0x7f96480c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:44.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.448+0000 7f964d496640 10 monclient: _finish_hunting 0 2026-02-17T11:15:44.456 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.448+0000 7f964d496640 1 monclient: found mon.noname-a 2026-02-17T11:15:44.457 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.448+0000 7f964d496640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:44.457 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.448+0000 7f964d496640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:15:44.457 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.448+0000 7f964d496640 1 -- 10.20.193.49:0/2117077207 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96480c8910 con 0x7f96480c7e20 2026-02-17T11:15:44.457 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.450+0000 7f964d496640 1 --2- 10.20.193.49:0/2117077207 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f96480c7e20 0x7f964815d750 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f963c0098a0 tx=0x7f963c02ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a1cbb67c035c718 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:44.464 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.452+0000 7f964cc95640 1 -- 10.20.193.49:0/2117077207 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963c03c070 con 0x7f96480c7e20 2026-02-17T11:15:44.464 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.452+0000 7f964cc95640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:44.465 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.452+0000 7f964cc95640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:15:44.465 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.452+0000 7f964cc95640 10 monclient: dump: 2026-02-17T11:15:44.465 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:44.465 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:44.465 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:44.465 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:44.465 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:44.465 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:44.465 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:44.465 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:44.466 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:44.466 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:44.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.452+0000 7f964cc95640 10 monclient: _finish_auth 0 2026-02-17T11:15:44.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.452+0000 7f964cc95640 10 monclient: _check_auth_tickets 2026-02-17T11:15:44.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.452+0000 7f964cc95640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:44.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.452+0000 7f964cc95640 1 -- 10.20.193.49:0/2117077207 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f963c02fb70 con 0x7f96480c7e20 2026-02-17T11:15:44.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.452+0000 7f964cc95640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:44.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.452+0000 7f964cc95640 1 -- 10.20.193.49:0/2117077207 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963c037440 con 0x7f96480c7e20 2026-02-17T11:15:44.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.452+0000 7f964ff22640 5 monclient: authenticate success, global_id 5181 2026-02-17T11:15:44.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.452+0000 7f964ff22640 10 monclient: get_monmap_and_config success 2026-02-17T11:15:44.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.452+0000 7f964ff22640 4 set_mon_vals no callback set 2026-02-17T11:15:44.467 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.452+0000 7f964cc95640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:44.467 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.452+0000 7f964cc95640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:15:44.467 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.452+0000 7f964cc95640 10 monclient: dump: 2026-02-17T11:15:44.467 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:44.467 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:44.467 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:44.467 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:44.467 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:44.467 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:44.467 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:44.467 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:44.468 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:44.468 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:44.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.452+0000 7f964ff22640 10 monclient: shutdown 2026-02-17T11:15:44.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.452+0000 7f964ff22640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:44.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.452+0000 7f964ff22640 1 -- 10.20.193.49:0/2117077207 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f96480c7e20 msgr2=0x7f964815d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:44.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.452+0000 7f964ff22640 1 --2- 10.20.193.49:0/2117077207 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f96480c7e20 0x7f964815d750 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f963c0098a0 tx=0x7f963c02ee60 comp rx=0 tx=0).stop 2026-02-17T11:15:44.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.452+0000 7f964ff22640 1 -- 10.20.193.49:0/2117077207 shutdown_connections 2026-02-17T11:15:44.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.452+0000 7f964ff22640 1 --2- 10.20.193.49:0/2117077207 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f96480c7e20 0x7f964815d750 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:44.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.452+0000 7f964ff22640 1 -- 10.20.193.49:0/2117077207 >> 10.20.193.49:0/2117077207 conn(0x7f96480c9f20 msgr2=0x7f96480ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:44.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.452+0000 7f964ff22640 1 -- 10.20.193.49:0/2117077207 shutdown_connections 2026-02-17T11:15:44.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.452+0000 7f964ff22640 1 -- 10.20.193.49:0/2117077207 wait complete. 2026-02-17T11:15:44.469 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.453+0000 7f964ff22640 10 monclient: build_initial_monmap 2026-02-17T11:15:44.469 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.453+0000 7f964ff22640 10 monclient: monmap: 2026-02-17T11:15:44.469 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:44.469 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:15:44.469 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:15:44.469 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:15:44.469 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:44.469 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:44.469 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:15:44.469 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:15:44.469 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:15:44.470 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:44.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.453+0000 7f964ff22640 1 librados: starting msgr at 2026-02-17T11:15:44.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.453+0000 7f964ff22640 1 librados: starting objecter 2026-02-17T11:15:44.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.453+0000 7f964ff22640 1 Processor -- start 2026-02-17T11:15:44.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.453+0000 7f964ff22640 1 -- start start 2026-02-17T11:15:44.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.453+0000 7f964ff22640 1 librados: setting wanted keys 2026-02-17T11:15:44.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.453+0000 7f964ff22640 1 librados: calling monclient init 2026-02-17T11:15:44.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.453+0000 7f964ff22640 10 monclient: init 2026-02-17T11:15:44.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.454+0000 7f964ff22640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:44.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.454+0000 7f964ff22640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:15:44.470 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.454+0000 7f964ff22640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f96480c74c0 0x7f96481f7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:44.471 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.454+0000 7f964ff22640 10 monclient(hunting): picked mon.noname-c con 0x7f96480c74c0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:15:44.471 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.454+0000 7f964ff22640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f96480c7e20 0x7f9648147dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:44.471 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.454+0000 7f964ff22640 10 monclient(hunting): picked mon.noname-a con 0x7f96480c7e20 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:15:44.471 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.454+0000 7f964ff22640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f964815d370 0x7f9648158a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:44.471 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.454+0000 7f964ff22640 10 monclient(hunting): picked mon.noname-b con 0x7f964815d370 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:15:44.471 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.454+0000 7f964ff22640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:44.471 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.454+0000 7f964ff22640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f96480c8ed0 con 0x7f96480c7e20 2026-02-17T11:15:44.471 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.454+0000 7f964ff22640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:44.471 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.454+0000 7f964ff22640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f96480c9240 con 0x7f964815d370 2026-02-17T11:15:44.471 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.454+0000 7f964ff22640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:44.471 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.454+0000 7f964ff22640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f96480c96d0 con 0x7f96480c74c0 2026-02-17T11:15:44.472 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.454+0000 7f964ff22640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:44.472 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.454+0000 7f964ff22640 10 monclient(hunting): authenticate will time out at 1421.118290s 2026-02-17T11:15:44.472 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.454+0000 7f964d496640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f96480c7e20 0x7f9648147dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:44.472 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.454+0000 7f964e498640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f964815d370 0x7f9648158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:44.472 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.454+0000 7f964dc97640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f96480c74c0 0x7f96481f7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:44.472 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.454+0000 7f964d496640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f96480c7e20 0x7f9648147dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:45332/0 (socket says 10.20.193.49:45332) 2026-02-17T11:15:44.472 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.454+0000 7f964d496640 1 -- 10.20.193.49:0/1361480480 learned_addr learned my addr 10.20.193.49:0/1361480480 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:44.472 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.454+0000 7f964d496640 10 monclient(hunting): get_auth_request con 0x7f96480c7e20 auth_method 0 2026-02-17T11:15:44.472 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.454+0000 7f964d496640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:44.472 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.454+0000 7f964d496640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:44.472 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.454+0000 7f964d496640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:44.473 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.454+0000 7f964e498640 10 monclient(hunting): get_auth_request con 0x7f964815d370 auth_method 0 2026-02-17T11:15:44.473 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.454+0000 7f964e498640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:44.473 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.454+0000 7f964e498640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:44.473 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.454+0000 7f964e498640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:44.473 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.454+0000 7f964d496640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:44.473 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.454+0000 7f964d496640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:44.473 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.454+0000 7f964d496640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:44.473 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.454+0000 7f964dc97640 10 monclient(hunting): get_auth_request con 0x7f96480c74c0 auth_method 0 2026-02-17T11:15:44.473 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.454+0000 7f964dc97640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:44.473 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.454+0000 7f964dc97640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:44.473 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.454+0000 7f964dc97640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:44.473 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.455+0000 7f964e498640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:44.473 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.455+0000 7f964e498640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:44.473 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.455+0000 7f964e498640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:44.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.455+0000 7f964dc97640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:44.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.455+0000 7f964dc97640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:44.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.455+0000 7f964dc97640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:44.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.456+0000 7f964d496640 10 monclient(hunting): handle_auth_done global_id 5187 payload 824 2026-02-17T11:15:44.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.456+0000 7f964d496640 1 -- 10.20.193.49:0/1361480480 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f96480c74c0 msgr2=0x7f96481f7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:44.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.456+0000 7f964d496640 1 --2- 10.20.193.49:0/1361480480 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f96480c74c0 0x7f96481f7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:44.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.456+0000 7f964d496640 1 -- 10.20.193.49:0/1361480480 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f964815d370 msgr2=0x7f9648158a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:44.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.456+0000 7f964d496640 1 --2- 10.20.193.49:0/1361480480 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f964815d370 0x7f9648158a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:44.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.456+0000 7f964d496640 10 monclient: _finish_hunting 0 2026-02-17T11:15:44.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.456+0000 7f964d496640 1 monclient: found mon.noname-a 2026-02-17T11:15:44.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.456+0000 7f964d496640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:44.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.456+0000 7f964d496640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:15:44.475 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.456+0000 7f964d496640 1 -- 10.20.193.49:0/1361480480 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96481f4190 con 0x7f96480c7e20 2026-02-17T11:15:44.475 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.457+0000 7f964d496640 1 --2- 10.20.193.49:0/1361480480 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f96480c7e20 0x7f9648147dc0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f963c009130 tx=0x7f963c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:44.475 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.457+0000 7f96367fc640 10 client.?.objecter ms_handle_connect 0x7f96480c7e20 2026-02-17T11:15:44.475 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.457+0000 7f96367fc640 10 client.?.objecter resend_mon_ops 2026-02-17T11:15:44.475 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.458+0000 7f96367fc640 1 -- 10.20.193.49:0/1361480480 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963c03c040 con 0x7f96480c7e20 2026-02-17T11:15:44.475 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.458+0000 7f96367fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:44.475 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.458+0000 7f96367fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:15:44.475 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.458+0000 7f96367fc640 10 monclient: dump: 2026-02-17T11:15:44.475 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:44.475 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:44.475 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:44.475 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:44.476 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:44.476 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:44.476 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:44.476 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:44.476 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:44.476 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:44.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.458+0000 7f96367fc640 10 monclient: _finish_auth 0 2026-02-17T11:15:44.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.458+0000 7f96367fc640 10 monclient: _check_auth_tickets 2026-02-17T11:15:44.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.458+0000 7f96367fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:44.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.458+0000 7f96367fc640 1 -- 10.20.193.49:0/1361480480 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f963c042630 con 0x7f96480c7e20 2026-02-17T11:15:44.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.458+0000 7f96367fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:44.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.458+0000 7f96367fc640 1 -- 10.20.193.49:0/1361480480 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963c042a20 con 0x7f96480c7e20 2026-02-17T11:15:44.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.458+0000 7f96367fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:44.476 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.458+0000 7f96367fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:15:44.477 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.458+0000 7f9637fff640 4 set_mon_vals no callback set 2026-02-17T11:15:44.477 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.458+0000 7f96367fc640 10 monclient: dump: 2026-02-17T11:15:44.477 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:44.477 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:44.477 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:44.477 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:44.477 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:44.477 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:44.477 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:44.477 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:44.477 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:44.477 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:44.477 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.458+0000 7f964ff22640 5 monclient: authenticate success, global_id 5187 2026-02-17T11:15:44.477 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.458+0000 7f964ff22640 10 monclient: _renew_subs 2026-02-17T11:15:44.477 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.458+0000 7f964ff22640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:44.478 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.458+0000 7f964ff22640 1 -- 10.20.193.49:0/1361480480 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9648157980 con 0x7f96480c7e20 2026-02-17T11:15:44.478 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.458+0000 7f964ff22640 10 client.5187.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:44.478 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.458+0000 7f964ff22640 10 monclient: _renew_subs 2026-02-17T11:15:44.478 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.458+0000 7f964ff22640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:44.478 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.458+0000 7f964ff22640 1 -- 10.20.193.49:0/1361480480 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9648157f40 con 0x7f96480c7e20 2026-02-17T11:15:44.478 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.458+0000 7f964ff22640 1 librados: init done 2026-02-17T11:15:44.478 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.459+0000 7f964ff22640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:44.478 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.459+0000 7f964ff22640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:44.478 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.459+0000 7f964ff22640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:44.478 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.459+0000 7f964ff22640 1 -- 10.20.193.49:0/1361480480 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f964815d750 con 0x7f96480c7e20 2026-02-17T11:15:44.568 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.565+0000 7f96367fc640 1 -- 10.20.193.49:0/1361480480 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f963c04b450 con 0x7f96480c7e20 2026-02-17T11:15:44.568 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.566+0000 7f96367fc640 1 --2- 10.20.193.49:0/1361480480 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f96180791c0 0x7f961807b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:44.569 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.566+0000 7f964dc97640 1 --2- 10.20.193.49:0/1361480480 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f96180791c0 0x7f961807b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:44.569 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.566+0000 7f964dc97640 10 monclient: get_auth_request con 0x7f96180791c0 auth_method 0 2026-02-17T11:15:44.569 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.566+0000 7f964dc97640 1 --2- 10.20.193.49:0/1361480480 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f96180791c0 0x7f961807b680 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9638005980 tx=0x7f9638007dd0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:44.569 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.566+0000 7f96367fc640 10 client.5187.objecter ms_handle_connect 0x7f96180791c0 2026-02-17T11:15:44.577 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.574+0000 7f96367fc640 1 -- 10.20.193.49:0/1361480480 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f963c02fab0 con 0x7f96480c7e20 2026-02-17T11:15:44.577 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.574+0000 7f96367fc640 10 client.5187.objecter ms_dispatch2 0x7f9648000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:15:44.577 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.574+0000 7f96367fc640 3 client.5187.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:15:44.578 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.574+0000 7f96367fc640 3 client.5187.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:15:44.578 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.575+0000 7f96367fc640 20 client.5187.objecter dump_active .. 0 homeless 2026-02-17T11:15:44.578 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.575+0000 7f96367fc640 1 -- 10.20.193.49:0/1361480480 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f963c086a50 con 0x7f96480c7e20 2026-02-17T11:15:44.578 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.575+0000 7f96367fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:44.578 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.575+0000 7f96367fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:15:44.660 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.658+0000 7f964ff22640 1 -- 10.20.193.49:0/1361480480 --> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f96480c5910 con 0x7f96180791c0 2026-02-17T11:15:44.660 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.658+0000 7f96367fc640 1 -- 10.20.193.49:0/1361480480 <== mgr.4106 v2:10.20.193.162:6800/2614632098 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f96480c5910 con 0x7f96180791c0 2026-02-17T11:15:44.660 INFO:teuthology.orchestra.run.trial049.stderr:instructed osd(s) 4 to deep-scrub 2026-02-17T11:15:44.661 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.659+0000 7f964ff22640 10 librados: watch_flush enter 2026-02-17T11:15:44.661 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.659+0000 7f964ff22640 10 librados: watch_flush exit 2026-02-17T11:15:44.661 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.659+0000 7f964ff22640 20 client.5187.objecter shutdown clearing up homeless session... 2026-02-17T11:15:44.662 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.659+0000 7f964ff22640 10 client.5187.objecter successfully canceled tick 2026-02-17T11:15:44.662 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.659+0000 7f964ff22640 1 -- 10.20.193.49:0/1361480480 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f96180791c0 msgr2=0x7f961807b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:44.662 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.659+0000 7f964ff22640 1 --2- 10.20.193.49:0/1361480480 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f96180791c0 0x7f961807b680 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9638005980 tx=0x7f9638007dd0 comp rx=0 tx=0).stop 2026-02-17T11:15:44.662 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.659+0000 7f964ff22640 10 monclient: shutdown 2026-02-17T11:15:44.662 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.659+0000 7f964ff22640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:44.662 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.659+0000 7f964ff22640 1 -- 10.20.193.49:0/1361480480 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f96480c7e20 msgr2=0x7f9648147dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:44.662 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.659+0000 7f964ff22640 1 --2- 10.20.193.49:0/1361480480 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f96480c7e20 0x7f9648147dc0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f963c009130 tx=0x7f963c0047c0 comp rx=0 tx=0).stop 2026-02-17T11:15:44.662 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.659+0000 7f964ff22640 1 -- 10.20.193.49:0/1361480480 shutdown_connections 2026-02-17T11:15:44.662 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.659+0000 7f964ff22640 1 --2- 10.20.193.49:0/1361480480 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f96180791c0 0x7f961807b680 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:44.662 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.659+0000 7f964ff22640 1 --2- 10.20.193.49:0/1361480480 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f964815d370 0x7f9648158a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:44.662 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.659+0000 7f964ff22640 1 --2- 10.20.193.49:0/1361480480 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f96480c7e20 0x7f9648147dc0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:44.662 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.659+0000 7f964ff22640 1 --2- 10.20.193.49:0/1361480480 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f96480c74c0 0x7f96481f7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:44.662 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.659+0000 7f964ff22640 1 -- 10.20.193.49:0/1361480480 >> 10.20.193.49:0/1361480480 conn(0x7f96480c9f20 msgr2=0x7f964815af00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:44.662 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.659+0000 7f964ff22640 1 -- 10.20.193.49:0/1361480480 shutdown_connections 2026-02-17T11:15:44.662 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.659+0000 7f964ff22640 1 -- 10.20.193.49:0/1361480480 wait complete. 2026-02-17T11:15:44.662 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.659+0000 7f964ff22640 1 librados: shutdown 2026-02-17T11:15:44.670 INFO:tasks.ceph:Scrubbing osd.8 2026-02-17T11:15:44.670 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 config set osd_debug_deep_scrub_sleep 0 2026-02-17T11:15:44.740 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.737+0000 7f29b747c640 10 monclient: get_monmap_and_config 2026-02-17T11:15:44.740 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.737+0000 7f29b747c640 10 monclient: build_initial_monmap 2026-02-17T11:15:44.740 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.737+0000 7f29b747c640 10 monclient: monmap: 2026-02-17T11:15:44.740 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:44.740 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:44.741 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:15:44.738905+0000 2026-02-17T11:15:44.741 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:15:44.738905+0000 2026-02-17T11:15:44.741 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:44.741 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:44.741 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:15:44.741 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:15:44.741 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:15:44.741 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:15:44.741 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:15:44.741 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:15:44.741 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:44.741 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.737+0000 7f29b747c640 1 Processor -- start 2026-02-17T11:15:44.742 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.737+0000 7f29b747c640 1 -- start start 2026-02-17T11:15:44.742 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.737+0000 7f29b747c640 10 monclient: init 2026-02-17T11:15:44.744 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.738+0000 7f29b747c640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:44.744 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.738+0000 7f29b747c640 10 monclient: _add_conns ranks=[2,3,5,4,0,1] 2026-02-17T11:15:44.745 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.738+0000 7f29b747c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f29b0153930 addr v1:10.20.193.157:6789/0 2026-02-17T11:15:44.745 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.738+0000 7f29b747c640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f29b0153d10 0x7f29b00c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:44.745 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.738+0000 7f29b747c640 10 monclient(hunting): picked mon.noname-a con 0x7f29b0153d10 addr v2:10.20.193.49:3300/0 2026-02-17T11:15:44.745 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.738+0000 7f29b747c640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f29b00c52d0 0x7f29b00c56e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:44.745 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.738+0000 7f29b747c640 10 monclient(hunting): picked mon.noname-c con 0x7f29b00c52d0 addr v2:10.20.193.157:3300/0 2026-02-17T11:15:44.745 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.738+0000 7f29b747c640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29b00c85a0 con 0x7f29b0153930 2026-02-17T11:15:44.745 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.738+0000 7f29b747c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:44.745 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.738+0000 7f29b747c640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f29b00c8380 con 0x7f29b0153d10 2026-02-17T11:15:44.745 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.738+0000 7f29b747c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:44.745 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.738+0000 7f29b747c640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f29b00c5c20 con 0x7f29b00c52d0 2026-02-17T11:15:44.745 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.738+0000 7f29b747c640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:44.746 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.738+0000 7f29b747c640 10 monclient(hunting): authenticate will time out at 1421.402397s 2026-02-17T11:15:44.746 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.738+0000 7f29b49f0640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f29b0153d10 0x7f29b00c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:44.746 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.738+0000 7f29b59f2640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f29b00c52d0 0x7f29b00c56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:44.746 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.739+0000 7f29b49f0640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f29b0153d10 0x7f29b00c7e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:45346/0 (socket says 10.20.193.49:45346) 2026-02-17T11:15:44.746 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.739+0000 7f29b49f0640 1 -- 10.20.193.49:0/1447241644 learned_addr learned my addr 10.20.193.49:0/1447241644 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:44.746 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.739+0000 7f29b49f0640 10 monclient(hunting): get_auth_request con 0x7f29b0153d10 auth_method 0 2026-02-17T11:15:44.746 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.739+0000 7f29b49f0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:44.746 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.739+0000 7f29b49f0640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:44.746 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.739+0000 7f29b49f0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:44.746 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.739+0000 7f29b59f2640 10 monclient(hunting): get_auth_request con 0x7f29b00c52d0 auth_method 0 2026-02-17T11:15:44.746 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.739+0000 7f29b59f2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:44.746 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.739+0000 7f29b59f2640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:44.747 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.739+0000 7f29b59f2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:44.747 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.739+0000 7f29b49f0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:44.747 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.739+0000 7f29b49f0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:44.747 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.739+0000 7f29b49f0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:44.747 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.739+0000 7f29b59f2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:44.747 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.739+0000 7f29b59f2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:44.747 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.739+0000 7f29b59f2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:44.747 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.740+0000 7f29b49f0640 10 monclient(hunting): handle_auth_done global_id 5190 payload 274 2026-02-17T11:15:44.747 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.740+0000 7f29b49f0640 1 -- 10.20.193.49:0/1447241644 >> v2:10.20.193.157:3300/0 conn(0x7f29b00c52d0 msgr2=0x7f29b00c56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:15:44.747 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.740+0000 7f29b49f0640 1 --2- 10.20.193.49:0/1447241644 >> v2:10.20.193.157:3300/0 conn(0x7f29b00c52d0 0x7f29b00c56e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:44.747 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.740+0000 7f29b49f0640 1 -- 10.20.193.49:0/1447241644 >> v1:10.20.193.157:6789/0 conn(0x7f29b0153930 legacy=0x7f29b015b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:44.747 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.740+0000 7f29b49f0640 10 monclient: _finish_hunting 0 2026-02-17T11:15:44.747 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.740+0000 7f29b49f0640 1 monclient: found mon.noname-a 2026-02-17T11:15:44.748 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.740+0000 7f29b49f0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:44.748 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.740+0000 7f29b49f0640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:15:44.748 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.740+0000 7f29b49f0640 1 -- 10.20.193.49:0/1447241644 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29b00c8880 con 0x7f29b0153d10 2026-02-17T11:15:44.748 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.741+0000 7f29b49f0640 1 --2- 10.20.193.49:0/1447241644 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f29b0153d10 0x7f29b00c7e40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f29b0157750 tx=0x7f29a402eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57e28a6dd453ae8b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:44.755 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.743+0000 7f299ffff640 1 -- 10.20.193.49:0/1447241644 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a403c070 con 0x7f29b0153d10 2026-02-17T11:15:44.756 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.743+0000 7f299ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:44.756 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.743+0000 7f299ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:15:44.756 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.743+0000 7f299ffff640 10 monclient: dump: 2026-02-17T11:15:44.756 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:44.756 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:44.756 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:44.756 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:44.756 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:44.756 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:44.756 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:44.757 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:44.757 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:44.757 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:44.757 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.743+0000 7f299ffff640 10 monclient: _finish_auth 0 2026-02-17T11:15:44.757 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.743+0000 7f299ffff640 10 monclient: _check_auth_tickets 2026-02-17T11:15:44.757 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.743+0000 7f299ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:44.757 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.743+0000 7f299ffff640 1 -- 10.20.193.49:0/1447241644 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29a402fbe0 con 0x7f29b0153d10 2026-02-17T11:15:44.757 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.743+0000 7f29b747c640 5 monclient: authenticate success, global_id 5190 2026-02-17T11:15:44.757 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.743+0000 7f29b747c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:15:44.757 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.743+0000 7f299ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:44.757 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.743+0000 7f299ffff640 1 -- 10.20.193.49:0/1447241644 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a4037440 con 0x7f29b0153d10 2026-02-17T11:15:44.757 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.743+0000 7f299ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:44.758 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.743+0000 7f299ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:15:44.758 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.743+0000 7f299ffff640 10 monclient: dump: 2026-02-17T11:15:44.758 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:44.758 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:44.758 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:44.758 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:44.758 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:44.758 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:44.758 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:44.758 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:44.758 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:44.758 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:44.759 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.743+0000 7f29b747c640 10 monclient: get_monmap_and_config success 2026-02-17T11:15:44.759 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.743+0000 7f29b747c640 4 set_mon_vals no callback set 2026-02-17T11:15:44.759 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.744+0000 7f29b747c640 10 monclient: shutdown 2026-02-17T11:15:44.759 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.744+0000 7f29b747c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:44.759 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.744+0000 7f29b747c640 1 -- 10.20.193.49:0/1447241644 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f29b0153d10 msgr2=0x7f29b00c7e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:44.759 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.744+0000 7f29b747c640 1 --2- 10.20.193.49:0/1447241644 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f29b0153d10 0x7f29b00c7e40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f29b0157750 tx=0x7f29a402eed0 comp rx=0 tx=0).stop 2026-02-17T11:15:44.759 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.744+0000 7f29b747c640 1 -- 10.20.193.49:0/1447241644 shutdown_connections 2026-02-17T11:15:44.759 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.744+0000 7f29b747c640 1 --2- 10.20.193.49:0/1447241644 >> v2:10.20.193.157:3300/0 conn(0x7f29b00c52d0 0x7f29b00c56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:44.759 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.744+0000 7f29b747c640 1 --2- 10.20.193.49:0/1447241644 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f29b0153d10 0x7f29b00c7e40 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:44.759 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.744+0000 7f29b747c640 1 -- 10.20.193.49:0/1447241644 >> 10.20.193.49:0/1447241644 conn(0x7f29b00c9f40 msgr2=0x7f29b00ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:44.759 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.744+0000 7f29b747c640 1 -- 10.20.193.49:0/1447241644 shutdown_connections 2026-02-17T11:15:44.759 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.744+0000 7f29b747c640 1 -- 10.20.193.49:0/1447241644 wait complete. 2026-02-17T11:15:44.760 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.744+0000 7f29b747c640 10 monclient: build_initial_monmap 2026-02-17T11:15:44.760 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.744+0000 7f29b747c640 10 monclient: monmap: 2026-02-17T11:15:44.760 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:44.760 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:15:44.760 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:15:44.760 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:15:44.760 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:44.760 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:44.760 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:15:44.760 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:15:44.760 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:15:44.760 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:44.760 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.744+0000 7f29b747c640 1 librados: starting msgr at 2026-02-17T11:15:44.761 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.744+0000 7f29b747c640 1 librados: starting objecter 2026-02-17T11:15:44.761 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.744+0000 7f29b747c640 1 Processor -- start 2026-02-17T11:15:44.761 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.744+0000 7f29b747c640 1 -- start start 2026-02-17T11:15:44.761 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.744+0000 7f29b747c640 1 librados: setting wanted keys 2026-02-17T11:15:44.761 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.744+0000 7f29b747c640 1 librados: calling monclient init 2026-02-17T11:15:44.761 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.744+0000 7f29b747c640 10 monclient: init 2026-02-17T11:15:44.761 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.745+0000 7f29b747c640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:44.761 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.745+0000 7f29b747c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:15:44.761 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.745+0000 7f29b747c640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f29b00c52d0 0x7f29b006e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:44.761 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.745+0000 7f29b747c640 10 monclient(hunting): picked mon.noname-c con 0x7f29b00c52d0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:15:44.761 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.745+0000 7f29b747c640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f29b0153930 0x7f29b0145890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:44.761 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.745+0000 7f29b747c640 10 monclient(hunting): picked mon.noname-a con 0x7f29b0153930 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:15:44.762 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.745+0000 7f29b747c640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f29b0153d10 0x7f29b01f4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:44.762 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.745+0000 7f29b747c640 10 monclient(hunting): picked mon.noname-b con 0x7f29b0153d10 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:15:44.762 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.745+0000 7f29b747c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:44.762 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.745+0000 7f29b747c640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f29b00c8e40 con 0x7f29b0153930 2026-02-17T11:15:44.762 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.745+0000 7f29b747c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:44.762 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.745+0000 7f29b747c640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f29b00c9490 con 0x7f29b0153d10 2026-02-17T11:15:44.762 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.745+0000 7f29b747c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:44.762 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.745+0000 7f29b747c640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f29b00c9120 con 0x7f29b00c52d0 2026-02-17T11:15:44.762 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.745+0000 7f29b747c640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:44.762 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.745+0000 7f29b747c640 10 monclient(hunting): authenticate will time out at 1421.409298s 2026-02-17T11:15:44.762 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.745+0000 7f29b49f0640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f29b0153930 0x7f29b0145890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:44.762 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.745+0000 7f29b51f1640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f29b00c52d0 0x7f29b006e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:44.762 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.745+0000 7f29b59f2640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f29b0153d10 0x7f29b01f4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:44.763 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.745+0000 7f29b49f0640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f29b0153930 0x7f29b0145890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:45358/0 (socket says 10.20.193.49:45358) 2026-02-17T11:15:44.763 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.745+0000 7f29b49f0640 1 -- 10.20.193.49:0/900767014 learned_addr learned my addr 10.20.193.49:0/900767014 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:44.763 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.745+0000 7f29b49f0640 10 monclient(hunting): get_auth_request con 0x7f29b0153930 auth_method 0 2026-02-17T11:15:44.763 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.745+0000 7f29b49f0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:44.763 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.745+0000 7f29b49f0640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:44.763 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.745+0000 7f29b49f0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:44.763 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.745+0000 7f29b51f1640 10 monclient(hunting): get_auth_request con 0x7f29b00c52d0 auth_method 0 2026-02-17T11:15:44.763 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.745+0000 7f29b51f1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:44.763 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.745+0000 7f29b51f1640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:44.763 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.745+0000 7f29b51f1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:44.763 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.745+0000 7f29b49f0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:44.763 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.745+0000 7f29b49f0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:44.764 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.745+0000 7f29b49f0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:44.764 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.745+0000 7f29b59f2640 10 monclient(hunting): get_auth_request con 0x7f29b0153d10 auth_method 0 2026-02-17T11:15:44.764 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.745+0000 7f29b59f2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:44.764 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.745+0000 7f29b59f2640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:44.764 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.745+0000 7f29b59f2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:44.764 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.746+0000 7f29b59f2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:44.764 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.746+0000 7f29b59f2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:44.764 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.746+0000 7f29b59f2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:44.764 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.746+0000 7f29b51f1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:44.764 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.746+0000 7f29b51f1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:44.764 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.746+0000 7f29b51f1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:44.764 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.747+0000 7f29b49f0640 10 monclient(hunting): handle_auth_done global_id 5193 payload 824 2026-02-17T11:15:44.764 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.747+0000 7f29b49f0640 1 -- 10.20.193.49:0/900767014 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f29b00c52d0 msgr2=0x7f29b006e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:44.765 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.747+0000 7f29b49f0640 1 --2- 10.20.193.49:0/900767014 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f29b00c52d0 0x7f29b006e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:44.765 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.747+0000 7f29b49f0640 1 -- 10.20.193.49:0/900767014 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f29b0153d10 msgr2=0x7f29b01f4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:44.765 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.747+0000 7f29b49f0640 1 --2- 10.20.193.49:0/900767014 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f29b0153d10 0x7f29b01f4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:44.765 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.747+0000 7f29b49f0640 10 monclient: _finish_hunting 0 2026-02-17T11:15:44.765 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.747+0000 7f29b49f0640 1 monclient: found mon.noname-a 2026-02-17T11:15:44.765 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.747+0000 7f29b49f0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:44.765 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.747+0000 7f29b49f0640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:15:44.765 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.747+0000 7f29b49f0640 1 -- 10.20.193.49:0/900767014 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29b006e840 con 0x7f29b0153930 2026-02-17T11:15:44.765 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.748+0000 7f29b49f0640 1 --2- 10.20.193.49:0/900767014 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f29b0153930 0x7f29b0145890 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f29a402f480 tx=0x7f29a40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:44.765 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.748+0000 7f299dffb640 10 client.?.objecter ms_handle_connect 0x7f29b0153930 2026-02-17T11:15:44.765 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.748+0000 7f299dffb640 10 client.?.objecter resend_mon_ops 2026-02-17T11:15:44.765 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.750+0000 7f299dffb640 1 -- 10.20.193.49:0/900767014 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a403c040 con 0x7f29b0153930 2026-02-17T11:15:44.766 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.750+0000 7f299dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:44.766 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.750+0000 7f299dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:15:44.766 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.750+0000 7f299dffb640 10 monclient: dump: 2026-02-17T11:15:44.766 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:44.766 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:44.766 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:44.766 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:44.766 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:44.766 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:44.766 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:44.766 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:44.766 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:44.766 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:44.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.750+0000 7f299dffb640 10 monclient: _finish_auth 0 2026-02-17T11:15:44.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.750+0000 7f299dffb640 10 monclient: _check_auth_tickets 2026-02-17T11:15:44.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.750+0000 7f299dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:44.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.750+0000 7f299dffb640 1 -- 10.20.193.49:0/900767014 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29a4042630 con 0x7f29b0153930 2026-02-17T11:15:44.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.750+0000 7f299dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:44.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.750+0000 7f299dffb640 1 -- 10.20.193.49:0/900767014 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a4042a20 con 0x7f29b0153930 2026-02-17T11:15:44.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.750+0000 7f29b747c640 5 monclient: authenticate success, global_id 5193 2026-02-17T11:15:44.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.750+0000 7f299dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:44.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.750+0000 7f299dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:15:44.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.750+0000 7f299dffb640 10 monclient: dump: 2026-02-17T11:15:44.767 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:44.767 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:44.767 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:44.768 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:44.768 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:44.768 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:44.768 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:44.768 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:44.768 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:44.768 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:44.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.750+0000 7f299f7fe640 4 set_mon_vals no callback set 2026-02-17T11:15:44.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.750+0000 7f29b747c640 10 monclient: _renew_subs 2026-02-17T11:15:44.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.750+0000 7f29b747c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:44.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.750+0000 7f29b747c640 1 -- 10.20.193.49:0/900767014 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29b006eb20 con 0x7f29b0153930 2026-02-17T11:15:44.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.750+0000 7f29b747c640 10 client.5193.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:44.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.750+0000 7f29b747c640 10 monclient: _renew_subs 2026-02-17T11:15:44.769 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.750+0000 7f29b747c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:44.769 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.750+0000 7f29b747c640 1 -- 10.20.193.49:0/900767014 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29b006f0e0 con 0x7f29b0153930 2026-02-17T11:15:44.769 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.750+0000 7f29b747c640 1 librados: init done 2026-02-17T11:15:44.769 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.750+0000 7f29b747c640 10 client.5193.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:44.769 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.750+0000 7f29b747c640 15 client.5193.objecter _session_command_op_assign -1 1 2026-02-17T11:15:44.769 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.750+0000 7f29b747c640 20 client.5193.objecter _get_session osd=-1 returning homeless 2026-02-17T11:15:44.769 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.750+0000 7f29b747c640 10 client.5193.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:44.769 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.750+0000 7f29b747c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:44.769 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.750+0000 7f29b747c640 1 -- 10.20.193.49:0/900767014 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f29b01f7e50 con 0x7f29b0153930 2026-02-17T11:15:44.771 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.762+0000 7f299dffb640 1 -- 10.20.193.49:0/900767014 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f29a4042bc0 con 0x7f29b0153930 2026-02-17T11:15:44.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.762+0000 7f299dffb640 1 --2- 10.20.193.49:0/900767014 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f2980079140 0x7f298007b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:44.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.762+0000 7f29b51f1640 1 --2- 10.20.193.49:0/900767014 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f2980079140 0x7f298007b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:44.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.763+0000 7f29b51f1640 10 monclient: get_auth_request con 0x7f2980079140 auth_method 0 2026-02-17T11:15:44.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.763+0000 7f29b51f1640 1 --2- 10.20.193.49:0/900767014 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f2980079140 0x7f298007b600 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f29a0002770 tx=0x7f29a0007ef0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:44.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.763+0000 7f299dffb640 10 client.5193.objecter ms_handle_connect 0x7f2980079140 2026-02-17T11:15:44.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.764+0000 7f299dffb640 1 -- 10.20.193.49:0/900767014 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f29a402faa0 con 0x7f29b0153930 2026-02-17T11:15:44.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.764+0000 7f299dffb640 10 client.5193.objecter ms_dispatch2 0x7f29b0000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:15:44.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.764+0000 7f299dffb640 3 client.5193.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:15:44.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.764+0000 7f299dffb640 3 client.5193.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:15:44.772 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.764+0000 7f299dffb640 10 client.5193.objecter checking command 1 2026-02-17T11:15:44.773 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.764+0000 7f299dffb640 1 --2- 10.20.193.49:0/900767014 >> [v2:10.20.193.49:6800/1386770137,v1:10.20.193.49:6801/1386770137] conn(0x7f2980081680 0x7f2980083aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:44.773 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.764+0000 7f299dffb640 20 client.5193.objecter _get_session s=0x7f2980080fb0 osd=8 3 2026-02-17T11:15:44.773 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.764+0000 7f299dffb640 20 client.5193.objecter put_session s=0x7f2980080fb0 osd=8 3 2026-02-17T11:15:44.773 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.764+0000 7f299dffb640 15 client.5193.objecter _session_command_op_remove -1 1 2026-02-17T11:15:44.773 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.764+0000 7f299dffb640 20 client.5193.objecter _get_session s=0x7f2980080fb0 osd=8 3 2026-02-17T11:15:44.773 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.764+0000 7f299dffb640 20 client.5193.objecter get_session s=0x7f2980080fb0 osd=8 3 2026-02-17T11:15:44.773 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.764+0000 7f299dffb640 15 client.5193.objecter _session_command_op_assign 8 1 2026-02-17T11:15:44.773 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.764+0000 7f299dffb640 20 client.5193.objecter put_session s=0x7f2980080fb0 osd=8 4 2026-02-17T11:15:44.773 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.764+0000 7f299dffb640 10 client.5193.objecter _send_command 1 2026-02-17T11:15:44.773 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.764+0000 7f299dffb640 1 -- 10.20.193.49:0/900767014 --> [v2:10.20.193.49:6800/1386770137,v1:10.20.193.49:6801/1386770137] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f29a4044e80 con 0x7f2980081680 2026-02-17T11:15:44.773 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.764+0000 7f299dffb640 20 client.5193.objecter dump_active .. 0 homeless 2026-02-17T11:15:44.773 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.765+0000 7f29b59f2640 1 --2- 10.20.193.49:0/900767014 >> [v2:10.20.193.49:6800/1386770137,v1:10.20.193.49:6801/1386770137] conn(0x7f2980081680 0x7f2980083aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:44.774 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.765+0000 7f299dffb640 1 -- 10.20.193.49:0/900767014 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f29a4083be0 con 0x7f29b0153930 2026-02-17T11:15:44.774 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.765+0000 7f299dffb640 10 monclient: handle_get_version_reply finishing 1 version 34 2026-02-17T11:15:44.774 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.765+0000 7f29b59f2640 10 monclient: get_auth_request con 0x7f2980081680 auth_method 0 2026-02-17T11:15:44.774 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.766+0000 7f29b59f2640 1 --2- 10.20.193.49:0/900767014 >> [v2:10.20.193.49:6800/1386770137,v1:10.20.193.49:6801/1386770137] conn(0x7f2980081680 0x7f2980083aa0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:44.774 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.766+0000 7f299dffb640 10 client.5193.objecter ms_handle_connect 0x7f2980081680 2026-02-17T11:15:44.779 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.776+0000 7f299dffb640 1 -- 10.20.193.49:0/900767014 <== osd.8 v2:10.20.193.49:6800/1386770137 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f29a4044e80 con 0x7f2980081680 2026-02-17T11:15:44.779 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.776+0000 7f299dffb640 10 client.5193.objecter ms_dispatch2 0x7f29b0000b90 command_reply(tid 1: 0 ) 2026-02-17T11:15:44.779 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.776+0000 7f299dffb640 10 client.5193.objecter _finish_command 1 = system:0 2026-02-17T11:15:44.779 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.776+0000 7f299dffb640 20 client.5193.objecter put_session s=0x7f2980080fb0 osd=8 4 2026-02-17T11:15:44.779 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.776+0000 7f299dffb640 15 client.5193.objecter _session_command_op_remove 8 1 2026-02-17T11:15:44.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.783+0000 7f29b747c640 10 client.5193.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T11:15:44.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.783+0000 7f29b747c640 15 client.5193.objecter _session_command_op_assign -1 2 2026-02-17T11:15:44.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.783+0000 7f29b747c640 20 client.5193.objecter _get_session s=0x7f2980080fb0 osd=8 3 2026-02-17T11:15:44.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.783+0000 7f29b747c640 20 client.5193.objecter put_session s=0x7f2980080fb0 osd=8 3 2026-02-17T11:15:44.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.783+0000 7f29b747c640 20 client.5193.objecter _get_session s=0x7f2980080fb0 osd=8 3 2026-02-17T11:15:44.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.783+0000 7f29b747c640 15 client.5193.objecter _session_command_op_remove -1 2 2026-02-17T11:15:44.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.783+0000 7f29b747c640 20 client.5193.objecter get_session s=0x7f2980080fb0 osd=8 3 2026-02-17T11:15:44.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.783+0000 7f29b747c640 15 client.5193.objecter _session_command_op_assign 8 2 2026-02-17T11:15:44.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.783+0000 7f29b747c640 20 client.5193.objecter put_session s=0x7f2980080fb0 osd=8 4 2026-02-17T11:15:44.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.783+0000 7f29b747c640 10 client.5193.objecter _send_command 2 2026-02-17T11:15:44.786 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.783+0000 7f29b747c640 1 -- 10.20.193.49:0/900767014 --> [v2:10.20.193.49:6800/1386770137,v1:10.20.193.49:6801/1386770137] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f29b0151910 con 0x7f2980081680 2026-02-17T11:15:44.792 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.789+0000 7f299dffb640 1 -- 10.20.193.49:0/900767014 <== osd.8 v2:10.20.193.49:6800/1386770137 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f29b0151910 con 0x7f2980081680 2026-02-17T11:15:44.792 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.789+0000 7f299dffb640 10 client.5193.objecter ms_dispatch2 0x7f29b0000b90 command_reply(tid 2: 0 ) 2026-02-17T11:15:44.792 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.789+0000 7f299dffb640 10 client.5193.objecter _finish_command 2 = system:0 2026-02-17T11:15:44.792 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.789+0000 7f299dffb640 20 client.5193.objecter put_session s=0x7f2980080fb0 osd=8 4 2026-02-17T11:15:44.792 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.789+0000 7f299dffb640 15 client.5193.objecter _session_command_op_remove 8 2 2026-02-17T11:15:44.793 INFO:teuthology.orchestra.run.trial049.stdout:{ 2026-02-17T11:15:44.793 INFO:teuthology.orchestra.run.trial049.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T11:15:44.793 INFO:teuthology.orchestra.run.trial049.stdout:} 2026-02-17T11:15:44.794 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.790+0000 7f29b747c640 10 librados: watch_flush enter 2026-02-17T11:15:44.794 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.790+0000 7f29b747c640 10 librados: watch_flush exit 2026-02-17T11:15:44.795 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.790+0000 7f29b747c640 10 client.5193.objecter close_session for osd.8 2026-02-17T11:15:44.795 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.790+0000 7f29b747c640 1 -- 10.20.193.49:0/900767014 >> [v2:10.20.193.49:6800/1386770137,v1:10.20.193.49:6801/1386770137] conn(0x7f2980081680 msgr2=0x7f2980083aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:44.795 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.790+0000 7f29b747c640 1 --2- 10.20.193.49:0/900767014 >> [v2:10.20.193.49:6800/1386770137,v1:10.20.193.49:6801/1386770137] conn(0x7f2980081680 0x7f2980083aa0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:44.795 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.790+0000 7f29b747c640 20 client.5193.objecter put_session s=0x7f2980080fb0 osd=8 1 2026-02-17T11:15:44.795 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.790+0000 7f29b747c640 20 client.5193.objecter shutdown clearing up homeless session... 2026-02-17T11:15:44.795 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.790+0000 7f29b747c640 10 client.5193.objecter successfully canceled tick 2026-02-17T11:15:44.795 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.790+0000 7f29b747c640 1 -- 10.20.193.49:0/900767014 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f2980079140 msgr2=0x7f298007b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:44.795 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.790+0000 7f29b747c640 1 --2- 10.20.193.49:0/900767014 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f2980079140 0x7f298007b600 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f29a0002770 tx=0x7f29a0007ef0 comp rx=0 tx=0).stop 2026-02-17T11:15:44.795 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.790+0000 7f29b747c640 10 monclient: shutdown 2026-02-17T11:15:44.795 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.790+0000 7f29b747c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:44.796 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.790+0000 7f29b747c640 1 -- 10.20.193.49:0/900767014 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f29b0153930 msgr2=0x7f29b0145890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:44.796 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.790+0000 7f29b747c640 1 --2- 10.20.193.49:0/900767014 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f29b0153930 0x7f29b0145890 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f29a402f480 tx=0x7f29a40047c0 comp rx=0 tx=0).stop 2026-02-17T11:15:44.796 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.790+0000 7f29b59f2640 1 -- 10.20.193.49:0/900767014 reap_dead start 2026-02-17T11:15:44.796 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.790+0000 7f29b747c640 1 -- 10.20.193.49:0/900767014 shutdown_connections 2026-02-17T11:15:44.796 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.790+0000 7f29b747c640 1 -- 10.20.193.49:0/900767014 >> 10.20.193.49:0/900767014 conn(0x7f29b00c9f40 msgr2=0x7f29b0151c90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:44.796 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.790+0000 7f29b747c640 1 -- 10.20.193.49:0/900767014 shutdown_connections 2026-02-17T11:15:44.796 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.790+0000 7f29b747c640 1 -- 10.20.193.49:0/900767014 wait complete. 2026-02-17T11:15:44.796 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.790+0000 7f29b747c640 1 librados: shutdown 2026-02-17T11:15:44.801 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 8 2026-02-17T11:15:44.869 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.866+0000 7f4b642f1640 10 monclient: get_monmap_and_config 2026-02-17T11:15:44.869 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.866+0000 7f4b642f1640 10 monclient: build_initial_monmap 2026-02-17T11:15:44.869 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.866+0000 7f4b642f1640 10 monclient: monmap: 2026-02-17T11:15:44.869 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:44.869 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:44.869 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:15:44.867991+0000 2026-02-17T11:15:44.870 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:15:44.867991+0000 2026-02-17T11:15:44.870 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:44.870 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:44.870 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:15:44.870 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:15:44.870 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:15:44.870 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:15:44.870 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:15:44.870 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:15:44.870 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:44.870 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.866+0000 7f4b642f1640 1 Processor -- start 2026-02-17T11:15:44.870 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.866+0000 7f4b642f1640 1 -- start start 2026-02-17T11:15:44.871 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.866+0000 7f4b642f1640 10 monclient: init 2026-02-17T11:15:44.873 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.867+0000 7f4b642f1640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:44.873 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.867+0000 7f4b642f1640 10 monclient: _add_conns ranks=[4,0,5,3,1,2] 2026-02-17T11:15:44.874 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.867+0000 7f4b642f1640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f4b5c0c7170 0x7f4b5c0c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:44.874 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.867+0000 7f4b642f1640 10 monclient(hunting): picked mon.noname-b con 0x7f4b5c0c7170 addr v2:10.20.193.97:3300/0 2026-02-17T11:15:44.874 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.867+0000 7f4b642f1640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f4b5c0c48c0 addr v1:10.20.193.49:6789/0 2026-02-17T11:15:44.874 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.867+0000 7f4b642f1640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f4b5c0c4d10 0x7f4b5c0c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:44.874 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.867+0000 7f4b642f1640 10 monclient(hunting): picked mon.noname-c con 0x7f4b5c0c4d10 addr v2:10.20.193.157:3300/0 2026-02-17T11:15:44.874 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.867+0000 7f4b642f1640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b5c15a9a0 con 0x7f4b5c0c48c0 2026-02-17T11:15:44.874 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.867+0000 7f4b642f1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:44.874 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.867+0000 7f4b642f1640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f4b5c0c8530 con 0x7f4b5c0c7170 2026-02-17T11:15:44.874 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.867+0000 7f4b642f1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:44.874 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.867+0000 7f4b642f1640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f4b5c0c5270 con 0x7f4b5c0c4d10 2026-02-17T11:15:44.874 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.867+0000 7f4b642f1640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:44.875 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.867+0000 7f4b642f1640 10 monclient(hunting): authenticate will time out at 1421.531440s 2026-02-17T11:15:44.875 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.867+0000 7f4b61865640 1 --1- >> v1:10.20.193.49:6789/0 conn(0x7f4b5c0c48c0 0x7f4b5c0749b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.49:6789/0 says I am v1:10.20.193.49:46136/0 (socket says 10.20.193.49:46136) 2026-02-17T11:15:44.875 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.867+0000 7f4b61865640 1 -- 10.20.193.49:0/1368441461 learned_addr learned my addr 10.20.193.49:0/1368441461 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:15:44.875 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.867+0000 7f4b62066640 1 --2- 10.20.193.49:0/1368441461 >> v2:10.20.193.97:3300/0 conn(0x7f4b5c0c7170 0x7f4b5c0c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:44.875 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.867+0000 7f4b62867640 1 --2- 10.20.193.49:0/1368441461 >> v2:10.20.193.157:3300/0 conn(0x7f4b5c0c4d10 0x7f4b5c0c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:44.875 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.868+0000 7f4b62066640 10 monclient(hunting): get_auth_request con 0x7f4b5c0c7170 auth_method 0 2026-02-17T11:15:44.875 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.868+0000 7f4b62066640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:44.875 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.868+0000 7f4b62066640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:44.875 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.868+0000 7f4b62066640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:44.875 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.868+0000 7f4b62867640 10 monclient(hunting): get_auth_request con 0x7f4b5c0c4d10 auth_method 0 2026-02-17T11:15:44.875 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.868+0000 7f4b62867640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:44.875 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.868+0000 7f4b62867640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:44.876 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.868+0000 7f4b62867640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:44.876 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.868+0000 7f4b62066640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:44.876 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.868+0000 7f4b62066640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:44.876 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.868+0000 7f4b62066640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:44.876 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.868+0000 7f4b62867640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:44.876 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.868+0000 7f4b62867640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:44.876 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.868+0000 7f4b62867640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:44.876 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.869+0000 7f4b61064640 1 -- 10.20.193.49:0/1368441461 <== mon.0 v1:10.20.193.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3589306772 0 0) 0x7f4b5c15a9a0 con 0x7f4b5c0c48c0 2026-02-17T11:15:44.876 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.869+0000 7f4b61064640 10 monclient(hunting): _negotiate 2026-02-17T11:15:44.876 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.869+0000 7f4b61064640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:44.876 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.869+0000 7f4b61064640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:44.876 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.869+0000 7f4b61064640 10 monclient(hunting): my global_id is 5196 2026-02-17T11:15:44.876 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.869+0000 7f4b61064640 1 -- 10.20.193.49:0/1368441461 --> v1:10.20.193.49:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b44003620 con 0x7f4b5c0c48c0 2026-02-17T11:15:44.877 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.869+0000 7f4b62066640 10 monclient(hunting): handle_auth_done global_id 5167 payload 274 2026-02-17T11:15:44.877 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.869+0000 7f4b62066640 1 -- 10.20.193.49:0/1368441461 >> v2:10.20.193.157:3300/0 conn(0x7f4b5c0c4d10 msgr2=0x7f4b5c0c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:15:44.877 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.869+0000 7f4b62066640 1 --2- 10.20.193.49:0/1368441461 >> v2:10.20.193.157:3300/0 conn(0x7f4b5c0c4d10 0x7f4b5c0c89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:44.877 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.869+0000 7f4b62066640 1 -- 10.20.193.49:0/1368441461 >> v1:10.20.193.49:6789/0 conn(0x7f4b5c0c48c0 legacy=0x7f4b5c0749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:44.877 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.869+0000 7f4b62066640 10 monclient: _finish_hunting 0 2026-02-17T11:15:44.877 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.869+0000 7f4b62066640 1 monclient: found mon.noname-b 2026-02-17T11:15:44.877 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.869+0000 7f4b62066640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:44.877 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.869+0000 7f4b62066640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:15:44.877 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.869+0000 7f4b62066640 1 -- 10.20.193.49:0/1368441461 --> v2:10.20.193.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b5c0c5550 con 0x7f4b5c0c7170 2026-02-17T11:15:44.877 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.870+0000 7f4b62066640 1 --2- 10.20.193.49:0/1368441461 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f4b5c0c7170 0x7f4b5c0c7550 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c0c6e90 tx=0x7f4b4c02ede0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0dd9390e2924b77 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:44.884 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.872+0000 7f4b61064640 1 -- 10.20.193.49:0/1368441461 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b4c03c070 con 0x7f4b5c0c7170 2026-02-17T11:15:44.884 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.872+0000 7f4b61064640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:44.884 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.872+0000 7f4b61064640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:15:44.884 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.872+0000 7f4b61064640 10 monclient: dump: 2026-02-17T11:15:44.884 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:44.884 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:44.884 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:44.885 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:44.885 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:44.885 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:44.885 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:44.885 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:44.885 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:44.885 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:44.885 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.872+0000 7f4b61064640 10 monclient: _finish_auth 0 2026-02-17T11:15:44.885 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.872+0000 7f4b61064640 10 monclient: _check_auth_tickets 2026-02-17T11:15:44.885 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.872+0000 7f4b61064640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:44.885 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.872+0000 7f4b61064640 1 -- 10.20.193.49:0/1368441461 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b4c02faf0 con 0x7f4b5c0c7170 2026-02-17T11:15:44.885 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.872+0000 7f4b642f1640 5 monclient: authenticate success, global_id 5167 2026-02-17T11:15:44.886 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.872+0000 7f4b61064640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:44.886 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.872+0000 7f4b61064640 1 -- 10.20.193.49:0/1368441461 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b4c037440 con 0x7f4b5c0c7170 2026-02-17T11:15:44.886 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.872+0000 7f4b642f1640 10 monclient: get_monmap_and_config success 2026-02-17T11:15:44.886 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.872+0000 7f4b642f1640 4 set_mon_vals no callback set 2026-02-17T11:15:44.886 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.872+0000 7f4b61064640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:44.886 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.872+0000 7f4b61064640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:15:44.886 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.872+0000 7f4b61064640 10 monclient: dump: 2026-02-17T11:15:44.886 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:44.886 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:44.886 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:44.886 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:44.886 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:44.886 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:44.887 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:44.887 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:44.887 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:44.887 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:44.887 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.872+0000 7f4b642f1640 10 monclient: shutdown 2026-02-17T11:15:44.887 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.872+0000 7f4b642f1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:44.887 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.872+0000 7f4b642f1640 1 -- 10.20.193.49:0/1368441461 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f4b5c0c7170 msgr2=0x7f4b5c0c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:44.887 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.872+0000 7f4b642f1640 1 --2- 10.20.193.49:0/1368441461 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f4b5c0c7170 0x7f4b5c0c7550 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c0c6e90 tx=0x7f4b4c02ede0 comp rx=0 tx=0).stop 2026-02-17T11:15:44.887 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.872+0000 7f4b642f1640 1 -- 10.20.193.49:0/1368441461 shutdown_connections 2026-02-17T11:15:44.887 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.872+0000 7f4b642f1640 1 --2- 10.20.193.49:0/1368441461 >> v2:10.20.193.157:3300/0 conn(0x7f4b5c0c4d10 0x7f4b5c0c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:44.887 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.872+0000 7f4b642f1640 1 --2- 10.20.193.49:0/1368441461 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f4b5c0c7170 0x7f4b5c0c7550 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:44.887 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.872+0000 7f4b642f1640 1 -- 10.20.193.49:0/1368441461 >> 10.20.193.49:0/1368441461 conn(0x7f4b5c0c9f40 msgr2=0x7f4b5c0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:44.888 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.872+0000 7f4b642f1640 1 -- 10.20.193.49:0/1368441461 shutdown_connections 2026-02-17T11:15:44.888 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.872+0000 7f4b642f1640 1 -- 10.20.193.49:0/1368441461 wait complete. 2026-02-17T11:15:44.888 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.873+0000 7f4b642f1640 10 monclient: build_initial_monmap 2026-02-17T11:15:44.888 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.873+0000 7f4b642f1640 10 monclient: monmap: 2026-02-17T11:15:44.888 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:44.888 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:15:44.888 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:15:44.888 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:15:44.888 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:44.888 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:44.888 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:15:44.888 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:15:44.888 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:15:44.889 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:44.889 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.873+0000 7f4b642f1640 1 librados: starting msgr at 2026-02-17T11:15:44.889 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.873+0000 7f4b642f1640 1 librados: starting objecter 2026-02-17T11:15:44.889 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.873+0000 7f4b642f1640 1 Processor -- start 2026-02-17T11:15:44.889 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.873+0000 7f4b642f1640 1 -- start start 2026-02-17T11:15:44.889 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.873+0000 7f4b642f1640 1 librados: setting wanted keys 2026-02-17T11:15:44.889 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.873+0000 7f4b642f1640 1 librados: calling monclient init 2026-02-17T11:15:44.889 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.873+0000 7f4b642f1640 10 monclient: init 2026-02-17T11:15:44.889 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.873+0000 7f4b642f1640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:44.889 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.873+0000 7f4b642f1640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:15:44.889 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.873+0000 7f4b642f1640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f4b5c0c48c0 0x7f4b5c1f7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:44.889 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.873+0000 7f4b642f1640 10 monclient(hunting): picked mon.noname-b con 0x7f4b5c0c48c0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:15:44.890 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.873+0000 7f4b642f1640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f4b5c0c4d10 0x7f4b5c0cc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:44.890 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.873+0000 7f4b642f1640 10 monclient(hunting): picked mon.noname-a con 0x7f4b5c0c4d10 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:15:44.890 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.873+0000 7f4b642f1640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f4b5c0c7170 0x7f4b5c15b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:44.890 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.873+0000 7f4b642f1640 10 monclient(hunting): picked mon.noname-c con 0x7f4b5c0c7170 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:15:44.890 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.873+0000 7f4b642f1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:44.890 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.873+0000 7f4b642f1640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f4b5c0c81c0 con 0x7f4b5c0c4d10 2026-02-17T11:15:44.890 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.873+0000 7f4b642f1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:44.890 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.873+0000 7f4b642f1640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f4b5c0c7ee0 con 0x7f4b5c0c48c0 2026-02-17T11:15:44.890 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.873+0000 7f4b642f1640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:44.890 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.873+0000 7f4b642f1640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f4b5c0750c0 con 0x7f4b5c0c7170 2026-02-17T11:15:44.890 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.873+0000 7f4b642f1640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:44.890 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.873+0000 7f4b642f1640 10 monclient(hunting): authenticate will time out at 1421.537783s 2026-02-17T11:15:44.890 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.874+0000 7f4b62066640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f4b5c0c48c0 0x7f4b5c1f7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:44.890 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.874+0000 7f4b61865640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f4b5c0c4d10 0x7f4b5c0cc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:44.891 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.874+0000 7f4b61865640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f4b5c0c4d10 0x7f4b5c0cc5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:45364/0 (socket says 10.20.193.49:45364) 2026-02-17T11:15:44.891 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.874+0000 7f4b61865640 1 -- 10.20.193.49:0/1882920320 learned_addr learned my addr 10.20.193.49:0/1882920320 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:44.891 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.874+0000 7f4b62066640 10 monclient(hunting): get_auth_request con 0x7f4b5c0c48c0 auth_method 0 2026-02-17T11:15:44.891 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.874+0000 7f4b62066640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:44.891 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.874+0000 7f4b62066640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:44.891 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.874+0000 7f4b62867640 1 --2- 10.20.193.49:0/1882920320 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f4b5c0c7170 0x7f4b5c15b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:44.891 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.874+0000 7f4b62066640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:44.891 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.874+0000 7f4b61865640 10 monclient(hunting): get_auth_request con 0x7f4b5c0c4d10 auth_method 0 2026-02-17T11:15:44.891 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.874+0000 7f4b61865640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:44.891 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.874+0000 7f4b61865640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:44.891 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.874+0000 7f4b61865640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:44.891 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.874+0000 7f4b62867640 10 monclient(hunting): get_auth_request con 0x7f4b5c0c7170 auth_method 0 2026-02-17T11:15:44.892 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.874+0000 7f4b62867640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:44.892 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.874+0000 7f4b62867640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:44.892 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.874+0000 7f4b62867640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:44.892 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.874+0000 7f4b61865640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:44.892 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.874+0000 7f4b61865640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:44.892 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.874+0000 7f4b61865640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:44.892 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.874+0000 7f4b62066640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:44.892 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.874+0000 7f4b62066640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:44.892 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.874+0000 7f4b62066640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:44.892 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.874+0000 7f4b62867640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:44.892 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.874+0000 7f4b62867640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:44.892 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.874+0000 7f4b62867640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:44.892 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.875+0000 7f4b61865640 10 monclient(hunting): handle_auth_done global_id 5199 payload 824 2026-02-17T11:15:44.893 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.875+0000 7f4b61865640 1 -- 10.20.193.49:0/1882920320 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f4b5c0c7170 msgr2=0x7f4b5c15b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:44.893 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.875+0000 7f4b61865640 1 --2- 10.20.193.49:0/1882920320 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f4b5c0c7170 0x7f4b5c15b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:44.893 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.875+0000 7f4b61865640 1 -- 10.20.193.49:0/1882920320 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f4b5c0c48c0 msgr2=0x7f4b5c1f7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:44.893 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.875+0000 7f4b61865640 1 --2- 10.20.193.49:0/1882920320 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f4b5c0c48c0 0x7f4b5c1f7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:44.893 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.875+0000 7f4b61865640 10 monclient: _finish_hunting 0 2026-02-17T11:15:44.893 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.875+0000 7f4b61865640 1 monclient: found mon.noname-a 2026-02-17T11:15:44.893 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.875+0000 7f4b61865640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:44.893 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.875+0000 7f4b61865640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:15:44.893 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.875+0000 7f4b61865640 1 -- 10.20.193.49:0/1882920320 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b5c1f4980 con 0x7f4b5c0c4d10 2026-02-17T11:15:44.893 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.877+0000 7f4b61865640 1 --2- 10.20.193.49:0/1882920320 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f4b5c0c4d10 0x7f4b5c0cc5e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4b5000c520 tx=0x7f4b5000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:44.893 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.877+0000 7f4b42ffd640 10 client.?.objecter ms_handle_connect 0x7f4b5c0c4d10 2026-02-17T11:15:44.894 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.877+0000 7f4b42ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:15:44.894 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.878+0000 7f4b42ffd640 1 -- 10.20.193.49:0/1882920320 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b50017070 con 0x7f4b5c0c4d10 2026-02-17T11:15:44.894 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.878+0000 7f4b42ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:44.894 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.878+0000 7f4b42ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:15:44.894 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.878+0000 7f4b42ffd640 10 monclient: dump: 2026-02-17T11:15:44.894 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:44.894 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:44.894 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:44.894 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:44.894 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:44.894 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:44.894 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:44.894 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:44.895 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:44.895 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:44.895 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.878+0000 7f4b42ffd640 10 monclient: _finish_auth 0 2026-02-17T11:15:44.895 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.878+0000 7f4b42ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:15:44.895 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.878+0000 7f4b42ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:44.895 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.878+0000 7f4b42ffd640 1 -- 10.20.193.49:0/1882920320 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b50005de0 con 0x7f4b5c0c4d10 2026-02-17T11:15:44.895 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.878+0000 7f4b642f1640 5 monclient: authenticate success, global_id 5199 2026-02-17T11:15:44.895 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.878+0000 7f4b42ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:44.895 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.878+0000 7f4b42ffd640 1 -- 10.20.193.49:0/1882920320 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b50007270 con 0x7f4b5c0c4d10 2026-02-17T11:15:44.895 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.878+0000 7f4b42ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:44.895 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.878+0000 7f4b42ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:15:44.895 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.878+0000 7f4b42ffd640 10 monclient: dump: 2026-02-17T11:15:44.896 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:44.896 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:44.896 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:44.896 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:44.896 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:44.896 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:44.896 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:44.896 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:44.896 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:44.896 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:44.896 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.878+0000 7f4b60863640 4 set_mon_vals no callback set 2026-02-17T11:15:44.896 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.878+0000 7f4b642f1640 10 monclient: _renew_subs 2026-02-17T11:15:44.896 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.878+0000 7f4b642f1640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:44.896 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.878+0000 7f4b642f1640 1 -- 10.20.193.49:0/1882920320 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b5c1f3e00 con 0x7f4b5c0c4d10 2026-02-17T11:15:44.897 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.879+0000 7f4b642f1640 10 client.5199.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:44.897 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.879+0000 7f4b642f1640 10 monclient: _renew_subs 2026-02-17T11:15:44.897 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.879+0000 7f4b642f1640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:44.897 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.879+0000 7f4b642f1640 1 -- 10.20.193.49:0/1882920320 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b5c1f43c0 con 0x7f4b5c0c4d10 2026-02-17T11:15:44.897 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.879+0000 7f4b642f1640 1 librados: init done 2026-02-17T11:15:44.897 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.879+0000 7f4b642f1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:44.897 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.879+0000 7f4b642f1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:44.897 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.879+0000 7f4b642f1640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:44.897 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.879+0000 7f4b642f1640 1 -- 10.20.193.49:0/1882920320 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b5c0c7550 con 0x7f4b5c0c4d10 2026-02-17T11:15:44.986 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.984+0000 7f4b42ffd640 1 -- 10.20.193.49:0/1882920320 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f4b50007410 con 0x7f4b5c0c4d10 2026-02-17T11:15:44.987 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.984+0000 7f4b42ffd640 1 --2- 10.20.193.49:0/1882920320 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f4b2c079170 0x7f4b2c07b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:44.987 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.985+0000 7f4b62066640 1 --2- 10.20.193.49:0/1882920320 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f4b2c079170 0x7f4b2c07b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:44.987 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.985+0000 7f4b62066640 10 monclient: get_auth_request con 0x7f4b2c079170 auth_method 0 2026-02-17T11:15:44.988 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.985+0000 7f4b62066640 1 --2- 10.20.193.49:0/1882920320 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f4b2c079170 0x7f4b2c07b630 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c039000 tx=0x7f4b4c033000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:44.988 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.985+0000 7f4b42ffd640 10 client.5199.objecter ms_handle_connect 0x7f4b2c079170 2026-02-17T11:15:44.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.992+0000 7f4b42ffd640 1 -- 10.20.193.49:0/1882920320 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f4b50007730 con 0x7f4b5c0c4d10 2026-02-17T11:15:44.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.992+0000 7f4b42ffd640 10 client.5199.objecter ms_dispatch2 0x7f4b5c000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:15:44.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.992+0000 7f4b42ffd640 3 client.5199.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:15:44.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.992+0000 7f4b42ffd640 3 client.5199.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:15:44.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.992+0000 7f4b42ffd640 20 client.5199.objecter dump_active .. 0 homeless 2026-02-17T11:15:44.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.992+0000 7f4b42ffd640 1 -- 10.20.193.49:0/1882920320 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f4b50061630 con 0x7f4b5c0c4d10 2026-02-17T11:15:44.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.992+0000 7f4b42ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:44.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:44.992+0000 7f4b42ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:15:45.077 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.074+0000 7f4b642f1640 1 -- 10.20.193.49:0/1882920320 --> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "8", "target": ["mon-mgr", ""]}) -- 0x7f4b5c0c1be0 con 0x7f4b2c079170 2026-02-17T11:15:45.077 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.074+0000 7f4b42ffd640 1 -- 10.20.193.49:0/1882920320 <== mgr.4106 v2:10.20.193.162:6800/2614632098 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 8 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4b4c041460 con 0x7f4b2c079170 2026-02-17T11:15:45.077 INFO:teuthology.orchestra.run.trial049.stderr:instructed osd(s) 8 to deep-scrub 2026-02-17T11:15:45.078 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.075+0000 7f4b642f1640 10 librados: watch_flush enter 2026-02-17T11:15:45.078 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.075+0000 7f4b642f1640 10 librados: watch_flush exit 2026-02-17T11:15:45.079 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.075+0000 7f4b642f1640 20 client.5199.objecter shutdown clearing up homeless session... 2026-02-17T11:15:45.079 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.075+0000 7f4b642f1640 10 client.5199.objecter successfully canceled tick 2026-02-17T11:15:45.079 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.075+0000 7f4b642f1640 1 -- 10.20.193.49:0/1882920320 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f4b2c079170 msgr2=0x7f4b2c07b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:45.079 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.075+0000 7f4b642f1640 1 --2- 10.20.193.49:0/1882920320 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f4b2c079170 0x7f4b2c07b630 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c039000 tx=0x7f4b4c033000 comp rx=0 tx=0).stop 2026-02-17T11:15:45.079 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.075+0000 7f4b642f1640 10 monclient: shutdown 2026-02-17T11:15:45.079 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.075+0000 7f4b642f1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:45.079 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.075+0000 7f4b642f1640 1 -- 10.20.193.49:0/1882920320 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f4b5c0c4d10 msgr2=0x7f4b5c0cc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:45.079 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.075+0000 7f4b642f1640 1 --2- 10.20.193.49:0/1882920320 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f4b5c0c4d10 0x7f4b5c0cc5e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4b5000c520 tx=0x7f4b5000c9f0 comp rx=0 tx=0).stop 2026-02-17T11:15:45.079 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.075+0000 7f4b642f1640 1 -- 10.20.193.49:0/1882920320 shutdown_connections 2026-02-17T11:15:45.079 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.075+0000 7f4b642f1640 1 --2- 10.20.193.49:0/1882920320 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f4b2c079170 0x7f4b2c07b630 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:45.079 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.075+0000 7f4b642f1640 1 --2- 10.20.193.49:0/1882920320 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f4b5c0c7170 0x7f4b5c15b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:45.079 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.075+0000 7f4b642f1640 1 --2- 10.20.193.49:0/1882920320 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f4b5c0c4d10 0x7f4b5c0cc5e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:45.080 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.075+0000 7f4b642f1640 1 --2- 10.20.193.49:0/1882920320 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f4b5c0c48c0 0x7f4b5c1f7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:45.080 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.075+0000 7f4b642f1640 1 -- 10.20.193.49:0/1882920320 >> 10.20.193.49:0/1882920320 conn(0x7f4b5c0c9f40 msgr2=0x7f4b5c06d5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:45.080 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.075+0000 7f4b642f1640 1 -- 10.20.193.49:0/1882920320 shutdown_connections 2026-02-17T11:15:45.080 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.075+0000 7f4b642f1640 1 -- 10.20.193.49:0/1882920320 wait complete. 2026-02-17T11:15:45.080 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.075+0000 7f4b642f1640 1 librados: shutdown 2026-02-17T11:15:45.086 INFO:tasks.ceph:Scrubbing osd.12 2026-02-17T11:15:45.086 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.12 config set osd_debug_deep_scrub_sleep 0 2026-02-17T11:15:45.155 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.152+0000 7ff373b51640 10 monclient: get_monmap_and_config 2026-02-17T11:15:45.155 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.152+0000 7ff373b51640 10 monclient: build_initial_monmap 2026-02-17T11:15:45.155 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.152+0000 7ff373b51640 10 monclient: monmap: 2026-02-17T11:15:45.155 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:45.155 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:45.155 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:15:45.153647+0000 2026-02-17T11:15:45.155 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:15:45.153647+0000 2026-02-17T11:15:45.155 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:45.155 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:45.156 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:15:45.156 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:15:45.156 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:15:45.156 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:15:45.156 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:15:45.156 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:15:45.156 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:45.156 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.152+0000 7ff373b51640 1 Processor -- start 2026-02-17T11:15:45.156 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.152+0000 7ff373b51640 1 -- start start 2026-02-17T11:15:45.156 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.152+0000 7ff373b51640 10 monclient: init 2026-02-17T11:15:45.158 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.153+0000 7ff373b51640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:45.158 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.153+0000 7ff373b51640 10 monclient: _add_conns ranks=[1,2,3,5,0,4] 2026-02-17T11:15:45.158 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.153+0000 7ff373b51640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7ff36c15d3c0 addr v1:10.20.193.97:6789/0 2026-02-17T11:15:45.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.153+0000 7ff373b51640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ff36c0c94c0 addr v1:10.20.193.157:6789/0 2026-02-17T11:15:45.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.153+0000 7ff373b51640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7ff36c15d7a0 0x7ff36c15b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:45.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.153+0000 7ff373b51640 10 monclient(hunting): picked mon.noname-a con 0x7ff36c15d7a0 addr v2:10.20.193.49:3300/0 2026-02-17T11:15:45.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.153+0000 7ff373b51640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff36c0c7e60 con 0x7ff36c15d3c0 2026-02-17T11:15:45.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.153+0000 7ff373b51640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff36c0c8140 con 0x7ff36c0c94c0 2026-02-17T11:15:45.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.153+0000 7ff373b51640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:45.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.153+0000 7ff373b51640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7ff36c0c8420 con 0x7ff36c15d7a0 2026-02-17T11:15:45.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.153+0000 7ff373b51640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:45.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.153+0000 7ff373b51640 10 monclient(hunting): authenticate will time out at 1421.817163s 2026-02-17T11:15:45.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.153+0000 7ff3720c7640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7ff36c15d7a0 0x7ff36c15b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:45.159 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.153+0000 7ff3720c7640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7ff36c15d7a0 0x7ff36c15b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:45378/0 (socket says 10.20.193.49:45378) 2026-02-17T11:15:45.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.153+0000 7ff3720c7640 1 -- 10.20.193.49:0/3880931813 learned_addr learned my addr 10.20.193.49:0/3880931813 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:45.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.153+0000 7ff3720c7640 10 monclient(hunting): get_auth_request con 0x7ff36c15d7a0 auth_method 0 2026-02-17T11:15:45.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.153+0000 7ff3720c7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:45.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.153+0000 7ff3720c7640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:45.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.153+0000 7ff3720c7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:45.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.153+0000 7ff3720c7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:45.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.153+0000 7ff3720c7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:45.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.153+0000 7ff3720c7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:45.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.154+0000 7ff3720c7640 10 monclient(hunting): handle_auth_done global_id 5202 payload 274 2026-02-17T11:15:45.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.154+0000 7ff3720c7640 1 -- 10.20.193.49:0/3880931813 >> v1:10.20.193.157:6789/0 conn(0x7ff36c0c94c0 legacy=0x7ff36c0c52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:45.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.154+0000 7ff3720c7640 1 -- 10.20.193.49:0/3880931813 >> v1:10.20.193.97:6789/0 conn(0x7ff36c15d3c0 legacy=0x7ff36c0c7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:45.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.154+0000 7ff3720c7640 10 monclient: _finish_hunting 0 2026-02-17T11:15:45.160 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.154+0000 7ff3720c7640 1 monclient: found mon.noname-a 2026-02-17T11:15:45.161 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.154+0000 7ff3720c7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:45.161 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.154+0000 7ff3720c7640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:15:45.161 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.154+0000 7ff3720c7640 1 -- 10.20.193.49:0/3880931813 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff36c0c8700 con 0x7ff36c15d7a0 2026-02-17T11:15:45.161 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.155+0000 7ff3720c7640 1 --2- 10.20.193.49:0/3880931813 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ff36c15d7a0 0x7ff36c15b050 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff368009e50 tx=0x7ff36802f420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc912209866225fb server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:45.167 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.157+0000 7ff3708c4640 1 -- 10.20.193.49:0/3880931813 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff36803b070 con 0x7ff36c15d7a0 2026-02-17T11:15:45.167 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.157+0000 7ff3708c4640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:45.167 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.157+0000 7ff3708c4640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:15:45.168 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.157+0000 7ff3708c4640 10 monclient: dump: 2026-02-17T11:15:45.168 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:45.168 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:45.168 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:45.168 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:45.168 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:45.168 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:45.168 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:45.168 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:45.168 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:45.168 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:45.168 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.157+0000 7ff3708c4640 10 monclient: _finish_auth 0 2026-02-17T11:15:45.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.157+0000 7ff3708c4640 10 monclient: _check_auth_tickets 2026-02-17T11:15:45.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.157+0000 7ff3708c4640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:45.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.157+0000 7ff373b51640 5 monclient: authenticate success, global_id 5202 2026-02-17T11:15:45.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.157+0000 7ff3708c4640 1 -- 10.20.193.49:0/3880931813 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff368036600 con 0x7ff36c15d7a0 2026-02-17T11:15:45.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.157+0000 7ff373b51640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:15:45.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.157+0000 7ff3708c4640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:45.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.157+0000 7ff373b51640 10 monclient: get_monmap_and_config success 2026-02-17T11:15:45.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.157+0000 7ff3708c4640 1 -- 10.20.193.49:0/3880931813 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3680369d0 con 0x7ff36c15d7a0 2026-02-17T11:15:45.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.157+0000 7ff3708c4640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:45.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.157+0000 7ff373b51640 4 set_mon_vals no callback set 2026-02-17T11:15:45.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.157+0000 7ff3708c4640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:15:45.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.157+0000 7ff3708c4640 10 monclient: dump: 2026-02-17T11:15:45.170 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:45.170 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:45.170 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:45.170 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:45.170 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:45.170 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:45.170 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:45.170 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:45.170 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:45.170 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:45.170 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.157+0000 7ff373b51640 10 monclient: shutdown 2026-02-17T11:15:45.170 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.157+0000 7ff373b51640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:45.170 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.157+0000 7ff373b51640 1 -- 10.20.193.49:0/3880931813 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ff36c15d7a0 msgr2=0x7ff36c15b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:45.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.157+0000 7ff373b51640 1 --2- 10.20.193.49:0/3880931813 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ff36c15d7a0 0x7ff36c15b050 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff368009e50 tx=0x7ff36802f420 comp rx=0 tx=0).stop 2026-02-17T11:15:45.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.157+0000 7ff373b51640 1 -- 10.20.193.49:0/3880931813 shutdown_connections 2026-02-17T11:15:45.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.157+0000 7ff373b51640 1 --2- 10.20.193.49:0/3880931813 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ff36c15d7a0 0x7ff36c15b050 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:45.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.157+0000 7ff373b51640 1 -- 10.20.193.49:0/3880931813 >> 10.20.193.49:0/3880931813 conn(0x7ff36c0c9f60 msgr2=0x7ff36c0ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:45.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.157+0000 7ff373b51640 1 -- 10.20.193.49:0/3880931813 shutdown_connections 2026-02-17T11:15:45.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.157+0000 7ff373b51640 1 -- 10.20.193.49:0/3880931813 wait complete. 2026-02-17T11:15:45.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.158+0000 7ff373b51640 10 monclient: build_initial_monmap 2026-02-17T11:15:45.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.158+0000 7ff373b51640 10 monclient: monmap: 2026-02-17T11:15:45.171 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:45.171 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:15:45.171 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:15:45.171 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:15:45.172 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:45.172 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:45.172 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:15:45.172 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:15:45.172 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:15:45.172 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:45.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.158+0000 7ff373b51640 1 librados: starting msgr at 2026-02-17T11:15:45.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.158+0000 7ff373b51640 1 librados: starting objecter 2026-02-17T11:15:45.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.158+0000 7ff373b51640 1 Processor -- start 2026-02-17T11:15:45.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.158+0000 7ff373b51640 1 -- start start 2026-02-17T11:15:45.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.158+0000 7ff373b51640 1 librados: setting wanted keys 2026-02-17T11:15:45.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.158+0000 7ff373b51640 1 librados: calling monclient init 2026-02-17T11:15:45.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.158+0000 7ff373b51640 10 monclient: init 2026-02-17T11:15:45.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.158+0000 7ff373b51640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:45.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.158+0000 7ff373b51640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:15:45.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.158+0000 7ff373b51640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff36c0c94c0 0x7ff36c158ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:45.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.158+0000 7ff373b51640 10 monclient(hunting): picked mon.noname-c con 0x7ff36c0c94c0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:15:45.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.158+0000 7ff373b51640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ff36c15d3c0 0x7ff36c159940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:45.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.158+0000 7ff373b51640 10 monclient(hunting): picked mon.noname-a con 0x7ff36c15d3c0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:15:45.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.158+0000 7ff373b51640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7ff36c15d7a0 0x7ff36c159e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:45.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.158+0000 7ff373b51640 10 monclient(hunting): picked mon.noname-b con 0x7ff36c15d7a0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:15:45.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.158+0000 7ff373b51640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:45.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.158+0000 7ff373b51640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff36c0c8fa0 con 0x7ff36c15d3c0 2026-02-17T11:15:45.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.158+0000 7ff373b51640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:45.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.158+0000 7ff373b51640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7ff36c0c8cc0 con 0x7ff36c15d7a0 2026-02-17T11:15:45.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.158+0000 7ff373b51640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:45.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.158+0000 7ff373b51640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7ff36c0c5a00 con 0x7ff36c0c94c0 2026-02-17T11:15:45.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.158+0000 7ff373b51640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:45.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.158+0000 7ff373b51640 10 monclient(hunting): authenticate will time out at 1421.822824s 2026-02-17T11:15:45.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.159+0000 7ff3710c5640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ff36c15d3c0 0x7ff36c159940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:45.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.159+0000 7ff3720c7640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7ff36c15d7a0 0x7ff36c159e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:45.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.159+0000 7ff3710c5640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ff36c15d3c0 0x7ff36c159940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:45380/0 (socket says 10.20.193.49:45380) 2026-02-17T11:15:45.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.159+0000 7ff3710c5640 1 -- 10.20.193.49:0/1529015826 learned_addr learned my addr 10.20.193.49:0/1529015826 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:45.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.159+0000 7ff3710c5640 10 monclient(hunting): get_auth_request con 0x7ff36c15d3c0 auth_method 0 2026-02-17T11:15:45.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.159+0000 7ff3710c5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:45.174 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.159+0000 7ff3710c5640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:45.175 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.159+0000 7ff3710c5640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:45.175 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.159+0000 7ff3718c6640 1 --2- 10.20.193.49:0/1529015826 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff36c0c94c0 0x7ff36c158ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:45.175 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.159+0000 7ff3710c5640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:45.175 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.159+0000 7ff3710c5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:45.175 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.159+0000 7ff3710c5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:45.175 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.159+0000 7ff3720c7640 10 monclient(hunting): get_auth_request con 0x7ff36c15d7a0 auth_method 0 2026-02-17T11:15:45.175 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.159+0000 7ff3720c7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:45.175 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.159+0000 7ff3720c7640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:45.175 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.159+0000 7ff3720c7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:45.175 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.159+0000 7ff3718c6640 10 monclient(hunting): get_auth_request con 0x7ff36c0c94c0 auth_method 0 2026-02-17T11:15:45.175 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.159+0000 7ff3718c6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:45.175 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.159+0000 7ff3718c6640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:45.175 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.159+0000 7ff3718c6640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:45.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.159+0000 7ff3720c7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:45.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.159+0000 7ff3720c7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:45.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.159+0000 7ff3720c7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:45.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.159+0000 7ff3718c6640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:45.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.159+0000 7ff3718c6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:45.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.159+0000 7ff3718c6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:45.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.160+0000 7ff3710c5640 10 monclient(hunting): handle_auth_done global_id 5205 payload 824 2026-02-17T11:15:45.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.160+0000 7ff3710c5640 1 -- 10.20.193.49:0/1529015826 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff36c0c94c0 msgr2=0x7ff36c158ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:45.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.160+0000 7ff3710c5640 1 --2- 10.20.193.49:0/1529015826 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7ff36c0c94c0 0x7ff36c158ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:45.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.160+0000 7ff3710c5640 1 -- 10.20.193.49:0/1529015826 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7ff36c15d7a0 msgr2=0x7ff36c159e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:45.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.160+0000 7ff3710c5640 1 --2- 10.20.193.49:0/1529015826 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7ff36c15d7a0 0x7ff36c159e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:45.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.160+0000 7ff3710c5640 10 monclient: _finish_hunting 0 2026-02-17T11:15:45.176 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.160+0000 7ff3710c5640 1 monclient: found mon.noname-a 2026-02-17T11:15:45.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.160+0000 7ff3710c5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:45.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.160+0000 7ff3710c5640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:15:45.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.160+0000 7ff3710c5640 1 -- 10.20.193.49:0/1529015826 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff36c1f3c50 con 0x7ff36c15d3c0 2026-02-17T11:15:45.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.161+0000 7ff3710c5640 1 --2- 10.20.193.49:0/1529015826 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ff36c15d3c0 0x7ff36c159940 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff36000c580 tx=0x7ff36000ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:45.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.161+0000 7ff35a7fc640 10 client.?.objecter ms_handle_connect 0x7ff36c15d3c0 2026-02-17T11:15:45.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.161+0000 7ff35a7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T11:15:45.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.163+0000 7ff35a7fc640 1 -- 10.20.193.49:0/1529015826 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff360017070 con 0x7ff36c15d3c0 2026-02-17T11:15:45.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.163+0000 7ff35a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:45.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.163+0000 7ff35a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:15:45.177 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.163+0000 7ff35a7fc640 10 monclient: dump: 2026-02-17T11:15:45.177 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:45.177 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:45.178 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:45.178 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:45.178 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:45.178 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:45.178 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:45.178 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:45.178 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:45.178 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:45.178 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.163+0000 7ff35a7fc640 10 monclient: _finish_auth 0 2026-02-17T11:15:45.178 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.163+0000 7ff35a7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:15:45.178 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.163+0000 7ff35a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:45.178 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.163+0000 7ff35a7fc640 1 -- 10.20.193.49:0/1529015826 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3600052d0 con 0x7ff36c15d3c0 2026-02-17T11:15:45.178 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.163+0000 7ff35a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:45.179 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.163+0000 7ff35a7fc640 1 -- 10.20.193.49:0/1529015826 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3600036b0 con 0x7ff36c15d3c0 2026-02-17T11:15:45.179 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.163+0000 7ff373b51640 5 monclient: authenticate success, global_id 5205 2026-02-17T11:15:45.179 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.163+0000 7ff35a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:45.179 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.163+0000 7ff35bfff640 4 set_mon_vals no callback set 2026-02-17T11:15:45.179 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.163+0000 7ff35a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:15:45.179 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.163+0000 7ff35a7fc640 10 monclient: dump: 2026-02-17T11:15:45.179 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:45.179 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:45.179 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:45.179 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:45.179 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:45.179 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:45.179 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:45.180 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:45.180 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:45.180 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:45.180 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.163+0000 7ff373b51640 10 monclient: _renew_subs 2026-02-17T11:15:45.180 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.163+0000 7ff373b51640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:45.180 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.163+0000 7ff373b51640 1 -- 10.20.193.49:0/1529015826 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff36c1f3f30 con 0x7ff36c15d3c0 2026-02-17T11:15:45.180 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.163+0000 7ff373b51640 10 client.5205.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:45.180 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.163+0000 7ff373b51640 10 monclient: _renew_subs 2026-02-17T11:15:45.180 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.163+0000 7ff373b51640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:45.180 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.163+0000 7ff373b51640 1 -- 10.20.193.49:0/1529015826 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff36c1f44f0 con 0x7ff36c15d3c0 2026-02-17T11:15:45.180 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.163+0000 7ff373b51640 1 librados: init done 2026-02-17T11:15:45.180 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.163+0000 7ff373b51640 10 client.5205.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:45.180 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.163+0000 7ff373b51640 15 client.5205.objecter _session_command_op_assign -1 1 2026-02-17T11:15:45.181 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.163+0000 7ff373b51640 20 client.5205.objecter _get_session osd=-1 returning homeless 2026-02-17T11:15:45.181 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.163+0000 7ff373b51640 10 client.5205.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:45.181 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.163+0000 7ff373b51640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:45.181 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.163+0000 7ff373b51640 1 -- 10.20.193.49:0/1529015826 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff36c070e90 con 0x7ff36c15d3c0 2026-02-17T11:15:45.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.175+0000 7ff35a7fc640 1 -- 10.20.193.49:0/1529015826 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7ff360003850 con 0x7ff36c15d3c0 2026-02-17T11:15:45.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.176+0000 7ff35a7fc640 1 --2- 10.20.193.49:0/1529015826 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ff33c079170 0x7ff33c07b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:45.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.176+0000 7ff3718c6640 1 --2- 10.20.193.49:0/1529015826 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ff33c079170 0x7ff33c07b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:45.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.176+0000 7ff3718c6640 10 monclient: get_auth_request con 0x7ff33c079170 auth_method 0 2026-02-17T11:15:45.183 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.176+0000 7ff3718c6640 1 --2- 10.20.193.49:0/1529015826 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ff33c079170 0x7ff33c07b630 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff35c0051f0 tx=0x7ff35c007f30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:45.184 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.176+0000 7ff35a7fc640 10 client.5205.objecter ms_handle_connect 0x7ff33c079170 2026-02-17T11:15:45.184 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.177+0000 7ff35a7fc640 1 -- 10.20.193.49:0/1529015826 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7ff360097260 con 0x7ff36c15d3c0 2026-02-17T11:15:45.184 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.177+0000 7ff35a7fc640 10 client.5205.objecter ms_dispatch2 0x7ff36c000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:15:45.184 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.177+0000 7ff35a7fc640 3 client.5205.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:15:45.184 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.177+0000 7ff35a7fc640 3 client.5205.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:15:45.184 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.177+0000 7ff35a7fc640 10 client.5205.objecter checking command 1 2026-02-17T11:15:45.184 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.177+0000 7ff35a7fc640 1 --2- 10.20.193.49:0/1529015826 >> [v2:10.20.193.49:6812/4012737431,v1:10.20.193.49:6814/4012737431] conn(0x7ff33c081650 0x7ff33c083a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:45.184 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.177+0000 7ff35a7fc640 20 client.5205.objecter _get_session s=0x7ff33c080f80 osd=12 3 2026-02-17T11:15:45.184 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.177+0000 7ff35a7fc640 20 client.5205.objecter put_session s=0x7ff33c080f80 osd=12 3 2026-02-17T11:15:45.184 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.177+0000 7ff35a7fc640 15 client.5205.objecter _session_command_op_remove -1 1 2026-02-17T11:15:45.184 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.177+0000 7ff35a7fc640 20 client.5205.objecter _get_session s=0x7ff33c080f80 osd=12 3 2026-02-17T11:15:45.184 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.177+0000 7ff35a7fc640 20 client.5205.objecter get_session s=0x7ff33c080f80 osd=12 3 2026-02-17T11:15:45.185 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.177+0000 7ff35a7fc640 15 client.5205.objecter _session_command_op_assign 12 1 2026-02-17T11:15:45.185 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.177+0000 7ff35a7fc640 20 client.5205.objecter put_session s=0x7ff33c080f80 osd=12 4 2026-02-17T11:15:45.185 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.177+0000 7ff35a7fc640 10 client.5205.objecter _send_command 1 2026-02-17T11:15:45.185 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.177+0000 7ff35a7fc640 1 -- 10.20.193.49:0/1529015826 --> [v2:10.20.193.49:6812/4012737431,v1:10.20.193.49:6814/4012737431] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff360020ec0 con 0x7ff33c081650 2026-02-17T11:15:45.185 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.177+0000 7ff35a7fc640 20 client.5205.objecter dump_active .. 0 homeless 2026-02-17T11:15:45.185 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.177+0000 7ff35a7fc640 1 -- 10.20.193.49:0/1529015826 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ff36005dc90 con 0x7ff36c15d3c0 2026-02-17T11:15:45.185 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.177+0000 7ff35a7fc640 10 monclient: handle_get_version_reply finishing 1 version 34 2026-02-17T11:15:45.185 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.178+0000 7ff3720c7640 1 --2- 10.20.193.49:0/1529015826 >> [v2:10.20.193.49:6812/4012737431,v1:10.20.193.49:6814/4012737431] conn(0x7ff33c081650 0x7ff33c083a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:45.185 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.178+0000 7ff3720c7640 10 monclient: get_auth_request con 0x7ff33c081650 auth_method 0 2026-02-17T11:15:45.185 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.179+0000 7ff3720c7640 1 --2- 10.20.193.49:0/1529015826 >> [v2:10.20.193.49:6812/4012737431,v1:10.20.193.49:6814/4012737431] conn(0x7ff33c081650 0x7ff33c083a70 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.12 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:45.185 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.179+0000 7ff35a7fc640 10 client.5205.objecter ms_handle_connect 0x7ff33c081650 2026-02-17T11:15:45.192 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.189+0000 7ff35a7fc640 1 -- 10.20.193.49:0/1529015826 <== osd.12 v2:10.20.193.49:6812/4012737431 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7ff360020ec0 con 0x7ff33c081650 2026-02-17T11:15:45.192 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.189+0000 7ff35a7fc640 10 client.5205.objecter ms_dispatch2 0x7ff36c000b90 command_reply(tid 1: 0 ) 2026-02-17T11:15:45.192 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.189+0000 7ff35a7fc640 10 client.5205.objecter _finish_command 1 = system:0 2026-02-17T11:15:45.192 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.189+0000 7ff35a7fc640 20 client.5205.objecter put_session s=0x7ff33c080f80 osd=12 4 2026-02-17T11:15:45.192 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.189+0000 7ff35a7fc640 15 client.5205.objecter _session_command_op_remove 12 1 2026-02-17T11:15:45.197 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.195+0000 7ff373b51640 10 client.5205.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T11:15:45.198 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.195+0000 7ff373b51640 15 client.5205.objecter _session_command_op_assign -1 2 2026-02-17T11:15:45.198 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.195+0000 7ff373b51640 20 client.5205.objecter _get_session s=0x7ff33c080f80 osd=12 3 2026-02-17T11:15:45.198 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.195+0000 7ff373b51640 20 client.5205.objecter put_session s=0x7ff33c080f80 osd=12 3 2026-02-17T11:15:45.198 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.195+0000 7ff373b51640 20 client.5205.objecter _get_session s=0x7ff33c080f80 osd=12 3 2026-02-17T11:15:45.198 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.195+0000 7ff373b51640 15 client.5205.objecter _session_command_op_remove -1 2 2026-02-17T11:15:45.198 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.195+0000 7ff373b51640 20 client.5205.objecter get_session s=0x7ff33c080f80 osd=12 3 2026-02-17T11:15:45.198 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.195+0000 7ff373b51640 15 client.5205.objecter _session_command_op_assign 12 2 2026-02-17T11:15:45.198 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.195+0000 7ff373b51640 20 client.5205.objecter put_session s=0x7ff33c080f80 osd=12 4 2026-02-17T11:15:45.198 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.195+0000 7ff373b51640 10 client.5205.objecter _send_command 2 2026-02-17T11:15:45.198 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.195+0000 7ff373b51640 1 -- 10.20.193.49:0/1529015826 --> [v2:10.20.193.49:6812/4012737431,v1:10.20.193.49:6814/4012737431] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff36c1596a0 con 0x7ff33c081650 2026-02-17T11:15:45.205 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.202+0000 7ff35a7fc640 1 -- 10.20.193.49:0/1529015826 <== osd.12 v2:10.20.193.49:6812/4012737431 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff36c1596a0 con 0x7ff33c081650 2026-02-17T11:15:45.205 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.202+0000 7ff35a7fc640 10 client.5205.objecter ms_dispatch2 0x7ff36c000b90 command_reply(tid 2: 0 ) 2026-02-17T11:15:45.205 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.202+0000 7ff35a7fc640 10 client.5205.objecter _finish_command 2 = system:0 2026-02-17T11:15:45.205 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.202+0000 7ff35a7fc640 20 client.5205.objecter put_session s=0x7ff33c080f80 osd=12 4 2026-02-17T11:15:45.205 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.202+0000 7ff35a7fc640 15 client.5205.objecter _session_command_op_remove 12 2 2026-02-17T11:15:45.206 INFO:teuthology.orchestra.run.trial049.stdout:{ 2026-02-17T11:15:45.206 INFO:teuthology.orchestra.run.trial049.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T11:15:45.206 INFO:teuthology.orchestra.run.trial049.stdout:} 2026-02-17T11:15:45.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.203+0000 7ff373b51640 10 librados: watch_flush enter 2026-02-17T11:15:45.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.203+0000 7ff373b51640 10 librados: watch_flush exit 2026-02-17T11:15:45.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.203+0000 7ff373b51640 10 client.5205.objecter close_session for osd.12 2026-02-17T11:15:45.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.203+0000 7ff373b51640 1 -- 10.20.193.49:0/1529015826 >> [v2:10.20.193.49:6812/4012737431,v1:10.20.193.49:6814/4012737431] conn(0x7ff33c081650 msgr2=0x7ff33c083a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:45.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.203+0000 7ff373b51640 1 --2- 10.20.193.49:0/1529015826 >> [v2:10.20.193.49:6812/4012737431,v1:10.20.193.49:6814/4012737431] conn(0x7ff33c081650 0x7ff33c083a70 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:45.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.203+0000 7ff373b51640 20 client.5205.objecter put_session s=0x7ff33c080f80 osd=12 1 2026-02-17T11:15:45.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.203+0000 7ff373b51640 20 client.5205.objecter shutdown clearing up homeless session... 2026-02-17T11:15:45.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.203+0000 7ff373b51640 10 client.5205.objecter successfully canceled tick 2026-02-17T11:15:45.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.203+0000 7ff373b51640 1 -- 10.20.193.49:0/1529015826 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ff33c079170 msgr2=0x7ff33c07b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:45.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.203+0000 7ff373b51640 1 --2- 10.20.193.49:0/1529015826 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7ff33c079170 0x7ff33c07b630 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff35c0051f0 tx=0x7ff35c007f30 comp rx=0 tx=0).stop 2026-02-17T11:15:45.208 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.203+0000 7ff373b51640 10 monclient: shutdown 2026-02-17T11:15:45.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.203+0000 7ff373b51640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:45.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.203+0000 7ff373b51640 1 -- 10.20.193.49:0/1529015826 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ff36c15d3c0 msgr2=0x7ff36c159940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:45.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.203+0000 7ff373b51640 1 --2- 10.20.193.49:0/1529015826 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7ff36c15d3c0 0x7ff36c159940 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff36000c580 tx=0x7ff36000ca50 comp rx=0 tx=0).stop 2026-02-17T11:15:45.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.203+0000 7ff3720c7640 1 -- 10.20.193.49:0/1529015826 reap_dead start 2026-02-17T11:15:45.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.203+0000 7ff373b51640 1 -- 10.20.193.49:0/1529015826 shutdown_connections 2026-02-17T11:15:45.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.203+0000 7ff373b51640 1 -- 10.20.193.49:0/1529015826 >> 10.20.193.49:0/1529015826 conn(0x7ff36c0c9f60 msgr2=0x7ff36c14f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:45.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.203+0000 7ff373b51640 1 -- 10.20.193.49:0/1529015826 shutdown_connections 2026-02-17T11:15:45.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.203+0000 7ff373b51640 1 -- 10.20.193.49:0/1529015826 wait complete. 2026-02-17T11:15:45.209 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.203+0000 7ff373b51640 1 librados: shutdown 2026-02-17T11:15:45.213 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 12 2026-02-17T11:15:45.282 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.279+0000 7fadd3eb7640 10 monclient: get_monmap_and_config 2026-02-17T11:15:45.282 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.279+0000 7fadd3eb7640 10 monclient: build_initial_monmap 2026-02-17T11:15:45.283 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.279+0000 7fadd3eb7640 10 monclient: monmap: 2026-02-17T11:15:45.283 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:45.283 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:45.283 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:15:45.281200+0000 2026-02-17T11:15:45.283 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:15:45.281200+0000 2026-02-17T11:15:45.283 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:45.283 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:45.283 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:15:45.283 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:15:45.283 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:15:45.283 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:15:45.284 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:15:45.284 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:15:45.284 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:45.284 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.280+0000 7fadd3eb7640 1 Processor -- start 2026-02-17T11:15:45.284 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.280+0000 7fadd3eb7640 1 -- start start 2026-02-17T11:15:45.284 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.280+0000 7fadd3eb7640 10 monclient: init 2026-02-17T11:15:45.287 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.280+0000 7fadd3eb7640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:45.287 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.280+0000 7fadd3eb7640 10 monclient: _add_conns ranks=[5,0,1,3,4,2] 2026-02-17T11:15:45.287 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.280+0000 7fadd3eb7640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7fadcc0c7170 0x7fadcc0c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:45.288 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.280+0000 7fadd3eb7640 10 monclient(hunting): picked mon.noname-c con 0x7fadcc0c7170 addr v2:10.20.193.157:3300/0 2026-02-17T11:15:45.288 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.280+0000 7fadd3eb7640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fadcc0c48c0 addr v1:10.20.193.49:6789/0 2026-02-17T11:15:45.288 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.280+0000 7fadd3eb7640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fadcc0c4d10 addr v1:10.20.193.97:6789/0 2026-02-17T11:15:45.288 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.280+0000 7fadd3eb7640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadcc15a9a0 con 0x7fadcc0c48c0 2026-02-17T11:15:45.288 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.280+0000 7fadd3eb7640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadcc0c5270 con 0x7fadcc0c4d10 2026-02-17T11:15:45.288 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.280+0000 7fadd3eb7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:45.288 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.280+0000 7fadd3eb7640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7fadcc0c8530 con 0x7fadcc0c7170 2026-02-17T11:15:45.288 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.280+0000 7fadd3eb7640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:45.288 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.280+0000 7fadd3eb7640 10 monclient(hunting): authenticate will time out at 1421.944774s 2026-02-17T11:15:45.288 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.281+0000 7fadd242d640 1 --1- >> v1:10.20.193.97:6789/0 conn(0x7fadcc0c4d10 0x7fadcc0c89c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.97:6789/0 says I am v1:10.20.193.49:51906/0 (socket says 10.20.193.49:51906) 2026-02-17T11:15:45.288 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.281+0000 7fadd242d640 1 -- 10.20.193.49:0/1557514435 learned_addr learned my addr 10.20.193.49:0/1557514435 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:15:45.288 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.281+0000 7fadd1c2c640 1 --2- 10.20.193.49:0/1557514435 >> v2:10.20.193.157:3300/0 conn(0x7fadcc0c7170 0x7fadcc0c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:45.289 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.281+0000 7fadd1c2c640 10 monclient(hunting): get_auth_request con 0x7fadcc0c7170 auth_method 0 2026-02-17T11:15:45.289 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.281+0000 7fadd1c2c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:45.289 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.281+0000 7fadd1c2c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:45.289 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.281+0000 7fadd1c2c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:45.289 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.281+0000 7fadd1c2c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:45.289 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.281+0000 7fadd1c2c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:45.289 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.281+0000 7fadd1c2c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:45.289 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.282+0000 7fadd0c2a640 1 -- 10.20.193.49:0/1557514435 <== mon.1 v1:10.20.193.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2964661619 0 0) 0x7fadcc0c5270 con 0x7fadcc0c4d10 2026-02-17T11:15:45.289 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.282+0000 7fadd0c2a640 10 monclient(hunting): _negotiate 2026-02-17T11:15:45.289 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.282+0000 7fadd0c2a640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:45.289 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.282+0000 7fadd0c2a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:45.289 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.282+0000 7fadd0c2a640 10 monclient(hunting): my global_id is 5179 2026-02-17T11:15:45.290 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.282+0000 7fadd0c2a640 1 -- 10.20.193.49:0/1557514435 --> v1:10.20.193.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fadb4003620 con 0x7fadcc0c4d10 2026-02-17T11:15:45.290 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.282+0000 7fadd0c2a640 1 -- 10.20.193.49:0/1557514435 <== mon.0 v1:10.20.193.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1111948534 0 0) 0x7fadcc15a9a0 con 0x7fadcc0c48c0 2026-02-17T11:15:45.290 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.282+0000 7fadd0c2a640 10 monclient(hunting): _negotiate 2026-02-17T11:15:45.290 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.282+0000 7fadd0c2a640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:45.290 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.282+0000 7fadd0c2a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:45.290 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.282+0000 7fadd0c2a640 10 monclient(hunting): my global_id is 5208 2026-02-17T11:15:45.290 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.282+0000 7fadd0c2a640 1 -- 10.20.193.49:0/1557514435 --> v1:10.20.193.49:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fadcc0c5270 con 0x7fadcc0c48c0 2026-02-17T11:15:45.290 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.282+0000 7fadd1c2c640 10 monclient(hunting): handle_auth_done global_id 5237 payload 274 2026-02-17T11:15:45.290 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.282+0000 7fadd1c2c640 1 -- 10.20.193.49:0/1557514435 >> v1:10.20.193.97:6789/0 conn(0x7fadcc0c4d10 legacy=0x7fadcc0c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:45.290 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.282+0000 7fadd1c2c640 1 -- 10.20.193.49:0/1557514435 >> v1:10.20.193.49:6789/0 conn(0x7fadcc0c48c0 legacy=0x7fadcc0749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:45.290 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.282+0000 7fadd1c2c640 10 monclient: _finish_hunting 0 2026-02-17T11:15:45.290 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.282+0000 7fadd1c2c640 1 monclient: found mon.noname-c 2026-02-17T11:15:45.291 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.282+0000 7fadd1c2c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:45.291 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.282+0000 7fadd1c2c640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:15:45.291 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.282+0000 7fadd1c2c640 1 -- 10.20.193.49:0/1557514435 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadcc0c5550 con 0x7fadcc0c7170 2026-02-17T11:15:45.291 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.283+0000 7fadd1c2c640 1 --2- 10.20.193.49:0/1557514435 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fadcc0c7170 0x7fadcc0c7550 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fadbc0098a0 tx=0x7fadbc02ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3711599bcc1d85d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:45.297 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.285+0000 7fadd0c2a640 1 -- 10.20.193.49:0/1557514435 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadbc03c070 con 0x7fadcc0c7170 2026-02-17T11:15:45.297 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.285+0000 7fadd0c2a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:45.298 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.285+0000 7fadd0c2a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:15:45.298 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.285+0000 7fadd0c2a640 10 monclient: dump: 2026-02-17T11:15:45.298 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:45.298 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:45.298 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:45.298 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:45.298 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:45.298 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:45.298 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:45.298 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:45.298 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:45.299 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:45.299 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.285+0000 7fadd0c2a640 10 monclient: _finish_auth 0 2026-02-17T11:15:45.299 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.285+0000 7fadd0c2a640 10 monclient: _check_auth_tickets 2026-02-17T11:15:45.299 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.285+0000 7fadd0c2a640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:45.299 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.285+0000 7fadd0c2a640 1 -- 10.20.193.49:0/1557514435 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadbc02fb70 con 0x7fadcc0c7170 2026-02-17T11:15:45.299 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.285+0000 7fadd0c2a640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:45.299 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.285+0000 7fadd3eb7640 5 monclient: authenticate success, global_id 5237 2026-02-17T11:15:45.299 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.285+0000 7fadd0c2a640 1 -- 10.20.193.49:0/1557514435 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadbc037440 con 0x7fadcc0c7170 2026-02-17T11:15:45.299 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.285+0000 7fadd3eb7640 10 monclient: get_monmap_and_config success 2026-02-17T11:15:45.299 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.285+0000 7fadd0c2a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:45.299 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.285+0000 7fadd3eb7640 4 set_mon_vals no callback set 2026-02-17T11:15:45.299 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.285+0000 7fadd0c2a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:15:45.299 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.285+0000 7fadd0c2a640 10 monclient: dump: 2026-02-17T11:15:45.300 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:45.300 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:45.300 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:45.300 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:45.300 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:45.300 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:45.300 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:45.300 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:45.300 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:45.300 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:45.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.286+0000 7fadd3eb7640 10 monclient: shutdown 2026-02-17T11:15:45.300 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.286+0000 7fadd3eb7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:45.301 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.286+0000 7fadd3eb7640 1 -- 10.20.193.49:0/1557514435 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fadcc0c7170 msgr2=0x7fadcc0c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:45.301 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.286+0000 7fadd3eb7640 1 --2- 10.20.193.49:0/1557514435 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fadcc0c7170 0x7fadcc0c7550 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fadbc0098a0 tx=0x7fadbc02ee60 comp rx=0 tx=0).stop 2026-02-17T11:15:45.301 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.286+0000 7fadd3eb7640 1 -- 10.20.193.49:0/1557514435 shutdown_connections 2026-02-17T11:15:45.301 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.286+0000 7fadd3eb7640 1 --2- 10.20.193.49:0/1557514435 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fadcc0c7170 0x7fadcc0c7550 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:45.301 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.286+0000 7fadd3eb7640 1 -- 10.20.193.49:0/1557514435 >> 10.20.193.49:0/1557514435 conn(0x7fadcc0c9f40 msgr2=0x7fadcc0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:45.301 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.286+0000 7fadd3eb7640 1 -- 10.20.193.49:0/1557514435 shutdown_connections 2026-02-17T11:15:45.301 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.286+0000 7fadd3eb7640 1 -- 10.20.193.49:0/1557514435 wait complete. 2026-02-17T11:15:45.301 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.286+0000 7fadd3eb7640 10 monclient: build_initial_monmap 2026-02-17T11:15:45.301 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.286+0000 7fadd3eb7640 10 monclient: monmap: 2026-02-17T11:15:45.301 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:45.301 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:15:45.301 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:15:45.302 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:15:45.302 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:45.302 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:45.302 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:15:45.302 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:15:45.302 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:15:45.302 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:45.302 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.286+0000 7fadd3eb7640 1 librados: starting msgr at 2026-02-17T11:15:45.302 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.286+0000 7fadd3eb7640 1 librados: starting objecter 2026-02-17T11:15:45.302 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.286+0000 7fadd3eb7640 1 Processor -- start 2026-02-17T11:15:45.302 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.287+0000 7fadd3eb7640 1 -- start start 2026-02-17T11:15:45.302 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.287+0000 7fadd3eb7640 1 librados: setting wanted keys 2026-02-17T11:15:45.302 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.287+0000 7fadd3eb7640 1 librados: calling monclient init 2026-02-17T11:15:45.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.287+0000 7fadd3eb7640 10 monclient: init 2026-02-17T11:15:45.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.287+0000 7fadd3eb7640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:45.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.287+0000 7fadd3eb7640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:15:45.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.287+0000 7fadd3eb7640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fadcc0c48c0 0x7fadcc1f1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:45.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.287+0000 7fadd3eb7640 10 monclient(hunting): picked mon.noname-b con 0x7fadcc0c48c0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:15:45.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.287+0000 7fadd3eb7640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fadcc0c4d10 0x7fadcc15dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:45.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.287+0000 7fadd3eb7640 10 monclient(hunting): picked mon.noname-c con 0x7fadcc0c4d10 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:15:45.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.287+0000 7fadd3eb7640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fadcc0c7170 0x7fadcc1f29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:45.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.287+0000 7fadd3eb7640 10 monclient(hunting): picked mon.noname-a con 0x7fadcc0c7170 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:15:45.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.287+0000 7fadd3eb7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:45.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.287+0000 7fadd3eb7640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc0c81c0 con 0x7fadcc0c7170 2026-02-17T11:15:45.303 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.287+0000 7fadd3eb7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:45.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.287+0000 7fadd3eb7640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc0c7ee0 con 0x7fadcc0c48c0 2026-02-17T11:15:45.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.287+0000 7fadd3eb7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:45.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.287+0000 7fadd3eb7640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc0750c0 con 0x7fadcc0c4d10 2026-02-17T11:15:45.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.287+0000 7fadd3eb7640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:45.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.287+0000 7fadd3eb7640 10 monclient(hunting): authenticate will time out at 1421.951426s 2026-02-17T11:15:45.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.287+0000 7fadd242d640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fadcc0c7170 0x7fadcc1f29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:45.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.287+0000 7fadd1c2c640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fadcc0c48c0 0x7fadcc1f1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:45.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.287+0000 7fadd242d640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fadcc0c7170 0x7fadcc1f29d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:45390/0 (socket says 10.20.193.49:45390) 2026-02-17T11:15:45.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.287+0000 7fadd242d640 1 -- 10.20.193.49:0/2608707668 learned_addr learned my addr 10.20.193.49:0/2608707668 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:45.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.287+0000 7fadd242d640 10 monclient(hunting): get_auth_request con 0x7fadcc0c7170 auth_method 0 2026-02-17T11:15:45.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.287+0000 7fadd242d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:45.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.287+0000 7fadd242d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:45.304 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.287+0000 7fadd242d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:45.305 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.287+0000 7fadd142b640 1 --2- 10.20.193.49:0/2608707668 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fadcc0c4d10 0x7fadcc15dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:45.305 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.288+0000 7fadd1c2c640 10 monclient(hunting): get_auth_request con 0x7fadcc0c48c0 auth_method 0 2026-02-17T11:15:45.305 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.288+0000 7fadd1c2c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:45.305 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.288+0000 7fadd1c2c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:45.305 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.288+0000 7fadd1c2c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:45.305 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.288+0000 7fadd142b640 10 monclient(hunting): get_auth_request con 0x7fadcc0c4d10 auth_method 0 2026-02-17T11:15:45.305 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.288+0000 7fadd142b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:45.305 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.288+0000 7fadd142b640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:45.305 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.288+0000 7fadd142b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:45.305 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.288+0000 7fadd242d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:45.305 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.288+0000 7fadd242d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:45.305 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.288+0000 7fadd242d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:45.305 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.288+0000 7fadd1c2c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:45.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.288+0000 7fadd1c2c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:45.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.288+0000 7fadd1c2c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:45.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.288+0000 7fadd142b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:45.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.288+0000 7fadd142b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:45.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.288+0000 7fadd142b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:45.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.289+0000 7fadd242d640 10 monclient(hunting): handle_auth_done global_id 5211 payload 824 2026-02-17T11:15:45.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.289+0000 7fadd242d640 1 -- 10.20.193.49:0/2608707668 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fadcc0c4d10 msgr2=0x7fadcc15dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:45.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.289+0000 7fadd242d640 1 --2- 10.20.193.49:0/2608707668 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fadcc0c4d10 0x7fadcc15dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:45.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.289+0000 7fadd242d640 1 -- 10.20.193.49:0/2608707668 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fadcc0c48c0 msgr2=0x7fadcc1f1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:45.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.289+0000 7fadd242d640 1 --2- 10.20.193.49:0/2608707668 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fadcc0c48c0 0x7fadcc1f1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:45.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.289+0000 7fadd242d640 10 monclient: _finish_hunting 0 2026-02-17T11:15:45.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.289+0000 7fadd242d640 1 monclient: found mon.noname-a 2026-02-17T11:15:45.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.289+0000 7fadd242d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:45.307 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.289+0000 7fadd242d640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:15:45.307 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.289+0000 7fadd242d640 1 -- 10.20.193.49:0/2608707668 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadcc15b260 con 0x7fadcc0c7170 2026-02-17T11:15:45.307 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.290+0000 7fadd242d640 1 --2- 10.20.193.49:0/2608707668 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fadcc0c7170 0x7fadcc1f29d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fadc800ca70 tx=0x7fadc800cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:45.307 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.290+0000 7fadba7fc640 10 client.?.objecter ms_handle_connect 0x7fadcc0c7170 2026-02-17T11:15:45.307 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.290+0000 7fadba7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T11:15:45.307 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.292+0000 7fadba7fc640 1 -- 10.20.193.49:0/2608707668 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc800ac40 con 0x7fadcc0c7170 2026-02-17T11:15:45.307 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.292+0000 7fadba7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:45.307 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.292+0000 7fadba7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:15:45.307 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.292+0000 7fadba7fc640 10 monclient: dump: 2026-02-17T11:15:45.307 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:45.307 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:45.307 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:45.307 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:45.307 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:45.308 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:45.308 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:45.308 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:45.308 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:45.308 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:45.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.292+0000 7fadba7fc640 10 monclient: _finish_auth 0 2026-02-17T11:15:45.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.292+0000 7fadba7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:15:45.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.292+0000 7fadba7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:45.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.292+0000 7fadba7fc640 1 -- 10.20.193.49:0/2608707668 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadc800ade0 con 0x7fadcc0c7170 2026-02-17T11:15:45.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.292+0000 7fadd3eb7640 5 monclient: authenticate success, global_id 5211 2026-02-17T11:15:45.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.292+0000 7fadd3eb7640 10 monclient: _renew_subs 2026-02-17T11:15:45.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.292+0000 7fadd3eb7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:45.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.292+0000 7fadd3eb7640 1 -- 10.20.193.49:0/2608707668 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadcc15b540 con 0x7fadcc0c7170 2026-02-17T11:15:45.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.292+0000 7fadba7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:45.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.292+0000 7fadba7fc640 1 -- 10.20.193.49:0/2608707668 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc8012640 con 0x7fadcc0c7170 2026-02-17T11:15:45.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.292+0000 7fadba7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:45.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.292+0000 7fadba7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:15:45.309 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.292+0000 7fadba7fc640 10 monclient: dump: 2026-02-17T11:15:45.309 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:45.309 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:45.309 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:45.309 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:45.309 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:45.309 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:45.309 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:45.310 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:45.310 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:45.310 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:45.310 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.292+0000 7fadbbfff640 4 set_mon_vals no callback set 2026-02-17T11:15:45.310 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.292+0000 7fadd3eb7640 10 client.5211.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:45.310 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.292+0000 7fadd3eb7640 10 monclient: _renew_subs 2026-02-17T11:15:45.310 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.292+0000 7fadd3eb7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:45.310 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.292+0000 7fadd3eb7640 1 -- 10.20.193.49:0/2608707668 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadcc15bb00 con 0x7fadcc0c7170 2026-02-17T11:15:45.310 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.292+0000 7fadd3eb7640 1 librados: init done 2026-02-17T11:15:45.310 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.293+0000 7fadd3eb7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:45.310 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.293+0000 7fadd3eb7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:45.310 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.293+0000 7fadd3eb7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:45.311 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.293+0000 7fadd3eb7640 1 -- 10.20.193.49:0/2608707668 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadcc0c7550 con 0x7fadcc0c7170 2026-02-17T11:15:45.312 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.304+0000 7fadba7fc640 1 -- 10.20.193.49:0/2608707668 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7fadc80127e0 con 0x7fadcc0c7170 2026-02-17T11:15:45.312 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.305+0000 7fadba7fc640 1 --2- 10.20.193.49:0/2608707668 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fad9c079190 0x7fad9c07b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:45.312 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.305+0000 7fadd1c2c640 1 --2- 10.20.193.49:0/2608707668 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fad9c079190 0x7fad9c07b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:45.312 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.305+0000 7fadd1c2c640 10 monclient: get_auth_request con 0x7fad9c079190 auth_method 0 2026-02-17T11:15:45.312 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.305+0000 7fadba7fc640 10 client.5211.objecter ms_handle_connect 0x7fad9c079190 2026-02-17T11:15:45.312 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.305+0000 7fadd1c2c640 1 --2- 10.20.193.49:0/2608707668 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fad9c079190 0x7fad9c07b650 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fadbc039000 tx=0x7fadbc033000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:45.312 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.306+0000 7fadba7fc640 1 -- 10.20.193.49:0/2608707668 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7fadc805ea80 con 0x7fadcc0c7170 2026-02-17T11:15:45.312 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.306+0000 7fadba7fc640 10 client.5211.objecter ms_dispatch2 0x7fadcc000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:15:45.312 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.306+0000 7fadba7fc640 3 client.5211.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:15:45.312 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.306+0000 7fadba7fc640 3 client.5211.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:15:45.313 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.306+0000 7fadba7fc640 20 client.5211.objecter dump_active .. 0 homeless 2026-02-17T11:15:45.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.407+0000 7fadba7fc640 1 -- 10.20.193.49:0/2608707668 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fadc8062a40 con 0x7fadcc0c7170 2026-02-17T11:15:45.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.407+0000 7fadba7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:45.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.407+0000 7fadba7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:15:45.496 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.493+0000 7fadd3eb7640 1 -- 10.20.193.49:0/2608707668 --> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "12", "target": ["mon-mgr", ""]}) -- 0x7fadcc0c0920 con 0x7fad9c079190 2026-02-17T11:15:45.496 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.494+0000 7fadba7fc640 1 -- 10.20.193.49:0/2608707668 <== mgr.4106 v2:10.20.193.162:6800/2614632098 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 12 to deep-scrub) ==== 42+0+0 (secure 0 0 0) 0x7fadcc0c0920 con 0x7fad9c079190 2026-02-17T11:15:45.497 INFO:teuthology.orchestra.run.trial049.stderr:instructed osd(s) 12 to deep-scrub 2026-02-17T11:15:45.499 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.495+0000 7fadd3eb7640 10 librados: watch_flush enter 2026-02-17T11:15:45.500 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.495+0000 7fadd3eb7640 10 librados: watch_flush exit 2026-02-17T11:15:45.500 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.495+0000 7fadd3eb7640 20 client.5211.objecter shutdown clearing up homeless session... 2026-02-17T11:15:45.500 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.495+0000 7fadd3eb7640 10 client.5211.objecter successfully canceled tick 2026-02-17T11:15:45.500 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.495+0000 7fadd3eb7640 1 -- 10.20.193.49:0/2608707668 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fad9c079190 msgr2=0x7fad9c07b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:45.500 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.495+0000 7fadd3eb7640 1 --2- 10.20.193.49:0/2608707668 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fad9c079190 0x7fad9c07b650 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fadbc039000 tx=0x7fadbc033000 comp rx=0 tx=0).stop 2026-02-17T11:15:45.501 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.495+0000 7fadd3eb7640 10 monclient: shutdown 2026-02-17T11:15:45.501 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.495+0000 7fadd3eb7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:45.501 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.495+0000 7fadd3eb7640 1 -- 10.20.193.49:0/2608707668 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fadcc0c7170 msgr2=0x7fadcc1f29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:45.501 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.495+0000 7fadd3eb7640 1 --2- 10.20.193.49:0/2608707668 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fadcc0c7170 0x7fadcc1f29d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fadc800ca70 tx=0x7fadc800cf40 comp rx=0 tx=0).stop 2026-02-17T11:15:45.501 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.495+0000 7fadd3eb7640 1 -- 10.20.193.49:0/2608707668 shutdown_connections 2026-02-17T11:15:45.501 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.495+0000 7fadd3eb7640 1 --2- 10.20.193.49:0/2608707668 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fad9c079190 0x7fad9c07b650 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:45.502 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.495+0000 7fadd3eb7640 1 --2- 10.20.193.49:0/2608707668 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fadcc0c7170 0x7fadcc1f29d0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:45.502 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.495+0000 7fadd3eb7640 1 --2- 10.20.193.49:0/2608707668 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fadcc0c4d10 0x7fadcc15dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:45.502 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.495+0000 7fadd3eb7640 1 --2- 10.20.193.49:0/2608707668 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fadcc0c48c0 0x7fadcc1f1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:45.502 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.495+0000 7fadd3eb7640 1 -- 10.20.193.49:0/2608707668 >> 10.20.193.49:0/2608707668 conn(0x7fadcc0c9f40 msgr2=0x7fadcc0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:45.502 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.495+0000 7fadd3eb7640 1 -- 10.20.193.49:0/2608707668 shutdown_connections 2026-02-17T11:15:45.502 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.495+0000 7fadd3eb7640 1 -- 10.20.193.49:0/2608707668 wait complete. 2026-02-17T11:15:45.502 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.496+0000 7fadd3eb7640 1 librados: shutdown 2026-02-17T11:15:45.507 INFO:tasks.ceph:Scrubbing osd.1 2026-02-17T11:15:45.507 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-02-17T11:15:45.576 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.573+0000 7fd6bfee8640 10 monclient: get_monmap_and_config 2026-02-17T11:15:45.576 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.573+0000 7fd6bfee8640 10 monclient: build_initial_monmap 2026-02-17T11:15:45.576 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.573+0000 7fd6bfee8640 10 monclient: monmap: 2026-02-17T11:15:45.576 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:45.576 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:45.576 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:15:45.574607+0000 2026-02-17T11:15:45.576 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:15:45.574607+0000 2026-02-17T11:15:45.577 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:45.577 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:45.577 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:15:45.577 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:15:45.577 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:15:45.577 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:15:45.577 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:15:45.577 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:15:45.577 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:45.577 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.573+0000 7fd6bfee8640 1 Processor -- start 2026-02-17T11:15:45.578 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.573+0000 7fd6bfee8640 1 -- start start 2026-02-17T11:15:45.578 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.573+0000 7fd6bfee8640 10 monclient: init 2026-02-17T11:15:45.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.574+0000 7fd6bfee8640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:45.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.574+0000 7fd6bfee8640 10 monclient: _add_conns ranks=[1,5,0,2,3,4] 2026-02-17T11:15:45.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.574+0000 7fd6bfee8640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fd6b815d3c0 addr v1:10.20.193.97:6789/0 2026-02-17T11:15:45.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.574+0000 7fd6bfee8640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7fd6b80c94c0 0x7fd6b815d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:45.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.574+0000 7fd6bfee8640 10 monclient(hunting): picked mon.noname-c con 0x7fd6b80c94c0 addr v2:10.20.193.157:3300/0 2026-02-17T11:15:45.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.574+0000 7fd6bfee8640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd6b815b050 addr v1:10.20.193.49:6789/0 2026-02-17T11:15:45.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.574+0000 7fd6bfee8640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6b815b4e0 con 0x7fd6b815b050 2026-02-17T11:15:45.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.574+0000 7fd6bfee8640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6b80c7e60 con 0x7fd6b815d3c0 2026-02-17T11:15:45.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.574+0000 7fd6bfee8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:45.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.574+0000 7fd6bfee8640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7fd6b80c8140 con 0x7fd6b80c94c0 2026-02-17T11:15:45.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.574+0000 7fd6bfee8640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:45.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.574+0000 7fd6bfee8640 10 monclient(hunting): authenticate will time out at 1422.238088s 2026-02-17T11:15:45.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.574+0000 7fd6bd45c640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7fd6b80c94c0 0x7fd6b815d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:45.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.574+0000 7fd6be45e640 1 --1- >> v1:10.20.193.49:6789/0 conn(0x7fd6b815b050 0x7fd6b80c52f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.49:6789/0 says I am v1:10.20.193.49:46158/0 (socket says 10.20.193.49:46158) 2026-02-17T11:15:45.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.574+0000 7fd6be45e640 1 -- 10.20.193.49:0/1545715943 learned_addr learned my addr 10.20.193.49:0/1545715943 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:15:45.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.574+0000 7fd6bd45c640 10 monclient(hunting): get_auth_request con 0x7fd6b80c94c0 auth_method 0 2026-02-17T11:15:45.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.574+0000 7fd6bd45c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:45.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.574+0000 7fd6bd45c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:45.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.574+0000 7fd6bd45c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:45.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.575+0000 7fd6bd45c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:45.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.575+0000 7fd6bd45c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:45.589 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.575+0000 7fd6bd45c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:45.589 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.575+0000 7fd6bd45c640 10 monclient(hunting): handle_auth_done global_id 5243 payload 274 2026-02-17T11:15:45.589 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.575+0000 7fd6bd45c640 1 -- 10.20.193.49:0/1545715943 >> v1:10.20.193.97:6789/0 conn(0x7fd6b815d3c0 legacy=0x7fd6b80c7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:45.589 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.575+0000 7fd6bd45c640 1 -- 10.20.193.49:0/1545715943 >> v1:10.20.193.49:6789/0 conn(0x7fd6b815b050 legacy=0x7fd6b80c52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:45.589 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.575+0000 7fd6bd45c640 10 monclient: _finish_hunting 0 2026-02-17T11:15:45.589 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.575+0000 7fd6bd45c640 1 monclient: found mon.noname-c 2026-02-17T11:15:45.589 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.575+0000 7fd6bd45c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:45.589 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.575+0000 7fd6bd45c640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:15:45.589 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.575+0000 7fd6bd45c640 1 -- 10.20.193.49:0/1545715943 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6b80c8420 con 0x7fd6b80c94c0 2026-02-17T11:15:45.589 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.576+0000 7fd6bd45c640 1 --2- 10.20.193.49:0/1545715943 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fd6b80c94c0 0x7fd6b815d7a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac0098a0 tx=0x7fd6ac02ef90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4859a986cbe347a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:45.589 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.578+0000 7fd6bcc5b640 1 -- 10.20.193.49:0/1545715943 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6ac03c070 con 0x7fd6b80c94c0 2026-02-17T11:15:45.590 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.578+0000 7fd6bcc5b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:45.590 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.578+0000 7fd6bcc5b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:15:45.590 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.578+0000 7fd6bcc5b640 10 monclient: dump: 2026-02-17T11:15:45.590 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:45.590 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:45.590 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:45.590 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:45.590 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:45.590 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:45.590 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:45.590 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:45.591 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:45.591 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:45.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.578+0000 7fd6bcc5b640 10 monclient: _finish_auth 0 2026-02-17T11:15:45.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.578+0000 7fd6bcc5b640 10 monclient: _check_auth_tickets 2026-02-17T11:15:45.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.578+0000 7fd6bcc5b640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:45.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.578+0000 7fd6bfee8640 5 monclient: authenticate success, global_id 5243 2026-02-17T11:15:45.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.578+0000 7fd6bcc5b640 1 -- 10.20.193.49:0/1545715943 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6ac02fca0 con 0x7fd6b80c94c0 2026-02-17T11:15:45.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.578+0000 7fd6bcc5b640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:45.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.578+0000 7fd6bcc5b640 1 -- 10.20.193.49:0/1545715943 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6ac037660 con 0x7fd6b80c94c0 2026-02-17T11:15:45.591 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.578+0000 7fd6bcc5b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:45.592 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.578+0000 7fd6bcc5b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:15:45.592 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.578+0000 7fd6bcc5b640 10 monclient: dump: 2026-02-17T11:15:45.592 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:45.592 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:45.592 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:45.592 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:45.592 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:45.592 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:45.592 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:45.592 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:45.592 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:45.593 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:45.593 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.578+0000 7fd6bfee8640 10 monclient: get_monmap_and_config success 2026-02-17T11:15:45.593 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.578+0000 7fd6bfee8640 4 set_mon_vals no callback set 2026-02-17T11:15:45.593 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.579+0000 7fd6bfee8640 10 monclient: shutdown 2026-02-17T11:15:45.593 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.579+0000 7fd6bfee8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:45.593 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.579+0000 7fd6bfee8640 1 -- 10.20.193.49:0/1545715943 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fd6b80c94c0 msgr2=0x7fd6b815d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:45.593 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.579+0000 7fd6bfee8640 1 --2- 10.20.193.49:0/1545715943 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fd6b80c94c0 0x7fd6b815d7a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac0098a0 tx=0x7fd6ac02ef90 comp rx=0 tx=0).stop 2026-02-17T11:15:45.593 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.579+0000 7fd6bfee8640 1 -- 10.20.193.49:0/1545715943 shutdown_connections 2026-02-17T11:15:45.593 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.579+0000 7fd6bfee8640 1 --2- 10.20.193.49:0/1545715943 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fd6b80c94c0 0x7fd6b815d7a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:45.593 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.579+0000 7fd6bfee8640 1 -- 10.20.193.49:0/1545715943 >> 10.20.193.49:0/1545715943 conn(0x7fd6b80c9f60 msgr2=0x7fd6b80ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:45.594 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.579+0000 7fd6bfee8640 1 -- 10.20.193.49:0/1545715943 shutdown_connections 2026-02-17T11:15:45.594 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.579+0000 7fd6bfee8640 1 -- 10.20.193.49:0/1545715943 wait complete. 2026-02-17T11:15:45.594 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.579+0000 7fd6bfee8640 10 monclient: build_initial_monmap 2026-02-17T11:15:45.594 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.579+0000 7fd6bfee8640 10 monclient: monmap: 2026-02-17T11:15:45.594 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:45.594 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:15:45.594 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:15:45.594 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:15:45.594 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:45.595 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:45.595 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:15:45.595 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:15:45.595 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:15:45.595 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:45.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.579+0000 7fd6bfee8640 1 librados: starting msgr at 2026-02-17T11:15:45.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.579+0000 7fd6bfee8640 1 librados: starting objecter 2026-02-17T11:15:45.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.580+0000 7fd6bfee8640 1 Processor -- start 2026-02-17T11:15:45.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.580+0000 7fd6bfee8640 1 -- start start 2026-02-17T11:15:45.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.580+0000 7fd6bfee8640 1 librados: setting wanted keys 2026-02-17T11:15:45.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.580+0000 7fd6bfee8640 1 librados: calling monclient init 2026-02-17T11:15:45.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.580+0000 7fd6bfee8640 10 monclient: init 2026-02-17T11:15:45.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.580+0000 7fd6bfee8640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:45.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.580+0000 7fd6bfee8640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:15:45.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.580+0000 7fd6bfee8640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fd6b80c94c0 0x7fd6b81e5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:45.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.580+0000 7fd6bfee8640 10 monclient(hunting): picked mon.noname-b con 0x7fd6b80c94c0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:15:45.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.580+0000 7fd6bfee8640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fd6b815b050 0x7fd6b814c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:45.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.580+0000 7fd6bfee8640 10 monclient(hunting): picked mon.noname-a con 0x7fd6b815b050 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:15:45.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.580+0000 7fd6bfee8640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fd6b815d3c0 0x7fd6b81414c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:45.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.580+0000 7fd6bfee8640 10 monclient(hunting): picked mon.noname-c con 0x7fd6b815d3c0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:15:45.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.580+0000 7fd6bfee8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:45.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.580+0000 7fd6bfee8640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b80c8cc0 con 0x7fd6b815b050 2026-02-17T11:15:45.597 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.580+0000 7fd6bfee8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:45.597 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.580+0000 7fd6bfee8640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b80c89e0 con 0x7fd6b80c94c0 2026-02-17T11:15:45.597 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.580+0000 7fd6bfee8640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:45.597 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.580+0000 7fd6bfee8640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b80c8fa0 con 0x7fd6b815d3c0 2026-02-17T11:15:45.597 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.580+0000 7fd6bfee8640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:45.597 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.580+0000 7fd6bfee8640 10 monclient(hunting): authenticate will time out at 1422.244491s 2026-02-17T11:15:45.597 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.580+0000 7fd6bd45c640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fd6b815b050 0x7fd6b814c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:45.597 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.580+0000 7fd6bdc5d640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fd6b80c94c0 0x7fd6b81e5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:45.597 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.580+0000 7fd6be45e640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fd6b815d3c0 0x7fd6b81414c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:45.597 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.581+0000 7fd6bd45c640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fd6b815b050 0x7fd6b814c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:45402/0 (socket says 10.20.193.49:45402) 2026-02-17T11:15:45.597 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.581+0000 7fd6bd45c640 1 -- 10.20.193.49:0/664958494 learned_addr learned my addr 10.20.193.49:0/664958494 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:45.597 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.581+0000 7fd6bd45c640 10 monclient(hunting): get_auth_request con 0x7fd6b815b050 auth_method 0 2026-02-17T11:15:45.598 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.581+0000 7fd6bd45c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:45.598 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.581+0000 7fd6bd45c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:45.598 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.581+0000 7fd6bd45c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:45.598 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.581+0000 7fd6bdc5d640 10 monclient(hunting): get_auth_request con 0x7fd6b80c94c0 auth_method 0 2026-02-17T11:15:45.598 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.581+0000 7fd6bdc5d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:45.598 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.581+0000 7fd6bdc5d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:45.598 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.581+0000 7fd6bdc5d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:45.598 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.581+0000 7fd6be45e640 10 monclient(hunting): get_auth_request con 0x7fd6b815d3c0 auth_method 0 2026-02-17T11:15:45.598 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.581+0000 7fd6be45e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:45.598 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.581+0000 7fd6be45e640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:45.598 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.581+0000 7fd6be45e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:45.598 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.581+0000 7fd6bd45c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:45.598 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.581+0000 7fd6bd45c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:45.599 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.581+0000 7fd6bd45c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:45.599 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.581+0000 7fd6bdc5d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:45.599 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.581+0000 7fd6bdc5d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:45.599 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.581+0000 7fd6bdc5d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:45.599 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.581+0000 7fd6be45e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:45.599 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.581+0000 7fd6be45e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:45.599 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.581+0000 7fd6be45e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:45.599 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.582+0000 7fd6be45e640 10 monclient(hunting): handle_auth_done global_id 5246 payload 824 2026-02-17T11:15:45.599 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.583+0000 7fd6be45e640 1 -- 10.20.193.49:0/664958494 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fd6b80c94c0 msgr2=0x7fd6b81e5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:45.599 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.583+0000 7fd6be45e640 1 --2- 10.20.193.49:0/664958494 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fd6b80c94c0 0x7fd6b81e5b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:45.599 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.583+0000 7fd6be45e640 1 -- 10.20.193.49:0/664958494 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fd6b815b050 msgr2=0x7fd6b814c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:45.599 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.583+0000 7fd6be45e640 1 --2- 10.20.193.49:0/664958494 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fd6b815b050 0x7fd6b814c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:45.599 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.583+0000 7fd6be45e640 10 monclient: _finish_hunting 0 2026-02-17T11:15:45.600 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.583+0000 7fd6be45e640 1 monclient: found mon.noname-c 2026-02-17T11:15:45.600 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.583+0000 7fd6be45e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:45.600 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.583+0000 7fd6be45e640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:15:45.600 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.583+0000 7fd6be45e640 1 -- 10.20.193.49:0/664958494 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6b81e6250 con 0x7fd6b815d3c0 2026-02-17T11:15:45.600 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.584+0000 7fd6be45e640 1 --2- 10.20.193.49:0/664958494 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fd6b815d3c0 0x7fd6b81414c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd6b400cb10 tx=0x7fd6b400a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:45.600 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.584+0000 7fd6a67fc640 10 client.?.objecter ms_handle_connect 0x7fd6b815d3c0 2026-02-17T11:15:45.600 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.584+0000 7fd6a67fc640 10 client.?.objecter resend_mon_ops 2026-02-17T11:15:45.605 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.585+0000 7fd6a67fc640 1 -- 10.20.193.49:0/664958494 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6b4017070 con 0x7fd6b815d3c0 2026-02-17T11:15:45.605 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.585+0000 7fd6a67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:45.605 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.585+0000 7fd6a67fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:15:45.605 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.585+0000 7fd6a67fc640 10 monclient: dump: 2026-02-17T11:15:45.605 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:45.605 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:45.605 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:45.605 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:45.606 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:45.606 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:45.606 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:45.606 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:45.606 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:45.606 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:45.606 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.585+0000 7fd6a67fc640 10 monclient: _finish_auth 0 2026-02-17T11:15:45.606 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.585+0000 7fd6a67fc640 10 monclient: _check_auth_tickets 2026-02-17T11:15:45.606 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.585+0000 7fd6a67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:45.606 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.585+0000 7fd6a67fc640 1 -- 10.20.193.49:0/664958494 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6b400acb0 con 0x7fd6b815d3c0 2026-02-17T11:15:45.606 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.585+0000 7fd6bfee8640 5 monclient: authenticate success, global_id 5246 2026-02-17T11:15:45.607 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.585+0000 7fd6bfee8640 10 monclient: _renew_subs 2026-02-17T11:15:45.607 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.585+0000 7fd6bfee8640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:15:45.607 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.585+0000 7fd6bfee8640 1 -- 10.20.193.49:0/664958494 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6b81e6530 con 0x7fd6b815d3c0 2026-02-17T11:15:45.607 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.585+0000 7fd6a67fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:45.607 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.585+0000 7fd6a67fc640 1 -- 10.20.193.49:0/664958494 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6b400ae60 con 0x7fd6b815d3c0 2026-02-17T11:15:45.607 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.585+0000 7fd6a67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:45.607 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.585+0000 7fd6a67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:15:45.607 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.585+0000 7fd6a7fff640 4 set_mon_vals no callback set 2026-02-17T11:15:45.607 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.585+0000 7fd6a67fc640 10 monclient: dump: 2026-02-17T11:15:45.607 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:45.608 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:45.608 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:45.608 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:45.608 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:45.608 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:45.608 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:45.608 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:45.608 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:45.608 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:45.608 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.585+0000 7fd6bfee8640 10 client.5246.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:45.608 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.585+0000 7fd6bfee8640 10 monclient: _renew_subs 2026-02-17T11:15:45.609 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.585+0000 7fd6bfee8640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:15:45.609 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.585+0000 7fd6bfee8640 1 -- 10.20.193.49:0/664958494 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6b8140cc0 con 0x7fd6b815d3c0 2026-02-17T11:15:45.609 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.585+0000 7fd6bfee8640 1 librados: init done 2026-02-17T11:15:45.609 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.586+0000 7fd6bfee8640 10 client.5246.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:45.609 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.586+0000 7fd6bfee8640 15 client.5246.objecter _session_command_op_assign -1 1 2026-02-17T11:15:45.609 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.586+0000 7fd6bfee8640 20 client.5246.objecter _get_session osd=-1 returning homeless 2026-02-17T11:15:45.609 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.586+0000 7fd6bfee8640 10 client.5246.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:45.609 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.586+0000 7fd6bfee8640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:15:45.609 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.586+0000 7fd6bfee8640 1 -- 10.20.193.49:0/664958494 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd6b81e6a50 con 0x7fd6b815d3c0 2026-02-17T11:15:45.609 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.598+0000 7fd6a67fc640 1 -- 10.20.193.49:0/664958494 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7fd6b401b3b0 con 0x7fd6b815d3c0 2026-02-17T11:15:45.610 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.598+0000 7fd6a67fc640 1 --2- 10.20.193.49:0/664958494 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fd688079140 0x7fd68807b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:45.610 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.599+0000 7fd6bdc5d640 1 --2- 10.20.193.49:0/664958494 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fd688079140 0x7fd68807b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:45.610 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.599+0000 7fd6bdc5d640 10 monclient: get_auth_request con 0x7fd688079140 auth_method 0 2026-02-17T11:15:45.610 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.599+0000 7fd6a67fc640 10 client.5246.objecter ms_handle_connect 0x7fd688079140 2026-02-17T11:15:45.610 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.599+0000 7fd6bdc5d640 1 --2- 10.20.193.49:0/664958494 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fd688079140 0x7fd68807b600 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd6a8005110 tx=0x7fd6a8007f30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:45.610 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.600+0000 7fd6a67fc640 1 -- 10.20.193.49:0/664958494 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7fd6b4097be0 con 0x7fd6b815d3c0 2026-02-17T11:15:45.610 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.600+0000 7fd6a67fc640 10 client.5246.objecter ms_dispatch2 0x7fd6b8000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:15:45.610 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.600+0000 7fd6a67fc640 3 client.5246.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:15:45.610 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.600+0000 7fd6a67fc640 3 client.5246.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:15:45.610 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.600+0000 7fd6a67fc640 10 client.5246.objecter checking command 1 2026-02-17T11:15:45.610 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.600+0000 7fd6a67fc640 1 --2- 10.20.193.49:0/664958494 >> [v2:10.20.193.97:6816/4259563897,v1:10.20.193.97:6817/4259563897] conn(0x7fd688081620 0x7fd688083a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:45.610 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.600+0000 7fd6a67fc640 20 client.5246.objecter _get_session s=0x7fd688080f50 osd=1 3 2026-02-17T11:15:45.611 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.600+0000 7fd6a67fc640 20 client.5246.objecter put_session s=0x7fd688080f50 osd=1 3 2026-02-17T11:15:45.611 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.600+0000 7fd6a67fc640 15 client.5246.objecter _session_command_op_remove -1 1 2026-02-17T11:15:45.611 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.600+0000 7fd6a67fc640 20 client.5246.objecter _get_session s=0x7fd688080f50 osd=1 3 2026-02-17T11:15:45.611 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.600+0000 7fd6a67fc640 20 client.5246.objecter get_session s=0x7fd688080f50 osd=1 3 2026-02-17T11:15:45.611 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.600+0000 7fd6a67fc640 15 client.5246.objecter _session_command_op_assign 1 1 2026-02-17T11:15:45.611 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.600+0000 7fd6a67fc640 20 client.5246.objecter put_session s=0x7fd688080f50 osd=1 4 2026-02-17T11:15:45.611 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.600+0000 7fd6a67fc640 10 client.5246.objecter _send_command 1 2026-02-17T11:15:45.611 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.600+0000 7fd6a67fc640 1 -- 10.20.193.49:0/664958494 --> [v2:10.20.193.97:6816/4259563897,v1:10.20.193.97:6817/4259563897] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd6b401bbb0 con 0x7fd688081620 2026-02-17T11:15:45.611 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.600+0000 7fd6a67fc640 20 client.5246.objecter dump_active .. 0 homeless 2026-02-17T11:15:45.611 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.600+0000 7fd6a67fc640 1 -- 10.20.193.49:0/664958494 <== mon.2 v2:10.20.193.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fd6b405e500 con 0x7fd6b815d3c0 2026-02-17T11:15:45.611 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.600+0000 7fd6a67fc640 10 monclient: handle_get_version_reply finishing 1 version 34 2026-02-17T11:15:45.611 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.601+0000 7fd6bd45c640 1 --2- 10.20.193.49:0/664958494 >> [v2:10.20.193.97:6816/4259563897,v1:10.20.193.97:6817/4259563897] conn(0x7fd688081620 0x7fd688083a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:45.612 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.601+0000 7fd6bd45c640 10 monclient: get_auth_request con 0x7fd688081620 auth_method 0 2026-02-17T11:15:45.612 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.603+0000 7fd6bd45c640 1 --2- 10.20.193.49:0/664958494 >> [v2:10.20.193.97:6816/4259563897,v1:10.20.193.97:6817/4259563897] conn(0x7fd688081620 0x7fd688083a40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:45.612 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.603+0000 7fd6a67fc640 10 client.5246.objecter ms_handle_connect 0x7fd688081620 2026-02-17T11:15:45.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.613+0000 7fd6a67fc640 1 -- 10.20.193.49:0/664958494 <== osd.1 v2:10.20.193.97:6816/4259563897 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fd6b401bbb0 con 0x7fd688081620 2026-02-17T11:15:45.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.613+0000 7fd6a67fc640 10 client.5246.objecter ms_dispatch2 0x7fd6b8000b90 command_reply(tid 1: 0 ) 2026-02-17T11:15:45.615 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.613+0000 7fd6a67fc640 10 client.5246.objecter _finish_command 1 = system:0 2026-02-17T11:15:45.616 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.613+0000 7fd6a67fc640 20 client.5246.objecter put_session s=0x7fd688080f50 osd=1 4 2026-02-17T11:15:45.616 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.613+0000 7fd6a67fc640 15 client.5246.objecter _session_command_op_remove 1 1 2026-02-17T11:15:45.621 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.619+0000 7fd6bfee8640 10 client.5246.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T11:15:45.622 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.619+0000 7fd6bfee8640 15 client.5246.objecter _session_command_op_assign -1 2 2026-02-17T11:15:45.622 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.619+0000 7fd6bfee8640 20 client.5246.objecter _get_session s=0x7fd688080f50 osd=1 3 2026-02-17T11:15:45.622 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.619+0000 7fd6bfee8640 20 client.5246.objecter put_session s=0x7fd688080f50 osd=1 3 2026-02-17T11:15:45.622 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.619+0000 7fd6bfee8640 20 client.5246.objecter _get_session s=0x7fd688080f50 osd=1 3 2026-02-17T11:15:45.622 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.619+0000 7fd6bfee8640 15 client.5246.objecter _session_command_op_remove -1 2 2026-02-17T11:15:45.622 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.619+0000 7fd6bfee8640 20 client.5246.objecter get_session s=0x7fd688080f50 osd=1 3 2026-02-17T11:15:45.622 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.619+0000 7fd6bfee8640 15 client.5246.objecter _session_command_op_assign 1 2 2026-02-17T11:15:45.622 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.619+0000 7fd6bfee8640 20 client.5246.objecter put_session s=0x7fd688080f50 osd=1 4 2026-02-17T11:15:45.622 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.619+0000 7fd6bfee8640 10 client.5246.objecter _send_command 2 2026-02-17T11:15:45.623 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.619+0000 7fd6bfee8640 1 -- 10.20.193.49:0/664958494 --> [v2:10.20.193.97:6816/4259563897,v1:10.20.193.97:6817/4259563897] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd6b815d7a0 con 0x7fd688081620 2026-02-17T11:15:45.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.625+0000 7fd6a67fc640 1 -- 10.20.193.49:0/664958494 <== osd.1 v2:10.20.193.97:6816/4259563897 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd6b815d7a0 con 0x7fd688081620 2026-02-17T11:15:45.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.625+0000 7fd6a67fc640 10 client.5246.objecter ms_dispatch2 0x7fd6b8000b90 command_reply(tid 2: 0 ) 2026-02-17T11:15:45.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.625+0000 7fd6a67fc640 10 client.5246.objecter _finish_command 2 = system:0 2026-02-17T11:15:45.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.625+0000 7fd6a67fc640 20 client.5246.objecter put_session s=0x7fd688080f50 osd=1 4 2026-02-17T11:15:45.628 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.625+0000 7fd6a67fc640 15 client.5246.objecter _session_command_op_remove 1 2 2026-02-17T11:15:45.629 INFO:teuthology.orchestra.run.trial049.stdout:{ 2026-02-17T11:15:45.629 INFO:teuthology.orchestra.run.trial049.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T11:15:45.629 INFO:teuthology.orchestra.run.trial049.stdout:} 2026-02-17T11:15:45.631 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.625+0000 7fd6bfee8640 10 librados: watch_flush enter 2026-02-17T11:15:45.631 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.625+0000 7fd6bfee8640 10 librados: watch_flush exit 2026-02-17T11:15:45.631 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.625+0000 7fd6bfee8640 10 client.5246.objecter close_session for osd.1 2026-02-17T11:15:45.631 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.625+0000 7fd6bfee8640 1 -- 10.20.193.49:0/664958494 >> [v2:10.20.193.97:6816/4259563897,v1:10.20.193.97:6817/4259563897] conn(0x7fd688081620 msgr2=0x7fd688083a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:45.631 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.625+0000 7fd6bfee8640 1 --2- 10.20.193.49:0/664958494 >> [v2:10.20.193.97:6816/4259563897,v1:10.20.193.97:6817/4259563897] conn(0x7fd688081620 0x7fd688083a40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:45.631 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.625+0000 7fd6bfee8640 20 client.5246.objecter put_session s=0x7fd688080f50 osd=1 1 2026-02-17T11:15:45.631 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.625+0000 7fd6bfee8640 20 client.5246.objecter shutdown clearing up homeless session... 2026-02-17T11:15:45.631 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.625+0000 7fd6bfee8640 10 client.5246.objecter successfully canceled tick 2026-02-17T11:15:45.631 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.626+0000 7fd6bfee8640 1 -- 10.20.193.49:0/664958494 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fd688079140 msgr2=0x7fd68807b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:45.632 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.626+0000 7fd6bfee8640 1 --2- 10.20.193.49:0/664958494 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fd688079140 0x7fd68807b600 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd6a8005110 tx=0x7fd6a8007f30 comp rx=0 tx=0).stop 2026-02-17T11:15:45.632 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.626+0000 7fd6bfee8640 10 monclient: shutdown 2026-02-17T11:15:45.632 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.626+0000 7fd6bfee8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:45.632 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.626+0000 7fd6bfee8640 1 -- 10.20.193.49:0/664958494 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fd6b815d3c0 msgr2=0x7fd6b81414c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:45.632 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.626+0000 7fd6bfee8640 1 --2- 10.20.193.49:0/664958494 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fd6b815d3c0 0x7fd6b81414c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd6b400cb10 tx=0x7fd6b400a060 comp rx=0 tx=0).stop 2026-02-17T11:15:45.632 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.626+0000 7fd6be45e640 1 -- 10.20.193.49:0/664958494 reap_dead start 2026-02-17T11:15:45.632 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.626+0000 7fd6bfee8640 1 -- 10.20.193.49:0/664958494 shutdown_connections 2026-02-17T11:15:45.632 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.626+0000 7fd6bfee8640 1 -- 10.20.193.49:0/664958494 >> 10.20.193.49:0/664958494 conn(0x7fd6b80c9f60 msgr2=0x7fd6b814f450 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:45.632 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.626+0000 7fd6bfee8640 1 -- 10.20.193.49:0/664958494 shutdown_connections 2026-02-17T11:15:45.633 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.626+0000 7fd6bfee8640 1 -- 10.20.193.49:0/664958494 wait complete. 2026-02-17T11:15:45.633 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.626+0000 7fd6bfee8640 1 librados: shutdown 2026-02-17T11:15:45.636 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-02-17T11:15:45.703 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.700+0000 7f75b7961640 10 monclient: get_monmap_and_config 2026-02-17T11:15:45.703 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.700+0000 7f75b7961640 10 monclient: build_initial_monmap 2026-02-17T11:15:45.703 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.700+0000 7f75b7961640 10 monclient: monmap: 2026-02-17T11:15:45.703 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:45.704 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:45.704 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:15:45.702171+0000 2026-02-17T11:15:45.704 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:15:45.702171+0000 2026-02-17T11:15:45.704 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:45.704 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:45.704 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:15:45.704 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:15:45.704 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:15:45.704 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:15:45.704 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:15:45.704 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:15:45.704 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:45.705 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.701+0000 7f75b7961640 1 Processor -- start 2026-02-17T11:15:45.705 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.701+0000 7f75b7961640 1 -- start start 2026-02-17T11:15:45.705 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.701+0000 7f75b7961640 10 monclient: init 2026-02-17T11:15:45.708 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.701+0000 7f75b7961640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:45.708 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.701+0000 7f75b7961640 10 monclient: _add_conns ranks=[4,3,1,2,5,0] 2026-02-17T11:15:45.708 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.701+0000 7f75b7961640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f75b015d370 0x7f75b015d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:45.708 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.701+0000 7f75b7961640 10 monclient(hunting): picked mon.noname-b con 0x7f75b015d370 addr v2:10.20.193.97:3300/0 2026-02-17T11:15:45.708 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.701+0000 7f75b7961640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f75b00c7e20 0x7f75b00c74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:45.708 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.701+0000 7f75b7961640 10 monclient(hunting): picked mon.noname-a con 0x7f75b00c7e20 addr v2:10.20.193.49:3300/0 2026-02-17T11:15:45.708 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.701+0000 7f75b7961640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f75b015b000 addr v1:10.20.193.97:6789/0 2026-02-17T11:15:45.708 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.701+0000 7f75b7961640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75b00c8350 con 0x7f75b015b000 2026-02-17T11:15:45.708 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.701+0000 7f75b7961640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:45.708 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.701+0000 7f75b7961640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f75b00c9240 con 0x7f75b00c7e20 2026-02-17T11:15:45.708 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.701+0000 7f75b7961640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:45.709 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.701+0000 7f75b7961640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f75b00c8630 con 0x7f75b015d370 2026-02-17T11:15:45.709 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.701+0000 7f75b7961640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:45.709 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.701+0000 7f75b7961640 10 monclient(hunting): authenticate will time out at 1422.365628s 2026-02-17T11:15:45.709 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.702+0000 7f75b56d6640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f75b015d370 0x7f75b015d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:45.709 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.702+0000 7f75b4ed5640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f75b00c7e20 0x7f75b00c74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:45.709 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.702+0000 7f75b56d6640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f75b015d370 0x7f75b015d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:46144/0 (socket says 10.20.193.49:46144) 2026-02-17T11:15:45.709 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.702+0000 7f75b56d6640 1 -- 10.20.193.49:0/2197923243 learned_addr learned my addr 10.20.193.49:0/2197923243 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:45.709 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.702+0000 7f75b56d6640 10 monclient(hunting): get_auth_request con 0x7f75b015d370 auth_method 0 2026-02-17T11:15:45.709 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.702+0000 7f75b56d6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:45.709 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.702+0000 7f75b56d6640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:45.709 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.702+0000 7f75b56d6640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:45.709 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.702+0000 7f75b4ed5640 10 monclient(hunting): get_auth_request con 0x7f75b00c7e20 auth_method 0 2026-02-17T11:15:45.710 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.702+0000 7f75b4ed5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:45.710 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.702+0000 7f75b4ed5640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:45.710 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.702+0000 7f75b4ed5640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:45.710 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.702+0000 7f75b4ed5640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:45.710 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.702+0000 7f75b4ed5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:45.710 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.702+0000 7f75b4ed5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:45.710 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.702+0000 7f75b56d6640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:45.710 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.702+0000 7f75b56d6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:45.710 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.702+0000 7f75b56d6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:45.710 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.703+0000 7f75b56d6640 10 monclient(hunting): handle_auth_done global_id 5191 payload 274 2026-02-17T11:15:45.710 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.703+0000 7f75b56d6640 1 -- 10.20.193.49:0/2197923243 >> v2:10.20.193.49:3300/0 conn(0x7f75b00c7e20 msgr2=0x7f75b00c74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:15:45.710 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.703+0000 7f75b56d6640 1 --2- 10.20.193.49:0/2197923243 >> v2:10.20.193.49:3300/0 conn(0x7f75b00c7e20 0x7f75b00c74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:45.710 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.703+0000 7f75b56d6640 1 -- 10.20.193.49:0/2197923243 >> v1:10.20.193.97:6789/0 conn(0x7f75b015b000 legacy=0x7f75b00c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:45.711 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.703+0000 7f75b56d6640 10 monclient: _finish_hunting 0 2026-02-17T11:15:45.711 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.703+0000 7f75b56d6640 1 monclient: found mon.noname-b 2026-02-17T11:15:45.711 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.703+0000 7f75b56d6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:45.711 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.703+0000 7f75b56d6640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:15:45.711 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.703+0000 7f75b56d6640 1 -- 10.20.193.49:0/2197923243 --> v2:10.20.193.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75b00c8910 con 0x7f75b015d370 2026-02-17T11:15:45.711 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.705+0000 7f75b56d6640 1 --2- 10.20.193.49:0/2197923243 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f75b015d370 0x7f75b015d750 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f75b00698d0 tx=0x7f75a002eed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b80ada33c0ce7901 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:45.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.706+0000 7f759ffff640 1 -- 10.20.193.49:0/2197923243 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a003c070 con 0x7f75b015d370 2026-02-17T11:15:45.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.706+0000 7f759ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:45.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.706+0000 7f759ffff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:15:45.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.706+0000 7f759ffff640 10 monclient: dump: 2026-02-17T11:15:45.717 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:45.717 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:45.717 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:45.717 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:45.717 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:45.717 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:45.718 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:45.718 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:45.718 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:45.718 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:45.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.706+0000 7f759ffff640 10 monclient: _finish_auth 0 2026-02-17T11:15:45.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.706+0000 7f759ffff640 10 monclient: _check_auth_tickets 2026-02-17T11:15:45.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.706+0000 7f759ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:45.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.706+0000 7f759ffff640 1 -- 10.20.193.49:0/2197923243 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75a002fbe0 con 0x7f75b015d370 2026-02-17T11:15:45.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.706+0000 7f75b7961640 5 monclient: authenticate success, global_id 5191 2026-02-17T11:15:45.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.706+0000 7f75b7961640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:15:45.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.706+0000 7f759ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:45.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.706+0000 7f759ffff640 1 -- 10.20.193.49:0/2197923243 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a0037440 con 0x7f75b015d370 2026-02-17T11:15:45.719 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.706+0000 7f75b7961640 10 monclient: get_monmap_and_config success 2026-02-17T11:15:45.719 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.706+0000 7f759ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:45.719 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.706+0000 7f75b7961640 4 set_mon_vals no callback set 2026-02-17T11:15:45.719 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.706+0000 7f759ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:15:45.719 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.706+0000 7f759ffff640 10 monclient: dump: 2026-02-17T11:15:45.719 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:45.719 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:45.719 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:45.719 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:45.719 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:45.719 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:45.719 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:45.719 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:45.720 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:45.720 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:45.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.707+0000 7f75b7961640 10 monclient: shutdown 2026-02-17T11:15:45.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.707+0000 7f75b7961640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:45.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.707+0000 7f75b7961640 1 -- 10.20.193.49:0/2197923243 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f75b015d370 msgr2=0x7f75b015d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:45.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.707+0000 7f75b7961640 1 --2- 10.20.193.49:0/2197923243 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f75b015d370 0x7f75b015d750 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f75b00698d0 tx=0x7f75a002eed0 comp rx=0 tx=0).stop 2026-02-17T11:15:45.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.707+0000 7f75b7961640 1 -- 10.20.193.49:0/2197923243 shutdown_connections 2026-02-17T11:15:45.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.707+0000 7f75b7961640 1 --2- 10.20.193.49:0/2197923243 >> v2:10.20.193.49:3300/0 conn(0x7f75b00c7e20 0x7f75b00c74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:45.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.707+0000 7f75b7961640 1 --2- 10.20.193.49:0/2197923243 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f75b015d370 0x7f75b015d750 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:45.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.707+0000 7f75b7961640 1 -- 10.20.193.49:0/2197923243 >> 10.20.193.49:0/2197923243 conn(0x7f75b00c9f20 msgr2=0x7f75b00ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:45.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.707+0000 7f75b7961640 1 -- 10.20.193.49:0/2197923243 shutdown_connections 2026-02-17T11:15:45.720 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.707+0000 7f75b7961640 1 -- 10.20.193.49:0/2197923243 wait complete. 2026-02-17T11:15:45.721 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.707+0000 7f75b7961640 10 monclient: build_initial_monmap 2026-02-17T11:15:45.721 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.707+0000 7f75b7961640 10 monclient: monmap: 2026-02-17T11:15:45.721 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:45.721 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:15:45.721 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:15:45.721 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:15:45.721 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:45.721 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:45.721 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:15:45.721 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:15:45.721 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:15:45.721 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:45.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.707+0000 7f75b7961640 1 librados: starting msgr at 2026-02-17T11:15:45.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.707+0000 7f75b7961640 1 librados: starting objecter 2026-02-17T11:15:45.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.708+0000 7f75b7961640 1 Processor -- start 2026-02-17T11:15:45.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.708+0000 7f75b7961640 1 -- start start 2026-02-17T11:15:45.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.708+0000 7f75b7961640 1 librados: setting wanted keys 2026-02-17T11:15:45.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.708+0000 7f75b7961640 1 librados: calling monclient init 2026-02-17T11:15:45.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.708+0000 7f75b7961640 10 monclient: init 2026-02-17T11:15:45.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.708+0000 7f75b7961640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:45.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.708+0000 7f75b7961640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:15:45.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.708+0000 7f75b7961640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f75b00c7e20 0x7f75b0148a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:45.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.708+0000 7f75b7961640 10 monclient(hunting): picked mon.noname-b con 0x7f75b00c7e20 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:15:45.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.708+0000 7f75b7961640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f75b015b000 0x7f75b00740e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:45.722 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.708+0000 7f75b7961640 10 monclient(hunting): picked mon.noname-a con 0x7f75b015b000 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:15:45.723 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.708+0000 7f75b7961640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f75b015d370 0x7f75b0074620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:45.723 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.708+0000 7f75b7961640 10 monclient(hunting): picked mon.noname-c con 0x7f75b015d370 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:15:45.723 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.708+0000 7f75b7961640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:45.723 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.708+0000 7f75b7961640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f75b00c96d0 con 0x7f75b015b000 2026-02-17T11:15:45.723 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.708+0000 7f75b7961640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:45.723 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.708+0000 7f75b7961640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f75b00c8ed0 con 0x7f75b00c7e20 2026-02-17T11:15:45.723 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.708+0000 7f75b7961640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:45.723 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.708+0000 7f75b7961640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f75b0073360 con 0x7f75b015d370 2026-02-17T11:15:45.723 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.708+0000 7f75b7961640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:45.723 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.708+0000 7f75b7961640 10 monclient(hunting): authenticate will time out at 1422.372618s 2026-02-17T11:15:45.723 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.708+0000 7f75b56d6640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f75b00c7e20 0x7f75b0148a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:45.723 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.708+0000 7f75b4ed5640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f75b015b000 0x7f75b00740e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:45.723 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.709+0000 7f75b5ed7640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f75b015d370 0x7f75b0074620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:45.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.709+0000 7f75b4ed5640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f75b015b000 0x7f75b00740e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:45420/0 (socket says 10.20.193.49:45420) 2026-02-17T11:15:45.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.709+0000 7f75b4ed5640 1 -- 10.20.193.49:0/3476355538 learned_addr learned my addr 10.20.193.49:0/3476355538 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:45.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.709+0000 7f75b4ed5640 10 monclient(hunting): get_auth_request con 0x7f75b015b000 auth_method 0 2026-02-17T11:15:45.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.709+0000 7f75b4ed5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:45.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.709+0000 7f75b4ed5640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:45.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.709+0000 7f75b4ed5640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:45.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.709+0000 7f75b56d6640 10 monclient(hunting): get_auth_request con 0x7f75b00c7e20 auth_method 0 2026-02-17T11:15:45.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.709+0000 7f75b56d6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:45.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.709+0000 7f75b56d6640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:45.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.709+0000 7f75b56d6640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:45.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.709+0000 7f75b5ed7640 10 monclient(hunting): get_auth_request con 0x7f75b015d370 auth_method 0 2026-02-17T11:15:45.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.709+0000 7f75b5ed7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:45.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.709+0000 7f75b5ed7640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:45.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.709+0000 7f75b5ed7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:45.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.709+0000 7f75b56d6640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:45.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.709+0000 7f75b56d6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:45.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.709+0000 7f75b56d6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:45.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.709+0000 7f75b4ed5640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:45.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.709+0000 7f75b4ed5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:45.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.709+0000 7f75b4ed5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:45.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.709+0000 7f75b5ed7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:45.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.709+0000 7f75b5ed7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:45.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.709+0000 7f75b5ed7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:45.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.710+0000 7f75b56d6640 10 monclient(hunting): handle_auth_done global_id 5194 payload 824 2026-02-17T11:15:45.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.710+0000 7f75b56d6640 1 -- 10.20.193.49:0/3476355538 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f75b015d370 msgr2=0x7f75b0074620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:45.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.710+0000 7f75b56d6640 1 --2- 10.20.193.49:0/3476355538 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f75b015d370 0x7f75b0074620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:45.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.710+0000 7f75b56d6640 1 -- 10.20.193.49:0/3476355538 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f75b015b000 msgr2=0x7f75b00740e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:45.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.710+0000 7f75b56d6640 1 --2- 10.20.193.49:0/3476355538 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f75b015b000 0x7f75b00740e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:45.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.710+0000 7f75b56d6640 10 monclient: _finish_hunting 0 2026-02-17T11:15:45.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.710+0000 7f75b56d6640 1 monclient: found mon.noname-b 2026-02-17T11:15:45.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.710+0000 7f75b56d6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:45.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.710+0000 7f75b56d6640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:15:45.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.710+0000 7f75b56d6640 1 -- 10.20.193.49:0/3476355538 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75b014ab60 con 0x7f75b00c7e20 2026-02-17T11:15:45.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.711+0000 7f75b56d6640 1 --2- 10.20.193.49:0/3476355538 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f75b00c7e20 0x7f75b0148a60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f75b00c93c0 tx=0x7f75a00047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:45.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.711+0000 7f759dffb640 10 client.?.objecter ms_handle_connect 0x7f75b00c7e20 2026-02-17T11:15:45.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.711+0000 7f759dffb640 10 client.?.objecter resend_mon_ops 2026-02-17T11:15:45.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.713+0000 7f759dffb640 1 -- 10.20.193.49:0/3476355538 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a003c040 con 0x7f75b00c7e20 2026-02-17T11:15:45.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.713+0000 7f759dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:45.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.713+0000 7f759dffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:15:45.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.713+0000 7f759dffb640 10 monclient: dump: 2026-02-17T11:15:45.727 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:45.727 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:45.727 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:45.727 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:45.727 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:45.727 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:45.727 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:45.727 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:45.727 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:45.727 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:45.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.713+0000 7f759dffb640 10 monclient: _finish_auth 0 2026-02-17T11:15:45.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.713+0000 7f759dffb640 10 monclient: _check_auth_tickets 2026-02-17T11:15:45.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.713+0000 7f759dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:45.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.713+0000 7f759dffb640 1 -- 10.20.193.49:0/3476355538 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75a0042650 con 0x7f75b00c7e20 2026-02-17T11:15:45.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.713+0000 7f759dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:45.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.713+0000 7f759dffb640 1 -- 10.20.193.49:0/3476355538 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a0042a40 con 0x7f75b00c7e20 2026-02-17T11:15:45.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.713+0000 7f759dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:45.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.713+0000 7f759dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:15:45.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.713+0000 7f759f7fe640 4 set_mon_vals no callback set 2026-02-17T11:15:45.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.713+0000 7f759dffb640 10 monclient: dump: 2026-02-17T11:15:45.728 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:45.728 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:45.728 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:45.728 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:45.729 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:45.729 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:45.729 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:45.729 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:45.729 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:45.729 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:45.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.713+0000 7f75b7961640 5 monclient: authenticate success, global_id 5194 2026-02-17T11:15:45.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.713+0000 7f75b7961640 10 monclient: _renew_subs 2026-02-17T11:15:45.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.713+0000 7f75b7961640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:15:45.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.713+0000 7f75b7961640 1 -- 10.20.193.49:0/3476355538 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75b0073600 con 0x7f75b00c7e20 2026-02-17T11:15:45.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.713+0000 7f75b7961640 10 client.5194.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:45.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.713+0000 7f75b7961640 10 monclient: _renew_subs 2026-02-17T11:15:45.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.713+0000 7f75b7961640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:15:45.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.713+0000 7f75b7961640 1 -- 10.20.193.49:0/3476355538 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75b0073bc0 con 0x7f75b00c7e20 2026-02-17T11:15:45.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.713+0000 7f75b7961640 1 librados: init done 2026-02-17T11:15:45.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.713+0000 7f75b7961640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:45.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.713+0000 7f75b7961640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:45.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.713+0000 7f75b7961640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:15:45.730 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.713+0000 7f75b7961640 1 -- 10.20.193.49:0/3476355538 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75b015b490 con 0x7f75b00c7e20 2026-02-17T11:15:45.731 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.725+0000 7f759dffb640 1 -- 10.20.193.49:0/3476355538 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f75a0042be0 con 0x7f75b00c7e20 2026-02-17T11:15:45.731 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.726+0000 7f759dffb640 1 --2- 10.20.193.49:0/3476355538 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f7580079140 0x7f758007b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:45.731 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.726+0000 7f75b4ed5640 1 --2- 10.20.193.49:0/3476355538 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f7580079140 0x7f758007b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:45.731 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.726+0000 7f75b4ed5640 10 monclient: get_auth_request con 0x7f7580079140 auth_method 0 2026-02-17T11:15:45.732 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.727+0000 7f759dffb640 10 client.5194.objecter ms_handle_connect 0x7f7580079140 2026-02-17T11:15:45.732 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.727+0000 7f75b4ed5640 1 --2- 10.20.193.49:0/3476355538 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f7580079140 0x7f758007b600 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f75b014fc40 tx=0x7f75a4009290 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:45.732 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.727+0000 7f759dffb640 1 -- 10.20.193.49:0/3476355538 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f75a002faa0 con 0x7f75b00c7e20 2026-02-17T11:15:45.732 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.727+0000 7f759dffb640 10 client.5194.objecter ms_dispatch2 0x7f75b0000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:15:45.732 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.727+0000 7f759dffb640 3 client.5194.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:15:45.732 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.727+0000 7f759dffb640 3 client.5194.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:15:45.732 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.727+0000 7f759dffb640 20 client.5194.objecter dump_active .. 0 homeless 2026-02-17T11:15:45.830 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.827+0000 7f759dffb640 1 -- 10.20.193.49:0/3476355538 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f75a00878d0 con 0x7f75b00c7e20 2026-02-17T11:15:45.830 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.827+0000 7f759dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:45.830 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.827+0000 7f759dffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:15:45.913 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.911+0000 7f75b7961640 1 -- 10.20.193.49:0/3476355538 --> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f75b0073e00 con 0x7f7580079140 2026-02-17T11:15:45.914 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.911+0000 7f759dffb640 1 -- 10.20.193.49:0/3476355538 <== mgr.4106 v2:10.20.193.162:6800/2614632098 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f75b0073e00 con 0x7f7580079140 2026-02-17T11:15:45.914 INFO:teuthology.orchestra.run.trial049.stderr:instructed osd(s) 1 to deep-scrub 2026-02-17T11:15:45.915 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.912+0000 7f75b7961640 10 librados: watch_flush enter 2026-02-17T11:15:45.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.912+0000 7f75b7961640 10 librados: watch_flush exit 2026-02-17T11:15:45.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.912+0000 7f75b7961640 20 client.5194.objecter shutdown clearing up homeless session... 2026-02-17T11:15:45.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.912+0000 7f75b7961640 10 client.5194.objecter successfully canceled tick 2026-02-17T11:15:45.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.912+0000 7f75b7961640 1 -- 10.20.193.49:0/3476355538 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f7580079140 msgr2=0x7f758007b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:45.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.912+0000 7f75b7961640 1 --2- 10.20.193.49:0/3476355538 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f7580079140 0x7f758007b600 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f75b014fc40 tx=0x7f75a4009290 comp rx=0 tx=0).stop 2026-02-17T11:15:45.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.912+0000 7f75b7961640 10 monclient: shutdown 2026-02-17T11:15:45.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.912+0000 7f75b7961640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:45.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.912+0000 7f75b7961640 1 -- 10.20.193.49:0/3476355538 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f75b00c7e20 msgr2=0x7f75b0148a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:45.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.912+0000 7f75b7961640 1 --2- 10.20.193.49:0/3476355538 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f75b00c7e20 0x7f75b0148a60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f75b00c93c0 tx=0x7f75a00047c0 comp rx=0 tx=0).stop 2026-02-17T11:15:45.916 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.912+0000 7f75b7961640 1 -- 10.20.193.49:0/3476355538 shutdown_connections 2026-02-17T11:15:45.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.912+0000 7f75b7961640 1 --2- 10.20.193.49:0/3476355538 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f7580079140 0x7f758007b600 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:45.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.912+0000 7f75b7961640 1 --2- 10.20.193.49:0/3476355538 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f75b015d370 0x7f75b0074620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:45.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.912+0000 7f75b7961640 1 --2- 10.20.193.49:0/3476355538 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f75b015b000 0x7f75b00740e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:45.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.912+0000 7f75b7961640 1 --2- 10.20.193.49:0/3476355538 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f75b00c7e20 0x7f75b0148a60 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:45.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.912+0000 7f75b7961640 1 -- 10.20.193.49:0/3476355538 >> 10.20.193.49:0/3476355538 conn(0x7f75b00c9f20 msgr2=0x7f75b00ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:45.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.912+0000 7f75b7961640 1 -- 10.20.193.49:0/3476355538 shutdown_connections 2026-02-17T11:15:45.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.912+0000 7f75b7961640 1 -- 10.20.193.49:0/3476355538 wait complete. 2026-02-17T11:15:45.917 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.912+0000 7f75b7961640 1 librados: shutdown 2026-02-17T11:15:45.923 INFO:tasks.ceph:Scrubbing osd.5 2026-02-17T11:15:45.923 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2026-02-17T11:15:45.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.989+0000 7f9bd784d640 10 monclient: get_monmap_and_config 2026-02-17T11:15:45.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.989+0000 7f9bd784d640 10 monclient: build_initial_monmap 2026-02-17T11:15:45.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.989+0000 7f9bd784d640 10 monclient: monmap: 2026-02-17T11:15:45.992 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:45.992 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:45.992 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:15:45.991000+0000 2026-02-17T11:15:45.992 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:15:45.991000+0000 2026-02-17T11:15:45.992 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:45.992 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:45.992 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:15:45.992 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:15:45.992 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:15:45.992 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:15:45.992 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:15:45.992 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:15:45.992 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:45.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.989+0000 7f9bd784d640 1 Processor -- start 2026-02-17T11:15:45.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.989+0000 7f9bd784d640 1 -- start start 2026-02-17T11:15:45.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.989+0000 7f9bd784d640 10 monclient: init 2026-02-17T11:15:45.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.990+0000 7f9bd784d640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:45.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.990+0000 7f9bd784d640 10 monclient: _add_conns ranks=[5,4,2,1,3,0] 2026-02-17T11:15:45.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.990+0000 7f9bd784d640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f9bd0153930 0x7f9bd00c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:45.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.990+0000 7f9bd784d640 10 monclient(hunting): picked mon.noname-c con 0x7f9bd0153930 addr v2:10.20.193.157:3300/0 2026-02-17T11:15:45.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.990+0000 7f9bd784d640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f9bd0153d10 0x7f9bd015b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:45.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.990+0000 7f9bd784d640 10 monclient(hunting): picked mon.noname-b con 0x7f9bd0153d10 addr v2:10.20.193.97:3300/0 2026-02-17T11:15:45.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.990+0000 7f9bd784d640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f9bd015b5b0 addr v1:10.20.193.157:6789/0 2026-02-17T11:15:45.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.990+0000 7f9bd784d640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bd00c85a0 con 0x7f9bd015b5b0 2026-02-17T11:15:45.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.990+0000 7f9bd784d640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:45.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.990+0000 7f9bd784d640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd00c8380 con 0x7f9bd0153d10 2026-02-17T11:15:45.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.990+0000 7f9bd784d640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:45.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.990+0000 7f9bd784d640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd00c9490 con 0x7f9bd0153930 2026-02-17T11:15:45.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.990+0000 7f9bd784d640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:45.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.990+0000 7f9bd784d640 10 monclient(hunting): authenticate will time out at 1422.654476s 2026-02-17T11:15:45.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.990+0000 7f9bd55c2640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f9bd0153930 0x7f9bd00c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:45.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.990+0000 7f9bd4dc1640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f9bd0153d10 0x7f9bd015b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:45.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.991+0000 7f9bd55c2640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f9bd0153930 0x7f9bd00c7e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:51898/0 (socket says 10.20.193.49:51898) 2026-02-17T11:15:45.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.991+0000 7f9bd55c2640 1 -- 10.20.193.49:0/3706981439 learned_addr learned my addr 10.20.193.49:0/3706981439 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:45.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.991+0000 7f9bd55c2640 10 monclient(hunting): get_auth_request con 0x7f9bd0153930 auth_method 0 2026-02-17T11:15:45.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.991+0000 7f9bd55c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:45.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.991+0000 7f9bd55c2640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:45.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.991+0000 7f9bd55c2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:45.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.991+0000 7f9bd4dc1640 10 monclient(hunting): get_auth_request con 0x7f9bd0153d10 auth_method 0 2026-02-17T11:15:45.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.991+0000 7f9bd4dc1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:45.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.991+0000 7f9bd4dc1640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:45.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.991+0000 7f9bd4dc1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:45.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.991+0000 7f9bd4dc1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:45.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.991+0000 7f9bd4dc1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:45.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.991+0000 7f9bd4dc1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:45.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.991+0000 7f9bd55c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:45.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.991+0000 7f9bd55c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:45.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.991+0000 7f9bd55c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:45.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.992+0000 7f9bd55c2640 10 monclient(hunting): handle_auth_done global_id 5252 payload 274 2026-02-17T11:15:45.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.992+0000 7f9bd55c2640 1 -- 10.20.193.49:0/3706981439 >> v2:10.20.193.97:3300/0 conn(0x7f9bd0153d10 msgr2=0x7f9bd015b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:15:45.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.992+0000 7f9bd55c2640 1 --2- 10.20.193.49:0/3706981439 >> v2:10.20.193.97:3300/0 conn(0x7f9bd0153d10 0x7f9bd015b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:45.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.992+0000 7f9bd55c2640 1 -- 10.20.193.49:0/3706981439 >> v1:10.20.193.157:6789/0 conn(0x7f9bd015b5b0 legacy=0x7f9bd00c52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:45.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.992+0000 7f9bd55c2640 10 monclient: _finish_hunting 0 2026-02-17T11:15:45.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.992+0000 7f9bd55c2640 1 monclient: found mon.noname-c 2026-02-17T11:15:45.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.992+0000 7f9bd55c2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:45.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.992+0000 7f9bd55c2640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:15:45.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.992+0000 7f9bd55c2640 1 -- 10.20.193.49:0/3706981439 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bd00c8880 con 0x7f9bd0153930 2026-02-17T11:15:45.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.994+0000 7f9bd55c2640 1 --2- 10.20.193.49:0/3706981439 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f9bd0153930 0x7f9bd00c7e40 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9bd00c9610 tx=0x7f9bc002eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f843b56fe96e932b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:45.998 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.996+0000 7f9bbffff640 1 -- 10.20.193.49:0/3706981439 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc003c070 con 0x7f9bd0153930 2026-02-17T11:15:45.998 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.996+0000 7f9bbffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:45.999 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.996+0000 7f9bbffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:15:45.999 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.996+0000 7f9bbffff640 10 monclient: dump: 2026-02-17T11:15:45.999 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:45.999 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:45.999 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:45.999 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:45.999 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:45.999 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:45.999 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:45.999 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:45.999 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:45.999 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:45.999 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.996+0000 7f9bbffff640 10 monclient: _finish_auth 0 2026-02-17T11:15:45.999 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.996+0000 7f9bbffff640 10 monclient: _check_auth_tickets 2026-02-17T11:15:45.999 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.996+0000 7f9bbffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:45.999 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.996+0000 7f9bbffff640 1 -- 10.20.193.49:0/3706981439 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bc002fbc0 con 0x7f9bd0153930 2026-02-17T11:15:45.999 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.996+0000 7f9bd784d640 5 monclient: authenticate success, global_id 5252 2026-02-17T11:15:45.999 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.996+0000 7f9bd784d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:15:45.999 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.996+0000 7f9bbffff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:45.999 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.996+0000 7f9bbffff640 1 -- 10.20.193.49:0/3706981439 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc0037440 con 0x7f9bd0153930 2026-02-17T11:15:45.999 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.996+0000 7f9bd784d640 10 monclient: get_monmap_and_config success 2026-02-17T11:15:45.999 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.996+0000 7f9bd784d640 4 set_mon_vals no callback set 2026-02-17T11:15:45.999 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.996+0000 7f9bbffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:45.999 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.996+0000 7f9bbffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:15:45.999 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.996+0000 7f9bbffff640 10 monclient: dump: 2026-02-17T11:15:45.999 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:45.999 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:45.999 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:45.999 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:45.999 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:46.000 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:46.000 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:46.000 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:46.000 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:46.000 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:46.000 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.996+0000 7f9bd784d640 10 monclient: shutdown 2026-02-17T11:15:46.000 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.996+0000 7f9bd784d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:46.000 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.996+0000 7f9bd784d640 1 -- 10.20.193.49:0/3706981439 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f9bd0153930 msgr2=0x7f9bd00c7e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:46.000 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.996+0000 7f9bd784d640 1 --2- 10.20.193.49:0/3706981439 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f9bd0153930 0x7f9bd00c7e40 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9bd00c9610 tx=0x7f9bc002eeb0 comp rx=0 tx=0).stop 2026-02-17T11:15:46.000 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.996+0000 7f9bd784d640 1 -- 10.20.193.49:0/3706981439 shutdown_connections 2026-02-17T11:15:46.000 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.996+0000 7f9bd784d640 1 --2- 10.20.193.49:0/3706981439 >> v2:10.20.193.97:3300/0 conn(0x7f9bd0153d10 0x7f9bd015b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:46.000 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.996+0000 7f9bd784d640 1 --2- 10.20.193.49:0/3706981439 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f9bd0153930 0x7f9bd00c7e40 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:46.000 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.996+0000 7f9bd784d640 1 -- 10.20.193.49:0/3706981439 >> 10.20.193.49:0/3706981439 conn(0x7f9bd00c9f40 msgr2=0x7f9bd00ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:46.000 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.996+0000 7f9bd784d640 1 -- 10.20.193.49:0/3706981439 shutdown_connections 2026-02-17T11:15:46.000 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.996+0000 7f9bd784d640 1 -- 10.20.193.49:0/3706981439 wait complete. 2026-02-17T11:15:46.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.997+0000 7f9bd784d640 10 monclient: build_initial_monmap 2026-02-17T11:15:46.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.997+0000 7f9bd784d640 10 monclient: monmap: 2026-02-17T11:15:46.001 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:46.002 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:15:46.002 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:15:46.002 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:15:46.002 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:46.002 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:46.002 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:15:46.002 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:15:46.002 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:15:46.002 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:46.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.997+0000 7f9bd784d640 1 librados: starting msgr at 2026-02-17T11:15:46.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.997+0000 7f9bd784d640 1 librados: starting objecter 2026-02-17T11:15:46.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.997+0000 7f9bd784d640 1 Processor -- start 2026-02-17T11:15:46.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.997+0000 7f9bd784d640 1 -- start start 2026-02-17T11:15:46.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.997+0000 7f9bd784d640 1 librados: setting wanted keys 2026-02-17T11:15:46.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.997+0000 7f9bd784d640 1 librados: calling monclient init 2026-02-17T11:15:46.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.997+0000 7f9bd784d640 10 monclient: init 2026-02-17T11:15:46.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.997+0000 7f9bd784d640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:46.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.997+0000 7f9bd784d640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:15:46.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.997+0000 7f9bd784d640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f9bd0153930 0x7f9bd0073c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:46.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.997+0000 7f9bd784d640 10 monclient(hunting): picked mon.noname-b con 0x7f9bd0153930 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:15:46.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.997+0000 7f9bd784d640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f9bd0153d10 0x7f9bd0141e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:46.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.997+0000 7f9bd784d640 10 monclient(hunting): picked mon.noname-a con 0x7f9bd0153d10 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:15:46.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.997+0000 7f9bd784d640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f9bd015b5b0 0x7f9bd01481f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:46.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.997+0000 7f9bd784d640 10 monclient(hunting): picked mon.noname-c con 0x7f9bd015b5b0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:15:46.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.997+0000 7f9bd784d640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:46.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.997+0000 7f9bd784d640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd00c9120 con 0x7f9bd0153d10 2026-02-17T11:15:46.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.997+0000 7f9bd784d640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:46.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.997+0000 7f9bd784d640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd00c8e40 con 0x7f9bd0153930 2026-02-17T11:15:46.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.997+0000 7f9bd784d640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:46.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.997+0000 7f9bd784d640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd00c7730 con 0x7f9bd015b5b0 2026-02-17T11:15:46.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.997+0000 7f9bd784d640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:46.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.997+0000 7f9bd784d640 10 monclient(hunting): authenticate will time out at 1422.661740s 2026-02-17T11:15:46.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.998+0000 7f9bd5dc3640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f9bd015b5b0 0x7f9bd01481f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:46.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.998+0000 7f9bd4dc1640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f9bd0153d10 0x7f9bd0141e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:46.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.998+0000 7f9bd5dc3640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f9bd015b5b0 0x7f9bd01481f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:51914/0 (socket says 10.20.193.49:51914) 2026-02-17T11:15:46.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.998+0000 7f9bd5dc3640 1 -- 10.20.193.49:0/590438535 learned_addr learned my addr 10.20.193.49:0/590438535 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:46.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.998+0000 7f9bd5dc3640 10 monclient(hunting): get_auth_request con 0x7f9bd015b5b0 auth_method 0 2026-02-17T11:15:46.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.998+0000 7f9bd5dc3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:46.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.998+0000 7f9bd5dc3640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:46.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.998+0000 7f9bd5dc3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:46.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.998+0000 7f9bd4dc1640 10 monclient(hunting): get_auth_request con 0x7f9bd0153d10 auth_method 0 2026-02-17T11:15:46.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.998+0000 7f9bd4dc1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:46.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.998+0000 7f9bd4dc1640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:46.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.998+0000 7f9bd4dc1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:46.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.998+0000 7f9bd55c2640 1 --2- 10.20.193.49:0/590438535 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f9bd0153930 0x7f9bd0073c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:46.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.998+0000 7f9bd5dc3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:46.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.998+0000 7f9bd5dc3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:46.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.998+0000 7f9bd5dc3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:46.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.998+0000 7f9bd55c2640 10 monclient(hunting): get_auth_request con 0x7f9bd0153930 auth_method 0 2026-02-17T11:15:46.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.998+0000 7f9bd55c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:46.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.998+0000 7f9bd55c2640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:46.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.998+0000 7f9bd55c2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:46.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.998+0000 7f9bd4dc1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:46.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.998+0000 7f9bd4dc1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:46.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.998+0000 7f9bd4dc1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:46.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.998+0000 7f9bd55c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:46.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.998+0000 7f9bd55c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:46.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.998+0000 7f9bd55c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:46.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.999+0000 7f9bd5dc3640 10 monclient(hunting): handle_auth_done global_id 5258 payload 824 2026-02-17T11:15:46.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.999+0000 7f9bd5dc3640 1 -- 10.20.193.49:0/590438535 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f9bd0153930 msgr2=0x7f9bd0073c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:46.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.999+0000 7f9bd5dc3640 1 --2- 10.20.193.49:0/590438535 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f9bd0153930 0x7f9bd0073c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:46.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.999+0000 7f9bd5dc3640 1 -- 10.20.193.49:0/590438535 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f9bd0153d10 msgr2=0x7f9bd0141e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:46.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.999+0000 7f9bd5dc3640 1 --2- 10.20.193.49:0/590438535 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f9bd0153d10 0x7f9bd0141e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:46.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.999+0000 7f9bd5dc3640 10 monclient: _finish_hunting 0 2026-02-17T11:15:46.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.999+0000 7f9bd5dc3640 1 monclient: found mon.noname-c 2026-02-17T11:15:46.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.999+0000 7f9bd5dc3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:46.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.999+0000 7f9bd5dc3640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:15:46.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:45.999+0000 7f9bd5dc3640 1 -- 10.20.193.49:0/590438535 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bd00742e0 con 0x7f9bd015b5b0 2026-02-17T11:15:46.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.000+0000 7f9bd5dc3640 1 --2- 10.20.193.49:0/590438535 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f9bd015b5b0 0x7f9bd01481f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc00cc10 tx=0x7f9bcc00a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:46.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.000+0000 7f9bbdffb640 10 client.?.objecter ms_handle_connect 0x7f9bd015b5b0 2026-02-17T11:15:46.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.000+0000 7f9bbdffb640 10 client.?.objecter resend_mon_ops 2026-02-17T11:15:46.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.002+0000 7f9bbdffb640 1 -- 10.20.193.49:0/590438535 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bcc00ce30 con 0x7f9bd015b5b0 2026-02-17T11:15:46.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.002+0000 7f9bbdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:46.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.002+0000 7f9bbdffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:15:46.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.002+0000 7f9bbdffb640 10 monclient: dump: 2026-02-17T11:15:46.005 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:46.005 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:46.005 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:46.005 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:46.005 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:46.005 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:46.005 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:46.005 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:46.005 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:46.005 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:46.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.002+0000 7f9bbdffb640 10 monclient: _finish_auth 0 2026-02-17T11:15:46.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.002+0000 7f9bbdffb640 10 monclient: _check_auth_tickets 2026-02-17T11:15:46.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.002+0000 7f9bbdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:46.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.002+0000 7f9bbdffb640 1 -- 10.20.193.49:0/590438535 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bcc003a70 con 0x7f9bd015b5b0 2026-02-17T11:15:46.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.002+0000 7f9bbdffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:46.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.002+0000 7f9bd784d640 5 monclient: authenticate success, global_id 5258 2026-02-17T11:15:46.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.002+0000 7f9bbdffb640 1 -- 10.20.193.49:0/590438535 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bcc003e60 con 0x7f9bd015b5b0 2026-02-17T11:15:46.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.002+0000 7f9bd784d640 10 monclient: _renew_subs 2026-02-17T11:15:46.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.002+0000 7f9bd784d640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:15:46.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.002+0000 7f9bd784d640 1 -- 10.20.193.49:0/590438535 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bd00745c0 con 0x7f9bd015b5b0 2026-02-17T11:15:46.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.002+0000 7f9bbf7fe640 4 set_mon_vals no callback set 2026-02-17T11:15:46.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.002+0000 7f9bbdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:46.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.002+0000 7f9bbdffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:15:46.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.002+0000 7f9bbdffb640 10 monclient: dump: 2026-02-17T11:15:46.006 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:46.006 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:46.006 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:46.006 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:46.006 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:46.006 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:46.006 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:46.006 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:46.006 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:46.006 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:46.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.002+0000 7f9bd784d640 10 client.5258.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:46.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.002+0000 7f9bd784d640 10 monclient: _renew_subs 2026-02-17T11:15:46.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.002+0000 7f9bd784d640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:15:46.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.002+0000 7f9bd784d640 1 -- 10.20.193.49:0/590438535 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bd0074b80 con 0x7f9bd015b5b0 2026-02-17T11:15:46.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.002+0000 7f9bd784d640 1 librados: init done 2026-02-17T11:15:46.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.002+0000 7f9bd784d640 10 client.5258.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:46.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.002+0000 7f9bd784d640 15 client.5258.objecter _session_command_op_assign -1 1 2026-02-17T11:15:46.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.002+0000 7f9bd784d640 20 client.5258.objecter _get_session osd=-1 returning homeless 2026-02-17T11:15:46.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.002+0000 7f9bd784d640 10 client.5258.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:46.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.002+0000 7f9bd784d640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:15:46.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.002+0000 7f9bd784d640 1 -- 10.20.193.49:0/590438535 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9bd00c7e40 con 0x7f9bd015b5b0 2026-02-17T11:15:46.016 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.014+0000 7f9bbdffb640 1 -- 10.20.193.49:0/590438535 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f9bcc0050d0 con 0x7f9bd015b5b0 2026-02-17T11:15:46.016 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.014+0000 7f9bbdffb640 1 --2- 10.20.193.49:0/590438535 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f9ba0079190 0x7f9ba007b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:46.017 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.015+0000 7f9bd55c2640 1 --2- 10.20.193.49:0/590438535 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f9ba0079190 0x7f9ba007b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:46.017 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.015+0000 7f9bd55c2640 10 monclient: get_auth_request con 0x7f9ba0079190 auth_method 0 2026-02-17T11:15:46.017 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.015+0000 7f9bd55c2640 1 --2- 10.20.193.49:0/590438535 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f9ba0079190 0x7f9ba007b650 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9bd0157750 tx=0x7f9bc0039040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:46.017 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.015+0000 7f9bbdffb640 10 client.5258.objecter ms_handle_connect 0x7f9ba0079190 2026-02-17T11:15:46.018 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.015+0000 7f9bbdffb640 1 -- 10.20.193.49:0/590438535 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f9bcc05e860 con 0x7f9bd015b5b0 2026-02-17T11:15:46.018 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.015+0000 7f9bbdffb640 10 client.5258.objecter ms_dispatch2 0x7f9bd0000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:15:46.018 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.015+0000 7f9bbdffb640 3 client.5258.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:15:46.018 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.015+0000 7f9bbdffb640 3 client.5258.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:15:46.018 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.015+0000 7f9bbdffb640 10 client.5258.objecter checking command 1 2026-02-17T11:15:46.018 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.015+0000 7f9bbdffb640 1 --2- 10.20.193.49:0/590438535 >> [v2:10.20.193.97:6800/3226749558,v1:10.20.193.97:6801/3226749558] conn(0x7f9ba0081670 0x7f9ba0083a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:46.018 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.015+0000 7f9bbdffb640 20 client.5258.objecter _get_session s=0x7f9ba0080fa0 osd=5 3 2026-02-17T11:15:46.018 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.015+0000 7f9bbdffb640 20 client.5258.objecter put_session s=0x7f9ba0080fa0 osd=5 3 2026-02-17T11:15:46.018 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.015+0000 7f9bbdffb640 15 client.5258.objecter _session_command_op_remove -1 1 2026-02-17T11:15:46.018 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.015+0000 7f9bbdffb640 20 client.5258.objecter _get_session s=0x7f9ba0080fa0 osd=5 3 2026-02-17T11:15:46.018 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.015+0000 7f9bbdffb640 20 client.5258.objecter get_session s=0x7f9ba0080fa0 osd=5 3 2026-02-17T11:15:46.018 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.015+0000 7f9bbdffb640 15 client.5258.objecter _session_command_op_assign 5 1 2026-02-17T11:15:46.018 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.015+0000 7f9bbdffb640 20 client.5258.objecter put_session s=0x7f9ba0080fa0 osd=5 4 2026-02-17T11:15:46.018 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.015+0000 7f9bbdffb640 10 client.5258.objecter _send_command 1 2026-02-17T11:15:46.018 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.015+0000 7f9bbdffb640 1 -- 10.20.193.49:0/590438535 --> [v2:10.20.193.97:6800/3226749558,v1:10.20.193.97:6801/3226749558] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9bcc013e70 con 0x7f9ba0081670 2026-02-17T11:15:46.018 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.015+0000 7f9bbdffb640 20 client.5258.objecter dump_active .. 0 homeless 2026-02-17T11:15:46.018 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.016+0000 7f9bbdffb640 1 -- 10.20.193.49:0/590438535 <== mon.2 v2:10.20.193.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f9bcc05ec20 con 0x7f9bd015b5b0 2026-02-17T11:15:46.019 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.016+0000 7f9bbdffb640 10 monclient: handle_get_version_reply finishing 1 version 34 2026-02-17T11:15:46.019 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.016+0000 7f9bd4dc1640 1 --2- 10.20.193.49:0/590438535 >> [v2:10.20.193.97:6800/3226749558,v1:10.20.193.97:6801/3226749558] conn(0x7f9ba0081670 0x7f9ba0083a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:46.019 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.016+0000 7f9bd4dc1640 10 monclient: get_auth_request con 0x7f9ba0081670 auth_method 0 2026-02-17T11:15:46.020 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.018+0000 7f9bbdffb640 10 client.5258.objecter ms_handle_connect 0x7f9ba0081670 2026-02-17T11:15:46.020 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.018+0000 7f9bd4dc1640 1 --2- 10.20.193.49:0/590438535 >> [v2:10.20.193.97:6800/3226749558,v1:10.20.193.97:6801/3226749558] conn(0x7f9ba0081670 0x7f9ba0083a90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:46.030 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.027+0000 7f9bbdffb640 1 -- 10.20.193.49:0/590438535 <== osd.5 v2:10.20.193.97:6800/3226749558 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f9bcc013e70 con 0x7f9ba0081670 2026-02-17T11:15:46.030 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.027+0000 7f9bbdffb640 10 client.5258.objecter ms_dispatch2 0x7f9bd0000b90 command_reply(tid 1: 0 ) 2026-02-17T11:15:46.030 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.027+0000 7f9bbdffb640 10 client.5258.objecter _finish_command 1 = system:0 2026-02-17T11:15:46.030 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.027+0000 7f9bbdffb640 20 client.5258.objecter put_session s=0x7f9ba0080fa0 osd=5 4 2026-02-17T11:15:46.031 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.027+0000 7f9bbdffb640 15 client.5258.objecter _session_command_op_remove 5 1 2026-02-17T11:15:46.037 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.035+0000 7f9bd784d640 10 client.5258.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T11:15:46.037 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.035+0000 7f9bd784d640 15 client.5258.objecter _session_command_op_assign -1 2 2026-02-17T11:15:46.037 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.035+0000 7f9bd784d640 20 client.5258.objecter _get_session s=0x7f9ba0080fa0 osd=5 3 2026-02-17T11:15:46.038 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.035+0000 7f9bd784d640 20 client.5258.objecter put_session s=0x7f9ba0080fa0 osd=5 3 2026-02-17T11:15:46.038 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.035+0000 7f9bd784d640 20 client.5258.objecter _get_session s=0x7f9ba0080fa0 osd=5 3 2026-02-17T11:15:46.038 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.035+0000 7f9bd784d640 15 client.5258.objecter _session_command_op_remove -1 2 2026-02-17T11:15:46.038 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.035+0000 7f9bd784d640 20 client.5258.objecter get_session s=0x7f9ba0080fa0 osd=5 3 2026-02-17T11:15:46.038 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.035+0000 7f9bd784d640 15 client.5258.objecter _session_command_op_assign 5 2 2026-02-17T11:15:46.038 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.035+0000 7f9bd784d640 20 client.5258.objecter put_session s=0x7f9ba0080fa0 osd=5 4 2026-02-17T11:15:46.038 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.035+0000 7f9bd784d640 10 client.5258.objecter _send_command 2 2026-02-17T11:15:46.038 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.035+0000 7f9bd784d640 1 -- 10.20.193.49:0/590438535 --> [v2:10.20.193.97:6800/3226749558,v1:10.20.193.97:6801/3226749558] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f9bd015cb30 con 0x7f9ba0081670 2026-02-17T11:15:46.045 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.043+0000 7f9bbdffb640 1 -- 10.20.193.49:0/590438535 <== osd.5 v2:10.20.193.97:6800/3226749558 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f9bd015cb30 con 0x7f9ba0081670 2026-02-17T11:15:46.045 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.043+0000 7f9bbdffb640 10 client.5258.objecter ms_dispatch2 0x7f9bd0000b90 command_reply(tid 2: 0 ) 2026-02-17T11:15:46.045 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.043+0000 7f9bbdffb640 10 client.5258.objecter _finish_command 2 = system:0 2026-02-17T11:15:46.046 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.043+0000 7f9bbdffb640 20 client.5258.objecter put_session s=0x7f9ba0080fa0 osd=5 4 2026-02-17T11:15:46.046 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.043+0000 7f9bbdffb640 15 client.5258.objecter _session_command_op_remove 5 2 2026-02-17T11:15:46.046 INFO:teuthology.orchestra.run.trial049.stdout:{ 2026-02-17T11:15:46.046 INFO:teuthology.orchestra.run.trial049.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T11:15:46.046 INFO:teuthology.orchestra.run.trial049.stdout:} 2026-02-17T11:15:46.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.043+0000 7f9bd784d640 10 librados: watch_flush enter 2026-02-17T11:15:46.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.043+0000 7f9bd784d640 10 librados: watch_flush exit 2026-02-17T11:15:46.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.043+0000 7f9bd784d640 10 client.5258.objecter close_session for osd.5 2026-02-17T11:15:46.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.043+0000 7f9bd784d640 1 -- 10.20.193.49:0/590438535 >> [v2:10.20.193.97:6800/3226749558,v1:10.20.193.97:6801/3226749558] conn(0x7f9ba0081670 msgr2=0x7f9ba0083a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:46.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.043+0000 7f9bd784d640 1 --2- 10.20.193.49:0/590438535 >> [v2:10.20.193.97:6800/3226749558,v1:10.20.193.97:6801/3226749558] conn(0x7f9ba0081670 0x7f9ba0083a90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:46.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.043+0000 7f9bd784d640 20 client.5258.objecter put_session s=0x7f9ba0080fa0 osd=5 1 2026-02-17T11:15:46.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.043+0000 7f9bd784d640 20 client.5258.objecter shutdown clearing up homeless session... 2026-02-17T11:15:46.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.043+0000 7f9bd784d640 10 client.5258.objecter successfully canceled tick 2026-02-17T11:15:46.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.043+0000 7f9bd784d640 1 -- 10.20.193.49:0/590438535 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f9ba0079190 msgr2=0x7f9ba007b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:46.048 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.043+0000 7f9bd784d640 1 --2- 10.20.193.49:0/590438535 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f9ba0079190 0x7f9ba007b650 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9bd0157750 tx=0x7f9bc0039040 comp rx=0 tx=0).stop 2026-02-17T11:15:46.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.043+0000 7f9bd784d640 10 monclient: shutdown 2026-02-17T11:15:46.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.043+0000 7f9bd784d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:46.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.043+0000 7f9bd784d640 1 -- 10.20.193.49:0/590438535 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f9bd015b5b0 msgr2=0x7f9bd01481f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:46.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.043+0000 7f9bd784d640 1 --2- 10.20.193.49:0/590438535 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f9bd015b5b0 0x7f9bd01481f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc00cc10 tx=0x7f9bcc00a430 comp rx=0 tx=0).stop 2026-02-17T11:15:46.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.043+0000 7f9bd5dc3640 1 -- 10.20.193.49:0/590438535 reap_dead start 2026-02-17T11:15:46.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.043+0000 7f9bd784d640 1 -- 10.20.193.49:0/590438535 shutdown_connections 2026-02-17T11:15:46.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.043+0000 7f9bd784d640 1 -- 10.20.193.49:0/590438535 >> 10.20.193.49:0/590438535 conn(0x7f9bd00c9f40 msgr2=0x7f9bd01519f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:46.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.043+0000 7f9bd784d640 1 -- 10.20.193.49:0/590438535 shutdown_connections 2026-02-17T11:15:46.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.043+0000 7f9bd784d640 1 -- 10.20.193.49:0/590438535 wait complete. 2026-02-17T11:15:46.049 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.043+0000 7f9bd784d640 1 librados: shutdown 2026-02-17T11:15:46.053 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2026-02-17T11:15:46.121 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.118+0000 7fb465511640 10 monclient: get_monmap_and_config 2026-02-17T11:15:46.122 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.118+0000 7fb465511640 10 monclient: build_initial_monmap 2026-02-17T11:15:46.122 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.118+0000 7fb465511640 10 monclient: monmap: 2026-02-17T11:15:46.122 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:46.122 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:46.122 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:15:46.120107+0000 2026-02-17T11:15:46.122 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:15:46.120107+0000 2026-02-17T11:15:46.122 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:46.123 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:46.123 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:15:46.123 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:15:46.123 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:15:46.123 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:15:46.123 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:15:46.123 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:15:46.123 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:46.123 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.119+0000 7fb465511640 1 Processor -- start 2026-02-17T11:15:46.123 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.119+0000 7fb465511640 1 -- start start 2026-02-17T11:15:46.123 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.119+0000 7fb465511640 10 monclient: init 2026-02-17T11:15:46.128 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.119+0000 7fb465511640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:46.128 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.119+0000 7fb465511640 10 monclient: _add_conns ranks=[0,5,1,4,2,3] 2026-02-17T11:15:46.128 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.119+0000 7fb465511640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb460155f90 addr v1:10.20.193.49:6789/0 2026-02-17T11:15:46.128 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.119+0000 7fb465511640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7fb4600c2b70 0x7fb46006f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:46.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.119+0000 7fb465511640 10 monclient(hunting): picked mon.noname-c con 0x7fb4600c2b70 addr v2:10.20.193.157:3300/0 2026-02-17T11:15:46.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.119+0000 7fb465511640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fb46006fc30 addr v1:10.20.193.97:6789/0 2026-02-17T11:15:46.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.119+0000 7fb465511640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb46015da20 con 0x7fb460155f90 2026-02-17T11:15:46.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.119+0000 7fb465511640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb46015ffc0 con 0x7fb46006fc30 2026-02-17T11:15:46.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.119+0000 7fb465511640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:46.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.119+0000 7fb465511640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7fb46015c860 con 0x7fb4600c2b70 2026-02-17T11:15:46.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.119+0000 7fb465511640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:46.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.119+0000 7fb465511640 10 monclient(hunting): authenticate will time out at 1422.783691s 2026-02-17T11:15:46.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.120+0000 7fb45effd640 1 --1- >> v1:10.20.193.49:6789/0 conn(0x7fb460155f90 0x7fb46015d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.49:6789/0 says I am v1:10.20.193.49:36364/0 (socket says 10.20.193.49:36364) 2026-02-17T11:15:46.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.120+0000 7fb45effd640 1 -- 10.20.193.49:0/2253560817 learned_addr learned my addr 10.20.193.49:0/2253560817 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:15:46.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.120+0000 7fb45e7fc640 1 --2- 10.20.193.49:0/2253560817 >> v2:10.20.193.157:3300/0 conn(0x7fb4600c2b70 0x7fb46006f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:46.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.120+0000 7fb45e7fc640 10 monclient(hunting): get_auth_request con 0x7fb4600c2b70 auth_method 0 2026-02-17T11:15:46.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.120+0000 7fb45e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:46.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.120+0000 7fb45e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:46.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.120+0000 7fb45e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:46.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.120+0000 7fb45e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:46.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.120+0000 7fb45e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:46.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.120+0000 7fb45e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:46.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.121+0000 7fb45dffb640 1 -- 10.20.193.49:0/2253560817 <== mon.0 v1:10.20.193.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3733229898 0 0) 0x7fb46015da20 con 0x7fb460155f90 2026-02-17T11:15:46.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.121+0000 7fb45dffb640 10 monclient(hunting): _negotiate 2026-02-17T11:15:46.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.121+0000 7fb45dffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:46.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.121+0000 7fb45dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:46.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.121+0000 7fb45dffb640 10 monclient(hunting): my global_id is 5229 2026-02-17T11:15:46.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.121+0000 7fb45dffb640 1 -- 10.20.193.49:0/2253560817 --> v1:10.20.193.49:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb44c003620 con 0x7fb460155f90 2026-02-17T11:15:46.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.121+0000 7fb45dffb640 1 -- 10.20.193.49:0/2253560817 <== mon.1 v1:10.20.193.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 984146331 0 0) 0x7fb46015ffc0 con 0x7fb46006fc30 2026-02-17T11:15:46.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.121+0000 7fb45dffb640 10 monclient(hunting): _negotiate 2026-02-17T11:15:46.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.121+0000 7fb45dffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:46.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.121+0000 7fb45dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:46.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.121+0000 7fb45dffb640 10 monclient(hunting): my global_id is 5203 2026-02-17T11:15:46.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.121+0000 7fb45dffb640 1 -- 10.20.193.49:0/2253560817 --> v1:10.20.193.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb46015da20 con 0x7fb46006fc30 2026-02-17T11:15:46.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.121+0000 7fb45e7fc640 10 monclient(hunting): handle_auth_done global_id 5261 payload 274 2026-02-17T11:15:46.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.121+0000 7fb45e7fc640 1 -- 10.20.193.49:0/2253560817 >> v1:10.20.193.97:6789/0 conn(0x7fb46006fc30 legacy=0x7fb4601667a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:46.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.121+0000 7fb45e7fc640 1 -- 10.20.193.49:0/2253560817 >> v1:10.20.193.49:6789/0 conn(0x7fb460155f90 legacy=0x7fb46015d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:46.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.121+0000 7fb45e7fc640 10 monclient: _finish_hunting 0 2026-02-17T11:15:46.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.121+0000 7fb45e7fc640 1 monclient: found mon.noname-c 2026-02-17T11:15:46.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.121+0000 7fb45e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:46.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.121+0000 7fb45e7fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:15:46.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.121+0000 7fb45e7fc640 1 -- 10.20.193.49:0/2253560817 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4601602a0 con 0x7fb4600c2b70 2026-02-17T11:15:46.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.122+0000 7fb45e7fc640 1 --2- 10.20.193.49:0/2253560817 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb4600c2b70 0x7fb46006f6f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb4480098a0 tx=0x7fb44802ef00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbdd2c8f7bbf1ddf server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:46.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.124+0000 7fb45dffb640 1 -- 10.20.193.49:0/2253560817 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb44803c070 con 0x7fb4600c2b70 2026-02-17T11:15:46.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.124+0000 7fb45dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:46.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.124+0000 7fb45dffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:15:46.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.124+0000 7fb45dffb640 10 monclient: dump: 2026-02-17T11:15:46.130 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:46.130 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:46.130 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:46.130 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:46.130 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:46.130 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:46.130 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:46.130 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:46.130 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:46.130 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:46.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.124+0000 7fb45dffb640 10 monclient: _finish_auth 0 2026-02-17T11:15:46.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.124+0000 7fb45dffb640 10 monclient: _check_auth_tickets 2026-02-17T11:15:46.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.124+0000 7fb45dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:46.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.124+0000 7fb465511640 5 monclient: authenticate success, global_id 5261 2026-02-17T11:15:46.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.124+0000 7fb465511640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:15:46.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.124+0000 7fb45dffb640 1 -- 10.20.193.49:0/2253560817 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb44802fc10 con 0x7fb4600c2b70 2026-02-17T11:15:46.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.124+0000 7fb45dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:46.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.124+0000 7fb45dffb640 1 -- 10.20.193.49:0/2253560817 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb448037440 con 0x7fb4600c2b70 2026-02-17T11:15:46.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.124+0000 7fb45dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:46.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.124+0000 7fb45dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:15:46.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.124+0000 7fb45dffb640 10 monclient: dump: 2026-02-17T11:15:46.130 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:46.130 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:46.130 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:46.130 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:46.130 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:46.130 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:46.130 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:46.130 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:46.130 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:46.130 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:46.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.124+0000 7fb465511640 10 monclient: get_monmap_and_config success 2026-02-17T11:15:46.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.124+0000 7fb465511640 4 set_mon_vals no callback set 2026-02-17T11:15:46.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.124+0000 7fb465511640 10 monclient: shutdown 2026-02-17T11:15:46.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.124+0000 7fb465511640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:46.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.124+0000 7fb465511640 1 -- 10.20.193.49:0/2253560817 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb4600c2b70 msgr2=0x7fb46006f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:46.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.124+0000 7fb465511640 1 --2- 10.20.193.49:0/2253560817 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb4600c2b70 0x7fb46006f6f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb4480098a0 tx=0x7fb44802ef00 comp rx=0 tx=0).stop 2026-02-17T11:15:46.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.124+0000 7fb465511640 1 -- 10.20.193.49:0/2253560817 shutdown_connections 2026-02-17T11:15:46.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.124+0000 7fb465511640 1 --2- 10.20.193.49:0/2253560817 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb4600c2b70 0x7fb46006f6f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:46.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.124+0000 7fb465511640 1 -- 10.20.193.49:0/2253560817 >> 10.20.193.49:0/2253560817 conn(0x7fb4600cc0c0 msgr2=0x7fb4600cc4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:46.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.124+0000 7fb465511640 1 -- 10.20.193.49:0/2253560817 shutdown_connections 2026-02-17T11:15:46.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.124+0000 7fb465511640 1 -- 10.20.193.49:0/2253560817 wait complete. 2026-02-17T11:15:46.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.125+0000 7fb465511640 10 monclient: build_initial_monmap 2026-02-17T11:15:46.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.125+0000 7fb465511640 10 monclient: monmap: 2026-02-17T11:15:46.131 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:46.131 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:15:46.131 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:15:46.131 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:15:46.131 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:46.131 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:46.131 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:15:46.131 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:15:46.131 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:15:46.131 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:46.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.125+0000 7fb465511640 1 librados: starting msgr at 2026-02-17T11:15:46.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.125+0000 7fb465511640 1 librados: starting objecter 2026-02-17T11:15:46.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.125+0000 7fb465511640 1 Processor -- start 2026-02-17T11:15:46.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.125+0000 7fb465511640 1 -- start start 2026-02-17T11:15:46.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.125+0000 7fb465511640 1 librados: setting wanted keys 2026-02-17T11:15:46.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.125+0000 7fb465511640 1 librados: calling monclient init 2026-02-17T11:15:46.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.125+0000 7fb465511640 10 monclient: init 2026-02-17T11:15:46.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.125+0000 7fb465511640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:46.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.125+0000 7fb465511640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:15:46.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.125+0000 7fb465511640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb46006fc30 0x7fb4600cb240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:46.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.125+0000 7fb465511640 10 monclient(hunting): picked mon.noname-b con 0x7fb46006fc30 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:15:46.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.125+0000 7fb465511640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb4600c2b70 0x7fb4601f6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:46.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.125+0000 7fb465511640 10 monclient(hunting): picked mon.noname-a con 0x7fb4600c2b70 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:15:46.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.125+0000 7fb465511640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb460155f90 0x7fb46014d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:46.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.125+0000 7fb465511640 10 monclient(hunting): picked mon.noname-c con 0x7fb460155f90 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:15:46.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.125+0000 7fb465511640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:46.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.125+0000 7fb465511640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb46015c4f0 con 0x7fb4600c2b70 2026-02-17T11:15:46.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.125+0000 7fb465511640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:46.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.125+0000 7fb465511640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb46015c210 con 0x7fb46006fc30 2026-02-17T11:15:46.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.125+0000 7fb465511640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:46.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.125+0000 7fb465511640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb460073080 con 0x7fb460155f90 2026-02-17T11:15:46.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.125+0000 7fb465511640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:46.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.125+0000 7fb465511640 10 monclient(hunting): authenticate will time out at 1422.789874s 2026-02-17T11:15:46.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.126+0000 7fb45f7fe640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb460155f90 0x7fb46014d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:46.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.126+0000 7fb45e7fc640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb4600c2b70 0x7fb4601f6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:46.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.126+0000 7fb45effd640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb46006fc30 0x7fb4600cb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:46.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.126+0000 7fb45f7fe640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb460155f90 0x7fb46014d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:53240/0 (socket says 10.20.193.49:53240) 2026-02-17T11:15:46.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.126+0000 7fb45f7fe640 1 -- 10.20.193.49:0/4136375761 learned_addr learned my addr 10.20.193.49:0/4136375761 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:46.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.126+0000 7fb45f7fe640 10 monclient(hunting): get_auth_request con 0x7fb460155f90 auth_method 0 2026-02-17T11:15:46.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.126+0000 7fb45f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:46.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.126+0000 7fb45f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:46.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.126+0000 7fb45f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:46.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.126+0000 7fb45e7fc640 10 monclient(hunting): get_auth_request con 0x7fb4600c2b70 auth_method 0 2026-02-17T11:15:46.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.126+0000 7fb45e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:46.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.126+0000 7fb45e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:46.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.126+0000 7fb45e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:46.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.126+0000 7fb45effd640 10 monclient(hunting): get_auth_request con 0x7fb46006fc30 auth_method 0 2026-02-17T11:15:46.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.126+0000 7fb45effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:46.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.126+0000 7fb45effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:46.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.126+0000 7fb45effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:46.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.126+0000 7fb45f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:46.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.126+0000 7fb45f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:46.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.126+0000 7fb45f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:46.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.126+0000 7fb45e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:46.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.126+0000 7fb45e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:46.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.126+0000 7fb45e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:46.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.126+0000 7fb45effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:46.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.126+0000 7fb45effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:46.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.126+0000 7fb45effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:46.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.127+0000 7fb45f7fe640 10 monclient(hunting): handle_auth_done global_id 5264 payload 824 2026-02-17T11:15:46.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.127+0000 7fb45f7fe640 1 -- 10.20.193.49:0/4136375761 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb46006fc30 msgr2=0x7fb4600cb240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:46.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.127+0000 7fb45f7fe640 1 --2- 10.20.193.49:0/4136375761 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb46006fc30 0x7fb4600cb240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:46.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.127+0000 7fb45f7fe640 1 -- 10.20.193.49:0/4136375761 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb4600c2b70 msgr2=0x7fb4601f6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:46.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.127+0000 7fb45f7fe640 1 --2- 10.20.193.49:0/4136375761 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb4600c2b70 0x7fb4601f6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:46.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.127+0000 7fb45f7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:15:46.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.127+0000 7fb45f7fe640 1 monclient: found mon.noname-c 2026-02-17T11:15:46.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.127+0000 7fb45f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:46.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.127+0000 7fb45f7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:15:46.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.127+0000 7fb45f7fe640 1 -- 10.20.193.49:0/4136375761 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4600cbef0 con 0x7fb460155f90 2026-02-17T11:15:46.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.130+0000 7fb45f7fe640 1 --2- 10.20.193.49:0/4136375761 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb460155f90 0x7fb46014d8a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb45000cc50 tx=0x7fb45000a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:46.133 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.130+0000 7fb43f7fe640 10 client.?.objecter ms_handle_connect 0x7fb460155f90 2026-02-17T11:15:46.133 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.130+0000 7fb43f7fe640 10 client.?.objecter resend_mon_ops 2026-02-17T11:15:46.134 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.131+0000 7fb43f7fe640 1 -- 10.20.193.49:0/4136375761 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb450003a70 con 0x7fb460155f90 2026-02-17T11:15:46.134 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.131+0000 7fb43f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:46.134 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.131+0000 7fb43f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:15:46.134 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.131+0000 7fb43f7fe640 10 monclient: dump: 2026-02-17T11:15:46.134 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:46.134 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:46.134 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:46.134 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:46.134 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:46.134 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:46.134 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:46.134 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:46.134 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:46.134 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:46.134 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.131+0000 7fb43f7fe640 10 monclient: _finish_auth 0 2026-02-17T11:15:46.134 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.131+0000 7fb43f7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:15:46.134 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.131+0000 7fb43f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:46.134 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.131+0000 7fb43f7fe640 1 -- 10.20.193.49:0/4136375761 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb450003c30 con 0x7fb460155f90 2026-02-17T11:15:46.134 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.131+0000 7fb43f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:46.134 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.131+0000 7fb43f7fe640 1 -- 10.20.193.49:0/4136375761 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4500050d0 con 0x7fb460155f90 2026-02-17T11:15:46.134 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.131+0000 7fb465511640 5 monclient: authenticate success, global_id 5264 2026-02-17T11:15:46.134 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.131+0000 7fb465511640 10 monclient: _renew_subs 2026-02-17T11:15:46.134 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.131+0000 7fb465511640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:15:46.134 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.131+0000 7fb465511640 1 -- 10.20.193.49:0/4136375761 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4600cb930 con 0x7fb460155f90 2026-02-17T11:15:46.134 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.131+0000 7fb45d7fa640 4 set_mon_vals no callback set 2026-02-17T11:15:46.134 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.131+0000 7fb43f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:46.134 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.131+0000 7fb43f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:15:46.134 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.131+0000 7fb43f7fe640 10 monclient: dump: 2026-02-17T11:15:46.134 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:46.134 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:46.134 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:46.134 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:46.134 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:46.134 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:46.134 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:46.134 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:46.134 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:46.134 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:46.135 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.131+0000 7fb465511640 10 client.5264.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:46.135 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.131+0000 7fb465511640 10 monclient: _renew_subs 2026-02-17T11:15:46.135 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.131+0000 7fb465511640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:15:46.135 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.131+0000 7fb465511640 1 -- 10.20.193.49:0/4136375761 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4601589e0 con 0x7fb460155f90 2026-02-17T11:15:46.135 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.131+0000 7fb465511640 1 librados: init done 2026-02-17T11:15:46.135 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.132+0000 7fb465511640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:46.135 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.132+0000 7fb465511640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:46.135 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.132+0000 7fb465511640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:15:46.135 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.132+0000 7fb465511640 1 -- 10.20.193.49:0/4136375761 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4600ccc60 con 0x7fb460155f90 2026-02-17T11:15:46.145 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.143+0000 7fb43f7fe640 1 -- 10.20.193.49:0/4136375761 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7fb450005270 con 0x7fb460155f90 2026-02-17T11:15:46.146 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.143+0000 7fb43f7fe640 1 --2- 10.20.193.49:0/4136375761 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb42c079140 0x7fb42c07b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:46.146 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.144+0000 7fb45effd640 1 --2- 10.20.193.49:0/4136375761 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb42c079140 0x7fb42c07b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:46.146 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.144+0000 7fb45effd640 10 monclient: get_auth_request con 0x7fb42c079140 auth_method 0 2026-02-17T11:15:46.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.144+0000 7fb43f7fe640 10 client.5264.objecter ms_handle_connect 0x7fb42c079140 2026-02-17T11:15:46.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.144+0000 7fb45effd640 1 --2- 10.20.193.49:0/4136375761 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb42c079140 0x7fb42c07b600 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb454007b60 tx=0x7fb454007ab0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:46.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.145+0000 7fb43f7fe640 1 -- 10.20.193.49:0/4136375761 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7fb45005e940 con 0x7fb460155f90 2026-02-17T11:15:46.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.145+0000 7fb43f7fe640 10 client.5264.objecter ms_dispatch2 0x7fb460000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:15:46.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.145+0000 7fb43f7fe640 3 client.5264.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:15:46.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.145+0000 7fb43f7fe640 3 client.5264.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:15:46.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.145+0000 7fb43f7fe640 20 client.5264.objecter dump_active .. 0 homeless 2026-02-17T11:15:46.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.247+0000 7fb43f7fe640 1 -- 10.20.193.49:0/4136375761 <== mon.2 v2:10.20.193.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb4600ccc60 con 0x7fb460155f90 2026-02-17T11:15:46.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.247+0000 7fb43f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:46.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.247+0000 7fb43f7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:15:46.332 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.329+0000 7fb465511640 1 -- 10.20.193.49:0/4136375761 --> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fb46015ccf0 con 0x7fb42c079140 2026-02-17T11:15:46.333 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.330+0000 7fb43f7fe640 1 -- 10.20.193.49:0/4136375761 <== mgr.4106 v2:10.20.193.162:6800/2614632098 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb46015ccf0 con 0x7fb42c079140 2026-02-17T11:15:46.333 INFO:teuthology.orchestra.run.trial049.stderr:instructed osd(s) 5 to deep-scrub 2026-02-17T11:15:46.334 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.331+0000 7fb465511640 10 librados: watch_flush enter 2026-02-17T11:15:46.335 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.331+0000 7fb465511640 10 librados: watch_flush exit 2026-02-17T11:15:46.335 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.331+0000 7fb465511640 20 client.5264.objecter shutdown clearing up homeless session... 2026-02-17T11:15:46.335 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.331+0000 7fb465511640 10 client.5264.objecter successfully canceled tick 2026-02-17T11:15:46.335 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.331+0000 7fb465511640 1 -- 10.20.193.49:0/4136375761 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb42c079140 msgr2=0x7fb42c07b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:46.335 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.331+0000 7fb465511640 1 --2- 10.20.193.49:0/4136375761 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb42c079140 0x7fb42c07b600 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb454007b60 tx=0x7fb454007ab0 comp rx=0 tx=0).stop 2026-02-17T11:15:46.335 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.331+0000 7fb465511640 10 monclient: shutdown 2026-02-17T11:15:46.335 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.331+0000 7fb465511640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:46.335 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.331+0000 7fb465511640 1 -- 10.20.193.49:0/4136375761 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb460155f90 msgr2=0x7fb46014d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:46.335 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.331+0000 7fb465511640 1 --2- 10.20.193.49:0/4136375761 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb460155f90 0x7fb46014d8a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb45000cc50 tx=0x7fb45000a430 comp rx=0 tx=0).stop 2026-02-17T11:15:46.335 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.331+0000 7fb465511640 1 -- 10.20.193.49:0/4136375761 shutdown_connections 2026-02-17T11:15:46.336 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.331+0000 7fb465511640 1 --2- 10.20.193.49:0/4136375761 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fb42c079140 0x7fb42c07b600 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:46.336 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.331+0000 7fb465511640 1 --2- 10.20.193.49:0/4136375761 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fb460155f90 0x7fb46014d8a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:46.336 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.331+0000 7fb465511640 1 --2- 10.20.193.49:0/4136375761 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fb4600c2b70 0x7fb4601f6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:46.336 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.331+0000 7fb465511640 1 --2- 10.20.193.49:0/4136375761 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fb46006fc30 0x7fb4600cb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:46.336 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.331+0000 7fb465511640 1 -- 10.20.193.49:0/4136375761 >> 10.20.193.49:0/4136375761 conn(0x7fb4600cc0c0 msgr2=0x7fb46015d210 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:46.336 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.331+0000 7fb465511640 1 -- 10.20.193.49:0/4136375761 shutdown_connections 2026-02-17T11:15:46.336 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.331+0000 7fb465511640 1 -- 10.20.193.49:0/4136375761 wait complete. 2026-02-17T11:15:46.336 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.331+0000 7fb465511640 1 librados: shutdown 2026-02-17T11:15:46.342 INFO:tasks.ceph:Scrubbing osd.9 2026-02-17T11:15:46.342 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 config set osd_debug_deep_scrub_sleep 0 2026-02-17T11:15:46.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.409+0000 7f5cbedd3640 10 monclient: get_monmap_and_config 2026-02-17T11:15:46.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.409+0000 7f5cbedd3640 10 monclient: build_initial_monmap 2026-02-17T11:15:46.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.409+0000 7f5cbedd3640 10 monclient: monmap: 2026-02-17T11:15:46.411 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:46.411 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:46.411 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:15:46.410674+0000 2026-02-17T11:15:46.411 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:15:46.410674+0000 2026-02-17T11:15:46.411 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:46.412 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:46.412 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:15:46.412 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:15:46.412 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:15:46.412 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:15:46.412 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:15:46.412 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:15:46.412 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:46.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.409+0000 7f5cbedd3640 1 Processor -- start 2026-02-17T11:15:46.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.409+0000 7f5cbedd3640 1 -- start start 2026-02-17T11:15:46.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.409+0000 7f5cbedd3640 10 monclient: init 2026-02-17T11:15:46.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.410+0000 7f5cbedd3640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:46.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.410+0000 7f5cbedd3640 10 monclient: _add_conns ranks=[5,2,3,1,4,0] 2026-02-17T11:15:46.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.410+0000 7f5cbedd3640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f5cb815d3c0 0x7f5cb815d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:46.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.410+0000 7f5cbedd3640 10 monclient(hunting): picked mon.noname-c con 0x7f5cb815d3c0 addr v2:10.20.193.157:3300/0 2026-02-17T11:15:46.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.410+0000 7f5cbedd3640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f5cb80c94c0 addr v1:10.20.193.157:6789/0 2026-02-17T11:15:46.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.410+0000 7f5cbedd3640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f5cb815b050 0x7f5cb80c52f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:46.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.410+0000 7f5cbedd3640 10 monclient(hunting): picked mon.noname-a con 0x7f5cb815b050 addr v2:10.20.193.49:3300/0 2026-02-17T11:15:46.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.410+0000 7f5cbedd3640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cb815b4a0 con 0x7f5cb80c94c0 2026-02-17T11:15:46.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.410+0000 7f5cbedd3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:46.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.410+0000 7f5cbedd3640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f5cb80c7e60 con 0x7f5cb815b050 2026-02-17T11:15:46.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.410+0000 7f5cbedd3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:46.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.410+0000 7f5cbedd3640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f5cb80c8140 con 0x7f5cb815d3c0 2026-02-17T11:15:46.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.410+0000 7f5cbedd3640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:46.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.410+0000 7f5cbedd3640 10 monclient(hunting): authenticate will time out at 1423.074229s 2026-02-17T11:15:46.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.410+0000 7f5cbd349640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f5cb815b050 0x7f5cb80c52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:46.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.410+0000 7f5cbcb48640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f5cb815d3c0 0x7f5cb815d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:46.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.410+0000 7f5cbd349640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f5cb815b050 0x7f5cb80c52f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:43110/0 (socket says 10.20.193.49:43110) 2026-02-17T11:15:46.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.410+0000 7f5cbd349640 1 -- 10.20.193.49:0/3691706119 learned_addr learned my addr 10.20.193.49:0/3691706119 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:46.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.410+0000 7f5cbd349640 10 monclient(hunting): get_auth_request con 0x7f5cb815b050 auth_method 0 2026-02-17T11:15:46.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.410+0000 7f5cbd349640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:46.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.410+0000 7f5cbd349640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:46.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.410+0000 7f5cbd349640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:46.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.410+0000 7f5cbcb48640 10 monclient(hunting): get_auth_request con 0x7f5cb815d3c0 auth_method 0 2026-02-17T11:15:46.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.410+0000 7f5cbcb48640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:46.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.410+0000 7f5cbcb48640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:46.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.410+0000 7f5cbcb48640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:46.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.411+0000 7f5cbd349640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:46.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.411+0000 7f5cbd349640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:46.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.411+0000 7f5cbd349640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:46.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.411+0000 7f5cbd349640 10 monclient(hunting): handle_auth_done global_id 5235 payload 274 2026-02-17T11:15:46.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.411+0000 7f5cbd349640 1 -- 10.20.193.49:0/3691706119 >> v2:10.20.193.157:3300/0 conn(0x7f5cb815d3c0 msgr2=0x7f5cb815d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:15:46.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.411+0000 7f5cbd349640 1 --2- 10.20.193.49:0/3691706119 >> v2:10.20.193.157:3300/0 conn(0x7f5cb815d3c0 0x7f5cb815d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:46.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.411+0000 7f5cbd349640 1 -- 10.20.193.49:0/3691706119 >> v1:10.20.193.157:6789/0 conn(0x7f5cb80c94c0 legacy=0x7f5cb80c7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:46.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.411+0000 7f5cbd349640 10 monclient: _finish_hunting 0 2026-02-17T11:15:46.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.411+0000 7f5cbd349640 1 monclient: found mon.noname-a 2026-02-17T11:15:46.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.411+0000 7f5cbd349640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:46.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.411+0000 7f5cbd349640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:15:46.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.411+0000 7f5cbd349640 1 -- 10.20.193.49:0/3691706119 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cb80c8420 con 0x7f5cb815b050 2026-02-17T11:15:46.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.412+0000 7f5cbd349640 1 --2- 10.20.193.49:0/3691706119 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5cb815b050 0x7f5cb80c52f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5cb8072390 tx=0x7f5cb402f3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=134d11f5847826ea server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:46.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.413+0000 7f5caf7fe640 1 -- 10.20.193.49:0/3691706119 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb40373f0 con 0x7f5cb815b050 2026-02-17T11:15:46.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.413+0000 7f5caf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:46.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.413+0000 7f5caf7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:15:46.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.413+0000 7f5caf7fe640 10 monclient: dump: 2026-02-17T11:15:46.416 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:46.416 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:46.416 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:46.416 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:46.416 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:46.416 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:46.416 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:46.416 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:46.416 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:46.416 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:46.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.413+0000 7f5caf7fe640 10 monclient: _finish_auth 0 2026-02-17T11:15:46.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.413+0000 7f5caf7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:15:46.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.413+0000 7f5caf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:46.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.413+0000 7f5cbedd3640 5 monclient: authenticate success, global_id 5235 2026-02-17T11:15:46.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.413+0000 7f5cbedd3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:15:46.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.414+0000 7f5caf7fe640 1 -- 10.20.193.49:0/3691706119 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cb4037590 con 0x7f5cb815b050 2026-02-17T11:15:46.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.414+0000 7f5caf7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:46.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.414+0000 7f5caf7fe640 1 -- 10.20.193.49:0/3691706119 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb4037960 con 0x7f5cb815b050 2026-02-17T11:15:46.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.414+0000 7f5cbedd3640 10 monclient: get_monmap_and_config success 2026-02-17T11:15:46.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.414+0000 7f5cbedd3640 4 set_mon_vals no callback set 2026-02-17T11:15:46.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.414+0000 7f5caf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:46.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.414+0000 7f5caf7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:15:46.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.414+0000 7f5caf7fe640 10 monclient: dump: 2026-02-17T11:15:46.417 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:46.417 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:46.417 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:46.417 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:46.417 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:46.417 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:46.417 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:46.417 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:46.417 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:46.417 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:46.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.415+0000 7f5cbedd3640 10 monclient: shutdown 2026-02-17T11:15:46.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.415+0000 7f5cbedd3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:46.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.415+0000 7f5cbedd3640 1 -- 10.20.193.49:0/3691706119 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5cb815b050 msgr2=0x7f5cb80c52f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:46.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.415+0000 7f5cbedd3640 1 --2- 10.20.193.49:0/3691706119 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5cb815b050 0x7f5cb80c52f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5cb8072390 tx=0x7f5cb402f3a0 comp rx=0 tx=0).stop 2026-02-17T11:15:46.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.415+0000 7f5cbedd3640 1 -- 10.20.193.49:0/3691706119 shutdown_connections 2026-02-17T11:15:46.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.415+0000 7f5cbedd3640 1 --2- 10.20.193.49:0/3691706119 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5cb815b050 0x7f5cb80c52f0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:46.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.415+0000 7f5cbedd3640 1 --2- 10.20.193.49:0/3691706119 >> v2:10.20.193.157:3300/0 conn(0x7f5cb815d3c0 0x7f5cb815d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:46.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.415+0000 7f5cbedd3640 1 -- 10.20.193.49:0/3691706119 >> 10.20.193.49:0/3691706119 conn(0x7f5cb80c9f60 msgr2=0x7f5cb80ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:46.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.415+0000 7f5cbedd3640 1 -- 10.20.193.49:0/3691706119 shutdown_connections 2026-02-17T11:15:46.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.415+0000 7f5cbedd3640 1 -- 10.20.193.49:0/3691706119 wait complete. 2026-02-17T11:15:46.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.415+0000 7f5cbedd3640 10 monclient: build_initial_monmap 2026-02-17T11:15:46.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.415+0000 7f5cbedd3640 10 monclient: monmap: 2026-02-17T11:15:46.418 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:46.418 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:15:46.418 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:15:46.418 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:15:46.418 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:46.418 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:46.418 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:15:46.418 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:15:46.418 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:15:46.418 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:46.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.415+0000 7f5cbedd3640 1 librados: starting msgr at 2026-02-17T11:15:46.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.415+0000 7f5cbedd3640 1 librados: starting objecter 2026-02-17T11:15:46.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.415+0000 7f5cbedd3640 1 Processor -- start 2026-02-17T11:15:46.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.415+0000 7f5cbedd3640 1 -- start start 2026-02-17T11:15:46.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.415+0000 7f5cbedd3640 1 librados: setting wanted keys 2026-02-17T11:15:46.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.415+0000 7f5cbedd3640 1 librados: calling monclient init 2026-02-17T11:15:46.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.415+0000 7f5cbedd3640 10 monclient: init 2026-02-17T11:15:46.420 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.416+0000 7f5cbedd3640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:46.420 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.416+0000 7f5cbedd3640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:15:46.420 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.416+0000 7f5cbedd3640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5cb80c94c0 0x7f5cb814b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:46.420 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.416+0000 7f5cbedd3640 10 monclient(hunting): picked mon.noname-b con 0x7f5cb80c94c0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:15:46.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.416+0000 7f5cbedd3640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5cb815b050 0x7f5cb81f55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:46.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.416+0000 7f5cbedd3640 10 monclient(hunting): picked mon.noname-c con 0x7f5cb815b050 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:15:46.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.416+0000 7f5cbedd3640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5cb815d3c0 0x7f5cb81f5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:46.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.416+0000 7f5cbedd3640 10 monclient(hunting): picked mon.noname-a con 0x7f5cb815d3c0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:15:46.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.416+0000 7f5cbedd3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:46.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.416+0000 7f5cbedd3640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb80c8cc0 con 0x7f5cb815d3c0 2026-02-17T11:15:46.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.416+0000 7f5cbedd3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:46.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.416+0000 7f5cbedd3640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb80c89e0 con 0x7f5cb80c94c0 2026-02-17T11:15:46.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.416+0000 7f5cbedd3640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:46.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.416+0000 7f5cbedd3640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb80c8fa0 con 0x7f5cb815b050 2026-02-17T11:15:46.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.416+0000 7f5cbedd3640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:46.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.416+0000 7f5cbedd3640 10 monclient(hunting): authenticate will time out at 1423.080358s 2026-02-17T11:15:46.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.416+0000 7f5cbd349640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5cb815d3c0 0x7f5cb81f5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:46.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.416+0000 7f5cbcb48640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5cb80c94c0 0x7f5cb814b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:46.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.416+0000 7f5cbd349640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5cb815d3c0 0x7f5cb81f5b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:43126/0 (socket says 10.20.193.49:43126) 2026-02-17T11:15:46.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.416+0000 7f5cbd349640 1 -- 10.20.193.49:0/2633162615 learned_addr learned my addr 10.20.193.49:0/2633162615 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:46.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.416+0000 7f5cbd349640 10 monclient(hunting): get_auth_request con 0x7f5cb815d3c0 auth_method 0 2026-02-17T11:15:46.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.416+0000 7f5cbd349640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:46.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.416+0000 7f5cbd349640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:46.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.416+0000 7f5cbd349640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:46.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.416+0000 7f5caffff640 1 --2- 10.20.193.49:0/2633162615 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5cb815b050 0x7f5cb81f55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:46.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.416+0000 7f5cbcb48640 10 monclient(hunting): get_auth_request con 0x7f5cb80c94c0 auth_method 0 2026-02-17T11:15:46.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.416+0000 7f5cbcb48640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:46.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.416+0000 7f5cbcb48640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:46.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.416+0000 7f5cbcb48640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:46.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.417+0000 7f5caffff640 10 monclient(hunting): get_auth_request con 0x7f5cb815b050 auth_method 0 2026-02-17T11:15:46.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.417+0000 7f5caffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:46.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.417+0000 7f5caffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:46.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.417+0000 7f5caffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:46.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.417+0000 7f5cbd349640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:46.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.417+0000 7f5cbd349640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:46.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.417+0000 7f5cbd349640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:46.422 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.417+0000 7f5cbcb48640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:46.422 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.417+0000 7f5cbcb48640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:46.422 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.417+0000 7f5cbcb48640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:46.422 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.417+0000 7f5caffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:46.422 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.417+0000 7f5caffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:46.422 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.417+0000 7f5caffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:46.422 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.418+0000 7f5cbd349640 10 monclient(hunting): handle_auth_done global_id 5238 payload 824 2026-02-17T11:15:46.422 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.418+0000 7f5cbd349640 1 -- 10.20.193.49:0/2633162615 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5cb815b050 msgr2=0x7f5cb81f55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:46.422 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.418+0000 7f5cbd349640 1 --2- 10.20.193.49:0/2633162615 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f5cb815b050 0x7f5cb81f55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:46.422 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.418+0000 7f5cbd349640 1 -- 10.20.193.49:0/2633162615 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5cb80c94c0 msgr2=0x7f5cb814b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:46.422 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.418+0000 7f5cbd349640 1 --2- 10.20.193.49:0/2633162615 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f5cb80c94c0 0x7f5cb814b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:46.422 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.418+0000 7f5cbd349640 10 monclient: _finish_hunting 0 2026-02-17T11:15:46.422 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.418+0000 7f5cbd349640 1 monclient: found mon.noname-a 2026-02-17T11:15:46.422 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.418+0000 7f5cbd349640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:46.422 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.418+0000 7f5cbd349640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:15:46.422 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.418+0000 7f5cbd349640 1 -- 10.20.193.49:0/2633162615 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cb806e680 con 0x7f5cb815d3c0 2026-02-17T11:15:46.422 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.419+0000 7f5cbd349640 1 --2- 10.20.193.49:0/2633162615 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5cb815d3c0 0x7f5cb81f5b10 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5cb4039040 tx=0x7f5cb4004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:46.422 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.419+0000 7f5cad7fa640 10 client.?.objecter ms_handle_connect 0x7f5cb815d3c0 2026-02-17T11:15:46.422 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.419+0000 7f5cad7fa640 10 client.?.objecter resend_mon_ops 2026-02-17T11:15:46.426 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.421+0000 7f5cad7fa640 1 -- 10.20.193.49:0/2633162615 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb4046020 con 0x7f5cb815d3c0 2026-02-17T11:15:46.426 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.421+0000 7f5cad7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:46.427 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.421+0000 7f5cad7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:15:46.427 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.421+0000 7f5cad7fa640 10 monclient: dump: 2026-02-17T11:15:46.427 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:46.427 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:46.427 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:46.427 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:46.427 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:46.428 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:46.428 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:46.428 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:46.428 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:46.428 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:46.428 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.421+0000 7f5cad7fa640 10 monclient: _finish_auth 0 2026-02-17T11:15:46.429 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.421+0000 7f5cad7fa640 10 monclient: _check_auth_tickets 2026-02-17T11:15:46.429 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.421+0000 7f5cad7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:46.429 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.421+0000 7f5cad7fa640 1 -- 10.20.193.49:0/2633162615 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cb40079b0 con 0x7f5cb815d3c0 2026-02-17T11:15:46.429 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.421+0000 7f5cad7fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:46.429 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.421+0000 7f5cad7fa640 1 -- 10.20.193.49:0/2633162615 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb40373f0 con 0x7f5cb815d3c0 2026-02-17T11:15:46.429 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.421+0000 7f5cad7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:46.429 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.421+0000 7f5cad7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:15:46.429 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.421+0000 7f5cad7fa640 10 monclient: dump: 2026-02-17T11:15:46.430 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:46.430 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:46.430 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:46.430 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:46.430 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:46.430 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:46.430 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:46.431 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:46.431 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:46.431 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:46.431 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.421+0000 7f5caeffd640 4 set_mon_vals no callback set 2026-02-17T11:15:46.431 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.421+0000 7f5cbedd3640 5 monclient: authenticate success, global_id 5238 2026-02-17T11:15:46.431 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.421+0000 7f5cbedd3640 10 monclient: _renew_subs 2026-02-17T11:15:46.431 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.421+0000 7f5cbedd3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:46.432 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.421+0000 7f5cbedd3640 1 -- 10.20.193.49:0/2633162615 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cb806e960 con 0x7f5cb815d3c0 2026-02-17T11:15:46.432 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.421+0000 7f5cbedd3640 10 client.5238.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:46.432 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.421+0000 7f5cbedd3640 10 monclient: _renew_subs 2026-02-17T11:15:46.432 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.421+0000 7f5cbedd3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:46.432 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.421+0000 7f5cbedd3640 1 -- 10.20.193.49:0/2633162615 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cb806ef20 con 0x7f5cb815d3c0 2026-02-17T11:15:46.432 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.421+0000 7f5cbedd3640 1 librados: init done 2026-02-17T11:15:46.432 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.421+0000 7f5cbedd3640 10 client.5238.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:46.432 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.421+0000 7f5cbedd3640 15 client.5238.objecter _session_command_op_assign -1 1 2026-02-17T11:15:46.432 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.421+0000 7f5cbedd3640 20 client.5238.objecter _get_session osd=-1 returning homeless 2026-02-17T11:15:46.432 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.421+0000 7f5cbedd3640 10 client.5238.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:46.432 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.421+0000 7f5cbedd3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:46.433 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.421+0000 7f5cbedd3640 1 -- 10.20.193.49:0/2633162615 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5cb815d7a0 con 0x7f5cb815d3c0 2026-02-17T11:15:46.435 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.433+0000 7f5cad7fa640 1 -- 10.20.193.49:0/2633162615 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f5cb4041450 con 0x7f5cb815d3c0 2026-02-17T11:15:46.436 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.433+0000 7f5cad7fa640 1 --2- 10.20.193.49:0/2633162615 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5c880791c0 0x7f5c8807b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:46.436 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.434+0000 7f5cbcb48640 1 --2- 10.20.193.49:0/2633162615 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5c880791c0 0x7f5c8807b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:46.436 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.434+0000 7f5cbcb48640 10 monclient: get_auth_request con 0x7f5c880791c0 auth_method 0 2026-02-17T11:15:46.436 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.434+0000 7f5cbcb48640 1 --2- 10.20.193.49:0/2633162615 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5c880791c0 0x7f5c8807b680 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5ca8009a50 tx=0x7f5ca8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:46.437 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.434+0000 7f5cad7fa640 10 client.5238.objecter ms_handle_connect 0x7f5c880791c0 2026-02-17T11:15:46.439 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.435+0000 7f5cad7fa640 1 -- 10.20.193.49:0/2633162615 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f5cb4007da0 con 0x7f5cb815d3c0 2026-02-17T11:15:46.439 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.435+0000 7f5cad7fa640 10 client.5238.objecter ms_dispatch2 0x7f5cb8000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:15:46.439 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.435+0000 7f5cad7fa640 3 client.5238.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:15:46.439 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.435+0000 7f5cad7fa640 3 client.5238.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:15:46.439 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.435+0000 7f5cad7fa640 10 client.5238.objecter checking command 1 2026-02-17T11:15:46.439 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.435+0000 7f5cad7fa640 1 --2- 10.20.193.49:0/2633162615 >> [v2:10.20.193.97:6808/676086260,v1:10.20.193.97:6809/676086260] conn(0x7f5c880816a0 0x7f5c88083ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:46.439 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.435+0000 7f5cad7fa640 20 client.5238.objecter _get_session s=0x7f5c88080fd0 osd=9 3 2026-02-17T11:15:46.439 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.435+0000 7f5cad7fa640 20 client.5238.objecter put_session s=0x7f5c88080fd0 osd=9 3 2026-02-17T11:15:46.439 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.435+0000 7f5cad7fa640 15 client.5238.objecter _session_command_op_remove -1 1 2026-02-17T11:15:46.439 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.436+0000 7f5cad7fa640 20 client.5238.objecter _get_session s=0x7f5c88080fd0 osd=9 3 2026-02-17T11:15:46.439 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.436+0000 7f5cad7fa640 20 client.5238.objecter get_session s=0x7f5c88080fd0 osd=9 3 2026-02-17T11:15:46.439 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.436+0000 7f5cad7fa640 15 client.5238.objecter _session_command_op_assign 9 1 2026-02-17T11:15:46.439 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.436+0000 7f5cad7fa640 20 client.5238.objecter put_session s=0x7f5c88080fd0 osd=9 4 2026-02-17T11:15:46.440 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.436+0000 7f5cad7fa640 10 client.5238.objecter _send_command 1 2026-02-17T11:15:46.440 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.436+0000 7f5cad7fa640 1 -- 10.20.193.49:0/2633162615 --> [v2:10.20.193.97:6808/676086260,v1:10.20.193.97:6809/676086260] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5cb4044e50 con 0x7f5c880816a0 2026-02-17T11:15:46.440 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.436+0000 7f5cad7fa640 20 client.5238.objecter dump_active .. 0 homeless 2026-02-17T11:15:46.440 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.436+0000 7f5cad7fa640 1 -- 10.20.193.49:0/2633162615 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f5cb4084470 con 0x7f5cb815d3c0 2026-02-17T11:15:46.440 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.436+0000 7f5cad7fa640 10 monclient: handle_get_version_reply finishing 1 version 34 2026-02-17T11:15:46.440 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.436+0000 7f5caffff640 1 --2- 10.20.193.49:0/2633162615 >> [v2:10.20.193.97:6808/676086260,v1:10.20.193.97:6809/676086260] conn(0x7f5c880816a0 0x7f5c88083ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:46.440 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.436+0000 7f5caffff640 10 monclient: get_auth_request con 0x7f5c880816a0 auth_method 0 2026-02-17T11:15:46.440 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.438+0000 7f5caffff640 1 --2- 10.20.193.49:0/2633162615 >> [v2:10.20.193.97:6808/676086260,v1:10.20.193.97:6809/676086260] conn(0x7f5c880816a0 0x7f5c88083ac0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:46.441 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.438+0000 7f5cad7fa640 10 client.5238.objecter ms_handle_connect 0x7f5c880816a0 2026-02-17T11:15:46.450 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.449+0000 7f5cad7fa640 1 -- 10.20.193.49:0/2633162615 <== osd.9 v2:10.20.193.97:6808/676086260 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f5cb4044e50 con 0x7f5c880816a0 2026-02-17T11:15:46.451 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.449+0000 7f5cad7fa640 10 client.5238.objecter ms_dispatch2 0x7f5cb8000b90 command_reply(tid 1: 0 ) 2026-02-17T11:15:46.451 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.449+0000 7f5cad7fa640 10 client.5238.objecter _finish_command 1 = system:0 2026-02-17T11:15:46.451 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.449+0000 7f5cad7fa640 20 client.5238.objecter put_session s=0x7f5c88080fd0 osd=9 4 2026-02-17T11:15:46.451 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.449+0000 7f5cad7fa640 15 client.5238.objecter _session_command_op_remove 9 1 2026-02-17T11:15:46.457 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.455+0000 7f5cbedd3640 10 client.5238.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T11:15:46.457 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.455+0000 7f5cbedd3640 15 client.5238.objecter _session_command_op_assign -1 2 2026-02-17T11:15:46.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.455+0000 7f5cbedd3640 20 client.5238.objecter _get_session s=0x7f5c88080fd0 osd=9 3 2026-02-17T11:15:46.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.455+0000 7f5cbedd3640 20 client.5238.objecter put_session s=0x7f5c88080fd0 osd=9 3 2026-02-17T11:15:46.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.455+0000 7f5cbedd3640 20 client.5238.objecter _get_session s=0x7f5c88080fd0 osd=9 3 2026-02-17T11:15:46.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.455+0000 7f5cbedd3640 15 client.5238.objecter _session_command_op_remove -1 2 2026-02-17T11:15:46.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.455+0000 7f5cbedd3640 20 client.5238.objecter get_session s=0x7f5c88080fd0 osd=9 3 2026-02-17T11:15:46.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.455+0000 7f5cbedd3640 15 client.5238.objecter _session_command_op_assign 9 2 2026-02-17T11:15:46.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.455+0000 7f5cbedd3640 20 client.5238.objecter put_session s=0x7f5c88080fd0 osd=9 4 2026-02-17T11:15:46.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.455+0000 7f5cbedd3640 10 client.5238.objecter _send_command 2 2026-02-17T11:15:46.458 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.455+0000 7f5cbedd3640 1 -- 10.20.193.49:0/2633162615 --> [v2:10.20.193.97:6808/676086260,v1:10.20.193.97:6809/676086260] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f5cb814bbc0 con 0x7f5c880816a0 2026-02-17T11:15:46.464 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.461+0000 7f5cad7fa640 1 -- 10.20.193.49:0/2633162615 <== osd.9 v2:10.20.193.97:6808/676086260 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f5cb814bbc0 con 0x7f5c880816a0 2026-02-17T11:15:46.464 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.461+0000 7f5cad7fa640 10 client.5238.objecter ms_dispatch2 0x7f5cb8000b90 command_reply(tid 2: 0 ) 2026-02-17T11:15:46.464 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.461+0000 7f5cad7fa640 10 client.5238.objecter _finish_command 2 = system:0 2026-02-17T11:15:46.464 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.461+0000 7f5cad7fa640 20 client.5238.objecter put_session s=0x7f5c88080fd0 osd=9 4 2026-02-17T11:15:46.464 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.461+0000 7f5cad7fa640 15 client.5238.objecter _session_command_op_remove 9 2 2026-02-17T11:15:46.465 INFO:teuthology.orchestra.run.trial049.stdout:{ 2026-02-17T11:15:46.465 INFO:teuthology.orchestra.run.trial049.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T11:15:46.465 INFO:teuthology.orchestra.run.trial049.stdout:} 2026-02-17T11:15:46.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.462+0000 7f5cbedd3640 10 librados: watch_flush enter 2026-02-17T11:15:46.466 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.462+0000 7f5cbedd3640 10 librados: watch_flush exit 2026-02-17T11:15:46.467 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.462+0000 7f5cbedd3640 10 client.5238.objecter close_session for osd.9 2026-02-17T11:15:46.467 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.462+0000 7f5cbedd3640 1 -- 10.20.193.49:0/2633162615 >> [v2:10.20.193.97:6808/676086260,v1:10.20.193.97:6809/676086260] conn(0x7f5c880816a0 msgr2=0x7f5c88083ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:46.467 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.462+0000 7f5cbedd3640 1 --2- 10.20.193.49:0/2633162615 >> [v2:10.20.193.97:6808/676086260,v1:10.20.193.97:6809/676086260] conn(0x7f5c880816a0 0x7f5c88083ac0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:46.467 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.462+0000 7f5cbedd3640 20 client.5238.objecter put_session s=0x7f5c88080fd0 osd=9 1 2026-02-17T11:15:46.467 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.462+0000 7f5cbedd3640 20 client.5238.objecter shutdown clearing up homeless session... 2026-02-17T11:15:46.467 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.462+0000 7f5cbedd3640 10 client.5238.objecter successfully canceled tick 2026-02-17T11:15:46.467 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.462+0000 7f5cbedd3640 1 -- 10.20.193.49:0/2633162615 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5c880791c0 msgr2=0x7f5c8807b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:46.467 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.462+0000 7f5cbedd3640 1 --2- 10.20.193.49:0/2633162615 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5c880791c0 0x7f5c8807b680 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5ca8009a50 tx=0x7f5ca8008040 comp rx=0 tx=0).stop 2026-02-17T11:15:46.467 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.462+0000 7f5cbedd3640 10 monclient: shutdown 2026-02-17T11:15:46.467 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.462+0000 7f5cbedd3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:46.467 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.462+0000 7f5cbedd3640 1 -- 10.20.193.49:0/2633162615 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5cb815d3c0 msgr2=0x7f5cb81f5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:46.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.462+0000 7f5cbedd3640 1 --2- 10.20.193.49:0/2633162615 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f5cb815d3c0 0x7f5cb81f5b10 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5cb4039040 tx=0x7f5cb4004b40 comp rx=0 tx=0).stop 2026-02-17T11:15:46.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.462+0000 7f5cbd349640 1 -- 10.20.193.49:0/2633162615 reap_dead start 2026-02-17T11:15:46.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.462+0000 7f5cbedd3640 1 -- 10.20.193.49:0/2633162615 shutdown_connections 2026-02-17T11:15:46.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.462+0000 7f5cbedd3640 1 -- 10.20.193.49:0/2633162615 >> 10.20.193.49:0/2633162615 conn(0x7f5cb80c9f60 msgr2=0x7f5cb80cb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:46.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.462+0000 7f5cbedd3640 1 -- 10.20.193.49:0/2633162615 shutdown_connections 2026-02-17T11:15:46.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.462+0000 7f5cbedd3640 1 -- 10.20.193.49:0/2633162615 wait complete. 2026-02-17T11:15:46.468 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.462+0000 7f5cbedd3640 1 librados: shutdown 2026-02-17T11:15:46.472 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 9 2026-02-17T11:15:46.545 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.536+0000 7fe032ff5640 10 monclient: get_monmap_and_config 2026-02-17T11:15:46.545 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.536+0000 7fe032ff5640 10 monclient: build_initial_monmap 2026-02-17T11:15:46.545 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.536+0000 7fe032ff5640 10 monclient: monmap: 2026-02-17T11:15:46.546 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:46.546 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:46.546 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:15:46.537607+0000 2026-02-17T11:15:46.546 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:15:46.537607+0000 2026-02-17T11:15:46.546 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:46.546 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:46.546 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:15:46.546 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:15:46.546 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:15:46.546 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:15:46.546 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:15:46.546 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:15:46.547 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:46.547 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.536+0000 7fe032ff5640 1 Processor -- start 2026-02-17T11:15:46.547 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.536+0000 7fe032ff5640 1 -- start start 2026-02-17T11:15:46.547 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.536+0000 7fe032ff5640 10 monclient: init 2026-02-17T11:15:46.547 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.537+0000 7fe032ff5640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:46.547 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.537+0000 7fe032ff5640 10 monclient: _add_conns ranks=[3,1,0,5,2,4] 2026-02-17T11:15:46.547 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.537+0000 7fe032ff5640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7fe02c0c7170 0x7fe02c0c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:46.547 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.537+0000 7fe032ff5640 10 monclient(hunting): picked mon.noname-a con 0x7fe02c0c7170 addr v2:10.20.193.49:3300/0 2026-02-17T11:15:46.547 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.537+0000 7fe032ff5640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fe02c0c48c0 addr v1:10.20.193.97:6789/0 2026-02-17T11:15:46.547 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.537+0000 7fe032ff5640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe02c0c4d10 addr v1:10.20.193.49:6789/0 2026-02-17T11:15:46.548 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.537+0000 7fe032ff5640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe02c15a9a0 con 0x7fe02c0c4d10 2026-02-17T11:15:46.548 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.537+0000 7fe032ff5640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe02c0c5270 con 0x7fe02c0c48c0 2026-02-17T11:15:46.548 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.537+0000 7fe032ff5640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:46.548 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.537+0000 7fe032ff5640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7fe02c0c8530 con 0x7fe02c0c7170 2026-02-17T11:15:46.548 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.537+0000 7fe032ff5640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:46.548 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.537+0000 7fe032ff5640 10 monclient(hunting): authenticate will time out at 1423.201131s 2026-02-17T11:15:46.548 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.537+0000 7fe023fff640 1 --1- >> v1:10.20.193.97:6789/0 conn(0x7fe02c0c48c0 0x7fe02c0749b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.97:6789/0 says I am v1:10.20.193.49:49828/0 (socket says 10.20.193.49:49828) 2026-02-17T11:15:46.548 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.537+0000 7fe023fff640 1 -- 10.20.193.49:0/70575203 learned_addr learned my addr 10.20.193.49:0/70575203 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:15:46.548 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.537+0000 7fe030d6a640 1 --2- 10.20.193.49:0/70575203 >> v2:10.20.193.49:3300/0 conn(0x7fe02c0c7170 0x7fe02c0c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:46.548 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.537+0000 7fe030d6a640 10 monclient(hunting): get_auth_request con 0x7fe02c0c7170 auth_method 0 2026-02-17T11:15:46.548 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.537+0000 7fe030d6a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:46.549 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.537+0000 7fe030d6a640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:46.549 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.537+0000 7fe030d6a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:46.549 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.538+0000 7fe030d6a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:46.549 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.538+0000 7fe030d6a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:46.549 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.538+0000 7fe030d6a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:46.549 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.538+0000 7fe0237fe640 1 -- 10.20.193.49:0/70575203 <== mon.1 v1:10.20.193.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1383953156 0 0) 0x7fe02c0c5270 con 0x7fe02c0c48c0 2026-02-17T11:15:46.549 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.538+0000 7fe0237fe640 10 monclient(hunting): _negotiate 2026-02-17T11:15:46.549 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.538+0000 7fe0237fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:46.549 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.538+0000 7fe0237fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:46.549 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.538+0000 7fe0237fe640 10 monclient(hunting): my global_id is 5212 2026-02-17T11:15:46.549 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.538+0000 7fe0237fe640 1 -- 10.20.193.49:0/70575203 --> v1:10.20.193.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe018003620 con 0x7fe02c0c48c0 2026-02-17T11:15:46.549 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.539+0000 7fe030d6a640 10 monclient(hunting): handle_auth_done global_id 5241 payload 274 2026-02-17T11:15:46.549 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.539+0000 7fe030d6a640 1 -- 10.20.193.49:0/70575203 >> v1:10.20.193.97:6789/0 conn(0x7fe02c0c48c0 legacy=0x7fe02c0749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:46.550 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.539+0000 7fe030d6a640 1 -- 10.20.193.49:0/70575203 >> v1:10.20.193.49:6789/0 conn(0x7fe02c0c4d10 legacy=0x7fe02c0c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:46.550 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.539+0000 7fe030d6a640 10 monclient: _finish_hunting 0 2026-02-17T11:15:46.550 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.539+0000 7fe030d6a640 1 monclient: found mon.noname-a 2026-02-17T11:15:46.550 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.539+0000 7fe030d6a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:46.550 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.539+0000 7fe030d6a640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:15:46.550 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.539+0000 7fe030d6a640 1 -- 10.20.193.49:0/70575203 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe02c0c5550 con 0x7fe02c0c7170 2026-02-17T11:15:46.550 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.541+0000 7fe030d6a640 1 --2- 10.20.193.49:0/70575203 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe02c0c7170 0x7fe02c0c7550 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe01c0098a0 tx=0x7fe01c02ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe2ea4c557d08874 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:46.556 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.543+0000 7fe0237fe640 1 -- 10.20.193.49:0/70575203 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe01c03c070 con 0x7fe02c0c7170 2026-02-17T11:15:46.557 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.543+0000 7fe0237fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:46.557 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.543+0000 7fe0237fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:15:46.557 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.543+0000 7fe0237fe640 10 monclient: dump: 2026-02-17T11:15:46.557 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:46.557 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:46.557 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:46.557 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:46.557 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:46.557 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:46.557 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:46.557 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:46.558 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:46.558 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:46.558 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.543+0000 7fe0237fe640 10 monclient: _finish_auth 0 2026-02-17T11:15:46.558 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.543+0000 7fe0237fe640 10 monclient: _check_auth_tickets 2026-02-17T11:15:46.558 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.543+0000 7fe0237fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:46.558 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.543+0000 7fe0237fe640 1 -- 10.20.193.49:0/70575203 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe01c02fb70 con 0x7fe02c0c7170 2026-02-17T11:15:46.558 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.543+0000 7fe032ff5640 5 monclient: authenticate success, global_id 5241 2026-02-17T11:15:46.558 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.543+0000 7fe032ff5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:15:46.558 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.543+0000 7fe0237fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:46.558 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.543+0000 7fe0237fe640 1 -- 10.20.193.49:0/70575203 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe01c037440 con 0x7fe02c0c7170 2026-02-17T11:15:46.558 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.543+0000 7fe032ff5640 10 monclient: get_monmap_and_config success 2026-02-17T11:15:46.558 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.543+0000 7fe032ff5640 4 set_mon_vals no callback set 2026-02-17T11:15:46.559 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.543+0000 7fe0237fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:46.559 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.543+0000 7fe0237fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:15:46.559 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.543+0000 7fe0237fe640 10 monclient: dump: 2026-02-17T11:15:46.559 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:46.559 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:46.559 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:46.559 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:46.559 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:46.559 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:46.559 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:46.559 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:46.559 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:46.560 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:46.560 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.543+0000 7fe032ff5640 10 monclient: shutdown 2026-02-17T11:15:46.560 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.543+0000 7fe032ff5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:46.560 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.543+0000 7fe032ff5640 1 -- 10.20.193.49:0/70575203 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe02c0c7170 msgr2=0x7fe02c0c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:46.560 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.543+0000 7fe032ff5640 1 --2- 10.20.193.49:0/70575203 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe02c0c7170 0x7fe02c0c7550 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe01c0098a0 tx=0x7fe01c02ee60 comp rx=0 tx=0).stop 2026-02-17T11:15:46.560 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.543+0000 7fe032ff5640 1 -- 10.20.193.49:0/70575203 shutdown_connections 2026-02-17T11:15:46.560 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.543+0000 7fe032ff5640 1 --2- 10.20.193.49:0/70575203 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe02c0c7170 0x7fe02c0c7550 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:46.560 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.543+0000 7fe032ff5640 1 -- 10.20.193.49:0/70575203 >> 10.20.193.49:0/70575203 conn(0x7fe02c0c9f40 msgr2=0x7fe02c0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:46.560 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.543+0000 7fe032ff5640 1 -- 10.20.193.49:0/70575203 shutdown_connections 2026-02-17T11:15:46.560 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.543+0000 7fe032ff5640 1 -- 10.20.193.49:0/70575203 wait complete. 2026-02-17T11:15:46.560 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.544+0000 7fe032ff5640 10 monclient: build_initial_monmap 2026-02-17T11:15:46.560 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.544+0000 7fe032ff5640 10 monclient: monmap: 2026-02-17T11:15:46.561 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:46.561 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:15:46.561 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:15:46.561 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:15:46.561 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:46.561 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:46.561 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:15:46.561 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:15:46.561 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:15:46.561 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:46.561 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.544+0000 7fe032ff5640 1 librados: starting msgr at 2026-02-17T11:15:46.561 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.544+0000 7fe032ff5640 1 librados: starting objecter 2026-02-17T11:15:46.562 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.544+0000 7fe032ff5640 1 Processor -- start 2026-02-17T11:15:46.562 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.544+0000 7fe032ff5640 1 -- start start 2026-02-17T11:15:46.562 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.544+0000 7fe032ff5640 1 librados: setting wanted keys 2026-02-17T11:15:46.562 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.544+0000 7fe032ff5640 1 librados: calling monclient init 2026-02-17T11:15:46.562 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.544+0000 7fe032ff5640 10 monclient: init 2026-02-17T11:15:46.562 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.545+0000 7fe032ff5640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:46.562 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.545+0000 7fe032ff5640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:15:46.562 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.545+0000 7fe032ff5640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe02c0c48c0 0x7fe02c1586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:46.562 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.545+0000 7fe032ff5640 10 monclient(hunting): picked mon.noname-b con 0x7fe02c0c48c0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:15:46.562 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.545+0000 7fe032ff5640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe02c0c4d10 0x7fe02c14b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:46.562 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.545+0000 7fe032ff5640 10 monclient(hunting): picked mon.noname-c con 0x7fe02c0c4d10 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:15:46.562 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.545+0000 7fe032ff5640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe02c0c7170 0x7fe02c15ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:46.562 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.545+0000 7fe032ff5640 10 monclient(hunting): picked mon.noname-a con 0x7fe02c0c7170 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:15:46.563 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.545+0000 7fe032ff5640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:46.563 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.545+0000 7fe032ff5640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe02c0c81c0 con 0x7fe02c0c7170 2026-02-17T11:15:46.563 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.545+0000 7fe032ff5640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:46.563 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.545+0000 7fe032ff5640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe02c0c7ee0 con 0x7fe02c0c48c0 2026-02-17T11:15:46.563 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.545+0000 7fe032ff5640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:46.563 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.545+0000 7fe032ff5640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe02c0750c0 con 0x7fe02c0c4d10 2026-02-17T11:15:46.563 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.545+0000 7fe032ff5640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:46.563 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.545+0000 7fe032ff5640 10 monclient(hunting): authenticate will time out at 1423.209269s 2026-02-17T11:15:46.563 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.545+0000 7fe03156b640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe02c0c7170 0x7fe02c15ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:46.563 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.545+0000 7fe023fff640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe02c0c4d10 0x7fe02c14b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:46.563 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.545+0000 7fe03156b640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe02c0c7170 0x7fe02c15ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:43136/0 (socket says 10.20.193.49:43136) 2026-02-17T11:15:46.563 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.545+0000 7fe03156b640 1 -- 10.20.193.49:0/2579872995 learned_addr learned my addr 10.20.193.49:0/2579872995 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:46.564 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.545+0000 7fe03156b640 10 monclient(hunting): get_auth_request con 0x7fe02c0c7170 auth_method 0 2026-02-17T11:15:46.564 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.545+0000 7fe03156b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:46.564 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.545+0000 7fe03156b640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:46.564 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.545+0000 7fe03156b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:46.564 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.545+0000 7fe030d6a640 1 --2- 10.20.193.49:0/2579872995 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe02c0c48c0 0x7fe02c1586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:46.564 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.545+0000 7fe03156b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:46.564 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.545+0000 7fe03156b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:46.564 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.545+0000 7fe03156b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:46.564 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.545+0000 7fe023fff640 10 monclient(hunting): get_auth_request con 0x7fe02c0c4d10 auth_method 0 2026-02-17T11:15:46.564 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.545+0000 7fe023fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:46.564 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.545+0000 7fe023fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:46.564 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.545+0000 7fe023fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:46.565 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.545+0000 7fe030d6a640 10 monclient(hunting): get_auth_request con 0x7fe02c0c48c0 auth_method 0 2026-02-17T11:15:46.565 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.545+0000 7fe030d6a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:46.565 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.545+0000 7fe030d6a640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:46.565 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.545+0000 7fe030d6a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:46.565 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.546+0000 7fe023fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:46.565 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.546+0000 7fe023fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:46.565 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.546+0000 7fe023fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:46.565 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.546+0000 7fe030d6a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:46.565 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.546+0000 7fe030d6a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:46.565 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.546+0000 7fe030d6a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:46.565 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.547+0000 7fe03156b640 10 monclient(hunting): handle_auth_done global_id 5247 payload 824 2026-02-17T11:15:46.565 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.547+0000 7fe03156b640 1 -- 10.20.193.49:0/2579872995 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe02c0c4d10 msgr2=0x7fe02c14b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:46.565 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.547+0000 7fe03156b640 1 --2- 10.20.193.49:0/2579872995 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe02c0c4d10 0x7fe02c14b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:46.566 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.547+0000 7fe03156b640 1 -- 10.20.193.49:0/2579872995 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe02c0c48c0 msgr2=0x7fe02c1586a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:46.566 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.547+0000 7fe03156b640 1 --2- 10.20.193.49:0/2579872995 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe02c0c48c0 0x7fe02c1586a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:46.566 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.547+0000 7fe03156b640 10 monclient: _finish_hunting 0 2026-02-17T11:15:46.566 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.547+0000 7fe03156b640 1 monclient: found mon.noname-a 2026-02-17T11:15:46.566 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.547+0000 7fe03156b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:46.566 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.547+0000 7fe03156b640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:15:46.566 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.547+0000 7fe03156b640 1 -- 10.20.193.49:0/2579872995 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe02c15c550 con 0x7fe02c0c7170 2026-02-17T11:15:46.566 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.548+0000 7fe03156b640 1 --2- 10.20.193.49:0/2579872995 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe02c0c7170 0x7fe02c15ba30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe02800cbf0 tx=0x7fe02800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:46.566 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.548+0000 7fe0217fa640 10 client.?.objecter ms_handle_connect 0x7fe02c0c7170 2026-02-17T11:15:46.566 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.548+0000 7fe0217fa640 10 client.?.objecter resend_mon_ops 2026-02-17T11:15:46.566 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.550+0000 7fe0217fa640 1 -- 10.20.193.49:0/2579872995 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe02800ce10 con 0x7fe02c0c7170 2026-02-17T11:15:46.566 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.550+0000 7fe0217fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:46.567 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.550+0000 7fe0217fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:15:46.567 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.550+0000 7fe0217fa640 10 monclient: dump: 2026-02-17T11:15:46.567 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:46.567 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:46.567 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:46.567 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:46.567 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:46.567 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:46.567 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:46.568 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:46.568 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:46.568 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:46.568 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.550+0000 7fe0217fa640 10 monclient: _finish_auth 0 2026-02-17T11:15:46.568 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.550+0000 7fe0217fa640 10 monclient: _check_auth_tickets 2026-02-17T11:15:46.568 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.550+0000 7fe0217fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:46.568 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.550+0000 7fe0217fa640 1 -- 10.20.193.49:0/2579872995 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe028003a20 con 0x7fe02c0c7170 2026-02-17T11:15:46.568 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.550+0000 7fe0217fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:46.568 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.550+0000 7fe0217fa640 1 -- 10.20.193.49:0/2579872995 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe028003df0 con 0x7fe02c0c7170 2026-02-17T11:15:46.568 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.550+0000 7fe0217fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:46.568 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.550+0000 7fe0217fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:15:46.568 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.550+0000 7fe0217fa640 10 monclient: dump: 2026-02-17T11:15:46.569 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:46.569 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:46.569 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:46.569 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:46.569 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:46.569 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:46.569 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:46.569 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:46.569 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:46.569 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:46.569 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.550+0000 7fe022ffd640 4 set_mon_vals no callback set 2026-02-17T11:15:46.569 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.550+0000 7fe032ff5640 5 monclient: authenticate success, global_id 5247 2026-02-17T11:15:46.569 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.550+0000 7fe032ff5640 10 monclient: _renew_subs 2026-02-17T11:15:46.570 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.550+0000 7fe032ff5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:46.570 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.550+0000 7fe032ff5640 1 -- 10.20.193.49:0/2579872995 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe02c151f50 con 0x7fe02c0c7170 2026-02-17T11:15:46.570 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.550+0000 7fe032ff5640 10 client.5247.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:46.570 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.550+0000 7fe032ff5640 10 monclient: _renew_subs 2026-02-17T11:15:46.570 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.550+0000 7fe032ff5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:46.570 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.550+0000 7fe032ff5640 1 -- 10.20.193.49:0/2579872995 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe02c152510 con 0x7fe02c0c7170 2026-02-17T11:15:46.570 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.550+0000 7fe032ff5640 1 librados: init done 2026-02-17T11:15:46.570 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.550+0000 7fe032ff5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:46.570 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.550+0000 7fe032ff5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:46.570 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.550+0000 7fe032ff5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:46.570 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.550+0000 7fe032ff5640 1 -- 10.20.193.49:0/2579872995 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe02c0c7550 con 0x7fe02c0c7170 2026-02-17T11:15:46.572 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.562+0000 7fe0217fa640 1 -- 10.20.193.49:0/2579872995 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7fe0280050d0 con 0x7fe02c0c7170 2026-02-17T11:15:46.572 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.562+0000 7fe0217fa640 1 --2- 10.20.193.49:0/2579872995 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fdffc079190 0x7fdffc07b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:46.572 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.563+0000 7fe030d6a640 1 --2- 10.20.193.49:0/2579872995 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fdffc079190 0x7fdffc07b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:46.572 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.563+0000 7fe030d6a640 10 monclient: get_auth_request con 0x7fdffc079190 auth_method 0 2026-02-17T11:15:46.572 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.563+0000 7fe030d6a640 1 --2- 10.20.193.49:0/2579872995 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fdffc079190 0x7fdffc07b650 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe01c039000 tx=0x7fe01c033000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:46.572 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.563+0000 7fe0217fa640 10 client.5247.objecter ms_handle_connect 0x7fdffc079190 2026-02-17T11:15:46.572 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.564+0000 7fe0217fa640 1 -- 10.20.193.49:0/2579872995 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7fe02805e880 con 0x7fe02c0c7170 2026-02-17T11:15:46.572 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.564+0000 7fe0217fa640 10 client.5247.objecter ms_dispatch2 0x7fe02c000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:15:46.573 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.564+0000 7fe0217fa640 3 client.5247.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:15:46.573 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.564+0000 7fe0217fa640 3 client.5247.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:15:46.573 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.564+0000 7fe0217fa640 20 client.5247.objecter dump_active .. 0 homeless 2026-02-17T11:15:46.664 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.661+0000 7fe0217fa640 1 -- 10.20.193.49:0/2579872995 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe028062840 con 0x7fe02c0c7170 2026-02-17T11:15:46.664 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.661+0000 7fe0217fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:46.665 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.661+0000 7fe0217fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:15:46.746 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.743+0000 7fe032ff5640 1 -- 10.20.193.49:0/2579872995 --> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "9", "target": ["mon-mgr", ""]}) -- 0x7fe02c073c90 con 0x7fdffc079190 2026-02-17T11:15:46.746 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.745+0000 7fe0217fa640 1 -- 10.20.193.49:0/2579872995 <== mgr.4106 v2:10.20.193.162:6800/2614632098 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 9 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe02c073c90 con 0x7fdffc079190 2026-02-17T11:15:46.746 INFO:teuthology.orchestra.run.trial049.stderr:instructed osd(s) 9 to deep-scrub 2026-02-17T11:15:46.747 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.745+0000 7fe032ff5640 10 librados: watch_flush enter 2026-02-17T11:15:46.747 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.745+0000 7fe032ff5640 10 librados: watch_flush exit 2026-02-17T11:15:46.747 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.745+0000 7fe032ff5640 20 client.5247.objecter shutdown clearing up homeless session... 2026-02-17T11:15:46.747 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.745+0000 7fe032ff5640 10 client.5247.objecter successfully canceled tick 2026-02-17T11:15:46.747 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.745+0000 7fe032ff5640 1 -- 10.20.193.49:0/2579872995 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fdffc079190 msgr2=0x7fdffc07b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:46.747 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.745+0000 7fe032ff5640 1 --2- 10.20.193.49:0/2579872995 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fdffc079190 0x7fdffc07b650 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe01c039000 tx=0x7fe01c033000 comp rx=0 tx=0).stop 2026-02-17T11:15:46.747 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.745+0000 7fe032ff5640 10 monclient: shutdown 2026-02-17T11:15:46.747 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.745+0000 7fe032ff5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:46.747 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.745+0000 7fe032ff5640 1 -- 10.20.193.49:0/2579872995 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe02c0c7170 msgr2=0x7fe02c15ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:46.747 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.745+0000 7fe032ff5640 1 --2- 10.20.193.49:0/2579872995 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe02c0c7170 0x7fe02c15ba30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe02800cbf0 tx=0x7fe02800a430 comp rx=0 tx=0).stop 2026-02-17T11:15:46.747 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.745+0000 7fe032ff5640 1 -- 10.20.193.49:0/2579872995 shutdown_connections 2026-02-17T11:15:46.747 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.745+0000 7fe032ff5640 1 --2- 10.20.193.49:0/2579872995 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fdffc079190 0x7fdffc07b650 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:46.747 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.745+0000 7fe032ff5640 1 --2- 10.20.193.49:0/2579872995 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fe02c0c7170 0x7fe02c15ba30 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:46.747 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.745+0000 7fe032ff5640 1 --2- 10.20.193.49:0/2579872995 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fe02c0c4d10 0x7fe02c14b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:46.747 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.745+0000 7fe032ff5640 1 --2- 10.20.193.49:0/2579872995 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fe02c0c48c0 0x7fe02c1586a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:46.747 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.745+0000 7fe032ff5640 1 -- 10.20.193.49:0/2579872995 >> 10.20.193.49:0/2579872995 conn(0x7fe02c0c9f40 msgr2=0x7fe02c159240 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:46.747 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.745+0000 7fe032ff5640 1 -- 10.20.193.49:0/2579872995 shutdown_connections 2026-02-17T11:15:46.747 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.745+0000 7fe032ff5640 1 -- 10.20.193.49:0/2579872995 wait complete. 2026-02-17T11:15:46.747 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.745+0000 7fe032ff5640 1 librados: shutdown 2026-02-17T11:15:46.755 INFO:tasks.ceph:Scrubbing osd.13 2026-02-17T11:15:46.755 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.13 config set osd_debug_deep_scrub_sleep 0 2026-02-17T11:15:46.825 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.823+0000 7f9bd9349640 10 monclient: get_monmap_and_config 2026-02-17T11:15:46.825 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.823+0000 7f9bd9349640 10 monclient: build_initial_monmap 2026-02-17T11:15:46.825 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.823+0000 7f9bd9349640 10 monclient: monmap: 2026-02-17T11:15:46.825 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:46.825 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:46.825 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:15:46.824659+0000 2026-02-17T11:15:46.825 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:15:46.824659+0000 2026-02-17T11:15:46.825 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:46.825 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:46.825 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:15:46.825 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:15:46.826 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:15:46.826 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:15:46.826 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:15:46.826 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:15:46.826 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:46.827 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.823+0000 7f9bd9349640 1 Processor -- start 2026-02-17T11:15:46.828 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.823+0000 7f9bd9349640 1 -- start start 2026-02-17T11:15:46.828 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.823+0000 7f9bd9349640 10 monclient: init 2026-02-17T11:15:46.828 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.824+0000 7f9bd9349640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:46.828 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.824+0000 7f9bd9349640 10 monclient: _add_conns ranks=[4,1,2,5,0,3] 2026-02-17T11:15:46.828 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.824+0000 7f9bd9349640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f9bd41528b0 0x7f9bd415d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:46.828 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.824+0000 7f9bd9349640 10 monclient(hunting): picked mon.noname-b con 0x7f9bd41528b0 addr v2:10.20.193.97:3300/0 2026-02-17T11:15:46.828 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.824+0000 7f9bd9349640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f9bd415d910 addr v1:10.20.193.97:6789/0 2026-02-17T11:15:46.828 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.824+0000 7f9bd9349640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f9bd415fbe0 addr v1:10.20.193.157:6789/0 2026-02-17T11:15:46.828 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.824+0000 7f9bd9349640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bd40c9f20 con 0x7f9bd415d910 2026-02-17T11:15:46.828 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.824+0000 7f9bd9349640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bd40c8ba0 con 0x7f9bd415fbe0 2026-02-17T11:15:46.829 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.824+0000 7f9bd9349640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:46.829 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.824+0000 7f9bd9349640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd40c9a90 con 0x7f9bd41528b0 2026-02-17T11:15:46.829 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.824+0000 7f9bd9349640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:46.829 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.824+0000 7f9bd9349640 10 monclient(hunting): authenticate will time out at 1423.488208s 2026-02-17T11:15:46.829 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.824+0000 7f9bd37fe640 1 --1- >> v1:10.20.193.157:6789/0 conn(0x7f9bd415fbe0 0x7f9bd4073850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.157:6789/0 says I am v1:10.20.193.49:44740/0 (socket says 10.20.193.49:44740) 2026-02-17T11:15:46.829 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.824+0000 7f9bd37fe640 1 -- 10.20.193.49:0/1929979535 learned_addr learned my addr 10.20.193.49:0/1929979535 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:15:46.829 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.824+0000 7f9bd2ffd640 1 --2- 10.20.193.49:0/1929979535 >> v2:10.20.193.97:3300/0 conn(0x7f9bd41528b0 0x7f9bd415d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:46.829 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.825+0000 7f9bd2ffd640 10 monclient(hunting): get_auth_request con 0x7f9bd41528b0 auth_method 0 2026-02-17T11:15:46.829 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.825+0000 7f9bd2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:46.829 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.825+0000 7f9bd2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:46.829 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.825+0000 7f9bd2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:46.830 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.825+0000 7f9bd2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:46.830 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.825+0000 7f9bd2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:46.830 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.825+0000 7f9bd2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:46.831 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.825+0000 7f9bd1ffb640 1 -- 10.20.193.49:0/1929979535 <== mon.2 v1:10.20.193.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3834726215 0 0) 0x7f9bd40c8ba0 con 0x7f9bd415fbe0 2026-02-17T11:15:46.831 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.825+0000 7f9bd1ffb640 10 monclient(hunting): _negotiate 2026-02-17T11:15:46.831 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.825+0000 7f9bd1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:46.831 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.825+0000 7f9bd1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:46.831 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.825+0000 7f9bd1ffb640 10 monclient(hunting): my global_id is 5276 2026-02-17T11:15:46.831 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.825+0000 7f9bd1ffb640 1 -- 10.20.193.49:0/1929979535 --> v1:10.20.193.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9bc0003620 con 0x7f9bd415fbe0 2026-02-17T11:15:46.831 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.826+0000 7f9bd2ffd640 10 monclient(hunting): handle_auth_done global_id 5218 payload 274 2026-02-17T11:15:46.832 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.826+0000 7f9bd2ffd640 1 -- 10.20.193.49:0/1929979535 >> v1:10.20.193.157:6789/0 conn(0x7f9bd415fbe0 legacy=0x7f9bd4073850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:46.832 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.826+0000 7f9bd2ffd640 1 -- 10.20.193.49:0/1929979535 >> v1:10.20.193.97:6789/0 conn(0x7f9bd415d910 legacy=0x7f9bd415f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:46.832 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.826+0000 7f9bd2ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:15:46.832 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.826+0000 7f9bd2ffd640 1 monclient: found mon.noname-b 2026-02-17T11:15:46.832 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.826+0000 7f9bd2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:46.832 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.826+0000 7f9bd2ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:15:46.832 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.826+0000 7f9bd2ffd640 1 -- 10.20.193.49:0/1929979535 --> v2:10.20.193.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bd40c8e80 con 0x7f9bd41528b0 2026-02-17T11:15:46.832 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.828+0000 7f9bd2ffd640 1 --2- 10.20.193.49:0/1929979535 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f9bd41528b0 0x7f9bd415d3d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9bc80098a0 tx=0x7f9bc802ef00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc85b51c2a57626e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:46.838 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.830+0000 7f9bd1ffb640 1 -- 10.20.193.49:0/1929979535 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc803c070 con 0x7f9bd41528b0 2026-02-17T11:15:46.838 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.830+0000 7f9bd1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:46.838 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.830+0000 7f9bd1ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:15:46.838 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.830+0000 7f9bd1ffb640 10 monclient: dump: 2026-02-17T11:15:46.838 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:46.838 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:46.838 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:46.838 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:46.838 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:46.839 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:46.839 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:46.839 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:46.839 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:46.839 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:46.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.830+0000 7f9bd1ffb640 10 monclient: _finish_auth 0 2026-02-17T11:15:46.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.830+0000 7f9bd1ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:15:46.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.830+0000 7f9bd1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:46.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.830+0000 7f9bd9349640 5 monclient: authenticate success, global_id 5218 2026-02-17T11:15:46.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.830+0000 7f9bd1ffb640 1 -- 10.20.193.49:0/1929979535 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bc802fc10 con 0x7f9bd41528b0 2026-02-17T11:15:46.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.830+0000 7f9bd9349640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:15:46.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.830+0000 7f9bd1ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:46.840 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.830+0000 7f9bd1ffb640 1 -- 10.20.193.49:0/1929979535 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc8037440 con 0x7f9bd41528b0 2026-02-17T11:15:46.840 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.830+0000 7f9bd9349640 10 monclient: get_monmap_and_config success 2026-02-17T11:15:46.840 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.830+0000 7f9bd9349640 4 set_mon_vals no callback set 2026-02-17T11:15:46.840 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.830+0000 7f9bd1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:46.840 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.830+0000 7f9bd1ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:15:46.840 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.830+0000 7f9bd1ffb640 10 monclient: dump: 2026-02-17T11:15:46.840 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:46.840 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:46.840 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:46.840 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:46.840 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:46.840 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:46.841 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:46.841 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:46.841 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:46.841 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:46.841 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.830+0000 7f9bd9349640 10 monclient: shutdown 2026-02-17T11:15:46.841 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.830+0000 7f9bd9349640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:46.841 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.830+0000 7f9bd9349640 1 -- 10.20.193.49:0/1929979535 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f9bd41528b0 msgr2=0x7f9bd415d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:46.841 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.830+0000 7f9bd9349640 1 --2- 10.20.193.49:0/1929979535 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f9bd41528b0 0x7f9bd415d3d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9bc80098a0 tx=0x7f9bc802ef00 comp rx=0 tx=0).stop 2026-02-17T11:15:46.841 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.830+0000 7f9bd9349640 1 -- 10.20.193.49:0/1929979535 shutdown_connections 2026-02-17T11:15:46.841 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.830+0000 7f9bd9349640 1 --2- 10.20.193.49:0/1929979535 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f9bd41528b0 0x7f9bd415d3d0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:46.841 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.830+0000 7f9bd9349640 1 -- 10.20.193.49:0/1929979535 >> 10.20.193.49:0/1929979535 conn(0x7f9bd40ca6e0 msgr2=0x7f9bd40caac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:46.842 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.830+0000 7f9bd9349640 1 -- 10.20.193.49:0/1929979535 shutdown_connections 2026-02-17T11:15:46.842 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.830+0000 7f9bd9349640 1 -- 10.20.193.49:0/1929979535 wait complete. 2026-02-17T11:15:46.842 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.831+0000 7f9bd9349640 10 monclient: build_initial_monmap 2026-02-17T11:15:46.842 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.831+0000 7f9bd9349640 10 monclient: monmap: 2026-02-17T11:15:46.842 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:46.842 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:15:46.842 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:15:46.842 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:15:46.842 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:46.842 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:46.842 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:15:46.842 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:15:46.842 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:15:46.842 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:46.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.831+0000 7f9bd9349640 1 librados: starting msgr at 2026-02-17T11:15:46.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.831+0000 7f9bd9349640 1 librados: starting objecter 2026-02-17T11:15:46.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.831+0000 7f9bd9349640 1 Processor -- start 2026-02-17T11:15:46.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.831+0000 7f9bd9349640 1 -- start start 2026-02-17T11:15:46.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.831+0000 7f9bd9349640 1 librados: setting wanted keys 2026-02-17T11:15:46.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.831+0000 7f9bd9349640 1 librados: calling monclient init 2026-02-17T11:15:46.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.831+0000 7f9bd9349640 10 monclient: init 2026-02-17T11:15:46.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.832+0000 7f9bd9349640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:46.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.832+0000 7f9bd9349640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:15:46.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.832+0000 7f9bd9349640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f9bd41528b0 0x7f9bd41f52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:46.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.832+0000 7f9bd9349640 10 monclient(hunting): picked mon.noname-a con 0x7f9bd41528b0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:15:46.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.832+0000 7f9bd9349640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f9bd415d910 0x7f9bd41f7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:46.843 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.832+0000 7f9bd9349640 10 monclient(hunting): picked mon.noname-b con 0x7f9bd415d910 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:15:46.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.832+0000 7f9bd9349640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f9bd415fbe0 0x7f9bd41f3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:46.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.832+0000 7f9bd9349640 10 monclient(hunting): picked mon.noname-c con 0x7f9bd415fbe0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:15:46.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.832+0000 7f9bd9349640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:46.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.832+0000 7f9bd9349640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd40c9720 con 0x7f9bd41528b0 2026-02-17T11:15:46.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.832+0000 7f9bd9349640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:46.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.832+0000 7f9bd9349640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd40c9440 con 0x7f9bd415d910 2026-02-17T11:15:46.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.832+0000 7f9bd9349640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:46.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.832+0000 7f9bd9349640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd4076460 con 0x7f9bd415fbe0 2026-02-17T11:15:46.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.832+0000 7f9bd9349640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:46.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.832+0000 7f9bd9349640 10 monclient(hunting): authenticate will time out at 1423.496134s 2026-02-17T11:15:46.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.832+0000 7f9bd27fc640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f9bd415d910 0x7f9bd41f7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:46.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.832+0000 7f9bd37fe640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f9bd415fbe0 0x7f9bd41f3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:46.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.832+0000 7f9bd27fc640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f9bd415d910 0x7f9bd41f7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:43376/0 (socket says 10.20.193.49:43376) 2026-02-17T11:15:46.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.832+0000 7f9bd27fc640 1 -- 10.20.193.49:0/2376576005 learned_addr learned my addr 10.20.193.49:0/2376576005 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:46.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.832+0000 7f9bd27fc640 10 monclient(hunting): get_auth_request con 0x7f9bd415d910 auth_method 0 2026-02-17T11:15:46.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.832+0000 7f9bd27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:46.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.832+0000 7f9bd27fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:46.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.832+0000 7f9bd27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:46.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.832+0000 7f9bd37fe640 10 monclient(hunting): get_auth_request con 0x7f9bd415fbe0 auth_method 0 2026-02-17T11:15:46.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.832+0000 7f9bd37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:46.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.832+0000 7f9bd37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:46.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.832+0000 7f9bd37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:46.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.832+0000 7f9bd27fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:46.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.832+0000 7f9bd27fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:46.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.832+0000 7f9bd27fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:46.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.832+0000 7f9bd37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:46.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.832+0000 7f9bd37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:46.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.832+0000 7f9bd37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:46.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.833+0000 7f9bd2ffd640 1 --2- 10.20.193.49:0/2376576005 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f9bd41528b0 0x7f9bd41f52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:46.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.834+0000 7f9bd2ffd640 10 monclient(hunting): get_auth_request con 0x7f9bd41528b0 auth_method 0 2026-02-17T11:15:46.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.834+0000 7f9bd2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:46.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.834+0000 7f9bd2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:46.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.834+0000 7f9bd2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:46.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.834+0000 7f9bd37fe640 10 monclient(hunting): handle_auth_done global_id 5279 payload 824 2026-02-17T11:15:46.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.834+0000 7f9bd37fe640 1 -- 10.20.193.49:0/2376576005 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f9bd415d910 msgr2=0x7f9bd41f7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:46.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.834+0000 7f9bd37fe640 1 --2- 10.20.193.49:0/2376576005 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f9bd415d910 0x7f9bd41f7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:46.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.834+0000 7f9bd37fe640 1 -- 10.20.193.49:0/2376576005 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f9bd41528b0 msgr2=0x7f9bd41f52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:46.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.834+0000 7f9bd37fe640 1 --2- 10.20.193.49:0/2376576005 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f9bd41528b0 0x7f9bd41f52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:46.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.834+0000 7f9bd37fe640 10 monclient: _finish_hunting 0 2026-02-17T11:15:46.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.834+0000 7f9bd37fe640 1 monclient: found mon.noname-c 2026-02-17T11:15:46.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.834+0000 7f9bd37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:46.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.834+0000 7f9bd37fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:15:46.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.834+0000 7f9bd37fe640 1 -- 10.20.193.49:0/2376576005 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bd406dff0 con 0x7f9bd415fbe0 2026-02-17T11:15:46.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.835+0000 7f9bd37fe640 1 --2- 10.20.193.49:0/2376576005 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f9bd415fbe0 0x7f9bd41f3ee0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9bc400ca70 tx=0x7f9bc400cf40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:46.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.835+0000 7f9bb37fe640 10 client.?.objecter ms_handle_connect 0x7f9bd415fbe0 2026-02-17T11:15:46.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.835+0000 7f9bb37fe640 10 client.?.objecter resend_mon_ops 2026-02-17T11:15:46.849 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.837+0000 7f9bb37fe640 1 -- 10.20.193.49:0/2376576005 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc400abe0 con 0x7f9bd415fbe0 2026-02-17T11:15:46.849 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.837+0000 7f9bb37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:46.849 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.837+0000 7f9bb37fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:15:46.849 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.837+0000 7f9bb37fe640 10 monclient: dump: 2026-02-17T11:15:46.849 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:46.849 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:46.849 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:46.849 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:46.849 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:46.849 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:46.849 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:46.849 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:46.849 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:46.849 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:46.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.837+0000 7f9bb37fe640 10 monclient: _finish_auth 0 2026-02-17T11:15:46.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.837+0000 7f9bb37fe640 10 monclient: _check_auth_tickets 2026-02-17T11:15:46.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.837+0000 7f9bb37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:46.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.837+0000 7f9bb37fe640 1 -- 10.20.193.49:0/2376576005 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bc400ad80 con 0x7f9bd415fbe0 2026-02-17T11:15:46.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.837+0000 7f9bd9349640 5 monclient: authenticate success, global_id 5279 2026-02-17T11:15:46.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.837+0000 7f9bd9349640 10 monclient: _renew_subs 2026-02-17T11:15:46.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.837+0000 7f9bd9349640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:15:46.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.837+0000 7f9bd9349640 1 -- 10.20.193.49:0/2376576005 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bd406e2d0 con 0x7f9bd415fbe0 2026-02-17T11:15:46.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.837+0000 7f9bb37fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:46.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.837+0000 7f9bb37fe640 1 -- 10.20.193.49:0/2376576005 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc4012640 con 0x7f9bd415fbe0 2026-02-17T11:15:46.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.837+0000 7f9bb37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:46.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.837+0000 7f9bb37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:15:46.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.837+0000 7f9bd17fa640 4 set_mon_vals no callback set 2026-02-17T11:15:46.850 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.837+0000 7f9bb37fe640 10 monclient: dump: 2026-02-17T11:15:46.850 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:46.851 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:46.851 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:46.851 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:46.851 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:46.851 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:46.851 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:46.851 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:46.851 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:46.851 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:46.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.837+0000 7f9bd9349640 10 client.5279.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:46.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.837+0000 7f9bd9349640 10 monclient: _renew_subs 2026-02-17T11:15:46.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.837+0000 7f9bd9349640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:15:46.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.837+0000 7f9bd9349640 1 -- 10.20.193.49:0/2376576005 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bd406e890 con 0x7f9bd415fbe0 2026-02-17T11:15:46.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.837+0000 7f9bd9349640 1 librados: init done 2026-02-17T11:15:46.851 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.838+0000 7f9bd9349640 10 client.5279.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:46.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.838+0000 7f9bd9349640 15 client.5279.objecter _session_command_op_assign -1 1 2026-02-17T11:15:46.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.838+0000 7f9bd9349640 20 client.5279.objecter _get_session osd=-1 returning homeless 2026-02-17T11:15:46.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.838+0000 7f9bd9349640 10 client.5279.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:46.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.838+0000 7f9bd9349640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:15:46.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.838+0000 7f9bd9349640 1 -- 10.20.193.49:0/2376576005 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9bd406f050 con 0x7f9bd415fbe0 2026-02-17T11:15:46.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.850+0000 7f9bb37fe640 1 -- 10.20.193.49:0/2376576005 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f9bc40127e0 con 0x7f9bd415fbe0 2026-02-17T11:15:46.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.850+0000 7f9bb37fe640 1 --2- 10.20.193.49:0/2376576005 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f9ba0079140 0x7f9ba007b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:46.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.851+0000 7f9bd2ffd640 1 --2- 10.20.193.49:0/2376576005 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f9ba0079140 0x7f9ba007b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:46.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.851+0000 7f9bd2ffd640 10 monclient: get_auth_request con 0x7f9ba0079140 auth_method 0 2026-02-17T11:15:46.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.851+0000 7f9bb37fe640 1 -- 10.20.193.49:0/2376576005 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f9bc4098440 con 0x7f9bd415fbe0 2026-02-17T11:15:46.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.851+0000 7f9bb37fe640 10 client.5279.objecter ms_dispatch2 0x7f9bd4000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:15:46.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.851+0000 7f9bb37fe640 3 client.5279.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:15:46.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.851+0000 7f9bb37fe640 3 client.5279.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:15:46.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.851+0000 7f9bd2ffd640 1 --2- 10.20.193.49:0/2376576005 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f9ba0079140 0x7f9ba007b600 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9bc8039000 tx=0x7f9bc8033000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:46.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.851+0000 7f9bb37fe640 10 client.5279.objecter checking command 1 2026-02-17T11:15:46.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.851+0000 7f9bb37fe640 1 --2- 10.20.193.49:0/2376576005 >> [v2:10.20.193.97:6824/409145483,v1:10.20.193.97:6825/409145483] conn(0x7f9ba0081620 0x7f9ba0083a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:46.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.851+0000 7f9bb37fe640 20 client.5279.objecter _get_session s=0x7f9ba0080f50 osd=13 3 2026-02-17T11:15:46.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.851+0000 7f9bb37fe640 20 client.5279.objecter put_session s=0x7f9ba0080f50 osd=13 3 2026-02-17T11:15:46.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.851+0000 7f9bb37fe640 15 client.5279.objecter _session_command_op_remove -1 1 2026-02-17T11:15:46.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.851+0000 7f9bb37fe640 20 client.5279.objecter _get_session s=0x7f9ba0080f50 osd=13 3 2026-02-17T11:15:46.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.851+0000 7f9bb37fe640 20 client.5279.objecter get_session s=0x7f9ba0080f50 osd=13 3 2026-02-17T11:15:46.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.851+0000 7f9bb37fe640 15 client.5279.objecter _session_command_op_assign 13 1 2026-02-17T11:15:46.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.851+0000 7f9bb37fe640 20 client.5279.objecter put_session s=0x7f9ba0080f50 osd=13 4 2026-02-17T11:15:46.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.851+0000 7f9bb37fe640 10 client.5279.objecter _send_command 1 2026-02-17T11:15:46.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.851+0000 7f9bb37fe640 1 -- 10.20.193.49:0/2376576005 --> [v2:10.20.193.97:6824/409145483,v1:10.20.193.97:6825/409145483] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9bc4025e50 con 0x7f9ba0081620 2026-02-17T11:15:46.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.851+0000 7f9bb37fe640 20 client.5279.objecter dump_active .. 0 homeless 2026-02-17T11:15:46.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.851+0000 7f9bb37fe640 10 client.5279.objecter ms_handle_connect 0x7f9ba0079140 2026-02-17T11:15:46.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.852+0000 7f9bd27fc640 1 --2- 10.20.193.49:0/2376576005 >> [v2:10.20.193.97:6824/409145483,v1:10.20.193.97:6825/409145483] conn(0x7f9ba0081620 0x7f9ba0083a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:46.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.852+0000 7f9bd27fc640 10 monclient: get_auth_request con 0x7f9ba0081620 auth_method 0 2026-02-17T11:15:46.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.854+0000 7f9bb37fe640 10 client.5279.objecter ms_handle_connect 0x7f9ba0081620 2026-02-17T11:15:46.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.854+0000 7f9bd27fc640 1 --2- 10.20.193.49:0/2376576005 >> [v2:10.20.193.97:6824/409145483,v1:10.20.193.97:6825/409145483] conn(0x7f9ba0081620 0x7f9ba0083a40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.13 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:46.867 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.865+0000 7f9bb37fe640 1 -- 10.20.193.49:0/2376576005 <== osd.13 v2:10.20.193.97:6824/409145483 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f9bc4025e50 con 0x7f9ba0081620 2026-02-17T11:15:46.867 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.865+0000 7f9bb37fe640 10 client.5279.objecter ms_dispatch2 0x7f9bd4000b90 command_reply(tid 1: 0 ) 2026-02-17T11:15:46.867 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.865+0000 7f9bb37fe640 10 client.5279.objecter _finish_command 1 = system:0 2026-02-17T11:15:46.867 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.865+0000 7f9bb37fe640 20 client.5279.objecter put_session s=0x7f9ba0080f50 osd=13 4 2026-02-17T11:15:46.868 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.865+0000 7f9bb37fe640 15 client.5279.objecter _session_command_op_remove 13 1 2026-02-17T11:15:46.874 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.871+0000 7f9bd9349640 10 client.5279.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T11:15:46.874 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.871+0000 7f9bd9349640 15 client.5279.objecter _session_command_op_assign -1 2 2026-02-17T11:15:46.874 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.871+0000 7f9bd9349640 20 client.5279.objecter _get_session s=0x7f9ba0080f50 osd=13 3 2026-02-17T11:15:46.874 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.871+0000 7f9bd9349640 20 client.5279.objecter put_session s=0x7f9ba0080f50 osd=13 3 2026-02-17T11:15:46.874 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.871+0000 7f9bd9349640 20 client.5279.objecter _get_session s=0x7f9ba0080f50 osd=13 3 2026-02-17T11:15:46.874 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.871+0000 7f9bd9349640 15 client.5279.objecter _session_command_op_remove -1 2 2026-02-17T11:15:46.874 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.871+0000 7f9bd9349640 20 client.5279.objecter get_session s=0x7f9ba0080f50 osd=13 3 2026-02-17T11:15:46.874 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.871+0000 7f9bd9349640 15 client.5279.objecter _session_command_op_assign 13 2 2026-02-17T11:15:46.874 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.871+0000 7f9bd9349640 20 client.5279.objecter put_session s=0x7f9ba0080f50 osd=13 4 2026-02-17T11:15:46.874 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.871+0000 7f9bd9349640 10 client.5279.objecter _send_command 2 2026-02-17T11:15:46.875 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.871+0000 7f9bd9349640 1 -- 10.20.193.49:0/2376576005 --> [v2:10.20.193.97:6824/409145483,v1:10.20.193.97:6825/409145483] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f9bd4152c90 con 0x7f9ba0081620 2026-02-17T11:15:46.881 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.878+0000 7f9bb37fe640 1 -- 10.20.193.49:0/2376576005 <== osd.13 v2:10.20.193.97:6824/409145483 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f9bd4152c90 con 0x7f9ba0081620 2026-02-17T11:15:46.881 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.878+0000 7f9bb37fe640 10 client.5279.objecter ms_dispatch2 0x7f9bd4000b90 command_reply(tid 2: 0 ) 2026-02-17T11:15:46.881 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.878+0000 7f9bb37fe640 10 client.5279.objecter _finish_command 2 = system:0 2026-02-17T11:15:46.881 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.878+0000 7f9bb37fe640 20 client.5279.objecter put_session s=0x7f9ba0080f50 osd=13 4 2026-02-17T11:15:46.881 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.878+0000 7f9bb37fe640 15 client.5279.objecter _session_command_op_remove 13 2 2026-02-17T11:15:46.882 INFO:teuthology.orchestra.run.trial049.stdout:{ 2026-02-17T11:15:46.882 INFO:teuthology.orchestra.run.trial049.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T11:15:46.882 INFO:teuthology.orchestra.run.trial049.stdout:} 2026-02-17T11:15:46.884 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.878+0000 7f9bd9349640 10 librados: watch_flush enter 2026-02-17T11:15:46.884 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.878+0000 7f9bd9349640 10 librados: watch_flush exit 2026-02-17T11:15:46.884 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.878+0000 7f9bd9349640 10 client.5279.objecter close_session for osd.13 2026-02-17T11:15:46.884 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.878+0000 7f9bd9349640 1 -- 10.20.193.49:0/2376576005 >> [v2:10.20.193.97:6824/409145483,v1:10.20.193.97:6825/409145483] conn(0x7f9ba0081620 msgr2=0x7f9ba0083a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:46.884 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.878+0000 7f9bd9349640 1 --2- 10.20.193.49:0/2376576005 >> [v2:10.20.193.97:6824/409145483,v1:10.20.193.97:6825/409145483] conn(0x7f9ba0081620 0x7f9ba0083a40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:46.884 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.878+0000 7f9bd9349640 20 client.5279.objecter put_session s=0x7f9ba0080f50 osd=13 1 2026-02-17T11:15:46.884 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.878+0000 7f9bd9349640 20 client.5279.objecter shutdown clearing up homeless session... 2026-02-17T11:15:46.884 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.878+0000 7f9bd9349640 10 client.5279.objecter successfully canceled tick 2026-02-17T11:15:46.884 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.878+0000 7f9bd9349640 1 -- 10.20.193.49:0/2376576005 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f9ba0079140 msgr2=0x7f9ba007b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:46.884 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.878+0000 7f9bd9349640 1 --2- 10.20.193.49:0/2376576005 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f9ba0079140 0x7f9ba007b600 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9bc8039000 tx=0x7f9bc8033000 comp rx=0 tx=0).stop 2026-02-17T11:15:46.884 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.878+0000 7f9bd9349640 10 monclient: shutdown 2026-02-17T11:15:46.885 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.878+0000 7f9bd9349640 20 monclient: shutdown canceling and discarding version request 1 2026-02-17T11:15:46.885 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.878+0000 7f9bd9349640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:46.885 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.878+0000 7f9bd9349640 1 -- 10.20.193.49:0/2376576005 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f9bd415fbe0 msgr2=0x7f9bd41f3ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:46.885 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.878+0000 7f9bd9349640 1 --2- 10.20.193.49:0/2376576005 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f9bd415fbe0 0x7f9bd41f3ee0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9bc400ca70 tx=0x7f9bc400cf40 comp rx=0 tx=0).stop 2026-02-17T11:15:46.885 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.878+0000 7f9bd37fe640 1 -- 10.20.193.49:0/2376576005 reap_dead start 2026-02-17T11:15:46.885 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.878+0000 7f9bd9349640 1 -- 10.20.193.49:0/2376576005 shutdown_connections 2026-02-17T11:15:46.885 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.878+0000 7f9bd9349640 1 -- 10.20.193.49:0/2376576005 >> 10.20.193.49:0/2376576005 conn(0x7f9bd40ca6e0 msgr2=0x7f9bd4070e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:46.885 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.878+0000 7f9bd9349640 1 -- 10.20.193.49:0/2376576005 shutdown_connections 2026-02-17T11:15:46.885 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.878+0000 7f9bd9349640 1 -- 10.20.193.49:0/2376576005 wait complete. 2026-02-17T11:15:46.885 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.878+0000 7f9bd9349640 1 librados: shutdown 2026-02-17T11:15:46.888 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 13 2026-02-17T11:15:46.956 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.954+0000 7f1f14bce640 10 monclient: get_monmap_and_config 2026-02-17T11:15:46.957 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.954+0000 7f1f14bce640 10 monclient: build_initial_monmap 2026-02-17T11:15:46.957 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.954+0000 7f1f14bce640 10 monclient: monmap: 2026-02-17T11:15:46.957 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:46.957 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:46.957 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:15:46.955967+0000 2026-02-17T11:15:46.957 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:15:46.955967+0000 2026-02-17T11:15:46.957 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:46.957 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:46.957 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:15:46.957 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:15:46.957 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:15:46.957 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:15:46.957 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:15:46.957 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:15:46.957 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:46.958 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.954+0000 7f1f14bce640 1 Processor -- start 2026-02-17T11:15:46.958 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.954+0000 7f1f14bce640 1 -- start start 2026-02-17T11:15:46.958 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.954+0000 7f1f14bce640 10 monclient: init 2026-02-17T11:15:46.958 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.955+0000 7f1f14bce640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:46.958 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.955+0000 7f1f14bce640 10 monclient: _add_conns ranks=[5,2,1,0,4,3] 2026-02-17T11:15:46.958 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.955+0000 7f1f14bce640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f1f1014f280 0x7f1f100c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:46.958 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.955+0000 7f1f14bce640 10 monclient(hunting): picked mon.noname-c con 0x7f1f1014f280 addr v2:10.20.193.157:3300/0 2026-02-17T11:15:46.958 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.955+0000 7f1f14bce640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f1f1014f660 addr v1:10.20.193.157:6789/0 2026-02-17T11:15:46.958 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.955+0000 7f1f14bce640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f1f1015abc0 addr v1:10.20.193.97:6789/0 2026-02-17T11:15:46.958 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.955+0000 7f1f14bce640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f100c7110 con 0x7f1f1015abc0 2026-02-17T11:15:46.958 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.955+0000 7f1f14bce640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f100c7390 con 0x7f1f1014f660 2026-02-17T11:15:46.958 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.955+0000 7f1f14bce640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:46.958 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.955+0000 7f1f14bce640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f1f100c7950 con 0x7f1f1014f280 2026-02-17T11:15:46.958 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.955+0000 7f1f14bce640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:46.958 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.955+0000 7f1f14bce640 10 monclient(hunting): authenticate will time out at 1423.619763s 2026-02-17T11:15:46.958 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.956+0000 7f1f0e575640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f1f1014f280 0x7f1f100c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:46.959 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.956+0000 7f1f0ed76640 1 --1- >> v1:10.20.193.97:6789/0 conn(0x7f1f1015abc0 0x7f1f1015afe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.97:6789/0 says I am v1:10.20.193.49:49838/0 (socket says 10.20.193.49:49838) 2026-02-17T11:15:46.959 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.956+0000 7f1f0ed76640 1 -- 10.20.193.49:0/94696087 learned_addr learned my addr 10.20.193.49:0/94696087 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:15:46.959 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.956+0000 7f1f0e575640 10 monclient(hunting): get_auth_request con 0x7f1f1014f280 auth_method 0 2026-02-17T11:15:46.959 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.956+0000 7f1f0e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:46.959 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.956+0000 7f1f0e575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:46.959 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.956+0000 7f1f0e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:46.959 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.956+0000 7f1f0e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:46.959 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.956+0000 7f1f0e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:46.959 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.956+0000 7f1f0e575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:46.959 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.957+0000 7f1f0d573640 1 -- 10.20.193.49:0/94696087 <== mon.1 v1:10.20.193.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2651960272 0 0) 0x7f1f00002ca0 con 0x7f1f1015abc0 2026-02-17T11:15:46.959 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.957+0000 7f1f0d573640 10 monclient(hunting): _negotiate 2026-02-17T11:15:46.959 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.957+0000 7f1f0d573640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:46.959 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.957+0000 7f1f0d573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:46.960 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.957+0000 7f1f0d573640 10 monclient(hunting): my global_id is 5227 2026-02-17T11:15:46.960 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.957+0000 7f1f0d573640 1 -- 10.20.193.49:0/94696087 --> v1:10.20.193.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1efc003620 con 0x7f1f1015abc0 2026-02-17T11:15:46.960 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.957+0000 7f1f0e575640 10 monclient(hunting): handle_auth_done global_id 5282 payload 274 2026-02-17T11:15:46.960 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.957+0000 7f1f0e575640 1 -- 10.20.193.49:0/94696087 >> v1:10.20.193.157:6789/0 conn(0x7f1f1014f660 legacy=0x7f1f100c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:46.960 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.957+0000 7f1f0e575640 1 -- 10.20.193.49:0/94696087 >> v1:10.20.193.97:6789/0 conn(0x7f1f1015abc0 legacy=0x7f1f1015afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:46.960 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.957+0000 7f1f0e575640 10 monclient: _finish_hunting 0 2026-02-17T11:15:46.960 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.957+0000 7f1f0e575640 1 monclient: found mon.noname-c 2026-02-17T11:15:46.960 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.957+0000 7f1f0e575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:46.960 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.957+0000 7f1f0e575640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:15:46.960 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.957+0000 7f1f0e575640 1 -- 10.20.193.49:0/94696087 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f100c7670 con 0x7f1f1014f280 2026-02-17T11:15:46.961 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.959+0000 7f1f0e575640 1 --2- 10.20.193.49:0/94696087 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f1f1014f280 0x7f1f100c7e20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1f040098a0 tx=0x7f1f0402ef00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1bc4615a04959026 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:46.963 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.961+0000 7f1f0d573640 1 -- 10.20.193.49:0/94696087 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f0403c070 con 0x7f1f1014f280 2026-02-17T11:15:46.964 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.961+0000 7f1f0d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:46.964 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.961+0000 7f1f0d573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:15:46.964 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.961+0000 7f1f0d573640 10 monclient: dump: 2026-02-17T11:15:46.964 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:46.964 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:46.964 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:46.964 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:46.964 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:46.964 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:46.964 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:46.964 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:46.964 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:46.964 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:46.964 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.961+0000 7f1f0d573640 10 monclient: _finish_auth 0 2026-02-17T11:15:46.964 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.961+0000 7f1f0d573640 10 monclient: _check_auth_tickets 2026-02-17T11:15:46.964 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.961+0000 7f1f0d573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:46.964 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.961+0000 7f1f0d573640 1 -- 10.20.193.49:0/94696087 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f0402fc10 con 0x7f1f1014f280 2026-02-17T11:15:46.964 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.961+0000 7f1f14bce640 5 monclient: authenticate success, global_id 5282 2026-02-17T11:15:46.964 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.961+0000 7f1f14bce640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:15:46.964 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.961+0000 7f1f0d573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:46.964 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.961+0000 7f1f14bce640 10 monclient: get_monmap_and_config success 2026-02-17T11:15:46.964 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.961+0000 7f1f0d573640 1 -- 10.20.193.49:0/94696087 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f04037440 con 0x7f1f1014f280 2026-02-17T11:15:46.964 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.961+0000 7f1f0d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:46.964 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.961+0000 7f1f14bce640 4 set_mon_vals no callback set 2026-02-17T11:15:46.964 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.961+0000 7f1f0d573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:15:46.964 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.961+0000 7f1f0d573640 10 monclient: dump: 2026-02-17T11:15:46.964 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:46.964 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:46.964 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:46.965 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:46.965 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:46.965 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:46.965 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:46.965 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:46.965 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:46.965 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:46.966 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.962+0000 7f1f14bce640 10 monclient: shutdown 2026-02-17T11:15:46.966 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.962+0000 7f1f14bce640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:46.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.962+0000 7f1f14bce640 1 -- 10.20.193.49:0/94696087 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f1f1014f280 msgr2=0x7f1f100c7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:46.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.962+0000 7f1f14bce640 1 --2- 10.20.193.49:0/94696087 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f1f1014f280 0x7f1f100c7e20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1f040098a0 tx=0x7f1f0402ef00 comp rx=0 tx=0).stop 2026-02-17T11:15:46.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.962+0000 7f1f14bce640 1 -- 10.20.193.49:0/94696087 shutdown_connections 2026-02-17T11:15:46.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.962+0000 7f1f14bce640 1 --2- 10.20.193.49:0/94696087 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f1f1014f280 0x7f1f100c7e20 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:46.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.962+0000 7f1f14bce640 1 -- 10.20.193.49:0/94696087 >> 10.20.193.49:0/94696087 conn(0x7f1f100c9f20 msgr2=0x7f1f100ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:46.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.962+0000 7f1f14bce640 1 -- 10.20.193.49:0/94696087 shutdown_connections 2026-02-17T11:15:46.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.962+0000 7f1f14bce640 1 -- 10.20.193.49:0/94696087 wait complete. 2026-02-17T11:15:46.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.962+0000 7f1f14bce640 10 monclient: build_initial_monmap 2026-02-17T11:15:46.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.962+0000 7f1f14bce640 10 monclient: monmap: 2026-02-17T11:15:46.967 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:46.967 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:15:46.967 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:15:46.967 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:15:46.967 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:46.967 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:46.967 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:15:46.967 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:15:46.967 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:15:46.967 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:46.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.962+0000 7f1f14bce640 1 librados: starting msgr at 2026-02-17T11:15:46.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.962+0000 7f1f14bce640 1 librados: starting objecter 2026-02-17T11:15:46.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.962+0000 7f1f14bce640 1 Processor -- start 2026-02-17T11:15:46.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.963+0000 7f1f14bce640 1 -- start start 2026-02-17T11:15:46.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.963+0000 7f1f14bce640 1 librados: setting wanted keys 2026-02-17T11:15:46.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.963+0000 7f1f14bce640 1 librados: calling monclient init 2026-02-17T11:15:46.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.963+0000 7f1f14bce640 10 monclient: init 2026-02-17T11:15:46.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.963+0000 7f1f14bce640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:46.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.963+0000 7f1f14bce640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:15:46.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.963+0000 7f1f14bce640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f1f1014f280 0x7f1f101f3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:46.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.963+0000 7f1f14bce640 10 monclient(hunting): picked mon.noname-b con 0x7f1f1014f280 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:15:46.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.963+0000 7f1f14bce640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1f1014f660 0x7f1f1006f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:46.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.963+0000 7f1f14bce640 10 monclient(hunting): picked mon.noname-a con 0x7f1f1014f660 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:15:46.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.963+0000 7f1f14bce640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f1f1015abc0 0x7f1f10072b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:46.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.963+0000 7f1f14bce640 10 monclient(hunting): picked mon.noname-c con 0x7f1f1015abc0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:15:46.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.963+0000 7f1f14bce640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:46.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.963+0000 7f1f14bce640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1015a3c0 con 0x7f1f1014f660 2026-02-17T11:15:46.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.963+0000 7f1f14bce640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:46.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.963+0000 7f1f14bce640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1015a730 con 0x7f1f1014f280 2026-02-17T11:15:46.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.963+0000 7f1f14bce640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:46.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.963+0000 7f1f14bce640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f1f100c8360 con 0x7f1f1015abc0 2026-02-17T11:15:46.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.963+0000 7f1f14bce640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:46.968 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.963+0000 7f1f14bce640 10 monclient(hunting): authenticate will time out at 1423.627452s 2026-02-17T11:15:46.968 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.963+0000 7f1f0ed76640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f1f1015abc0 0x7f1f10072b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:46.968 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.963+0000 7f1f0dd74640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1f1014f660 0x7f1f1006f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:46.968 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.963+0000 7f1f0e575640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f1f1014f280 0x7f1f101f3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:46.968 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.963+0000 7f1f0ed76640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f1f1015abc0 0x7f1f10072b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:53286/0 (socket says 10.20.193.49:53286) 2026-02-17T11:15:46.968 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.963+0000 7f1f0ed76640 1 -- 10.20.193.49:0/3902049204 learned_addr learned my addr 10.20.193.49:0/3902049204 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:46.968 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.963+0000 7f1f0ed76640 10 monclient(hunting): get_auth_request con 0x7f1f1015abc0 auth_method 0 2026-02-17T11:15:46.968 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.963+0000 7f1f0ed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:46.968 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.964+0000 7f1f0ed76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:46.968 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.964+0000 7f1f0ed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:46.968 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.964+0000 7f1f0dd74640 10 monclient(hunting): get_auth_request con 0x7f1f1014f660 auth_method 0 2026-02-17T11:15:46.968 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.964+0000 7f1f0dd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:46.968 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.964+0000 7f1f0dd74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:46.968 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.964+0000 7f1f0dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:46.968 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.964+0000 7f1f0e575640 10 monclient(hunting): get_auth_request con 0x7f1f1014f280 auth_method 0 2026-02-17T11:15:46.968 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.964+0000 7f1f0e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:46.968 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.964+0000 7f1f0e575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:46.968 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.964+0000 7f1f0e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:46.968 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.964+0000 7f1f0ed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:46.968 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.964+0000 7f1f0ed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:46.968 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.964+0000 7f1f0ed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:46.968 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.964+0000 7f1f0dd74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:46.968 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.964+0000 7f1f0dd74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:46.968 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.964+0000 7f1f0dd74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:46.968 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.964+0000 7f1f0e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:46.968 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.964+0000 7f1f0e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:46.968 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.964+0000 7f1f0e575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:46.969 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.965+0000 7f1f0ed76640 10 monclient(hunting): handle_auth_done global_id 5288 payload 824 2026-02-17T11:15:46.969 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.965+0000 7f1f0ed76640 1 -- 10.20.193.49:0/3902049204 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f1f1014f280 msgr2=0x7f1f101f3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:46.969 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.965+0000 7f1f0ed76640 1 --2- 10.20.193.49:0/3902049204 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f1f1014f280 0x7f1f101f3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:46.969 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.965+0000 7f1f0ed76640 1 -- 10.20.193.49:0/3902049204 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1f1014f660 msgr2=0x7f1f1006f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:46.969 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.965+0000 7f1f0ed76640 1 --2- 10.20.193.49:0/3902049204 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1f1014f660 0x7f1f1006f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:46.969 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.965+0000 7f1f0ed76640 10 monclient: _finish_hunting 0 2026-02-17T11:15:46.969 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.965+0000 7f1f0ed76640 1 monclient: found mon.noname-c 2026-02-17T11:15:46.969 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.965+0000 7f1f0ed76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:46.969 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.965+0000 7f1f0ed76640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:15:46.969 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.965+0000 7f1f0ed76640 1 -- 10.20.193.49:0/3902049204 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f10073690 con 0x7f1f1015abc0 2026-02-17T11:15:46.969 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.967+0000 7f1f0ed76640 1 --2- 10.20.193.49:0/3902049204 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f1f1015abc0 0x7f1f10072b50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1f0000cb40 tx=0x7f1f0000a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:46.969 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.967+0000 7f1ef6ffd640 10 client.?.objecter ms_handle_connect 0x7f1f1015abc0 2026-02-17T11:15:46.969 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.967+0000 7f1ef6ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:15:46.970 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.968+0000 7f1ef6ffd640 1 -- 10.20.193.49:0/3902049204 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f0000ad50 con 0x7f1f1015abc0 2026-02-17T11:15:46.970 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.968+0000 7f1ef6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:46.970 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.968+0000 7f1ef6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:15:46.970 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.968+0000 7f1ef6ffd640 10 monclient: dump: 2026-02-17T11:15:46.970 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:46.970 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:46.970 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:46.970 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:46.970 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:46.970 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:46.970 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:46.970 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:46.970 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:46.970 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:46.970 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.968+0000 7f1ef6ffd640 10 monclient: _finish_auth 0 2026-02-17T11:15:46.970 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.968+0000 7f1ef6ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:15:46.970 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.968+0000 7f1ef6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:46.970 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.968+0000 7f1f14bce640 5 monclient: authenticate success, global_id 5288 2026-02-17T11:15:46.970 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.968+0000 7f1f14bce640 10 monclient: _renew_subs 2026-02-17T11:15:46.970 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.968+0000 7f1f14bce640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:15:46.970 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.968+0000 7f1f14bce640 1 -- 10.20.193.49:0/3902049204 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f10073970 con 0x7f1f1015abc0 2026-02-17T11:15:46.970 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.968+0000 7f1f14bce640 10 client.5288.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:46.970 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.968+0000 7f1f14bce640 10 monclient: _renew_subs 2026-02-17T11:15:46.970 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.968+0000 7f1f14bce640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:15:46.970 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.968+0000 7f1f14bce640 1 -- 10.20.193.49:0/3902049204 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f10073f30 con 0x7f1f1015abc0 2026-02-17T11:15:46.970 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.968+0000 7f1f14bce640 1 librados: init done 2026-02-17T11:15:46.971 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.968+0000 7f1f14bce640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:46.971 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.968+0000 7f1f14bce640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:46.971 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.968+0000 7f1f14bce640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:15:46.971 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.968+0000 7f1f14bce640 1 -- 10.20.193.49:0/3902049204 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f100c9b70 con 0x7f1f1015abc0 2026-02-17T11:15:46.971 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.968+0000 7f1ef6ffd640 1 -- 10.20.193.49:0/3902049204 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f0001b400 con 0x7f1f1015abc0 2026-02-17T11:15:46.971 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.968+0000 7f1ef6ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:46.971 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.968+0000 7f1ef6ffd640 1 -- 10.20.193.49:0/3902049204 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f0001b7f0 con 0x7f1f1015abc0 2026-02-17T11:15:46.971 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.968+0000 7f1ef6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:46.971 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.968+0000 7f1ef6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:15:46.971 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.968+0000 7f1ef6ffd640 10 monclient: dump: 2026-02-17T11:15:46.971 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:46.971 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:46.971 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:46.971 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:46.971 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:46.971 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:46.971 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:46.971 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:46.971 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:46.971 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:46.971 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:46.968+0000 7f1f0cd72640 4 set_mon_vals no callback set 2026-02-17T11:15:47.079 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.077+0000 7f1ef6ffd640 1 -- 10.20.193.49:0/3902049204 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f1f00012400 con 0x7f1f1015abc0 2026-02-17T11:15:47.080 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.077+0000 7f1ef6ffd640 1 --2- 10.20.193.49:0/3902049204 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f1edc079170 0x7f1edc07b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:47.080 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.077+0000 7f1f0e575640 1 --2- 10.20.193.49:0/3902049204 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f1edc079170 0x7f1edc07b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:47.080 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.077+0000 7f1f0e575640 10 monclient: get_auth_request con 0x7f1edc079170 auth_method 0 2026-02-17T11:15:47.081 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.078+0000 7f1f0e575640 1 --2- 10.20.193.49:0/3902049204 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f1edc079170 0x7f1edc07b630 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1f04039000 tx=0x7f1f04033000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:47.081 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.078+0000 7f1ef6ffd640 10 client.5288.objecter ms_handle_connect 0x7f1edc079170 2026-02-17T11:15:47.081 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.080+0000 7f1ef6ffd640 1 -- 10.20.193.49:0/3902049204 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f1f0005eb10 con 0x7f1f1015abc0 2026-02-17T11:15:47.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.080+0000 7f1ef6ffd640 10 client.5288.objecter ms_dispatch2 0x7f1f10000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:15:47.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.080+0000 7f1ef6ffd640 3 client.5288.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:15:47.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.080+0000 7f1ef6ffd640 3 client.5288.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:15:47.082 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.080+0000 7f1ef6ffd640 20 client.5288.objecter dump_active .. 0 homeless 2026-02-17T11:15:47.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.085+0000 7f1ef6ffd640 1 -- 10.20.193.49:0/3902049204 <== mon.2 v2:10.20.193.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f1f100c7110 con 0x7f1f1015abc0 2026-02-17T11:15:47.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.085+0000 7f1ef6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:47.087 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.085+0000 7f1ef6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:15:47.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.166+0000 7f1f14bce640 1 -- 10.20.193.49:0/3902049204 --> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "13", "target": ["mon-mgr", ""]}) -- 0x7f1f10074c60 con 0x7f1edc079170 2026-02-17T11:15:47.169 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.167+0000 7f1ef6ffd640 1 -- 10.20.193.49:0/3902049204 <== mgr.4106 v2:10.20.193.162:6800/2614632098 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 13 to deep-scrub) ==== 42+0+0 (secure 0 0 0) 0x7f1f10074c60 con 0x7f1edc079170 2026-02-17T11:15:47.170 INFO:teuthology.orchestra.run.trial049.stderr:instructed osd(s) 13 to deep-scrub 2026-02-17T11:15:47.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.167+0000 7f1f14bce640 10 librados: watch_flush enter 2026-02-17T11:15:47.171 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.167+0000 7f1f14bce640 10 librados: watch_flush exit 2026-02-17T11:15:47.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.167+0000 7f1f14bce640 20 client.5288.objecter shutdown clearing up homeless session... 2026-02-17T11:15:47.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.167+0000 7f1f14bce640 10 client.5288.objecter successfully canceled tick 2026-02-17T11:15:47.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.167+0000 7f1f14bce640 1 -- 10.20.193.49:0/3902049204 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f1edc079170 msgr2=0x7f1edc07b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:47.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.167+0000 7f1f14bce640 1 --2- 10.20.193.49:0/3902049204 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f1edc079170 0x7f1edc07b630 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1f04039000 tx=0x7f1f04033000 comp rx=0 tx=0).stop 2026-02-17T11:15:47.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.167+0000 7f1f14bce640 10 monclient: shutdown 2026-02-17T11:15:47.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.167+0000 7f1f14bce640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:47.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.167+0000 7f1f14bce640 1 -- 10.20.193.49:0/3902049204 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f1f1015abc0 msgr2=0x7f1f10072b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:47.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.167+0000 7f1f14bce640 1 --2- 10.20.193.49:0/3902049204 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f1f1015abc0 0x7f1f10072b50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1f0000cb40 tx=0x7f1f0000a430 comp rx=0 tx=0).stop 2026-02-17T11:15:47.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.168+0000 7f1f14bce640 1 -- 10.20.193.49:0/3902049204 shutdown_connections 2026-02-17T11:15:47.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.168+0000 7f1f14bce640 1 --2- 10.20.193.49:0/3902049204 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f1edc079170 0x7f1edc07b630 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:47.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.168+0000 7f1f14bce640 1 --2- 10.20.193.49:0/3902049204 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f1f1015abc0 0x7f1f10072b50 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:47.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.168+0000 7f1f14bce640 1 --2- 10.20.193.49:0/3902049204 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f1f1014f660 0x7f1f1006f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:47.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.168+0000 7f1f14bce640 1 --2- 10.20.193.49:0/3902049204 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f1f1014f280 0x7f1f101f3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:47.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.168+0000 7f1f14bce640 1 -- 10.20.193.49:0/3902049204 >> 10.20.193.49:0/3902049204 conn(0x7f1f100c9f20 msgr2=0x7f1f1014e220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:47.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.168+0000 7f1f14bce640 1 -- 10.20.193.49:0/3902049204 shutdown_connections 2026-02-17T11:15:47.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.168+0000 7f1f14bce640 1 -- 10.20.193.49:0/3902049204 wait complete. 2026-02-17T11:15:47.173 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.168+0000 7f1f14bce640 1 librados: shutdown 2026-02-17T11:15:47.179 INFO:tasks.ceph:Scrubbing osd.2 2026-02-17T11:15:47.179 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2026-02-17T11:15:47.247 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.245+0000 7f6cee72c640 10 monclient: get_monmap_and_config 2026-02-17T11:15:47.247 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.245+0000 7f6cee72c640 10 monclient: build_initial_monmap 2026-02-17T11:15:47.248 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.245+0000 7f6cee72c640 10 monclient: monmap: 2026-02-17T11:15:47.248 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:47.248 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:47.248 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:15:47.247012+0000 2026-02-17T11:15:47.248 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:15:47.247012+0000 2026-02-17T11:15:47.248 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:47.248 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:47.248 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:15:47.248 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:15:47.248 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:15:47.248 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:15:47.248 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:15:47.248 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:15:47.248 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:47.248 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.245+0000 7f6cee72c640 1 Processor -- start 2026-02-17T11:15:47.248 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.246+0000 7f6cee72c640 1 -- start start 2026-02-17T11:15:47.248 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.246+0000 7f6cee72c640 10 monclient: init 2026-02-17T11:15:47.248 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.246+0000 7f6cee72c640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:47.248 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.246+0000 7f6cee72c640 10 monclient: _add_conns ranks=[5,4,2,1,0,3] 2026-02-17T11:15:47.248 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.246+0000 7f6cee72c640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f6ce8153930 0x7f6ce80c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:47.248 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.246+0000 7f6cee72c640 10 monclient(hunting): picked mon.noname-c con 0x7f6ce8153930 addr v2:10.20.193.157:3300/0 2026-02-17T11:15:47.248 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.246+0000 7f6cee72c640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f6ce8153d10 0x7f6ce815b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:47.248 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.246+0000 7f6cee72c640 10 monclient(hunting): picked mon.noname-b con 0x7f6ce8153d10 addr v2:10.20.193.97:3300/0 2026-02-17T11:15:47.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.246+0000 7f6cee72c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f6ce815b5b0 addr v1:10.20.193.157:6789/0 2026-02-17T11:15:47.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.246+0000 7f6cee72c640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ce80c85a0 con 0x7f6ce815b5b0 2026-02-17T11:15:47.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.246+0000 7f6cee72c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:47.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.246+0000 7f6cee72c640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f6ce80c8380 con 0x7f6ce8153d10 2026-02-17T11:15:47.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.246+0000 7f6cee72c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:47.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.246+0000 7f6cee72c640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f6ce80c9490 con 0x7f6ce8153930 2026-02-17T11:15:47.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.246+0000 7f6cee72c640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:47.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.246+0000 7f6cee72c640 10 monclient(hunting): authenticate will time out at 1423.910573s 2026-02-17T11:15:47.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.246+0000 7f6ce7fff640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f6ce8153930 0x7f6ce80c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:47.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.247+0000 7f6ce77fe640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f6ce8153d10 0x7f6ce815b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:47.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.247+0000 7f6ce77fe640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f6ce8153d10 0x7f6ce815b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:43404/0 (socket says 10.20.193.49:43404) 2026-02-17T11:15:47.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.247+0000 7f6ce77fe640 1 -- 10.20.193.49:0/1986225615 learned_addr learned my addr 10.20.193.49:0/1986225615 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:47.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.247+0000 7f6ce77fe640 10 monclient(hunting): get_auth_request con 0x7f6ce8153d10 auth_method 0 2026-02-17T11:15:47.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.247+0000 7f6ce77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:47.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.247+0000 7f6ce77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:47.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.247+0000 7f6ce77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:47.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.247+0000 7f6ce7fff640 10 monclient(hunting): get_auth_request con 0x7f6ce8153930 auth_method 0 2026-02-17T11:15:47.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.247+0000 7f6ce7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:47.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.247+0000 7f6ce7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:47.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.247+0000 7f6ce7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:47.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.247+0000 7f6ce77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:47.249 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.247+0000 7f6ce77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:47.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.247+0000 7f6ce77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:47.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.247+0000 7f6ce7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:47.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.247+0000 7f6ce7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:47.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.247+0000 7f6ce7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:47.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.248+0000 7f6ce77fe640 10 monclient(hunting): handle_auth_done global_id 5233 payload 274 2026-02-17T11:15:47.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.248+0000 7f6ce77fe640 1 -- 10.20.193.49:0/1986225615 >> v2:10.20.193.157:3300/0 conn(0x7f6ce8153930 msgr2=0x7f6ce80c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:15:47.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.248+0000 7f6ce77fe640 1 --2- 10.20.193.49:0/1986225615 >> v2:10.20.193.157:3300/0 conn(0x7f6ce8153930 0x7f6ce80c7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:47.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.248+0000 7f6ce77fe640 1 -- 10.20.193.49:0/1986225615 >> v1:10.20.193.157:6789/0 conn(0x7f6ce815b5b0 legacy=0x7f6ce80c52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:47.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.248+0000 7f6ce77fe640 10 monclient: _finish_hunting 0 2026-02-17T11:15:47.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.248+0000 7f6ce77fe640 1 monclient: found mon.noname-b 2026-02-17T11:15:47.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.248+0000 7f6ce77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:47.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.248+0000 7f6ce77fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:15:47.250 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.248+0000 7f6ce77fe640 1 -- 10.20.193.49:0/1986225615 --> v2:10.20.193.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ce80c8880 con 0x7f6ce8153d10 2026-02-17T11:15:47.251 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.249+0000 7f6ce77fe640 1 --2- 10.20.193.49:0/1986225615 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f6ce8153d10 0x7f6ce815b070 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6ce80c9610 tx=0x7f6cd802eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82a87425f823568d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:47.252 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.250+0000 7f6ce6ffd640 1 -- 10.20.193.49:0/1986225615 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd803c070 con 0x7f6ce8153d10 2026-02-17T11:15:47.252 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.250+0000 7f6ce6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:47.252 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.250+0000 7f6ce6ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:15:47.252 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.250+0000 7f6ce6ffd640 10 monclient: dump: 2026-02-17T11:15:47.252 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:47.252 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:47.252 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:47.252 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:47.252 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:47.253 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:47.253 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:47.253 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:47.253 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:47.253 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:47.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.250+0000 7f6ce6ffd640 10 monclient: _finish_auth 0 2026-02-17T11:15:47.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.250+0000 7f6ce6ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:15:47.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.250+0000 7f6ce6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:47.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.250+0000 7f6cee72c640 5 monclient: authenticate success, global_id 5233 2026-02-17T11:15:47.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.250+0000 7f6cee72c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:15:47.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.251+0000 7f6ce6ffd640 1 -- 10.20.193.49:0/1986225615 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cd802fbc0 con 0x7f6ce8153d10 2026-02-17T11:15:47.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.251+0000 7f6ce6ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:47.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.251+0000 7f6ce6ffd640 1 -- 10.20.193.49:0/1986225615 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd8037440 con 0x7f6ce8153d10 2026-02-17T11:15:47.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.251+0000 7f6cee72c640 10 monclient: get_monmap_and_config success 2026-02-17T11:15:47.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.251+0000 7f6ce6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:47.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.251+0000 7f6cee72c640 4 set_mon_vals no callback set 2026-02-17T11:15:47.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.251+0000 7f6ce6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:15:47.253 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.251+0000 7f6ce6ffd640 10 monclient: dump: 2026-02-17T11:15:47.253 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:47.253 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:47.253 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:47.253 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:47.253 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:47.253 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:47.253 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:47.253 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:47.254 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:47.254 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:47.254 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.251+0000 7f6cee72c640 10 monclient: shutdown 2026-02-17T11:15:47.254 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.251+0000 7f6cee72c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:47.254 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.251+0000 7f6cee72c640 1 -- 10.20.193.49:0/1986225615 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f6ce8153d10 msgr2=0x7f6ce815b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:47.254 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.251+0000 7f6cee72c640 1 --2- 10.20.193.49:0/1986225615 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f6ce8153d10 0x7f6ce815b070 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6ce80c9610 tx=0x7f6cd802eeb0 comp rx=0 tx=0).stop 2026-02-17T11:15:47.254 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.251+0000 7f6cee72c640 1 -- 10.20.193.49:0/1986225615 shutdown_connections 2026-02-17T11:15:47.254 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.251+0000 7f6cee72c640 1 --2- 10.20.193.49:0/1986225615 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f6ce8153d10 0x7f6ce815b070 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:47.254 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.251+0000 7f6cee72c640 1 --2- 10.20.193.49:0/1986225615 >> v2:10.20.193.157:3300/0 conn(0x7f6ce8153930 0x7f6ce80c7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:47.254 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.251+0000 7f6cee72c640 1 -- 10.20.193.49:0/1986225615 >> 10.20.193.49:0/1986225615 conn(0x7f6ce80c9f40 msgr2=0x7f6ce80ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:47.254 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.251+0000 7f6cee72c640 1 -- 10.20.193.49:0/1986225615 shutdown_connections 2026-02-17T11:15:47.254 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.251+0000 7f6cee72c640 1 -- 10.20.193.49:0/1986225615 wait complete. 2026-02-17T11:15:47.254 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.252+0000 7f6cee72c640 10 monclient: build_initial_monmap 2026-02-17T11:15:47.254 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.252+0000 7f6cee72c640 10 monclient: monmap: 2026-02-17T11:15:47.254 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:47.254 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:15:47.254 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:15:47.254 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:15:47.254 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:47.254 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:47.254 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:15:47.254 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:15:47.254 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:15:47.254 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:47.258 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.252+0000 7f6cee72c640 1 librados: starting msgr at 2026-02-17T11:15:47.258 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.252+0000 7f6cee72c640 1 librados: starting objecter 2026-02-17T11:15:47.258 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.252+0000 7f6cee72c640 1 Processor -- start 2026-02-17T11:15:47.258 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.252+0000 7f6cee72c640 1 -- start start 2026-02-17T11:15:47.258 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.252+0000 7f6cee72c640 1 librados: setting wanted keys 2026-02-17T11:15:47.259 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.252+0000 7f6cee72c640 1 librados: calling monclient init 2026-02-17T11:15:47.259 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.252+0000 7f6cee72c640 10 monclient: init 2026-02-17T11:15:47.259 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.253+0000 7f6cee72c640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:47.259 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.253+0000 7f6cee72c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:15:47.259 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.253+0000 7f6cee72c640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f6ce8153930 0x7f6ce81f4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:47.259 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.253+0000 7f6cee72c640 10 monclient(hunting): picked mon.noname-c con 0x7f6ce8153930 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:15:47.259 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.253+0000 7f6cee72c640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f6ce8153d10 0x7f6ce814b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:47.259 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.253+0000 7f6cee72c640 10 monclient(hunting): picked mon.noname-b con 0x7f6ce8153d10 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:15:47.259 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.253+0000 7f6cee72c640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f6ce815b5b0 0x7f6ce8074690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:47.259 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.253+0000 7f6cee72c640 10 monclient(hunting): picked mon.noname-a con 0x7f6ce815b5b0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:15:47.259 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.253+0000 7f6cee72c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:47.259 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.253+0000 7f6cee72c640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce80c9120 con 0x7f6ce815b5b0 2026-02-17T11:15:47.259 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.253+0000 7f6cee72c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:47.260 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.253+0000 7f6cee72c640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce80c8e40 con 0x7f6ce8153d10 2026-02-17T11:15:47.260 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.253+0000 7f6cee72c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:47.260 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.253+0000 7f6cee72c640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce80c7730 con 0x7f6ce8153930 2026-02-17T11:15:47.260 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.253+0000 7f6cee72c640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:47.260 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.253+0000 7f6cee72c640 10 monclient(hunting): authenticate will time out at 1423.917138s 2026-02-17T11:15:47.260 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.253+0000 7f6ce77fe640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f6ce8153d10 0x7f6ce814b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:47.260 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.253+0000 7f6cecca2640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f6ce815b5b0 0x7f6ce8074690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:47.260 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.253+0000 7f6ce7fff640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f6ce8153930 0x7f6ce81f4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:47.260 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.253+0000 7f6cecca2640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f6ce815b5b0 0x7f6ce8074690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:43166/0 (socket says 10.20.193.49:43166) 2026-02-17T11:15:47.260 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.253+0000 7f6cecca2640 1 -- 10.20.193.49:0/3236874304 learned_addr learned my addr 10.20.193.49:0/3236874304 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:47.260 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.253+0000 7f6cecca2640 10 monclient(hunting): get_auth_request con 0x7f6ce815b5b0 auth_method 0 2026-02-17T11:15:47.260 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.253+0000 7f6cecca2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:47.260 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.253+0000 7f6cecca2640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:47.260 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.253+0000 7f6cecca2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:47.260 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.253+0000 7f6ce77fe640 10 monclient(hunting): get_auth_request con 0x7f6ce8153d10 auth_method 0 2026-02-17T11:15:47.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.253+0000 7f6ce77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:47.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.253+0000 7f6ce77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:47.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.253+0000 7f6ce77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:47.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.253+0000 7f6ce7fff640 10 monclient(hunting): get_auth_request con 0x7f6ce8153930 auth_method 0 2026-02-17T11:15:47.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.253+0000 7f6ce7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:47.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.253+0000 7f6ce7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:47.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.253+0000 7f6ce7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:47.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.253+0000 7f6cecca2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:47.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.253+0000 7f6cecca2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:47.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.253+0000 7f6cecca2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:47.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.253+0000 7f6ce77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:47.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.253+0000 7f6ce77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:47.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.253+0000 7f6ce77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:47.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.253+0000 7f6ce7fff640 1 -- 10.20.193.49:0/3236874304 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f6ce8153930 msgr2=0x7f6ce81f4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T11:15:47.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.253+0000 7f6ce7fff640 1 -- 10.20.193.49:0/3236874304 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f6ce8153930 msgr2=0x7f6ce81f4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T11:15:47.262 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.253+0000 7f6ce7fff640 1 --2- 10.20.193.49:0/3236874304 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f6ce8153930 0x7f6ce81f4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:15:47.262 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.253+0000 7f6ce7fff640 1 --2- 10.20.193.49:0/3236874304 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f6ce8153930 0x7f6ce81f4110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:15:47.262 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.255+0000 7f6cecca2640 10 monclient(hunting): handle_auth_done global_id 5256 payload 824 2026-02-17T11:15:47.262 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.255+0000 7f6cecca2640 1 -- 10.20.193.49:0/3236874304 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f6ce8153930 msgr2=0x7f6ce81f4110 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T11:15:47.262 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.255+0000 7f6cecca2640 1 --2- 10.20.193.49:0/3236874304 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f6ce8153930 0x7f6ce81f4110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:47.262 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.255+0000 7f6cecca2640 1 -- 10.20.193.49:0/3236874304 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f6ce8153d10 msgr2=0x7f6ce814b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:47.262 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.255+0000 7f6cecca2640 1 --2- 10.20.193.49:0/3236874304 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f6ce8153d10 0x7f6ce814b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:47.262 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.255+0000 7f6cecca2640 10 monclient: _finish_hunting 0 2026-02-17T11:15:47.262 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.255+0000 7f6cecca2640 1 monclient: found mon.noname-a 2026-02-17T11:15:47.262 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.255+0000 7f6cecca2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:47.262 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.255+0000 7f6cecca2640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:15:47.262 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.255+0000 7f6cecca2640 1 -- 10.20.193.49:0/3236874304 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ce8148bf0 con 0x7f6ce815b5b0 2026-02-17T11:15:47.264 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.256+0000 7f6cecca2640 1 --2- 10.20.193.49:0/3236874304 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f6ce815b5b0 0x7f6ce8074690 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc00cc50 tx=0x7f6cdc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:47.264 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.256+0000 7f6ce4ff9640 10 client.?.objecter ms_handle_connect 0x7f6ce815b5b0 2026-02-17T11:15:47.264 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.256+0000 7f6ce4ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T11:15:47.264 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.258+0000 7f6ce4ff9640 1 -- 10.20.193.49:0/3236874304 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc003a70 con 0x7f6ce815b5b0 2026-02-17T11:15:47.264 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.258+0000 7f6ce4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:47.264 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.258+0000 7f6ce4ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:15:47.264 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.258+0000 7f6ce4ff9640 10 monclient: dump: 2026-02-17T11:15:47.264 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:47.264 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:47.264 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:47.264 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:47.265 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:47.265 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:47.265 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:47.265 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:47.265 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:47.265 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:47.265 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.258+0000 7f6ce4ff9640 10 monclient: _finish_auth 0 2026-02-17T11:15:47.265 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.258+0000 7f6ce4ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:15:47.265 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.258+0000 7f6ce4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:47.265 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.258+0000 7f6ce4ff9640 1 -- 10.20.193.49:0/3236874304 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cdc003c10 con 0x7f6ce815b5b0 2026-02-17T11:15:47.265 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.258+0000 7f6cee72c640 5 monclient: authenticate success, global_id 5256 2026-02-17T11:15:47.265 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.258+0000 7f6ce4ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:47.265 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.258+0000 7f6cee72c640 10 monclient: _renew_subs 2026-02-17T11:15:47.265 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.258+0000 7f6ce4ff9640 1 -- 10.20.193.49:0/3236874304 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc0050d0 con 0x7f6ce815b5b0 2026-02-17T11:15:47.265 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.258+0000 7f6cee72c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:47.266 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.258+0000 7f6cee72c640 1 -- 10.20.193.49:0/3236874304 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ce8148ed0 con 0x7f6ce815b5b0 2026-02-17T11:15:47.266 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.258+0000 7f6ce67fc640 4 set_mon_vals no callback set 2026-02-17T11:15:47.266 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.258+0000 7f6ce4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:47.266 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.258+0000 7f6ce4ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:15:47.266 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.258+0000 7f6ce4ff9640 10 monclient: dump: 2026-02-17T11:15:47.266 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:47.266 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:47.266 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:47.266 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:47.266 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:47.266 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:47.266 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:47.266 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:47.267 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:47.267 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:47.267 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.258+0000 7f6cee72c640 10 client.5256.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:47.267 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.258+0000 7f6cee72c640 10 monclient: _renew_subs 2026-02-17T11:15:47.267 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.258+0000 7f6cee72c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:47.267 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.258+0000 7f6cee72c640 1 -- 10.20.193.49:0/3236874304 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ce814a8b0 con 0x7f6ce815b5b0 2026-02-17T11:15:47.267 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.258+0000 7f6cee72c640 1 librados: init done 2026-02-17T11:15:47.267 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.258+0000 7f6cee72c640 10 client.5256.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:47.267 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.258+0000 7f6cee72c640 15 client.5256.objecter _session_command_op_assign -1 1 2026-02-17T11:15:47.267 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.258+0000 7f6cee72c640 20 client.5256.objecter _get_session osd=-1 returning homeless 2026-02-17T11:15:47.267 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.258+0000 7f6cee72c640 10 client.5256.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:47.267 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.258+0000 7f6cee72c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:47.267 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.258+0000 7f6cee72c640 1 -- 10.20.193.49:0/3236874304 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6ce80c7e40 con 0x7f6ce815b5b0 2026-02-17T11:15:47.273 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.270+0000 7f6ce4ff9640 1 -- 10.20.193.49:0/3236874304 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f6cdc005270 con 0x7f6ce815b5b0 2026-02-17T11:15:47.273 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.271+0000 7f6ce4ff9640 1 --2- 10.20.193.49:0/3236874304 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f6cb8079140 0x7f6cb807b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:47.274 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.271+0000 7f6ce7fff640 1 --2- 10.20.193.49:0/3236874304 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f6cb8079140 0x7f6cb807b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:47.274 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.271+0000 7f6ce7fff640 10 monclient: get_auth_request con 0x7f6cb8079140 auth_method 0 2026-02-17T11:15:47.274 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.272+0000 7f6ce7fff640 1 --2- 10.20.193.49:0/3236874304 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f6cb8079140 0x7f6cb807b600 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4009480 tx=0x7f6cd4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:47.274 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.272+0000 7f6ce4ff9640 10 client.5256.objecter ms_handle_connect 0x7f6cb8079140 2026-02-17T11:15:47.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.272+0000 7f6ce4ff9640 1 -- 10.20.193.49:0/3236874304 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f6cdc0983c0 con 0x7f6ce815b5b0 2026-02-17T11:15:47.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.272+0000 7f6ce4ff9640 10 client.5256.objecter ms_dispatch2 0x7f6ce8000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:15:47.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.272+0000 7f6ce4ff9640 3 client.5256.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:15:47.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.272+0000 7f6ce4ff9640 3 client.5256.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:15:47.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.272+0000 7f6ce4ff9640 10 client.5256.objecter checking command 1 2026-02-17T11:15:47.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.272+0000 7f6ce4ff9640 1 --2- 10.20.193.49:0/3236874304 >> [v2:10.20.193.157:6816/1377516118,v1:10.20.193.157:6817/1377516118] conn(0x7f6cb8081620 0x7f6cb8083a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:47.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.272+0000 7f6ce4ff9640 20 client.5256.objecter _get_session s=0x7f6cb8080f50 osd=2 3 2026-02-17T11:15:47.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.272+0000 7f6ce4ff9640 20 client.5256.objecter put_session s=0x7f6cb8080f50 osd=2 3 2026-02-17T11:15:47.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.272+0000 7f6ce4ff9640 15 client.5256.objecter _session_command_op_remove -1 1 2026-02-17T11:15:47.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.272+0000 7f6ce4ff9640 20 client.5256.objecter _get_session s=0x7f6cb8080f50 osd=2 3 2026-02-17T11:15:47.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.272+0000 7f6ce4ff9640 20 client.5256.objecter get_session s=0x7f6cb8080f50 osd=2 3 2026-02-17T11:15:47.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.272+0000 7f6ce4ff9640 15 client.5256.objecter _session_command_op_assign 2 1 2026-02-17T11:15:47.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.272+0000 7f6ce4ff9640 20 client.5256.objecter put_session s=0x7f6cb8080f50 osd=2 4 2026-02-17T11:15:47.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.272+0000 7f6ce4ff9640 10 client.5256.objecter _send_command 1 2026-02-17T11:15:47.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.272+0000 7f6ce4ff9640 1 -- 10.20.193.49:0/3236874304 --> [v2:10.20.193.157:6816/1377516118,v1:10.20.193.157:6817/1377516118] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6cdc013e70 con 0x7f6cb8081620 2026-02-17T11:15:47.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.272+0000 7f6ce4ff9640 20 client.5256.objecter dump_active .. 0 homeless 2026-02-17T11:15:47.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.273+0000 7f6ce77fe640 1 --2- 10.20.193.49:0/3236874304 >> [v2:10.20.193.157:6816/1377516118,v1:10.20.193.157:6817/1377516118] conn(0x7f6cb8081620 0x7f6cb8083a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:47.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.273+0000 7f6ce77fe640 10 monclient: get_auth_request con 0x7f6cb8081620 auth_method 0 2026-02-17T11:15:47.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.273+0000 7f6ce4ff9640 1 -- 10.20.193.49:0/3236874304 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f6cdc05ec30 con 0x7f6ce815b5b0 2026-02-17T11:15:47.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.273+0000 7f6ce4ff9640 10 monclient: handle_get_version_reply finishing 1 version 34 2026-02-17T11:15:47.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.275+0000 7f6ce77fe640 1 --2- 10.20.193.49:0/3236874304 >> [v2:10.20.193.157:6816/1377516118,v1:10.20.193.157:6817/1377516118] conn(0x7f6cb8081620 0x7f6cb8083a40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:47.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.275+0000 7f6ce4ff9640 10 client.5256.objecter ms_handle_connect 0x7f6cb8081620 2026-02-17T11:15:47.288 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.286+0000 7f6ce4ff9640 1 -- 10.20.193.49:0/3236874304 <== osd.2 v2:10.20.193.157:6816/1377516118 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f6cdc013e70 con 0x7f6cb8081620 2026-02-17T11:15:47.288 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.286+0000 7f6ce4ff9640 10 client.5256.objecter ms_dispatch2 0x7f6ce8000b90 command_reply(tid 1: 0 ) 2026-02-17T11:15:47.288 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.286+0000 7f6ce4ff9640 10 client.5256.objecter _finish_command 1 = system:0 2026-02-17T11:15:47.288 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.286+0000 7f6ce4ff9640 20 client.5256.objecter put_session s=0x7f6cb8080f50 osd=2 4 2026-02-17T11:15:47.288 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.286+0000 7f6ce4ff9640 15 client.5256.objecter _session_command_op_remove 2 1 2026-02-17T11:15:47.294 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.291+0000 7f6cee72c640 10 client.5256.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T11:15:47.295 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.291+0000 7f6cee72c640 15 client.5256.objecter _session_command_op_assign -1 2 2026-02-17T11:15:47.295 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.291+0000 7f6cee72c640 20 client.5256.objecter _get_session s=0x7f6cb8080f50 osd=2 3 2026-02-17T11:15:47.295 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.291+0000 7f6cee72c640 20 client.5256.objecter put_session s=0x7f6cb8080f50 osd=2 3 2026-02-17T11:15:47.295 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.291+0000 7f6cee72c640 20 client.5256.objecter _get_session s=0x7f6cb8080f50 osd=2 3 2026-02-17T11:15:47.295 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.291+0000 7f6cee72c640 15 client.5256.objecter _session_command_op_remove -1 2 2026-02-17T11:15:47.295 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.291+0000 7f6cee72c640 20 client.5256.objecter get_session s=0x7f6cb8080f50 osd=2 3 2026-02-17T11:15:47.296 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.291+0000 7f6cee72c640 15 client.5256.objecter _session_command_op_assign 2 2 2026-02-17T11:15:47.296 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.291+0000 7f6cee72c640 20 client.5256.objecter put_session s=0x7f6cb8080f50 osd=2 4 2026-02-17T11:15:47.296 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.291+0000 7f6cee72c640 10 client.5256.objecter _send_command 2 2026-02-17T11:15:47.296 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.291+0000 7f6cee72c640 1 -- 10.20.193.49:0/3236874304 --> [v2:10.20.193.157:6816/1377516118,v1:10.20.193.157:6817/1377516118] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6ce80c5930 con 0x7f6cb8081620 2026-02-17T11:15:47.302 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.299+0000 7f6ce4ff9640 1 -- 10.20.193.49:0/3236874304 <== osd.2 v2:10.20.193.157:6816/1377516118 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f6ce80c5930 con 0x7f6cb8081620 2026-02-17T11:15:47.302 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.299+0000 7f6ce4ff9640 10 client.5256.objecter ms_dispatch2 0x7f6ce8000b90 command_reply(tid 2: 0 ) 2026-02-17T11:15:47.302 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.299+0000 7f6ce4ff9640 10 client.5256.objecter _finish_command 2 = system:0 2026-02-17T11:15:47.302 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.299+0000 7f6ce4ff9640 20 client.5256.objecter put_session s=0x7f6cb8080f50 osd=2 4 2026-02-17T11:15:47.302 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.299+0000 7f6ce4ff9640 15 client.5256.objecter _session_command_op_remove 2 2 2026-02-17T11:15:47.303 INFO:teuthology.orchestra.run.trial049.stdout:{ 2026-02-17T11:15:47.303 INFO:teuthology.orchestra.run.trial049.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T11:15:47.303 INFO:teuthology.orchestra.run.trial049.stdout:} 2026-02-17T11:15:47.305 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.299+0000 7f6cee72c640 10 librados: watch_flush enter 2026-02-17T11:15:47.305 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.299+0000 7f6cee72c640 10 librados: watch_flush exit 2026-02-17T11:15:47.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.299+0000 7f6cee72c640 10 client.5256.objecter close_session for osd.2 2026-02-17T11:15:47.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.299+0000 7f6cee72c640 1 -- 10.20.193.49:0/3236874304 >> [v2:10.20.193.157:6816/1377516118,v1:10.20.193.157:6817/1377516118] conn(0x7f6cb8081620 msgr2=0x7f6cb8083a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:47.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.299+0000 7f6cee72c640 1 --2- 10.20.193.49:0/3236874304 >> [v2:10.20.193.157:6816/1377516118,v1:10.20.193.157:6817/1377516118] conn(0x7f6cb8081620 0x7f6cb8083a40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:47.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.299+0000 7f6cee72c640 20 client.5256.objecter put_session s=0x7f6cb8080f50 osd=2 1 2026-02-17T11:15:47.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.299+0000 7f6cee72c640 20 client.5256.objecter shutdown clearing up homeless session... 2026-02-17T11:15:47.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.299+0000 7f6cee72c640 10 client.5256.objecter successfully canceled tick 2026-02-17T11:15:47.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.299+0000 7f6cee72c640 1 -- 10.20.193.49:0/3236874304 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f6cb8079140 msgr2=0x7f6cb807b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:47.307 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.299+0000 7f6cee72c640 1 --2- 10.20.193.49:0/3236874304 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f6cb8079140 0x7f6cb807b600 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4009480 tx=0x7f6cd4008040 comp rx=0 tx=0).stop 2026-02-17T11:15:47.307 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.299+0000 7f6cee72c640 10 monclient: shutdown 2026-02-17T11:15:47.307 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.299+0000 7f6cee72c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:47.307 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.299+0000 7f6cee72c640 1 -- 10.20.193.49:0/3236874304 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f6ce815b5b0 msgr2=0x7f6ce8074690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:47.307 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.299+0000 7f6cee72c640 1 --2- 10.20.193.49:0/3236874304 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f6ce815b5b0 0x7f6ce8074690 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc00cc50 tx=0x7f6cdc00a430 comp rx=0 tx=0).stop 2026-02-17T11:15:47.307 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.299+0000 7f6cecca2640 1 -- 10.20.193.49:0/3236874304 reap_dead start 2026-02-17T11:15:47.307 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.299+0000 7f6cee72c640 1 -- 10.20.193.49:0/3236874304 shutdown_connections 2026-02-17T11:15:47.307 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.299+0000 7f6cee72c640 1 -- 10.20.193.49:0/3236874304 >> 10.20.193.49:0/3236874304 conn(0x7f6ce80c9f40 msgr2=0x7f6ce815b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:47.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.299+0000 7f6cee72c640 1 -- 10.20.193.49:0/3236874304 shutdown_connections 2026-02-17T11:15:47.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.299+0000 7f6cee72c640 1 -- 10.20.193.49:0/3236874304 wait complete. 2026-02-17T11:15:47.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.299+0000 7f6cee72c640 1 librados: shutdown 2026-02-17T11:15:47.310 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2026-02-17T11:15:47.378 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.375+0000 7f915bff7640 10 monclient: get_monmap_and_config 2026-02-17T11:15:47.378 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.375+0000 7f915bff7640 10 monclient: build_initial_monmap 2026-02-17T11:15:47.378 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.375+0000 7f915bff7640 10 monclient: monmap: 2026-02-17T11:15:47.378 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:47.378 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:47.378 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:15:47.377297+0000 2026-02-17T11:15:47.379 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:15:47.377297+0000 2026-02-17T11:15:47.379 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:47.379 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:47.379 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:15:47.379 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:15:47.379 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:15:47.379 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:15:47.379 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:15:47.379 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:15:47.379 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:47.382 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.376+0000 7f915bff7640 1 Processor -- start 2026-02-17T11:15:47.382 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.376+0000 7f915bff7640 1 -- start start 2026-02-17T11:15:47.383 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.376+0000 7f915bff7640 10 monclient: init 2026-02-17T11:15:47.383 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.376+0000 7f915bff7640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:47.383 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.376+0000 7f915bff7640 10 monclient: _add_conns ranks=[2,3,4,1,5,0] 2026-02-17T11:15:47.383 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.376+0000 7f915bff7640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f91540c7170 addr v1:10.20.193.157:6789/0 2026-02-17T11:15:47.383 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.376+0000 7f915bff7640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f91540c7550 0x7f91540749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:47.383 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.376+0000 7f915bff7640 10 monclient(hunting): picked mon.noname-a con 0x7f91540c7550 addr v2:10.20.193.49:3300/0 2026-02-17T11:15:47.383 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.376+0000 7f915bff7640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f9154074ef0 0x7f91540c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:47.383 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.376+0000 7f915bff7640 10 monclient(hunting): picked mon.noname-b con 0x7f9154074ef0 addr v2:10.20.193.97:3300/0 2026-02-17T11:15:47.383 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.376+0000 7f915bff7640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91540c4fd0 con 0x7f91540c7170 2026-02-17T11:15:47.383 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.376+0000 7f915bff7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:47.383 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.376+0000 7f915bff7640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f91540c8530 con 0x7f91540c7550 2026-02-17T11:15:47.383 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.376+0000 7f915bff7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:47.384 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.376+0000 7f915bff7640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f915415a9a0 con 0x7f9154074ef0 2026-02-17T11:15:47.384 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.376+0000 7f915bff7640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:47.384 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.376+0000 7f915bff7640 10 monclient(hunting): authenticate will time out at 1424.040825s 2026-02-17T11:15:47.384 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.377+0000 7f9159d6c640 1 --1- >> v1:10.20.193.157:6789/0 conn(0x7f91540c7170 0x7f91540c48c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.157:6789/0 says I am v1:10.20.193.49:44774/0 (socket says 10.20.193.49:44774) 2026-02-17T11:15:47.384 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.377+0000 7f9159d6c640 1 -- 10.20.193.49:0/3627787356 learned_addr learned my addr 10.20.193.49:0/3627787356 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:15:47.384 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.377+0000 7f915956b640 1 --2- 10.20.193.49:0/3627787356 >> v2:10.20.193.49:3300/0 conn(0x7f91540c7550 0x7f91540749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:47.384 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.377+0000 7f915a56d640 1 --2- 10.20.193.49:0/3627787356 >> v2:10.20.193.97:3300/0 conn(0x7f9154074ef0 0x7f91540c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:47.384 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.377+0000 7f915956b640 10 monclient(hunting): get_auth_request con 0x7f91540c7550 auth_method 0 2026-02-17T11:15:47.384 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.377+0000 7f915956b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:47.384 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.377+0000 7f915956b640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:47.384 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.377+0000 7f915956b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:47.384 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.377+0000 7f915a56d640 10 monclient(hunting): get_auth_request con 0x7f9154074ef0 auth_method 0 2026-02-17T11:15:47.385 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.377+0000 7f915a56d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:47.385 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.377+0000 7f915a56d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:47.385 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.377+0000 7f915a56d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:47.385 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.377+0000 7f915956b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:47.385 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.377+0000 7f915956b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:47.385 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.377+0000 7f915956b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:47.385 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.377+0000 7f915a56d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:47.385 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.377+0000 7f915a56d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:47.385 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.378+0000 7f915a56d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:47.385 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.378+0000 7f9158d6a640 1 -- 10.20.193.49:0/3627787356 <== mon.2 v1:10.20.193.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 42894254 0 0) 0x7f91540c4fd0 con 0x7f91540c7170 2026-02-17T11:15:47.385 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.378+0000 7f9158d6a640 10 monclient(hunting): _negotiate 2026-02-17T11:15:47.385 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.378+0000 7f9158d6a640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:47.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.378+0000 7f9158d6a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:47.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.378+0000 7f9158d6a640 10 monclient(hunting): my global_id is 5297 2026-02-17T11:15:47.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.378+0000 7f9158d6a640 1 -- 10.20.193.49:0/3627787356 --> v1:10.20.193.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f913c003620 con 0x7f91540c7170 2026-02-17T11:15:47.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.378+0000 7f915956b640 10 monclient(hunting): handle_auth_done global_id 5259 payload 274 2026-02-17T11:15:47.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.378+0000 7f915956b640 1 -- 10.20.193.49:0/3627787356 >> v2:10.20.193.97:3300/0 conn(0x7f9154074ef0 msgr2=0x7f91540c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:15:47.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.378+0000 7f915956b640 1 --2- 10.20.193.49:0/3627787356 >> v2:10.20.193.97:3300/0 conn(0x7f9154074ef0 0x7f91540c89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:47.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.378+0000 7f915956b640 1 -- 10.20.193.49:0/3627787356 >> v1:10.20.193.157:6789/0 conn(0x7f91540c7170 legacy=0x7f91540c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:47.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.378+0000 7f915956b640 10 monclient: _finish_hunting 0 2026-02-17T11:15:47.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.378+0000 7f915956b640 1 monclient: found mon.noname-a 2026-02-17T11:15:47.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.378+0000 7f915956b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:47.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.378+0000 7f915956b640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:15:47.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.378+0000 7f915956b640 1 -- 10.20.193.49:0/3627787356 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91540c5270 con 0x7f91540c7550 2026-02-17T11:15:47.387 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.379+0000 7f915956b640 1 --2- 10.20.193.49:0/3627787356 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f91540c7550 0x7f91540749b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f91540c84a0 tx=0x7f914802ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5db641cd5a88f1d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:47.393 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.380+0000 7f9158d6a640 1 -- 10.20.193.49:0/3627787356 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f914803c070 con 0x7f91540c7550 2026-02-17T11:15:47.393 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.380+0000 7f9158d6a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:47.393 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.380+0000 7f9158d6a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:15:47.394 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.380+0000 7f9158d6a640 10 monclient: dump: 2026-02-17T11:15:47.394 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:47.394 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:47.394 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:47.394 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:47.394 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:47.394 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:47.394 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:47.394 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:47.394 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:47.394 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:47.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.380+0000 7f9158d6a640 10 monclient: _finish_auth 0 2026-02-17T11:15:47.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.380+0000 7f9158d6a640 10 monclient: _check_auth_tickets 2026-02-17T11:15:47.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.380+0000 7f9158d6a640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:47.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.380+0000 7f915bff7640 5 monclient: authenticate success, global_id 5259 2026-02-17T11:15:47.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.380+0000 7f915bff7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:15:47.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.381+0000 7f9158d6a640 1 -- 10.20.193.49:0/3627787356 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f914802faf0 con 0x7f91540c7550 2026-02-17T11:15:47.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.381+0000 7f9158d6a640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:47.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.381+0000 7f9158d6a640 1 -- 10.20.193.49:0/3627787356 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9148037440 con 0x7f91540c7550 2026-02-17T11:15:47.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.381+0000 7f9158d6a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:47.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.381+0000 7f9158d6a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:15:47.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.381+0000 7f9158d6a640 10 monclient: dump: 2026-02-17T11:15:47.395 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:47.395 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:47.396 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:47.396 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:47.396 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:47.396 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:47.396 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:47.396 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:47.396 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:47.396 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:47.396 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.381+0000 7f915bff7640 10 monclient: get_monmap_and_config success 2026-02-17T11:15:47.396 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.381+0000 7f915bff7640 4 set_mon_vals no callback set 2026-02-17T11:15:47.396 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.381+0000 7f915bff7640 10 monclient: shutdown 2026-02-17T11:15:47.396 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.381+0000 7f915bff7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:47.397 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.381+0000 7f915bff7640 1 -- 10.20.193.49:0/3627787356 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f91540c7550 msgr2=0x7f91540749b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:47.397 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.381+0000 7f915bff7640 1 --2- 10.20.193.49:0/3627787356 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f91540c7550 0x7f91540749b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f91540c84a0 tx=0x7f914802ede0 comp rx=0 tx=0).stop 2026-02-17T11:15:47.397 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.381+0000 7f915bff7640 1 -- 10.20.193.49:0/3627787356 shutdown_connections 2026-02-17T11:15:47.397 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.381+0000 7f915bff7640 1 --2- 10.20.193.49:0/3627787356 >> v2:10.20.193.97:3300/0 conn(0x7f9154074ef0 0x7f91540c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:47.397 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.381+0000 7f915bff7640 1 --2- 10.20.193.49:0/3627787356 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f91540c7550 0x7f91540749b0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:47.397 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.381+0000 7f915bff7640 1 -- 10.20.193.49:0/3627787356 >> 10.20.193.49:0/3627787356 conn(0x7f91540c9f40 msgr2=0x7f91540ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:47.397 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.381+0000 7f915bff7640 1 -- 10.20.193.49:0/3627787356 shutdown_connections 2026-02-17T11:15:47.397 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.381+0000 7f915bff7640 1 -- 10.20.193.49:0/3627787356 wait complete. 2026-02-17T11:15:47.397 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.382+0000 7f915bff7640 10 monclient: build_initial_monmap 2026-02-17T11:15:47.397 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.382+0000 7f915bff7640 10 monclient: monmap: 2026-02-17T11:15:47.397 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:47.397 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:15:47.398 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:15:47.398 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:15:47.398 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:47.398 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:47.398 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:15:47.398 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:15:47.398 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:15:47.398 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:47.398 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.382+0000 7f915bff7640 1 librados: starting msgr at 2026-02-17T11:15:47.398 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.382+0000 7f915bff7640 1 librados: starting objecter 2026-02-17T11:15:47.398 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.382+0000 7f915bff7640 1 Processor -- start 2026-02-17T11:15:47.398 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.382+0000 7f915bff7640 1 -- start start 2026-02-17T11:15:47.398 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.382+0000 7f915bff7640 1 librados: setting wanted keys 2026-02-17T11:15:47.399 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.382+0000 7f915bff7640 1 librados: calling monclient init 2026-02-17T11:15:47.399 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.382+0000 7f915bff7640 10 monclient: init 2026-02-17T11:15:47.399 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.382+0000 7f915bff7640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:47.399 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.383+0000 7f915bff7640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:15:47.399 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.383+0000 7f915bff7640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f9154074ef0 0x7f915406ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:47.399 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.383+0000 7f915bff7640 10 monclient(hunting): picked mon.noname-a con 0x7f9154074ef0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:15:47.399 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.383+0000 7f915bff7640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f91540c7170 0x7f91541f6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:47.399 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.383+0000 7f915bff7640 10 monclient(hunting): picked mon.noname-b con 0x7f91540c7170 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:15:47.399 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.383+0000 7f915bff7640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f91540c7550 0x7f91541f7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:47.399 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.383+0000 7f915bff7640 10 monclient(hunting): picked mon.noname-c con 0x7f91540c7550 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:15:47.399 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.383+0000 7f915bff7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:47.399 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.383+0000 7f915bff7640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f91540c7ee0 con 0x7f9154074ef0 2026-02-17T11:15:47.399 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.383+0000 7f915bff7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:47.400 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.383+0000 7f915bff7640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f91540c5830 con 0x7f91540c7170 2026-02-17T11:15:47.400 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.383+0000 7f915bff7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:47.400 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.383+0000 7f915bff7640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f91540c81c0 con 0x7f91540c7550 2026-02-17T11:15:47.400 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.383+0000 7f915bff7640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:47.400 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.383+0000 7f915bff7640 10 monclient(hunting): authenticate will time out at 1424.047047s 2026-02-17T11:15:47.400 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.383+0000 7f9159d6c640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f9154074ef0 0x7f915406ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:47.400 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.383+0000 7f9159d6c640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f9154074ef0 0x7f915406ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:43186/0 (socket says 10.20.193.49:43186) 2026-02-17T11:15:47.400 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.383+0000 7f9159d6c640 1 -- 10.20.193.49:0/1398801865 learned_addr learned my addr 10.20.193.49:0/1398801865 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:47.400 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.383+0000 7f9159d6c640 10 monclient(hunting): get_auth_request con 0x7f9154074ef0 auth_method 0 2026-02-17T11:15:47.400 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.383+0000 7f9159d6c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:47.400 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.383+0000 7f9159d6c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:47.400 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.383+0000 7f9159d6c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:47.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.383+0000 7f915a56d640 1 --2- 10.20.193.49:0/1398801865 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f91540c7550 0x7f91541f7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:47.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.383+0000 7f915956b640 1 --2- 10.20.193.49:0/1398801865 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f91540c7170 0x7f91541f6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:47.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.383+0000 7f915956b640 10 monclient(hunting): get_auth_request con 0x7f91540c7170 auth_method 0 2026-02-17T11:15:47.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.383+0000 7f915956b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:47.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.383+0000 7f915956b640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:47.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.383+0000 7f915956b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:47.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.383+0000 7f915a56d640 10 monclient(hunting): get_auth_request con 0x7f91540c7550 auth_method 0 2026-02-17T11:15:47.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.383+0000 7f915a56d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:47.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.383+0000 7f915a56d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:47.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.383+0000 7f915a56d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:47.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.383+0000 7f9159d6c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:47.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.383+0000 7f9159d6c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:47.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.383+0000 7f9159d6c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:47.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.383+0000 7f915956b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:47.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.383+0000 7f915956b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:47.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.383+0000 7f915956b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:47.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.383+0000 7f915a56d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:47.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.383+0000 7f915a56d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:47.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.383+0000 7f915a56d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:47.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.384+0000 7f9159d6c640 10 monclient(hunting): handle_auth_done global_id 5262 payload 824 2026-02-17T11:15:47.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.384+0000 7f9159d6c640 1 -- 10.20.193.49:0/1398801865 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f91540c7550 msgr2=0x7f91541f7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:47.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.384+0000 7f9159d6c640 1 --2- 10.20.193.49:0/1398801865 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f91540c7550 0x7f91541f7050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:47.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.384+0000 7f9159d6c640 1 -- 10.20.193.49:0/1398801865 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f91540c7170 msgr2=0x7f91541f6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:47.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.384+0000 7f9159d6c640 1 --2- 10.20.193.49:0/1398801865 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f91540c7170 0x7f91541f6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:47.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.384+0000 7f9159d6c640 10 monclient: _finish_hunting 0 2026-02-17T11:15:47.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.384+0000 7f9159d6c640 1 monclient: found mon.noname-a 2026-02-17T11:15:47.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.384+0000 7f9159d6c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:47.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.384+0000 7f9159d6c640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:15:47.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.384+0000 7f9159d6c640 1 -- 10.20.193.49:0/1398801865 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91541f3380 con 0x7f9154074ef0 2026-02-17T11:15:47.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.386+0000 7f9159d6c640 1 --2- 10.20.193.49:0/1398801865 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f9154074ef0 0x7f915406ffd0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f914400c700 tx=0x7f914400cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:47.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.386+0000 7f91427fc640 10 client.?.objecter ms_handle_connect 0x7f9154074ef0 2026-02-17T11:15:47.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.386+0000 7f91427fc640 10 client.?.objecter resend_mon_ops 2026-02-17T11:15:47.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.387+0000 7f91427fc640 1 -- 10.20.193.49:0/1398801865 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9144017070 con 0x7f9154074ef0 2026-02-17T11:15:47.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.387+0000 7f91427fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:47.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.387+0000 7f91427fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:15:47.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.387+0000 7f91427fc640 10 monclient: dump: 2026-02-17T11:15:47.403 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:47.403 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:47.404 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:47.404 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:47.404 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:47.404 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:47.404 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:47.404 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:47.404 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:47.404 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:47.404 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.387+0000 7f91427fc640 10 monclient: _finish_auth 0 2026-02-17T11:15:47.404 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.387+0000 7f91427fc640 10 monclient: _check_auth_tickets 2026-02-17T11:15:47.404 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.387+0000 7f91427fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:47.404 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.387+0000 7f91427fc640 1 -- 10.20.193.49:0/1398801865 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9144005bd0 con 0x7f9154074ef0 2026-02-17T11:15:47.404 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.387+0000 7f915bff7640 5 monclient: authenticate success, global_id 5262 2026-02-17T11:15:47.405 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.387+0000 7f915bff7640 10 monclient: _renew_subs 2026-02-17T11:15:47.405 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.387+0000 7f915bff7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:47.405 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.387+0000 7f915bff7640 1 -- 10.20.193.49:0/1398801865 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91541f3660 con 0x7f9154074ef0 2026-02-17T11:15:47.405 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.387+0000 7f91427fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:47.405 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.387+0000 7f91427fc640 1 -- 10.20.193.49:0/1398801865 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9144007070 con 0x7f9154074ef0 2026-02-17T11:15:47.405 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.387+0000 7f91427fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:47.405 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.387+0000 7f91427fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:15:47.405 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.387+0000 7f9143fff640 4 set_mon_vals no callback set 2026-02-17T11:15:47.405 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.387+0000 7f91427fc640 10 monclient: dump: 2026-02-17T11:15:47.405 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:47.405 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:47.405 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:47.406 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:47.406 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:47.406 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:47.406 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:47.406 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:47.406 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:47.406 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:47.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.388+0000 7f915bff7640 10 client.5262.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:47.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.388+0000 7f915bff7640 10 monclient: _renew_subs 2026-02-17T11:15:47.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.388+0000 7f915bff7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:47.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.388+0000 7f915bff7640 1 -- 10.20.193.49:0/1398801865 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91541f3c20 con 0x7f9154074ef0 2026-02-17T11:15:47.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.388+0000 7f915bff7640 1 librados: init done 2026-02-17T11:15:47.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.388+0000 7f915bff7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:47.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.388+0000 7f915bff7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:47.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.388+0000 7f915bff7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:47.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.388+0000 7f915bff7640 1 -- 10.20.193.49:0/1398801865 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91541f3e60 con 0x7f9154074ef0 2026-02-17T11:15:47.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.399+0000 7f91427fc640 1 -- 10.20.193.49:0/1398801865 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f9144007210 con 0x7f9154074ef0 2026-02-17T11:15:47.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.400+0000 7f91427fc640 1 --2- 10.20.193.49:0/1398801865 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f9124079190 0x7f912407b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:47.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.400+0000 7f915956b640 1 --2- 10.20.193.49:0/1398801865 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f9124079190 0x7f912407b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:47.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.400+0000 7f915956b640 10 monclient: get_auth_request con 0x7f9124079190 auth_method 0 2026-02-17T11:15:47.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.401+0000 7f91427fc640 10 client.5262.objecter ms_handle_connect 0x7f9124079190 2026-02-17T11:15:47.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.401+0000 7f915956b640 1 --2- 10.20.193.49:0/1398801865 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f9124079190 0x7f912407b650 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9148039000 tx=0x7f9148033000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:47.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.401+0000 7f91427fc640 1 -- 10.20.193.49:0/1398801865 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f914405d700 con 0x7f9154074ef0 2026-02-17T11:15:47.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.401+0000 7f91427fc640 10 client.5262.objecter ms_dispatch2 0x7f9154000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:15:47.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.401+0000 7f91427fc640 3 client.5262.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:15:47.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.401+0000 7f91427fc640 3 client.5262.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:15:47.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.401+0000 7f91427fc640 20 client.5262.objecter dump_active .. 0 homeless 2026-02-17T11:15:47.501 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.499+0000 7f91427fc640 1 -- 10.20.193.49:0/1398801865 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f91541f3e60 con 0x7f9154074ef0 2026-02-17T11:15:47.501 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.499+0000 7f91427fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:47.501 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.499+0000 7f91427fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:15:47.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.582+0000 7f915bff7640 1 -- 10.20.193.49:0/1398801865 --> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f9154158660 con 0x7f9124079190 2026-02-17T11:15:47.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.582+0000 7f91427fc640 1 -- 10.20.193.49:0/1398801865 <== mgr.4106 v2:10.20.193.162:6800/2614632098 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f9154158660 con 0x7f9124079190 2026-02-17T11:15:47.585 INFO:teuthology.orchestra.run.trial049.stderr:instructed osd(s) 2 to deep-scrub 2026-02-17T11:15:47.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.583+0000 7f915bff7640 10 librados: watch_flush enter 2026-02-17T11:15:47.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.583+0000 7f915bff7640 10 librados: watch_flush exit 2026-02-17T11:15:47.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.583+0000 7f915bff7640 20 client.5262.objecter shutdown clearing up homeless session... 2026-02-17T11:15:47.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.583+0000 7f915bff7640 10 client.5262.objecter successfully canceled tick 2026-02-17T11:15:47.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.583+0000 7f915bff7640 1 -- 10.20.193.49:0/1398801865 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f9124079190 msgr2=0x7f912407b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:47.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.583+0000 7f915bff7640 1 --2- 10.20.193.49:0/1398801865 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f9124079190 0x7f912407b650 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9148039000 tx=0x7f9148033000 comp rx=0 tx=0).stop 2026-02-17T11:15:47.587 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.583+0000 7f915bff7640 10 monclient: shutdown 2026-02-17T11:15:47.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.583+0000 7f915bff7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:47.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.583+0000 7f915bff7640 1 -- 10.20.193.49:0/1398801865 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f9154074ef0 msgr2=0x7f915406ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:47.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.583+0000 7f915bff7640 1 --2- 10.20.193.49:0/1398801865 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f9154074ef0 0x7f915406ffd0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f914400c700 tx=0x7f914400cbd0 comp rx=0 tx=0).stop 2026-02-17T11:15:47.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.583+0000 7f915bff7640 1 -- 10.20.193.49:0/1398801865 shutdown_connections 2026-02-17T11:15:47.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.583+0000 7f915bff7640 1 --2- 10.20.193.49:0/1398801865 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f9124079190 0x7f912407b650 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:47.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.583+0000 7f915bff7640 1 --2- 10.20.193.49:0/1398801865 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f91540c7550 0x7f91541f7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:47.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.583+0000 7f915bff7640 1 --2- 10.20.193.49:0/1398801865 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f91540c7170 0x7f91541f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:47.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.583+0000 7f915bff7640 1 --2- 10.20.193.49:0/1398801865 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f9154074ef0 0x7f915406ffd0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:47.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.583+0000 7f915bff7640 1 -- 10.20.193.49:0/1398801865 >> 10.20.193.49:0/1398801865 conn(0x7f91540c9f40 msgr2=0x7f9154158b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:47.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.583+0000 7f915bff7640 1 -- 10.20.193.49:0/1398801865 shutdown_connections 2026-02-17T11:15:47.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.583+0000 7f915bff7640 1 -- 10.20.193.49:0/1398801865 wait complete. 2026-02-17T11:15:47.588 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.583+0000 7f915bff7640 1 librados: shutdown 2026-02-17T11:15:47.594 INFO:tasks.ceph:Scrubbing osd.6 2026-02-17T11:15:47.595 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2026-02-17T11:15:47.663 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.661+0000 7f4b155f7640 10 monclient: get_monmap_and_config 2026-02-17T11:15:47.663 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.661+0000 7f4b155f7640 10 monclient: build_initial_monmap 2026-02-17T11:15:47.663 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.661+0000 7f4b155f7640 10 monclient: monmap: 2026-02-17T11:15:47.663 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:47.664 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:47.664 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:15:47.663034+0000 2026-02-17T11:15:47.664 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:15:47.663034+0000 2026-02-17T11:15:47.664 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:47.664 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:47.664 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:15:47.664 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:15:47.664 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:15:47.664 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:15:47.664 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:15:47.664 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:15:47.664 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:47.664 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.662+0000 7f4b155f7640 1 Processor -- start 2026-02-17T11:15:47.664 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.662+0000 7f4b155f7640 1 -- start start 2026-02-17T11:15:47.664 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.662+0000 7f4b155f7640 10 monclient: init 2026-02-17T11:15:47.664 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.662+0000 7f4b155f7640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:47.665 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.662+0000 7f4b155f7640 10 monclient: _add_conns ranks=[0,5,4,2,1,3] 2026-02-17T11:15:47.665 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.662+0000 7f4b155f7640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f4b10155eb0 addr v1:10.20.193.49:6789/0 2026-02-17T11:15:47.665 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.662+0000 7f4b155f7640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f4b1015e420 0x7f4b100cba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:47.665 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.662+0000 7f4b155f7640 10 monclient(hunting): picked mon.noname-c con 0x7f4b1015e420 addr v2:10.20.193.157:3300/0 2026-02-17T11:15:47.665 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.662+0000 7f4b155f7640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f4b10073b50 0x7f4b100c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:47.665 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.662+0000 7f4b155f7640 10 monclient(hunting): picked mon.noname-b con 0x7f4b10073b50 addr v2:10.20.193.97:3300/0 2026-02-17T11:15:47.665 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.662+0000 7f4b155f7640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b100c9df0 con 0x7f4b10155eb0 2026-02-17T11:15:47.665 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.662+0000 7f4b155f7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:47.665 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.662+0000 7f4b155f7640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f4b1015d880 con 0x7f4b10073b50 2026-02-17T11:15:47.665 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.662+0000 7f4b155f7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:47.665 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.662+0000 7f4b155f7640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f4b100ca0d0 con 0x7f4b1015e420 2026-02-17T11:15:47.665 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.662+0000 7f4b155f7640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:47.665 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.662+0000 7f4b155f7640 10 monclient(hunting): authenticate will time out at 1424.326669s 2026-02-17T11:15:47.665 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.663+0000 7f4b0f7fe640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f4b10073b50 0x7f4b100c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:47.665 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.663+0000 7f4b0e7fc640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f4b1015e420 0x7f4b100cba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:47.665 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.663+0000 7f4b0effd640 1 --1- >> v1:10.20.193.49:6789/0 conn(0x7f4b10155eb0 0x7f4b1015dd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.49:6789/0 says I am v1:10.20.193.49:36376/0 (socket says 10.20.193.49:36376) 2026-02-17T11:15:47.665 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.663+0000 7f4b0effd640 1 -- 10.20.193.49:0/1798053540 learned_addr learned my addr 10.20.193.49:0/1798053540 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:15:47.665 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.663+0000 7f4b0e7fc640 10 monclient(hunting): get_auth_request con 0x7f4b1015e420 auth_method 0 2026-02-17T11:15:47.665 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.663+0000 7f4b0e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:47.665 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.663+0000 7f4b0e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:47.665 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.663+0000 7f4b0e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:47.665 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.663+0000 7f4b0f7fe640 10 monclient(hunting): get_auth_request con 0x7f4b10073b50 auth_method 0 2026-02-17T11:15:47.665 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.663+0000 7f4b0f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:47.665 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.663+0000 7f4b0f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:47.665 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.663+0000 7f4b0f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:47.666 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.663+0000 7f4b0f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:47.666 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.663+0000 7f4b0f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:47.666 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.663+0000 7f4b0f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:47.666 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.663+0000 7f4b0e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:47.666 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.663+0000 7f4b0e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:47.666 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.663+0000 7f4b0e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:47.666 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.664+0000 7f4b0f7fe640 10 monclient(hunting): handle_auth_done global_id 5245 payload 274 2026-02-17T11:15:47.666 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.664+0000 7f4b0f7fe640 1 -- 10.20.193.49:0/1798053540 >> v2:10.20.193.157:3300/0 conn(0x7f4b1015e420 msgr2=0x7f4b100cba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:15:47.666 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.664+0000 7f4b0f7fe640 1 --2- 10.20.193.49:0/1798053540 >> v2:10.20.193.157:3300/0 conn(0x7f4b1015e420 0x7f4b100cba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:47.666 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.664+0000 7f4b0f7fe640 1 -- 10.20.193.49:0/1798053540 >> v1:10.20.193.49:6789/0 conn(0x7f4b10155eb0 legacy=0x7f4b1015dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:47.666 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.664+0000 7f4b0f7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:15:47.667 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.664+0000 7f4b0f7fe640 1 monclient: found mon.noname-b 2026-02-17T11:15:47.667 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.664+0000 7f4b0f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:47.667 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.664+0000 7f4b0f7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:15:47.667 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.664+0000 7f4b0f7fe640 1 -- 10.20.193.49:0/1798053540 --> v2:10.20.193.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b100ca3b0 con 0x7f4b10073b50 2026-02-17T11:15:47.667 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.664+0000 7f4b0e7fc640 1 --2- 10.20.193.49:0/1798053540 >> v2:10.20.193.157:3300/0 conn(0x7f4b1015e420 0x7f4b100cba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:15:47.667 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.665+0000 7f4b0f7fe640 1 --2- 10.20.193.49:0/1798053540 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f4b10073b50 0x7f4b100c9740 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4b10069cd0 tx=0x7f4b0002f250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ce8c51b3826ce3a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:47.669 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.667+0000 7f4b0dffb640 1 -- 10.20.193.49:0/1798053540 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b0003c070 con 0x7f4b10073b50 2026-02-17T11:15:47.669 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.667+0000 7f4b0dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:47.669 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.667+0000 7f4b0dffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:15:47.669 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.667+0000 7f4b0dffb640 10 monclient: dump: 2026-02-17T11:15:47.670 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:47.670 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:47.670 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:47.670 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:47.670 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:47.670 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:47.670 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:47.670 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:47.670 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:47.670 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:47.670 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.667+0000 7f4b0dffb640 10 monclient: _finish_auth 0 2026-02-17T11:15:47.670 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.667+0000 7f4b0dffb640 10 monclient: _check_auth_tickets 2026-02-17T11:15:47.670 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.667+0000 7f4b0dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:47.670 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.667+0000 7f4b155f7640 5 monclient: authenticate success, global_id 5245 2026-02-17T11:15:47.670 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.667+0000 7f4b0dffb640 1 -- 10.20.193.49:0/1798053540 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b00037440 con 0x7f4b10073b50 2026-02-17T11:15:47.670 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.667+0000 7f4b155f7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:15:47.670 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.667+0000 7f4b0dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:47.670 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.667+0000 7f4b0dffb640 1 -- 10.20.193.49:0/1798053540 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b00037810 con 0x7f4b10073b50 2026-02-17T11:15:47.670 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.667+0000 7f4b155f7640 10 monclient: get_monmap_and_config success 2026-02-17T11:15:47.670 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.667+0000 7f4b155f7640 4 set_mon_vals no callback set 2026-02-17T11:15:47.670 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.667+0000 7f4b0dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:47.670 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.667+0000 7f4b0dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:15:47.670 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.667+0000 7f4b0dffb640 10 monclient: dump: 2026-02-17T11:15:47.670 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:47.670 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:47.670 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:47.670 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:47.670 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:47.670 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:47.670 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:47.670 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:47.670 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:47.670 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:47.671 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.667+0000 7f4b155f7640 10 monclient: shutdown 2026-02-17T11:15:47.671 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.667+0000 7f4b155f7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:47.671 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.667+0000 7f4b155f7640 1 -- 10.20.193.49:0/1798053540 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f4b10073b50 msgr2=0x7f4b100c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:47.671 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.667+0000 7f4b155f7640 1 --2- 10.20.193.49:0/1798053540 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f4b10073b50 0x7f4b100c9740 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4b10069cd0 tx=0x7f4b0002f250 comp rx=0 tx=0).stop 2026-02-17T11:15:47.671 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.668+0000 7f4b155f7640 1 -- 10.20.193.49:0/1798053540 shutdown_connections 2026-02-17T11:15:47.671 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.668+0000 7f4b155f7640 1 --2- 10.20.193.49:0/1798053540 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f4b10073b50 0x7f4b100c9740 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:47.671 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.668+0000 7f4b155f7640 1 --2- 10.20.193.49:0/1798053540 >> v2:10.20.193.157:3300/0 conn(0x7f4b1015e420 0x7f4b100cba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:47.671 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.668+0000 7f4b155f7640 1 -- 10.20.193.49:0/1798053540 >> 10.20.193.49:0/1798053540 conn(0x7f4b10073030 msgr2=0x7f4b10073440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:47.671 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.668+0000 7f4b155f7640 1 -- 10.20.193.49:0/1798053540 shutdown_connections 2026-02-17T11:15:47.671 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.668+0000 7f4b155f7640 1 -- 10.20.193.49:0/1798053540 wait complete. 2026-02-17T11:15:47.671 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.668+0000 7f4b155f7640 10 monclient: build_initial_monmap 2026-02-17T11:15:47.671 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.668+0000 7f4b155f7640 10 monclient: monmap: 2026-02-17T11:15:47.671 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:47.671 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:15:47.671 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:15:47.671 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:15:47.671 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:47.671 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:47.671 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:15:47.671 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:15:47.671 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:15:47.671 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:47.671 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.668+0000 7f4b155f7640 1 librados: starting msgr at 2026-02-17T11:15:47.671 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.668+0000 7f4b155f7640 1 librados: starting objecter 2026-02-17T11:15:47.671 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.668+0000 7f4b155f7640 1 Processor -- start 2026-02-17T11:15:47.671 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.668+0000 7f4b155f7640 1 -- start start 2026-02-17T11:15:47.671 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.668+0000 7f4b155f7640 1 librados: setting wanted keys 2026-02-17T11:15:47.672 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.668+0000 7f4b155f7640 1 librados: calling monclient init 2026-02-17T11:15:47.672 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.668+0000 7f4b155f7640 10 monclient: init 2026-02-17T11:15:47.672 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.669+0000 7f4b155f7640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:47.672 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.669+0000 7f4b155f7640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:15:47.672 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.669+0000 7f4b155f7640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f4b10073b50 0x7f4b101f3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:47.672 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.669+0000 7f4b155f7640 10 monclient(hunting): picked mon.noname-c con 0x7f4b10073b50 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:15:47.672 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.669+0000 7f4b155f7640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f4b10155eb0 0x7f4b101488c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:47.672 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.669+0000 7f4b155f7640 10 monclient(hunting): picked mon.noname-a con 0x7f4b10155eb0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:15:47.672 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.669+0000 7f4b155f7640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f4b1015e420 0x7f4b10148140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:47.672 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.669+0000 7f4b155f7640 10 monclient(hunting): picked mon.noname-b con 0x7f4b1015e420 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:15:47.673 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.669+0000 7f4b155f7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:47.673 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.669+0000 7f4b155f7640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f4b1015f470 con 0x7f4b10155eb0 2026-02-17T11:15:47.673 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.669+0000 7f4b155f7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:47.673 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.669+0000 7f4b155f7640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f4b10156290 con 0x7f4b1015e420 2026-02-17T11:15:47.673 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.669+0000 7f4b155f7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:47.673 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.669+0000 7f4b155f7640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f4b1015f5f0 con 0x7f4b10073b50 2026-02-17T11:15:47.673 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.669+0000 7f4b155f7640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:47.673 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.669+0000 7f4b155f7640 10 monclient(hunting): authenticate will time out at 1424.333407s 2026-02-17T11:15:47.673 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.669+0000 7f4b0e7fc640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f4b10155eb0 0x7f4b101488c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:47.673 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.669+0000 7f4b0f7fe640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f4b1015e420 0x7f4b10148140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:47.673 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.669+0000 7f4b0e7fc640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f4b10155eb0 0x7f4b101488c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:43196/0 (socket says 10.20.193.49:43196) 2026-02-17T11:15:47.673 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.669+0000 7f4b0f7fe640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f4b1015e420 0x7f4b10148140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:43456/0 (socket says 10.20.193.49:43456) 2026-02-17T11:15:47.673 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.669+0000 7f4b0e7fc640 1 -- 10.20.193.49:0/271405029 learned_addr learned my addr 10.20.193.49:0/271405029 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:47.673 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.669+0000 7f4b0e7fc640 10 monclient(hunting): get_auth_request con 0x7f4b10155eb0 auth_method 0 2026-02-17T11:15:47.673 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.669+0000 7f4b0effd640 1 --2- 10.20.193.49:0/271405029 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f4b10073b50 0x7f4b101f3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:47.673 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.669+0000 7f4b0e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:47.673 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.669+0000 7f4b0e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:47.673 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.669+0000 7f4b0e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:47.673 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.669+0000 7f4b0f7fe640 10 monclient(hunting): get_auth_request con 0x7f4b1015e420 auth_method 0 2026-02-17T11:15:47.673 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.669+0000 7f4b0f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:47.673 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.669+0000 7f4b0f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:47.673 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.669+0000 7f4b0f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:47.673 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.670+0000 7f4b0effd640 10 monclient(hunting): get_auth_request con 0x7f4b10073b50 auth_method 0 2026-02-17T11:15:47.673 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.670+0000 7f4b0effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:47.673 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.670+0000 7f4b0effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:47.673 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.670+0000 7f4b0effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:47.673 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.670+0000 7f4b0f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:47.673 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.670+0000 7f4b0f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:47.673 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.670+0000 7f4b0f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:47.673 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.670+0000 7f4b0e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:47.673 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.670+0000 7f4b0e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:47.673 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.670+0000 7f4b0e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:47.673 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.670+0000 7f4b0effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:47.673 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.670+0000 7f4b0effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:47.673 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.670+0000 7f4b0effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:47.674 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.671+0000 7f4b0f7fe640 10 monclient(hunting): handle_auth_done global_id 5248 payload 824 2026-02-17T11:15:47.674 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.671+0000 7f4b0f7fe640 1 -- 10.20.193.49:0/271405029 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f4b10073b50 msgr2=0x7f4b101f3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:47.674 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.671+0000 7f4b0f7fe640 1 --2- 10.20.193.49:0/271405029 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f4b10073b50 0x7f4b101f3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:47.674 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.671+0000 7f4b0f7fe640 1 -- 10.20.193.49:0/271405029 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f4b10155eb0 msgr2=0x7f4b101488c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:47.674 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.671+0000 7f4b0f7fe640 1 --2- 10.20.193.49:0/271405029 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f4b10155eb0 0x7f4b101488c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:47.674 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.671+0000 7f4b0f7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:15:47.674 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.671+0000 7f4b0f7fe640 1 monclient: found mon.noname-b 2026-02-17T11:15:47.674 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.671+0000 7f4b0f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:47.674 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.671+0000 7f4b0f7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:15:47.674 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.671+0000 7f4b0f7fe640 1 -- 10.20.193.49:0/271405029 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b10148680 con 0x7f4b1015e420 2026-02-17T11:15:47.674 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.672+0000 7f4b0f7fe640 1 --2- 10.20.193.49:0/271405029 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f4b1015e420 0x7f4b10148140 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4b1008e8c0 tx=0x7f4b00004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:47.674 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.672+0000 7f4aef7fe640 10 client.?.objecter ms_handle_connect 0x7f4b1015e420 2026-02-17T11:15:47.674 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.672+0000 7f4aef7fe640 10 client.?.objecter resend_mon_ops 2026-02-17T11:15:47.675 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.673+0000 7f4aef7fe640 1 -- 10.20.193.49:0/271405029 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b0003c050 con 0x7f4b1015e420 2026-02-17T11:15:47.675 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.673+0000 7f4aef7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:47.675 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.673+0000 7f4aef7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:15:47.675 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.673+0000 7f4aef7fe640 10 monclient: dump: 2026-02-17T11:15:47.675 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:47.675 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:47.675 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:47.675 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:47.675 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:47.675 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:47.675 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:47.676 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:47.676 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:47.676 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:47.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.673+0000 7f4aef7fe640 10 monclient: _finish_auth 0 2026-02-17T11:15:47.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.673+0000 7f4aef7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:15:47.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.673+0000 7f4aef7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:47.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.673+0000 7f4b155f7640 5 monclient: authenticate success, global_id 5248 2026-02-17T11:15:47.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.673+0000 7f4b155f7640 10 monclient: _renew_subs 2026-02-17T11:15:47.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.673+0000 7f4b155f7640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:15:47.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.673+0000 7f4b155f7640 1 -- 10.20.193.49:0/271405029 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b101f43e0 con 0x7f4b1015e420 2026-02-17T11:15:47.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.673+0000 7f4b155f7640 10 client.5248.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:47.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.673+0000 7f4b155f7640 10 monclient: _renew_subs 2026-02-17T11:15:47.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.673+0000 7f4b155f7640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:15:47.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.673+0000 7f4b155f7640 1 -- 10.20.193.49:0/271405029 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b101f49a0 con 0x7f4b1015e420 2026-02-17T11:15:47.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.673+0000 7f4b155f7640 1 librados: init done 2026-02-17T11:15:47.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.673+0000 7f4b155f7640 10 client.5248.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:47.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.673+0000 7f4b155f7640 15 client.5248.objecter _session_command_op_assign -1 1 2026-02-17T11:15:47.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.673+0000 7f4b155f7640 20 client.5248.objecter _get_session osd=-1 returning homeless 2026-02-17T11:15:47.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.673+0000 7f4b155f7640 10 client.5248.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:47.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.673+0000 7f4b155f7640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:15:47.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.673+0000 7f4b155f7640 1 -- 10.20.193.49:0/271405029 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4b10148e00 con 0x7f4b1015e420 2026-02-17T11:15:47.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.674+0000 7f4aef7fe640 1 -- 10.20.193.49:0/271405029 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b00048070 con 0x7f4b1015e420 2026-02-17T11:15:47.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.674+0000 7f4aef7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:47.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.674+0000 7f4aef7fe640 1 -- 10.20.193.49:0/271405029 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b00041a10 con 0x7f4b1015e420 2026-02-17T11:15:47.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.674+0000 7f4aef7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:47.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.674+0000 7f4aef7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:15:47.676 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.674+0000 7f4aef7fe640 10 monclient: dump: 2026-02-17T11:15:47.676 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:47.677 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:47.677 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:47.677 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:47.677 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:47.677 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:47.677 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:47.677 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:47.677 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:47.677 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:47.677 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.674+0000 7f4b0d7fa640 4 set_mon_vals no callback set 2026-02-17T11:15:47.688 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.686+0000 7f4aef7fe640 1 -- 10.20.193.49:0/271405029 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f4b00041bb0 con 0x7f4b1015e420 2026-02-17T11:15:47.689 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.687+0000 7f4aef7fe640 1 --2- 10.20.193.49:0/271405029 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f4adc079140 0x7f4adc07b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:47.689 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.687+0000 7f4b0effd640 1 --2- 10.20.193.49:0/271405029 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f4adc079140 0x7f4adc07b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:47.689 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.687+0000 7f4b0effd640 10 monclient: get_auth_request con 0x7f4adc079140 auth_method 0 2026-02-17T11:15:47.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.688+0000 7f4aef7fe640 10 client.5248.objecter ms_handle_connect 0x7f4adc079140 2026-02-17T11:15:47.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.688+0000 7f4b0effd640 1 --2- 10.20.193.49:0/271405029 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f4adc079140 0x7f4adc07b600 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4b04002770 tx=0x7f4b04009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:47.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.688+0000 7f4aef7fe640 1 -- 10.20.193.49:0/271405029 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f4b000bdf40 con 0x7f4b1015e420 2026-02-17T11:15:47.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.688+0000 7f4aef7fe640 10 client.5248.objecter ms_dispatch2 0x7f4b10000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:15:47.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.688+0000 7f4aef7fe640 3 client.5248.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:15:47.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.688+0000 7f4aef7fe640 3 client.5248.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:15:47.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.688+0000 7f4aef7fe640 10 client.5248.objecter checking command 1 2026-02-17T11:15:47.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.688+0000 7f4aef7fe640 1 --2- 10.20.193.49:0/271405029 >> [v2:10.20.193.157:6800/815989681,v1:10.20.193.157:6801/815989681] conn(0x7f4adc081680 0x7f4adc083aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:47.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.688+0000 7f4aef7fe640 20 client.5248.objecter _get_session s=0x7f4adc080fb0 osd=6 3 2026-02-17T11:15:47.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.688+0000 7f4aef7fe640 20 client.5248.objecter put_session s=0x7f4adc080fb0 osd=6 3 2026-02-17T11:15:47.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.688+0000 7f4aef7fe640 15 client.5248.objecter _session_command_op_remove -1 1 2026-02-17T11:15:47.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.688+0000 7f4aef7fe640 20 client.5248.objecter _get_session s=0x7f4adc080fb0 osd=6 3 2026-02-17T11:15:47.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.688+0000 7f4aef7fe640 20 client.5248.objecter get_session s=0x7f4adc080fb0 osd=6 3 2026-02-17T11:15:47.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.688+0000 7f4aef7fe640 15 client.5248.objecter _session_command_op_assign 6 1 2026-02-17T11:15:47.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.688+0000 7f4aef7fe640 20 client.5248.objecter put_session s=0x7f4adc080fb0 osd=6 4 2026-02-17T11:15:47.691 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.688+0000 7f4aef7fe640 10 client.5248.objecter _send_command 1 2026-02-17T11:15:47.691 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.688+0000 7f4aef7fe640 1 -- 10.20.193.49:0/271405029 --> [v2:10.20.193.157:6800/815989681,v1:10.20.193.157:6801/815989681] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4b000038c0 con 0x7f4adc081680 2026-02-17T11:15:47.691 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.688+0000 7f4aef7fe640 20 client.5248.objecter dump_active .. 0 homeless 2026-02-17T11:15:47.691 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.688+0000 7f4aef7fe640 1 -- 10.20.193.49:0/271405029 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f4b00084970 con 0x7f4b1015e420 2026-02-17T11:15:47.691 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.688+0000 7f4aef7fe640 10 monclient: handle_get_version_reply finishing 1 version 34 2026-02-17T11:15:47.691 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.689+0000 7f4b0e7fc640 1 --2- 10.20.193.49:0/271405029 >> [v2:10.20.193.157:6800/815989681,v1:10.20.193.157:6801/815989681] conn(0x7f4adc081680 0x7f4adc083aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:47.691 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.689+0000 7f4b0e7fc640 10 monclient: get_auth_request con 0x7f4adc081680 auth_method 0 2026-02-17T11:15:47.692 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.690+0000 7f4b0e7fc640 1 --2- 10.20.193.49:0/271405029 >> [v2:10.20.193.157:6800/815989681,v1:10.20.193.157:6801/815989681] conn(0x7f4adc081680 0x7f4adc083aa0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:47.692 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.690+0000 7f4aef7fe640 10 client.5248.objecter ms_handle_connect 0x7f4adc081680 2026-02-17T11:15:47.702 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.701+0000 7f4aef7fe640 1 -- 10.20.193.49:0/271405029 <== osd.6 v2:10.20.193.157:6800/815989681 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f4b000038c0 con 0x7f4adc081680 2026-02-17T11:15:47.702 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.701+0000 7f4aef7fe640 10 client.5248.objecter ms_dispatch2 0x7f4b10000b90 command_reply(tid 1: 0 ) 2026-02-17T11:15:47.702 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.701+0000 7f4aef7fe640 10 client.5248.objecter _finish_command 1 = system:0 2026-02-17T11:15:47.702 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.701+0000 7f4aef7fe640 20 client.5248.objecter put_session s=0x7f4adc080fb0 osd=6 4 2026-02-17T11:15:47.702 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.701+0000 7f4aef7fe640 15 client.5248.objecter _session_command_op_remove 6 1 2026-02-17T11:15:47.708 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.706+0000 7f4b155f7640 10 client.5248.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T11:15:47.708 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.706+0000 7f4b155f7640 15 client.5248.objecter _session_command_op_assign -1 2 2026-02-17T11:15:47.708 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.706+0000 7f4b155f7640 20 client.5248.objecter _get_session s=0x7f4adc080fb0 osd=6 3 2026-02-17T11:15:47.709 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.706+0000 7f4b155f7640 20 client.5248.objecter put_session s=0x7f4adc080fb0 osd=6 3 2026-02-17T11:15:47.709 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.706+0000 7f4b155f7640 20 client.5248.objecter _get_session s=0x7f4adc080fb0 osd=6 3 2026-02-17T11:15:47.709 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.706+0000 7f4b155f7640 15 client.5248.objecter _session_command_op_remove -1 2 2026-02-17T11:15:47.709 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.706+0000 7f4b155f7640 20 client.5248.objecter get_session s=0x7f4adc080fb0 osd=6 3 2026-02-17T11:15:47.709 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.706+0000 7f4b155f7640 15 client.5248.objecter _session_command_op_assign 6 2 2026-02-17T11:15:47.709 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.706+0000 7f4b155f7640 20 client.5248.objecter put_session s=0x7f4adc080fb0 osd=6 4 2026-02-17T11:15:47.709 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.706+0000 7f4b155f7640 10 client.5248.objecter _send_command 2 2026-02-17T11:15:47.709 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.706+0000 7f4b155f7640 1 -- 10.20.193.49:0/271405029 --> [v2:10.20.193.157:6800/815989681,v1:10.20.193.157:6801/815989681] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f4b10147370 con 0x7f4adc081680 2026-02-17T11:15:47.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.715+0000 7f4aef7fe640 1 -- 10.20.193.49:0/271405029 <== osd.6 v2:10.20.193.157:6800/815989681 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f4b10147370 con 0x7f4adc081680 2026-02-17T11:15:47.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.715+0000 7f4aef7fe640 10 client.5248.objecter ms_dispatch2 0x7f4b10000b90 command_reply(tid 2: 0 ) 2026-02-17T11:15:47.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.715+0000 7f4aef7fe640 10 client.5248.objecter _finish_command 2 = system:0 2026-02-17T11:15:47.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.715+0000 7f4aef7fe640 20 client.5248.objecter put_session s=0x7f4adc080fb0 osd=6 4 2026-02-17T11:15:47.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.715+0000 7f4aef7fe640 15 client.5248.objecter _session_command_op_remove 6 2 2026-02-17T11:15:47.716 INFO:teuthology.orchestra.run.trial049.stdout:{ 2026-02-17T11:15:47.716 INFO:teuthology.orchestra.run.trial049.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T11:15:47.716 INFO:teuthology.orchestra.run.trial049.stdout:} 2026-02-17T11:15:47.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.715+0000 7f4b155f7640 10 librados: watch_flush enter 2026-02-17T11:15:47.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.715+0000 7f4b155f7640 10 librados: watch_flush exit 2026-02-17T11:15:47.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.715+0000 7f4b155f7640 10 client.5248.objecter close_session for osd.6 2026-02-17T11:15:47.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.715+0000 7f4b155f7640 1 -- 10.20.193.49:0/271405029 >> [v2:10.20.193.157:6800/815989681,v1:10.20.193.157:6801/815989681] conn(0x7f4adc081680 msgr2=0x7f4adc083aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:47.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.715+0000 7f4b155f7640 1 --2- 10.20.193.49:0/271405029 >> [v2:10.20.193.157:6800/815989681,v1:10.20.193.157:6801/815989681] conn(0x7f4adc081680 0x7f4adc083aa0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:47.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.715+0000 7f4b155f7640 20 client.5248.objecter put_session s=0x7f4adc080fb0 osd=6 1 2026-02-17T11:15:47.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.715+0000 7f4b155f7640 20 client.5248.objecter shutdown clearing up homeless session... 2026-02-17T11:15:47.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.715+0000 7f4b155f7640 10 client.5248.objecter successfully canceled tick 2026-02-17T11:15:47.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.715+0000 7f4b155f7640 1 -- 10.20.193.49:0/271405029 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f4adc079140 msgr2=0x7f4adc07b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:47.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.715+0000 7f4b155f7640 1 --2- 10.20.193.49:0/271405029 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f4adc079140 0x7f4adc07b600 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4b04002770 tx=0x7f4b04009040 comp rx=0 tx=0).stop 2026-02-17T11:15:47.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.715+0000 7f4b155f7640 10 monclient: shutdown 2026-02-17T11:15:47.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.715+0000 7f4b155f7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:47.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.715+0000 7f4b155f7640 1 -- 10.20.193.49:0/271405029 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f4b1015e420 msgr2=0x7f4b10148140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:47.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.715+0000 7f4b155f7640 1 --2- 10.20.193.49:0/271405029 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f4b1015e420 0x7f4b10148140 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4b1008e8c0 tx=0x7f4b00004b40 comp rx=0 tx=0).stop 2026-02-17T11:15:47.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.715+0000 7f4b0f7fe640 1 -- 10.20.193.49:0/271405029 reap_dead start 2026-02-17T11:15:47.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.715+0000 7f4b155f7640 1 -- 10.20.193.49:0/271405029 shutdown_connections 2026-02-17T11:15:47.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.715+0000 7f4b155f7640 1 -- 10.20.193.49:0/271405029 >> 10.20.193.49:0/271405029 conn(0x7f4b10073030 msgr2=0x7f4b1015fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:47.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.715+0000 7f4b155f7640 1 -- 10.20.193.49:0/271405029 shutdown_connections 2026-02-17T11:15:47.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.715+0000 7f4b155f7640 1 -- 10.20.193.49:0/271405029 wait complete. 2026-02-17T11:15:47.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.715+0000 7f4b155f7640 1 librados: shutdown 2026-02-17T11:15:47.723 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2026-02-17T11:15:47.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.788+0000 7f492d390640 10 monclient: get_monmap_and_config 2026-02-17T11:15:47.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.788+0000 7f492d390640 10 monclient: build_initial_monmap 2026-02-17T11:15:47.791 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.788+0000 7f492d390640 10 monclient: monmap: 2026-02-17T11:15:47.791 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:47.791 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:47.791 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:15:47.790445+0000 2026-02-17T11:15:47.791 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:15:47.790445+0000 2026-02-17T11:15:47.791 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:47.791 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:47.791 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:15:47.791 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:15:47.791 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:15:47.791 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:15:47.791 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:15:47.791 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:15:47.791 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:47.792 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.789+0000 7f492d390640 1 Processor -- start 2026-02-17T11:15:47.792 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.789+0000 7f492d390640 1 -- start start 2026-02-17T11:15:47.792 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.789+0000 7f492d390640 10 monclient: init 2026-02-17T11:15:47.792 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.790+0000 7f492d390640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:47.792 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.790+0000 7f492d390640 10 monclient: _add_conns ranks=[2,0,5,1,4,3] 2026-02-17T11:15:47.792 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.790+0000 7f492d390640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f4928152060 addr v1:10.20.193.157:6789/0 2026-02-17T11:15:47.793 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.790+0000 7f492d390640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f4928152440 addr v1:10.20.193.49:6789/0 2026-02-17T11:15:47.793 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.790+0000 7f492d390640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f4928156940 0x7f4928158c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:47.793 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.790+0000 7f492d390640 10 monclient(hunting): picked mon.noname-c con 0x7f4928156940 addr v2:10.20.193.157:3300/0 2026-02-17T11:15:47.793 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.790+0000 7f492d390640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f492815a470 con 0x7f4928152440 2026-02-17T11:15:47.793 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.790+0000 7f492d390640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f492815a750 con 0x7f4928152060 2026-02-17T11:15:47.793 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.790+0000 7f492d390640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:47.793 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.790+0000 7f492d390640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f4928159180 con 0x7f4928156940 2026-02-17T11:15:47.793 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.790+0000 7f492d390640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:47.793 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.790+0000 7f492d390640 10 monclient(hunting): authenticate will time out at 1424.454378s 2026-02-17T11:15:47.793 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.790+0000 7f49267fc640 1 --1- >> v1:10.20.193.49:6789/0 conn(0x7f4928152440 0x7f49280c9330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.49:6789/0 says I am v1:10.20.193.49:36382/0 (socket says 10.20.193.49:36382) 2026-02-17T11:15:47.793 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.790+0000 7f49267fc640 1 -- 10.20.193.49:0/1764907084 learned_addr learned my addr 10.20.193.49:0/1764907084 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:15:47.793 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.791+0000 7f49277fe640 1 --2- 10.20.193.49:0/1764907084 >> v2:10.20.193.157:3300/0 conn(0x7f4928156940 0x7f4928158c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:47.793 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.791+0000 7f49277fe640 10 monclient(hunting): get_auth_request con 0x7f4928156940 auth_method 0 2026-02-17T11:15:47.793 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.791+0000 7f49277fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:47.793 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.791+0000 7f49277fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:47.794 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.791+0000 7f49277fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:47.794 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.792+0000 7f4925ffb640 1 -- 10.20.193.49:0/1764907084 <== mon.0 v1:10.20.193.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4206474914 0 0) 0x7f492815a470 con 0x7f4928152440 2026-02-17T11:15:47.794 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.792+0000 7f4925ffb640 10 monclient(hunting): _negotiate 2026-02-17T11:15:47.794 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.792+0000 7f4925ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:47.794 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.792+0000 7f4925ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:47.794 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.792+0000 7f4925ffb640 10 monclient(hunting): my global_id is 5271 2026-02-17T11:15:47.794 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.792+0000 7f4925ffb640 1 -- 10.20.193.49:0/1764907084 --> v1:10.20.193.49:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4914003540 con 0x7f4928152440 2026-02-17T11:15:47.794 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.792+0000 7f49277fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:47.794 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.792+0000 7f49277fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:47.794 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.792+0000 7f49277fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:47.795 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.793+0000 7f4925ffb640 1 -- 10.20.193.49:0/1764907084 <== mon.2 v1:10.20.193.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 421828451 0 0) 0x7f492815a750 con 0x7f4928152060 2026-02-17T11:15:47.795 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.793+0000 7f4925ffb640 10 monclient(hunting): _negotiate 2026-02-17T11:15:47.795 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.793+0000 7f4925ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:47.795 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.793+0000 7f4925ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:47.795 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.793+0000 7f4925ffb640 10 monclient(hunting): my global_id is 5312 2026-02-17T11:15:47.795 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.793+0000 7f4925ffb640 1 -- 10.20.193.49:0/1764907084 --> v1:10.20.193.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f492815a470 con 0x7f4928152060 2026-02-17T11:15:47.796 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.793+0000 7f49277fe640 10 monclient(hunting): handle_auth_done global_id 5309 payload 274 2026-02-17T11:15:47.796 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.793+0000 7f49277fe640 1 -- 10.20.193.49:0/1764907084 >> v1:10.20.193.157:6789/0 conn(0x7f4928152060 legacy=0x7f4928156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:47.796 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.793+0000 7f49277fe640 1 -- 10.20.193.49:0/1764907084 >> v1:10.20.193.49:6789/0 conn(0x7f4928152440 legacy=0x7f49280c9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:47.796 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.793+0000 7f49277fe640 10 monclient: _finish_hunting 0 2026-02-17T11:15:47.796 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.793+0000 7f49277fe640 1 monclient: found mon.noname-c 2026-02-17T11:15:47.796 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.793+0000 7f49277fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:47.796 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.793+0000 7f49277fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:15:47.796 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.793+0000 7f49277fe640 1 -- 10.20.193.49:0/1764907084 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f492815aa30 con 0x7f4928156940 2026-02-17T11:15:47.798 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.796+0000 7f49277fe640 1 --2- 10.20.193.49:0/1764907084 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f4928156940 0x7f4928158c40 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4918009d90 tx=0x7f491802f1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0a8b3e4e4d4f198 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:47.805 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.798+0000 7f4925ffb640 1 -- 10.20.193.49:0/1764907084 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f491803c070 con 0x7f4928156940 2026-02-17T11:15:47.806 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.798+0000 7f4925ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:47.806 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.798+0000 7f4925ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:15:47.806 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.798+0000 7f4925ffb640 10 monclient: dump: 2026-02-17T11:15:47.806 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:47.806 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:47.806 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:47.806 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:47.806 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:47.806 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:47.806 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:47.807 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:47.807 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:47.807 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:47.807 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.798+0000 7f4925ffb640 10 monclient: _finish_auth 0 2026-02-17T11:15:47.807 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.798+0000 7f4925ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:15:47.807 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.798+0000 7f4925ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:47.807 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.798+0000 7f4925ffb640 1 -- 10.20.193.49:0/1764907084 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4918037440 con 0x7f4928156940 2026-02-17T11:15:47.807 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.798+0000 7f4925ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:47.807 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.798+0000 7f492d390640 5 monclient: authenticate success, global_id 5309 2026-02-17T11:15:47.807 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.798+0000 7f492d390640 10 monclient: get_monmap_and_config success 2026-02-17T11:15:47.807 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.798+0000 7f492d390640 4 set_mon_vals no callback set 2026-02-17T11:15:47.807 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.798+0000 7f4925ffb640 1 -- 10.20.193.49:0/1764907084 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4918037810 con 0x7f4928156940 2026-02-17T11:15:47.808 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.798+0000 7f4925ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:47.808 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.798+0000 7f4925ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:15:47.808 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.798+0000 7f4925ffb640 10 monclient: dump: 2026-02-17T11:15:47.808 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:47.808 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:47.808 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:47.808 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:47.808 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:47.808 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:47.808 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:47.808 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:47.809 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:47.809 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:47.809 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.799+0000 7f492d390640 10 monclient: shutdown 2026-02-17T11:15:47.809 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.799+0000 7f492d390640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:47.809 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.799+0000 7f492d390640 1 -- 10.20.193.49:0/1764907084 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f4928156940 msgr2=0x7f4928158c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:47.809 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.799+0000 7f492d390640 1 --2- 10.20.193.49:0/1764907084 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f4928156940 0x7f4928158c40 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4918009d90 tx=0x7f491802f1e0 comp rx=0 tx=0).stop 2026-02-17T11:15:47.809 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.799+0000 7f492d390640 1 -- 10.20.193.49:0/1764907084 shutdown_connections 2026-02-17T11:15:47.809 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.799+0000 7f492d390640 1 --2- 10.20.193.49:0/1764907084 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f4928156940 0x7f4928158c40 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:47.809 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.799+0000 7f492d390640 1 -- 10.20.193.49:0/1764907084 >> 10.20.193.49:0/1764907084 conn(0x7f49280c9f20 msgr2=0x7f49280ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:47.809 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.799+0000 7f492d390640 1 -- 10.20.193.49:0/1764907084 shutdown_connections 2026-02-17T11:15:47.809 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.799+0000 7f492d390640 1 -- 10.20.193.49:0/1764907084 wait complete. 2026-02-17T11:15:47.810 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.800+0000 7f492d390640 10 monclient: build_initial_monmap 2026-02-17T11:15:47.810 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.800+0000 7f492d390640 10 monclient: monmap: 2026-02-17T11:15:47.810 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:47.810 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:15:47.810 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:15:47.810 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:15:47.810 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:47.810 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:47.810 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:15:47.810 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:15:47.810 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:15:47.810 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:47.811 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.800+0000 7f492d390640 1 librados: starting msgr at 2026-02-17T11:15:47.811 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.800+0000 7f492d390640 1 librados: starting objecter 2026-02-17T11:15:47.811 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.800+0000 7f492d390640 1 Processor -- start 2026-02-17T11:15:47.811 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.800+0000 7f492d390640 1 -- start start 2026-02-17T11:15:47.811 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.800+0000 7f492d390640 1 librados: setting wanted keys 2026-02-17T11:15:47.811 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.800+0000 7f492d390640 1 librados: calling monclient init 2026-02-17T11:15:47.811 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.800+0000 7f492d390640 10 monclient: init 2026-02-17T11:15:47.811 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.800+0000 7f492d390640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:47.811 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.800+0000 7f492d390640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:15:47.811 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.800+0000 7f492d390640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f4928152060 0x7f4928074640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:47.811 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.800+0000 7f492d390640 10 monclient(hunting): picked mon.noname-a con 0x7f4928152060 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:15:47.811 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.800+0000 7f492d390640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f4928152440 0x7f49281f2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:47.812 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.800+0000 7f492d390640 10 monclient(hunting): picked mon.noname-b con 0x7f4928152440 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:15:47.812 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.800+0000 7f492d390640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f4928156940 0x7f492814e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:47.812 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.800+0000 7f492d390640 10 monclient(hunting): picked mon.noname-c con 0x7f4928156940 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:15:47.812 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.800+0000 7f492d390640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:47.812 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.800+0000 7f492d390640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f492815b2d0 con 0x7f4928152060 2026-02-17T11:15:47.812 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.800+0000 7f492d390640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:47.812 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.800+0000 7f492d390640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f492815aff0 con 0x7f4928152440 2026-02-17T11:15:47.812 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.800+0000 7f492d390640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:47.812 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.800+0000 7f492d390640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f49280c9a40 con 0x7f4928156940 2026-02-17T11:15:47.812 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.800+0000 7f492d390640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:47.812 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.800+0000 7f492d390640 10 monclient(hunting): authenticate will time out at 1424.464762s 2026-02-17T11:15:47.812 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.801+0000 7f4926ffd640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f4928152060 0x7f4928074640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:47.812 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.801+0000 7f49277fe640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f4928156940 0x7f492814e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:47.813 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.801+0000 7f49267fc640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f4928152440 0x7f49281f2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:47.813 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.801+0000 7f4926ffd640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f4928152060 0x7f4928074640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:43206/0 (socket says 10.20.193.49:43206) 2026-02-17T11:15:47.813 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.801+0000 7f4926ffd640 1 -- 10.20.193.49:0/727794948 learned_addr learned my addr 10.20.193.49:0/727794948 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:47.813 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.801+0000 7f4926ffd640 10 monclient(hunting): get_auth_request con 0x7f4928152060 auth_method 0 2026-02-17T11:15:47.813 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.801+0000 7f4926ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:47.813 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.801+0000 7f4926ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:47.813 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.801+0000 7f4926ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:47.813 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.801+0000 7f49277fe640 10 monclient(hunting): get_auth_request con 0x7f4928156940 auth_method 0 2026-02-17T11:15:47.813 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.801+0000 7f49277fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:47.813 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.801+0000 7f49277fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:47.813 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.801+0000 7f49277fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:47.813 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.801+0000 7f49267fc640 10 monclient(hunting): get_auth_request con 0x7f4928152440 auth_method 0 2026-02-17T11:15:47.814 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.801+0000 7f49267fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:47.814 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.801+0000 7f49267fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:47.814 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.801+0000 7f49267fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:47.814 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.801+0000 7f4926ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:47.814 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.801+0000 7f4926ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:47.814 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.801+0000 7f4926ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:47.814 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.801+0000 7f49277fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:47.814 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.801+0000 7f49277fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:47.814 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.801+0000 7f49277fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:47.814 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.801+0000 7f49267fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:47.814 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.801+0000 7f49267fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:47.814 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.801+0000 7f49267fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:47.814 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.803+0000 7f4926ffd640 10 monclient(hunting): handle_auth_done global_id 5274 payload 824 2026-02-17T11:15:47.815 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.803+0000 7f4926ffd640 1 -- 10.20.193.49:0/727794948 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f4928156940 msgr2=0x7f492814e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:47.815 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.803+0000 7f4926ffd640 1 --2- 10.20.193.49:0/727794948 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f4928156940 0x7f492814e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:47.815 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.803+0000 7f4926ffd640 1 -- 10.20.193.49:0/727794948 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f4928152440 msgr2=0x7f49281f2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:47.815 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.803+0000 7f4926ffd640 1 --2- 10.20.193.49:0/727794948 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f4928152440 0x7f49281f2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:47.815 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.803+0000 7f4926ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:15:47.815 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.803+0000 7f4926ffd640 1 monclient: found mon.noname-a 2026-02-17T11:15:47.815 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.803+0000 7f4926ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:47.815 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.803+0000 7f4926ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:15:47.815 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.803+0000 7f4926ffd640 1 -- 10.20.193.49:0/727794948 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49281f2960 con 0x7f4928152060 2026-02-17T11:15:47.817 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.804+0000 7f4926ffd640 1 --2- 10.20.193.49:0/727794948 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f4928152060 0x7f4928074640 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f491c00c700 tx=0x7f491c00cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:47.817 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.804+0000 7f49077fe640 10 client.?.objecter ms_handle_connect 0x7f4928152060 2026-02-17T11:15:47.817 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.804+0000 7f49077fe640 10 client.?.objecter resend_mon_ops 2026-02-17T11:15:47.817 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.805+0000 7f49077fe640 1 -- 10.20.193.49:0/727794948 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f491c0052d0 con 0x7f4928152060 2026-02-17T11:15:47.817 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.805+0000 7f49077fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:47.817 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.805+0000 7f49077fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:15:47.817 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.805+0000 7f49077fe640 10 monclient: dump: 2026-02-17T11:15:47.817 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:47.818 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:47.818 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:47.818 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:47.818 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:47.818 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:47.818 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:47.818 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:47.818 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:47.818 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:47.818 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.805+0000 7f49077fe640 10 monclient: _finish_auth 0 2026-02-17T11:15:47.818 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.805+0000 7f49077fe640 10 monclient: _check_auth_tickets 2026-02-17T11:15:47.818 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.805+0000 7f49077fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:47.818 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.805+0000 7f49077fe640 1 -- 10.20.193.49:0/727794948 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f491c005490 con 0x7f4928152060 2026-02-17T11:15:47.819 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.805+0000 7f49077fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:47.819 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.805+0000 7f49077fe640 1 -- 10.20.193.49:0/727794948 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f491c0038d0 con 0x7f4928152060 2026-02-17T11:15:47.819 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.805+0000 7f49077fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:47.819 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.805+0000 7f49077fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:15:47.819 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.805+0000 7f49077fe640 10 monclient: dump: 2026-02-17T11:15:47.819 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:47.819 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:47.819 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:47.819 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:47.819 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:47.819 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:47.819 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:47.819 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:47.819 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:47.819 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:47.819 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.805+0000 7f49257fa640 4 set_mon_vals no callback set 2026-02-17T11:15:47.820 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.805+0000 7f492d390640 5 monclient: authenticate success, global_id 5274 2026-02-17T11:15:47.820 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.805+0000 7f492d390640 10 monclient: _renew_subs 2026-02-17T11:15:47.820 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.805+0000 7f492d390640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:47.820 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.805+0000 7f492d390640 1 -- 10.20.193.49:0/727794948 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49280732c0 con 0x7f4928152060 2026-02-17T11:15:47.820 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.805+0000 7f492d390640 10 client.5274.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:47.820 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.805+0000 7f492d390640 10 monclient: _renew_subs 2026-02-17T11:15:47.820 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.805+0000 7f492d390640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:47.820 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.805+0000 7f492d390640 1 -- 10.20.193.49:0/727794948 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4928073880 con 0x7f4928152060 2026-02-17T11:15:47.820 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.805+0000 7f492d390640 1 librados: init done 2026-02-17T11:15:47.820 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.806+0000 7f492d390640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:47.820 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.806+0000 7f492d390640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:47.820 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.806+0000 7f492d390640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:47.820 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.806+0000 7f492d390640 1 -- 10.20.193.49:0/727794948 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4928158c40 con 0x7f4928152060 2026-02-17T11:15:47.821 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.818+0000 7f49077fe640 1 -- 10.20.193.49:0/727794948 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f491c003a70 con 0x7f4928152060 2026-02-17T11:15:47.821 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.818+0000 7f49077fe640 1 --2- 10.20.193.49:0/727794948 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f48f4079140 0x7f48f407b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:47.822 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.819+0000 7f49267fc640 1 --2- 10.20.193.49:0/727794948 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f48f4079140 0x7f48f407b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:47.822 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.819+0000 7f49267fc640 10 monclient: get_auth_request con 0x7f48f4079140 auth_method 0 2026-02-17T11:15:47.822 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.819+0000 7f49077fe640 10 client.5274.objecter ms_handle_connect 0x7f48f4079140 2026-02-17T11:15:47.822 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.819+0000 7f49267fc640 1 --2- 10.20.193.49:0/727794948 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f48f4079140 0x7f48f407b600 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4910002410 tx=0x7f49100075a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:47.823 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.820+0000 7f49077fe640 1 -- 10.20.193.49:0/727794948 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f491c05e360 con 0x7f4928152060 2026-02-17T11:15:47.823 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.820+0000 7f49077fe640 10 client.5274.objecter ms_dispatch2 0x7f4928000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:15:47.823 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.820+0000 7f49077fe640 3 client.5274.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:15:47.823 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.820+0000 7f49077fe640 3 client.5274.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:15:47.823 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.820+0000 7f49077fe640 20 client.5274.objecter dump_active .. 0 homeless 2026-02-17T11:15:47.920 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.918+0000 7f49077fe640 1 -- 10.20.193.49:0/727794948 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f491c062320 con 0x7f4928152060 2026-02-17T11:15:47.921 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.918+0000 7f49077fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:47.921 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:47.918+0000 7f49077fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:15:48.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.001+0000 7f492d390640 1 -- 10.20.193.49:0/727794948 --> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f49280caa10 con 0x7f48f4079140 2026-02-17T11:15:48.004 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.001+0000 7f49077fe640 1 -- 10.20.193.49:0/727794948 <== mgr.4106 v2:10.20.193.162:6800/2614632098 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f49280caa10 con 0x7f48f4079140 2026-02-17T11:15:48.004 INFO:teuthology.orchestra.run.trial049.stderr:instructed osd(s) 6 to deep-scrub 2026-02-17T11:15:48.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.002+0000 7f492d390640 10 librados: watch_flush enter 2026-02-17T11:15:48.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.002+0000 7f492d390640 10 librados: watch_flush exit 2026-02-17T11:15:48.005 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.002+0000 7f492d390640 20 client.5274.objecter shutdown clearing up homeless session... 2026-02-17T11:15:48.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.002+0000 7f492d390640 10 client.5274.objecter successfully canceled tick 2026-02-17T11:15:48.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.002+0000 7f492d390640 1 -- 10.20.193.49:0/727794948 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f48f4079140 msgr2=0x7f48f407b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:48.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.002+0000 7f492d390640 1 --2- 10.20.193.49:0/727794948 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f48f4079140 0x7f48f407b600 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4910002410 tx=0x7f49100075a0 comp rx=0 tx=0).stop 2026-02-17T11:15:48.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.002+0000 7f492d390640 10 monclient: shutdown 2026-02-17T11:15:48.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.002+0000 7f492d390640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:48.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.002+0000 7f492d390640 1 -- 10.20.193.49:0/727794948 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f4928152060 msgr2=0x7f4928074640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:48.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.002+0000 7f492d390640 1 --2- 10.20.193.49:0/727794948 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f4928152060 0x7f4928074640 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f491c00c700 tx=0x7f491c00cbd0 comp rx=0 tx=0).stop 2026-02-17T11:15:48.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.002+0000 7f492d390640 1 -- 10.20.193.49:0/727794948 shutdown_connections 2026-02-17T11:15:48.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.002+0000 7f492d390640 1 --2- 10.20.193.49:0/727794948 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f48f4079140 0x7f48f407b600 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:48.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.002+0000 7f492d390640 1 --2- 10.20.193.49:0/727794948 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f4928156940 0x7f492814e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:48.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.002+0000 7f492d390640 1 --2- 10.20.193.49:0/727794948 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f4928152440 0x7f49281f2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:48.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.002+0000 7f492d390640 1 --2- 10.20.193.49:0/727794948 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f4928152060 0x7f4928074640 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:48.006 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.002+0000 7f492d390640 1 -- 10.20.193.49:0/727794948 >> 10.20.193.49:0/727794948 conn(0x7f49280c9f20 msgr2=0x7f492814f880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:48.007 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.002+0000 7f492d390640 1 -- 10.20.193.49:0/727794948 shutdown_connections 2026-02-17T11:15:48.007 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.002+0000 7f492d390640 1 -- 10.20.193.49:0/727794948 wait complete. 2026-02-17T11:15:48.007 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.002+0000 7f492d390640 1 librados: shutdown 2026-02-17T11:15:48.013 INFO:tasks.ceph:Scrubbing osd.10 2026-02-17T11:15:48.013 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 config set osd_debug_deep_scrub_sleep 0 2026-02-17T11:15:48.099 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.080+0000 7f93fdd31640 10 monclient: get_monmap_and_config 2026-02-17T11:15:48.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.080+0000 7f93fdd31640 10 monclient: build_initial_monmap 2026-02-17T11:15:48.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.080+0000 7f93fdd31640 10 monclient: monmap: 2026-02-17T11:15:48.100 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:48.100 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:48.101 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:15:48.081932+0000 2026-02-17T11:15:48.101 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:15:48.081932+0000 2026-02-17T11:15:48.101 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:48.101 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:48.101 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:15:48.101 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:15:48.101 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:15:48.102 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:15:48.102 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:15:48.102 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:15:48.102 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:48.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.080+0000 7f93fdd31640 1 Processor -- start 2026-02-17T11:15:48.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.080+0000 7f93fdd31640 1 -- start start 2026-02-17T11:15:48.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.080+0000 7f93fdd31640 10 monclient: init 2026-02-17T11:15:48.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.081+0000 7f93fdd31640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:48.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.081+0000 7f93fdd31640 10 monclient: _add_conns ranks=[5,3,2,0,1,4] 2026-02-17T11:15:48.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.081+0000 7f93fdd31640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f93f80c6db0 0x7f93f80c7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:48.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.081+0000 7f93fdd31640 10 monclient(hunting): picked mon.noname-c con 0x7f93f80c6db0 addr v2:10.20.193.157:3300/0 2026-02-17T11:15:48.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.081+0000 7f93fdd31640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f93f80c4550 0x7f93f80745e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:48.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.081+0000 7f93fdd31640 10 monclient(hunting): picked mon.noname-a con 0x7f93f80c4550 addr v2:10.20.193.49:3300/0 2026-02-17T11:15:48.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.081+0000 7f93fdd31640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f93f8074b20 addr v1:10.20.193.157:6789/0 2026-02-17T11:15:48.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.081+0000 7f93fdd31640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93f80c4b90 con 0x7f93f8074b20 2026-02-17T11:15:48.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.081+0000 7f93fdd31640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:48.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.081+0000 7f93fdd31640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f93f80c4e70 con 0x7f93f80c4550 2026-02-17T11:15:48.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.081+0000 7f93fdd31640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:48.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.081+0000 7f93fdd31640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f93f80c5150 con 0x7f93f80c6db0 2026-02-17T11:15:48.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.081+0000 7f93fdd31640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:48.104 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.081+0000 7f93fdd31640 10 monclient(hunting): authenticate will time out at 1424.745726s 2026-02-17T11:15:48.104 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.082+0000 7f93effff640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f93f80c4550 0x7f93f80745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:48.104 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.082+0000 7f93fcd2f640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f93f80c6db0 0x7f93f80c7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:48.104 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.082+0000 7f93effff640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f93f80c4550 0x7f93f80745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:43222/0 (socket says 10.20.193.49:43222) 2026-02-17T11:15:48.104 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.082+0000 7f93effff640 1 -- 10.20.193.49:0/3294380383 learned_addr learned my addr 10.20.193.49:0/3294380383 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:48.104 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.082+0000 7f93effff640 10 monclient(hunting): get_auth_request con 0x7f93f80c4550 auth_method 0 2026-02-17T11:15:48.104 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.082+0000 7f93effff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:48.104 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.082+0000 7f93effff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:48.104 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.082+0000 7f93effff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:48.104 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.082+0000 7f93fcd2f640 10 monclient(hunting): get_auth_request con 0x7f93f80c6db0 auth_method 0 2026-02-17T11:15:48.104 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.082+0000 7f93fcd2f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:48.104 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.082+0000 7f93fcd2f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:48.105 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.082+0000 7f93fcd2f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:48.105 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.082+0000 7f93effff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:48.105 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.082+0000 7f93effff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:48.105 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.082+0000 7f93effff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:48.105 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.082+0000 7f93fcd2f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:48.105 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.082+0000 7f93fcd2f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:48.105 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.083+0000 7f93fcd2f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:48.105 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.083+0000 7f93effff640 10 monclient(hunting): handle_auth_done global_id 5277 payload 274 2026-02-17T11:15:48.105 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.083+0000 7f93effff640 1 -- 10.20.193.49:0/3294380383 >> v2:10.20.193.157:3300/0 conn(0x7f93f80c6db0 msgr2=0x7f93f80c7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:15:48.105 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.083+0000 7f93effff640 1 --2- 10.20.193.49:0/3294380383 >> v2:10.20.193.157:3300/0 conn(0x7f93f80c6db0 0x7f93f80c7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:48.105 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.083+0000 7f93effff640 1 -- 10.20.193.49:0/3294380383 >> v1:10.20.193.157:6789/0 conn(0x7f93f8074b20 legacy=0x7f93f80c85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:48.105 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.083+0000 7f93effff640 10 monclient: _finish_hunting 0 2026-02-17T11:15:48.105 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.083+0000 7f93effff640 1 monclient: found mon.noname-a 2026-02-17T11:15:48.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.083+0000 7f93effff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:48.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.083+0000 7f93effff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:15:48.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.083+0000 7f93effff640 1 -- 10.20.193.49:0/3294380383 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93f80c5430 con 0x7f93f80c4550 2026-02-17T11:15:48.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.084+0000 7f93effff640 1 --2- 10.20.193.49:0/3294380383 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f93f80c4550 0x7f93f80745e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f93f80caa20 tx=0x7f93e002ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ee049dd12a3cefb server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:48.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.085+0000 7f93ef7fe640 1 -- 10.20.193.49:0/3294380383 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e003c070 con 0x7f93f80c4550 2026-02-17T11:15:48.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.085+0000 7f93ef7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:48.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.085+0000 7f93ef7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:15:48.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.085+0000 7f93ef7fe640 10 monclient: dump: 2026-02-17T11:15:48.106 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:48.106 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:48.106 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:48.106 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:48.107 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:48.107 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:48.107 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:48.107 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:48.107 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:48.107 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:48.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.085+0000 7f93ef7fe640 10 monclient: _finish_auth 0 2026-02-17T11:15:48.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.085+0000 7f93ef7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:15:48.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.085+0000 7f93ef7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:48.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.085+0000 7f93fdd31640 5 monclient: authenticate success, global_id 5277 2026-02-17T11:15:48.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.085+0000 7f93fdd31640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:15:48.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.086+0000 7f93ef7fe640 1 -- 10.20.193.49:0/3294380383 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93e002fb30 con 0x7f93f80c4550 2026-02-17T11:15:48.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.086+0000 7f93ef7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:48.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.086+0000 7f93fdd31640 10 monclient: get_monmap_and_config success 2026-02-17T11:15:48.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.086+0000 7f93ef7fe640 1 -- 10.20.193.49:0/3294380383 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e0037440 con 0x7f93f80c4550 2026-02-17T11:15:48.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.086+0000 7f93ef7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:48.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.086+0000 7f93fdd31640 4 set_mon_vals no callback set 2026-02-17T11:15:48.109 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.086+0000 7f93ef7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:15:48.109 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.086+0000 7f93ef7fe640 10 monclient: dump: 2026-02-17T11:15:48.109 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:48.109 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:48.109 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:48.109 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:48.109 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:48.109 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:48.109 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:48.109 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:48.109 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:48.109 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:48.109 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.087+0000 7f93fdd31640 10 monclient: shutdown 2026-02-17T11:15:48.110 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.087+0000 7f93fdd31640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:48.110 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.087+0000 7f93fdd31640 1 -- 10.20.193.49:0/3294380383 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f93f80c4550 msgr2=0x7f93f80745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:48.110 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.087+0000 7f93fdd31640 1 --2- 10.20.193.49:0/3294380383 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f93f80c4550 0x7f93f80745e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f93f80caa20 tx=0x7f93e002ee60 comp rx=0 tx=0).stop 2026-02-17T11:15:48.110 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.087+0000 7f93fdd31640 1 -- 10.20.193.49:0/3294380383 shutdown_connections 2026-02-17T11:15:48.110 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.087+0000 7f93fdd31640 1 --2- 10.20.193.49:0/3294380383 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f93f80c4550 0x7f93f80745e0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:48.110 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.087+0000 7f93fdd31640 1 --2- 10.20.193.49:0/3294380383 >> v2:10.20.193.157:3300/0 conn(0x7f93f80c6db0 0x7f93f80c7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:48.110 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.087+0000 7f93fdd31640 1 -- 10.20.193.49:0/3294380383 >> 10.20.193.49:0/3294380383 conn(0x7f93f80c9bd0 msgr2=0x7f93f80c9fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:48.110 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.087+0000 7f93fdd31640 1 -- 10.20.193.49:0/3294380383 shutdown_connections 2026-02-17T11:15:48.110 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.087+0000 7f93fdd31640 1 -- 10.20.193.49:0/3294380383 wait complete. 2026-02-17T11:15:48.110 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.087+0000 7f93fdd31640 10 monclient: build_initial_monmap 2026-02-17T11:15:48.110 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.087+0000 7f93fdd31640 10 monclient: monmap: 2026-02-17T11:15:48.111 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:48.111 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:15:48.111 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:15:48.111 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:15:48.111 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:48.111 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:48.111 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:15:48.111 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:15:48.111 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:15:48.111 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:48.111 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.087+0000 7f93fdd31640 1 librados: starting msgr at 2026-02-17T11:15:48.111 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.087+0000 7f93fdd31640 1 librados: starting objecter 2026-02-17T11:15:48.111 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.087+0000 7f93fdd31640 1 Processor -- start 2026-02-17T11:15:48.112 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.087+0000 7f93fdd31640 1 -- start start 2026-02-17T11:15:48.112 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.087+0000 7f93fdd31640 1 librados: setting wanted keys 2026-02-17T11:15:48.112 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.087+0000 7f93fdd31640 1 librados: calling monclient init 2026-02-17T11:15:48.112 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.087+0000 7f93fdd31640 10 monclient: init 2026-02-17T11:15:48.112 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.088+0000 7f93fdd31640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:48.112 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.088+0000 7f93fdd31640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:15:48.112 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.088+0000 7f93fdd31640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f93f8074b20 0x7f93f81e5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:48.112 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.088+0000 7f93fdd31640 10 monclient(hunting): picked mon.noname-a con 0x7f93f8074b20 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:15:48.112 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.088+0000 7f93fdd31640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f93f80c4550 0x7f93f813cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:48.112 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.088+0000 7f93fdd31640 10 monclient(hunting): picked mon.noname-b con 0x7f93f80c4550 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:15:48.112 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.088+0000 7f93fdd31640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f93f80c6db0 0x7f93f8151480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:48.112 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.088+0000 7f93fdd31640 10 monclient(hunting): picked mon.noname-c con 0x7f93f80c6db0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:15:48.112 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.088+0000 7f93fdd31640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:48.113 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.088+0000 7f93fdd31640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f93f80c8090 con 0x7f93f8074b20 2026-02-17T11:15:48.113 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.088+0000 7f93fdd31640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:48.113 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.088+0000 7f93fdd31640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f93f80c7db0 con 0x7f93f80c4550 2026-02-17T11:15:48.113 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.088+0000 7f93fdd31640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:48.113 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.088+0000 7f93fdd31640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f93f815a690 con 0x7f93f80c6db0 2026-02-17T11:15:48.113 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.088+0000 7f93fdd31640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:48.113 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.088+0000 7f93fdd31640 10 monclient(hunting): authenticate will time out at 1424.752468s 2026-02-17T11:15:48.113 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.088+0000 7f93fcd2f640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f93f8074b20 0x7f93f81e5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:48.113 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.088+0000 7f93fcd2f640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f93f8074b20 0x7f93f81e5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:43228/0 (socket says 10.20.193.49:43228) 2026-02-17T11:15:48.113 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.088+0000 7f93fcd2f640 1 -- 10.20.193.49:0/994061589 learned_addr learned my addr 10.20.193.49:0/994061589 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:48.113 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.088+0000 7f93effff640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f93f80c4550 0x7f93f813cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:48.113 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.088+0000 7f93fcd2f640 10 monclient(hunting): get_auth_request con 0x7f93f8074b20 auth_method 0 2026-02-17T11:15:48.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.088+0000 7f93fcd2f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:48.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.088+0000 7f93fcd2f640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:48.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.088+0000 7f93fcd2f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:48.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.088+0000 7f93fd530640 1 --2- 10.20.193.49:0/994061589 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f93f80c6db0 0x7f93f8151480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:48.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.089+0000 7f93effff640 10 monclient(hunting): get_auth_request con 0x7f93f80c4550 auth_method 0 2026-02-17T11:15:48.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.089+0000 7f93effff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:48.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.089+0000 7f93effff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:48.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.089+0000 7f93effff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:48.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.089+0000 7f93fd530640 10 monclient(hunting): get_auth_request con 0x7f93f80c6db0 auth_method 0 2026-02-17T11:15:48.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.089+0000 7f93fd530640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:48.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.089+0000 7f93fd530640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:48.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.089+0000 7f93fd530640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:48.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.089+0000 7f93fcd2f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:48.115 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.089+0000 7f93fcd2f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:48.115 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.089+0000 7f93fcd2f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:48.115 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.089+0000 7f93effff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:48.115 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.089+0000 7f93effff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:48.115 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.089+0000 7f93effff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:48.115 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.089+0000 7f93fd530640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:48.115 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.089+0000 7f93fd530640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:48.115 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.089+0000 7f93fd530640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:48.115 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.090+0000 7f93fcd2f640 10 monclient(hunting): handle_auth_done global_id 5280 payload 824 2026-02-17T11:15:48.115 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.090+0000 7f93fcd2f640 1 -- 10.20.193.49:0/994061589 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f93f80c6db0 msgr2=0x7f93f8151480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:48.115 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.090+0000 7f93fcd2f640 1 --2- 10.20.193.49:0/994061589 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f93f80c6db0 0x7f93f8151480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:48.116 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.090+0000 7f93fcd2f640 1 -- 10.20.193.49:0/994061589 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f93f80c4550 msgr2=0x7f93f813cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:48.116 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.090+0000 7f93fcd2f640 1 --2- 10.20.193.49:0/994061589 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f93f80c4550 0x7f93f813cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:48.116 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.090+0000 7f93fcd2f640 10 monclient: _finish_hunting 0 2026-02-17T11:15:48.116 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.090+0000 7f93fcd2f640 1 monclient: found mon.noname-a 2026-02-17T11:15:48.116 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.090+0000 7f93fcd2f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:48.116 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.090+0000 7f93fcd2f640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:15:48.116 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.090+0000 7f93fcd2f640 1 -- 10.20.193.49:0/994061589 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93f8151d20 con 0x7f93f8074b20 2026-02-17T11:15:48.116 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.091+0000 7f93fcd2f640 1 --2- 10.20.193.49:0/994061589 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f93f8074b20 0x7f93f81e5040 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f93e800ec10 tx=0x7f93e800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:48.116 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.091+0000 7f93ed7fa640 10 client.?.objecter ms_handle_connect 0x7f93f8074b20 2026-02-17T11:15:48.116 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.091+0000 7f93ed7fa640 10 client.?.objecter resend_mon_ops 2026-02-17T11:15:48.116 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.092+0000 7f93ed7fa640 1 -- 10.20.193.49:0/994061589 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e8017070 con 0x7f93f8074b20 2026-02-17T11:15:48.116 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.092+0000 7f93ed7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:48.116 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.092+0000 7f93ed7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:15:48.116 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.092+0000 7f93ed7fa640 10 monclient: dump: 2026-02-17T11:15:48.117 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:48.117 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:48.117 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:48.117 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:48.117 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:48.117 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:48.117 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:48.117 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:48.117 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:48.117 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:48.117 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.092+0000 7f93ed7fa640 10 monclient: _finish_auth 0 2026-02-17T11:15:48.117 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.092+0000 7f93ed7fa640 10 monclient: _check_auth_tickets 2026-02-17T11:15:48.117 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.092+0000 7f93ed7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:48.117 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.092+0000 7f93fdd31640 5 monclient: authenticate success, global_id 5280 2026-02-17T11:15:48.118 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.092+0000 7f93fdd31640 10 monclient: _renew_subs 2026-02-17T11:15:48.118 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.092+0000 7f93fdd31640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:48.118 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.092+0000 7f93fdd31640 1 -- 10.20.193.49:0/994061589 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93f8152000 con 0x7f93f8074b20 2026-02-17T11:15:48.118 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.092+0000 7f93fdd31640 10 client.5280.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:48.118 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.092+0000 7f93fdd31640 10 monclient: _renew_subs 2026-02-17T11:15:48.118 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.092+0000 7f93fdd31640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:48.118 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.092+0000 7f93fdd31640 1 -- 10.20.193.49:0/994061589 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93f81525c0 con 0x7f93f8074b20 2026-02-17T11:15:48.118 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.092+0000 7f93fdd31640 1 librados: init done 2026-02-17T11:15:48.118 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.093+0000 7f93fdd31640 10 client.5280.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:48.118 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.093+0000 7f93fdd31640 15 client.5280.objecter _session_command_op_assign -1 1 2026-02-17T11:15:48.118 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.093+0000 7f93fdd31640 20 client.5280.objecter _get_session osd=-1 returning homeless 2026-02-17T11:15:48.118 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.093+0000 7f93fdd31640 10 client.5280.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:48.118 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.093+0000 7f93fdd31640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:48.118 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.093+0000 7f93fdd31640 1 -- 10.20.193.49:0/994061589 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f93f8152c10 con 0x7f93f8074b20 2026-02-17T11:15:48.119 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.093+0000 7f93ed7fa640 1 -- 10.20.193.49:0/994061589 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93f8152c10 con 0x7f93f8074b20 2026-02-17T11:15:48.119 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.093+0000 7f93ed7fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:48.119 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.093+0000 7f93ed7fa640 1 -- 10.20.193.49:0/994061589 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e8021060 con 0x7f93f8074b20 2026-02-17T11:15:48.119 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.093+0000 7f93ed7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:48.119 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.093+0000 7f93eeffd640 4 set_mon_vals no callback set 2026-02-17T11:15:48.119 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.093+0000 7f93ed7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:15:48.119 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.093+0000 7f93ed7fa640 10 monclient: dump: 2026-02-17T11:15:48.119 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:48.119 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:48.119 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:48.119 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:48.119 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:48.119 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:48.119 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:48.119 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:48.120 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:48.120 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:48.121 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.105+0000 7f93ed7fa640 1 -- 10.20.193.49:0/994061589 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f93e8013470 con 0x7f93f8074b20 2026-02-17T11:15:48.122 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.106+0000 7f93ed7fa640 1 --2- 10.20.193.49:0/994061589 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f93c8079170 0x7f93c807b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:48.122 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.106+0000 7f93effff640 1 --2- 10.20.193.49:0/994061589 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f93c8079170 0x7f93c807b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:48.122 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.106+0000 7f93effff640 10 monclient: get_auth_request con 0x7f93c8079170 auth_method 0 2026-02-17T11:15:48.122 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.107+0000 7f93ed7fa640 10 client.5280.objecter ms_handle_connect 0x7f93c8079170 2026-02-17T11:15:48.122 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.107+0000 7f93effff640 1 --2- 10.20.193.49:0/994061589 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f93c8079170 0x7f93c807b630 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f93f80c6860 tx=0x7f93e0039040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:48.122 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.107+0000 7f93ed7fa640 1 -- 10.20.193.49:0/994061589 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f93e800ce40 con 0x7f93f8074b20 2026-02-17T11:15:48.122 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.107+0000 7f93ed7fa640 10 client.5280.objecter ms_dispatch2 0x7f93f8000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:15:48.122 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.107+0000 7f93ed7fa640 3 client.5280.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:15:48.122 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.107+0000 7f93ed7fa640 3 client.5280.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:15:48.122 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.107+0000 7f93ed7fa640 10 client.5280.objecter checking command 1 2026-02-17T11:15:48.122 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.107+0000 7f93ed7fa640 1 --2- 10.20.193.49:0/994061589 >> [v2:10.20.193.157:6808/3711386099,v1:10.20.193.157:6809/3711386099] conn(0x7f93c80816b0 0x7f93c8083ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:48.122 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.107+0000 7f93ed7fa640 20 client.5280.objecter _get_session s=0x7f93c8080fe0 osd=10 3 2026-02-17T11:15:48.122 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.107+0000 7f93ed7fa640 20 client.5280.objecter put_session s=0x7f93c8080fe0 osd=10 3 2026-02-17T11:15:48.122 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.107+0000 7f93ed7fa640 15 client.5280.objecter _session_command_op_remove -1 1 2026-02-17T11:15:48.122 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.107+0000 7f93ed7fa640 20 client.5280.objecter _get_session s=0x7f93c8080fe0 osd=10 3 2026-02-17T11:15:48.123 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.107+0000 7f93ed7fa640 20 client.5280.objecter get_session s=0x7f93c8080fe0 osd=10 3 2026-02-17T11:15:48.123 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.107+0000 7f93ed7fa640 15 client.5280.objecter _session_command_op_assign 10 1 2026-02-17T11:15:48.123 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.107+0000 7f93ed7fa640 20 client.5280.objecter put_session s=0x7f93c8080fe0 osd=10 4 2026-02-17T11:15:48.123 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.107+0000 7f93ed7fa640 10 client.5280.objecter _send_command 1 2026-02-17T11:15:48.123 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.107+0000 7f93ed7fa640 1 -- 10.20.193.49:0/994061589 --> [v2:10.20.193.157:6808/3711386099,v1:10.20.193.157:6809/3711386099] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f93e8016ec0 con 0x7f93c80816b0 2026-02-17T11:15:48.123 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.107+0000 7f93ed7fa640 20 client.5280.objecter dump_active .. 0 homeless 2026-02-17T11:15:48.123 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.107+0000 7f93ed7fa640 1 -- 10.20.193.49:0/994061589 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f93e805eae0 con 0x7f93f8074b20 2026-02-17T11:15:48.123 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.107+0000 7f93ed7fa640 10 monclient: handle_get_version_reply finishing 1 version 34 2026-02-17T11:15:48.123 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.108+0000 7f93fd530640 1 --2- 10.20.193.49:0/994061589 >> [v2:10.20.193.157:6808/3711386099,v1:10.20.193.157:6809/3711386099] conn(0x7f93c80816b0 0x7f93c8083ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:48.123 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.108+0000 7f93fd530640 10 monclient: get_auth_request con 0x7f93c80816b0 auth_method 0 2026-02-17T11:15:48.123 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.110+0000 7f93fd530640 1 --2- 10.20.193.49:0/994061589 >> [v2:10.20.193.157:6808/3711386099,v1:10.20.193.157:6809/3711386099] conn(0x7f93c80816b0 0x7f93c8083ad0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:48.123 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.110+0000 7f93ed7fa640 10 client.5280.objecter ms_handle_connect 0x7f93c80816b0 2026-02-17T11:15:48.124 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.121+0000 7f93ed7fa640 1 -- 10.20.193.49:0/994061589 <== osd.10 v2:10.20.193.157:6808/3711386099 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f93e8016ec0 con 0x7f93c80816b0 2026-02-17T11:15:48.124 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.121+0000 7f93ed7fa640 10 client.5280.objecter ms_dispatch2 0x7f93f8000b90 command_reply(tid 1: 0 ) 2026-02-17T11:15:48.124 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.121+0000 7f93ed7fa640 10 client.5280.objecter _finish_command 1 = system:0 2026-02-17T11:15:48.124 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.121+0000 7f93ed7fa640 20 client.5280.objecter put_session s=0x7f93c8080fe0 osd=10 4 2026-02-17T11:15:48.124 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.121+0000 7f93ed7fa640 15 client.5280.objecter _session_command_op_remove 10 1 2026-02-17T11:15:48.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.127+0000 7f93fdd31640 10 client.5280.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T11:15:48.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.127+0000 7f93fdd31640 15 client.5280.objecter _session_command_op_assign -1 2 2026-02-17T11:15:48.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.127+0000 7f93fdd31640 20 client.5280.objecter _get_session s=0x7f93c8080fe0 osd=10 3 2026-02-17T11:15:48.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.127+0000 7f93fdd31640 20 client.5280.objecter put_session s=0x7f93c8080fe0 osd=10 3 2026-02-17T11:15:48.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.127+0000 7f93fdd31640 20 client.5280.objecter _get_session s=0x7f93c8080fe0 osd=10 3 2026-02-17T11:15:48.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.127+0000 7f93fdd31640 15 client.5280.objecter _session_command_op_remove -1 2 2026-02-17T11:15:48.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.127+0000 7f93fdd31640 20 client.5280.objecter get_session s=0x7f93c8080fe0 osd=10 3 2026-02-17T11:15:48.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.127+0000 7f93fdd31640 15 client.5280.objecter _session_command_op_assign 10 2 2026-02-17T11:15:48.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.127+0000 7f93fdd31640 20 client.5280.objecter put_session s=0x7f93c8080fe0 osd=10 4 2026-02-17T11:15:48.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.127+0000 7f93fdd31640 10 client.5280.objecter _send_command 2 2026-02-17T11:15:48.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.127+0000 7f93fdd31640 1 -- 10.20.193.49:0/994061589 --> [v2:10.20.193.157:6808/3711386099,v1:10.20.193.157:6809/3711386099] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f93f813d2c0 con 0x7f93c80816b0 2026-02-17T11:15:48.138 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.137+0000 7f93ed7fa640 1 -- 10.20.193.49:0/994061589 <== osd.10 v2:10.20.193.157:6808/3711386099 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f93f40056e0 con 0x7f93c80816b0 2026-02-17T11:15:48.138 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.137+0000 7f93ed7fa640 10 client.5280.objecter ms_dispatch2 0x7f93f8000b90 command_reply(tid 2: 0 ) 2026-02-17T11:15:48.138 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.137+0000 7f93ed7fa640 10 client.5280.objecter _finish_command 2 = system:0 2026-02-17T11:15:48.138 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.137+0000 7f93ed7fa640 20 client.5280.objecter put_session s=0x7f93c8080fe0 osd=10 4 2026-02-17T11:15:48.138 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.137+0000 7f93ed7fa640 15 client.5280.objecter _session_command_op_remove 10 2 2026-02-17T11:15:48.139 INFO:teuthology.orchestra.run.trial049.stdout:{ 2026-02-17T11:15:48.139 INFO:teuthology.orchestra.run.trial049.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T11:15:48.139 INFO:teuthology.orchestra.run.trial049.stdout:} 2026-02-17T11:15:48.140 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.137+0000 7f93fdd31640 10 librados: watch_flush enter 2026-02-17T11:15:48.140 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.137+0000 7f93fdd31640 10 librados: watch_flush exit 2026-02-17T11:15:48.140 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.137+0000 7f93fdd31640 10 client.5280.objecter close_session for osd.10 2026-02-17T11:15:48.141 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.137+0000 7f93fdd31640 1 -- 10.20.193.49:0/994061589 >> [v2:10.20.193.157:6808/3711386099,v1:10.20.193.157:6809/3711386099] conn(0x7f93c80816b0 msgr2=0x7f93c8083ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:48.141 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.137+0000 7f93fdd31640 1 --2- 10.20.193.49:0/994061589 >> [v2:10.20.193.157:6808/3711386099,v1:10.20.193.157:6809/3711386099] conn(0x7f93c80816b0 0x7f93c8083ad0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:48.141 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.137+0000 7f93fdd31640 20 client.5280.objecter put_session s=0x7f93c8080fe0 osd=10 1 2026-02-17T11:15:48.141 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.137+0000 7f93fdd31640 20 client.5280.objecter shutdown clearing up homeless session... 2026-02-17T11:15:48.141 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.137+0000 7f93fdd31640 10 client.5280.objecter successfully canceled tick 2026-02-17T11:15:48.141 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.137+0000 7f93fdd31640 1 -- 10.20.193.49:0/994061589 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f93c8079170 msgr2=0x7f93c807b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:48.141 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.137+0000 7f93fdd31640 1 --2- 10.20.193.49:0/994061589 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f93c8079170 0x7f93c807b630 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f93f80c6860 tx=0x7f93e0039040 comp rx=0 tx=0).stop 2026-02-17T11:15:48.141 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.137+0000 7f93fdd31640 10 monclient: shutdown 2026-02-17T11:15:48.141 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.137+0000 7f93fdd31640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:48.141 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.137+0000 7f93fdd31640 1 -- 10.20.193.49:0/994061589 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f93f8074b20 msgr2=0x7f93f81e5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:48.141 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.137+0000 7f93fdd31640 1 --2- 10.20.193.49:0/994061589 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f93f8074b20 0x7f93f81e5040 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f93e800ec10 tx=0x7f93e800c520 comp rx=0 tx=0).stop 2026-02-17T11:15:48.141 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.137+0000 7f93fd530640 1 -- 10.20.193.49:0/994061589 reap_dead start 2026-02-17T11:15:48.141 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.137+0000 7f93fdd31640 1 -- 10.20.193.49:0/994061589 shutdown_connections 2026-02-17T11:15:48.142 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.137+0000 7f93fdd31640 1 -- 10.20.193.49:0/994061589 >> 10.20.193.49:0/994061589 conn(0x7f93f80c9bd0 msgr2=0x7f93f80c8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:48.142 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.137+0000 7f93fdd31640 1 -- 10.20.193.49:0/994061589 shutdown_connections 2026-02-17T11:15:48.142 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.137+0000 7f93fdd31640 1 -- 10.20.193.49:0/994061589 wait complete. 2026-02-17T11:15:48.142 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.137+0000 7f93fdd31640 1 librados: shutdown 2026-02-17T11:15:48.147 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 10 2026-02-17T11:15:48.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.211+0000 7f3330c15640 10 monclient: get_monmap_and_config 2026-02-17T11:15:48.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.211+0000 7f3330c15640 10 monclient: build_initial_monmap 2026-02-17T11:15:48.214 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.211+0000 7f3330c15640 10 monclient: monmap: 2026-02-17T11:15:48.214 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:48.214 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:48.215 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:15:48.213056+0000 2026-02-17T11:15:48.215 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:15:48.213056+0000 2026-02-17T11:15:48.215 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:48.215 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:48.215 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:15:48.215 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:15:48.215 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:15:48.215 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:15:48.215 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:15:48.215 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:15:48.215 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:48.215 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.212+0000 7f3330c15640 1 Processor -- start 2026-02-17T11:15:48.216 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.212+0000 7f3330c15640 1 -- start start 2026-02-17T11:15:48.216 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.212+0000 7f3330c15640 10 monclient: init 2026-02-17T11:15:48.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.212+0000 7f3330c15640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:48.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.212+0000 7f3330c15640 10 monclient: _add_conns ranks=[3,2,0,1,4,5] 2026-02-17T11:15:48.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.212+0000 7f3330c15640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f332c0c7170 0x7f332c0c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:48.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.212+0000 7f3330c15640 10 monclient(hunting): picked mon.noname-a con 0x7f332c0c7170 addr v2:10.20.193.49:3300/0 2026-02-17T11:15:48.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.212+0000 7f3330c15640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f332c0c48c0 addr v1:10.20.193.157:6789/0 2026-02-17T11:15:48.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.212+0000 7f3330c15640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f332c0c4d10 addr v1:10.20.193.49:6789/0 2026-02-17T11:15:48.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.212+0000 7f3330c15640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f332c15a9a0 con 0x7f332c0c4d10 2026-02-17T11:15:48.218 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.212+0000 7f3330c15640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f332c0c5270 con 0x7f332c0c48c0 2026-02-17T11:15:48.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.212+0000 7f3330c15640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:48.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.212+0000 7f3330c15640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f332c0c8530 con 0x7f332c0c7170 2026-02-17T11:15:48.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.212+0000 7f3330c15640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:48.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.212+0000 7f3330c15640 10 monclient(hunting): authenticate will time out at 1424.876614s 2026-02-17T11:15:48.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.213+0000 7f332a575640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f332c0c7170 0x7f332c0c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:48.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.213+0000 7f3329d74640 1 --1- >> v1:10.20.193.157:6789/0 conn(0x7f332c0c48c0 0x7f332c0749b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.157:6789/0 says I am v1:10.20.193.49:44798/0 (socket says 10.20.193.49:44798) 2026-02-17T11:15:48.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.213+0000 7f3329d74640 1 -- 10.20.193.49:0/2735968802 learned_addr learned my addr 10.20.193.49:0/2735968802 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:15:48.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.213+0000 7f332a575640 10 monclient(hunting): get_auth_request con 0x7f332c0c7170 auth_method 0 2026-02-17T11:15:48.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.213+0000 7f332a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:48.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.213+0000 7f332a575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:48.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.213+0000 7f332a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:48.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.213+0000 7f332a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:48.219 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.213+0000 7f332a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:48.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.213+0000 7f332a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:48.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.214+0000 7f3329573640 1 -- 10.20.193.49:0/2735968802 <== mon.2 v1:10.20.193.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2913378923 0 0) 0x7f332c0c5270 con 0x7f332c0c48c0 2026-02-17T11:15:48.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.214+0000 7f3329573640 10 monclient(hunting): _negotiate 2026-02-17T11:15:48.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.214+0000 7f3329573640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:48.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.214+0000 7f3329573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:48.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.214+0000 7f3329573640 10 monclient(hunting): my global_id is 5327 2026-02-17T11:15:48.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.214+0000 7f3329573640 1 -- 10.20.193.49:0/2735968802 --> v1:10.20.193.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3318003620 con 0x7f332c0c48c0 2026-02-17T11:15:48.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.214+0000 7f332a575640 10 monclient(hunting): handle_auth_done global_id 5283 payload 274 2026-02-17T11:15:48.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.214+0000 7f332a575640 1 -- 10.20.193.49:0/2735968802 >> v1:10.20.193.157:6789/0 conn(0x7f332c0c48c0 legacy=0x7f332c0749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:48.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.214+0000 7f332a575640 1 -- 10.20.193.49:0/2735968802 >> v1:10.20.193.49:6789/0 conn(0x7f332c0c4d10 legacy=0x7f332c0c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:48.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.214+0000 7f332a575640 10 monclient: _finish_hunting 0 2026-02-17T11:15:48.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.214+0000 7f332a575640 1 monclient: found mon.noname-a 2026-02-17T11:15:48.220 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.215+0000 7f332a575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:48.221 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.215+0000 7f332a575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:15:48.221 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.215+0000 7f332a575640 1 -- 10.20.193.49:0/2735968802 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f332c0c5550 con 0x7f332c0c7170 2026-02-17T11:15:48.226 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.216+0000 7f332a575640 1 --2- 10.20.193.49:0/2735968802 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f332c0c7170 0x7f332c0c7550 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f33200098a0 tx=0x7f332002ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ef05c2610a3cf06 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:48.226 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.217+0000 7f3329573640 1 -- 10.20.193.49:0/2735968802 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332003c070 con 0x7f332c0c7170 2026-02-17T11:15:48.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.217+0000 7f3329573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:48.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.217+0000 7f3329573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:15:48.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.217+0000 7f3329573640 10 monclient: dump: 2026-02-17T11:15:48.227 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:48.227 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:48.227 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:48.227 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:48.227 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:48.227 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:48.227 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:48.228 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:48.228 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:48.228 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:48.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.217+0000 7f3329573640 10 monclient: _finish_auth 0 2026-02-17T11:15:48.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.217+0000 7f3329573640 10 monclient: _check_auth_tickets 2026-02-17T11:15:48.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.217+0000 7f3329573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:48.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.217+0000 7f3330c15640 5 monclient: authenticate success, global_id 5283 2026-02-17T11:15:48.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.217+0000 7f3330c15640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:15:48.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.218+0000 7f3329573640 1 -- 10.20.193.49:0/2735968802 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f332002fb70 con 0x7f332c0c7170 2026-02-17T11:15:48.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.218+0000 7f3329573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:48.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.218+0000 7f3329573640 1 -- 10.20.193.49:0/2735968802 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3320037440 con 0x7f332c0c7170 2026-02-17T11:15:48.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.218+0000 7f3330c15640 10 monclient: get_monmap_and_config success 2026-02-17T11:15:48.229 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.218+0000 7f3330c15640 4 set_mon_vals no callback set 2026-02-17T11:15:48.229 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.218+0000 7f3329573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:48.229 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.218+0000 7f3329573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:15:48.229 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.218+0000 7f3329573640 10 monclient: dump: 2026-02-17T11:15:48.229 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:48.229 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:48.229 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:48.229 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:48.229 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:48.229 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:48.229 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:48.229 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:48.230 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:48.230 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:48.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.218+0000 7f3330c15640 10 monclient: shutdown 2026-02-17T11:15:48.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.218+0000 7f3330c15640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:48.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.218+0000 7f3330c15640 1 -- 10.20.193.49:0/2735968802 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f332c0c7170 msgr2=0x7f332c0c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:48.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.218+0000 7f3330c15640 1 --2- 10.20.193.49:0/2735968802 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f332c0c7170 0x7f332c0c7550 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f33200098a0 tx=0x7f332002ee60 comp rx=0 tx=0).stop 2026-02-17T11:15:48.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.218+0000 7f3330c15640 1 -- 10.20.193.49:0/2735968802 shutdown_connections 2026-02-17T11:15:48.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.218+0000 7f3330c15640 1 --2- 10.20.193.49:0/2735968802 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f332c0c7170 0x7f332c0c7550 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:48.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.218+0000 7f3330c15640 1 -- 10.20.193.49:0/2735968802 >> 10.20.193.49:0/2735968802 conn(0x7f332c0c9f40 msgr2=0x7f332c0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:48.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.218+0000 7f3330c15640 1 -- 10.20.193.49:0/2735968802 shutdown_connections 2026-02-17T11:15:48.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.218+0000 7f3330c15640 1 -- 10.20.193.49:0/2735968802 wait complete. 2026-02-17T11:15:48.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.219+0000 7f3330c15640 10 monclient: build_initial_monmap 2026-02-17T11:15:48.230 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.219+0000 7f3330c15640 10 monclient: monmap: 2026-02-17T11:15:48.231 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:48.231 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:15:48.231 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:15:48.231 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:15:48.231 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:48.231 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:48.231 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:15:48.231 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:15:48.231 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:15:48.231 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:48.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.219+0000 7f3330c15640 1 librados: starting msgr at 2026-02-17T11:15:48.231 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.219+0000 7f3330c15640 1 librados: starting objecter 2026-02-17T11:15:48.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.219+0000 7f3330c15640 1 Processor -- start 2026-02-17T11:15:48.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.219+0000 7f3330c15640 1 -- start start 2026-02-17T11:15:48.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.219+0000 7f3330c15640 1 librados: setting wanted keys 2026-02-17T11:15:48.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.219+0000 7f3330c15640 1 librados: calling monclient init 2026-02-17T11:15:48.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.219+0000 7f3330c15640 10 monclient: init 2026-02-17T11:15:48.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.219+0000 7f3330c15640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:48.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.219+0000 7f3330c15640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:15:48.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.219+0000 7f3330c15640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f332c0c48c0 0x7f332c1f4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:48.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.219+0000 7f3330c15640 10 monclient(hunting): picked mon.noname-b con 0x7f332c0c48c0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:15:48.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.219+0000 7f3330c15640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f332c0c4d10 0x7f332c14d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:48.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.219+0000 7f3330c15640 10 monclient(hunting): picked mon.noname-c con 0x7f332c0c4d10 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:15:48.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.219+0000 7f3330c15640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f332c0c7170 0x7f332c14bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:48.232 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.219+0000 7f3330c15640 10 monclient(hunting): picked mon.noname-a con 0x7f332c0c7170 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:15:48.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.219+0000 7f3330c15640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:48.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.219+0000 7f3330c15640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f332c0c81c0 con 0x7f332c0c7170 2026-02-17T11:15:48.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.219+0000 7f3330c15640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:48.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.219+0000 7f3330c15640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f332c0c7ee0 con 0x7f332c0c48c0 2026-02-17T11:15:48.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.219+0000 7f3330c15640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:48.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.219+0000 7f3330c15640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f332c0750c0 con 0x7f332c0c4d10 2026-02-17T11:15:48.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.219+0000 7f3330c15640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:48.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.219+0000 7f3330c15640 10 monclient(hunting): authenticate will time out at 1424.883791s 2026-02-17T11:15:48.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.220+0000 7f332ad76640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f332c0c7170 0x7f332c14bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:48.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.220+0000 7f3329d74640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f332c0c4d10 0x7f332c14d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:48.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.220+0000 7f332a575640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f332c0c48c0 0x7f332c1f4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:48.233 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.220+0000 7f332ad76640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f332c0c7170 0x7f332c14bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:43242/0 (socket says 10.20.193.49:43242) 2026-02-17T11:15:48.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.220+0000 7f332ad76640 1 -- 10.20.193.49:0/1801976145 learned_addr learned my addr 10.20.193.49:0/1801976145 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:48.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.220+0000 7f332ad76640 10 monclient(hunting): get_auth_request con 0x7f332c0c7170 auth_method 0 2026-02-17T11:15:48.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.220+0000 7f332ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:48.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.220+0000 7f332ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:48.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.220+0000 7f332ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:48.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.220+0000 7f3329d74640 10 monclient(hunting): get_auth_request con 0x7f332c0c4d10 auth_method 0 2026-02-17T11:15:48.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.220+0000 7f3329d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:48.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.220+0000 7f3329d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:48.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.220+0000 7f3329d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:48.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.220+0000 7f332a575640 10 monclient(hunting): get_auth_request con 0x7f332c0c48c0 auth_method 0 2026-02-17T11:15:48.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.220+0000 7f332a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:48.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.220+0000 7f332a575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:48.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.220+0000 7f332a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:48.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.220+0000 7f332ad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:48.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.220+0000 7f332ad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:48.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.220+0000 7f332ad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:48.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.220+0000 7f3329d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:48.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.220+0000 7f3329d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:48.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.220+0000 7f3329d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:48.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.220+0000 7f332a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:48.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.220+0000 7f332a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:48.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.220+0000 7f332a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:48.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.221+0000 7f332ad76640 10 monclient(hunting): handle_auth_done global_id 5286 payload 824 2026-02-17T11:15:48.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.221+0000 7f332ad76640 1 -- 10.20.193.49:0/1801976145 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f332c0c4d10 msgr2=0x7f332c14d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:48.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.221+0000 7f332ad76640 1 --2- 10.20.193.49:0/1801976145 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f332c0c4d10 0x7f332c14d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:48.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.221+0000 7f332ad76640 1 -- 10.20.193.49:0/1801976145 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f332c0c48c0 msgr2=0x7f332c1f4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:48.236 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.221+0000 7f332ad76640 1 --2- 10.20.193.49:0/1801976145 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f332c0c48c0 0x7f332c1f4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:48.236 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.221+0000 7f332ad76640 10 monclient: _finish_hunting 0 2026-02-17T11:15:48.236 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.221+0000 7f332ad76640 1 monclient: found mon.noname-a 2026-02-17T11:15:48.236 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.221+0000 7f332ad76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:48.236 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.221+0000 7f332ad76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:15:48.236 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.221+0000 7f332ad76640 1 -- 10.20.193.49:0/1801976145 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f332c155e20 con 0x7f332c0c7170 2026-02-17T11:15:48.236 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.222+0000 7f332ad76640 1 --2- 10.20.193.49:0/1801976145 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f332c0c7170 0x7f332c14bcb0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f331c00cbc0 tx=0x7f331c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:48.236 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.222+0000 7f3312ffd640 10 client.?.objecter ms_handle_connect 0x7f332c0c7170 2026-02-17T11:15:48.236 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.222+0000 7f3312ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:15:48.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.224+0000 7f3312ffd640 1 -- 10.20.193.49:0/1801976145 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f331c00ad50 con 0x7f332c0c7170 2026-02-17T11:15:48.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.224+0000 7f3312ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:48.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.224+0000 7f3312ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:15:48.239 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.224+0000 7f3312ffd640 10 monclient: dump: 2026-02-17T11:15:48.239 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:48.239 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:48.239 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:48.239 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:48.239 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:48.239 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:48.240 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:48.240 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:48.240 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:48.240 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:48.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.224+0000 7f3312ffd640 10 monclient: _finish_auth 0 2026-02-17T11:15:48.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.224+0000 7f3312ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:15:48.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.224+0000 7f3312ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:48.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.224+0000 7f3312ffd640 1 -- 10.20.193.49:0/1801976145 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f331c003a20 con 0x7f332c0c7170 2026-02-17T11:15:48.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.224+0000 7f3330c15640 5 monclient: authenticate success, global_id 5286 2026-02-17T11:15:48.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.224+0000 7f3312ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:48.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.224+0000 7f3312ffd640 1 -- 10.20.193.49:0/1801976145 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f331c003e30 con 0x7f332c0c7170 2026-02-17T11:15:48.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.224+0000 7f3330c15640 10 monclient: _renew_subs 2026-02-17T11:15:48.240 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.224+0000 7f3328d72640 4 set_mon_vals no callback set 2026-02-17T11:15:48.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.224+0000 7f3330c15640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:48.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.224+0000 7f3330c15640 1 -- 10.20.193.49:0/1801976145 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f332c156100 con 0x7f332c0c7170 2026-02-17T11:15:48.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.224+0000 7f3312ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:48.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.224+0000 7f3312ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:15:48.241 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.224+0000 7f3312ffd640 10 monclient: dump: 2026-02-17T11:15:48.241 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:48.241 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:48.241 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:48.241 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:48.241 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:48.241 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:48.241 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:48.242 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:48.242 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:48.242 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:48.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.224+0000 7f3330c15640 10 client.5286.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:48.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.224+0000 7f3330c15640 10 monclient: _renew_subs 2026-02-17T11:15:48.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.224+0000 7f3330c15640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:48.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.224+0000 7f3330c15640 1 -- 10.20.193.49:0/1801976145 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f332c1566c0 con 0x7f332c0c7170 2026-02-17T11:15:48.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.224+0000 7f3330c15640 1 librados: init done 2026-02-17T11:15:48.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.225+0000 7f3330c15640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:48.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.225+0000 7f3330c15640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:48.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.225+0000 7f3330c15640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:48.242 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.225+0000 7f3330c15640 1 -- 10.20.193.49:0/1801976145 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f332c0c7550 con 0x7f332c0c7170 2026-02-17T11:15:48.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.237+0000 7f3312ffd640 1 -- 10.20.193.49:0/1801976145 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f331c0052e0 con 0x7f332c0c7170 2026-02-17T11:15:48.243 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.237+0000 7f3312ffd640 1 --2- 10.20.193.49:0/1801976145 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f32f8079190 0x7f32f807b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:48.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.237+0000 7f332a575640 1 --2- 10.20.193.49:0/1801976145 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f32f8079190 0x7f32f807b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:48.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.238+0000 7f332a575640 10 monclient: get_auth_request con 0x7f32f8079190 auth_method 0 2026-02-17T11:15:48.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.238+0000 7f332a575640 1 --2- 10.20.193.49:0/1801976145 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f32f8079190 0x7f32f807b650 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3320039000 tx=0x7f3320033000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:48.244 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.238+0000 7f3312ffd640 10 client.5286.objecter ms_handle_connect 0x7f32f8079190 2026-02-17T11:15:48.340 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.339+0000 7f3312ffd640 1 -- 10.20.193.49:0/1801976145 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f331c05ea80 con 0x7f332c0c7170 2026-02-17T11:15:48.341 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.339+0000 7f3312ffd640 10 client.5286.objecter ms_dispatch2 0x7f332c000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:15:48.341 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.339+0000 7f3312ffd640 3 client.5286.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:15:48.341 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.339+0000 7f3312ffd640 3 client.5286.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:15:48.341 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.339+0000 7f3312ffd640 20 client.5286.objecter dump_active .. 0 homeless 2026-02-17T11:15:48.341 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.339+0000 7f3312ffd640 1 -- 10.20.193.49:0/1801976145 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f331c062a40 con 0x7f332c0c7170 2026-02-17T11:15:48.341 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.339+0000 7f3312ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:48.341 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.339+0000 7f3312ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:15:48.425 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.424+0000 7f3330c15640 1 -- 10.20.193.49:0/1801976145 --> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "10", "target": ["mon-mgr", ""]}) -- 0x7f332c14e7a0 con 0x7f32f8079190 2026-02-17T11:15:48.425 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.424+0000 7f3312ffd640 1 -- 10.20.193.49:0/1801976145 <== mgr.4106 v2:10.20.193.162:6800/2614632098 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 10 to deep-scrub) ==== 42+0+0 (secure 0 0 0) 0x7f332c14e7a0 con 0x7f32f8079190 2026-02-17T11:15:48.425 INFO:teuthology.orchestra.run.trial049.stderr:instructed osd(s) 10 to deep-scrub 2026-02-17T11:15:48.426 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.424+0000 7f3330c15640 10 librados: watch_flush enter 2026-02-17T11:15:48.426 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.424+0000 7f3330c15640 10 librados: watch_flush exit 2026-02-17T11:15:48.426 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.424+0000 7f3330c15640 20 client.5286.objecter shutdown clearing up homeless session... 2026-02-17T11:15:48.426 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.424+0000 7f3330c15640 10 client.5286.objecter successfully canceled tick 2026-02-17T11:15:48.426 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.424+0000 7f3330c15640 1 -- 10.20.193.49:0/1801976145 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f32f8079190 msgr2=0x7f32f807b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:48.427 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.424+0000 7f3330c15640 1 --2- 10.20.193.49:0/1801976145 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f32f8079190 0x7f32f807b650 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3320039000 tx=0x7f3320033000 comp rx=0 tx=0).stop 2026-02-17T11:15:48.427 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.424+0000 7f3330c15640 10 monclient: shutdown 2026-02-17T11:15:48.427 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.424+0000 7f3330c15640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:48.427 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.424+0000 7f3330c15640 1 -- 10.20.193.49:0/1801976145 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f332c0c7170 msgr2=0x7f332c14bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:48.427 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.424+0000 7f3330c15640 1 --2- 10.20.193.49:0/1801976145 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f332c0c7170 0x7f332c14bcb0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f331c00cbc0 tx=0x7f331c00a430 comp rx=0 tx=0).stop 2026-02-17T11:15:48.427 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.424+0000 7f3330c15640 1 -- 10.20.193.49:0/1801976145 shutdown_connections 2026-02-17T11:15:48.427 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.424+0000 7f3330c15640 1 --2- 10.20.193.49:0/1801976145 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f32f8079190 0x7f32f807b650 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:48.427 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.424+0000 7f3330c15640 1 --2- 10.20.193.49:0/1801976145 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f332c0c7170 0x7f332c14bcb0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:48.427 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.424+0000 7f3330c15640 1 --2- 10.20.193.49:0/1801976145 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f332c0c4d10 0x7f332c14d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:48.427 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.424+0000 7f3330c15640 1 --2- 10.20.193.49:0/1801976145 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f332c0c48c0 0x7f332c1f4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:48.427 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.424+0000 7f3330c15640 1 -- 10.20.193.49:0/1801976145 >> 10.20.193.49:0/1801976145 conn(0x7f332c0c9f40 msgr2=0x7f332c158520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:48.427 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.424+0000 7f3330c15640 1 -- 10.20.193.49:0/1801976145 shutdown_connections 2026-02-17T11:15:48.427 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.424+0000 7f3330c15640 1 -- 10.20.193.49:0/1801976145 wait complete. 2026-02-17T11:15:48.427 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.424+0000 7f3330c15640 1 librados: shutdown 2026-02-17T11:15:48.436 INFO:tasks.ceph:Scrubbing osd.14 2026-02-17T11:15:48.437 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.14 config set osd_debug_deep_scrub_sleep 0 2026-02-17T11:15:48.506 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.504+0000 7fd73536e640 10 monclient: get_monmap_and_config 2026-02-17T11:15:48.507 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.504+0000 7fd73536e640 10 monclient: build_initial_monmap 2026-02-17T11:15:48.507 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.504+0000 7fd73536e640 10 monclient: monmap: 2026-02-17T11:15:48.507 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:48.507 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:48.507 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:15:48.505789+0000 2026-02-17T11:15:48.507 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:15:48.505789+0000 2026-02-17T11:15:48.507 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:48.507 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:48.507 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:15:48.507 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:15:48.507 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:15:48.508 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:15:48.508 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:15:48.508 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:15:48.508 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:48.510 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.504+0000 7fd73536e640 1 Processor -- start 2026-02-17T11:15:48.511 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.504+0000 7fd73536e640 1 -- start start 2026-02-17T11:15:48.511 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.504+0000 7fd73536e640 10 monclient: init 2026-02-17T11:15:48.511 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.505+0000 7fd73536e640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:48.511 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.505+0000 7fd73536e640 10 monclient: _add_conns ranks=[0,2,4,5,1,3] 2026-02-17T11:15:48.511 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.505+0000 7fd73536e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd73015f8a0 addr v1:10.20.193.49:6789/0 2026-02-17T11:15:48.511 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.505+0000 7fd73536e640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fd7300cb9c0 addr v1:10.20.193.157:6789/0 2026-02-17T11:15:48.511 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.505+0000 7fd73536e640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7fd7300ca650 0x7fd730159150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:48.511 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.505+0000 7fd73536e640 10 monclient(hunting): picked mon.noname-b con 0x7fd7300ca650 addr v2:10.20.193.97:3300/0 2026-02-17T11:15:48.511 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.505+0000 7fd73536e640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd730068ff0 con 0x7fd73015f8a0 2026-02-17T11:15:48.511 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.505+0000 7fd73536e640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7300692d0 con 0x7fd7300cb9c0 2026-02-17T11:15:48.511 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.505+0000 7fd73536e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:48.511 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.505+0000 7fd73536e640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7fd7300c8e70 con 0x7fd7300ca650 2026-02-17T11:15:48.512 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.505+0000 7fd73536e640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:48.512 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.505+0000 7fd73536e640 10 monclient(hunting): authenticate will time out at 1425.169469s 2026-02-17T11:15:48.512 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.505+0000 7fd72e7fc640 1 --1- >> v1:10.20.193.157:6789/0 conn(0x7fd7300cb9c0 0x7fd73015fc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.157:6789/0 says I am v1:10.20.193.49:44812/0 (socket says 10.20.193.49:44812) 2026-02-17T11:15:48.512 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.505+0000 7fd72e7fc640 1 -- 10.20.193.49:0/19815247 learned_addr learned my addr 10.20.193.49:0/19815247 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:15:48.512 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.505+0000 7fd72f7fe640 1 --2- 10.20.193.49:0/19815247 >> v2:10.20.193.97:3300/0 conn(0x7fd7300ca650 0x7fd730159150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:48.512 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.506+0000 7fd72f7fe640 10 monclient(hunting): get_auth_request con 0x7fd7300ca650 auth_method 0 2026-02-17T11:15:48.512 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.506+0000 7fd72f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:48.512 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.506+0000 7fd72f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:48.512 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.506+0000 7fd72f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:48.512 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.506+0000 7fd72f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:48.512 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.506+0000 7fd72f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:48.512 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.506+0000 7fd72f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:48.513 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.507+0000 7fd72dffb640 1 -- 10.20.193.49:0/19815247 <== mon.2 v1:10.20.193.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 363322094 0 0) 0x7fd7300692d0 con 0x7fd7300cb9c0 2026-02-17T11:15:48.513 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.507+0000 7fd72dffb640 10 monclient(hunting): _negotiate 2026-02-17T11:15:48.513 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.507+0000 7fd72dffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:48.513 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.507+0000 7fd72dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:48.513 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.507+0000 7fd72dffb640 10 monclient(hunting): my global_id is 5333 2026-02-17T11:15:48.513 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.507+0000 7fd72dffb640 1 -- 10.20.193.49:0/19815247 --> v1:10.20.193.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd71c003620 con 0x7fd7300cb9c0 2026-02-17T11:15:48.513 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.507+0000 7fd72f7fe640 10 monclient(hunting): handle_auth_done global_id 5260 payload 274 2026-02-17T11:15:48.513 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.507+0000 7fd72f7fe640 1 -- 10.20.193.49:0/19815247 >> v1:10.20.193.157:6789/0 conn(0x7fd7300cb9c0 legacy=0x7fd73015fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:48.513 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.507+0000 7fd72f7fe640 1 -- 10.20.193.49:0/19815247 >> v1:10.20.193.49:6789/0 conn(0x7fd73015f8a0 legacy=0x7fd7300c9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:15:48.513 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.507+0000 7fd72f7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:15:48.513 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.507+0000 7fd72f7fe640 1 monclient: found mon.noname-b 2026-02-17T11:15:48.513 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.507+0000 7fd72f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:48.513 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.507+0000 7fd72f7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:15:48.514 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.507+0000 7fd72f7fe640 1 -- 10.20.193.49:0/19815247 --> v2:10.20.193.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7300c9150 con 0x7fd7300ca650 2026-02-17T11:15:48.514 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.507+0000 7fd72f7fe640 1 -- 10.20.193.49:0/19815247 >> v2:10.20.193.97:3300/0 conn(0x7fd7300ca650 msgr2=0x7fd730159150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T11:15:48.514 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.507+0000 7fd72f7fe640 1 -- 10.20.193.49:0/19815247 >> v2:10.20.193.97:3300/0 conn(0x7fd7300ca650 msgr2=0x7fd730159150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T11:15:48.514 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.507+0000 7fd72f7fe640 1 --2- 10.20.193.49:0/19815247 >> v2:10.20.193.97:3300/0 conn(0x7fd7300ca650 0x7fd730159150 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rev1=1 crypto rx=0x7fd720009d90 tx=0x7fd72002f190 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T11:15:48.514 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.507+0000 7fd72f7fe640 1 --2- 10.20.193.49:0/19815247 >> v2:10.20.193.97:3300/0 conn(0x7fd7300ca650 0x7fd730159150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T11:15:48.714 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.709+0000 7fd72f7fe640 1 --2- 10.20.193.49:0/19815247 >> v2:10.20.193.97:3300/0 conn(0x7fd7300ca650 0x7fd730159150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:48.714 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.709+0000 7fd72f7fe640 10 monclient: get_auth_request con 0x7fd7300ca650 auth_method 0 2026-02-17T11:15:48.714 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.709+0000 7fd72f7fe640 0 --2- 10.20.193.49:0/19815247 >> v2:10.20.193.97:3300/0 conn(0x7fd7300ca650 0x7fd730159150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2026-02-17T11:15:48.714 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.709+0000 7fd72f7fe640 1 --2- 10.20.193.49:0/19815247 >> v2:10.20.193.97:3300/0 conn(0x7fd7300ca650 0x7fd730159150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:48.714 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.709+0000 7fd72dffb640 10 monclient: ms_handle_reset current mon v2:10.20.193.97:3300/0 2026-02-17T11:15:48.714 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.709+0000 7fd72dffb640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:48.714 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.709+0000 7fd72dffb640 1 -- 10.20.193.49:0/19815247 >> v2:10.20.193.97:3300/0 conn(0x7fd7300ca650 msgr2=0x7fd730159150 unknown :-1 s=STATE_CLOSED l=0).mark_down 2026-02-17T11:15:48.715 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.709+0000 7fd72dffb640 1 --2- 10.20.193.49:0/19815247 >> v2:10.20.193.97:3300/0 conn(0x7fd7300ca650 0x7fd730159150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:48.715 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.709+0000 7fd72dffb640 10 monclient: _add_conns ranks=[5,3,1] 2026-02-17T11:15:48.715 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.709+0000 7fd72dffb640 1 --2- 10.20.193.49:0/19815247 >> v2:10.20.193.157:3300/0 conn(0x7fd71c003930 0x7fd71c003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:48.715 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.709+0000 7fd72dffb640 10 monclient(hunting): picked mon.noname-c con 0x7fd71c003930 addr v2:10.20.193.157:3300/0 2026-02-17T11:15:48.715 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.709+0000 7fd72dffb640 1 --2- 10.20.193.49:0/19815247 >> v2:10.20.193.49:3300/0 conn(0x7fd71c004900 0x7fd71c004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:48.715 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.709+0000 7fd72dffb640 10 monclient(hunting): picked mon.noname-a con 0x7fd71c004900 addr v2:10.20.193.49:3300/0 2026-02-17T11:15:48.715 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.709+0000 7fd72dffb640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fd71c005350 addr v1:10.20.193.97:6789/0 2026-02-17T11:15:48.715 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.709+0000 7fd72dffb640 1 -- 10.20.193.49:0/19815247 --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7300692d0 con 0x7fd71c005350 2026-02-17T11:15:48.715 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.709+0000 7fd72dffb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:48.715 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.709+0000 7fd72dffb640 1 -- 10.20.193.49:0/19815247 --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7fd71c00e490 con 0x7fd71c004900 2026-02-17T11:15:48.715 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.709+0000 7fd72dffb640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:48.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.709+0000 7fd72dffb640 1 -- 10.20.193.49:0/19815247 --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7fd71c00e690 con 0x7fd71c003930 2026-02-17T11:15:48.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.709+0000 7fd72dffb640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:48.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.709+0000 7fd72dffb640 10 monclient(hunting): ms_handle_reset stray mon v2:10.20.193.97:3300/0 2026-02-17T11:15:48.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.709+0000 7fd72e7fc640 1 --2- 10.20.193.49:0/19815247 >> v2:10.20.193.49:3300/0 conn(0x7fd71c004900 0x7fd71c004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:48.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.710+0000 7fd72effd640 1 --2- 10.20.193.49:0/19815247 >> v2:10.20.193.157:3300/0 conn(0x7fd71c003930 0x7fd71c003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:48.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.710+0000 7fd72e7fc640 10 monclient(hunting): get_auth_request con 0x7fd71c004900 auth_method 0 2026-02-17T11:15:48.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.710+0000 7fd72e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:48.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.710+0000 7fd72e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:48.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.710+0000 7fd72e7fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:15:48.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.710+0000 7fd72effd640 10 monclient(hunting): get_auth_request con 0x7fd71c003930 auth_method 0 2026-02-17T11:15:48.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.710+0000 7fd72effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:48.716 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.710+0000 7fd72effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:48.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.710+0000 7fd72effd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:15:48.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.710+0000 7fd72e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:48.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.710+0000 7fd72e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:48.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.710+0000 7fd72e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:15:48.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.710+0000 7fd72effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:48.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.710+0000 7fd72effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:48.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.710+0000 7fd72effd640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:15:48.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.711+0000 7fd72dffb640 1 -- 10.20.193.49:0/19815247 <== mon.1 v1:10.20.193.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3484191258 0 0) 0x7fd7300692d0 con 0x7fd71c005350 2026-02-17T11:15:48.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.711+0000 7fd72dffb640 10 monclient(hunting): _negotiate 2026-02-17T11:15:48.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.711+0000 7fd72dffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:48.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.711+0000 7fd72dffb640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:15:48.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.711+0000 7fd72dffb640 1 -- 10.20.193.49:0/19815247 --> v1:10.20.193.97:6789/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7fd71c00d460 con 0x7fd71c005350 2026-02-17T11:15:48.717 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.711+0000 7fd72e7fc640 10 monclient(hunting): handle_auth_done global_id 5260 payload 293 2026-02-17T11:15:48.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.711+0000 7fd72e7fc640 1 -- 10.20.193.49:0/19815247 >> v2:10.20.193.157:3300/0 conn(0x7fd71c003930 msgr2=0x7fd71c003d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:15:48.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.711+0000 7fd72e7fc640 1 --2- 10.20.193.49:0/19815247 >> v2:10.20.193.157:3300/0 conn(0x7fd71c003930 0x7fd71c003d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:48.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.711+0000 7fd72e7fc640 1 -- 10.20.193.49:0/19815247 >> v1:10.20.193.97:6789/0 conn(0x7fd71c005350 legacy=0x7fd71c00bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:48.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.711+0000 7fd72e7fc640 10 monclient: _finish_hunting 0 2026-02-17T11:15:48.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.711+0000 7fd72e7fc640 1 monclient: found mon.noname-a 2026-02-17T11:15:48.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.711+0000 7fd72f7fe640 1 -- 10.20.193.49:0/19815247 reap_dead start 2026-02-17T11:15:48.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.711+0000 7fd72e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:48.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.711+0000 7fd72e7fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:15:48.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.711+0000 7fd72e7fc640 1 -- 10.20.193.49:0/19815247 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd71c00e950 con 0x7fd71c004900 2026-02-17T11:15:48.718 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.712+0000 7fd72e7fc640 1 --2- 10.20.193.49:0/19815247 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fd71c004900 0x7fd71c004db0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd71c0038d0 tx=0x7fd720009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10671493fd540142 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:48.723 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.714+0000 7fd72dffb640 1 -- 10.20.193.49:0/19815247 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd718002f90 con 0x7fd71c004900 2026-02-17T11:15:48.723 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.714+0000 7fd72dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:48.723 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.714+0000 7fd72dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:15:48.723 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.714+0000 7fd72dffb640 10 monclient: dump: 2026-02-17T11:15:48.723 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:48.723 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:48.723 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:48.723 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:48.723 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:48.723 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:48.723 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:48.723 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:48.723 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:48.723 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:48.723 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.714+0000 7fd72dffb640 10 monclient: _finish_auth 0 2026-02-17T11:15:48.723 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.714+0000 7fd72dffb640 10 monclient: _check_auth_tickets 2026-02-17T11:15:48.723 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.714+0000 7fd72dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:48.723 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.714+0000 7fd72dffb640 1 -- 10.20.193.49:0/19815247 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd71800cd30 con 0x7fd71c004900 2026-02-17T11:15:48.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.714+0000 7fd72dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:48.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.714+0000 7fd72dffb640 1 -- 10.20.193.49:0/19815247 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd718004be0 con 0x7fd71c004900 2026-02-17T11:15:48.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.714+0000 7fd72dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:48.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.714+0000 7fd72dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:15:48.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.714+0000 7fd72dffb640 10 monclient: dump: 2026-02-17T11:15:48.724 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:48.724 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:48.724 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:48.724 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:48.724 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:48.724 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:48.724 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:48.724 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:48.724 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:48.724 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:48.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.714+0000 7fd73536e640 5 monclient: authenticate success, global_id 5260 2026-02-17T11:15:48.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.714+0000 7fd73536e640 10 monclient: get_monmap_and_config success 2026-02-17T11:15:48.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.714+0000 7fd73536e640 4 set_mon_vals no callback set 2026-02-17T11:15:48.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.715+0000 7fd73536e640 10 monclient: shutdown 2026-02-17T11:15:48.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.715+0000 7fd73536e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:48.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.715+0000 7fd73536e640 1 -- 10.20.193.49:0/19815247 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fd71c004900 msgr2=0x7fd71c004db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:48.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.715+0000 7fd73536e640 1 --2- 10.20.193.49:0/19815247 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fd71c004900 0x7fd71c004db0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd71c0038d0 tx=0x7fd720009750 comp rx=0 tx=0).stop 2026-02-17T11:15:48.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.715+0000 7fd73536e640 1 -- 10.20.193.49:0/19815247 shutdown_connections 2026-02-17T11:15:48.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.715+0000 7fd73536e640 1 --2- 10.20.193.49:0/19815247 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fd71c004900 0x7fd71c004db0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:48.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.715+0000 7fd73536e640 1 -- 10.20.193.49:0/19815247 >> 10.20.193.49:0/19815247 conn(0x7fd7300caed0 msgr2=0x7fd7300cb2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:48.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.715+0000 7fd73536e640 1 -- 10.20.193.49:0/19815247 shutdown_connections 2026-02-17T11:15:48.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.715+0000 7fd73536e640 1 -- 10.20.193.49:0/19815247 wait complete. 2026-02-17T11:15:48.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.715+0000 7fd73536e640 10 monclient: build_initial_monmap 2026-02-17T11:15:48.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.715+0000 7fd73536e640 10 monclient: monmap: 2026-02-17T11:15:48.724 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:48.724 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:15:48.724 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:15:48.724 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:15:48.724 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:48.724 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:48.724 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:15:48.724 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:15:48.724 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:15:48.724 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:48.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.716+0000 7fd73536e640 1 librados: starting msgr at 2026-02-17T11:15:48.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.716+0000 7fd73536e640 1 librados: starting objecter 2026-02-17T11:15:48.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.716+0000 7fd73536e640 1 Processor -- start 2026-02-17T11:15:48.724 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.716+0000 7fd73536e640 1 -- start start 2026-02-17T11:15:48.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.716+0000 7fd73536e640 1 librados: setting wanted keys 2026-02-17T11:15:48.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.716+0000 7fd73536e640 1 librados: calling monclient init 2026-02-17T11:15:48.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.716+0000 7fd73536e640 10 monclient: init 2026-02-17T11:15:48.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.716+0000 7fd73536e640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:48.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.716+0000 7fd73536e640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:15:48.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.716+0000 7fd73536e640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fd71c004900 0x7fd73014dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:48.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.716+0000 7fd73536e640 10 monclient(hunting): picked mon.noname-c con 0x7fd71c004900 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:15:48.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.716+0000 7fd73536e640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fd73014e630 0x7fd7301f5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:48.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.716+0000 7fd73536e640 10 monclient(hunting): picked mon.noname-b con 0x7fd73014e630 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:15:48.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.716+0000 7fd73536e640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fd7301f5c90 0x7fd7300c7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:48.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.716+0000 7fd73536e640 10 monclient(hunting): picked mon.noname-a con 0x7fd7301f5c90 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:15:48.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.716+0000 7fd73536e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:48.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.716+0000 7fd73536e640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd73006e5f0 con 0x7fd7301f5c90 2026-02-17T11:15:48.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.716+0000 7fd73536e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:48.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.716+0000 7fd73536e640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd73006e470 con 0x7fd73014e630 2026-02-17T11:15:48.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.716+0000 7fd73536e640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:48.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.716+0000 7fd73536e640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fd7300ca100 con 0x7fd71c004900 2026-02-17T11:15:48.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.716+0000 7fd73536e640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:48.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.716+0000 7fd73536e640 10 monclient(hunting): authenticate will time out at 1425.379686s 2026-02-17T11:15:48.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.716+0000 7fd72f7fe640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fd7301f5c90 0x7fd7300c7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:48.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.717+0000 7fd72e7fc640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fd73014e630 0x7fd7301f5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:48.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.717+0000 7fd72f7fe640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fd7301f5c90 0x7fd7300c7d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:43262/0 (socket says 10.20.193.49:43262) 2026-02-17T11:15:48.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.717+0000 7fd72f7fe640 1 -- 10.20.193.49:0/678137886 learned_addr learned my addr 10.20.193.49:0/678137886 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:48.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.717+0000 7fd72f7fe640 10 monclient(hunting): get_auth_request con 0x7fd7301f5c90 auth_method 0 2026-02-17T11:15:48.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.717+0000 7fd72f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:48.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.717+0000 7fd72f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:48.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.717+0000 7fd72f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:48.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.717+0000 7fd72effd640 1 --2- 10.20.193.49:0/678137886 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fd71c004900 0x7fd73014dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:48.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.717+0000 7fd72e7fc640 10 monclient(hunting): get_auth_request con 0x7fd73014e630 auth_method 0 2026-02-17T11:15:48.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.717+0000 7fd72e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:48.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.717+0000 7fd72e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:48.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.717+0000 7fd72e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:48.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.717+0000 7fd72f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:48.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.717+0000 7fd72f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:48.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.717+0000 7fd72f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:48.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.717+0000 7fd72effd640 10 monclient(hunting): get_auth_request con 0x7fd71c004900 auth_method 0 2026-02-17T11:15:48.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.717+0000 7fd72effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:48.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.717+0000 7fd72effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:48.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.717+0000 7fd72effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:48.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.717+0000 7fd72e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:48.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.717+0000 7fd72e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:48.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.717+0000 7fd72e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:48.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.717+0000 7fd72effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:48.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.717+0000 7fd72effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:48.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.717+0000 7fd72effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:48.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.718+0000 7fd72f7fe640 10 monclient(hunting): handle_auth_done global_id 5289 payload 824 2026-02-17T11:15:48.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.718+0000 7fd72f7fe640 1 -- 10.20.193.49:0/678137886 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fd71c004900 msgr2=0x7fd73014dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:48.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.718+0000 7fd72f7fe640 1 --2- 10.20.193.49:0/678137886 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fd71c004900 0x7fd73014dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:48.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.718+0000 7fd72f7fe640 1 -- 10.20.193.49:0/678137886 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fd73014e630 msgr2=0x7fd7301f5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:48.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.718+0000 7fd72f7fe640 1 --2- 10.20.193.49:0/678137886 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fd73014e630 0x7fd7301f5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:48.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.718+0000 7fd72f7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:15:48.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.718+0000 7fd72f7fe640 1 monclient: found mon.noname-a 2026-02-17T11:15:48.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.718+0000 7fd72f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:48.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.718+0000 7fd72f7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:15:48.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.718+0000 7fd72f7fe640 1 -- 10.20.193.49:0/678137886 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7301f4a00 con 0x7fd7301f5c90 2026-02-17T11:15:48.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.719+0000 7fd72f7fe640 1 --2- 10.20.193.49:0/678137886 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fd7301f5c90 0x7fd7300c7d20 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd72002f6f0 tx=0x7fd720004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:48.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.719+0000 7fd70f7fe640 10 client.?.objecter ms_handle_connect 0x7fd7301f5c90 2026-02-17T11:15:48.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.719+0000 7fd70f7fe640 10 client.?.objecter resend_mon_ops 2026-02-17T11:15:48.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.721+0000 7fd70f7fe640 1 -- 10.20.193.49:0/678137886 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd720035040 con 0x7fd7301f5c90 2026-02-17T11:15:48.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.721+0000 7fd70f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:48.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.721+0000 7fd70f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:15:48.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.721+0000 7fd70f7fe640 10 monclient: dump: 2026-02-17T11:15:48.726 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:48.726 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:48.726 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:48.726 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:48.726 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:48.726 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:48.726 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:48.726 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:48.726 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:48.726 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:48.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.721+0000 7fd70f7fe640 10 monclient: _finish_auth 0 2026-02-17T11:15:48.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.721+0000 7fd70f7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:15:48.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.721+0000 7fd70f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:48.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.721+0000 7fd70f7fe640 1 -- 10.20.193.49:0/678137886 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd720004670 con 0x7fd7301f5c90 2026-02-17T11:15:48.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.721+0000 7fd70f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:48.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.721+0000 7fd70f7fe640 1 -- 10.20.193.49:0/678137886 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd720009450 con 0x7fd7301f5c90 2026-02-17T11:15:48.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.721+0000 7fd70f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:48.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.721+0000 7fd70f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:15:48.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.721+0000 7fd70f7fe640 10 monclient: dump: 2026-02-17T11:15:48.726 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:48.726 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:48.726 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:48.726 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:48.726 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:48.726 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:48.726 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:48.726 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:48.726 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:48.727 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:48.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.721+0000 7fd72d7fa640 4 set_mon_vals no callback set 2026-02-17T11:15:48.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.721+0000 7fd73536e640 5 monclient: authenticate success, global_id 5289 2026-02-17T11:15:48.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.721+0000 7fd73536e640 10 monclient: _renew_subs 2026-02-17T11:15:48.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.721+0000 7fd73536e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:48.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.721+0000 7fd73536e640 1 -- 10.20.193.49:0/678137886 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7301f6110 con 0x7fd7301f5c90 2026-02-17T11:15:48.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.721+0000 7fd73536e640 10 client.5289.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:48.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.721+0000 7fd73536e640 10 monclient: _renew_subs 2026-02-17T11:15:48.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.721+0000 7fd73536e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:48.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.721+0000 7fd73536e640 1 -- 10.20.193.49:0/678137886 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7301f4c70 con 0x7fd7301f5c90 2026-02-17T11:15:48.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.721+0000 7fd73536e640 1 librados: init done 2026-02-17T11:15:48.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.721+0000 7fd73536e640 10 client.5289.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:48.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.721+0000 7fd73536e640 15 client.5289.objecter _session_command_op_assign -1 1 2026-02-17T11:15:48.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.721+0000 7fd73536e640 20 client.5289.objecter _get_session osd=-1 returning homeless 2026-02-17T11:15:48.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.721+0000 7fd73536e640 10 client.5289.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:48.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.721+0000 7fd73536e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:48.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.721+0000 7fd73536e640 1 -- 10.20.193.49:0/678137886 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd7300cf200 con 0x7fd7301f5c90 2026-02-17T11:15:48.734 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.733+0000 7fd70f7fe640 1 -- 10.20.193.49:0/678137886 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7fd720038030 con 0x7fd7301f5c90 2026-02-17T11:15:48.735 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.734+0000 7fd70f7fe640 1 --2- 10.20.193.49:0/678137886 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fd6fc079170 0x7fd6fc07b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:48.735 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.734+0000 7fd72effd640 1 --2- 10.20.193.49:0/678137886 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fd6fc079170 0x7fd6fc07b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:48.735 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.734+0000 7fd72effd640 10 monclient: get_auth_request con 0x7fd6fc079170 auth_method 0 2026-02-17T11:15:48.736 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.735+0000 7fd70f7fe640 10 client.5289.objecter ms_handle_connect 0x7fd6fc079170 2026-02-17T11:15:48.736 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.735+0000 7fd72effd640 1 --2- 10.20.193.49:0/678137886 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fd6fc079170 0x7fd6fc07b630 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd724003fd0 tx=0x7fd724007da0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:48.737 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.735+0000 7fd70f7fe640 1 -- 10.20.193.49:0/678137886 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7fd7200bbf60 con 0x7fd7301f5c90 2026-02-17T11:15:48.738 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.735+0000 7fd70f7fe640 10 client.5289.objecter ms_dispatch2 0x7fd730000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:15:48.738 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.735+0000 7fd70f7fe640 3 client.5289.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:15:48.738 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.735+0000 7fd70f7fe640 3 client.5289.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:15:48.738 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.735+0000 7fd70f7fe640 10 client.5289.objecter checking command 1 2026-02-17T11:15:48.738 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.735+0000 7fd70f7fe640 1 --2- 10.20.193.49:0/678137886 >> [v2:10.20.193.157:6824/404726964,v1:10.20.193.157:6825/404726964] conn(0x7fd6fc081650 0x7fd6fc083a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:48.738 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.735+0000 7fd70f7fe640 20 client.5289.objecter _get_session s=0x7fd6fc080f80 osd=14 3 2026-02-17T11:15:48.738 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.735+0000 7fd70f7fe640 20 client.5289.objecter put_session s=0x7fd6fc080f80 osd=14 3 2026-02-17T11:15:48.738 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.735+0000 7fd70f7fe640 15 client.5289.objecter _session_command_op_remove -1 1 2026-02-17T11:15:48.738 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.735+0000 7fd70f7fe640 20 client.5289.objecter _get_session s=0x7fd6fc080f80 osd=14 3 2026-02-17T11:15:48.738 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.735+0000 7fd70f7fe640 20 client.5289.objecter get_session s=0x7fd6fc080f80 osd=14 3 2026-02-17T11:15:48.739 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.735+0000 7fd70f7fe640 15 client.5289.objecter _session_command_op_assign 14 1 2026-02-17T11:15:48.739 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.735+0000 7fd70f7fe640 20 client.5289.objecter put_session s=0x7fd6fc080f80 osd=14 4 2026-02-17T11:15:48.739 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.735+0000 7fd70f7fe640 10 client.5289.objecter _send_command 1 2026-02-17T11:15:48.739 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.735+0000 7fd70f7fe640 1 -- 10.20.193.49:0/678137886 --> [v2:10.20.193.157:6824/404726964,v1:10.20.193.157:6825/404726964] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd6fc084140 con 0x7fd6fc081650 2026-02-17T11:15:48.739 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.735+0000 7fd70f7fe640 20 client.5289.objecter dump_active .. 0 homeless 2026-02-17T11:15:48.739 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.735+0000 7fd70f7fe640 1 -- 10.20.193.49:0/678137886 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fd720082990 con 0x7fd7301f5c90 2026-02-17T11:15:48.739 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.735+0000 7fd70f7fe640 10 monclient: handle_get_version_reply finishing 1 version 34 2026-02-17T11:15:48.739 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.736+0000 7fd72e7fc640 1 --2- 10.20.193.49:0/678137886 >> [v2:10.20.193.157:6824/404726964,v1:10.20.193.157:6825/404726964] conn(0x7fd6fc081650 0x7fd6fc083a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:48.739 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.736+0000 7fd72e7fc640 10 monclient: get_auth_request con 0x7fd6fc081650 auth_method 0 2026-02-17T11:15:48.740 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.738+0000 7fd72e7fc640 1 --2- 10.20.193.49:0/678137886 >> [v2:10.20.193.157:6824/404726964,v1:10.20.193.157:6825/404726964] conn(0x7fd6fc081650 0x7fd6fc083a70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.14 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:48.740 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.738+0000 7fd70f7fe640 10 client.5289.objecter ms_handle_connect 0x7fd6fc081650 2026-02-17T11:15:48.750 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.749+0000 7fd70f7fe640 1 -- 10.20.193.49:0/678137886 <== osd.14 v2:10.20.193.157:6824/404726964 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fd6fc084140 con 0x7fd6fc081650 2026-02-17T11:15:48.750 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.749+0000 7fd70f7fe640 10 client.5289.objecter ms_dispatch2 0x7fd730000b90 command_reply(tid 1: 0 ) 2026-02-17T11:15:48.750 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.749+0000 7fd70f7fe640 10 client.5289.objecter _finish_command 1 = system:0 2026-02-17T11:15:48.750 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.749+0000 7fd70f7fe640 20 client.5289.objecter put_session s=0x7fd6fc080f80 osd=14 4 2026-02-17T11:15:48.751 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.749+0000 7fd70f7fe640 15 client.5289.objecter _session_command_op_remove 14 1 2026-02-17T11:15:48.757 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.755+0000 7fd73536e640 10 client.5289.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T11:15:48.757 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.755+0000 7fd73536e640 15 client.5289.objecter _session_command_op_assign -1 2 2026-02-17T11:15:48.757 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.755+0000 7fd73536e640 20 client.5289.objecter _get_session s=0x7fd6fc080f80 osd=14 3 2026-02-17T11:15:48.757 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.755+0000 7fd73536e640 20 client.5289.objecter put_session s=0x7fd6fc080f80 osd=14 3 2026-02-17T11:15:48.757 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.755+0000 7fd73536e640 20 client.5289.objecter _get_session s=0x7fd6fc080f80 osd=14 3 2026-02-17T11:15:48.757 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.755+0000 7fd73536e640 15 client.5289.objecter _session_command_op_remove -1 2 2026-02-17T11:15:48.757 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.755+0000 7fd73536e640 20 client.5289.objecter get_session s=0x7fd6fc080f80 osd=14 3 2026-02-17T11:15:48.757 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.755+0000 7fd73536e640 15 client.5289.objecter _session_command_op_assign 14 2 2026-02-17T11:15:48.757 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.755+0000 7fd73536e640 20 client.5289.objecter put_session s=0x7fd6fc080f80 osd=14 4 2026-02-17T11:15:48.758 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.755+0000 7fd73536e640 10 client.5289.objecter _send_command 2 2026-02-17T11:15:48.758 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.755+0000 7fd73536e640 1 -- 10.20.193.49:0/678137886 --> [v2:10.20.193.157:6824/404726964,v1:10.20.193.157:6825/404726964] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd7300cb430 con 0x7fd6fc081650 2026-02-17T11:15:48.763 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.762+0000 7fd70f7fe640 1 -- 10.20.193.49:0/678137886 <== osd.14 v2:10.20.193.157:6824/404726964 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd7300cb430 con 0x7fd6fc081650 2026-02-17T11:15:48.764 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.762+0000 7fd70f7fe640 10 client.5289.objecter ms_dispatch2 0x7fd730000b90 command_reply(tid 2: 0 ) 2026-02-17T11:15:48.764 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.762+0000 7fd70f7fe640 10 client.5289.objecter _finish_command 2 = system:0 2026-02-17T11:15:48.764 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.762+0000 7fd70f7fe640 20 client.5289.objecter put_session s=0x7fd6fc080f80 osd=14 4 2026-02-17T11:15:48.764 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.762+0000 7fd70f7fe640 15 client.5289.objecter _session_command_op_remove 14 2 2026-02-17T11:15:48.764 INFO:teuthology.orchestra.run.trial049.stdout:{ 2026-02-17T11:15:48.765 INFO:teuthology.orchestra.run.trial049.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T11:15:48.765 INFO:teuthology.orchestra.run.trial049.stdout:} 2026-02-17T11:15:48.766 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.762+0000 7fd73536e640 10 librados: watch_flush enter 2026-02-17T11:15:48.766 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.762+0000 7fd73536e640 10 librados: watch_flush exit 2026-02-17T11:15:48.766 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.762+0000 7fd73536e640 10 client.5289.objecter close_session for osd.14 2026-02-17T11:15:48.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.762+0000 7fd73536e640 1 -- 10.20.193.49:0/678137886 >> [v2:10.20.193.157:6824/404726964,v1:10.20.193.157:6825/404726964] conn(0x7fd6fc081650 msgr2=0x7fd6fc083a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:48.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.762+0000 7fd73536e640 1 --2- 10.20.193.49:0/678137886 >> [v2:10.20.193.157:6824/404726964,v1:10.20.193.157:6825/404726964] conn(0x7fd6fc081650 0x7fd6fc083a70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:48.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.762+0000 7fd73536e640 20 client.5289.objecter put_session s=0x7fd6fc080f80 osd=14 1 2026-02-17T11:15:48.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.762+0000 7fd73536e640 20 client.5289.objecter shutdown clearing up homeless session... 2026-02-17T11:15:48.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.762+0000 7fd73536e640 10 client.5289.objecter successfully canceled tick 2026-02-17T11:15:48.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.762+0000 7fd73536e640 1 -- 10.20.193.49:0/678137886 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fd6fc079170 msgr2=0x7fd6fc07b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:48.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.762+0000 7fd73536e640 1 --2- 10.20.193.49:0/678137886 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fd6fc079170 0x7fd6fc07b630 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd724003fd0 tx=0x7fd724007da0 comp rx=0 tx=0).stop 2026-02-17T11:15:48.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.762+0000 7fd73536e640 10 monclient: shutdown 2026-02-17T11:15:48.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.762+0000 7fd73536e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:48.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.762+0000 7fd73536e640 1 -- 10.20.193.49:0/678137886 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fd7301f5c90 msgr2=0x7fd7300c7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:48.767 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.762+0000 7fd73536e640 1 --2- 10.20.193.49:0/678137886 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fd7301f5c90 0x7fd7300c7d20 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd72002f6f0 tx=0x7fd720004b40 comp rx=0 tx=0).stop 2026-02-17T11:15:48.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.762+0000 7fd72f7fe640 1 -- 10.20.193.49:0/678137886 reap_dead start 2026-02-17T11:15:48.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.762+0000 7fd73536e640 1 -- 10.20.193.49:0/678137886 shutdown_connections 2026-02-17T11:15:48.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.762+0000 7fd73536e640 1 -- 10.20.193.49:0/678137886 >> 10.20.193.49:0/678137886 conn(0x7fd7300caed0 msgr2=0x7fd73015dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:48.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.762+0000 7fd73536e640 1 -- 10.20.193.49:0/678137886 shutdown_connections 2026-02-17T11:15:48.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.762+0000 7fd73536e640 1 -- 10.20.193.49:0/678137886 wait complete. 2026-02-17T11:15:48.768 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.762+0000 7fd73536e640 1 librados: shutdown 2026-02-17T11:15:48.772 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 14 2026-02-17T11:15:48.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.837+0000 7f33a7df7640 10 monclient: get_monmap_and_config 2026-02-17T11:15:48.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.837+0000 7f33a7df7640 10 monclient: build_initial_monmap 2026-02-17T11:15:48.839 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.837+0000 7f33a7df7640 10 monclient: monmap: 2026-02-17T11:15:48.839 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:48.839 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:48.839 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:15:48.838278+0000 2026-02-17T11:15:48.840 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:15:48.838278+0000 2026-02-17T11:15:48.840 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:48.840 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:48.840 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:15:48.840 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:15:48.840 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:15:48.840 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:15:48.840 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:15:48.840 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:15:48.840 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:48.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.838+0000 7f33a7df7640 1 Processor -- start 2026-02-17T11:15:48.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.838+0000 7f33a7df7640 1 -- start start 2026-02-17T11:15:48.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.838+0000 7f33a7df7640 10 monclient: init 2026-02-17T11:15:48.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.838+0000 7f33a7df7640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:48.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.838+0000 7f33a7df7640 10 monclient: _add_conns ranks=[5,3,2,4,0,1] 2026-02-17T11:15:48.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.838+0000 7f33a7df7640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f33a015d370 0x7f33a015d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:48.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.838+0000 7f33a7df7640 10 monclient(hunting): picked mon.noname-c con 0x7f33a015d370 addr v2:10.20.193.157:3300/0 2026-02-17T11:15:48.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.838+0000 7f33a7df7640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f33a00c7e20 0x7f33a00c74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:48.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.838+0000 7f33a7df7640 10 monclient(hunting): picked mon.noname-a con 0x7f33a00c7e20 addr v2:10.20.193.49:3300/0 2026-02-17T11:15:48.844 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.838+0000 7f33a7df7640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f33a015b000 addr v1:10.20.193.157:6789/0 2026-02-17T11:15:48.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.838+0000 7f33a7df7640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33a00c8350 con 0x7f33a015b000 2026-02-17T11:15:48.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.838+0000 7f33a7df7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:48.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.838+0000 7f33a7df7640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f33a00c9240 con 0x7f33a00c7e20 2026-02-17T11:15:48.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.838+0000 7f33a7df7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:48.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.838+0000 7f33a7df7640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f33a00c8630 con 0x7f33a015d370 2026-02-17T11:15:48.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.838+0000 7f33a7df7640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:48.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.838+0000 7f33a7df7640 10 monclient(hunting): authenticate will time out at 1425.501761s 2026-02-17T11:15:48.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.839+0000 7f33a536b640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f33a00c7e20 0x7f33a00c74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:48.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.839+0000 7f33a5b6c640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f33a015d370 0x7f33a015d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:48.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.839+0000 7f33a536b640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f33a00c7e20 0x7f33a00c74c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:43270/0 (socket says 10.20.193.49:43270) 2026-02-17T11:15:48.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.839+0000 7f33a536b640 1 -- 10.20.193.49:0/1736139438 learned_addr learned my addr 10.20.193.49:0/1736139438 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:48.845 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.839+0000 7f33a536b640 10 monclient(hunting): get_auth_request con 0x7f33a00c7e20 auth_method 0 2026-02-17T11:15:48.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.839+0000 7f33a536b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:48.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.839+0000 7f33a536b640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:48.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.839+0000 7f33a536b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:48.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.839+0000 7f33a5b6c640 10 monclient(hunting): get_auth_request con 0x7f33a015d370 auth_method 0 2026-02-17T11:15:48.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.839+0000 7f33a5b6c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:48.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.839+0000 7f33a5b6c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:48.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.839+0000 7f33a5b6c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:48.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.839+0000 7f33a536b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:48.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.839+0000 7f33a536b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:48.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.839+0000 7f33a536b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:48.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.840+0000 7f33a5b6c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:48.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.840+0000 7f33a5b6c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:48.846 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.840+0000 7f33a5b6c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:48.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.840+0000 7f33a536b640 10 monclient(hunting): handle_auth_done global_id 5292 payload 274 2026-02-17T11:15:48.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.840+0000 7f33a536b640 1 -- 10.20.193.49:0/1736139438 >> v2:10.20.193.157:3300/0 conn(0x7f33a015d370 msgr2=0x7f33a015d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:15:48.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.840+0000 7f33a536b640 1 --2- 10.20.193.49:0/1736139438 >> v2:10.20.193.157:3300/0 conn(0x7f33a015d370 0x7f33a015d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:48.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.840+0000 7f33a536b640 1 -- 10.20.193.49:0/1736139438 >> v1:10.20.193.157:6789/0 conn(0x7f33a015b000 legacy=0x7f33a00c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:48.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.840+0000 7f33a536b640 10 monclient: _finish_hunting 0 2026-02-17T11:15:48.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.840+0000 7f33a536b640 1 monclient: found mon.noname-a 2026-02-17T11:15:48.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.840+0000 7f33a536b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:48.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.840+0000 7f33a536b640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:15:48.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.840+0000 7f33a536b640 1 -- 10.20.193.49:0/1736139438 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33a00c8910 con 0x7f33a00c7e20 2026-02-17T11:15:48.847 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.841+0000 7f33a536b640 1 --2- 10.20.193.49:0/1736139438 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f33a00c7e20 0x7f33a00c74c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f33a00698d0 tx=0x7f339402eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de6909bd8a5c7f8d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:48.852 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.843+0000 7f33a4b6a640 1 -- 10.20.193.49:0/1736139438 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f339403c070 con 0x7f33a00c7e20 2026-02-17T11:15:48.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.843+0000 7f33a4b6a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:48.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.843+0000 7f33a4b6a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:15:48.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.843+0000 7f33a4b6a640 10 monclient: dump: 2026-02-17T11:15:48.853 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:48.853 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:48.853 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:48.853 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:48.853 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:48.853 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:48.853 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:48.853 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:48.853 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:48.853 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:48.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.843+0000 7f33a4b6a640 10 monclient: _finish_auth 0 2026-02-17T11:15:48.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.843+0000 7f33a4b6a640 10 monclient: _check_auth_tickets 2026-02-17T11:15:48.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.843+0000 7f33a4b6a640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:48.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.843+0000 7f33a4b6a640 1 -- 10.20.193.49:0/1736139438 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f339402fbe0 con 0x7f33a00c7e20 2026-02-17T11:15:48.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.843+0000 7f33a7df7640 5 monclient: authenticate success, global_id 5292 2026-02-17T11:15:48.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.843+0000 7f33a7df7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:15:48.853 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.843+0000 7f33a4b6a640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:48.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.843+0000 7f33a4b6a640 1 -- 10.20.193.49:0/1736139438 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3394037440 con 0x7f33a00c7e20 2026-02-17T11:15:48.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.843+0000 7f33a7df7640 10 monclient: get_monmap_and_config success 2026-02-17T11:15:48.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.843+0000 7f33a7df7640 4 set_mon_vals no callback set 2026-02-17T11:15:48.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.843+0000 7f33a4b6a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:48.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.843+0000 7f33a4b6a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:15:48.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.843+0000 7f33a4b6a640 10 monclient: dump: 2026-02-17T11:15:48.854 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:48.854 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:48.854 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:48.854 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:48.854 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:48.854 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:48.854 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:48.854 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:48.854 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:48.854 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:48.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.843+0000 7f33a7df7640 10 monclient: shutdown 2026-02-17T11:15:48.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.843+0000 7f33a7df7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:48.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.843+0000 7f33a7df7640 1 -- 10.20.193.49:0/1736139438 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f33a00c7e20 msgr2=0x7f33a00c74c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:48.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.843+0000 7f33a7df7640 1 --2- 10.20.193.49:0/1736139438 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f33a00c7e20 0x7f33a00c74c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f33a00698d0 tx=0x7f339402eed0 comp rx=0 tx=0).stop 2026-02-17T11:15:48.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.844+0000 7f33a7df7640 1 -- 10.20.193.49:0/1736139438 shutdown_connections 2026-02-17T11:15:48.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.844+0000 7f33a7df7640 1 --2- 10.20.193.49:0/1736139438 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f33a00c7e20 0x7f33a00c74c0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:48.854 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.844+0000 7f33a7df7640 1 --2- 10.20.193.49:0/1736139438 >> v2:10.20.193.157:3300/0 conn(0x7f33a015d370 0x7f33a015d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:48.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.844+0000 7f33a7df7640 1 -- 10.20.193.49:0/1736139438 >> 10.20.193.49:0/1736139438 conn(0x7f33a00c9f20 msgr2=0x7f33a00ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:48.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.844+0000 7f33a7df7640 1 -- 10.20.193.49:0/1736139438 shutdown_connections 2026-02-17T11:15:48.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.844+0000 7f33a7df7640 1 -- 10.20.193.49:0/1736139438 wait complete. 2026-02-17T11:15:48.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.844+0000 7f33a7df7640 10 monclient: build_initial_monmap 2026-02-17T11:15:48.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.844+0000 7f33a7df7640 10 monclient: monmap: 2026-02-17T11:15:48.855 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:48.855 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:15:48.855 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:15:48.855 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:15:48.855 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:48.855 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:48.855 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:15:48.855 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:15:48.855 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:15:48.855 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:48.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.844+0000 7f33a7df7640 1 librados: starting msgr at 2026-02-17T11:15:48.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.844+0000 7f33a7df7640 1 librados: starting objecter 2026-02-17T11:15:48.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.844+0000 7f33a7df7640 1 Processor -- start 2026-02-17T11:15:48.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.844+0000 7f33a7df7640 1 -- start start 2026-02-17T11:15:48.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.844+0000 7f33a7df7640 1 librados: setting wanted keys 2026-02-17T11:15:48.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.844+0000 7f33a7df7640 1 librados: calling monclient init 2026-02-17T11:15:48.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.844+0000 7f33a7df7640 10 monclient: init 2026-02-17T11:15:48.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.845+0000 7f33a7df7640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:48.855 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.845+0000 7f33a7df7640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:15:48.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.845+0000 7f33a7df7640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f33a00c7e20 0x7f33a014d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:48.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.845+0000 7f33a7df7640 10 monclient(hunting): picked mon.noname-a con 0x7f33a00c7e20 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:15:48.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.845+0000 7f33a7df7640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f33a015b000 0x7f33a01f3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:48.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.845+0000 7f33a7df7640 10 monclient(hunting): picked mon.noname-b con 0x7f33a015b000 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:15:48.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.845+0000 7f33a7df7640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f33a015d370 0x7f33a01f3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:48.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.845+0000 7f33a7df7640 10 monclient(hunting): picked mon.noname-c con 0x7f33a015d370 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:15:48.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.845+0000 7f33a7df7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:48.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.845+0000 7f33a7df7640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f33a00c96d0 con 0x7f33a00c7e20 2026-02-17T11:15:48.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.845+0000 7f33a7df7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:48.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.845+0000 7f33a7df7640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f33a00c8ed0 con 0x7f33a015b000 2026-02-17T11:15:48.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.845+0000 7f33a7df7640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:48.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.845+0000 7f33a7df7640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f33a01f1650 con 0x7f33a015d370 2026-02-17T11:15:48.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.845+0000 7f33a7df7640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:48.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.845+0000 7f33a7df7640 10 monclient(hunting): authenticate will time out at 1425.508234s 2026-02-17T11:15:48.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.845+0000 7f33a636d640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f33a015d370 0x7f33a01f3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:48.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.845+0000 7f33a5b6c640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f33a00c7e20 0x7f33a014d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:48.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.845+0000 7f33a536b640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f33a015b000 0x7f33a01f3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:48.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.845+0000 7f33a636d640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f33a015d370 0x7f33a01f3690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:53366/0 (socket says 10.20.193.49:53366) 2026-02-17T11:15:48.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.845+0000 7f33a636d640 1 -- 10.20.193.49:0/1963408376 learned_addr learned my addr 10.20.193.49:0/1963408376 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:48.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.845+0000 7f33a636d640 10 monclient(hunting): get_auth_request con 0x7f33a015d370 auth_method 0 2026-02-17T11:15:48.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.845+0000 7f33a636d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:48.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.845+0000 7f33a636d640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:48.856 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.845+0000 7f33a636d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:48.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.845+0000 7f33a5b6c640 10 monclient(hunting): get_auth_request con 0x7f33a00c7e20 auth_method 0 2026-02-17T11:15:48.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.845+0000 7f33a5b6c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:48.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.845+0000 7f33a5b6c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:48.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.845+0000 7f33a5b6c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:48.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.845+0000 7f33a536b640 10 monclient(hunting): get_auth_request con 0x7f33a015b000 auth_method 0 2026-02-17T11:15:48.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.845+0000 7f33a536b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:48.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.845+0000 7f33a536b640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:48.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.845+0000 7f33a536b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:48.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.845+0000 7f33a636d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:48.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.845+0000 7f33a636d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:48.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.845+0000 7f33a636d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:48.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.846+0000 7f33a5b6c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:48.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.846+0000 7f33a5b6c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:48.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.846+0000 7f33a5b6c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:48.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.846+0000 7f33a536b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:48.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.846+0000 7f33a536b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:48.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.846+0000 7f33a536b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:48.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.847+0000 7f33a636d640 10 monclient(hunting): handle_auth_done global_id 5345 payload 824 2026-02-17T11:15:48.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.847+0000 7f33a636d640 1 -- 10.20.193.49:0/1963408376 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f33a015b000 msgr2=0x7f33a01f3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:48.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.847+0000 7f33a636d640 1 --2- 10.20.193.49:0/1963408376 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f33a015b000 0x7f33a01f3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:48.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.847+0000 7f33a636d640 1 -- 10.20.193.49:0/1963408376 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f33a00c7e20 msgr2=0x7f33a014d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:48.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.847+0000 7f33a636d640 1 --2- 10.20.193.49:0/1963408376 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f33a00c7e20 0x7f33a014d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:48.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.847+0000 7f33a636d640 10 monclient: _finish_hunting 0 2026-02-17T11:15:48.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.847+0000 7f33a636d640 1 monclient: found mon.noname-c 2026-02-17T11:15:48.857 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.847+0000 7f33a636d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:48.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.847+0000 7f33a636d640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:15:48.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.847+0000 7f33a636d640 1 -- 10.20.193.49:0/1963408376 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33a014b120 con 0x7f33a015d370 2026-02-17T11:15:48.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.848+0000 7f33a636d640 1 --2- 10.20.193.49:0/1963408376 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f33a015d370 0x7f33a01f3690 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f339c00cc50 tx=0x7f339c00a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:48.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.848+0000 7f338e7fc640 10 client.?.objecter ms_handle_connect 0x7f33a015d370 2026-02-17T11:15:48.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.848+0000 7f338e7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T11:15:48.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.849+0000 7f338e7fc640 1 -- 10.20.193.49:0/1963408376 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f339c003a70 con 0x7f33a015d370 2026-02-17T11:15:48.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.849+0000 7f338e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:48.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.849+0000 7f338e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:15:48.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.849+0000 7f338e7fc640 10 monclient: dump: 2026-02-17T11:15:48.858 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:48.858 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:48.858 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:48.858 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:48.858 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:48.858 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:48.858 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:48.858 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:48.858 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:48.858 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:48.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.849+0000 7f338e7fc640 10 monclient: _finish_auth 0 2026-02-17T11:15:48.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.849+0000 7f338e7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:15:48.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.849+0000 7f338e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:48.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.849+0000 7f33a7df7640 5 monclient: authenticate success, global_id 5345 2026-02-17T11:15:48.858 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.849+0000 7f33a7df7640 10 monclient: _renew_subs 2026-02-17T11:15:48.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.849+0000 7f33a7df7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:15:48.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.849+0000 7f33a7df7640 1 -- 10.20.193.49:0/1963408376 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33a014b400 con 0x7f33a015d370 2026-02-17T11:15:48.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.849+0000 7f33a7df7640 10 client.5345.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:48.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.849+0000 7f33a7df7640 10 monclient: _renew_subs 2026-02-17T11:15:48.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.849+0000 7f33a7df7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:15:48.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.849+0000 7f33a7df7640 1 -- 10.20.193.49:0/1963408376 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33a01f2950 con 0x7f33a015d370 2026-02-17T11:15:48.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.849+0000 7f33a7df7640 1 librados: init done 2026-02-17T11:15:48.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.850+0000 7f33a7df7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:48.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.850+0000 7f338e7fc640 1 -- 10.20.193.49:0/1963408376 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f339c003c10 con 0x7f33a015d370 2026-02-17T11:15:48.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.850+0000 7f33a7df7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:48.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.850+0000 7f33a7df7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:15:48.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.850+0000 7f33a7df7640 1 -- 10.20.193.49:0/1963408376 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33a00c7af0 con 0x7f33a015d370 2026-02-17T11:15:48.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.850+0000 7f338e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:48.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.850+0000 7f338e7fc640 1 -- 10.20.193.49:0/1963408376 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f339c0050d0 con 0x7f33a015d370 2026-02-17T11:15:48.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.850+0000 7f338e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:48.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.850+0000 7f338e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:15:48.859 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.850+0000 7f338e7fc640 10 monclient: dump: 2026-02-17T11:15:48.859 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:48.859 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:48.859 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:48.859 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:48.859 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:48.859 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:48.859 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:48.860 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:48.860 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:48.860 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:48.860 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.850+0000 7f338ffff640 4 set_mon_vals no callback set 2026-02-17T11:15:48.959 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.957+0000 7f338e7fc640 1 -- 10.20.193.49:0/1963408376 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f339c005270 con 0x7f33a015d370 2026-02-17T11:15:48.960 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.957+0000 7f338e7fc640 1 --2- 10.20.193.49:0/1963408376 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3370079170 0x7f337007b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:48.960 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.957+0000 7f33a5b6c640 1 --2- 10.20.193.49:0/1963408376 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3370079170 0x7f337007b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:48.960 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.957+0000 7f33a5b6c640 10 monclient: get_auth_request con 0x7f3370079170 auth_method 0 2026-02-17T11:15:48.960 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.958+0000 7f33a5b6c640 1 --2- 10.20.193.49:0/1963408376 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3370079170 0x7f337007b630 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3390009ba0 tx=0x7f3390009290 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:48.960 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.958+0000 7f338e7fc640 10 client.5345.objecter ms_handle_connect 0x7f3370079170 2026-02-17T11:15:48.962 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.959+0000 7f338e7fc640 1 -- 10.20.193.49:0/1963408376 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f339c0983f0 con 0x7f33a015d370 2026-02-17T11:15:48.962 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.959+0000 7f338e7fc640 10 client.5345.objecter ms_dispatch2 0x7f33a0000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:15:48.962 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.959+0000 7f338e7fc640 3 client.5345.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:15:48.962 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.959+0000 7f338e7fc640 3 client.5345.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:15:48.962 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.959+0000 7f338e7fc640 20 client.5345.objecter dump_active .. 0 homeless 2026-02-17T11:15:48.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.966+0000 7f338e7fc640 1 -- 10.20.193.49:0/1963408376 <== mon.2 v2:10.20.193.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f33a00c7af0 con 0x7f33a015d370 2026-02-17T11:15:48.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.966+0000 7f338e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:48.967 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:48.966+0000 7f338e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:15:49.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.051+0000 7f33a7df7640 1 -- 10.20.193.49:0/1963408376 --> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "14", "target": ["mon-mgr", ""]}) -- 0x7f33a014b8c0 con 0x7f3370079170 2026-02-17T11:15:49.053 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.051+0000 7f338e7fc640 1 -- 10.20.193.49:0/1963408376 <== mgr.4106 v2:10.20.193.162:6800/2614632098 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 14 to deep-scrub) ==== 42+0+0 (secure 0 0 0) 0x7f33a014b8c0 con 0x7f3370079170 2026-02-17T11:15:49.053 INFO:teuthology.orchestra.run.trial049.stderr:instructed osd(s) 14 to deep-scrub 2026-02-17T11:15:49.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.052+0000 7f33a7df7640 10 librados: watch_flush enter 2026-02-17T11:15:49.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.052+0000 7f33a7df7640 10 librados: watch_flush exit 2026-02-17T11:15:49.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.052+0000 7f33a7df7640 20 client.5345.objecter shutdown clearing up homeless session... 2026-02-17T11:15:49.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.052+0000 7f33a7df7640 10 client.5345.objecter successfully canceled tick 2026-02-17T11:15:49.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.052+0000 7f33a7df7640 1 -- 10.20.193.49:0/1963408376 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3370079170 msgr2=0x7f337007b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:49.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.052+0000 7f33a7df7640 1 --2- 10.20.193.49:0/1963408376 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3370079170 0x7f337007b630 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3390009ba0 tx=0x7f3390009290 comp rx=0 tx=0).stop 2026-02-17T11:15:49.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.052+0000 7f33a7df7640 10 monclient: shutdown 2026-02-17T11:15:49.055 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.052+0000 7f33a7df7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:49.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.052+0000 7f33a7df7640 1 -- 10.20.193.49:0/1963408376 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f33a015d370 msgr2=0x7f33a01f3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:49.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.052+0000 7f33a7df7640 1 --2- 10.20.193.49:0/1963408376 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f33a015d370 0x7f33a01f3690 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f339c00cc50 tx=0x7f339c00a430 comp rx=0 tx=0).stop 2026-02-17T11:15:49.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.053+0000 7f33a7df7640 1 -- 10.20.193.49:0/1963408376 shutdown_connections 2026-02-17T11:15:49.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.053+0000 7f33a7df7640 1 --2- 10.20.193.49:0/1963408376 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3370079170 0x7f337007b630 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:49.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.053+0000 7f33a7df7640 1 --2- 10.20.193.49:0/1963408376 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f33a015d370 0x7f33a01f3690 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:49.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.053+0000 7f33a7df7640 1 --2- 10.20.193.49:0/1963408376 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f33a015b000 0x7f33a01f3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:49.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.053+0000 7f33a7df7640 1 --2- 10.20.193.49:0/1963408376 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f33a00c7e20 0x7f33a014d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:49.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.053+0000 7f33a7df7640 1 -- 10.20.193.49:0/1963408376 >> 10.20.193.49:0/1963408376 conn(0x7f33a00c9f20 msgr2=0x7f33a00ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:49.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.053+0000 7f33a7df7640 1 -- 10.20.193.49:0/1963408376 shutdown_connections 2026-02-17T11:15:49.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.053+0000 7f33a7df7640 1 -- 10.20.193.49:0/1963408376 wait complete. 2026-02-17T11:15:49.056 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.053+0000 7f33a7df7640 1 librados: shutdown 2026-02-17T11:15:49.063 INFO:tasks.ceph:Scrubbing osd.3 2026-02-17T11:15:49.063 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2026-02-17T11:15:49.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.129+0000 7feb94491640 10 monclient: get_monmap_and_config 2026-02-17T11:15:49.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.129+0000 7feb94491640 10 monclient: build_initial_monmap 2026-02-17T11:15:49.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.129+0000 7feb94491640 10 monclient: monmap: 2026-02-17T11:15:49.131 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:49.131 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:49.131 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:15:49.130490+0000 2026-02-17T11:15:49.132 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:15:49.130490+0000 2026-02-17T11:15:49.132 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:49.132 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:49.132 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:15:49.132 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:15:49.132 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:15:49.132 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:15:49.132 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:15:49.132 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:15:49.132 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:49.135 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.130+0000 7feb94491640 1 Processor -- start 2026-02-17T11:15:49.135 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.130+0000 7feb94491640 1 -- start start 2026-02-17T11:15:49.135 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.130+0000 7feb94491640 10 monclient: init 2026-02-17T11:15:49.135 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.130+0000 7feb94491640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:49.135 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.130+0000 7feb94491640 10 monclient: _add_conns ranks=[1,2,5,0,4,3] 2026-02-17T11:15:49.135 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.130+0000 7feb94491640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7feb8c15d3c0 addr v1:10.20.193.97:6789/0 2026-02-17T11:15:49.135 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.130+0000 7feb94491640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7feb8c0c94c0 addr v1:10.20.193.157:6789/0 2026-02-17T11:15:49.135 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.130+0000 7feb94491640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7feb8c15d7a0 0x7feb8c15b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:49.135 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.130+0000 7feb94491640 10 monclient(hunting): picked mon.noname-c con 0x7feb8c15d7a0 addr v2:10.20.193.157:3300/0 2026-02-17T11:15:49.136 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.130+0000 7feb94491640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb8c0c7e60 con 0x7feb8c15d3c0 2026-02-17T11:15:49.136 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.130+0000 7feb94491640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb8c0c8140 con 0x7feb8c0c94c0 2026-02-17T11:15:49.136 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.130+0000 7feb94491640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:49.136 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.130+0000 7feb94491640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7feb8c0c8420 con 0x7feb8c15d7a0 2026-02-17T11:15:49.136 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.130+0000 7feb94491640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:49.136 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.130+0000 7feb94491640 10 monclient(hunting): authenticate will time out at 1425.793986s 2026-02-17T11:15:49.136 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.131+0000 7feb92a07640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7feb8c15d7a0 0x7feb8c15b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:49.136 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.131+0000 7feb92206640 1 --1- >> v1:10.20.193.97:6789/0 conn(0x7feb8c15d3c0 0x7feb8c0c7300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.97:6789/0 says I am v1:10.20.193.49:49856/0 (socket says 10.20.193.49:49856) 2026-02-17T11:15:49.136 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.131+0000 7feb92206640 1 -- 10.20.193.49:0/2543539188 learned_addr learned my addr 10.20.193.49:0/2543539188 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:15:49.136 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.131+0000 7feb92a07640 10 monclient(hunting): get_auth_request con 0x7feb8c15d7a0 auth_method 0 2026-02-17T11:15:49.136 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.131+0000 7feb92a07640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:49.136 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.131+0000 7feb92a07640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:49.136 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.131+0000 7feb92a07640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:49.137 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.131+0000 7feb92a07640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:49.137 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.131+0000 7feb92a07640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:49.137 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.132+0000 7feb92a07640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:49.137 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.132+0000 7feb91204640 1 -- 10.20.193.49:0/2543539188 <== mon.1 v1:10.20.193.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 835754940 0 0) 0x7feb8c0c7e60 con 0x7feb8c15d3c0 2026-02-17T11:15:49.137 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.132+0000 7feb91204640 10 monclient(hunting): _negotiate 2026-02-17T11:15:49.137 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.132+0000 7feb91204640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:49.137 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.132+0000 7feb91204640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:49.137 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.132+0000 7feb91204640 10 monclient(hunting): my global_id is 5269 2026-02-17T11:15:49.137 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.133+0000 7feb91204640 1 -- 10.20.193.49:0/2543539188 --> v1:10.20.193.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb74003620 con 0x7feb8c15d3c0 2026-02-17T11:15:49.137 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.133+0000 7feb92a07640 10 monclient(hunting): handle_auth_done global_id 5348 payload 274 2026-02-17T11:15:49.137 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.133+0000 7feb92a07640 1 -- 10.20.193.49:0/2543539188 >> v1:10.20.193.157:6789/0 conn(0x7feb8c0c94c0 legacy=0x7feb8c0c52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:49.137 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.133+0000 7feb92a07640 1 -- 10.20.193.49:0/2543539188 >> v1:10.20.193.97:6789/0 conn(0x7feb8c15d3c0 legacy=0x7feb8c0c7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:49.138 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.133+0000 7feb92a07640 10 monclient: _finish_hunting 0 2026-02-17T11:15:49.138 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.133+0000 7feb92a07640 1 monclient: found mon.noname-c 2026-02-17T11:15:49.138 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.133+0000 7feb92a07640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:49.138 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.133+0000 7feb92a07640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:15:49.138 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.133+0000 7feb92a07640 1 -- 10.20.193.49:0/2543539188 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb8c0c8700 con 0x7feb8c15d7a0 2026-02-17T11:15:49.143 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.135+0000 7feb92a07640 1 --2- 10.20.193.49:0/2543539188 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7feb8c15d7a0 0x7feb8c15b050 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7feb88009d90 tx=0x7feb8802f360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96d11974187a1dc6 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:49.143 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.137+0000 7feb91204640 1 -- 10.20.193.49:0/2543539188 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb8803c070 con 0x7feb8c15d7a0 2026-02-17T11:15:49.143 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.137+0000 7feb91204640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:49.143 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.137+0000 7feb91204640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:15:49.143 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.137+0000 7feb91204640 10 monclient: dump: 2026-02-17T11:15:49.143 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:49.144 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:49.144 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:49.144 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:49.144 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:49.144 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:49.144 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:49.144 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:49.144 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:49.144 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:49.144 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.137+0000 7feb91204640 10 monclient: _finish_auth 0 2026-02-17T11:15:49.144 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.137+0000 7feb91204640 10 monclient: _check_auth_tickets 2026-02-17T11:15:49.144 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.137+0000 7feb91204640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:49.144 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.137+0000 7feb91204640 1 -- 10.20.193.49:0/2543539188 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb88037640 con 0x7feb8c15d7a0 2026-02-17T11:15:49.145 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.137+0000 7feb91204640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:49.145 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.137+0000 7feb94491640 5 monclient: authenticate success, global_id 5348 2026-02-17T11:15:49.145 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.137+0000 7feb91204640 1 -- 10.20.193.49:0/2543539188 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb88037a10 con 0x7feb8c15d7a0 2026-02-17T11:15:49.145 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.137+0000 7feb91204640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:49.145 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.137+0000 7feb91204640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:15:49.145 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.137+0000 7feb91204640 10 monclient: dump: 2026-02-17T11:15:49.145 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:49.145 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:49.145 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:49.145 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:49.145 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:49.145 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:49.146 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:49.146 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:49.146 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:49.146 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:49.146 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.137+0000 7feb94491640 10 monclient: get_monmap_and_config success 2026-02-17T11:15:49.146 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.137+0000 7feb94491640 4 set_mon_vals no callback set 2026-02-17T11:15:49.146 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.137+0000 7feb94491640 10 monclient: shutdown 2026-02-17T11:15:49.146 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.137+0000 7feb94491640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:49.146 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.137+0000 7feb94491640 1 -- 10.20.193.49:0/2543539188 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7feb8c15d7a0 msgr2=0x7feb8c15b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:49.146 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.137+0000 7feb94491640 1 --2- 10.20.193.49:0/2543539188 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7feb8c15d7a0 0x7feb8c15b050 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7feb88009d90 tx=0x7feb8802f360 comp rx=0 tx=0).stop 2026-02-17T11:15:49.146 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.137+0000 7feb94491640 1 -- 10.20.193.49:0/2543539188 shutdown_connections 2026-02-17T11:15:49.146 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.137+0000 7feb94491640 1 --2- 10.20.193.49:0/2543539188 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7feb8c15d7a0 0x7feb8c15b050 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:49.146 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.137+0000 7feb94491640 1 -- 10.20.193.49:0/2543539188 >> 10.20.193.49:0/2543539188 conn(0x7feb8c0c9f60 msgr2=0x7feb8c0ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:49.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.137+0000 7feb94491640 1 -- 10.20.193.49:0/2543539188 shutdown_connections 2026-02-17T11:15:49.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.137+0000 7feb94491640 1 -- 10.20.193.49:0/2543539188 wait complete. 2026-02-17T11:15:49.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.138+0000 7feb94491640 10 monclient: build_initial_monmap 2026-02-17T11:15:49.147 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.138+0000 7feb94491640 10 monclient: monmap: 2026-02-17T11:15:49.147 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:49.147 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:15:49.147 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:15:49.147 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:15:49.147 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:49.147 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:49.147 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:15:49.147 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:15:49.147 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:15:49.148 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:49.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.138+0000 7feb94491640 1 librados: starting msgr at 2026-02-17T11:15:49.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.138+0000 7feb94491640 1 librados: starting objecter 2026-02-17T11:15:49.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.138+0000 7feb94491640 1 Processor -- start 2026-02-17T11:15:49.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.138+0000 7feb94491640 1 -- start start 2026-02-17T11:15:49.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.138+0000 7feb94491640 1 librados: setting wanted keys 2026-02-17T11:15:49.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.138+0000 7feb94491640 1 librados: calling monclient init 2026-02-17T11:15:49.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.138+0000 7feb94491640 10 monclient: init 2026-02-17T11:15:49.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.139+0000 7feb94491640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:49.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.139+0000 7feb94491640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T11:15:49.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.139+0000 7feb94491640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7feb8c0c94c0 0x7feb8c1594d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:49.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.139+0000 7feb94491640 10 monclient(hunting): picked mon.noname-c con 0x7feb8c0c94c0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:15:49.148 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.139+0000 7feb94491640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7feb8c15d3c0 0x7feb8c06e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:49.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.139+0000 7feb94491640 10 monclient(hunting): picked mon.noname-b con 0x7feb8c15d3c0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:15:49.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.139+0000 7feb94491640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7feb8c15d7a0 0x7feb8c1f6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:49.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.139+0000 7feb94491640 10 monclient(hunting): picked mon.noname-a con 0x7feb8c15d7a0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:15:49.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.139+0000 7feb94491640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:49.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.139+0000 7feb94491640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7feb8c0c8fa0 con 0x7feb8c15d7a0 2026-02-17T11:15:49.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.139+0000 7feb94491640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:49.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.139+0000 7feb94491640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7feb8c0c8cc0 con 0x7feb8c15d3c0 2026-02-17T11:15:49.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.139+0000 7feb94491640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:49.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.139+0000 7feb94491640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7feb8c0c5a00 con 0x7feb8c0c94c0 2026-02-17T11:15:49.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.139+0000 7feb94491640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:49.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.139+0000 7feb94491640 10 monclient(hunting): authenticate will time out at 1425.802376s 2026-02-17T11:15:49.149 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.139+0000 7feb92a07640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7feb8c15d7a0 0x7feb8c1f6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:49.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.139+0000 7feb92206640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7feb8c0c94c0 0x7feb8c1594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:49.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.139+0000 7feb91a05640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7feb8c15d3c0 0x7feb8c06e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:49.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.139+0000 7feb92a07640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7feb8c15d7a0 0x7feb8c1f6ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:43284/0 (socket says 10.20.193.49:43284) 2026-02-17T11:15:49.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.139+0000 7feb92a07640 1 -- 10.20.193.49:0/184594877 learned_addr learned my addr 10.20.193.49:0/184594877 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:49.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.139+0000 7feb92a07640 10 monclient(hunting): get_auth_request con 0x7feb8c15d7a0 auth_method 0 2026-02-17T11:15:49.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.139+0000 7feb92a07640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:49.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.139+0000 7feb92a07640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:49.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.139+0000 7feb92a07640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:49.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.139+0000 7feb92206640 10 monclient(hunting): get_auth_request con 0x7feb8c0c94c0 auth_method 0 2026-02-17T11:15:49.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.139+0000 7feb92206640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:49.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.140+0000 7feb92206640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:49.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.140+0000 7feb92206640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:49.150 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.140+0000 7feb91a05640 10 monclient(hunting): get_auth_request con 0x7feb8c15d3c0 auth_method 0 2026-02-17T11:15:49.151 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.140+0000 7feb91a05640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:49.151 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.140+0000 7feb91a05640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:49.151 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.140+0000 7feb91a05640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:49.151 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.140+0000 7feb92a07640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:49.151 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.140+0000 7feb92a07640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:49.151 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.140+0000 7feb92a07640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:49.151 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.140+0000 7feb92206640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:49.151 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.140+0000 7feb92206640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:49.151 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.140+0000 7feb92206640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:49.151 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.140+0000 7feb91a05640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:49.151 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.140+0000 7feb91a05640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:49.151 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.140+0000 7feb91a05640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:49.151 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.141+0000 7feb91a05640 10 monclient(hunting): handle_auth_done global_id 5272 payload 824 2026-02-17T11:15:49.151 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.141+0000 7feb91a05640 1 -- 10.20.193.49:0/184594877 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7feb8c0c94c0 msgr2=0x7feb8c1594d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:49.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.141+0000 7feb91a05640 1 --2- 10.20.193.49:0/184594877 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7feb8c0c94c0 0x7feb8c1594d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:49.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.141+0000 7feb91a05640 1 -- 10.20.193.49:0/184594877 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7feb8c15d7a0 msgr2=0x7feb8c1f6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:49.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.141+0000 7feb91a05640 1 --2- 10.20.193.49:0/184594877 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7feb8c15d7a0 0x7feb8c1f6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:49.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.141+0000 7feb91a05640 10 monclient: _finish_hunting 0 2026-02-17T11:15:49.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.141+0000 7feb91a05640 1 monclient: found mon.noname-b 2026-02-17T11:15:49.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.141+0000 7feb91a05640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:49.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.141+0000 7feb91a05640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:15:49.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.141+0000 7feb91a05640 1 -- 10.20.193.49:0/184594877 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb8c06d690 con 0x7feb8c15d3c0 2026-02-17T11:15:49.152 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.141+0000 7feb92206640 1 --2- 10.20.193.49:0/184594877 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7feb8c0c94c0 0x7feb8c1594d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T11:15:49.155 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.142+0000 7feb91a05640 1 --2- 10.20.193.49:0/184594877 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7feb8c15d3c0 0x7feb8c06e130 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7feb8000c4e0 tx=0x7feb8000c9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:49.155 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.142+0000 7feb72ffd640 10 client.?.objecter ms_handle_connect 0x7feb8c15d3c0 2026-02-17T11:15:49.155 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.142+0000 7feb72ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:15:49.155 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.143+0000 7feb72ffd640 1 -- 10.20.193.49:0/184594877 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb800052d0 con 0x7feb8c15d3c0 2026-02-17T11:15:49.155 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.143+0000 7feb72ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:49.155 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.143+0000 7feb72ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:15:49.155 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.143+0000 7feb72ffd640 10 monclient: dump: 2026-02-17T11:15:49.155 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:49.155 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:49.156 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:49.156 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:49.156 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:49.156 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:49.156 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:49.156 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:49.156 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:49.156 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:49.156 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.143+0000 7feb72ffd640 10 monclient: _finish_auth 0 2026-02-17T11:15:49.156 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.143+0000 7feb72ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:15:49.156 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.143+0000 7feb72ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:49.156 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.143+0000 7feb94491640 5 monclient: authenticate success, global_id 5272 2026-02-17T11:15:49.157 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.143+0000 7feb94491640 10 monclient: _renew_subs 2026-02-17T11:15:49.157 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.143+0000 7feb94491640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:15:49.157 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.143+0000 7feb94491640 1 -- 10.20.193.49:0/184594877 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb8c1f7360 con 0x7feb8c15d3c0 2026-02-17T11:15:49.157 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.143+0000 7feb94491640 10 client.5272.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:49.157 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.143+0000 7feb94491640 10 monclient: _renew_subs 2026-02-17T11:15:49.157 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.143+0000 7feb94491640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:15:49.157 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.143+0000 7feb94491640 1 -- 10.20.193.49:0/184594877 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb8c06d930 con 0x7feb8c15d3c0 2026-02-17T11:15:49.157 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.143+0000 7feb94491640 1 librados: init done 2026-02-17T11:15:49.157 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.144+0000 7feb94491640 10 client.5272.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:49.157 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.144+0000 7feb94491640 15 client.5272.objecter _session_command_op_assign -1 1 2026-02-17T11:15:49.157 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.144+0000 7feb94491640 20 client.5272.objecter _get_session osd=-1 returning homeless 2026-02-17T11:15:49.157 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.144+0000 7feb94491640 10 client.5272.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:49.157 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.144+0000 7feb94491640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:15:49.158 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.144+0000 7feb94491640 1 -- 10.20.193.49:0/184594877 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7feb8c06def0 con 0x7feb8c15d3c0 2026-02-17T11:15:49.158 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.144+0000 7feb72ffd640 1 -- 10.20.193.49:0/184594877 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb8c06def0 con 0x7feb8c15d3c0 2026-02-17T11:15:49.158 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.144+0000 7feb72ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:49.158 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.144+0000 7feb72ffd640 1 -- 10.20.193.49:0/184594877 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb800036f0 con 0x7feb8c15d3c0 2026-02-17T11:15:49.158 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.144+0000 7feb72ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:49.158 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.144+0000 7feb72ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:15:49.158 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.144+0000 7feb90a03640 4 set_mon_vals no callback set 2026-02-17T11:15:49.158 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.144+0000 7feb72ffd640 10 monclient: dump: 2026-02-17T11:15:49.158 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:49.158 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:49.158 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:49.158 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:49.158 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:49.159 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:49.159 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:49.159 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:49.159 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:49.159 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:49.161 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.156+0000 7feb72ffd640 1 -- 10.20.193.49:0/184594877 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7feb80003890 con 0x7feb8c15d3c0 2026-02-17T11:15:49.161 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.156+0000 7feb72ffd640 1 --2- 10.20.193.49:0/184594877 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7feb5c079170 0x7feb5c07b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:49.161 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.157+0000 7feb92206640 1 --2- 10.20.193.49:0/184594877 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7feb5c079170 0x7feb5c07b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:49.161 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.157+0000 7feb92206640 10 monclient: get_auth_request con 0x7feb5c079170 auth_method 0 2026-02-17T11:15:49.161 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.157+0000 7feb92206640 1 --2- 10.20.193.49:0/184594877 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7feb5c079170 0x7feb5c07b630 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7feb7c005980 tx=0x7feb7c007dd0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:49.161 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.157+0000 7feb72ffd640 10 client.5272.objecter ms_handle_connect 0x7feb5c079170 2026-02-17T11:15:49.161 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.158+0000 7feb72ffd640 1 -- 10.20.193.49:0/184594877 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7feb800979c0 con 0x7feb8c15d3c0 2026-02-17T11:15:49.161 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.158+0000 7feb72ffd640 10 client.5272.objecter ms_dispatch2 0x7feb8c000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:15:49.162 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.158+0000 7feb72ffd640 3 client.5272.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:15:49.162 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.158+0000 7feb72ffd640 3 client.5272.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:15:49.162 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.158+0000 7feb72ffd640 10 client.5272.objecter checking command 1 2026-02-17T11:15:49.162 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.158+0000 7feb72ffd640 1 --2- 10.20.193.49:0/184594877 >> [v2:10.20.193.162:6818/1543573918,v1:10.20.193.162:6820/1543573918] conn(0x7feb5c081650 0x7feb5c083a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:49.162 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.158+0000 7feb72ffd640 20 client.5272.objecter _get_session s=0x7feb5c080f80 osd=3 3 2026-02-17T11:15:49.162 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.158+0000 7feb72ffd640 20 client.5272.objecter put_session s=0x7feb5c080f80 osd=3 3 2026-02-17T11:15:49.162 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.158+0000 7feb72ffd640 15 client.5272.objecter _session_command_op_remove -1 1 2026-02-17T11:15:49.162 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.158+0000 7feb72ffd640 20 client.5272.objecter _get_session s=0x7feb5c080f80 osd=3 3 2026-02-17T11:15:49.162 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.158+0000 7feb72ffd640 20 client.5272.objecter get_session s=0x7feb5c080f80 osd=3 3 2026-02-17T11:15:49.162 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.158+0000 7feb72ffd640 15 client.5272.objecter _session_command_op_assign 3 1 2026-02-17T11:15:49.162 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.158+0000 7feb72ffd640 20 client.5272.objecter put_session s=0x7feb5c080f80 osd=3 4 2026-02-17T11:15:49.162 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.158+0000 7feb72ffd640 10 client.5272.objecter _send_command 1 2026-02-17T11:15:49.163 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.158+0000 7feb72ffd640 1 -- 10.20.193.49:0/184594877 --> [v2:10.20.193.162:6818/1543573918,v1:10.20.193.162:6820/1543573918] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feb5c084140 con 0x7feb5c081650 2026-02-17T11:15:49.163 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.158+0000 7feb72ffd640 20 client.5272.objecter dump_active .. 0 homeless 2026-02-17T11:15:49.163 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.158+0000 7feb72ffd640 1 -- 10.20.193.49:0/184594877 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7feb8005e370 con 0x7feb8c15d3c0 2026-02-17T11:15:49.163 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.158+0000 7feb72ffd640 10 monclient: handle_get_version_reply finishing 1 version 34 2026-02-17T11:15:49.163 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.159+0000 7feb92a07640 1 --2- 10.20.193.49:0/184594877 >> [v2:10.20.193.162:6818/1543573918,v1:10.20.193.162:6820/1543573918] conn(0x7feb5c081650 0x7feb5c083a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:49.163 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.159+0000 7feb92a07640 10 monclient: get_auth_request con 0x7feb5c081650 auth_method 0 2026-02-17T11:15:49.163 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.161+0000 7feb92a07640 1 --2- 10.20.193.49:0/184594877 >> [v2:10.20.193.162:6818/1543573918,v1:10.20.193.162:6820/1543573918] conn(0x7feb5c081650 0x7feb5c083a70 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:49.163 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.161+0000 7feb72ffd640 10 client.5272.objecter ms_handle_connect 0x7feb5c081650 2026-02-17T11:15:49.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.170+0000 7feb72ffd640 1 -- 10.20.193.49:0/184594877 <== osd.3 v2:10.20.193.162:6818/1543573918 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7feb5c084140 con 0x7feb5c081650 2026-02-17T11:15:49.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.170+0000 7feb72ffd640 10 client.5272.objecter ms_dispatch2 0x7feb8c000b90 command_reply(tid 1: 0 ) 2026-02-17T11:15:49.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.170+0000 7feb72ffd640 10 client.5272.objecter _finish_command 1 = system:0 2026-02-17T11:15:49.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.170+0000 7feb72ffd640 20 client.5272.objecter put_session s=0x7feb5c080f80 osd=3 4 2026-02-17T11:15:49.172 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.170+0000 7feb72ffd640 15 client.5272.objecter _session_command_op_remove 3 1 2026-02-17T11:15:49.178 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.176+0000 7feb94491640 10 client.5272.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T11:15:49.178 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.176+0000 7feb94491640 15 client.5272.objecter _session_command_op_assign -1 2 2026-02-17T11:15:49.178 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.176+0000 7feb94491640 20 client.5272.objecter _get_session s=0x7feb5c080f80 osd=3 3 2026-02-17T11:15:49.178 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.176+0000 7feb94491640 20 client.5272.objecter put_session s=0x7feb5c080f80 osd=3 3 2026-02-17T11:15:49.178 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.176+0000 7feb94491640 20 client.5272.objecter _get_session s=0x7feb5c080f80 osd=3 3 2026-02-17T11:15:49.178 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.176+0000 7feb94491640 15 client.5272.objecter _session_command_op_remove -1 2 2026-02-17T11:15:49.178 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.176+0000 7feb94491640 20 client.5272.objecter get_session s=0x7feb5c080f80 osd=3 3 2026-02-17T11:15:49.178 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.176+0000 7feb94491640 15 client.5272.objecter _session_command_op_assign 3 2 2026-02-17T11:15:49.178 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.176+0000 7feb94491640 20 client.5272.objecter put_session s=0x7feb5c080f80 osd=3 4 2026-02-17T11:15:49.179 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.176+0000 7feb94491640 10 client.5272.objecter _send_command 2 2026-02-17T11:15:49.179 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.176+0000 7feb94491640 1 -- 10.20.193.49:0/184594877 --> [v2:10.20.193.162:6818/1543573918,v1:10.20.193.162:6820/1543573918] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7feb8c15b050 con 0x7feb5c081650 2026-02-17T11:15:49.185 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.184+0000 7feb72ffd640 1 -- 10.20.193.49:0/184594877 <== osd.3 v2:10.20.193.162:6818/1543573918 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7feb8c15b050 con 0x7feb5c081650 2026-02-17T11:15:49.185 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.184+0000 7feb72ffd640 10 client.5272.objecter ms_dispatch2 0x7feb8c000b90 command_reply(tid 2: 0 ) 2026-02-17T11:15:49.185 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.184+0000 7feb72ffd640 10 client.5272.objecter _finish_command 2 = system:0 2026-02-17T11:15:49.185 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.184+0000 7feb72ffd640 20 client.5272.objecter put_session s=0x7feb5c080f80 osd=3 4 2026-02-17T11:15:49.185 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.184+0000 7feb72ffd640 15 client.5272.objecter _session_command_op_remove 3 2 2026-02-17T11:15:49.186 INFO:teuthology.orchestra.run.trial049.stdout:{ 2026-02-17T11:15:49.186 INFO:teuthology.orchestra.run.trial049.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T11:15:49.186 INFO:teuthology.orchestra.run.trial049.stdout:} 2026-02-17T11:15:49.187 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.184+0000 7feb94491640 10 librados: watch_flush enter 2026-02-17T11:15:49.187 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.184+0000 7feb94491640 10 librados: watch_flush exit 2026-02-17T11:15:49.188 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.184+0000 7feb94491640 10 client.5272.objecter close_session for osd.3 2026-02-17T11:15:49.188 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.184+0000 7feb94491640 1 -- 10.20.193.49:0/184594877 >> [v2:10.20.193.162:6818/1543573918,v1:10.20.193.162:6820/1543573918] conn(0x7feb5c081650 msgr2=0x7feb5c083a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:49.188 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.184+0000 7feb94491640 1 --2- 10.20.193.49:0/184594877 >> [v2:10.20.193.162:6818/1543573918,v1:10.20.193.162:6820/1543573918] conn(0x7feb5c081650 0x7feb5c083a70 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:49.188 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.184+0000 7feb94491640 20 client.5272.objecter put_session s=0x7feb5c080f80 osd=3 1 2026-02-17T11:15:49.188 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.184+0000 7feb94491640 20 client.5272.objecter shutdown clearing up homeless session... 2026-02-17T11:15:49.188 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.184+0000 7feb94491640 10 client.5272.objecter successfully canceled tick 2026-02-17T11:15:49.188 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.184+0000 7feb94491640 1 -- 10.20.193.49:0/184594877 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7feb5c079170 msgr2=0x7feb5c07b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:49.188 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.184+0000 7feb94491640 1 --2- 10.20.193.49:0/184594877 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7feb5c079170 0x7feb5c07b630 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7feb7c005980 tx=0x7feb7c007dd0 comp rx=0 tx=0).stop 2026-02-17T11:15:49.188 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.184+0000 7feb94491640 10 monclient: shutdown 2026-02-17T11:15:49.188 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.184+0000 7feb94491640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:49.188 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.184+0000 7feb94491640 1 -- 10.20.193.49:0/184594877 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7feb8c15d3c0 msgr2=0x7feb8c06e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:49.189 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.184+0000 7feb94491640 1 --2- 10.20.193.49:0/184594877 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7feb8c15d3c0 0x7feb8c06e130 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7feb8000c4e0 tx=0x7feb8000c9b0 comp rx=0 tx=0).stop 2026-02-17T11:15:49.189 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.184+0000 7feb92a07640 1 -- 10.20.193.49:0/184594877 reap_dead start 2026-02-17T11:15:49.189 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.184+0000 7feb94491640 1 -- 10.20.193.49:0/184594877 shutdown_connections 2026-02-17T11:15:49.189 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.184+0000 7feb94491640 1 -- 10.20.193.49:0/184594877 >> 10.20.193.49:0/184594877 conn(0x7feb8c0c9f60 msgr2=0x7feb8c0cbaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:49.189 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.184+0000 7feb94491640 1 -- 10.20.193.49:0/184594877 shutdown_connections 2026-02-17T11:15:49.189 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.184+0000 7feb94491640 1 -- 10.20.193.49:0/184594877 wait complete. 2026-02-17T11:15:49.189 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.184+0000 7feb94491640 1 librados: shutdown 2026-02-17T11:15:49.192 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2026-02-17T11:15:49.260 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.258+0000 7fed2e66f640 10 monclient: get_monmap_and_config 2026-02-17T11:15:49.260 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.258+0000 7fed2e66f640 10 monclient: build_initial_monmap 2026-02-17T11:15:49.260 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.258+0000 7fed2e66f640 10 monclient: monmap: 2026-02-17T11:15:49.260 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:49.260 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:49.261 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:15:49.258830+0000 2026-02-17T11:15:49.261 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:15:49.258830+0000 2026-02-17T11:15:49.261 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:49.261 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:49.261 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:15:49.261 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:15:49.261 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:15:49.261 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:15:49.261 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:15:49.261 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:15:49.261 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:49.261 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.258+0000 7fed2e66f640 1 Processor -- start 2026-02-17T11:15:49.262 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.258+0000 7fed2e66f640 1 -- start start 2026-02-17T11:15:49.262 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.258+0000 7fed2e66f640 10 monclient: init 2026-02-17T11:15:49.267 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.259+0000 7fed2e66f640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:49.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.259+0000 7fed2e66f640 10 monclient: _add_conns ranks=[0,1,2,3,5,4] 2026-02-17T11:15:49.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.259+0000 7fed2e66f640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fed2815d370 addr v1:10.20.193.49:6789/0 2026-02-17T11:15:49.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.259+0000 7fed2e66f640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fed280c7e20 addr v1:10.20.193.97:6789/0 2026-02-17T11:15:49.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.259+0000 7fed2e66f640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fed280c59c0 addr v1:10.20.193.157:6789/0 2026-02-17T11:15:49.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.259+0000 7fed2e66f640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed280c8350 con 0x7fed2815d370 2026-02-17T11:15:49.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.259+0000 7fed2e66f640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed280c8630 con 0x7fed280c7e20 2026-02-17T11:15:49.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.259+0000 7fed2e66f640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed280c8910 con 0x7fed280c59c0 2026-02-17T11:15:49.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.259+0000 7fed2e66f640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:49.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.259+0000 7fed2e66f640 10 monclient(hunting): authenticate will time out at 1425.922284s 2026-02-17T11:15:49.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.259+0000 7fed27fff640 1 --1- >> v1:10.20.193.49:6789/0 conn(0x7fed2815d370 0x7fed2815b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.49:6789/0 says I am v1:10.20.193.49:36408/0 (socket says 10.20.193.49:36408) 2026-02-17T11:15:49.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.259+0000 7fed27fff640 1 -- 10.20.193.49:0/936747141 learned_addr learned my addr 10.20.193.49:0/936747141 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:15:49.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.261+0000 7fed26ffd640 1 -- 10.20.193.49:0/936747141 <== mon.1 v1:10.20.193.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 125597779 0 0) 0x7fed280c8630 con 0x7fed280c7e20 2026-02-17T11:15:49.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.261+0000 7fed26ffd640 10 monclient(hunting): _negotiate 2026-02-17T11:15:49.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.261+0000 7fed26ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:49.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.261+0000 7fed26ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:49.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.261+0000 7fed26ffd640 10 monclient(hunting): my global_id is 5275 2026-02-17T11:15:49.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.261+0000 7fed26ffd640 1 -- 10.20.193.49:0/936747141 --> v1:10.20.193.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed0c003620 con 0x7fed280c7e20 2026-02-17T11:15:49.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.261+0000 7fed26ffd640 1 -- 10.20.193.49:0/936747141 <== mon.0 v1:10.20.193.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2440501673 0 0) 0x7fed280c8350 con 0x7fed2815d370 2026-02-17T11:15:49.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.261+0000 7fed26ffd640 10 monclient(hunting): _negotiate 2026-02-17T11:15:49.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.261+0000 7fed26ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:49.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.261+0000 7fed26ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:49.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.261+0000 7fed26ffd640 10 monclient(hunting): my global_id is 5301 2026-02-17T11:15:49.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.261+0000 7fed26ffd640 1 -- 10.20.193.49:0/936747141 --> v1:10.20.193.49:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed280c8630 con 0x7fed2815d370 2026-02-17T11:15:49.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.261+0000 7fed26ffd640 1 -- 10.20.193.49:0/936747141 <== mon.2 v1:10.20.193.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3175249684 0 0) 0x7fed280c8910 con 0x7fed280c59c0 2026-02-17T11:15:49.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.261+0000 7fed26ffd640 10 monclient(hunting): _negotiate 2026-02-17T11:15:49.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.261+0000 7fed26ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:49.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.261+0000 7fed26ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:49.268 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.261+0000 7fed26ffd640 10 monclient(hunting): my global_id is 5357 2026-02-17T11:15:49.269 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.261+0000 7fed26ffd640 1 -- 10.20.193.49:0/936747141 --> v1:10.20.193.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed280c8350 con 0x7fed280c59c0 2026-02-17T11:15:49.269 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.262+0000 7fed26ffd640 1 -- 10.20.193.49:0/936747141 <== mon.1 v1:10.20.193.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4024770920 0 0) 0x7fed0c003620 con 0x7fed280c7e20 2026-02-17T11:15:49.269 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.262+0000 7fed26ffd640 1 -- 10.20.193.49:0/936747141 >> v1:10.20.193.157:6789/0 conn(0x7fed280c59c0 legacy=0x7fed28153480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:49.269 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.262+0000 7fed26ffd640 1 -- 10.20.193.49:0/936747141 >> v1:10.20.193.49:6789/0 conn(0x7fed2815d370 legacy=0x7fed2815b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:49.269 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.262+0000 7fed26ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:15:49.269 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.262+0000 7fed26ffd640 1 monclient: found mon.noname-b-legacy 2026-02-17T11:15:49.269 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.262+0000 7fed26ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:49.269 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.262+0000 7fed26ffd640 10 monclient: _send_mon_message to mon.noname-b-legacy at v1:10.20.193.97:6789/0 2026-02-17T11:15:49.269 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.262+0000 7fed26ffd640 1 -- 10.20.193.49:0/936747141 --> v1:10.20.193.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed280c8bf0 con 0x7fed280c7e20 2026-02-17T11:15:49.269 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.262+0000 7fed26ffd640 10 monclient: _finish_auth 0 2026-02-17T11:15:49.269 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.262+0000 7fed26ffd640 10 monclient: _check_auth_tickets 2026-02-17T11:15:49.269 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.262+0000 7fed26ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:49.269 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.262+0000 7fed26ffd640 1 -- 10.20.193.49:0/936747141 <== mon.1 v1:10.20.193.97:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2462710995 0 0) 0x7fed18002f00 con 0x7fed280c7e20 2026-02-17T11:15:49.269 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.262+0000 7fed26ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:49.269 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.262+0000 7fed26ffd640 10 monclient: got monmap 1 from mon.noname-b-legacy (according to old e1) 2026-02-17T11:15:49.269 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.262+0000 7fed26ffd640 10 monclient: dump: 2026-02-17T11:15:49.269 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:49.269 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:49.269 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:49.269 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:49.269 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:49.269 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:49.269 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:49.269 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:49.269 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:49.269 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:49.269 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.262+0000 7fed26ffd640 1 monclient: mon.b has (v2) addrs [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] but i'm connected to v1:10.20.193.97:6789/0, reconnecting 2026-02-17T11:15:49.269 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.262+0000 7fed26ffd640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:49.269 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.262+0000 7fed26ffd640 1 -- 10.20.193.49:0/936747141 >> v1:10.20.193.97:6789/0 conn(0x7fed280c7e20 legacy=0x7fed280c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:49.269 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.262+0000 7fed26ffd640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:15:49.269 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.262+0000 7fed26ffd640 1 --2- 10.20.193.49:0/936747141 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fed0c003f90 0x7fed0c004370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:49.269 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.262+0000 7fed26ffd640 10 monclient(hunting): picked mon.a con 0x7fed0c003f90 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:15:49.269 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.262+0000 7fed26ffd640 1 --2- 10.20.193.49:0/936747141 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fed0c004a30 0x7fed0c004eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:49.269 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.262+0000 7fed26ffd640 10 monclient(hunting): picked mon.b con 0x7fed0c004a30 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:15:49.269 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.262+0000 7fed26ffd640 1 --2- 10.20.193.49:0/936747141 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fed0c009ab0 0x7fed0c00bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:49.269 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.262+0000 7fed26ffd640 10 monclient(hunting): picked mon.c con 0x7fed0c009ab0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:15:49.269 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.262+0000 7fed26ffd640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:49.269 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.262+0000 7fed26ffd640 1 -- 10.20.193.49:0/936747141 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fed0c00c4e0 con 0x7fed0c003f90 2026-02-17T11:15:49.269 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.262+0000 7fed26ffd640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:49.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.262+0000 7fed26ffd640 1 -- 10.20.193.49:0/936747141 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fed0c00c690 con 0x7fed0c004a30 2026-02-17T11:15:49.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.262+0000 7fed26ffd640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:49.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.262+0000 7fed26ffd640 1 -- 10.20.193.49:0/936747141 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fed0c00c890 con 0x7fed0c009ab0 2026-02-17T11:15:49.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.262+0000 7fed26ffd640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:49.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.262+0000 7fed26ffd640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:15:49.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.263+0000 7fed27fff640 1 --2- 10.20.193.49:0/936747141 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fed0c003f90 0x7fed0c004370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:49.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.263+0000 7fed2cbe5640 1 --2- 10.20.193.49:0/936747141 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fed0c009ab0 0x7fed0c00bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:49.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.263+0000 7fed27fff640 10 monclient(hunting): get_auth_request con 0x7fed0c003f90 auth_method 0 2026-02-17T11:15:49.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.263+0000 7fed27fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:49.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.263+0000 7fed27fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:49.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.263+0000 7fed27fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:15:49.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.264+0000 7fed277fe640 1 --2- 10.20.193.49:0/936747141 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fed0c004a30 0x7fed0c004eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:49.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.264+0000 7fed2cbe5640 10 monclient(hunting): get_auth_request con 0x7fed0c009ab0 auth_method 0 2026-02-17T11:15:49.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.264+0000 7fed2cbe5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:49.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.264+0000 7fed2cbe5640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:49.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.264+0000 7fed2cbe5640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:15:49.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.264+0000 7fed277fe640 10 monclient(hunting): get_auth_request con 0x7fed0c004a30 auth_method 0 2026-02-17T11:15:49.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.264+0000 7fed277fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:49.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.264+0000 7fed277fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:49.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.264+0000 7fed277fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:15:49.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.264+0000 7fed2cbe5640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:49.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.264+0000 7fed2cbe5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:49.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.264+0000 7fed2cbe5640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:15:49.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.264+0000 7fed27fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:49.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.264+0000 7fed27fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:49.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.264+0000 7fed27fff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:15:49.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.264+0000 7fed277fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:49.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.264+0000 7fed277fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:49.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.264+0000 7fed277fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:15:49.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.265+0000 7fed2cbe5640 10 monclient(hunting): handle_auth_done global_id 5275 payload 293 2026-02-17T11:15:49.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.265+0000 7fed2cbe5640 1 -- 10.20.193.49:0/936747141 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fed0c004a30 msgr2=0x7fed0c004eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:15:49.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.265+0000 7fed2cbe5640 1 --2- 10.20.193.49:0/936747141 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fed0c004a30 0x7fed0c004eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:49.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.265+0000 7fed2cbe5640 1 -- 10.20.193.49:0/936747141 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fed0c003f90 msgr2=0x7fed0c004370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:15:49.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.265+0000 7fed2cbe5640 1 --2- 10.20.193.49:0/936747141 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fed0c003f90 0x7fed0c004370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:49.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.265+0000 7fed2cbe5640 10 monclient: _finish_hunting 0 2026-02-17T11:15:49.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.265+0000 7fed2cbe5640 1 monclient: found mon.c 2026-02-17T11:15:49.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.265+0000 7fed2cbe5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:49.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.265+0000 7fed2cbe5640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:15:49.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.265+0000 7fed2cbe5640 1 -- 10.20.193.49:0/936747141 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed0c003620 con 0x7fed0c009ab0 2026-02-17T11:15:49.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.265+0000 7fed2cbe5640 10 monclient: _finish_auth 0 2026-02-17T11:15:49.270 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.265+0000 7fed2cbe5640 10 monclient: _check_auth_tickets 2026-02-17T11:15:49.271 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.265+0000 7fed2cbe5640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:49.271 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.265+0000 7fed2e66f640 5 monclient: authenticate success, global_id 5275 2026-02-17T11:15:49.271 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.265+0000 7fed2e66f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:15:49.271 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.265+0000 7fed2cbe5640 1 -- 10.20.193.49:0/936747141 reap_dead start 2026-02-17T11:15:49.271 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.266+0000 7fed2cbe5640 1 --2- 10.20.193.49:0/936747141 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fed0c009ab0 0x7fed0c00bea0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fed1c00c2f0 tx=0x7fed1c02f5e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46856f89aaa6e92e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:49.272 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.267+0000 7fed26ffd640 1 -- 10.20.193.49:0/936747141 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed1c003860 con 0x7fed0c009ab0 2026-02-17T11:15:49.272 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.267+0000 7fed26ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:49.272 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.267+0000 7fed26ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:15:49.272 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.267+0000 7fed26ffd640 10 monclient: dump: 2026-02-17T11:15:49.272 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:49.272 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:49.272 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:49.272 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:49.273 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:49.273 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:49.273 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:49.273 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:49.273 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:49.273 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:49.273 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.267+0000 7fed2e66f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:15:49.273 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.268+0000 7fed26ffd640 1 -- 10.20.193.49:0/936747141 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed1c003c70 con 0x7fed0c009ab0 2026-02-17T11:15:49.273 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.268+0000 7fed26ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:49.273 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.268+0000 7fed26ffd640 1 -- 10.20.193.49:0/936747141 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed1c005310 con 0x7fed0c009ab0 2026-02-17T11:15:49.273 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.268+0000 7fed26ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:49.273 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.268+0000 7fed26ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:15:49.273 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.268+0000 7fed26ffd640 10 monclient: dump: 2026-02-17T11:15:49.273 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:49.273 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:49.273 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:49.273 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:49.273 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:49.273 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:49.273 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:49.273 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:49.273 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:49.273 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:49.273 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.268+0000 7fed2e66f640 10 monclient: get_monmap_and_config success 2026-02-17T11:15:49.273 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.268+0000 7fed2e66f640 4 set_mon_vals no callback set 2026-02-17T11:15:49.273 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.268+0000 7fed2e66f640 10 monclient: shutdown 2026-02-17T11:15:49.273 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.268+0000 7fed2e66f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:49.273 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.268+0000 7fed2e66f640 1 -- 10.20.193.49:0/936747141 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fed0c009ab0 msgr2=0x7fed0c00bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:49.273 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.268+0000 7fed2e66f640 1 --2- 10.20.193.49:0/936747141 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fed0c009ab0 0x7fed0c00bea0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fed1c00c2f0 tx=0x7fed1c02f5e0 comp rx=0 tx=0).stop 2026-02-17T11:15:49.273 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.268+0000 7fed2e66f640 1 -- 10.20.193.49:0/936747141 shutdown_connections 2026-02-17T11:15:49.273 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.268+0000 7fed2e66f640 1 --2- 10.20.193.49:0/936747141 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fed0c009ab0 0x7fed0c00bea0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:49.273 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.268+0000 7fed2e66f640 1 -- 10.20.193.49:0/936747141 >> 10.20.193.49:0/936747141 conn(0x7fed280c9f20 msgr2=0x7fed280ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:49.273 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.268+0000 7fed2e66f640 1 -- 10.20.193.49:0/936747141 shutdown_connections 2026-02-17T11:15:49.273 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.268+0000 7fed2e66f640 1 -- 10.20.193.49:0/936747141 wait complete. 2026-02-17T11:15:49.273 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.268+0000 7fed2e66f640 10 monclient: build_initial_monmap 2026-02-17T11:15:49.273 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.268+0000 7fed2e66f640 10 monclient: monmap: 2026-02-17T11:15:49.273 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:49.273 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:15:49.273 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:15:49.274 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:15:49.274 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:49.274 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:49.274 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:15:49.274 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:15:49.274 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:15:49.274 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:49.274 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.269+0000 7fed2e66f640 1 librados: starting msgr at 2026-02-17T11:15:49.274 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.269+0000 7fed2e66f640 1 librados: starting objecter 2026-02-17T11:15:49.274 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.269+0000 7fed2e66f640 1 Processor -- start 2026-02-17T11:15:49.274 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.269+0000 7fed2e66f640 1 -- start start 2026-02-17T11:15:49.274 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.269+0000 7fed2e66f640 1 librados: setting wanted keys 2026-02-17T11:15:49.274 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.269+0000 7fed2e66f640 1 librados: calling monclient init 2026-02-17T11:15:49.274 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.269+0000 7fed2e66f640 10 monclient: init 2026-02-17T11:15:49.274 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.269+0000 7fed2e66f640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:49.274 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.269+0000 7fed2e66f640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:15:49.274 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.269+0000 7fed2e66f640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fed0c009ab0 0x7fed281f6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:49.274 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.269+0000 7fed2e66f640 10 monclient(hunting): picked mon.noname-b con 0x7fed0c009ab0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:15:49.274 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.269+0000 7fed2e66f640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fed280730b0 0x7fed28073540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:49.274 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.269+0000 7fed2e66f640 10 monclient(hunting): picked mon.noname-a con 0x7fed280730b0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:15:49.274 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.269+0000 7fed2e66f640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fed280c3c20 0x7fed2806edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:49.274 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.269+0000 7fed2e66f640 10 monclient(hunting): picked mon.noname-c con 0x7fed280c3c20 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:15:49.274 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.269+0000 7fed2e66f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:49.274 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.269+0000 7fed2e66f640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fed280c96d0 con 0x7fed280730b0 2026-02-17T11:15:49.274 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.269+0000 7fed2e66f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:49.274 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.269+0000 7fed2e66f640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fed280c9240 con 0x7fed0c009ab0 2026-02-17T11:15:49.274 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.269+0000 7fed2e66f640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:49.274 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.269+0000 7fed2e66f640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fed281f4470 con 0x7fed280c3c20 2026-02-17T11:15:49.274 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.269+0000 7fed2e66f640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:49.274 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.269+0000 7fed2e66f640 10 monclient(hunting): authenticate will time out at 1425.932510s 2026-02-17T11:15:49.274 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.269+0000 7fed277fe640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fed280730b0 0x7fed28073540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:49.274 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.269+0000 7fed2cbe5640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fed280c3c20 0x7fed2806edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:49.274 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.269+0000 7fed27fff640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fed0c009ab0 0x7fed281f6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:49.274 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.269+0000 7fed277fe640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fed280730b0 0x7fed28073540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:43298/0 (socket says 10.20.193.49:43298) 2026-02-17T11:15:49.274 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.269+0000 7fed277fe640 1 -- 10.20.193.49:0/1052553296 learned_addr learned my addr 10.20.193.49:0/1052553296 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:49.274 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.269+0000 7fed277fe640 10 monclient(hunting): get_auth_request con 0x7fed280730b0 auth_method 0 2026-02-17T11:15:49.274 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.269+0000 7fed277fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:49.274 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.269+0000 7fed277fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:49.274 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.269+0000 7fed277fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:49.274 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.269+0000 7fed2cbe5640 10 monclient(hunting): get_auth_request con 0x7fed280c3c20 auth_method 0 2026-02-17T11:15:49.274 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.269+0000 7fed2cbe5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:49.275 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.269+0000 7fed2cbe5640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:49.275 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.269+0000 7fed2cbe5640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:49.275 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.270+0000 7fed27fff640 10 monclient(hunting): get_auth_request con 0x7fed0c009ab0 auth_method 0 2026-02-17T11:15:49.275 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.270+0000 7fed27fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:49.275 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.270+0000 7fed27fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:49.275 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.270+0000 7fed27fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:49.275 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.270+0000 7fed277fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:49.275 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.270+0000 7fed277fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:49.275 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.270+0000 7fed277fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:49.275 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.270+0000 7fed2cbe5640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:49.275 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.270+0000 7fed2cbe5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:49.275 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.270+0000 7fed2cbe5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:49.275 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.270+0000 7fed27fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:49.275 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.270+0000 7fed27fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:49.275 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.270+0000 7fed27fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:49.275 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.271+0000 7fed2cbe5640 10 monclient(hunting): handle_auth_done global_id 5360 payload 824 2026-02-17T11:15:49.275 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.271+0000 7fed2cbe5640 1 -- 10.20.193.49:0/1052553296 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fed0c009ab0 msgr2=0x7fed281f6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:49.275 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.271+0000 7fed2cbe5640 1 --2- 10.20.193.49:0/1052553296 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fed0c009ab0 0x7fed281f6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:49.275 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.271+0000 7fed2cbe5640 1 -- 10.20.193.49:0/1052553296 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fed280730b0 msgr2=0x7fed28073540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:49.275 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.271+0000 7fed2cbe5640 1 --2- 10.20.193.49:0/1052553296 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fed280730b0 0x7fed28073540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:49.275 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.271+0000 7fed2cbe5640 10 monclient: _finish_hunting 0 2026-02-17T11:15:49.275 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.271+0000 7fed2cbe5640 1 monclient: found mon.noname-c 2026-02-17T11:15:49.275 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.271+0000 7fed2cbe5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:49.275 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.271+0000 7fed2cbe5640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:15:49.275 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.271+0000 7fed2cbe5640 1 -- 10.20.193.49:0/1052553296 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed281f73b0 con 0x7fed280c3c20 2026-02-17T11:15:49.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.272+0000 7fed2cbe5640 1 --2- 10.20.193.49:0/1052553296 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fed280c3c20 0x7fed2806edd0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fed280c68d0 tx=0x7fed1c002e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:49.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.272+0000 7fed24ff9640 10 client.?.objecter ms_handle_connect 0x7fed280c3c20 2026-02-17T11:15:49.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.272+0000 7fed24ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T11:15:49.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.274+0000 7fed24ff9640 1 -- 10.20.193.49:0/1052553296 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed1c003860 con 0x7fed280c3c20 2026-02-17T11:15:49.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.274+0000 7fed24ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:49.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.274+0000 7fed24ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:15:49.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.274+0000 7fed24ff9640 10 monclient: dump: 2026-02-17T11:15:49.276 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:49.276 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:49.276 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:49.276 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:49.276 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:49.276 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:49.276 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:49.276 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:49.276 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:49.276 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:49.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.274+0000 7fed24ff9640 10 monclient: _finish_auth 0 2026-02-17T11:15:49.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.274+0000 7fed24ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:15:49.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.274+0000 7fed24ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:49.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.274+0000 7fed24ff9640 1 -- 10.20.193.49:0/1052553296 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed1c045070 con 0x7fed280c3c20 2026-02-17T11:15:49.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.274+0000 7fed2e66f640 5 monclient: authenticate success, global_id 5360 2026-02-17T11:15:49.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.274+0000 7fed2e66f640 10 monclient: _renew_subs 2026-02-17T11:15:49.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.274+0000 7fed2e66f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:15:49.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.274+0000 7fed2e66f640 1 -- 10.20.193.49:0/1052553296 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed281f7690 con 0x7fed280c3c20 2026-02-17T11:15:49.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.274+0000 7fed24ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:49.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.274+0000 7fed24ff9640 1 -- 10.20.193.49:0/1052553296 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed1c003e20 con 0x7fed280c3c20 2026-02-17T11:15:49.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.274+0000 7fed24ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:49.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.274+0000 7fed24ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:15:49.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.274+0000 7fed267fc640 4 set_mon_vals no callback set 2026-02-17T11:15:49.276 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.274+0000 7fed24ff9640 10 monclient: dump: 2026-02-17T11:15:49.277 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:49.277 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:49.277 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:49.277 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:49.277 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:49.277 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:49.277 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:49.277 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:49.277 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:49.277 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:49.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.274+0000 7fed2e66f640 10 client.5360.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:49.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.274+0000 7fed2e66f640 10 monclient: _renew_subs 2026-02-17T11:15:49.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.274+0000 7fed2e66f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:15:49.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.274+0000 7fed2e66f640 1 -- 10.20.193.49:0/1052553296 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed281f3990 con 0x7fed280c3c20 2026-02-17T11:15:49.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.274+0000 7fed2e66f640 1 librados: init done 2026-02-17T11:15:49.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.274+0000 7fed2e66f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:49.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.274+0000 7fed2e66f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:49.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.274+0000 7fed2e66f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.157:3300/0 2026-02-17T11:15:49.277 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.274+0000 7fed2e66f640 1 -- 10.20.193.49:0/1052553296 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed2815d870 con 0x7fed280c3c20 2026-02-17T11:15:49.381 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.380+0000 7fed24ff9640 1 -- 10.20.193.49:0/1052553296 <== mon.2 v2:10.20.193.157:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7fed1c03f680 con 0x7fed280c3c20 2026-02-17T11:15:49.382 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.380+0000 7fed24ff9640 1 --2- 10.20.193.49:0/1052553296 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fecf8079190 0x7fecf807b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:49.382 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.380+0000 7fed27fff640 1 --2- 10.20.193.49:0/1052553296 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fecf8079190 0x7fecf807b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:49.382 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.380+0000 7fed27fff640 10 monclient: get_auth_request con 0x7fecf8079190 auth_method 0 2026-02-17T11:15:49.382 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.381+0000 7fed27fff640 1 --2- 10.20.193.49:0/1052553296 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fecf8079190 0x7fecf807b650 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fed14002410 tx=0x7fed14007eb0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:49.382 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.381+0000 7fed24ff9640 10 client.5360.objecter ms_handle_connect 0x7fecf8079190 2026-02-17T11:15:49.383 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.382+0000 7fed24ff9640 1 -- 10.20.193.49:0/1052553296 <== mon.2 v2:10.20.193.157:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7fed1c083a00 con 0x7fed280c3c20 2026-02-17T11:15:49.383 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.382+0000 7fed24ff9640 10 client.5360.objecter ms_dispatch2 0x7fed28000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:15:49.383 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.382+0000 7fed24ff9640 3 client.5360.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:15:49.383 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.382+0000 7fed24ff9640 3 client.5360.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:15:49.383 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.382+0000 7fed24ff9640 20 client.5360.objecter dump_active .. 0 homeless 2026-02-17T11:15:49.389 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.388+0000 7fed24ff9640 1 -- 10.20.193.49:0/1052553296 <== mon.2 v2:10.20.193.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fed1c0880c0 con 0x7fed280c3c20 2026-02-17T11:15:49.390 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.388+0000 7fed24ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:49.390 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.388+0000 7fed24ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:15:49.472 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.470+0000 7fed2e66f640 1 -- 10.20.193.49:0/1052553296 --> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fed28152c40 con 0x7fecf8079190 2026-02-17T11:15:49.472 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.470+0000 7fed24ff9640 1 -- 10.20.193.49:0/1052553296 <== mgr.4106 v2:10.20.193.162:6800/2614632098 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fed28152c40 con 0x7fecf8079190 2026-02-17T11:15:49.472 INFO:teuthology.orchestra.run.trial049.stderr:instructed osd(s) 3 to deep-scrub 2026-02-17T11:15:49.473 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.471+0000 7fed2e66f640 10 librados: watch_flush enter 2026-02-17T11:15:49.473 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.471+0000 7fed2e66f640 10 librados: watch_flush exit 2026-02-17T11:15:49.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.471+0000 7fed2e66f640 20 client.5360.objecter shutdown clearing up homeless session... 2026-02-17T11:15:49.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.471+0000 7fed2e66f640 10 client.5360.objecter successfully canceled tick 2026-02-17T11:15:49.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.471+0000 7fed2e66f640 1 -- 10.20.193.49:0/1052553296 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fecf8079190 msgr2=0x7fecf807b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:49.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.471+0000 7fed2e66f640 1 --2- 10.20.193.49:0/1052553296 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fecf8079190 0x7fecf807b650 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fed14002410 tx=0x7fed14007eb0 comp rx=0 tx=0).stop 2026-02-17T11:15:49.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.471+0000 7fed2e66f640 10 monclient: shutdown 2026-02-17T11:15:49.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.471+0000 7fed2e66f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:49.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.471+0000 7fed2e66f640 1 -- 10.20.193.49:0/1052553296 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fed280c3c20 msgr2=0x7fed2806edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:49.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.471+0000 7fed2e66f640 1 --2- 10.20.193.49:0/1052553296 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fed280c3c20 0x7fed2806edd0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fed280c68d0 tx=0x7fed1c002e40 comp rx=0 tx=0).stop 2026-02-17T11:15:49.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.471+0000 7fed2e66f640 1 -- 10.20.193.49:0/1052553296 shutdown_connections 2026-02-17T11:15:49.474 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.471+0000 7fed2e66f640 1 --2- 10.20.193.49:0/1052553296 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fecf8079190 0x7fecf807b650 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:49.475 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.471+0000 7fed2e66f640 1 --2- 10.20.193.49:0/1052553296 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fed280c3c20 0x7fed2806edd0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:49.475 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.471+0000 7fed2e66f640 1 --2- 10.20.193.49:0/1052553296 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fed280730b0 0x7fed28073540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:49.475 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.471+0000 7fed2e66f640 1 --2- 10.20.193.49:0/1052553296 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fed0c009ab0 0x7fed281f6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:49.475 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.471+0000 7fed2e66f640 1 -- 10.20.193.49:0/1052553296 >> 10.20.193.49:0/1052553296 conn(0x7fed280c9f20 msgr2=0x7fed280c51b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:49.475 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.471+0000 7fed2e66f640 1 -- 10.20.193.49:0/1052553296 shutdown_connections 2026-02-17T11:15:49.475 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.471+0000 7fed2e66f640 1 -- 10.20.193.49:0/1052553296 wait complete. 2026-02-17T11:15:49.475 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.471+0000 7fed2e66f640 1 librados: shutdown 2026-02-17T11:15:49.481 INFO:tasks.ceph:Scrubbing osd.7 2026-02-17T11:15:49.481 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2026-02-17T11:15:49.551 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.549+0000 7f25a5aa0640 10 monclient: get_monmap_and_config 2026-02-17T11:15:49.551 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.549+0000 7f25a5aa0640 10 monclient: build_initial_monmap 2026-02-17T11:15:49.551 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.549+0000 7f25a5aa0640 10 monclient: monmap: 2026-02-17T11:15:49.551 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:49.551 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:49.551 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:15:49.549805+0000 2026-02-17T11:15:49.551 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:15:49.549805+0000 2026-02-17T11:15:49.552 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:49.552 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:49.552 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:15:49.552 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:15:49.552 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:15:49.552 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:15:49.552 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:15:49.552 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:15:49.552 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:49.552 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.549+0000 7f25a5aa0640 1 Processor -- start 2026-02-17T11:15:49.552 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.549+0000 7f25a5aa0640 1 -- start start 2026-02-17T11:15:49.552 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.549+0000 7f25a5aa0640 10 monclient: init 2026-02-17T11:15:49.562 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.550+0000 7f25a5aa0640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:49.562 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.550+0000 7f25a5aa0640 10 monclient: _add_conns ranks=[3,4,5,1,0,2] 2026-02-17T11:15:49.562 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.550+0000 7f25a5aa0640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f25a0153930 0x7f25a00c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:49.562 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.550+0000 7f25a5aa0640 10 monclient(hunting): picked mon.noname-a con 0x7f25a0153930 addr v2:10.20.193.49:3300/0 2026-02-17T11:15:49.562 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.550+0000 7f25a5aa0640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f25a0153d10 0x7f25a015b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:49.562 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.550+0000 7f25a5aa0640 10 monclient(hunting): picked mon.noname-b con 0x7f25a0153d10 addr v2:10.20.193.97:3300/0 2026-02-17T11:15:49.562 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.550+0000 7f25a5aa0640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f25a015b5b0 0x7f25a00c52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:49.563 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.550+0000 7f25a5aa0640 10 monclient(hunting): picked mon.noname-c con 0x7f25a015b5b0 addr v2:10.20.193.157:3300/0 2026-02-17T11:15:49.563 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.550+0000 7f25a5aa0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:49.563 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.550+0000 7f25a5aa0640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f25a00c8380 con 0x7f25a0153930 2026-02-17T11:15:49.563 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.550+0000 7f25a5aa0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:49.563 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.550+0000 7f25a5aa0640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f25a00c9490 con 0x7f25a0153d10 2026-02-17T11:15:49.563 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.550+0000 7f25a5aa0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:49.563 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.550+0000 7f25a5aa0640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f25a00c85a0 con 0x7f25a015b5b0 2026-02-17T11:15:49.563 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.550+0000 7f25a5aa0640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:49.563 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.550+0000 7f25a5aa0640 10 monclient(hunting): authenticate will time out at 1426.213331s 2026-02-17T11:15:49.563 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.550+0000 7f259f7fe640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f25a0153930 0x7f25a00c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:49.563 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.550+0000 7f259ffff640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f25a015b5b0 0x7f25a00c52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:49.563 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.550+0000 7f259effd640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f25a0153d10 0x7f25a015b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:49.564 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.550+0000 7f259f7fe640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f25a0153930 0x7f25a00c7e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:43308/0 (socket says 10.20.193.49:43308) 2026-02-17T11:15:49.564 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.550+0000 7f259f7fe640 1 -- 10.20.193.49:0/302341997 learned_addr learned my addr 10.20.193.49:0/302341997 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:49.564 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.550+0000 7f259f7fe640 10 monclient(hunting): get_auth_request con 0x7f25a0153930 auth_method 0 2026-02-17T11:15:49.564 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.550+0000 7f259f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:49.564 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.550+0000 7f259f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:49.564 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.550+0000 7f259f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:49.564 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.551+0000 7f259effd640 10 monclient(hunting): get_auth_request con 0x7f25a0153d10 auth_method 0 2026-02-17T11:15:49.564 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.551+0000 7f259effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:49.564 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.551+0000 7f259effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:49.564 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.551+0000 7f259effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:49.564 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.551+0000 7f259ffff640 10 monclient(hunting): get_auth_request con 0x7f25a015b5b0 auth_method 0 2026-02-17T11:15:49.564 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.551+0000 7f259ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:49.565 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.551+0000 7f259ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:49.565 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.551+0000 7f259ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:49.565 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.551+0000 7f259f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:49.565 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.551+0000 7f259f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:49.565 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.551+0000 7f259f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:49.565 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.551+0000 7f259effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:49.565 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.551+0000 7f259effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:49.565 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.551+0000 7f259effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:49.565 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.551+0000 7f259ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:49.565 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.551+0000 7f259ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:49.565 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.551+0000 7f259ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:49.565 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.552+0000 7f259f7fe640 10 monclient(hunting): handle_auth_done global_id 5307 payload 274 2026-02-17T11:15:49.565 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.552+0000 7f259f7fe640 1 -- 10.20.193.49:0/302341997 >> v2:10.20.193.157:3300/0 conn(0x7f25a015b5b0 msgr2=0x7f25a00c52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:15:49.566 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.552+0000 7f259f7fe640 1 --2- 10.20.193.49:0/302341997 >> v2:10.20.193.157:3300/0 conn(0x7f25a015b5b0 0x7f25a00c52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:49.566 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.552+0000 7f259f7fe640 1 -- 10.20.193.49:0/302341997 >> v2:10.20.193.97:3300/0 conn(0x7f25a0153d10 msgr2=0x7f25a015b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:15:49.566 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.552+0000 7f259f7fe640 1 --2- 10.20.193.49:0/302341997 >> v2:10.20.193.97:3300/0 conn(0x7f25a0153d10 0x7f25a015b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:49.566 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.552+0000 7f259f7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:15:49.566 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.552+0000 7f259f7fe640 1 monclient: found mon.noname-a 2026-02-17T11:15:49.566 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.552+0000 7f259f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:49.566 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.552+0000 7f259f7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:15:49.566 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.552+0000 7f259f7fe640 1 -- 10.20.193.49:0/302341997 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25a00c8880 con 0x7f25a0153930 2026-02-17T11:15:49.566 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.553+0000 7f259f7fe640 1 --2- 10.20.193.49:0/302341997 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f25a0153930 0x7f25a00c7e40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f25a0069c40 tx=0x7f258c02ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=487e6d1aa6616a1e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:49.566 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.554+0000 7f259e7fc640 1 -- 10.20.193.49:0/302341997 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f258c03c070 con 0x7f25a0153930 2026-02-17T11:15:49.566 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.554+0000 7f259e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:49.566 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.554+0000 7f259e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:15:49.566 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.554+0000 7f259e7fc640 10 monclient: dump: 2026-02-17T11:15:49.567 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:49.567 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:49.567 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:49.567 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:49.567 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:49.567 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:49.567 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:49.567 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:49.567 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:49.567 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:49.567 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.554+0000 7f259e7fc640 10 monclient: _finish_auth 0 2026-02-17T11:15:49.567 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.554+0000 7f259e7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:15:49.568 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.554+0000 7f259e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:49.568 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.554+0000 7f25a5aa0640 5 monclient: authenticate success, global_id 5307 2026-02-17T11:15:49.568 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.554+0000 7f259e7fc640 1 -- 10.20.193.49:0/302341997 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f258c02fb50 con 0x7f25a0153930 2026-02-17T11:15:49.568 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.554+0000 7f25a5aa0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:15:49.568 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.554+0000 7f259e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:49.568 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.554+0000 7f259e7fc640 1 -- 10.20.193.49:0/302341997 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f258c037440 con 0x7f25a0153930 2026-02-17T11:15:49.568 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.554+0000 7f25a5aa0640 10 monclient: get_monmap_and_config success 2026-02-17T11:15:49.568 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.554+0000 7f25a5aa0640 4 set_mon_vals no callback set 2026-02-17T11:15:49.568 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.554+0000 7f259e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:49.568 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.554+0000 7f259e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:15:49.568 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.554+0000 7f259e7fc640 10 monclient: dump: 2026-02-17T11:15:49.568 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:49.569 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:49.569 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:49.569 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:49.569 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:49.569 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:49.569 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:49.569 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:49.569 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:49.569 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:49.569 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.555+0000 7f25a5aa0640 10 monclient: shutdown 2026-02-17T11:15:49.569 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.555+0000 7f25a5aa0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:49.569 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.555+0000 7f25a5aa0640 1 -- 10.20.193.49:0/302341997 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f25a0153930 msgr2=0x7f25a00c7e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:49.569 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.555+0000 7f25a5aa0640 1 --2- 10.20.193.49:0/302341997 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f25a0153930 0x7f25a00c7e40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f25a0069c40 tx=0x7f258c02ee90 comp rx=0 tx=0).stop 2026-02-17T11:15:49.570 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.555+0000 7f25a5aa0640 1 -- 10.20.193.49:0/302341997 shutdown_connections 2026-02-17T11:15:49.570 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.555+0000 7f25a5aa0640 1 --2- 10.20.193.49:0/302341997 >> v2:10.20.193.97:3300/0 conn(0x7f25a0153d10 0x7f25a015b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:49.570 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.555+0000 7f25a5aa0640 1 --2- 10.20.193.49:0/302341997 >> v2:10.20.193.157:3300/0 conn(0x7f25a015b5b0 0x7f25a00c52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:49.570 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.555+0000 7f25a5aa0640 1 --2- 10.20.193.49:0/302341997 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f25a0153930 0x7f25a00c7e40 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:49.570 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.555+0000 7f25a5aa0640 1 -- 10.20.193.49:0/302341997 >> 10.20.193.49:0/302341997 conn(0x7f25a00c9f40 msgr2=0x7f25a00ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:49.570 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.555+0000 7f25a5aa0640 1 -- 10.20.193.49:0/302341997 shutdown_connections 2026-02-17T11:15:49.570 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.555+0000 7f25a5aa0640 1 -- 10.20.193.49:0/302341997 wait complete. 2026-02-17T11:15:49.570 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.555+0000 7f25a5aa0640 10 monclient: build_initial_monmap 2026-02-17T11:15:49.570 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.555+0000 7f25a5aa0640 10 monclient: monmap: 2026-02-17T11:15:49.570 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:49.570 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:15:49.570 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:15:49.570 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:15:49.571 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:49.571 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:49.571 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:15:49.571 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:15:49.571 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:15:49.571 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:49.571 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.556+0000 7f25a5aa0640 1 librados: starting msgr at 2026-02-17T11:15:49.571 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.556+0000 7f25a5aa0640 1 librados: starting objecter 2026-02-17T11:15:49.571 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.556+0000 7f25a5aa0640 1 Processor -- start 2026-02-17T11:15:49.571 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.556+0000 7f25a5aa0640 1 -- start start 2026-02-17T11:15:49.571 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.556+0000 7f25a5aa0640 1 librados: setting wanted keys 2026-02-17T11:15:49.571 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.556+0000 7f25a5aa0640 1 librados: calling monclient init 2026-02-17T11:15:49.572 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.556+0000 7f25a5aa0640 10 monclient: init 2026-02-17T11:15:49.572 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.556+0000 7f25a5aa0640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:49.572 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.556+0000 7f25a5aa0640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:15:49.572 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.556+0000 7f25a5aa0640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f25a0153930 0x7f25a0073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:49.572 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.556+0000 7f25a5aa0640 10 monclient(hunting): picked mon.noname-a con 0x7f25a0153930 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:15:49.572 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.556+0000 7f25a5aa0640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f25a0153d10 0x7f25a0148430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:49.572 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.556+0000 7f25a5aa0640 10 monclient(hunting): picked mon.noname-c con 0x7f25a0153d10 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:15:49.572 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.556+0000 7f25a5aa0640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f25a015b5b0 0x7f25a00c3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:49.572 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.556+0000 7f25a5aa0640 10 monclient(hunting): picked mon.noname-b con 0x7f25a015b5b0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:15:49.572 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.556+0000 7f25a5aa0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:49.572 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.556+0000 7f25a5aa0640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f25a00c9120 con 0x7f25a0153930 2026-02-17T11:15:49.572 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.556+0000 7f25a5aa0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:49.572 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.556+0000 7f25a5aa0640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f25a00c8e40 con 0x7f25a015b5b0 2026-02-17T11:15:49.573 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.556+0000 7f25a5aa0640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:49.573 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.556+0000 7f25a5aa0640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f25a00c7730 con 0x7f25a0153d10 2026-02-17T11:15:49.573 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.556+0000 7f25a5aa0640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:49.573 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.556+0000 7f25a5aa0640 10 monclient(hunting): authenticate will time out at 1426.219776s 2026-02-17T11:15:49.573 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.557+0000 7f259f7fe640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f25a0153930 0x7f25a0073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:49.573 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.557+0000 7f259effd640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f25a0153d10 0x7f25a0148430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:49.573 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.557+0000 7f259ffff640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f25a015b5b0 0x7f25a00c3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:49.573 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.557+0000 7f259f7fe640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f25a0153930 0x7f25a0073050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:43310/0 (socket says 10.20.193.49:43310) 2026-02-17T11:15:49.573 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.557+0000 7f259f7fe640 1 -- 10.20.193.49:0/1695349876 learned_addr learned my addr 10.20.193.49:0/1695349876 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:49.573 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.557+0000 7f259f7fe640 10 monclient(hunting): get_auth_request con 0x7f25a0153930 auth_method 0 2026-02-17T11:15:49.573 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.557+0000 7f259f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:49.573 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.557+0000 7f259f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:49.573 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.557+0000 7f259f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:49.574 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.557+0000 7f259ffff640 10 monclient(hunting): get_auth_request con 0x7f25a015b5b0 auth_method 0 2026-02-17T11:15:49.574 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.557+0000 7f259ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:49.574 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.557+0000 7f259ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:49.574 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.557+0000 7f259ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:49.574 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.557+0000 7f259effd640 10 monclient(hunting): get_auth_request con 0x7f25a0153d10 auth_method 0 2026-02-17T11:15:49.574 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.557+0000 7f259effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:49.574 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.557+0000 7f259effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:49.574 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.557+0000 7f259effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:49.574 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.557+0000 7f259f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:49.574 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.557+0000 7f259f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:49.574 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.557+0000 7f259f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:49.574 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.557+0000 7f259ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:49.574 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.557+0000 7f259ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:49.575 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.557+0000 7f259ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:49.575 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.557+0000 7f259effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:49.575 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.557+0000 7f259effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:49.575 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.557+0000 7f259effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:49.575 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.558+0000 7f259f7fe640 10 monclient(hunting): handle_auth_done global_id 5310 payload 824 2026-02-17T11:15:49.575 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.558+0000 7f259f7fe640 1 -- 10.20.193.49:0/1695349876 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f25a0153d10 msgr2=0x7f25a0148430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:49.575 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.558+0000 7f259f7fe640 1 --2- 10.20.193.49:0/1695349876 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f25a0153d10 0x7f25a0148430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:49.575 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.558+0000 7f259f7fe640 1 -- 10.20.193.49:0/1695349876 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f25a015b5b0 msgr2=0x7f25a00c3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:49.575 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.558+0000 7f259f7fe640 1 --2- 10.20.193.49:0/1695349876 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f25a015b5b0 0x7f25a00c3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:49.575 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.558+0000 7f259f7fe640 10 monclient: _finish_hunting 0 2026-02-17T11:15:49.575 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.558+0000 7f259f7fe640 1 monclient: found mon.noname-a 2026-02-17T11:15:49.575 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.558+0000 7f259f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:49.576 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.558+0000 7f259f7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:15:49.576 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.558+0000 7f259f7fe640 1 -- 10.20.193.49:0/1695349876 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25a01f4550 con 0x7f25a0153930 2026-02-17T11:15:49.576 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.559+0000 7f259f7fe640 1 --2- 10.20.193.49:0/1695349876 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f25a0153930 0x7f25a0073050 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f258c009a40 tx=0x7f258c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:49.576 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.559+0000 7f257bfff640 10 client.?.objecter ms_handle_connect 0x7f25a0153930 2026-02-17T11:15:49.576 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.559+0000 7f257bfff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:15:49.579 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.561+0000 7f257bfff640 1 -- 10.20.193.49:0/1695349876 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f258c03c040 con 0x7f25a0153930 2026-02-17T11:15:49.580 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.561+0000 7f257bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:49.580 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.561+0000 7f257bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:15:49.580 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.561+0000 7f257bfff640 10 monclient: dump: 2026-02-17T11:15:49.580 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:49.580 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:49.580 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:49.580 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:49.580 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:49.580 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:49.580 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:49.580 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:49.581 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:49.581 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:49.581 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.561+0000 7f257bfff640 10 monclient: _finish_auth 0 2026-02-17T11:15:49.581 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.561+0000 7f257bfff640 10 monclient: _check_auth_tickets 2026-02-17T11:15:49.581 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.561+0000 7f257bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:49.581 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.561+0000 7f257bfff640 1 -- 10.20.193.49:0/1695349876 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f258c042430 con 0x7f25a0153930 2026-02-17T11:15:49.581 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.561+0000 7f257bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:49.581 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.561+0000 7f257bfff640 1 -- 10.20.193.49:0/1695349876 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f258c042800 con 0x7f25a0153930 2026-02-17T11:15:49.581 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.561+0000 7f25a5aa0640 5 monclient: authenticate success, global_id 5310 2026-02-17T11:15:49.581 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.561+0000 7f259dffb640 4 set_mon_vals no callback set 2026-02-17T11:15:49.581 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.561+0000 7f25a5aa0640 10 monclient: _renew_subs 2026-02-17T11:15:49.581 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.561+0000 7f25a5aa0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:49.582 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.561+0000 7f25a5aa0640 1 -- 10.20.193.49:0/1695349876 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25a0146e40 con 0x7f25a0153930 2026-02-17T11:15:49.582 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.561+0000 7f257bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:49.582 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.561+0000 7f257bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:15:49.582 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.561+0000 7f257bfff640 10 monclient: dump: 2026-02-17T11:15:49.582 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:49.582 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:49.582 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:49.582 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:49.582 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:49.582 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:49.582 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:49.582 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:49.582 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:49.583 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:49.583 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.561+0000 7f25a5aa0640 10 client.5310.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:49.583 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.561+0000 7f25a5aa0640 10 monclient: _renew_subs 2026-02-17T11:15:49.583 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.561+0000 7f25a5aa0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:49.583 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.561+0000 7f25a5aa0640 1 -- 10.20.193.49:0/1695349876 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25a0147390 con 0x7f25a0153930 2026-02-17T11:15:49.583 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.561+0000 7f25a5aa0640 1 librados: init done 2026-02-17T11:15:49.583 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.562+0000 7f25a5aa0640 10 client.5310.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:49.583 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.562+0000 7f25a5aa0640 15 client.5310.objecter _session_command_op_assign -1 1 2026-02-17T11:15:49.583 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.562+0000 7f25a5aa0640 20 client.5310.objecter _get_session osd=-1 returning homeless 2026-02-17T11:15:49.583 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.562+0000 7f25a5aa0640 10 client.5310.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:49.583 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.562+0000 7f25a5aa0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:49.583 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.562+0000 7f25a5aa0640 1 -- 10.20.193.49:0/1695349876 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f25a015b3c0 con 0x7f25a0153930 2026-02-17T11:15:49.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.573+0000 7f257bfff640 1 -- 10.20.193.49:0/1695349876 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f258c0429a0 con 0x7f25a0153930 2026-02-17T11:15:49.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.573+0000 7f257bfff640 1 --2- 10.20.193.49:0/1695349876 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f2570079140 0x7f257007b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:49.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.574+0000 7f259effd640 1 --2- 10.20.193.49:0/1695349876 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f2570079140 0x7f257007b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:49.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.574+0000 7f259effd640 10 monclient: get_auth_request con 0x7f2570079140 auth_method 0 2026-02-17T11:15:49.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.574+0000 7f259effd640 1 --2- 10.20.193.49:0/1695349876 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f2570079140 0x7f257007b600 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f25a00cd120 tx=0x7f2590009290 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:49.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.574+0000 7f257bfff640 10 client.5310.objecter ms_handle_connect 0x7f2570079140 2026-02-17T11:15:49.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.574+0000 7f257bfff640 1 -- 10.20.193.49:0/1695349876 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f258c0bd0c0 con 0x7f25a0153930 2026-02-17T11:15:49.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.574+0000 7f257bfff640 10 client.5310.objecter ms_dispatch2 0x7f25a0000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:15:49.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.574+0000 7f257bfff640 3 client.5310.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:15:49.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.574+0000 7f257bfff640 3 client.5310.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:15:49.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.575+0000 7f257bfff640 10 client.5310.objecter checking command 1 2026-02-17T11:15:49.584 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.575+0000 7f257bfff640 1 --2- 10.20.193.49:0/1695349876 >> [v2:10.20.193.162:6806/2715110678,v1:10.20.193.162:6808/2715110678] conn(0x7f2570081620 0x7f2570083a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:49.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.575+0000 7f257bfff640 20 client.5310.objecter _get_session s=0x7f2570080f50 osd=7 3 2026-02-17T11:15:49.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.575+0000 7f257bfff640 20 client.5310.objecter put_session s=0x7f2570080f50 osd=7 3 2026-02-17T11:15:49.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.575+0000 7f257bfff640 15 client.5310.objecter _session_command_op_remove -1 1 2026-02-17T11:15:49.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.575+0000 7f257bfff640 20 client.5310.objecter _get_session s=0x7f2570080f50 osd=7 3 2026-02-17T11:15:49.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.575+0000 7f257bfff640 20 client.5310.objecter get_session s=0x7f2570080f50 osd=7 3 2026-02-17T11:15:49.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.575+0000 7f257bfff640 15 client.5310.objecter _session_command_op_assign 7 1 2026-02-17T11:15:49.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.575+0000 7f257bfff640 20 client.5310.objecter put_session s=0x7f2570080f50 osd=7 4 2026-02-17T11:15:49.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.575+0000 7f257bfff640 10 client.5310.objecter _send_command 1 2026-02-17T11:15:49.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.575+0000 7f257bfff640 1 -- 10.20.193.49:0/1695349876 --> [v2:10.20.193.162:6806/2715110678,v1:10.20.193.162:6808/2715110678] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f258c041e50 con 0x7f2570081620 2026-02-17T11:15:49.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.575+0000 7f257bfff640 20 client.5310.objecter dump_active .. 0 homeless 2026-02-17T11:15:49.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.575+0000 7f257bfff640 1 -- 10.20.193.49:0/1695349876 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f258c083c00 con 0x7f25a0153930 2026-02-17T11:15:49.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.575+0000 7f257bfff640 10 monclient: handle_get_version_reply finishing 1 version 34 2026-02-17T11:15:49.585 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.576+0000 7f259ffff640 1 --2- 10.20.193.49:0/1695349876 >> [v2:10.20.193.162:6806/2715110678,v1:10.20.193.162:6808/2715110678] conn(0x7f2570081620 0x7f2570083a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:49.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.576+0000 7f259ffff640 10 monclient: get_auth_request con 0x7f2570081620 auth_method 0 2026-02-17T11:15:49.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.577+0000 7f259ffff640 1 --2- 10.20.193.49:0/1695349876 >> [v2:10.20.193.162:6806/2715110678,v1:10.20.193.162:6808/2715110678] conn(0x7f2570081620 0x7f2570083a40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:49.586 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.577+0000 7f257bfff640 10 client.5310.objecter ms_handle_connect 0x7f2570081620 2026-02-17T11:15:49.589 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.588+0000 7f257bfff640 1 -- 10.20.193.49:0/1695349876 <== osd.7 v2:10.20.193.162:6806/2715110678 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f258c041e50 con 0x7f2570081620 2026-02-17T11:15:49.589 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.588+0000 7f257bfff640 10 client.5310.objecter ms_dispatch2 0x7f25a0000b90 command_reply(tid 1: 0 ) 2026-02-17T11:15:49.589 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.588+0000 7f257bfff640 10 client.5310.objecter _finish_command 1 = system:0 2026-02-17T11:15:49.589 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.588+0000 7f257bfff640 20 client.5310.objecter put_session s=0x7f2570080f50 osd=7 4 2026-02-17T11:15:49.589 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.588+0000 7f257bfff640 15 client.5310.objecter _session_command_op_remove 7 1 2026-02-17T11:15:49.595 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.594+0000 7f25a5aa0640 10 client.5310.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T11:15:49.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.594+0000 7f25a5aa0640 15 client.5310.objecter _session_command_op_assign -1 2 2026-02-17T11:15:49.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.594+0000 7f25a5aa0640 20 client.5310.objecter _get_session s=0x7f2570080f50 osd=7 3 2026-02-17T11:15:49.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.594+0000 7f25a5aa0640 20 client.5310.objecter put_session s=0x7f2570080f50 osd=7 3 2026-02-17T11:15:49.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.594+0000 7f25a5aa0640 20 client.5310.objecter _get_session s=0x7f2570080f50 osd=7 3 2026-02-17T11:15:49.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.594+0000 7f25a5aa0640 15 client.5310.objecter _session_command_op_remove -1 2 2026-02-17T11:15:49.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.594+0000 7f25a5aa0640 20 client.5310.objecter get_session s=0x7f2570080f50 osd=7 3 2026-02-17T11:15:49.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.594+0000 7f25a5aa0640 15 client.5310.objecter _session_command_op_assign 7 2 2026-02-17T11:15:49.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.594+0000 7f25a5aa0640 20 client.5310.objecter put_session s=0x7f2570080f50 osd=7 4 2026-02-17T11:15:49.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.594+0000 7f25a5aa0640 10 client.5310.objecter _send_command 2 2026-02-17T11:15:49.596 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.594+0000 7f25a5aa0640 1 -- 10.20.193.49:0/1695349876 --> [v2:10.20.193.162:6806/2715110678,v1:10.20.193.162:6808/2715110678] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f25a0076de0 con 0x7f2570081620 2026-02-17T11:15:49.602 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.601+0000 7f257bfff640 1 -- 10.20.193.49:0/1695349876 <== osd.7 v2:10.20.193.162:6806/2715110678 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f25a0076de0 con 0x7f2570081620 2026-02-17T11:15:49.602 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.601+0000 7f257bfff640 10 client.5310.objecter ms_dispatch2 0x7f25a0000b90 command_reply(tid 2: 0 ) 2026-02-17T11:15:49.602 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.601+0000 7f257bfff640 10 client.5310.objecter _finish_command 2 = system:0 2026-02-17T11:15:49.602 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.601+0000 7f257bfff640 20 client.5310.objecter put_session s=0x7f2570080f50 osd=7 4 2026-02-17T11:15:49.603 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.601+0000 7f257bfff640 15 client.5310.objecter _session_command_op_remove 7 2 2026-02-17T11:15:49.603 INFO:teuthology.orchestra.run.trial049.stdout:{ 2026-02-17T11:15:49.603 INFO:teuthology.orchestra.run.trial049.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T11:15:49.603 INFO:teuthology.orchestra.run.trial049.stdout:} 2026-02-17T11:15:49.604 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.601+0000 7f25a5aa0640 10 librados: watch_flush enter 2026-02-17T11:15:49.605 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.601+0000 7f25a5aa0640 10 librados: watch_flush exit 2026-02-17T11:15:49.605 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.601+0000 7f25a5aa0640 10 client.5310.objecter close_session for osd.7 2026-02-17T11:15:49.605 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.601+0000 7f25a5aa0640 1 -- 10.20.193.49:0/1695349876 >> [v2:10.20.193.162:6806/2715110678,v1:10.20.193.162:6808/2715110678] conn(0x7f2570081620 msgr2=0x7f2570083a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:49.605 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.601+0000 7f25a5aa0640 1 --2- 10.20.193.49:0/1695349876 >> [v2:10.20.193.162:6806/2715110678,v1:10.20.193.162:6808/2715110678] conn(0x7f2570081620 0x7f2570083a40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:49.605 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.601+0000 7f25a5aa0640 20 client.5310.objecter put_session s=0x7f2570080f50 osd=7 1 2026-02-17T11:15:49.605 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.601+0000 7f25a5aa0640 20 client.5310.objecter shutdown clearing up homeless session... 2026-02-17T11:15:49.605 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.601+0000 7f25a5aa0640 10 client.5310.objecter successfully canceled tick 2026-02-17T11:15:49.605 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.601+0000 7f25a5aa0640 1 -- 10.20.193.49:0/1695349876 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f2570079140 msgr2=0x7f257007b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:49.605 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.601+0000 7f25a5aa0640 1 --2- 10.20.193.49:0/1695349876 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f2570079140 0x7f257007b600 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f25a00cd120 tx=0x7f2590009290 comp rx=0 tx=0).stop 2026-02-17T11:15:49.605 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.601+0000 7f25a5aa0640 10 monclient: shutdown 2026-02-17T11:15:49.605 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.601+0000 7f25a5aa0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:49.606 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.601+0000 7f25a5aa0640 1 -- 10.20.193.49:0/1695349876 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f25a0153930 msgr2=0x7f25a0073050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:49.606 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.601+0000 7f25a5aa0640 1 --2- 10.20.193.49:0/1695349876 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f25a0153930 0x7f25a0073050 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f258c009a40 tx=0x7f258c0047c0 comp rx=0 tx=0).stop 2026-02-17T11:15:49.606 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.601+0000 7f259ffff640 1 -- 10.20.193.49:0/1695349876 reap_dead start 2026-02-17T11:15:49.606 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.601+0000 7f25a5aa0640 1 -- 10.20.193.49:0/1695349876 shutdown_connections 2026-02-17T11:15:49.606 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.601+0000 7f25a5aa0640 1 -- 10.20.193.49:0/1695349876 >> 10.20.193.49:0/1695349876 conn(0x7f25a00c9f40 msgr2=0x7f25a01513a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:49.606 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.601+0000 7f25a5aa0640 1 -- 10.20.193.49:0/1695349876 shutdown_connections 2026-02-17T11:15:49.606 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.601+0000 7f25a5aa0640 1 -- 10.20.193.49:0/1695349876 wait complete. 2026-02-17T11:15:49.606 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.601+0000 7f25a5aa0640 1 librados: shutdown 2026-02-17T11:15:49.611 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2026-02-17T11:15:49.679 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.677+0000 7fa9f7153640 10 monclient: get_monmap_and_config 2026-02-17T11:15:49.679 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.677+0000 7fa9f7153640 10 monclient: build_initial_monmap 2026-02-17T11:15:49.679 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.677+0000 7fa9f7153640 10 monclient: monmap: 2026-02-17T11:15:49.679 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:49.679 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:49.679 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:15:49.677578+0000 2026-02-17T11:15:49.679 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:15:49.677578+0000 2026-02-17T11:15:49.679 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:49.679 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:49.680 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:15:49.680 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:15:49.680 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:15:49.680 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:15:49.680 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:15:49.680 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:15:49.680 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:49.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.677+0000 7fa9f7153640 1 Processor -- start 2026-02-17T11:15:49.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.677+0000 7fa9f7153640 1 -- start start 2026-02-17T11:15:49.680 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.677+0000 7fa9f7153640 10 monclient: init 2026-02-17T11:15:49.685 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.678+0000 7fa9f7153640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:49.685 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.678+0000 7fa9f7153640 10 monclient: _add_conns ranks=[1,2,0,4,3,5] 2026-02-17T11:15:49.686 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.678+0000 7fa9f7153640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fa9f015d370 addr v1:10.20.193.97:6789/0 2026-02-17T11:15:49.686 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.678+0000 7fa9f7153640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fa9f00c7e20 addr v1:10.20.193.157:6789/0 2026-02-17T11:15:49.686 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.678+0000 7fa9f7153640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fa9f00c59c0 addr v1:10.20.193.49:6789/0 2026-02-17T11:15:49.686 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.678+0000 7fa9f7153640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f00c8350 con 0x7fa9f00c59c0 2026-02-17T11:15:49.686 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.678+0000 7fa9f7153640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f00c8630 con 0x7fa9f015d370 2026-02-17T11:15:49.686 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.678+0000 7fa9f7153640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f00c8910 con 0x7fa9f00c7e20 2026-02-17T11:15:49.686 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.678+0000 7fa9f7153640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:49.686 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.678+0000 7fa9f7153640 10 monclient(hunting): authenticate will time out at 1426.341175s 2026-02-17T11:15:49.686 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.678+0000 7fa9f4ec8640 1 --1- >> v1:10.20.193.97:6789/0 conn(0x7fa9f015d370 0x7fa9f015b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.97:6789/0 says I am v1:10.20.193.49:49876/0 (socket says 10.20.193.49:49876) 2026-02-17T11:15:49.686 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.678+0000 7fa9f56c9640 1 --1- >> v1:10.20.193.49:6789/0 conn(0x7fa9f00c59c0 0x7fa9f0153480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.49:6789/0 says I am v1:10.20.193.49:36420/0 (socket says 10.20.193.49:36420) 2026-02-17T11:15:49.687 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.678+0000 7fa9f4ec8640 1 -- 10.20.193.49:0/3985011941 learned_addr learned my addr 10.20.193.49:0/3985011941 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:15:49.687 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.679+0000 7fa9e77fe640 1 -- 10.20.193.49:0/3985011941 <== mon.0 v1:10.20.193.49:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2877400460 0 0) 0x7fa9f00c8350 con 0x7fa9f00c59c0 2026-02-17T11:15:49.687 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.679+0000 7fa9e77fe640 10 monclient(hunting): _negotiate 2026-02-17T11:15:49.687 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.679+0000 7fa9e77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:49.687 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.679+0000 7fa9e77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:49.687 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.679+0000 7fa9e77fe640 10 monclient(hunting): my global_id is 5313 2026-02-17T11:15:49.687 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.680+0000 7fa9e77fe640 1 -- 10.20.193.49:0/3985011941 --> v1:10.20.193.49:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa9dc003620 con 0x7fa9f00c59c0 2026-02-17T11:15:49.687 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.680+0000 7fa9e77fe640 1 -- 10.20.193.49:0/3985011941 <== mon.1 v1:10.20.193.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3763791631 0 0) 0x7fa9f00c8630 con 0x7fa9f015d370 2026-02-17T11:15:49.687 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.680+0000 7fa9e77fe640 10 monclient(hunting): _negotiate 2026-02-17T11:15:49.687 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.680+0000 7fa9e77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:49.687 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.680+0000 7fa9e77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:49.687 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.680+0000 7fa9e77fe640 10 monclient(hunting): my global_id is 5287 2026-02-17T11:15:49.687 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.680+0000 7fa9e77fe640 1 -- 10.20.193.49:0/3985011941 --> v1:10.20.193.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa9f00c8350 con 0x7fa9f015d370 2026-02-17T11:15:49.688 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.680+0000 7fa9e77fe640 1 -- 10.20.193.49:0/3985011941 <== mon.2 v1:10.20.193.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2158184310 0 0) 0x7fa9f00c8910 con 0x7fa9f00c7e20 2026-02-17T11:15:49.688 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.680+0000 7fa9e77fe640 10 monclient(hunting): _negotiate 2026-02-17T11:15:49.688 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.680+0000 7fa9e77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:49.688 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.680+0000 7fa9e77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:49.688 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.680+0000 7fa9e77fe640 10 monclient(hunting): my global_id is 5369 2026-02-17T11:15:49.688 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.680+0000 7fa9e77fe640 1 -- 10.20.193.49:0/3985011941 --> v1:10.20.193.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa9f00c8630 con 0x7fa9f00c7e20 2026-02-17T11:15:49.688 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.681+0000 7fa9e77fe640 1 -- 10.20.193.49:0/3985011941 <== mon.0 v1:10.20.193.49:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 368929895 0 0) 0x7fa9dc003620 con 0x7fa9f00c59c0 2026-02-17T11:15:49.688 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.681+0000 7fa9e77fe640 1 -- 10.20.193.49:0/3985011941 >> v1:10.20.193.157:6789/0 conn(0x7fa9f00c7e20 legacy=0x7fa9f00c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:49.688 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.681+0000 7fa9e77fe640 1 -- 10.20.193.49:0/3985011941 >> v1:10.20.193.97:6789/0 conn(0x7fa9f015d370 legacy=0x7fa9f015b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:49.688 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.681+0000 7fa9e77fe640 10 monclient: _finish_hunting 0 2026-02-17T11:15:49.688 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.681+0000 7fa9e77fe640 1 monclient: found mon.noname-a-legacy 2026-02-17T11:15:49.688 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.681+0000 7fa9e77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:49.688 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.681+0000 7fa9e77fe640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.49:6789/0 2026-02-17T11:15:49.689 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.681+0000 7fa9e77fe640 1 -- 10.20.193.49:0/3985011941 --> v1:10.20.193.49:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9f00c8bf0 con 0x7fa9f00c59c0 2026-02-17T11:15:49.689 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.681+0000 7fa9e77fe640 10 monclient: _finish_auth 0 2026-02-17T11:15:49.689 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.681+0000 7fa9e77fe640 10 monclient: _check_auth_tickets 2026-02-17T11:15:49.689 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.681+0000 7fa9e77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:49.689 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.681+0000 7fa9e77fe640 1 -- 10.20.193.49:0/3985011941 <== mon.0 v1:10.20.193.49:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2462710995 0 0) 0x7fa9ec003280 con 0x7fa9f00c59c0 2026-02-17T11:15:49.689 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.681+0000 7fa9e77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:49.689 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.681+0000 7fa9e77fe640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T11:15:49.689 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.681+0000 7fa9e77fe640 10 monclient: dump: 2026-02-17T11:15:49.689 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:49.689 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:49.689 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:49.689 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:49.689 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:49.689 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:49.689 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:49.689 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:49.689 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:49.689 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:49.689 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.681+0000 7fa9e77fe640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] but i'm connected to v1:10.20.193.49:6789/0, reconnecting 2026-02-17T11:15:49.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.681+0000 7fa9e77fe640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:49.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.681+0000 7fa9e77fe640 1 -- 10.20.193.49:0/3985011941 >> v1:10.20.193.49:6789/0 conn(0x7fa9f00c59c0 legacy=0x7fa9f0153480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:49.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.681+0000 7fa9e77fe640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T11:15:49.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.681+0000 7fa9e77fe640 1 --2- 10.20.193.49:0/3985011941 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fa9dc003fe0 0x7fa9dc004900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:49.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.681+0000 7fa9e77fe640 10 monclient(hunting): picked mon.a con 0x7fa9dc003fe0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:15:49.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.681+0000 7fa9e77fe640 1 --2- 10.20.193.49:0/3985011941 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fa9dc004e40 0x7fa9dc0052c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:49.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.681+0000 7fa9e77fe640 10 monclient(hunting): picked mon.c con 0x7fa9dc004e40 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:15:49.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.681+0000 7fa9e77fe640 1 --2- 10.20.193.49:0/3985011941 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fa9dc009ab0 0x7fa9dc00bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:49.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.681+0000 7fa9e77fe640 10 monclient(hunting): picked mon.b con 0x7fa9dc009ab0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:15:49.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.681+0000 7fa9e77fe640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:49.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.681+0000 7fa9e77fe640 1 -- 10.20.193.49:0/3985011941 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa9dc00c570 con 0x7fa9dc003fe0 2026-02-17T11:15:49.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.681+0000 7fa9e77fe640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:49.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.681+0000 7fa9e77fe640 1 -- 10.20.193.49:0/3985011941 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa9dc00c6f0 con 0x7fa9dc009ab0 2026-02-17T11:15:49.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.681+0000 7fa9e77fe640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:49.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.681+0000 7fa9e77fe640 1 -- 10.20.193.49:0/3985011941 --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fa9dc00c8f0 con 0x7fa9dc004e40 2026-02-17T11:15:49.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.681+0000 7fa9e77fe640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:49.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.681+0000 7fa9e77fe640 10 monclient(hunting): _finish_auth 0 2026-02-17T11:15:49.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.682+0000 7fa9f56c9640 1 --2- 10.20.193.49:0/3985011941 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fa9dc009ab0 0x7fa9dc00bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:49.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.682+0000 7fa9f56c9640 10 monclient(hunting): get_auth_request con 0x7fa9dc009ab0 auth_method 0 2026-02-17T11:15:49.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.682+0000 7fa9f56c9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:49.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.682+0000 7fa9f56c9640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:49.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.682+0000 7fa9f56c9640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:15:49.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.682+0000 7fa9e7fff640 1 --2- 10.20.193.49:0/3985011941 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fa9dc004e40 0x7fa9dc0052c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:49.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.682+0000 7fa9f56c9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:49.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.682+0000 7fa9f56c9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:49.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.682+0000 7fa9f56c9640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:15:49.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.683+0000 7fa9f4ec8640 1 --2- 10.20.193.49:0/3985011941 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fa9dc003fe0 0x7fa9dc004900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:49.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.683+0000 7fa9f4ec8640 10 monclient(hunting): get_auth_request con 0x7fa9dc003fe0 auth_method 0 2026-02-17T11:15:49.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.683+0000 7fa9f4ec8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:49.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.683+0000 7fa9f4ec8640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:49.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.683+0000 7fa9f4ec8640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:15:49.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.683+0000 7fa9e7fff640 10 monclient(hunting): get_auth_request con 0x7fa9dc004e40 auth_method 0 2026-02-17T11:15:49.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.683+0000 7fa9e7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:49.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.683+0000 7fa9e7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:49.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.683+0000 7fa9e7fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T11:15:49.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.683+0000 7fa9f4ec8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:49.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.683+0000 7fa9f4ec8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:49.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.683+0000 7fa9f4ec8640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T11:15:49.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.683+0000 7fa9f56c9640 10 monclient(hunting): handle_auth_done global_id 5313 payload 293 2026-02-17T11:15:49.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.683+0000 7fa9f56c9640 1 -- 10.20.193.49:0/3985011941 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fa9dc004e40 msgr2=0x7fa9dc0052c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:15:49.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.683+0000 7fa9f56c9640 1 --2- 10.20.193.49:0/3985011941 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fa9dc004e40 0x7fa9dc0052c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:49.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.683+0000 7fa9f56c9640 1 -- 10.20.193.49:0/3985011941 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fa9dc003fe0 msgr2=0x7fa9dc004900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:15:49.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.683+0000 7fa9f56c9640 1 --2- 10.20.193.49:0/3985011941 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fa9dc003fe0 0x7fa9dc004900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:49.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.683+0000 7fa9f56c9640 10 monclient: _finish_hunting 0 2026-02-17T11:15:49.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.683+0000 7fa9f56c9640 1 monclient: found mon.b 2026-02-17T11:15:49.690 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.683+0000 7fa9f56c9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:49.691 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.683+0000 7fa9f56c9640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:15:49.691 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.683+0000 7fa9f56c9640 1 -- 10.20.193.49:0/3985011941 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9dc003620 con 0x7fa9dc009ab0 2026-02-17T11:15:49.691 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.683+0000 7fa9f56c9640 10 monclient: _finish_auth 0 2026-02-17T11:15:49.691 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.683+0000 7fa9f56c9640 10 monclient: _check_auth_tickets 2026-02-17T11:15:49.691 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.683+0000 7fa9f56c9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:49.691 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.683+0000 7fa9f7153640 5 monclient: authenticate success, global_id 5313 2026-02-17T11:15:49.691 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.683+0000 7fa9f7153640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:15:49.691 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.684+0000 7fa9f56c9640 1 -- 10.20.193.49:0/3985011941 reap_dead start 2026-02-17T11:15:49.692 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.684+0000 7fa9f56c9640 1 --2- 10.20.193.49:0/3985011941 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fa9dc009ab0 0x7fa9dc00bea0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec00a740 tx=0x7fa9ec02fae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec933813b843f4f0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:49.692 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.685+0000 7fa9e77fe640 1 -- 10.20.193.49:0/3985011941 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec00a390 con 0x7fa9dc009ab0 2026-02-17T11:15:49.692 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.685+0000 7fa9e77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:49.692 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.685+0000 7fa9e77fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:15:49.692 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.685+0000 7fa9e77fe640 10 monclient: dump: 2026-02-17T11:15:49.692 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:49.692 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:49.692 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:49.692 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:49.692 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:49.692 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:49.692 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:49.692 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:49.692 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:49.692 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:49.692 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.685+0000 7fa9f7153640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:15:49.692 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.686+0000 7fa9e77fe640 1 -- 10.20.193.49:0/3985011941 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9ec034470 con 0x7fa9dc009ab0 2026-02-17T11:15:49.693 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.686+0000 7fa9e77fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:49.693 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.686+0000 7fa9e77fe640 1 -- 10.20.193.49:0/3985011941 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec034840 con 0x7fa9dc009ab0 2026-02-17T11:15:49.693 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.686+0000 7fa9e77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:49.693 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.686+0000 7fa9e77fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:15:49.693 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.686+0000 7fa9e77fe640 10 monclient: dump: 2026-02-17T11:15:49.693 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:49.693 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:49.693 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:49.693 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:49.693 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:49.693 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:49.693 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:49.693 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:49.693 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:49.693 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:49.693 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.686+0000 7fa9f7153640 10 monclient: get_monmap_and_config success 2026-02-17T11:15:49.693 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.686+0000 7fa9f7153640 4 set_mon_vals no callback set 2026-02-17T11:15:49.693 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.686+0000 7fa9f7153640 10 monclient: shutdown 2026-02-17T11:15:49.693 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.686+0000 7fa9f7153640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:49.693 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.686+0000 7fa9f7153640 1 -- 10.20.193.49:0/3985011941 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fa9dc009ab0 msgr2=0x7fa9dc00bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:49.693 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.686+0000 7fa9f7153640 1 --2- 10.20.193.49:0/3985011941 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fa9dc009ab0 0x7fa9dc00bea0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec00a740 tx=0x7fa9ec02fae0 comp rx=0 tx=0).stop 2026-02-17T11:15:49.693 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.686+0000 7fa9f7153640 1 -- 10.20.193.49:0/3985011941 shutdown_connections 2026-02-17T11:15:49.693 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.686+0000 7fa9f7153640 1 --2- 10.20.193.49:0/3985011941 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fa9dc009ab0 0x7fa9dc00bea0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:49.693 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.686+0000 7fa9f7153640 1 -- 10.20.193.49:0/3985011941 >> 10.20.193.49:0/3985011941 conn(0x7fa9f00c9f20 msgr2=0x7fa9f00ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:49.693 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.686+0000 7fa9f7153640 1 -- 10.20.193.49:0/3985011941 shutdown_connections 2026-02-17T11:15:49.693 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.686+0000 7fa9f7153640 1 -- 10.20.193.49:0/3985011941 wait complete. 2026-02-17T11:15:49.693 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.687+0000 7fa9f7153640 10 monclient: build_initial_monmap 2026-02-17T11:15:49.693 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.687+0000 7fa9f7153640 10 monclient: monmap: 2026-02-17T11:15:49.693 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:49.693 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:15:49.693 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:15:49.693 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:15:49.693 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:49.693 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:49.693 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:15:49.693 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:15:49.693 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:15:49.693 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:49.693 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.687+0000 7fa9f7153640 1 librados: starting msgr at 2026-02-17T11:15:49.693 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.687+0000 7fa9f7153640 1 librados: starting objecter 2026-02-17T11:15:49.693 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.687+0000 7fa9f7153640 1 Processor -- start 2026-02-17T11:15:49.693 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.687+0000 7fa9f7153640 1 -- start start 2026-02-17T11:15:49.693 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.687+0000 7fa9f7153640 1 librados: setting wanted keys 2026-02-17T11:15:49.693 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.687+0000 7fa9f7153640 1 librados: calling monclient init 2026-02-17T11:15:49.693 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.687+0000 7fa9f7153640 10 monclient: init 2026-02-17T11:15:49.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.687+0000 7fa9f7153640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:49.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.687+0000 7fa9f7153640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:15:49.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.687+0000 7fa9f7153640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fa9dc009ab0 0x7fa9f0074590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:49.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.687+0000 7fa9f7153640 10 monclient(hunting): picked mon.noname-a con 0x7fa9dc009ab0 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:15:49.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.687+0000 7fa9f7153640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fa9f0074ad0 0x7fa9f014a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:49.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.688+0000 7fa9f7153640 10 monclient(hunting): picked mon.noname-b con 0x7fa9f0074ad0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:15:49.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.688+0000 7fa9f7153640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fa9f01440c0 0x7fa9f014ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:49.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.688+0000 7fa9f7153640 10 monclient(hunting): picked mon.noname-c con 0x7fa9f01440c0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:15:49.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.688+0000 7fa9f7153640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:49.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.688+0000 7fa9f7153640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f00c96d0 con 0x7fa9dc009ab0 2026-02-17T11:15:49.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.688+0000 7fa9f7153640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:49.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.688+0000 7fa9f7153640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f00c9240 con 0x7fa9f0074ad0 2026-02-17T11:15:49.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.688+0000 7fa9f7153640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:49.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.688+0000 7fa9f7153640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f0154830 con 0x7fa9f01440c0 2026-02-17T11:15:49.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.688+0000 7fa9f7153640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:49.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.688+0000 7fa9f7153640 10 monclient(hunting): authenticate will time out at 1426.351040s 2026-02-17T11:15:49.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.688+0000 7fa9f4ec8640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fa9dc009ab0 0x7fa9f0074590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:49.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.688+0000 7fa9e7fff640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fa9f0074ad0 0x7fa9f014a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:49.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.688+0000 7fa9f4ec8640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fa9dc009ab0 0x7fa9f0074590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:43338/0 (socket says 10.20.193.49:43338) 2026-02-17T11:15:49.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.688+0000 7fa9f4ec8640 1 -- 10.20.193.49:0/1004741972 learned_addr learned my addr 10.20.193.49:0/1004741972 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:49.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.688+0000 7fa9f4ec8640 10 monclient(hunting): get_auth_request con 0x7fa9dc009ab0 auth_method 0 2026-02-17T11:15:49.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.688+0000 7fa9f4ec8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:49.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.688+0000 7fa9f4ec8640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:49.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.688+0000 7fa9f4ec8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:49.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.688+0000 7fa9f56c9640 1 --2- 10.20.193.49:0/1004741972 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fa9f01440c0 0x7fa9f014ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:49.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.688+0000 7fa9e7fff640 10 monclient(hunting): get_auth_request con 0x7fa9f0074ad0 auth_method 0 2026-02-17T11:15:49.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.688+0000 7fa9e7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:49.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.688+0000 7fa9e7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:49.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.688+0000 7fa9e7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:49.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.688+0000 7fa9f56c9640 10 monclient(hunting): get_auth_request con 0x7fa9f01440c0 auth_method 0 2026-02-17T11:15:49.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.688+0000 7fa9f56c9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:49.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.688+0000 7fa9f56c9640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:49.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.688+0000 7fa9f56c9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:49.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.688+0000 7fa9f4ec8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:49.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.688+0000 7fa9f4ec8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:49.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.688+0000 7fa9f4ec8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:49.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.688+0000 7fa9e7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:49.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.688+0000 7fa9e7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:49.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.688+0000 7fa9e7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:49.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.688+0000 7fa9f56c9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:49.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.688+0000 7fa9f56c9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:49.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.688+0000 7fa9f56c9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:49.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.689+0000 7fa9e7fff640 10 monclient(hunting): handle_auth_done global_id 5290 payload 824 2026-02-17T11:15:49.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.689+0000 7fa9e7fff640 1 -- 10.20.193.49:0/1004741972 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fa9f01440c0 msgr2=0x7fa9f014ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:49.694 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.689+0000 7fa9e7fff640 1 --2- 10.20.193.49:0/1004741972 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fa9f01440c0 0x7fa9f014ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:49.695 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.689+0000 7fa9e7fff640 1 -- 10.20.193.49:0/1004741972 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fa9dc009ab0 msgr2=0x7fa9f0074590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:49.695 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.689+0000 7fa9e7fff640 1 --2- 10.20.193.49:0/1004741972 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fa9dc009ab0 0x7fa9f0074590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:49.695 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.689+0000 7fa9e7fff640 10 monclient: _finish_hunting 0 2026-02-17T11:15:49.695 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.689+0000 7fa9e7fff640 1 monclient: found mon.noname-b 2026-02-17T11:15:49.695 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.689+0000 7fa9e7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:49.695 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.689+0000 7fa9e7fff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:15:49.695 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.689+0000 7fa9e7fff640 1 -- 10.20.193.49:0/1004741972 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9f0143e80 con 0x7fa9f0074ad0 2026-02-17T11:15:49.695 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.690+0000 7fa9e7fff640 1 --2- 10.20.193.49:0/1004741972 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fa9f0074ad0 0x7fa9f014a710 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa9d800e5d0 tx=0x7fa9d800eaa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:49.695 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.691+0000 7fa9e57fa640 10 client.?.objecter ms_handle_connect 0x7fa9f0074ad0 2026-02-17T11:15:49.695 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.691+0000 7fa9e57fa640 10 client.?.objecter resend_mon_ops 2026-02-17T11:15:49.695 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.692+0000 7fa9e57fa640 1 -- 10.20.193.49:0/1004741972 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d80040d0 con 0x7fa9f0074ad0 2026-02-17T11:15:49.695 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.692+0000 7fa9e57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:49.695 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.692+0000 7fa9e57fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:15:49.695 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.692+0000 7fa9e57fa640 10 monclient: dump: 2026-02-17T11:15:49.695 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:49.695 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:49.695 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:49.695 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:49.695 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:49.696 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:49.696 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:49.696 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:49.696 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:49.696 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:49.696 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.692+0000 7fa9e57fa640 10 monclient: _finish_auth 0 2026-02-17T11:15:49.696 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.692+0000 7fa9e57fa640 10 monclient: _check_auth_tickets 2026-02-17T11:15:49.696 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.692+0000 7fa9e57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:49.696 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.692+0000 7fa9e57fa640 1 -- 10.20.193.49:0/1004741972 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9d8018070 con 0x7fa9f0074ad0 2026-02-17T11:15:49.696 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.692+0000 7fa9e57fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:49.696 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.692+0000 7fa9e57fa640 1 -- 10.20.193.49:0/1004741972 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d80044d0 con 0x7fa9f0074ad0 2026-02-17T11:15:49.696 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.692+0000 7fa9e57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:49.696 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.692+0000 7fa9e57fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:15:49.696 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.692+0000 7fa9e57fa640 10 monclient: dump: 2026-02-17T11:15:49.696 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:49.696 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:49.696 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:49.696 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:49.696 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:49.696 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:49.696 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:49.696 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:49.696 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:49.696 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:49.696 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.692+0000 7fa9e6ffd640 4 set_mon_vals no callback set 2026-02-17T11:15:49.696 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.692+0000 7fa9f7153640 5 monclient: authenticate success, global_id 5290 2026-02-17T11:15:49.696 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.692+0000 7fa9f7153640 10 monclient: _renew_subs 2026-02-17T11:15:49.696 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.692+0000 7fa9f7153640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:15:49.696 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.692+0000 7fa9f7153640 1 -- 10.20.193.49:0/1004741972 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9f01f1950 con 0x7fa9f0074ad0 2026-02-17T11:15:49.696 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.692+0000 7fa9f7153640 10 client.5290.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:49.696 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.692+0000 7fa9f7153640 10 monclient: _renew_subs 2026-02-17T11:15:49.696 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.692+0000 7fa9f7153640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:15:49.696 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.692+0000 7fa9f7153640 1 -- 10.20.193.49:0/1004741972 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9f01f1f10 con 0x7fa9f0074ad0 2026-02-17T11:15:49.696 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.692+0000 7fa9f7153640 1 librados: init done 2026-02-17T11:15:49.696 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.693+0000 7fa9f7153640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:49.696 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.693+0000 7fa9f7153640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:49.696 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.693+0000 7fa9f7153640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:15:49.696 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.693+0000 7fa9f7153640 1 -- 10.20.193.49:0/1004741972 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9f015d870 con 0x7fa9f0074ad0 2026-02-17T11:15:49.705 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.704+0000 7fa9e57fa640 1 -- 10.20.193.49:0/1004741972 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7fa9d8004670 con 0x7fa9f0074ad0 2026-02-17T11:15:49.706 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.705+0000 7fa9e57fa640 1 --2- 10.20.193.49:0/1004741972 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fa9c0079140 0x7fa9c007b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:49.706 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.705+0000 7fa9f4ec8640 1 --2- 10.20.193.49:0/1004741972 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fa9c0079140 0x7fa9c007b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:49.706 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.705+0000 7fa9f4ec8640 10 monclient: get_auth_request con 0x7fa9c0079140 auth_method 0 2026-02-17T11:15:49.707 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.706+0000 7fa9f4ec8640 1 --2- 10.20.193.49:0/1004741972 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fa9c0079140 0x7fa9c007b600 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0002910 tx=0x7fa9e0007eb0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:49.707 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.706+0000 7fa9e57fa640 10 client.5290.objecter ms_handle_connect 0x7fa9c0079140 2026-02-17T11:15:49.707 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.706+0000 7fa9e57fa640 1 -- 10.20.193.49:0/1004741972 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7fa9d8004990 con 0x7fa9f0074ad0 2026-02-17T11:15:49.707 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.706+0000 7fa9e57fa640 10 client.5290.objecter ms_dispatch2 0x7fa9f0000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:15:49.707 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.706+0000 7fa9e57fa640 3 client.5290.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:15:49.707 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.706+0000 7fa9e57fa640 3 client.5290.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:15:49.707 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.706+0000 7fa9e57fa640 20 client.5290.objecter dump_active .. 0 homeless 2026-02-17T11:15:49.807 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.805+0000 7fa9e57fa640 1 -- 10.20.193.49:0/1004741972 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fa9d8062360 con 0x7fa9f0074ad0 2026-02-17T11:15:49.807 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.805+0000 7fa9e57fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:49.808 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.805+0000 7fa9e57fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:15:49.890 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.888+0000 7fa9f7153640 1 -- 10.20.193.49:0/1004741972 --> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7fa9f01f5c50 con 0x7fa9c0079140 2026-02-17T11:15:49.890 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.888+0000 7fa9e57fa640 1 -- 10.20.193.49:0/1004741972 <== mgr.4106 v2:10.20.193.162:6800/2614632098 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa9e0007280 con 0x7fa9c0079140 2026-02-17T11:15:49.890 INFO:teuthology.orchestra.run.trial049.stderr:instructed osd(s) 7 to deep-scrub 2026-02-17T11:15:49.892 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.889+0000 7fa9f7153640 10 librados: watch_flush enter 2026-02-17T11:15:49.892 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.889+0000 7fa9f7153640 10 librados: watch_flush exit 2026-02-17T11:15:49.892 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.889+0000 7fa9f7153640 20 client.5290.objecter shutdown clearing up homeless session... 2026-02-17T11:15:49.892 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.889+0000 7fa9f7153640 10 client.5290.objecter successfully canceled tick 2026-02-17T11:15:49.892 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.889+0000 7fa9f7153640 1 -- 10.20.193.49:0/1004741972 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fa9c0079140 msgr2=0x7fa9c007b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:49.892 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.889+0000 7fa9f7153640 1 --2- 10.20.193.49:0/1004741972 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fa9c0079140 0x7fa9c007b600 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0002910 tx=0x7fa9e0007eb0 comp rx=0 tx=0).stop 2026-02-17T11:15:49.893 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.889+0000 7fa9f7153640 10 monclient: shutdown 2026-02-17T11:15:49.893 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.889+0000 7fa9f7153640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:49.893 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.889+0000 7fa9f7153640 1 -- 10.20.193.49:0/1004741972 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fa9f0074ad0 msgr2=0x7fa9f014a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:49.893 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.889+0000 7fa9f7153640 1 --2- 10.20.193.49:0/1004741972 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fa9f0074ad0 0x7fa9f014a710 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa9d800e5d0 tx=0x7fa9d800eaa0 comp rx=0 tx=0).stop 2026-02-17T11:15:49.893 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.889+0000 7fa9f7153640 1 -- 10.20.193.49:0/1004741972 shutdown_connections 2026-02-17T11:15:49.893 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.889+0000 7fa9f7153640 1 --2- 10.20.193.49:0/1004741972 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fa9c0079140 0x7fa9c007b600 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:49.893 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.889+0000 7fa9f7153640 1 --2- 10.20.193.49:0/1004741972 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fa9f01440c0 0x7fa9f014ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:49.893 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.889+0000 7fa9f7153640 1 --2- 10.20.193.49:0/1004741972 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fa9f0074ad0 0x7fa9f014a710 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:49.893 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.889+0000 7fa9f7153640 1 --2- 10.20.193.49:0/1004741972 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fa9dc009ab0 0x7fa9f0074590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:49.893 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.889+0000 7fa9f7153640 1 -- 10.20.193.49:0/1004741972 >> 10.20.193.49:0/1004741972 conn(0x7fa9f00c9f20 msgr2=0x7fa9f01528d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:49.893 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.889+0000 7fa9f7153640 1 -- 10.20.193.49:0/1004741972 shutdown_connections 2026-02-17T11:15:49.893 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.889+0000 7fa9f7153640 1 -- 10.20.193.49:0/1004741972 wait complete. 2026-02-17T11:15:49.894 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.889+0000 7fa9f7153640 1 librados: shutdown 2026-02-17T11:15:49.899 INFO:tasks.ceph:Scrubbing osd.11 2026-02-17T11:15:49.899 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 config set osd_debug_deep_scrub_sleep 0 2026-02-17T11:15:49.972 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.967+0000 7f8a8920c640 10 monclient: get_monmap_and_config 2026-02-17T11:15:49.972 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.967+0000 7f8a8920c640 10 monclient: build_initial_monmap 2026-02-17T11:15:49.972 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.967+0000 7f8a8920c640 10 monclient: monmap: 2026-02-17T11:15:49.972 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:49.972 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:49.973 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:15:49.968139+0000 2026-02-17T11:15:49.973 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:15:49.968139+0000 2026-02-17T11:15:49.973 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:49.973 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:49.973 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:15:49.973 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:15:49.973 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:15:49.973 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:15:49.973 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:15:49.973 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:15:49.973 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:49.974 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.968+0000 7f8a8920c640 1 Processor -- start 2026-02-17T11:15:49.974 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.968+0000 7f8a8920c640 1 -- start start 2026-02-17T11:15:49.974 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.968+0000 7f8a8920c640 10 monclient: init 2026-02-17T11:15:49.974 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.968+0000 7f8a8920c640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:49.974 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.968+0000 7f8a8920c640 10 monclient: _add_conns ranks=[3,4,5,2,0,1] 2026-02-17T11:15:49.974 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.968+0000 7f8a8920c640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f8a8415d3c0 0x7f8a8415d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:49.974 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.968+0000 7f8a8920c640 10 monclient(hunting): picked mon.noname-a con 0x7f8a8415d3c0 addr v2:10.20.193.49:3300/0 2026-02-17T11:15:49.974 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.968+0000 7f8a8920c640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f8a840c94c0 0x7f8a8415b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:49.974 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.968+0000 7f8a8920c640 10 monclient(hunting): picked mon.noname-b con 0x7f8a840c94c0 addr v2:10.20.193.97:3300/0 2026-02-17T11:15:49.974 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.968+0000 7f8a8920c640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f8a840c7300 0x7f8a840c52f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:49.974 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.968+0000 7f8a8920c640 10 monclient(hunting): picked mon.noname-c con 0x7f8a840c7300 addr v2:10.20.193.157:3300/0 2026-02-17T11:15:49.974 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.968+0000 7f8a8920c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:49.975 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.968+0000 7f8a8920c640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f8a840c7e60 con 0x7f8a8415d3c0 2026-02-17T11:15:49.975 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.968+0000 7f8a8920c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:49.975 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.968+0000 7f8a8920c640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f8a840c8140 con 0x7f8a840c94c0 2026-02-17T11:15:49.975 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.968+0000 7f8a8920c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:49.975 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.968+0000 7f8a8920c640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f8a840c8420 con 0x7f8a840c7300 2026-02-17T11:15:49.975 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.968+0000 7f8a8920c640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:49.975 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.968+0000 7f8a8920c640 10 monclient(hunting): authenticate will time out at 1426.631715s 2026-02-17T11:15:49.975 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.969+0000 7f8a82d76640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f8a8415d3c0 0x7f8a8415d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:49.975 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.969+0000 7f8a83577640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f8a840c7300 0x7f8a840c52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:49.975 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.969+0000 7f8a82575640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f8a840c94c0 0x7f8a8415b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:49.975 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.969+0000 7f8a83577640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f8a840c7300 0x7f8a840c52f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:53438/0 (socket says 10.20.193.49:53438) 2026-02-17T11:15:49.975 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.969+0000 7f8a82d76640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f8a8415d3c0 0x7f8a8415d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:43350/0 (socket says 10.20.193.49:43350) 2026-02-17T11:15:49.975 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.969+0000 7f8a83577640 1 -- 10.20.193.49:0/576615118 learned_addr learned my addr 10.20.193.49:0/576615118 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:49.976 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.969+0000 7f8a82d76640 10 monclient(hunting): get_auth_request con 0x7f8a8415d3c0 auth_method 0 2026-02-17T11:15:49.976 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.969+0000 7f8a82d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:49.976 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.969+0000 7f8a82d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:49.976 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.969+0000 7f8a82d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:49.976 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.969+0000 7f8a83577640 10 monclient(hunting): get_auth_request con 0x7f8a840c7300 auth_method 0 2026-02-17T11:15:49.976 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.969+0000 7f8a83577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:49.976 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.969+0000 7f8a83577640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:49.976 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.969+0000 7f8a83577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:49.976 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.969+0000 7f8a82575640 10 monclient(hunting): get_auth_request con 0x7f8a840c94c0 auth_method 0 2026-02-17T11:15:49.976 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.969+0000 7f8a82575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:49.976 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.969+0000 7f8a82575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:49.976 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.969+0000 7f8a82575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:49.976 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.969+0000 7f8a83577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:49.977 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.969+0000 7f8a83577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:49.977 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.969+0000 7f8a83577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:49.977 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.969+0000 7f8a82d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:49.977 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.969+0000 7f8a82d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:49.977 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.969+0000 7f8a82d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:49.977 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.969+0000 7f8a82575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:49.977 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.969+0000 7f8a82575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:49.977 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.969+0000 7f8a82575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:49.977 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.970+0000 7f8a83577640 10 monclient(hunting): handle_auth_done global_id 5375 payload 274 2026-02-17T11:15:49.977 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.970+0000 7f8a83577640 1 -- 10.20.193.49:0/576615118 >> v2:10.20.193.97:3300/0 conn(0x7f8a840c94c0 msgr2=0x7f8a8415b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:15:49.977 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.970+0000 7f8a83577640 1 --2- 10.20.193.49:0/576615118 >> v2:10.20.193.97:3300/0 conn(0x7f8a840c94c0 0x7f8a8415b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:49.977 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.970+0000 7f8a83577640 1 -- 10.20.193.49:0/576615118 >> v2:10.20.193.49:3300/0 conn(0x7f8a8415d3c0 msgr2=0x7f8a8415d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:15:49.977 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.970+0000 7f8a83577640 1 --2- 10.20.193.49:0/576615118 >> v2:10.20.193.49:3300/0 conn(0x7f8a8415d3c0 0x7f8a8415d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:49.978 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.970+0000 7f8a83577640 10 monclient: _finish_hunting 0 2026-02-17T11:15:49.978 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.970+0000 7f8a83577640 1 monclient: found mon.noname-c 2026-02-17T11:15:49.978 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.970+0000 7f8a83577640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:49.978 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.970+0000 7f8a83577640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:15:49.978 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.970+0000 7f8a83577640 1 -- 10.20.193.49:0/576615118 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a840c8700 con 0x7f8a840c7300 2026-02-17T11:15:49.984 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.971+0000 7f8a83577640 1 --2- 10.20.193.49:0/576615118 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f8a840c7300 0x7f8a840c52f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8a84069390 tx=0x7f8a7402f3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afb0f99158e059f7 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:49.985 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.973+0000 7f8a81d74640 1 -- 10.20.193.49:0/576615118 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a7402fe20 con 0x7f8a840c7300 2026-02-17T11:15:49.985 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.973+0000 7f8a81d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:49.985 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.973+0000 7f8a81d74640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:15:49.985 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.973+0000 7f8a81d74640 10 monclient: dump: 2026-02-17T11:15:49.985 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:49.985 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:49.985 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:49.985 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:49.985 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:49.985 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:49.986 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:49.986 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:49.986 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:49.986 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:49.986 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.973+0000 7f8a81d74640 10 monclient: _finish_auth 0 2026-02-17T11:15:49.986 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.973+0000 7f8a81d74640 10 monclient: _check_auth_tickets 2026-02-17T11:15:49.986 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.973+0000 7f8a81d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:49.986 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.973+0000 7f8a8920c640 5 monclient: authenticate success, global_id 5375 2026-02-17T11:15:49.986 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.973+0000 7f8a81d74640 1 -- 10.20.193.49:0/576615118 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a740373f0 con 0x7f8a840c7300 2026-02-17T11:15:49.986 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.973+0000 7f8a8920c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:15:49.986 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.973+0000 7f8a81d74640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:49.986 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.973+0000 7f8a81d74640 1 -- 10.20.193.49:0/576615118 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a740377c0 con 0x7f8a840c7300 2026-02-17T11:15:49.987 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.973+0000 7f8a81d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:49.987 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.973+0000 7f8a81d74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:15:49.987 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.973+0000 7f8a81d74640 10 monclient: dump: 2026-02-17T11:15:49.987 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:49.987 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:49.987 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:49.987 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:49.987 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:49.987 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:49.987 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:49.987 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:49.987 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:49.987 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:49.988 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.973+0000 7f8a8920c640 10 monclient: get_monmap_and_config success 2026-02-17T11:15:49.988 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.973+0000 7f8a8920c640 4 set_mon_vals no callback set 2026-02-17T11:15:49.988 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.973+0000 7f8a8920c640 10 monclient: shutdown 2026-02-17T11:15:49.988 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.973+0000 7f8a8920c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:49.988 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.973+0000 7f8a8920c640 1 -- 10.20.193.49:0/576615118 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f8a840c7300 msgr2=0x7f8a840c52f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:49.988 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.973+0000 7f8a8920c640 1 --2- 10.20.193.49:0/576615118 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f8a840c7300 0x7f8a840c52f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8a84069390 tx=0x7f8a7402f3b0 comp rx=0 tx=0).stop 2026-02-17T11:15:49.988 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.973+0000 7f8a8920c640 1 -- 10.20.193.49:0/576615118 shutdown_connections 2026-02-17T11:15:49.988 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.973+0000 7f8a8920c640 1 --2- 10.20.193.49:0/576615118 >> v2:10.20.193.97:3300/0 conn(0x7f8a840c94c0 0x7f8a8415b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:49.988 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.973+0000 7f8a8920c640 1 --2- 10.20.193.49:0/576615118 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f8a840c7300 0x7f8a840c52f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:49.988 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.973+0000 7f8a8920c640 1 --2- 10.20.193.49:0/576615118 >> v2:10.20.193.49:3300/0 conn(0x7f8a8415d3c0 0x7f8a8415d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:49.988 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.973+0000 7f8a8920c640 1 -- 10.20.193.49:0/576615118 >> 10.20.193.49:0/576615118 conn(0x7f8a840c9f60 msgr2=0x7f8a840ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:49.988 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.973+0000 7f8a8920c640 1 -- 10.20.193.49:0/576615118 shutdown_connections 2026-02-17T11:15:49.989 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.973+0000 7f8a8920c640 1 -- 10.20.193.49:0/576615118 wait complete. 2026-02-17T11:15:49.989 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.974+0000 7f8a8920c640 10 monclient: build_initial_monmap 2026-02-17T11:15:49.989 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.974+0000 7f8a8920c640 10 monclient: monmap: 2026-02-17T11:15:49.989 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:49.989 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:15:49.989 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:15:49.989 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:15:49.989 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:49.989 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:49.989 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:15:49.989 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:15:49.989 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:15:49.989 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:49.990 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.974+0000 7f8a8920c640 1 librados: starting msgr at 2026-02-17T11:15:49.990 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.974+0000 7f8a8920c640 1 librados: starting objecter 2026-02-17T11:15:49.990 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.974+0000 7f8a8920c640 1 Processor -- start 2026-02-17T11:15:49.990 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.974+0000 7f8a8920c640 1 -- start start 2026-02-17T11:15:49.990 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.974+0000 7f8a8920c640 1 librados: setting wanted keys 2026-02-17T11:15:49.990 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.974+0000 7f8a8920c640 1 librados: calling monclient init 2026-02-17T11:15:49.990 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.974+0000 7f8a8920c640 10 monclient: init 2026-02-17T11:15:49.990 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.974+0000 7f8a8920c640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:49.990 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.974+0000 7f8a8920c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:15:49.990 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.974+0000 7f8a8920c640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f8a840c7300 0x7f8a841f29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:49.990 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.974+0000 7f8a8920c640 10 monclient(hunting): picked mon.noname-a con 0x7f8a840c7300 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:15:49.990 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.974+0000 7f8a8920c640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f8a840c94c0 0x7f8a8413e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:49.990 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.974+0000 7f8a8920c640 10 monclient(hunting): picked mon.noname-b con 0x7f8a840c94c0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:15:49.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.974+0000 7f8a8920c640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f8a8415d3c0 0x7f8a8413ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:49.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.974+0000 7f8a8920c640 10 monclient(hunting): picked mon.noname-c con 0x7f8a8415d3c0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:15:49.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.974+0000 7f8a8920c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:49.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.974+0000 7f8a8920c640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8a840c8fa0 con 0x7f8a840c7300 2026-02-17T11:15:49.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.974+0000 7f8a8920c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:49.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.974+0000 7f8a8920c640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f8a840c8cc0 con 0x7f8a840c94c0 2026-02-17T11:15:49.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.974+0000 7f8a8920c640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:49.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.974+0000 7f8a8920c640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f8a840c7750 con 0x7f8a8415d3c0 2026-02-17T11:15:49.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.974+0000 7f8a8920c640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:49.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.974+0000 7f8a8920c640 10 monclient(hunting): authenticate will time out at 1426.637987s 2026-02-17T11:15:49.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.975+0000 7f8a82d76640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f8a840c7300 0x7f8a841f29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:49.991 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.975+0000 7f8a82575640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f8a840c94c0 0x7f8a8413e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:49.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.975+0000 7f8a83577640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f8a8415d3c0 0x7f8a8413ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:49.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.975+0000 7f8a82d76640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f8a840c7300 0x7f8a841f29a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:43366/0 (socket says 10.20.193.49:43366) 2026-02-17T11:15:49.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.975+0000 7f8a82d76640 1 -- 10.20.193.49:0/2568493353 learned_addr learned my addr 10.20.193.49:0/2568493353 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:49.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.975+0000 7f8a82d76640 10 monclient(hunting): get_auth_request con 0x7f8a840c7300 auth_method 0 2026-02-17T11:15:49.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.975+0000 7f8a82d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:49.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.975+0000 7f8a82d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:49.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.975+0000 7f8a82d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:49.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.975+0000 7f8a82575640 10 monclient(hunting): get_auth_request con 0x7f8a840c94c0 auth_method 0 2026-02-17T11:15:49.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.975+0000 7f8a82575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:49.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.975+0000 7f8a82575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:49.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.975+0000 7f8a82575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:49.992 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.975+0000 7f8a83577640 10 monclient(hunting): get_auth_request con 0x7f8a8415d3c0 auth_method 0 2026-02-17T11:15:49.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.975+0000 7f8a83577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:49.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.975+0000 7f8a83577640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:49.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.975+0000 7f8a83577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:49.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.975+0000 7f8a83577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:49.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.975+0000 7f8a83577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:49.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.975+0000 7f8a83577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:49.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.975+0000 7f8a82575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:49.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.975+0000 7f8a82575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:49.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.975+0000 7f8a82575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:49.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.975+0000 7f8a82d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:49.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.975+0000 7f8a82d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:49.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.975+0000 7f8a82d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:49.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.976+0000 7f8a82575640 10 monclient(hunting): handle_auth_done global_id 5296 payload 824 2026-02-17T11:15:49.993 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.976+0000 7f8a82575640 1 -- 10.20.193.49:0/2568493353 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f8a8415d3c0 msgr2=0x7f8a8413ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:49.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.976+0000 7f8a82575640 1 --2- 10.20.193.49:0/2568493353 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f8a8415d3c0 0x7f8a8413ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:49.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.976+0000 7f8a82575640 1 -- 10.20.193.49:0/2568493353 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f8a840c7300 msgr2=0x7f8a841f29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:49.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.976+0000 7f8a82575640 1 --2- 10.20.193.49:0/2568493353 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f8a840c7300 0x7f8a841f29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:49.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.976+0000 7f8a82575640 10 monclient: _finish_hunting 0 2026-02-17T11:15:49.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.976+0000 7f8a82575640 1 monclient: found mon.noname-b 2026-02-17T11:15:49.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.976+0000 7f8a82575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:49.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.976+0000 7f8a82575640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:15:49.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.976+0000 7f8a82575640 1 -- 10.20.193.49:0/2568493353 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a84157790 con 0x7f8a840c94c0 2026-02-17T11:15:49.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.977+0000 7f8a82575640 1 --2- 10.20.193.49:0/2568493353 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f8a840c94c0 0x7f8a8413e840 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c00e8d0 tx=0x7f8a6c00eda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:49.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.977+0000 7f8a637fe640 10 client.?.objecter ms_handle_connect 0x7f8a840c94c0 2026-02-17T11:15:49.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.977+0000 7f8a637fe640 10 client.?.objecter resend_mon_ops 2026-02-17T11:15:49.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.978+0000 7f8a637fe640 1 -- 10.20.193.49:0/2568493353 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c017070 con 0x7f8a840c94c0 2026-02-17T11:15:49.994 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.978+0000 7f8a637fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:49.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.978+0000 7f8a637fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:15:49.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.978+0000 7f8a637fe640 10 monclient: dump: 2026-02-17T11:15:49.995 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:49.995 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:49.995 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:49.995 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:49.995 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:49.995 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:49.995 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:49.995 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:49.995 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:49.995 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:49.995 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.978+0000 7f8a637fe640 10 monclient: _finish_auth 0 2026-02-17T11:15:49.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.978+0000 7f8a637fe640 10 monclient: _check_auth_tickets 2026-02-17T11:15:49.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.978+0000 7f8a637fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:49.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.978+0000 7f8a8920c640 5 monclient: authenticate success, global_id 5296 2026-02-17T11:15:49.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.978+0000 7f8a8920c640 10 monclient: _renew_subs 2026-02-17T11:15:49.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.978+0000 7f8a8920c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:15:49.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.978+0000 7f8a8920c640 1 -- 10.20.193.49:0/2568493353 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a84158ea0 con 0x7f8a840c94c0 2026-02-17T11:15:49.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.979+0000 7f8a8920c640 10 client.5296.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:49.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.979+0000 7f8a8920c640 10 monclient: _renew_subs 2026-02-17T11:15:49.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.979+0000 7f8a8920c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:15:49.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.979+0000 7f8a8920c640 1 -- 10.20.193.49:0/2568493353 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a84159460 con 0x7f8a840c94c0 2026-02-17T11:15:49.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.979+0000 7f8a8920c640 1 librados: init done 2026-02-17T11:15:49.996 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.979+0000 7f8a8920c640 10 client.5296.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:49.997 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.979+0000 7f8a8920c640 15 client.5296.objecter _session_command_op_assign -1 1 2026-02-17T11:15:49.997 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.979+0000 7f8a8920c640 20 client.5296.objecter _get_session osd=-1 returning homeless 2026-02-17T11:15:49.997 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.979+0000 7f8a8920c640 10 client.5296.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:49.997 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.979+0000 7f8a8920c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:15:49.997 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.979+0000 7f8a8920c640 1 -- 10.20.193.49:0/2568493353 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8a84159fe0 con 0x7f8a840c94c0 2026-02-17T11:15:49.997 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.979+0000 7f8a637fe640 1 -- 10.20.193.49:0/2568493353 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a84159fe0 con 0x7f8a840c94c0 2026-02-17T11:15:49.997 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.979+0000 7f8a637fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:49.997 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.979+0000 7f8a637fe640 1 -- 10.20.193.49:0/2568493353 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c021060 con 0x7f8a840c94c0 2026-02-17T11:15:49.997 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.979+0000 7f8a637fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:49.997 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.979+0000 7f8a81573640 4 set_mon_vals no callback set 2026-02-17T11:15:49.998 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.979+0000 7f8a637fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:15:49.998 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.979+0000 7f8a637fe640 10 monclient: dump: 2026-02-17T11:15:49.998 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:49.998 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:49.998 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:49.998 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:49.998 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:49.998 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:49.998 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:49.998 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:49.998 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:49.998 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:50.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.991+0000 7f8a637fe640 1 -- 10.20.193.49:0/2568493353 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f8a6c024060 con 0x7f8a840c94c0 2026-02-17T11:15:50.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.992+0000 7f8a637fe640 1 --2- 10.20.193.49:0/2568493353 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f8a50079140 0x7f8a5007b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:50.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.992+0000 7f8a82d76640 1 --2- 10.20.193.49:0/2568493353 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f8a50079140 0x7f8a5007b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:50.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.992+0000 7f8a82d76640 10 monclient: get_auth_request con 0x7f8a50079140 auth_method 0 2026-02-17T11:15:50.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.992+0000 7f8a637fe640 1 -- 10.20.193.49:0/2568493353 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f8a6c097620 con 0x7f8a840c94c0 2026-02-17T11:15:50.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.992+0000 7f8a637fe640 10 client.5296.objecter ms_dispatch2 0x7f8a84000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:15:50.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.992+0000 7f8a637fe640 3 client.5296.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:15:50.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.992+0000 7f8a637fe640 3 client.5296.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:15:50.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.992+0000 7f8a637fe640 10 client.5296.objecter checking command 1 2026-02-17T11:15:50.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.992+0000 7f8a637fe640 1 --2- 10.20.193.49:0/2568493353 >> [v2:10.20.193.162:6802/3400543064,v1:10.20.193.162:6803/3400543064] conn(0x7f8a50081620 0x7f8a50083a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:50.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.992+0000 7f8a637fe640 20 client.5296.objecter _get_session s=0x7f8a50080f50 osd=11 3 2026-02-17T11:15:50.001 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.992+0000 7f8a637fe640 20 client.5296.objecter put_session s=0x7f8a50080f50 osd=11 3 2026-02-17T11:15:50.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.992+0000 7f8a637fe640 15 client.5296.objecter _session_command_op_remove -1 1 2026-02-17T11:15:50.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.992+0000 7f8a637fe640 20 client.5296.objecter _get_session s=0x7f8a50080f50 osd=11 3 2026-02-17T11:15:50.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.992+0000 7f8a637fe640 20 client.5296.objecter get_session s=0x7f8a50080f50 osd=11 3 2026-02-17T11:15:50.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.992+0000 7f8a637fe640 15 client.5296.objecter _session_command_op_assign 11 1 2026-02-17T11:15:50.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.992+0000 7f8a637fe640 20 client.5296.objecter put_session s=0x7f8a50080f50 osd=11 4 2026-02-17T11:15:50.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.992+0000 7f8a637fe640 10 client.5296.objecter _send_command 1 2026-02-17T11:15:50.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.992+0000 7f8a637fe640 1 -- 10.20.193.49:0/2568493353 --> [v2:10.20.193.162:6802/3400543064,v1:10.20.193.162:6803/3400543064] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8a6c00be50 con 0x7f8a50081620 2026-02-17T11:15:50.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.992+0000 7f8a637fe640 20 client.5296.objecter dump_active .. 0 homeless 2026-02-17T11:15:50.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.992+0000 7f8a637fe640 1 -- 10.20.193.49:0/2568493353 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f8a6c05df40 con 0x7f8a840c94c0 2026-02-17T11:15:50.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.992+0000 7f8a637fe640 10 monclient: handle_get_version_reply finishing 1 version 34 2026-02-17T11:15:50.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.993+0000 7f8a82d76640 1 --2- 10.20.193.49:0/2568493353 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f8a50079140 0x7f8a5007b600 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8a78009d00 tx=0x7f8a78009290 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:50.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.993+0000 7f8a637fe640 10 client.5296.objecter ms_handle_connect 0x7f8a50079140 2026-02-17T11:15:50.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.993+0000 7f8a83577640 1 --2- 10.20.193.49:0/2568493353 >> [v2:10.20.193.162:6802/3400543064,v1:10.20.193.162:6803/3400543064] conn(0x7f8a50081620 0x7f8a50083a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:50.002 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.993+0000 7f8a83577640 10 monclient: get_auth_request con 0x7f8a50081620 auth_method 0 2026-02-17T11:15:50.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.995+0000 7f8a637fe640 10 client.5296.objecter ms_handle_connect 0x7f8a50081620 2026-02-17T11:15:50.003 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:49.995+0000 7f8a83577640 1 --2- 10.20.193.49:0/2568493353 >> [v2:10.20.193.162:6802/3400543064,v1:10.20.193.162:6803/3400543064] conn(0x7f8a50081620 0x7f8a50083a40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:50.007 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.005+0000 7f8a637fe640 1 -- 10.20.193.49:0/2568493353 <== osd.11 v2:10.20.193.162:6802/3400543064 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f8a6c00be50 con 0x7f8a50081620 2026-02-17T11:15:50.007 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.005+0000 7f8a637fe640 10 client.5296.objecter ms_dispatch2 0x7f8a84000b90 command_reply(tid 1: 0 ) 2026-02-17T11:15:50.007 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.005+0000 7f8a637fe640 10 client.5296.objecter _finish_command 1 = system:0 2026-02-17T11:15:50.007 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.005+0000 7f8a637fe640 20 client.5296.objecter put_session s=0x7f8a50080f50 osd=11 4 2026-02-17T11:15:50.007 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.005+0000 7f8a637fe640 15 client.5296.objecter _session_command_op_remove 11 1 2026-02-17T11:15:50.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.011+0000 7f8a8920c640 10 client.5296.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T11:15:50.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.011+0000 7f8a8920c640 15 client.5296.objecter _session_command_op_assign -1 2 2026-02-17T11:15:50.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.011+0000 7f8a8920c640 20 client.5296.objecter _get_session s=0x7f8a50080f50 osd=11 3 2026-02-17T11:15:50.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.011+0000 7f8a8920c640 20 client.5296.objecter put_session s=0x7f8a50080f50 osd=11 3 2026-02-17T11:15:50.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.011+0000 7f8a8920c640 20 client.5296.objecter _get_session s=0x7f8a50080f50 osd=11 3 2026-02-17T11:15:50.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.011+0000 7f8a8920c640 15 client.5296.objecter _session_command_op_remove -1 2 2026-02-17T11:15:50.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.011+0000 7f8a8920c640 20 client.5296.objecter get_session s=0x7f8a50080f50 osd=11 3 2026-02-17T11:15:50.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.011+0000 7f8a8920c640 15 client.5296.objecter _session_command_op_assign 11 2 2026-02-17T11:15:50.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.011+0000 7f8a8920c640 20 client.5296.objecter put_session s=0x7f8a50080f50 osd=11 4 2026-02-17T11:15:50.012 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.011+0000 7f8a8920c640 10 client.5296.objecter _send_command 2 2026-02-17T11:15:50.013 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.011+0000 7f8a8920c640 1 -- 10.20.193.49:0/2568493353 --> [v2:10.20.193.162:6802/3400543064,v1:10.20.193.162:6803/3400543064] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8a8415e2a0 con 0x7f8a50081620 2026-02-17T11:15:50.021 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.020+0000 7f8a637fe640 1 -- 10.20.193.49:0/2568493353 <== osd.11 v2:10.20.193.162:6802/3400543064 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f8a8415e2a0 con 0x7f8a50081620 2026-02-17T11:15:50.021 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.020+0000 7f8a637fe640 10 client.5296.objecter ms_dispatch2 0x7f8a84000b90 command_reply(tid 2: 0 ) 2026-02-17T11:15:50.021 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.020+0000 7f8a637fe640 10 client.5296.objecter _finish_command 2 = system:0 2026-02-17T11:15:50.021 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.020+0000 7f8a637fe640 20 client.5296.objecter put_session s=0x7f8a50080f50 osd=11 4 2026-02-17T11:15:50.021 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.020+0000 7f8a637fe640 15 client.5296.objecter _session_command_op_remove 11 2 2026-02-17T11:15:50.021 INFO:teuthology.orchestra.run.trial049.stdout:{ 2026-02-17T11:15:50.021 INFO:teuthology.orchestra.run.trial049.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T11:15:50.021 INFO:teuthology.orchestra.run.trial049.stdout:} 2026-02-17T11:15:50.021 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.020+0000 7f8a8920c640 10 librados: watch_flush enter 2026-02-17T11:15:50.022 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.020+0000 7f8a8920c640 10 librados: watch_flush exit 2026-02-17T11:15:50.022 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.020+0000 7f8a8920c640 10 client.5296.objecter close_session for osd.11 2026-02-17T11:15:50.022 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.020+0000 7f8a8920c640 1 -- 10.20.193.49:0/2568493353 >> [v2:10.20.193.162:6802/3400543064,v1:10.20.193.162:6803/3400543064] conn(0x7f8a50081620 msgr2=0x7f8a50083a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:50.022 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.020+0000 7f8a8920c640 1 --2- 10.20.193.49:0/2568493353 >> [v2:10.20.193.162:6802/3400543064,v1:10.20.193.162:6803/3400543064] conn(0x7f8a50081620 0x7f8a50083a40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:50.022 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.020+0000 7f8a8920c640 20 client.5296.objecter put_session s=0x7f8a50080f50 osd=11 1 2026-02-17T11:15:50.022 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.020+0000 7f8a8920c640 20 client.5296.objecter shutdown clearing up homeless session... 2026-02-17T11:15:50.022 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.020+0000 7f8a8920c640 10 client.5296.objecter successfully canceled tick 2026-02-17T11:15:50.022 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.020+0000 7f8a8920c640 1 -- 10.20.193.49:0/2568493353 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f8a50079140 msgr2=0x7f8a5007b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:50.022 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.020+0000 7f8a8920c640 1 --2- 10.20.193.49:0/2568493353 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f8a50079140 0x7f8a5007b600 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8a78009d00 tx=0x7f8a78009290 comp rx=0 tx=0).stop 2026-02-17T11:15:50.022 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.020+0000 7f8a8920c640 10 monclient: shutdown 2026-02-17T11:15:50.022 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.020+0000 7f8a8920c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:50.022 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.020+0000 7f8a8920c640 1 -- 10.20.193.49:0/2568493353 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f8a840c94c0 msgr2=0x7f8a8413e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:50.022 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.020+0000 7f8a8920c640 1 --2- 10.20.193.49:0/2568493353 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f8a840c94c0 0x7f8a8413e840 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c00e8d0 tx=0x7f8a6c00eda0 comp rx=0 tx=0).stop 2026-02-17T11:15:50.022 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.020+0000 7f8a83577640 1 -- 10.20.193.49:0/2568493353 reap_dead start 2026-02-17T11:15:50.022 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.020+0000 7f8a8920c640 1 -- 10.20.193.49:0/2568493353 shutdown_connections 2026-02-17T11:15:50.022 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.020+0000 7f8a8920c640 1 -- 10.20.193.49:0/2568493353 >> 10.20.193.49:0/2568493353 conn(0x7f8a840c9f60 msgr2=0x7f8a840cbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:50.022 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.020+0000 7f8a8920c640 1 -- 10.20.193.49:0/2568493353 shutdown_connections 2026-02-17T11:15:50.022 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.020+0000 7f8a8920c640 1 -- 10.20.193.49:0/2568493353 wait complete. 2026-02-17T11:15:50.022 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.020+0000 7f8a8920c640 1 librados: shutdown 2026-02-17T11:15:50.028 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 11 2026-02-17T11:15:50.096 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.094+0000 7f076cf61640 10 monclient: get_monmap_and_config 2026-02-17T11:15:50.096 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.094+0000 7f076cf61640 10 monclient: build_initial_monmap 2026-02-17T11:15:50.096 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.094+0000 7f076cf61640 10 monclient: monmap: 2026-02-17T11:15:50.096 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:50.096 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:50.097 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:15:50.094867+0000 2026-02-17T11:15:50.097 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:15:50.094867+0000 2026-02-17T11:15:50.097 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:50.097 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:50.097 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:15:50.097 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:15:50.097 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:15:50.097 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:15:50.097 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:15:50.097 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:15:50.097 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:50.098 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.094+0000 7f076cf61640 1 Processor -- start 2026-02-17T11:15:50.098 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.094+0000 7f076cf61640 1 -- start start 2026-02-17T11:15:50.098 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.094+0000 7f076cf61640 10 monclient: init 2026-02-17T11:15:50.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.095+0000 7f076cf61640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:50.100 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.095+0000 7f076cf61640 10 monclient: _add_conns ranks=[3,0,1,2,4,5] 2026-02-17T11:15:50.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.095+0000 7f076cf61640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f076814f280 0x7f07680c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:50.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.095+0000 7f076cf61640 10 monclient(hunting): picked mon.noname-a con 0x7f076814f280 addr v2:10.20.193.49:3300/0 2026-02-17T11:15:50.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.095+0000 7f076cf61640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f076814f660 addr v1:10.20.193.49:6789/0 2026-02-17T11:15:50.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.095+0000 7f076cf61640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f076815abc0 addr v1:10.20.193.97:6789/0 2026-02-17T11:15:50.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.095+0000 7f076cf61640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07680c7110 con 0x7f076814f660 2026-02-17T11:15:50.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.095+0000 7f076cf61640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07680c7390 con 0x7f076815abc0 2026-02-17T11:15:50.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.095+0000 7f076cf61640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:50.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.095+0000 7f076cf61640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f07680c7950 con 0x7f076814f280 2026-02-17T11:15:50.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.095+0000 7f076cf61640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:50.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.095+0000 7f076cf61640 10 monclient(hunting): authenticate will time out at 1426.758348s 2026-02-17T11:15:50.101 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.095+0000 7f0766575640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f076814f280 0x7f07680c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:50.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.095+0000 7f0766d76640 1 --1- >> v1:10.20.193.97:6789/0 conn(0x7f076815abc0 0x7f076815afe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.97:6789/0 says I am v1:10.20.193.49:49882/0 (socket says 10.20.193.49:49882) 2026-02-17T11:15:50.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.095+0000 7f0766d76640 1 -- 10.20.193.49:0/2317946743 learned_addr learned my addr 10.20.193.49:0/2317946743 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:15:50.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.096+0000 7f0766575640 10 monclient(hunting): get_auth_request con 0x7f076814f280 auth_method 0 2026-02-17T11:15:50.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.096+0000 7f0766575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:50.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.096+0000 7f0766575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:50.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.096+0000 7f0766575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:50.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.096+0000 7f0766575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:50.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.096+0000 7f0766575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:50.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.096+0000 7f0766575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:50.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.096+0000 7f0765573640 1 -- 10.20.193.49:0/2317946743 <== mon.1 v1:10.20.193.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3729165213 0 0) 0x7f07680c7390 con 0x7f076815abc0 2026-02-17T11:15:50.102 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.096+0000 7f0765573640 10 monclient(hunting): _negotiate 2026-02-17T11:15:50.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.096+0000 7f0765573640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:50.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.096+0000 7f0765573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:50.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.096+0000 7f0765573640 10 monclient(hunting): my global_id is 5299 2026-02-17T11:15:50.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.096+0000 7f0765573640 1 -- 10.20.193.49:0/2317946743 --> v1:10.20.193.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0754003620 con 0x7f076815abc0 2026-02-17T11:15:50.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.097+0000 7f0766575640 10 monclient(hunting): handle_auth_done global_id 5325 payload 274 2026-02-17T11:15:50.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.097+0000 7f0766575640 1 -- 10.20.193.49:0/2317946743 >> v1:10.20.193.97:6789/0 conn(0x7f076815abc0 legacy=0x7f076815afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:50.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.097+0000 7f0766575640 1 -- 10.20.193.49:0/2317946743 >> v1:10.20.193.49:6789/0 conn(0x7f076814f660 legacy=0x7f07680c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:50.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.097+0000 7f0766575640 10 monclient: _finish_hunting 0 2026-02-17T11:15:50.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.097+0000 7f0766575640 1 monclient: found mon.noname-a 2026-02-17T11:15:50.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.097+0000 7f0766575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:50.103 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.097+0000 7f0766575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:15:50.104 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.097+0000 7f0766575640 1 -- 10.20.193.49:0/2317946743 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07680c7670 con 0x7f076814f280 2026-02-17T11:15:50.111 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.099+0000 7f0766575640 1 --2- 10.20.193.49:0/2317946743 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f076814f280 0x7f07680c7e20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f075c0098a0 tx=0x7f075c02ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a1ab0ca142fcb00 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:50.111 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.101+0000 7f0765573640 1 -- 10.20.193.49:0/2317946743 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f075c03c070 con 0x7f076814f280 2026-02-17T11:15:50.111 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.101+0000 7f0765573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:50.111 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.101+0000 7f0765573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:15:50.111 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.101+0000 7f0765573640 10 monclient: dump: 2026-02-17T11:15:50.111 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:50.112 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:50.112 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:50.112 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:50.112 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:50.112 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:50.112 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:50.112 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:50.112 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:50.112 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:50.112 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.101+0000 7f0765573640 10 monclient: _finish_auth 0 2026-02-17T11:15:50.112 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.101+0000 7f0765573640 10 monclient: _check_auth_tickets 2026-02-17T11:15:50.113 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.101+0000 7f0765573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:50.113 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.101+0000 7f0765573640 1 -- 10.20.193.49:0/2317946743 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f075c02fc10 con 0x7f076814f280 2026-02-17T11:15:50.113 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.101+0000 7f076cf61640 5 monclient: authenticate success, global_id 5325 2026-02-17T11:15:50.113 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.101+0000 7f076cf61640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:15:50.113 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.101+0000 7f0765573640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:50.113 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.101+0000 7f0765573640 1 -- 10.20.193.49:0/2317946743 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f075c037440 con 0x7f076814f280 2026-02-17T11:15:50.113 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.101+0000 7f076cf61640 10 monclient: get_monmap_and_config success 2026-02-17T11:15:50.113 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.101+0000 7f0765573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:50.113 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.101+0000 7f076cf61640 4 set_mon_vals no callback set 2026-02-17T11:15:50.113 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.101+0000 7f0765573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:15:50.113 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.101+0000 7f0765573640 10 monclient: dump: 2026-02-17T11:15:50.114 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:50.114 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:50.114 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:50.114 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:50.114 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:50.114 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:50.114 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:50.114 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:50.114 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:50.114 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:50.115 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.101+0000 7f076cf61640 10 monclient: shutdown 2026-02-17T11:15:50.115 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.101+0000 7f076cf61640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:50.115 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.101+0000 7f076cf61640 1 -- 10.20.193.49:0/2317946743 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f076814f280 msgr2=0x7f07680c7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:50.115 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.101+0000 7f076cf61640 1 --2- 10.20.193.49:0/2317946743 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f076814f280 0x7f07680c7e20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f075c0098a0 tx=0x7f075c02ef00 comp rx=0 tx=0).stop 2026-02-17T11:15:50.115 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.101+0000 7f076cf61640 1 -- 10.20.193.49:0/2317946743 shutdown_connections 2026-02-17T11:15:50.115 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.101+0000 7f076cf61640 1 --2- 10.20.193.49:0/2317946743 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f076814f280 0x7f07680c7e20 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:50.115 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.101+0000 7f076cf61640 1 -- 10.20.193.49:0/2317946743 >> 10.20.193.49:0/2317946743 conn(0x7f07680c9f20 msgr2=0x7f07680ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:50.115 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.101+0000 7f076cf61640 1 -- 10.20.193.49:0/2317946743 shutdown_connections 2026-02-17T11:15:50.115 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.101+0000 7f076cf61640 1 -- 10.20.193.49:0/2317946743 wait complete. 2026-02-17T11:15:50.115 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.102+0000 7f076cf61640 10 monclient: build_initial_monmap 2026-02-17T11:15:50.115 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.102+0000 7f076cf61640 10 monclient: monmap: 2026-02-17T11:15:50.116 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:50.116 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:15:50.116 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:15:50.116 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:15:50.116 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:50.116 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:50.116 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:15:50.116 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:15:50.116 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:15:50.116 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:50.116 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.102+0000 7f076cf61640 1 librados: starting msgr at 2026-02-17T11:15:50.117 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.102+0000 7f076cf61640 1 librados: starting objecter 2026-02-17T11:15:50.117 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.102+0000 7f076cf61640 1 Processor -- start 2026-02-17T11:15:50.117 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.102+0000 7f076cf61640 1 -- start start 2026-02-17T11:15:50.117 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.102+0000 7f076cf61640 1 librados: setting wanted keys 2026-02-17T11:15:50.117 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.102+0000 7f076cf61640 1 librados: calling monclient init 2026-02-17T11:15:50.117 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.102+0000 7f076cf61640 10 monclient: init 2026-02-17T11:15:50.117 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.103+0000 7f076cf61640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:50.117 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.103+0000 7f076cf61640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:15:50.117 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.103+0000 7f076cf61640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f076814f280 0x7f07681f2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:50.117 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.103+0000 7f076cf61640 10 monclient(hunting): picked mon.noname-a con 0x7f076814f280 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:15:50.117 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.103+0000 7f076cf61640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f076814f660 0x7f076814db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:50.118 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.103+0000 7f076cf61640 10 monclient(hunting): picked mon.noname-b con 0x7f076814f660 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:15:50.118 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.103+0000 7f076cf61640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f076815abc0 0x7f07681f4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:50.118 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.103+0000 7f076cf61640 10 monclient(hunting): picked mon.noname-c con 0x7f076815abc0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:15:50.118 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.103+0000 7f076cf61640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:50.118 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.103+0000 7f076cf61640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f076815a3c0 con 0x7f076814f280 2026-02-17T11:15:50.118 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.103+0000 7f076cf61640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:50.118 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.103+0000 7f076cf61640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f076815a730 con 0x7f076814f660 2026-02-17T11:15:50.118 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.103+0000 7f076cf61640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:50.118 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.103+0000 7f076cf61640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f07680c8360 con 0x7f076815abc0 2026-02-17T11:15:50.118 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.103+0000 7f076cf61640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:50.118 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.103+0000 7f076cf61640 10 monclient(hunting): authenticate will time out at 1426.766131s 2026-02-17T11:15:50.119 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.103+0000 7f0766575640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f076814f280 0x7f07681f2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:50.119 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.103+0000 7f0766575640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f076814f280 0x7f07681f2480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:43380/0 (socket says 10.20.193.49:43380) 2026-02-17T11:15:50.119 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.103+0000 7f0766575640 1 -- 10.20.193.49:0/518323206 learned_addr learned my addr 10.20.193.49:0/518323206 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:50.119 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.103+0000 7f0766575640 10 monclient(hunting): get_auth_request con 0x7f076814f280 auth_method 0 2026-02-17T11:15:50.119 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.103+0000 7f0766575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:50.119 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.103+0000 7f0766575640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:50.119 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.103+0000 7f0766575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:50.119 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.103+0000 7f0765d74640 1 --2- 10.20.193.49:0/518323206 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f076814f660 0x7f076814db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:50.119 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.103+0000 7f0766d76640 1 --2- 10.20.193.49:0/518323206 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f076815abc0 0x7f07681f4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:50.119 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.103+0000 7f0766d76640 10 monclient(hunting): get_auth_request con 0x7f076815abc0 auth_method 0 2026-02-17T11:15:50.120 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.103+0000 7f0766d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:50.120 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.103+0000 7f0766d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:50.120 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.103+0000 7f0766d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:50.120 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.103+0000 7f0765d74640 10 monclient(hunting): get_auth_request con 0x7f076814f660 auth_method 0 2026-02-17T11:15:50.120 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.103+0000 7f0765d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:50.120 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.103+0000 7f0765d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:50.120 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.103+0000 7f0765d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:50.120 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.103+0000 7f0766575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:50.120 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.103+0000 7f0766575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:50.120 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.103+0000 7f0766575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:50.120 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.103+0000 7f0766d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:50.120 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.103+0000 7f0766d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:50.121 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.103+0000 7f0766d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:50.121 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.104+0000 7f0765d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:50.121 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.104+0000 7f0765d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:50.121 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.104+0000 7f0765d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:50.121 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.105+0000 7f0766575640 10 monclient(hunting): handle_auth_done global_id 5331 payload 824 2026-02-17T11:15:50.121 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.105+0000 7f0766575640 1 -- 10.20.193.49:0/518323206 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f076815abc0 msgr2=0x7f07681f4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:50.121 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.105+0000 7f0766575640 1 --2- 10.20.193.49:0/518323206 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f076815abc0 0x7f07681f4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:50.121 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.105+0000 7f0766575640 1 -- 10.20.193.49:0/518323206 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f076814f660 msgr2=0x7f076814db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:50.121 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.105+0000 7f0766575640 1 --2- 10.20.193.49:0/518323206 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f076814f660 0x7f076814db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:50.121 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.105+0000 7f0766575640 10 monclient: _finish_hunting 0 2026-02-17T11:15:50.122 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.105+0000 7f0766575640 1 monclient: found mon.noname-a 2026-02-17T11:15:50.122 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.105+0000 7f0766575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:50.122 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.105+0000 7f0766575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:15:50.122 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.105+0000 7f0766575640 1 -- 10.20.193.49:0/518323206 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07681f5070 con 0x7f076814f280 2026-02-17T11:15:50.122 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.106+0000 7f0766575640 1 --2- 10.20.193.49:0/518323206 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f076814f280 0x7f07681f2480 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f075c009130 tx=0x7f075c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:50.122 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.106+0000 7f074effd640 10 client.?.objecter ms_handle_connect 0x7f076814f280 2026-02-17T11:15:50.122 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.106+0000 7f074effd640 10 client.?.objecter resend_mon_ops 2026-02-17T11:15:50.122 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.107+0000 7f074effd640 1 -- 10.20.193.49:0/518323206 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f075c03c040 con 0x7f076814f280 2026-02-17T11:15:50.122 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.107+0000 7f074effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:50.122 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.107+0000 7f074effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:15:50.122 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.107+0000 7f074effd640 10 monclient: dump: 2026-02-17T11:15:50.123 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:50.123 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:50.123 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:50.123 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:50.123 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:50.123 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:50.123 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:50.123 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:50.123 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:50.123 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:50.124 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.107+0000 7f074effd640 10 monclient: _finish_auth 0 2026-02-17T11:15:50.124 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.107+0000 7f074effd640 10 monclient: _check_auth_tickets 2026-02-17T11:15:50.124 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.107+0000 7f074effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:50.124 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.107+0000 7f074effd640 1 -- 10.20.193.49:0/518323206 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f075c042630 con 0x7f076814f280 2026-02-17T11:15:50.124 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.107+0000 7f074effd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:50.124 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.107+0000 7f074effd640 1 -- 10.20.193.49:0/518323206 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f075c042a20 con 0x7f076814f280 2026-02-17T11:15:50.124 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.107+0000 7f076cf61640 5 monclient: authenticate success, global_id 5331 2026-02-17T11:15:50.124 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.107+0000 7f076cf61640 10 monclient: _renew_subs 2026-02-17T11:15:50.124 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.107+0000 7f076cf61640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:50.124 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.107+0000 7f0764d72640 4 set_mon_vals no callback set 2026-02-17T11:15:50.124 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.107+0000 7f076cf61640 1 -- 10.20.193.49:0/518323206 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07681f5350 con 0x7f076814f280 2026-02-17T11:15:50.124 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.107+0000 7f074effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:50.125 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.107+0000 7f074effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:15:50.125 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.107+0000 7f074effd640 10 monclient: dump: 2026-02-17T11:15:50.125 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:50.125 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:50.125 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:50.125 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:50.125 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:50.125 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:50.125 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:50.125 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:50.125 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:50.126 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:50.126 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.107+0000 7f076cf61640 10 client.5331.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:50.126 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.107+0000 7f076cf61640 10 monclient: _renew_subs 2026-02-17T11:15:50.126 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.107+0000 7f076cf61640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:50.126 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.107+0000 7f076cf61640 1 -- 10.20.193.49:0/518323206 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07681f1530 con 0x7f076814f280 2026-02-17T11:15:50.126 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.107+0000 7f076cf61640 1 librados: init done 2026-02-17T11:15:50.126 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.108+0000 7f076cf61640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:50.126 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.108+0000 7f076cf61640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:50.126 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.108+0000 7f076cf61640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:15:50.126 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.108+0000 7f076cf61640 1 -- 10.20.193.49:0/518323206 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07680c9b70 con 0x7f076814f280 2026-02-17T11:15:50.128 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.119+0000 7f074effd640 1 -- 10.20.193.49:0/518323206 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f075c04b450 con 0x7f076814f280 2026-02-17T11:15:50.128 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.120+0000 7f074effd640 1 --2- 10.20.193.49:0/518323206 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0734079190 0x7f073407b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:50.128 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.120+0000 7f0765d74640 1 --2- 10.20.193.49:0/518323206 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0734079190 0x7f073407b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:50.128 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.120+0000 7f0765d74640 10 monclient: get_auth_request con 0x7f0734079190 auth_method 0 2026-02-17T11:15:50.128 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.121+0000 7f074effd640 10 client.5331.objecter ms_handle_connect 0x7f0734079190 2026-02-17T11:15:50.128 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.121+0000 7f0765d74640 1 --2- 10.20.193.49:0/518323206 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0734079190 0x7f073407b650 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f07680c4710 tx=0x7f0750007ef0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:50.224 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.222+0000 7f074effd640 1 -- 10.20.193.49:0/518323206 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f075c02fb50 con 0x7f076814f280 2026-02-17T11:15:50.224 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.222+0000 7f074effd640 10 client.5331.objecter ms_dispatch2 0x7f0768000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:15:50.224 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.222+0000 7f074effd640 3 client.5331.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:15:50.225 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.222+0000 7f074effd640 3 client.5331.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:15:50.225 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.222+0000 7f074effd640 20 client.5331.objecter dump_active .. 0 homeless 2026-02-17T11:15:50.225 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.222+0000 7f074effd640 1 -- 10.20.193.49:0/518323206 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f075c086a50 con 0x7f076814f280 2026-02-17T11:15:50.225 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.222+0000 7f074effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:50.225 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.222+0000 7f074effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:15:50.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.305+0000 7f076cf61640 1 -- 10.20.193.49:0/518323206 --> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "11", "target": ["mon-mgr", ""]}) -- 0x7f07680c64f0 con 0x7f0734079190 2026-02-17T11:15:50.306 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.305+0000 7f074effd640 1 -- 10.20.193.49:0/518323206 <== mgr.4106 v2:10.20.193.162:6800/2614632098 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 11 to deep-scrub) ==== 42+0+0 (secure 0 0 0) 0x7f07680c64f0 con 0x7f0734079190 2026-02-17T11:15:50.306 INFO:teuthology.orchestra.run.trial049.stderr:instructed osd(s) 11 to deep-scrub 2026-02-17T11:15:50.307 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.306+0000 7f076cf61640 10 librados: watch_flush enter 2026-02-17T11:15:50.307 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.306+0000 7f076cf61640 10 librados: watch_flush exit 2026-02-17T11:15:50.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.306+0000 7f076cf61640 20 client.5331.objecter shutdown clearing up homeless session... 2026-02-17T11:15:50.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.306+0000 7f076cf61640 10 client.5331.objecter successfully canceled tick 2026-02-17T11:15:50.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.306+0000 7f076cf61640 1 -- 10.20.193.49:0/518323206 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0734079190 msgr2=0x7f073407b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:50.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.306+0000 7f076cf61640 1 --2- 10.20.193.49:0/518323206 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0734079190 0x7f073407b650 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f07680c4710 tx=0x7f0750007ef0 comp rx=0 tx=0).stop 2026-02-17T11:15:50.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.306+0000 7f076cf61640 10 monclient: shutdown 2026-02-17T11:15:50.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.306+0000 7f076cf61640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:50.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.306+0000 7f076cf61640 1 -- 10.20.193.49:0/518323206 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f076814f280 msgr2=0x7f07681f2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:50.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.306+0000 7f076cf61640 1 --2- 10.20.193.49:0/518323206 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f076814f280 0x7f07681f2480 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f075c009130 tx=0x7f075c0047c0 comp rx=0 tx=0).stop 2026-02-17T11:15:50.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.306+0000 7f076cf61640 1 -- 10.20.193.49:0/518323206 shutdown_connections 2026-02-17T11:15:50.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.306+0000 7f076cf61640 1 --2- 10.20.193.49:0/518323206 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0734079190 0x7f073407b650 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:50.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.306+0000 7f076cf61640 1 --2- 10.20.193.49:0/518323206 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f076815abc0 0x7f07681f4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:50.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.306+0000 7f076cf61640 1 --2- 10.20.193.49:0/518323206 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f076814f660 0x7f076814db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:50.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.306+0000 7f076cf61640 1 --2- 10.20.193.49:0/518323206 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f076814f280 0x7f07681f2480 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:50.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.306+0000 7f076cf61640 1 -- 10.20.193.49:0/518323206 >> 10.20.193.49:0/518323206 conn(0x7f07680c9f20 msgr2=0x7f076815c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:50.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.306+0000 7f076cf61640 1 -- 10.20.193.49:0/518323206 shutdown_connections 2026-02-17T11:15:50.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.306+0000 7f076cf61640 1 -- 10.20.193.49:0/518323206 wait complete. 2026-02-17T11:15:50.308 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.306+0000 7f076cf61640 1 librados: shutdown 2026-02-17T11:15:50.315 INFO:tasks.ceph:Scrubbing osd.15 2026-02-17T11:15:50.315 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.15 config set osd_debug_deep_scrub_sleep 0 2026-02-17T11:15:50.384 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.382+0000 7f029ed87640 10 monclient: get_monmap_and_config 2026-02-17T11:15:50.384 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.382+0000 7f029ed87640 10 monclient: build_initial_monmap 2026-02-17T11:15:50.385 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.382+0000 7f029ed87640 10 monclient: monmap: 2026-02-17T11:15:50.385 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:50.385 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:50.385 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:15:50.383109+0000 2026-02-17T11:15:50.385 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:15:50.383109+0000 2026-02-17T11:15:50.385 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:50.385 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:50.385 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:15:50.385 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:15:50.385 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:15:50.385 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:15:50.385 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:15:50.385 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:15:50.385 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:50.385 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.383+0000 7f029ed87640 1 Processor -- start 2026-02-17T11:15:50.385 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.383+0000 7f029ed87640 1 -- start start 2026-02-17T11:15:50.385 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.383+0000 7f029ed87640 10 monclient: init 2026-02-17T11:15:50.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.383+0000 7f029ed87640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:50.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.383+0000 7f029ed87640 10 monclient: _add_conns ranks=[2,5,4,0,1,3] 2026-02-17T11:15:50.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.383+0000 7f029ed87640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f029815c260 addr v1:10.20.193.157:6789/0 2026-02-17T11:15:50.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.383+0000 7f029ed87640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f02980c9b40 0x7f029815c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:50.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.383+0000 7f029ed87640 10 monclient(hunting): picked mon.noname-c con 0x7f02980c9b40 addr v2:10.20.193.157:3300/0 2026-02-17T11:15:50.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.383+0000 7f029ed87640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f02980c7e60 0x7f029815ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:50.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.383+0000 7f029ed87640 10 monclient(hunting): picked mon.noname-b con 0x7f02980c7e60 addr v2:10.20.193.97:3300/0 2026-02-17T11:15:50.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.383+0000 7f029ed87640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02980c7370 con 0x7f029815c260 2026-02-17T11:15:50.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.383+0000 7f029ed87640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:50.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.383+0000 7f029ed87640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f02980c7930 con 0x7f02980c7e60 2026-02-17T11:15:50.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.383+0000 7f029ed87640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:50.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.383+0000 7f029ed87640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f029815a6e0 con 0x7f02980c9b40 2026-02-17T11:15:50.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.383+0000 7f029ed87640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:50.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.383+0000 7f029ed87640 10 monclient(hunting): authenticate will time out at 1427.046654s 2026-02-17T11:15:50.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.384+0000 7f029cafc640 1 --1- >> v1:10.20.193.157:6789/0 conn(0x7f029815c260 0x7f02980c6ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.157:6789/0 says I am v1:10.20.193.49:44858/0 (socket says 10.20.193.49:44858) 2026-02-17T11:15:50.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.384+0000 7f029cafc640 1 -- 10.20.193.49:0/2988156318 learned_addr learned my addr 10.20.193.49:0/2988156318 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:15:50.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.384+0000 7f028ffff640 1 --2- 10.20.193.49:0/2988156318 >> v2:10.20.193.157:3300/0 conn(0x7f02980c9b40 0x7f029815c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:50.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.385+0000 7f028ffff640 10 monclient(hunting): get_auth_request con 0x7f02980c9b40 auth_method 0 2026-02-17T11:15:50.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.385+0000 7f028ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:50.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.385+0000 7f028ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:50.386 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.385+0000 7f028ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:50.387 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.385+0000 7f028ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:50.387 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.385+0000 7f028ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:50.387 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.385+0000 7f028ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:50.389 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.386+0000 7f029d2fd640 1 --2- 10.20.193.49:0/2988156318 >> v2:10.20.193.97:3300/0 conn(0x7f02980c7e60 0x7f029815ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:50.390 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.386+0000 7f029d2fd640 10 monclient(hunting): get_auth_request con 0x7f02980c7e60 auth_method 0 2026-02-17T11:15:50.390 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.386+0000 7f029d2fd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:50.390 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.386+0000 7f029d2fd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:50.390 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.386+0000 7f029d2fd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:50.390 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.386+0000 7f029d2fd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:50.390 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.386+0000 7f029d2fd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:50.391 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.386+0000 7f029d2fd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:50.391 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.386+0000 7f028ffff640 10 monclient(hunting): handle_auth_done global_id 5387 payload 274 2026-02-17T11:15:50.391 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.386+0000 7f028ffff640 1 -- 10.20.193.49:0/2988156318 >> v2:10.20.193.97:3300/0 conn(0x7f02980c7e60 msgr2=0x7f029815ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:15:50.391 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.386+0000 7f028ffff640 1 --2- 10.20.193.49:0/2988156318 >> v2:10.20.193.97:3300/0 conn(0x7f02980c7e60 0x7f029815ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:50.391 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.386+0000 7f028ffff640 1 -- 10.20.193.49:0/2988156318 >> v1:10.20.193.157:6789/0 conn(0x7f029815c260 legacy=0x7f02980c6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:50.391 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.386+0000 7f028ffff640 10 monclient: _finish_hunting 0 2026-02-17T11:15:50.392 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.386+0000 7f028ffff640 1 monclient: found mon.noname-c 2026-02-17T11:15:50.392 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.386+0000 7f028ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:50.392 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.386+0000 7f028ffff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:15:50.392 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.386+0000 7f028ffff640 1 -- 10.20.193.49:0/2988156318 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02980c7650 con 0x7f02980c9b40 2026-02-17T11:15:50.392 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.388+0000 7f028ffff640 1 --2- 10.20.193.49:0/2988156318 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f02980c9b40 0x7f029815c640 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f02980c49c0 tx=0x7f028002eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b73f1da9446f18a7 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:50.399 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.390+0000 7f028f7fe640 1 -- 10.20.193.49:0/2988156318 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f028003c070 con 0x7f02980c9b40 2026-02-17T11:15:50.400 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.390+0000 7f028f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:50.400 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.390+0000 7f028f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:15:50.400 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.390+0000 7f028f7fe640 10 monclient: dump: 2026-02-17T11:15:50.400 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:50.400 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:50.400 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:50.400 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:50.400 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:50.400 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:50.400 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:50.401 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:50.401 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:50.401 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:50.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.390+0000 7f028f7fe640 10 monclient: _finish_auth 0 2026-02-17T11:15:50.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.390+0000 7f028f7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:15:50.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.390+0000 7f028f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:50.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.390+0000 7f028f7fe640 1 -- 10.20.193.49:0/2988156318 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f028002fb80 con 0x7f02980c9b40 2026-02-17T11:15:50.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.390+0000 7f029ed87640 5 monclient: authenticate success, global_id 5387 2026-02-17T11:15:50.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.390+0000 7f029ed87640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:15:50.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.390+0000 7f028f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:50.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.390+0000 7f028f7fe640 1 -- 10.20.193.49:0/2988156318 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0280037440 con 0x7f02980c9b40 2026-02-17T11:15:50.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.390+0000 7f028f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:50.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.390+0000 7f028f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:15:50.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.390+0000 7f028f7fe640 10 monclient: dump: 2026-02-17T11:15:50.402 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:50.402 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:50.402 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:50.402 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:50.402 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:50.402 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:50.402 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:50.402 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:50.402 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:50.402 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:50.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.390+0000 7f029ed87640 10 monclient: get_monmap_and_config success 2026-02-17T11:15:50.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.390+0000 7f029ed87640 4 set_mon_vals no callback set 2026-02-17T11:15:50.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.390+0000 7f029ed87640 10 monclient: shutdown 2026-02-17T11:15:50.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.390+0000 7f029ed87640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:50.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.390+0000 7f029ed87640 1 -- 10.20.193.49:0/2988156318 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f02980c9b40 msgr2=0x7f029815c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:50.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.390+0000 7f029ed87640 1 --2- 10.20.193.49:0/2988156318 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f02980c9b40 0x7f029815c640 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f02980c49c0 tx=0x7f028002eeb0 comp rx=0 tx=0).stop 2026-02-17T11:15:50.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.390+0000 7f029ed87640 1 -- 10.20.193.49:0/2988156318 shutdown_connections 2026-02-17T11:15:50.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.390+0000 7f029ed87640 1 --2- 10.20.193.49:0/2988156318 >> v2:10.20.193.97:3300/0 conn(0x7f02980c7e60 0x7f029815ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:50.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.390+0000 7f029ed87640 1 --2- 10.20.193.49:0/2988156318 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f02980c9b40 0x7f029815c640 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:50.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.390+0000 7f029ed87640 1 -- 10.20.193.49:0/2988156318 >> 10.20.193.49:0/2988156318 conn(0x7f02980c9f60 msgr2=0x7f02980ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:50.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.390+0000 7f029ed87640 1 -- 10.20.193.49:0/2988156318 shutdown_connections 2026-02-17T11:15:50.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.390+0000 7f029ed87640 1 -- 10.20.193.49:0/2988156318 wait complete. 2026-02-17T11:15:50.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.391+0000 7f029ed87640 10 monclient: build_initial_monmap 2026-02-17T11:15:50.404 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.391+0000 7f029ed87640 10 monclient: monmap: 2026-02-17T11:15:50.404 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:50.404 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:15:50.404 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:15:50.404 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:15:50.404 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:50.404 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:50.404 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:15:50.404 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:15:50.404 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:15:50.404 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:50.404 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.391+0000 7f029ed87640 1 librados: starting msgr at 2026-02-17T11:15:50.405 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.391+0000 7f029ed87640 1 librados: starting objecter 2026-02-17T11:15:50.405 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.391+0000 7f029ed87640 1 Processor -- start 2026-02-17T11:15:50.405 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.391+0000 7f029ed87640 1 -- start start 2026-02-17T11:15:50.405 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.391+0000 7f029ed87640 1 librados: setting wanted keys 2026-02-17T11:15:50.405 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.391+0000 7f029ed87640 1 librados: calling monclient init 2026-02-17T11:15:50.405 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.391+0000 7f029ed87640 10 monclient: init 2026-02-17T11:15:50.405 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.391+0000 7f029ed87640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:50.405 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.391+0000 7f029ed87640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T11:15:50.405 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.391+0000 7f029ed87640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f02980c7e60 0x7f029806e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:50.405 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.391+0000 7f029ed87640 10 monclient(hunting): picked mon.noname-a con 0x7f02980c7e60 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:15:50.405 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.391+0000 7f029ed87640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f02980c9b40 0x7f02981f4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:50.405 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.391+0000 7f029ed87640 10 monclient(hunting): picked mon.noname-b con 0x7f02980c9b40 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:15:50.405 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.391+0000 7f029ed87640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f029815c260 0x7f0298141550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:50.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.391+0000 7f029ed87640 10 monclient(hunting): picked mon.noname-c con 0x7f029815c260 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:15:50.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.391+0000 7f029ed87640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:50.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.391+0000 7f029ed87640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f02980c8290 con 0x7f02980c7e60 2026-02-17T11:15:50.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.391+0000 7f029ed87640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:50.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.391+0000 7f029ed87640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f029815a370 con 0x7f02980c9b40 2026-02-17T11:15:50.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.391+0000 7f029ed87640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:50.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.391+0000 7f029ed87640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f02980c8410 con 0x7f029815c260 2026-02-17T11:15:50.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.391+0000 7f029ed87640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:50.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.391+0000 7f029ed87640 10 monclient(hunting): authenticate will time out at 1427.054824s 2026-02-17T11:15:50.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.392+0000 7f028ffff640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f02980c9b40 0x7f02981f4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:50.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.392+0000 7f029d2fd640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f029815c260 0x7f0298141550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:50.406 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.392+0000 7f029d2fd640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f029815c260 0x7f0298141550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:53472/0 (socket says 10.20.193.49:53472) 2026-02-17T11:15:50.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.392+0000 7f029d2fd640 1 -- 10.20.193.49:0/1976336774 learned_addr learned my addr 10.20.193.49:0/1976336774 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:50.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.392+0000 7f029d2fd640 10 monclient(hunting): get_auth_request con 0x7f029815c260 auth_method 0 2026-02-17T11:15:50.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.392+0000 7f029d2fd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:50.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.392+0000 7f029d2fd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:50.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.392+0000 7f029d2fd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:50.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.392+0000 7f028ffff640 10 monclient(hunting): get_auth_request con 0x7f02980c9b40 auth_method 0 2026-02-17T11:15:50.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.392+0000 7f028ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:50.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.392+0000 7f028ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:50.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.392+0000 7f028ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:50.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.392+0000 7f029d2fd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:50.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.392+0000 7f029d2fd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:50.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.392+0000 7f029d2fd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:50.407 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.392+0000 7f028ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:50.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.392+0000 7f028ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:50.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.392+0000 7f028ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:50.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.393+0000 7f029cafc640 1 --2- 10.20.193.49:0/1976336774 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f02980c7e60 0x7f029806e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:50.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.394+0000 7f028ffff640 10 monclient(hunting): handle_auth_done global_id 5308 payload 824 2026-02-17T11:15:50.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.394+0000 7f028ffff640 1 -- 10.20.193.49:0/1976336774 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f029815c260 msgr2=0x7f0298141550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:50.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.394+0000 7f028ffff640 1 --2- 10.20.193.49:0/1976336774 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f029815c260 0x7f0298141550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:50.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.394+0000 7f028ffff640 1 -- 10.20.193.49:0/1976336774 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f02980c7e60 msgr2=0x7f029806e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:50.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.394+0000 7f028ffff640 1 --2- 10.20.193.49:0/1976336774 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f02980c7e60 0x7f029806e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:50.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.394+0000 7f028ffff640 10 monclient: _finish_hunting 0 2026-02-17T11:15:50.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.394+0000 7f028ffff640 1 monclient: found mon.noname-b 2026-02-17T11:15:50.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.394+0000 7f028ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:50.408 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.394+0000 7f028ffff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:15:50.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.394+0000 7f028ffff640 1 -- 10.20.193.49:0/1976336774 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02981f49c0 con 0x7f02980c9b40 2026-02-17T11:15:50.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.395+0000 7f028ffff640 1 --2- 10.20.193.49:0/1976336774 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f02980c9b40 0x7f02981f4ee0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0280036000 tx=0x7f02800047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:50.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.395+0000 7f028d7fa640 10 client.?.objecter ms_handle_connect 0x7f02980c9b40 2026-02-17T11:15:50.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.395+0000 7f028d7fa640 10 client.?.objecter resend_mon_ops 2026-02-17T11:15:50.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.396+0000 7f028d7fa640 1 -- 10.20.193.49:0/1976336774 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f028003c040 con 0x7f02980c9b40 2026-02-17T11:15:50.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.396+0000 7f028d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:50.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.396+0000 7f028d7fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:15:50.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.396+0000 7f028d7fa640 10 monclient: dump: 2026-02-17T11:15:50.409 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:50.409 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:50.409 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:50.409 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:50.409 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:50.409 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:50.410 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:50.410 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:50.410 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:50.410 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:50.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.396+0000 7f028d7fa640 10 monclient: _finish_auth 0 2026-02-17T11:15:50.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.396+0000 7f028d7fa640 10 monclient: _check_auth_tickets 2026-02-17T11:15:50.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.396+0000 7f028d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:50.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.396+0000 7f029ed87640 5 monclient: authenticate success, global_id 5308 2026-02-17T11:15:50.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.396+0000 7f029ed87640 10 monclient: _renew_subs 2026-02-17T11:15:50.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.396+0000 7f029ed87640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:15:50.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.396+0000 7f029ed87640 1 -- 10.20.193.49:0/1976336774 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f029806d390 con 0x7f02980c9b40 2026-02-17T11:15:50.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.396+0000 7f029ed87640 10 client.5308.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:50.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.396+0000 7f029ed87640 10 monclient: _renew_subs 2026-02-17T11:15:50.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.396+0000 7f029ed87640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:15:50.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.396+0000 7f029ed87640 1 -- 10.20.193.49:0/1976336774 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f029806d630 con 0x7f02980c9b40 2026-02-17T11:15:50.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.396+0000 7f029ed87640 1 librados: init done 2026-02-17T11:15:50.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.397+0000 7f029ed87640 10 client.5308.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:50.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.397+0000 7f029ed87640 15 client.5308.objecter _session_command_op_assign -1 1 2026-02-17T11:15:50.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.397+0000 7f029ed87640 20 client.5308.objecter _get_session osd=-1 returning homeless 2026-02-17T11:15:50.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.397+0000 7f029ed87640 10 client.5308.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:50.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.397+0000 7f029ed87640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:15:50.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.397+0000 7f029ed87640 1 -- 10.20.193.49:0/1976336774 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f029806ded0 con 0x7f02980c9b40 2026-02-17T11:15:50.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.397+0000 7f028d7fa640 1 -- 10.20.193.49:0/1976336774 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f029806ded0 con 0x7f02980c9b40 2026-02-17T11:15:50.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.397+0000 7f028d7fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:50.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.397+0000 7f028d7fa640 1 -- 10.20.193.49:0/1976336774 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0280042450 con 0x7f02980c9b40 2026-02-17T11:15:50.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.397+0000 7f028d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:50.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.397+0000 7f028d7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:15:50.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.397+0000 7f028effd640 4 set_mon_vals no callback set 2026-02-17T11:15:50.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.397+0000 7f028d7fa640 10 monclient: dump: 2026-02-17T11:15:50.412 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:50.412 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:50.412 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:50.412 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:50.412 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:50.412 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:50.412 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:50.412 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:50.412 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:50.412 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:50.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.410+0000 7f028d7fa640 1 -- 10.20.193.49:0/1976336774 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f02800425f0 con 0x7f02980c9b40 2026-02-17T11:15:50.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.411+0000 7f028d7fa640 1 --2- 10.20.193.49:0/1976336774 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0268079170 0x7f026807b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:50.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.411+0000 7f029cafc640 1 --2- 10.20.193.49:0/1976336774 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0268079170 0x7f026807b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:50.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.411+0000 7f029cafc640 10 monclient: get_auth_request con 0x7f0268079170 auth_method 0 2026-02-17T11:15:50.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.411+0000 7f028d7fa640 1 -- 10.20.193.49:0/1976336774 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f02800bcee0 con 0x7f02980c9b40 2026-02-17T11:15:50.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.411+0000 7f028d7fa640 10 client.5308.objecter ms_dispatch2 0x7f0298000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:15:50.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.411+0000 7f028d7fa640 3 client.5308.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:15:50.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.411+0000 7f028d7fa640 3 client.5308.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:15:50.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.411+0000 7f028d7fa640 10 client.5308.objecter checking command 1 2026-02-17T11:15:50.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.411+0000 7f028d7fa640 1 --2- 10.20.193.49:0/1976336774 >> [v2:10.20.193.162:6819/3057705174,v1:10.20.193.162:6821/3057705174] conn(0x7f0268081650 0x7f0268083a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:50.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.411+0000 7f028d7fa640 20 client.5308.objecter _get_session s=0x7f0268080f80 osd=15 3 2026-02-17T11:15:50.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.411+0000 7f028d7fa640 20 client.5308.objecter put_session s=0x7f0268080f80 osd=15 3 2026-02-17T11:15:50.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.411+0000 7f028d7fa640 15 client.5308.objecter _session_command_op_remove -1 1 2026-02-17T11:15:50.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.411+0000 7f028d7fa640 20 client.5308.objecter _get_session s=0x7f0268080f80 osd=15 3 2026-02-17T11:15:50.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.411+0000 7f028d7fa640 20 client.5308.objecter get_session s=0x7f0268080f80 osd=15 3 2026-02-17T11:15:50.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.411+0000 7f028d7fa640 15 client.5308.objecter _session_command_op_assign 15 1 2026-02-17T11:15:50.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.411+0000 7f028d7fa640 20 client.5308.objecter put_session s=0x7f0268080f80 osd=15 4 2026-02-17T11:15:50.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.411+0000 7f028d7fa640 10 client.5308.objecter _send_command 1 2026-02-17T11:15:50.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.411+0000 7f028d7fa640 1 -- 10.20.193.49:0/1976336774 --> [v2:10.20.193.162:6819/3057705174,v1:10.20.193.162:6821/3057705174] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0268084140 con 0x7f0268081650 2026-02-17T11:15:50.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.411+0000 7f028d7fa640 20 client.5308.objecter dump_active .. 0 homeless 2026-02-17T11:15:50.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.411+0000 7f028d7fa640 1 -- 10.20.193.49:0/1976336774 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f02800838f0 con 0x7f02980c9b40 2026-02-17T11:15:50.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.411+0000 7f028d7fa640 10 monclient: handle_get_version_reply finishing 1 version 34 2026-02-17T11:15:50.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.411+0000 7f028d7fa640 10 client.5308.objecter ms_handle_connect 0x7f0268079170 2026-02-17T11:15:50.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.411+0000 7f029cafc640 1 --2- 10.20.193.49:0/1976336774 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0268079170 0x7f026807b630 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0288002770 tx=0x7f0288009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:50.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.411+0000 7f029d2fd640 1 --2- 10.20.193.49:0/1976336774 >> [v2:10.20.193.162:6819/3057705174,v1:10.20.193.162:6821/3057705174] conn(0x7f0268081650 0x7f0268083a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:50.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.412+0000 7f029d2fd640 10 monclient: get_auth_request con 0x7f0268081650 auth_method 0 2026-02-17T11:15:50.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.413+0000 7f029d2fd640 1 --2- 10.20.193.49:0/1976336774 >> [v2:10.20.193.162:6819/3057705174,v1:10.20.193.162:6821/3057705174] conn(0x7f0268081650 0x7f0268083a70 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.15 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:50.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.413+0000 7f028d7fa640 10 client.5308.objecter ms_handle_connect 0x7f0268081650 2026-02-17T11:15:50.425 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.423+0000 7f028d7fa640 1 -- 10.20.193.49:0/1976336774 <== osd.15 v2:10.20.193.162:6819/3057705174 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f0268084140 con 0x7f0268081650 2026-02-17T11:15:50.425 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.423+0000 7f028d7fa640 10 client.5308.objecter ms_dispatch2 0x7f0298000b90 command_reply(tid 1: 0 ) 2026-02-17T11:15:50.425 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.423+0000 7f028d7fa640 10 client.5308.objecter _finish_command 1 = system:0 2026-02-17T11:15:50.425 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.423+0000 7f028d7fa640 20 client.5308.objecter put_session s=0x7f0268080f80 osd=15 4 2026-02-17T11:15:50.425 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.423+0000 7f028d7fa640 15 client.5308.objecter _session_command_op_remove 15 1 2026-02-17T11:15:50.431 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.429+0000 7f029ed87640 10 client.5308.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T11:15:50.431 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.429+0000 7f029ed87640 15 client.5308.objecter _session_command_op_assign -1 2 2026-02-17T11:15:50.431 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.429+0000 7f029ed87640 20 client.5308.objecter _get_session s=0x7f0268080f80 osd=15 3 2026-02-17T11:15:50.431 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.429+0000 7f029ed87640 20 client.5308.objecter put_session s=0x7f0268080f80 osd=15 3 2026-02-17T11:15:50.431 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.429+0000 7f029ed87640 20 client.5308.objecter _get_session s=0x7f0268080f80 osd=15 3 2026-02-17T11:15:50.431 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.429+0000 7f029ed87640 15 client.5308.objecter _session_command_op_remove -1 2 2026-02-17T11:15:50.431 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.429+0000 7f029ed87640 20 client.5308.objecter get_session s=0x7f0268080f80 osd=15 3 2026-02-17T11:15:50.431 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.429+0000 7f029ed87640 15 client.5308.objecter _session_command_op_assign 15 2 2026-02-17T11:15:50.432 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.429+0000 7f029ed87640 20 client.5308.objecter put_session s=0x7f0268080f80 osd=15 4 2026-02-17T11:15:50.432 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.429+0000 7f029ed87640 10 client.5308.objecter _send_command 2 2026-02-17T11:15:50.432 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.429+0000 7f029ed87640 1 -- 10.20.193.49:0/1976336774 --> [v2:10.20.193.162:6819/3057705174,v1:10.20.193.162:6821/3057705174] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f029815c640 con 0x7f0268081650 2026-02-17T11:15:50.437 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.436+0000 7f028d7fa640 1 -- 10.20.193.49:0/1976336774 <== osd.15 v2:10.20.193.162:6819/3057705174 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f029815c640 con 0x7f0268081650 2026-02-17T11:15:50.437 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.436+0000 7f028d7fa640 10 client.5308.objecter ms_dispatch2 0x7f0298000b90 command_reply(tid 2: 0 ) 2026-02-17T11:15:50.438 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.436+0000 7f028d7fa640 10 client.5308.objecter _finish_command 2 = system:0 2026-02-17T11:15:50.438 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.436+0000 7f028d7fa640 20 client.5308.objecter put_session s=0x7f0268080f80 osd=15 4 2026-02-17T11:15:50.438 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.436+0000 7f028d7fa640 15 client.5308.objecter _session_command_op_remove 15 2 2026-02-17T11:15:50.438 INFO:teuthology.orchestra.run.trial049.stdout:{ 2026-02-17T11:15:50.438 INFO:teuthology.orchestra.run.trial049.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T11:15:50.438 INFO:teuthology.orchestra.run.trial049.stdout:} 2026-02-17T11:15:50.438 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.436+0000 7f029ed87640 10 librados: watch_flush enter 2026-02-17T11:15:50.438 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.436+0000 7f029ed87640 10 librados: watch_flush exit 2026-02-17T11:15:50.438 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.436+0000 7f029ed87640 10 client.5308.objecter close_session for osd.15 2026-02-17T11:15:50.438 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.436+0000 7f029ed87640 1 -- 10.20.193.49:0/1976336774 >> [v2:10.20.193.162:6819/3057705174,v1:10.20.193.162:6821/3057705174] conn(0x7f0268081650 msgr2=0x7f0268083a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:50.438 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.436+0000 7f029ed87640 1 --2- 10.20.193.49:0/1976336774 >> [v2:10.20.193.162:6819/3057705174,v1:10.20.193.162:6821/3057705174] conn(0x7f0268081650 0x7f0268083a70 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:50.438 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.436+0000 7f029ed87640 20 client.5308.objecter put_session s=0x7f0268080f80 osd=15 1 2026-02-17T11:15:50.438 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.436+0000 7f029ed87640 20 client.5308.objecter shutdown clearing up homeless session... 2026-02-17T11:15:50.438 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.436+0000 7f029ed87640 10 client.5308.objecter successfully canceled tick 2026-02-17T11:15:50.438 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.436+0000 7f029ed87640 1 -- 10.20.193.49:0/1976336774 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0268079170 msgr2=0x7f026807b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:50.439 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.436+0000 7f029ed87640 1 --2- 10.20.193.49:0/1976336774 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f0268079170 0x7f026807b630 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0288002770 tx=0x7f0288009040 comp rx=0 tx=0).stop 2026-02-17T11:15:50.439 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.436+0000 7f029ed87640 10 monclient: shutdown 2026-02-17T11:15:50.439 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.436+0000 7f029ed87640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:50.439 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.436+0000 7f029ed87640 1 -- 10.20.193.49:0/1976336774 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f02980c9b40 msgr2=0x7f02981f4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:50.439 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.436+0000 7f029ed87640 1 --2- 10.20.193.49:0/1976336774 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f02980c9b40 0x7f02981f4ee0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0280036000 tx=0x7f02800047c0 comp rx=0 tx=0).stop 2026-02-17T11:15:50.439 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.436+0000 7f029d2fd640 1 -- 10.20.193.49:0/1976336774 reap_dead start 2026-02-17T11:15:50.439 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.436+0000 7f029ed87640 1 -- 10.20.193.49:0/1976336774 shutdown_connections 2026-02-17T11:15:50.439 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.436+0000 7f029ed87640 1 -- 10.20.193.49:0/1976336774 >> 10.20.193.49:0/1976336774 conn(0x7f02980c9f60 msgr2=0x7f029815b130 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:50.439 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.436+0000 7f029ed87640 1 -- 10.20.193.49:0/1976336774 shutdown_connections 2026-02-17T11:15:50.439 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.436+0000 7f029ed87640 1 -- 10.20.193.49:0/1976336774 wait complete. 2026-02-17T11:15:50.439 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.437+0000 7f029ed87640 1 librados: shutdown 2026-02-17T11:15:50.445 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 15 2026-02-17T11:15:50.513 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.511+0000 7fbd594f2640 10 monclient: get_monmap_and_config 2026-02-17T11:15:50.513 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.511+0000 7fbd594f2640 10 monclient: build_initial_monmap 2026-02-17T11:15:50.513 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.511+0000 7fbd594f2640 10 monclient: monmap: 2026-02-17T11:15:50.513 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:50.513 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:50.514 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:15:50.512188+0000 2026-02-17T11:15:50.514 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:15:50.512188+0000 2026-02-17T11:15:50.514 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:50.514 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:50.514 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:15:50.514 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:15:50.514 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:15:50.514 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:15:50.514 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:15:50.514 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:15:50.514 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:50.515 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.512+0000 7fbd594f2640 1 Processor -- start 2026-02-17T11:15:50.515 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.512+0000 7fbd594f2640 1 -- start start 2026-02-17T11:15:50.515 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.512+0000 7fbd594f2640 10 monclient: init 2026-02-17T11:15:50.515 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.512+0000 7fbd594f2640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:50.515 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.512+0000 7fbd594f2640 10 monclient: _add_conns ranks=[5,1,0,3,4,2] 2026-02-17T11:15:50.515 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.512+0000 7fbd594f2640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7fbd54152820 0x7fbd541593f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:50.515 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.512+0000 7fbd594f2640 10 monclient(hunting): picked mon.noname-c con 0x7fbd54152820 addr v2:10.20.193.157:3300/0 2026-02-17T11:15:50.515 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.512+0000 7fbd594f2640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fbd54152c00 addr v1:10.20.193.97:6789/0 2026-02-17T11:15:50.515 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.512+0000 7fbd594f2640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fbd540738f0 addr v1:10.20.193.49:6789/0 2026-02-17T11:15:50.515 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.512+0000 7fbd594f2640 1 -- --> v1:10.20.193.49:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd54073e90 con 0x7fbd540738f0 2026-02-17T11:15:50.515 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.512+0000 7fbd594f2640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd54074170 con 0x7fbd54152c00 2026-02-17T11:15:50.515 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.512+0000 7fbd594f2640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:50.515 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.512+0000 7fbd594f2640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7fbd54159930 con 0x7fbd54152820 2026-02-17T11:15:50.515 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.512+0000 7fbd594f2640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:50.515 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.512+0000 7fbd594f2640 10 monclient(hunting): authenticate will time out at 1427.175756s 2026-02-17T11:15:50.515 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.513+0000 7fbd527fc640 1 --1- >> v1:10.20.193.97:6789/0 conn(0x7fbd54152c00 0x7fbd540c7e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.97:6789/0 says I am v1:10.20.193.49:49894/0 (socket says 10.20.193.49:49894) 2026-02-17T11:15:50.515 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.513+0000 7fbd527fc640 1 -- 10.20.193.49:0/862331546 learned_addr learned my addr 10.20.193.49:0/862331546 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:15:50.515 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.513+0000 7fbd52ffd640 1 --2- 10.20.193.49:0/862331546 >> v2:10.20.193.157:3300/0 conn(0x7fbd54152820 0x7fbd541593f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:50.515 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.513+0000 7fbd52ffd640 10 monclient(hunting): get_auth_request con 0x7fbd54152820 auth_method 0 2026-02-17T11:15:50.516 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.513+0000 7fbd52ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:50.516 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.513+0000 7fbd52ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:50.516 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.513+0000 7fbd52ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:50.516 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.513+0000 7fbd52ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:50.516 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.513+0000 7fbd52ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:50.516 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.513+0000 7fbd52ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:50.516 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.514+0000 7fbd51ffb640 1 -- 10.20.193.49:0/862331546 <== mon.1 v1:10.20.193.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2241245025 0 0) 0x7fbd54074170 con 0x7fbd54152c00 2026-02-17T11:15:50.516 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.514+0000 7fbd51ffb640 10 monclient(hunting): _negotiate 2026-02-17T11:15:50.516 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.514+0000 7fbd51ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:50.516 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.514+0000 7fbd51ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:50.516 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.514+0000 7fbd51ffb640 10 monclient(hunting): my global_id is 5311 2026-02-17T11:15:50.516 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.514+0000 7fbd51ffb640 1 -- 10.20.193.49:0/862331546 --> v1:10.20.193.97:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd400058b0 con 0x7fbd54152c00 2026-02-17T11:15:50.516 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.514+0000 7fbd52ffd640 10 monclient(hunting): handle_auth_done global_id 5393 payload 274 2026-02-17T11:15:50.516 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.514+0000 7fbd52ffd640 1 -- 10.20.193.49:0/862331546 >> v1:10.20.193.97:6789/0 conn(0x7fbd54152c00 legacy=0x7fbd540c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:50.516 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.514+0000 7fbd52ffd640 1 -- 10.20.193.49:0/862331546 >> v1:10.20.193.49:6789/0 conn(0x7fbd540738f0 legacy=0x7fbd540c5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:15:50.516 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.514+0000 7fbd52ffd640 10 monclient: _finish_hunting 0 2026-02-17T11:15:50.516 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.514+0000 7fbd52ffd640 1 monclient: found mon.noname-c 2026-02-17T11:15:50.517 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.514+0000 7fbd52ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:50.517 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.514+0000 7fbd52ffd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.157:3300/0 2026-02-17T11:15:50.517 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.514+0000 7fbd52ffd640 1 -- 10.20.193.49:0/862331546 --> v2:10.20.193.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd54074450 con 0x7fbd54152820 2026-02-17T11:15:50.517 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.516+0000 7fbd52ffd640 1 --2- 10.20.193.49:0/862331546 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fbd54152820 0x7fbd541593f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbd480098a0 tx=0x7fbd4802eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5941eb37886cc6b2 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:50.519 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.517+0000 7fbd51ffb640 1 -- 10.20.193.49:0/862331546 <== mon.2 v2:10.20.193.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd4803c070 con 0x7fbd54152820 2026-02-17T11:15:50.519 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.517+0000 7fbd51ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:50.519 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.517+0000 7fbd51ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T11:15:50.519 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.517+0000 7fbd51ffb640 10 monclient: dump: 2026-02-17T11:15:50.519 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:50.519 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:50.519 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:50.519 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:50.519 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:50.519 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:50.519 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:50.519 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:50.519 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:50.519 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:50.520 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.517+0000 7fbd51ffb640 10 monclient: _finish_auth 0 2026-02-17T11:15:50.520 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.517+0000 7fbd51ffb640 10 monclient: _check_auth_tickets 2026-02-17T11:15:50.520 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.517+0000 7fbd51ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:50.520 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.517+0000 7fbd51ffb640 1 -- 10.20.193.49:0/862331546 <== mon.2 v2:10.20.193.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd4802fb70 con 0x7fbd54152820 2026-02-17T11:15:50.520 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.517+0000 7fbd51ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:50.520 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.517+0000 7fbd51ffb640 1 -- 10.20.193.49:0/862331546 <== mon.2 v2:10.20.193.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd48037440 con 0x7fbd54152820 2026-02-17T11:15:50.520 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.517+0000 7fbd594f2640 5 monclient: authenticate success, global_id 5393 2026-02-17T11:15:50.520 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.517+0000 7fbd51ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:50.520 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.517+0000 7fbd51ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T11:15:50.520 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.517+0000 7fbd51ffb640 10 monclient: dump: 2026-02-17T11:15:50.520 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:50.520 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:50.520 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:50.520 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:50.520 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:50.520 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:50.520 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:50.520 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:50.520 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:50.520 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:50.520 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.517+0000 7fbd594f2640 10 monclient: get_monmap_and_config success 2026-02-17T11:15:50.520 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.517+0000 7fbd594f2640 4 set_mon_vals no callback set 2026-02-17T11:15:50.520 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.518+0000 7fbd594f2640 10 monclient: shutdown 2026-02-17T11:15:50.520 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.518+0000 7fbd594f2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:50.520 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.518+0000 7fbd594f2640 1 -- 10.20.193.49:0/862331546 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fbd54152820 msgr2=0x7fbd541593f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:50.520 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.518+0000 7fbd594f2640 1 --2- 10.20.193.49:0/862331546 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fbd54152820 0x7fbd541593f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbd480098a0 tx=0x7fbd4802eeb0 comp rx=0 tx=0).stop 2026-02-17T11:15:50.520 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.518+0000 7fbd594f2640 1 -- 10.20.193.49:0/862331546 shutdown_connections 2026-02-17T11:15:50.520 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.518+0000 7fbd594f2640 1 --2- 10.20.193.49:0/862331546 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fbd54152820 0x7fbd541593f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:50.520 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.518+0000 7fbd594f2640 1 -- 10.20.193.49:0/862331546 >> 10.20.193.49:0/862331546 conn(0x7fbd540c9f40 msgr2=0x7fbd540ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:50.520 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.518+0000 7fbd594f2640 1 -- 10.20.193.49:0/862331546 shutdown_connections 2026-02-17T11:15:50.521 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.518+0000 7fbd594f2640 1 -- 10.20.193.49:0/862331546 wait complete. 2026-02-17T11:15:50.522 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.518+0000 7fbd594f2640 10 monclient: build_initial_monmap 2026-02-17T11:15:50.522 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.519+0000 7fbd594f2640 10 monclient: monmap: 2026-02-17T11:15:50.522 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:50.522 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:15:50.522 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:15:50.522 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:15:50.522 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:50.522 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:50.522 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:15:50.522 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:15:50.522 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:15:50.522 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:50.522 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.519+0000 7fbd594f2640 1 librados: starting msgr at 2026-02-17T11:15:50.522 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.519+0000 7fbd594f2640 1 librados: starting objecter 2026-02-17T11:15:50.522 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.519+0000 7fbd594f2640 1 Processor -- start 2026-02-17T11:15:50.522 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.519+0000 7fbd594f2640 1 -- start start 2026-02-17T11:15:50.522 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.519+0000 7fbd594f2640 1 librados: setting wanted keys 2026-02-17T11:15:50.522 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.519+0000 7fbd594f2640 1 librados: calling monclient init 2026-02-17T11:15:50.522 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.519+0000 7fbd594f2640 10 monclient: init 2026-02-17T11:15:50.522 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.519+0000 7fbd594f2640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:50.522 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.519+0000 7fbd594f2640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:15:50.522 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.519+0000 7fbd594f2640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fbd540738f0 0x7fbd541f38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:50.522 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.519+0000 7fbd594f2640 10 monclient(hunting): picked mon.noname-c con 0x7fbd540738f0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:15:50.522 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.519+0000 7fbd594f2640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbd54152820 0x7fbd541f77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:50.522 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.519+0000 7fbd594f2640 10 monclient(hunting): picked mon.noname-a con 0x7fbd54152820 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:15:50.522 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.519+0000 7fbd594f2640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fbd54152c00 0x7fbd54153260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:50.522 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.519+0000 7fbd594f2640 10 monclient(hunting): picked mon.noname-b con 0x7fbd54152c00 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:15:50.523 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.519+0000 7fbd594f2640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:50.523 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.519+0000 7fbd594f2640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7fbd54074cf0 con 0x7fbd54152820 2026-02-17T11:15:50.523 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.519+0000 7fbd594f2640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:50.523 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.519+0000 7fbd594f2640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7fbd54074a10 con 0x7fbd54152c00 2026-02-17T11:15:50.523 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.519+0000 7fbd594f2640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:50.523 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.519+0000 7fbd594f2640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7fbd540c63f0 con 0x7fbd540738f0 2026-02-17T11:15:50.523 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.519+0000 7fbd594f2640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:50.523 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.519+0000 7fbd594f2640 10 monclient(hunting): authenticate will time out at 1427.182829s 2026-02-17T11:15:50.523 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.520+0000 7fbd527fc640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbd54152820 0x7fbd541f77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:50.523 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.520+0000 7fbd52ffd640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fbd540738f0 0x7fbd541f38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:50.523 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.520+0000 7fbd537fe640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fbd54152c00 0x7fbd54153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:50.523 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.520+0000 7fbd527fc640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbd54152820 0x7fbd541f77a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:43404/0 (socket says 10.20.193.49:43404) 2026-02-17T11:15:50.523 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.520+0000 7fbd527fc640 1 -- 10.20.193.49:0/2358404983 learned_addr learned my addr 10.20.193.49:0/2358404983 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:50.523 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.520+0000 7fbd527fc640 10 monclient(hunting): get_auth_request con 0x7fbd54152820 auth_method 0 2026-02-17T11:15:50.523 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.520+0000 7fbd527fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:50.523 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.520+0000 7fbd527fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:50.523 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.520+0000 7fbd527fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:50.523 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.520+0000 7fbd52ffd640 10 monclient(hunting): get_auth_request con 0x7fbd540738f0 auth_method 0 2026-02-17T11:15:50.523 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.520+0000 7fbd52ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:50.523 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.520+0000 7fbd52ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:50.523 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.520+0000 7fbd52ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:50.523 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.520+0000 7fbd537fe640 10 monclient(hunting): get_auth_request con 0x7fbd54152c00 auth_method 0 2026-02-17T11:15:50.523 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.520+0000 7fbd537fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:50.523 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.520+0000 7fbd537fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:50.523 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.520+0000 7fbd537fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:50.523 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.520+0000 7fbd527fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:50.523 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.520+0000 7fbd527fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:50.523 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.520+0000 7fbd527fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:50.523 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.520+0000 7fbd52ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:50.523 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.520+0000 7fbd52ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:50.523 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.520+0000 7fbd52ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:50.523 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.520+0000 7fbd537fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:50.523 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.520+0000 7fbd537fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:50.523 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.520+0000 7fbd537fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:50.524 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.522+0000 7fbd537fe640 10 monclient(hunting): handle_auth_done global_id 5314 payload 824 2026-02-17T11:15:50.524 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.522+0000 7fbd537fe640 1 -- 10.20.193.49:0/2358404983 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fbd540738f0 msgr2=0x7fbd541f38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:50.524 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.522+0000 7fbd537fe640 1 --2- 10.20.193.49:0/2358404983 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fbd540738f0 0x7fbd541f38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:50.524 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.522+0000 7fbd537fe640 1 -- 10.20.193.49:0/2358404983 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbd54152820 msgr2=0x7fbd541f77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:50.524 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.522+0000 7fbd537fe640 1 --2- 10.20.193.49:0/2358404983 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbd54152820 0x7fbd541f77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:50.524 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.522+0000 7fbd537fe640 10 monclient: _finish_hunting 0 2026-02-17T11:15:50.524 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.522+0000 7fbd537fe640 1 monclient: found mon.noname-b 2026-02-17T11:15:50.524 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.522+0000 7fbd537fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:50.524 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.522+0000 7fbd537fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:15:50.524 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.522+0000 7fbd537fe640 1 -- 10.20.193.49:0/2358404983 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd5414c5a0 con 0x7fbd54152c00 2026-02-17T11:15:50.524 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.523+0000 7fbd537fe640 1 --2- 10.20.193.49:0/2358404983 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fbd54152c00 0x7fbd54153260 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fbd4400be20 tx=0x7fbd4400bf20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:50.524 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.523+0000 7fbd337fe640 10 client.?.objecter ms_handle_connect 0x7fbd54152c00 2026-02-17T11:15:50.524 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.523+0000 7fbd337fe640 10 client.?.objecter resend_mon_ops 2026-02-17T11:15:50.526 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.525+0000 7fbd337fe640 1 -- 10.20.193.49:0/2358404983 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd44006e60 con 0x7fbd54152c00 2026-02-17T11:15:50.526 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.525+0000 7fbd337fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:50.526 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.525+0000 7fbd337fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:15:50.526 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.525+0000 7fbd337fe640 10 monclient: dump: 2026-02-17T11:15:50.526 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:50.526 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:50.526 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:50.526 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:50.526 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:50.526 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:50.526 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:50.526 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:50.526 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:50.526 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:50.526 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.525+0000 7fbd337fe640 10 monclient: _finish_auth 0 2026-02-17T11:15:50.526 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.525+0000 7fbd337fe640 10 monclient: _check_auth_tickets 2026-02-17T11:15:50.526 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.525+0000 7fbd337fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:50.527 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.525+0000 7fbd337fe640 1 -- 10.20.193.49:0/2358404983 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd44010070 con 0x7fbd54152c00 2026-02-17T11:15:50.527 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.525+0000 7fbd337fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:50.527 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.525+0000 7fbd337fe640 1 -- 10.20.193.49:0/2358404983 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd4400cc90 con 0x7fbd54152c00 2026-02-17T11:15:50.527 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.525+0000 7fbd337fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:50.527 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.525+0000 7fbd337fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:15:50.527 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.525+0000 7fbd337fe640 10 monclient: dump: 2026-02-17T11:15:50.527 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:50.527 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:50.527 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:50.527 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:50.527 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:50.527 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:50.527 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:50.527 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:50.527 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:50.527 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:50.527 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.525+0000 7fbd517fa640 4 set_mon_vals no callback set 2026-02-17T11:15:50.527 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.525+0000 7fbd594f2640 5 monclient: authenticate success, global_id 5314 2026-02-17T11:15:50.527 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.525+0000 7fbd594f2640 10 monclient: _renew_subs 2026-02-17T11:15:50.527 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.525+0000 7fbd594f2640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:15:50.527 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.525+0000 7fbd594f2640 1 -- 10.20.193.49:0/2358404983 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd541f47c0 con 0x7fbd54152c00 2026-02-17T11:15:50.527 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.525+0000 7fbd594f2640 10 client.5314.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:50.527 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.525+0000 7fbd594f2640 10 monclient: _renew_subs 2026-02-17T11:15:50.527 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.525+0000 7fbd594f2640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:15:50.527 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.525+0000 7fbd594f2640 1 -- 10.20.193.49:0/2358404983 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd541537a0 con 0x7fbd54152c00 2026-02-17T11:15:50.527 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.525+0000 7fbd594f2640 1 librados: init done 2026-02-17T11:15:50.527 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.525+0000 7fbd594f2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:50.528 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.525+0000 7fbd594f2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:50.528 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.525+0000 7fbd594f2640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:15:50.528 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.525+0000 7fbd594f2640 1 -- 10.20.193.49:0/2358404983 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd541f3f80 con 0x7fbd54152c00 2026-02-17T11:15:50.537 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.536+0000 7fbd337fe640 1 -- 10.20.193.49:0/2358404983 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7fbd4401d030 con 0x7fbd54152c00 2026-02-17T11:15:50.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.537+0000 7fbd337fe640 1 --2- 10.20.193.49:0/2358404983 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fbd200791c0 0x7fbd2007b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:50.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.537+0000 7fbd52ffd640 1 --2- 10.20.193.49:0/2358404983 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fbd200791c0 0x7fbd2007b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:50.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.537+0000 7fbd52ffd640 10 monclient: get_auth_request con 0x7fbd200791c0 auth_method 0 2026-02-17T11:15:50.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.537+0000 7fbd52ffd640 1 --2- 10.20.193.49:0/2358404983 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fbd200791c0 0x7fbd2007b680 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fbd48039000 tx=0x7fbd48033000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:50.538 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.537+0000 7fbd337fe640 10 client.5314.objecter ms_handle_connect 0x7fbd200791c0 2026-02-17T11:15:50.539 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.538+0000 7fbd337fe640 1 -- 10.20.193.49:0/2358404983 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7fbd4405db60 con 0x7fbd54152c00 2026-02-17T11:15:50.539 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.538+0000 7fbd337fe640 10 client.5314.objecter ms_dispatch2 0x7fbd54000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:15:50.539 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.538+0000 7fbd337fe640 3 client.5314.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:15:50.539 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.538+0000 7fbd337fe640 3 client.5314.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:15:50.539 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.538+0000 7fbd337fe640 20 client.5314.objecter dump_active .. 0 homeless 2026-02-17T11:15:50.641 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.639+0000 7fbd337fe640 1 -- 10.20.193.49:0/2358404983 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fbd541f3f80 con 0x7fbd54152c00 2026-02-17T11:15:50.641 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.640+0000 7fbd337fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:50.641 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.640+0000 7fbd337fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:15:50.725 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.723+0000 7fbd594f2640 1 -- 10.20.193.49:0/2358404983 --> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "15", "target": ["mon-mgr", ""]}) -- 0x7fbd541593f0 con 0x7fbd200791c0 2026-02-17T11:15:50.726 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.724+0000 7fbd337fe640 1 -- 10.20.193.49:0/2358404983 <== mgr.4106 v2:10.20.193.162:6800/2614632098 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 15 to deep-scrub) ==== 42+0+0 (secure 0 0 0) 0x7fbd541593f0 con 0x7fbd200791c0 2026-02-17T11:15:50.726 INFO:teuthology.orchestra.run.trial049.stderr:instructed osd(s) 15 to deep-scrub 2026-02-17T11:15:50.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.725+0000 7fbd594f2640 10 librados: watch_flush enter 2026-02-17T11:15:50.727 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.725+0000 7fbd594f2640 10 librados: watch_flush exit 2026-02-17T11:15:50.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.725+0000 7fbd594f2640 20 client.5314.objecter shutdown clearing up homeless session... 2026-02-17T11:15:50.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.725+0000 7fbd594f2640 10 client.5314.objecter successfully canceled tick 2026-02-17T11:15:50.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.725+0000 7fbd594f2640 1 -- 10.20.193.49:0/2358404983 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fbd200791c0 msgr2=0x7fbd2007b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:50.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.725+0000 7fbd594f2640 1 --2- 10.20.193.49:0/2358404983 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fbd200791c0 0x7fbd2007b680 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fbd48039000 tx=0x7fbd48033000 comp rx=0 tx=0).stop 2026-02-17T11:15:50.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.725+0000 7fbd594f2640 10 monclient: shutdown 2026-02-17T11:15:50.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.725+0000 7fbd594f2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:50.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.725+0000 7fbd594f2640 1 -- 10.20.193.49:0/2358404983 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fbd54152c00 msgr2=0x7fbd54153260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:50.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.725+0000 7fbd594f2640 1 --2- 10.20.193.49:0/2358404983 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fbd54152c00 0x7fbd54153260 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fbd4400be20 tx=0x7fbd4400bf20 comp rx=0 tx=0).stop 2026-02-17T11:15:50.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.725+0000 7fbd594f2640 1 -- 10.20.193.49:0/2358404983 shutdown_connections 2026-02-17T11:15:50.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.725+0000 7fbd594f2640 1 --2- 10.20.193.49:0/2358404983 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7fbd200791c0 0x7fbd2007b680 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:50.728 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.725+0000 7fbd594f2640 1 --2- 10.20.193.49:0/2358404983 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7fbd54152c00 0x7fbd54153260 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:50.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.725+0000 7fbd594f2640 1 --2- 10.20.193.49:0/2358404983 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7fbd54152820 0x7fbd541f77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:50.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.725+0000 7fbd594f2640 1 --2- 10.20.193.49:0/2358404983 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7fbd540738f0 0x7fbd541f38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:50.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.725+0000 7fbd594f2640 1 -- 10.20.193.49:0/2358404983 >> 10.20.193.49:0/2358404983 conn(0x7fbd540c9f40 msgr2=0x7fbd5414cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:50.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.725+0000 7fbd594f2640 1 -- 10.20.193.49:0/2358404983 shutdown_connections 2026-02-17T11:15:50.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.725+0000 7fbd594f2640 1 -- 10.20.193.49:0/2358404983 wait complete. 2026-02-17T11:15:50.729 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.725+0000 7fbd594f2640 1 librados: shutdown 2026-02-17T11:15:50.735 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:15:50.803 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.801+0000 7f505adb6640 10 monclient: get_monmap_and_config 2026-02-17T11:15:50.803 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.801+0000 7f505adb6640 10 monclient: build_initial_monmap 2026-02-17T11:15:50.803 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.801+0000 7f505adb6640 10 monclient: monmap: 2026-02-17T11:15:50.803 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:50.803 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:50.803 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:15:50.802376+0000 2026-02-17T11:15:50.803 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:15:50.802376+0000 2026-02-17T11:15:50.803 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:50.803 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:50.803 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:15:50.803 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:15:50.803 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:15:50.803 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:15:50.803 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:15:50.803 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:15:50.803 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:50.804 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.802+0000 7f505adb6640 1 Processor -- start 2026-02-17T11:15:50.804 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.802+0000 7f505adb6640 1 -- start start 2026-02-17T11:15:50.804 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.802+0000 7f505adb6640 10 monclient: init 2026-02-17T11:15:50.804 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.802+0000 7f505adb6640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:50.804 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.802+0000 7f505adb6640 10 monclient: _add_conns ranks=[2,1,4,0,3,5] 2026-02-17T11:15:50.804 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.802+0000 7f505adb6640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f50540c7170 addr v1:10.20.193.157:6789/0 2026-02-17T11:15:50.804 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.802+0000 7f505adb6640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f50540c7550 addr v1:10.20.193.97:6789/0 2026-02-17T11:15:50.804 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.802+0000 7f505adb6640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7f50540c89c0 0x7f50540c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:50.804 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.802+0000 7f505adb6640 10 monclient(hunting): picked mon.noname-b con 0x7f50540c89c0 addr v2:10.20.193.97:3300/0 2026-02-17T11:15:50.804 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.802+0000 7f505adb6640 1 -- --> v1:10.20.193.97:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50540c4fd0 con 0x7f50540c7550 2026-02-17T11:15:50.804 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.802+0000 7f505adb6640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f505415a9a0 con 0x7f50540c7170 2026-02-17T11:15:50.804 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.802+0000 7f505adb6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:50.804 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.802+0000 7f505adb6640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7f50540c8530 con 0x7f50540c89c0 2026-02-17T11:15:50.804 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.802+0000 7f505adb6640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:50.804 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.802+0000 7f505adb6640 10 monclient(hunting): authenticate will time out at 1427.465875s 2026-02-17T11:15:50.804 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.803+0000 7f5058b2b640 1 --1- >> v1:10.20.193.157:6789/0 conn(0x7f50540c7170 0x7f50540c48c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.157:6789/0 says I am v1:10.20.193.49:44864/0 (socket says 10.20.193.49:44864) 2026-02-17T11:15:50.804 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.803+0000 7f5058b2b640 1 -- 10.20.193.49:0/934469276 learned_addr learned my addr 10.20.193.49:0/934469276 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:15:50.804 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.803+0000 7f505932c640 1 --2- 10.20.193.49:0/934469276 >> v2:10.20.193.97:3300/0 conn(0x7f50540c89c0 0x7f50540c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:50.804 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.803+0000 7f505932c640 10 monclient(hunting): get_auth_request con 0x7f50540c89c0 auth_method 0 2026-02-17T11:15:50.804 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.803+0000 7f505932c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:50.805 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.803+0000 7f505932c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:50.805 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.803+0000 7f505932c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:50.805 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.804+0000 7f505932c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:50.805 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.804+0000 7f505932c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:50.805 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.804+0000 7f505932c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:50.805 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.804+0000 7f504b7fe640 1 -- 10.20.193.49:0/934469276 <== mon.2 v1:10.20.193.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 459784130 0 0) 0x7f505415a9a0 con 0x7f50540c7170 2026-02-17T11:15:50.805 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.804+0000 7f504b7fe640 10 monclient(hunting): _negotiate 2026-02-17T11:15:50.805 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.804+0000 7f504b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:50.805 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.804+0000 7f504b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:50.805 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.804+0000 7f504b7fe640 10 monclient(hunting): my global_id is 5399 2026-02-17T11:15:50.805 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.804+0000 7f504b7fe640 1 -- 10.20.193.49:0/934469276 --> v1:10.20.193.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5040003620 con 0x7f50540c7170 2026-02-17T11:15:50.806 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.805+0000 7f505932c640 10 monclient(hunting): handle_auth_done global_id 5317 payload 274 2026-02-17T11:15:50.806 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.805+0000 7f505932c640 1 -- 10.20.193.49:0/934469276 >> v1:10.20.193.157:6789/0 conn(0x7f50540c7170 legacy=0x7f50540c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:50.806 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.805+0000 7f505932c640 1 -- 10.20.193.49:0/934469276 >> v1:10.20.193.97:6789/0 conn(0x7f50540c7550 legacy=0x7f50540749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:50.806 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.805+0000 7f505932c640 10 monclient: _finish_hunting 0 2026-02-17T11:15:50.806 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.805+0000 7f505932c640 1 monclient: found mon.noname-b 2026-02-17T11:15:50.806 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.805+0000 7f505932c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:50.806 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.805+0000 7f505932c640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:15:50.806 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.805+0000 7f505932c640 1 -- 10.20.193.49:0/934469276 --> v2:10.20.193.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50540c5270 con 0x7f50540c89c0 2026-02-17T11:15:50.808 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.807+0000 7f505932c640 1 --2- 10.20.193.49:0/934469276 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f50540c89c0 0x7f50540c8e70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5050009d90 tx=0x7f505002f230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7145f8a48c77c97c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:50.810 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.809+0000 7f504b7fe640 1 -- 10.20.193.49:0/934469276 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f505003c070 con 0x7f50540c89c0 2026-02-17T11:15:50.810 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.809+0000 7f504b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:50.810 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.809+0000 7f504b7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:15:50.810 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.809+0000 7f504b7fe640 10 monclient: dump: 2026-02-17T11:15:50.810 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:50.810 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:50.810 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:50.810 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:50.810 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:50.810 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:50.810 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:50.810 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:50.810 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:50.810 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:50.810 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.809+0000 7f504b7fe640 10 monclient: _finish_auth 0 2026-02-17T11:15:50.810 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.809+0000 7f504b7fe640 10 monclient: _check_auth_tickets 2026-02-17T11:15:50.811 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.809+0000 7f504b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:50.811 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.809+0000 7f504b7fe640 1 -- 10.20.193.49:0/934469276 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5050037440 con 0x7f50540c89c0 2026-02-17T11:15:50.811 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.809+0000 7f505adb6640 5 monclient: authenticate success, global_id 5317 2026-02-17T11:15:50.811 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.809+0000 7f505adb6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:15:50.811 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.809+0000 7f504b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:50.811 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.809+0000 7f505adb6640 10 monclient: get_monmap_and_config success 2026-02-17T11:15:50.811 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.809+0000 7f505adb6640 4 set_mon_vals no callback set 2026-02-17T11:15:50.811 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.809+0000 7f504b7fe640 1 -- 10.20.193.49:0/934469276 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5050037810 con 0x7f50540c89c0 2026-02-17T11:15:50.811 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.809+0000 7f504b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:50.811 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.809+0000 7f504b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:15:50.811 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.809+0000 7f504b7fe640 10 monclient: dump: 2026-02-17T11:15:50.811 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:50.811 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:50.811 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:50.811 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:50.811 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:50.811 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:50.811 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:50.811 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:50.811 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:50.811 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:50.811 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.809+0000 7f505adb6640 10 monclient: shutdown 2026-02-17T11:15:50.811 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.809+0000 7f505adb6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:50.811 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.809+0000 7f505adb6640 1 -- 10.20.193.49:0/934469276 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f50540c89c0 msgr2=0x7f50540c8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:50.811 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.809+0000 7f505adb6640 1 --2- 10.20.193.49:0/934469276 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f50540c89c0 0x7f50540c8e70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5050009d90 tx=0x7f505002f230 comp rx=0 tx=0).stop 2026-02-17T11:15:50.811 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.809+0000 7f505adb6640 1 -- 10.20.193.49:0/934469276 shutdown_connections 2026-02-17T11:15:50.811 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.809+0000 7f505adb6640 1 --2- 10.20.193.49:0/934469276 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f50540c89c0 0x7f50540c8e70 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:50.811 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.809+0000 7f505adb6640 1 -- 10.20.193.49:0/934469276 >> 10.20.193.49:0/934469276 conn(0x7f50540c9f40 msgr2=0x7f50540ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:50.811 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.809+0000 7f505adb6640 1 -- 10.20.193.49:0/934469276 shutdown_connections 2026-02-17T11:15:50.811 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.809+0000 7f505adb6640 1 -- 10.20.193.49:0/934469276 wait complete. 2026-02-17T11:15:50.812 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.809+0000 7f505adb6640 10 monclient: build_initial_monmap 2026-02-17T11:15:50.812 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.809+0000 7f505adb6640 10 monclient: monmap: 2026-02-17T11:15:50.812 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:15:50.812 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:15:50.812 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:15:50.812 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:15:50.812 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:15:50.812 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:50.812 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:15:50.812 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:15:50.812 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:15:50.812 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:50.813 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.810+0000 7f505adb6640 1 librados: starting msgr at 2026-02-17T11:15:50.813 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.810+0000 7f505adb6640 1 librados: starting objecter 2026-02-17T11:15:50.813 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.810+0000 7f505adb6640 1 Processor -- start 2026-02-17T11:15:50.813 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.810+0000 7f505adb6640 1 -- start start 2026-02-17T11:15:50.813 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.810+0000 7f505adb6640 1 librados: setting wanted keys 2026-02-17T11:15:50.813 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.810+0000 7f505adb6640 1 librados: calling monclient init 2026-02-17T11:15:50.813 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.810+0000 7f505adb6640 10 monclient: init 2026-02-17T11:15:50.813 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.810+0000 7f505adb6640 10 monclient: _reopen_session rank -1 2026-02-17T11:15:50.813 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.810+0000 7f505adb6640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T11:15:50.813 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.810+0000 7f505adb6640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f50540c7170 0x7f50541f14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:50.813 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.810+0000 7f505adb6640 10 monclient(hunting): picked mon.noname-b con 0x7f50540c7170 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:15:50.813 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.810+0000 7f505adb6640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f50540c7550 0x7f50541f1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:50.813 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.810+0000 7f505adb6640 10 monclient(hunting): picked mon.noname-a con 0x7f50540c7550 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:15:50.813 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.810+0000 7f505adb6640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f50540c89c0 0x7f50540c35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:50.813 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.810+0000 7f505adb6640 10 monclient(hunting): picked mon.noname-c con 0x7f50540c89c0 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:15:50.813 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.810+0000 7f505adb6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:50.813 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.810+0000 7f505adb6640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f50540c5830 con 0x7f50540c7550 2026-02-17T11:15:50.813 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.810+0000 7f505adb6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:50.813 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.810+0000 7f505adb6640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f50540c93b0 con 0x7f50540c7170 2026-02-17T11:15:50.813 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.810+0000 7f505adb6640 10 monclient(hunting): start opening mon connection 2026-02-17T11:15:50.813 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.810+0000 7f505adb6640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f50540c7ee0 con 0x7f50540c89c0 2026-02-17T11:15:50.813 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.810+0000 7f505adb6640 10 monclient(hunting): _renew_subs 2026-02-17T11:15:50.813 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.810+0000 7f505adb6640 10 monclient(hunting): authenticate will time out at 1427.473553s 2026-02-17T11:15:50.813 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.810+0000 7f5058b2b640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f50540c7170 0x7f50541f14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:50.813 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.810+0000 7f504bfff640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f50540c7550 0x7f50541f1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:50.813 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.811+0000 7f505932c640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f50540c89c0 0x7f50540c35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:50.813 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.811+0000 7f5058b2b640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f50540c7170 0x7f50541f14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.97:3300/0 says I am v2:10.20.193.49:43656/0 (socket says 10.20.193.49:43656) 2026-02-17T11:15:50.813 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.811+0000 7f5058b2b640 1 -- 10.20.193.49:0/3474057554 learned_addr learned my addr 10.20.193.49:0/3474057554 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:15:50.813 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.811+0000 7f5058b2b640 10 monclient(hunting): get_auth_request con 0x7f50540c7170 auth_method 0 2026-02-17T11:15:50.813 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.811+0000 7f5058b2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:50.813 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.811+0000 7f5058b2b640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:50.813 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.811+0000 7f5058b2b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:50.813 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.811+0000 7f504bfff640 10 monclient(hunting): get_auth_request con 0x7f50540c7550 auth_method 0 2026-02-17T11:15:50.813 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.811+0000 7f504bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:50.813 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.811+0000 7f504bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:50.813 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.811+0000 7f504bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:50.813 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.811+0000 7f505932c640 10 monclient(hunting): get_auth_request con 0x7f50540c89c0 auth_method 0 2026-02-17T11:15:50.813 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.811+0000 7f505932c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:15:50.813 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.811+0000 7f505932c640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:15:50.813 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.811+0000 7f505932c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:15:50.814 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.811+0000 7f5058b2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:50.814 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.811+0000 7f5058b2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:50.814 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.811+0000 7f5058b2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:50.814 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.811+0000 7f504bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:50.814 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.811+0000 7f504bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:50.814 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.811+0000 7f504bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:50.814 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.811+0000 7f505932c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:15:50.814 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.811+0000 7f505932c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:15:50.814 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.811+0000 7f505932c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:15:50.814 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.812+0000 7f5058b2b640 10 monclient(hunting): handle_auth_done global_id 5323 payload 824 2026-02-17T11:15:50.814 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.812+0000 7f5058b2b640 1 -- 10.20.193.49:0/3474057554 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f50540c89c0 msgr2=0x7f50540c35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:50.814 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.812+0000 7f5058b2b640 1 --2- 10.20.193.49:0/3474057554 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f50540c89c0 0x7f50540c35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:50.814 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.812+0000 7f5058b2b640 1 -- 10.20.193.49:0/3474057554 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f50540c7550 msgr2=0x7f50541f1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:50.814 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.812+0000 7f5058b2b640 1 --2- 10.20.193.49:0/3474057554 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f50540c7550 0x7f50541f1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:50.814 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.812+0000 7f5058b2b640 10 monclient: _finish_hunting 0 2026-02-17T11:15:50.814 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.812+0000 7f5058b2b640 1 monclient: found mon.noname-b 2026-02-17T11:15:50.814 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.812+0000 7f5058b2b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:15:50.814 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.812+0000 7f5058b2b640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.97:3300/0 2026-02-17T11:15:50.814 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.812+0000 7f5058b2b640 1 -- 10.20.193.49:0/3474057554 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50541f56a0 con 0x7f50540c7170 2026-02-17T11:15:50.814 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.813+0000 7f5058b2b640 1 --2- 10.20.193.49:0/3474057554 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f50540c7170 0x7f50541f14c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f504400c520 tx=0x7f504400c9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:50.814 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.813+0000 7f50497fa640 10 client.?.objecter ms_handle_connect 0x7f50540c7170 2026-02-17T11:15:50.814 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.813+0000 7f50497fa640 10 client.?.objecter resend_mon_ops 2026-02-17T11:15:50.815 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.814+0000 7f50497fa640 1 -- 10.20.193.49:0/3474057554 <== mon.1 v2:10.20.193.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5044017070 con 0x7f50540c7170 2026-02-17T11:15:50.815 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.814+0000 7f50497fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:50.815 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.814+0000 7f50497fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T11:15:50.815 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.814+0000 7f50497fa640 10 monclient: dump: 2026-02-17T11:15:50.815 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:50.816 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:50.816 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:50.816 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:50.816 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:50.816 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:50.816 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:50.816 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:50.816 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:50.816 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:50.816 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.814+0000 7f50497fa640 10 monclient: _finish_auth 0 2026-02-17T11:15:50.816 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.814+0000 7f50497fa640 10 monclient: _check_auth_tickets 2026-02-17T11:15:50.816 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.814+0000 7f50497fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:15:50.816 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.814+0000 7f505adb6640 5 monclient: authenticate success, global_id 5323 2026-02-17T11:15:50.816 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.814+0000 7f505adb6640 10 monclient: _renew_subs 2026-02-17T11:15:50.816 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.814+0000 7f505adb6640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:15:50.816 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.814+0000 7f505adb6640 1 -- 10.20.193.49:0/3474057554 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50541f5980 con 0x7f50540c7170 2026-02-17T11:15:50.816 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.814+0000 7f505adb6640 10 client.5323.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:15:50.816 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.814+0000 7f505adb6640 10 monclient: _renew_subs 2026-02-17T11:15:50.816 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.814+0000 7f505adb6640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:15:50.816 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.814+0000 7f505adb6640 1 -- 10.20.193.49:0/3474057554 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50541f5f40 con 0x7f50540c7170 2026-02-17T11:15:50.816 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.814+0000 7f505adb6640 1 librados: init done 2026-02-17T11:15:50.816 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.815+0000 7f505adb6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:50.816 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.815+0000 7f505adb6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:50.816 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.815+0000 7f505adb6640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.97:3300/0 2026-02-17T11:15:50.816 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.815+0000 7f505adb6640 1 -- 10.20.193.49:0/3474057554 --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50540c90d0 con 0x7f50540c7170 2026-02-17T11:15:50.816 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.815+0000 7f50497fa640 1 -- 10.20.193.49:0/3474057554 <== mon.1 v2:10.20.193.97:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5044002a20 con 0x7f50540c7170 2026-02-17T11:15:50.816 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.815+0000 7f50497fa640 10 monclient: handle_config config(0 keys) 2026-02-17T11:15:50.816 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.815+0000 7f50497fa640 1 -- 10.20.193.49:0/3474057554 <== mon.1 v2:10.20.193.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5044021060 con 0x7f50540c7170 2026-02-17T11:15:50.817 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.815+0000 7f50497fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:15:50.817 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.815+0000 7f50497fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T11:15:50.817 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.815+0000 7f50497fa640 10 monclient: dump: 2026-02-17T11:15:50.817 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:15:50.817 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:15:50.817 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:50.817 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:15:50.817 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:15:50.817 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:15:50.817 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:15:50.817 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:15:50.817 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:15:50.817 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:15:50.817 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.815+0000 7f504affd640 4 set_mon_vals no callback set 2026-02-17T11:15:50.922 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.920+0000 7f50497fa640 1 -- 10.20.193.49:0/3474057554 <== mon.1 v2:10.20.193.97:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f5044024080 con 0x7f50540c7170 2026-02-17T11:15:50.923 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.921+0000 7f50497fa640 1 --2- 10.20.193.49:0/3474057554 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5024079170 0x7f502407b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:15:50.923 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.921+0000 7f504bfff640 1 --2- 10.20.193.49:0/3474057554 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5024079170 0x7f502407b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:15:50.923 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.921+0000 7f504bfff640 10 monclient: get_auth_request con 0x7f5024079170 auth_method 0 2026-02-17T11:15:50.923 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.921+0000 7f504bfff640 1 --2- 10.20.193.49:0/3474057554 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5024079170 0x7f502407b630 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f503c002410 tx=0x7f503c007ef0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:15:50.923 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.921+0000 7f50497fa640 10 client.5323.objecter ms_handle_connect 0x7f5024079170 2026-02-17T11:15:50.924 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.922+0000 7f50497fa640 1 -- 10.20.193.49:0/3474057554 <== mon.1 v2:10.20.193.97:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f504405d730 con 0x7f50540c7170 2026-02-17T11:15:50.924 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.922+0000 7f50497fa640 10 client.5323.objecter ms_dispatch2 0x7f5054000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:15:50.924 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.922+0000 7f50497fa640 3 client.5323.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:15:50.924 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.922+0000 7f50497fa640 3 client.5323.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:15:50.924 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.922+0000 7f50497fa640 20 client.5323.objecter dump_active .. 0 homeless 2026-02-17T11:15:50.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.929+0000 7f50497fa640 1 -- 10.20.193.49:0/3474057554 <== mon.1 v2:10.20.193.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f50540c90d0 con 0x7f50540c7170 2026-02-17T11:15:50.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.929+0000 7f50497fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:15:50.930 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:50.929+0000 7f50497fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:15:51.013 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:51.011+0000 7f505adb6640 1 -- 10.20.193.49:0/3474057554 --> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f50540c81c0 con 0x7f5024079170 2026-02-17T11:15:51.014 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:51.012+0000 7f50497fa640 1 -- 10.20.193.49:0/3474057554 <== mgr.4106 v2:10.20.193.162:6800/2614632098 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+44644 (secure 0 0 0) 0x7f50540c81c0 con 0x7f5024079170 2026-02-17T11:15:51.014 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:15:51.015 INFO:teuthology.orchestra.run.trial049.stderr:dumped all 2026-02-17T11:15:51.015 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:51.013+0000 7f505adb6640 10 librados: watch_flush enter 2026-02-17T11:15:51.015 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:51.013+0000 7f505adb6640 10 librados: watch_flush exit 2026-02-17T11:15:51.015 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:51.013+0000 7f505adb6640 20 client.5323.objecter shutdown clearing up homeless session... 2026-02-17T11:15:51.015 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:51.013+0000 7f505adb6640 10 client.5323.objecter successfully canceled tick 2026-02-17T11:15:51.015 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:51.013+0000 7f505adb6640 1 -- 10.20.193.49:0/3474057554 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5024079170 msgr2=0x7f502407b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:51.015 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:51.013+0000 7f505adb6640 1 --2- 10.20.193.49:0/3474057554 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5024079170 0x7f502407b630 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f503c002410 tx=0x7f503c007ef0 comp rx=0 tx=0).stop 2026-02-17T11:15:51.015 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:51.013+0000 7f505adb6640 10 monclient: shutdown 2026-02-17T11:15:51.015 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:51.013+0000 7f505adb6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:15:51.015 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:51.013+0000 7f505adb6640 1 -- 10.20.193.49:0/3474057554 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f50540c7170 msgr2=0x7f50541f14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:15:51.015 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:51.013+0000 7f505adb6640 1 --2- 10.20.193.49:0/3474057554 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f50540c7170 0x7f50541f14c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f504400c520 tx=0x7f504400c9f0 comp rx=0 tx=0).stop 2026-02-17T11:15:51.015 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:51.013+0000 7f505adb6640 1 -- 10.20.193.49:0/3474057554 shutdown_connections 2026-02-17T11:15:51.015 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:51.013+0000 7f505adb6640 1 --2- 10.20.193.49:0/3474057554 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f5024079170 0x7f502407b630 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:51.015 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:51.013+0000 7f505adb6640 1 --2- 10.20.193.49:0/3474057554 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f50540c89c0 0x7f50540c35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:51.015 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:51.013+0000 7f505adb6640 1 --2- 10.20.193.49:0/3474057554 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f50540c7550 0x7f50541f1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:51.015 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:51.013+0000 7f505adb6640 1 --2- 10.20.193.49:0/3474057554 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f50540c7170 0x7f50541f14c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:15:51.015 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:51.013+0000 7f505adb6640 1 -- 10.20.193.49:0/3474057554 >> 10.20.193.49:0/3474057554 conn(0x7f50540c9f40 msgr2=0x7f50540cb380 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:15:51.015 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:51.013+0000 7f505adb6640 1 -- 10.20.193.49:0/3474057554 shutdown_connections 2026-02-17T11:15:51.015 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:51.013+0000 7f505adb6640 1 -- 10.20.193.49:0/3474057554 wait complete. 2026-02-17T11:15:51.015 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:15:51.013+0000 7f505adb6640 1 librados: shutdown 2026-02-17T11:15:51.023 INFO:teuthology.orchestra.run.trial049.stdout:{"pg_ready":true,"pg_map":{"version":236,"stamp":"2026-02-17T11:15:50.505505+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459299,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":59,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":12,"kb":1509949440,"kb_used":438088,"kb_used_data":6680,"kb_used_omap":24,"kb_used_meta":431079,"kb_avail":1509511352,"statfs":{"total":1546188226560,"available":1545739624448,"internally_reserved":0,"allocated":6840320,"data_stored":3451878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25501,"internal_metadata":441424995},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":112,"apply_latency_ms":112,"commit_latency_ns":112000000,"apply_latency_ns":112000000},"alerts":[" osd: 0 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 1 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 4 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 5 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 6 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 8 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 9 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 10 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 12 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 13 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 14 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001802"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:12:45.256474+0000","last_change":"2026-02-17T11:10:34.390486+0000","last_active":"2026-02-17T11:12:45.256474+0000","last_peered":"2026-02-17T11:12:45.256474+0000","last_clean":"2026-02-17T11:12:45.256474+0000","last_became_active":"2026-02-17T11:10:31.882486+0000","last_became_peered":"2026-02-17T11:10:31.882486+0000","last_unstale":"2026-02-17T11:12:45.256474+0000","last_undegraded":"2026-02-17T11:12:45.256474+0000","last_fullsized":"2026-02-17T11:12:45.256474+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_clean_scrub_stamp":"2026-02-17T11:10:30.447281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:57:41.179473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.031448708999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,10],"acting":[15,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:15:45.653753+0000","last_change":"2026-02-17T11:15:45.658488+0000","last_active":"2026-02-17T11:15:45.653753+0000","last_peered":"2026-02-17T11:15:45.653753+0000","last_clean":"2026-02-17T11:15:45.653753+0000","last_became_active":"2026-02-17T11:10:32.011352+0000","last_became_peered":"2026-02-17T11:10:32.011352+0000","last_unstale":"2026-02-17T11:15:45.653753+0000","last_undegraded":"2026-02-17T11:15:45.653753+0000","last_fullsized":"2026-02-17T11:15:45.653753+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:15:45.650495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:15:45.650495+0000","last_clean_scrub_stamp":"2026-02-17T11:15:45.650495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:35:13.790394+0000","scrub_duration":189,"objects_trimmed":0,"snaptrim_duration":0.030517882999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,13],"acting":[8,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:15:47.741885+0000","last_change":"2026-02-17T11:15:47.746986+0000","last_active":"2026-02-17T11:15:47.741885+0000","last_peered":"2026-02-17T11:15:47.741885+0000","last_clean":"2026-02-17T11:15:47.741885+0000","last_became_active":"2026-02-17T11:10:31.774687+0000","last_became_peered":"2026-02-17T11:10:31.774687+0000","last_unstale":"2026-02-17T11:15:47.741885+0000","last_undegraded":"2026-02-17T11:15:47.741885+0000","last_fullsized":"2026-02-17T11:15:47.741885+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:15:47.736478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:15:47.736478+0000","last_clean_scrub_stamp":"2026-02-17T11:15:47.736478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:54:59.226581+0000","scrub_duration":153,"objects_trimmed":0,"snaptrim_duration":0.034911202000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4],"acting":[9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:15:45.802315+0000","last_change":"2026-02-17T11:15:45.806915+0000","last_active":"2026-02-17T11:15:45.802315+0000","last_peered":"2026-02-17T11:15:45.802315+0000","last_clean":"2026-02-17T11:15:45.802315+0000","last_became_active":"2026-02-17T11:10:31.919932+0000","last_became_peered":"2026-02-17T11:10:31.919932+0000","last_unstale":"2026-02-17T11:15:45.802315+0000","last_undegraded":"2026-02-17T11:15:45.802315+0000","last_fullsized":"2026-02-17T11:15:45.802315+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:15:45.798989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:15:45.798989+0000","last_clean_scrub_stamp":"2026-02-17T11:15:45.798989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:15:58.520921+0000","scrub_duration":198,"objects_trimmed":0,"snaptrim_duration":0.034931859000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"33'2","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:12:40.709325+0000","last_change":"2026-02-17T11:10:33.847595+0000","last_active":"2026-02-17T11:12:40.709325+0000","last_peered":"2026-02-17T11:12:40.709325+0000","last_clean":"2026-02-17T11:12:40.709325+0000","last_became_active":"2026-02-17T11:10:31.924469+0000","last_became_peered":"2026-02-17T11:10:31.924469+0000","last_unstale":"2026-02-17T11:12:40.709325+0000","last_undegraded":"2026-02-17T11:12:40.709325+0000","last_fullsized":"2026-02-17T11:12:40.709325+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_clean_scrub_stamp":"2026-02-17T11:10:30.447281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:39:57.389842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057723655999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,12],"acting":[3,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:12:36.274433+0000","last_change":"2026-02-17T11:10:33.798221+0000","last_active":"2026-02-17T11:12:36.274433+0000","last_peered":"2026-02-17T11:12:36.274433+0000","last_clean":"2026-02-17T11:12:36.274433+0000","last_became_active":"2026-02-17T11:10:31.972595+0000","last_became_peered":"2026-02-17T11:10:31.972595+0000","last_unstale":"2026-02-17T11:12:36.274433+0000","last_undegraded":"2026-02-17T11:12:36.274433+0000","last_fullsized":"2026-02-17T11:12:36.274433+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_clean_scrub_stamp":"2026-02-17T11:10:30.447281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:29:40.302770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038208368999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:12:35.707268+0000","last_change":"2026-02-17T11:10:33.851767+0000","last_active":"2026-02-17T11:12:35.707268+0000","last_peered":"2026-02-17T11:12:35.707268+0000","last_clean":"2026-02-17T11:12:35.707268+0000","last_became_active":"2026-02-17T11:10:31.878425+0000","last_became_peered":"2026-02-17T11:10:31.878425+0000","last_unstale":"2026-02-17T11:12:35.707268+0000","last_undegraded":"2026-02-17T11:12:35.707268+0000","last_fullsized":"2026-02-17T11:12:35.707268+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_clean_scrub_stamp":"2026-02-17T11:10:30.447281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:59:50.900049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057827870000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"31'1","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:12:36.274609+0000","last_change":"2026-02-17T11:10:33.802208+0000","last_active":"2026-02-17T11:12:36.274609+0000","last_peered":"2026-02-17T11:12:36.274609+0000","last_clean":"2026-02-17T11:12:36.274609+0000","last_became_active":"2026-02-17T11:10:31.780197+0000","last_became_peered":"2026-02-17T11:10:31.780197+0000","last_unstale":"2026-02-17T11:12:36.274609+0000","last_undegraded":"2026-02-17T11:12:36.274609+0000","last_fullsized":"2026-02-17T11:12:36.274609+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:10:30.447281+0000","last_clean_scrub_stamp":"2026-02-17T11:10:30.447281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:23:13.359463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.029469485,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,15],"acting":[14,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"1.0","version":"26'32","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:12:31.756690+0000","last_change":"2026-02-17T11:10:28.869213+0000","last_active":"2026-02-17T11:12:31.756690+0000","last_peered":"2026-02-17T11:12:31.756690+0000","last_clean":"2026-02-17T11:12:31.756690+0000","last_became_active":"2026-02-17T11:10:28.524896+0000","last_became_peered":"2026-02-17T11:10:28.524896+0000","last_unstale":"2026-02-17T11:12:31.756690+0000","last_undegraded":"2026-02-17T11:12:31.756690+0000","last_fullsized":"2026-02-17T11:12:31.756690+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:10:20.960810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:10:20.960810+0000","last_clean_scrub_stamp":"2026-02-17T11:10:20.960810+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:21:38.378078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":10,"up_from":27,"seq":115964117063,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[0,1,2,5,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 10 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":6,"up_from":27,"seq":115964117061,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":778240,"data_stored":563850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,5,7,8,9,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 6 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":12,"up_from":26,"seq":111669149765,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":166029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,7,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 12 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":4,"up_from":21,"seq":90194313285,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3,5,8,9,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[" osd: 4 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":8,"up_from":21,"seq":90194313284,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5,7,9,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[" osd: 8 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":1,"up_from":22,"seq":94489280581,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27332,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27589065},"hb_peers":[0,2,7,8,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 1 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":14,"up_from":23,"seq":98784247876,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3,4,5,7,8,9,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 14 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":2,"up_from":22,"seq":94489280581,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27332,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,5,7,8,9,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":15,"up_from":22,"seq":94489280581,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,2,4,5,7,8,9,10,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280580,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":778240,"data_stored":563850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[4,6,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[" osd: 5 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":9,"up_from":22,"seq":94489280581,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1598,"internal_metadata":27589058},"hb_peers":[2,4,5,7,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[" osd: 9 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":13,"up_from":22,"seq":94489280581,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[4,5,6,7,8,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[" osd: 13 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":0,"up_from":26,"seq":111669149767,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[1,2,3,4,5,7,8,9,11,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 0 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":7,"up_from":25,"seq":107374182469,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27332,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27589067},"hb_peers":[0,4,5,6,8,9,10,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149766,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":380928,"data_stored":166029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[2,4,5,6,8,9,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":11,"up_from":26,"seq":111669149766,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27332,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27589061},"hb_peers":[0,2,3,4,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:15:51.034 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2026-02-17T11:10:30.447281+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=10, tm_sec=30, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=15, tm_sec=42, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T11:15:51.034 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2026-02-17T11:10:30.447281+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=10, tm_sec=30, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=15, tm_sec=42, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T11:15:51.034 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2026-02-17T11:10:30.447281+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=10, tm_sec=30, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=15, tm_sec=42, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T11:15:51.035 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2026-02-17T11:10:30.447281+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=10, tm_sec=30, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=15, tm_sec=42, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T11:15:51.035 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2026-02-17T11:10:30.447281+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=10, tm_sec=30, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=15, tm_sec=42, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T11:15:51.035 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2026-02-17T11:10:20.960810+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=10, tm_sec=20, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=15, tm_sec=42, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T11:15:51.035 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2026-02-17T11:15:52.162 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:07:37.643 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:15:52.187 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:07:37.662 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:15:52.187 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:07:37.668 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:15:52.188 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:07:37.663 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:15:52.196 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:07:37.678 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:15:52.196 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:07:37.672 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:15:52.215 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:07:37.657 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:15:52.217 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:07:37.658 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:15:52.225 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:07:37.667 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:16:11.036 DEBUG:teuthology.orchestra.run.trial049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:16:11.106 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.103+0000 7faef241a640 10 monclient: get_monmap_and_config 2026-02-17T11:16:11.107 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.103+0000 7faef241a640 10 monclient: build_initial_monmap 2026-02-17T11:16:11.107 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.103+0000 7faef241a640 10 monclient: monmap: 2026-02-17T11:16:11.107 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:16:11.107 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:16:11.107 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:16:11.105457+0000 2026-02-17T11:16:11.107 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:16:11.105457+0000 2026-02-17T11:16:11.107 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:16:11.107 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:16:11.107 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:16:11.107 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:16:11.108 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:16:11.108 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:16:11.108 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:16:11.108 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:16:11.108 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:16:11.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.104+0000 7faef241a640 1 Processor -- start 2026-02-17T11:16:11.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.104+0000 7faef241a640 1 -- start start 2026-02-17T11:16:11.108 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.104+0000 7faef241a640 10 monclient: init 2026-02-17T11:16:11.111 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.105+0000 7faef241a640 10 monclient: _reopen_session rank -1 2026-02-17T11:16:11.111 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.105+0000 7faef241a640 10 monclient: _add_conns ranks=[2,4,3,5,0,1] 2026-02-17T11:16:11.111 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.105+0000 7faef241a640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7faeec152820 addr v1:10.20.193.157:6789/0 2026-02-17T11:16:11.112 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.105+0000 7faef241a640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7faeec152c00 0x7faeec1593f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:16:11.112 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.105+0000 7faef241a640 10 monclient(hunting): picked mon.noname-b con 0x7faeec152c00 addr v2:10.20.193.97:3300/0 2026-02-17T11:16:11.112 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.105+0000 7faef241a640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7faeec0738f0 0x7faeec0c5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:16:11.112 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.105+0000 7faef241a640 10 monclient(hunting): picked mon.noname-a con 0x7faeec0738f0 addr v2:10.20.193.49:3300/0 2026-02-17T11:16:11.112 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.105+0000 7faef241a640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faeec073e90 con 0x7faeec152820 2026-02-17T11:16:11.112 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.105+0000 7faef241a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:16:11.112 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.105+0000 7faef241a640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7faeec159930 con 0x7faeec0738f0 2026-02-17T11:16:11.112 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.105+0000 7faef241a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:16:11.112 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.105+0000 7faef241a640 1 -- --> v2:10.20.193.97:3300/0 -- mon_getmap magic: 0 -- 0x7faeec0c8550 con 0x7faeec152c00 2026-02-17T11:16:11.112 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.105+0000 7faef241a640 10 monclient(hunting): _renew_subs 2026-02-17T11:16:11.112 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.105+0000 7faef241a640 10 monclient(hunting): authenticate will time out at 1447.769225s 2026-02-17T11:16:11.112 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.105+0000 7faef0990640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7faeec0738f0 0x7faeec0c5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:16:11.113 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.105+0000 7faeeb7fe640 1 --2- >> v2:10.20.193.97:3300/0 conn(0x7faeec152c00 0x7faeec1593f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:16:11.113 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.105+0000 7faeebfff640 1 --1- >> v1:10.20.193.157:6789/0 conn(0x7faeec152820 0x7faeec0c7e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.157:6789/0 says I am v1:10.20.193.49:45668/0 (socket says 10.20.193.49:45668) 2026-02-17T11:16:11.113 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.105+0000 7faeebfff640 1 -- 10.20.193.49:0/4096634023 learned_addr learned my addr 10.20.193.49:0/4096634023 (peer_addr_for_me v1:10.20.193.49:0/0) 2026-02-17T11:16:11.113 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.105+0000 7faef0990640 10 monclient(hunting): get_auth_request con 0x7faeec0738f0 auth_method 0 2026-02-17T11:16:11.113 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.105+0000 7faef0990640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:16:11.113 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.105+0000 7faef0990640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:16:11.113 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.105+0000 7faef0990640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:16:11.113 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.105+0000 7faeeb7fe640 10 monclient(hunting): get_auth_request con 0x7faeec152c00 auth_method 0 2026-02-17T11:16:11.113 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.105+0000 7faeeb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:16:11.113 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.105+0000 7faeeb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:16:11.113 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.105+0000 7faeeb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:16:11.113 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.106+0000 7faef0990640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:16:11.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.106+0000 7faef0990640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:16:11.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.106+0000 7faef0990640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:16:11.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.106+0000 7faeeb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:16:11.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.106+0000 7faeeb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:16:11.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.106+0000 7faeeb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:16:11.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.107+0000 7faef0990640 10 monclient(hunting): handle_auth_done global_id 5340 payload 274 2026-02-17T11:16:11.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.107+0000 7faef0990640 1 -- 10.20.193.49:0/4096634023 >> v2:10.20.193.97:3300/0 conn(0x7faeec152c00 msgr2=0x7faeec1593f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:16:11.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.107+0000 7faef0990640 1 --2- 10.20.193.49:0/4096634023 >> v2:10.20.193.97:3300/0 conn(0x7faeec152c00 0x7faeec1593f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:16:11.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.107+0000 7faef0990640 1 -- 10.20.193.49:0/4096634023 >> v1:10.20.193.157:6789/0 conn(0x7faeec152820 legacy=0x7faeec0c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:16:11.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.107+0000 7faef0990640 10 monclient: _finish_hunting 0 2026-02-17T11:16:11.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.107+0000 7faef0990640 1 monclient: found mon.noname-a 2026-02-17T11:16:11.114 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.107+0000 7faef0990640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:16:11.115 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.107+0000 7faef0990640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:16:11.115 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.107+0000 7faef0990640 1 -- 10.20.193.49:0/4096634023 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faeec074170 con 0x7faeec0738f0 2026-02-17T11:16:11.115 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.108+0000 7faef0990640 1 --2- 10.20.193.49:0/4096634023 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7faeec0738f0 0x7faeec0c5ce0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7faeec0cb010 tx=0x7faee002f250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b544f1a9ad9aa045 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:16:11.121 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.110+0000 7faeeaffd640 1 -- 10.20.193.49:0/4096634023 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee003c070 con 0x7faeec0738f0 2026-02-17T11:16:11.121 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.110+0000 7faeeaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:16:11.121 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.110+0000 7faeeaffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:16:11.121 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.110+0000 7faeeaffd640 10 monclient: dump: 2026-02-17T11:16:11.122 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:16:11.122 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:16:11.122 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:16:11.122 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:16:11.122 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:16:11.122 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:16:11.122 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:16:11.122 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:16:11.122 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:16:11.122 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:16:11.122 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.110+0000 7faeeaffd640 10 monclient: _finish_auth 0 2026-02-17T11:16:11.122 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.110+0000 7faeeaffd640 10 monclient: _check_auth_tickets 2026-02-17T11:16:11.122 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.110+0000 7faeeaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:16:11.123 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.110+0000 7faeeaffd640 1 -- 10.20.193.49:0/4096634023 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faee0037440 con 0x7faeec0738f0 2026-02-17T11:16:11.123 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.110+0000 7faeeaffd640 10 monclient: handle_config config(0 keys) 2026-02-17T11:16:11.123 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.110+0000 7faeeaffd640 1 -- 10.20.193.49:0/4096634023 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee0037810 con 0x7faeec0738f0 2026-02-17T11:16:11.123 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.110+0000 7faef241a640 5 monclient: authenticate success, global_id 5340 2026-02-17T11:16:11.123 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.110+0000 7faef241a640 10 monclient: get_monmap_and_config success 2026-02-17T11:16:11.123 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.110+0000 7faef241a640 4 set_mon_vals no callback set 2026-02-17T11:16:11.123 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.110+0000 7faeeaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:16:11.123 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.110+0000 7faeeaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:16:11.123 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.110+0000 7faeeaffd640 10 monclient: dump: 2026-02-17T11:16:11.123 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:16:11.123 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:16:11.123 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:16:11.124 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:16:11.124 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:16:11.124 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:16:11.124 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:16:11.124 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:16:11.124 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:16:11.124 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:16:11.124 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.110+0000 7faef241a640 10 monclient: shutdown 2026-02-17T11:16:11.124 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.110+0000 7faef241a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:16:11.124 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.110+0000 7faef241a640 1 -- 10.20.193.49:0/4096634023 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7faeec0738f0 msgr2=0x7faeec0c5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:16:11.124 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.110+0000 7faef241a640 1 --2- 10.20.193.49:0/4096634023 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7faeec0738f0 0x7faeec0c5ce0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7faeec0cb010 tx=0x7faee002f250 comp rx=0 tx=0).stop 2026-02-17T11:16:11.124 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.110+0000 7faef241a640 1 -- 10.20.193.49:0/4096634023 shutdown_connections 2026-02-17T11:16:11.125 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.110+0000 7faef241a640 1 --2- 10.20.193.49:0/4096634023 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7faeec0738f0 0x7faeec0c5ce0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:16:11.125 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.110+0000 7faef241a640 1 --2- 10.20.193.49:0/4096634023 >> v2:10.20.193.97:3300/0 conn(0x7faeec152c00 0x7faeec1593f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:16:11.125 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.110+0000 7faef241a640 1 -- 10.20.193.49:0/4096634023 >> 10.20.193.49:0/4096634023 conn(0x7faeec0c9f40 msgr2=0x7faeec0ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:16:11.125 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.110+0000 7faef241a640 1 -- 10.20.193.49:0/4096634023 shutdown_connections 2026-02-17T11:16:11.125 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.110+0000 7faef241a640 1 -- 10.20.193.49:0/4096634023 wait complete. 2026-02-17T11:16:11.125 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.111+0000 7faef241a640 10 monclient: build_initial_monmap 2026-02-17T11:16:11.125 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.111+0000 7faef241a640 10 monclient: monmap: 2026-02-17T11:16:11.125 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:16:11.125 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:16:11.125 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:16:11.125 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:16:11.125 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:16:11.125 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:16:11.126 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:16:11.126 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:16:11.126 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:16:11.126 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:16:11.126 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.111+0000 7faef241a640 1 librados: starting msgr at 2026-02-17T11:16:11.126 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.111+0000 7faef241a640 1 librados: starting objecter 2026-02-17T11:16:11.126 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.111+0000 7faef241a640 1 Processor -- start 2026-02-17T11:16:11.126 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.111+0000 7faef241a640 1 -- start start 2026-02-17T11:16:11.126 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.111+0000 7faef241a640 1 librados: setting wanted keys 2026-02-17T11:16:11.126 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.111+0000 7faef241a640 1 librados: calling monclient init 2026-02-17T11:16:11.126 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.111+0000 7faef241a640 10 monclient: init 2026-02-17T11:16:11.126 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.111+0000 7faef241a640 10 monclient: _reopen_session rank -1 2026-02-17T11:16:11.127 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.112+0000 7faef241a640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T11:16:11.127 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.112+0000 7faef241a640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7faeec0738f0 0x7faeec1f79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:16:11.127 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.112+0000 7faef241a640 10 monclient(hunting): picked mon.noname-b con 0x7faeec0738f0 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:16:11.127 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.112+0000 7faef241a640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7faeec152820 0x7faeec1f3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:16:11.127 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.112+0000 7faef241a640 10 monclient(hunting): picked mon.noname-c con 0x7faeec152820 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:16:11.127 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.112+0000 7faef241a640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7faeec152c00 0x7faeec0c01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:16:11.127 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.112+0000 7faef241a640 10 monclient(hunting): picked mon.noname-a con 0x7faeec152c00 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:16:11.127 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.112+0000 7faef241a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:16:11.127 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.112+0000 7faef241a640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7faeec074a10 con 0x7faeec152c00 2026-02-17T11:16:11.127 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.112+0000 7faef241a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:16:11.127 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.112+0000 7faef241a640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7faeec074730 con 0x7faeec0738f0 2026-02-17T11:16:11.127 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.112+0000 7faef241a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:16:11.128 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.112+0000 7faef241a640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7faeec074cf0 con 0x7faeec152820 2026-02-17T11:16:11.128 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.112+0000 7faef241a640 10 monclient(hunting): _renew_subs 2026-02-17T11:16:11.128 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.112+0000 7faef241a640 10 monclient(hunting): authenticate will time out at 1447.776047s 2026-02-17T11:16:11.128 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.112+0000 7faef0990640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7faeec152c00 0x7faeec0c01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:16:11.128 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.112+0000 7faeebfff640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7faeec0738f0 0x7faeec1f79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:16:11.128 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.112+0000 7faeeb7fe640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7faeec152820 0x7faeec1f3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:16:11.128 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.112+0000 7faef0990640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7faeec152c00 0x7faeec0c01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:51780/0 (socket says 10.20.193.49:51780) 2026-02-17T11:16:11.128 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.112+0000 7faef0990640 1 -- 10.20.193.49:0/1234401327 learned_addr learned my addr 10.20.193.49:0/1234401327 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:16:11.128 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.112+0000 7faef0990640 10 monclient(hunting): get_auth_request con 0x7faeec152c00 auth_method 0 2026-02-17T11:16:11.128 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.112+0000 7faef0990640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:16:11.128 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.112+0000 7faef0990640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:16:11.128 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.112+0000 7faef0990640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:16:11.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.112+0000 7faeeb7fe640 10 monclient(hunting): get_auth_request con 0x7faeec152820 auth_method 0 2026-02-17T11:16:11.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.112+0000 7faeeb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:16:11.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.112+0000 7faeeb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:16:11.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.112+0000 7faeeb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:16:11.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.112+0000 7faeebfff640 10 monclient(hunting): get_auth_request con 0x7faeec0738f0 auth_method 0 2026-02-17T11:16:11.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.112+0000 7faeebfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:16:11.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.112+0000 7faeebfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:16:11.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.112+0000 7faeebfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:16:11.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.112+0000 7faef0990640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:16:11.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.112+0000 7faef0990640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:16:11.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.112+0000 7faef0990640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:16:11.129 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.112+0000 7faeeb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:16:11.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.112+0000 7faeeb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:16:11.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.112+0000 7faeeb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:16:11.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.112+0000 7faeebfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:16:11.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.112+0000 7faeebfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:16:11.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.112+0000 7faeebfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:16:11.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.114+0000 7faef0990640 10 monclient(hunting): handle_auth_done global_id 5343 payload 824 2026-02-17T11:16:11.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.114+0000 7faef0990640 1 -- 10.20.193.49:0/1234401327 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7faeec152820 msgr2=0x7faeec1f3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:16:11.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.114+0000 7faef0990640 1 --2- 10.20.193.49:0/1234401327 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7faeec152820 0x7faeec1f3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:16:11.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.114+0000 7faef0990640 1 -- 10.20.193.49:0/1234401327 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7faeec0738f0 msgr2=0x7faeec1f79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:16:11.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.114+0000 7faef0990640 1 --2- 10.20.193.49:0/1234401327 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7faeec0738f0 0x7faeec1f79e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:16:11.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.114+0000 7faef0990640 10 monclient: _finish_hunting 0 2026-02-17T11:16:11.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.114+0000 7faef0990640 1 monclient: found mon.noname-a 2026-02-17T11:16:11.130 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.114+0000 7faef0990640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:16:11.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.114+0000 7faef0990640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:16:11.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.114+0000 7faef0990640 1 -- 10.20.193.49:0/1234401327 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faeec0c0710 con 0x7faeec152c00 2026-02-17T11:16:11.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.115+0000 7faef0990640 1 --2- 10.20.193.49:0/1234401327 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7faeec152c00 0x7faeec0c01d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7faee002f780 tx=0x7faee0004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:16:11.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.115+0000 7faee8ff9640 10 client.?.objecter ms_handle_connect 0x7faeec152c00 2026-02-17T11:16:11.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.115+0000 7faee8ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T11:16:11.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.116+0000 7faee8ff9640 1 -- 10.20.193.49:0/1234401327 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee0047030 con 0x7faeec152c00 2026-02-17T11:16:11.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.116+0000 7faee8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:16:11.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.116+0000 7faee8ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:16:11.131 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.116+0000 7faee8ff9640 10 monclient: dump: 2026-02-17T11:16:11.131 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:16:11.131 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:16:11.131 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:16:11.131 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:16:11.132 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:16:11.132 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:16:11.132 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:16:11.132 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:16:11.132 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:16:11.132 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:16:11.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.116+0000 7faee8ff9640 10 monclient: _finish_auth 0 2026-02-17T11:16:11.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.116+0000 7faee8ff9640 10 monclient: _check_auth_tickets 2026-02-17T11:16:11.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.116+0000 7faee8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:16:11.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.116+0000 7faef241a640 5 monclient: authenticate success, global_id 5343 2026-02-17T11:16:11.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.116+0000 7faef241a640 10 monclient: _renew_subs 2026-02-17T11:16:11.132 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.116+0000 7faef241a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:16:11.133 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.116+0000 7faef241a640 1 -- 10.20.193.49:0/1234401327 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faeec1f4200 con 0x7faeec152c00 2026-02-17T11:16:11.133 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.116+0000 7faef241a640 10 client.5343.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:16:11.133 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.116+0000 7faef241a640 10 monclient: _renew_subs 2026-02-17T11:16:11.133 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.116+0000 7faef241a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:16:11.133 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.116+0000 7faef241a640 1 -- 10.20.193.49:0/1234401327 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faeec1f47c0 con 0x7faeec152c00 2026-02-17T11:16:11.133 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.116+0000 7faef241a640 1 librados: init done 2026-02-17T11:16:11.133 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.116+0000 7faef241a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:16:11.133 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.116+0000 7faef241a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:16:11.133 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.116+0000 7faef241a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:16:11.133 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.116+0000 7faef241a640 1 -- 10.20.193.49:0/1234401327 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faeec1593f0 con 0x7faeec152c00 2026-02-17T11:16:11.133 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.116+0000 7faee8ff9640 1 -- 10.20.193.49:0/1234401327 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faee0038030 con 0x7faeec152c00 2026-02-17T11:16:11.133 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.116+0000 7faee8ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T11:16:11.133 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.116+0000 7faee8ff9640 1 -- 10.20.193.49:0/1234401327 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee003c040 con 0x7faeec152c00 2026-02-17T11:16:11.134 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.116+0000 7faee8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:16:11.134 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.116+0000 7faee8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:16:11.134 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.116+0000 7faeea7fc640 4 set_mon_vals no callback set 2026-02-17T11:16:11.134 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.116+0000 7faee8ff9640 10 monclient: dump: 2026-02-17T11:16:11.134 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:16:11.134 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:16:11.134 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:16:11.134 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:16:11.134 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:16:11.134 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:16:11.134 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:16:11.134 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:16:11.134 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:16:11.135 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:16:11.226 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.223+0000 7faee8ff9640 1 -- 10.20.193.49:0/1234401327 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7faee0042470 con 0x7faeec152c00 2026-02-17T11:16:11.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.224+0000 7faee8ff9640 1 --2- 10.20.193.49:0/1234401327 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7faebc079140 0x7faebc07b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:16:11.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.224+0000 7faeebfff640 1 --2- 10.20.193.49:0/1234401327 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7faebc079140 0x7faebc07b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:16:11.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.224+0000 7faeebfff640 10 monclient: get_auth_request con 0x7faebc079140 auth_method 0 2026-02-17T11:16:11.227 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.225+0000 7faee8ff9640 10 client.5343.objecter ms_handle_connect 0x7faebc079140 2026-02-17T11:16:11.228 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.225+0000 7faeebfff640 1 --2- 10.20.193.49:0/1234401327 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7faebc079140 0x7faebc07b600 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7faed8002770 tx=0x7faed8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:16:11.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.231+0000 7faee8ff9640 1 -- 10.20.193.49:0/1234401327 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7faee00383e0 con 0x7faeec152c00 2026-02-17T11:16:11.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.231+0000 7faee8ff9640 10 client.5343.objecter ms_dispatch2 0x7faeec000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:16:11.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.231+0000 7faee8ff9640 3 client.5343.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:16:11.234 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.231+0000 7faee8ff9640 3 client.5343.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:16:11.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.232+0000 7faee8ff9640 20 client.5343.objecter dump_active .. 0 homeless 2026-02-17T11:16:11.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.232+0000 7faee8ff9640 1 -- 10.20.193.49:0/1234401327 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7faee0051070 con 0x7faeec152c00 2026-02-17T11:16:11.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.232+0000 7faee8ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:16:11.235 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.232+0000 7faee8ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:16:11.316 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.314+0000 7faef241a640 1 -- 10.20.193.49:0/1234401327 --> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7faeec1f3fa0 con 0x7faebc079140 2026-02-17T11:16:11.318 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.316+0000 7faee8ff9640 1 -- 10.20.193.49:0/1234401327 <== mgr.4106 v2:10.20.193.162:6800/2614632098 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+44559 (secure 0 0 0) 0x7faed800f800 con 0x7faebc079140 2026-02-17T11:16:11.319 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-17T11:16:11.320 INFO:teuthology.orchestra.run.trial049.stderr:dumped all 2026-02-17T11:16:11.320 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.316+0000 7faef241a640 10 librados: watch_flush enter 2026-02-17T11:16:11.320 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.316+0000 7faef241a640 10 librados: watch_flush exit 2026-02-17T11:16:11.320 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.316+0000 7faef241a640 20 client.5343.objecter shutdown clearing up homeless session... 2026-02-17T11:16:11.321 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.316+0000 7faef241a640 10 client.5343.objecter successfully canceled tick 2026-02-17T11:16:11.321 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.316+0000 7faef241a640 1 -- 10.20.193.49:0/1234401327 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7faebc079140 msgr2=0x7faebc07b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:16:11.321 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.316+0000 7faef241a640 1 --2- 10.20.193.49:0/1234401327 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7faebc079140 0x7faebc07b600 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7faed8002770 tx=0x7faed8009040 comp rx=0 tx=0).stop 2026-02-17T11:16:11.321 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.316+0000 7faef241a640 10 monclient: shutdown 2026-02-17T11:16:11.321 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.316+0000 7faef241a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:16:11.321 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.316+0000 7faef241a640 1 -- 10.20.193.49:0/1234401327 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7faeec152c00 msgr2=0x7faeec0c01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:16:11.321 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.316+0000 7faef241a640 1 --2- 10.20.193.49:0/1234401327 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7faeec152c00 0x7faeec0c01d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7faee002f780 tx=0x7faee0004b40 comp rx=0 tx=0).stop 2026-02-17T11:16:11.321 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.316+0000 7faef241a640 1 -- 10.20.193.49:0/1234401327 shutdown_connections 2026-02-17T11:16:11.321 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.316+0000 7faef241a640 1 --2- 10.20.193.49:0/1234401327 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7faebc079140 0x7faebc07b600 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:16:11.321 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.316+0000 7faef241a640 1 --2- 10.20.193.49:0/1234401327 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7faeec152c00 0x7faeec0c01d0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:16:11.322 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.316+0000 7faef241a640 1 --2- 10.20.193.49:0/1234401327 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7faeec152820 0x7faeec1f3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:16:11.322 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.316+0000 7faef241a640 1 --2- 10.20.193.49:0/1234401327 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7faeec0738f0 0x7faeec1f79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:16:11.322 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.316+0000 7faef241a640 1 -- 10.20.193.49:0/1234401327 >> 10.20.193.49:0/1234401327 conn(0x7faeec0c9f40 msgr2=0x7faeec0c8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:16:11.322 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.316+0000 7faef241a640 1 -- 10.20.193.49:0/1234401327 shutdown_connections 2026-02-17T11:16:11.322 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.316+0000 7faef241a640 1 -- 10.20.193.49:0/1234401327 wait complete. 2026-02-17T11:16:11.322 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.316+0000 7faef241a640 1 librados: shutdown 2026-02-17T11:16:11.327 INFO:teuthology.orchestra.run.trial049.stdout:{"pg_ready":true,"pg_map":{"version":246,"stamp":"2026-02-17T11:16:10.508187+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459299,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":59,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":12,"kb":1509949440,"kb_used":438064,"kb_used_data":6680,"kb_used_omap":24,"kb_used_meta":431079,"kb_avail":1509511376,"statfs":{"total":1546188226560,"available":1545739649024,"internally_reserved":0,"allocated":6840320,"data_stored":3451878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25501,"internal_metadata":441424995},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 0 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 1 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 4 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 5 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 6 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 8 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 9 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 10 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 12 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 13 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 14 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001562"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:15:51.575145+0000","last_change":"2026-02-17T11:15:51.577841+0000","last_active":"2026-02-17T11:15:51.575145+0000","last_peered":"2026-02-17T11:15:51.575145+0000","last_clean":"2026-02-17T11:15:51.575145+0000","last_became_active":"2026-02-17T11:10:31.882486+0000","last_became_peered":"2026-02-17T11:10:31.882486+0000","last_unstale":"2026-02-17T11:15:51.575145+0000","last_undegraded":"2026-02-17T11:15:51.575145+0000","last_fullsized":"2026-02-17T11:15:51.575145+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:15:51.573023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:15:51.573023+0000","last_clean_scrub_stamp":"2026-02-17T11:15:51.573023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:03:48.513966+0000","scrub_duration":165,"objects_trimmed":0,"snaptrim_duration":0.031448708999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,10],"acting":[15,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:15:45.653753+0000","last_change":"2026-02-17T11:15:45.658488+0000","last_active":"2026-02-17T11:15:45.653753+0000","last_peered":"2026-02-17T11:15:45.653753+0000","last_clean":"2026-02-17T11:15:45.653753+0000","last_became_active":"2026-02-17T11:10:32.011352+0000","last_became_peered":"2026-02-17T11:10:32.011352+0000","last_unstale":"2026-02-17T11:15:45.653753+0000","last_undegraded":"2026-02-17T11:15:45.653753+0000","last_fullsized":"2026-02-17T11:15:45.653753+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:15:45.650495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:15:45.650495+0000","last_clean_scrub_stamp":"2026-02-17T11:15:45.650495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:35:13.790394+0000","scrub_duration":189,"objects_trimmed":0,"snaptrim_duration":0.030517882999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,13],"acting":[8,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:15:47.741885+0000","last_change":"2026-02-17T11:15:47.746986+0000","last_active":"2026-02-17T11:15:47.741885+0000","last_peered":"2026-02-17T11:15:47.741885+0000","last_clean":"2026-02-17T11:15:47.741885+0000","last_became_active":"2026-02-17T11:10:31.774687+0000","last_became_peered":"2026-02-17T11:10:31.774687+0000","last_unstale":"2026-02-17T11:15:47.741885+0000","last_undegraded":"2026-02-17T11:15:47.741885+0000","last_fullsized":"2026-02-17T11:15:47.741885+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:15:47.736478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:15:47.736478+0000","last_clean_scrub_stamp":"2026-02-17T11:15:47.736478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:54:59.226581+0000","scrub_duration":153,"objects_trimmed":0,"snaptrim_duration":0.034911202000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4],"acting":[9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:15:45.802315+0000","last_change":"2026-02-17T11:15:45.806915+0000","last_active":"2026-02-17T11:15:45.802315+0000","last_peered":"2026-02-17T11:15:45.802315+0000","last_clean":"2026-02-17T11:15:45.802315+0000","last_became_active":"2026-02-17T11:10:31.919932+0000","last_became_peered":"2026-02-17T11:10:31.919932+0000","last_unstale":"2026-02-17T11:15:45.802315+0000","last_undegraded":"2026-02-17T11:15:45.802315+0000","last_fullsized":"2026-02-17T11:15:45.802315+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:15:45.798989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:15:45.798989+0000","last_clean_scrub_stamp":"2026-02-17T11:15:45.798989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:15:58.520921+0000","scrub_duration":198,"objects_trimmed":0,"snaptrim_duration":0.034931859000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"34'3","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:15:51.226765+0000","last_change":"2026-02-17T11:15:51.227837+0000","last_active":"2026-02-17T11:15:51.226765+0000","last_peered":"2026-02-17T11:15:51.226765+0000","last_clean":"2026-02-17T11:15:51.226765+0000","last_became_active":"2026-02-17T11:10:31.924469+0000","last_became_peered":"2026-02-17T11:10:31.924469+0000","last_unstale":"2026-02-17T11:15:51.226765+0000","last_undegraded":"2026-02-17T11:15:51.226765+0000","last_fullsized":"2026-02-17T11:15:51.226765+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2026-02-17T11:15:51.224075+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2026-02-17T11:15:51.224075+0000","last_clean_scrub_stamp":"2026-02-17T11:15:51.224075+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:03:48.756541+0000","scrub_duration":171,"objects_trimmed":0,"snaptrim_duration":0.057723655999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,12],"acting":[3,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:15:50.432311+0000","last_change":"2026-02-17T11:15:50.432671+0000","last_active":"2026-02-17T11:15:50.432311+0000","last_peered":"2026-02-17T11:15:50.432311+0000","last_clean":"2026-02-17T11:15:50.432311+0000","last_became_active":"2026-02-17T11:10:31.972595+0000","last_became_peered":"2026-02-17T11:10:31.972595+0000","last_unstale":"2026-02-17T11:15:50.432311+0000","last_undegraded":"2026-02-17T11:15:50.432311+0000","last_fullsized":"2026-02-17T11:15:50.432311+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:15:50.430615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:15:50.430615+0000","last_clean_scrub_stamp":"2026-02-17T11:15:50.430615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:04:21.385986+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0.038208368999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:15:50.171189+0000","last_change":"2026-02-17T11:15:50.175877+0000","last_active":"2026-02-17T11:15:50.171189+0000","last_peered":"2026-02-17T11:15:50.171189+0000","last_clean":"2026-02-17T11:15:50.171189+0000","last_became_active":"2026-02-17T11:10:31.878425+0000","last_became_peered":"2026-02-17T11:10:31.878425+0000","last_unstale":"2026-02-17T11:15:50.171189+0000","last_undegraded":"2026-02-17T11:15:50.171189+0000","last_fullsized":"2026-02-17T11:15:50.171189+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:15:50.168083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:15:50.168083+0000","last_clean_scrub_stamp":"2026-02-17T11:15:50.168083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:31:49.383198+0000","scrub_duration":112,"objects_trimmed":0,"snaptrim_duration":0.057827870000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"34'2","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:15:49.678649+0000","last_change":"2026-02-17T11:15:49.683807+0000","last_active":"2026-02-17T11:15:49.678649+0000","last_peered":"2026-02-17T11:15:49.678649+0000","last_clean":"2026-02-17T11:15:49.678649+0000","last_became_active":"2026-02-17T11:10:31.780197+0000","last_became_peered":"2026-02-17T11:10:31.780197+0000","last_unstale":"2026-02-17T11:15:49.678649+0000","last_undegraded":"2026-02-17T11:15:49.678649+0000","last_fullsized":"2026-02-17T11:15:49.678649+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2026-02-17T11:15:49.676372+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2026-02-17T11:15:49.676372+0000","last_clean_scrub_stamp":"2026-02-17T11:15:49.676372+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:08:02.909103+0000","scrub_duration":271,"objects_trimmed":0,"snaptrim_duration":0.029469485,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,15],"acting":[14,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"1.0","version":"34'34","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:15:48.350378+0000","last_change":"2026-02-17T11:15:48.355459+0000","last_active":"2026-02-17T11:15:48.350378+0000","last_peered":"2026-02-17T11:15:48.350378+0000","last_clean":"2026-02-17T11:15:48.350378+0000","last_became_active":"2026-02-17T11:10:28.524896+0000","last_became_peered":"2026-02-17T11:10:28.524896+0000","last_unstale":"2026-02-17T11:15:48.350378+0000","last_undegraded":"2026-02-17T11:15:48.350378+0000","last_fullsized":"2026-02-17T11:15:48.350378+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'34","last_scrub_stamp":"2026-02-17T11:15:48.348202+0000","last_deep_scrub":"34'34","last_deep_scrub_stamp":"2026-02-17T11:15:48.348202+0000","last_clean_scrub_stamp":"2026-02-17T11:15:48.348202+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:21:38.890578+0000","scrub_duration":306,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34,"ondisk_log_size":34,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":10,"up_from":27,"seq":115964117067,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[0,1,2,5,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 10 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":6,"up_from":27,"seq":115964117065,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":778240,"data_stored":563850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,5,7,8,9,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 6 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":12,"up_from":26,"seq":111669149770,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":380928,"data_stored":166029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,7,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 12 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":4,"up_from":21,"seq":90194313289,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3,5,8,9,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 4 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":8,"up_from":21,"seq":90194313288,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5,7,9,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 8 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":1,"up_from":22,"seq":94489280585,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27332,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27589065},"hb_peers":[0,2,7,8,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 1 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":14,"up_from":23,"seq":98784247880,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3,4,5,7,8,9,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 14 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":2,"up_from":22,"seq":94489280585,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27332,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,5,7,8,9,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":15,"up_from":22,"seq":94489280585,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,2,4,5,7,8,9,10,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280584,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":778240,"data_stored":563850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[4,6,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 5 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":9,"up_from":22,"seq":94489280585,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1598,"internal_metadata":27589058},"hb_peers":[2,4,5,7,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 9 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":13,"up_from":22,"seq":94489280585,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[4,5,6,7,8,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 13 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":0,"up_from":26,"seq":111669149771,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[1,2,3,4,5,7,8,9,11,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 0 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":7,"up_from":25,"seq":107374182473,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27332,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27589067},"hb_peers":[0,4,5,6,8,9,10,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149770,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":380928,"data_stored":166029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[2,4,5,6,8,9,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":11,"up_from":26,"seq":111669149770,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27332,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":376832,"data_stored":166010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27589061},"hb_peers":[0,2,3,4,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:16:11.329 DEBUG:teuthology.orchestra.run.trial049:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-17T11:16:11.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.392+0000 7f3b95d0a640 10 monclient: get_monmap_and_config 2026-02-17T11:16:11.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.392+0000 7f3b95d0a640 10 monclient: build_initial_monmap 2026-02-17T11:16:11.395 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.392+0000 7f3b95d0a640 10 monclient: monmap: 2026-02-17T11:16:11.395 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:16:11.395 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:16:11.395 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:16:11.394225+0000 2026-02-17T11:16:11.395 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:16:11.394225+0000 2026-02-17T11:16:11.395 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:16:11.396 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:16:11.396 INFO:teuthology.orchestra.run.trial049.stderr:0: v1:10.20.193.49:6789/0 mon.noname-a-legacy 2026-02-17T11:16:11.396 INFO:teuthology.orchestra.run.trial049.stderr:1: v1:10.20.193.97:6789/0 mon.noname-b-legacy 2026-02-17T11:16:11.396 INFO:teuthology.orchestra.run.trial049.stderr:2: v1:10.20.193.157:6789/0 mon.noname-c-legacy 2026-02-17T11:16:11.396 INFO:teuthology.orchestra.run.trial049.stderr:3: v2:10.20.193.49:3300/0 mon.noname-a 2026-02-17T11:16:11.396 INFO:teuthology.orchestra.run.trial049.stderr:4: v2:10.20.193.97:3300/0 mon.noname-b 2026-02-17T11:16:11.396 INFO:teuthology.orchestra.run.trial049.stderr:5: v2:10.20.193.157:3300/0 mon.noname-c 2026-02-17T11:16:11.396 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:16:11.399 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.393+0000 7f3b95d0a640 1 Processor -- start 2026-02-17T11:16:11.399 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.393+0000 7f3b95d0a640 1 -- start start 2026-02-17T11:16:11.399 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.393+0000 7f3b95d0a640 10 monclient: init 2026-02-17T11:16:11.399 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.393+0000 7f3b95d0a640 10 monclient: _reopen_session rank -1 2026-02-17T11:16:11.399 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.393+0000 7f3b95d0a640 10 monclient: _add_conns ranks=[5,3,2,1,4,0] 2026-02-17T11:16:11.399 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.393+0000 7f3b95d0a640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f3b9015d370 0x7f3b9015d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:16:11.400 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.393+0000 7f3b95d0a640 10 monclient(hunting): picked mon.noname-c con 0x7f3b9015d370 addr v2:10.20.193.157:3300/0 2026-02-17T11:16:11.400 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.393+0000 7f3b95d0a640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f3b900c7e20 0x7f3b900c74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:16:11.400 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.393+0000 7f3b95d0a640 10 monclient(hunting): picked mon.noname-a con 0x7f3b900c7e20 addr v2:10.20.193.49:3300/0 2026-02-17T11:16:11.400 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.393+0000 7f3b95d0a640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f3b9015b000 addr v1:10.20.193.157:6789/0 2026-02-17T11:16:11.400 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.393+0000 7f3b95d0a640 1 -- --> v1:10.20.193.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b900c8350 con 0x7f3b9015b000 2026-02-17T11:16:11.400 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.393+0000 7f3b95d0a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:16:11.400 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.393+0000 7f3b95d0a640 1 -- --> v2:10.20.193.49:3300/0 -- mon_getmap magic: 0 -- 0x7f3b900c9240 con 0x7f3b900c7e20 2026-02-17T11:16:11.400 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.393+0000 7f3b95d0a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:16:11.400 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.393+0000 7f3b95d0a640 1 -- --> v2:10.20.193.157:3300/0 -- mon_getmap magic: 0 -- 0x7f3b900c8630 con 0x7f3b9015d370 2026-02-17T11:16:11.400 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.393+0000 7f3b95d0a640 10 monclient(hunting): _renew_subs 2026-02-17T11:16:11.400 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.393+0000 7f3b95d0a640 10 monclient(hunting): authenticate will time out at 1448.057765s 2026-02-17T11:16:11.400 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.394+0000 7f3b8f7fe640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f3b9015d370 0x7f3b9015d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:16:11.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.394+0000 7f3b8effd640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f3b900c7e20 0x7f3b900c74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:16:11.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.394+0000 7f3b8f7fe640 1 --2- >> v2:10.20.193.157:3300/0 conn(0x7f3b9015d370 0x7f3b9015d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.157:3300/0 says I am v2:10.20.193.49:56910/0 (socket says 10.20.193.49:56910) 2026-02-17T11:16:11.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.394+0000 7f3b8f7fe640 1 -- 10.20.193.49:0/310883947 learned_addr learned my addr 10.20.193.49:0/310883947 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:16:11.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.394+0000 7f3b8effd640 1 --2- >> v2:10.20.193.49:3300/0 conn(0x7f3b900c7e20 0x7f3b900c74c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:51790/0 (socket says 10.20.193.49:51790) 2026-02-17T11:16:11.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.394+0000 7f3b8f7fe640 10 monclient(hunting): get_auth_request con 0x7f3b9015d370 auth_method 0 2026-02-17T11:16:11.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.394+0000 7f3b8f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:16:11.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.394+0000 7f3b8f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:16:11.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.394+0000 7f3b8f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:16:11.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.394+0000 7f3b8effd640 10 monclient(hunting): get_auth_request con 0x7f3b900c7e20 auth_method 0 2026-02-17T11:16:11.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.394+0000 7f3b8effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:16:11.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.394+0000 7f3b8effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:16:11.401 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.394+0000 7f3b8effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:16:11.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.394+0000 7f3b8effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:16:11.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.394+0000 7f3b8effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:16:11.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.394+0000 7f3b8effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:16:11.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.394+0000 7f3b8f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:16:11.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.394+0000 7f3b8f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:16:11.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.394+0000 7f3b8f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:16:11.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.395+0000 7f3b8effd640 10 monclient(hunting): handle_auth_done global_id 5346 payload 274 2026-02-17T11:16:11.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.395+0000 7f3b8effd640 1 -- 10.20.193.49:0/310883947 >> v2:10.20.193.157:3300/0 conn(0x7f3b9015d370 msgr2=0x7f3b9015d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T11:16:11.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.395+0000 7f3b8effd640 1 --2- 10.20.193.49:0/310883947 >> v2:10.20.193.157:3300/0 conn(0x7f3b9015d370 0x7f3b9015d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:16:11.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.395+0000 7f3b8effd640 1 -- 10.20.193.49:0/310883947 >> v1:10.20.193.157:6789/0 conn(0x7f3b9015b000 legacy=0x7f3b900c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:16:11.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.395+0000 7f3b8effd640 10 monclient: _finish_hunting 0 2026-02-17T11:16:11.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.395+0000 7f3b8effd640 1 monclient: found mon.noname-a 2026-02-17T11:16:11.402 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.395+0000 7f3b8effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:16:11.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.395+0000 7f3b8effd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:16:11.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.395+0000 7f3b8effd640 1 -- 10.20.193.49:0/310883947 --> v2:10.20.193.49:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b900c8910 con 0x7f3b900c7e20 2026-02-17T11:16:11.403 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.396+0000 7f3b8effd640 1 --2- 10.20.193.49:0/310883947 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f3b900c7e20 0x7f3b900c74c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3b900698d0 tx=0x7f3b8002ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b93a44445bc9947d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:16:11.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.398+0000 7f3b8e7fc640 1 -- 10.20.193.49:0/310883947 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b8003c070 con 0x7f3b900c7e20 2026-02-17T11:16:11.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.398+0000 7f3b8e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:16:11.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.399+0000 7f3b8e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:16:11.409 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.399+0000 7f3b8e7fc640 10 monclient: dump: 2026-02-17T11:16:11.409 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:16:11.409 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:16:11.409 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:16:11.409 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:16:11.409 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:16:11.409 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:16:11.410 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:16:11.410 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:16:11.410 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:16:11.410 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:16:11.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.399+0000 7f3b8e7fc640 10 monclient: _finish_auth 0 2026-02-17T11:16:11.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.399+0000 7f3b8e7fc640 10 monclient: _check_auth_tickets 2026-02-17T11:16:11.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.399+0000 7f3b8e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:16:11.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.399+0000 7f3b8e7fc640 1 -- 10.20.193.49:0/310883947 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b8002faf0 con 0x7f3b900c7e20 2026-02-17T11:16:11.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.399+0000 7f3b95d0a640 5 monclient: authenticate success, global_id 5346 2026-02-17T11:16:11.410 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.399+0000 7f3b95d0a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T11:16:11.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.399+0000 7f3b8e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T11:16:11.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.399+0000 7f3b8e7fc640 1 -- 10.20.193.49:0/310883947 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b80037440 con 0x7f3b900c7e20 2026-02-17T11:16:11.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.399+0000 7f3b8e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:16:11.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.399+0000 7f3b8e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:16:11.411 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.399+0000 7f3b8e7fc640 10 monclient: dump: 2026-02-17T11:16:11.411 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:16:11.411 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:16:11.411 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:16:11.411 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:16:11.411 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:16:11.411 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:16:11.412 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:16:11.412 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:16:11.412 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:16:11.412 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:16:11.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.399+0000 7f3b95d0a640 10 monclient: get_monmap_and_config success 2026-02-17T11:16:11.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.399+0000 7f3b95d0a640 4 set_mon_vals no callback set 2026-02-17T11:16:11.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.399+0000 7f3b95d0a640 10 monclient: shutdown 2026-02-17T11:16:11.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.399+0000 7f3b95d0a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:16:11.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.399+0000 7f3b95d0a640 1 -- 10.20.193.49:0/310883947 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f3b900c7e20 msgr2=0x7f3b900c74c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:16:11.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.399+0000 7f3b95d0a640 1 --2- 10.20.193.49:0/310883947 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f3b900c7e20 0x7f3b900c74c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3b900698d0 tx=0x7f3b8002ede0 comp rx=0 tx=0).stop 2026-02-17T11:16:11.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.399+0000 7f3b95d0a640 1 -- 10.20.193.49:0/310883947 shutdown_connections 2026-02-17T11:16:11.412 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.399+0000 7f3b95d0a640 1 --2- 10.20.193.49:0/310883947 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f3b900c7e20 0x7f3b900c74c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:16:11.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.399+0000 7f3b95d0a640 1 --2- 10.20.193.49:0/310883947 >> v2:10.20.193.157:3300/0 conn(0x7f3b9015d370 0x7f3b9015d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:16:11.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.399+0000 7f3b95d0a640 1 -- 10.20.193.49:0/310883947 >> 10.20.193.49:0/310883947 conn(0x7f3b900c9f20 msgr2=0x7f3b900ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:16:11.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.399+0000 7f3b95d0a640 1 -- 10.20.193.49:0/310883947 shutdown_connections 2026-02-17T11:16:11.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.399+0000 7f3b95d0a640 1 -- 10.20.193.49:0/310883947 wait complete. 2026-02-17T11:16:11.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.399+0000 7f3b95d0a640 10 monclient: build_initial_monmap 2026-02-17T11:16:11.413 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.399+0000 7f3b95d0a640 10 monclient: monmap: 2026-02-17T11:16:11.413 INFO:teuthology.orchestra.run.trial049.stderr:epoch 0 2026-02-17T11:16:11.413 INFO:teuthology.orchestra.run.trial049.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T11:16:11.413 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 0.000000 2026-02-17T11:16:11.413 INFO:teuthology.orchestra.run.trial049.stderr:created 0.000000 2026-02-17T11:16:11.413 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 0 (unknown) 2026-02-17T11:16:11.413 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:16:11.414 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.noname-a 2026-02-17T11:16:11.414 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.noname-b 2026-02-17T11:16:11.414 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.noname-c 2026-02-17T11:16:11.414 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:16:11.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.399+0000 7f3b95d0a640 1 librados: starting msgr at 2026-02-17T11:16:11.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.399+0000 7f3b95d0a640 1 librados: starting objecter 2026-02-17T11:16:11.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.399+0000 7f3b95d0a640 1 Processor -- start 2026-02-17T11:16:11.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.400+0000 7f3b95d0a640 1 -- start start 2026-02-17T11:16:11.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.400+0000 7f3b95d0a640 1 librados: setting wanted keys 2026-02-17T11:16:11.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.400+0000 7f3b95d0a640 1 librados: calling monclient init 2026-02-17T11:16:11.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.400+0000 7f3b95d0a640 10 monclient: init 2026-02-17T11:16:11.414 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.400+0000 7f3b95d0a640 10 monclient: _reopen_session rank -1 2026-02-17T11:16:11.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.400+0000 7f3b95d0a640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T11:16:11.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.400+0000 7f3b95d0a640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f3b900c7e20 0x7f3b901586b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:16:11.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.400+0000 7f3b95d0a640 10 monclient(hunting): picked mon.noname-c con 0x7f3b900c7e20 addr [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-17T11:16:11.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.400+0000 7f3b95d0a640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f3b9015b000 0x7f3b9015a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:16:11.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.400+0000 7f3b95d0a640 10 monclient(hunting): picked mon.noname-a con 0x7f3b9015b000 addr [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] 2026-02-17T11:16:11.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.400+0000 7f3b95d0a640 1 --2- >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f3b9015d370 0x7f3b901f3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:16:11.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.400+0000 7f3b95d0a640 10 monclient(hunting): picked mon.noname-b con 0x7f3b9015d370 addr [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] 2026-02-17T11:16:11.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.400+0000 7f3b95d0a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:16:11.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.400+0000 7f3b95d0a640 1 -- --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_getmap magic: 0 -- 0x7f3b900c96d0 con 0x7f3b9015b000 2026-02-17T11:16:11.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.400+0000 7f3b95d0a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:16:11.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.400+0000 7f3b95d0a640 1 -- --> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] -- mon_getmap magic: 0 -- 0x7f3b900c8ed0 con 0x7f3b9015d370 2026-02-17T11:16:11.415 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.400+0000 7f3b95d0a640 10 monclient(hunting): start opening mon connection 2026-02-17T11:16:11.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.400+0000 7f3b95d0a640 1 -- --> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] -- mon_getmap magic: 0 -- 0x7f3b9014da50 con 0x7f3b900c7e20 2026-02-17T11:16:11.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.400+0000 7f3b95d0a640 10 monclient(hunting): _renew_subs 2026-02-17T11:16:11.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.400+0000 7f3b95d0a640 10 monclient(hunting): authenticate will time out at 1448.064449s 2026-02-17T11:16:11.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.400+0000 7f3b8effd640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f3b9015b000 0x7f3b9015a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:16:11.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.400+0000 7f3b8f7fe640 1 --2- >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f3b900c7e20 0x7f3b901586b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:16:11.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.400+0000 7f3b8effd640 1 --2- >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f3b9015b000 0x7f3b9015a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.49:3300/0 says I am v2:10.20.193.49:51800/0 (socket says 10.20.193.49:51800) 2026-02-17T11:16:11.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.400+0000 7f3b8effd640 1 -- 10.20.193.49:0/2968134677 learned_addr learned my addr 10.20.193.49:0/2968134677 (peer_addr_for_me v2:10.20.193.49:0/0) 2026-02-17T11:16:11.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.400+0000 7f3b8effd640 10 monclient(hunting): get_auth_request con 0x7f3b9015b000 auth_method 0 2026-02-17T11:16:11.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.400+0000 7f3b8effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:16:11.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.400+0000 7f3b8effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:16:11.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.400+0000 7f3b8effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:16:11.416 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.400+0000 7f3b8ffff640 1 --2- 10.20.193.49:0/2968134677 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f3b9015d370 0x7f3b901f3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:16:11.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.401+0000 7f3b8f7fe640 10 monclient(hunting): get_auth_request con 0x7f3b900c7e20 auth_method 0 2026-02-17T11:16:11.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.401+0000 7f3b8f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:16:11.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.401+0000 7f3b8f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:16:11.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.401+0000 7f3b8f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:16:11.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.401+0000 7f3b8effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:16:11.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.401+0000 7f3b8effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:16:11.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.401+0000 7f3b8effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:16:11.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.401+0000 7f3b8ffff640 10 monclient(hunting): get_auth_request con 0x7f3b9015d370 auth_method 0 2026-02-17T11:16:11.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.401+0000 7f3b8ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T11:16:11.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.401+0000 7f3b8ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T11:16:11.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.401+0000 7f3b8ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T11:16:11.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.401+0000 7f3b8f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:16:11.417 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.401+0000 7f3b8f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:16:11.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.401+0000 7f3b8f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:16:11.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.401+0000 7f3b8ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T11:16:11.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.401+0000 7f3b8ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T11:16:11.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.401+0000 7f3b8ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T11:16:11.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.402+0000 7f3b8effd640 10 monclient(hunting): handle_auth_done global_id 5349 payload 824 2026-02-17T11:16:11.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.402+0000 7f3b8effd640 1 -- 10.20.193.49:0/2968134677 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f3b900c7e20 msgr2=0x7f3b901586b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:16:11.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.402+0000 7f3b8effd640 1 --2- 10.20.193.49:0/2968134677 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f3b900c7e20 0x7f3b901586b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:16:11.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.402+0000 7f3b8effd640 1 -- 10.20.193.49:0/2968134677 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f3b9015d370 msgr2=0x7f3b901f3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:16:11.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.402+0000 7f3b8effd640 1 --2- 10.20.193.49:0/2968134677 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f3b9015d370 0x7f3b901f3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:16:11.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.402+0000 7f3b8effd640 10 monclient: _finish_hunting 0 2026-02-17T11:16:11.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.402+0000 7f3b8effd640 1 monclient: found mon.noname-a 2026-02-17T11:16:11.418 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.402+0000 7f3b8effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T11:16:11.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.402+0000 7f3b8effd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.49:3300/0 2026-02-17T11:16:11.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.402+0000 7f3b8effd640 1 -- 10.20.193.49:0/2968134677 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b9014a650 con 0x7f3b9015b000 2026-02-17T11:16:11.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.403+0000 7f3b8effd640 1 --2- 10.20.193.49:0/2968134677 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f3b9015b000 0x7f3b9015a130 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3b80009130 tx=0x7f3b800047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:16:11.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.403+0000 7f3b6bfff640 10 client.?.objecter ms_handle_connect 0x7f3b9015b000 2026-02-17T11:16:11.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.403+0000 7f3b6bfff640 10 client.?.objecter resend_mon_ops 2026-02-17T11:16:11.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.405+0000 7f3b6bfff640 1 -- 10.20.193.49:0/2968134677 <== mon.0 v2:10.20.193.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b8003c040 con 0x7f3b9015b000 2026-02-17T11:16:11.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.405+0000 7f3b6bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:16:11.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.405+0000 7f3b6bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T11:16:11.419 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.405+0000 7f3b6bfff640 10 monclient: dump: 2026-02-17T11:16:11.419 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:16:11.419 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:16:11.419 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:16:11.420 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:16:11.420 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:16:11.420 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:16:11.420 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:16:11.420 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:16:11.420 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:16:11.420 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:16:11.420 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.405+0000 7f3b6bfff640 10 monclient: _finish_auth 0 2026-02-17T11:16:11.420 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.405+0000 7f3b6bfff640 10 monclient: _check_auth_tickets 2026-02-17T11:16:11.420 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.405+0000 7f3b6bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T11:16:11.420 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.405+0000 7f3b6bfff640 1 -- 10.20.193.49:0/2968134677 <== mon.0 v2:10.20.193.49:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b80042610 con 0x7f3b9015b000 2026-02-17T11:16:11.420 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.405+0000 7f3b95d0a640 5 monclient: authenticate success, global_id 5349 2026-02-17T11:16:11.420 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.405+0000 7f3b95d0a640 10 monclient: _renew_subs 2026-02-17T11:16:11.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.405+0000 7f3b95d0a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:16:11.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.405+0000 7f3b95d0a640 1 -- 10.20.193.49:0/2968134677 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b901f4630 con 0x7f3b9015b000 2026-02-17T11:16:11.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.405+0000 7f3b6bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T11:16:11.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.405+0000 7f3b6bfff640 1 -- 10.20.193.49:0/2968134677 <== mon.0 v2:10.20.193.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b800429e0 con 0x7f3b9015b000 2026-02-17T11:16:11.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.405+0000 7f3b6bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T11:16:11.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.405+0000 7f3b6bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T11:16:11.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.405+0000 7f3b8dffb640 4 set_mon_vals no callback set 2026-02-17T11:16:11.421 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.405+0000 7f3b6bfff640 10 monclient: dump: 2026-02-17T11:16:11.421 INFO:teuthology.orchestra.run.trial049.stderr:epoch 1 2026-02-17T11:16:11.421 INFO:teuthology.orchestra.run.trial049.stderr:fsid 2799a57b-9ea3-46ae-8e91-1fe004a3651d 2026-02-17T11:16:11.421 INFO:teuthology.orchestra.run.trial049.stderr:last_changed 2026-02-17T11:06:52.787816+0000 2026-02-17T11:16:11.421 INFO:teuthology.orchestra.run.trial049.stderr:created 2026-02-17T11:06:52.787816+0000 2026-02-17T11:16:11.421 INFO:teuthology.orchestra.run.trial049.stderr:min_mon_release 19 (squid) 2026-02-17T11:16:11.422 INFO:teuthology.orchestra.run.trial049.stderr:election_strategy: 1 2026-02-17T11:16:11.422 INFO:teuthology.orchestra.run.trial049.stderr:0: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.a 2026-02-17T11:16:11.422 INFO:teuthology.orchestra.run.trial049.stderr:1: [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] mon.b 2026-02-17T11:16:11.422 INFO:teuthology.orchestra.run.trial049.stderr:2: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-17T11:16:11.422 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:16:11.422 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.405+0000 7f3b95d0a640 10 client.5349.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T11:16:11.422 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.405+0000 7f3b95d0a640 10 monclient: _renew_subs 2026-02-17T11:16:11.422 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.405+0000 7f3b95d0a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:16:11.422 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.405+0000 7f3b95d0a640 1 -- 10.20.193.49:0/2968134677 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b90157bd0 con 0x7f3b9015b000 2026-02-17T11:16:11.422 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.405+0000 7f3b95d0a640 1 librados: init done 2026-02-17T11:16:11.422 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.405+0000 7f3b95d0a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T11:16:11.422 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.405+0000 7f3b95d0a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:16:11.423 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.405+0000 7f3b95d0a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:16:11.423 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.405+0000 7f3b95d0a640 1 -- 10.20.193.49:0/2968134677 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b9015bc50 con 0x7f3b9015b000 2026-02-17T11:16:11.424 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.416+0000 7f3b6bfff640 1 -- 10.20.193.49:0/2968134677 <== mon.0 v2:10.20.193.49:3300/0 4 ==== mgrmap(e 5) ==== 100057+0+0 (secure 0 0 0) 0x7f3b8004b450 con 0x7f3b9015b000 2026-02-17T11:16:11.424 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.417+0000 7f3b6bfff640 1 --2- 10.20.193.49:0/2968134677 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3b600791c0 0x7f3b6007b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T11:16:11.424 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.417+0000 7f3b8f7fe640 1 --2- 10.20.193.49:0/2968134677 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3b600791c0 0x7f3b6007b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T11:16:11.424 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.417+0000 7f3b8f7fe640 10 monclient: get_auth_request con 0x7f3b600791c0 auth_method 0 2026-02-17T11:16:11.424 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.418+0000 7f3b8f7fe640 1 --2- 10.20.193.49:0/2968134677 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3b600791c0 0x7f3b6007b680 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c006fd0 tx=0x7f3b7c009340 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T11:16:11.424 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.418+0000 7f3b6bfff640 10 client.5349.objecter ms_handle_connect 0x7f3b600791c0 2026-02-17T11:16:11.425 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.419+0000 7f3b6bfff640 1 -- 10.20.193.49:0/2968134677 <== mon.0 v2:10.20.193.49:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 8944+0+0 (secure 0 0 0) 0x7f3b8002fa70 con 0x7f3b9015b000 2026-02-17T11:16:11.425 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.419+0000 7f3b6bfff640 10 client.5349.objecter ms_dispatch2 0x7f3b90000b90 osd_map(34..34 src has 1..34) 2026-02-17T11:16:11.425 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.419+0000 7f3b6bfff640 3 client.5349.objecter handle_osd_map got epochs [34,34] > 0 2026-02-17T11:16:11.425 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.419+0000 7f3b6bfff640 3 client.5349.objecter handle_osd_map decoding full epoch 34 2026-02-17T11:16:11.425 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.419+0000 7f3b6bfff640 20 client.5349.objecter dump_active .. 0 homeless 2026-02-17T11:16:11.524 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.522+0000 7f3b6bfff640 1 -- 10.20.193.49:0/2968134677 <== mon.0 v2:10.20.193.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f3b80086aa0 con 0x7f3b9015b000 2026-02-17T11:16:11.524 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.522+0000 7f3b6bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T11:16:11.524 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.522+0000 7f3b6bfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T11:16:11.610 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.607+0000 7f3b95d0a640 10 start_mon_command cmd=[{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-17T11:16:11.610 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.607+0000 7f3b95d0a640 10 monclient: _send_command 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-17T11:16:11.611 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.607+0000 7f3b95d0a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.49:3300/0 2026-02-17T11:16:11.611 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.607+0000 7f3b95d0a640 1 -- 10.20.193.49:0/2968134677 --> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f3b9014dc20 con 0x7f3b9015b000 2026-02-17T11:16:11.656 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.654+0000 7f3b6bfff640 1 -- 10.20.193.49:0/2968134677 <== mon.0 v2:10.20.193.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v9)=0 v9) ==== 123+0+0 (secure 0 0 0) 0x7f3b8008ada0 con 0x7f3b9015b000 2026-02-17T11:16:11.657 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.654+0000 7f3b6bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-17T11:16:11.657 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.654+0000 7f3b6bfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T11:16:11.659 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.656+0000 7f3b95d0a640 10 librados: watch_flush enter 2026-02-17T11:16:11.660 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.656+0000 7f3b95d0a640 10 librados: watch_flush exit 2026-02-17T11:16:11.660 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.656+0000 7f3b95d0a640 20 client.5349.objecter shutdown clearing up homeless session... 2026-02-17T11:16:11.660 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.656+0000 7f3b95d0a640 10 client.5349.objecter successfully canceled tick 2026-02-17T11:16:11.660 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.656+0000 7f3b95d0a640 1 -- 10.20.193.49:0/2968134677 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3b600791c0 msgr2=0x7f3b6007b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:16:11.660 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.656+0000 7f3b95d0a640 1 --2- 10.20.193.49:0/2968134677 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3b600791c0 0x7f3b6007b680 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c006fd0 tx=0x7f3b7c009340 comp rx=0 tx=0).stop 2026-02-17T11:16:11.660 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.656+0000 7f3b95d0a640 10 monclient: shutdown 2026-02-17T11:16:11.660 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.656+0000 7f3b95d0a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T11:16:11.660 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.656+0000 7f3b95d0a640 1 -- 10.20.193.49:0/2968134677 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f3b9015b000 msgr2=0x7f3b9015a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T11:16:11.660 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.656+0000 7f3b95d0a640 1 --2- 10.20.193.49:0/2968134677 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f3b9015b000 0x7f3b9015a130 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3b80009130 tx=0x7f3b800047c0 comp rx=0 tx=0).stop 2026-02-17T11:16:11.660 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.656+0000 7f3b95d0a640 1 -- 10.20.193.49:0/2968134677 shutdown_connections 2026-02-17T11:16:11.661 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.656+0000 7f3b95d0a640 1 --2- 10.20.193.49:0/2968134677 >> [v2:10.20.193.162:6800/2614632098,v1:10.20.193.162:6801/2614632098] conn(0x7f3b600791c0 0x7f3b6007b680 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:16:11.661 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.656+0000 7f3b95d0a640 1 --2- 10.20.193.49:0/2968134677 >> [v2:10.20.193.97:3300/0,v1:10.20.193.97:6789/0] conn(0x7f3b9015d370 0x7f3b901f3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:16:11.661 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.656+0000 7f3b95d0a640 1 --2- 10.20.193.49:0/2968134677 >> [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] conn(0x7f3b9015b000 0x7f3b9015a130 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:16:11.661 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.656+0000 7f3b95d0a640 1 --2- 10.20.193.49:0/2968134677 >> [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] conn(0x7f3b900c7e20 0x7f3b901586b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T11:16:11.661 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.656+0000 7f3b95d0a640 1 -- 10.20.193.49:0/2968134677 >> 10.20.193.49:0/2968134677 conn(0x7f3b900c9f20 msgr2=0x7f3b90150f10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T11:16:11.661 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.656+0000 7f3b95d0a640 1 -- 10.20.193.49:0/2968134677 shutdown_connections 2026-02-17T11:16:11.661 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.656+0000 7f3b95d0a640 1 -- 10.20.193.49:0/2968134677 wait complete. 2026-02-17T11:16:11.661 INFO:teuthology.orchestra.run.trial049.stderr:2026-02-17T11:16:11.656+0000 7f3b95d0a640 1 librados: shutdown 2026-02-17T11:16:11.668 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/ceph.py", line 1922, in task healthy(ctx=ctx, config=dict(cluster=config['cluster'])) File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/ceph.py", line 1484, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/ceph_manager.py", line 3303, in wait_until_healthy assert time.time() - start < timeout, \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: timeout expired in wait_until_healthy 2026-02-17T11:16:11.672 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-17T11:16:11.672 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-17T11:16:11.672 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-17T11:16:11.673 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T11:16:11.680 INFO:tasks.ceph.osd.0.trial049.stderr:2026-02-17T11:16:11.672+0000 c69b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 0 (PID: 45309) UID: 0 2026-02-17T11:16:11.680 INFO:tasks.ceph.osd.0.trial049.stderr:2026-02-17T11:16:11.673+0000 c69b640 -1 osd.0 34 *** Got signal Terminated *** 2026-02-17T11:16:12.214 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:07:57.695 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:16:12.216 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:07:57.697 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:16:12.223 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:07:57.705 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:16:12.242 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:07:57.717 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:16:12.243 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:07:57.685 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:16:12.243 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:07:57.718 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:16:12.246 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:07:57.688 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:16:12.251 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:07:57.726 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:16:12.253 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:07:57.695 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:16:17.513 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2026-02-17T11:16:17.774 INFO:tasks.ceph.osd.0:Stopped 2026-02-17T11:16:17.775 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2026-02-17T11:16:17.775 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T11:16:17.781 INFO:tasks.ceph.osd.4.trial049.stderr:2026-02-17T11:16:17.776+0000 c69b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.4.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 4 (PID: 45313) UID: 0 2026-02-17T11:16:17.781 INFO:tasks.ceph.osd.4.trial049.stderr:2026-02-17T11:16:17.776+0000 c69b640 -1 osd.4 36 *** Got signal Terminated *** 2026-02-17T11:16:23.876 INFO:tasks.ceph.osd.4:Stopped 2026-02-17T11:16:23.877 DEBUG:tasks.ceph.osd.8:waiting for process to exit 2026-02-17T11:16:23.877 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T11:16:23.884 INFO:tasks.ceph.osd.8.trial049.stderr:2026-02-17T11:16:23.878+0000 c69b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.8.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 8 (PID: 45316) UID: 0 2026-02-17T11:16:23.884 INFO:tasks.ceph.osd.8.trial049.stderr:2026-02-17T11:16:23.879+0000 c69b640 -1 osd.8 38 *** Got signal Terminated *** 2026-02-17T11:16:24.428 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2026-02-17T11:16:24.428 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2026-02-17T11:16:29.979 INFO:tasks.ceph.osd.8:Stopped 2026-02-17T11:16:29.979 DEBUG:tasks.ceph.osd.12:waiting for process to exit 2026-02-17T11:16:29.980 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T11:16:29.989 INFO:tasks.ceph.osd.12.trial049.stderr:2026-02-17T11:16:29.983+0000 c69b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.12.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 12 (PID: 45318) UID: 0 2026-02-17T11:16:29.990 INFO:tasks.ceph.osd.12.trial049.stderr:2026-02-17T11:16:29.984+0000 c69b640 -1 osd.12 40 *** Got signal Terminated *** 2026-02-17T11:16:31.243 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.8 is failed for ~0s 2026-02-17T11:16:31.243 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2026-02-17T11:16:31.519 INFO:tasks.ceph.osd.12.trial049.stderr:2026-02-17T11:16:31.517+0000 ae98640 -1 monclient: get_auth_request but no auth handler is set up 2026-02-17T11:16:32.239 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:08:17.720 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:16:32.242 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:08:17.723 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:16:32.256 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:08:17.738 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:16:32.267 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:08:17.709 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:16:32.269 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:08:17.745 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:16:32.271 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:08:17.746 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:16:32.272 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:08:17.713 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:16:32.283 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:08:17.758 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:16:32.284 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:08:17.726 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:16:36.081 INFO:tasks.ceph.osd.12:Stopped 2026-02-17T11:16:36.081 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-17T11:16:36.081 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T11:16:36.088 INFO:tasks.ceph.osd.1.trial097.stderr:2026-02-17T11:16:36.081+0000 c69b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.1.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 1 (PID: 44842) UID: 0 2026-02-17T11:16:36.088 INFO:tasks.ceph.osd.1.trial097.stderr:2026-02-17T11:16:36.082+0000 c69b640 -1 osd.1 42 *** Got signal Terminated *** 2026-02-17T11:16:37.956 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.8 has been restored 2026-02-17T11:16:42.183 INFO:tasks.ceph.osd.1:Stopped 2026-02-17T11:16:42.184 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2026-02-17T11:16:42.184 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T11:16:42.191 INFO:tasks.ceph.osd.5.trial097.stderr:2026-02-17T11:16:42.184+0000 c69b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.5.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 5 (PID: 44846) UID: 0 2026-02-17T11:16:42.191 INFO:tasks.ceph.osd.5.trial097.stderr:2026-02-17T11:16:42.185+0000 c69b640 -1 osd.5 43 *** Got signal Terminated *** 2026-02-17T11:16:48.285 INFO:tasks.ceph.osd.5:Stopped 2026-02-17T11:16:48.285 DEBUG:tasks.ceph.osd.9:waiting for process to exit 2026-02-17T11:16:48.286 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T11:16:48.295 INFO:tasks.ceph.osd.9.trial097.stderr:2026-02-17T11:16:48.288+0000 c69b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.9.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 9 (PID: 44848) UID: 0 2026-02-17T11:16:48.295 INFO:tasks.ceph.osd.9.trial097.stderr:2026-02-17T11:16:48.288+0000 c69b640 -1 osd.9 45 *** Got signal Terminated *** 2026-02-17T11:16:52.265 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:08:37.747 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:16:52.291 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:08:37.772 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:16:52.292 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:08:37.767 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:16:52.294 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:08:37.769 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:16:52.301 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:08:37.783 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:16:52.304 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:08:37.779 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:16:52.320 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:08:37.762 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:16:52.321 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:08:37.763 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:16:52.331 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:08:37.773 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:16:54.387 INFO:tasks.ceph.osd.9:Stopped 2026-02-17T11:16:54.387 DEBUG:tasks.ceph.osd.13:waiting for process to exit 2026-02-17T11:16:54.387 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T11:16:54.395 INFO:tasks.ceph.osd.13.trial097.stderr:2026-02-17T11:16:54.388+0000 c69b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.13.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 13 (PID: 44877) UID: 0 2026-02-17T11:16:54.395 INFO:tasks.ceph.osd.13.trial097.stderr:2026-02-17T11:16:54.389+0000 c69b640 -1 osd.13 46 *** Got signal Terminated *** 2026-02-17T11:16:57.385 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.13 is failed for ~0s 2026-02-17T11:17:00.489 INFO:tasks.ceph.osd.13:Stopped 2026-02-17T11:17:00.490 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-17T11:17:00.490 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T11:17:00.498 INFO:tasks.ceph.osd.2.trial157.stderr:2026-02-17T11:17:00.490+0000 c69b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.2.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 2 (PID: 44295) UID: 0 2026-02-17T11:17:00.498 INFO:tasks.ceph.osd.2.trial157.stderr:2026-02-17T11:17:00.491+0000 c69b640 -1 osd.2 47 *** Got signal Terminated *** 2026-02-17T11:17:03.595 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2026-02-17T11:17:03.595 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.13 has been restored 2026-02-17T11:17:06.592 INFO:tasks.ceph.osd.2:Stopped 2026-02-17T11:17:06.592 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2026-02-17T11:17:06.592 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T11:17:06.600 INFO:tasks.ceph.osd.6.trial157.stderr:2026-02-17T11:17:06.593+0000 c69b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.6.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 6 (PID: 44297) UID: 0 2026-02-17T11:17:06.600 INFO:tasks.ceph.osd.6.trial157.stderr:2026-02-17T11:17:06.593+0000 c69b640 -1 osd.6 48 *** Got signal Terminated *** 2026-02-17T11:17:07.557 INFO:tasks.ceph.osd.6.trial157.stderr:2026-02-17T11:17:07.554+0000 a697640 -1 monclient: get_auth_request but no auth handler is set up 2026-02-17T11:17:09.703 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2026-02-17T11:17:09.704 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2026-02-17T11:17:12.319 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:08:57.800 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:17:12.321 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:08:57.802 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:17:12.330 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:08:57.811 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:17:12.346 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:08:57.821 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:17:12.346 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:08:57.822 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:17:12.348 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:08:57.790 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:17:12.349 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:08:57.791 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:17:12.355 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:08:57.831 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:17:12.358 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:08:57.800 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:17:12.694 INFO:tasks.ceph.osd.6:Stopped 2026-02-17T11:17:12.694 DEBUG:tasks.ceph.osd.10:waiting for process to exit 2026-02-17T11:17:12.695 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T11:17:12.702 INFO:tasks.ceph.osd.10.trial157.stderr:2026-02-17T11:17:12.695+0000 c69b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.10.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 10 (PID: 44301) UID: 0 2026-02-17T11:17:12.702 INFO:tasks.ceph.osd.10.trial157.stderr:2026-02-17T11:17:12.696+0000 c69b640 -1 osd.10 49 *** Got signal Terminated *** 2026-02-17T11:17:15.712 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.10 is failed for ~0s 2026-02-17T11:17:15.713 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2026-02-17T11:17:18.796 INFO:tasks.ceph.osd.10:Stopped 2026-02-17T11:17:18.796 DEBUG:tasks.ceph.osd.14:waiting for process to exit 2026-02-17T11:17:18.796 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T11:17:18.800 INFO:tasks.ceph.osd.14.trial157.stderr:2026-02-17T11:17:18.797+0000 c69b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.14.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 14 (PID: 44302) UID: 0 2026-02-17T11:17:18.804 INFO:tasks.ceph.osd.14.trial157.stderr:2026-02-17T11:17:18.798+0000 c69b640 -1 osd.14 51 *** Got signal Terminated *** 2026-02-17T11:17:21.624 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.14 is failed for ~0s 2026-02-17T11:17:21.624 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.10 has been restored 2026-02-17T11:17:24.898 INFO:tasks.ceph.osd.14:Stopped 2026-02-17T11:17:24.899 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-17T11:17:24.899 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T11:17:24.976 INFO:tasks.ceph.osd.3.trial162.stderr:2026-02-17T11:17:24.970+0000 c69b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.3.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 3 (PID: 44720) UID: 0 2026-02-17T11:17:24.977 INFO:tasks.ceph.osd.3.trial162.stderr:2026-02-17T11:17:24.970+0000 c69b640 -1 osd.3 53 *** Got signal Terminated *** 2026-02-17T11:17:27.431 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2026-02-17T11:17:27.431 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.14 has been restored 2026-02-17T11:17:31.001 INFO:tasks.ceph.osd.3:Stopped 2026-02-17T11:17:31.001 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2026-02-17T11:17:31.001 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T11:17:31.009 INFO:tasks.ceph.osd.7.trial162.stderr:2026-02-17T11:17:31.002+0000 c69b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.7.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 7 (PID: 44723) UID: 0 2026-02-17T11:17:31.009 INFO:tasks.ceph.osd.7.trial162.stderr:2026-02-17T11:17:31.003+0000 c69b640 -1 osd.7 53 *** Got signal Terminated *** 2026-02-17T11:17:32.326 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:09:17.807 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:17:32.351 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:09:17.826 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:17:32.352 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:09:17.833 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:17:32.353 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:09:17.829 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:17:32.362 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:09:17.843 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:17:32.363 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:09:17.839 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:17:32.378 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:09:17.820 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:17:32.387 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:09:17.829 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:17:32.399 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:09:17.841 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:17:33.238 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2026-02-17T11:17:38.944 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2026-02-17T11:17:43.204 INFO:tasks.ceph.osd.7:Stopped 2026-02-17T11:17:43.205 DEBUG:tasks.ceph.osd.11:waiting for process to exit 2026-02-17T11:17:43.205 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T11:17:43.212 INFO:tasks.ceph.osd.11.trial162.stderr:2026-02-17T11:17:43.207+0000 c69b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.11.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 11 (PID: 44725) UID: 0 2026-02-17T11:17:43.212 INFO:tasks.ceph.osd.11.trial162.stderr:2026-02-17T11:17:43.207+0000 c69b640 -1 osd.11 53 *** Got signal Terminated *** 2026-02-17T11:17:44.650 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2026-02-17T11:17:49.306 INFO:tasks.ceph.osd.11:Stopped 2026-02-17T11:17:49.307 DEBUG:tasks.ceph.osd.15:waiting for process to exit 2026-02-17T11:17:49.307 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T11:17:49.314 INFO:tasks.ceph.osd.15.trial162.stderr:2026-02-17T11:17:49.309+0000 c69b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.15.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 15 (PID: 44728) UID: 0 2026-02-17T11:17:49.316 INFO:tasks.ceph.osd.15.trial162.stderr:2026-02-17T11:17:49.309+0000 c69b640 -1 osd.15 53 *** Got signal Terminated *** 2026-02-17T11:17:52.379 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:09:37.861 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:17:52.381 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:09:37.862 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:17:52.389 INFO:tasks.ceph.mon.a.trial049.stderr:==00:00:09:37.871 44972== Warning: unimplemented fcntl command: 1036 2026-02-17T11:17:52.407 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:09:37.882 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:17:52.408 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:09:37.850 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:17:52.411 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:09:37.853 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:17:52.415 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:09:37.891 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:17:52.420 INFO:tasks.ceph.mon.c.trial157.stderr:==00:00:09:37.862 44061== Warning: unimplemented fcntl command: 1036 2026-02-17T11:17:52.426 INFO:tasks.ceph.mon.b.trial097.stderr:==00:00:09:37.901 44633== Warning: unimplemented fcntl command: 1036 2026-02-17T11:17:55.409 INFO:tasks.ceph.osd.15:Stopped 2026-02-17T11:17:55.409 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-17T11:17:55.409 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2026-02-17T11:17:55.409 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T11:17:55.440 INFO:tasks.ceph.mgr.y:Stopped 2026-02-17T11:17:55.440 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-17T11:17:55.441 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T11:17:55.441 INFO:tasks.ceph.mgr.x.trial162.stderr:2026-02-17T11:17:55.439+0000 7efc3b0a2640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-mgr -f --cluster ceph -i x (PID: 43659) UID: 0 2026-02-17T11:17:55.441 INFO:tasks.ceph.mgr.x.trial162.stderr:2026-02-17T11:17:55.439+0000 7efc3b0a2640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2026-02-17T11:17:55.474 INFO:tasks.ceph.mgr.x:Stopped 2026-02-17T11:17:55.474 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-17T11:17:55.474 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-17T11:17:55.474 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T11:17:55.488 INFO:tasks.ceph.mon.a.trial049.stderr:2026-02-17T11:17:55.481+0000 aca4640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a (PID: 44970) UID: 0 2026-02-17T11:17:55.488 INFO:tasks.ceph.mon.a.trial049.stderr:2026-02-17T11:17:55.482+0000 aca4640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2026-02-17T11:17:55.557 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.15 is failed for ~0s 2026-02-17T11:18:00.760 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2026-02-17T11:18:00.760 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.15 has been restored 2026-02-17T11:18:01.576 INFO:tasks.ceph.mon.a:Stopped 2026-02-17T11:18:01.576 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-17T11:18:01.577 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T11:18:01.584 INFO:tasks.ceph.mon.b.trial097.stderr:2026-02-17T11:18:01.576+0000 aca4640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b (PID: 44631) UID: 0 2026-02-17T11:18:01.585 INFO:tasks.ceph.mon.b.trial097.stderr:2026-02-17T11:18:01.577+0000 aca4640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2026-02-17T11:18:05.862 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2026-02-17T11:18:05.862 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2026-02-17T11:18:07.678 INFO:tasks.ceph.mon.b:Stopped 2026-02-17T11:18:07.678 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-17T11:18:07.678 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T11:18:07.686 INFO:tasks.ceph.mon.c.trial157.stderr:2026-02-17T11:18:07.680+0000 aca4640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c (PID: 44059) UID: 0 2026-02-17T11:18:07.687 INFO:tasks.ceph.mon.c.trial157.stderr:2026-02-17T11:18:07.680+0000 aca4640 -1 mon.c@2(probing) e1 *** Got Signal Terminated *** 2026-02-17T11:18:10.863 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2026-02-17T11:18:10.863 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2026-02-17T11:18:13.780 INFO:tasks.ceph.mon.c:Stopped 2026-02-17T11:18:13.780 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-17T11:18:13.780 DEBUG:teuthology.orchestra.run.trial049:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'reached quota' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(OBJECT_MISPLACED\)' | egrep -v 'slow request' | egrep -v 'overall HEALTH_' | egrep -v '\(PG_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'slow request' | egrep -v 'OSD bench result' | head -n 1 2026-02-17T11:18:13.809 INFO:teuthology.orchestra.run.trial049.stdout:2026-02-17T11:10:21.169138+0000 mon.a (mon.0) 171 : cluster [WRN] Health check failed: 6 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2026-02-17T11:18:13.809 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2026-02-17T11:18:13.809 DEBUG:teuthology.orchestra.run.trial049:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'reached quota' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(OBJECT_MISPLACED\)' | egrep -v 'slow request' | egrep -v 'overall HEALTH_' | egrep -v '\(PG_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'slow request' | egrep -v 'OSD bench result' | head -n 1 2026-02-17T11:18:13.875 DEBUG:teuthology.orchestra.run.trial049:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'reached quota' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(OBJECT_MISPLACED\)' | egrep -v 'slow request' | egrep -v 'overall HEALTH_' | egrep -v '\(PG_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'slow request' | egrep -v 'OSD bench result' | head -n 1 2026-02-17T11:18:13.941 DEBUG:teuthology.orchestra.run.trial049:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'reached quota' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(OBJECT_MISPLACED\)' | egrep -v 'slow request' | egrep -v 'overall HEALTH_' | egrep -v '\(PG_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'slow request' | egrep -v 'OSD bench result' | head -n 1 2026-02-17T11:18:14.007 INFO:teuthology.orchestra.run.trial049.stdout:2026-02-17T11:10:21.169138+0000 mon.a (mon.0) 171 : cluster [WRN] Health check failed: 6 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2026-02-17T11:18:14.007 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial049.front.sepia.ceph.com 2026-02-17T11:18:14.007 DEBUG:teuthology.orchestra.run.trial049:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-17T11:18:14.081 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@trial049.front.sepia.ceph.com 2026-02-17T11:18:14.081 DEBUG:teuthology.orchestra.run.trial049:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2026-02-17T11:18:14.162 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-8 on ubuntu@trial049.front.sepia.ceph.com 2026-02-17T11:18:14.162 DEBUG:teuthology.orchestra.run.trial049:> sync && sudo umount -f /var/lib/ceph/osd/ceph-8 2026-02-17T11:18:14.230 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-12 on ubuntu@trial049.front.sepia.ceph.com 2026-02-17T11:18:14.230 DEBUG:teuthology.orchestra.run.trial049:> sync && sudo umount -f /var/lib/ceph/osd/ceph-12 2026-02-17T11:18:14.301 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial097.front.sepia.ceph.com 2026-02-17T11:18:14.301 DEBUG:teuthology.orchestra.run.trial097:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-17T11:18:14.338 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@trial097.front.sepia.ceph.com 2026-02-17T11:18:14.339 DEBUG:teuthology.orchestra.run.trial097:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2026-02-17T11:18:14.414 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-9 on ubuntu@trial097.front.sepia.ceph.com 2026-02-17T11:18:14.415 DEBUG:teuthology.orchestra.run.trial097:> sync && sudo umount -f /var/lib/ceph/osd/ceph-9 2026-02-17T11:18:14.482 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-13 on ubuntu@trial097.front.sepia.ceph.com 2026-02-17T11:18:14.483 DEBUG:teuthology.orchestra.run.trial097:> sync && sudo umount -f /var/lib/ceph/osd/ceph-13 2026-02-17T11:18:14.550 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial157.front.sepia.ceph.com 2026-02-17T11:18:14.550 DEBUG:teuthology.orchestra.run.trial157:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-17T11:18:14.584 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@trial157.front.sepia.ceph.com 2026-02-17T11:18:14.584 DEBUG:teuthology.orchestra.run.trial157:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2026-02-17T11:18:14.653 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-10 on ubuntu@trial157.front.sepia.ceph.com 2026-02-17T11:18:14.654 DEBUG:teuthology.orchestra.run.trial157:> sync && sudo umount -f /var/lib/ceph/osd/ceph-10 2026-02-17T11:18:14.723 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-14 on ubuntu@trial157.front.sepia.ceph.com 2026-02-17T11:18:14.723 DEBUG:teuthology.orchestra.run.trial157:> sync && sudo umount -f /var/lib/ceph/osd/ceph-14 2026-02-17T11:18:14.797 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@trial162.front.sepia.ceph.com 2026-02-17T11:18:14.797 DEBUG:teuthology.orchestra.run.trial162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2026-02-17T11:18:14.833 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@trial162.front.sepia.ceph.com 2026-02-17T11:18:14.834 DEBUG:teuthology.orchestra.run.trial162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2026-02-17T11:18:14.909 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-11 on ubuntu@trial162.front.sepia.ceph.com 2026-02-17T11:18:14.909 DEBUG:teuthology.orchestra.run.trial162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-11 2026-02-17T11:18:14.979 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-15 on ubuntu@trial162.front.sepia.ceph.com 2026-02-17T11:18:14.979 DEBUG:teuthology.orchestra.run.trial162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-15 2026-02-17T11:18:15.048 INFO:tasks.ceph:Archiving mon data... 2026-02-17T11:18:15.050 DEBUG:teuthology.misc:Transferring archived files from trial049:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51248/data/mon.a.tgz 2026-02-17T11:18:15.051 DEBUG:teuthology.orchestra.run.trial049:> mktemp 2026-02-17T11:18:15.068 INFO:teuthology.orchestra.run.trial049.stdout:/tmp/tmp.tzzX8QM9vN 2026-02-17T11:18:15.068 DEBUG:teuthology.orchestra.run.trial049:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.tzzX8QM9vN 2026-02-17T11:18:15.178 DEBUG:teuthology.orchestra.run.trial049:> sudo chmod 0666 /tmp/tmp.tzzX8QM9vN 2026-02-17T11:18:15.260 DEBUG:teuthology.orchestra.remote:trial049:/tmp/tmp.tzzX8QM9vN is 414KB 2026-02-17T11:18:15.367 DEBUG:teuthology.orchestra.run.trial049:> rm -fr /tmp/tmp.tzzX8QM9vN 2026-02-17T11:18:15.388 DEBUG:teuthology.misc:Transferring archived files from trial097:/var/lib/ceph/mon/ceph-b to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51248/data/mon.b.tgz 2026-02-17T11:18:15.388 DEBUG:teuthology.orchestra.run.trial097:> mktemp 2026-02-17T11:18:15.409 INFO:teuthology.orchestra.run.trial097.stdout:/tmp/tmp.zdBabaddRu 2026-02-17T11:18:15.409 DEBUG:teuthology.orchestra.run.trial097:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.zdBabaddRu 2026-02-17T11:18:15.522 DEBUG:teuthology.orchestra.run.trial097:> sudo chmod 0666 /tmp/tmp.zdBabaddRu 2026-02-17T11:18:15.603 DEBUG:teuthology.orchestra.remote:trial097:/tmp/tmp.zdBabaddRu is 415KB 2026-02-17T11:18:15.695 DEBUG:teuthology.orchestra.run.trial097:> rm -fr /tmp/tmp.zdBabaddRu 2026-02-17T11:18:15.712 DEBUG:teuthology.misc:Transferring archived files from trial157:/var/lib/ceph/mon/ceph-c to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51248/data/mon.c.tgz 2026-02-17T11:18:15.712 DEBUG:teuthology.orchestra.run.trial157:> mktemp 2026-02-17T11:18:15.731 INFO:teuthology.orchestra.run.trial157.stdout:/tmp/tmp.6whLNCW9fO 2026-02-17T11:18:15.732 DEBUG:teuthology.orchestra.run.trial157:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.6whLNCW9fO 2026-02-17T11:18:15.842 DEBUG:teuthology.orchestra.run.trial157:> sudo chmod 0666 /tmp/tmp.6whLNCW9fO 2026-02-17T11:18:15.864 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2026-02-17T11:18:15.921 DEBUG:teuthology.orchestra.remote:trial157:/tmp/tmp.6whLNCW9fO is 415KB 2026-02-17T11:18:15.983 DEBUG:teuthology.orchestra.run.trial157:> rm -fr /tmp/tmp.6whLNCW9fO 2026-02-17T11:18:16.001 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-17T11:18:16.001 DEBUG:teuthology.orchestra.run.trial049:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-17T11:18:16.003 DEBUG:teuthology.orchestra.run.trial097:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-17T11:18:16.005 DEBUG:teuthology.orchestra.run.trial157:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-17T11:18:16.043 DEBUG:teuthology.orchestra.run.trial162:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-17T11:18:16.343 DEBUG:tasks.ceph:valgrind exception message: valgrind error: Leak_StillReachable malloc malloc _dl_new_object 2026-02-17T11:18:17.041 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-17T11:18:17.042 INFO:tasks.ceph:Archiving crash dumps... 2026-02-17T11:18:17.044 DEBUG:teuthology.misc:Transferring archived files from trial049:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51248/remote/trial049/crash 2026-02-17T11:18:17.045 DEBUG:teuthology.orchestra.run.trial049:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-17T11:18:17.072 DEBUG:teuthology.misc:Transferring archived files from trial097:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51248/remote/trial097/crash 2026-02-17T11:18:17.073 DEBUG:teuthology.orchestra.run.trial097:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-17T11:18:17.099 DEBUG:teuthology.misc:Transferring archived files from trial157:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51248/remote/trial157/crash 2026-02-17T11:18:17.100 DEBUG:teuthology.orchestra.run.trial157:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-17T11:18:17.126 DEBUG:teuthology.misc:Transferring archived files from trial162:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51248/remote/trial162/crash 2026-02-17T11:18:17.128 DEBUG:teuthology.orchestra.run.trial162:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-17T11:18:17.155 INFO:tasks.ceph:Compressing logs... 2026-02-17T11:18:17.156 DEBUG:teuthology.orchestra.run.trial049:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T11:18:17.159 DEBUG:teuthology.orchestra.run.trial097:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T11:18:17.161 DEBUG:teuthology.orchestra.run.trial157:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T11:18:17.171 DEBUG:teuthology.orchestra.run.trial162:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T11:18:17.181 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50638.log 2026-02-17T11:18:17.181 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50722.log 2026-02-17T11:18:17.181 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.50638.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-17T11:18:17.181 INFO:teuthology.orchestra.run.trial049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50638.log.gz 2026-02-17T11:18:17.181 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57160.log 2026-02-17T11:18:17.182 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.50722.log: /var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58337.log 2026-02-17T11:18:17.182 INFO:teuthology.orchestra.run.trial049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50722.log.gz 2026-02-17T11:18:17.182 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57406.log 2026-02-17T11:18:17.182 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.57160.log: /var/log/ceph/ceph-client.admin.58337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51452.log 2026-02-17T11:18:17.182 INFO:teuthology.orchestra.run.trial049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57160.log.gz 2026-02-17T11:18:17.182 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.57406.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.58337.log.gz 2026-02-17T11:18:17.183 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45574.log 2026-02-17T11:18:17.183 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.51452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49391.log 2026-02-17T11:18:17.183 INFO:teuthology.orchestra.run.trial049.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.57406.log.gz 2026-02-17T11:18:17.183 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.45574.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51452.log.gz 2026-02-17T11:18:17.183 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53874.log 2026-02-17T11:18:17.183 INFO:teuthology.orchestra.run.trial049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45574.log.gz 2026-02-17T11:18:17.183 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.49391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58141.log 2026-02-17T11:18:17.184 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.53874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52122.log 2026-02-17T11:18:17.184 INFO:teuthology.orchestra.run.trial049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49391.log.gz 2026-02-17T11:18:17.184 INFO:teuthology.orchestra.run.trial097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2026-02-17T11:18:17.184 INFO:teuthology.orchestra.run.trial097.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.5.log 2026-02-17T11:18:17.184 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.58141.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-17T11:18:17.184 INFO:teuthology.orchestra.run.trial049.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53874.log.gz 2026-02-17T11:18:17.184 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.52122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58778.log 2026-02-17T11:18:17.184 INFO:teuthology.orchestra.run.trial049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58141.log.gz 2026-02-17T11:18:17.184 INFO:teuthology.orchestra.run.trial049.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52122.log.gz 2026-02-17T11:18:17.185 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51756.log 2026-02-17T11:18:17.185 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.58778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50100.log 2026-02-17T11:18:17.185 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.51756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57602.log 2026-02-17T11:18:17.185 INFO:teuthology.orchestra.run.trial049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.58778.log.gz 2026-02-17T11:18:17.185 INFO:teuthology.orchestra.run.trial097.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.13.log 2026-02-17T11:18:17.186 INFO:teuthology.orchestra.run.trial097.stderr:/var/log/ceph/valgrind/osd.5.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.1.log 2026-02-17T11:18:17.186 INFO:teuthology.orchestra.run.trial097.stderr: 68.1% -- replaced with /var/log/ceph/valgrind/osd.5.log.gz 2026-02-17T11:18:17.186 INFO:teuthology.orchestra.run.trial097.stderr:/var/log/ceph/valgrind/osd.13.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.9.log 2026-02-17T11:18:17.186 INFO:teuthology.orchestra.run.trial097.stderr: 68.2% -- replaced with /var/log/ceph/valgrind/osd.13.log.gz 2026-02-17T11:18:17.186 INFO:teuthology.orchestra.run.trial097.stderr:/var/log/ceph/valgrind/osd.1.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.b.log 2026-02-17T11:18:17.186 INFO:teuthology.orchestra.run.trial097.stderr: 68.2% -- replaced with /var/log/ceph/valgrind/osd.1.log.gz 2026-02-17T11:18:17.186 INFO:teuthology.orchestra.run.trial097.stderr:/var/log/ceph/valgrind/osd.9.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-17T11:18:17.186 INFO:teuthology.orchestra.run.trial097.stderr: 67.9% -- replaced with /var/log/ceph/valgrind/osd.9.log.gz 2026-02-17T11:18:17.186 INFO:teuthology.orchestra.run.trial097.stderr:/var/log/ceph/valgrind/mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2026-02-17T11:18:17.187 INFO:teuthology.orchestra.run.trial097.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.13.log 2026-02-17T11:18:17.187 INFO:teuthology.orchestra.run.trial097.stderr:/var/log/ceph/ceph-mon.b.log: 94.2% -- replaced with /var/log/ceph/valgrind/mon.b.log.gz 2026-02-17T11:18:17.187 INFO:teuthology.orchestra.run.trial097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-17T11:18:17.187 INFO:teuthology.orchestra.run.trial097.stderr:/var/log/ceph/ceph-osd.13.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-17T11:18:17.187 INFO:teuthology.orchestra.run.trial097.stderr:/var/log/ceph/ceph-osd.1.log: 90.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-17T11:18:17.187 INFO:teuthology.orchestra.run.trial097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.9.log 2026-02-17T11:18:17.188 INFO:teuthology.orchestra.run.trial097.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-osd.9.log: 88.2% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-17T11:18:17.189 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.50100.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.51756.log.gz 2026-02-17T11:18:17.189 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49064.log 2026-02-17T11:18:17.189 INFO:teuthology.orchestra.run.trial049.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50100.log.gz 2026-02-17T11:18:17.189 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.57602.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2026-02-17T11:18:17.189 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56719.log 2026-02-17T11:18:17.189 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.49064.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57602.log.gz 2026-02-17T11:18:17.189 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56082.log 2026-02-17T11:18:17.189 INFO:teuthology.orchestra.run.trial049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49064.log.gz 2026-02-17T11:18:17.189 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.56719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52463.log 2026-02-17T11:18:17.189 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.56082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57749.log 2026-02-17T11:18:17.189 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.52463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57700.log 2026-02-17T11:18:17.189 INFO:teuthology.orchestra.run.trial049.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.56082.log.gz 2026-02-17T11:18:17.189 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.57749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54660.log 2026-02-17T11:18:17.189 INFO:teuthology.orchestra.run.trial049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52463.log.gz 2026-02-17T11:18:17.189 INFO:teuthology.orchestra.run.trial049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56719.log.gz 2026-02-17T11:18:17.189 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.57700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50728.log 2026-02-17T11:18:17.189 INFO:teuthology.orchestra.run.trial049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57749.log.gz 2026-02-17T11:18:17.189 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.54660.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.57700.log.gz 2026-02-17T11:18:17.189 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59170.log 2026-02-17T11:18:17.189 INFO:teuthology.orchestra.run.trial049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54660.log.gz 2026-02-17T11:18:17.189 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.50728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56229.log 2026-02-17T11:18:17.189 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.59170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57504.log 2026-02-17T11:18:17.189 INFO:teuthology.orchestra.run.trial049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50728.log.gz 2026-02-17T11:18:17.189 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.56229.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.59170.log.gz 2026-02-17T11:18:17.189 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50829.log 2026-02-17T11:18:17.190 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.57504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58484.log 2026-02-17T11:18:17.190 INFO:teuthology.orchestra.run.trial049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56229.log.gz 2026-02-17T11:18:17.190 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.50829.log: gzip 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57504.log.gz -5 2026-02-17T11:18:17.190 INFO:teuthology.orchestra.run.trial049.stderr: --verbose -- /var/log/ceph/ceph-client.admin.50080.log 2026-02-17T11:18:17.190 INFO:teuthology.orchestra.run.trial049.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50829.log.gz 2026-02-17T11:18:17.190 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.58484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55101.log 2026-02-17T11:18:17.190 INFO:teuthology.orchestra.run.trial049.stderr: 94.2% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2026-02-17T11:18:17.190 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52930.log 2026-02-17T11:18:17.190 INFO:teuthology.orchestra.run.trial049.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.58484.log.gz 2026-02-17T11:18:17.190 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.50080.log: /var/log/ceph/ceph-client.admin.55101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46562.log 2026-02-17T11:18:17.190 INFO:teuthology.orchestra.run.trial049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50080.log.gz 2026-02-17T11:18:17.191 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.52930.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55101.log.gz 2026-02-17T11:18:17.191 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50101.log 2026-02-17T11:18:17.191 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.46562.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52930.log.gz 2026-02-17T11:18:17.191 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56866.log 2026-02-17T11:18:17.191 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.50101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53678.log 2026-02-17T11:18:17.191 INFO:teuthology.orchestra.run.trial049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46562.log.gz 2026-02-17T11:18:17.191 INFO:teuthology.orchestra.run.trial049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50101.log.gz 2026-02-17T11:18:17.191 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.56866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58043.log 2026-02-17T11:18:17.191 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.53678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50766.log 2026-02-17T11:18:17.191 INFO:teuthology.orchestra.run.trial049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56866.log.gz 2026-02-17T11:18:17.192 INFO:teuthology.orchestra.run.trial157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-17T11:18:17.192 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.58043.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53678.log.gz 2026-02-17T11:18:17.192 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52299.log 2026-02-17T11:18:17.192 INFO:teuthology.orchestra.run.trial049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58043.log.gz 2026-02-17T11:18:17.192 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.50766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55297.log 2026-02-17T11:18:17.193 INFO:teuthology.orchestra.run.trial157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2026-02-17T11:18:17.193 INFO:teuthology.orchestra.run.trial157.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.2.log 2026-02-17T11:18:17.193 INFO:teuthology.orchestra.run.trial157.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.6.log 2026-02-17T11:18:17.193 INFO:teuthology.orchestra.run.trial157.stderr:/var/log/ceph/valgrind/osd.2.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.14.log 2026-02-17T11:18:17.193 INFO:teuthology.orchestra.run.trial157.stderr: 68.1% -- replaced with /var/log/ceph/valgrind/osd.2.log.gz 2026-02-17T11:18:17.193 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.52299.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50766.log.gz 2026-02-17T11:18:17.193 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58827.log 2026-02-17T11:18:17.193 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.55297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54513.log 2026-02-17T11:18:17.193 INFO:teuthology.orchestra.run.trial049.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52299.log.gz 2026-02-17T11:18:17.193 INFO:teuthology.orchestra.run.trial049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55297.log.gz 2026-02-17T11:18:17.193 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.58827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55150.log 2026-02-17T11:18:17.193 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.54513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55346.log 2026-02-17T11:18:17.193 INFO:teuthology.orchestra.run.trial049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.58827.log.gz 2026-02-17T11:18:17.193 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.55150.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54513.log.gz 2026-02-17T11:18:17.193 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52303.log 2026-02-17T11:18:17.194 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.55346.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55150.log.gz 2026-02-17T11:18:17.195 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55690.log 2026-02-17T11:18:17.195 INFO:teuthology.orchestra.run.trial049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55346.log.gz 2026-02-17T11:18:17.195 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.52303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58974.log 2026-02-17T11:18:17.195 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.55690.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52303.log.gz 2026-02-17T11:18:17.195 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54021.log 2026-02-17T11:18:17.195 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.58974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55641.log 2026-02-17T11:18:17.195 INFO:teuthology.orchestra.run.trial049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55690.log.gz 2026-02-17T11:18:17.195 INFO:teuthology.orchestra.run.trial049.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.58974.log.gz 2026-02-17T11:18:17.195 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.54021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58092.log 2026-02-17T11:18:17.195 INFO:teuthology.orchestra.run.trial157.stderr:/var/log/ceph/valgrind/osd.6.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.10.log 2026-02-17T11:18:17.195 INFO:teuthology.orchestra.run.trial157.stderr: 68.2% -- replaced with /var/log/ceph/valgrind/osd.6.log.gz 2026-02-17T11:18:17.195 INFO:teuthology.orchestra.run.trial157.stderr:/var/log/ceph/valgrind/osd.14.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.c.log 2026-02-17T11:18:17.195 INFO:teuthology.orchestra.run.trial157.stderr: 68.2% -- replaced with /var/log/ceph/valgrind/osd.14.log.gz 2026-02-17T11:18:17.195 INFO:teuthology.orchestra.run.trial157.stderr:/var/log/ceph/valgrind/osd.10.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.10.log 2026-02-17T11:18:17.195 INFO:teuthology.orchestra.run.trial157.stderr: 67.8% -- replaced with /var/log/ceph/valgrind/osd.10.log.gz 2026-02-17T11:18:17.195 INFO:teuthology.orchestra.run.trial157.stderr:/var/log/ceph/valgrind/mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.14.log 2026-02-17T11:18:17.195 INFO:teuthology.orchestra.run.trial157.stderr:/var/log/ceph/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-17T11:18:17.195 INFO:teuthology.orchestra.run.trial157.stderr: 94.2% -- replaced with /var/log/ceph/valgrind/mon.c.log.gz 2026-02-17T11:18:17.195 INFO:teuthology.orchestra.run.trial157.stderr:/var/log/ceph/ceph-osd.14.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2026-02-17T11:18:17.195 INFO:teuthology.orchestra.run.trial157.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-17T11:18:17.196 INFO:teuthology.orchestra.run.trial157.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph.log: 90.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-17T11:18:17.196 INFO:teuthology.orchestra.run.trial049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54021.log.gz 2026-02-17T11:18:17.196 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.55641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46397.log 2026-02-17T11:18:17.196 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.58092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56915.log 2026-02-17T11:18:17.196 INFO:teuthology.orchestra.run.trial049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55641.log.gz 2026-02-17T11:18:17.196 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.46397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52832.log 2026-02-17T11:18:17.196 INFO:teuthology.orchestra.run.trial049.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58092.log.gz 2026-02-17T11:18:17.196 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.56915.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46397.log.gz 2026-02-17T11:18:17.196 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54954.log 2026-02-17T11:18:17.196 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.52832.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56915.log.gz 2026-02-17T11:18:17.197 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55003.log 2026-02-17T11:18:17.197 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.54954.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52832.log.gz 2026-02-17T11:18:17.197 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56621.log 2026-02-17T11:18:17.197 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.55003.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54954.log.gz 2026-02-17T11:18:17.197 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57847.log 2026-02-17T11:18:17.197 INFO:teuthology.orchestra.run.trial157.stderr: 88.2% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-17T11:18:17.197 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.56621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54562.log 2026-02-17T11:18:17.197 INFO:teuthology.orchestra.run.trial049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55003.log.gz 2026-02-17T11:18:17.197 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.57847.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56621.log.gz 2026-02-17T11:18:17.197 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50818.log 2026-02-17T11:18:17.197 INFO:teuthology.orchestra.run.trial049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.57847.log.gz 2026-02-17T11:18:17.197 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.54562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56817.log 2026-02-17T11:18:17.198 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.50818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58435.log 2026-02-17T11:18:17.198 INFO:teuthology.orchestra.run.trial049.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54562.log.gz 2026-02-17T11:18:17.198 INFO:teuthology.orchestra.run.trial049.stderr: 87.7%/var/log/ceph/ceph-client.admin.56817.log: -- replaced with /var/log/ceph/ceph-client.admin.50818.log.gz 2026-02-17T11:18:17.198 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53580.log 2026-02-17T11:18:17.198 INFO:teuthology.orchestra.run.trial049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56817.log.gz 2026-02-17T11:18:17.198 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.58435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54366.log 2026-02-17T11:18:17.198 INFO:teuthology.orchestra.run.trial049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.58435.log.gz 2026-02-17T11:18:17.198 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.53580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52648.log 2026-02-17T11:18:17.199 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.54366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57896.log 2026-02-17T11:18:17.199 INFO:teuthology.orchestra.run.trial049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53580.log.gz 2026-02-17T11:18:17.199 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.52648.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54366.log.gz 2026-02-17T11:18:17.199 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57945.log 2026-02-17T11:18:17.200 INFO:teuthology.orchestra.run.trial049.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.52648.log.gz 2026-02-17T11:18:17.200 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.57896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49647.log 2026-02-17T11:18:17.200 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.57945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57357.log 2026-02-17T11:18:17.200 INFO:teuthology.orchestra.run.trial049.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.57896.log.gz 2026-02-17T11:18:17.200 INFO:teuthology.orchestra.run.trial049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57945.log.gz 2026-02-17T11:18:17.200 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.49647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50831.log 2026-02-17T11:18:17.200 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51354.log 2026-02-17T11:18:17.200 INFO:teuthology.orchestra.run.trial049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49647.log.gz 2026-02-17T11:18:17.200 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.57357.log: /var/log/ceph/ceph-client.admin.50831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56670.log 2026-02-17T11:18:17.200 INFO:teuthology.orchestra.run.trial049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57357.log.gz 2026-02-17T11:18:17.200 INFO:teuthology.orchestra.run.trial049.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.50831.log.gz 2026-02-17T11:18:17.200 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.51354.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.0.log 2026-02-17T11:18:17.201 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.56670.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.12.log 2026-02-17T11:18:17.201 INFO:teuthology.orchestra.run.trial049.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51354.log.gz 2026-02-17T11:18:17.201 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/valgrind/osd.0.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.8.log 2026-02-17T11:18:17.201 INFO:teuthology.orchestra.run.trial049.stderr: 67.9% -- replaced with /var/log/ceph/valgrind/osd.0.log.gz 2026-02-17T11:18:17.201 INFO:teuthology.orchestra.run.trial049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56670.log.gz 2026-02-17T11:18:17.201 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/valgrind/osd.12.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.a.log 2026-02-17T11:18:17.201 INFO:teuthology.orchestra.run.trial049.stderr: 68.2% -- replaced with /var/log/ceph/valgrind/osd.12.log.gz 2026-02-17T11:18:17.201 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/valgrind/osd.8.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.4.log 2026-02-17T11:18:17.202 INFO:teuthology.orchestra.run.trial049.stderr: 68.2% -- replaced with /var/log/ceph/valgrind/osd.8.log.gz 2026-02-17T11:18:17.202 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/valgrind/mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49110.log 2026-02-17T11:18:17.202 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/valgrind/osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53629.log 2026-02-17T11:18:17.202 INFO:teuthology.orchestra.run.trial049.stderr: 68.2% -- replaced with /var/log/ceph/valgrind/osd.4.log.gz 2026-02-17T11:18:17.202 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52881.log 2026-02-17T11:18:17.202 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.49110.log: 94.2% -- replaced with /var/log/ceph/valgrind/mon.a.log.gz 2026-02-17T11:18:17.203 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.53629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53126.log 2026-02-17T11:18:17.203 INFO:teuthology.orchestra.run.trial049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49110.log.gz 2026-02-17T11:18:17.203 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.52881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54611.log 2026-02-17T11:18:17.203 INFO:teuthology.orchestra.run.trial049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53629.log.gz 2026-02-17T11:18:17.203 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.53126.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52881.log.gz 2026-02-17T11:18:17.203 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56425.log 2026-02-17T11:18:17.203 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.54611.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53126.log.gz 2026-02-17T11:18:17.203 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58533.log 2026-02-17T11:18:17.204 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.56425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52277.log 2026-02-17T11:18:17.204 INFO:teuthology.orchestra.run.trial049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54611.log.gz 2026-02-17T11:18:17.204 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.58533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51780.log 2026-02-17T11:18:17.204 INFO:teuthology.orchestra.run.trial049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56425.log.gz 2026-02-17T11:18:17.204 INFO:teuthology.orchestra.run.trial049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58533.log.gz 2026-02-17T11:18:17.204 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.52277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48972.log 2026-02-17T11:18:17.205 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.51780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49018.log 2026-02-17T11:18:17.205 INFO:teuthology.orchestra.run.trial049.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52277.log.gz 2026-02-17T11:18:17.205 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.48972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57798.log 2026-02-17T11:18:17.205 INFO:teuthology.orchestra.run.trial049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51780.log.gz 2026-02-17T11:18:17.205 INFO:teuthology.orchestra.run.trial049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48972.log.gz 2026-02-17T11:18:17.205 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.49018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50784.log 2026-02-17T11:18:17.205 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.57798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53923.log 2026-02-17T11:18:17.205 INFO:teuthology.orchestra.run.trial049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49018.log.gz 2026-02-17T11:18:17.206 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.50784.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57798.log.gz 2026-02-17T11:18:17.206 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50093.log 2026-02-17T11:18:17.206 INFO:teuthology.orchestra.run.trial049.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50784.log.gz 2026-02-17T11:18:17.206 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.53923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52090.log 2026-02-17T11:18:17.206 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.50093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54856.log 2026-02-17T11:18:17.206 INFO:teuthology.orchestra.run.trial049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53923.log.gz 2026-02-17T11:18:17.206 INFO:teuthology.orchestra.run.trial049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50093.log.gz 2026-02-17T11:18:17.207 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.52090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50812.log 2026-02-17T11:18:17.207 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.54856.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52090.log.gz 2026-02-17T11:18:17.207 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55837.log 2026-02-17T11:18:17.207 INFO:teuthology.orchestra.run.trial049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54856.log.gz 2026-02-17T11:18:17.207 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.50812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56474.log 2026-02-17T11:18:17.207 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.55837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50817.log 2026-02-17T11:18:17.207 INFO:teuthology.orchestra.run.trial049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50812.log.gz 2026-02-17T11:18:17.208 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.56474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49461.log 2026-02-17T11:18:17.208 INFO:teuthology.orchestra.run.trial049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55837.log.gz 2026-02-17T11:18:17.208 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.50817.log: 88.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.56474.log.gz 2026-02-17T11:18:17.208 INFO:teuthology.orchestra.run.trial049.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.55199.log 2026-02-17T11:18:17.208 INFO:teuthology.orchestra.run.trial049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50817.log.gz 2026-02-17T11:18:17.208 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.49461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56572.log 2026-02-17T11:18:17.208 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.55199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57651.log 2026-02-17T11:18:17.208 INFO:teuthology.orchestra.run.trial049.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49461.log.gz 2026-02-17T11:18:17.209 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.56572.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55199.log.gz 2026-02-17T11:18:17.209 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48799.log 2026-02-17T11:18:17.209 INFO:teuthology.orchestra.run.trial049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56572.log.gz 2026-02-17T11:18:17.209 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.57651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49484.log 2026-02-17T11:18:17.209 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.48799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56376.log 2026-02-17T11:18:17.209 INFO:teuthology.orchestra.run.trial049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57651.log.gz 2026-02-17T11:18:17.210 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.49484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55592.log 2026-02-17T11:18:17.210 INFO:teuthology.orchestra.run.trial049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48799.log.gz 2026-02-17T11:18:17.210 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.56376.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.12.log 2026-02-17T11:18:17.210 INFO:teuthology.orchestra.run.trial049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49484.log.gz 2026-02-17T11:18:17.210 INFO:teuthology.orchestra.run.trial049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56376.log.gz 2026-02-17T11:18:17.210 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.55592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48926.log 2026-02-17T11:18:17.210 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-osd.12.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59217.log 2026-02-17T11:18:17.210 INFO:teuthology.orchestra.run.trial049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55592.log.gz 2026-02-17T11:18:17.211 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.48926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55935.log 2026-02-17T11:18:17.211 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.59217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51607.log 2026-02-17T11:18:17.211 INFO:teuthology.orchestra.run.trial049.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48926.log.gz 2026-02-17T11:18:17.211 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.55935.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.59217.log.gz 2026-02-17T11:18:17.211 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54070.log 2026-02-17T11:18:17.211 INFO:teuthology.orchestra.run.trial049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55935.log.gz 2026-02-17T11:18:17.212 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.51607.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.38670.log 2026-02-17T11:18:17.212 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.54070.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51607.log.gz 2026-02-17T11:18:17.212 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2026-02-17T11:18:17.212 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph.tmp-client.admin.38670.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54070.log.gz 2026-02-17T11:18:17.212 INFO:teuthology.orchestra.run.trial049.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.38670.log.gz 2026-02-17T11:18:17.212 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54415.log 2026-02-17T11:18:17.212 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57308.log 2026-02-17T11:18:17.213 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.54415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51584.log 2026-02-17T11:18:17.213 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.57308.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54415.log.gzgzip 2026-02-17T11:18:17.213 INFO:teuthology.orchestra.run.trial049.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.53482.log 2026-02-17T11:18:17.213 INFO:teuthology.orchestra.run.trial049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.57308.log.gz 2026-02-17T11:18:17.213 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.51584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56964.log 2026-02-17T11:18:17.214 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.53482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55494.log 2026-02-17T11:18:17.214 INFO:teuthology.orchestra.run.trial049.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51584.log.gz 2026-02-17T11:18:17.214 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.56964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54219.log 2026-02-17T11:18:17.214 INFO:teuthology.orchestra.run.trial049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53482.log.gz 2026-02-17T11:18:17.214 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.55494.log: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.56964.log.gz -5 2026-02-17T11:18:17.214 INFO:teuthology.orchestra.run.trial049.stderr: --verbose -- /var/log/ceph/ceph-client.admin.57553.log 2026-02-17T11:18:17.214 INFO:teuthology.orchestra.run.trial049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55494.log.gz 2026-02-17T11:18:17.214 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.54219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52048.log 2026-02-17T11:18:17.215 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.57553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58582.log 2026-02-17T11:18:17.215 INFO:teuthology.orchestra.run.trial049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54219.log.gz 2026-02-17T11:18:17.215 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.52048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51582.log 2026-02-17T11:18:17.215 INFO:teuthology.orchestra.run.trial049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57553.log.gz 2026-02-17T11:18:17.215 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.58582.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52048.log.gz 2026-02-17T11:18:17.215 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52651.log 2026-02-17T11:18:17.215 INFO:teuthology.orchestra.run.trial049.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.58582.log.gz 2026-02-17T11:18:17.215 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.51582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57210.log 2026-02-17T11:18:17.216 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.52651.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51582.log.gz 2026-02-17T11:18:17.216 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53224.log 2026-02-17T11:18:17.216 INFO:teuthology.orchestra.run.trial049.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.52651.log.gz 2026-02-17T11:18:17.216 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.57210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52979.log 2026-02-17T11:18:17.216 INFO:teuthology.orchestra.run.trial049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.57210.log.gz 2026-02-17T11:18:17.216 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.53224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56131.log 2026-02-17T11:18:17.216 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.52979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54120.log 2026-02-17T11:18:17.216 INFO:teuthology.orchestra.run.trial049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53224.log.gz 2026-02-17T11:18:17.217 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.56131.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52979.log.gz 2026-02-17T11:18:17.217 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52425.log 2026-02-17T11:18:17.217 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.54120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51066.log 2026-02-17T11:18:17.217 INFO:teuthology.orchestra.run.trial049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56131.log.gz 2026-02-17T11:18:17.217 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.52425.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54120.log.gz 2026-02-17T11:18:17.217 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-17T11:18:17.217 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.51066.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52425.log.gz 2026-02-17T11:18:17.218 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58680.log 2026-02-17T11:18:17.218 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph.audit.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51066.log.gz 2026-02-17T11:18:17.218 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50731.log 2026-02-17T11:18:17.218 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.58680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53825.log 2026-02-17T11:18:17.219 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.50731.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.58680.log.gz 2026-02-17T11:18:17.219 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53322.log 2026-02-17T11:18:17.219 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.53825.log: 87.4% 90.5% -- replaced with /var/log/ceph/ceph-client.admin.50731.log.gz 2026-02-17T11:18:17.219 INFO:teuthology.orchestra.run.trial049.stderr: -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-17T11:18:17.219 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45350.log 2026-02-17T11:18:17.219 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.53322.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53825.log.gz 2026-02-17T11:18:17.219 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53077.log 2026-02-17T11:18:17.220 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.45350.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53322.log.gz 2026-02-17T11:18:17.220 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51757.log 2026-02-17T11:18:17.220 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.53077.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45350.log.gz 2026-02-17T11:18:17.220 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54317.log 2026-02-17T11:18:17.220 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.51757.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53077.log.gz 2026-02-17T11:18:17.220 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59023.log 2026-02-17T11:18:17.220 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.54317.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51757.log.gz 2026-02-17T11:18:17.220 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50094.log 2026-02-17T11:18:17.222 INFO:teuthology.orchestra.run.trial049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54317.log.gz 2026-02-17T11:18:17.222 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.59023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50064.log 2026-02-17T11:18:17.222 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.50094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57111.log 2026-02-17T11:18:17.222 INFO:teuthology.orchestra.run.trial049.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.59023.log.gz 2026-02-17T11:18:17.222 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.50064.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50094.log.gz 2026-02-17T11:18:17.222 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58190.log 2026-02-17T11:18:17.222 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.57111.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50064.log.gz 2026-02-17T11:18:17.222 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56180.log 2026-02-17T11:18:17.222 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.58190.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57111.log.gz 2026-02-17T11:18:17.222 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53776.log 2026-02-17T11:18:17.222 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.56180.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.58190.log.gz 2026-02-17T11:18:17.222 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53371.log 2026-02-17T11:18:17.222 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.53776.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56180.log.gz 2026-02-17T11:18:17.222 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53175.log 2026-02-17T11:18:17.231 INFO:teuthology.orchestra.run.trial162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44556.log 2026-02-17T11:18:17.231 INFO:teuthology.orchestra.run.trial162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44603.log 2026-02-17T11:18:17.231 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.44556.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2026-02-17T11:18:17.231 INFO:teuthology.orchestra.run.trial162.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44556.log.gz 2026-02-17T11:18:17.231 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.44603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44180.log 2026-02-17T11:18:17.231 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44321.log 2026-02-17T11:18:17.231 INFO:teuthology.orchestra.run.trial162.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44603.log.gz 2026-02-17T11:18:17.231 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.44180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43912.log 2026-02-17T11:18:17.231 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.44321.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2026-02-17T11:18:17.231 INFO:teuthology.orchestra.run.trial162.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44180.log.gz 2026-02-17T11:18:17.231 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.43912.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.7.log 2026-02-17T11:18:17.231 INFO:teuthology.orchestra.run.trial162.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44321.log.gz 2026-02-17T11:18:17.231 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-osd.7.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43912.log.gz 2026-02-17T11:18:17.231 INFO:teuthology.orchestra.run.trial162.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.11.log 2026-02-17T11:18:17.231 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/valgrind/osd.7.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.15.log 2026-02-17T11:18:17.231 INFO:teuthology.orchestra.run.trial162.stderr: 67.8% -- replaced with /var/log/ceph/valgrind/osd.7.log.gz 2026-02-17T11:18:17.231 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/valgrind/osd.11.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.3.log 2026-02-17T11:18:17.231 INFO:teuthology.orchestra.run.trial162.stderr: 67.9% -- replaced with /var/log/ceph/valgrind/osd.11.log.gz 2026-02-17T11:18:17.231 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/valgrind/osd.15.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.11.log 2026-02-17T11:18:17.231 INFO:teuthology.orchestra.run.trial162.stderr: 68.2% -- replaced with /var/log/ceph/valgrind/osd.15.log.gz 2026-02-17T11:18:17.231 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/valgrind/osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43858.log 2026-02-17T11:18:17.231 INFO:teuthology.orchestra.run.trial162.stderr: 67.9% -- replaced with /var/log/ceph/valgrind/osd.3.log.gz 2026-02-17T11:18:17.231 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44274.log 2026-02-17T11:18:17.231 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.43858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44006.log 2026-02-17T11:18:17.231 INFO:teuthology.orchestra.run.trial162.stderr: 87.2%/var/log/ceph/ceph-client.admin.44274.log: -- replaced with /var/log/ceph/ceph-client.admin.43858.log.gz 2026-02-17T11:18:17.231 INFO:teuthology.orchestra.run.trial162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43807.log 2026-02-17T11:18:17.231 INFO:teuthology.orchestra.run.trial162.stderr:gzip/var/log/ceph/ceph-client.admin.44006.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.44368.log 2026-02-17T11:18:17.231 INFO:teuthology.orchestra.run.trial162.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44274.log.gz 2026-02-17T11:18:17.231 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.43807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44462.log 2026-02-17T11:18:17.231 INFO:teuthology.orchestra.run.trial162.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.44006.log.gz 2026-02-17T11:18:17.231 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.44368.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43807.log.gz 2026-02-17T11:18:17.231 INFO:teuthology.orchestra.run.trial162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43959.log 2026-02-17T11:18:17.231 INFO:teuthology.orchestra.run.trial162.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44368.log.gz 2026-02-17T11:18:17.231 INFO:teuthology.orchestra.run.trial162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-17T11:18:17.232 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.44462.log: /var/log/ceph/ceph-client.admin.43959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44227.log 2026-02-17T11:18:17.232 INFO:teuthology.orchestra.run.trial162.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44462.log.gz 2026-02-17T11:18:17.232 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44415.log 2026-02-17T11:18:17.232 INFO:teuthology.orchestra.run.trial162.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43959.log.gz 2026-02-17T11:18:17.232 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.44227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44509.log 2026-02-17T11:18:17.232 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.44415.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.15.log 2026-02-17T11:18:17.232 INFO:teuthology.orchestra.run.trial162.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44227.log.gz 2026-02-17T11:18:17.232 INFO:teuthology.orchestra.run.trial162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44129.log 2026-02-17T11:18:17.232 INFO:teuthology.orchestra.run.trial162.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44415.log.gz 2026-02-17T11:18:17.232 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.44509.log: /var/log/ceph/ceph-osd.15.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44509.log.gz 2026-02-17T11:18:17.232 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.44129.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.44129.log.gz 2026-02-17T11:18:17.233 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.53371.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53776.log.gz 2026-02-17T11:18:17.233 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53727.log 2026-02-17T11:18:17.233 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.53175.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53371.log.gz 2026-02-17T11:18:17.233 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50813.log 2026-02-17T11:18:17.233 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.53727.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53175.log.gz 2026-02-17T11:18:17.233 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58386.log 2026-02-17T11:18:17.233 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.50813.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53727.log.gz 2026-02-17T11:18:17.233 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58925.log 2026-02-17T11:18:17.234 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.58386.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50813.log.gz 2026-02-17T11:18:17.234 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52464.log 2026-02-17T11:18:17.234 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.58925.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.58386.log.gz 2026-02-17T11:18:17.234 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57259.log 2026-02-17T11:18:17.234 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.52464.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.58925.log.gz 2026-02-17T11:18:17.234 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54170.log 2026-02-17T11:18:17.234 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.57259.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52464.log.gz 2026-02-17T11:18:17.234 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53028.log 2026-02-17T11:18:17.234 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.54170.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.57259.log.gz 2026-02-17T11:18:17.234 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48880.log 2026-02-17T11:18:17.234 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.53028.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54170.log.gz 2026-02-17T11:18:17.234 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51345.log 2026-02-17T11:18:17.234 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.48880.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53028.log.gz 2026-02-17T11:18:17.234 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50074.log 2026-02-17T11:18:17.234 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.51345.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48880.log.gz 2026-02-17T11:18:17.234 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50063.log 2026-02-17T11:18:17.234 INFO:teuthology.orchestra.run.trial049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51345.log.gz 2026-02-17T11:18:17.234 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.50074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56768.log 2026-02-17T11:18:17.234 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.50063.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50074.log.gz 2026-02-17T11:18:17.234 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56523.log 2026-02-17T11:18:17.234 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.56768.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50063.log.gz 2026-02-17T11:18:17.234 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54709.log 2026-02-17T11:18:17.234 INFO:teuthology.orchestra.run.trial049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56768.log.gz 2026-02-17T11:18:17.234 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.56523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52783.log 2026-02-17T11:18:17.234 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.54709.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56523.log.gz 2026-02-17T11:18:17.234 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53972.log 2026-02-17T11:18:17.234 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.52783.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54709.log.gz 2026-02-17T11:18:17.234 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51353.log 2026-02-17T11:18:17.234 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.53972.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52783.log.gz 2026-02-17T11:18:17.234 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51930.log 2026-02-17T11:18:17.234 INFO:teuthology.orchestra.run.trial049.stderr: 87.9%/var/log/ceph/ceph-client.admin.51353.log: -- replaced with /var/log/ceph/ceph-client.admin.53972.log.gz 2026-02-17T11:18:17.234 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51496.log 2026-02-17T11:18:17.234 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.51930.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51353.log.gz 2026-02-17T11:18:17.234 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56278.log 2026-02-17T11:18:17.234 INFO:teuthology.orchestra.run.trial049.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.51930.log.gz 2026-02-17T11:18:17.234 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.51496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55886.log 2026-02-17T11:18:17.234 INFO:teuthology.orchestra.run.trial049.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.51496.log.gz 2026-02-17T11:18:17.234 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.56278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50076.log 2026-02-17T11:18:17.234 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.55886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56327.log 2026-02-17T11:18:17.234 INFO:teuthology.orchestra.run.trial049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56278.log.gz 2026-02-17T11:18:17.234 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.50076.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55886.log.gz 2026-02-17T11:18:17.234 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45023.log 2026-02-17T11:18:17.234 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.56327.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50076.log.gz 2026-02-17T11:18:17.235 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49598.log 2026-02-17T11:18:17.235 INFO:teuthology.orchestra.run.trial049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56327.log.gz 2026-02-17T11:18:17.235 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.45023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58729.log 2026-02-17T11:18:17.235 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.49598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53273.log 2026-02-17T11:18:17.235 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.58729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55788.log 2026-02-17T11:18:17.235 INFO:teuthology.orchestra.run.trial049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49598.log.gz 2026-02-17T11:18:17.235 INFO:teuthology.orchestra.run.trial049.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.45023.log.gz 2026-02-17T11:18:17.235 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.53273.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.58729.log.gz 2026-02-17T11:18:17.235 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50816.log 2026-02-17T11:18:17.235 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.55788.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53273.log.gz 2026-02-17T11:18:17.235 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50062.log 2026-02-17T11:18:17.235 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.50816.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55788.log.gz 2026-02-17T11:18:17.235 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55248.log 2026-02-17T11:18:17.235 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.50062.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50816.log.gz 2026-02-17T11:18:17.235 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58876.log 2026-02-17T11:18:17.235 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.55248.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50062.log.gz 2026-02-17T11:18:17.235 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57013.log 2026-02-17T11:18:17.235 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.58876.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55248.log.gz 2026-02-17T11:18:17.235 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55395.log 2026-02-17T11:18:17.235 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.57013.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58876.log.gz 2026-02-17T11:18:17.235 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55052.log 2026-02-17T11:18:17.235 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.55395.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.57013.log.gz 2026-02-17T11:18:17.235 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52734.log 2026-02-17T11:18:17.235 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.55052.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55395.log.gz 2026-02-17T11:18:17.235 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55543.log 2026-02-17T11:18:17.235 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.52734.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55052.log.gz 2026-02-17T11:18:17.235 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50097.log 2026-02-17T11:18:17.235 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.55543.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52734.log.gz 2026-02-17T11:18:17.235 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52278.log 2026-02-17T11:18:17.235 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.50097.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55543.log.gz 2026-02-17T11:18:17.235 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55444.log 2026-02-17T11:18:17.235 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.52278.log: gzip 88.5% -5 -- replaced with /var/log/ceph/ceph-client.admin.50097.log.gz --verbose 2026-02-17T11:18:17.235 INFO:teuthology.orchestra.run.trial049.stderr: -- /var/log/ceph/ceph-client.admin.54807.log 2026-02-17T11:18:17.235 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.55444.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52278.log.gz 2026-02-17T11:18:17.235 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54464.log 2026-02-17T11:18:17.235 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.54807.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55444.log.gz 2026-02-17T11:18:17.235 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51932.log 2026-02-17T11:18:17.235 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.54464.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54807.log.gz 2026-02-17T11:18:17.235 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55984.log 2026-02-17T11:18:17.236 INFO:teuthology.orchestra.run.trial097.stderr: 91.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-17T11:18:17.236 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.51932.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54464.log.gz 2026-02-17T11:18:17.236 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54268.log 2026-02-17T11:18:17.236 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.55984.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51932.log.gz 2026-02-17T11:18:17.236 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58631.log 2026-02-17T11:18:17.236 INFO:teuthology.orchestra.run.trial049.stderr: 90.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-17T11:18:17.236 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.54268.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55984.log.gz 2026-02-17T11:18:17.237 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-17T11:18:17.237 INFO:teuthology.orchestra.run.trial049.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54268.log.gz 2026-02-17T11:18:17.237 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.58631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54905.log 2026-02-17T11:18:17.237 INFO:teuthology.orchestra.run.trial049.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58631.log.gz 2026-02-17T11:18:17.237 INFO:teuthology.orchestra.run.trial049.stderr:gzip/var/log/ceph/ceph.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.51067.log 2026-02-17T11:18:17.237 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.54905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50067.log 2026-02-17T11:18:17.237 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.51067.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54905.log.gz 2026-02-17T11:18:17.237 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51705.log 2026-02-17T11:18:17.237 INFO:teuthology.orchestra.run.trial049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51067.log.gz 2026-02-17T11:18:17.237 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.50067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57062.log 2026-02-17T11:18:17.237 INFO:teuthology.orchestra.run.trial049.stderr: 88.2% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-17T11:18:17.237 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.51705.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.8.log 2026-02-17T11:18:17.237 INFO:teuthology.orchestra.run.trial049.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50067.log.gz 2026-02-17T11:18:17.237 INFO:teuthology.orchestra.run.trial049.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51705.log.gz 2026-02-17T11:18:17.237 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.57062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53433.log 2026-02-17T11:18:17.237 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50828.log 2026-02-17T11:18:17.237 INFO:teuthology.orchestra.run.trial049.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57062.log.gz 2026-02-17T11:18:17.237 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.53433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57455.log 2026-02-17T11:18:17.237 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.50828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53531.log 2026-02-17T11:18:17.237 INFO:teuthology.orchestra.run.trial049.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53433.log.gz 2026-02-17T11:18:17.237 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.57455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52513.log 2026-02-17T11:18:17.237 INFO:teuthology.orchestra.run.trial049.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50828.log.gz 2026-02-17T11:18:17.238 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.53531.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.57455.log.gz 2026-02-17T11:18:17.238 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59072.log 2026-02-17T11:18:17.238 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55739.log 2026-02-17T11:18:17.238 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.52513.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53531.log.gz 2026-02-17T11:18:17.238 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.59072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45373.log 2026-02-17T11:18:17.238 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.55739.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52513.log.gz 2026-02-17T11:18:17.238 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51606.log 2026-02-17T11:18:17.238 INFO:teuthology.orchestra.run.trial049.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.59072.log.gz 2026-02-17T11:18:17.238 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.45373.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55739.log.gz 2026-02-17T11:18:17.238 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50085.log 2026-02-17T11:18:17.239 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.51606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49549.log 2026-02-17T11:18:17.239 INFO:teuthology.orchestra.run.trial049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45373.log.gz 2026-02-17T11:18:17.239 INFO:teuthology.orchestra.run.trial157.stderr: 91.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2026-02-17T11:18:17.239 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.50085.log: 87.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.51606.log.gz -5 2026-02-17T11:18:17.239 INFO:teuthology.orchestra.run.trial049.stderr: --verbose -- /var/log/ceph/ceph-client.admin.56033.log 2026-02-17T11:18:17.239 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.49549.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50085.log.gz 2026-02-17T11:18:17.239 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50088.log 2026-02-17T11:18:17.239 INFO:teuthology.orchestra.run.trial049.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49549.log.gz 2026-02-17T11:18:17.240 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.56033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54758.log 2026-02-17T11:18:17.240 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.50088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51264.log 2026-02-17T11:18:17.240 INFO:teuthology.orchestra.run.trial049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56033.log.gz 2026-02-17T11:18:17.240 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.54758.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50088.log.gz 2026-02-17T11:18:17.240 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58239.log 2026-02-17T11:18:17.240 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.51264.log: gzip -5 --verbose 88.1% -- -- replaced with /var/log/ceph/ceph-client.admin.54758.log.gz /var/log/ceph/ceph-client.admin.50091.log 2026-02-17T11:18:17.240 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:18:17.240 INFO:teuthology.orchestra.run.trial049.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51264.log.gz 2026-02-17T11:18:17.240 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.58239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52276.log 2026-02-17T11:18:17.241 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.50091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50099.log 2026-02-17T11:18:17.241 INFO:teuthology.orchestra.run.trial049.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58239.log.gz 2026-02-17T11:18:17.241 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.52276.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50091.log.gz 2026-02-17T11:18:17.241 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49326.log 2026-02-17T11:18:17.242 INFO:teuthology.orchestra.run.trial049.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52276.log.gz 2026-02-17T11:18:17.242 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.50099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57994.log 2026-02-17T11:18:17.242 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.49326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58288.log 2026-02-17T11:18:17.242 INFO:teuthology.orchestra.run.trial049.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50099.log.gz 2026-02-17T11:18:17.242 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.57994.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49326.log.gz 2026-02-17T11:18:17.242 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45419.log 2026-02-17T11:18:17.242 INFO:teuthology.orchestra.run.trial049.stderr: 88.0%/var/log/ceph/ceph-client.admin.58288.log: -- replaced with /var/log/ceph/ceph-client.admin.57994.log.gz 2026-02-17T11:18:17.242 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59121.log 2026-02-17T11:18:17.242 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.45419.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.58288.log.gz 2026-02-17T11:18:17.242 INFO:teuthology.orchestra.run.trial049.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45419.log.gz 2026-02-17T11:18:17.243 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/ceph-client.admin.59121.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.59121.log.gz 2026-02-17T11:18:17.245 INFO:teuthology.orchestra.run.trial157.stderr: 90.8% -- replaced with /var/log/ceph/ceph-osd.10.log.gz 2026-02-17T11:18:17.249 INFO:teuthology.orchestra.run.trial097.stderr: 91.0% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2026-02-17T11:18:17.250 INFO:teuthology.orchestra.run.trial157.stderr: 90.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-17T11:18:17.250 INFO:teuthology.orchestra.run.trial097.stderr: 90.7% -- replaced with /var/log/ceph/ceph-osd.13.log.gz 2026-02-17T11:18:17.252 INFO:teuthology.orchestra.run.trial097.stderr: 90.6% -- replaced with /var/log/ceph/ceph-osd.9.log.gz 2026-02-17T11:18:17.257 INFO:teuthology.orchestra.run.trial049.stderr: 90.9% -- replaced with /var/log/ceph/ceph-osd.12.log.gz 2026-02-17T11:18:17.262 INFO:teuthology.orchestra.run.trial157.stderr: 90.7% -- replaced with /var/log/ceph/ceph-osd.14.log.gz 2026-02-17T11:18:17.270 INFO:teuthology.orchestra.run.trial049.stderr: 90.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2026-02-17T11:18:17.273 INFO:teuthology.orchestra.run.trial162.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-17T11:18:17.280 INFO:teuthology.orchestra.run.trial162.stderr: 90.9% -- replaced with /var/log/ceph/ceph-osd.11.log.gz 2026-02-17T11:18:17.280 INFO:teuthology.orchestra.run.trial162.stderr: 90.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2026-02-17T11:18:17.281 INFO:teuthology.orchestra.run.trial162.stderr: 90.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2026-02-17T11:18:17.282 INFO:teuthology.orchestra.run.trial097.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2026-02-17T11:18:17.283 INFO:teuthology.orchestra.run.trial097.stderr: 2026-02-17T11:18:17.283 INFO:teuthology.orchestra.run.trial097.stderr:real 0m0.108s 2026-02-17T11:18:17.283 INFO:teuthology.orchestra.run.trial097.stderr:user 0m0.321s 2026-02-17T11:18:17.284 INFO:teuthology.orchestra.run.trial097.stderr:sys 0m0.041s 2026-02-17T11:18:17.295 INFO:teuthology.orchestra.run.trial049.stderr: 90.7% -- replaced with /var/log/ceph/ceph-osd.8.log.gz 2026-02-17T11:18:17.296 INFO:teuthology.orchestra.run.trial162.stderr: 90.7% -- replaced with /var/log/ceph/ceph-osd.15.log.gz 2026-02-17T11:18:17.298 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T11:18:17.298 INFO:teuthology.orchestra.run.trial162.stderr:real 0m0.085s 2026-02-17T11:18:17.298 INFO:teuthology.orchestra.run.trial162.stderr:user 0m0.291s 2026-02-17T11:18:17.298 INFO:teuthology.orchestra.run.trial162.stderr:sys 0m0.031s 2026-02-17T11:18:17.301 INFO:teuthology.orchestra.run.trial157.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2026-02-17T11:18:17.303 INFO:teuthology.orchestra.run.trial157.stderr: 2026-02-17T11:18:17.303 INFO:teuthology.orchestra.run.trial157.stderr:real 0m0.119s 2026-02-17T11:18:17.303 INFO:teuthology.orchestra.run.trial157.stderr:user 0m0.322s 2026-02-17T11:18:17.303 INFO:teuthology.orchestra.run.trial157.stderr:sys 0m0.035s 2026-02-17T11:18:17.374 INFO:teuthology.orchestra.run.trial049.stderr: 89.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-17T11:18:17.375 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-17T11:18:17.375 INFO:teuthology.orchestra.run.trial049.stderr:real 0m0.203s 2026-02-17T11:18:17.375 INFO:teuthology.orchestra.run.trial049.stderr:user 0m0.477s 2026-02-17T11:18:17.375 INFO:teuthology.orchestra.run.trial049.stderr:sys 0m0.146s 2026-02-17T11:18:17.376 INFO:tasks.ceph:Archiving logs... 2026-02-17T11:18:17.376 DEBUG:teuthology.misc:Transferring archived files from trial049:/var/log/ceph to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51248/remote/trial049/log 2026-02-17T11:18:17.378 DEBUG:teuthology.orchestra.run.trial049:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-17T11:18:17.590 DEBUG:teuthology.misc:Transferring archived files from trial097:/var/log/ceph to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51248/remote/trial097/log 2026-02-17T11:18:17.591 DEBUG:teuthology.orchestra.run.trial097:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-17T11:18:17.678 DEBUG:teuthology.misc:Transferring archived files from trial157:/var/log/ceph to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51248/remote/trial157/log 2026-02-17T11:18:17.679 DEBUG:teuthology.orchestra.run.trial157:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-17T11:18:17.757 DEBUG:teuthology.misc:Transferring archived files from trial162:/var/log/ceph to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51248/remote/trial162/log 2026-02-17T11:18:17.758 DEBUG:teuthology.orchestra.run.trial162:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-17T11:18:17.842 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/ceph.py", line 329, in valgrind_post yield File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/ceph.py", line 1922, in task healthy(ctx=ctx, config=dict(cluster=config['cluster'])) File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/ceph.py", line 1484, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/ceph_manager.py", line 3303, in wait_until_healthy assert time.time() - start < timeout, \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: timeout expired in wait_until_healthy During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/ceph.py", line 1919, in task with contextutil.nested(*subtasks): File "/usr/lib/python3.12/contextlib.py", line 158, in __exit__ self.gen.throw(value) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 46, in nested if exit(*exc): ^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 158, in __exit__ self.gen.throw(value) File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable malloc malloc _dl_new_object 2026-02-17T11:18:17.843 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-17T11:18:17.856 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-17T11:18:17.870 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-17T11:18:17.870 DEBUG:teuthology.orchestra.run.trial049:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-17T11:18:17.872 DEBUG:teuthology.orchestra.run.trial097:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-17T11:18:17.874 DEBUG:teuthology.orchestra.run.trial157:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-17T11:18:17.876 DEBUG:teuthology.orchestra.run.trial162:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-17T11:18:18.825 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-17T11:18:18.838 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-17T11:18:18.838 DEBUG:teuthology.orchestra.run.trial049:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T11:18:18.840 DEBUG:teuthology.orchestra.run.trial097:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T11:18:18.842 DEBUG:teuthology.orchestra.run.trial157:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T11:18:18.843 DEBUG:teuthology.orchestra.run.trial162:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T11:18:18.855 INFO:teuthology.orchestra.run.trial049.stderr:bash: line 1: ntpq: command not found 2026-02-17T11:18:18.856 INFO:teuthology.orchestra.run.trial097.stderr:bash: line 1: ntpq: command not found 2026-02-17T11:18:18.858 INFO:teuthology.orchestra.run.trial157.stderr:bash: line 1: ntpq: command not found 2026-02-17T11:18:18.859 INFO:teuthology.orchestra.run.trial162.stderr:bash: line 1: ntpq: command not found 2026-02-17T11:18:18.876 INFO:teuthology.orchestra.run.trial049.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T11:18:18.876 INFO:teuthology.orchestra.run.trial049.stdout:=============================================================================== 2026-02-17T11:18:18.877 INFO:teuthology.orchestra.run.trial049.stdout:^* time.cloudflare.com 3 6 377 35 -26us[ -170us] +/- 6834us 2026-02-17T11:18:18.877 INFO:teuthology.orchestra.run.trial049.stdout:^- baron.cgee.net 2 7 377 33 +939us[ +939us] +/- 23ms 2026-02-17T11:18:18.877 INFO:teuthology.orchestra.run.trial049.stdout:^+ ntp4.glypnod.com 2 6 377 31 +350us[ +350us] +/- 13ms 2026-02-17T11:18:18.877 INFO:teuthology.orchestra.run.trial049.stdout:^- 198-23-133-146-host.colo> 3 6 377 98 +104us[ -41us] +/- 64ms 2026-02-17T11:18:18.938 INFO:teuthology.orchestra.run.trial162.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T11:18:18.938 INFO:teuthology.orchestra.run.trial162.stdout:=============================================================================== 2026-02-17T11:18:18.939 INFO:teuthology.orchestra.run.trial162.stdout:^* time.cloudflare.com 3 6 377 98 +158us[ +214us] +/- 6772us 2026-02-17T11:18:18.939 INFO:teuthology.orchestra.run.trial162.stdout:^- baron.cgee.net 2 7 377 35 +1477us[+1477us] +/- 24ms 2026-02-17T11:18:18.939 INFO:teuthology.orchestra.run.trial162.stdout:^- ntp4.glypnod.com 2 6 377 32 +309us[ +309us] +/- 12ms 2026-02-17T11:18:18.939 INFO:teuthology.orchestra.run.trial162.stdout:^- 198-23-133-146-host.colo> 3 7 377 35 +80us[ +80us] +/- 65ms 2026-02-17T11:18:18.942 INFO:teuthology.orchestra.run.trial157.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T11:18:18.942 INFO:teuthology.orchestra.run.trial157.stdout:=============================================================================== 2026-02-17T11:18:18.942 INFO:teuthology.orchestra.run.trial157.stdout:^* time.cloudflare.com 3 7 377 33 -80us[ -77us] +/- 6938us 2026-02-17T11:18:18.943 INFO:teuthology.orchestra.run.trial157.stdout:^- baron.cgee.net 2 7 377 33 +1251us[+1255us] +/- 23ms 2026-02-17T11:18:18.943 INFO:teuthology.orchestra.run.trial157.stdout:^- ntp4.glypnod.com 2 6 377 35 +565us[ +569us] +/- 13ms 2026-02-17T11:18:18.943 INFO:teuthology.orchestra.run.trial157.stdout:^- 198-23-133-146-host.colo> 3 6 377 98 -504us[ -498us] +/- 64ms 2026-02-17T11:18:18.943 INFO:teuthology.orchestra.run.trial097.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T11:18:18.943 INFO:teuthology.orchestra.run.trial097.stdout:=============================================================================== 2026-02-17T11:18:18.943 INFO:teuthology.orchestra.run.trial097.stdout:^* time.cloudflare.com 3 6 377 34 -13us[ -76us] +/- 6802us 2026-02-17T11:18:18.943 INFO:teuthology.orchestra.run.trial097.stdout:^- baron.cgee.net 2 7 377 34 +992us[ +992us] +/- 24ms 2026-02-17T11:18:18.943 INFO:teuthology.orchestra.run.trial097.stdout:^+ ntp4.glypnod.com 2 6 377 35 -1543us[-1606us] +/- 14ms 2026-02-17T11:18:18.943 INFO:teuthology.orchestra.run.trial097.stdout:^- 198-23-133-146-host.colo> 3 7 377 33 -179us[ -179us] +/- 65ms 2026-02-17T11:18:18.944 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-17T11:18:18.955 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-17T11:18:18.955 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-17T11:18:18.968 DEBUG:teuthology.orchestra.run.trial049:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-17T11:18:19.026 DEBUG:teuthology.orchestra.run.trial097:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-17T11:18:19.081 DEBUG:teuthology.orchestra.run.trial157:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-17T11:18:19.136 DEBUG:teuthology.orchestra.run.trial162:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-17T11:18:19.192 DEBUG:teuthology.orchestra.run.trial049:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T11:18:19.221 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T11:18:19.221 DEBUG:teuthology.orchestra.run.trial097:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T11:18:19.249 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T11:18:19.250 DEBUG:teuthology.orchestra.run.trial157:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T11:18:19.276 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T11:18:19.277 DEBUG:teuthology.orchestra.run.trial162:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T11:18:19.304 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T11:18:19.304 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-17T11:18:19.316 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-17T11:18:19.330 INFO:teuthology.task.internal:Duration was 1200.093849 seconds 2026-02-17T11:18:19.331 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-17T11:18:19.344 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-17T11:18:19.344 DEBUG:teuthology.orchestra.run.trial049:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-17T11:18:19.346 DEBUG:teuthology.orchestra.run.trial097:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-17T11:18:19.349 DEBUG:teuthology.orchestra.run.trial157:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-17T11:18:19.351 DEBUG:teuthology.orchestra.run.trial162:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-17T11:18:19.382 INFO:teuthology.orchestra.run.trial049.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T11:18:19.385 INFO:teuthology.orchestra.run.trial097.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T11:18:19.386 INFO:teuthology.orchestra.run.trial157.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T11:18:19.389 INFO:teuthology.orchestra.run.trial162.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T11:18:19.877 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-17T11:18:19.877 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial049.front.sepia.ceph.com 2026-02-17T11:18:19.878 DEBUG:teuthology.orchestra.run.trial049:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-17T11:18:19.936 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial097.front.sepia.ceph.com 2026-02-17T11:18:19.937 DEBUG:teuthology.orchestra.run.trial097:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-17T11:18:19.956 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial157.front.sepia.ceph.com 2026-02-17T11:18:19.957 DEBUG:teuthology.orchestra.run.trial157:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-17T11:18:19.977 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial162.front.sepia.ceph.com 2026-02-17T11:18:19.977 DEBUG:teuthology.orchestra.run.trial162:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-17T11:18:19.998 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-17T11:18:19.998 DEBUG:teuthology.orchestra.run.trial049:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T11:18:20.001 DEBUG:teuthology.orchestra.run.trial097:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T11:18:20.003 DEBUG:teuthology.orchestra.run.trial157:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T11:18:20.019 DEBUG:teuthology.orchestra.run.trial162:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T11:18:20.099 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-17T11:18:20.100 DEBUG:teuthology.orchestra.run.trial049:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T11:18:20.102 DEBUG:teuthology.orchestra.run.trial097:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T11:18:20.105 DEBUG:teuthology.orchestra.run.trial157:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T11:18:20.107 DEBUG:teuthology.orchestra.run.trial162:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T11:18:20.122 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T11:18:20.123 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T11:18:20.123 INFO:teuthology.orchestra.run.trial049.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-17T11:18:20.123 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T11:18:20.124 INFO:teuthology.orchestra.run.trial049.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-17T11:18:20.125 INFO:teuthology.orchestra.run.trial097.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T11:18:20.127 INFO:teuthology.orchestra.run.trial097.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T11:18:20.127 INFO:teuthology.orchestra.run.trial097.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-17T11:18:20.127 INFO:teuthology.orchestra.run.trial097.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T11:18:20.127 INFO:teuthology.orchestra.run.trial097.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-17T11:18:20.127 INFO:teuthology.orchestra.run.trial157.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T11:18:20.129 INFO:teuthology.orchestra.run.trial157.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T11:18:20.129 INFO:teuthology.orchestra.run.trial157.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T11:18:20.129 INFO:teuthology.orchestra.run.trial157.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-17T11:18:20.129 INFO:teuthology.orchestra.run.trial157.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-17T11:18:20.130 INFO:teuthology.orchestra.run.trial162.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T11:18:20.131 INFO:teuthology.orchestra.run.trial162.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T11:18:20.131 INFO:teuthology.orchestra.run.trial162.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T11:18:20.132 INFO:teuthology.orchestra.run.trial162.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-17T11:18:20.132 INFO:teuthology.orchestra.run.trial162.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-17T11:18:20.133 INFO:teuthology.orchestra.run.trial049.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 83.5% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-17T11:18:20.136 INFO:teuthology.orchestra.run.trial097.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 82.1% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-17T11:18:20.139 INFO:teuthology.orchestra.run.trial157.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 82.1% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-17T11:18:20.141 INFO:teuthology.orchestra.run.trial162.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 81.9% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-17T11:18:20.143 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-17T11:18:20.159 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-17T11:18:20.159 DEBUG:teuthology.orchestra.run.trial049:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-17T11:18:20.200 DEBUG:teuthology.orchestra.run.trial097:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-17T11:18:20.227 DEBUG:teuthology.orchestra.run.trial157:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-17T11:18:20.252 DEBUG:teuthology.orchestra.run.trial162:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-17T11:18:20.278 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-17T11:18:20.295 DEBUG:teuthology.orchestra.run.trial049:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-17T11:18:20.298 DEBUG:teuthology.orchestra.run.trial097:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-17T11:18:20.301 DEBUG:teuthology.orchestra.run.trial157:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-17T11:18:20.303 DEBUG:teuthology.orchestra.run.trial162:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-17T11:18:20.320 INFO:teuthology.orchestra.run.trial049.stdout:kernel.core_pattern = core 2026-02-17T11:18:20.323 INFO:teuthology.orchestra.run.trial097.stdout:kernel.core_pattern = core 2026-02-17T11:18:20.325 INFO:teuthology.orchestra.run.trial157.stdout:kernel.core_pattern = core 2026-02-17T11:18:20.342 INFO:teuthology.orchestra.run.trial162.stdout:kernel.core_pattern = core 2026-02-17T11:18:20.355 DEBUG:teuthology.orchestra.run.trial049:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-17T11:18:20.394 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T11:18:20.395 DEBUG:teuthology.orchestra.run.trial097:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-17T11:18:20.412 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T11:18:20.412 DEBUG:teuthology.orchestra.run.trial157:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-17T11:18:20.429 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T11:18:20.429 DEBUG:teuthology.orchestra.run.trial162:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-17T11:18:20.446 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T11:18:20.447 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-17T11:18:20.465 INFO:teuthology.task.internal:Transferring archived files... 2026-02-17T11:18:20.465 DEBUG:teuthology.misc:Transferring archived files from trial049:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51248/remote/trial049 2026-02-17T11:18:20.465 DEBUG:teuthology.orchestra.run.trial049:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-17T11:18:20.506 DEBUG:teuthology.misc:Transferring archived files from trial097:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51248/remote/trial097 2026-02-17T11:18:20.506 DEBUG:teuthology.orchestra.run.trial097:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-17T11:18:20.537 DEBUG:teuthology.misc:Transferring archived files from trial157:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51248/remote/trial157 2026-02-17T11:18:20.537 DEBUG:teuthology.orchestra.run.trial157:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-17T11:18:20.577 DEBUG:teuthology.misc:Transferring archived files from trial162:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51248/remote/trial162 2026-02-17T11:18:20.578 DEBUG:teuthology.orchestra.run.trial162:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-17T11:18:20.614 INFO:teuthology.task.internal:Removing archive directory... 2026-02-17T11:18:20.614 DEBUG:teuthology.orchestra.run.trial049:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-17T11:18:20.617 DEBUG:teuthology.orchestra.run.trial097:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-17T11:18:20.620 DEBUG:teuthology.orchestra.run.trial157:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-17T11:18:20.622 DEBUG:teuthology.orchestra.run.trial162:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-17T11:18:20.662 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-17T11:18:20.676 INFO:teuthology.task.internal:Not uploading archives. 2026-02-17T11:18:20.677 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-17T11:18:20.692 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-17T11:18:20.692 DEBUG:teuthology.orchestra.run.trial049:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-17T11:18:20.694 DEBUG:teuthology.orchestra.run.trial097:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-17T11:18:20.697 DEBUG:teuthology.orchestra.run.trial157:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-17T11:18:20.698 DEBUG:teuthology.orchestra.run.trial162:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-17T11:18:20.707 INFO:teuthology.orchestra.run.trial049.stdout: 786525 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 17 11:18 /home/ubuntu/cephtest 2026-02-17T11:18:20.712 INFO:teuthology.orchestra.run.trial097.stdout: 791885 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 17 11:18 /home/ubuntu/cephtest 2026-02-17T11:18:20.712 INFO:teuthology.orchestra.run.trial157.stdout: 786525 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 17 11:18 /home/ubuntu/cephtest 2026-02-17T11:18:20.721 INFO:teuthology.orchestra.run.trial162.stdout: 791885 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 17 11:18 /home/ubuntu/cephtest 2026-02-17T11:18:20.721 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-17T11:18:20.732 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-17T11:18:20.764 INFO:teuthology.run:Summary data: description: rados/verify/{centos_latest ceph clusters/fixed-4 d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} duration: 1200.0938487052917 failure_reason: '"2026-02-17T11:10:21.169138+0000 mon.a (mon.0) 171 : cluster [WRN] Health check failed: 6 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT)" in cluster log' flavor: default owner: scheduled_skanta@soko04.front.sepia.ceph.com sentry_event: null status: fail success: false 2026-02-17T11:18:20.764 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T11:18:20.868 INFO:teuthology.run:FAIL